Apple Building In-House Visual AI Models for Camera AirPods and Smart Glasses

Apple is accelerating development of its own in-house visual AI models to power a new generation of camera-equipped wearables, as it works to reduce reliance on third-party partners for a feature that will be central to its next wave of hardware.



From Bloomberg's Weekend Forecast, Apple is developing three new wearable devices: smart glasses, a screenless pendant, and camera-equipped AirPods. Each would incorporate computer-vision camera systems designed to enable what Apple calls Visual Intelligence — AI that uses images of a user's surroundings to provide context for actions.


Potential use cases include analyzing the ingredients in a meal, extracting dates and times from printed flyers, triggering reminders based on what the device sees, and enhancing turn-by-turn directions with real-world context. Apple already offers a limited version of this feature on newer iPhones, where visual analysis currently relies on OpenAI's ChatGPT for scene understanding and Google's reverse image search for object identification.

That reliance presents a long-term challenge. OpenAI and Google are both developing their own AI hardware, including smart glasses, making it unlikely they would indefinitely provide Apple access to their most advanced visual models. For a feature described as fundamental to Apple's next generation of devices, Apple will need proprietary visual models.

The report says the company is actively working on those in-house models. However, Apple's prior attempt at launching fully self-developed large language models under Apple Intelligence resulted in a staggered and underwhelming rollout. The company has since partnered more deeply with Google, including plans for a major Siri overhaul in iOS 27, and deeper integration of Google's Gemini models to power more advanced assistant capabilities.

Among the three wearables, AirPods with cameras are seen as having the broadest appeal. With AirPods already a major consumer product line, adding visual capabilities could extend their functionality without requiring users to adopt an entirely new device category.


For now, Apple's AI shortcomings have not materially impacted sales, with the company generating roughly $85 billion in iPhone revenue over the holiday quarter. But as Apple shifts toward AI-driven hardware, the success of its wearable strategy may increasingly depend on the strength of its own visual models.



[Concept]