Apple Unveils AI-Powered Accessibility Updates and Vision Pro Wheelchair Control

Apple has announced a major expansion of accessibility features across its device lineup, with new Apple Intelligence-powered tools coming to VoiceOver, Magnifier, Voice Control, and Accessibility Reader later this year. The updates also introduce a new Apple Vision Pro feature that lets users control compatible power wheelchairs using eye tracking, alongside on-device subtitle generation for uncaptioned videos.



For users who are blind or have low vision, VoiceOver and Magnifier are receiving substantial upgrades. The new Image Explorer utilizes Apple Intelligence to deliver highly detailed system-wide descriptions of visual content, from personal photographs to scanned bills and receipts. Updates to Live Recognition integrate directly with the Action button on supported iPhone models. This allows a user to point their camera at an object or scene, ask a question about what's in the viewfinder, and get a detailed audio response. Users can also ask follow-up questions to gather more specific visual context.



Magnifier benefits from similar generative exploration tools and now supports spoken requests, allowing users to simply say commands like "zoom in" or "turn on flashlight."



Navigation is also becoming significantly more intuitive through updates to Voice Control. Instead of forcing users to memorize exact button labels or grid numbers, the system now understands natural language descriptions of onscreen elements. A user navigating a complex or poorly labeled interface can simply say what they see, telling their device to "tap the guide about best restaurants" or "tap the purple folder." This flexible input method is designed to help users with physical disabilities navigate apps even when interface elements are not properly labeled for accessibility.



Apple is also enhancing the reading experience for those with dyslexia or low vision. Accessibility Reader has been updated to process highly complex source materials, easily managing scientific articles containing multiple columns, embedded images, and data tables. It can generate on-demand summaries so a reader can grasp the core concepts of an article before reading the full text. A new built-in translation tool allows users to read foreign text in their native language without losing the original custom formatting, fonts, or colors.



Media consumption receives a practical upgrade with the introduction of generated subtitles. While professional streaming content usually includes closed captioning, subtitles for spoken dialogue are rarely available in personal videos recorded on an iPhone, clips shared through social media, or other uncaptioned online videos. The new system uses on-device speech recognition to automatically transcribe spoken audio in these clips. Because processing happens locally on-device, subtitle generation remains private while delivering live text across the iPhone, iPad, Mac, Apple TV, and Vision Pro.



Beyond software, Apple is pushing the boundaries of its spatial computing hardware by allowing the Vision Pro to control power wheelchairs. Designed for users who cannot operate a traditional joystick, the feature leverages the headset's precision eye-tracking cameras as an alternative drive control. Apple notes that the system works reliably across different lighting conditions and does not require frequent recalibration. At launch, the capability will support Bluetooth and wired connections for Tolt and LUCI alternative drive systems in the United States, with plans to expand compatibility to additional manufacturers over time.



On the accessory front, Apple has partnered with designer Bailey Hikawa and PopSockets to release the Hikawa Grip & Stand for iPhone. Available now through the Apple Store, the adaptive MagSafe accessory was built in collaboration with disability communities to assist individuals with grip or mobility limitations. Apple also announced several smaller accessibility improvements across its platforms. Vision Pro is gaining Vehicle Motion Cues to help reduce motion sickness for passengers in moving vehicles, alongside new face gesture controls and additional eye-based interaction features. The Apple TV will support larger onscreen text, while users with physical motor limitations will be able to connect and customize Sony's Access controller for gaming on iPhone, iPad, and Mac.



Apple says the new accessibility features and Apple Intelligence integrations will roll out across supported devices later this year.