Apple has unveiled a significant expansion of its accessibility suite, integrating Apple Intelligence to provide more intuitive and responsive tools for users with disabilities. By leveraging on-device processing, the company is aiming to enhance core features—including VoiceOver, Magnifier, and Voice Control—to offer more detailed, natural language-based interactions. These updates, slated for release later this year, represent a strategic shift in how the company utilizes generative models to bridge gaps in digital accessibility.
The new suite of accessibility features and updates powered by Apple Intelligence focuses on reducing the technical barriers often associated with navigating complex digital interfaces. For users who are blind or have low vision, the integration of Apple Intelligence into VoiceOver and Magnifier is designed to provide richer context for visual information, from scanned documents to surroundings captured via the camera. According to Apple, this approach maintains a strict focus on privacy by design, ensuring that sensitive visual data is processed locally on the device.
“Apple’s approach to accessibility is unlike any other,” said Tim Cook, Apple’s CEO. “Now, with Apple Intelligence, we are bringing powerful new capabilities into our accessibility features while maintaining our foundational commitment to privacy by design.”
Enhancing Navigation and Visual Recognition
The update to VoiceOver introduces the Image Explorer, which uses on-device intelligence to provide detailed descriptions of images systemwide. This includes identifying content in photographs, personal records, and even scanned bills. Live Recognition is being enhanced through the iPhone Action button; users can now trigger the camera to identify objects in the viewfinder and ask follow-up questions in their own words to gain a deeper understanding of their environment.
Magnifier is also receiving a performance boost, bringing similar high-contrast exploration tools to users with low vision. The app will soon support voice-driven commands, allowing users to adjust settings like zoom levels or flashlight status through simple, spoken requests. These enhancements are intended to make the iPhone a more versatile tool for daily tasks, though the company notes these tools should not be relied upon in high-risk situations or for the diagnosis of medical conditions.
Natural Language and Accessible Reading
One of the most anticipated changes is the evolution of Voice Control. By utilizing natural language processing, the feature will allow users to navigate apps like Maps or Files without needing to memorize specific labels or numerical tags. Instead, users can use phrases such as “tap the purple folder” or “tap the guide about best restaurants.” This “say what you see” functionality is aimed at overcoming barriers in apps where interface elements may not be properly labeled for screen readers.
Simultaneously, Accessibility Reader is becoming more robust. It is being updated to handle complex layouts, including scientific articles that feature multiple columns, tables, and images. The tool will now offer on-demand summaries, helping users get an overview of dense material before diving into the specifics. Built-in translation services will also allow users to read content in their native language while maintaining custom formatting, fonts, and color preferences.
Expanding Hardware and Software Support
Beyond software, Apple is expanding its hardware ecosystem to support a wider range of physical needs. A new feature for Apple Vision Pro will allow users to control compatible power wheelchairs—specifically those from Tolt and LUCI—using eye-tracking technology. This provides an alternative input method for individuals who cannot operate standard joysticks, and the system is engineered to work across various lighting conditions without requiring frequent recalibration.
“The option to control my power wheelchair on my own is gold to me,” said Pat Dolan, founder of GeoALS and a member of Team Gleason’s patient advisory board, who has lived with ALS for 10 years. “With this new feature, Apple is developing life-enhancing technology for the people who need it most.”
In addition to these core updates, Apple announced several other accessibility-focused additions, including:
- Vehicle Motion Cues for visionOS: Designed to help reduce motion sickness for passengers in moving vehicles.
- Generated Subtitles: Automatically transcribes spoken audio for personal videos and media across the Apple ecosystem when existing captions are unavailable.
- Sony Access Controller Support: Users can now connect the Sony Access controller to iOS, iPadOS, and macOS, allowing for personalized game controller layouts.
- Name Recognition: A feature for users who are deaf or hard of hearing to be notified when their name is spoken, now supporting more than 50 languages.
Adaptive Accessories and Community Collaboration
Apple is also expanding the availability of the Hikawa Grip & Stand for iPhone. Developed by Los Angeles-based designer Bailey Hikawa in collaboration with disability communities, the MagSafe accessory is designed to assist users with varying levels of grip strength and mobility. Starting today, the accessory is available globally in three new colors via the Apple Store online. To mark the release, Apple The Grove in Los Angeles is scheduled to host a session on May 20 featuring Hikawa, author Shane Burcaw, and actor Alex Barone to discuss the role of the iPhone as a pivotal assistive technology.
As these features move toward their public rollout, users can find specific documentation and support requirements at the official Apple support website. These updates build on the company’s existing accessibility framework, which continues to evolve as new AI-driven capabilities become available. The next major checkpoint for these features will be their integration into the upcoming software releases scheduled for later this year.
Disclaimer: VoiceOver and Magnifier should not be relied upon in circumstances where one could be harmed or injured, in high-risk situations, for navigation, or for the diagnosis or treatment of any medical condition.
We invite you to share your thoughts on these upcoming accessibility tools in the comments below.
