Apple unveils new Apple Intelligence accessibility features across its devices

Ahead of Google’s annual I/O developer conference, Apple announced a broad range of new accessibility enhancements powered by Apple Intelligence across its ecosystem of devices. The updates expand the capabilities of features such as VoiceOver, Voice Control, Live Recognition, and real-time caption generation while also introducing new ways for users with disabilities to interact with Apple products.

Among the most notable additions is an enhanced version of VoiceOver that uses Apple Intelligence to provide more detailed image recognition and description capabilities. According to Apple, the upgraded feature will better understand image content and explain it with greater context and accuracy. For example, when a user points their device at a bill or invoice, VoiceOver can identify important information such as the amount due and payment deadline. Apple said the system can also generate richer descriptions of photographs, documents, and personal records, helping users gain a more complete understanding of visual content.

The company is also expanding the functionality of Live Recognition. Users can now use an iPhone camera to activate the feature, which identifies objects, text, and other content visible within the camera’s frame. In addition to recognising what appears on screen, users will be able to ask follow-up questions to obtain more information about the detected content. Apple said this conversational capability is intended to make the feature more useful and interactive for people with vision impairments.

For users with low vision, Apple is introducing additional accessibility options through the Magnifier app. The company said users will be able to assign Magnifier to the Action button on supported iPhone models, making it easier to access visual assistance tools quickly. The feature can present information using a high-contrast interface to improve readability and visibility. Users will also be able to operate Magnifier using voice commands such as “zoom in” or “turn on flashlight,” providing a more hands-free experience when navigating physical environments or reading printed materials.

Apple noted that its updated voice command functionality extends beyond the Magnifier app. The company is enabling users to interact with applications through more natural language instructions that describe what appears on the screen. Rather than relying on predefined commands, users can explain the action they want to perform. For example, while using Apple Maps, a user could say, “Tap the guide about best restaurants,” and the system would identify and select the appropriate item. Similarly, in the Files app, users could issue commands such as “Tap the purple folder” to navigate content more easily.

The company is also updating Reader, its feature designed to make written content more accessible and easier to consume. Apple said the new version of Reader will be capable of handling more complex document layouts, including scientific papers and other materials that contain multiple columns, embedded images, and detailed tables. The update aims to improve readability for users who frequently interact with academic, technical, or professional documents.

In addition to improved document support, Reader will offer AI-powered summaries to help users quickly understand key information in lengthy texts. Users will also be able to read content in its original language while preserving custom fonts, colours, and formatting. Apple stated that the enhanced Reader experience is designed to better support users with a variety of accessibility needs, including dyslexia and low vision.

Another major announcement involves automatic subtitle generation for videos that do not already include captions. Apple is introducing AI-generated subtitles that can create captions for content recorded directly on an iPhone, as well as for videos from friends and family. The feature is intended to improve accessibility for users who are deaf or hard of hearing while also providing greater flexibility when consuming multimedia content.

The generated subtitles will be available across multiple Apple platforms, including iPhone, iPad, Mac, Apple TV, and Apple Vision Pro. Users will also be able to customise the appearance of captions to suit their preferences and accessibility needs.

Apple also announced a new initiative to improve accessibility for wheelchair users with Vision Pro. Under the new system, users wearing the headset will be able to control compatible wheelchairs using eye-tracking technology. According to Apple, the feature is designed to function reliably under different lighting conditions without requiring repeated recalibration. The company stated that the technology is intended to provide a more seamless and intuitive method of wheelchair control for supported systems.

At launch, the capability will be compatible with Tolt and LUCI alternative drive systems in the United States. Apple said support will be available through both Bluetooth and wired accessory connections, giving users flexibility in how they connect and control their mobility devices.

The company also announced improvements to its name-recognition feature, which helps users with hearing disabilities by notifying them when someone says their name. Apple said the feature now supports 50 languages, significantly expanding its usefulness for users around the world.

Additional accessibility enhancements are coming to Apple’s television platform as well. The company confirmed that tvOS will receive support for larger text, making content easier to read for users with visual impairments or those who prefer larger interface elements. Apple also said that Made for iPhone hearing aids will provide improved handoff functionality between Apple devices, creating a smoother experience when switching between products within the company’s ecosystem.

According to Apple, all of these accessibility features are scheduled to become available later this year. The updates are expected to arrive with the company’s next major software release, which is anticipated to include the latest generation of iOS and related operating system updates across Apple’s product lineup.

By combining Apple Intelligence with accessibility-focused innovations, the company is expanding how users interact with devices, consume information, and navigate digital and physical environments, while supporting a broader range of accessibility needs across its ecosystem.