Apple wires Apple Intelligence into VoiceOver, Magnifier, and Voice Control
Apple previewed a round of accessibility updates that lean heavily on its on-device Apple Intelligence models. VoiceOver’s Image Explorer and Live Recognition will generate richer descriptions of photos, documents, and camera scenes, with follow-up questions handled in natural language. Magnifier gains the same descriptive layer in a high-contrast UI, and Voice Control drops the requirement to memorize exact button labels — users can say things like ‘tap the purple folder’ and have the system resolve the target, which also patches around apps with poorly labeled controls.
Accessibility Reader now handles multi-column scientific layouts, offers on-demand summaries, and translates while preserving custom typography. On-device speech recognition will auto-generate subtitles for uncaptioned video across iPhone, iPad, Mac, Apple TV, and Vision Pro. Vision Pro’s eye tracking is being extended to drive compatible power wheelchairs from Tolt and LUCI in the US, aimed at users for whom joystick control isn’t viable.
Throughout, Apple emphasizes that the new AI-driven features run on-device, framing the rollout as a privacy-preserving alternative to cloud-based assistive AI. The features ship later this year; the Hikawa adaptive MagSafe grip becomes globally available today via a PopSockets collaboration.
Read the full article
Continue reading at Hacker News →This is an AI-generated summary. Read the original for the full story.