4
Door detection, subtitles, extended gestures for Apple Watch… Apple is full of new features related to accessibility for its flagship products. Currently reserved for a limited audience, these options will be deployed by the end of 2022.
On the occasion of World Accessibility Awareness Day, Apple introduced new features on Tuesday, May 17 ad hoc for its flagship products. Are concerned the iPhone, the iPad, the Mac and the Apple Watch. These features will first be available in English and in beta, before a massive rollout by the end of the year.
Subtitles for the hearing impaired
Among the most interesting innovations, we find, for example, the display of live subtitles, capable of transcribing any audio content, whether FaceTime calls, calls from videoconferencing applications, or streaming videos and IRL conversations. A function already known in the world of Android, notably available on the latest batch of Pixel smartphones.
“Users can also adjust the font size for easier readingsays Apple. Live captioning in FaceTime assigns auto-transcribed dialogue to call participants […] When live captions are used for calls on Mac, users have the option to type in a response and have it spoken aloud in real time to others in the conversation. And because live captions are generated on the device, user information remains private and secure”.
Apple will also improve the sound recognition launched with iOS 14. The function can pick up specific sounds, such as a smoke alarm, and alert users who may be deaf or hard of hearing. Soon, users will be able to customize sounds by recording them themselves from the phone. It will thus be possible to be alerted if the telephone recognizes the doorbell or the end of the oven timer.
Door Detection for the blind and visually impaired
Apple is also introducing Door Detection, a navigation feature for the blind or visually impaired. It promises to help them locate a door when they arrive at a new destination, understand how far they are from it, and also describe the door’s attributes, including whether it’s open or closed. And when it’s closed, if it can be opened by pushing it, turning a knob or pulling a handle. This new feature leverages on-device LiDAR, camera and machine learning, and will be available on iPhone and iPad models with the LiDAR scanner.
Finally, some other new features are in the game. For the visually impaired, we note for example the addition of parameters and languages to VoiceOver, the tool that displays a screen reader controlled by gestures. Users will also be able to choose from dozens of new voices optimized for assistance functions in all languages. These new locales, languages, and voices will also be available for the Speak Selection and Speak Screen accessibility features. Additionally, VoiceOver users on Mac will be able to use the new text proofing tool and discover common display issues, such as unsightly double spaces or misplaced capitals, making it even easier to proofread documents or emails.
Options for physical and motor accessibility
The Apple Watch could become easier to use for people with physical and motor disabilities thanks to a new mirroring feature that will add remote control from a paired iPhone. Apple Watch Mirroring includes technology taken from AirPlay, which promotes access to the watch’s unique features without specifically relying on the ability to tap on its tiny screen or what voice commands can activate. Users will be able to control the Apple Watch using iPhone assist features like Voice Control and Switch Control, and take advantage of inputs like voice commands, sound actions, or head tracking.
The Apple Watch will expand the Assistive Touch gesture recognition controls the brand added last year with quick actions such as double pinch to end a call, dismiss notifications, take a photo, pause/ play media or start a workout.
Finally, Apple mentions a function called Buddy Controller, allowing an assistant (caregiver, for example) or a friend to help the user play a game by combining two controllers into one. With Siri Pause Time, users with speech impairments will also be able to adjust how long Siri waits before responding to a request.