Door detection

When: Later this year

Platform: iOS

The LiDAR sensor on certain iPhones and iPads have been introduced in the last few years keeping a lot of features in mind, some of which were not available at the time of introduction. One such implementation has to do with the ‘door detection’ feature, which is clever use of technology. Coming as part of the magnifier app, the feature will help blind iPhone users know what’s around or where they are going. If there’s a door nearby, the app will audibly tell the user how far away it is, whether it’s open or closed and, if a clear view of the door is possible, specific details (numbers, text or if you need to turn a knob or push a bar to open it) get announced. To implement the feature, the LiDAR sensor on the iPhone 12 Pro, 12 Pro Max, 13 Pro and 13 Pro Max, besides iPad Pros from 2020 onwards, get used.

Live Captions

When: Available as beta for Apple products later this year and available for a few Android devices

Platform: iOS, ipadOS, macOS and Android

Some Android phones already allow the feature. Basically, it transcribes audio, which is helpful for the deaf and hard of hearing community. Apple’s Live Captions will appear on-screen for any audio the phone can play. Not just that, during group video calls on, say, FaceTime, transcriptions will be attributed to specific users to make it easy to follow the chat. Live Captions will get generated on device, so user information stays private and secure.

Apple Watch Mirroring

When: Later this year

Platform: iOS

Users with physical or motor disabilities can use Apple Watch Mirroring, which allows the Apple Watch to be controlled remotely from the pair iPhone. Using the phone’s assistive features, like Voice Control and Switch Control, one can use voice commands, sound actions and head tracking as alternatives to tapping the Apple Watch display. The feature uses hardware and software integration, including advances built on AirPlay, to help ensure users who rely on these mobility features can benefit from unique Apple Watch apps, like Blood Oxygen, Heart Rate, Mindfulness, and more.

Sound Recognition

When: Later this year for iOS and Google is yet to confirm a launch date

Platform: iOS and Android

Users who are deaf or hard of hearing can use their phones to receive visual alerts when important sounds — breaking glass, fire alarms or crying babies — are picked up by the phone. For Apple Sound Recognition can be customised to recognise sounds that are specific to a person’s environment, like their home’s unique alarm, doorbell, or appliances, like the microwave.

VoiceOver has new language support, including Bengali

When: Soon

Platform: iOS

Apple’s VoiceOver, which is a screen reader for blind and low vision users, is adding support for more than 20 additional locales and languages, including Bengali, Ukrainian, and Vietnamese. Users can also select from dozens of new voices that are optimised for assistive features across languages.