A big update is SignTime, which allows customers communicate with AppleCare and Retail Customer Care using American Sign Language in the US, British Sign Language in the UK, or French Sign Language in France, right in their web browsers. Though it will first launch in the US, the UK and France, it will expand to other countries in the future. People will be able to use the service in Apple stores to get interpretation without booking it in advance.
Another helpful feature coming this year is AssistiveTouch, which will help Apple Watch users with “upper body limb differences” to use WatchOS without having to touch the display or controls by using certain hand gestures, like clenching or pinching. The technology will also enable users to easily answer incoming calls, control an onscreen motion pointer and access the notification and control centres. The gestures take advantage of built-in motion sensors like the gyroscope and accelerometer, along with the optical heart rate sensor and on-device machine learning to detect subtle differences in muscle movement and tendon activity.
That’s not all. iPad users with low mobility will have more access to third-party eye-tracking devices, helping them to move a cursor with their gaze and perform actions by holding eye contact instead of tapping the screen.
VoiceOver, Apple’s built-in screen reader, also has received an update. Users will get more details in images. For example, users can navigate a photo of a receipt (like a table) by row and column, complete with table headers. VoiceOver can also describe a person’s position along with other objects within images.
New Memoji customisations better represent users with oxygen tubes, cochlear implants, and a soft helmet for headwear
Next, background sounds, which can be distracting and overwhelming. Apple is introducing Background Sounds that can be incorporated with other audio and system sounds, helping users focus, stay calm, or rest. Balanced, bright, or dark noise, as well as ocean, rain, or stream sounds continuously play in the background to mask unwanted environmental or external noise.
Other features Apple is planning for later in the year include more Memoji customisations to better represent users with oxygen tubes, cochlear implants, and a soft helmet for headwear.