It's not just Google who can use AI and machine learning to deliver impressive accessibility features, with Apple also showcasing an impressive set of must-see features you'll engage with below, while also clearly pointing to the kinds of smarts that future Apple AR glasses and the future Apple Car to come will feature, in even more refined form.

It's rare for Apple to preview something outside of its Worldwide Developer Conference event, or its keynote launches for new iPhones and Macs, but it does happen, and Apple has now previewed software features coming later this year which offer users with disabilities new tools for navigation, health, communication and more.

While some might think this announcement is in some way a response to things Google showcased in its must-watch Google I/O 2022 keynote https://io.google, Apple plans things well in advance, and has no doubt been working on these features and capabilities for, presumably, years.

Apple says its innovative software features preview introduces new ways for users with disabilities to navigate, connect and get the most out of Apple products.

We're told these powerful updates "combine the company’s latest technologies to deliver unique and customisable tools for users, and build on Apple’s long-standing commitment to making products that work for everyone."

Here's what Apple said at its Newsroom release in full:

Using advancements across hardware, software and machine learning, people who are blind or low vision can use their iPhone and iPad to navigate the last metre to their destination with Door Detection; users with physical and motor disabilities who may rely on assistive features like Voice Control and Switch Control can fully control Apple Watch from their iPhone with Apple Watch Mirroring; and the Deaf and hard of hearing community can follow Live Captions on iPhone, iPad and Mac.

Apple is also expanding support for its industry-leading screen reader VoiceOver with over 20 new languages and locales. These features will be available later this year with software updates across Apple platforms.

“Apple embeds accessibility into every aspect of our work, and we are committed to designing the best products and services for everyone,” said Sarah Herrlinger, Apple’s senior director of Accessibility Policy and Initiatives. “We’re excited to introduce these new features, which combine innovation and creativity from teams across Apple to give users more options to use our products in ways that best suit their needs and lives.”

Door Detection for Users Who Are Blind or Low Vision

Apple is introducing Door Detection, a cutting-edge navigation feature for users who are blind or low vision. Door Detection can help users locate a door upon arriving at a new destination, understand how far they are from it and describe door attributes — including if it is open or closed, and when it’s closed, whether it can be opened by pushing, turning a knob or pulling a handle. Door Detection can also read signs and symbols around the door, like the room number at an office, or the presence of an accessible entrance symbol. This new feature combines the power of LiDAR, camera and on-device machine learning, and will be available on iPhone and iPad models with the LiDAR Scanner.

Door Detection will be available in a new Detection Mode within Magnifier, Apple’s built-in app supporting blind and low vision users. Door Detection, along with People Detection and Image Descriptions, can each be used alone or simultaneously in Detection Mode, offering users with vision disabilities a go-to place with customisable tools to help navigate and access rich descriptions of their surroundings. In addition to navigation tools within Magnifier, Apple Maps will offer sound and haptics feedback for VoiceOver users to identify the starting point for walking directions.

Door Detection is a powerful feature for users who are blind or low vision to navigate the last few feet to their destination. Note: Door Detection and People Detection features in Magnifier require the LiDAR Scanner on iPhone 13 Pro, iPhone 13 Pro Max, iPhone 12 Pro, iPhone 12 Pro Max, iPad Pro 11-inch (2nd and 3rd generation) and iPad Pro 12.9-inch (4th and 5th generation). Door Detection should not be relied upon in circumstances where a user may be harmed or injured, or in high-risk or emergency situations.

Advancing Physical and Motor Accessibility for Apple Watch

Apple Watch becomes more accessible than ever for people with physical and motor disabilities with Apple Watch Mirroring, which helps users control Apple Watch remotely from their paired iPhone. With Apple Watch Mirroring, users can control Apple Watch using iPhone’s assistive features like Voice Control and Switch Control, and use inputs including voice commands, sound actions, head tracking or external Made for iPhone switches as alternatives to tapping the Apple Watch display. Apple Watch Mirroring uses hardware and software integration, including advances built on AirPlay, to help ensure users who rely on these mobility features can benefit from unique Apple Watch apps like Blood Oxygen, Heart Rate, Mindfulness and more.

Plus, users can do even more with simple hand gestures to control Apple Watch. With new Quick Actions on Apple Watch, a double-pinch gesture can answer or end a phone call, dismiss a notification, take a photo, play or pause media in the Now Playing app, and start, pause or resume a workout. This builds on the innovative technology used in AssistiveTouch on Apple Watch, which gives users with upper body limb differences the option to control Apple Watch with gestures like a pinch or a clench without having to tap the display.

Note: Apple Watch Mirroring is available on Apple Watch Series 6 and later.

Live Captions Come to iPhone, iPad and Mac for Deaf and Hard of Hearing Users

For the Deaf and hard of hearing community, Apple is introducing Live Captions on iPhone, iPad and Mac. Users in the US and Canada can follow along more easily with any audio content — whether they are on a phone or FaceTime call, using a video conferencing or social media app, streaming media content or having a conversation with someone next to them. Users can also adjust font size for ease of reading. Live Captions in FaceTime attribute auto-transcribed dialogue to call participants, so group video calls become even more convenient for users with hearing disabilities. When Live Captions are used for calls on Mac, users have the option to type a response and have it spoken aloud in real time to others who are part of the conversation. And because Live Captions are generated on device, user information stays private and secure. 

Note: Live Captions on iPhone, iPad, and Mac make it easier to follow along with any audio content. Live Captions will be available in beta later this year in English (US, Canada) on iPhone 11 and later, iPad models with A12 Bionic and later, and Macs with Apple silicon. Accuracy of Live Captions may vary and should not be relied upon in high-risk situations.

VoiceOver Adds New Languages and More

VoiceOver, Apple’s industry-leading screen reader for blind and low vision users, is adding support for more than 20 additional locales and languages, including Bengali, Bulgarian, Catalan, Ukrainian and Vietnamese. Users can also select from dozens of new voices that are optimised for assistive features across languages. These new languages, locales and voices will also be available for Speak Selection and Speak Screen accessibility features. Additionally, VoiceOver users on Mac can use the new Text Checker tool to discover common formatting issues such as duplicative spaces or misplaced capital letters, which makes proofreading documents or emails even easier.

VoiceOver, Speak Selection and Speak Screen will add support for Arabic (World), Basque, Bengali (India), Bhojpuri (India), Bulgarian, Catalan, Croatian, Farsi, French (Belgium), Galician, Kannada, Malay, Mandarin (Liaoning, Shaanxi, Sichuan), Marathi, Shanghainese (China), Spanish (Chile), Slovenian, Tamil, Telugu, Ukrainian, Valencian and Vietnamese.

Celebrating Global Accessibility Awareness Day

This week, Apple is celebrating Global Accessibility Awareness Day with special sessions, curated collections and more:

PROMOTE YOUR WEBINAR ON ITWIRE It's all about Webinars. Marketing budgets are now focused on Webinars combined with Lead Generation. If you wish to promote a Webinar we recommend at least a 3 to 4 week campaign prior to your event. The iTWire campaign will include extensive adverts on our News Site itwire.com and prominent Newsletter promotion https://itwire.com/itwire-update.html and Promotional News & Editorial. Plus a video interview of the key speaker on iTWire TV https://www.youtube.com/c/iTWireTV/videos which will be used in Promotional Posts on the iTWire Home Page. Now we are coming out of Lockdown iTWire will be focussed to assisting with your webinars and campaigns and assistance via part payments and extended terms, a Webinar Business Booster Pack and other supportive programs. We can also create your adverts and written content plus coordinate your video interview. We look forward to discussing your campaign goals with you. Please click the button below. MORE INFO HERE!

Alex Zaharov-Reutt is iTWire's Technology Editor is one of Australia’s best-known technology journalists and consumer tech experts, Alex has appeared in his capacity as technology expert on all of Australia’s free-to-air and pay TV networks on all the major news and current affairs programs, on commercial and public radio, and technology, lifestyle and reality TV shows. Visit Alex at Twitter here.

Linux is becoming worse than Windows. :-(

I have. https://itwire.com/opin...

Instead of complaining about it, do something - use Linux, or better still, a Mac. Microsoft is dead to me,[…]

While flowcharts might be of help to management at a high level, they are of little use in programming (which[…]

On Trustpilot (https://www.trustpilot.com/..., 88% of TomTom users are blown away by how bad TomTom Service is. Comments range from TomTom[…]