Earlier today, I reported that Google's Gemini AI model is now underpinning its new range of Pixel 9 smartphones. Well, as part of that expansion, Google has rolled out several AI-powered updates aimed at improving accessibility features on Pixel phones, particularly benefiting users with visual and auditory disabilities. Updates include enhancements to Guided Frame, Magnifier, and Live Transcribe.
Guided Frame: Smarter Photo Assist
The Guided Frame tool, designed to help visually impaired users take photos, now features advanced object recognition and improved face detection for group photos. Users can access it directly from the camera settings, receiving audio and haptic cues to correctly align their phones. Once perfectly positioned, the phone takes the photo automatically. The feature now also alerts users to poor lighting and offers enhanced focus in complicated scenes.
Magnifier App: Enhanced Search and Dual Views
The Magnifier app, which allows users to zoom in on text and objects, now includes AI-driven word search capabilities. The improvement helps quickly locate text in the environment, useful for tasks like finding flight information or reading menus. Picture-in-picture mode has been added, enabling both detailed and wide views simultaneously. Additionally, the front camera can now function as a mirror with Selfie Illumination. These upgrades are available on Pixel 5 and newer models, but not on the Pixel Fold series.
Live Transcribe and Live Caption: More Languages
Live Transcribe, which provides real-time transcription of spoken words and sounds, now supports a dual-screen setup for foldable phones like the Pixel 9 Pro Fold. This allows users to position their devices in tabletop mode, making it easier to follow conversations in meetings or social situations. Live Transcribe and Live Caption now support seven new languages: Korean, Polish, Portuguese, Russian, Chinese, Turkish, and Vietnamese. These languages can be accessed offline after downloading the required language packs, raising the total to 15 offline languages and over 120 online.
These updates coincide with the launch of the Pixel 9 series, highlighting Google's attempts to make its technology more inclusive. Past initiatives include Lookout for identifying objects and Sound Notifications for alerting users to important household sounds. Additionally, the Speech Accessibility Project aims to make voice recognition technology more versatile for a variety of speech patterns and disabilities.
