Google Enhances Android and Chrome with New AI and Accessibility Features

Google has recently announced a suite of new AI-driven accessibility features for both Android and Chrome, designed to improve the user experience for individuals with disabilities. These updates focus on leveraging AI to provide more intuitive and comprehensive assistance.

One of the most significant updates is to TalkBack, Android’s built-in screen reader. TalkBack now integrates Gemini’s AI capabilities, allowing users to ask questions about images and screen content. This builds upon last year’s introduction of AI-generated image descriptions, extending functionality to enable a more interactive experience.

For instance, a user can now ask Gemini about the details of a photo received from a friend, such as the brand and color of a guitar. Similarly, when shopping within an app, users can inquire about the material of an item or any available discounts directly through Gemini, enhancing the accessibility of e-commerce platforms.

Gemini and Talkback AI feature — **Image Credits:**Google

Expressive Captions, another Android feature providing real-time captions, has also been updated. Recognizing the importance of vocal tone and emphasis, Google has introduced a new duration feature. This allows the captioning to reflect how words are spoken, differentiating between a simple “no” and a drawn-out “nooooo.” The update also includes new labels for sounds like whistling or throat clearing, providing a richer context.

Expressive Captions AI feature — **Image Credits:**Google

The Expressive Captions update is currently rolling out in English across the U.S., U.K., Canada, and Australia, specifically for devices running Android 15 and above.

Chrome is also receiving accessibility enhancements. The browser can now automatically recognize scanned PDFs, enabling users to highlight, copy, search, and use screen readers with these documents. This functionality is powered by Optical Character Recognition (OCR) technology.

Furthermore, Page Zoom on Chrome for Android now allows users to increase text size without disrupting the webpage layout. This feature can be accessed via the three-dot menu in the top-right corner of Chrome, and users can apply zoom preferences to all or selected pages.

These updates from Google demonstrate a continued commitment to leveraging AI to create a more accessible and inclusive digital environment for all users.