To blind traveling bluesman Joshua Pearson, songwriting is more than just a good melody. “Songwriting gave me a language to talk about my frustrations. And by putting my music out there, I could hopefully let somebody else feel some of what I was feeling.” For Joshua, TalkBack is his main pen and paper for writing songs; it lets him dictate lyrics into his phone and hear them told back to him.

Screen readers, such as Android’s TalkBack, are the primary interface through which Joshua and many other people who are blind or low vision read, write, send emails, share social media, order delivery and even write music. TalkBack speaks the screen aloud, navigates through apps, and facilitates communication with braille, voice and keyboard input. And today we’re releasing an all-new version of TalkBack that includes some of the most highly requested features from the blind and low vision community.

Tap as you please with multi-finger gestures

We’ve added a dozen easy-to-learn and easy-to-use multi-finger gestures that are available with the latest version of TalkBack on Pixel and ​Samsung Galaxy devices from One UI 3 onwards. These gestures make it easier for you to interact with apps and let you perform common actions, such as selecting and editing text, controlling media and finding help. 

We worked closely with people in the blind and low vision community to develop these easy-to-remember gestures and make sure they felt natural. For example, instead of navigating through multiple menus and announcements to start or stop your favorite podcast, it's now as simple as double tapping the screen with two fingers. 

Read or skim with just a swipe

Reading and listening is easier with new controls that help you find the most relevant information. For instance, you can swipe right or left with three fingers to hear only the headlines, listen word-by-word or even character-by-character. And then with a single swipe up or down you can navigate through the text. 

Say what? There’s new Voice Commands 

Starting with TalkBack 9.1, you can now swipe up and right to use TalkBack’s new voice commands. TalkBack will stop talking and await your instructions. With over 25 different commands, you can say “find” to locate text on the screen or “increase speech rate” to make TalkBack speak more quickly. 

Do things your way with more customization and language options

While we put a lot of thought into this redesign, one thing we’ve learned from working with the community is that everyone interacts with their phones in their own way — which makes customization important. You can now add or remove options in the TalkBack menu or reading controls. Additionally, gestures can be assigned or reassigned to scores of settings, actions and navigation controls.

Lastly, we’re adding support for two new languages in TalkBack’s braille keyboard: Arabic and Spanish.

Joining forces for accessibility

The all-new TalkBack is the result of our collaboration with trusted testers and Samsung, who co-developed this release. ​TalkBack is now the default screen reader on all ​Samsung Galaxy devices from One UI 3 onwards, making it easier to enjoy a consistent and productive screen reader experience across even more devices.

To help everyone keep up with all the changes, we’ve created an entirely new tutorial to make it easier to make the most of TalkBack — there’s even a test pad to practice new gestures. With these new features and collaborations we hope that more people can find useful and creative ways to use TalkBack. Who knows, you might even find lyrical inspiration like Joshua. 

Over 150 years ago, the invention of braille was revolutionary in making reading and writing accessible to blind people. Today, braille displays make typing accessible on most phones and computers through a physical braille keyboard. But it can be time-consuming to connect an external device each time you want to type something quickly on your phone. 

TalkBack braille keyboard is a new virtual braille keyboard integrated directly into Android. It’s a fast, convenient way to type on your phone without any additional hardware, whether you’re posting on social media, responding to a text, or writing a brief email. As part of our mission to make the world’s information universally accessible, we hope this keyboard can broadly expand braille literacy and exposure among blind and low vision people. 

Our team collaborated with braille developers and users throughout the development of this feature, so it’ll be familiar to anyone who has typed using braille before. It uses a standard 6-key layout and each key represents one of 6 braille dots which, when tapped, make any letter or symbol. To type an “A” you would press dot 1 and to type a “B,”  dots 1 and 2 together. 

The keyboard can be used anywhere you would normally type and allows you to delete letters and words, add lines, and submit text. You can turn the keyboard on and off as simply as switching between international keyboards. (Note: TalkBack gestures are not supported when the keyboard is on.)

To use the braille keyboard, turn on TalkBack in the Accessibility section within Settings, and follow these instructions to set it up. Once you set up the keyboard, use three fingers to swipe up on your screen and try practicing with the gestures tutorial. 

Talkback braille keyboard is rolling out to Android devices running version 5.0 or later, starting today. It works across all apps on your Android device, supports braille grade 1 and grade 2 and is available initially in English. 

Over 150 years ago, the invention of braille was revolutionary in making reading and writing accessible to blind people. Today, braille displays make typing accessible on most phones and computers through a physical braille keyboard. But it can be time-consuming to connect an external device each time you want to type something quickly on your phone. 

TalkBack braille keyboard is a new virtual braille keyboard integrated directly into Android. It’s a fast, convenient way to type on your phone without any additional hardware, whether you’re posting on social media, responding to a text, or writing a brief email. As part of our mission to make the world’s information universally accessible, we hope this keyboard can broadly expand braille literacy and exposure among blind and low vision people. 

Our team collaborated with braille developers and users throughout the development of this feature, so it’ll be familiar to anyone who has typed using braille before. It uses a standard 6-key layout and each key represents one of 6 braille dots which, when tapped, make any letter or symbol. To type an “A” you would press dot 1 and to type a “B,”  dots 1 and 2 together. 

The keyboard can be used anywhere you would normally type and allows you to delete letters and words, add lines, and submit text. You can turn the keyboard on and off as simply as switching between international keyboards. (Note: TalkBack gestures are not supported when the keyboard is on.)

To use the braille keyboard, turn on TalkBack in the Accessibility section within Settings, and follow these instructions to set it up. Once you set up the keyboard, use three fingers to swipe up on your screen and try practicing with the gestures tutorial. 

Talkback braille keyboard is rolling out to Android devices running version 6.0 or later, starting today. It works across all apps on your Android device, supports braille grade 1 and grade 2 and is available initially in English. 

A decade ago, we added automatic captions to videos on YouTube, making online videos more accessible. However, they’re not always available on other types of content—like audio messages from your friends, trending videos on social media feeds or even the stuff you record yourself. It’s hard to enjoy that content if you forgot your headphones and can’t play the audio out loud—or if you’re one of the 466 million people in the world who are Deaf or hard of hearing, that content may be entirely inaccessible. 

That’s why we created Live Caption, an automatic captioning system that is fast and small enough to fit on a smartphone. Live Caption is helpful whether you’re on a loud commuter train, trying not to wake a baby, or want to follow along the conversation more closely. 

With the launch of Pixel 4, Live Caption is now officially available to make digital media more accessible. With a single tap, Live Caption automatically captions videos and spoken audio on your device (except phone and video calls). It happens in real time and completely on-device, so it works even if you don’t have cell data or Wi-Fi, and the captions always stay private and never leave your phone. The captions won’t get in the way of whatever you’re looking at because you can position them anywhere on the screen. If you want to see more text, simply double tap to expand the caption box.

Live Caption wouldn’t have been possible without the Deaf and hard of hearing communities who helped guide us from the very beginning. Similar to how we designed Live Transcribe earlier this year, we developed Live Caption in collaboration with individuals from the community and partners like Gallaudet University, the world’s premier university for Deaf and hard of hearing people. An early Deaf tester, Naiajah Wilson, explained how Live Caption   would impact her daily life: “Now I don't have to wake up my mom or dad and ask what's being said.”

Today, Live Caption supports English with plans to support more languages in the near future. And while the captions may not always be perfect as it depends on the quality of the sound, we’ll continue to improve the technology over time. 

In addition to Pixel 4, Live Caption will roll out to Pixel 3, Pixel 3 XL, Pixel 3a and Pixel 3a XL later this year, and we’re working closely with other Android phone manufacturers to make it more widely available in the coming year. 

You can learn more about our broader commitment to build for everyone on our new Android Accessibility site.