You no longer have to select text or keep a mini-app running to translate text in your Android apps. Google is expanding Android Marshmallow’s Now on Tap feature to support text translation from any screen. If you’re looking at text that doesn’t match your phone’s current language, Now on Tap will offer to translate that screen even if there are multiple unfamiliar tongues on screen. It’s available today if your phone is set to use either a major European language or Russian… and it’s not the only feature rolling out today.
Now on Tap is also getting a Discover button that will show a visual feed of content related to what you’re looking at — say, articles on Jupiter. And if you use the feature’s camera-based image searching, you’ll be glad to hear that it now recognizes barcodes and QR codes. You just have to fire up the camera to find out whether or not that book or movie is worth buying. All told, Now on Tap is getting bread-and-butter features that you might just use on a frequent basis.
Today, Google is adding three new features to Now on Tap that should make the service even more useful and smarter.
The first of these new features allows you to easily translate text from any application. Chrome has long featured a built-in translation feature, but that’s obviously not available in other native apps. Now on Tap now makes this same technology available for virtually any application on your device. Simply press and hold the home button and select the new “translate this screen” options and the text will be translated into the phone’s default language. Google says Translate in Now on Tap will also be able to recognize multiple languages on your screen and translate them accordingly. This new feature is available for translations into English, French, Italian, German, Spanish, Portuguese and Russian.
The updated Now on Tap now also features a ‘Discover’ section, which highlights related stories and videos. These related stories will show in a new “related news for [topic x]” section in the Now on Tap pop-up and in my unscientific tests, this generally worked pretty well.
The third new feature involves using Now on Tap while you are using your camera. With this update, you can now point your camera at any bar code or QR code, press and hold the home button, and Now on Tap will automatically recognize it and show you related information. I tried this with a book and Google quickly pulled up info about the publishers, the book, and its author. Similarly, scanning the code on a bar of chocolate quickly brought up the name of the product. What’s sadly missing in the interface is a quick way to order the product. Instead, Google offers you to do a Google search for it, which then inevitably leads you to Amazon or the manufacturer’s website. Google says this feature will work with packaged products, books, DVDs and more.
None of these updates, though, solve one of Now on Tap’s main problems: if you don’t know it exists, it’s very unlikely that you will ever find it unless you accidentally press and hold the home button. That’s a shame, because it’s a really useful feature once you know it exists.