How to use your phones camera to translate anything – Engadget

If you’re a frequent traveler, you may frequently encounter signage or other text in foreign languages. That’s all well and good if you have enough knowledge to piece together a translation, but if you can’t even understand the alphabet in question, you’re faced with a much bigger challenge.

The good news is that your phone’s camera can recognize and translate just about any text in seconds, even if the language uses an entirely different script. While a translation app may seem like the obvious choice for this task, it’s actually not always your best bet. Depending on the languages involved and the context, you may sometimes need more than one tool. Luckily, your phone’s camera is all you need to translate pretty much anything in the real world.

For over a decade now, the Google Translate app has offered a dedicated camera mode. Simply install the app from the Google Play Store on Android or theApp Store on iOS, open it, and tap the Camera icon located at the bottom of your screen. This will open up a viewfinder, allowing you to point your phone’s camera at anything in the real world.

You can select any two of Google Translate’s hundreds of languages for the translation. The default “Detect language” option in the source field is handy if you’ve come across a language you cannot identify. The app translates text in real time, so you don’t even need to capture an image. You may also want todownload frequently-used languages within Google Translate. This allows you to translate text offline — handy if you’re preparing for an upcoming trip.

You can also use Google Lens on Android, which many phones include out of the box these days. This eliminates the need for a dedicated translation app. On Google Pixel phones, Lens is available as a shortcut within the search bar on the home screen. Otherwise, you can find it as an icon in the app drawer. Recent iOS versions also have a translation feature baked into the camera app through the Live Text feature. To access it, open the Camera app on your iPhone and point the device at any text you come across. You should see a yellow frame appear around the text and a grid icon towards the bottom of the viewfinder. Tap this icon and select Translate.

While Google Translate has served me well, it can fall short of expectations. While traveling in Vietnam, for instance, I found that the app struggled to identify diacritics in printed text through my phone’s camera. This was a major problem because a word can have two completely different meanings depending on whether the letters have the correct diacritics. In my experience, another area where Google Translate stumbles is restaurant menus. Menus often use informal shorthand or a single word, meaning the app may lack enough context for an accurate translation.

The solution I’ve found is to translate via an AI app. These apps often cannot translate in real time and require an internet connection, but I’ve found that the output quality is far and away better than Google Translate.Modern AI models understand context, so sending a picture of a menu will typically yield food-related translations. Even if your image is blurry or difficult to read, the AI model often understands the intended meaning based on the surrounding text instead of replying with gibberish.

You can use any AI app such as ChatGPT, Gemini, and Claude. You’ll need to uploada picture of the text you need translated and type a short instruction, such as “Translate to English,” before sending the message. The AI will reply with the translated text, but cannot overlay the translation over your image as Google Translate does. The other downside to this method is that it’s much more expensive — ChatGPT’s free tier limits you to a few image uploads every day, and even then, processing can take a few seconds. Still, I often use it as a last resort whenever traditional translation methods fail me.