Google is rolling out brand new search technology in India, one of the search company’s largest markets, including bilingual search results and in-video search.

This week, Google hosted its eighth Google For India event, showcasing the following search features:

• search in the video
• Bilingual search results
• Bilingual voice search
• Natural language search in Google Pay
• Handwriting to text translation via Google Lens

These features could eventually make their way to North America, so they’re worth keeping on your radar.

Here is more information on the features listed above, which are being rolled out first in India.

Search in the video

Google allows you to search YouTube videos.

While watching a video on YouTube, tap Find in Video and type the topic in the video you want to jump to.

Having a hard time skipping to the good part of the video? ?
▶ ──?── 19:19
We’re testing the ability to search videos in your phone’s search app. Just enter your search query using the Find in Video feature and find exactly what you are looking for.#GoogleForIndia pic.twitter.com/G3KIhpO7ow

– Google India (@GoogleIndia) December 19, 2022

In a blog post, Google writes:

“Besides images, video is also a rich source of visual information, but it’s often difficult to find something hidden in a long clip. For example, you may be watching a long video about Agra and wondering if it also covers Fatehpur Sikri. With a new feature we’re currently testing, you can now search for anything mentioned in a video directly in Search. Simply enter a search term using the ‘search in video’ function and quickly find what you are looking for.”

Bilingual search results

Google makes search results in India bilingual, returning results in the user’s native language in addition to English results.

? Introducing an India-first ?? innovation that makes search results bilingual for people who prefer it that way.#GoogleForIndia pic.twitter.com/B4iCqeb6Zc

– Google India (@GoogleIndia) December 19, 2022

Google states in a blog post:

“Language needs in India are becoming more dynamic and multilingual and we are seeing this reflected in people’s search experiences as well. Notably, the majority of Google users in India use more than one language.

To make it easier for people who use more than one language to search and explore information, we are now making search results pages bilingual for people who prefer it that way.”

This functionality will be launched in Hindi and will be extended to other Indic languages ​​including Tamil, Telugu, Marathi and Bengali in the coming year.

Bilingual voice search

Google is improving speech recognition technology for Hinglish speakers, a mix of Hindi and English.

Searchers in India can do a voice search using Hindi and English in the same query, and Google can understand what they’re looking for.

If you search for “cheese kis cheez se banta hai”, voice search will better understand your Hinglish query – this way you’ll always get Gouda results ?#GoogleForIndia pic.twitter.com/f1vihmB9df

– Google India (@GoogleIndia) December 19, 2022

Google states in a blog post:

“We want to help more people, especially Indians, to ask questions naturally and intuitively with their voice. Today we’re announcing a new speech recognition model that can better understand people who speak Hinglish. We do this by using a new neural network-inspired speech recognition model that takes into account the person’s accent, ambient noise, context and speaking style.”

Natural language search in Google Pay

Google is debuting a feature in India that allows users to search Google Pay in natural language.

Users can now query Google Pay with natural language questions, e.g. B. “Show me how much I spent on coffee last week.”

?️?️?️
“Fuel Cost Last Month”
“Grocery Expenses Last Week”

The new Transaction Lookup feature in Google Pay allows us to track our spend and make month-ends smoother ✨ #GoogleForIndia pic.twitter.com/7kOHWA1hXB

– Google India (@GoogleIndia) December 19, 2022

Handwriting to text translation

Google is working on a feature for Google Lens that will translate doctors’ handwriting into readable text.

We started work on the complex process of identifying the doctor’s prescriptions by creating a supporting model to digitize it using AI for healthcare professionals.#GoogleForIndia pic.twitter.com/XD8YwJ6HBr

– Google India (@GoogleIndia) December 19, 2022

Google has not committed to a launch date for this feature, indicating that it is intended for healthcare professionals.

However, the development of this technology could potentially lead to other use cases in the future.

source: Google