Google is launching a new update Wednesday that allows users to search for content on their screens with simple gestures while browsing in Google Chrome or Google Search apps on iOS. This function is similar to Android’s built-in “loop search” feature This also allows users to search for content on the screen using various gestures.
At launch, iPhone users can also search for content on their screen via Google Lens by drawing, highlighting, or tapping on something.
For example, if you are reading an article and encountering an image of an interesting work of art, you can now use the lens to quickly circle or click on the image to learn more about it. Or, if you are watching a video and viewing your favorite items, you can use the lens to hover to find something similar.
The idea behind this feature is to allow users to quickly perform visual searches while browsing without screenshots or opening new tabs, but it also provides users with another way to start traditional web searches – its business area may use AI technology for a long time Will affect.
Once you highlight or tap on the content on your mobile device screen, you will display visual matches and other related results. You can then click on the “Add to Your Search” option to perfect it by color, brand, or other details. You can also ask a follow-up question to learn more about a topic.
To access new features in Chrome or Google App, you need to open a three-dot menu and select “Search screen with Google Lens.” Google says that over the next few months, you will be able to access the feature via the new lens icon in the address bar.
The update will continue this week and will be available worldwide on iOS.
Additionally, Google announced that it is expanding its AI overview, which displays a snapshot of the information at the top of the results page to provide more Google Lens search results.
In the past, Google has shown an overview of AI in lens searches that include images and text. With this latest update, users will start seeing an AI overview without adding additional text or issues to their searches.
For example, if you come across an interesting car, you can take a photo and then get an AI overview to help you quickly learn more about what you see and get useful links to resources on the web.
This update will be launched this week for English-speaking users in countries outlined by AI, starting with Google apps for Android and iOS.
The company said the update will soon be rolled out to Chrome on desktop and mobile devices.
