Google brings multimodal search to AI modeIts Google Search experiment allows users to ask complex, multi-part questions and follow-up measures to study topics more deeply. Users who have access to AI mode can now click on the feature to ask questions about photos they uploaded or took with their cameras.
Google said in a blog post on Monday that the new image analysis feature in AI mode is powered by Google Lens’ multimodal capabilities.
According to Google, AI patterns can understand the entire scene in an image, including the interrelationships between objects and their materials, colors, shapes, and arrangements. Using a technique called “querying fans” to ask multiple questions about images and objects displayed in them, providing more details than traditional Google searches provide.
For example, you can take photos of bookshelf and type in the query: “If I like these, what similar books are highly rated?” The AI pattern will recognize each book and then provide a list of recommended books with links to learn more about and/or purchases.
The AI model can also let you ask follow-up questions to narrow your search, such as “I’m looking for a quick read, which one is the shortest?”
As part of Monday’s announcement, Google said it is offering an AI model to millions of enrolled users laboratoryGoogle’s experimental features and products home. Prior to this, the AI model was only available to Google’s advanced AI subscriber.
The AI model was launched last month, hoping to adopt popular services such as Perplexity and Openai’s chatgpt search. Google has said it plans to continue to refine the user experience and expand the features in the features.
