Earlier this year, Google incorporated generative AI into Lens — so you can point your camera, ask a question and get an AI Overview with the information you need, along with links to learn more. Already, people are finding this experience incredibly helpful.
Lens queries are now one of the fastest growing query types on Search, and younger users (ages 18-24) are engaging most with Lens. Now, Google is introducing more capabilities to Lens to make it even easier to search the world around you.
Video understanding in Lens
Google previewed their video understanding capabilities at I/O, and now you can use Lens to search by taking a video, and asking questions about the moving objects that you see. Say you’re at the aquarium and want to learn more about some interesting fish at one of the exhibits. Open Lens in the Google app and hold down the shutter button to record while asking your question out loud, like, “why are they swimming together?”
Voice questions in Lens
The option to ask a question with your voice is also now available any time you take a photo with Lens. Just point your camera, hold the shutter button and ask whatever’s on your mind — the same way you’d point at something and ask your friend about it.
Lens updates to help you shop what you see
Google is also making it easier to shop the world around you with Lens. For years, you’ve been able to use Lens to find visually similar products from retailers across the web. But starting this week, you’ll now see a dramatically more helpful results page that shows key information about the product you’re looking for, including reviews, price info across retailers and where to buy.
For example, say you spot a backpack at the airport and want to buy one for yourself. Just take a photo and Lens will bring together our advanced AI models and Google’s Shopping Graph — which has information on more than 45 billion products — to identify the exact item. So you can learn more about whatever catches your eye, and start shopping right in the moment.
A new way to identify the songs you hear
Whether on a video while you’re scrolling through social media, in a movie you’re streaming, or on the website you’re visiting, with Google latest Circle to Search update, you can instantly search the songs you hear without switching apps.
Your search results page, organized with AI
Earlier this year, Google previewed how AI can help you explore and discover a wider range of results from the web, for those questions that may be open-ended or have no single right answer — like if you’re searching for a vegetarian appetizer to make for a dinner party.
This week, Google is rolling out search results pages organized with AI in the U.S. — beginning with recipes and meal inspiration on mobile. You’ll now see a full-page experience, with relevant results organized just for you. You can easily explore content and perspectives from across the web including articles, videos, forums and more — all in one place.
In testing, people have found AI-organized search results pages more helpful. And with AI-organized search results pages, Google is bringing people more diverse content formats and sites, creating even more opportunities for content to be discovered.
More connections to the best of the web
Google knows that people want to go directly to the source for many of their questions. With AI in Search, Google is focused on helping people discover content and perspectives from a wide range of sources across the web.
Whether it’s searching with text, audio, voice or images, Google always worked to expand the type of questions you can ask on Google. With AI, Google is continuing to reimagine how Search can help get you the information you need — fast.