Google Introduces 'Ask Photos,' A Gemini-Powered Search That Can Understand Context Of Photos

Phone listens

Google Photos’ search feature has been a favorite for years.

With nearly half a billion users relying on it monthly to find people, pets, places, and more. And this time, Google is giving it an update to make it even better. With AI, users can search for images and videos using more detailed descriptions, moving beyond simple keywords to find more accurate results.

As photo collections grow, it can become difficult to find specific images.

With the update, users can use everyday language to search more precisely.

For instance, they could search for “Alice and me laughing,” “Kayaking on a lake with mountains,” or “Emma painting in the backyard.”

This makes it easier to locate exactly what users are after.

In addition to improved accuracy, users are also given the option to sort results by date or relevance.

This feature should help users find specific memories faster.

This enhanced search has been made available in English on Android and iOS, with plans to expand to more languages soon.

And because AI is all the hype, thanks to Gemini to its products, starts offering early access to 'Ask Photos,' a Gemini-powered conversational search tool.

Initially to users in the U.S. via Google Labs, this experimental feature goes beyond the aforementioned improved search.

With the help of Gemini, the feature can not only interpret user queries in everyday language but also grasp the context of the photos.

For example, users can use the Ask Photos feature to find people, activities, or favorite foods, "and pull out relevant details to help you find specific memories and uncover information about your life."

"For example, if you are trying to plan your next camping trip and want to return to a favorite site, you could ask 'Where did we camp last time we went to Yosemite?' Or if you want to go back to a restaurant you enjoyed and order the same thing, just ask, 'What did we eat at the hotel in Stanley?'" explained Google.

"Ask Photos understands details, like where you took photos with your camping gear or what dish is sitting on the table in your picture at the restaurant, to give you the answer. And because Ask Photos is conversational, if it doesn't find the right answer immediately, you can provide extra clues or details to nudge it in the right direction."

Long story short, the feature is designed to help users locate memories and even provide answers based on their photos.

Additionally, Ask Photos can help streamline tasks, like suggesting the best images from birthday party for a shared album or summarizing highlights from a recent trip to share with friends.

Then, once again, privacy concerns arise.

The relationship between AI development and people's privacy is a significant concern, particularly when it comes to the data used for training these models. AI systems, especially those based on machine learning, require large datasets, often consisting of personal information, images, text, and more. This raises critical questions about how user data is handled, protected, and anonymized.

Here, Google is committed to a responsible rollout of Ask Photos, guided by its AI Principles.

While usage will help improve the product, user privacy is a top priority.

Google said that Google Photos data is never used for ads and is safeguarded with advanced security.

To refine the experience, queries may occasionally be reviewed by humans, but these are separated from your Google account information to ensure privacy. Human review of your photos or videos only occurs if users provide feedback or in rare cases of abuse.

Published: 
06/09/2024