Google tests “Ask Photos” for advanced photo search | Festina Lente - Your leading source of AI news | Turtles AI

Highlights:

• Google introduces "Ask Photos," utilizing Gemini AI to search photos via natural language.
• The feature is currently being tested by a select group of users.
• Ask Photos can answer specific questions about elements in photos.
• Integrating Gemini into Google Photos promises significant improvements in image organization and search.

Google tests a new AI feature to search photos: discover how Ask Photos is transforming image organization.

Google has begun testing a new feature called "Ask Photos," previewed at Google I/O 2024, which uses the Gemini AI to search through users’ photo libraries using natural language, without needing to pre-organize or tag images. Currently, Google hasn’t announced an official release date, but it appears a select group of users is testing the feature to provide feedback before a broader rollout.

Ask Photos extends Gemini’s ability to parse visual information from users’ photos. The AI can comb through images in an album or on a device it has permission to access, answering specific questions posed by the user. For instance, during the initial demonstration at Google I/O, CEO Sundar Pichai showed how he could ask his phone for his license plate number, with the answer provided thanks to a photo of the license plate in his album.

The version highlighted by 9to5 Google was discovered by a user on his Pixel 8 Pro. Unlike the official demo, where Ask Photos had its own tab, the feature now appears to be available on the Search tab via an "Ask" button next to the search bar. Tapping the button brings up the Ask Photos interface, including sample prompts and space to write your question under "What would you like to see?" Some aspects of the feature are still being tested, as evidenced by a technical error response to the sample prompt "Photos of me over time," which suggested using "Classic search." However, the feature seemingly disappeared shortly after the user first saw it.

Employing Gemini to search photos benefits users, especially those with poorly organized images. Google Photos already has some ability to find photos of specific events and people, but applying Gemini’s AI models would vastly improve these capabilities. The AI could better identify photos taken in the same place, recognize people across different time periods, and organize images based on detailed criteria.

Ask Photos is just another facet of Google’s effort to embed Gemini into every product and service. The apparent limitations and technical issues of the feature highlight the complexity of integrating Gemini. However, combined with other developments like making Gemini available from Android phone lock screens, the broader picture becomes clearer.

This new feature offers an advanced solution for users with large photo collections, providing a more effective method to manage and access them through direct and specific queries. Combining Gemini with Google Photos could redefine how users interact with their photo archives, providing immediate and precise answers without the need for manual organization.