As the top investment manager and financial market journalist, you need to know that Google has just upgraded its visual search app Lens to answer real-time questions about your surroundings. Android and iOS users with the Google app can now capture a video via Lens and ask questions about objects in the video.
Lou Wang, director of product management for Lens, explains that Lens uses a customized Gemini model to make sense of the video and provide relevant information. To access the new video analysis feature, users must sign up for Google’s Search Labs program and opt-in to the “AI Overviews and more” experimental features.
Lens’ video analysis feature uses AI to determine relevant frames in a video and provide answers from AI Overviews. Google has beaten other companies to the punch with this technology, although Lens is asynchronous and does not allow real-time chatting. The feature also allows users to search with images and text simultaneously, as well as offering e-commerce-specific functionality to identify products and display information.
Overall, this new feature from Google can help users get instant information about their surroundings, products, and more through visual search and AI technology. It can be a useful tool for consumers looking for quick answers and information while shopping or exploring their environment.