Google has begun deploying new artificial intelligence features for Gemini Live that allow it to "see" a smartphone screen or receive images through a camera and provide answers in real time, The Verge reports.
- These features appear almost a year after Google first demonstrated the Project Astra AI assistant, which they are based on.
- A Reddit user reported that the new feature appeared on his Xiaomi smartphone. He later posted a video demonstrating Gemini's ability to read information from the device's screen.
- This is one of two features that Google has announced and promised to roll out later this month to Gemini Advanced subscribers as part of the Google One AI Premium plan.
- The other new feature is real-time video analytics. It allows Gemini to interpret the video stream from a smartphone camera and answer questions about objects in the frame.
- In a demonstration video released by Google this month, a user asks for advice on choosing a color for a ceramic product.
As a reminder, by the end of 2025, Google Assistant will no longer be available on most smartphones and will disappear from app stores. In the coming months, it will switch most users to Gemini.
