Google has started rolling out powerful new AI features for Gemini Live, enabling it to “see” what’s on your screen or through your smartphone camera and respond in real-time.
Google spokesperson Alex Joseph confirmed the update to The Verge.
A Reddit user first reported spotting the feature on their Xiaomi phone, as noted by 9to5Google. The same user later shared a video showing Gemini’s new ability to read on-screen content, one of the two major upgrades Google had announced in early March. These features are now gradually becoming available to Gemini Advanced subscribers under the Google One AI Premium plan.
A short demo of Project Astra (Share screen with Live)
byu/Kien_PS inBard
Another significant feature now rolling out is live video assistance, which lets Gemini analyze real-time footage from a smartphone camera and provide instant responses. In a recent demonstration video from Google, a user asked Gemini for help choosing a paint color for freshly glazed pottery, showcasing its practical applications.
