Hey everyone, it looks like Google’s Gemini is getting a major upgrade! I’ve been following the AI assistant space pretty closely, and this news is huge: Gemini can now “see.” That’s right, it’s gaining vision, which is seriously exciting.
Apparently, Google is rolling out new vision features for Gemini Live, and this means the AI assistant can now analyze what’s on your phone screen or your camera feed. This is all powered by Project Astra, Google’s ambitious AI R&D project.
I saw a report that a Reddit user uncovered these new capabilities and even shared a video demonstrating them. It seems like Gemini can now peer through your screen or camera lens and process what it sees. While Gemini could already handle static screenshots, this update allows it to continuously “watch” your screen in real-time. Think about the possibilities!
From what I’ve seen, there’s a “Share screen with Live” button that lets Gemini analyze your screen. And the camera tool is equally impressive. Google has shown that Gemini can accurately identify colors and objects. I’m really curious to see how well the final product performs in real-world situations.
It seems like this feature is being rolled out first to Gemini Advanced subscribers who are paying $20 a month for the Google One plan with extra AI features. Interestingly, the rollout seems to be pretty broad, as the Reddit user demonstrated it on a Xiaomi phone. Google had previously hinted that Pixel and Galaxy S25 owners might get faster or better access to Project Astra, so it will be interesting to see how that develops.
It’s worth noting that other AI assistants have similar seeing tools, but they’re often tied to third-party apps. Having real-time screen and camera-connected AI built into Android could definitely be a big draw for users interested in a powerful AI assistant.
The timing of this release is also pretty significant. Google is really trying to establish its lead in the AI assistant market. While Amazon is hyping its “Alexa Plus” update, it hasn’t arrived yet. And Apple’s upgraded Siri has faced multiple delays. This gives Google a real, even if temporary, advantage. Gemini, despite its early challenges, is now capable of things that neither Alexa nor Siri can currently match.
Google has promised that Project Astra will be the “next-generation assistant” we’ll all want to use every day. I’m definitely keeping my eyes peeled for more new features in the coming weeks. This is a really exciting development in the world of AI!
