Google is expanding Gemini’s real-time AI capabilities, allowing it to analyze smartphone screens and camera feeds instantly. The tech giant has begun rolling out these features to select Google One AI Premium subscribers, marking a major leap in AI-powered assistance.
Real-Time AI Assistance
Gemini can now “see” what’s on a user’s screen or through their smartphone camera, providing real-time responses. These features build on Google’s “Project Astra,” first demonstrated nearly a year ago.
Users can ask Gemini questions about what’s displayed on their screen. For instance, if someone is reading an article in another language, Gemini can translate or summarize it instantly. A Reddit user recently demonstrated this screen-reading feature on a Xiaomi phone, confirming its rollout.
Read: The Rocky Future of Asteroid Mining
Live Video Interpretation
Alongside screen analysis, Gemini now supports live video interpretation. By accessing a smartphone camera, Gemini can process visuals in real-time and offer useful insights. In a recent demonstration, a user asked Gemini for advice on choosing a paint color for a pottery project. The AI quickly analyzed the options and provided helpful suggestions.
Competing with Other AI Assistants
Google’s advancements put it ahead of competitors like Amazon’s Alexa and Apple’s Siri. While Amazon is still testing its upgraded Alexa Plus and Apple has delayed its next-gen Siri, Gemini’s real-time features are already reaching users.
Samsung, which still relies on Bixby, has also integrated Gemini as the default assistant on its devices, further strengthening Google’s position in the AI space.
Expanding AI’s Role in Daily Tasks
These new capabilities showcase Google’s vision of AI-powered everyday assistance. Whether helping with translations, providing shopping advice, or analyzing visual data, Gemini aims to become an indispensable tool for users.
As Google continues expanding these features, real-time AI assistance may soon become a standard part of daily smartphone use.
Follow us on Google News, Instagram, YouTube, Facebook,Whats App, and TikTok for latest updates