You've long been able to offer up photos and screenshots for Gemini to analyze, but it's the real-time aspect of the upgrade that makes this most interesting—it's as if the AI bot can actually see the world around you. You may remember some of this functionality was shown off by Google under the Project Astra name last year.
There are plenty of ways to use Gemini Live. Credit: SamsungIt's now available as a free update on Pixel 9 and Galaxy S25 phones, with further Android devices getting it soon—though wider availability will be tied to a Gemini Advanced subscription. As yet, there's no definitive list of which phones are in line for the update, though presumably it needs a certain level of local processing power to work. There's no word yet on it coming to the Gemini app for the iPhone.
As always, the official advice is to "check responses for accuracy," so just because there's a fancy new interface to make use of doesn't mean the Gemini AI is any more reliable than it was before. You're also going to need an active internet connection for this to work, so the app can get some help from the web.
Two new buttons have been added for camera and screen sharing. Credit: LifehackerClose down the Gemini Live interface, and you'll find your conversation has been recorded as a standard text chat, so you can refer back to it if needed. As the new features have appeared on my Google Pixel 9, I tested them out using questions I already knew the answers to, to check for any unhelpful hallucinations.
Putting Gemini Live to the test
I then asked about a package with a UN3481 label: lithium-ion batteries packed inside equipment (over-ear headphones, in this case). Gemini Live correctly figured out that lithium-ion batteries were involved, needing "extra care" when handled, but gave no more information. When pushed, it said these batteries were packed separately, not in equipment. Wrong answer, Gemini Live—you're thinking of code UN3480.
Gemini Live figured out how to reset a Charge 6 (this is a transcript of the live conversation). Credit: LifehackerSharing your screen with Gemini Live is interesting. The app shrinks to a small widget, so you can use your phone as normal, and then ask questions about anything on the screen. Gemini Live did a good job of identifying which apps I was using, and some of the content in those apps, like movie posters and band photos. It also accurately translated a social media post in a foreign language for me.
Regarding a website showing the recent Leicester v Newcastle soccer match, Gemini Live correctly told me what the score was and which players got the goals—all information that was already on screen. When I asked when the match was though, the AI got confused, and told me it happened on May 22, 2023 (the same teams playing, but nearly two years ago).
Gemini Live can see what's on your phone's screen, with permission. Credit: LifehackerEssentially, this is just an enhanced, instant version of visual search: Previously, you might just type "UN3481 label" into Google for the same query. But whereas the traditional search results list of blue links lets you see the information you're looking up, and make a judgment on its reliability and authoritativeness, Gemini Live is much more of a closed box that doesn't show its workings. While it feels almost like magic at times, because of that interface, having to double-check everything it says isn't ideal.
Read More Details
Finally We wish PressBee provided you with enough information of ( Gemini Live Can Now 'See' Your Phone (to a Point) )
Also on site :