Googlebooks’ Magic Pointer will also come to Gemini on Chrome

Google just gave us our first look at Magic Pointer, the new AI-powered cursor experience coming to its recently announced Googlebook laptops. The company has now confirmed that Magic Pointer will not be limited to google booksand that the experience is also directed to Gemini in Chrome.

in a new blog postGoogle DeepMind researchers detailed the ideas and interaction principles behind Magic Pointer.

DeepMind says the mouse pointer “has barely evolved in more than half a century” and Google now wants to change that with contextual understanding powered by Gemini.

The goal is to create “intuitive AI that adapts to users in all the tools they use, without interrupting their flow.”

That means that instead of copying text into Gemini or writing long messages, Chrome users can simply point to something on the screen and ask for help. Google says the system can understand both what you’re targeting and what you’re trying to do with it.

“Starting today, instead of typing a complex message, you can now use your pointer to ask Gemini in Chrome about the part of the web page you’re interested in. For example, you can select a few products on a page and ask to compare, or point out where you want to view a new sofa in your living room,” DeepMind noted on its blog.

Google describes the Magic Pointer experience as one where users can “simply point and the AI ​​knows exactly what word, paragraph, part of an image, or block of code the user needs help with.”

The company also says it wants to make AI interactions feel more human and conversational. Instead of typing detailed prompts, users can make simple requests like “Fix this,” “Move this here,” or “What does this mean?” while relying on physical gestures and shared context to communicate intent.

One of the most interesting ideas that Google highlighted is turning “pixels into actionable entities.” Basically, Gemini can recognize objects, dates, places, and other content directly from what appears on the screen. Google says this could allow users to instantly interact with things like video restaurant listings, handwritten notes, or travel destinations.

It looks like Magic Pointer’s more complex capabilities will reside in upcoming Googlebooks, while its Chrome experience could offer some basic features like comparison and visualization.

Google has not shared which regions or users will first have access to the Magic Pointer experience through Gemini in Chrome. We also checked out Gemini in Chrome ourselves and weren’t able to access any of the Magic Pointer’s capabilities yet, so the rollout may be limited or gradual.