Background
Computer use means an AI model operates a computer's apps and websites on the user's behalf. On 19 November 2026 Google announced it for the Gemini app on Mac, in a post by Michael Friedman, Group Product Manager, Gemini App.[1]
What happened
Gemini can navigate Mac apps and websites to complete multi-step tasks across local files, desktop apps and the web.[1] It works in an isolated background window with a live preview in the chat, so the user's main screen and cursor stay free.[1]
Control
Users choose which apps Gemini can access. They can watch each step live, pause at any time, and approve key actions before they happen.[1]
Examples
The post gives three examples: batch color-grading photos, extracting weights and addresses from local PDFs to fill shipping quotes, and building Google Slides decks from live dashboards.[1]
Terms used in this entry
Computer use is a general name for a model that operates a computer through its interface, such as clicking buttons, typing and reading what is on screen, rather than only through an API. A multi-step task is one where the model must carry out several actions in order and use what it learns from one step in the next. Tasks that cross local files, desktop apps and websites are harder because each one has its own interface and rules.
An isolated background window means the work happens in a separate window that does not take over the user's main screen or mouse pointer, so the user can keep working in other apps while the task runs. A live preview lets the user see what Gemini is doing without having to switch windows. Approval before key actions is a common safeguard for this kind of tool: the user confirms steps that could change or send something, such as a file sent to someone else, before they happen.
Automating repetitive chores is the main use case the examples point to. Tasks such as adjusting many photos the same way, copying values from documents into a form, or building slides from a dashboard are routine work that takes time when done by hand, and they follow steps that a computer can repeat once they are described clearly.
Sources
- 1
Cite this page: Gemini app gains computer use on Mac. TellWorld, https://www.tellworld.net/news/gemini-app-mac-computer-use-2026. Updated 2026-11-20