Google launched a computer use feature for its Gemini app on macOS on Thursday enabling the AI to perform multi-step tasks by using desktop applications and websites.
The update allows the Gemini assistant to operate on behalf of users by handling repetitive interface actions such as clicking, typing, and using menus. This capability moves the tool from a conversational chatbot toward an agentic assistant that can interact directly with a user’s local files and software.
This launch follows Google’s recent introduction of the Task feature—previously known as Gemini Spark—which was offered in beta since May and allows the AI to work as an agent for browser users by helping with website sign-ins, online shopping, or booking appointments.
Let Tasks in Gemini tackle your to-do list. At our next Gemini Discord event, a member of our team will demo how Tasks in Gemini can help you tackle big projects, ongoing workflows, and everyday chores, all in the background and under your direction. 👉 Join the Discord to…
— Post by @GeminiApp on X
“Just describe what you need, and Gemini handles the clicking, typing, menus and forms for you,” said Michael Friedman, group product manager for the Gemini App, according to PYMNTS.
To prevent the AI from taking over the user’s entire workspace, Gemini performs these actions within an isolated background window. This window provides a live preview of the agent’s activity directly in the chat interface, which TechCrunch reports allows the user’s main screen and cursor to remain free for other work.
Google has built several safety and oversight mechanisms into the feature. Users can choose which specific applications the AI is permitted to access and maintain the ability to pause or stop the process at any time.

Furthermore, the system is designed to require user approval before executing key actions, and Google noted it will pause for logins and payments to ensure sensitive transactions are confirmed by the human user. The execution environment utilizes a virtual machine that is isolated for each account.
The company suggested several practical applications for the tool, ranging from administrative work to creative production. 9to5Google and Superpower Daily said that the feature could be used to:
With computer use in the Gemini app for Mac, you can now hand off tasks across your folders, apps, and the web, while your screen and cursor stay yours. Watch Gemini click, scroll, and type in a live background window, turning a quick sketch into a rigged 3D model in Blender.
— Post by @GeminiApp on X
- Extract data like weights and addresses from local PDFs to fill out shipping quote forms.
- Pull metrics and screenshots from live dashboards to assemble presentations in Google Slides.
- Analyze clothing photos in a local folder to research prices and stage listings on resale platforms.
- Perform batch photo color-grading in design software or set up 3D scenes in programs like Blender.
In the app’s Customize > Connectors settings, users will find new Desktop applications available for integration, including Autodesk Fusion, joining existing integrations for Obsidian and Git. Google also provided an example of using the tool to take a butterfly sketch from a child and render it polygonally using Blender.
The feature is currently rolling out in English for users in the United States. To access computer use, users must have a Mac with Apple Silicon running macOS Sequoia 15.0 or later and a personal Google account for those aged 18 or older.
| Metric or Plan | Price / Value |
|---|---|
| Developer API input (per 1M tokens) | $3 (approx. ¥480) |
| Developer API output (per 1M tokens) | $15 (approx. ¥2,400) |
| Developer API cached input reuse | $0.15 (approx. ¥24) |
| Japan: Google AI Pro monthly | ¥2,900 (approx. $18) |
| Japan: Google AI Ultra monthly | ¥14,500 (approx. $91) |
The launch arrives as Apple prepares to introduce new restrictions for applications seeking “full disk access” on macOS.

Google has advised users to keep passwords and payment details out of their task prompts, as the company said that Gemini can make mistakes.