Google has updated Gemini for Mac with a feature that lets its AI assistant control other applications, click buttons, fill out forms, and navigate menus without requiring users to perform every step themselves.
Called computer use, the feature allows Gemini to handle repetitive tasks in the background while you focus on something else.
The rollout comes as Apple prepares new macOS security controls to give users more visibility into AI assistants that operate other apps.
Gemini Can Now Handle Tasks Across Mac Apps
Instead of simply providing instructions, Gemini can interact directly with applications to complete multi-step assignments.
Google highlights several examples of what the assistant can do:
- Edit photos in batches without manually repeating the same steps.
- Prepare online listings by entering product details into resale platforms.
- Build presentations using screenshots, performance metrics, and other information.
Gemini performs these actions in an isolated window, with a live preview in the chat interface so users can follow its progress.
You can choose which applications the assistant can access, and Gemini is designed to request approval before taking significant actions.
Apple’s Next macOS Update Will Make App Access More Visible
The timing is particularly interesting because Apple is preparing to introduce stricter permission controls in macOS 27.3.
The upcoming macOS security changes will make it clearer when an application wants permission to control other apps.
Users will see more explicit warnings, gain more control over which apps and folders can be accessed, and get a persistent indicator when one app is operating another.
There’s an important distinction for people installing Gemini now.
Permissions granted before macOS 27.3 arrives will carry over automatically, meaning users won’t necessarily see the new explanatory screens when the update becomes available.
Anyone enabling computer use should review which applications Gemini can access rather than granting broad permissions without checking.
Who Can Use Gemini’s New Feature?
Computer use is currently available in the United States to subscribers on Google’s AI Plus, Pro, and Ultra plans, starting at $4.99 per month.
You’ll need an Apple silicon Mac and the Gemini desktop app, available directly from Google’s website.
Meanwhile, Apple is developing its own AI assistant that can control apps and complete complex tasks, though the company hasn’t announced when users will get those capabilities.
For Mac owners, Gemini offers an early look at how AI assistants could move beyond answering questions to actually getting work done.