Gemini for Mac gets computer use to automate tasks across apps and websites

Google has introduced computer use in the Gemini app for Mac, allowing users to automate multi-step tasks across desktop applications, local files, and websites. The feature handles tasks such as clicking, typing, navigating menus, and filling out forms.

Gemini for Mac computer use

Computer use operates in an isolated background window, with a live preview available in the Gemini chat. Users can continue working on their Mac without Gemini taking control of the main screen or cursor. They can select which apps Gemini can access, monitor its actions through the live preview, and pause tasks at any time. Gemini also asks users to approve key actions before carrying them out.

Google has outlined the following use cases for computer use:

  • Creative workflows: Batch color-grade photos in design software or set up complex 3D scenes.
  • Shipping quotes: Extract weights, dimensions, and addresses from local PDF files and enter the information into shipping quote forms.
  • Presentation creation: Collect metrics and screenshots from live dashboards across multiple regions and prepare presentations in Google Slides.
  • Resale listings: Analyze clothing photos stored in a local folder, research prices, record item details, and prepare listings on resale platforms.

Availability

Computer use in the Gemini app for Mac is rolling out in English in the U.S. The availability requirements are:

  • Requires an Apple Silicon Mac running macOS Sequoia 15.0 or later.
  • Available to users aged 18 or above with a personal Google account and a Google AI Plus, Pro, or Ultra subscription.

The Gemini app for Mac is available at gemini.google/mac.


Related Post