Accueil / Tech News / AI leaves the chat window behind with Gemini's new Mac voice mode

AI leaves the chat window behind with Gemini's new Mac voice mode

Google is bringing voice-first AI assistance to the Mac, letting Gemini turn spoken requests into finished text without pulling users out of the app they're already using.

Gemini's default intelligent dictation mode transcribes speech at the cursor and automatically removes verbal fillers such as "ums" and "ahs." Google said the feature produces polished text directly where the user is already working.

Users can also enable screen-aware reasoning, which lets Gemini understand on-screen content before carrying out more complex requests. Google said Gemini can turn highlighted notes into an executive summary and insert the rewritten text directly into the document.

Holding down the Function, or Fn, key activates the voice controls from any desktop window. The shortcut lets users call on Gemini without opening a separate chat window or copying text between apps.

Google released a native Gemini app for Mac in April 2026, providing a keyboard shortcut for opening the assistant and permission-based tools for analyzing on-screen content. The new voice controls push that approach further by allowing users to speak while remaining in the window where they're already working.

The underlying capabilities aren't entirely new to macOS. Apple's built-in Dictation feature already converts speech into text across Mac apps and text fields.

Google's approach adds AI editing to the same interaction. Gemini can remove filler words by default, then use optional screen context to rewrite or summarize existing material after receiving a spoken request.

Apple offers similar editing functions through Apple Intelligence Writing Tools, which can proofread, rewrite, and summarize selected text in supported apps. Gemini's main distinction is that Google is combining dictation, editing, and screen awareness behind one voice shortcut.

Google's screen-aware mode resembles Siri AI's onscreen awareness, which lets Apple's assistant understand visible content and use that context when answering questions or taking actions.

Gemini's initial Mac implementation appears more focused on rewriting and inserting text within the active window. Siri AI is designed to connect onscreen content with personal context and actions across supported apps.

The new Gemini voice workflow makes practical sense because the feature removes several steps from a common AI task. Instead of opening a chatbot, typing a prompt, copying the response, and returning to a document, users can speak while the cursor is already positioned where the finished text belongs.

Google made screen awareness optional, allowing users to decide whether Gemini can access information shown on the display. The company didn't explain which macOS permissions Gemini will require, how Google will process on-screen content, or whether the feature will work in every app and text field.

The missing privacy and compatibility details matter because screen-aware assistance requires access to more information than ordinary dictation. Gemini's usefulness will depend on accurate transcription, reliable identification of the active window, and clear controls over which on-screen material the assistant can examine.

The update also arrives as Google becomes more closely tied to Apple's own AI plans. Apple's coming context-aware Siri upgrade will use technology based on Gemini, although Google's Mac app remains a separate product that competes directly for the same writing and desktop-assistant tasks.

Google has two promotional videos, one of which appeared to use an AI narrator voice complete with an on-screen narrator bubble. It's hard to imagine a more on-brand way to promote an AI feature, short of having Gemini answer the press emails too.

The new voice capability is rolling out globally in English to users of the Gemini app for macOS. More languages are planned for later in 2026, though Google hasn't announced a more specific schedule.

Origine de l’article : lire l’article original
Traduction