Skip to content

Google-Extended

A robots.txt product token that lets site owners control whether Google uses their content to train Gemini models and to ground answers in Gemini Apps.

Google-Extended isn't a crawler. Google fetches pages with its usual user agents, and Google-Extended is a token you name in robots.txt to say how that content may be used afterward. Disallowing it opts your site out of training future Gemini models and out of grounding in Gemini Apps and in Grounding with Google Search on Vertex AI.

User-agent: Google-Extended
Disallow: /

What it doesn't control

Google says Google-Extended doesn't affect a site's inclusion or ranking in Google Search. That covers AI Overviews and AI Mode, which are part of Search and follow Googlebot and snippet controls such as nosnippet and max-snippet. Google has also begun rolling out a separate Search Console setting for opting out of those AI features.

How to decide

Treat training and visibility as separate questions. If you want Gemini to cite you, leave Google-Extended allowed. If your legal team needs a training opt-out, know that the same token removes your content from Gemini grounding. The Citeplot audit reports how your robots.txt treats AI training and answer bots, and our robots.txt guide covers the trade-offs.

Bring better evidence to your next pitch.

Start a 14-day trial. Explore clearly labelled sample data, then build the evidence for your clients. No card required.