Google AI Overviews now answer queries before users reach any destination. The shift removes visits that once arrived through ordinary search results. Publishers lose impressions. Google loses search traffic ad revenue. Both sides report the same outcome from opposite directions.
Reddit’s Login Requirement Exposed the Scale of the Problem
In late October 2026, Reddit began requiring a login to view most content. The stated reasons centered on scraping and AI training. Within days, Google referral search traffic fell by more than a million weekly visits. Reddit’s stock dropped 29 percent. Google's AI Overviews Lowered Reddit's Traffic. Its Stock Dropped 29% - Slashdot
The connection is direct. Reddit removed content from surfaces Google could reach without authentication. That action also removed the material from the index that feeds both standard results and Google AI Overviews.
CEO Statement Confirmed Zero Search Traffic from AI Mode
Reddit’s CEO stated the shift explicitly. AI Mode does not drive traffic. Not for us, and not to anybody, as far as I know. Reddit’s CEO says Google’s AI Mode ‘does not drive traffic’ | The Verge
The statement reflects a broader pattern. Once Google answers a query inside the result page, the click never occurs.
Googlebot Controls What Enters the Index
Googlebot is the crawler. Blocking it or using noindex removes the page from Google Search entirely. That choice also keeps the page out of Google AI Overviews and AI Mode. No partial setting achieves the same result.
Google-Extended Only Limits Training Use
Google-Extended is a token in robots.txt. It tells Google not to use already-crawled content for training future Gemini models or for grounding in Gemini Apps and Vertex AI. The token does not affect inclusion in Google Search or ranking signals. Google-Extended: What It Blocks and Doesn't | 99visibility.com
Shared Token Aims for Cross-Provider Consistency
A shared _usageai-training token was announced at the end of October 2026. Google plans to treat an opt-out through that token as equivalent to a Google-Extended disallow beginning in early 2027. Supporting a shared AI training control for websites | Google Search Central Blog
Existing company-specific controls remain available in the meantime. None of them remove a page from the index or from generative features inside Google Search.
Search Console Control Targets Generative Features Directly
The Search Console generative AI control can exclude a site from AI Overviews, AI Mode, and generative features in Discover. That setting also removes impressions and any residual clicks those surfaces still produce. Google adds existing AI and snippet controls to its Search sharing guide
Login Walls Achieve the Same Effect as a Hard Block
Authentication requirements produce the same outcome as blocking the crawler. Content becomes unavailable for fetch. Discovery disappears with it.
Residual Exposure Persists After Opt-Outs
Once a page has been crawled and indexed, residual exposure exceeds what published controls suggest. The Search organization can still draw on indexed material for generative features even after training controls are set. Google can train search AI with web content even after opt-out - The Business Times
DOJ Testimony Revealed Internal Training Pathways
In DOJ testimony, a Google DeepMind vice president confirmed that once a Gemini model moves inside the Search organization, that organization can train on content publishers had opted out of for other Google AI products.
Memorization Creates Additional Risk
Training-control promises are also bounded by what has already been collected and by the ordinary limits of AI model memorization. A model that has seen the text can sometimes be prompted to produce substantial portions later. That pathway does not require ongoing crawler access.
Enforceable Controls Prevent the Fetch or Remove the Page
The enforceable controls are therefore the ones that prevent the fetch or remove the page from the index. Everything else is damage limitation. It reduces certain uses without restoring the previous relationship between ranking and visits.
Summarizable Pages Disappear First
Not every page faces equal exposure. Informational pages that can be fully answered in a paragraph are the ones that disappear into an Overview. Pages that require a tool, a configurator, a sequence of choices, or a logged-in state continue to force a visit even when an Overview exists.
Being Named as a Source Offers Limited Value
Being named as a source still carries some residual value for queries where the Overview wins. It is not a substitute for the visit. It does not replace the search traffic that used to arrive from the same query.
Interaction Requirements Preserve Some Clicks
Sites that can shift effort toward pages that still require interaction lose less when fully summarizable content collapses. That is a narrower optimization than ranking for the click on every head term.
No Setting Preserves Both Old Clicks and Training Protection
There is no setting that keeps the old informational head-term clicks while also keeping the source material out of training and summaries. The zero-click rate on answerable queries is the baseline. Partial opt-outs leave residual exposure. Full blocks remove the page from the surfaces that still send traffic.
Publishers Must Choose Which Search Traffic to Lose
Publishers now decide which traffic they are willing to lose. The content that can be fully extracted and summarized is the content that will be, unless it is kept out of the index. The content that cannot be summarized cleanly can still be left in. Those are the available options.
The Previous Equilibrium No Longer Exists
The previous equilibrium, in which high-volume informational queries reliably produced visits, is not among them.
Publishers evaluating these choices should audit current indexing status, review robots.txt directives for Googlebot and Google-Extended, and test the effect of the Search Console generative AI control before making permanent changes. The decision affects both immediate traffic and long-term visibility in Google Search and related surfaces.
