Overview
- Cloudflare’s July 1 report found that more than half of web requests are non-human and that Google’s AI overviews have driven human traffic down by roughly 35 to 40 percent in under a year.
- The report and related analyses show Google accounts for about 88 percent of referral traffic to sites, which creates a trade-off where opting out of AI overviews can also block indexing for some publishers.
- Independent measurements document rapid growth in agent traffic, with Decodo/Cloudflare data showing AI-driven requests jumped about 187 percent in 2025 and DataDome reporting a 45 percent rise in AI agent requests in Q2 2026.
- Publishers are trying mixed responses such as blocking crawlers, using llms.txt files, and building whitelists but live tests show bans often fail and most llms.txt files are never requested.
- Industry pilots and regulatory moves are emerging to measure and monetize AI consumption, including Cloudflare pay-per-use tools and a UK trial that lets publishers opt out of AI overviews without losing search indexing.