60% of Web Traffic Is Now Bots. Here's What That Means for Your Site.

Sometime in May 2026, non-human requests overtook human ones on the open web — a year earlier than the company that measured it had predicted. Cloudflare calls it a crossover. For anyone who runs a website, it's worth understanding what actually crossed, and what didn't.

What Cloudflare's Own Data Shows

In its "Content Independence Day" report, published July 2026, Cloudflare put the split at 57.5% bot traffic versus 42.5% human traffic, measured across HTML requests on its network. The crossover — bots becoming the majority — happened in May 2026, roughly a year ahead of Cloudflare's own 2027 forecast.

Agentic AI traffic specifically grew 1,700% year over year. On a Q2 2026 earnings call, Cloudflare CFO Thomas Seifert went further, projecting that "in five years, non-human traffic will be as much as 1,000 times as much as human traffic," adding that "humans will be a rounding error on the internet — not because human traffic goes down, but that's just how fast we're seeing non-human traffic grow."

Seifert immediately qualified his own projection: "with the big caveat that I have called it wrong at every point along the way." Worth keeping in mind before treating any five-year forecast as settled — including this one.

Why the Internet Wasn't Built for This

Most of the web's business model — ads, pageviews, click-through rates, conversion funnels — assumes a human on the other end who looks at things, clicks things, and occasionally buys things. Agents don't click ads. They don't fill out lead-gen forms. They don't scroll past the fold to see what's "below."

That mismatch is already visible in why bots are on your site at all. Cloudflare's report found that 52% of crawls are now for AI training purposes, up from 22% in spring 2025 — search-engine indexing, the traffic pattern the web's ad economy was actually built around, is a shrinking share of the total. Separately, over 2.5 billion people have adopted generative AI in the space of 3.5 years, roughly twice the speed of smartphone adoption. Cloudflare's estimate: for every hour someone spends looking for information, only about 15 minutes of it now touches the open web directly — the rest happens inside an AI interface that already did the browsing for them.

The Honest Caveat

The 57.5% figure is real, but it's narrower than "57.5% of the internet is bots." It covers HTML requests only — it excludes video streaming, gaming traffic, mobile app traffic, and infinite-scroll API calls, all overwhelmingly human. Counted across the whole internet, the bot share is meaningfully smaller than the headline number.

And Seifert's own hedge is worth repeating rather than glossing over: this is a fast-moving trend reported by one vendor from its own network's vantage point, not a settled fact about the entire web. Directionally, though, the underlying pattern — AI agents and crawlers becoming a larger and larger share of the requests hitting any given site — shows up consistently across every Cloudflare report cited below, not just the headline one.

Who's Actually Knocking on Your Door

Aggregate percentages hide something more useful for a site owner: which specific bot is showing up, and how much it costs you per human visitor it sends back. Cloudflare's "Crawl-to-Click" report measured exactly that — requests made per resulting human visit:

Search-engine crawlers like Google's send you visitors in rough proportion to how often they crawl you — that's the deal search indexing has always run on. AI-training crawlers largely don't; they take content to improve a model that answers questions elsewhere, with no click back to you built into the exchange. You don't need to manage every one of these individually. But most site owners have no idea these ratios exist for their own traffic, let alone which crawler is the outlier on their specific site.

Panic or Control

The instinctive reactions to "most of my traffic might be bots" are usually panic (block everything, starting now) or denial (my analytics would show it, and they don't). Neither is quite right.

Standard analytics tools weren't built to answer this question. Google Analytics filters out traffic it recognizes as a bot before you ever see it in a report — which means the "bot problem," if you have one, is often invisible in the tool most people check first. (We've written separately about how HumanKey's counting differs from GA and Cloudflare, and why three legitimate tools can report three different numbers for the same traffic.) Cloudflare's edge counts include bots, but at the aggregate network level, not broken down per-site or per-crawler in the tools most operators actually use day to day.

The gap in the middle — knowing your own site's actual human/bot split, and which specific crawlers make it up — is where most site owners are currently flying blind.

Preparing Your Site for the Agentic Web

None of this requires an overreaction. A few concrete, low-effort steps:

• Publish a robots.txt that actually says what you mean for AI crawlers specifically — not just search engines. Most sites still only address the crawlers from 2010.
• Declare your content-usage preferences explicitly where the emerging standards allow it (Cloudflare's own Content Signals policy is one; more are coming), rather than leaving AI companies to infer your intent from silence.
• Know which crawlers are actually visiting, not just that "bot traffic exists." The ratio table above is Cloudflare's aggregate; your own site's mix will differ, sometimes a lot.

That last point is the one most existing tools don't answer well — which is the specific gap HumanKey is built for: classifying and naming the AI crawlers hitting your site (GPTBot, ClaudeBot, PerplexityBot, and dozens of others), rather than filtering them out of view like a general-purpose analytics tool does.

Get Your Own Numbers

You can't manage a split you can't see. If you want to know your own site's actual human-versus-bot breakdown — and which AI crawlers make up the "bot" half — get a free 7-day AI crawler report for your site. No credit card, no commitment; just the numbers.