Bots now make up about half of all web traffic. Are they a threat to block or an audience to win?
For most of the web's history, the deal was simple. Search engines pointed people to websites, and those visits paid for the content through advertising and subscriptions. AI is rewriting that arrangement, and the clearest place to see it is in who, or what, is showing up at the door.
Akamai says it now handles more than 150 billion bot requests a day, with AI bot traffic climbing more than 300% year over year. Bots account for roughly half of all internet traffic. On this episode of The Media Copilot podcast, Pete Pachal talks with two Akamai executives who sit on opposite sides of that shift:
Kim Salem-Jackson, the company's chief marketing officer, and
Patrick Sullivan, its CTO of security strategy. Their jobs once had little to do with each other. Now they are working the same problem from two directions.
For Sullivan, bots have been a security headache for more than a decade. What changed is that the most valuable visitor to a site is now also a bot: the retrieval and training crawlers that feed large language models. "The VIP visitor to the website are the various bots that really make LLMs go," he says. Detection and blocking are no longer the point. Akamai keeps dozens of categories of bots and a menu of responses for each.
For Salem-Jackson, the reframe is sharper. She treats LLMs as a new audience, each with its own personality, the way a marketer treats different buyers. "The bots are my new customer," she says. She monitors bot volume by the hour, rolls out a welcome mat, and watches whether her team's work on AI visibility pulls more crawlers in.
The catch is that the same bot looks like an opportunity to one business and a threat to another. A training crawler can compress a publisher's entire site, hand it to a model, and never send a reader back. Sullivan puts the ratio of training visits to human visits at tens of thousands to one. For a company like Akamai that wants to show up in AI answers, that crawler gets cookies and milk. For a publisher whose business runs on traffic, the same crawler is something to block or charge for.
That’s where the conversation gets useful for media people. Akamai offers pay-per-click tools, but Sullivan is candid that those models are early and that content licensing deals remain more common. The technology is the easy part. The hard part is the business and legal call about what to allow, and who can enforce it. Unlike Cloudflare, which has taken a loud public stance on publisher control, Akamai casts itself as "Switzerland," a technology enabler that leaves the decision to the publisher.
Then there’s the part every publisher can act on now. Salem-Jackson says an average webpage runs about 200,000 tokens, but a model reads only around 10,000. Roughly 1% of your site actually gets consumed. Anything important that sits below that budget is invisible. Her fix was a separate "bot site" that serves crawlers stripped-down, high-value content, which she credits for an 85% lift in citations. Great content is not enough if the machine cannot read it.
Key Takeaways
• AI bot traffic is up more than 300% a year, and bots now make up about half of all web traffic
• For some sites, the most valuable visitor may now a bot, not a person
• The difference between training bots, retrieval bots, and malicious bots
• Marketers are starting to treat LLMs as an audience to court, each with its own personality
• The same crawler can be an asset or a threat depending on whether your business runs on visibility or on traffic
• Pay-per-click for bots exists, but licensing deals are still the more common path, and enforcement rests with publishers rather than the CDN
• A model reads only about 1% of a webpage, so anything below the token budget is invisible to AI
• A separate bot-optimized site can raise AI citations sharply, which Akamai puts at 85%
• Wikipedia, LinkedIn, YouTube and Reddit carry outsized weight in what LLMs cite
🔗 About the 👤 Guests
About the show: To explore more conversations like this and see what’s new, visit the
Media Copilot website at
mediacopilot.ai. You’ll find new episodes, expanded resources, and tools designed for journalists, communicators, and media leaders navigating the fast-changing world of AI. It’s the home base for everything Media Copilot and it’s just getting started.
Produced by Pete Pachal and Executive Producer Michele Musso
Edited by the
Musso Media Team
Music: “Favorite” by Alexander Nakarada, licensed under CC BY 4.0
All rights reserved. © AnyWho Media 2026