The options for monetising AI bot traffic come down to a single question: do you want to be paid for access to your content, or paid for what AI agents do with it once they read it. Licensing and pay-per-crawl charge for access, and they suit different situations. Licensing works for the handful of large publishers AI companies will negotiate with, while pay-per-crawl charges identified crawlers that agree to a price. Neither reliably captures the Live Search Agent, the bot that fetches a page anonymously to answer a live user question, and that is the fastest-growing category of AI traffic. Earning from the read itself, through real-time contextual advertising at the content layer, is the model built for it. In practice most publishers combine more than one, and the right mix depends on how AI systems actually consume their site.
Why AI traffic generates no revenue today
When a human visits a page, the browser runs JavaScript. Analytics fire, the programmatic ad auction runs, affiliate links activate, and the page is monetised. AI agents do not behave like this. A Live Search Agent dispatched by ChatGPT, Perplexity, Claude, or Gemini makes an HTTP request, receives the HTML, reads the text, and leaves. No JavaScript executes. No ad renders. No analytics record the visit. The content is consumed at the exact moment a user is researching a decision, and the publisher earns nothing.
This is no longer a rounding error. The IAB Tech Lab estimates publishers lose around $2 billion a year to uncompensated AI bot traffic, automated requests already make up more than half of internet traffic, and the share is rising. For many sites, AI agents are now the fastest-growing segment of the audience and the only one generating zero revenue.
The three ways to monetise AI bot traffic
Direct content licensing
Large publishers can sign licensing deals with AI companies that pay a flat fee, a per-use rate, or a revenue share for the right to train on or display their content. Deals signed by major newsrooms have made headlines. The limitation is structural. These are bilateral deals available to a small number of brand-name publishers with leverage. Independent research has warned that most publishers will see little or no meaningful licensing revenue, because the same large platforms eroding referral traffic also control the licensing terms. Licensing is real money for the few and largely unavailable to the many.
Pay-per-crawl access gateways
Pay-per-crawl turns access into a transaction. A crawler that wants a page is met with a charge set by the publisher, collected by an intermediary. Cloudflare began blocking AI crawlers by default in 2025 and launched a pay-per-crawl marketplace, and TollBit operates a similar paywall used by thousands of sites. This model works well for training crawlers that identify themselves and are willing to pay for bulk access. It works less well for Live Search Agents that fetch a single page anonymously to answer a user prompt, and intermediaries take a cut of the revenue. Pay-per-crawl is best understood as access control with a price, not as advertising.
Real-time contextual advertising at the content layer
The third model monetises the read itself. Instead of charging for access or blocking the agent, the publisher allows the visit and earns from a paid, contextually relevant brand mention placed in the text the agent reads. Because Live Search Agents parse text and ignore JavaScript, this has to happen in the content layer, server-side, before the agent processes the page. This is the layer blankspace operates in. When a Live Search Agent retrieves an eligible page, blankspace runs a sub-50ms auction at the CDN edge and injects a relevant brand fact into the content as editorial context, invisible to human readers. Revenue is attributed the same day. It captures the Live Search category that licensing and pay-per-crawl largely miss.
How to choose the right approach
Start by understanding your traffic. Deploy analytics that see AI agents server-side, then look at the mix. If a large share of your AI traffic is training crawlers from a handful of named companies, pay-per-crawl or a licensing conversation may be worth pursuing. If, as is increasingly common, the largest single category is Live Search Agents answering live user questions, then content-layer advertising is the only model that monetises it. The three approaches are not mutually exclusive. A publisher can block scrapers, charge training crawlers, and monetise Live Search retrievals at the same time.
How much is AI traffic worth
Value depends on commercial intent. Pages where a user is close to a purchase decision, such as product comparisons and buying guides, are worth far more than general informational pages, because advertisers will pay to appear in the answer. In live blankspace publisher accounts the average CPM has benchmarked at around $15, comparable to premium programmatic, earned from inventory that was previously generating nothing. High-intent decision-stage segments can be worth considerably more. The point is that AI retrievals are not waste traffic. They are an audience, often a higher-intent audience than human search visitors, arriving at the moment of maximum purchase intent.
Getting started without risk
The safest way to begin is to observe before you monetise. Capture and classify your AI traffic first, see which pages are retrieved and by which agents, review the intent segments and advertiser demand, and only then switch eligible commercial pages into monetisation. Keep sensitive editorial content in observe mode permanently. This sequencing gives you a baseline, confirms the integration works, and prevents the most common mistake, which is monetising before you understand what you have.
Frequently asked questions
Can publishers really get paid when ChatGPT or Perplexity reads their site?
Yes. The read itself can be monetised through contextual advertising placed in the content the agent retrieves, or through access charges if the crawler identifies itself and agrees to pay. The mechanism depends on whether the agent is fetching for a live user answer or crawling for training.
Is blocking AI crawlers better than monetising them?
Blocking protects content but forgoes revenue and can reduce a brand's presence in AI answers. Monetising captures value from traffic that is happening anyway. Many publishers do both selectively: block low-value scrapers, monetise high-intent Live Search retrievals.
Do I need to change my CMS or ad stack to monetise AI traffic?
No. Content-layer monetisation runs at the CDN edge through a lightweight worker on Cloudflare, Akamai, Fastly, CloudFront, or Nginx. It sits between the AI agent and your origin and does not touch your CMS, your server, or your human-facing ad stack.
Why will not pay-per-crawl alone solve this?
Pay-per-crawl charges crawlers that identify themselves and accept the price. Live Search Agents often fetch a single page anonymously to answer a user prompt and are not always willing to pay for access, so a large and growing slice of AI traffic falls outside the model. Content-layer advertising monetises that slice.
How quickly can a publisher see revenue?
With content-layer monetisation, attribution happens at the edge and appears the same day. Revenue typically starts low while your content categories accumulate auction history, then stabilises over the first few weeks as more advertisers target your inventory.