← Back to blog

What is Grok, and what does it mean for publishers?

Grok is xAI's AI assistant, built natively into X and available at grok.com, and by early 2026 it had become the third most-used chatbot in the United States. For publishers it is one of the most extractive AI surfaces in the market: it reads the open web and live X posts to answer questions, returns almost no referral traffic, and runs a retrieval crawler that routinely ignores robots.txt by presenting itself as an ordinary human visitor.


Most AI assistants announce themselves when they read a website. Grok largely does not. Behavioural reports through 2026 describe its retrieval traffic arriving from rotating residential IP addresses behind ordinary browser user-agent strings, which means much of what Grok reads looks like a person rather than a bot. That single trait shapes almost everything publishers need to know about it. Grok is the generative assistant built by Elon Musk's xAI, embedded directly in the X platform (formerly Twitter) and offered as a standalone product at grok.com and through mobile apps, and it answers questions by combining a trained model with live retrieval from the open web and from real-time posts on X.

What is Grok?

Grok is xAI's family of conversational AI products. It began as a chatbot available to paying X subscribers in late 2023, positioned by xAI as a less filtered, more irreverent alternative to ChatGPT, and has since grown into a full assistant with web search, image generation, voice, and an agentic "DeepSearch" research mode. It runs in three main places: inside X itself, where users can summon it to summarise threads or fact-check posts; at grok.com and in dedicated iOS and Android apps; and through an API for developers. What distinguishes Grok from the other large assistants is its native wiring into a live social network. Where ChatGPT, Gemini and Copilot reach the open web through search partners, Grok sits inside the firehose of X and can read what is being posted there as it happens.

How big is Grok's reach?

Grok has grown from a niche subscriber perk into one of the most used assistants in the United States. Its US chatbot market share rose from roughly 1.9 percent in January 2025 to around 17.8 percent by January 2026, making it the third most-used chatbot in the country behind ChatGPT and Gemini. Standalone usage climbed in parallel: grok.com received an estimated 234 million visits in November 2025, rising to roughly 326 million by March 2026, and xAI reported on the order of 64 million monthly active users in September 2025. The reach is not uncontested. By Cloudflare Radar's ranking of AI services, Grok had slipped to around eighth by June 2026, a reminder that the assistant market is volatile and that headline market-share figures vary widely by methodology and by whether in-X usage is counted. For publishers the practical conclusion is steady regardless of the exact number: a large and growing audience is asking Grok questions and receiving answers built partly from published content.

How does Grok source its answers?

Grok draws on three pools of content, and only one behaves the way publishers expect. The first is training data, the large corpus xAI uses to build the underlying models, which can include web content and public X posts. The second is live retrieval from the open web, where Grok fetches and reads pages to answer time-sensitive questions, much as other live search agents do. The third, and the most distinctive, is real-time access to X: Grok can read public posts, threads and trends as they appear, summarise what is going viral in a niche, and reflect fast-moving events within minutes. That social layer makes Grok strong on current affairs and breaking news, and it means a meaningful share of Grok's answers are assembled from content created inside X rather than from open-web articles. The open-web read still matters, though, and it is the part publishers can neither see clearly nor easily control.

Why doesn't blocking Grok's crawler work?

This is where Grok differs sharply from a compliant assistant, and it is the most important point for publishers. xAI does document official user agents for its crawlers, including strings such as GrokBot, xAI-Grok and Grok-DeepSearch, which a publisher could in principle target in robots.txt. In practice, multiple crawler-tracking reports in 2026 found that Grok's retrieval traffic frequently does not present those declared user agents at all. Instead it has been observed arriving as outdated Chrome and mobile Safari strings, as generic Go-http-client requests, and from rotating residential IP addresses, which makes it functionally indistinguishable from a genuine human visitor. A robots.txt rule only works if the bot identifies itself and chooses to obey, so a disallow directive aimed at GrokBot does little when the actual fetch looks like a person on an iPhone. This contrasts with assistants such as Anthropic's Claude, which checks robots.txt before fetching, and Meta's training crawler, which is documented as respecting it. The consequence is concrete: for Grok, declared access controls are unreliable, and the only dependable way to identify the read is to detect it by behaviour at the server or CDN edge, using signals such as request bursts, datacentre and residential IP patterns, impossible navigation speeds and stale browser versions.

How much referral traffic does Grok send publishers?

In practice, almost none. Analyses of AI referral data in 2026 placed Grok among the most self-contained assistants of all, with very high in-session depth and effectively zero measurable outbound referral traffic in business panels. It is built as a destination that keeps the user inside X or inside its own app, not as a search interface that hands visitors onward to source pages. The content a publisher produces can still shape a Grok answer, whether through training, an open-web fetch or a surfaced X post, but it does not generate a page view, an ad impression or a subscription prompt for the site that produced it. Grok therefore expresses the central asymmetry of the AI era in an especially stark form: the read happens, often disguised as ordinary traffic, the answer is delivered inside X, and the publisher sees neither the visit nor the value.

What does advertising inside Grok mean for brands?

Grok is also becoming an advertising surface, which matters to the advertiser side of the audience as much as the publisher side. X has confirmed plans to place ads inside Grok's answers, allowing brands to pay for their messages to appear within the assistant's suggested solutions when a user asks a relevant question. In April 2026 X announced what it called the biggest refresh of its ad system in the company's history, rebuilt on xAI models, with Grok handling contextual and semantic ad targeting, brand-safety assessment and product-recommendation tailoring. It also rolled out creative tools such as "Prefill with Grok", which generates ad copy, imagery and a headline from a brand's URL. The strategic logic is the size of the prize: AI search advertising is forecast to become a market worth around 25 billion dollars by 2029, and X, whose ad sales were about 1.8 billion dollars in 2025, is positioning Grok to capture a share of it. For brands this is a new contextual placement to evaluate. For publishers it underlines the pattern: the value created when an assistant answers from web content is increasingly monetised by the assistant, at the answer, rather than shared with the source.

What should publishers do about Grok?

Start with measurement, because Grok is close to invisible in the tools most publishers rely on. The read sends almost no referral, so it barely registers in referral reports, and because the crawl often disguises itself as a human it can be miscounted as ordinary audience in client-side analytics rather than flagged as a bot. The only place a Grok-style read is reliably observable is in server-side logs at the CDN edge, where behavioural signals expose retrieval traffic that declared user agents would never reveal. The second step is to recognise that the usual access lever is weak here: a robots.txt block aimed at GrokBot will not stop a fetch that arrives looking like a browser, so meaningful control has to move to edge-level detection and enforcement rather than a file the crawler can ignore. This is the layer blankspace operates at. By identifying AI and Live Search Agent traffic at the CDN edge through behaviour rather than self-declared identity, blankspace lets publishers see reads that analytics and robots.txt miss, including from assistants that decline to announce themselves, and decide whether to block them or treat them as monetisable inventory.

Frequently asked questions

Is Grok the same as ChatGPT?

No. Grok is xAI's assistant, created by Elon Musk's company and wired directly into the X platform, while ChatGPT is OpenAI's separate product. The most important difference for publishers is Grok's native access to live X posts and its reputation for retrieval traffic that disguises itself as a human visitor, which together make it both strong on real-time content and unusually difficult to identify and control at the access layer.

Does Grok read content from my website?

Very likely. Grok uses web content for model training and also fetches live pages to answer time-sensitive questions. The complication is that its retrieval crawl has frequently been observed using ordinary browser user-agent strings and rotating residential IP addresses rather than its declared bot identities, so a site can be read by Grok without any clear "GrokBot" entry appearing in its logs.

Can I block Grok with robots.txt?

Only unreliably. xAI documents official user agents such as GrokBot, xAI-Grok and Grok-DeepSearch that you can target in robots.txt, but 2026 crawler reports found Grok's actual retrieval traffic often does not use them, instead spoofing Chrome and Safari strings from residential IPs. Because robots.txt depends on a bot identifying itself and choosing to comply, the dependable approach for Grok is behavioural detection and enforcement at the server or CDN edge.

Does Grok send any traffic to publishers?

In practice, almost none. 2026 AI referral analyses found Grok has very high in-session depth and effectively zero measurable outbound referral traffic, because it is designed to keep users inside X or its own app rather than send them to source pages. Publishers should treat Grok as a content-consumption surface, not a traffic source.

What does it mean that X is putting ads in Grok?

X has confirmed it will place advertising inside Grok's answers and has rebuilt its ad system on xAI models, with Grok powering contextual targeting, brand-safety checks and product recommendations. For advertisers this is a new in-answer placement to assess. For publishers it reinforces the core dynamic of AI search: the revenue generated when an assistant answers from web content accrues to the assistant at the point of the answer, not to the publisher whose content informed it.