Docs › Use the dashboard
AI traffic and AI crawlers
The people AI assistants send to your site, the AI crawlers that read it, why they read, and how much each AI company gives back.
The AI tab (/app/<your-domain>/ai, shortcut 5) puts both sides of AI next to each other: the people an AI assistant sent to your site, and the AI crawlers that read your pages.
The figures
One sentence, then a row of tiles:
- Human visitors: people only, never bots.
- Via AI assistants: people who came through ChatGPT, Perplexity, Claude, Gemini, Copilot, Mistral, DeepSeek, Grok and other assistants.
- AI crawler reads: pages read by AI crawlers.
- Reads per visitor sent, for example “104 : 1”
Each tile shows the change against the previous period and a small chart; click it to see that figure per day with the previous period dashed. A falling ratio is green: AI gives back more.
Training, search or for a user
Every AI crawler has a purpose:
| Purpose | What it means | Examples |
|---|---|---|
| Training | Reads to train models and sends nobody back. | GPTBot, ClaudeBot, CCBot, Bytespider, Meta |
| Search | Builds the index that AI answers draw from. | OAI-SearchBot, Claude-SearchBot, PerplexityBot |
| For a user | Someone just asked a question and the assistant read your page to answer, even if that person did not click through. | ChatGPT-User, Claude-User, Perplexity-User, Mistral, DuckAssist, Gemini Deep Research |
One bar shows the split over the three purposes, with the number, the share and a short explanation for each. “For a user” is visibility in AI answers, even without a click; training is what you can refuse in your robots.txt.
Per AI company: read against sent
For each company (OpenAI, Anthropic, Perplexity, Google, Meta, ByteDance, Common Crawl and others): how often its crawlers read, split by purpose, how many visitors its assistant sent, and the ratio. A company that read but sent nobody is shown in red. The crawler names are listed under each company.
This gives you facts to decide whom to block, and for conversations about licensing.
Pages that AI reads and that AI visitors bring
For each page: how often AI read it (per purpose) and how many people came in through an AI assistant. The 12 most important are shown; Show all lists up to 50. You see which content ends up in AI answers and which actually brings visitors.
Honest about what you cannot see
Most AI crawlers only fetch the HTML and never load the script. Until you forward bots from your server, the tab says the crawler numbers are a minimum, with a link to set that up. And because some AI apps send no referrer, the tab also says the real number of visitors from AI is higher.
Also elsewhere
- AI assistant is a channel of its own in Traffic sources and Reports; filter with
channel:ai. - The AI panel can be added to your Overview.
- Insights tell you when assistants send more or fewer people, or when a crawler reads your site for the first time.
API: GET /v1/sites/{site}/ai?period=7d with humans, referrals, crawlers, ratio, by_company, pages, series, previous_series and complete (whether bots are forwarded from your server).