Track AI crawler visits and visits referred by AI assistants

See which AI systems visit your site and which sources send visitors, with captured events to investigate.

What's inside

Crawler activity by name

See which detected AI crawlers request your pages and how often they visit.

  • Named crawler and provider breakdowns, including GPTBot, ClaudeBot and PerplexityBot.
  • Daily visit counts to identify changes in activity.
  • Compare activity across the websites connected to your workspace.

The pages crawlers visit

Review which parts of your site receive detected crawler requests.

  • Pages ranked by crawler visit count.
  • Page-level evidence to inspect individual requests.
  • Check new pages for detected visits without treating a request as proof of indexing or use in an answer.

Visits referred by AI assistants

Measure incoming visits attributed to AI sources separately from crawler activity.

  • Referral counts by assistant and landing page.
  • Trends over time alongside crawler activity.
  • Use your wider analytics to assess what referred visitors do next.

Browser and server-side tracking

Choose the collection method for your site and the activity you need to measure.

  • A browser snippet for browser activity and assistant referrals.
  • Server-side tracking for requests from crawlers that do not run JavaScript.
  • WordPress plugin, Vercel Log Drain, Bunny CDN forwarding or an HTML snippet, with setup guides for each.

Connect visibility research with site activity

For SEO and web teams measuring AI traffic on their own site.

  1. Connect the site you want to measure

    Add a tracking site and follow its installation instructions. Browser and server-side collection cover different types of activity.

  2. Separate visits by type and source

    Review crawler activity and AI referrals independently. Inspect source and page breakdowns to understand where activity is concentrated.

  3. Investigate captured events

    Check event evidence before drawing conclusions. Bring referral patterns into your wider analytics review when assessing visitor quality and business outcomes.

Plan availability

AI traffic and crawler tracking are included on every paid plan. Starter supports one website. CSV export starts on Business.

Compare plans
AI Traffic availability and limits by plan
FeatureStarterBusinessEnterpriseCustom
Tracked websites1310Unlimited
History90 days90 days12 monthsUnlimited
ExportsNot includedCSVCSV and PDFCSV, PDF and API

Pairs with

Questions and answers

What is an AI crawler?

An AI crawler is an automated system that requests web pages. Cleotic identifies detected crawler requests separately from visitor referrals. A request does not establish that a page was indexed, used for training or included in an answer.

Will tracking slow my site down?

The browser snippet loads without blocking the page. Server-side connections collect request data without adding browser code for crawler tracking. Follow the setup instructions for your platform and check performance after installation.

Do I need a developer to connect my site?

It depends on your platform and access. If you can add a tracking snippet, you can set up browser collection. Server-side connections and sites with managed deployment processes may need a developer. The documentation covers the supported methods.

Why do these numbers differ from my analytics tool?

The tools may collect and classify different events. Many analytics tools exclude bots, while Cleotic reports detected crawler requests separately. Referral attribution also depends on the information available with a visit, so compare equivalent traffic types and date ranges.

Should I block AI crawlers?

That depends on your content and business priorities. Review each crawler's purpose and your access policies before changing them. The traffic data shows detected requests; blocking or allowing a crawler does not by itself guarantee exclusion from AI systems or inclusion in their answers.

Which plans include AI traffic tracking?

Every paid plan includes it. Starter supports one website, Business three, Enterprise ten, and Custom unlimited websites. CSV export starts on Business.

Start measuring AI activity on your site

Create a workspace, connect a tracking site, and follow the installation guide for your setup.