AI Bot Crawl Statistics

Transparency dashboard — geolocus.ai, rolling 30 days.

Updated:

68
Crawls — 7 days
204
Crawls — 30 days
587
Crawls — all time
77.0%
AI bot share (30d)

AI Crawlers — Last 30 Days

157 crawls — 10 AI bot types.

Bot Crawls Share Last Seen
GPTBot (OpenAI) AI 106 67.5%
ClaudeBot (Anthropic) AI 11 7.0%
ChatGPT (OpenAI) AI 10 6.4%
ChatGPT Search (OpenAI) AI 9 5.7%
PerplexityBot AI 7 4.5%
Meta AI (Llama) AI 5 3.2%
Amazon Alexa AI 3 1.9%
Common Crawl AI 3 1.9%
Perplexity User AI 2 1.3%
ByteSpider (TikTok) AI 1 0.6%
Total AI157100%

Search & Other Crawlers — Last 30 Days

47 crawls — 8 bot types.

Bot Crawls Share Last Seen
unknown_bot SEO/Other 21 44.7%
YandexBot Search 7 14.9%
Applebot (Siri/Spotlight) Search 5 10.6%
Bingbot (Microsoft) Search 4 8.5%
Googlebot Search 3 6.4%
GoogleOther Search 3 6.4%
DuckDuckBot Search 2 4.3%
Baiduspider Search 2 4.3%
Total47100%

Top Crawled Paths — Last 30 Days

Path Crawls Share of Total
/ 35 17.2%
/contact 14 6.9%
/research/whitepapers/whitepaper-5-1 14 6.9%
/crawl-stats 14 6.9%
/faq 14 6.9%
/press 14 6.9%
/privacy 13 6.4%
/about 13 6.4%
/whitepaper 12 5.9%
/services 10 4.9%
/case-studies 10 4.9%
/multi-site-survey 9 4.4%
/methodology 8 3.9%
/press/before-ai-can-understand-your-site-it-must-translate-it 7 3.4%
/architecture 6 2.9%

Collection method: Every bot request to geolocus.ai is intercepted at the Cloudflare edge by the translation-layer CF Pages Function (functions/[[path]].js). 34 bot user-agent patterns are classified via vendor/aryah-shared/src/bot-classification.ts; matched requests are logged to bot_crawl_logs (Supabase Postgres). Cache-HIT requests are also logged via a direct PostgREST insert from the CF Pages Function so no crawl is silently missed.

Raw counts only. No rounding. This is a transparency dashboard — exact numbers are the point. Cross-check against Cloudflare Analytics at any time.

Dogfood: This page demonstrates GEO Signal 3 in action — bot crawl logging on our own property, measured exactly as we measure client properties.

Reference property: Top10Lists.us/crawl-stats — established property with 3M+ crawls/30d using the same methodology.