AI Bot Crawl Statistics

Transparency dashboard — geolocus.ai, rolling 30 days.

Updated:

13
Crawls — 7 days
113
Crawls — 30 days
934
Crawls — all time
61.1%
AI bot share (30d)

AI Crawlers — Last 30 Days

69 crawls — 6 AI bot types.

Bot Crawls Share Last Seen
GPTBot (OpenAI) AI 46 66.7%
ClaudeBot (Anthropic) AI 11 15.9%
Meta AI (Llama) AI 5 7.2%
ChatGPT (OpenAI) AI 4 5.8%
PerplexityBot AI 2 2.9%
Amazon Alexa AI 1 1.4%
Total AI69100%

Search & Other Crawlers — Last 30 Days

44 crawls — 6 bot types.

Bot Crawls Share Last Seen
unknown_bot SEO/Other 30 68.2%
Baiduspider Search 4 9.1%
Bingbot (Microsoft) Search 3 6.8%
YandexBot Search 3 6.8%
Applebot (Siri/Spotlight) Search 2 4.5%
Googlebot Search 2 4.5%
Total44100%

Top Crawled Paths — Last 30 Days

Path Crawls Share of Total
/ 19 16.8%
/about 10 8.8%
/contact 9 8.0%
/press 9 8.0%
/faq 9 8.0%
/whitepaper 8 7.1%
/research/whitepapers/whitepaper-5-1 8 7.1%
/privacy 7 6.2%
/case-studies 7 6.2%
/services 7 6.2%
/crawl-stats 6 5.3%
/press/before-ai-can-understand-your-site-it-must-translate-it 5 4.4%
/press/why-gemini-called-top10lists-us-the-gold-standard-for-professional-verification 4 3.5%
/multi-site-survey 3 2.7%
/architecture 1 0.9%

Collection method: Every bot request to geolocus.ai is intercepted at the Cloudflare edge by the translation-layer CF Pages Function (functions/[[path]].js). 34 bot user-agent patterns are classified via vendor/aryah-shared/src/bot-classification.ts; matched requests are logged to bot_crawl_logs (Supabase Postgres). Cache-HIT requests are also logged via a direct PostgREST insert from the CF Pages Function so no crawl is silently missed.

Raw counts only. No rounding. This is a transparency dashboard — exact numbers are the point. Cross-check against Cloudflare Analytics at any time.

Dogfood: This page demonstrates GEO Signal 3 in action — bot crawl logging on our own property, measured exactly as we measure client properties.

Reference property: Top10Lists.us/crawl-stats — established property with 3M+ crawls/30d using the same methodology.