crawler-analytics

Here are 3 public repositories matching this topic...

waseemnasir2k26 / aeo-crawl-radar

Parse your server logs to see which AI crawlers actually visited - GPTBot, ClaudeBot, PerplexityBot, Google-Extended and 20 more. Sitemap-gap report shows which pages no AI engine has ever fetched. nginx/Apache/Cloudflare/Vercel, SQLite, optional reverse-DNS verification.

Updated Sep 16, 2026
Python

Mormolykos / GEO-Observatory

Star

Append-only observability platform for AI crawler and search engine discovery.

python flask sqlite seo geo telemetry cloudflare observability bot-detection reverse-dns search-console append-only nginx-logs generative-engine-optimization crawler-analytics ai-crawlers

Updated Aug 27, 2026
Python

Alex9001 / cybermaps

Star

WordPress sitemaps + AI-readable publishing. XML sitemaps, llms.txt, Markdown, structured discovery, delivery diagnostics, and local crawler analytics.

markdown open-source php wordpress wordpress-plugin sitemap seo schema-org robots-txt xml-sitemap structured-data content-discovery json-feed technical-seo indexnow llms-txt crawler-analytics ai-discovery

Updated Sep 28, 2026
PHP

Add this topic to your repo

To associate your repository with the crawler-analytics topic, visit your repo's landing page and select "manage topics."

Learn more