🇺🇸 Andi Search

andisearch.com · SEO & AI search · rank #31 · AI answer engine · live robots.txt ↗

AI crawler access (latest snapshot, 4h ago)

⛔blocked restricted ✅allowed faded = inherited from the * wildcard group

✅GPTBot

✅ChatGPT-User

✅OAI-SearchBot

✅ClaudeBot

✅Claude-User

✅Claude-SearchBot

✅anthropic-ai

✅Claude-Web

✅CCBot

✅Google-Extended

✅Applebot-Extended

✅PerplexityBot

✅Perplexity-User

✅Bytespider

✅Amazonbot

✅FacebookBot

✅meta-externalagent

✅meta-externalfetcher

✅cohere-ai

✅AI2Bot

✅Diffbot

✅omgili

✅YouBot

✅DuckAssistBot

✅MistralAI-User

✅PanguBot

✅Timpibot

Current robots.txt 297 bytes · sha256 979054ee343d · raw

# https://www.robotstxt.org/robotstxt.html
# Allow access to root homepage and specific pages only
User-agent: *
Allow: /about/
Allow: /help/
Allow: /privacy/
Allow: /commands/
Allow: /default/
Allow: /static/
Allow: /sitemap.txt
Allow: /$
Disallow: /*
Sitemap: https://andisearch.com/sitemap.txt

Change history

initial 4h ago snapshot
- First snapshot of robots.txt archived