🇺🇸 Poe

poe.com · SEO & AI search · rank #49 · AI chat aggregation · live robots.txt ↗

AI crawler access (latest snapshot, 4h ago)

⛔blocked restricted ✅allowed faded = inherited from the * wildcard group

✅GPTBot

⛔ChatGPT-User

⛔OAI-SearchBot

⛔ClaudeBot

⛔Claude-User

⛔Claude-SearchBot

⛔anthropic-ai

⛔Claude-Web

⛔CCBot

✅Google-Extended

⛔Applebot-Extended

⛔PerplexityBot

⛔Perplexity-User

⛔Bytespider

⛔Amazonbot

⛔FacebookBot

⛔meta-externalagent

⛔meta-externalfetcher

⛔cohere-ai

⛔AI2Bot

⛔Diffbot

⛔omgili

⛔YouBot

⛔DuckAssistBot

⛔MistralAI-User

⛔PanguBot

⛔Timpibot

Current robots.txt 510 bytes · sha256 308d4bf5fb63 · raw

User-agent: Googlebot
Allow: /

User-agent: Bingbot
Allow: /

User-agent: msnbot
Allow: /

User-agent: DuckDuckBot
Allow: /

User-Agent: GPTBot
Disallow: /p/*

User-Agent: Google-Extended
Disallow: /p/*

User-Agent: *
Allow: /*/api
Disallow: /_next/
Disallow: /api/
Disallow: /chat/
Disallow: /s/
Disallow: /apple_callback
Disallow: /chats
Disallow: /continue_chat
Disallow: /desktop_app_open
Disallow: /google_callback
Disallow: /login
Disallow: /search
Disallow: /settings
Disallow: /unsubscribe
Disallow: /

Change history

initial 4h ago snapshot
- First snapshot of robots.txt archived