πΊπΈ ElevenLabs
elevenlabs.io · Top 1000 websites · rank #13 · AI Chatbots and Tools · live robots.txt ↗
AI crawler access (latest snapshot, 13h ago)
⛔blocked
restricted
✅allowed
faded = inherited from the * wildcard group
✅GPTBot
✅ChatGPT-User
✅OAI-SearchBot
✅ClaudeBot
✅Claude-User
✅Claude-SearchBot
✅anthropic-ai
✅Claude-Web
✅CCBot
✅Google-Extended
✅Applebot-Extended
✅PerplexityBot
✅Perplexity-User
✅Bytespider
✅Amazonbot
✅FacebookBot
✅meta-externalagent
✅meta-externalfetcher
✅cohere-ai
✅AI2Bot
✅Diffbot
✅omgili
✅YouBot
✅DuckAssistBot
✅MistralAI-User
✅PanguBot
✅Timpibot
Current robots.txt 1216 bytes · sha256 80c8b14a1317 · raw
User-Agent: Twitterbot Allow: / Allow: /share/ Allow: /embed/ Allow: /app/sign-in Allow: /app/sign-up Disallow: /admin Disallow: /app/redirect-external/ Disallow: /legal/ Disallow: /hog/ Disallow: /dachshund/ Disallow: /feature-flags/ Disallow: /app/sign-in? Disallow: /app/sign-up? Disallow: */abtest/ Disallow: */p/ Disallow: /sentry-monitoring Disallow: /docs/api/ Disallow: /next/ Disallow: /v1/ Allow: /app/flows Disallow: /app/agents Disallow: /app/api Disallow: /app/developers Disallow: /app/files Disallow: /app/settings Disallow: /app/subscription User-Agent: * Content-Signal: ai-train=yes, search=yes, ai-input=yes Allow: / Allow: /share/ Allow: /embed/ Allow: /app/sign-in Allow: /app/sign-up Disallow: /admin Disallow: /app/redirect-external/ Disallow: /legal/ Disallow: /hog/ Disallow: /dachshund/ Disallow: /feature-flags/ Disallow: /app/sign-in? Disallow: /app/sign-up? Disallow: */abtest/ Disallow: */p/ Disallow: /sentry-monitoring Disallow: /docs/api/ Disallow: /next/ Disallow: /v1/ Disallow: /app/ Sitemap: https://elevenlabs.io/sitemap.xml Sitemap: https://help.elevenlabs.io/hc/sitemap.xml Sitemap: https://elevenlabs.io/docs/sitemap.xml Sitemap: https://showcase.elevenlabs.io/sitemap.xml
Change history
-
initial snapshot
- First snapshot of robots.txt archived