🇺🇸 Discord

discord.com · Social Networks · rank #12 · Messaging · live robots.txt ↗

AI crawler access (latest snapshot, 13h ago)

⛔blocked restricted ✅allowed faded = inherited from the * wildcard group

✅GPTBot

✅ChatGPT-User

✅OAI-SearchBot

✅ClaudeBot

✅Claude-User

✅Claude-SearchBot

✅anthropic-ai

✅Claude-Web

✅CCBot

✅Google-Extended

✅Applebot-Extended

✅PerplexityBot

✅Perplexity-User

✅Bytespider

✅Amazonbot

✅FacebookBot

✅meta-externalagent

✅meta-externalfetcher

✅cohere-ai

✅AI2Bot

✅Diffbot

✅omgili

✅YouBot

✅DuckAssistBot

✅MistralAI-User

✅PanguBot

✅Timpibot

Current robots.txt 1717 bytes · sha256 3b8820b34412 · raw

User-agent: *
Allow: /api/v*/store
Allow: /api/v*/applications
Allow: /api/v*/application-directory-static
Allow: /api/v*/invite
Allow: /api/v*/discovery
Allow: /api/discovery
Allow: /invite
Allow: /invite/
Allow: /terms
Allow: /privacy
Disallow: /channels
Disallow: /channels/
Disallow: /verify
Disallow: /verify/
Disallow: /reset
Disallow: /reset/
Disallow: /authorize-ip
Disallow: /authorize-ip/
Disallow: /reject-ip
Disallow: /reject-ip/
Disallow: /reject-mfa
Disallow: /reject-mfa/
Disallow: /oauth2
Disallow: /oauth2/
Disallow: /api
Disallow: /api/
Disallow: /widget
Disallow: /widget/
Disallow: /profile/
Disallow: /report-review
Disallow: /report-review/
Disallow: /store/skus/
Disallow: /wasntme
Disallow: /wasntme/

User-agent: Twitterbot
Disallow: /channels
Disallow: /channels/
Disallow: /verify
Disallow: /verify/
Disallow: /reset
Disallow: /reset/
Disallow: /authorize-ip
Disallow: /authorize-ip/
Disallow: /reject-ip
Disallow: /reject-ip/
Disallow: /reject-mfa
Disallow: /reject-mfa/
Disallow: /report-review
Disallow: /report-review/
Disallow: /oauth2
Disallow: /oauth2/
Disallow: /api
Disallow: /api/
Disallow: /widget
Disallow: /widget/
Disallow: /profile/
Allow: /api/v*/application-directory-static
Allow: /invite
Allow: /invite/
Allow: /terms
Allow: /privacy

User-agent: nsa
Disallow: /

Sitemap: https://discord.com/servers/servers-sitemap-index.xml
Sitemap: https://discord.com/servers/servers-parent-search-sitemap-index.xml
Sitemap: https://discord.com/application-directory-seo/sitemap-index.xml
Sitemap: https://discord.com/announcements/announcements-sitemap-index.xml
Sitemap: https://discord.com/trending-games/trending-games-sitemap-index.xml
Sitemap: https://discord.com/blog/rss.xml

Change history

initial 13h ago snapshot
- First snapshot of robots.txt archived