NeuralCrawl

πŸ‡ΊπŸ‡Έ Slack

slack.com · Top 1000 websites · rank #114 · Web · live robots.txt ↗

AI crawler access (latest snapshot, 1h ago)

blocked restricted allowed faded = inherited from the * wildcard group

GPTBot
ChatGPT-User
OAI-SearchBot
ClaudeBot
Claude-User
Claude-SearchBot
anthropic-ai
Claude-Web
CCBot
Google-Extended
Applebot-Extended
PerplexityBot
Perplexity-User
Bytespider
Amazonbot
FacebookBot
meta-externalagent
meta-externalfetcher
cohere-ai
AI2Bot
Diffbot
omgili
YouBot
DuckAssistBot
MistralAI-User
PanguBot
Timpibot

Current robots.txt 578 bytes · sha256 af5c7b2afdf5 · raw

User-agent: *
Disallow: /messages
Disallow: /quickstart
Disallow: /go/
Disallow: /unsub/
Disallow: /answers/
Disallow: /help/requests/new?app_id=*
Disallow: /what-is-slack
Disallow: /collaborating-with-slack
Disallow: /lp/three
Disallow: /documents/slack_pilot_dpa
Disallow: /openid
Disallow: /oauth
Disallow: /careers/
Disallow: /join/shared_invite
Disallow: /*?*
Disallow: /files-pri/
Allow: /*?geocode=*
Allow: /*?*&geocode=*

Sitemap: https://slack.com/sitemap.xml
Sitemap: https://slack.com/sitemap_marketplace.xml
Sitemap: https://slack.com/sitemaps/blog/news/sitemap.xml

Change history

  1. initial snapshot
    • First snapshot of robots.txt archived