πΊπΈ Steampowered
steampowered.com · Top 1000 websites · rank #101 · Web · live robots.txt ↗
AI crawler access (latest snapshot, 1h ago)
⛔blocked
restricted
✅allowed
faded = inherited from the * wildcard group
✅GPTBot
✅ChatGPT-User
✅OAI-SearchBot
✅ClaudeBot
✅Claude-User
✅Claude-SearchBot
✅anthropic-ai
✅Claude-Web
✅CCBot
✅Google-Extended
✅Applebot-Extended
✅PerplexityBot
✅Perplexity-User
✅Bytespider
✅Amazonbot
✅FacebookBot
✅meta-externalagent
✅meta-externalfetcher
✅cohere-ai
✅AI2Bot
✅Diffbot
✅omgili
✅YouBot
✅DuckAssistBot
✅MistralAI-User
✅PanguBot
✅Timpibot
Current robots.txt 303 bytes · sha256 d7943b2b8e93 · raw
Host: store.steampowered.com User-Agent: * Disallow: /share/ Disallow: /news/externalpost/ Disallow: /account/emailoptout/?*token= Disallow: /account/notificationsettings/?*token= Disallow: /login/?*guestpasskey= Disallow: /join/?*redir= Disallow: /account/ackgift/ Disallow: /email/ Disallow: /widget/
Change history
-
initial snapshot
- First snapshot of robots.txt archived