IGN / robots.txt
← back to ign.com · change detected 23d ago (2026-08-26T20:03:19Z) · modified +1 −1
What changed
- Added Allow: /sponsored/ for "008"
- Removed Allow: /sponsored/ for *
- Added Allow: /sponsored/ for AddSearchBot
- 🤖 AIAdded Allow: /sponsored/ for AI2Bot
- Added Allow: /sponsored/ for Ai2Bot-DeepResearchEval
- Added Allow: /sponsored/ for Ai2Bot-Dolma
- 🤖 AIAdded Allow: /sponsored/ for Amazonbot
- Added Allow: /sponsored/ for AmazonBuyForMe
- Added Allow: /sponsored/ for Anchor Browser
- 🤖 AIAdded Allow: /sponsored/ for anthropic-ai
- Added Allow: /sponsored/ for Applebot
- 🤖 AIAdded Allow: /sponsored/ for Applebot-extended
- Added Allow: /sponsored/ for atlassian-bot
- Added Allow: /sponsored/ for AutoRAG
- Added Allow: /sponsored/ for AwarioSmartBot
- Added Allow: /sponsored/ for Big Sur AI
- Added Allow: /sponsored/ for bigsur.ai
- Added Allow: /sponsored/ for Brandwatch
- Added Allow: /sponsored/ for Bravebot
- 🤖 AIAdded Allow: /sponsored/ for Bytespider
- 🤖 AIAdded Allow: /sponsored/ for CCBot
- Added Allow: /sponsored/ for Channel3Bot
- Added Allow: /sponsored/ for ChatGLM-Spider
- 🤖 AIAdded Allow: /sponsored/ for Claude-SearchBot
- 🤖 AIAdded Allow: /sponsored/ for Claude-User
- 🤖 AIAdded Allow: /sponsored/ for Claude-Web
- 🤖 AIAdded Allow: /sponsored/ for ClaudeBot
- 🤖 AIAdded Allow: /sponsored/ for cohere-ai
- Added Allow: /sponsored/ for cohere-training-data-crawler
- Added Allow: /sponsored/ for Cotoyogi
- Added Allow: /sponsored/ for Crawl4AI
- Added Allow: /sponsored/ for Datenbank Crawler
- Added Allow: /sponsored/ for DDM*
- Added Allow: /sponsored/ for DDM-DCipher*
- Added Allow: /sponsored/ for DDM-DCipher/1.0.7
- Added Allow: /sponsored/ for DeepSeekBot
- Added Allow: /sponsored/ for Devin
- 🤖 AIAdded Allow: /sponsored/ for Diffbot
- Added Allow: /sponsored/ for Direqt Anomura
- 🤖 AIAdded Allow: /sponsored/ for DuckAssistBot
- Added Allow: /sponsored/ for Echobot Bot
- 🤖 AIAdded Allow: /sponsored/ for FacebookBot
- Added Allow: /sponsored/ for Factset_spyderbot
- Added Allow: /sponsored/ for HTTrack
- Added Allow: /sponsored/ for iAsk
- Added Allow: /sponsored/ for iaskspider
- Added Allow: /sponsored/ for ICC Crawler
- Added Allow: /sponsored/ for ICC-Crawler
- Added Allow: /sponsored/ for ImageSiftBot
- Added Allow: /sponsored/ for imageSpider
- ... and 43 more change(s)
Diff old (2026-08-23T06:58:34Z) → new (2026-08-26T20:03:19Z)
| @@ -12,7 +12,6 @@ | ||
| 12 | 12 | # Contact [email protected] for assistance. |
| 13 | 13 | |
| 14 | 14 | User-agent: * |
| 15 | - Allow: /sponsored/ | |
| 16 | 15 | Disallow: /_views/ |
| 17 | 16 | Disallow: /apiproxy |
| 18 | 17 | Disallow: */empty/ |
| @@ -265,6 +264,7 @@ | ||
| 265 | 264 | Allow: /wikis/the-legend-of-zelda-breath-of-the-wild/Shrines |
| 266 | 265 | Allow: /wikis/the-legend-of-zelda-tears-of-the-kingdom/All_Shrine_Locations_and_Solutions |
| 267 | 266 | Allow: /wikis/vv-ultimatum-roblox/VV_ULTIMATUM_Codes |
| 267 | + Allow: /sponsored/ | |
| 268 | 268 | Disallow: / |
| 269 | 269 | |
| 270 | 270 | User-agent: DuckDuckBot |