The Washington Post / robots.txt
← back to washingtonpost.com · change detected 14d ago (2026-07-21T19:32:39Z) · modified +1 −3
What changed
- 🤖 AIUnblocked PerplexityBot (Perplexity)
- 🤖 AIAdded Allow: / for PerplexityBot
- 🤖 AIRemoved Allow: /advertising/ for PerplexityBot
- 🤖 AIRemoved Allow: /creativegroup/ for PerplexityBot
Diff old (2026-06-20T01:10:30Z) → new (2026-07-21T19:32:39Z)
| @@ -238,9 +238,7 @@ | ||
| 238 | 238 | Allow: /advertising/ |
| 239 | 239 | |
| 240 | 240 | User-agent: PerplexityBot |
| 241 | - Disallow: / | |
| 242 | - Allow: /creativegroup/ | |
| 243 | - Allow: /advertising/ | |
| 241 | + Allow: / | |
| 244 | 242 | |
| 245 | 243 | User-agent: Primalbot |
| 246 | 244 | Disallow: / |