The Washington Post / robots.txt
← back to washingtonpost.com · change detected 13d ago (2026-07-22T19:49:29Z) · modified +3 −1
What changed
- 🤖 AIBlocked PerplexityBot (Perplexity) entirely
- 🤖 AIAdded Allow: /advertising/ for PerplexityBot
- 🤖 AIAdded Allow: /creativegroup/ for PerplexityBot
- 🤖 AIRemoved Allow: / for PerplexityBot
Diff old (2026-07-21T19:32:39Z) → new (2026-07-22T19:49:29Z)
| @@ -238,7 +238,9 @@ | ||
| 238 | 238 | Allow: /advertising/ |
| 239 | 239 | |
| 240 | 240 | User-agent: PerplexityBot |
| 241 | - Allow: / | |
| 241 | + Disallow: / | |
| 242 | + Allow: /creativegroup/ | |
| 243 | + Allow: /advertising/ | |
| 242 | 244 | |
| 243 | 245 | User-agent: Primalbot |
| 244 | 246 | Disallow: / |