The Associated Press / robots.txt
← back to apnews.com · change detected 2d ago (2026-11-04T19:33:54Z) · modified +3 −0
What changed
- 🤖 AIBlocked Perplexity-User (Perplexity) entirely
Diff old (2026-10-23T15:24:48Z) → new (2026-11-04T19:33:54Z)
| @@ -52,6 +52,9 @@ | ||
| 52 | 52 | User-agent: PerplexityBot |
| 53 | 53 | Disallow: / |
| 54 | 54 | |
| 55 | + User-agent: Perplexity-User | |
| 56 | + Disallow: / | |
| 57 | + | |
| 55 | 58 | User-agent: Amazonbot |
| 56 | 59 | Disallow: / |
| 57 | 60 |