NPR / robots.txt
← back to npr.org · change detected 11d ago (2026-10-26T22:30:46Z) · modified +3 −0
What changed
- 🤖 AIBlocked meta-externalagent (Meta) entirely
Diff old (2026-09-22T16:26:18Z) → new (2026-10-26T22:30:46Z)
| @@ -86,6 +86,9 @@ | ||
| 86 | 86 | Disallow: / |
| 87 | 87 | |
| 88 | 88 | User-agent: FacebookBot |
| 89 | + Disallow: / | |
| 90 | + | |
| 91 | + User-agent: Meta-ExternalAgent | |
| 89 | 92 | Disallow: / |
| 90 | 93 | |
| 91 | 94 | User-agent: omgili |