The Washington Post / robots.txt
← back to washingtonpost.com · change detected 2mo ago (2026-08-10T20:55:49Z) · modified +1 −0
What changed
- Added Disallow: /partials/ for *
Diff old (2026-07-22T19:49:29Z) → new (2026-08-10T20:55:49Z)
| @@ -114,6 +114,7 @@ | ||
| 114 | 114 | Disallow: /discussions/2021/09/13/cookie-policy/ |
| 115 | 115 | Disallow: /discussions/2021/09/13/cookie-policy-eea/ |
| 116 | 116 | Disallow: /privacy-policy/ |
| 117 | + Disallow: /partials/ | |
| 117 | 118 | |
| 118 | 119 | User-agent: Twitterbot |
| 119 | 120 | Allow: /posttv-beta/ |