Penguin Random House / robots.txt
← back to penguinrandomhouse.com · change detected 1d ago (2026-09-17T15:11:14Z) · modified +1 −10
What changed
- Blocked user-agent ‘*’ entirely
- Removed Allow: /wp-admin/admin-ajax.php for *
- Removed Allow: /wp-includes/css/dist/block-library/style.min.css for *
- Removed Disallow: /interactive/reading-preference for *
- Removed Disallow: /prh-internal-news/ for *
- Removed Disallow: /search/ for *
- Removed Disallow: /trackback/ for *
- Removed Disallow: /wp-admin/ for *
- Removed Disallow: /wp-content/cache/ for *
- Removed Disallow: /wp-content/plugins/ for *
- Removed Disallow: /wp-includes/ for *
Diff old (2026-06-20T01:10:31Z) → new (2026-09-17T15:11:14Z)
| @@ -1,11 +1,2 @@ | ||
| 1 | 1 | User-agent: * |
| 2 | - Disallow: /wp-admin/ | |
| 3 | - Disallow: /wp-includes/ | |
| 4 | - Disallow: /wp-content/plugins/ | |
| 5 | - Disallow: /wp-content/cache/ | |
| 6 | - Disallow: /trackback/ | |
| 7 | - Disallow: /search/ | |
| 8 | - Disallow: /prh-internal-news/ | |
| 9 | - Disallow: /interactive/reading-preference | |
| 10 | - Allow: /wp-admin/admin-ajax.php | |
| 11 | - Allow: /wp-includes/css/dist/block-library/style.min.css | |
| 2 | + Disallow: / |