NeuralCrawl

Penguin Random House / robots.txt snapshot

← back to penguinrandomhouse.com · fetched 2026-06-20T01:10:31Z (15h ago) · HTTP 200 · 321 bytes · sha256 8a2381e3080a76b1 · raw

final URL: https://www.penguinrandomhouse.com/robots.txt

1User-agent: *
2Disallow: /wp-admin/
3Disallow: /wp-includes/
4Disallow: /wp-content/plugins/
5Disallow: /wp-content/cache/
6Disallow: /trackback/
7Disallow: /search/
8Disallow: /prh-internal-news/
9Disallow: /interactive/reading-preference
10Allow: /wp-admin/admin-ajax.php
11Allow: /wp-includes/css/dist/block-library/style.min.css