News Corp / robots.txt snapshot
← back to newscorp.com · fetched 2026-08-24T19:21:08Z (2mo ago) · HTTP 200 · 232 bytes · sha256 0e2d133c2965cd5e · raw
final URL: https://newscorp.com/robots.txt
| 1 | User-agent: * |
| 2 | Disallow: /corporate-governance/supplier-info |
| 3 | |
| 4 | # START YOAST BLOCK |
| 5 | # --------------------------- |
| 6 | User-agent: * |
| 7 | Disallow: |
| 8 | |
| 9 | Sitemap: https://newscorp.com/sitemap_index.xml |
| 10 | # --------------------------- |
| 11 | # END YOAST BLOCK |