Norfolk Southern / robots.txt snapshot
← back to norfolksouthern.com · fetched 2026-07-14T10:57:07Z (24d ago) · HTTP 200 · 435 bytes · sha256 d77687e7115110be · raw
final URL: https://norfolksouthern.com/robots.txt
| 1 | # robots.txt — allow all verified crawlers |
| 2 | # Encoding: UTF-8 |
| 3 | # Location: https://www.norfolksouthern.com/robots.txt |
| 4 | |
| 5 | # Global rule |
| 6 | User-agent: * |
| 7 | Disallow: |
| 8 | |
| 9 | # Explicit allowances for verified AI and search crawlers |
| 10 | User-agent: GPTBot |
| 11 | Allow: / |
| 12 | |
| 13 | User-agent: PerplexityBot |
| 14 | Allow: / |
| 15 | |
| 16 | User-agent: Claude-Web |
| 17 | Allow: / |
| 18 | |
| 19 | # Sitemaps |
| 20 | Sitemap: https://www.norfolksouthern.com/sitemap.xml |
| 21 | Sitemap: https://www.norfolksouthern.com/sitemap_index.xml |