NRG Energy / robots.txt snapshot
← back to nrg.com · fetched 2026-10-04T02:35:37Z (1mo ago) · HTTP 200 · 334 bytes · sha256 ad719ef624b9f5fa · raw
final URL: https://www.nrg.com/robots.txt
| 1 | User-agent: * |
| 2 | |
| 3 | Disallow: */search |
| 4 | Disallow: *?keyword=* |
| 5 | |
| 6 | User-agent: Baiduspider |
| 7 | User-agent: Baiduspider-video |
| 8 | User-agent: Baiduspider-image |
| 9 | User-agent: Baiduspider-ads |
| 10 | User-agent: Baiduspider-cpro |
| 11 | User-agent: Baiduspider-favo |
| 12 | User-agent: Baiduspider-news |
| 13 | User-agent: PetalBot |
| 14 | Disallow: / |
| 15 | |
| 16 | Sitemap: https://www.nrg.com/en.sitemap.xml |