PetroChina / robots.txt snapshot
← back to cnpc.com.cn · fetched 2026-06-21T15:15:48Z (21h ago) · HTTP 200 · 173 bytes · sha256 3011877f8b09e956 · raw
final URL: https://www.cnpc.com.cn/robots.txt
| 1 | User-Agent: * |
| 2 | |
| 3 | Disallow: /*.gif$ |
| 4 | Disallow: /*.jpg$ |
| 5 | Disallow: /*.jpeg$ |
| 6 | Disallow: /*.png$ |
| 7 | Disallow: /*.bmp$ |
| 8 | Disallow: /*.css$ |
| 9 | Disallow: /*.js$ |
| 10 | Disallow: /cnpc/error/ |