S&P Global / robots.txt
← back to spglobal.com · change detected 1mo ago (2026-07-01T06:18:40Z) · modified +0 −5
What changed
- Removed Disallow: /automotive-insights/en-test/* for *
- Removed Disallow: /engineering/en/search for *
- Removed Disallow: /mobility/en/search for *
- Removed sitemap https://www.spglobal.com/automotive-insights/en/sitemap.xml
- Removed sitemap https://www.spglobal.com/mobility/en/sitemap.xml
Diff old (2026-06-20T01:10:31Z) → new (2026-07-01T06:18:40Z)
| @@ -5,14 +5,11 @@ | ||
| 5 | 5 | Disallow: /ratings/en-test/* |
| 6 | 6 | Disallow: /market-intelligence/en-test/* |
| 7 | 7 | Disallow: /commodity-insights/en-test/* |
| 8 | - Disallow: /automotive-insights/en-test/* | |
| 9 | 8 | Disallow: /sustainable1/en-test/* |
| 10 | 9 | Disallow: /en/homepage-v2 |
| 11 | 10 | Disallow: /en/search |
| 12 | 11 | Disallow: /market-intelligence/en/search |
| 13 | 12 | Disallow: /ratings/en/search |
| 14 | - Disallow: /engineering/en/search | |
| 15 | - Disallow: /mobility/en/search | |
| 16 | 13 | Disallow: prod.aws.platts.com |
| 17 | 14 | Disallow: prod-us.aws.platts.com |
| 18 | 15 | Disallow: prod-us1.aws.platts.com |
| @@ -164,8 +161,6 @@ | ||
| 164 | 161 | Sitemap: https://www.spglobal.com/energy/zh/sitemap.xml |
| 165 | 162 | Sitemap: https://www.spglobal.com/energy/ko/sitemap.xml |
| 166 | 163 | Sitemap: https://www.spglobal.com/spdji/en/sitemap/ |
| 167 | - Sitemap: https://www.spglobal.com/mobility/en/sitemap.xml | |
| 168 | - Sitemap: https://www.spglobal.com/automotive-insights/en/sitemap.xml | |
| 169 | 164 | Sitemap: https://www.spglobal.com/commodityinsights/en/ci/sitemap.xml |
| 170 | 165 | Sitemap: https://www.spglobal.com/en/enterprise/sitemap.xml |
| 171 | 166 | Sitemap: https://www.spglobal.com/esg/s1/sitemap.xml |