CME Group / robots.txt
← back to cmegroup.com · change detected 24d ago (2026-07-13T16:47:36Z) · modified +1 −0
What changed
- Added Disallow: /markets/energy/crude-oil/commodity-direct-spot-crude-markets.html for *
Diff old (2026-06-20T01:10:31Z) → new (2026-07-13T16:47:36Z)
| @@ -312,6 +312,7 @@ | ||
| 312 | 312 | Disallow: /market-regulation/position-limits/leftnav/ |
| 313 | 313 | Disallow: /market-regulation/rightnav/ |
| 314 | 314 | Disallow: /market-regulation/rulebook/rightnav/ |
| 315 | + Disallow: /markets/energy/crude-oil/commodity-direct-spot-crude-markets.html | |
| 315 | 316 | Disallow: /misc/ |
| 316 | 317 | Disallow: /mobile/ |
| 317 | 318 | Disallow: /openmarkets/events/webinars/ |