NeuralCrawl

Shell / robots.txt

← back to shell.com · change detected 1mo ago (2026-09-25T23:27:22Z) · modified +14 −4

What changed

Diff old (2026-09-25T17:22:55Z) → new (2026-09-25T23:27:22Z)

@@ -167,18 +167,28 @@
167167  Disallow: /news-and-insights/scenarios/a-better-life-with-a-healthy-planet/
168168  Disallow: /shellbitumen100.html
169169  Disallow: /shellbitumen100/
170- Disallow: /shellenergy/cement.html
171- Disallow: /shellenergy/cement/
172170  Disallow: /shellenergy/electricity.html
173171  Disallow: /shellenergy/electricity/
172+ Disallow: /shellenergy/othersolutions/carbonmarketreports/shell-voluntary-carbon-market-reports.html
173+ Disallow: /shellenergy/othersolutions/carbonmarketreports/shell-voluntary-carbon-market-reports/
174+ Disallow: /shellenergy/othersolutions/environmental-products/contact-us.html
175+ Disallow: /shellenergy/othersolutions/environmental-products/contact-us/
176+ Disallow: /shellenergy/othersolutions/environmental-products/duedilligence.html
177+ Disallow: /shellenergy/othersolutions/environmental-products/duedilligence/
178+ Disallow: /shellenergy/othersolutions/environmental-products/project-types.html
179+ Disallow: /shellenergy/othersolutions/environmental-products/project-types/
180+ Disallow: /shellenergy/othersolutions/environmental-products/sep-disclaimer.html
181+ Disallow: /shellenergy/othersolutions/environmental-products/sep-disclaimer/
182+ Disallow: /shellenergy/othersolutions/voluntary-carbon-market-insights-and-trends-webinar.html
183+ Disallow: /shellenergy/othersolutions/voluntary-carbon-market-insights-and-trends-webinar/
174184  Disallow: /shellenergy/progesstogether/case-studies-alimerka.html
175185  Disallow: /shellenergy/progesstogether/case-studies-alimerka/
186+ Disallow: /shellenergy/progesstogether/case-studies-bsro.html
187+ Disallow: /shellenergy/progesstogether/case-studies-bsro/
176188  Disallow: /shellenergy/progesstogether/case-studies-schneider-electric.html
177189  Disallow: /shellenergy/progesstogether/case-studies-schneider-electric/
178190  Disallow: /shellenergy/shell-energy-europe/eworld.html
179191  Disallow: /shellenergy/shell-energy-europe/eworld/
180- Disallow: /shellenergy/tech/dc-whitepaper.html
181- Disallow: /shellenergy/tech/dc-whitepaper/
182192  Disallow: /shellenergy/test-oage-for-shell-energy.html
183193  Disallow: /shellenergy/test-oage-for-shell-energy/
184194  Disallow: /tag-search.html