NeuralCrawl

Shell / robots.txt

← back to shell.com · change detected 1mo ago (2026-09-27T18:09:53Z) · modified +6 −14

What changed

Diff old (2026-09-25T23:27:22Z) → new (2026-09-27T18:09:53Z)

@@ -169,18 +169,8 @@
169169  Disallow: /shellbitumen100/
170170  Disallow: /shellenergy/electricity.html
171171  Disallow: /shellenergy/electricity/
172- Disallow: /shellenergy/othersolutions/carbonmarketreports/shell-voluntary-carbon-market-reports.html
173- Disallow: /shellenergy/othersolutions/carbonmarketreports/shell-voluntary-carbon-market-reports/
174- Disallow: /shellenergy/othersolutions/environmental-products/contact-us.html
175- Disallow: /shellenergy/othersolutions/environmental-products/contact-us/
176- Disallow: /shellenergy/othersolutions/environmental-products/duedilligence.html
177- Disallow: /shellenergy/othersolutions/environmental-products/duedilligence/
178- Disallow: /shellenergy/othersolutions/environmental-products/project-types.html
179- Disallow: /shellenergy/othersolutions/environmental-products/project-types/
180- Disallow: /shellenergy/othersolutions/environmental-products/sep-disclaimer.html
181- Disallow: /shellenergy/othersolutions/environmental-products/sep-disclaimer/
182- Disallow: /shellenergy/othersolutions/voluntary-carbon-market-insights-and-trends-webinar.html
183- Disallow: /shellenergy/othersolutions/voluntary-carbon-market-insights-and-trends-webinar/
172+ Disallow: /shellenergy/othersolutions.html
173+ Disallow: /shellenergy/othersolutions/
184174  Disallow: /shellenergy/progesstogether/case-studies-alimerka.html
185175  Disallow: /shellenergy/progesstogether/case-studies-alimerka/
186176  Disallow: /shellenergy/progesstogether/case-studies-bsro.html
@@ -189,6 +179,8 @@
189179  Disallow: /shellenergy/progesstogether/case-studies-schneider-electric/
190180  Disallow: /shellenergy/shell-energy-europe/eworld.html
191181  Disallow: /shellenergy/shell-energy-europe/eworld/
182+ Disallow: /shellenergy/shell-energy-europe/natural-gas-portfolio.html
183+ Disallow: /shellenergy/shell-energy-europe/natural-gas-portfolio/
192184  Disallow: /shellenergy/test-oage-for-shell-energy.html
193185  Disallow: /shellenergy/test-oage-for-shell-energy/
194186  Disallow: /tag-search.html
@@ -213,8 +205,8 @@
213205  Disallow: /what-we-do/our-strategy/powering-progress-in-action/
214206  Disallow: /what-we-do/our-strategy/sustainability/advocacy-and-political-activity/advocacy-releases.html
215207  Disallow: /what-we-do/our-strategy/sustainability/advocacy-and-political-activity/advocacy-releases/
216- Disallow: /what-we-do/renewable-power/wind/supplier-registration.html
217- Disallow: /what-we-do/renewable-power/wind/supplier-registration/
208+ Disallow: /what-we-do/renewable-power.html
209+ Disallow: /what-we-do/renewable-power/
218210  Disallow: /wholesalefuel-test-am.html
219211  Disallow: /wholesalefuel-test-am/
220212  Sitemap: https://www.shell.com/.sitemap.xml