NeuralCrawl

Shell / robots.txt

← back to shell.com · change detected 1mo ago (2026-09-24T17:05:16Z) · modified +2 −2

What changed

Diff old (2026-09-22T16:26:18Z) → new (2026-09-24T17:05:16Z)

@@ -179,8 +179,6 @@
179179  Disallow: /shellenergy/tech/dc-whitepaper/
180180  Disallow: /shellenergy/test-oage-for-shell-energy.html
181181  Disallow: /shellenergy/test-oage-for-shell-energy/
182- Disallow: /sustainability/advocacy-and-political-activity/advocacy-releases.html
183- Disallow: /sustainability/advocacy-and-political-activity/advocacy-releases/
184182  Disallow: /tag-search.html
185183  Disallow: /tag-search/
186184  Disallow: /tco.html
@@ -201,6 +199,8 @@
201199  Disallow: /what-we-do/our-strategy/generating-shareholder-value/
202200  Disallow: /what-we-do/our-strategy/powering-progress-in-action.html
203201  Disallow: /what-we-do/our-strategy/powering-progress-in-action/
202+ Disallow: /what-we-do/our-strategy/sustainability/advocacy-and-political-activity/advocacy-releases.html
203+ Disallow: /what-we-do/our-strategy/sustainability/advocacy-and-political-activity/advocacy-releases/
204204  Disallow: /what-we-do/renewable-power/wind/supplier-registration.html
205205  Disallow: /what-we-do/renewable-power/wind/supplier-registration/
206206  Disallow: /wholesalefuel-test-am.html