NeuralCrawl

Shell / robots.txt

← back to shell.com · change detected 2mo ago (2026-09-08T12:01:45Z) · modified +8 −0

What changed

Diff old (2026-09-04T10:58:24Z) → new (2026-09-08T12:01:45Z)

@@ -51,6 +51,12 @@
5151  Disallow: /business-customers/industrial-lubricants-and-specialty-fluids-for-business/industry-insights/
5252  Disallow: /business-customers/industrial-lubricants-and-specialty-fluids-for-business/lubricants-services.html
5353  Disallow: /business-customers/industrial-lubricants-and-specialty-fluids-for-business/lubricants-services/
54+ Disallow: /business-customers/industrial-lubricants-and-specialty-fluids-for-business/perspectives/future-solutions-factory.html
55+ Disallow: /business-customers/industrial-lubricants-and-specialty-fluids-for-business/perspectives/future-solutions-factory/
56+ Disallow: /business-customers/industrial-lubricants-and-specialty-fluids-for-business/perspectives/how-biodegradable-lubricants-can-support-sustainable-construction.html
57+ Disallow: /business-customers/industrial-lubricants-and-specialty-fluids-for-business/perspectives/how-biodegradable-lubricants-can-support-sustainable-construction/
58+ Disallow: /business-customers/industrial-lubricants-and-specialty-fluids-for-business/perspectives/leadership-in-manufacturing.html
59+ Disallow: /business-customers/industrial-lubricants-and-specialty-fluids-for-business/perspectives/leadership-in-manufacturing/
5460  Disallow: /business-customers/industrial-lubricants-and-specialty-fluids-for-business/perspectives/why-economy-lubricants-dont-save-you-money-in-long-run.html
5561  Disallow: /business-customers/industrial-lubricants-and-specialty-fluids-for-business/perspectives/why-economy-lubricants-dont-save-you-money-in-long-run/
5662  Disallow: /business-customers/industrial-lubricants-and-specialty-fluids-for-business/products/shell-panolin/reducing-carbon-intensity.html
@@ -79,6 +85,8 @@
7985  Disallow: /business-customers/industrial-lubricants-and-specialty-fluids-for-business/shell-expertise/lubrication-services-for-your-industry/shell-remotesense/engine/
8086  Disallow: /business-customers/industrial-lubricants-and-specialty-fluids-for-business/shell-expertise/lubrication-services-for-your-industry/solutions-hub.html
8187  Disallow: /business-customers/industrial-lubricants-and-specialty-fluids-for-business/shell-expertise/lubrication-services-for-your-industry/solutions-hub/
88+ Disallow: /business-customers/industrial-lubricants-and-specialty-fluids-for-business/sustainability.html
89+ Disallow: /business-customers/industrial-lubricants-and-specialty-fluids-for-business/sustainability/
8290  Disallow: /business-customers/marine/digital-touch-screen-contact-us.html
8391  Disallow: /business-customers/marine/digital-touch-screen-contact-us/
8492  Disallow: /business-customers/marine/marine-lng.html