NeuralCrawl

Nestle / robots.txt

← back to nestle.com · change detected 1mo ago (2026-09-22T22:34:38Z) · modified +0 −1

What changed

Diff old (2026-07-28T03:59:04Z) → new (2026-09-22T22:34:38Z)

@@ -66,7 +66,6 @@
6666  # Disallow Ajax loaded pages
6767  Disallow: /feedback-form
6868  Disallow: /report-concern
69- Disallow: /sites/default/files/asset-library/documents/library/documents/annual_reports/2000-management-report-brands-de.pdf
7069  # Disallow brand search page
7170  Disallow: /brands/brandssearchlist
7271  Disallow: /cdn-cgi