NeuralCrawl

Danone / robots.txt snapshot

← back to danone.com · fetched 2026-06-20T01:10:30Z (15h ago) · HTTP 200 · 195 bytes · sha256 856d5967974364fd · raw

final URL: https://www.danone.com/robots.txt

1User-agent: *
2
3# Prevent dynamic search-related pages from being crawled
4Disallow: /*?query=*
5Disallow: /libs/granite/security/currentuser.json
6
7Sitemap: https://www.danone.com/sitemap_index.xml