NeuralCrawl

Ahold Delhaize / robots.txt

← back to aholddelhaize.com · change detected 15d ago (2026-07-22T07:43:26Z) · modified +2 −16

What changed

Diff old (2026-06-20T01:10:30Z)new (2026-07-22T07:43:26Z)

@@ -1,19 +1,5 @@
1- User-Agent: *
2- Disallow:
3- Allow: /
1+ User-agent: *
42 
5- # Block admin and technical paths
6- Disallow: /umbraco/
7- Disallow: /_nuxt/
83  Disallow: /api/
9- Disallow: /admin/
10- Disallow: /private/
11- Disallow: /*.json$
12- Disallow: /*.xml$
13- Disallow: /node_modules/
14- Disallow: /health
15- Disallow: /server/
16- Disallow: /uSync/
174 
18- # TODO replace with actual sitemap url
19- Sitemap: https://www.aholddelhaize.com/sitemap.xml
5+ Sitemap: https://aholddelhaize.com/sitemap.xml