NeuralCrawl

US Foods / robots.txt snapshot

← back to usfoods.com · fetched 2026-06-20T01:10:30Z (18h ago) · HTTP 200 · 602 bytes · sha256 9dd5e5de17dd2210 · raw

final URL: https://www.usfoods.com/robots.txt

1# ================================
2# robots.txt for https://www.usfoods.com/
3# Last updated: 2026‑01‑14
4# ================================
5User-agent: *
6Allow: /
7# Block AEM language masters (internal authoring content)
8Disallow: /content/*/language-masters/
9
10# Block style guide / component demo pages
11Disallow: /style-guide/
12
13# Block internal search results
14Disallow: /search-results
15# Block tracking parameters
16Disallow: /*?utm_
17Disallow: /*&utm_
18Disallow: /*?fbclid=
19Disallow: /*?gclid=
20Disallow: /*?msclkid=
21Sitemap: https://www.usfoods.com/sitemap.xml