NeuralCrawl

Archer Daniels Midland / robots.txt snapshot

← back to adm.com · fetched 2026-06-20T01:10:30Z (18h ago) · HTTP 200 · 515 bytes · sha256 add11ac5b85e6e36 · raw

final URL: https://www.adm.com/robots.txt/

1User-agent: *
2Disallow: /EPiServer/CMS/
3Disallow: /Util/
4
5Disallow: /?q=
6Disallow: /?r=
7Disallow: /Pages/default.aspx
8Disallow: /_layouts/
9Disallow: /Documents/
10Disallow: /documents/
11Disallow: /Lists/PressRelease/Attachments/
12Disallow: /detail?id=
13Disallow: /externalContentView/
14Disallow: /en-us/search/?q=*
15Disallow: /pt-br*
16Sitemap: https://www.adm.com/en-us/sitemap.xml
17Sitemap: https://www.adm.com/fr-ca/sitemap.xml
18Sitemap: https://www.adm.com/zh-cn/sitemap.xml
19
20User-Agent: Googlebot
21Allow: .js
22Allow: .css