Ford Motor / robots.txt
← back to ford.com · change detected 5d ago (2026-07-31T23:22:14Z) · modified +10 −6
What changed
- Added sitemap https://www.ford.com/inventory/llms.txt
- Added sitemap https://www.ford.com/llms.txt
- Removed sitemap https://www.ford.com/href-sitemap-en-us.xml.
Diff old (2026-07-18T00:21:17Z) → new (2026-07-31T23:22:14Z)
| @@ -1,7 +1,5 @@ | ||
| 1 | 1 | #robots.txt for www.Ford.com/es.ford.com - NS - 20231106 |
| 2 | 2 | User-agent: * |
| 3 | - Allow: /llms.txt | |
| 4 | - Allow: /inventory/llms.txt | |
| 5 | 3 | Disallow: /content/experience-fragments/na/* |
| 6 | 4 | Disallow: /search/ |
| 7 | 5 | Disallow: /trucks/ranger/index.amp/ |
| @@ -15,6 +13,11 @@ | ||
| 15 | 13 | Disallow: /finder* |
| 16 | 14 | Disallow: /finder/* |
| 17 | 15 | Disallow: *chipsoverlayclose* |
| 16 | + Allow: /llms.txt | |
| 17 | + Allow: /inventory/llms.txt | |
| 18 | + Crawl-delay: 10 | |
| 19 | + Allow: /inventory/ | |
| 20 | + | |
| 18 | 21 | #es.ford.com WIP cart files |
| 19 | 22 | Disallow: /catalogsearch/ |
| 20 | 23 | Disallow: /nvc/checkout |
| @@ -28,10 +31,14 @@ | ||
| 28 | 31 | Disallow: / |
| 29 | 32 | |
| 30 | 33 | Sitemap: https://www.ford.com/sitemap.xml |
| 31 | - Sitemap: https://www.ford.com/href-sitemap-en-us.xml. | |
| 32 | 34 | Sitemap: https://www.ford.com/href-sitemap-en-us.xml |
| 33 | 35 | Sitemap: https://www.ford.com/accessories/sitemap.xml |
| 34 | 36 | Sitemap: https://www.ford.com/parts/sitemap.xml |
| 37 | + | |
| 38 | + # AI agent / LLM documentation | |
| 39 | + Sitemap: https://www.ford.com/llms.txt | |
| 40 | + Sitemap: https://www.ford.com/inventory/llms.txt | |
| 41 | + | |
| 35 | 42 | |
| 36 | 43 | User-agent: Baiduspider |
| 37 | 44 | User-agent: Baiduspider-image |
| @@ -42,6 +49,3 @@ | ||
| 42 | 49 | User-agent: Bytespider |
| 43 | 50 | User-agent: PetalBot |
| 44 | 51 | Disallow: /inventory/ |
| 45 | - User-agent: * | |
| 46 | - Crawl-delay: 10 | |
| 47 | - Allow: /inventory/ |