Ford Motor / robots.txt snapshot
← back to ford.com · fetched 2026-07-18T00:21:17Z (19d ago) · HTTP 200 · 1189 bytes · sha256 9e4f82dc917be470 · raw
final URL: https://www.ford.com/robots.txt
| 1 | #robots.txt for www.Ford.com/es.ford.com - NS - 20231106 |
| 2 | User-agent: * |
| 3 | Allow: /llms.txt |
| 4 | Allow: /inventory/llms.txt |
| 5 | Disallow: /content/experience-fragments/na/* |
| 6 | Disallow: /search/ |
| 7 | Disallow: /trucks/ranger/index.amp/ |
| 8 | Disallow: /trucks/ranger/index.amp |
| 9 | Disallow: /articles/ |
| 10 | Disallow: /akamai/ |
| 11 | Disallow: /synbase/bev* |
| 12 | Disallow: /synbase/bev/* |
| 13 | Disallow: /semashow* |
| 14 | Disallow: /finder |
| 15 | Disallow: /finder* |
| 16 | Disallow: /finder/* |
| 17 | Disallow: *chipsoverlayclose* |
| 18 | #es.ford.com WIP cart files |
| 19 | Disallow: /catalogsearch/ |
| 20 | Disallow: /nvc/checkout |
| 21 | Disallow: /nvc/cart |
| 22 | Disallow: /nvc/order-confirmation |
| 23 | Disallow: /fps/script |
| 24 | Disallow: /api/fps |
| 25 | |
| 26 | #Naver bot |
| 27 | User-agent: Yeti |
| 28 | Disallow: / |
| 29 | |
| 30 | Sitemap: https://www.ford.com/sitemap.xml |
| 31 | Sitemap: https://www.ford.com/href-sitemap-en-us.xml. |
| 32 | Sitemap: https://www.ford.com/href-sitemap-en-us.xml |
| 33 | Sitemap: https://www.ford.com/accessories/sitemap.xml |
| 34 | Sitemap: https://www.ford.com/parts/sitemap.xml |
| 35 | |
| 36 | User-agent: Baiduspider |
| 37 | User-agent: Baiduspider-image |
| 38 | User-agent: YisouSpider |
| 39 | User-agent: Sogou web spider |
| 40 | User-agent: Sogou inst spider |
| 41 | User-agent: 360Spider |
| 42 | User-agent: Bytespider |
| 43 | User-agent: PetalBot |
| 44 | Disallow: /inventory/ |
| 45 | User-agent: * |
| 46 | Crawl-delay: 10 |
| 47 | Allow: /inventory/ |