NeuralCrawl

Ford Motor / robots.txt snapshot

← back to ford.com · fetched 2026-06-20T01:10:30Z (18h ago) · HTTP 200 · 1145 bytes · sha256 af6568a9d53c7eb9 · raw

final URL: https://www.ford.com/robots.txt

1#robots.txt for www.Ford.com/es.ford.com - NS - 20231106
2User-agent: *
3Disallow: /content/experience-fragments/na/*
4Disallow: /search/
5Disallow: /trucks/ranger/index.amp/
6Disallow: /trucks/ranger/index.amp
7Disallow: /articles/
8Disallow: /akamai/
9Disallow: /synbase/bev*
10Disallow: /synbase/bev/*
11Disallow: /semashow*
12Disallow: /finder
13Disallow: /finder*
14Disallow: /finder/*
15Disallow: *chipsoverlayclose*
16#es.ford.com WIP cart files
17Disallow: /catalogsearch/
18Disallow: /nvc/checkout
19Disallow: /nvc/cart
20Disallow: /nvc/order-confirmation
21Disallow: /fps/script
22Disallow: /api/fps
23
24#Naver bot
25User-agent: Yeti
26Disallow: /
27
28Sitemap: https://www.ford.com/sitemap.xml
29Sitemap: https://www.ford.com/href-sitemap-en-us.xml.
30Sitemap: https://www.ford.com/href-sitemap-en-us.xml
31Sitemap: https://www.ford.com/accessories/sitemap.xml
32Sitemap: https://www.ford.com/parts/sitemap.xml
33
34User-agent: Baiduspider
35User-agent: Baiduspider-image
36User-agent: YisouSpider
37User-agent: Sogou web spider
38User-agent: Sogou inst spider
39User-agent: 360Spider
40User-agent: Bytespider
41User-agent: PetalBot
42Disallow: /inventory/
43User-agent: *
44Crawl-delay: 10
45Allow: /inventory/