NeuralCrawl

Goodyear Tire & Rubber / robots.txt

← back to goodyear.com · change detected 4h ago (2026-06-20T14:27:25Z) · modified +40 −0

What changed

Diff old (2026-06-20T11:23:55Z)new (2026-06-20T14:27:25Z)

@@ -1,3 +1,43 @@
11  User-Agent: *
2+ Disallow: /*cache-purge*
3+ Disallow: /cgi-bin
4+ Disallow: /en-us/search
5+ Disallow: /en-us/account
6+ Disallow: /en-us/forgotpassword
7+ Disallow: /en-us/cart
8+ Disallow: /en-us/checkout
9+ Disallow: /en-us/login
10+ Disallow: /en-us/callback
11+ Disallow: /en-us/reset-password
12+ Disallow: /en-us/partner-promo
13+ Disallow: /en-us/order-confirmation
14+ Disallow: /en-us/order-details
15+ Disallow: /en-us/actuator
16+ Disallow: /en-us/UsaaPartner-CreateUSAACookie
17+ Disallow: /api/
18+
19+ User-Agent: cazoodlebot
220  Disallow: /
321 
22+ User-Agent: mj12bot
23+ Disallow: /
24+
25+ User-Agent: dotbot/1.0
26+ Disallow: /
27+
28+ User-Agent: gigabot
29+ Disallow: /
30+
31+ User-Agent: sogou web spider
32+ Disallow: /
33+
34+ User-Agent: sogou inst spider
35+ Disallow: /
36+
37+ User-Agent: sogou spider2
38+ Disallow: /
39+
40+ User-Agent: ahrefsbot
41+ Disallow: /
42+
43+ Sitemap: https://www.goodyear.com/en-us/sitemap.xml