NeuralCrawl

CarMax / robots.txt

← back to carmax.com · change detected 25d ago (2026-10-12T17:28:08Z) · modified +36 −0

What changed

Diff old (2026-06-20T01:10:31Z) → new (2026-10-12T17:28:08Z)

@@ -26,6 +26,42 @@
2626  Disallow: /activity/*
2727  Disallow: /*stocknumber=*
2828 
29+ # ---------------------------------------------------------------------------
30+ # CDP Indexing
31+ # ROLLBACK: delete this entire block.
32+ # ---------------------------------------------------------------------------
33+ User-agent: GPTBot
34+ User-agent: OAI-SearchBot
35+ User-agent: ClaudeBot
36+ User-agent: PerplexityBot
37+ Disallow: /500.html
38+ Disallow: /contact-us/appointment/cancel
39+ Disallow: /contact-us/appointment/cancel-confirmation
40+ Disallow: /contact-us/schedule/test-drive
41+ Disallow: /contact-us/schedule/test-drive-confirmation
42+ Disallow: /email
43+ Disallow: /mycarmax/appointments
44+ Disallow: /mycarmax/cancel-alerts
45+ Disallow: /mycarmax/cancel-alerts-confirmation
46+ Disallow: /mycarmax/forgot-password-confirmation
47+ Disallow: /mycarmax/invalid-link
48+ Disallow: /mycarmax/profile
49+ Disallow: /mycarmax/reset-password
50+ Disallow: /mycarmax/reset-password-confirmation
51+ Disallow: /mycarmax/saved-cars
52+ Disallow: /mycarmax/saved-cars-unsubscribe
53+ Disallow: /mycarmax/saved-cars-unsubscribe-confirmation
54+ Disallow: /mycarmax/saved-searches
55+ Disallow: /mycarmax/saved-searches-unsubscribe
56+ Disallow: /mycarmax/saved-searches-unsubscribe-confirmation
57+ Disallow: /cars/for-you/luxury-vehicles-for-you
58+ Disallow: /pre-qual/*
59+ Disallow: /mycarmax/sign-in*
60+ Disallow: /activity/*
61+ Disallow: /*stocknumber=*
62+ # End Phase 1 block
63+ # ---------------------------------------------------------------------------
64+
2965  Sitemap: https://www.carmax.com/sitemap.xml
3066  Sitemap: https://www.carmax.com/shared/sitemaps/index.xml
3167  Sitemap: https://www.carmax.com/research/sharedsitemap.xml