NeuralCrawl

Copart / robots.txt

← back to copart.com · change detected 27d ago (2026-10-11T10:58:04Z) · modified +39 −1

What changed

Diff old (2026-10-10T10:36:20Z) → new (2026-10-11T10:58:04Z)

@@ -1,1 +1,39 @@
1- <HashMap><returnCode>-1</returnCode><returnCodeDesc>Error occured</returnCodeDesc><data><errorMsg>Unexpected error occurred on the server, Please check logs - CorrelationID - 98ec36fe-5aaf-4c03-a70e-33c8efb74904</errorMsg></data></HashMap>
1+ User-agent: *
2+ Disallow: /public/data/
3+ Disallow: /paymentsDue/
4+ Disallow: /paymentHistory/
5+ Disallow: /myBids/
6+ Disallow: /lotsWon/
7+ Disallow: /lotsLost
8+ Disallow: /driverseat/
9+ Disallow: /dashboard/
10+ Disallow: /dashboard
11+ Disallow: /downloadSalesData
12+ Disallow: /memberFees
13+ Disallow: /messagesettings
14+ Disallow: /accountInformation/accountSetting
15+ Disallow: /accountinformation/contactinfo
16+ Disallow: /hireabroker
17+ Disallow: /es/hireabroker
18+ Disallow: /ar/hireabroker
19+ Disallow: /ru/hireabroker
20+ Disallow: /pl/hireabroker
21+ Disallow: /fr-CA/hireabroker
22+ Allow: /lotSearchResults$
23+ Allow: /es/lotSearchResults$
24+ Allow: /ar/lotSearchResults$
25+ Allow: /ru/lotSearchResults$
26+ Allow: /pl/lotSearchResults$
27+ Allow: /fr-CA/lotSearchResults$
28+ Disallow: /lotSearchResults/
29+ Disallow: /es/lotSearchResults/
30+ Disallow: /ar/lotSearchResults/
31+ Disallow: /ru/lotSearchResults/
32+ Disallow: /pl/lotSearchResults/
33+ Disallow: /fr-CA/lotSearchResults/
34+ Sitemap: https://www.copart-sitemaps.com/sitemap-index.xml
35+ Sitemap: https://www.copart-sitemaps.com/es/sitemap-index.xml
36+ Sitemap: https://www.copart-sitemaps.com/fr-CA/sitemap-index.xml
37+ Sitemap: https://www.copart-sitemaps.com/ru/sitemap-index.xml
38+ Sitemap: https://www.copart-sitemaps.com/ar/sitemap-index.xml
39+ Sitemap: https://www.copart-sitemaps.com/pl/sitemap-index.xml