NeuralCrawl

Copart / robots.txt

← back to copart.com · change detected 2mo ago (2026-09-02T16:17:54Z) · modified +39 −1

What changed

Diff old (2026-09-01T15:59:14Z) → new (2026-09-02T16:17:54Z)

@@ -1,1 +1,39 @@
1- <HashMap><returnCode>-1</returnCode><returnCodeDesc>Error occured</returnCodeDesc><data><errorMsg>Unexpected error occurred on the server, Please check logs - CorrelationID - e04104f4-146f-4497-99c8-944e4627e7e5</errorMsg></data></HashMap>
1+ User-agent: *
2+ Disallow: /public/data/
3+ Disallow: /paymentsDue/
4+ Disallow: /paymentHistory/
5+ Disallow: /myBids/
6+ Disallow: /lotsWon/
7+ Disallow: /lotsLost
8+ Disallow: /driverseat/
9+ Disallow: /dashboard/
10+ Disallow: /dashboard
11+ Disallow: /downloadSalesData
12+ Disallow: /memberFees
13+ Disallow: /messagesettings
14+ Disallow: /accountInformation/accountSetting
15+ Disallow: /accountinformation/contactinfo
16+ Disallow: /hireabroker
17+ Disallow: /es/hireabroker
18+ Disallow: /ar/hireabroker
19+ Disallow: /ru/hireabroker
20+ Disallow: /pl/hireabroker
21+ Disallow: /fr-CA/hireabroker
22+ Allow: /lotSearchResults$
23+ Allow: /es/lotSearchResults$
24+ Allow: /ar/lotSearchResults$
25+ Allow: /ru/lotSearchResults$
26+ Allow: /pl/lotSearchResults$
27+ Allow: /fr-CA/lotSearchResults$
28+ Disallow: /lotSearchResults/
29+ Disallow: /es/lotSearchResults/
30+ Disallow: /ar/lotSearchResults/
31+ Disallow: /ru/lotSearchResults/
32+ Disallow: /pl/lotSearchResults/
33+ Disallow: /fr-CA/lotSearchResults/
34+ Sitemap: https://www.copart-sitemaps.com/sitemap-index.xml
35+ Sitemap: https://www.copart-sitemaps.com/es/sitemap-index.xml
36+ Sitemap: https://www.copart-sitemaps.com/fr-CA/sitemap-index.xml
37+ Sitemap: https://www.copart-sitemaps.com/ru/sitemap-index.xml
38+ Sitemap: https://www.copart-sitemaps.com/ar/sitemap-index.xml
39+ Sitemap: https://www.copart-sitemaps.com/pl/sitemap-index.xml