NeuralCrawl

Copart / robots.txt

← back to copart.com · change detected 28d ago (2026-10-10T10:36:20Z) · modified +1 −39

What changed

Diff old (2026-09-02T16:17:54Z) → new (2026-10-10T10:36:20Z)

@@ -1,39 +1,1 @@
1- User-agent: *
2- Disallow: /public/data/
3- Disallow: /paymentsDue/
4- Disallow: /paymentHistory/
5- Disallow: /myBids/
6- Disallow: /lotsWon/
7- Disallow: /lotsLost
8- Disallow: /driverseat/
9- Disallow: /dashboard/
10- Disallow: /dashboard
11- Disallow: /downloadSalesData
12- Disallow: /memberFees
13- Disallow: /messagesettings
14- Disallow: /accountInformation/accountSetting
15- Disallow: /accountinformation/contactinfo
16- Disallow: /hireabroker
17- Disallow: /es/hireabroker
18- Disallow: /ar/hireabroker
19- Disallow: /ru/hireabroker
20- Disallow: /pl/hireabroker
21- Disallow: /fr-CA/hireabroker
22- Allow: /lotSearchResults$
23- Allow: /es/lotSearchResults$
24- Allow: /ar/lotSearchResults$
25- Allow: /ru/lotSearchResults$
26- Allow: /pl/lotSearchResults$
27- Allow: /fr-CA/lotSearchResults$
28- Disallow: /lotSearchResults/
29- Disallow: /es/lotSearchResults/
30- Disallow: /ar/lotSearchResults/
31- Disallow: /ru/lotSearchResults/
32- Disallow: /pl/lotSearchResults/
33- Disallow: /fr-CA/lotSearchResults/
34- Sitemap: https://www.copart-sitemaps.com/sitemap-index.xml
35- Sitemap: https://www.copart-sitemaps.com/es/sitemap-index.xml
36- Sitemap: https://www.copart-sitemaps.com/fr-CA/sitemap-index.xml
37- Sitemap: https://www.copart-sitemaps.com/ru/sitemap-index.xml
38- Sitemap: https://www.copart-sitemaps.com/ar/sitemap-index.xml
39- Sitemap: https://www.copart-sitemaps.com/pl/sitemap-index.xml
1+ <HashMap><returnCode>-1</returnCode><returnCodeDesc>Error occured</returnCodeDesc><data><errorMsg>Unexpected error occurred on the server, Please check logs - CorrelationID - 98ec36fe-5aaf-4c03-a70e-33c8efb74904</errorMsg></data></HashMap>