NeuralCrawl

Copart / robots.txt snapshot

← back to copart.com · fetched 2026-06-20T01:10:31Z (15h ago) · HTTP 200 · 1273 bytes · sha256 b91f8e281c499789 · raw

final URL: https://www.copart.com/robots.txt

1User-agent: *
2Disallow: /public/data/
3Disallow: /paymentsDue/
4Disallow: /paymentHistory/
5Disallow: /myBids/
6Disallow: /lotsWon/
7Disallow: /lotsLost
8Disallow: /driverseat/
9Disallow: /dashboard/
10Disallow: /dashboard
11Disallow: /downloadSalesData
12Disallow: /memberFees
13Disallow: /messagesettings
14Disallow: /accountInformation/accountSetting
15Disallow: /accountinformation/contactinfo
16Disallow: /hireabroker
17Disallow: /es/hireabroker
18Disallow: /ar/hireabroker
19Disallow: /ru/hireabroker
20Disallow: /pl/hireabroker
21Disallow: /fr-CA/hireabroker
22Allow: /lotSearchResults$
23Allow: /es/lotSearchResults$
24Allow: /ar/lotSearchResults$
25Allow: /ru/lotSearchResults$
26Allow: /pl/lotSearchResults$
27Allow: /fr-CA/lotSearchResults$
28Disallow: /lotSearchResults/
29Disallow: /es/lotSearchResults/
30Disallow: /ar/lotSearchResults/
31Disallow: /ru/lotSearchResults/
32Disallow: /pl/lotSearchResults/
33Disallow: /fr-CA/lotSearchResults/
34Sitemap: https://www.copart-sitemaps.com/sitemap-index.xml
35Sitemap: https://www.copart-sitemaps.com/es/sitemap-index.xml
36Sitemap: https://www.copart-sitemaps.com/fr-CA/sitemap-index.xml
37Sitemap: https://www.copart-sitemaps.com/ru/sitemap-index.xml
38Sitemap: https://www.copart-sitemaps.com/ar/sitemap-index.xml
39Sitemap: https://www.copart-sitemaps.com/pl/sitemap-index.xml