NeuralCrawl

Fastenal / robots.txt

← back to fastenal.com · change detected 25d ago (2026-10-12T23:35:00Z) · modified +1 −5

What changed

Diff old (2026-06-20T01:10:31Z) → new (2026-10-12T23:35:00Z)

@@ -2,6 +2,7 @@
22  Disallow: /shopping-cart/
33  Disallow: /checkout
44  Disallow: /logon/sign-in
5+ Disallow: /blue-lane-freight/blf-request
56 
67  Sitemap: https://www.fastenal.com/static-assets/sitemaps/branches.xml
78  Sitemap: https://www.fastenal.ca/static-assets/sitemaps/fca-branches.xml
@@ -22,11 +23,6 @@
2223  Sitemap: https://www.fastenal.com/static-assets/sitemaps/fcom-products-13.xml
2324  Sitemap: https://www.fastenal.com/static-assets/sitemaps/fcom-products-14.xml
2425  Sitemap: https://www.fastenal.com/static-assets/sitemaps/fcom-products-15.xml
25- Sitemap: https://www.fastenal.com/static-assets/sitemaps/fcom-products-16.xml
26- Sitemap: https://www.fastenal.com/static-assets/sitemaps/fcom-products-17.xml
27- Sitemap: https://www.fastenal.com/static-assets/sitemaps/fcom-products-18.xml
28- Sitemap: https://www.fastenal.com/static-assets/sitemaps/fcom-products-19.xml
29- Sitemap: https://www.fastenal.com/static-assets/sitemaps/fcom-products-20.xml
3026  Sitemap: https://www.fastenal.ca/static-assets/sitemaps/fca-categories.xml
3127  Sitemap: https://www.fastenal.ca/static-assets/sitemaps/fca-products-1.xml
3228  Sitemap: https://www.fastenal.ca/static-assets/sitemaps/fca-products-2.xml