Expeditors International / robots.txt
← back to expeditors.com · change detected 1mo ago (2026-06-29T23:53:45Z) · modified +14 −15
What changed
- Added Disallow: /404-page-not-found/ for *
- Added Disallow: /error/ for *
- Added Disallow: /search/ for *
- Removed Disallow: /404-page-not-found for *
- Removed Disallow: /error for *
- Removed Disallow: /search for *
Diff old (2026-06-20T01:10:30Z) → new (2026-06-29T23:53:45Z)
| @@ -58,19 +58,18 @@ | ||
| 58 | 58 | |
| 59 | 59 | # END Cloudflare Managed Content |
| 60 | 60 | |
| 61 | + User-agent: * | |
| 62 | + Disallow: /aspnet_client/ | |
| 63 | + Disallow: /bin/ | |
| 64 | + Disallow: /config/ | |
| 65 | + Disallow: /data/ | |
| 66 | + Disallow: /macroScripts/ | |
| 67 | + Disallow: /umbraco/ | |
| 68 | + Disallow: /umbraco_client/ | |
| 69 | + Disallow: /usercontrols/ | |
| 70 | + Disallow: /xslt/ | |
| 71 | + Disallow: /search/ | |
| 72 | + Disallow: /404-page-not-found/ | |
| 73 | + Disallow: /error/ | |
| 74 | + Sitemap: https://www.expeditors.com/sitemap.xml | |
| 61 | 75 | |
| 62 | - User-agent: * | |
| 63 | - Disallow: /aspnet_client/ | |
| 64 | - Disallow: /bin/ | |
| 65 | - Disallow: /config/ | |
| 66 | - Disallow: /data/ | |
| 67 | - Disallow: /macroScripts/ | |
| 68 | - Disallow: /umbraco/ | |
| 69 | - Disallow: /umbraco_client/ | |
| 70 | - Disallow: /usercontrols/ | |
| 71 | - Disallow: /xslt/ | |
| 72 | - Disallow: /search | |
| 73 | - Disallow: /404-page-not-found | |
| 74 | - Disallow: /error | |
| 75 | - Sitemap: https://www.expeditors.com/sitemap.xml | |
| 76 | - |