CHS / robots.txt
← back to chsinc.com · change detected 2mo ago (2026-09-04T16:59:44Z) · modified +7 −6
What changed
- Removed all rules for user-agent ‘facebookexternalhit’
- Added Disallow: (empty) for *
- Removed Disallow: /*?* for *
- Removed Disallow: /-/media/ for *
- Crawl-delay for *: none → 10
- Added sitemap https://www.chsinc.com/sitemap_index.xml
- Removed sitemap https://www.chsinc.com/sitemap.xml
Diff old (2026-06-20T01:10:30Z) → new (2026-09-04T16:59:44Z)
| @@ -1,8 +1,9 @@ | ||
| 1 | + Crawl-delay: 10 | |
| 2 | + # START YOAST BLOCK | |
| 3 | + # --------------------------- | |
| 1 | 4 | User-agent: * |
| 2 | - Disallow: /*?* | |
| 3 | - Disallow: /-/media/ | |
| 5 | + Disallow: | |
| 4 | 6 | |
| 5 | - User-agent: facebookexternalhit | |
| 6 | - Allow: / | |
| 7 | - | |
| 8 | - Sitemap: https://www.chsinc.com/sitemap.xml | |
| 7 | + Sitemap: https://www.chsinc.com/sitemap_index.xml | |
| 8 | + # --------------------------- | |
| 9 | + # END YOAST BLOCK |