Celanese / robots.txt snapshot
← back to celanese.com · fetched 2026-09-06T23:40:27Z (2mo ago) · HTTP 200 · 279 bytes · sha256 332bb5c24d08c913 · raw
final URL: https://www.celanese.com/robots.txt
| 1 | Disallow: /sitecore_files/ |
| 2 | Disallow: /sitecore modules/ |
| 3 | Disallow: /App_Browsers/ |
| 4 | Disallow: /App_config/ |
| 5 | Disallow: /App_Data/ |
| 6 | Disallow: /temp/ |
| 7 | Disallow: /xsl/ |
| 8 | User-agent: Screaming Frog SEO Spider |
| 9 | Allow: / |
| 10 | |
| 11 | User-agent: rogerbot |
| 12 | Allow: / |
| 13 | |
| 14 | Sitemap: https://www.celanese.com/sitemap |