NeuralCrawl

Kohl's / robots.txt

← back to kohls.com · change detected 1mo ago (2026-09-22T22:34:39Z) · modified +0 −6

What changed

Diff old (2026-07-30T23:00:57Z) → new (2026-09-22T22:34:39Z)

@@ -30,12 +30,6 @@
3030  Disallow: /faq/search/
3131  Disallow: /snb/
3232 
33- User-agent: meta-externalagent
34- Disallow: /
35-
36- User-agent: meta-webindexer
37- Disallow: /
38-
3933  User-agent: Baiduspider
4034  Disallow: /
4135