Kohl's / robots.txt
← back to kohls.com · change detected 6d ago (2026-07-30T23:00:57Z) · modified +3 −0
What changed
- 🤖 AIBlocked Meta-WebIndexer (Meta) entirely
Diff old (2026-07-29T16:38:54Z) → new (2026-07-30T23:00:57Z)
| @@ -33,6 +33,9 @@ | ||
| 33 | 33 | User-agent: meta-externalagent |
| 34 | 34 | Disallow: / |
| 35 | 35 | |
| 36 | + User-agent: meta-webindexer | |
| 37 | + Disallow: / | |
| 38 | + | |
| 36 | 39 | User-agent: Baiduspider |
| 37 | 40 | Disallow: / |
| 38 | 41 |