Zscaler / robots.txt
← back to zscaler.com · change detected 7d ago (2026-09-11T19:15:58Z) · modified +1 −1
What changed
- 🤖 AIAdded Disallow: /8199ac63-be6c-4cba-9bd9-45500a02d64f.txt for Applebot-Extended
- 🤖 AIRemoved Disallow: /indexNowKey.txt for Applebot-Extended
- 🤖 AIAdded Disallow: /8199ac63-be6c-4cba-9bd9-45500a02d64f.txt for ChatGPT-User
- 🤖 AIRemoved Disallow: /indexNowKey.txt for ChatGPT-User
- 🤖 AIAdded Disallow: /8199ac63-be6c-4cba-9bd9-45500a02d64f.txt for Claude-SearchBot
- 🤖 AIRemoved Disallow: /indexNowKey.txt for Claude-SearchBot
- 🤖 AIAdded Disallow: /8199ac63-be6c-4cba-9bd9-45500a02d64f.txt for Claude-User
- 🤖 AIRemoved Disallow: /indexNowKey.txt for Claude-User
- 🤖 AIAdded Disallow: /8199ac63-be6c-4cba-9bd9-45500a02d64f.txt for ClaudeBot
- 🤖 AIRemoved Disallow: /indexNowKey.txt for ClaudeBot
- 🤖 AIAdded Disallow: /8199ac63-be6c-4cba-9bd9-45500a02d64f.txt for Cohere-ai
- 🤖 AIRemoved Disallow: /indexNowKey.txt for Cohere-ai
- 🤖 AIAdded Disallow: /8199ac63-be6c-4cba-9bd9-45500a02d64f.txt for Google-Extended
- 🤖 AIRemoved Disallow: /indexNowKey.txt for Google-Extended
- 🤖 AIAdded Disallow: /8199ac63-be6c-4cba-9bd9-45500a02d64f.txt for GPTBot
- 🤖 AIRemoved Disallow: /indexNowKey.txt for GPTBot
- 🤖 AIAdded Disallow: /8199ac63-be6c-4cba-9bd9-45500a02d64f.txt for OAI-SearchBot
- 🤖 AIRemoved Disallow: /indexNowKey.txt for OAI-SearchBot
- 🤖 AIAdded Disallow: /8199ac63-be6c-4cba-9bd9-45500a02d64f.txt for PerplexityBot
- 🤖 AIRemoved Disallow: /indexNowKey.txt for PerplexityBot
Diff old (2026-08-04T12:42:22Z) → new (2026-09-11T19:15:58Z)
| @@ -177,7 +177,7 @@ | ||
| 177 | 177 | Disallow: /index.php/*/media/oembed |
| 178 | 178 | |
| 179 | 179 | # Disallow IndexNowKey |
| 180 | - Disallow: /indexNowKey.txt | |
| 180 | + Disallow: /8199ac63-be6c-4cba-9bd9-45500a02d64f.txt | |
| 181 | 181 | |
| 182 | 182 | # To be remove after proxy |
| 183 | 183 | # CSS, JS, Images ends |