Zscaler / robots.txt
← back to zscaler.com · change detected 1mo ago (2026-09-23T10:50:20Z) · modified +0 −7
What changed
- 🤖 AIRemoved Disallow: /*?* for Applebot-Extended
- 🤖 AIRemoved Disallow: /*?* for ChatGPT-User
- 🤖 AIRemoved Disallow: /*?* for Claude-SearchBot
- 🤖 AIRemoved Disallow: /*?* for Claude-User
- 🤖 AIRemoved Disallow: /*?* for ClaudeBot
- 🤖 AIRemoved Disallow: /*?* for Cohere-ai
- 🤖 AIRemoved Disallow: /*?* for Google-Extended
- 🤖 AIRemoved Disallow: /*?* for GPTBot
- 🤖 AIRemoved Disallow: /*?* for OAI-SearchBot
- 🤖 AIRemoved Disallow: /*?* for PerplexityBot
Diff old (2026-09-11T19:15:58Z) → new (2026-09-23T10:50:20Z)
| @@ -54,9 +54,6 @@ | ||
| 54 | 54 | # Zscaler: Disallow email-signature page |
| 55 | 55 | Disallow: /email-signature |
| 56 | 56 | Disallow: /*/email-signature |
| 57 | - | |
| 58 | - # Query strings | |
| 59 | - Disallow: /*?* | |
| 60 | 57 | |
| 61 | 58 | # Allow _next images |
| 62 | 59 | Allow: /_next/image?url=* |
| @@ -152,10 +149,6 @@ | ||
| 152 | 149 | Disallow: /user/password/ |
| 153 | 150 | Disallow: /user/login/ |
| 154 | 151 | Disallow: /user/logout/ |
| 155 | - | |
| 156 | - # Query strings | |
| 157 | - Disallow: /*?* | |
| 158 | - | |
| 159 | 152 | Disallow: /en$ |
| 160 | 153 | Disallow: /en/* |
| 161 | 154 |