Bloomberg / robots.txt
← back to bloomberg.com · change detected 1mo ago (2026-09-28T18:34:49Z) · modified +0 −38
What changed
- 🤖 AIRemoved Allow: /$ for ClaudeBot
- 🤖 AIRemoved Allow: /africa$ for ClaudeBot
- 🤖 AIRemoved Allow: /africa/$ for ClaudeBot
- 🤖 AIRemoved Allow: /asia$ for ClaudeBot
- 🤖 AIRemoved Allow: /asia/$ for ClaudeBot
- 🤖 AIRemoved Allow: /canada$ for ClaudeBot
- 🤖 AIRemoved Allow: /canada/$ for ClaudeBot
- 🤖 AIRemoved Allow: /europe$ for ClaudeBot
- 🤖 AIRemoved Allow: /europe/$ for ClaudeBot
- 🤖 AIRemoved Allow: /india$ for ClaudeBot
- 🤖 AIRemoved Allow: /india/$ for ClaudeBot
- 🤖 AIRemoved Allow: /jp$ for ClaudeBot
- 🤖 AIRemoved Allow: /jp/$ for ClaudeBot
- 🤖 AIRemoved Allow: /latinamerica$ for ClaudeBot
- 🤖 AIRemoved Allow: /latinamerica/$ for ClaudeBot
- 🤖 AIRemoved Allow: /middleeast$ for ClaudeBot
- 🤖 AIRemoved Allow: /middleeast/$ for ClaudeBot
- 🤖 AIRemoved Allow: /uk$ for ClaudeBot
- 🤖 AIRemoved Allow: /uk/$ for ClaudeBot
- 🤖 AIRemoved Allow: /$ for GPTBot
- 🤖 AIRemoved Allow: /africa$ for GPTBot
- 🤖 AIRemoved Allow: /africa/$ for GPTBot
- 🤖 AIRemoved Allow: /asia$ for GPTBot
- 🤖 AIRemoved Allow: /asia/$ for GPTBot
- 🤖 AIRemoved Allow: /canada$ for GPTBot
- 🤖 AIRemoved Allow: /canada/$ for GPTBot
- 🤖 AIRemoved Allow: /europe$ for GPTBot
- 🤖 AIRemoved Allow: /europe/$ for GPTBot
- 🤖 AIRemoved Allow: /india$ for GPTBot
- 🤖 AIRemoved Allow: /india/$ for GPTBot
- 🤖 AIRemoved Allow: /jp$ for GPTBot
- 🤖 AIRemoved Allow: /jp/$ for GPTBot
- 🤖 AIRemoved Allow: /latinamerica$ for GPTBot
- 🤖 AIRemoved Allow: /latinamerica/$ for GPTBot
- 🤖 AIRemoved Allow: /middleeast$ for GPTBot
- 🤖 AIRemoved Allow: /middleeast/$ for GPTBot
- 🤖 AIRemoved Allow: /uk$ for GPTBot
- 🤖 AIRemoved Allow: /uk/$ for GPTBot
Diff old (2026-09-23T16:51:28Z) → new (2026-09-28T18:34:49Z)
| @@ -124,25 +124,6 @@ | ||
| 124 | 124 | Allow: /latam |
| 125 | 125 | Allow: /faq |
| 126 | 126 | Allow: /tc |
| 127 | - Allow: /$ | |
| 128 | - Allow: /europe$ | |
| 129 | - Allow: /europe/$ | |
| 130 | - Allow: /asia$ | |
| 131 | - Allow: /asia/$ | |
| 132 | - Allow: /jp$ | |
| 133 | - Allow: /jp/$ | |
| 134 | - Allow: /india$ | |
| 135 | - Allow: /india/$ | |
| 136 | - Allow: /middleeast$ | |
| 137 | - Allow: /middleeast/$ | |
| 138 | - Allow: /africa$ | |
| 139 | - Allow: /africa/$ | |
| 140 | - Allow: /canada$ | |
| 141 | - Allow: /canada/$ | |
| 142 | - Allow: /uk$ | |
| 143 | - Allow: /uk/$ | |
| 144 | - Allow: /latinamerica$ | |
| 145 | - Allow: /latinamerica/$ | |
| 146 | 127 | User-agent: ClaudeBot |
| 147 | 128 | Disallow: / |
| 148 | 129 | Allow: /professional |
| @@ -150,25 +131,6 @@ | ||
| 150 | 131 | Allow: /latam |
| 151 | 132 | Allow: /faq |
| 152 | 133 | Allow: /tc |
| 153 | - Allow: /$ | |
| 154 | - Allow: /europe$ | |
| 155 | - Allow: /europe/$ | |
| 156 | - Allow: /asia$ | |
| 157 | - Allow: /asia/$ | |
| 158 | - Allow: /jp$ | |
| 159 | - Allow: /jp/$ | |
| 160 | - Allow: /india$ | |
| 161 | - Allow: /india/$ | |
| 162 | - Allow: /middleeast$ | |
| 163 | - Allow: /middleeast/$ | |
| 164 | - Allow: /africa$ | |
| 165 | - Allow: /africa/$ | |
| 166 | - Allow: /canada$ | |
| 167 | - Allow: /canada/$ | |
| 168 | - Allow: /uk$ | |
| 169 | - Allow: /uk/$ | |
| 170 | - Allow: /latinamerica$ | |
| 171 | - Allow: /latinamerica/$ | |
| 172 | 134 | |
| 173 | 135 | # Search indexing |
| 174 | 136 | User-agent: OAI-SearchBot |