Bloomberg / robots.txt
← back to bloomberg.com · change detected 1mo ago (2026-10-06T03:20:59Z) · modified +80 −0
What changed
- 🤖 AIAdded Allow: /africa/llms.txt$ for ChatGPT-User
- 🤖 AIAdded Allow: /africa/llms.txt/$ for ChatGPT-User
- 🤖 AIAdded Allow: /asia/llms.txt$ for ChatGPT-User
- 🤖 AIAdded Allow: /asia/llms.txt/$ for ChatGPT-User
- 🤖 AIAdded Allow: /canada/llms.txt$ for ChatGPT-User
- 🤖 AIAdded Allow: /canada/llms.txt/$ for ChatGPT-User
- 🤖 AIAdded Allow: /europe/llms.txt$ for ChatGPT-User
- 🤖 AIAdded Allow: /europe/llms.txt/$ for ChatGPT-User
- 🤖 AIAdded Allow: /india/llms.txt$ for ChatGPT-User
- 🤖 AIAdded Allow: /india/llms.txt/$ for ChatGPT-User
- 🤖 AIAdded Allow: /jp/llms.txt$ for ChatGPT-User
- 🤖 AIAdded Allow: /jp/llms.txt/$ for ChatGPT-User
- 🤖 AIAdded Allow: /latinamerica/llms.txt$ for ChatGPT-User
- 🤖 AIAdded Allow: /latinamerica/llms.txt/$ for ChatGPT-User
- 🤖 AIAdded Allow: /llms.txt$ for ChatGPT-User
- 🤖 AIAdded Allow: /llms.txt/$ for ChatGPT-User
- 🤖 AIAdded Allow: /middleeast/llms.txt$ for ChatGPT-User
- 🤖 AIAdded Allow: /middleeast/llms.txt/$ for ChatGPT-User
- 🤖 AIAdded Allow: /uk/llms.txt$ for ChatGPT-User
- 🤖 AIAdded Allow: /uk/llms.txt/$ for ChatGPT-User
- 🤖 AIAdded Allow: /africa/llms.txt$ for Claude-SearchBot
- 🤖 AIAdded Allow: /africa/llms.txt/$ for Claude-SearchBot
- 🤖 AIAdded Allow: /asia/llms.txt$ for Claude-SearchBot
- 🤖 AIAdded Allow: /asia/llms.txt/$ for Claude-SearchBot
- 🤖 AIAdded Allow: /canada/llms.txt$ for Claude-SearchBot
- 🤖 AIAdded Allow: /canada/llms.txt/$ for Claude-SearchBot
- 🤖 AIAdded Allow: /europe/llms.txt$ for Claude-SearchBot
- 🤖 AIAdded Allow: /europe/llms.txt/$ for Claude-SearchBot
- 🤖 AIAdded Allow: /india/llms.txt$ for Claude-SearchBot
- 🤖 AIAdded Allow: /india/llms.txt/$ for Claude-SearchBot
- 🤖 AIAdded Allow: /jp/llms.txt$ for Claude-SearchBot
- 🤖 AIAdded Allow: /jp/llms.txt/$ for Claude-SearchBot
- 🤖 AIAdded Allow: /latinamerica/llms.txt$ for Claude-SearchBot
- 🤖 AIAdded Allow: /latinamerica/llms.txt/$ for Claude-SearchBot
- 🤖 AIAdded Allow: /llms.txt$ for Claude-SearchBot
- 🤖 AIAdded Allow: /llms.txt/$ for Claude-SearchBot
- 🤖 AIAdded Allow: /middleeast/llms.txt$ for Claude-SearchBot
- 🤖 AIAdded Allow: /middleeast/llms.txt/$ for Claude-SearchBot
- 🤖 AIAdded Allow: /uk/llms.txt$ for Claude-SearchBot
- 🤖 AIAdded Allow: /uk/llms.txt/$ for Claude-SearchBot
- 🤖 AIAdded Allow: /africa/llms.txt$ for Claude-User
- 🤖 AIAdded Allow: /africa/llms.txt/$ for Claude-User
- 🤖 AIAdded Allow: /asia/llms.txt$ for Claude-User
- 🤖 AIAdded Allow: /asia/llms.txt/$ for Claude-User
- 🤖 AIAdded Allow: /canada/llms.txt$ for Claude-User
- 🤖 AIAdded Allow: /canada/llms.txt/$ for Claude-User
- 🤖 AIAdded Allow: /europe/llms.txt$ for Claude-User
- 🤖 AIAdded Allow: /europe/llms.txt/$ for Claude-User
- 🤖 AIAdded Allow: /india/llms.txt$ for Claude-User
- 🤖 AIAdded Allow: /india/llms.txt/$ for Claude-User
- ... and 30 more change(s)
Diff old (2026-09-28T18:34:49Z) → new (2026-10-06T03:20:59Z)
| @@ -159,6 +159,26 @@ | ||
| 159 | 159 | Allow: /uk/$ |
| 160 | 160 | Allow: /latinamerica$ |
| 161 | 161 | Allow: /latinamerica/$ |
| 162 | + Allow: /llms.txt$ | |
| 163 | + Allow: /llms.txt/$ | |
| 164 | + Allow: /europe/llms.txt$ | |
| 165 | + Allow: /europe/llms.txt/$ | |
| 166 | + Allow: /asia/llms.txt$ | |
| 167 | + Allow: /asia/llms.txt/$ | |
| 168 | + Allow: /jp/llms.txt$ | |
| 169 | + Allow: /jp/llms.txt/$ | |
| 170 | + Allow: /india/llms.txt$ | |
| 171 | + Allow: /india/llms.txt/$ | |
| 172 | + Allow: /middleeast/llms.txt$ | |
| 173 | + Allow: /middleeast/llms.txt/$ | |
| 174 | + Allow: /africa/llms.txt$ | |
| 175 | + Allow: /africa/llms.txt/$ | |
| 176 | + Allow: /canada/llms.txt$ | |
| 177 | + Allow: /canada/llms.txt/$ | |
| 178 | + Allow: /uk/llms.txt$ | |
| 179 | + Allow: /uk/llms.txt/$ | |
| 180 | + Allow: /latinamerica/llms.txt$ | |
| 181 | + Allow: /latinamerica/llms.txt/$ | |
| 162 | 182 | User-agent: Claude-SearchBot |
| 163 | 183 | Disallow: / |
| 164 | 184 | Allow: /professional |
| @@ -185,6 +205,26 @@ | ||
| 185 | 205 | Allow: /uk/$ |
| 186 | 206 | Allow: /latinamerica$ |
| 187 | 207 | Allow: /latinamerica/$ |
| 208 | + Allow: /llms.txt$ | |
| 209 | + Allow: /llms.txt/$ | |
| 210 | + Allow: /europe/llms.txt$ | |
| 211 | + Allow: /europe/llms.txt/$ | |
| 212 | + Allow: /asia/llms.txt$ | |
| 213 | + Allow: /asia/llms.txt/$ | |
| 214 | + Allow: /jp/llms.txt$ | |
| 215 | + Allow: /jp/llms.txt/$ | |
| 216 | + Allow: /india/llms.txt$ | |
| 217 | + Allow: /india/llms.txt/$ | |
| 218 | + Allow: /middleeast/llms.txt$ | |
| 219 | + Allow: /middleeast/llms.txt/$ | |
| 220 | + Allow: /africa/llms.txt$ | |
| 221 | + Allow: /africa/llms.txt/$ | |
| 222 | + Allow: /canada/llms.txt$ | |
| 223 | + Allow: /canada/llms.txt/$ | |
| 224 | + Allow: /uk/llms.txt$ | |
| 225 | + Allow: /uk/llms.txt/$ | |
| 226 | + Allow: /latinamerica/llms.txt$ | |
| 227 | + Allow: /latinamerica/llms.txt/$ | |
| 188 | 228 | |
| 189 | 229 | # User-triggered fetches |
| 190 | 230 | User-agent: ChatGPT-User |
| @@ -213,6 +253,26 @@ | ||
| 213 | 253 | Allow: /uk/$ |
| 214 | 254 | Allow: /latinamerica$ |
| 215 | 255 | Allow: /latinamerica/$ |
| 256 | + Allow: /llms.txt$ | |
| 257 | + Allow: /llms.txt/$ | |
| 258 | + Allow: /europe/llms.txt$ | |
| 259 | + Allow: /europe/llms.txt/$ | |
| 260 | + Allow: /asia/llms.txt$ | |
| 261 | + Allow: /asia/llms.txt/$ | |
| 262 | + Allow: /jp/llms.txt$ | |
| 263 | + Allow: /jp/llms.txt/$ | |
| 264 | + Allow: /india/llms.txt$ | |
| 265 | + Allow: /india/llms.txt/$ | |
| 266 | + Allow: /middleeast/llms.txt$ | |
| 267 | + Allow: /middleeast/llms.txt/$ | |
| 268 | + Allow: /africa/llms.txt$ | |
| 269 | + Allow: /africa/llms.txt/$ | |
| 270 | + Allow: /canada/llms.txt$ | |
| 271 | + Allow: /canada/llms.txt/$ | |
| 272 | + Allow: /uk/llms.txt$ | |
| 273 | + Allow: /uk/llms.txt/$ | |
| 274 | + Allow: /latinamerica/llms.txt$ | |
| 275 | + Allow: /latinamerica/llms.txt/$ | |
| 216 | 276 | User-agent: Claude-User |
| 217 | 277 | Disallow: / |
| 218 | 278 | Allow: /professional |
| @@ -239,6 +299,26 @@ | ||
| 239 | 299 | Allow: /uk/$ |
| 240 | 300 | Allow: /latinamerica$ |
| 241 | 301 | Allow: /latinamerica/$ |
| 302 | + Allow: /llms.txt$ | |
| 303 | + Allow: /llms.txt/$ | |
| 304 | + Allow: /europe/llms.txt$ | |
| 305 | + Allow: /europe/llms.txt/$ | |
| 306 | + Allow: /asia/llms.txt$ | |
| 307 | + Allow: /asia/llms.txt/$ | |
| 308 | + Allow: /jp/llms.txt$ | |
| 309 | + Allow: /jp/llms.txt/$ | |
| 310 | + Allow: /india/llms.txt$ | |
| 311 | + Allow: /india/llms.txt/$ | |
| 312 | + Allow: /middleeast/llms.txt$ | |
| 313 | + Allow: /middleeast/llms.txt/$ | |
| 314 | + Allow: /africa/llms.txt$ | |
| 315 | + Allow: /africa/llms.txt/$ | |
| 316 | + Allow: /canada/llms.txt$ | |
| 317 | + Allow: /canada/llms.txt/$ | |
| 318 | + Allow: /uk/llms.txt$ | |
| 319 | + Allow: /uk/llms.txt/$ | |
| 320 | + Allow: /latinamerica/llms.txt$ | |
| 321 | + Allow: /latinamerica/llms.txt/$ | |
| 242 | 322 | |
| 243 | 323 | # Google Services |
| 244 | 324 | User-agent: Google-Apps |