Renault Group / robots.txt
← back to renaultgroup.com · change detected 6d ago (2026-08-18T11:29:20Z) · modified +0 −72
What changed
- 🤖 AIUnblocked ClaudeBot (Anthropic)
- 🤖 AIRemoved Allow: /br/ for ClaudeBot
- 🤖 AIRemoved Allow: /de/ for ClaudeBot
- 🤖 AIRemoved Allow: /es/ for ClaudeBot
- 🤖 AIRemoved Allow: /it/ for ClaudeBot
- 🤖 AIRemoved Allow: /pt/ for ClaudeBot
- 🤖 AIRemoved Allow: /ro/ for ClaudeBot
- 🤖 AIUnblocked GPTBot (OpenAI)
- 🤖 AIRemoved Allow: /br/ for GPTBot
- 🤖 AIRemoved Allow: /de/ for GPTBot
- 🤖 AIRemoved Allow: /es/ for GPTBot
- 🤖 AIRemoved Allow: /it/ for GPTBot
- 🤖 AIRemoved Allow: /pt/ for GPTBot
- 🤖 AIRemoved Allow: /ro/ for GPTBot
Diff old (2026-07-20T19:11:56Z) → new (2026-08-18T11:29:20Z)
| @@ -178,78 +178,6 @@ | ||
| 178 | 178 | Disallow: /ro/ |
| 179 | 179 | Disallow: /nl/ |
| 180 | 180 | |
| 181 | - # OpenAI — GPTBot (model training) | |
| 182 | - User-agent: GPTBot | |
| 183 | - Allow: /de/ | |
| 184 | - Allow: /es/ | |
| 185 | - Allow: /it/ | |
| 186 | - Allow: /pt/ | |
| 187 | - Allow: /br/ | |
| 188 | - Allow: /ro/ | |
| 189 | - Disallow: / | |
| 190 | - | |
| 191 | - # OpenAI — OAI-SearchBot (ChatGPT Search real-time results) | |
| 192 | - User-agent: OAI-SearchBot | |
| 193 | - Allow: / | |
| 194 | - | |
| 195 | - # OpenAI — ChatGPT-User (user-triggered in ChatGPT) | |
| 196 | - User-agent: ChatGPT-User | |
| 197 | - Allow: / | |
| 198 | - | |
| 199 | - # Anthropic — ClaudeBot (model training) | |
| 200 | - User-agent: ClaudeBot | |
| 201 | - Allow: /de/ | |
| 202 | - Allow: /es/ | |
| 203 | - Allow: /it/ | |
| 204 | - Allow: /pt/ | |
| 205 | - Allow: /br/ | |
| 206 | - Allow: /ro/ | |
| 207 | - Disallow: / | |
| 208 | - | |
| 209 | - # Anthropic — Claude-Web | |
| 210 | - User-agent: Claude-Web | |
| 211 | - Allow: / | |
| 212 | - | |
| 213 | - # Anthropic — anthropic-ai | |
| 214 | - User-agent: anthropic-ai | |
| 215 | - Allow: / | |
| 216 | - | |
| 217 | - # Google AI | |
| 218 | - User-agent: Google-Extended | |
| 219 | - Allow: / | |
| 220 | - | |
| 221 | - # Perplexity | |
| 222 | - User-agent: PerplexityBot | |
| 223 | - Allow: / | |
| 224 | - | |
| 225 | - # Apple | |
| 226 | - User-agent: Applebot-Extended | |
| 227 | - Allow: / | |
| 228 | - | |
| 229 | - # xAI — Grok | |
| 230 | - User-agent: Grok | |
| 231 | - Allow: / | |
| 232 | - | |
| 233 | - # Meta | |
| 234 | - User-agent: FacebookBot | |
| 235 | - Allow: / | |
| 236 | - | |
| 237 | - # Microsoft Copilot | |
| 238 | - User-agent: Bingbot | |
| 239 | - Allow: / | |
| 240 | - | |
| 241 | - # Amazon | |
| 242 | - User-agent: Amazonbot | |
| 243 | - Allow: / | |
| 244 | - | |
| 245 | - # Common Crawl (open-source models) | |
| 246 | - User-agent: CCBot | |
| 247 | - Allow: / | |
| 248 | - | |
| 249 | - # ByteDance / TikTok (Doubao and other LLMs) | |
| 250 | - User-agent: Bytespider | |
| 251 | - Allow: / | |
| 252 | - | |
| 253 | 181 | Sitemap: https://www.renaultgroup.com/sitemap.xml |
| 254 | 182 | Sitemap: https://www.renaultgroup.com/sitemap2-index.xml |
| 255 | 183 | Sitemap: https://www.renaultgroup.com/sitemap-en-index.xml |