NeuralCrawl

Renault Group / robots.txt snapshot

← back to renaultgroup.com · fetched 2026-06-20T01:10:30Z (18h ago) · HTTP 200 · 4249 bytes · sha256 0baeaefbcc8e46c1 · raw

final URL: https://www.renaultgroup.com/robots.txt

1User-Agent: *
2Allow: /
3Disallow: /_next/
4Disallow: /api/
5Disallow: /static/
6Disallow: https://back.renaultgroup.com/wp-admin/
7Disallow: https://back.renaultgroup.com/wp-json/
8Disallow: /wp-content/uploads/
9Disallow: /search/
10Disallow: /de/
11Disallow: /es/
12Disallow: /it/
13Disallow: /pt/
14Disallow: /br/
15Disallow: /ro/
16Disallow: /nl/
17
18# OpenAI — GPTBot (model training) — FR + EN only
19User-agent: GPTBot
20Allow: /
21Disallow: /de/
22Disallow: /es/
23Disallow: /it/
24Disallow: /pt/
25Disallow: /br/
26Disallow: /ro/
27Disallow: /nl/
28
29# OpenAI — OAI-SearchBot (ChatGPT Search real-time results) — FR + EN only
30User-agent: OAI-SearchBot
31Allow: /
32Disallow: /de/
33Disallow: /es/
34Disallow: /it/
35Disallow: /pt/
36Disallow: /br/
37Disallow: /ro/
38Disallow: /nl/
39
40# OpenAI — ChatGPT-User (user-triggered in ChatGPT) — FR + EN only
41User-agent: ChatGPT-User
42Allow: /
43Disallow: /de/
44Disallow: /es/
45Disallow: /it/
46Disallow: /pt/
47Disallow: /br/
48Disallow: /ro/
49Disallow: /nl/
50
51# Anthropic — ClaudeBot (model training) — FR + EN only
52User-agent: ClaudeBot
53Allow: /
54Disallow: /de/
55Disallow: /es/
56Disallow: /it/
57Disallow: /pt/
58Disallow: /br/
59Disallow: /ro/
60Disallow: /nl/
61
62# Anthropic — Claude-Web — FR + EN only
63User-agent: Claude-Web
64Allow: /
65Disallow: /de/
66Disallow: /es/
67Disallow: /it/
68Disallow: /pt/
69Disallow: /br/
70Disallow: /ro/
71Disallow: /nl/
72
73# Anthropic — anthropic-ai — FR + EN only
74User-agent: anthropic-ai
75Allow: /
76Disallow: /de/
77Disallow: /es/
78Disallow: /it/
79Disallow: /pt/
80Disallow: /br/
81Disallow: /ro/
82Disallow: /nl/
83
84# Google AI — FR + EN only
85User-agent: Google-Extended
86Allow: /
87Disallow: /de/
88Disallow: /es/
89Disallow: /it/
90Disallow: /pt/
91Disallow: /br/
92Disallow: /ro/
93Disallow: /nl/
94
95# Perplexity — FR + EN only
96User-agent: PerplexityBot
97Allow: /
98Disallow: /de/
99Disallow: /es/
100Disallow: /it/
101Disallow: /pt/
102Disallow: /br/
103Disallow: /ro/
104Disallow: /nl/
105
106# Apple — FR + EN only
107User-agent: Applebot-Extended
108Allow: /
109Disallow: /de/
110Disallow: /es/
111Disallow: /it/
112Disallow: /pt/
113Disallow: /br/
114Disallow: /ro/
115Disallow: /nl/
116
117# xAI — Grok — FR + EN only
118User-agent: Grok
119Allow: /
120Disallow: /de/
121Disallow: /es/
122Disallow: /it/
123Disallow: /pt/
124Disallow: /br/
125Disallow: /ro/
126Disallow: /nl/
127
128# Meta — FR + EN only
129User-agent: FacebookBot
130Allow: /
131Disallow: /de/
132Disallow: /es/
133Disallow: /it/
134Disallow: /pt/
135Disallow: /br/
136Disallow: /ro/
137Disallow: /nl/
138
139# Microsoft Copilot — FR + EN only
140User-agent: Bingbot
141Allow: /
142Disallow: /de/
143Disallow: /es/
144Disallow: /it/
145Disallow: /pt/
146Disallow: /br/
147Disallow: /ro/
148Disallow: /nl/
149
150# Amazon — FR + EN only
151User-agent: Amazonbot
152Allow: /
153Disallow: /de/
154Disallow: /es/
155Disallow: /it/
156Disallow: /pt/
157Disallow: /br/
158Disallow: /ro/
159Disallow: /nl/
160
161# Common Crawl (open-source models) — FR + EN only
162User-agent: CCBot
163Allow: /
164Disallow: /de/
165Disallow: /es/
166Disallow: /it/
167Disallow: /pt/
168Disallow: /br/
169Disallow: /ro/
170Disallow: /nl/
171
172# ByteDance / TikTok (Doubao and other LLMs) — FR + EN only
173User-agent: Bytespider
174Allow: /
175Disallow: /de/
176Disallow: /es/
177Disallow: /it/
178Disallow: /pt/
179Disallow: /br/
180Disallow: /ro/
181Disallow: /nl/
182
183# OpenAI — GPTBot (model training)
184User-agent: GPTBot
185Allow: /de/
186Allow: /es/
187Allow: /it/
188Allow: /pt/
189Allow: /br/
190Allow: /ro/
191Disallow: /
192
193# OpenAI — OAI-SearchBot (ChatGPT Search real-time results)
194User-agent: OAI-SearchBot
195Allow: /
196
197# OpenAI — ChatGPT-User (user-triggered in ChatGPT)
198User-agent: ChatGPT-User
199Allow: /
200
201# Anthropic — ClaudeBot (model training)
202User-agent: ClaudeBot
203Allow: /de/
204Allow: /es/
205Allow: /it/
206Allow: /pt/
207Allow: /br/
208Allow: /ro/
209Disallow: /
210
211# Anthropic — Claude-Web
212User-agent: Claude-Web
213Allow: /
214
215# Anthropic — anthropic-ai
216User-agent: anthropic-ai
217Allow: /
218
219# Google AI
220User-agent: Google-Extended
221Allow: /
222
223# Perplexity
224User-agent: PerplexityBot
225Allow: /
226
227# Apple
228User-agent: Applebot-Extended
229Allow: /
230
231# xAI — Grok
232User-agent: Grok
233Allow: /
234
235# Meta
236User-agent: FacebookBot
237Allow: /
238
239# Microsoft Copilot
240User-agent: Bingbot
241Allow: /
242
243# Amazon
244User-agent: Amazonbot
245Allow: /
246
247# Common Crawl (open-source models)
248User-agent: CCBot
249Allow: /
250
251# ByteDance / TikTok (Doubao and other LLMs)
252User-agent: Bytespider
253Allow: /
254
255Sitemap: https://www.renaultgroup.com/sitemap.xml
256Sitemap: https://www.renaultgroup.com/sitemap2-index.xml
257Sitemap: https://www.renaultgroup.com/sitemap-en-index.xml