π«π· Thales
thalesgroup.com · European companies · rank #95 · Aerospace & Defense · live robots.txt ↗
AI crawler access (latest snapshot, 13h ago)
⛔blocked
restricted
✅allowed
faded = inherited from the * wildcard group
✅GPTBot
✅ChatGPT-User
✅OAI-SearchBot
✅ClaudeBot
✅Claude-User
✅Claude-SearchBot
✅anthropic-ai
✅Claude-Web
✅CCBot
✅Google-Extended
✅Applebot-Extended
✅PerplexityBot
✅Perplexity-User
✅Bytespider
✅Amazonbot
✅FacebookBot
✅meta-externalagent
✅meta-externalfetcher
✅cohere-ai
✅AI2Bot
✅Diffbot
✅omgili
✅YouBot
✅DuckAssistBot
✅MistralAI-User
✅PanguBot
✅Timpibot
Current robots.txt 2187 bytes · sha256 6a3c8ea648af · raw
User-agent: * # Directories Disallow: /core/ Disallow: /profiles/ # Files Disallow: /README.txt Disallow: /web.config # Paths Disallow: /admin/ Disallow: /comment/reply/ Disallow: /filter/tips Disallow: /node/add/ Disallow: */node/* Disallow: */taxonomy/* Disallow: /user/register/ Disallow: /user/password/ Disallow: /user/login/ Disallow: /user/logout/ Disallow: /index.php/admin/ Disallow: /index.php/comment/reply/ Disallow: /index.php/filter/tips Disallow: /index.php/node/add/ Disallow: /index.php/search/ Disallow: /index.php/user/password/ Disallow: /index.php/user/register/ Disallow: /index.php/user/login/ Disallow: /index.php/user/logout/ Disallow: /index.php* # Paramètres internes Disallow: *?you_are=* Disallow: *?sort_by=* Disallow: *?sort_order=* Disallow: *?field_productrange_target_id=* Disallow: *?field_productadviceareas_target_id=* Disallow: *?field_productmaintarget_target_id=* Disallow: ?field_productcategory_target_id=* Disallow: ?field_product_type_target_id=* Disallow: ?field_productdistinction_target_id=* Disallow: /xxx Disallow: *?longitude=* Disallow: *?latitude=* Disallow: /modal-review Disallow: *?view=teaser=* Disallow: *?*review_rate=* Disallow: /media/* Disallow: *catalogue-de-solutions=* Disallow: *_ga=* Disallow: *amp;utm_campaign=* Disallow: *amp;utm_medium=* Disallow: *amp;utm_source=* Disallow: *f[0]=* Disallow: *f[10]=* Disallow: *f[11]=* Disallow: *f[1]=* Disallow: *f[2]=* Disallow: *f[3]=* Disallow: *f[4]=* Disallow: *f[5]=* Disallow: *f[6]=* Disallow: *f[7]=* Disallow: *f[8]=* Disallow: *f[9]=* Disallow: *f[9]=* Disallow: *?f* Disallow: *field_asset_category_target_id=* Disallow: *gad_campaignid=* Disallow: *gad_source=* Disallow: *gbraid=* Disallow: *gclid=* Disallow: *h=* Disallow: *itok=* Disallow: *mkt_tok=* Disallow: *search=* Disallow: *sessionGUID=* Disallow: *sort_bef_combine=* Disallow: *utm_campaign=* Disallow: *utm_medium=* Disallow: *utm_source=* Disallow: *v=* Disallow: *webSyncID=* Disallow: *scope=* Disallow: *delta=* Disallow: *include=* Disallow: *theme=* # Paramètre langue (si géré par dossiers/sous-domaines) Disallow: *?*language=* # Sitemap Sitemap: https://www.thalesgroup.com/sitemap.xml
Change history
-
initial snapshot
- First snapshot of robots.txt archived