NeuralCrawl

Bayer / robots.txt

← back to bayer.com · change detected 26d ago (2026-10-12T17:28:07Z) · modified +3 −30

What changed

Diff old (2026-09-22T10:23:37Z) → new (2026-10-12T17:28:07Z)

@@ -1,34 +1,7 @@
1+ # Bayer Global robots.txt
2+ # https://www.bayer.com/
3+
14  User-agent: *
25  Disallow: /search/
3- Disallow: /contact/
4- Disallow: /kontakt/
5- Disallow: /report/
6- Disallow: /product/
7- Disallow: /uk-ua/v-med-news/overview
8- Disallow: /uk-ua/v-med-news/1
9- Disallow: /uk-ua/v-med-news/mednews231
10- Disallow: /uk-ua/v-med-news/anticoagulant-therapy
11- Disallow: /uk-ua/v-med-news/endometriom
12- Disallow: /uk-ua/v-med-news/dienogest
13- Disallow: /uk-ua/v-med-news/contraception
14- Disallow: /uk-ua/v-med-news/2
15- Disallow: /uk-ua/v-med-news/3
16- Disallow: /uk-ua/v-med-news/time-interview
17- Disallow: /*/locations$
18-
19- # Paths (no clean URLs)
20- Disallow: /index.php/admin/
21- Disallow: /index.php/comment/reply/
22- Disallow: /index.php/filter/tips
23- Disallow: /index.php/node/add/
24- Disallow: /index.php/search/
256  Disallow: /*?
26- Disallow: /*?autotranslate=*
27- Disallow: /en/data-privacy-information-for-managing-contingent-workforce
28- Disallow: /*/form/*
29- Disallow: /*/webform/*
30- Disallow: /en/cxpatients
31- Disallow: /en/investors/document-download-tool?
32- Disallow: /de-de/investoren/document-download-tool?
33- Disallow: /node/*
347  Sitemap: https://www.bayer.com/sitemap.xml