Biogen / robots.txt snapshot
← back to biogen.com · fetched 2026-06-20T01:10:30Z (18h ago) · HTTP 200 · 338 bytes · sha256 2c15109e13ac1ae2 · raw
final URL: https://www.biogen.com/robots.txt
| 1 | # Updated 08/10/25 |
| 2 | # Disallow modals, error, search, utility and ? pages |
| 3 | |
| 4 | User-agent: * |
| 5 | |
| 6 | Disallow: /cookies.html |
| 7 | Disallow: /global-references.html |
| 8 | Disallow: /modal* |
| 9 | Disallow: /*?lightbox= |
| 10 | Disallow: /suche.html?* |
| 11 | Disallow: /errors/404.html |
| 12 | Disallow: /errors/403.html |
| 13 | Disallow: /errors/500.html |
| 14 | |
| 15 | Sitemap: https://www.biogen.com/sitemap.xml |