NeuralCrawl

ASML / robots.txt snapshot

← back to asml.com · fetched 2026-06-20T01:10:30Z (18h ago) · HTTP 200 · 953 bytes · sha256 20941d12ee9c58a2 · raw

final URL: https://www.asml.com/robots.txt

1User-agent: *
2# Exclude Sitecore paths
3Disallow: /en/Presentation
4# Exclude parameters for SEO
5Disallow: /*?job_country=
6Disallow: /*?job_type=
7Disallow: /*?job_teams=
8Disallow: /*?job_technical_fields=
9Disallow: /*?job_degrees=
10Disallow: /*?job_experience_levels=
11Disallow: /*?job_educational_backgrounds=
12Disallow: /*?job_city=
13Disallow: /*?sort_by=
14Disallow: /*?query=
15Disallow: /*?tags=
16Disallow: /*&job_country=
17Disallow: /*&job_type=
18Disallow: /*&job_teams=
19Disallow: /*&job_technical_fields=
20Disallow: /*&job_degrees=
21Disallow: /*&job_experience_levels=
22Disallow: /*&job_educational_backgrounds=
23Disallow: /*&job_city=
24Disallow: /*&sort_by=
25Disallow: /*&query=
26Disallow: /*&tags=
27# Exclude paths for old platform
28Disallow: /sitecore
29Disallow: *show.do
30Disallow: *sys_tab
31Disallow: *?rid
32Disallow: */tw/
33Disallow: */ja/
34Disallow: */kr/
35User-agent: Acrolinx-bot
36Allow: /en/careers/
37Allow: /de-de/karriere/
38Sitemap: https://www.asml.com/sitemap.xml