NeuralCrawl

Marsh McLennan / robots.txt

← back to marshmclennan.com · change detected 2mo ago (2026-08-26T14:01:29Z) · modified +22 −4

What changed

Diff old (2026-06-20T01:10:30Z) → new (2026-08-26T14:01:29Z)

@@ -1,5 +1,23 @@
11  User-agent: *
2- Disallow: /pages/redirects/*
3- Disallow: /search.html?*
4- Disallow: /content/mmc-web/mmc-v2/*
5- Sitemap: https://www.corporate.marsh.com/sitemap.xml
2+
3+ Disallow: /*.html/content/
4+ Disallow: /sharedcontent/
5+ Disallow: /*/_jcr_content/
6+ Disallow: /*/jcr:content/
7+ Disallow: /*/designs/
8+ Disallow: /*/etc/tags/
9+ Disallow: /*/registration-form/request-submitted.html
10+ Disallow: /*/registration-form/email-not-validated.html
11+ Disallow: /*/registration-form/email-sent.html
12+
13+ Disallow: /libs/cq/security/userinfo.json*
14+ Disallow: *.cookiepolicy.json*
15+ Disallow: /etc/segmentation.segment.js?_=*
16+
17+ Disallow: /*/search.html
18+ Disallow: /*/forms.html
19+ Disallow: /*/campaigns.html
20+ Disallow: /*/register.html
21+ Disallow: /*/registration-form.html
22+ Disallow: /*/confirmation.html
23+ Disallow: /*/moi?=*