NeuralCrawl

MetLife / robots.txt

← back to metlife.com · change detected 8d ago (2026-07-29T10:28:28Z) · modified +2 −8

What changed

Diff old (2026-07-28T16:12:16Z)new (2026-07-29T10:28:28Z)

@@ -1,4 +1,6 @@
11  User-agent: *
2+ Disallow: /investments$
3+ Disallow: /investments/
24  Disallow: /sitemap/_jcr_content/root/sitemap.xml
35  Disallow: /*aemform.iframe.html*
46  Disallow: /uat/
@@ -9,14 +11,6 @@
911  Disallow: https://origin-intl.metlife.com/*
1012  Disallow: https://target.www.metlife.com/*
1113  Disallow: https://origin-target.metlife.com/*
12- Disallow: https://metlife-prod.adobecqms.net/*
13- Disallow: https://author-metlife-prod.adobecqms.net/*
14- Disallow: https://metlife-prod.adobecqms.net/*
15- Disallow: https://metlife-prod-2019.adobecqms.net/*
16- Disallow: https://metlife-prod-65.adobecqms.net/*
17- Disallow: https://metlife-prodtenants.adobecqms.net/*
18- Disallow: https://metlife-qa1-65.adobecqms.net/*
19- Disallow: https://metlife-qa1tenants.adobecqms.net/*
2014  User-agent: prodGSA
2115  Disallow: /system/
2216  Disallow: /MCOMDefault/