MetLife / robots.txt snapshot

← back to metlife.com · fetched 2026-06-20T01:10:30Z (18h ago) · HTTP 200 · 1253 bytes · sha256 2fe60d1c771854b4 · raw

final URL: https://www.metlife.com/robots.txt

1	User-agent: *
2	Disallow: /sitemap/_jcr_content/root/sitemap.xml
3	Disallow: /aemform.iframe.html
4	Disallow: /uat/
5	Disallow: /smoketest/
6	Disallow: /pagenotfound/
7	Disallow: /*.pdf
8	Disallow: /*.pdf$
9	Disallow: https://origin-intl.metlife.com/*
10	Disallow: https://target.www.metlife.com/*
11	Disallow: https://origin-target.metlife.com/*
12	Disallow: https://metlife-prod.adobecqms.net/*
13	Disallow: https://author-metlife-prod.adobecqms.net/*
14	Disallow: https://metlife-prod.adobecqms.net/*
15	Disallow: https://metlife-prod-2019.adobecqms.net/*
16	Disallow: https://metlife-prod-65.adobecqms.net/*
17	Disallow: https://metlife-prodtenants.adobecqms.net/*
18	Disallow: https://metlife-qa1-65.adobecqms.net/*
19	Disallow: https://metlife-qa1tenants.adobecqms.net/*
20	User-agent: prodGSA
21	Disallow: /system/
22	Disallow: /MCOMDefault/
23	Disallow: /WPSAssets/
24	Disallow: /navimages/
25	Disallow: /*.css$
26	Disallow: /*.js$
27	Disallow: /pagenotfound/
28	User-agent: drGSA
29	Disallow: /system/
30	Disallow: /MCOMDefault/
31	Disallow: /WPSAssets/
32	Disallow: /navimages/
33	Disallow: /*.css$
34	Disallow: /*.js$
35	Disallow: /pagenotfound/
36	User-agent: devqaGSA
37	Disallow: /system/
38	Disallow: /MCOMDefault/
39	Disallow: /WPSAssets/
40	Disallow: /navimages/
41	Disallow: /*.css$
42	Disallow: /*.js$
43	Sitemap: https://www.metlife.com/sitemap.xml