MetLife / robots.txt snapshot
← back to metlife.com · fetched 2026-07-31T17:16:59Z (5d ago) · HTTP 200 · 1921 bytes · sha256 e36c4e2b26f52d16 · raw
final URL: https://www.metlife.com/robots.txt
| 1 | User-agent: * |
| 2 | Disallow: /sitemap/_jcr_content/root/sitemap.xml |
| 3 | Disallow: /*aemform.iframe.html* |
| 4 | Disallow: /uat/ |
| 5 | Disallow: /smoketest/ |
| 6 | Disallow: /pagenotfound/ |
| 7 | Disallow: /*.pdf |
| 8 | Disallow: /*.pdf$ |
| 9 | Disallow: https://origin-intl.metlife.com/* |
| 10 | Disallow: https://target.www.metlife.com/* |
| 11 | Disallow: https://origin-target.metlife.com/* |
| 12 | User-agent: prodGSA |
| 13 | Disallow: /system/ |
| 14 | Disallow: /MCOMDefault/ |
| 15 | Disallow: /WPSAssets/ |
| 16 | Disallow: /navimages/ |
| 17 | Disallow: /*.css$ |
| 18 | Disallow: /*.js$ |
| 19 | Disallow: /pagenotfound/ |
| 20 | User-agent: drGSA |
| 21 | Disallow: /system/ |
| 22 | Disallow: /MCOMDefault/ |
| 23 | Disallow: /WPSAssets/ |
| 24 | Disallow: /navimages/ |
| 25 | Disallow: /*.css$ |
| 26 | Disallow: /*.js$ |
| 27 | Disallow: /pagenotfound/ |
| 28 | User-agent: devqaGSA |
| 29 | Disallow: /system/ |
| 30 | Disallow: /MCOMDefault/ |
| 31 | Disallow: /WPSAssets/ |
| 32 | Disallow: /navimages/ |
| 33 | Disallow: /*.css$ |
| 34 | Disallow: /*.js$ |
| 35 | Sitemap: https://www.metlife.com/sitemap.xml |
| 36 | Sitemap: https://www.metlife.com/investments/en-us/sitemap.xml |
| 37 | Sitemap: https://www.metlife.com/investments/en-au/sitemap.xml |
| 38 | Sitemap: https://www.metlife.com/investments/en-ca/sitemap.xml |
| 39 | Sitemap: https://www.metlife.com/investments/en-ch/sitemap.xml |
| 40 | Sitemap: https://www.metlife.com/investments/en-de/sitemap.xml |
| 41 | Sitemap: https://www.metlife.com/investments/en-dk/sitemap.xml |
| 42 | Sitemap: https://www.metlife.com/investments/en-es/sitemap.xml |
| 43 | Sitemap: https://www.metlife.com/investments/en-fi/sitemap.xml |
| 44 | Sitemap: https://www.metlife.com/investments/en-uk/sitemap.xml |
| 45 | Sitemap: https://www.metlife.com/investments/en-ie/sitemap.xml |
| 46 | Sitemap: https://www.metlife.com/investments/en-nl/sitemap.xml |
| 47 | Sitemap: https://www.metlife.com/investments/en-se/sitemap.xml |
| 48 | Sitemap: https://www.metlife.com/investments/en-sg/sitemap.xml |
| 49 | Sitemap: https://www.metlife.com/investments/en-hk/sitemap.xml |
| 50 | Sitemap: https://www.metlife.com/investments/zh-hk/sitemap.xml |
| 51 | Sitemap: https://www.metlife.com/investments/en-me/sitemap.xml |
| 52 | Sitemap: https://www.metlife.com/investments/en-latam/sitemap.xml |