ExxonMobil / robots.txt snapshot
← back to exxonmobil.com · fetched 2026-06-20T01:10:30Z (18h ago) · HTTP 200 · 1202 bytes · sha256 e0442ce3db9563d5 · raw
final URL: https://www.exxonmobil.com/robots.txt
| 1 | User-agent: * |
| 2 | Disallow: /api |
| 3 | Disallow: /Xomfl |
| 4 | Disallow: /sitecore |
| 5 | Disallow: /basestocks/brexit |
| 6 | Disallow: /data privacy_fr.pdf |
| 7 | Disallow: /data privacy_en.pdf |
| 8 | Disallow: /data privacy_es.pdf |
| 9 | Disallow: /media/global/exxonmobil/ |
| 10 | Disallow: /license agreement_en.pdf |
| 11 | Disallow: /license agreement_es.pdf |
| 12 | Disallow: /license agreement_fr.pdf |
| 13 | |
| 14 | Sitemap: https://www.exxonmobil.com/sitemap.xml |
| 15 | Sitemap: https://www.exxonmobil.com/wax/sitemap.xml |
| 16 | Sitemap: https://www.exxonmobil.com/en/wax/sitemap.xml |
| 17 | Sitemap: https://www.exxonmobil.com/marine/sitemap.xml |
| 18 | Sitemap: https://www.exxonmobil.com/asphalt/sitemap.xml |
| 19 | Sitemap: https://www.exxonmobil.com/whiteoil/sitemap.xml |
| 20 | Sitemap: https://www.exxonmobil.com/aviation/sitemap.xml |
| 21 | Sitemap: https://www.exxonmobil.com/en/marine/sitemap.xml |
| 22 | Sitemap: https://www.exxonmobil.com/en/asphalt/sitemap.xml |
| 23 | Sitemap: https://www.exxonmobil.com/basestocks/sitemap.xml |
| 24 | Sitemap: https://www.exxonmobil.com/en/whiteoil/sitemap.xml |
| 25 | Sitemap: https://www.exxonmobil.com/en/aviation/sitemap.xml |
| 26 | Sitemap: https://www.exxonmobil.com/en/basestocks/sitemap.xml |
| 27 | Sitemap: https://www.exxonmobil.com/wholesale-fuels/sitemap.xml |
| 28 | Sitemap: https://www.exxonmobil.com/en/wholesale-fuels/sitemap.xml |