BP / robots.txt
← back to bp.com · change detected 24d ago (2026-10-14T05:59:57Z) · modified +0 −7
What changed
- Removed Disallow: /en_gb/united-kingdom/home/products-and-services/bp-fleet/contactus.html for *
- Removed Disallow: /en_gb/united-kingdom/home/products-and-services/bp-fleet/legal-notice.html for *
- Removed Disallow: /en_gb/united-kingdom/home/products-and-services/bp-fleet/privacy-statement.html for *
- Removed Disallow: /en_gb/united-kingdom/home/references.html for *
- Removed Disallow: /en_gb/united-kingdom/media/press-releases/bpme-launch.html for *
- Removed Disallow: /en_gb/united-kingdom/home/references.html for Algolia Crawler
- Removed Disallow: /en_gb/united-kingdom/media/press-releases/bpme-launch.html for Algolia Crawler
Diff old (2026-09-09T12:27:15Z) → new (2026-10-14T05:59:57Z)
| @@ -2,11 +2,6 @@ | ||
| 2 | 2 | User-agent: * |
| 3 | 3 | Disallow: |
| 4 | 4 | Disallow: /*.html?* |
| 5 | - Disallow: /en_gb/united-kingdom/media/press-releases/bpme-launch.html | |
| 6 | - Disallow: /en_gb/united-kingdom/home/references.html | |
| 7 | - Disallow: /en_gb/united-kingdom/home/products-and-services/bp-fleet/privacy-statement.html | |
| 8 | - Disallow: /en_gb/united-kingdom/home/products-and-services/bp-fleet/legal-notice.html | |
| 9 | - Disallow: /en_gb/united-kingdom/home/products-and-services/bp-fleet/contactus.html | |
| 10 | 5 | Disallow: /en/global/air-bp/contact-us/update-your-myinvoice-user-details.html |
| 11 | 6 | Disallow: /en/global/air-bp/contact-us/update-your-myinvoice-user-details-es.html |
| 12 | 7 | Disallow: /en/global/air-bp/contact-us/update-your-myinvoice-user-details-it.html |
| @@ -53,8 +48,6 @@ | ||
| 53 | 48 | |
| 54 | 49 | User-agent: Algolia Crawler |
| 55 | 50 | Disallow: |
| 56 | - Disallow: /en_gb/united-kingdom/media/press-releases/bpme-launch.html | |
| 57 | 51 | Disallow: /narrative2018 |
| 58 | - Disallow: /en_gb/united-kingdom/home/references.html | |
| 59 | 52 | |
| 60 | 53 | Sitemap: https://www.bp.com/sitemap.xml |