NeuralCrawl

Repsol / robots.txt snapshot

← back to repsol.com · fetched 2026-06-20T01:10:30Z (15h ago) · HTTP 200 · 1352 bytes · sha256 d7401ea1c38e5ae9 · raw

final URL: https://www.repsol.com/robots.txt

1User-agent: *
2Disallow: /*/dynamic/*
3Disallow: /es/energia-innovacion/un-mundo-colaborativo/energy-ventures/index.cshtml
4Disallow: /en/energy-and-innovation/a-collaborative-world/energy-ventures/index.cshtml
5# Archivos
6Disallow: *.xls
7Disallow: *.zip
8Disallow: *.mp4
9Disallow: *.m4v
10# Meses
11Disallow: *month
12Allow: *month=all
13# Directorios Antiguos Herramientas
14Disallow: */aplicaciones/SA/Herramientas/*
15Disallow: */SA/Corporacion/BuscadorCertificadosCorporacion/*
16Disallow: */SA/Corporacion/Newsletter/*
17Disallow: */SA/Herramientas/FormsLogin/*
18Disallow: */SA/Herramientas/NuevoRegistroParticulares/*
19Disallow: */herramientas/registro/*
20Disallow: */fenix/FormularioProveedorRemApp/*
21Disallow: */includes/_t
22# Directorios Antiguos
23Disallow: */prensa/news/*
24Disallow: /SE/Motor/
25Disallow: /test/
26Disallow: /demo_no_eliminar/
27Disallow: /SE/Competicion/
28Disallow: *?gp*
29Disallow: */EESS_Portugal/*
30Disallow: */EESS_Peru/*
31Disallow: */SolredMasPTUNIVERSIA/*
32Disallow: */Solred/SolredMasRACC/*
33Disallow: *aspx?*
34Allow: /es/productos-y-servicios/estaciones-de-servicio/productos/carburantes-neotech/index.cshtml
35# Otros
36Disallow: */coronavirus/
37
38Sitemap:https://www.repsol.com/es_paginas_sitemap.xml
39Sitemap:https://www.repsol.com/es_prensa_sitemap.xml
40Sitemap:https://www.repsol.com/en_pages_sitemap.xml
41Sitemap:https://www.repsol.com/en_press_sitemap.xml