NeuralCrawl

El País / robots.txt

← back to elpais.com · change detected 1mo ago (2026-10-06T03:20:59Z) · modified +4 −1

What changed

Diff old (2026-09-17T21:12:52Z) → new (2026-10-06T03:20:59Z)

@@ -298,6 +298,10 @@
298298 
299299  # OAI-AdsBot se mantiene permitido y no se bloquea.
300300 
301+ # Parametros transversales
302+ User-agent: *
303+ Disallow: /*core_dmena
304+
301305  User-agent: *
302306  Disallow: /pruebas/
303307  Disallow: /publicidad/
@@ -313,7 +317,6 @@
313317  Disallow: /Msgeskup
314318  Disallow: /Profileeskup
315319  Disallow: /Threadeskup
316- Disallow: /*?*core_dmena=
317320 
318321  # Disallow: /.well-known/amphtml/
319322  Disallow: /t/