NeuralCrawl

Ahrefs / robots.txt

← back to ahrefs.com · change detected 3mo ago (2026-08-07T19:48:33Z) · modified +2 −0

What changed

Diff old (2026-07-31T17:16:58Z) → new (2026-08-07T19:48:33Z)

@@ -10,8 +10,10 @@
1010  Disallow: /blog/*?archive*
1111  Disallow: /*/blog
1212  Allow: /de/blog
13+ Allow: /es/blog
1314  Allow: /fr/blog
1415  Allow: /it/blog
16+ Allow: /ja/blog
1517  Allow: /pt/blog
1618  Allow: /zh/blog
1719  Disallow: /seo/for/*?*draft