Ahrefs / robots.txt
← back to ahrefs.com · change detected 2mo ago (2026-08-12T15:24:38Z) · modified +0 −8
What changed
- Removed Allow: /de/blog for *
- Removed Allow: /es/blog for *
- Removed Allow: /fr/blog for *
- Removed Allow: /it/blog for *
- Removed Allow: /ja/blog for *
- Removed Allow: /pt/blog for *
- Removed Allow: /zh/blog for *
- Removed Disallow: /*/blog for *
Diff old (2026-08-07T19:48:33Z) → new (2026-08-12T15:24:38Z)
| @@ -8,14 +8,6 @@ | ||
| 8 | 8 | Disallow: /v4* |
| 9 | 9 | Disallow: /blog/*?s=* |
| 10 | 10 | Disallow: /blog/*?archive* |
| 11 | - Disallow: /*/blog | |
| 12 | - Allow: /de/blog | |
| 13 | - Allow: /es/blog | |
| 14 | - Allow: /fr/blog | |
| 15 | - Allow: /it/blog | |
| 16 | - Allow: /ja/blog | |
| 17 | - Allow: /pt/blog | |
| 18 | - Allow: /zh/blog | |
| 19 | 11 | Disallow: /seo/for/*?*draft |
| 20 | 12 | Disallow: /academy/*?*draft |
| 21 | 13 | Disallow: /seo-toolbar/welcome |