NeuralCrawl

Surfer / robots.txt

← back to surferseo.com · change detected 16d ago (2026-10-22T15:00:52Z) · modified +1 −5

What changed

Diff old (2026-06-20T14:56:27Z) → new (2026-10-22T15:00:52Z)

@@ -1,6 +1,2 @@
11  User-Agent: *
2- Disallow: /free-outline-generator/?permalink=*
3- Disallow: /dev/
4- Disallow: /design-system/
5- Disallow: /archive/
6- Disallow: /blog?page=
2+ Disallow: