NeuralCrawl

Surfer / robots.txt snapshot

← back to surferseo.com · fetched 2026-06-20T14:56:27Z (7h ago) · HTTP 200 · 145 bytes · sha256 daeb888fde6bef22 · raw

final URL: https://surferseo.com/robots.txt/

1User-Agent: *
2Disallow: /free-outline-generator/?permalink=*
3Disallow: /dev/
4Disallow: /design-system/
5Disallow: /archive/
6Disallow: /blog?page=