NeuralCrawl

Semrush / robots.txt

← back to semrush.com · change detected 2mo ago (2026-08-18T17:30:26Z) · modified +1 −0

What changed

Diff old (2026-08-12T15:24:38Z) → new (2026-08-18T17:30:26Z)

@@ -78,6 +78,7 @@
7878  Disallow: /projects2/*
7979  Disallow: /free-tools/plagiarism-checker/?q=
8080  Allow: /news/*?page=*
81+ Allow: /analytics/keywordoverview/*?q=*
8182 
8283  # Community rules
8384  Allow: /blog/*