NeuralCrawl

Semrush / robots.txt

← back to semrush.com · change detected 2mo ago (2026-08-12T15:24:38Z) · modified +1 −0

What changed

Diff old (2026-07-16T17:46:03Z) → new (2026-08-12T15:24:38Z)

@@ -121,6 +121,7 @@
121121  Allow: /competitive-research/
122122  Allow: /analytics/traffic/overview/
123123  Disallow: /listings-management/superpower-landing2/
124+ Allow: /semrush-questions/*
124125 
125126  #academy
126127  Allow: /academy/*