Semrush / robots.txt
← back to semrush.com · change detected 1mo ago (2026-09-28T18:34:49Z) · modified +1 −3
What changed
- Added Disallow: /_/semrush_regular_1_blank/ for *
- Removed Disallow: /_/empty_blank/ for *
- Removed Disallow: /_/site_info_blank/ for *
- Removed Disallow: /_/toolkit_blank/ for *
Diff old (2026-08-19T17:42:33Z) → new (2026-09-28T18:34:49Z)
| @@ -71,9 +71,7 @@ | ||
| 71 | 71 | Disallow: /swa/api/* |
| 72 | 72 | Disallow: /redirect?url=* |
| 73 | 73 | Disallow: /sso/ |
| 74 | - Disallow: /_/empty_blank/ | |
| 75 | - Disallow: /_/toolkit_blank/ | |
| 76 | - Disallow: /_/site_info_blank/ | |
| 74 | + Disallow: /_/semrush_regular_1_blank/ | |
| 77 | 75 | Disallow: /seo-old/* |
| 78 | 76 | Disallow: /projects2/* |
| 79 | 77 | Disallow: /free-tools/plagiarism-checker/?q= |