NeuralCrawl

seoClarity / robots.txt snapshot

← back to seoclarity.net · fetched 2026-10-15T18:35:45Z (22d ago) · HTTP 200 · 894 bytes · sha256 9fbea07a2cfd1c29 · raw

final URL: https://www.seoclarity.net/robots.txt

1User-agent: BrightEdge Crawler/1.0
2Disallow: /
3Disallow: /_hcms/preview/
4Disallow: /hs/manage-preferences/
5Disallow: /hs/preferences-center/
6Disallow: /*?*hs_preview=*
7Disallow: /*?*hsCacheBuster=*
8
9User-agent: OAI-SearchBot
10Allow: /
11Disallow: /_hcms/preview/
12Disallow: /hs/manage-preferences/
13Disallow: /hs/preferences-center/
14Disallow: /*?*hs_preview=*
15Disallow: /*?*hsCacheBuster=*
16
17User-agent: *
18Disallow: /thank-you
19Disallow: /thank-you/
20Disallow: /thank-you*
21Disallow: /*thank-you$
22Disallow: /seo-platform-essentials/confirmation-lead/thank-you
23Disallow: /competitive-insights-report-3/
24Disallow: /see-it-in-action-enterprise-v1
25Disallow: /hubfs/Client%20Stories/Client%20Testimonials.pdf
26Sitemap: https://www.seoclarity.net/sitemap.xml
27Disallow: /_hcms/preview/
28Disallow: /hs/manage-preferences/
29Disallow: /hs/preferences-center/
30Disallow: /*?*hs_preview=*
31Disallow: /*?*hsCacheBuster=*