# * User-agent: * Allow: / Allow: /marketplace Allow: /*/marketplace Disallow: /api/ Disallow: /dashboard Disallow: /*/dashboard Disallow: /agents Disallow: /*/agents Disallow: /settings/ Disallow: /*/settings/ Disallow: /marketplace/publish$ Disallow: /*/marketplace/publish$ Disallow: /team/accept-invite Disallow: /*/team/accept-invite Disallow: /team/free-trial Disallow: /team/new-team Disallow: /*/team/new-team Disallow: /verifyEmail Disallow: /*/verifyEmail Disallow: /failure Disallow: /*/failure Disallow: /loginDeepControl Disallow: /*/loginDeepControl Disallow: /loginDeepPage Disallow: /*/loginDeepPage Disallow: /referral Disallow: /*/referral Disallow: /pricing-history Disallow: /*/pricing-history Disallow: /artifacts/c/ Disallow: /artifacts/v/ Disallow: /marketing-static/ Disallow: /docs-static/ # Favicon/icon assets must stay crawlable: the homepage declares its favicon # under /marketing-static/ (and docs pages under /docs-static/), and Google # drops the site icon from search results when the declared favicon URL is # blocked by robots.txt. These longer Allow rules take precedence over the # Disallow prefixes above. Allow: /marketing-static/favicon* Allow: /marketing-static/icon-* Allow: /marketing-static/apple-touch-icon* Allow: /docs-static/favicon* Allow: /docs-static/icon-* Allow: /docs-static/apple-touch-icon* Disallow: /link/prompt Disallow: /*/link/prompt Disallow: /*/docs Disallow: /*/docs/ Disallow: /*/learn Disallow: /*/learn/ Disallow: /*/help Disallow: /*/help/ Disallow: /*/for Disallow: /*/for/ # Host Host: https://cursor.com # Sitemaps Sitemap: https://cursor.com/sitemap_index.xml Sitemap: https://forum.cursor.com/sitemap.xml