Anysphere (Cursor) / robots.txt
← back to cursor.com · change detected 2mo ago (2026-08-20T05:59:22Z) · modified +0 −13
What changed
- Removed Allow: /docs-static/apple-touch-icon* for *
- Removed Allow: /docs-static/favicon* for *
- Removed Allow: /docs-static/icon-* for *
- Removed Allow: /marketing-static/apple-touch-icon* for *
- Removed Allow: /marketing-static/favicon* for *
- Removed Allow: /marketing-static/icon-* for *
- Removed Disallow: /docs-static/ for *
- Removed Disallow: /marketing-static/ for *
Diff old (2026-08-04T18:49:16Z) → new (2026-08-20T05:59:22Z)
| @@ -29,19 +29,6 @@ | ||
| 29 | 29 | Disallow: /*/pricing-history |
| 30 | 30 | Disallow: /artifacts/c/ |
| 31 | 31 | Disallow: /artifacts/v/ |
| 32 | - Disallow: /marketing-static/ | |
| 33 | - Disallow: /docs-static/ | |
| 34 | - # Favicon/icon assets must stay crawlable: the homepage declares its favicon | |
| 35 | - # under /marketing-static/ (and docs pages under /docs-static/), and Google | |
| 36 | - # drops the site icon from search results when the declared favicon URL is | |
| 37 | - # blocked by robots.txt. These longer Allow rules take precedence over the | |
| 38 | - # Disallow prefixes above. | |
| 39 | - Allow: /marketing-static/favicon* | |
| 40 | - Allow: /marketing-static/icon-* | |
| 41 | - Allow: /marketing-static/apple-touch-icon* | |
| 42 | - Allow: /docs-static/favicon* | |
| 43 | - Allow: /docs-static/icon-* | |
| 44 | - Allow: /docs-static/apple-touch-icon* | |
| 45 | 32 | Disallow: /link/prompt |
| 46 | 33 | Disallow: /*/link/prompt |
| 47 | 34 | Disallow: /*/docs |