Anysphere (Cursor) / robots.txt
← back to cursor.com · change detected 28d ago (2026-07-09T21:47:31Z) · modified +11 −0
What changed
- Added Allow: /docs-static/apple-touch-icon* for *
- Added Allow: /docs-static/favicon* for *
- Added Allow: /docs-static/icon-* for *
- Added Allow: /marketing-static/apple-touch-icon* for *
- Added Allow: /marketing-static/favicon* for *
- Added Allow: /marketing-static/icon-* for *
Diff old (2026-06-20T01:10:30Z) → new (2026-07-09T21:47:31Z)
| @@ -33,6 +33,17 @@ | ||
| 33 | 33 | Disallow: /artifacts/v/ |
| 34 | 34 | Disallow: /marketing-static/ |
| 35 | 35 | Disallow: /docs-static/ |
| 36 | + # Favicon/icon assets must stay crawlable: the homepage declares its favicon | |
| 37 | + # under /marketing-static/ (and docs pages under /docs-static/), and Google | |
| 38 | + # drops the site icon from search results when the declared favicon URL is | |
| 39 | + # blocked by robots.txt. These longer Allow rules take precedence over the | |
| 40 | + # Disallow prefixes above. | |
| 41 | + Allow: /marketing-static/favicon* | |
| 42 | + Allow: /marketing-static/icon-* | |
| 43 | + Allow: /marketing-static/apple-touch-icon* | |
| 44 | + Allow: /docs-static/favicon* | |
| 45 | + Allow: /docs-static/icon-* | |
| 46 | + Allow: /docs-static/apple-touch-icon* | |
| 36 | 47 | Disallow: /link/prompt |
| 37 | 48 | Disallow: /*/link/prompt |
| 38 | 49 | Disallow: /*/docs |