Genius / robots.txt snapshot
← back to genius.com · fetched 2026-06-20T12:52:38Z (6h ago) · HTTP 200 · 1149 bytes · sha256 08ee08424b891a2c · raw
final URL: manual:file
| 1 | User-Agent: * |
| 2 | Disallow: /songs/*/metadata |
| 3 | Disallow: /songs/*/comments |
| 4 | Disallow: /users/*/top_artist_iq_rank |
| 5 | Disallow: /artists/*/top_iq_earners |
| 6 | Disallow: /comments/for_profile_page |
| 7 | Disallow: /bagon/* |
| 8 | Disallow: /mecha/* |
| 9 | Disallow: /account/unsubscribe/* |
| 10 | Disallow: /email_notifications/*/unsubscribe |
| 11 | Disallow: /annotations/*/report_as_abusive |
| 12 | Disallow: /songs/for_profile_page |
| 13 | Disallow: /api$ |
| 14 | Disallow: /api/* |
| 15 | Disallow: /search?* |
| 16 | Disallow: /*/*/leaderboard |
| 17 | Disallow: /songs/*/apple_music_player* |
| 18 | Disallow: /songs/*/show_amp_header_play_toggle* |
| 19 | Disallow: /guiver |
| 20 | |
| 21 | User-agent: Uniscan |
| 22 | User-agent: Searchie |
| 23 | User-agent: CCBot |
| 24 | User-agent: ChatGPT-User |
| 25 | User-agent: GPTBot |
| 26 | User-agent: Google-Extended |
| 27 | User-agent: Applebot-Extended |
| 28 | User-agent: anthropic-ai |
| 29 | User-agent: ClaudeBot |
| 30 | User-agent: Omgilibot |
| 31 | User-agent: Omgili |
| 32 | User-agent: FacebookBot |
| 33 | User-agent: Diffbot |
| 34 | User-agent: Bytespider |
| 35 | User-agent: ImagesiftBot |
| 36 | User-agent: cohere-ai |
| 37 | User-agent: Meta-ExternalAgent |
| 38 | User-agent: Meta-ExternalFetcher |
| 39 | User-agent: Timpibot |
| 40 | User-agent: Webzio-Extended |
| 41 | User-agent: YouBot |
| 42 | Disallow: / |