NeuralCrawl

Twitch / robots.txt snapshot

← back to twitch.tv · fetched 2026-06-20T01:10:30Z (15h ago) · HTTP 200 · 1096 bytes · sha256 e17c3908cc6cd4ee · raw

final URL: https://www.twitch.tv/robots.txt

1User-agent: Amazonbot
2Disallow:
3
4User-agent: Amzn-SearchBot
5Disallow:
6
7User-agent: Amzn-User
8Disallow:
9
10User-agent: *
11Disallow: /login
12Disallow: /signup
13Disallow: /auth/
14Disallow: /user/account-recovery
15Disallow: /user/password-reset
16Disallow: /user/not-me
17Disallow: /activate
18Disallow: /admin/*
19Disallow: /wv/*
20Disallow: /user/*
21Disallow: /message/*
22Disallow: /settings/
23Disallow: /subscriptions
24Disallow: /inventory
25Disallow: /wallet
26Disallow: /drops/
27Disallow: /payments/
28Disallow: /email-unsubscribe/
29Disallow: /search
30Disallow: /bits-checkout
31Disallow: /redeem
32Disallow: /claim
33Disallow: /download-keys
34Disallow: /popout/
35Disallow: /embed/
36Disallow: /chat/
37Disallow: /moderator/
38Disallow: /stream
39Disallow: /collab
40Disallow: /guest-star
41Disallow: /sq
42Disallow: /gl
43Disallow: /sportradar-widgets
44Disallow: /beta/
45Disallow: /extensions/oauth-redirect
46Disallow: /copyright-claims
47Disallow: /report-appeal
48Disallow: /oss-attribution
49Disallow: /dj-signup
50Disallow: /r/
51Disallow: /stale/
52Allow: /directory
53Allow: /.well-known/assetlinks.json
54
55Sitemap: https://www.twitch.tv/sitemapv2_index.xml.gz