NeuralCrawl

Twitch / robots.txt snapshot

← back to twitch.tv · fetched 2026-07-31T23:22:14Z (5d ago) · HTTP 200 · 1167 bytes · sha256 3bf83d9ad4057c9f · raw

final URL: https://www.twitch.tv/robots.txt

1User-agent: Amazonbot
2Disallow:
3
4User-agent: Amazonbot-Video
5Disallow:
6
7User-agent: Amzn-SearchBot
8Disallow:
9
10User-agent: Amzn-User
11Disallow:
12
13User-agent: *
14Disallow: /login
15Disallow: /signup
16Disallow: /auth/
17Disallow: /user/account-recovery
18Disallow: /user/password-reset
19Disallow: /user/not-me
20Disallow: /activate
21Disallow: /admin/*
22Disallow: /wv/*
23Disallow: /user/*
24Disallow: /message/*
25Disallow: /settings/
26Disallow: /subscriptions
27Disallow: /inventory
28Disallow: /wallet
29Disallow: /drops/
30Disallow: /payments/
31Disallow: /email-unsubscribe/
32Disallow: /search
33Disallow: /bits-checkout
34Disallow: /redeem
35Disallow: /claim
36Disallow: /download-keys
37Disallow: /popout/
38Disallow: /embed/
39Disallow: /chat/
40Disallow: /moderator/
41Disallow: /stream
42Disallow: /collab
43Disallow: /guest-star
44Disallow: /sq$
45Disallow: /sq/
46Disallow: /gl$
47Disallow: /gl/
48Disallow: /sportradar-widgets
49Disallow: /beta/
50Disallow: /extensions/oauth-redirect
51Disallow: /copyright-claims
52Disallow: /report-appeal
53Disallow: /oss-attribution
54Disallow: /dj-signup
55Disallow: /r/
56Disallow: /stale/
57Allow: /directory
58Allow: /.well-known/assetlinks.json
59
60Sitemap: https://www.twitch.tv/sitemapv2_index.xml.gz