Twitch / robots.txt

← back to twitch.tv · change detected 22d ago (2026-10-16T00:44:51Z) · modified +35 −11

What changed

Added Disallow: /activate$ for *
Added Disallow: /activate/ for *
Added Disallow: /activate? for *
Added Disallow: /claim$ for *
Added Disallow: /claim/ for *
Added Disallow: /claim? for *
Added Disallow: /collab$ for *
Added Disallow: /collab/ for *
Added Disallow: /collab? for *
Added Disallow: /gl? for *
Added Disallow: /inventory$ for *
Added Disallow: /inventory/ for *
Added Disallow: /inventory? for *
Added Disallow: /login$ for *
Added Disallow: /login/ for *
Added Disallow: /login? for *
Added Disallow: /redeem$ for *
Added Disallow: /redeem/ for *
Added Disallow: /redeem? for *
Added Disallow: /search$ for *
Added Disallow: /search/ for *
Added Disallow: /search? for *
Added Disallow: /signup$ for *
Added Disallow: /signup/ for *
Added Disallow: /signup? for *
Added Disallow: /sq? for *
Added Disallow: /stream$ for *
Added Disallow: /stream/ for *
Added Disallow: /stream? for *
Added Disallow: /subscriptions$ for *
Added Disallow: /subscriptions/ for *
Added Disallow: /subscriptions? for *
Added Disallow: /wallet$ for *
Added Disallow: /wallet/ for *
Added Disallow: /wallet? for *
Removed Disallow: /activate for *
Removed Disallow: /claim for *
Removed Disallow: /collab for *
Removed Disallow: /inventory for *
Removed Disallow: /login for *
Removed Disallow: /redeem for *
Removed Disallow: /search for *
Removed Disallow: /signup for *
Removed Disallow: /stream for *
Removed Disallow: /subscriptions for *
Removed Disallow: /wallet for *

Diff old (2026-07-31T23:22:14Z) → new (2026-10-16T00:44:51Z)

		@@ -11,39 +11,63 @@
11	11	Disallow:
12	12
13	13	User-agent: *
14		- Disallow: /login
15		- Disallow: /signup
	14	+ Disallow: /login$
	15	+ Disallow: /login?
	16	+ Disallow: /login/
	17	+ Disallow: /signup$
	18	+ Disallow: /signup?
	19	+ Disallow: /signup/
16	20	Disallow: /auth/
17	21	Disallow: /user/account-recovery
18	22	Disallow: /user/password-reset
19	23	Disallow: /user/not-me
20		- Disallow: /activate
	24	+ Disallow: /activate$
	25	+ Disallow: /activate?
	26	+ Disallow: /activate/
21	27	Disallow: /admin/*
22	28	Disallow: /wv/*
23	29	Disallow: /user/*
24	30	Disallow: /message/*
25	31	Disallow: /settings/
26		- Disallow: /subscriptions
27		- Disallow: /inventory
28		- Disallow: /wallet
	32	+ Disallow: /subscriptions$
	33	+ Disallow: /subscriptions?
	34	+ Disallow: /subscriptions/
	35	+ Disallow: /inventory$
	36	+ Disallow: /inventory?
	37	+ Disallow: /inventory/
	38	+ Disallow: /wallet$
	39	+ Disallow: /wallet?
	40	+ Disallow: /wallet/
29	41	Disallow: /drops/
30	42	Disallow: /payments/
31	43	Disallow: /email-unsubscribe/
32		- Disallow: /search
	44	+ Disallow: /search$
	45	+ Disallow: /search?
	46	+ Disallow: /search/
33	47	Disallow: /bits-checkout
34		- Disallow: /redeem
35		- Disallow: /claim
	48	+ Disallow: /redeem$
	49	+ Disallow: /redeem?
	50	+ Disallow: /redeem/
	51	+ Disallow: /claim$
	52	+ Disallow: /claim?
	53	+ Disallow: /claim/
36	54	Disallow: /download-keys
37	55	Disallow: /popout/
38	56	Disallow: /embed/
39	57	Disallow: /chat/
40	58	Disallow: /moderator/
41		- Disallow: /stream
42		- Disallow: /collab
	59	+ Disallow: /stream$
	60	+ Disallow: /stream?
	61	+ Disallow: /stream/
	62	+ Disallow: /collab$
	63	+ Disallow: /collab?
	64	+ Disallow: /collab/
43	65	Disallow: /guest-star
44	66	Disallow: /sq$
	67	+ Disallow: /sq?
45	68	Disallow: /sq/
46	69	Disallow: /gl$
	70	+ Disallow: /gl?
47	71	Disallow: /gl/
48	72	Disallow: /sportradar-widgets
49	73	Disallow: /beta/