Twitch / robots.txt
← back to twitch.tv · change detected 25d ago (2026-07-10T22:06:36Z) · modified +3 −0
What changed
- Added rules for user-agent ‘Amazonbot-Video’
Diff old (2026-06-20T01:10:30Z) → new (2026-07-10T22:06:36Z)
| @@ -1,4 +1,7 @@ | ||
| 1 | 1 | User-agent: Amazonbot |
| 2 | + Disallow: | |
| 3 | + | |
| 4 | + User-agent: Amazonbot-Video | |
| 2 | 5 | Disallow: |
| 3 | 6 | |
| 4 | 7 | User-agent: Amzn-SearchBot |