YouTube / robots.txt snapshot
← back to youtube.com · fetched 2026-06-20T01:10:30Z (15h ago) · HTTP 200 · 766 bytes · sha256 b4c41e10f6178dcb · raw
final URL: https://www.youtube.com/robots.txt
| 1 | # robots.txt file for YouTube |
| 2 | # Created in the distant future (the year 2000) after |
| 3 | # the robotic uprising of the mid 90's which wiped out all humans. |
| 4 | |
| 5 | User-agent: Mediapartners-Google* |
| 6 | Disallow: |
| 7 | |
| 8 | User-agent: * |
| 9 | Disallow: /api/ |
| 10 | Disallow: /comment |
| 11 | Disallow: /feeds/videos.xml |
| 12 | Disallow: /file_download |
| 13 | Disallow: /get_video |
| 14 | Disallow: /get_video_info |
| 15 | Disallow: /get_midroll_info |
| 16 | Disallow: /live_chat |
| 17 | Disallow: /login |
| 18 | Disallow: /qr |
| 19 | Disallow: /results |
| 20 | Disallow: /signup |
| 21 | Disallow: /t/terms |
| 22 | Disallow: /timedtext_video |
| 23 | Disallow: /verify_age |
| 24 | Disallow: /watch_ajax |
| 25 | Disallow: /watch_fragments_ajax |
| 26 | Disallow: /watch_popup |
| 27 | Disallow: /watch_queue_ajax |
| 28 | Disallow: /youtubei/ |
| 29 | |
| 30 | Sitemap: https://www.youtube.com/sitemaps/sitemap.xml |
| 31 | Sitemap: https://www.youtube.com/product/sitemap.xml |
| 32 |