NeuralCrawl

YouTube / robots.txt snapshot

← back to youtube.com · fetched 2026-06-20T01:10:30Z (15h ago) · HTTP 200 · 766 bytes · sha256 b4c41e10f6178dcb · raw

final URL: https://www.youtube.com/robots.txt

1# robots.txt file for YouTube
2# Created in the distant future (the year 2000) after
3# the robotic uprising of the mid 90's which wiped out all humans.
4
5User-agent: Mediapartners-Google*
6Disallow:
7
8User-agent: *
9Disallow: /api/
10Disallow: /comment
11Disallow: /feeds/videos.xml
12Disallow: /file_download
13Disallow: /get_video
14Disallow: /get_video_info
15Disallow: /get_midroll_info
16Disallow: /live_chat
17Disallow: /login
18Disallow: /qr
19Disallow: /results
20Disallow: /signup
21Disallow: /t/terms
22Disallow: /timedtext_video
23Disallow: /verify_age
24Disallow: /watch_ajax
25Disallow: /watch_fragments_ajax
26Disallow: /watch_popup
27Disallow: /watch_queue_ajax
28Disallow: /youtubei/
29
30Sitemap: https://www.youtube.com/sitemaps/sitemap.xml
31Sitemap: https://www.youtube.com/product/sitemap.xml
32