NeuralCrawl

YouTube / robots.txt snapshot

← back to youtube.com · fetched 2026-07-22T01:36:46Z (15d ago) · HTTP 200 · 792 bytes · sha256 96f8640ca357626e · raw

final URL: https://www.youtube.com/robots.txt

1# robots.txt file for YouTube
2# Created in the distant future (the year 2000) after
3# the robotic uprising of the mid 90's which wiped out all humans.
4
5User-agent: Mediapartners-Google*
6Disallow:
7
8User-agent: *
9Disallow: /api/
10Disallow: /channel_picker
11Disallow: /comment
12Disallow: /feeds/videos.xml
13Disallow: /file_download
14Disallow: /get_video
15Disallow: /get_video_info
16Disallow: /get_midroll_info
17Disallow: /live_chat
18Disallow: /login
19Disallow: /qr
20Disallow: /results
21Disallow: /signup
22Disallow: /t/terms
23Disallow: /timedtext_video
24Disallow: /verify_age
25Disallow: /watch_ajax
26Disallow: /watch_fragments_ajax
27Disallow: /watch_popup
28Disallow: /watch_queue_ajax
29Disallow: /youtubei/
30
31Sitemap: https://www.youtube.com/sitemaps/sitemap.xml
32Sitemap: https://www.youtube.com/product/sitemap.xml
33