NeuralCrawl

Disneyplus / robots.txt snapshot

← back to disneyplus.com · fetched 2026-06-26T13:23:15Z (3h ago) · HTTP 200 · 2794 bytes · sha256 ea1fedfeaf8ce8df · raw

final URL: https://www.disneyplus.com/robots.txt

1#robots.txt for www.disneyplus.com/
2
3User-agent: *
4Disallow: /
5
6# SEO Bots
7User-agent: Googlebot
8User-agent: Googlebot-Video
9User-agent: Googlebot-Image
10User-agent: Googlebot-News
11User-agent: Storebot-Google
12User-agent: Google-InspectionTool
13User-agent: Applebot
14User-agent: Bingbot
15User-agent: BingPreview
16User-agent: Slurp
17User-agent: DuckDuckBot
18User-agent: Baiduspider
19User-agent: Baiduspider-mobile
20User-agent: Baiduspider-video
21User-agent: Baiduspider-image
22User-agent: NaverBot
23User-agent: Y!J-WSC
24User-agent: YJ-WSC
25User-agent: Yeti
26User-agent: Yandex
27User-agent: YandexBot
28User-agent: YandexMobileBot
29User-agent: YandexVideo
30User-agent: YandexWebmaster
31User-agent: YandexSitelinks
32User-agent: SeznamBot
33User-agent: PetalBot
34User-agent: Sogou
35User-agent: Qwantify
36User-agent: Ecosia
37User-agent: 360Spider
38User-agent: Coc Coc
39User-agent: Qwantbot
40# SEO Tools
41User-agent: Botify
42User-agent: SemrushBot
43User-agent: Screaming Frog SEO Spider
44User-agent: DataForSeoBot
45User-agent: ia_archiver
46# Social
47User-agent: Facebot
48User-agent: Twitterbot
49User-agent: facebookexternalhit
50User-agent: instagram
51User-agent: Threads
52User-agent: TikTok
53User-agent: Pinterest
54User-agent: Pinterestbot
55User-agent: redditbot
56User-agent: WhatsApp
57User-agent: Snapchat
58User-agent: TelegramBot
59User-agent: Viber
60User-agent: KakaoTalk
61User-agent: Line
62# Ad Bots
63User-agent: AdsBot-Google
64User-agent: AdsBot-Google-Mobile
65User-agent: AdsBot-Google-Mobile-Apps
66User-agent: Mediapartners-Google
67User-agent: Google-Ads-Creatives-Assistant
68User-agent: FacebookAdPreview
69User-agent: meta-externalads
70User-agent: Twitterbot
71User-agent: Adidxbot
72User-agent: Bytespider
73User-agent: IAS-Crawler
74User-agent: DoubleVerifyBot
75User-agent: Moatbot
76User-agent: TheTradeDesk
77User-agent: TTDCrawler
78User-agent: CriteoBot
79# AI Bots
80User-agent: GPTBot
81User-agent: ChatGPT-User
82User-agent: OAI-SearchBot
83User-agent: Google-Extended
84User-agent: ClaudeBot
85User-agent: Claude-User
86User-agent: Claude-SearchBot
87User-agent: PerplexityBot
88User-agent: Applebot-Extended
89User-agent: Meta-ExternalAgent
90User-agent: Meta-ExternalFetcher
91User-agent: Amazonbot
92User-agent: CCBot
93User-agent: Google-Agent
94User-agent: GrokBot
95User-agent: YouBot
96User-agent: DuckAssistBot
97User-agent: DeepSeekBot
98Allow: /
99
100# Auth Account Related Pages
101Disallow: /home
102Disallow: /*/home
103Disallow: /episode
104Disallow: /*/episode
105Disallow: /watch
106Disallow: /*/watch
107Disallow: /billing
108Disallow: /*/billing
109Disallow: /search
110Disallow: /*/search
111Disallow: /account
112Disallow: /*/account
113Disallow: /app-settings
114Disallow: /*/app-settings
115Disallow: /enter-password
116Disallow: /*/enter-password
117Disallow: /create-password
118Disallow: /*/create-password
119Disallow: /welcome/responder
120
121# Announce Sitemap
122Sitemap: https://www.disneyplus.com/sitemap.xml
123
124# Source: static-root-proxy