NeuralCrawl

Microsoft Bing / robots.txt snapshot

← back to bing.com · fetched 2026-06-20T14:56:27Z (7h ago) · HTTP 200 · 2570 bytes · sha256 9eae498db20076e2 · raw

final URL: https://www.bing.com/robots.txt?toWww=1&redig=EFA5B404269141749ECEACC78EC5842D

1User-agent: msnbot-media
2Disallow: /
3Allow: /th?
4
5User-agent: Twitterbot
6Disallow:
7
8User-agent: *
9Disallow: /academic/profile
10Disallow: /academic/search
11Disallow: /account/
12Disallow: /aclick
13Disallow: /alink
14Disallow: /amp/
15Allow: /api/maps/
16Disallow: /api/
17Disallow: /bfp/search
18Disallow: /bing-site-safety
19Disallow: /blogs/search/
20Disallow: /ck/
21Disallow: /copilotsearch?q=
22Disallow: /cr$
23Disallow: /cr?
24Disallow: /entities/search
25Disallow: /entityexplore$
26Disallow: /entityexplore?
27Disallow: /fd/
28Disallow: /fun/api/
29Disallow: /fun/g/
30Disallow: /history
31Disallow: /hotel/reviews?
32Disallow: /hotels/search
33Disallow: /HpImageArchive.aspx
34Disallow: /hpm
35Disallow: /hpmob
36Disallow: /images/async/?
37Disallow: /images/async?
38Disallow: /images/hosted/?
39Disallow: /images/hosted/search?
40Disallow: /images/hosted?
41Disallow: /images/search%3F
42Disallow: /images/search%5C
43Disallow: /images/search/?
44Disallow: /images/search?
45Disallow: /images/searchbyimage
46Disallow: /images?
47Disallow: /inboxcommerce
48Disallow: /local
49Disallow: /maps/adsendpoint
50Disallow: /merchant/reviews?
51Disallow: /notifications/
52Disallow: /offers/proxy/dealsserver/api/log
53Disallow: /offers/proxy/dealsserver/buy
54Disallow: /ping
55Disallow: /product/reviews?
56Disallow: /profile/history?
57Disallow: /proFile/history?
58Disallow: /Proxy.ashx
59Disallow: /results
60Disallow: /rewardsapp/
61Disallow: /search
62Disallow: /Search
63Disallow: /settings
64Disallow: /shenghuo
65Allow: /shop$
66Allow: /shop/
67Disallow: /shop/collections
68Disallow: /shop/productpage
69Disallow: /shop/topics
70Disallow: /shop?*
71Disallow: /social/search?
72Disallow: /spbasic
73Disallow: /spresults
74Disallow: /static/
75Disallow: /th$
76Disallow: /th?
77Disallow: /translator/?ref=
78Disallow: /travel/api
79Disallow: /travel/css
80Disallow: /travel/flight/flightSearch
81Disallow: /travel/flight/flightSearchAction
82Disallow: /travel/flight/search/?
83Disallow: /travel/flight/search?
84Disallow: /travel/flights
85Disallow: /travel/flight-search
86Disallow: /travel/hotel/hotelMiniSearchRequest
87Disallow: /travel/hotel/hotelSearch
88Disallow: /travel/hotels/checkout
89Disallow: /travel/hotels/detail
90Disallow: /travel/hotels/search/?
91Disallow: /travel/hotels/search?
92Disallow: /travel/hotel-search
93Disallow: /travel/scripts
94Disallow: /travel/secure
95Disallow: /url
96Disallow: /videos/browsing
97Disallow: /videos/explore
98Disallow: /videos/favorites
99Disallow: /videos/feed
100Disallow: /videos/music
101Disallow: /videos/trending
102Disallow: /widget/cr
103Disallow: /widget/entity/search/?
104Disallow: /widget/render
105Disallow: /widget/snapshot
106Disallow: /work
107
108Sitemap: https://www.bing.com/sitemap.xml