NeuralCrawl

Hilton Worldwide / robots.txt

← back to hilton.com · change detected 1mo ago (2026-06-30T12:09:39Z) · modified +29 −71

What changed

Diff old (2026-06-20T01:10:30Z)new (2026-06-30T12:09:39Z)

@@ -1,85 +1,43 @@
11  User-agent: AdIdxBot
2- Allow: */search/
2+ Allow: /search/
33 
44  User-agent: Mediapartners-Google
5- Allow: */search/
6- Allow: */book/
5+ Allow: /search/
6+ Allow: /book/
77 
88  User-agent: AdsBot-Google-Mobile
9- Allow: */search/
10- Allow: */book/
9+ Allow: /search/
10+ Allow: /book/
1111 
1212  User-agent: AdsBot-Google
13- Allow: */search/
14- Allow: */book/
13+ Allow: /search/
14+ Allow: /book/
1515 
1616  User-agent: *
17- Disallow: */search/
18- Disallow: */checkin/
19- Disallow: */partner/
17+ Disallow: /search/
18+ Disallow: /checkin/
19+ Disallow: /partner/
2020  Disallow: /*.jhtml*
21- Disallow: */book/
22- Disallow: */guest/
23- Disallow: */auth/
24- Disallow: */group-search/
25- Disallow: */find-hotels/
26- Disallow: */event-locations/
27- Disallow: */group-locations/
28- Disallow: */confirmation/
29- Disallow: */personalized/
30- Disallow: */attend-my-event/
31- Disallow: */business/
32- Disallow: */modify/
33- Disallow: */public/
34- Disallow: /*20000
35- Disallow: */locales/
36- Disallow: */auth2/
37- Disallow: */hrcc/
38-
39- User-agent: Googlebot
40- Disallow: */search/
41- Disallow: */checkin/
42- Disallow: */partner/
43- Disallow: /*.jhtml*
44- Disallow: */book/
45- Disallow: */guest/
46- Disallow: */auth/
47- Disallow: */group-search/
48- Disallow: */find-hotels/
49- Disallow: */event-locations/
50- Disallow: */group-locations/
51- Disallow: */confirmation/
52- Disallow: */personalized/
53- Disallow: */attend-my-event/
54- Disallow: */business/
55- Disallow: */modify/
56- Disallow: */public/
57- Disallow: */auth2/
58- Disallow: */hrcc/
59- Disallow: */locales/
60-
61- User-agent: Bingbot
62- Disallow: */search/
63- Disallow: */checkin/
64- Disallow: */partner/
65- Disallow: /*.jhtml*
66- Disallow: */book/
67- Disallow: */guest/
68- Disallow: */auth/
69- Disallow: */group-search/
70- Disallow: */find-hotels/
71- Disallow: */event-locations/
72- Disallow: */group-locations/
73- Disallow: */confirmation/
74- Disallow: */personalized/
75- Disallow: */attend-my-event/
76- Disallow: */business/
77- Disallow: */modify/
78- Disallow: */public/
79- Disallow: */auth2/
80- Disallow: */hrcc/
81- Disallow: */locales/
21+ Disallow: /book/
22+ Disallow: /guest/
23+ Disallow: /auth/
24+ Disallow: /group-search/
25+ Disallow: /find-hotels/
26+ Disallow: /event-locations/
27+ Disallow: /group-locations/
28+ Disallow: /confirmation/
29+ Disallow: /personalized/
30+ Disallow: /attend-my-event/
31+ Disallow: /business/
32+ Disallow: /modify/
33+ Disallow: /public/
34+ Disallow: /locales/
35+ Disallow: /auth2/
36+ Disallow: /hrcc/
8237 
8338  User-agent: null
8439  Sitemap: https://www.hilton.com/sitemap.xml
8540 
41+ User-agent: facebookexternalhit
42+ Allow: /
43+