NeuralCrawl

United Airlines Holdings / robots.txt snapshot

← back to united.com · fetched 2026-06-20T01:10:30Z (18h ago) · HTTP 200 · 4080 bytes · sha256 92a3d434a706090d · raw

final URL: https://www.united.com/robots.txt

1User-agent: *
2Disallow: /CMS/ContinentalDocuments/pdfs/agency/
3Disallow: /cms/ContinentalDocuments/pdfs/agency/
4Disallow: /CMS/UnitedDocuments/pdfs/agency/
5Disallow: /cms/UnitedDocuments/pdfs/agency/
6Disallow: /web/en-US/apps/booking/flight/fareCalendar.aspx
7Disallow: /web/en-us/apps/booking/flight/farecalendar.aspx
8Disallow: /web/en-US/apps/vendors/emailForm.aspx
9Disallow: /web/en-us/apps/vendors/emailform.aspx
10Disallow: /web/es/apps/booking/flight/fareCalendar.aspx
11Disallow: /web/es/apps/booking/flight/farecalendar.aspx
12Disallow: /web/es/apps/vendors/emailForm.aspx
13Disallow: /web/es/apps/vendors/emailform.aspx
14Disallow: /web/ja-JP/apps/booking/flight/fareCalendar.aspx
15Disallow: /web/ja-jp/apps/booking/flight/farecalendar.aspx
16Disallow: /web/ja-JP/apps/vendors/emailForm.aspx
17Disallow: /web/ja-jp/apps/vendors/emailform.aspx
18Disallow: /web/de-DE/apps/booking/flight/fareCalendar.aspx
19Disallow: /web/de-de/apps/booking/flight/farecalendar.aspx
20Disallow: /web/de-DE/apps/vendors/emailForm.aspx
21Disallow: /web/de-de/apps/vendors/emailform.aspx
22Disallow: /web/zh-CN/apps/booking/flight/fareCalendar.aspx
23Disallow: /web/zh-cn/apps/booking/flight/farecalendar.aspx
24Disallow: /web/zh-CN/apps/vendors/emailForm.aspx
25Disallow: /web/zh-cn/apps/vendors/emailform.aspx
26Disallow: /web/fr/apps/booking/flight/fareCalendar.aspx
27Disallow: /web/fr/apps/booking/flight/farecalendar.aspx
28Disallow: /web/fr/apps/vendors/emailForm.aspx
29Disallow: /web/fr/apps/vendors/emailform.aspx
30Disallow: /web/pt/apps/booking/flight/fareCalendar.aspx
31Disallow: /web/pt/apps/booking/flight/farecalendar.aspx
32Disallow: /web/pt/apps/vendors/emailForm.aspx
33Disallow: /web/pt/apps/vendors/emailform.aspx
34Disallow: /web/ko/apps/booking/flight/fareCalendar.aspx
35Disallow: /web/ko/apps/booking/flight/farecalendar.aspx
36Disallow: /web/ko/apps/vendors/emailForm.aspx
37Disallow: /web/ko/apps/vendors/emailform.aspx
38Disallow: /web/zh-HK/apps/booking/flight/fareCalendar.aspx
39Disallow: /web/zh-hk/apps/booking/flight/farecalendar.aspx
40Disallow: /web/zh-HK/apps/vendors/emailForm.aspx
41Disallow: /web/zh-hk/apps/vendors/emailform.aspx
42Disallow: /web/en-US/apps/reservation/main.aspx
43Disallow: /web/en-US/apps/reservation/flight/view/default.aspx
44Disallow: /web/en-us/apps/reservation/flight/view/default.aspx
45Disallow: /web/es/apps/reservation/flight/view/default.aspx
46Disallow: /web/ja-JP/apps/reservation/flight/view/default.aspx
47Disallow: /web/ja-jp/apps/reservation/flight/view/default.aspx
48Disallow: /web/de-DE/apps/reservation/flight/view/default.aspx
49Disallow: /web/de-de/apps/reservation/flight/view/default.aspx
50Disallow: /web/zh-cn/apps/reservation/flight/view/default.aspx
51Disallow: /web/zh-CN/apps/reservation/flight/view/default.aspx
52Disallow: /web/fr/apps/reservation/flight/view/default.aspx
53Disallow: /web/pt/apps/reservation/flight/view/default.aspx
54Disallow: /web/ko/apps/reservation/flight/view/default.aspx
55Disallow: /web/zh-HK/apps/reservation/flight/view/default.aspx
56Disallow: /web/zh-hk/apps/reservation/flight/view/default.aspx
57Disallow: /web/en-US/apps/reservation/flight/cancelFlightConfirm.aspx
58Disallow: /web/es/apps/reservation/flight/cancelFlightConfirm.aspx
59Disallow: /web/fr/apps/reservation/flight/cancelflightconfirm.aspx
60Disallow: /web/ja-JP/apps/reservation/flight/cancelflightconfirm.aspx
61Disallow: /web/ja-jp/apps/reservation/flight/cancelflightconfirm.aspx
62Disallow: /web/de-DE/apps/reservation/flight/cancelflightconfirm.aspx
63Disallow: /web/de-de/apps/reservation/flight/cancelflightconfirm.aspx
64Disallow: /web/zh-CN/apps/reservation/flight/cancelflightconfirm.aspx
65Disallow: /web/zh-cn/apps/reservation/flight/cancelflightconfirm.aspx
66Disallow: /web/ko/apps/reservation/flight/cancelflightconfirm.aspx
67Disallow: /web/pt/apps/reservation/flight/cancelflightconfirm.aspx
68Disallow: /web/zh-HK/apps/reservation/flight/cancelflightconfirm.aspx
69Disallow: /web/zh-hk/apps/reservation/flight/cancelflightconfirm.aspx
70Disallow: /api/*
71
72User-agent: HuaweiSymantecSpider
73Disallow: /web/ScriptResource.axd
74Disallow: /web/en-US/apps/booking/AutoComplete.asmx
75Disallow: /web/WebResource.axd