NeuralCrawl

DXC Technology / robots.txt snapshot

← back to dxc.com · fetched 2026-06-20T01:10:31Z (18h ago) · HTTP 200 · 2161 bytes · sha256 6ead6e81261ece33 · raw

final URL: https://dxc.com/robots.txt

1User-agent: *
2Allow: /
3Disallow: */search?search=
4Disallow: */search$
5
6#All the regional pages excluding homepages are disallowed for indexing
7Disallow: */za/en/
8Disallow: */tw/zh/
9Disallow: */vn/en/
10Disallow: */tn/en/
11Disallow: */th/en/
12Disallow: */sk/sk/
13Disallow: */sg/en/
14Disallow: */se/en/
15Disallow: */pl/en/
16Disallow: */sa/en/
17Disallow: */qa/en/
18Disallow: */ph/en/
19Disallow: */no/en/
20Disallow: */nl/en/
21Disallow: */ng/en/
22Disallow: */my/en/
23Disallow: */ma/en/
24Disallow: */kr/en/
25Disallow: */lu/en/
26Disallow: */lt/en/
27Disallow: */ie/en/
28Disallow: */id/en/
29Disallow: */hr/en/
30Disallow: */hu/en/
31Disallow: */hk/en/
32Disallow: */fi/en/
33Disallow: */es/ca/
34Disallow: */eg/en/
35Disallow: */dk/da/
36Disallow: */dk/en/
37Disallow: */cz/en/
38Disallow: */cn/zh/
39Disallow: */ch/en/
40Disallow: */bg/en/
41Disallow: */be/nl/
42Disallow: */uk/en/
43Disallow: */pt/pt/
44Disallow: */pl/pl/
45Disallow: */pe/es/
46Disallow: */pa/es/
47Disallow: */nz/en/
48Disallow: */lu/fr/
49Disallow: */mx/es/
50Disallow: */jp/ja/
51Disallow: */it/it/
52Disallow: */in/en/
53Disallow: */fr/fr/
54Disallow: */es/es/
55Disallow: */ec/es/
56Disallow: */de/de/
57Disallow: */cr/es/
58Disallow: */co/es/
59Disallow: */ca/fr/
60Disallow: */cl/es/
61Disallow: */ca/en/
62Disallow: */br/pt/
63Disallow: */be/fr/
64Disallow: */be/en/
65Disallow: */au/en/
66Disallow: */ae/en/
67Disallow: */at/de/
68Disallow: */ar/es/
69Disallow: */ar/es/
70Disallow: */sk/en/
71
72Allow: */au/en/careers/graduate-program$
73Allow: */au/en/cp/claims-management-services$
74Allow: */au/en/cp/claims-management-services/new-south-wales$
75Allow: */au/en/cp/claims-management-services/new-south-wales/worker$
76Allow: */au/en/cp/claims-management-services/victoria$
77Allow: */au/en/cp/claims-management-services/victoria/employer$
78Allow: */nz/en/careers/graduate-program$
79Allow: */uk/en/careers/early-careers$
80
81
82#OpenAI bot for indexing web content for ChatGPT search
83User-agent: OAI-SearchBot
84Allow: /
85
86#Identifies user requests from ChatGPT
87User-agent: ChatGPT-User
88Allow: /
89
90#Bot from Perplexity.ai to fetch real-time info with citations
91User-agent: PerplexityBot
92Allow: /
93
94#Exa.ai crawler for dev-focused AI search
95User-agent: ExaBot
96Allow: /
97
98
99
100Sitemap: https://dxc.com/sitemap.xml
101
102
103