NeuralCrawl

DXC Technology / robots.txt snapshot

← back to dxc.com · fetched 2026-11-03T13:00:12Z (4d ago) · HTTP 200 · 2259 bytes · sha256 aa94c62f7dabad81 · raw

final URL: https://dxc.com/robots.txt

1User-agent: *
2Allow: /
3Disallow: */search?search=
4Disallow: */search$
5Disallow: */test-pages/
6Disallow: */language-masters/
7
8#All the regional pages excluding homepages are disallowed for indexing
9
10Disallow: */za/en/
11Disallow: */tw/zh/
12Disallow: */vn/en/
13Disallow: */tn/en/
14Disallow: */th/en/
15Disallow: */sk/sk/
16Disallow: */sg/en/
17Disallow: */se/en/
18Disallow: */pl/en/
19Disallow: */sa/en/
20Disallow: */qa/en/
21Disallow: */ph/en/
22Disallow: */no/en/
23Disallow: */nl/en/
24Disallow: */ng/en/
25Disallow: */my/en/
26Disallow: */ma/en/
27Disallow: */kr/en/
28Disallow: */lu/en/
29Disallow: */lt/en/
30Disallow: */ie/en/
31Disallow: */id/en/
32Disallow: */hr/en/
33Disallow: */hu/en/
34Disallow: */hk/en/
35Disallow: */fi/en/
36Disallow: */es/ca/
37Disallow: */eg/en/
38Disallow: */dk/da/
39Disallow: */dk/en/
40Disallow: */cz/en/
41Disallow: */cn/zh/
42Disallow: */ch/en/
43Disallow: */bg/en/
44Disallow: */be/nl/
45Disallow: */uk/en/
46Disallow: */pt/pt/
47Disallow: */pl/pl/
48Disallow: */pe/es/
49Disallow: */pa/es/
50Disallow: */nz/en/
51Disallow: */lu/fr/
52Disallow: */mx/es/
53Disallow: */jp/ja/
54Disallow: */it/it/
55Disallow: */in/en/
56Disallow: */fr/fr/
57Disallow: */es/es/
58Disallow: */ec/es/
59Disallow: */de/de/
60Disallow: */cr/es/
61Disallow: */co/es/
62Disallow: */ca/fr/
63Disallow: */cl/es/
64Disallow: */ca/en/
65Disallow: */br/pt/
66Disallow: */be/fr/
67Disallow: */be/en/
68Disallow: */au/en/
69Disallow: */ae/en/
70Disallow: */at/de/
71Disallow: */ar/es/
72Disallow: */ar/es/
73Disallow: */sk/en/
74
75Allow: */au/en/careers/graduate-program$
76Allow: */au/en/cp/claims-management-services$
77Allow: */au/en/cp/claims-management-services/new-south-wales$
78Allow: */au/en/cp/claims-management-services/new-south-wales/worker$
79Allow: */au/en/cp/claims-management-services/victoria$
80Allow: */au/en/cp/claims-management-services/victoria/employer$
81Allow: */nz/en/careers/graduate-program$
82Allow: */uk/en/careers/early-careers$
83
84
85#OpenAI bot for indexing web content for ChatGPT search
86User-agent: OAI-SearchBot
87Allow: /
88
89#Identifies user requests from ChatGPT
90User-agent: ChatGPT-User
91Allow: /
92
93#Bot from Perplexity.ai to fetch real-time info with citations
94User-agent: PerplexityBot
95Allow: /
96
97#Exa.ai crawler for dev-focused AI search
98User-agent: ExaBot
99Allow: /
100
101
102
103Sitemap: https://dxc.com/sitemap.xml
104Sitemap: https://dxc.com/newsroom-sitemap.xml