NeuralCrawl

BT Group / robots.txt snapshot

← back to bt.com · fetched 2026-06-20T01:10:30Z (18h ago) · HTTP 200 · 549 bytes · sha256 ad7e7bb6a1f9dbb0 · raw

final URL: https://www.bt.com/robots.txt

1# BT robots.txt. file
2User-agent: *
3Allow: /
4Disallow: /dev/
5Disallow: */order-
6Disallow: */existing
7Disallow: *affiliate
8Disallow: */closed/
9Disallow: */sim-ordersummary/
10Disallow: *acq1
11Disallow: *uinf1
12Disallow: *uinf2
13Disallow: *acq1
14Disallow: *acq2
15Disallow: *ec1
16Disallow: */retention
17Disallow: /lookup-pages
18Disallow: /modals/
19Disallow: /local-navigation/
20Disallow: /campaign/
21Disallow: /pricing/
22Disallow: /help/tv/now-tv-on-bt-tv
23Disallow: /help/tv/ocean/*
24Disallow: /newjoiners
25Disallow: /mydonate
26
27Sitemap: https://www.bt.com/sitemap.xml