NeuralCrawl

Bitdefender / robots.txt snapshot

← back to bitdefender.com · fetched 2026-10-08T16:07:06Z (30d ago) · HTTP 200 · 1361 bytes · sha256 c56d69cb19e9005c · raw

final URL: https://www.bitdefender.com/robots.txt

1User-agent: *
2Content-Signal: ai-train=yes, search=yes, ai-input=yes
3
4# Disallow
5Disallow: /content/dam/bitdefender/business/ar/
6Disallow: /content/bitdefender/language-master/
7Disallow: /content/bitdefender/us/
8Disallow: /content/bitdefender/gb/
9Disallow: /content/bitdefender/au/
10Disallow: /content/bitdefender/se/
11Disallow: /content/bitdefender/ro/
12Disallow: /content/bitdefender/fr/
13Disallow: /content/bitdefender/es/
14Disallow: /content/bitdefender/it/
15Disallow: /content/bitdefender/de/
16Disallow: /content/bitdefender/pt/
17Disallow: /content/bitdefender/nl/
18Disallow: /content/bitdefender/be/
19Disallow: /content/bitdefender/br/
20Disallow: /*.plain.html
21Disallow: /geoip
22
23# Legacy rules
24Disallow: /en/
25Disallow: /2010/
26Disallow: /2011/
27Disallow: /2012/
28Disallow: /2013/
29Disallow: /2014/
30Disallow: /ru/
31
32# Business rules
33Disallow: /business/special-offer/
34Disallow: /business/enterprise-advisory-board/
35Disallow: /business/explore/
36
37
38# LP rules
39Allow: /media/html/spread/
40Allow: /media/html/box/
41Allow: /media/html/easter2015/
42Allow: /media/html/enterprise-cybersecurity/
43Allow: /media/html/
44Allow: /media/uploads/
45Disallow: /media/
46Disallow: /lp/
47
48# Disallow eronated indexing based on parameters
49Disallow: /?action_typTHe=
50Disallow: /?callback=
51Disallow: /cdp/
52
53Llmstxt: https://www.bitdefender.com/llms.txt
54Sitemap: https://www.bitdefender.com/sitemap.xml
55