NeuralCrawl

Bitdefender / robots.txt snapshot

← back to bitdefender.com · fetched 2026-08-18T17:30:26Z (2mo ago) · HTTP 200 · 1344 bytes · sha256 6b7b87fc8fada8bc · raw

final URL: https://www.bitdefender.com/robots.txt

1User-agent: *
2Content-Signal: ai-train=yes, search=yes, ai-input=yes
3
4# Disallow
5Disallow: /content/dam/bitdefender/business/ar/
6Disallow: /content/bitdefender/language-master/
7Disallow: /content/bitdefender/us/
8Disallow: /content/bitdefender/gb/
9Disallow: /content/bitdefender/au/
10Disallow: /content/bitdefender/se/
11Disallow: /content/bitdefender/ro/
12Disallow: /content/bitdefender/fr/
13Disallow: /content/bitdefender/es/
14Disallow: /content/bitdefender/it/
15Disallow: /content/bitdefender/de/
16Disallow: /content/bitdefender/pt/
17Disallow: /content/bitdefender/nl/
18Disallow: /content/bitdefender/be/
19Disallow: /content/bitdefender/br/
20Disallow: /*.plain.html
21
22# Legacy rules
23Disallow: /en/
24Disallow: /2010/
25Disallow: /2011/
26Disallow: /2012/
27Disallow: /2013/
28Disallow: /2014/
29Disallow: /ru/
30
31# Business rules
32Disallow: /business/special-offer/
33Disallow: /business/enterprise-advisory-board/
34Disallow: /business/explore/
35
36
37# LP rules
38Allow: /media/html/spread/
39Allow: /media/html/box/
40Allow: /media/html/easter2015/
41Allow: /media/html/enterprise-cybersecurity/
42Allow: /media/html/
43Allow: /media/uploads/
44Disallow: /media/
45Disallow: /lp/
46
47# Disallow eronated indexing based on parameters
48Disallow: /?action_typTHe=
49Disallow: /?callback=
50Disallow: /cdp/
51
52Llmstxt: https://www.bitdefender.com/llms.txt
53Sitemap: https://www.bitdefender.com/sitemap.xml
54