NeuralCrawl

Fortinet / robots.txt snapshot

← back to fortinet.com · fetched 2026-06-20T01:10:31Z (15h ago) · HTTP 200 · 2989 bytes · sha256 81d37364aac38fd7 · raw

final URL: https://www.fortinet.com/robots.txt

1Sitemap: https://www.fortinet.com/sitemap-index.xml
2Sitemap: https://www.fortinet.com/sitemap.xml
3Sitemap: https://www.fortinet.com/it/sitemap.xml
4Sitemap: https://www.fortinet.com/de/sitemap.xml
5Sitemap: https://www.fortinet.com/fr/sitemap.xml
6Sitemap: https://www.fortinet.com/jp/sitemap.xml
7Sitemap: https://www.fortinet.com/kr/sitemap.xml
8Sitemap: https://www.fortinet.com/cn/sitemap.xml
9Sitemap: https://www.fortinet.com/tw/sitemap.xml
10Sitemap: https://www.fortinet.com/br/sitemap.xml
11Sitemap: https://www.fortinet.com/lat/sitemap.xml
12Sitemap: https://www.fortinet.com/uk/sitemap.xml
13Sitemap: https://www.fortinet.com/bin/fortinet/allnewsxml
14
15User-agent: CCBot/2.0
16Disallow: /
17
18User-agent: Google-CloudVertexBot
19User-agent: GoogleOther
20Disallow: /
21
22User-agent: AhrefsBot
23User-agent: SemrushBot
24User-agent: Baiduspider
25User-agent: BingBot
26User-agent: Brightedge
27User-agent: ChatGPT-User
28User-agent: Claude-SearchBot
29User-agent: Claude-User
30User-agent: Exabot
31User-agent: FeedFetcher-Google
32User-agent: Google-extended
33User-agent: Google-InspectionTool
34User-agent: Google-Pinpoint
35User-agent: Google-Site-Verification
36User-agent: Google-speakr
37User-agent: GoogleBot
38User-agent: Googlebot-Image
39User-agent: Googlebot-News
40User-agent: Googlebot-Video
41User-agent: GPTBot
42User-agent: LinkedInBot
43User-agent: OAI-SearchBot
44User-agent: PerplexityBot
45User-agent: SchemaBot/1.2
46User-agent: Twitterbot
47User-agent: facebookexternalhit
48User-agent: Qwantify
49Disallow: /blog/tags-search
50Disallow: /blog/tags-search.html
51Disallow: /cn/corporate/about-us/newsroom/press-releases/
52Disallow: /content/dam/fortinet/assets/*.txt$
53Disallow: /content/dam/fortinet/assets/ja_jp/private/*
54Disallow: /content/dam/fortinet/assets/partners/state-contracts/*
55Disallow: /content/dam/fortinet/assets/private/*
56Disallow: /content/dam/fortinet/assets/solution-guides/ja_jp/LF_fortiproxy.pdf
57Disallow: /content/dam/fortinet/assets/white-papers/vpat*.pdf
58Disallow: /content/dam/fortinet/assets/white-papers/VPAT*.pdf
59Disallow: /content/dam/fortinet/assets/legal/*
60Disallow: /content/dam/fortinet/assets/zip/*
61Disallow: /content/dam/fortinet/assets/zip
62Disallow: /*sled-contracts-grants*
63Disallow: /content/dam/maindam/*
64Disallow: /content/dam/fortinet/assets/data-sheets/pdf/*
65Disallow: /content/dam/fortinet/assets/buyers-guide/pdf/*
66Disallow: /error.html
67Disallow: /form/
68Disallow: /form.html
69Disallow: /ir.html
70Disallow: /partners/mississippi-its.html
71Disallow: /partners/mississippi-its$
72Disallow: /partners/california-list-fortinet$
73Disallow: /partners/alabama-aljp$
74Disallow: /partners/equalis-group$
75Disallow: /resources-campaign/*
76Disallow: /br/resources-campaign/*
77Disallow: /lat/resources-campaign/*
78Disallow: /gb/resources-campaign/*
79Disallow: /de/resources-campaign/*
80Disallow: /fr/resources-campaign/*
81Disallow: /reports/
82Disallow: /*?tag=*
83Disallow: /*.php$
84Disallow: /*.aspx$
85Disallow: /*.php?$
86Disallow: /*.asmx?$
87
88User-agent: MojeekBot
89User-agent: PetalBot
90User-agent: YouBot
91User-agent: *
92Disallow: /