NeuralCrawl

Fortinet / robots.txt snapshot

← back to fortinet.com · fetched 2026-08-31T21:34:42Z (2mo ago) · HTTP 200 · 3017 bytes · sha256 42d6ea5ff5d01a20 · raw

final URL: https://www.fortinet.com/robots.txt

1Sitemap: https://www.fortinet.com/sitemap-index.xml
2Sitemap: https://www.fortinet.com/sitemap.xml
3Sitemap: https://www.fortinet.com/it/sitemap.xml
4Sitemap: https://www.fortinet.com/de/sitemap.xml
5Sitemap: https://www.fortinet.com/fr/sitemap.xml
6Sitemap: https://www.fortinet.com/jp/sitemap.xml
7Sitemap: https://www.fortinet.com/kr/sitemap.xml
8Sitemap: https://www.fortinet.com/cn/sitemap.xml
9Sitemap: https://www.fortinet.com/tw/sitemap.xml
10Sitemap: https://www.fortinet.com/br/sitemap.xml
11Sitemap: https://www.fortinet.com/lat/sitemap.xml
12Sitemap: https://www.fortinet.com/uk/sitemap.xml
13Sitemap: https://www.fortinet.com/bin/fortinet/allnewsxml
14
15User-agent: CCBot/2.0
16Disallow: /
17
18User-agent: Google-CloudVertexBot
19User-agent: GoogleOther
20Disallow: /
21
22User-agent: AhrefsBot
23User-agent: SemrushBot
24User-agent: Baiduspider
25User-agent: BingBot
26User-agent: Brightedge
27User-agent: ChatGPT-User
28User-agent: Claude-SearchBot
29User-agent: Claude-User
30User-agent: Exabot
31User-agent: FeedFetcher-Google
32User-agent: Google-extended
33User-agent: Google-InspectionTool
34User-agent: Google-Pinpoint
35User-agent: Google-Site-Verification
36User-agent: Google-speakr
37User-agent: GoogleBot
38User-agent: Googlebot-Image
39User-agent: Googlebot-News
40User-agent: Googlebot-Video
41User-agent: GPTBot
42User-agent: LinkedInBot
43User-agent: OAI-SearchBot
44User-agent: PerplexityBot
45User-agent: ProfoundBot/1.0
46User-agent: SchemaBot/1.2
47User-agent: Twitterbot
48User-agent: facebookexternalhit
49User-agent: Qwantify
50Disallow: /blog/tags-search
51Disallow: /blog/tags-search.html
52Disallow: /cn/corporate/about-us/newsroom/press-releases/
53Disallow: /content/dam/fortinet/assets/*.txt$
54Disallow: /content/dam/fortinet/assets/ja_jp/private/*
55Disallow: /content/dam/fortinet/assets/partners/state-contracts/*
56Disallow: /content/dam/fortinet/assets/private/*
57Disallow: /content/dam/fortinet/assets/solution-guides/ja_jp/LF_fortiproxy.pdf
58Disallow: /content/dam/fortinet/assets/white-papers/vpat*.pdf
59Disallow: /content/dam/fortinet/assets/white-papers/VPAT*.pdf
60Disallow: /content/dam/fortinet/assets/legal/*
61Disallow: /content/dam/fortinet/assets/zip/*
62Disallow: /content/dam/fortinet/assets/zip
63Disallow: /*sled-contracts-grants*
64Disallow: /content/dam/maindam/*
65Disallow: /content/dam/fortinet/assets/data-sheets/pdf/*
66Disallow: /content/dam/fortinet/assets/buyers-guide/pdf/*
67Disallow: /error.html
68Disallow: /form/
69Disallow: /form.html
70Disallow: /ir.html
71Disallow: /partners/mississippi-its.html
72Disallow: /partners/mississippi-its$
73Disallow: /partners/california-list-fortinet$
74Disallow: /partners/alabama-aljp$
75Disallow: /partners/equalis-group$
76Disallow: /resources-campaign/*
77Disallow: /br/resources-campaign/*
78Disallow: /lat/resources-campaign/*
79Disallow: /gb/resources-campaign/*
80Disallow: /de/resources-campaign/*
81Disallow: /fr/resources-campaign/*
82Disallow: /reports/
83Disallow: /*?tag=*
84Disallow: /*.php$
85Disallow: /*.aspx$
86Disallow: /*.php?$
87Disallow: /*.asmx?$
88
89User-agent: MojeekBot
90User-agent: PetalBot
91User-agent: YouBot
92User-agent: *
93Disallow: /