🇺🇸 F5

f5.com · Cybersecurity · rank #50 · Cybersecurity · live robots.txt ↗

AI crawler access (latest snapshot, 3h ago)

⛔blocked restricted ✅allowed faded = inherited from the * wildcard group

✅GPTBot

✅ChatGPT-User

✅OAI-SearchBot

✅ClaudeBot

✅Claude-User

✅Claude-SearchBot

✅anthropic-ai

✅Claude-Web

✅CCBot

✅Google-Extended

✅Applebot-Extended

✅PerplexityBot

✅Perplexity-User

✅Bytespider

✅Amazonbot

✅FacebookBot

✅meta-externalagent

✅meta-externalfetcher

✅cohere-ai

✅AI2Bot

✅Diffbot

✅omgili

✅YouBot

✅DuckAssistBot

✅MistralAI-User

✅PanguBot

✅Timpibot

Current robots.txt 1805 bytes · sha256 dffdcb2ae306 · raw

<link href="
https://cdn.web.f5.com/web/css/simplified-f5-error.css"
rel="stylesheet"><script src="
https://cdn.web.f5.com/web/js/simplified-f5-error.js"></script><noscript><iframe
height="0" src="//
www.googletagmanager.com/ns.html?id=GTM-PPZPQ6"
style="display:none;visibility:hidden" width="0"></iframe></noscript><div class="F5 homepage" id="Wrapper"><div class="c main-c"><div class="content-c"><path
d="M0 14.6h96v56H0z"/><path d="M94.5 1.5v13h-93v-13h93M96 0H0v16h96V0z"/><path d="M7 8h6.7M20.6 8h6.8M34.3 8H41" class="c1"/><path d="M88 5.5A2.5 2.5 0 1 1 85.7 8 2.5 2.5 0 0 1 88 5.5M88 4a4 4 0 1 0 4 4 4 4 0 0 0-4-4z"/><circle cx="47.6" cy="41.4" r="10.6" class="c2"/><path d="M40 49l15-15" class="c2"/></svg><h1 class="d1 block-padding-lg-ver">File Not Found</h1>
<p class="lead lead-in">The file you requested was not found or has been moved.</p>
<p>Please return to the <a href="javascript:history.back()">previous URL</a> or visit <a
        href="https://www.f5.com">www.f5.com</a> to get back on track.</p>
<p>Regards,<br>The Web Team</p>
<p>Contact Email: <a href="mailto:[email protected]">[email protected]</a></p><br><br>Your support ID is: 79c8d08c-b18b-43ea-85db-6bc07d6dd523<br><br></div></div></div><header class="header-f5" id="F5-Header"><div class="main-row"><div class="c header-c"><div class="brand"><a href="
https://f5.com"
data-link-type="nav: brand"><img class="brand-main" alt="f5 logo" src="
https://cdn.web.f5.com/web/assets/images/f5-logo-rgb.png"></a></div><a
href="javascript:history.back()" class="btn">Return to previous page</a></div></div></header><div class="mobilenav no-print" role="navigation"><div class="c"><a href="
https://f5.com"
class="brand-main"><img class="brand-main" alt="f5 logo" src="
https://cdn.web.f5.com/web/assets/images/f5-logo-rgb.png"></a></div></div>

Compare any two snapshots

Change history

modified 3h ago +1 −1 view diff → snapshot
- Formatting/comment-only change (no semantic difference)
initial 4h ago snapshot
- First snapshot of robots.txt archived