NeuralCrawl

Fortra / robots.txt

← back to fortra.com · change detected 3mo ago (2026-08-06T19:27:21Z) · modified +2 −2

What changed

Diff old (2026-07-28T22:23:38Z) → new (2026-08-06T19:27:21Z)

@@ -63,14 +63,14 @@
6363 
6464  # OpenAI
6565  User-agent: GPTBot
66- Disallow: /
66+ Allow: /
6767 
6868  User-agent: ChatGPT-User
6969  Allow: /
7070 
7171  # Anthropic
7272  User-agent: ClaudeBot
73- Disallow: /
73+ Allow: /
7474 
7575  # Google AI training
7676  User-agent: Google-Extended