NeuralCrawl

Waldo / robots.txt snapshot

← back to waldo.fyi · fetched 2026-08-13T21:57:57Z (2mo ago) · HTTP 200 · 274 bytes · sha256 43113344794ecd1e · raw

final URL: https://www.waldo.fyi/robots.txt

1User-Agent: GPTBot
2User-Agent: OAI-SearchBot
3User-Agent: ChatGPT-User
4User-Agent: PerplexityBot
5User-Agent: ClaudeBot
6User-Agent: Claude-Web
7User-Agent: Google-Extended
8Allow: /
9
10User-Agent: *
11Allow: /
12
13Host: https://www.waldo.fyi
14Sitemap: https://www.waldo.fyi/sitemap.xml