Waldo / robots.txt snapshot
← back to waldo.fyi · fetched 2026-07-20T19:11:56Z (16d ago) · HTTP 200 · 266 bytes · sha256 fed1a3be2c8d9b45 · raw
final URL: https://www.waldo.fyi/robots.txt
| 1 | User-Agent: GPTBot |
| 2 | User-Agent: OAI-SearchBot |
| 3 | User-Agent: ChatGPT-User |
| 4 | User-Agent: PerplexityBot |
| 5 | User-Agent: ClaudeBot |
| 6 | User-Agent: Claude-Web |
| 7 | User-Agent: Google-Extended |
| 8 | Allow: / |
| 9 | |
| 10 | User-Agent: * |
| 11 | Allow: / |
| 12 | |
| 13 | Host: https://waldo.fyi |
| 14 | Sitemap: https://waldo.fyi/sitemap.xml |