π§π· ItaΓΊ Unibanco
itau.com.br · National indices · rank #81 · Banking · live robots.txt ↗
AI crawler access (latest snapshot, 13h ago)
⛔blocked
restricted
✅allowed
faded = inherited from the * wildcard group
✅GPTBot
✅ChatGPT-User
✅OAI-SearchBot
✅ClaudeBot
✅Claude-User
✅Claude-SearchBot
✅anthropic-ai
✅Claude-Web
✅CCBot
✅Google-Extended
✅Applebot-Extended
✅PerplexityBot
✅Perplexity-User
✅Bytespider
✅Amazonbot
✅FacebookBot
✅meta-externalagent
✅meta-externalfetcher
✅cohere-ai
✅AI2Bot
✅Diffbot
✅omgili
✅YouBot
✅DuckAssistBot
✅MistralAI-User
✅PanguBot
✅Timpibot
Current robots.txt 700 bytes · sha256 a6a5a95937d4 · raw
# Allow AI search and agent use User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: PerplexityBot Allow: / User-agent: Perplexity-User Allow: / User-agent: PerplexityiOS Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-User Allow: / User-agent: FirecrawlAgent Allow: / User-agent: AndiBot Allow: / User-agent: ExaBot Allow: / User-agent: PhindBot Allow: / User-agent: YouBot Allow: / # Allow all crawlers User-agent: * Allow: / Disallow: /mapa-fst/ Disallow: /xml/ Disallow: /Xml/ Disallow: /404/ Disallow: /*.pdf* Disallow: /_arquivosestaticos/* Disallow: /content/itau/resultado-de-busca-generico* Sitemap: https://www.itau.com.br/sitemap.xml
Change history
-
initial snapshot
- First snapshot of robots.txt archived