All sites · Finance & Insurance
5 sites in Finance & Insurance blocking ≥1 AI crawler by name.
All sites
Top 1000 websites
US 500
Nasdaq 100
AI models
Cybersecurity
SEO & AI search
Creative rights-holders
Knowledge & UGC
Academic & open research
Universities
National indices
Banks & fintech
E-commerce
European companies
Social Networks
Governments
Publishers
Sector: Finance & Insurance · AI blockers ×
| # | Company | Domain | Sector | robots.txt | AI bots blocked | Snapshots | Changes | Last change | |
|---|---|---|---|---|---|---|---|---|---|
| 6 | 🇺🇸 | Bloomberg | bloomberg.com | News & Financial | present | 🤖 20 | 2 | 1 | 23d ago |
| 40 | 🇬🇧 | Financial Times | ft.com | News & Financial | present | 🤖 15 | 2 | 1 | 9d ago |
| 56 | 🇯🇵 | Nikkei | nikkei.com | News & Financial | present | 🤖 25 | 1 | 1 | 1mo ago |
| 81 | 🇺🇸 | Prudential Financial | prudential.com | Financials | present | 🤖 3 | 1 | 0 | — |
| 499 | 🇺🇸 | American Financial Group | afginc.com | Financials | present | 🤖 1 | 1 | 1 | 1mo ago |