AI2Bot
Allen Institute for AI · Research crawler
35 of 1201 monitored sites (2.9%) block AI2Bot by name.
AI2Bot blocking over time share of monitored sites · weekly snapshot
Sites blocking
AI2Bot
2026-06-21
2026-09-20
12 earlier weeks omitted (archive building) · 14 weekly snapshots with reliable coverage
Recent AI2Bot events
- 2026-09-18 — Indeed: Added Disallow: /Zeige-Job for AI2Bot; Added Disallow: /generate-question for AI2Bot; Added Disallow: /hire/ats-partners for AI2Bot … and 17 more change(s) diff
- 2026-09-09 — DBLP: Blocked user-agent ‘AI2Bot-DeepResearchEval’ entirely diff
- 2026-09-07 — DBLP: Blocked AI2Bot (Allen Institute for AI) entirely; Blocked user-agent ‘Ai2Bot-Dolma’ entirely diff
- 2026-08-26 — IGN: Added Allow: /sponsored/ for AI2Bot; Added Allow: /sponsored/ for Ai2Bot-DeepResearchEval; Added Allow: /sponsored/ for Ai2Bot-Dolma diff
- 2026-08-25 — Qwant: Added Disallow: /?*bottomMenu=* for AI2Bot; Added Disallow: /?*drawer=* for AI2Bot; Added Disallow: /?*home=* for AI2Bot … and 9 more change(s) diff
- 2026-08-20 — Vox: Added Allow: /strategist for AI2Bot; Added Allow: /strategist for AI2Bot-DeepResearchEval; Added Allow: /strategist for Ai2Bot-Dolma diff
- 2026-08-19 — Vox: Removed Allow: /strategist for AI2Bot; Removed Allow: /strategist for AI2Bot-DeepResearchEval; Removed Allow: /strategist for Ai2Bot-Dolma diff
- 2026-08-19 — Vox: Added Allow: /strategist for AI2Bot; Added Allow: /strategist for AI2Bot-DeepResearchEval; Added Allow: /strategist for Ai2Bot-Dolma diff
- 2026-08-18 — Indeed: Added Allow: /*&start=0& for AI2Bot; Added Allow: /*&start=10& for AI2Bot; Added Allow: /*&start=20& for AI2Bot … and 7 more change(s) diff
- 2026-08-12 — Nvidia: Removed rules for AI crawler AI2Bot (Allen Institute for AI) diff
- 2026-08-11 — Der Spiegel: Blocked AI2Bot (Allen Institute for AI) entirely diff
- 2026-07-08 — Slate: Blocked AI2Bot (Allen Institute for AI) entirely diff
- 2026-06-30 — Indeed: Added rules for AI crawler AI2Bot (Allen Institute for AI) diff
- 2026-06-17 — Nikkei: Blocked AI2Bot (Allen Institute for AI) entirely; Blocked user-agent ‘AI2Bot-Dolma’ entirely diff
Sites blocking AI2Bot
| Site | Sector | Badge |
|---|---|---|
| Amazon | Retailing |  |
| Behance | Graphics Multimedia and Web Design |  |
| Bild | News |  |
| Canva | Web |  |
| CNN | Broadcast News |  |
| Daily Mail | News |  |
| DBLP | CS bibliography |  |
| Der Spiegel | News |  |
| Electronic Arts | Technology |  |
| IGN | Web |  |
| Le Monde | News |  |
| Letterboxd | Arts and Entertainment |  |
| Msn | Web |  |
| Nikkei | News & Financial |  |
| Nintendo | Video Games |  |
| Parker Hannifin | Industrials |  |
| Politico | News |  |
| Proofpoint | Cybersecurity |  |
| Scribd | Public Records and Directories |  |
| Sky News | Broadcast News |  |
| Slate | Digital Media |  |
| SlideShare | Public Records and Directories |  |
| Snapchat | Messaging |  |
| Storyblocks | Stock media |  |
| The Asahi Shimbun | News |  |
| The Globe and Mail | News |  |
| The Telegraph | News |  |
| The Verge | Technology |  |
| TikTok | Video |  |
| Toronto Star | News |  |
| Uol | Web |  |
| USA Today | News |  |
| Vox | News |  |
| wikiHow | Dictionaries and Encyclopedias |  |
| Zillow | Web |  |