AI2Bot
Allen Institute for AI · Research crawler
37 of 1203 monitored sites (3.1%) block AI2Bot by name.
AI2Bot blocking over time share of monitored sites · weekly snapshot
Sites blocking
AI2Bot
2026-06-20
2026-11-07
5 earlier weeks omitted (archive building) · 21 weekly snapshots with reliable coverage
Recent AI2Bot events
- 2026-11-05 — The Telegraph: Added Allow: /bah-avis/usa-sports-road-trip-map for AI2Bot; Added Allow: /bespoke-content/ for AI2Bot; Added Allow: /betting/ for AI2Bot … and 47 more change(s) diff
- 2026-11-04 — Corriere della Sera: Blocked AI2Bot (Allen Institute for AI) entirely; Blocked user-agent ‘Ai2Bot-Dolma’ entirely diff
- 2026-11-03 — The Telegraph: Removed Allow: /bah-avis/usa-sports-road-trip-map for AI2Bot; Removed Allow: /bespoke-content/ for AI2Bot; Removed Allow: /betting/ for AI2Bot … and 44 more change(s) diff
- 2026-10-27 — Mastodon: Blocked AI2Bot (Allen Institute for AI) entirely; Blocked user-agent ‘Ai2Bot-Dolma’ entirely diff
- 2026-10-22 — The Telegraph: Added Allow: /bah-avis/usa-sports-road-trip-map for AI2Bot; Added Allow: /bespoke-content/ for AI2Bot; Added Allow: /betting/ for AI2Bot … and 45 more change(s) diff
- 2026-10-20 — Daily Mail: Added Allow: /llms.txt for AI2Bot; Added Allow: /llms.txt for Ai2Bot-Dolma diff
- 2026-10-16 — Alamy: Added Disallow: /fpanalytics/ for AI2Bot; Added Disallow: /purchased-assets/ for AI2Bot; Added Disallow: /search-assistant/ for AI2Bot diff
- 2026-10-12 — IGN: Added Allow: /articles/how-the-samsung-galaxy-z-fold8-has-been-optimised-for-large-screen-entertainment-multitasking-and-all-day-battery-life for AI2Bot; Added Allow: /articles/z-fold8-vs-previous-samsung-foldables-how-battery-performance-efficiency-and-display-experience-have-evolved for AI2Bot; Added Allow: /articles/how-the-samsung-galaxy-z-fold8-has-been-optimised-for-large-screen-entertainment-multitasking-and-all-day-battery-life for Ai2Bot-DeepResearchEval … and 3 more change(s) diff
- 2026-10-12 — DBLP: Unblocked AI2Bot (Allen Institute for AI) - rules removed; Removed all rules for user-agent ‘AI2Bot-DeepResearchEval’; Removed all rules for user-agent ‘Ai2Bot-Dolma’ diff
- 2026-10-05 — The Telegraph: Added Allow: /ads.txt for AI2Bot; Added Allow: /business/uk-business-growth/ for AI2Bot; Added Allow: /travel/explore-dubai/ for AI2Bot … and 5 more change(s) diff
- 2026-09-26 — Airbnb: Blocked AI2Bot (Allen Institute for AI) entirely diff
- 2026-09-23 — Daily Mail: Removed Allow: /buyline/ for AI2Bot; Removed Allow: /buyline/ for Ai2Bot-Dolma diff
- 2026-09-18 — Indeed: Added Disallow: /Zeige-Job for AI2Bot; Added Disallow: /generate-question for AI2Bot; Added Disallow: /hire/ats-partners for AI2Bot … and 17 more change(s) diff
- 2026-09-09 — DBLP: Blocked user-agent ‘AI2Bot-DeepResearchEval’ entirely diff
- 2026-09-07 — DBLP: Blocked AI2Bot (Allen Institute for AI) entirely; Blocked user-agent ‘Ai2Bot-Dolma’ entirely diff
- 2026-08-26 — IGN: Added Allow: /sponsored/ for AI2Bot; Added Allow: /sponsored/ for Ai2Bot-DeepResearchEval; Added Allow: /sponsored/ for Ai2Bot-Dolma diff
- 2026-08-25 — Qwant: Added Disallow: /?*bottomMenu=* for AI2Bot; Added Disallow: /?*drawer=* for AI2Bot; Added Disallow: /?*home=* for AI2Bot … and 9 more change(s) diff
- 2026-08-20 — Vox: Added Allow: /strategist for AI2Bot; Added Allow: /strategist for AI2Bot-DeepResearchEval; Added Allow: /strategist for Ai2Bot-Dolma diff
- 2026-08-19 — Vox: Removed Allow: /strategist for AI2Bot; Removed Allow: /strategist for AI2Bot-DeepResearchEval; Removed Allow: /strategist for Ai2Bot-Dolma diff
- 2026-08-19 — Vox: Added Allow: /strategist for AI2Bot; Added Allow: /strategist for AI2Bot-DeepResearchEval; Added Allow: /strategist for Ai2Bot-Dolma diff
- 2026-08-18 — Indeed: Added Allow: /*&start=0& for AI2Bot; Added Allow: /*&start=10& for AI2Bot; Added Allow: /*&start=20& for AI2Bot … and 7 more change(s) diff
- 2026-08-12 — Nvidia: Removed rules for AI crawler AI2Bot (Allen Institute for AI) diff
- 2026-08-11 — Der Spiegel: Blocked AI2Bot (Allen Institute for AI) entirely diff
- 2026-07-08 — Slate: Blocked AI2Bot (Allen Institute for AI) entirely diff
- 2026-06-30 — Indeed: Added rules for AI crawler AI2Bot (Allen Institute for AI) diff
- 2026-06-17 — Nikkei: Blocked AI2Bot (Allen Institute for AI) entirely; Blocked user-agent ‘AI2Bot-Dolma’ entirely diff
Sites blocking AI2Bot
| Site | Sector | Badge |
|---|---|---|
| Airbnb | Technology |  |
| Amazon | Retailing |  |
| Behance | Graphics Multimedia and Web Design |  |
| Bild | News |  |
| Canva | Web |  |
| CNN | Broadcast News |  |
| Corriere della Sera | News |  |
| Daily Mail | News |  |
| Der Spiegel | News |  |
| Electronic Arts | Technology |  |
| IGN | Web |  |
| Le Monde | News |  |
| Letterboxd | Arts and Entertainment |  |
| Mastodon | Social Network (Fediverse) |  |
| Msn | Web |  |
| Nikkei | News & Financial |  |
| Nintendo | Video Games |  |
| Parker Hannifin | Industrials |  |
| Politico | News |  |
| Proofpoint | Cybersecurity |  |
| Scribd | Public Records and Directories |  |
| Sky News | Broadcast News |  |
| Slate | Digital Media |  |
| SlideShare | Public Records and Directories |  |
| Snapchat | Messaging |  |
| Storyblocks | Stock media |  |
| The Asahi Shimbun | News |  |
| The Globe and Mail | News |  |
| The Telegraph | News |  |
| The Verge | Technology |  |
| TikTok | Video |  |
| Toronto Star | News |  |
| Uol | Web |  |
| USA Today | News |  |
| Vox | News |  |
| wikiHow | Dictionaries and Encyclopedias |  |
| Zillow | Web |  |