Claude-SearchBot
Anthropic · Search indexing
38 of 1201 monitored sites (3.2%) block Claude-SearchBot by name.
Claude-SearchBot blocking over time share of monitored sites · weekly snapshot
Sites blocking
Claude-SearchBot
2026-06-20
2026-09-19
12 earlier weeks omitted (archive building) · 14 weekly snapshots with reliable coverage
Recent Claude-SearchBot events
- 2026-09-18 — Commonwealth Bank: Added Allow: /digital/home-loans/borrowing-power-calculator for Claude-SearchBot; Added Allow: /etc/designs/commbank/favicon.ico for Claude-SearchBot diff
- 2026-09-17 — GoDaddy: Added Allow: */domain-auctions/ for Claude-SearchBot; Added Allow: */domainsearch/ for Claude-SearchBot; Added Disallow: */domain-auctions/api/* for Claude-SearchBot … and 2 more change(s) diff
- 2026-09-17 — Figma Community: Added Allow: /blog/show-your-work/$ for Claude-SearchBot; Added Allow: /de-de/blog/source-material-thom-bettridge/$ for Claude-SearchBot; Added Allow: /de-de/blog/workflow-lab-moving-between-design-and-code-with-agents/$ for Claude-SearchBot … and 17 more change(s) diff
- 2026-09-17 — The Atlantic: Added Allow: /sponsored/ for Claude-SearchBot diff
- 2026-09-16 — Figma Community: Added Allow: /blog/try-these-5-weave-tools-and-share-your-own/$ for Claude-SearchBot; Added Allow: /webinars/intro-to-weave-workflow/$ for Claude-SearchBot diff
- 2026-09-16 — GoDaddy: Added rules for AI crawler Claude-SearchBot (Anthropic) diff
- 2026-09-16 — Figma Community: Added Allow: /blog/source-material-zach-lieberman/$ for Claude-SearchBot diff
- 2026-09-15 — Figma Community: Added Allow: /de-de/blog/source-material-marisa-chentakul/$ for Claude-SearchBot; Added Allow: /es-es/blog/source-material-marisa-chentakul/$ for Claude-SearchBot; Added Allow: /es-la/blog/source-material-marisa-chentakul/$ for Claude-SearchBot … and 10 more change(s) diff
- 2026-09-15 — Figma Community: Added Allow: /es-la/blog/source-material-thom-bettridge/$ for Claude-SearchBot diff
- 2026-09-14 — Figma Community: Added Allow: /careers/early-career/$ for Claude-SearchBot; Added Allow: /resource-library/claude-code-for-designers/$ for Claude-SearchBot; Added Allow: /resource-library/claude-skills-for-product-designers/$ for Claude-SearchBot … and 22 more change(s) diff
- 2026-09-11 — Zscaler: Added Disallow: /8199ac63-be6c-4cba-9bd9-45500a02d64f.txt for Claude-SearchBot; Removed Disallow: /indexNowKey.txt for Claude-SearchBot diff
- 2026-09-11 — Figma Community: Added Allow: /blog/japan-local-data-hosting/$ for Claude-SearchBot; Added Allow: /blog/source-material-marisa-chentakul/$ for Claude-SearchBot; Added Allow: /blog/source-material-thom-bettridge/$ for Claude-SearchBot … and 4 more change(s) diff
- 2026-09-11 — Figma Community: Added Allow: /webinars/code-connect-to-the-test-coinbase/$ for Claude-SearchBot diff
- 2026-09-10 — Figma Community: Added Allow: /de-de/blog/source-material-i-d-magazine-editor-in-chief-thom-bettridge/$ for Claude-SearchBot; Added Allow: /es-es/blog/source-material-i-d-magazine-editor-in-chief-thom-bettridge/$ for Claude-SearchBot; Added Allow: /fr-fr/blog/source-material-i-d-magazine-editor-in-chief-thom-bettridge/$ for Claude-SearchBot … and 3 more change(s) diff
- 2026-09-09 — Figma Community: Added Allow: /de-de/blog/how-coinbase-used-code-connect-to-shrink-token-costs/$ for Claude-SearchBot; Added Allow: /de-de/blog/how-we-built-generative-plugins-and-shaders/$ for Claude-SearchBot; Added Allow: /es-es/blog/how-coinbase-used-code-connect-to-shrink-token-costs/$ for Claude-SearchBot … and 11 more change(s) diff
- 2026-09-09 — SAP: Added Disallow: /fetch for Claude-SearchBot; Added Disallow: /proxy for Claude-SearchBot; Added Disallow: /sharedlibs/ for Claude-SearchBot diff
- 2026-09-09 — Commonwealth Bank: Removed Disallow: /personal/eform/ for Claude-SearchBot diff
- 2026-09-09 — Figma Community: Added Allow: /blog/source-material-creative-technologist-marisa-chentakul-meshtimes/$ for Claude-SearchBot diff
- 2026-09-08 — Figma Community: Added Allow: /id-id/resource-library/alat-desain-ai/$ for Claude-SearchBot; Added Allow: /it-it/resource-library/strumenti-design-ai/$ for Claude-SearchBot; Added Allow: /ko-kr/resource-library/ai-design-tools/$ for Claude-SearchBot … and 3 more change(s) diff
- 2026-09-08 — Figma Community: Added Allow: /pl-pl/rozwiazania/generator-systemow-projektowania-ai/$ for Claude-SearchBot diff
- 2026-09-07 — DBLP: Blocked Claude-SearchBot (Anthropic) entirely diff
- 2026-09-03 — Figma Community: Added Allow: /es-la/blog/start-anywhere/$ for Claude-SearchBot diff
- 2026-09-02 — Figma Community: Added Allow: /webinars/building-your-first-component-with-ai/$ for Claude-SearchBot; Added Allow: /webinars/connecting-reviewing-and-shipping-your-component/$ for Claude-SearchBot; Added Allow: /webinars/designer-to-builder-series/$ for Claude-SearchBot … and 1 more change(s) diff
- 2026-09-02 — Figma Community: Added Allow: /blog/how-coinbase-used-code-connect-to-shrink-token-costs/$ for Claude-SearchBot; Added Allow: /de-de/blog/start-anywhere/$ for Claude-SearchBot; Added Allow: /es-es/blog/start-anywhere/$ for Claude-SearchBot … and 10 more change(s) diff
- 2026-09-01 — Figma Community: Added Allow: /blog/how-we-built-generative-plugins-and-shaders/$ for Claude-SearchBot; Added Allow: /de-de/blog/sightlines-issue-no2/$ for Claude-SearchBot; Added Allow: /es-es/blog/sightlines-issue-no2/$ for Claude-SearchBot … and 6 more change(s) diff
- 2026-08-28 — Figma Community: Added Allow: /blog/measuring-the-impact-of-ai/$ for Claude-SearchBot; Added Allow: /blog/source-material-i-d-magazine-editor-in-chief-thom-bettridge/$ for Claude-SearchBot; Added Allow: /webinars/expressive-design-tools/$ for Claude-SearchBot diff
- 2026-08-27 — Figma Community: Added Allow: /blog/workflow-lab-moving-between-design-and-code-with-agents/$ for Claude-SearchBot diff
- 2026-08-26 — Toyota: Removed Disallow: /espanol/vehicles/ for Claude-SearchBot; Removed Disallow: /vehicles/ for Claude-SearchBot diff
- 2026-08-26 — IGN: Added Allow: /sponsored/ for Claude-SearchBot diff
- 2026-08-25 — Figma Community: Added Allow: /de-de/blog/measuring-time-savings-from-figma-make/$ for Claude-SearchBot; Added Allow: /es-es/blog/measuring-time-savings-from-figma-make/$ for Claude-SearchBot; Added Allow: /es-la/blog/measuring-time-savings-from-figma-make/$ for Claude-SearchBot … and 4 more change(s) diff
Sites blocking Claude-SearchBot
| Site | Sector | Badge |
|---|---|---|
| Amazon | Retailing |  |
| Ars Technica | Technology |  |
| Bloomberg | News & Financial |  |
| CNN | Broadcast News |  |
| Daily Mail | News |  |
| DBLP | CS bibliography |  |
| De Telegraaf | News |  |
| Der Spiegel | News |  |
| El País | News |  |
| Figma Community | Graphics Multimedia and Web Design |  |
| HuffPost | Digital Media |  |
| IGN | Web |  |
| Le Figaro | News |  |
| Le Monde | News |  |
| Msn | Web |  |
| NBC News | Broadcast News |  |
| Nikkei | News & Financial |  |
| Politico | News |  |
| Quora | Q&A |  |
| Reliance Steel & Aluminum | Materials |  |
| The Asahi Shimbun | News |  |
| The Associated Press | Newswire |  |
| The Atlantic | Magazine |  |
| The Economist | Magazine |  |
| The Globe and Mail | News |  |
| The Guardian | News |  |
| The New York Times | News |  |
| The New Yorker | Magazine |  |
| The Telegraph | News |  |
| The Verge | Technology |  |
| TikTok | Video |  |
| Toronto Star | News |  |
| Uol | Web |  |
| USA Today | News |  |
| Vox | News |  |
| wikiHow | Dictionaries and Encyclopedias |  |
| Wired | Technology |  |
| Yelp | Web |  |