🇨🇳 Weibo

weibo.com · Social Networks · rank #22 · Social Network · live robots.txt ↗

AI crawler access (latest snapshot, 13h ago)

⛔blocked restricted ✅allowed faded = inherited from the * wildcard group

⛔GPTBot

⛔ChatGPT-User

⛔OAI-SearchBot

⛔ClaudeBot

⛔Claude-User

⛔Claude-SearchBot

⛔anthropic-ai

⛔Claude-Web

⛔CCBot

⛔Google-Extended

⛔Applebot-Extended

⛔PerplexityBot

⛔Perplexity-User

⛔Bytespider

⛔Amazonbot

⛔FacebookBot

⛔meta-externalagent

⛔meta-externalfetcher

⛔cohere-ai

⛔AI2Bot

⛔Diffbot

⛔omgili

⛔YouBot

⛔DuckAssistBot

⛔MistralAI-User

⛔PanguBot

⛔Timpibot

Current robots.txt 294 bytes · sha256 a2b02a4886dd · raw

User-Agent: Baiduspider
Disallow: 
User-agent: 360Spider
Disallow:
User-agent: Googlebot
Disallow:
User-agent: Sogou web spider
Disallow:
User-agent: bingbot
Disallow:
User-agent: smspider
Disallow:
User-agent: HaosouSpider
Disallow:
User-agent: YisouSpider
Disallow:
User-agent: *
Disallow: /

Change history

initial 13h ago snapshot
- First snapshot of robots.txt archived