Weibo / robots.txt
← back to weibo.com · change detected 2mo ago (2026-08-31T09:30:24Z) · modified +6 −0
What changed
- Blocked user-agent ‘Google-adstxt’ entirely
Diff old (2026-08-04T06:35:30Z) → new (2026-08-31T09:30:24Z)
| @@ -11,6 +11,12 @@ | ||
| 11 | 11 | Content-Signal: search=yes, ai-input=yes, ai-train=no |
| 12 | 12 | Crawl-delay: 1 |
| 13 | 13 | Disallow: |
| 14 | + | |
| 15 | + User-Agent: Google-adstxt | |
| 16 | + Content-Signal: search=yes, ai-input=yes, ai-train=no | |
| 17 | + Crawl-delay: 1 | |
| 18 | + Allow: /app-ads.txt | |
| 19 | + Disallow: / | |
| 14 | 20 | |
| 15 | 21 | User-Agent: Perplexity-User |
| 16 | 22 | User-Agent: DeepSeek Chat |