01.AI / robots.txt
← back to 01.ai · change detected 1mo ago (2026-07-06T14:16:42Z) · modified +4 −8
What changed
- Added rules for user-agent ‘*’
- Added sitemap https://www.lingyiwanwu.com/sitemap.xml
- Removed sitemap http://www.01.ai/sitemap.xml
Diff old (2026-06-20T01:10:30Z) → new (2026-07-06T14:16:42Z)
| @@ -1,9 +1,5 @@ | ||
| 1 | - # See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file | |
| 2 | - # | |
| 3 | - # To ban all spiders from the entire site uncomment the next two lines: | |
| 4 | - # User-Agent: * | |
| 5 | - # Disallow: / | |
| 1 | + # 01.AI official website | |
| 2 | + User-agent: * | |
| 3 | + Allow: / | |
| 6 | 4 | |
| 7 | - Sitemap: http://www.01.ai/sitemap.xml | |
| 8 | - | |
| 9 | - | |
| 5 | + Sitemap: https://www.lingyiwanwu.com/sitemap.xml |