Flickr / robots.txt
← back to flickr.com · change detected 1mo ago (2026-06-30T06:03:14Z) · modified +5 −0
What changed
- 🤖 AIAdded rules for AI crawler ChatGPT-User (OpenAI)
- 🤖 AIAdded rules for AI crawler Claude-SearchBot (Anthropic)
- 🤖 AIAdded rules for AI crawler Claude-User (Anthropic)
- 🤖 AIAdded rules for AI crawler OAI-SearchBot (OpenAI)
- 🤖 AIAdded rules for AI crawler PerplexityBot (Perplexity)
Diff old (2026-06-20T01:10:30Z) → new (2026-06-30T06:03:14Z)
| @@ -7,6 +7,9 @@ | ||
| 7 | 7 | User-agent: bitlybot |
| 8 | 8 | User-agent: bingbot |
| 9 | 9 | User-agent: BingPreview |
| 10 | + User-agent: ChatGPT-User | |
| 11 | + User-agent: Claude-SearchBot | |
| 12 | + User-agent: Claude-User | |
| 10 | 13 | User-agent: coccocbot |
| 11 | 14 | User-agent: Discordbot |
| 12 | 15 | User-agent: DuckDuckBot |
| @@ -24,6 +27,8 @@ | ||
| 24 | 27 | User-agent: Mediapartners-Google |
| 25 | 28 | User-agent: msnbot |
| 26 | 29 | User-agent: NAVER |
| 30 | + User-agent: OAI-SearchBot | |
| 31 | + User-agent: PerplexityBot | |
| 27 | 32 | User-agent: PetalBot |
| 28 | 33 | User-agent: Pingdom |
| 29 | 34 | User-agent: Pinterest |