Indeed / robots.txt
← back to indeed.com · change detected 30d ago (2026-10-07T21:56:40Z) · modified +2 −0
What changed
- Added Disallow: /promo/ for *
- 🤖 AIAdded Disallow: /promo/ for ChatGPT-User
- 🤖 AIAdded Disallow: /promo/ for Claude-SearchBot
- 🤖 AIAdded Disallow: /promo/ for Claude-User
- 🤖 AIAdded Disallow: /promo/ for DuckAssistBot
- Added Disallow: /promo/ for DuckDuckBot
- Added Disallow: /promo/ for Gemini-Deep-Research
- Added Disallow: /promo/ for Google-Agent
- Added Disallow: /promo/ for Google-CloudVertexBot
- 🤖 AIAdded Disallow: /promo/ for Google-Extended
- Added Disallow: /promo/ for Googlebot
- Added Disallow: /promo/ for Grok-DeepSearch
- 🤖 AIAdded Disallow: /promo/ for Meta-ExternalFetcher
- 🤖 AIAdded Disallow: /promo/ for Meta-WebIndexer
- 🤖 AIAdded Disallow: /promo/ for OAI-SearchBot
- 🤖 AIAdded Disallow: /promo/ for Perplexity-User
- 🤖 AIAdded Disallow: /promo/ for PerplexityBot
- Added Disallow: /promo/ for PetalBot
- Added Disallow: /promo/ for Slurp
- Added Disallow: /promo/ for xAI-Grok
- Added Disallow: /promo/ for YahooJP
- 🤖 AIAdded Disallow: /promo/ for YouBot
Diff old (2026-09-18T15:27:37Z) → new (2026-10-07T21:56:40Z)
| @@ -132,6 +132,7 @@ | ||
| 132 | 132 | Disallow: /poka%C5%BCprac%C4%99? |
| 133 | 133 | Disallow: /praca/ |
| 134 | 134 | Disallow: /preferences |
| 135 | + Disallow: /promo/ | |
| 135 | 136 | Disallow: /*radius= |
| 136 | 137 | Disallow: /rc/ |
| 137 | 138 | Disallow: /rdr/ |
| @@ -333,6 +334,7 @@ | ||
| 333 | 334 | Disallow: /poka%C5%BCprac%C4%99? |
| 334 | 335 | Disallow: /praca/ |
| 335 | 336 | Disallow: /preferences |
| 337 | + Disallow: /promo/ | |
| 336 | 338 | Disallow: /*radius= |
| 337 | 339 | Disallow: /rc/ |
| 338 | 340 | Disallow: /rdr/ |