ESET / robots.txt
← back to eset.com · change detected 2mo ago (2026-08-19T17:42:34Z) · modified +19 −0
What changed
- Blocked user-agent ‘AwarioRssBot’ entirely
- Blocked user-agent ‘AwarioSmartBot’ entirely
- Blocked user-agent ‘BacklinkBot’ entirely
- Blocked user-agent ‘Brandwatch’ entirely
- Blocked user-agent ‘CognitiveSEO’ entirely
- Blocked user-agent ‘DataForSeoBot’ entirely
- Blocked user-agent ‘DotBot’ entirely
- Blocked user-agent ‘LinkpadBot’ entirely
- Blocked user-agent ‘Lipperhey’ entirely
- Blocked user-agent ‘Majestic-12’ entirely
- Blocked user-agent ‘MegaIndex.ru’ entirely
- Blocked user-agent ‘MeltwaterBot’ entirely
- Blocked user-agent ‘NetpeakCheckerBot’ entirely
- Blocked user-agent ‘Rogerbot’ entirely
- Blocked user-agent ‘SemrushBot’ entirely
- Blocked user-agent ‘SEOkicks’ entirely
- Blocked user-agent ‘SerpstatBot’ entirely
- Blocked user-agent ‘SiteExplorerBot’ entirely
- Blocked user-agent ‘ZoomInfoBot’ entirely
Diff old (2026-06-20T14:27:25Z) → new (2026-08-19T17:42:34Z)
| @@ -10,6 +10,25 @@ | ||
| 10 | 10 | |
| 11 | 11 | User-agent: MJ12bot |
| 12 | 12 | User-agent: BLEXBot |
| 13 | + User-agent: DotBot | |
| 14 | + User-agent: SemrushBot | |
| 15 | + User-agent: Rogerbot | |
| 16 | + User-agent: MegaIndex.ru | |
| 17 | + User-agent: DataForSeoBot | |
| 18 | + User-agent: ZoomInfoBot | |
| 19 | + User-agent: AwarioSmartBot | |
| 20 | + User-agent: AwarioRssBot | |
| 21 | + User-agent: MeltwaterBot | |
| 22 | + User-agent: Brandwatch | |
| 23 | + User-agent: SerpstatBot | |
| 24 | + User-agent: CognitiveSEO | |
| 25 | + User-agent: LinkpadBot | |
| 26 | + User-agent: Lipperhey | |
| 27 | + User-agent: NetpeakCheckerBot | |
| 28 | + User-agent: SiteExplorerBot | |
| 29 | + User-agent: BacklinkBot | |
| 30 | + User-agent: Majestic-12 | |
| 31 | + User-agent: SEOkicks | |
| 13 | 32 | Disallow: / |
| 14 | 33 | |
| 15 | 34 | Sitemap: https://www.eset.com/za/sitemap.xml |