Malwarebytes / robots.txt snapshot
← back to malwarebytes.com · fetched 2026-06-20T14:27:25Z (7h ago) · HTTP 200 · 1817 bytes · sha256 9054793fd9200e8b · raw
final URL: https://www.malwarebytes.com/robots.txt
| 1 | User-agent: * |
| 2 | User-Agent: Googlebot |
| 3 | User-Agent: applebot |
| 4 | User-Agent: PerplexityBot |
| 5 | User-Agent: bingbot |
| 6 | User-Agent: OAI-SearchBot |
| 7 | User-Agent: GPTBot |
| 8 | User-Agent: GeminiBot |
| 9 | User-Agent: ClaudeBot |
| 10 | |
| 11 | Disallow: /wp-admin/ |
| 12 | Allow: /wp-admin/admin-ajax.php |
| 13 | Disallow: /*?wg-choose-original= |
| 14 | DISALLOW: /*?x-clickref= |
| 15 | DISALLOW: /*?amp |
| 16 | DISALLOW: /*?d= |
| 17 | DISALLOW: /*?sid2= |
| 18 | DISALLOW: /*.pdf |
| 19 | DISALLOW: /ctrl/* |
| 20 | DISALLOW: /v1a/* |
| 21 | DISALLOW: /*.php |
| 22 | DISALLOW: /404 |
| 23 | DISALLOW: /press/2008* |
| 24 | DISALLOW: /press/2009* |
| 25 | DISALLOW: /press/2010* |
| 26 | DISALLOW: /press/2011* |
| 27 | DISALLOW: /press/2012* |
| 28 | DISALLOW: /press/2013* |
| 29 | DISALLOW: /press/2014* |
| 30 | DISALLOW: /press/2015* |
| 31 | DISALLOW: /press/2016* |
| 32 | DISALLOW: /press/2017* |
| 33 | DISALLOW: /press/2018* |
| 34 | DISALLOW: /press/2019* |
| 35 | DISALLOW: /press/2020* |
| 36 | DISALLOW: /press/2021* |
| 37 | DISALLOW: /press/2022* |
| 38 | DISALLOW: /press/category/in-the-news* |
| 39 | DISALLOW: /business/solutions/gdpr/contact-us |
| 40 | DISALLOW: /education/contact/thankyou |
| 41 | DISALLOW: /eula/* |
| 42 | DISALLOW: /finance/contact/thankyou |
| 43 | DISALLOW: /lp/* |
| 44 | DISALLOW: /mac-download |
| 45 | DISALLOW: /pricing/inapp/* |
| 46 | DISALLOW: /secure |
| 47 | DISALLOW: /secure/guidelines |
| 48 | DISALLOW: /support/thirdpartynotices/* |
| 49 | DISALLOW: /thank_you* |
| 50 | DISALLOW: /thank-you* |
| 51 | DISALLOW: /threezerodays |
| 52 | Disallow: *.ttf? |
| 53 | DISALLOW: /mbam-whats-new.json* |
| 54 | Sitemap: https://www.malwarebytes.com/sitemap_index.xml |
| 55 | Sitemap: https://www.malwarebytes.com/pt-br/page-sitemap.xml |
| 56 | Sitemap: https://www.malwarebytes.com/nl/page-sitemap.xml |
| 57 | Sitemap: https://www.malwarebytes.com/es/page-sitemap.xml |
| 58 | Sitemap: https://www.malwarebytes.com/de/page-sitemap.xml |
| 59 | Sitemap: https://www.malwarebytes.com/fr/page-sitemap.xml |
| 60 | Sitemap: https://www.malwarebytes.com/pl/page-sitemap.xml |
| 61 | Sitemap: https://www.malwarebytes.com/it/page-sitemap.xml |
| 62 | Sitemap: https://www.malwarebytes.com/ru/page-sitemap.xml |
| 63 | Sitemap: https://www.malwarebytes.com/pt/page-sitemap.xml |