User-agent: * Allow: / Disallow: /search-results Disallow: /404 User-agent: Bytespider Disallow: / User-agent: SiteAuditBot Allow: / Sitemap: https://www.arkoselabs.com/sitemap.xml