Algolia / robots.txt snapshot

← back to algolia.com · fetched 2026-06-20T14:56:27Z (4h ago) · HTTP 200 · 1225 bytes · sha256 2834b6a75e0cb013 · raw

final URL: https://www.algolia.com/robots.txt

1	User-agent: Screaming Frog SEO Spider
2	Allow: /
3
4	User-agent: *
5	Disallow: /policies/ai-personalization
6	Disallow: /policies/marketplace-trial-terms
7	Disallow: /policies/value-engineering-specific-terms
8	Disallow: /policies/startup-program-terms
9	Disallow: /policies/algolia-core-foundation
10	Disallow: /policies/algolia-enterprise-foundation
11	Disallow: /policies/neural-elevate-plan
12	Disallow: /policies/neural-elevate-for-ecommerce-plan
13	Disallow: /policies/free-services-terms
14	Disallow: /policies/premium-plan-algolia-keyword-search
15	Disallow: /policies/scale-plan
16	Disallow: /policies/grow-plan-specific-terms
17	Disallow: /policies/premier-platform-availability-sla
18	Disallow: /policies/terms/algolia-premier-support
19	Disallow: /policies/distributed-search-network
20	Disallow: /policies/extended-support
21	Disallow: /policies/algolia-recommend
22	Disallow: /policies/algolia-essential-foundation
23	Disallow: /policies/premium-free-tier-specific-terms
24	Disallow: /policies/terms/algolia-support-professional-services-success-offerings
25	Disallow: /policies/hipaa-enabled-service-features/
26	Disallow: /policies/terms/algolia-premier-support
27	Disallow: /policies/algolia-genai-addendum
28	Disallow: /policies/algolia-fetch
29	Disallow: /policies/genexperiences