Andi Search / robots.txt snapshot

← back to andisearch.com · fetched 2026-10-29T11:22:58Z (9d ago) · HTTP 200 · 347 bytes · sha256 e7413f1d2753320b · raw

final URL: https://andisearch.com/robots.txt

1	# https://www.robotstxt.org/robotstxt.html
2	# Allow access to root homepage and specific pages only
3	User-agent: *
4	Allow: /about/
5	Allow: /help/
6	Allow: /privacy/
7	Allow: /commands/
8	Allow: /default/
9	Allow: /bot
10	Allow: /static/
11	Allow: /sitemap.txt
12	Allow: /$
13	Allow: /llms.txt
14	Allow: /.well-known/
15	Disallow: /*
16	Sitemap: https://andisearch.com/sitemap.txt