Andi Search / robots.txt snapshot
← back to andisearch.com · fetched 2026-10-26T10:22:12Z (12d ago) · HTTP 200 · 309 bytes · sha256 56116cb7d7a4ece3 · raw
final URL: https://andisearch.com/robots.txt
| 1 | # https://www.robotstxt.org/robotstxt.html |
| 2 | # Allow access to root homepage and specific pages only |
| 3 | User-agent: * |
| 4 | Allow: /about/ |
| 5 | Allow: /help/ |
| 6 | Allow: /privacy/ |
| 7 | Allow: /commands/ |
| 8 | Allow: /default/ |
| 9 | Allow: /bot |
| 10 | Allow: /static/ |
| 11 | Allow: /sitemap.txt |
| 12 | Allow: /$ |
| 13 | Disallow: /* |
| 14 | Sitemap: https://andisearch.com/sitemap.txt |