Andi Search / robots.txt snapshot
← back to andisearch.com · fetched 2026-06-20T14:56:27Z (4h ago) · HTTP 200 · 297 bytes · sha256 979054ee343d2816 · raw
final URL: https://andisearch.com/robots.txt
| 1 | # https://www.robotstxt.org/robotstxt.html |
| 2 | # Allow access to root homepage and specific pages only |
| 3 | User-agent: * |
| 4 | Allow: /about/ |
| 5 | Allow: /help/ |
| 6 | Allow: /privacy/ |
| 7 | Allow: /commands/ |
| 8 | Allow: /default/ |
| 9 | Allow: /static/ |
| 10 | Allow: /sitemap.txt |
| 11 | Allow: /$ |
| 12 | Disallow: /* |
| 13 | Sitemap: https://andisearch.com/sitemap.txt |