NeuralCrawl

Pilot Company / robots.txt snapshot

← back to pilotcompany.com · fetched 2026-06-20T01:10:31Z (18h ago) · HTTP 200 · 231 bytes · sha256 38873c744e596f29 · raw

final URL: https://pilotcompany.com/robots.txt

1# Robots.txt for pilotcompany.com
2
3User-agent: *
4Allow: /
5
6# Sitemap location
7Sitemap: https://pilotcompany.com/sitemap.xml
8
9# Block admin/internal areas (if any)
10Disallow: /admin/
11Disallow: /api/
12Disallow: /_app/
13Disallow: /test/