NeuralCrawl

AECOM / robots.txt snapshot

← back to aecom.com · fetched 2026-06-20T01:10:30Z (18h ago) · HTTP 200 · 298 bytes · sha256 53c452213545b10c · raw

final URL: https://aecom.com/robots.txt

1User-agent: *
2Disallow: /content/
3
4User-agent: dotbot
5User-agent: PetalBot
6User-agent: PowerMapper
7User-agent: RavenCrawler
8User-agent: rogerbot
9User-agent: SemrushBot
10User-agent: SemrushBot-SA
11User-agent: Swiftbot
12Disallow: /
13
14User-agent: *
15Disallow:
16
17Sitemap: https://aecom.com/sitemap_index.xml