The Trade Desk / robots.txt snapshot
← back to thetradedesk.com · fetched 2026-06-20T01:10:31Z (15h ago) · HTTP 200 · 145 bytes · sha256 1f14383e6ac1d285 · raw
final URL: https://www.thetradedesk.com/robots.txt
| 1 | sitemap: https://careers.thetradedesk.com/sitemap.xml |
| 2 | User-agent: * |
| 3 | Disallow: /cpresources/ |
| 4 | Disallow: /vendor/ |
| 5 | Disallow: /cache/ |
| 6 | Disallow: /.env |