The Trade Desk / robots.txt snapshot
← back to thetradedesk.com · fetched 2026-06-23T15:50:08Z (1mo ago) · HTTP 200 · 141 bytes · sha256 600eecdad533ebd2 · raw
final URL: https://www.thetradedesk.com/robots.txt
| 1 | sitemap: https://www.thetradedesk.com/sitemap.xml |
| 2 | User-agent: * |
| 3 | Disallow: /cpresources/ |
| 4 | Disallow: /vendor/ |
| 5 | Disallow: /cache/ |
| 6 | Disallow: /.env |