The Trade Desk / robots.txt snapshot
← back to thetradedesk.com · fetched 2026-08-04T18:49:16Z (5h ago) · HTTP 200 · 140 bytes · sha256 cabf3c53d65209d6 · raw
final URL: https://www.thetradedesk.com/robots.txt
| 1 | sitemap: https://www.thetradedesk.cn/sitemap.xml |
| 2 | User-agent: * |
| 3 | Disallow: /cpresources/ |
| 4 | Disallow: /vendor/ |
| 5 | Disallow: /cache/ |
| 6 | Disallow: /.env |