NeuralCrawl

Cadence Design Systems / robots.txt snapshot

← back to cadence.com · fetched 2026-06-23T12:18:50Z (1mo ago) · HTTP 200 · 4736 bytes · sha256 851b03c6743cd009 · raw

final URL: manual:file

1#Allow AI search and agent use
2User-agent: OAI-SearchBot Allow: /
3User-agent: ChatGPT-User Allow: /
4User-agent: PerplexityBot Allow: /
5User-agent: FirecrawlAgent Allow: /
6User-agent: AndiBot Allow: /
7User-agent: PhindBot Allow: /
8User-agent: YouBot Allow: /
9
10#Disallow AI training data collection
11User-agent: GPTBot Disallow: /
12User-agent: CCBot Disallow: /
13User-agent: Google-Extend Disallow: /
14
15User-agent: Google-CloudVertexBot
16Disallow: /content/dam/cadence-www/global/en_US/videos/resources/on-demand-webinars/*
17Disallow: /content/cadence-www/global/en_US/home/for-testing-only/*
18Disallow: /en_US/home/for-testing-only/*
19Disallow: /content/cadence-www/global/en_US/home/multimedia.html/content/dam/cadence-www/global/en_US/videos/resources/on-demand-webinars/*
20Disallow: /en_US/home/multimedia.html/content/dam/cadence-www/global/en_US/videos/resources/on-demand-webinars/*
21
22User-agent: MS Search 6.0 Robot
23Disallow: /content/dam/cadence-www/global/en_US/videos/resources/on-demand-webinars/*
24Disallow: /content/cadence-www/global/en_US/home/multimedia.html/content/dam/cadence-www/global/en_US/videos/resources/on-demand-webinars/*
25Disallow: /en_US/home/multimedia.html/content/dam/cadence-www/global/en_US/videos/resources/on-demand-webinars/*
26Disallow: /content/cadence-www/global/en_US/home/for-testing-only/*
27Disallow: /en_US/home/for-testing-only/*
28
29User-agent: Googlebot
30User-agent: Googlebot-Image
31User-agent: Googlebot-Video
32User-agent: adsbot-google
33User-agent: Baiduspider
34User-agent: bingbot
35User-agent: msnbot
36User-agent: msnbot-media
37User-agent: slurp
38User-agent: DuckDuckBot
39User-agent: YandexBot
40User-agent: YandexMobileBot
41User-agent: Naverbot
42User-agent: Screaming Frog SEO Spider
43User-agent: AhrefsBot
44User-agent: AhrefsSiteAudit
45User-agent: SemrushBot
46User-agent: SiteAuditBot
47User-agent: SemrushBot-BA
48User-agent: SemrushBot-SI
49User-agent: SemrushBot-SWA
50User-agent: SemrushBot-CT
51User-agent: SplitSignalBot
52User-agent: SemrushBot-COUB
53Disallow: /content/cadence-www/global/en_US/home/search.html
54Disallow: /content/cadence-www/global/en_US/home/resource-library.html
55Disallow: /content/cadence-www/global/en_US/home/company/newsroom/press-releases.html
56Disallow: /content/cadence-www/global/zh_CN/home/search.html
57Disallow: /content/cadence-www/global/zh_CN/home/resource-library.html
58Disallow: /content/cadence-www/global/zh_CN/home/company/newsroom/press-releases.html
59Disallow: /content/cadence-www/global/zh_TW/home/search.html
60Disallow: /content/cadence-www/global/zh_TW/home/resource-library.html
61Disallow: /content/cadence-www/global/zh_TW/home/company/newsroom/press-releases.html
62Disallow: /content/cadence-www/global/ko_KR/home/search.html
63Disallow: /content/cadence-www/global/ko_KR/home/resource-library.html
64Disallow: /content/cadence-www/global/ko_KR/home/company/newsroom/press-releases.html
65Disallow: /content/cadence-www/global/ja_JP/home/search.html
66Disallow: /content/cadence-www/global/ja_JP/home/resource-library.html
67Disallow: /content/cadence-www/global/ja_JP/home/company/newsroom/press-releases.html
68Disallow: /autodiscover/autodiscover.xml
69Disallow: /en_US/home/search.html
70Disallow: /en_US/home/resource-library.html
71Disallow: /en_US/home/company/newsroom/press-releases.html
72Disallow: /zh_CN/home/search.html
73Disallow: /zh_CN/home/resource-library.html
74Disallow: /zh_CN/home/company/newsroom/press-releases.html
75Disallow: /zh_TW/home/search.html
76Disallow: /zh_TW/home/resource-library.html
77Disallow: /zh_TW/home/company/newsroom/press-releases.html
78Disallow: /ko_KR/home/search.html
79Disallow: /ko_KR/home/resource-library.html
80Disallow: /ko_KR/home/company/newsroom/press-releases.html
81Disallow: /ja_JP/home/search.html
82Disallow: /ja_JP/home/resource-library.html
83Disallow: /ja_JP/home/company/newsroom/press-releases.html
84Disallow: /content/dam/cadence-www/global/en_US/documents/company/Legal/Terms-and-Conditions/*
85Disallow: /content/dam/cadence-www/global/en_US/documents/terms-and-conditions/*
86Disallow: /content/dam/cadence-www/global/ja_JP/documents/terms-and-conditions/*
87Disallow: /doc/*
88Disallow: /content/dam/cadence-www/global/en_US/videos/resources/on-demand-webinars/*
89Disallow: /content/cadence-www/global/en_US/home/for-testing-only/*
90Disallow: /en_US/home/for-testing-only/*
91Disallow: /content/cadence-www/global/en_US/home/multimedia.html/content/dam/cadence-www/global/en_US/videos/resources/on-demand-webinars/*
92Disallow: /en_US/home/multimedia.html/content/dam/cadence-www/global/en_US/videos/resources/on-demand-webinars/*
93Disallow: /content/cadence-www/global/en_US/home/company/newsroom/news-stories/*
94Disallow: /en_US/home/company/newsroom/news-stories/*
95
96
97#sitemap files
98Sitemap: https://www.cadence.com/2020-sitemap-index.xml
99
100User-agent: *
101Disallow: /