NeuralCrawl

Juniper Networks / robots.txt

← back to juniper.net · change detected 7d ago (2026-10-31T00:05:41Z) · modified +2 −314

What changed

Diff old (2026-06-25T10:29:46Z) → new (2026-10-31T00:05:41Z)

@@ -1,314 +1,2 @@
1- #For any updates or problems - please contact seo<at>juniper<dot>net
2-
3- # The use of robots or other automated means to access the Juniper site
4- # without the express permission of Juniper is strictly prohibited.
5- # Notwithstanding the foregoing, Juniper may permit automated access to
6- # access certain Juniper pages but solely for the limited purpose of
7- # including content in publicly available search engines. Any other
8- # use of robots or failure to obey the robots exclusion standards set
9- # forth at http://www.robotstxt.org/ is strictly prohibited.
10-
11- User-Agent: *
12-
13- Disallow: /br/pt/cm.html
14- Disallow: /br/pt/cm/
15- Disallow: /cn/zh/cm.html
16- Disallow: /cn/zh/cm/
17- Disallow: /content/dam/www/assets/partners/us/en/mississippi/
18- Disallow: /content/dam/www/assets/partners/us/en/state-and-local-price-list/
19- Disallow: /de/de/cm.html
20- Disallow: /de/de/cm/
21- Disallow: /es/es/cm.html
22- Disallow: /es/es/cm/
23- Disallow: /fr/fr/cm.html
24- Disallow: /fr/fr/cm/
25- Disallow: /gb/en/cm.html
26- Disallow: /gb/en/cm/
27- Disallow: /help/english/5.1.0/
28- Disallow: /help/english/5.2.0/
29- Disallow: /help/english/5.3.0/
30- Disallow: /help/english/5.4.0/
31- Disallow: /help/english/6.0.0/
32- Disallow: /help/english/6.1.0/
33- Disallow: /help/english/6.2.0/
34- Disallow: /help/english/6.3.0/
35- Disallow: /il/en/cm.html
36- Disallow: /il/en/cm/
37- Disallow: /it/it/cm.html
38- Disallow: /it/it/cm/
39- Disallow: /jp/ja/cm.html
40- Disallow: /jp/ja/cm/
41- Disallow: /kr/ko/cm.html
42- Disallow: /kr/ko/cm/
43- Disallow: /mx/es/cm.html
44- Disallow: /mx/es/cm/
45- Disallow: /nl/nl/cm.html
46- Disallow: /nl/nl/cm/
47- Disallow: /ru/ru/cm.html
48- Disallow: /ru/ru/cm/
49- Disallow: /techpubs/
50- Disallow: /us/en/cm.html
51- Disallow: /us/en/cm/
52- Disallow: /us/en/company/events/summit-2009/
53- Disallow: /us/en/company/events/summit-2009/
54- Disallow: /us/en/demo-pages.html
55- Disallow: /us/en/demo-pages/
56- Disallow: /us/en/forms/technology-alliances-partner-program/
57- Disallow: /us/en/forms/technology-alliances-partner-program/index.html
58- Disallow: /us/en/hold-folder.html
59- Disallow: /us/en/hold-folder/
60- Disallow: /us/en/partners/dm-channel/
61- Disallow: /us/en/partners/florida-state-pricing/
62- Disallow: /us/en/partners/georgia-state-pricing/
63- Disallow: /us/en/partners/jpartner-assistance/
64- Disallow: /us/en/partners/minnesota-state-pricing/
65- Disallow: /us/en/partners/mississippi.html
66- Disallow: /us/en/partners/mississippi/juniper-pricelist-mississippi.pdf
67- Disallow: /us/en/partners/mississippi/juniper-pricelist-mississippi-2017.pdf
68- Disallow: /us/en/partners/mississippi/juniper-pricelist-mississippi-march-2017.pdf
69- Disallow: /us/en/partners/ny-state-pricing/
70- Disallow: /us/en/partners/oklahoma-state-pricing/
71- Disallow: /us/en/partners/pricing/
72- Disallow: /us/en/partners/texas-state-pricing/
73- Disallow: /us/en/partners/utah-state-pricing/
74- Disallow: /us/en/remove-delete-folder.html
75- Disallow: /us/en/remove-delete-folder/
76- Disallow: /documentation/a071.html
77- Disallow: /documentation/cloud-software
78- Disallow: /documentation/en_US/ais
79- Disallow: /documentation/en_US/appformix/
80- Disallow: /documentation/en_US/apstra-fabric-conductor/
81- Disallow: /documentation/en_US/automation/
82- Disallow: /documentation/en_US/bti-pronx7.0/
83- Disallow: /documentation/en_US/bti-psm7.0/
84- Disallow: /documentation/en_US/bti-series/
85- Disallow: /documentation/en_US/bxos
86- Disallow: /documentation/en_US/cloud-software-trial/
87- Disallow: /documentation/en_US/collections/next-generation-data-center/
88- Disallow: /documentation/en_US/communications
89- Disallow: /documentation/en_US/communications/
90- Disallow: /documentation/en_US/contrail/
91- Disallow: /documentation/en_US/contrail19/
92- Disallow: /documentation/en_US/contrail2.0/
93- Disallow: /documentation/en_US/contrail2.1/
94- Disallow: /documentation/en_US/contrail2.2/
95- Disallow: /documentation/en_US/contrail2.21/
96- Disallow: /documentation/en_US/contrail2.22/
97- Disallow: /documentation/en_US/contrail20/
98- Disallow: /documentation/en_US/contrail21/information-products/topic-collections/release-notes/
99- Disallow: /documentation/en_US/contrail21/topics/
100- Disallow: /documentation/en_US/contrail3
101- Disallow: /documentation/en_US/contrail4
102- Disallow: /documentation/en_US/contrail5
103- Disallow: /documentation/en_US/contrail-cloud10.0/
104- Disallow: /documentation/en_US/contrail-insights/
105- Disallow: /documentation/en_US/corero-smartwall
106- Disallow: /documentation/en_US/crpd/
107- Disallow: /documentation/en_US/cse-series
108- Disallow: /documentation/en_US/cso
109- Disallow: /documentation/en_US/csrx
110- Disallow: /documentation/en_US/ctp5
111- Disallow: /documentation/en_US/ctp6
112- Disallow: /documentation/en_US/ctp7
113- Disallow: /documentation/en_US/ddos
114- Disallow: /documentation/en_US/design-and-architecture/
115- Disallow: /documentation/en_US/doceng-qa2015.1/
116- Disallow: /documentation/en_US/dxos
117- Disallow: /documentation/en_US/firefly
118- Disallow: /documentation/en_US/hardware/ja2500/
119- Disallow: /documentation/en_US/healthbot/
120- Disallow: /documentation/en_US/help/
121- Disallow: /documentation/en_US/idp
122- Disallow: /documentation/en_US/ims-aaa/
123- Disallow: /documentation/en_US/infographics/
124- Disallow: /documentation/en_US/internal/
125- Disallow: /documentation/en_US/ip-mplsview6.2.1/
126- Disallow: /documentation/en_US/ip-poolbot/
127- Disallow: /documentation/en_US/jdpi-decoder/
128- Disallow: /documentation/en_US/jet
129- Disallow: /documentation/en_US/jims/information-products/topic-collections/feature-guide/jims-guide/
130- Disallow: /documentation/en_US/jims/topics/task/configuration/
131- Disallow: /documentation/en_US/jnu
132- Disallow: /documentation/en_US/jsa2
133- Disallow: /documentation/en_US/jsa3
134- Disallow: /documentation/en_US/jsa4
135- Disallow: /documentation/en_US/junipersecureconnect/information-products/topic-collections/release-notes/21.2.2.0/
136- Disallow: /documentation/en_US/junipersecureconnect/information-products/topic-collections/release-notes/index.html
137- Disallow: /documentation/en_US/junipersecureconnect/information-products/topic-collections/release-notes/jd0e
138- Disallow: /documentation/en_US/junipersecureconnect/information-products/topic-collections/release-notes/juniper-secure-connect-application-release-notes.pdf
139- Disallow: /documentation/en_US/junipersecureconnect/information-products/topic-collections/release-notes/new-changed-features.html
140- Disallow: /documentation/en_US/junipersecureconnect/information-products/topic-collections/release-notes/request-support.html
141- Disallow: /documentation/en_US/junipersecureconnect/topics/
142- Disallow: /documentation/en_US/junos/
143- Disallow: /documentation/en_US/junos1
144- Disallow: /documentation/en_US/junos2
145- Disallow: /documentation/en_US/junos8
146- Disallow: /documentation/en_US/junos9
147- Disallow: /documentation/en_US/junos-cc
148- Disallow: /documentation/en_US/junos-chef
149- Disallow: /documentation/en_US/junos-ddos/
150- Disallow: /documentation/en_US/junose
151- Disallow: /documentation/en_US/junos-ex/
152- Disallow: /documentation/en_US/junos-fips
153- Disallow: /documentation/en_US/junos-mobility
154- Disallow: /documentation/en_US/junos-pulse
155- Disallow: /documentation/en_US/junos-scope
156- Disallow: /documentation/en_US/junos-sdk
157- Disallow: /documentation/en_US/junos-snapshot1.0/topics/
158- Disallow: /documentation/en_US/junos-space/
159- Disallow: /documentation/en_US/junos-space1
160- Disallow: /documentation/en_US/junos-space2.0/
161- Disallow: /documentation/en_US/junos-space20.1
162- Disallow: /documentation/en_US/junos-space21.1/
163- Disallow: /documentation/en_US/junos-space21.2
164- Disallow: /documentation/en_US/junos-space21.3/information-products/
165- Disallow: /documentation/en_US/junos-space21.3/information-products/topic-collections/release-notes/
166- Disallow: /documentation/en_US/junos-space21.3/topics/
167- Disallow: /documentation/en_US/junos-space22.1/information-products/
168- Disallow: /documentation/en_US/junos-space22.1/topics/
169- Disallow: /documentation/en_US/junos-space22.2/information-products/
170- Disallow: /documentation/en_US/junos-space22.2/topics/
171- Disallow: /documentation/en_US/junos-space22.3/information-products/
172- Disallow: /documentation/en_US/junos-space22.3/topics/
173- Disallow: /documentation/en_US/junos-space23.1/information-products/
174- Disallow: /documentation/en_US/junos-space23.1/topics/
175- Disallow: /documentation/en_US/junos-space-apps/ccpe
176- Disallow: /documentation/en_US/junos-space-apps/connectivity-services-director1.0/
177- Disallow: /documentation/en_US/junos-space-apps/network-director
178- Disallow: /documentation/en_US/junos-space-apps1
179- Disallow: /documentation/en_US/junos-space-logging-reporting/
180- Disallow: /documentation/en_US/junos-space-sdk/
181- Disallow: /documentation/en_US/junos-srx/
182- Disallow: /documentation/en_US/junosv-app-engine13.2/
183- Disallow: /documentation/en_US/jweb/
184- Disallow: /documentation/en_US/jweb20.2/
185- Disallow: /documentation/en_US/jweb20.3/
186- Disallow: /documentation/en_US/jweb21.1/
187- Disallow: /documentation/en_US/jweb21.4/
188- Disallow: /documentation/en_US/jwos
189- Disallow: /documentation/en_US/jwos6.2/
190- Disallow: /documentation/en_US/learn-about/
191- Disallow: /documentation/en_US/ln1000
192- Disallow: /documentation/en_US/magmagnull/
193- Disallow: /documentation/en_US/magnull/
194- Disallow: /documentation/en_US/media-flow
195- Disallow: /documentation/en_US/mobile-content11.4/
196- Disallow: /documentation/en_US/netscreen-remote
197- Disallow: /documentation/en_US/network-director
198- Disallow: /documentation/en_US/nfv
199- Disallow: /documentation/en_US/northstar
200- Disallow: /documentation/en_US/nsm
201- Disallow: /documentation/en_US/nsmTest/
202- Disallow: /documentation/en_US/nso1.0/
203- Disallow: /documentation/en_US/oac
204- Disallow: /documentation/en_US/paragon-automation21.1/
205- Disallow: /documentation/en_US/profiler/
206- Disallow: /documentation/en_US/pronx-optical-director/help/
207- Disallow: /documentation/en_US/release-independent/aaa-802/
208- Disallow: /documentation/en_US/release-independent/automation/
209- Disallow: /documentation/en_US/release-independent/bti/
210- Disallow: /documentation/en_US/release-independent/bxos/
211- Disallow: /documentation/en_US/release-independent/contrail
212- Disallow: /documentation/en_US/release-independent/cse-series/
213- Disallow: /documentation/en_US/release-independent/ctp/information-products/pathway-pages/ctp150-hardware.pdf
214- Disallow: /documentation/en_US/release-independent/ctp/information-products/topic-collections/access.html
215- Disallow: /documentation/en_US/release-independent/ctp/information-products/topic-collections/book-ctp1000
216- Disallow: /documentation/en_US/release-independent/ctp/information-products/topic-collections/book-ctp2000
217- Disallow: /documentation/en_US/release-independent/ctp/information-products/topic-collections/ctp1000-hardware/
218- Disallow: /documentation/en_US/release-independent/ctp/information-products/topic-collections/ctp1000-quick-start.pdf
219- Disallow: /documentation/en_US/release-independent/ctp/information-products/topic-collections/ctp150
220- Disallow: /documentation/en_US/release-independent/ctp/information-products/topic-collections/ctp151
221- Disallow: /documentation/en_US/release-independent/ctp/information-products/topic-collections/ctp2000-hardware/
222- Disallow: /documentation/en_US/release-independent/ctp/information-products/topic-collections/index.html
223- Disallow: /documentation/en_US/release-independent/ctp/information-products/topic-collections/jd0e
224- Disallow: /documentation/en_US/release-independent/ctp/information-products/topic-collections/safety-warnings.html
225- Disallow: /documentation/en_US/release-independent/ctp/topics/
226- Disallow: /documentation/en_US/release-independent/ddos/
227- Disallow: /documentation/en_US/release-independent/downloads/jsa/
228- Disallow: /documentation/en_US/release-independent/downloads/junos-rns/
229- Disallow: /documentation/en_US/release-independent/dxos/information-products/pathway-pages/hardware/eol.html
230- Disallow: /documentation/en_US/release-independent/firefly/
231- Disallow: /documentation/en_US/release-independent/glossary/
232- Disallow: /documentation/en_US/release-independent/ims-aaa/
233- Disallow: /documentation/en_US/release-independent/information-products/pathway-pages/hardware/SRX210/
234- Disallow: /documentation/en_US/release-independent/information-products/pathway-pages/hardware/SRX650/HW/index.html
235- Disallow: /documentation/en_US/release-independent/information-products/pathway-pages/jcs/
236- Disallow: /documentation/en_US/release-independent/information-products/pathway-pages/SRX240/
237- Disallow: /documentation/en_US/release-independent/information-products/topic-collections/hardware/mx-series/common/dpc-guide/
238- Disallow: /documentation/en_US/release-independent/information-products/topic-collections/hardware/vgw-series/
239- Disallow: /documentation/en_US/release-independent/jatp/
240- Disallow: /documentation/en_US/release-independent/jet/
241- Disallow: /documentation/en_US/release-independent/junos/
242- Disallow: /documentation/en_US/release-independent/junose/
243- Disallow: /documentation/en_US/release-independent/junos-pulse/information-products/pathway-pages/junos-pulse/index.html
244- Disallow: /documentation/en_US/release-independent/junos-scope/
245- Disallow: /documentation/en_US/release-independent/junos-sdk/
246- Disallow: /documentation/en_US/release-independent/junos-snapshot/
247- Disallow: /documentation/en_US/release-independent/junos-space/
248- Disallow: /documentation/en_US/release-independent/junos-space-apps/
249- Disallow: /documentation/en_US/release-independent/jweb/eol-index.html
250- Disallow: /documentation/en_US/release-independent/jwos/
251- Disallow: /documentation/en_US/release-independent/licenses/
252- Disallow: /documentation/en_US/release-independent/licensing/
253- Disallow: /documentation/en_US/release-independent/nce/
254- Disallow: /documentation/en_US/release-independent/netscreen-remote/
255- Disallow: /documentation/en_US/release-independent/network-director/information-products/pathway-pages/eol-index.html
256- Disallow: /documentation/en_US/release-independent/onboarding/
257- Disallow: /documentation/en_US/release-independent/policy-enforcer/
258- Disallow: /documentation/en_US/release-independent/service-automation/
259- Disallow: /documentation/en_US/release-independent/sky-atp/
260- Disallow: /documentation/en_US/release-independent/solutions/
261- Disallow: /documentation/en_US/release-independent/spotlight-secure/
262- Disallow: /documentation/en_US/release-independent/ssla/
263- Disallow: /documentation/en_US/release-independent/strm/
264- Disallow: /documentation/en_US/release-independent/topics/
265- Disallow: /documentation/en_US/release-independent/vxa-series/
266- Disallow: /documentation/en_US/release-independent/wireless/
267- Disallow: /documentation/en_US/sa
268- Disallow: /documentation/en_US/sbr
269- Disallow: /documentation/en_US/secintel/
270- Disallow: /documentation/en_US/sky-enterprise/
271- Disallow: /documentation/en_US/slipstream/sd/junos-space-security-director
272- Disallow: /documentation/en_US/src
273- Disallow: /documentation/en_US/strm
274- Disallow: /documentation/en_US/tech-center/
275- Disallow: /documentation/en_US/uac
276- Disallow: /documentation/en_US/vgw
277- Disallow: /documentation/en_US/vmx/
278- Disallow: /documentation/en_US/vrr
279- Disallow: /documentation/en_US/vsrx
280- Disallow: /documentation/en_US/wlan
281- Disallow: /documentation/en_US/wx
282- Disallow: /documentation/es/
283- Disallow: /documentation/glossary/
284- Disallow: /documentation/hardware
285- Disallow: /documentation/images
286- Disallow: /documentation/includes
287- Disallow: /documentation/ja/
288- Disallow: /documentation/netscreen-certifications.html
289- Disallow: /documentation/partners
290- Disallow: /documentation/product/en_US/cse2000
291- Disallow: /documentation/public_sector/common-criteria.html
292- Disallow: /documentation/qrc/
293- Disallow: /documentation/resources/
294- Disallow: /documentation/software
295- Disallow: /documentation/test/
296- Disallow: /documentation/us/en/quick-start/juniper-get-started/juniper-get-started.pdf
297- Disallow: /documentation/us/en/quick-start/selvats
298- Disallow: /documentation/us/en/software/doceng-evo-qa/
299- Disallow: /documentation/us/en/software/junos/jet-proto/
300- Disallow: /documentation/us/en/software/junos/junos-feature-meta-test/
301- Disallow: /documentation/us/en/software/junos/vcf-best-practices-guide/
302- Disallow: /documentation/us/en/software/junos/virtual-chassis-fabric/
303- Disallow: /documentation/us/en/software/sky-atp/help/
304- Disallow: /documentation/zh_Hans/
305- Disallow: /techpubs/
306- Disallow: /us/en/search.html
307- Disallow: /us/en/search.html*?
308- Disallow: /documentation/rne/release-notes/
309- Disallow: /documentation/hpe/pace-ai-studio/
310-
311-
312- # XML Sitemaps
313- Sitemap: https://www.juniper.net/content/dam/www/utils/xml-sitemaps/sitemap.xml
314- Sitemap: https://www.juniper.net/documentation/sitemap/sitemap.xml
1+ User-agent: *
2+ Disallow: /