NeuralCrawl

ICICI Bank / robots.txt snapshot

← back to icicibank.com · fetched 2026-07-02T12:51:16Z (1mo ago) · HTTP 200 · 5719 bytes · sha256 8184d5fff3539c75 · raw

final URL: https://www.icici.bank.in/robots.txt

1Sitemap: https://www.icici.bank.in/sitemap-index.xml
2
3User-agent: *
4Disallow: /nri-banking/money_transfer/promo/mobile-app/appstore
5Disallow: /nri-banking/money_transfer/promo/mobile-app/playstore
6Disallow: /personal-banking/account-online/power-pay-account/
7
8Allow: /campaigns/bonanza/index
9Allow: /campaigns/TOB/
10
11Disallow: /lite/*
12Disallow: /ajax/*
13Disallow: /archive/*
14Disallow: /cars/*
15Disallow: /ms/*
16Disallow: *.pdf
17Disallow: /campaigns/
18Disallow: /mailer/
19Disallow: *.xls
20Disallow: *.doc
21Disallow: *.docx
22Disallow: *.jpg
23Disallow: /j.php
24
25User-agent: OmniExplorer_Bot
26Disallow: /
27
28User-agent: FreeFind
29Disallow: /
30
31User-agent: BecomeBot
32Disallow: /
33
34User-agent: Nutch
35Disallow: /
36
37User-agent: Jetbot/1.0
38Disallow: /
39
40User-agent: Jetbot
41Disallow: /
42
43User-agent: WebVac
44Disallow: /
45
46User-agent: Stanford
47Disallow: /
48
49User-agent: naver
50Disallow: /
51
52User-agent: dumbot
53Disallow: /
54
55User-agent: Hatena Antenna
56Disallow: /
57
58User-agent: grub-client
59Disallow: /
60
61User-agent: grub
62Disallow: /
63
64User-agent: WebZip
65Disallow: /
66
67User-agent: larbin
68Disallow: /
69
70User-agent: b2w/0.1
71Disallow: /
72
73User-agent: Copernic
74Disallow: /
75
76User-agent: psbot
77Disallow: /
78
79User-agent: Python-urllib
80Disallow: /
81
82User-agent: NetMechanic
83Disallow: /
84
85User-agent: URL_Spider_Pro
86Disallow: /
87
88User-agent: CherryPicker
89Disallow: /
90
91User-agent: EmailCollector
92Disallow: /
93
94User-agent: EmailSiphon
95Disallow: /
96
97User-agent: WebBandit
98Disallow: /
99
100User-agent: EmailWolf
101Disallow: /
102
103User-agent: ExtractorPro
104Disallow: /
105
106User-agent: CopyRightCheck
107Disallow: /
108
109User-agent: Crescent
110Disallow: /
111
112User-agent: SiteSnagger
113Disallow: /
114
115User-agent: ProWebWalker
116Disallow: /
117
118User-agent: CheeseBot
119Disallow: /
120
121User-agent: LNSpiderguy
122Disallow: /
123
124User-agent: Alexibot
125Disallow: /
126
127User-agent: Teleport
128Disallow: /
129
130User-agent: TeleportPro
131Disallow: /
132
133User-agent: Stanford Comp Sci
134Disallow: /
135
136User-agent: MIIxpc
137Disallow: /
138
139User-agent: Telesoft
140Disallow: /
141
142User-agent: Website Quester
143Disallow: /
144
145User-agent: moget/2.1
146Disallow: /
147
148User-agent: WebZip/4.0
149Disallow: /
150
151User-agent: WebStripper
152Disallow: /
153
154User-agent: WebSauger
155Disallow: /
156
157User-agent: WebCopier
158Disallow: /
159
160User-agent: NetAnts
161Disallow: /
162
163User-agent: Mister PiX
164Disallow: /
165
166User-agent: WebAuto
167Disallow: /
168
169User-agent: TheNomad
170Disallow: /
171
172User-agent: WWW-Collector-E
173Disallow: /
174
175User-agent: RMA
176Disallow: /
177
178User-agent: libWeb/clsHTTP
179Disallow: /
180
181User-agent: asterias
182Disallow: /
183
184User-agent: httplib
185Disallow: /
186
187User-agent: turingos
188Disallow: /
189
190User-agent: spanner
191Disallow: /
192
193User-agent: InfoNaviRobot
194Disallow: /
195
196User-agent: Harvest/1.5
197Disallow: /
198
199User-agent: Bullseye/1.0
200Disallow: /
201
202User-agent: Crescent Internet ToolPak HTTP OLE Control v.1.0
203Disallow: /
204
205User-agent: CherryPickerSE/1.0
206Disallow: /
207
208User-agent: CherryPickerElite/1.0
209Disallow: /
210
211User-agent: WebBandit/3.50
212Disallow: /
213
214User-agent: NICErsPRO
215Disallow: /
216
217User-agent: Microsoft URL Control - 5.01.4511
218Disallow: /
219
220User-agent: DittoSpyder
221Disallow: /
222
223User-agent: Foobot
224Disallow: /
225
226User-agent: SpankBot
227Disallow: /
228
229User-agent: BotALot
230Disallow: /
231
232User-agent: lwp-trivial/1.34
233Disallow: /
234
235User-agent: lwp-trivial
236Disallow: /
237
238User-agent: BunnySlippers
239Disallow: /
240
241User-agent: Microsoft URL Control - 6.00.8169
242Disallow: /
243
244User-agent: URLy Warning
245Disallow: /
246
247User-agent: Wget/1.6
248Disallow: /
249
250User-agent: Wget/1.5.3
251Disallow: /
252
253User-agent: Wget
254Disallow: /
255
256User-agent: LinkWalker
257Disallow: /
258
259User-agent: cosmos
260Disallow: /
261
262User-agent: moget
263Disallow: /
264
265User-agent: hloader
266Disallow: /
267
268User-agent: humanlinks
269Disallow: /
270
271User-agent: LinkextractorPro
272Disallow: /
273
274User-agent: Offline Explorer
275Disallow: /
276
277User-agent: Mata Hari
278Disallow: /
279
280User-agent: LexiBot
281Disallow: /
282
283User-agent: Web Image Collector
284Disallow: /
285
286User-agent: The Intraformant
287Disallow: /
288
289User-agent: True_Robot/1.0
290Disallow: /
291
292User-agent: True_Robot
293Disallow: /
294
295User-agent: BlowFish/1.0
296Disallow: /
297
298User-agent: JennyBot
299Disallow: /
300
301User-agent: MIIxpc/4.2
302Disallow: /
303
304User-agent: BuiltBotTough
305Disallow: /
306
307User-agent: ProPowerBot/2.14
308Disallow: /
309
310User-agent: BackDoorBot/1.0
311Disallow: /
312
313User-agent: toCrawl/UrlDispatcher
314Disallow: /
315
316User-agent: WebEnhancer
317Disallow: /
318
319User-agent: suzuran
320Disallow: /
321
322User-agent: VCI WebViewer VCI WebViewer Win32
323Disallow: /
324
325User-agent: VCI
326Disallow: /
327
328User-agent: Szukacz/1.4
329Disallow: /
330
331User-agent: QueryN Metasearch
332Disallow: /
333
334User-agent: Openfind data gathere
335Disallow: /
336
337User-agent: Openfind
338Disallow: /
339
340User-agent: Xenu's Link Sleuth 1.1c
341Disallow: /
342
343User-agent: Xenu's
344Disallow: /
345
346User-agent: Zeus
347Disallow: /
348
349User-agent: RepoMonkey Bait & Tackle/v1.01
350Disallow: /
351
352User-agent: RepoMonkey
353Disallow: /
354
355User-agent: Microsoft URL Control
356Disallow: /
357
358User-agent: Openbot
359Disallow: /
360
361User-agent: URL Control
362Disallow: /
363
364User-agent: Zeus Link Scout
365Disallow: /
366
367User-agent: Zeus 32297 Webster Pro V2.9 Win32
368Disallow: /
369
370User-agent: Webster Pro
371Disallow: /
372
373User-agent: EroCrawler
374Disallow: /
375
376User-agent: LinkScan/8.1a Unix
377Disallow: /
378
379User-agent: Keyword Density/0.9
380Disallow: /
381
382User-agent: Kenjin Spider
383Disallow: /
384
385User-agent: Iron33/1.0.2
386Disallow: /
387
388User-agent: Bookmark search tool
389Disallow: /
390
391User-agent: GetRight/4.2
392Disallow: /
393
394User-agent: FairAd Client
395Disallow: /
396
397User-agent: Gaisbot
398Disallow: /
399
400User-agent: Aqua_Products
401Disallow: /
402
403User-agent: Radiation Retriever 1.1
404Disallow: /
405
406User-agent: Flaming AttackBot
407Disallow: /
408
409User-agent: Oracle Ultra Search
410Disallow: /
411
412User-agent: MSIECrawler
413Disallow: /
414
415User-agent: PerMan
416Disallow: /
417
418User-agent: searchpreview
419Disallow: /
420
421User-agent: sootle
422Disallow: /
423
424User-agent: es
425Disallow: /
426
427User-agent: Enterprise_Search/1.0
428Disallow: /
429
430User-agent: Enterprise_Search
431Disallow: /