NeuralCrawl

ICICI Bank / robots.txt snapshot

← back to icicibank.com · fetched 2026-06-20T01:10:31Z (16h ago) · HTTP 200 · 5640 bytes · sha256 34dfb659ee6368a9 · raw

final URL: https://www.icici.bank.in/robots.txt

1Sitemap: https://www.icici.bank.in/sitemap-index.xml
2
3User-agent: *
4Disallow: /nri-banking/money_transfer/promo/mobile-app/appstore
5Disallow: /nri-banking/money_transfer/promo/mobile-app/playstore
6
7Allow: /campaigns/bonanza/index
8Allow: /campaigns/TOB/
9
10Disallow: /lite/*
11Disallow: /ajax/*
12Disallow: /archive/*
13Disallow: /cars/*
14Disallow: /ms/*
15Disallow: *.pdf
16Disallow: /campaigns/
17Disallow: /mailer/
18Disallow: *.xls
19Disallow: *.doc
20Disallow: *.docx
21Disallow: *.jpg
22
23User-agent: OmniExplorer_Bot
24Disallow: /
25
26User-agent: FreeFind
27Disallow: /
28
29User-agent: BecomeBot
30Disallow: /
31
32User-agent: Nutch
33Disallow: /
34
35User-agent: Jetbot/1.0
36Disallow: /
37
38User-agent: Jetbot
39Disallow: /
40
41User-agent: WebVac
42Disallow: /
43
44User-agent: Stanford
45Disallow: /
46
47User-agent: naver
48Disallow: /
49
50User-agent: dumbot
51Disallow: /
52
53User-agent: Hatena Antenna
54Disallow: /
55
56User-agent: grub-client
57Disallow: /
58
59User-agent: grub
60Disallow: /
61
62User-agent: WebZip
63Disallow: /
64
65User-agent: larbin
66Disallow: /
67
68User-agent: b2w/0.1
69Disallow: /
70
71User-agent: Copernic
72Disallow: /
73
74User-agent: psbot
75Disallow: /
76
77User-agent: Python-urllib
78Disallow: /
79
80User-agent: NetMechanic
81Disallow: /
82
83User-agent: URL_Spider_Pro
84Disallow: /
85
86User-agent: CherryPicker
87Disallow: /
88
89User-agent: EmailCollector
90Disallow: /
91
92User-agent: EmailSiphon
93Disallow: /
94
95User-agent: WebBandit
96Disallow: /
97
98User-agent: EmailWolf
99Disallow: /
100
101User-agent: ExtractorPro
102Disallow: /
103
104User-agent: CopyRightCheck
105Disallow: /
106
107User-agent: Crescent
108Disallow: /
109
110User-agent: SiteSnagger
111Disallow: /
112
113User-agent: ProWebWalker
114Disallow: /
115
116User-agent: CheeseBot
117Disallow: /
118
119User-agent: LNSpiderguy
120Disallow: /
121
122User-agent: Alexibot
123Disallow: /
124
125User-agent: Teleport
126Disallow: /
127
128User-agent: TeleportPro
129Disallow: /
130
131User-agent: Stanford Comp Sci
132Disallow: /
133
134User-agent: MIIxpc
135Disallow: /
136
137User-agent: Telesoft
138Disallow: /
139
140User-agent: Website Quester
141Disallow: /
142
143User-agent: moget/2.1
144Disallow: /
145
146User-agent: WebZip/4.0
147Disallow: /
148
149User-agent: WebStripper
150Disallow: /
151
152User-agent: WebSauger
153Disallow: /
154
155User-agent: WebCopier
156Disallow: /
157
158User-agent: NetAnts
159Disallow: /
160
161User-agent: Mister PiX
162Disallow: /
163
164User-agent: WebAuto
165Disallow: /
166
167User-agent: TheNomad
168Disallow: /
169
170User-agent: WWW-Collector-E
171Disallow: /
172
173User-agent: RMA
174Disallow: /
175
176User-agent: libWeb/clsHTTP
177Disallow: /
178
179User-agent: asterias
180Disallow: /
181
182User-agent: httplib
183Disallow: /
184
185User-agent: turingos
186Disallow: /
187
188User-agent: spanner
189Disallow: /
190
191User-agent: InfoNaviRobot
192Disallow: /
193
194User-agent: Harvest/1.5
195Disallow: /
196
197User-agent: Bullseye/1.0
198Disallow: /
199
200User-agent: Crescent Internet ToolPak HTTP OLE Control v.1.0
201Disallow: /
202
203User-agent: CherryPickerSE/1.0
204Disallow: /
205
206User-agent: CherryPickerElite/1.0
207Disallow: /
208
209User-agent: WebBandit/3.50
210Disallow: /
211
212User-agent: NICErsPRO
213Disallow: /
214
215User-agent: Microsoft URL Control - 5.01.4511
216Disallow: /
217
218User-agent: DittoSpyder
219Disallow: /
220
221User-agent: Foobot
222Disallow: /
223
224User-agent: SpankBot
225Disallow: /
226
227User-agent: BotALot
228Disallow: /
229
230User-agent: lwp-trivial/1.34
231Disallow: /
232
233User-agent: lwp-trivial
234Disallow: /
235
236User-agent: BunnySlippers
237Disallow: /
238
239User-agent: Microsoft URL Control - 6.00.8169
240Disallow: /
241
242User-agent: URLy Warning
243Disallow: /
244
245User-agent: Wget/1.6
246Disallow: /
247
248User-agent: Wget/1.5.3
249Disallow: /
250
251User-agent: Wget
252Disallow: /
253
254User-agent: LinkWalker
255Disallow: /
256
257User-agent: cosmos
258Disallow: /
259
260User-agent: moget
261Disallow: /
262
263User-agent: hloader
264Disallow: /
265
266User-agent: humanlinks
267Disallow: /
268
269User-agent: LinkextractorPro
270Disallow: /
271
272User-agent: Offline Explorer
273Disallow: /
274
275User-agent: Mata Hari
276Disallow: /
277
278User-agent: LexiBot
279Disallow: /
280
281User-agent: Web Image Collector
282Disallow: /
283
284User-agent: The Intraformant
285Disallow: /
286
287User-agent: True_Robot/1.0
288Disallow: /
289
290User-agent: True_Robot
291Disallow: /
292
293User-agent: BlowFish/1.0
294Disallow: /
295
296User-agent: JennyBot
297Disallow: /
298
299User-agent: MIIxpc/4.2
300Disallow: /
301
302User-agent: BuiltBotTough
303Disallow: /
304
305User-agent: ProPowerBot/2.14
306Disallow: /
307
308User-agent: BackDoorBot/1.0
309Disallow: /
310
311User-agent: toCrawl/UrlDispatcher
312Disallow: /
313
314User-agent: WebEnhancer
315Disallow: /
316
317User-agent: suzuran
318Disallow: /
319
320User-agent: VCI WebViewer VCI WebViewer Win32
321Disallow: /
322
323User-agent: VCI
324Disallow: /
325
326User-agent: Szukacz/1.4
327Disallow: /
328
329User-agent: QueryN Metasearch
330Disallow: /
331
332User-agent: Openfind data gathere
333Disallow: /
334
335User-agent: Openfind
336Disallow: /
337
338User-agent: Xenu's Link Sleuth 1.1c
339Disallow: /
340
341User-agent: Xenu's
342Disallow: /
343
344User-agent: Zeus
345Disallow: /
346
347User-agent: RepoMonkey Bait & Tackle/v1.01
348Disallow: /
349
350User-agent: RepoMonkey
351Disallow: /
352
353User-agent: Microsoft URL Control
354Disallow: /
355
356User-agent: Openbot
357Disallow: /
358
359User-agent: URL Control
360Disallow: /
361
362User-agent: Zeus Link Scout
363Disallow: /
364
365User-agent: Zeus 32297 Webster Pro V2.9 Win32
366Disallow: /
367
368User-agent: Webster Pro
369Disallow: /
370
371User-agent: EroCrawler
372Disallow: /
373
374User-agent: LinkScan/8.1a Unix
375Disallow: /
376
377User-agent: Keyword Density/0.9
378Disallow: /
379
380User-agent: Kenjin Spider
381Disallow: /
382
383User-agent: Iron33/1.0.2
384Disallow: /
385
386User-agent: Bookmark search tool
387Disallow: /
388
389User-agent: GetRight/4.2
390Disallow: /
391
392User-agent: FairAd Client
393Disallow: /
394
395User-agent: Gaisbot
396Disallow: /
397
398User-agent: Aqua_Products
399Disallow: /
400
401User-agent: Radiation Retriever 1.1
402Disallow: /
403
404User-agent: Flaming AttackBot
405Disallow: /
406
407User-agent: Oracle Ultra Search
408Disallow: /
409
410User-agent: MSIECrawler
411Disallow: /
412
413User-agent: PerMan
414Disallow: /
415
416User-agent: searchpreview
417Disallow: /
418
419User-agent: sootle
420Disallow: /
421
422User-agent: es
423Disallow: /
424
425User-agent: Enterprise_Search/1.0
426Disallow: /
427
428User-agent: Enterprise_Search
429Disallow: /