NeuralCrawl

Qonto / robots.txt snapshot

← back to qonto.com · fetched 2026-06-20T01:10:30Z (18h ago) · HTTP 200 · 15180 bytes · sha256 56d66bf5ab17208e · raw

final URL: https://qonto.com/robots.txt

1# robots.txt qonto.com v1.4.20230921 - Energize your Web Crawlers
2
3## Website Section
4Sitemap: https://qonto.com/sitemap.xml.gz
5
6## Blog Section
7Sitemap: https://qonto.com/sitemap-blog.xml.gz
8
9## Galaxy Section
10Sitemap: https://qonto.com/accountant/sitemaps/sitemap.xml.gz
11
12## Swift-codes Section
13Sitemap: https://qonto.com/sitemap-swift-codes.xml.gz
14
15## IBAN Section
16Sitemap: https://qonto.com/sitemap-iban.xml.gz
17
18# Block Assets & Tests
19User-agent: *
20Disallow: /*.pdf$
21Disallow: /revamp/*
22Disallow: /*/ab-test-sales
23
24# Block new locales Swift-Codes pages
25Disallow: /de-at/swift-codes/*
26Disallow: /nl-be/swift-codes/*
27Disallow: /fr-be/swift-codes/*
28Disallow: /en-de/swift-codes/*
29Disallow: /en-pt/swift-codes/*
30Disallow: /en-nl/swift-codes/*
31Disallow: /en-be/swift-codes/*
32Disallow: /en-at/swift-codes/*
33# Block old locales Swift-Codes pages
34Disallow: /be-nl/swift-codes/*
35Disallow: /be-fr/swift-codes/*
36Disallow: /at/swift-codes/*
37
38# Block Search
39Disallow: */accountants-partners?name=*
40Disallow: */blog/search*
41Disallow: */integrations_list?*
42
43# Block Spam Bots
44User-agent: AITCSRobot/1.1
45User-agent: Alexibot
46User-agent: Amazonbot
47User-agent: Aqua_Products
48User-agent: Arachnophilia
49User-agent: ASpider/0.09
50User-agent: asterias
51User-agent: AURESYS/1.0
52User-agent: b2w/0.1
53User-agent: BackDoorBot
54User-agent: BackDoorBot/1.0
55User-agent: BackRub/.
56User-agent: Baiduspider-video
57User-agent: Big Brother
58User-agent: Bizbot003
59User-agent: BizBot04 kirk.overleaf.com
60User-agent: Black Hole
61User-agent: Black.Hole
62User-agent: BlackWidow
63User-agent: BLEXBot
64User-agent: BlowFish
65User-agent: BlowFish/1.0
66User-agent: Bookmark search tool
67User-agent: Bot mailto:[email protected]
68User-agent: BotALot
69User-agent: BotRightHere
70User-agent: BSpider/1.0 libwww-perl/0.40
71User-agent: BuiltBotTough
72User-agent: Bullseye
73User-agent: Bullseye/1.0
74User-agent: BunnySlippers
75User-agent: CACTVS Chemistry Spider
76User-agent: Cegbfeieh
77User-agent: ChangeDetection
78User-agent: Checkbot/x.xx LWP/5.x
79User-agent: CheeseBot
80User-agent: CherryPicker
81User-agent: CherryPickerElite/1.0
82User-agent: CherryPickerSE/1.0
83User-agent: ChinaClaw
84User-agent: combine/0.0
85User-agent: conceptbot/0.3
86User-agent: Copernic
87User-agent: CopyRightCheck
88User-agent: cosmos
89User-agent: Crescent
90User-agent: Crescent Internet ToolPak HTTP OLE Control v.1.0
91User-agent: Custo
92User-agent: CyberPatrol SiteCat Webbot
93User-agent: CyberSpyder/2.1
94User-agent: Daumoa
95User-agent: Deweb/1.01
96User-agent: DISCo
97User-agent: DISCo Pump 3.0
98User-agent: DISCo Pump 3.2
99User-agent: DISCoFinder
100User-agent: DittoSpyder
101User-agent: Download Demon
102User-agent: Download Demon/3.2.0.8
103User-agent: Download Demon/3.5.0.11
104User-agent: dumbot
105User-agent: eCatch
106User-agent: eCatch/3.0
107User-agent: EirGrabber
108User-agent: EmailCollector
109User-agent: EmailSiphon
110User-agent: EmailWolf
111User-agent: EnigmaBot
112User-agent: EroCrawler
113User-agent: es
114User-agent: explorersearch
115User-agent: Express WebPictures
116User-agent: Express WebPictures (www.express-soft.com)
117User-agent: ExtractorPro
118User-agent: EyeNetIE
119User-agent: FairAd Client
120User-agent: FelixIDE/1.0
121User-agent: fido/0.9 Harvest/1.4.pl2
122User-agent: Fish-Search-Robot
123User-agent: Flaming AttackBot
124User-agent: FlashGet
125User-agent: FlashGet WebWasher 3.2
126User-agent: Foobot
127User-agent: Freecrawl
128User-agent: FrontPage
129User-agent: FrontPage [NC,OR]
130User-agent: Gaisbot
131User-agent: gcreep/1.0
132User-agent: GetRight
133User-agent: GetRight/2.11
134User-agent: GetRight/3.1
135User-agent: GetRight/3.2
136User-agent: GetRight/3.3
137User-agent: GetRight/3.3.3
138User-agent: GetRight/3.3.4
139User-agent: GetRight/4.0.0
140User-agent: GetRight/4.1.0
141User-agent: GetRight/4.1.1
142User-agent: GetRight/4.1.2
143User-agent: GetRight/4.2
144User-agent: GetRight/4.2b (Portuguxeas)
145User-agent: GetRight/4.2c
146User-agent: GetRight/4.3
147User-agent: GetRight/4.5
148User-agent: GetRight/4.5a
149User-agent: GetRight/4.5b
150User-agent: GetRight/4.5b1
151User-agent: GetRight/4.5b2
152User-agent: GetRight/4.5b3
153User-agent: GetRight/4.5b6
154User-agent: GetRight/4.5b7
155User-agent: GetRight/4.5c
156User-agent: GetRight/4.5d
157User-agent: GetRight/4.5e
158User-agent: GetRight/5.0beta1
159User-agent: GetRight/5.0beta2
160User-agent: GetURL.rexx v1.05
161User-agent: GetWeb!
162User-agent: Go!Zilla
163User-agent: Go!Zilla (www.gozilla.com)
164User-agent: Go!Zilla 3.3 (www.gozilla.com)
165User-agent: Go!Zilla 3.5 (www.gozilla.com)
166User-agent: Go-Ahead-Got-It
167User-agent: Golem/1.1
168User-agent: GrabNet
169User-agent: Grafula
170User-agent: Gromit/1.0
171User-agent: grub
172User-agent: HappyFunBot
173User-agent: Harvest
174User-agent: Harvest/1.5
175User-agent: Hatena Antenna
176User-agent: Hazel's Ferret Web hopper
177User-agent: hloader
178User-agent: HMView
179User-agent: httplib
180User-agent: HTTrack
181User-agent: HTTrack 3.0
182User-agent: HTTrack [NC,OR]
183User-agent: Huaweisymantecspider
184User-agent: humanlinks
185User-agent: H‰m‰h‰kki/0.2
186User-agent: Image Stripper
187User-agent: Image Sucker
188User-agent: inagist.com url crawler
189User-agent: IncyWincy/1.0b1
190User-agent: Indy Library
191User-agent: Indy Library [NC,OR]
192User-agent: InfoNaviRobot
193User-agent: Informant
194User-agent: INGRID/0.1
195User-agent: InterGET
196User-agent: Internet Ninja
197User-agent: Internet Ninja 4.0
198User-agent: Internet Ninja 5.0
199User-agent: Internet Ninja 6.0
200User-agent: Iron33/1.0.2
201User-agent: IsraeliSearch/1.0
202User-agent: ITI Spider
203User-agent: JennyBot
204User-agent: JetCar
205User-agent: JOC Web Spider
206User-agent: JubiiRobot
207User-agent: jumpstation
208User-agent: Katipo/1.0
209User-agent: Kenjin Spider
210User-agent: Kenjin.Spider
211User-agent: Keyword Density/0.9
212User-agent: Keyword.Density
213User-agent: KIT-Fireball/2.0 libwww/5.0a
214User-agent: LabelGrab/1.1
215User-agent: larbin
216User-agent: larbin ([email protected])
217User-agent: larbin [email protected]
218User-agent: larbin_2.6.2 ([email protected])
219User-agent: larbin_2.6.2 ([email protected])
220User-agent: larbin_2.6.2 (listonATccDOTgatechDOTedu)
221User-agent: larbin_2.6.2 ([email protected])
222User-agent: larbin_2.6.2 [email protected]
223User-agent: larbin_2.6.2 [email protected]
224User-agent: larbin_2.6.2 [email protected]
225User-agent: larbin_2.6.2 listonATccDOTgatechDOTedu
226User-agent: larbin_2.6.2 [email protected]
227User-agent: LeechFTP
228User-agent: LexiBot
229User-agent: libWeb/clsHTTP
230User-agent: LinkextractorPro
231User-agent: linklooker
232User-agent: LinkScan/8.1a Unix
233User-agent: LinkScan/8.1a.Unix
234User-agent: LinkWalker
235User-agent: LNSpiderguy
236User-agent: lwp-trivial
237User-agent: lwp-trivial/1.34
238User-agent: Mass Downloader
239User-agent: Mass Downloader/2.2
240User-agent: Mata Hari
241User-agent: Mata.Hari
242User-agent: MediaFox/x.y
243User-agent: MerzScope
244User-agent: METAGOPHER
245User-agent: Microsoft URL Control
246User-agent: Microsoft URL Control - 5.01.4511
247User-agent: Microsoft URL Control - 6.00.8169
248User-agent: Microsoft.URL
249User-agent: MIDown tool
250User-agent: MIIxpc
251User-agent: MIIxpc/4.2
252User-agent: Mister PiX
253User-agent: Mister Pix II 2.01
254User-agent: Mister Pix II 2.02a
255User-agent: Mister PiX version.dll
256User-agent: Mister.PiX
257User-agent: moget
258User-agent: moget/2.1
259User-agent: MOMspider/1.00 libwww-perl/0.40
260User-agent: Motor/0.2
261User-agent: MSIECrawler
262User-agent: naver
263User-agent: Navroad
264User-agent: NearSite
265User-agent: NeoScioCrawler
266User-agent: Net Vampire
267User-agent: Net Vampire/3.0
268User-agent: NetAnts
269User-agent: NetAnts/1.10
270User-agent: NetAnts/1.23
271User-agent: NetAnts/1.24
272User-agent: NetAnts/1.25
273User-agent: NetCarta CyberPilot Pro
274User-agent: NetMechanic
275User-agent: NetScoop/1.0 libwww/5.0a
276User-agent: NetSpider
277User-agent: NetZIP
278User-agent: NetZip Downloader 1.0 Win32(Nov 12 1998)
279User-agent: NetZip-Downloader/1.0.62 (Win32; Dec 7 1998)
280User-agent: NetZippy+(http://www.innerprise.net/usp-spider.asp)
281User-agent: NHSEWalker/3.0
282User-agent: NICErsPRO
283User-agent: Nomad-V2.x
284User-agent: NPbot
285User-agent: Nutch
286User-agent: Occam/1.0
287User-agent: Octopus
288User-agent: Offline Explorer
289User-agent: Offline Explorer/1.2
290User-agent: Offline Explorer/1.4
291User-agent: Offline Explorer/1.6
292User-agent: Offline Explorer/1.7
293User-agent: Offline Explorer/1.9
294User-agent: Offline Explorer/2.0
295User-agent: Offline Explorer/2.1
296User-agent: Offline Explorer/2.3
297User-agent: Offline Explorer/2.4
298User-agent: Offline Explorer/2.5
299User-agent: Offline Navigator
300User-agent: Offline.Explorer
301User-agent: OGspider
302User-agent: Open Text Site Crawler V1.0
303User-agent: Openbot
304User-agent: Openfind
305User-agent: Openfind data gatherer
306User-agent: Oracle Ultra Search
307User-agent: PageGrabber
308User-agent: Papa Foto
309User-agent: pavuk
310User-agent: pcBrowser
311User-agent: PerMan
312User-agent: PGP-KA/1.2
313User-agent: ProPowerBot/2.14
314User-agent: ProWebWalker
315User-agent: psbot
316User-agent: Python-urllib
317User-agent: QueryN Metasearch
318User-agent: QueryN.Metasearch
319User-agent: R6_CommentReader
320User-agent: R6_FeedFetcher
321User-agent: Radiation Retriever 1.1
322User-agent: RealDownload
323User-agent: RealDownload/4.0.0.40
324User-agent: RealDownload/4.0.0.41
325User-agent: RealDownload/4.0.0.42
326User-agent: ReGet
327User-agent: RepoMonkey
328User-agent: RepoMonkey Bait & Tackle/v1.01
329User-agent: Resume Robot
330User-agent: RMA
331User-agent: Roverbot
332User-agent: SafetyNet Robot 0.1
333User-agent: searchpreview
334User-agent: Senrigan/xxxxxx
335User-agent: SiteSnagger
336User-agent: SlySearch
337User-agent: SmartDownload
338User-agent: SmartDownload/1.2.76 (Win32; Apr 1 1999)
339User-agent: SmartDownload/1.2.77 (Win32; Aug 17 1999)
340User-agent: SmartDownload/1.2.77 (Win32; Feb 1 2000)
341User-agent: SmartDownload/1.2.77 (Win32; Jun 19 2001)
342User-agent: Snooper/b97_01
343User-agent: Solbot/1.0 LWP/5.07
344User-agent: sootle
345User-agent: SpankBot
346User-agent: spanner
347User-agent: Spanner/1.0 (Linux 2.0.27 i586)
348User-agent: spyder3.microsys.com
349User-agent: Sqworm/2.9.85-BETA (beta_release; 20011115-775; i686-pc-linux
350User-agent: SuperBot
351User-agent: SuperBot/3.0 (Win32)
352User-agent: SuperBot/3.1 (Win32)
353User-agent: SuperHTTP
354User-agent: SuperHTTP/1.0
355User-agent: Surfbot
356User-agent: suzuran
357User-agent: Szukacz/1.4
358User-agent: tAkeOut
359User-agent: Teleport
360User-agent: Teleport Pro
361User-agent: Teleport Pro/1.29
362User-agent: Teleport Pro/1.29.1590
363User-agent: Teleport Pro/1.29.1634
364User-agent: Teleport Pro/1.29.1718
365User-agent: Teleport Pro/1.29.1820
366User-agent: Teleport Pro/1.29.1847
367User-agent: TeleportPro
368User-agent: Telesoft
369User-agent: The Intraformant
370User-agent: The.Intraformant
371User-agent: TheNomad
372User-agent: TightTwatBot
373User-agent: Titan
374User-agent: toCrawl/UrlDispatcher
375User-agent: True_Robot
376User-agent: True_Robot/1.0
377User-agent: turingos
378User-agent: TurnitinBot
379User-agent: UCSD-Crawler
380User-agent: UnisterBot
381User-agent: UnwindFetchor/1.0
382User-agent: URL Control
383User-agent: URLSpiderPro
384User-agent: urlck/1.2.3
385User-agent: URLy Warning
386User-agent: URLy.Warning
387User-agent: Valkyrie/1.0 libwww-perl/0.40
388User-agent: vBSEO
389User-agent: VCI
390User-agent: VCI WebViewer VCI WebViewer Win32
391User-agent: VoidEYE
392User-agent: Web Image Collector
393User-agent: Web Sucker
394User-agent: Web.Image.Collector
395User-agent: WebAuto
396User-agent: WebAuto/3.40 (Win98; I)
397User-agent: WebBandit
398User-agent: WebBandit/3.50
399User-agent: WebCapture 2.0
400User-agent: WebCopier
401User-agent: WebCopier v.2.2
402User-agent: WebCopier v2.5
403User-agent: WebCopier v2.6
404User-agent: WebCopier v2.7a
405User-agent: WebCopier v2.8
406User-agent: WebCopier v3.0
407User-agent: WebCopier v3.0.1
408User-agent: WebCopier v3.2
409User-agent: WebCopier v3.2a
410User-agent: WebCopy/
411User-agent: WebCrawler/3.0 Robot libwww/5.0a
412User-agent: WebEMailExtrac.*
413User-agent: WebEnhancer
414User-agent: WebFerret
415User-agent: WebFetch
416User-agent: webfetch/2.1.0
417User-agent: WebFetcher/0.8,
418User-agent: WebGo IS
419User-agent: weblayers/0.0
420User-agent: WebLeacher
421User-agent: WebLinker/0.0 libwww-perl/0.1
422User-agent: WebmasterWorld Extractor
423User-agent: WebmasterWorld Extractor
424User-agent: WebmasterWorldForumBot
425User-agent: WebmasterWorldForumBot
426User-agent: WebMoose/0.0.0000
427User-agent: WebReaper
428User-agent: WebReaper [[email protected]]
429User-agent: WebReaper [[email protected]]
430User-agent: WebReaper v9.1 - www.otway.com/webreaper
431User-agent: WebReaper v9.7 - www.webreaper.net
432User-agent: WebReaper v9.8 - www.webreaper.net
433User-agent: WebReaper vWebReaper v7.3 - www,otway.com/webreaper
434User-agent: [email protected]
435User-agent: WebSauger
436User-agent: WebSauger 1.20b
437User-agent: WebSauger 1.20j
438User-agent: WebSauger 1.20k
439User-agent: Website eXtractor
440User-agent: Website Quester
441User-agent: Website Quester - www.asona.org
442User-agent: Website Quester - www.esalesbiz.com/extra/
443User-agent: Website.Quester
444User-agent: Webster Pro
445User-agent: Webster.Pro
446User-agent: WebStripper
447User-agent: WebStripper/2.03
448User-agent: WebStripper/2.10
449User-agent: WebStripper/2.12
450User-agent: WebStripper/2.13
451User-agent: WebStripper/2.15
452User-agent: WebStripper/2.16
453User-agent: WebStripper/2.19
454User-agent: WebVac
455User-agent: webvac/1.0
456User-agent: webwalk
457User-agent: WebWalker
458User-agent: WebWalker/1.10
459User-agent: WebWatch
460User-agent: WebWhacker
461User-agent: WebZIP
462User-agent: WebZIP/2.75 (http://www.spidersoft.com)
463User-agent: WebZIP/3.65 (http://www.spidersoft.com)
464User-agent: WebZIP/3.80 (http://www.spidersoft.com)
465User-agent: WebZip/4.0
466User-agent: WebZIP/4.0 (http://www.spidersoft.com)
467User-agent: WebZIP/4.1 (http://www.spidersoft.com)
468User-agent: WebZIP/4.21
469User-agent: WebZIP/4.21 (http://www.spidersoft.com)
470User-agent: WebZIP/5.0
471User-agent: WebZIP/5.0 (http://www.spidersoft.com)
472User-agent: WebZIP/5.0 PR1 (http://www.spidersoft.com)
473User-agent: Wget
474User-agent: wget
475User-agent: Wget/1.4.0
476User-agent: Wget/1.5.2
477User-agent: Wget/1.5.3
478User-agent: Wget/1.6
479User-agent: Wget/1.7
480User-agent: Wget/1.8
481User-agent: Wget/1.8.1
482User-agent: Wget/1.8.1+cvs
483User-agent: Wget/1.8.2
484User-agent: Wget/1.9-beta
485User-agent: WhoWhere Robot
486User-agent: Widow
487User-agent: wired-digital-newsbot/1.5
488User-agent: WWW Collector
489User-agent: WWW-Collector-E
490User-agent: www.freeloader.com.
491User-agent: WWWOFFLE
492User-agent: WWWWanderer v3.0
493User-agent: Xaldon WebSpider
494User-agent: Xaldon WebSpider 2.5.b3
495User-agent: Xaldon_WebSpider
496User-agent: Xenu's
497User-agent: Xenu's Link Sleuth 1.1c
498User-agent: XGET/0.7
499User-agent: Yasaklibot
500User-agent: yes
501User-agent: YesupBot
502User-agent: Yeti
503User-agent: Zeus
504User-agent: Zeus 11389 Webster Pro V2.9 Win32
505User-agent: Zeus 11652 Webster Pro V2.9 Win32
506User-agent: Zeus 18018 Webster Pro V2.9 Win32
507User-agent: Zeus 26378 Webster Pro V2.9 Win32
508User-agent: Zeus 30747 Webster Pro V2.9 Win32
509User-agent: Zeus 32297 Webster Pro V2.9 Win32
510User-agent: Zeus 39206 Webster Pro V2.9 Win32
511User-agent: Zeus 41641 Webster Pro V2.9 Win32
512User-agent: Zeus 44238 Webster Pro V2.9 Win32
513User-agent: Zeus 51070 Webster Pro V2.9 Win32
514User-agent: Zeus 51674 Webster Pro V2.9 Win32
515User-agent: Zeus 51837 Webster Pro V2.9 Win32
516User-agent: Zeus 63567 Webster Pro V2.9 Win32
517User-agent: Zeus 6694 Webster Pro V2.9 Win32
518User-agent: Zeus 82016 Webster Pro V2.9 Win32
519User-agent: Zeus 82900 Webster Pro V2.9 Win32
520User-agent: Zeus 84842 Webster Pro V2.9 Win32
521User-agent: Zeus 90872 Webster Pro V2.9 Win32
522User-agent: Zeus 94934 Webster Pro V2.9 Win32
523User-agent: Zeus 95245 Webster Pro V2.9 Win32
524User-agent: Zeus 95351 Webster Pro V2.9 Win32
525User-agent: Zeus 97371 Webster Pro V2.9 Win32
526User-agent: Zeus Link Scout
527User-agent: ZyBorg
528Disallow: /