NeuralCrawl

Wise / robots.txt snapshot

← back to wise.com · fetched 2026-06-20T01:10:30Z (18h ago) · HTTP 200 · 2486 bytes · sha256 299ab0bf4758d800 · raw

final URL: https://wise.com/robots.txt

1User-agent: *
2Disallow: /attribution
3Disallow: /migrate-cookies
4Disallow: /visit/
5Disallow: /*/*/currency-converter/
6Disallow: /*/swift-bic/
7Disallow: /*/help/search
8Disallow: /*//publiccurrency-converter/
9Disallow: /widget
10
11# Stop bots from wasting crawl budget on these parameters
12Disallow: *redirectUrl=*
13Disallow: *0=/public*
14Disallow: */send-money/?sourceCurrency=*
15
16# Block MY send money to IL for compliance reasons
17Disallow: /my/send-money/send-money-to-israel
18
19# Allow bots to access API endpoints
20Allow: *gateway*sourceCurrency=*
21Allow: *comparisons*sourceCurrency=*
22
23User-agent: Rogerbot
24User-agent: Exabot
25User-agent: MJ12bot
26User-agent: Dotbot
27User-agent: Gigabot
28User-agent: AhrefsBot
29User-agent: BlackWidow
30User-agent: ChinaClaw
31User-agent: Custo
32User-agent: DISCo
33User-agent: Download\ Demon
34User-agent: eCatch
35User-agent: EirGrabber
36User-agent: EmailSiphon
37User-agent: EmailWolf
38User-agent: Express\ WebPictures
39User-agent: ExtractorPro
40User-agent: EyeNetIE
41User-agent: FlashGet
42User-agent: GetRight
43User-agent: GetWeb!
44User-agent: Go!Zilla
45User-agent: Go-Ahead-Got-It
46User-agent: GrabNet
47User-agent: Grafula
48User-agent: HMView
49User-agent: HTTrack
50User-agent: Image\ Stripper
51User-agent: Image\ Sucker
52User-agent: Indy\ Library
53User-agent: InterGET
54User-agent: Internet\ Ninja
55User-agent: JetCar
56User-agent: JOC\ Web\ Spider
57User-agent: larbin
58User-agent: LeechFTP
59User-agent: Mass\ Downloader
60User-agent: MIDown\ tool
61User-agent: Mister\ PiX
62User-agent: Navroad
63User-agent: NearSite
64User-agent: NetAnts
65User-agent: NetSpider
66User-agent: Net\ Vampire
67User-agent: NetZIP
68User-agent: Octopus
69User-agent: Offline\ Explorer
70User-agent: Offline\ Navigator
71User-agent: PageGrabber
72User-agent: Papa\ Foto
73User-agent: pavuk
74User-agent: pcBrowser
75User-agent: RealDownload
76User-agent: ReGet
77User-agent: SiteSnagger
78User-agent: SemrushBot
79User-agent: SmartDownload
80User-agent: SuperBot
81User-agent: SuperHTTP
82User-agent: Surfbot
83User-agent: tAkeOut
84User-agent: Teleport\ Pro
85User-agent: VoidEYE
86User-agent: Web\ Image\ Collector
87User-agent: Web\ Sucker
88User-agent: WebAuto
89User-agent: WebCopier
90User-agent: WebFetch
91User-agent: WebGo\ IS
92User-agent: WebLeacher
93User-agent: WebReaper
94User-agent: WebSauger
95User-agent: Website\ eXtractor
96User-agent: Website\ Quester
97User-agent: WebStripper
98User-agent: WebWhacker
99User-agent: WebZIP
100User-agent: Wget
101User-agent: Widow
102User-agent: WWWOFFLE
103User-agent: Xaldon\ WebSpider
104User-agent: Zeus
105Disallow: /
106
107Sitemap: https://wise.com/sitemap