🇩🇰 A.P. Moller-Maersk

AI crawler access (latest snapshot, 13h ago)

⛔blocked restricted ✅allowed faded = inherited from the * wildcard group

Current robots.txt 3916 bytes · sha256 3df86d669877 · raw

# Try Maersk GPT
# https://maer.sk/gpt

User-agent: AhrefsBot 
Crawl-Delay: 10

User-agent: BernardBot
Allow: /about/executive-leadership-team/bernard-bot

User-agent: Baiduspider
Disallow: /

User-agent: *
Allow: /*-*/careers/technology
Allow: /~/media_sc9/maersk/local-information/files/*/india/export/indemnity-bond-format-*.docx
Allow: /insights/filter$
Allow: /logistics-explained/filter$
Allow: /onlinequote/$
Allow: /onlinequote/assets/
Allow: /portaluser/login$
Allow: /portaluser/register$
Allow: /support/filter$
Allow: /tracking/$
Allow: /tracking/air/$
Allow: /tracking/assets/
Allow: /tracking/lcl/$
Allow: /tracking/parcel$
Allow: /de-de/local-information/europe/contract-logistics/*/bremen
Allow: /de-de/local-information/europe/contract-logistics/*/bremerhaven
Allow: /de-de/local-information/europe/contract-logistics/*/duisburg
Allow: /de-de/local-information/europe/contract-logistics/*/hamburg
Allow: /de-de/local-information/europe/contract-logistics/*/hanover
Allow: /es-mx/local-information/europe/contract-logistics/*/barcelona
Allow: /es-mx/local-information/europe/contract-logistics/*/madrid
Allow: /tr-tr/local-information/europe/contract-logistics/*/eskisehir
Allow: /tr-tr/local-information/europe/contract-logistics/*/istanbul
Disallow: /dashboard
Disallow: /about/cfs
Disallow: /news/category/*?
Disallow: /ibooking
Disallow: /essential/location
Disallow: /lcl
Disallow: /payer
Disallow: /about/do-copy
Disallow: /tasks/
Disallow: /ign/
Disallow: /*-*/about/our-history
Disallow: /*-*/beta
Disallow: /*-*/brexit
Disallow: /*-*/careers
Disallow: /*-*/growth
Disallow: /*-*/insights/tags/
Disallow: /*-*/live-events
Disallow: /*-*/local-information/europe/contract-logistics
Disallow: /*-*/logistics-explained$
Disallow: /*-*/onlinequote
Disallow: /*-*/portaluser
Disallow: /*-*/procurement
Disallow: /*-*/schedules
Disallow: /*-*/search
Disallow: /*-*/share-via
Disallow: /*-*/support/case
Disallow: /*-*/support/chat
Disallow: /*-*/tracking
Disallow: /*-*/undefined
Disallow: /*-*/why-maersk
Disallow: /*.doc
Disallow: /*.ppt
Disallow: /*.xls
Disallow: /*/filter
Disallow: /*/news/tags
Disallow: /*/treatment/
Disallow: /*cHash=
Disallow: /*elqTrackId=
Disallow: /*exit=
Disallow: /*filter=
Disallow: /*link.aspx_id=
Disallow: /*locationId=
Disallow: /*originalUrl=
Disallow: /*tx_
Disallow: /*url=
Disallow: /about/edo
Disallow: /acm/
Disallow: /akam/
Disallow: /allocations
Disallow: /beta
Disallow: /billoflading
Disallow: /book
Disallow: /captcha
Disallow: /careers/vacancies*?
Disallow: /careers/vacancies/sv
Disallow: /cargo-insurance
Disallow: /commodity/
Disallow: /common/
Disallow: /demurrage
Disallow: /doLogin
Disallow: /dqcs
Disallow: /fixedSpotBooking
Disallow: /flow/
Disallow: /forms/
Disallow: /go$
Disallow: /hub
Disallow: /import/
Disallow: /inlandpricelookup
Disallow: /instantPrice
Disallow: /intermodal/
Disallow: /liveEngage
Disallow: /loggedin
Disallow: /logistics-explained/newsletter
Disallow: /logistics-explained/tags/
Disallow: /logoff
Disallow: /Maersk/Home/
Disallow: /multilanguageapp/
Disallow: /my-customs
Disallow: /myfinance
Disallow: /mymaersk
Disallow: /news/category/$
Disallow: /onlinequote/*
Disallow: /pdf/
Disallow: /ping
Disallow: /portallang
Disallow: /portaluser
Disallow: /public
Disallow: /ratelookup/
Disallow: /ru-ru/insights
Disallow: /ru-ru/local-information
Disallow: /ru-ru/logistics-explained
Disallow: /ru-ru/news
Disallow: /rules-lookup/
Disallow: /schedules/*?
Disallow: /scp/
Disallow: /search*=
Disallow: /security/
Disallow: /share-via
Disallow: /shipment
Disallow: /shipping
Disallow: /sitecore
Disallow: /subscriptions/
Disallow: /support/chat/?
Disallow: /tracking/*
Disallow: /undefined
Disallow: /user/
Disallow: /vacancies/
Disallow: /vessels
Disallow: /web/
Disallow: /webuser

Sitemap: https://www.maersk.com/sitemap.xml
Sitemap: https://www.maersk.com/sitemap-cs.xml
Sitemap: https://www.maersk.com/sitemap-is.xml

Change history

1. initial 13h ago snapshot

   • First snapshot of robots.txt archived