NeuralCrawl

🇺🇸 Adorama

adorama.com · E-commerce · rank #17 · Retailer · live robots.txt ↗

AI crawler access (latest snapshot, 3h ago)

⛔blocked restricted ✅allowed faded = inherited from the * wildcard group

✅GPTBot
✅ChatGPT-User
✅OAI-SearchBot
✅ClaudeBot
✅Claude-User
✅Claude-SearchBot
✅anthropic-ai
✅Claude-Web
✅CCBot
✅Google-Extended
✅Applebot-Extended
✅PerplexityBot
✅Perplexity-User
✅Bytespider
✅Amazonbot
✅FacebookBot
✅meta-externalagent
✅meta-externalfetcher
✅cohere-ai
✅AI2Bot
✅Diffbot
✅omgili
✅YouBot
✅DuckAssistBot
✅MistralAI-User
✅PanguBot
✅Timpibot

Current robots.txt 5450 bytes · sha256 b87d7159dcb6 · raw 

User-agent: *
Disallow: /catalog.tpl?op=process
Disallow: /catalog.tpl?op=wishlist
Disallow: /catalog.tpl?op=WishList
Disallow: /catalog.tpl?op=requestaquote
Disallow: /ps/catalog.pl?op=trackorder_login
Disallow: /*sid=*
Disallow: /*mode=*
Disallow: /*Mode=*
Disallow: /*SearchMode=*
Disallow: /catalog/
Disallow: /trackOrder
Disallow: *MyAccount*
Disallow: /*history=true
Disallow: /Als
Disallow: /Als.Main/
Disallow: /Als.Mvc/
Disallow: /als.mvc/
Disallow: /Als.Commerce/
Disallow: /Als.Commerce/
Disallow: /SearchSite/NewDesign/Controls/
Disallow: /searchsite/newdesign/controls/
Disallow: /SearchSite/Popups/
Disallow: /searchsite/popups/
Disallow: /RedirectCatalog.tpl
Disallow: /RedirectDefault.aspx
Disallow: /SearchSite/HeaderUserControls/
Disallow: /searchsite/AjaxHelperService.asmx/
Disallow: /searchsite/RedirectDefault.aspx
Disallow: /searchsite/RedirectCatalog.tpl
Disallow: /Redirectl/
Disallow: /*/Redirectl/
Disallow: /g/*/%*
Disallow: /redirectl/
Disallow: /*/redirectl/
Disallow: /col/xmlsitemaps/
Allow: /als.mvc/*/*css*
Allow: /als.mvc/*/*js*
Allow: /Als.Mvc/*/*css*
Allow: /Als.Mvc/*/*js*
Allow: /als.mvc/*/*Css*
Allow: /als.mvc/*/*Js*
Allow: /Als.Mvc/*/*Css*
Allow: /Als.Mvc/*/*Js*
Allow: /als.mvc/nspc/SpecsTab
Allow: /Als.Mvc/nspc/SpecsTab
Allow: /als.mvc/nspc/dailydeal
Disallow: /Als.Mvc/nspc/Product/GetRevisedImagesPopupContent/
Disallow: /finder/*
Allow: /finder/kiponadapterfinder$
Disallow: /pages/WriteAReview
Disallow: /RecommendFor/
Disallow: /k/*
Disallow: /bundles
Disallow: /alc/wp-admin/
Disallow: /business/wp-admin/
Disallow: /alc/wp-login.php
Disallow: /API/RfkRecommendations*
Allow: /Als.Mvc/nspc/ProductCompareTab*
Allow: /g/Camera-Batteries/$
Disallow: /g/Camera-Batteries/*
Allow: /g/glow-softboxes/$
Disallow: /g/glow-softboxes/*
Allow: /g/lacie/$
Disallow: /g/lacie/*
Disallow: /Als.Mvc/nspc/revisedsearch?op=recommended*
Disallow: *searchinfo=*
Disallow: *sharewishlist*
Disallow: *GetUsedWaysToSave*
Disallow: *_pxhc=*
Disallow: *RRref=*
Disallow: *kbid=*
Disallow: *KBID=*
Disallow: *nrtv_cid=*
Disallow: /r/

Disallow: /*source=recommendFor
Disallow: /*source=RECOMMENDFOR
Disallow: /*SOURCE=recommendFor
Disallow: /*SOURCE=RECOMMENDFOR
Disallow: /*source=RecommendFor
Disallow: /*source=recommendfor

Disallow: /*utm_source=
Disallow: /*utm_content=
Disallow: /*utm_medium=
Disallow: /*utm_campaign=

Allow: /2x-rewards/l/$
Disallow: /2x-rewards/l/
Allow: /ces-specials/l/$
Disallow: /ces-specials/l/
Allow: /financing-48-months/l/$
Disallow: /financing-48-months/l/
Allow: /flashpoint-promo/l/$
Disallow: /flashpoint-promo/l/
Allow: /flash-sale/l/$
Disallow: /flash-sale/l/
Allow: /imaging-usa-specials/l/$
Disallow: /imaging-usa-specials/l/
Allow: /july-fourth-sale/l/$
Disallow: /july-fourth-sale/l/
Allow: /leica-customer-appreciation/l/$
Disallow: /leica-customer-appreciation/l/
Allow: /lighting-sale/l/$
Disallow: /lighting-sale/l/
Allow: /lighting-week/l/$
Disallow: /lighting-week/l/
Allow: /new-rebates/l/$
Disallow: /new-rebates/l/
Allow: /save-on-fender/l/$
Disallow: /save-on-fender/l/
Allow: /shop-by-price/l/$
Disallow: /shop-by-price/l/
Allow: /wppi-show/l/$
Disallow: /wppi-show/l/

Disallow: /api/user/
Disallow: /searchsite/AjaxHelperService.asmx/AddToSearchLogTable
Disallow: /searchsite/AjaxHelperService.asmx/AddToSearchPageSearchLogTable
Disallow: /api/v1/
Disallow: /api/v2/*
Disallow: /SearchSite/Default.aspx?category=*
Disallow: /searchsite/default.aspx?category=*
Disallow: /searchsite/Default.aspx?category=*
Disallow: /api/retail/*

Disallow: /*?*sel=*|*
Disallow: /*~*?*sel=*
Disallow: /*?*sel=*_*_*
Disallow: /*~*~
Disallow: /*?*term=*
Disallow: /*?*OrigTerm=*
Disallow: /*?*origterm=*

Disallow: /px/xhr
Disallow: /px/*
Disallow: /PXTY0eJULE/
Disallow: /PXTY0eJULE/*

Disallow: *Item-Condition_
Disallow: *Discount_
Disallow: *Ratings-and-Reviews_
Disallow: *Price-Range_
Allow: *Filter-By_Specials
Disallow: *Filter-By_
Disallow: /alc/search/
Disallow: /API/GetContent
Disallow: /alc/tags/

User-agent: 008
Disallow: /

User-agent: AhrefsBot
Crawl-delay: 1

User-agent: AhrefsSiteAudit
Crawl-delay: 1

Sitemap: https://www.adorama.com/UnifySiteMaps/Category.xml
Sitemap: https://www.adorama.com/UnifySiteMaps/Brand.xml
Sitemap: https://www.adorama.com/UnifySiteMaps/BrandCategoryListing.xml
Sitemap: https://www.adorama.com/gcssitemaps/Products1.xml
Sitemap: https://www.adorama.com/gcssitemaps/Products2.xml
Sitemap: https://www.adorama.com/gcssitemaps/Products3.xml
Sitemap: https://www.adorama.com/gcssitemaps/Products4.xml
Sitemap: https://www.adorama.com/gcssitemaps/Products5.xml
Sitemap: https://www.adorama.com/gcssitemaps/Products6.xml
Sitemap: https://www.adorama.com/gcssitemaps/UsedProductPages.xml
Sitemap: https://www.adorama.com/UnifySiteMaps/UsedCategoryPage.xml
Sitemap: https://www.adorama.com/UnifySiteMaps/UsedBrandListingPage.xml
Sitemap: https://www.adorama.com/UnifySiteMaps/GLPPage.xml
Sitemap: https://www.adorama.com/UnifySiteMaps/StaticPages.xml
Sitemap: https://www.adorama.com/UnifySiteMaps/promopages.xml
Sitemap: https://www.adorama.com/alc/sitemap_index.xml
Sitemap: https://www.adorama.com/col/sitemaps/VideoSitemap.xml
Sitemap: https://www.adorama.com/UnifySiteMaps/ProductVideos1.xml
Sitemap: https://www.adorama.com/UnifySiteMaps/ProductVideos2.xml
Sitemap: https://www.adorama.com/UnifySiteMaps/ProductVideos3.xml
Sitemap: https://www.adorama.com/lists/sitemap.xml
Sitemap: https://www.adorama.com/business/sitemap_index.xml

Change history

  1. initial snapshot
    • First snapshot of robots.txt archived