NeuralCrawl

๐Ÿ‡ฐ๐Ÿ‡ท Coupang

coupang.com · Top 1000 websites · rank #130 · Web · live robots.txt ↗

AI crawler access (latest snapshot, 1h ago)

blocked restricted allowed faded = inherited from the * wildcard group

GPTBot
ChatGPT-User
OAI-SearchBot
ClaudeBot
Claude-User
Claude-SearchBot
anthropic-ai
Claude-Web
CCBot
Google-Extended
Applebot-Extended
PerplexityBot
Perplexity-User
Bytespider
Amazonbot
FacebookBot
meta-externalagent
meta-externalfetcher
cohere-ai
AI2Bot
Diffbot
omgili
YouBot
DuckAssistBot
MistralAI-User
PanguBot
Timpibot

Current robots.txt 3754 bytes · sha256 8c184c8ff396 · raw

## Google
User-agent: Googlebot
Allow: /vp/products/
Allow: /np/products/brand-shop?brandName=*
Allow: /np/categories/
Allow: /np/campaigns/
Allow: /np/best100/
Allow: /np/todayopen
Allow: /np/omp
Allow: /vp/wowcard
Allow: /np/coupangglobal
Allow: /np/search?q=*
Disallow: /vm/direct-orders/
Disallow: /vm/cart/
Disallow: /gppu-choice-widget?itemId=*
Disallow: /vendor-items/
Disallow: /other-seller-json
Disallow: /brandsdp/invalid/
Disallow: /vm/mlp/

## Google Mobile
User-agent: Googlebot-Mobile
Allow: /vp/products/
Allow: /np/products/brand-shop?brandName=*
Allow: /np/categories/
Allow: /np/campaigns/
Allow: /np/best100/
Allow: /np/todayopen
Allow: /np/omp
Allow: /vp/wowcard
Allow: /np/coupangglobal
Allow: /np/search?q=*
Disallow: /vm/direct-orders/
Disallow: /vm/cart/
Disallow: /gppu-choice-widget?itemId=*
Disallow: /vendor-items/
Disallow: /other-seller-json
Disallow: /brandsdp/invalid/
Disallow: /vm/mlp/

## Google Image
User-agent: Googlebot-image
Allow: /vp/products/
Allow: /np/products/brand-shop?brandName=*
Allow: /np/categories/
Allow: /np/campaigns/
Allow: /np/best100/
Allow: /np/todayopen
Allow: /np/omp
Allow: /np/coupangglobal
Allow: /np/search?q=*
Disallow: /vm/direct-orders/
Disallow: /vm/cart/
Disallow: /gppu-choice-widget?itemId=*
Disallow: /vendor-items/
Disallow: /other-seller-json
Disallow: /brandsdp/invalid/
Disallow: /vm/mlp/

## Naver
User-agent: NaverBot
Allow: /$
Allow: /vp/products/
Allow: /np/products/brand-shop?brandName=*
Allow: /np/categories/
Allow: /np/campaigns/
Allow: /np/best100/
Allow: /np/todayopen
Allow: /np/omp
Allow: /vp/wowcard
Allow: /np/coupangglobal
Allow: /np/search?q=*
Disallow: /vm/direct-orders/
Disallow: /vm/cart/
Disallow: /gppu-choice-widget?itemId=*
Disallow: /vendor-items/
Disallow: /other-seller-json
Disallow: /brandsdp/invalid/
Disallow: /vm/mlp/

## Naver
User-agent: Yeti
Allow: /$
Allow: /vp/products/
Allow: /np/products/brand-shop?brandName=*
Allow: /np/categories/
Allow: /np/campaigns/
Allow: /np/best100/
Allow: /np/todayopen
Allow: /np/omp
Allow: /vp/wowcard
Allow: /np/coupangglobal
Allow: /np/search?q=*
Disallow: /vm/direct-orders/
Disallow: /vm/cart/
Disallow: /gppu-choice-widget?itemId=*
Disallow: /vendor-items/
Disallow: /other-seller-json
Disallow: /brandsdp/invalid/
Disallow: /vm/mlp/

## Bing
User-agent: Bingbot
Allow: /vp/products/
Allow: /np/products/brand-shop?brandName=*
Allow: /np/categories/
Allow: /np/campaigns/
Allow: /np/best100/
Allow: /np/todayopen
Allow: /np/omp
Allow: /vp/wowcard
Allow: /np/coupangglobal
Allow: /np/search?q=*
Disallow: /vm/direct-orders/
Disallow: /vm/cart/
Disallow: /gppu-choice-widget?itemId=*
Disallow: /vendor-items/
Disallow: /other-seller-json
Disallow: /brandsdp/invalid/
Disallow: /vm/mlp/

## Daum
User-agent: Daum
Allow: /$
Allow: /vp/products/
Allow: /np/products/brand-shop?brandName=*
Allow: /np/categories/
Allow: /np/campaigns/
Allow: /np/best100/
Allow: /np/todayopen
Allow: /np/omp
Allow: /vp/wowcard
Allow: /np/coupangglobal
Allow: /np/search?q=*
Disallow: /vm/direct-orders/
Disallow: /vm/cart/
Disallow: /gppu-choice-widget?itemId=*
Disallow: /vendor-items/
Disallow: /other-seller-json
Disallow: /brandsdp/invalid/
Disallow: /vm/mlp/

## Daumoa
User-agent: Daumoa
Allow: /vp/products/
Allow: /np/products/brand-shop?brandName=*
Allow: /np/categories/
Allow: /np/campaigns/
Allow: /np/best100/
Allow: /np/todayopen
Allow: /np/omp
Allow: /vp/wowcard
Allow: /np/coupangglobal
Allow: /np/search?q=*
Disallow: /vm/direct-orders/
Disallow: /vm/cart/
Disallow: /gppu-choice-widget?itemId=*
Disallow: /vendor-items/
Disallow: /other-seller-json
Disallow: /brandsdp/invalid/
Disallow: /vm/mlp/

## disallow all other bots
User-agent: *
Disallow: /

Sitemap: https://www.coupang.com/sitemap/sitemap.xml

Change history

  1. initial snapshot
    • First snapshot of robots.txt archived