Best Buy / robots.txt

← back to bestbuy.com · change detected 15d ago (2026-09-03T16:37:09Z) · modified +0 −1

What changed

🤖 AIRemoved Disallow: */site/searchpage.jsp?st=* for AmazonBot
Removed Disallow: */site/searchpage.jsp?st=* for Applebot
🤖 AIRemoved Disallow: */site/searchpage.jsp?st=* for ChatGPT-User
🤖 AIRemoved Disallow: */site/searchpage.jsp?st=* for Claude-User
🤖 AIRemoved Disallow: */site/searchpage.jsp?st=* for Claudebot
Removed Disallow: */site/searchpage.jsp?st=* for Gemeni-AI
Removed Disallow: */site/searchpage.jsp?st=* for Gemini-Deep-Research
🤖 AIRemoved Disallow: */site/searchpage.jsp?st=* for Google-Extended
🤖 AIRemoved Disallow: */site/searchpage.jsp?st=* for GPTBot
🤖 AIRemoved Disallow: */site/searchpage.jsp?st=* for OAI-SearchBot
🤖 AIRemoved Disallow: */site/searchpage.jsp?st=* for Perplexity-User
🤖 AIRemoved Disallow: */site/searchpage.jsp?st=* for PerplexityBot

Diff old (2026-08-24T19:21:08Z) → new (2026-09-03T16:37:09Z)

		@@ -167,7 +167,6 @@
167	167	Disallow: ?page=&page=$
168	168
169	169	# Search Parameters Controls
170		- Disallow: /site/searchpage.jsp?st=
171	170	Disallow: ?id_facet&st=
172	171	Disallow: ?id_facet_facet&st=*
173	172	Disallow: ?cp=&id=&st=