NeuralCrawl

Simon & Schuster / robots.txt snapshot

← back to simonandschuster.com · fetched 2026-10-03T02:09:18Z (1mo ago) · HTTP 200 · 728 bytes · sha256 c69ea334b605e905 · raw

final URL: https://www.simonandschuster.com/robots.txt

1User-Agent: *
2Disallow: /search
3Allow: /search/books/Category-Biography-Autobiography/Available-For-Sale-Now/_/N-hr0Zpgz/Ne-pgx$
4Allow: /search/books/Category-Games-Crosswords/Available-For-Sale-Now/_/N-g6aZpgz/Ne-ffk$
5Allow: /search/books/Category-Fiction/Available-For-Sale-Now/_/N-g1hZpgz/Ne-pgx$
6Allow: /search/books/Category-History/Available-For-Sale-Now/_/N-ha4Zpgz/Ne-ffk$
7Allow: /search/books/Category-Fiction-Mystery-Detective/Available-For-Sale-Now/_/N-g32Zpgz/Ne-pgx$
8Allow: /search/books/Category-Political-Science/Available-For-Sale-Now/_/N-hnqZpgz/Ne-ffk$
9Allow: /search/books/Available-For-Sale-Now/_/N-pgz/Ne-pgx$
10Disallow: /about/contact_us
11Sitemap: https://www.simonandschuster.com/sitemaps/us/sitemap.xml.gz