NeuralCrawl

Reliance Steel & Aluminum / robots.txt snapshot

← back to rsac.com · fetched 2026-08-18T23:34:24Z (5d ago) · HTTP 200 · 765 bytes · sha256 8e6b3a9d6f6191c3 · raw

final URL: https://reliance.com/robots.txt

1# START WPFORMS BLOCK
2# ---------------------------
3User-agent: *
4Disallow: /wp-content/uploads/wpforms/
5# ---------------------------
6# END WPFORMS BLOCK
7
8# Search and discovery crawlers that are not useful to this site.
9User-agent: AhrefsBot
10User-agent: BLEXBot
11User-agent: Bytespider
12User-agent: CCBot
13User-agent: ClaudeBot
14User-agent: Claude-SearchBot
15User-agent: DataForSeoBot
16User-agent: DotBot
17User-agent: GPTBot
18User-agent: ImagesiftBot
19User-agent: MJ12bot
20User-agent: PetalBot
21User-agent: SemrushBot
22User-agent: SeznamBot
23User-agent: meta-externalagent
24User-agent: omgili
25User-agent: omgilibot
26Disallow: /
27
28# Permit normal search engines while keeping administrative pages out of results.
29User-agent: *
30Disallow: /wp-admin/
31Allow: /wp-admin/admin-ajax.php