NeuralCrawl

Tyson Foods / robots.txt

← back to tysonfoods.com · change detected 30d ago (2026-07-08T14:47:09Z) · modified +4 −0

What changed

Diff old (2026-06-20T01:10:30Z)new (2026-07-08T14:47:09Z)

@@ -18,6 +18,10 @@
1818  Allow: /core/*.css$
1919  Allow: /core/*.css?
2020  Allow: /core/*.js$
21+
22+ Disallow: /bricks
23+ Disallow: *.docx
24+
2125  Allow: /core/*.js?
2226  Allow: /core/*.gif
2327  Allow: /core/*.jpg