Conagra Brands / robots.txt
← back to conagrabrands.com · change detected 2mo ago (2026-08-27T14:17:26Z) · modified +2 −15
What changed
- Added sitemap https://www.conagrabrands.com/sitemap.xml
Diff old (2026-06-20T01:10:30Z) → new (2026-08-27T14:17:26Z)
| @@ -1,18 +1,3 @@ | ||
| 1 | - # | |
| 2 | - # robots.txt | |
| 3 | - # | |
| 4 | - # This file is to prevent the crawling and indexing of certain parts | |
| 5 | - # of your site by web crawlers and spiders run by sites like Yahoo! | |
| 6 | - # and Google. By telling these "robots" where not to go on your site, | |
| 7 | - # you save bandwidth and server resources. | |
| 8 | - # | |
| 9 | - # This file will be ignored unless it is at the root of your host: | |
| 10 | - # Used: http://example.com/robots.txt | |
| 11 | - # Ignored: http://example.com/site/robots.txt | |
| 12 | - # | |
| 13 | - # For more information about the robots.txt standard, see: | |
| 14 | - # http://www.robotstxt.org/robotstxt.html | |
| 15 | - | |
| 16 | 1 | User-agent: * |
| 17 | 2 | # CSS, JS, Images |
| 18 | 3 | Allow: /core/*.css$ |
| @@ -70,3 +55,5 @@ | ||
| 70 | 55 | Disallow: /es/busqueda-avanzada |
| 71 | 56 | Disallow: /tags/* |
| 72 | 57 | Disallow: /es/advanced-search |
| 58 | + | |
| 59 | + Sitemap: https://www.conagrabrands.com/sitemap.xml |