NeuralCrawl

Glencore / robots.txt

← back to glencore.com · change detected 6d ago (2026-11-01T06:14:58Z) · modified +8 −8

What changed

Diff old (2026-11-01T00:13:54Z) → new (2026-11-01T06:14:58Z)

@@ -3,9 +3,6 @@
33 
44  # Excluded documents
55  User-agent: *
6- Disallow: /.rest/api/v1/documents/static/72f40bbd-1240-4e41-8177-5fba47c6323f/Business%2Bconfirmation%2Bgeneral%2Bterms-purchase-ext.pdf
7- Disallow: /.rest/api/v1/documents/static/975c896c-6824-401f-9def-50bc0d31d097/Business%2Bconfirmation%2Bgeneral%2Bterms-sale.pdf
8- Disallow: /.rest/api/v1/documents/static/610492b3-3d6e-4622-aff1-4fc0f747b271/Business%2Bconfirmation%2Bgeneral%2Bterms-purchase.pdf
96  Disallow: /.rest/api/v1/documents/static/644477c5-ca8a-4785-826b-1d86aa69f48b/%E4%BA%BA%E6%9D%83+-+Supplier+Code+of+Conduct+Training+%28CHI%29.pdf
107  Disallow: /.rest/api/v1/documents/static/635f225d-72e0-400e-a793-c936790160c5/%E5%81%A5%E5%BA%B7%E4%B8%8E%E5%AE%89%E5%85%A8+-+Supplier+Code+of+Conduct+Training+%28CHI%29.pdf
118  Disallow: /.rest/api/v1/documents/static/f6588712-bf12-4c8c-862c-fb550b789941/%E5%85%AC%E5%B9%B3%E4%B8%8E%E5%B0%8A%E9%87%8D+-+Supplier+Code+of+Conduct+Training+%28CHI%29.pdf
@@ -68,8 +65,6 @@
6865  Disallow: /.rest/api/v1/documents/static/765794ef-7037-4023-9ea8-d48d1bd99995/Comunidades+-+Formaci%C3%B3n+sobre+el+C%C3%B3digo+de+Conducta+para+Proveedores+%28SPA%29.pdf
6966  Disallow: /.rest/api/v1/documents/static/452a625a-26e2-41e6-8246-dd240b608b4a/Derechos+humanos+-+Formaci%C3%B3n+sobre+el+C%C3%B3digo+de+Conducta+para+Proveedores+%28SPA%29.pdf
7067  Disallow: /.rest/api/v1/documents/static/30f47ccb-6e91-4b1f-8a90-1ecce88990d7/Equidad+y+respeto+-+Formaci%C3%B3n+sobre+el+C%C3%B3digo+de+Conducta+para+Proveedores+%28SPA%29.pdf
71- Disallow: /.rest/api/v1/documents/7a5d3eb7a056308363da09ab224f03a9/GLT+3286A+IsaMill+Broch+8pp+A4+2026-03+%28ENG%29+02-SR.pdf
72- Disallow: /.rest/api/v1/documents/f783ed07f6529634aae7d2801136327d/GLT+3286ZI+IsaMill+Broch+8pp+A4+2026-03+%28ESP%29+01-SR.pdf
7368  Disallow: /.rest/api/v1/documents/static/29685126-18cc-4b8a-9c47-2292ac59fd1d/Esclavitud+moderna%2C+trabajo+forzado+y+trabajo+infantil+-+Formaci%C3%B3n+sobre+el+C%C3%B3digo+de+Conducta+para+Proveedores+%28SPA%29.pdf
7469  Disallow: /.rest/api/v1/documents/static/21175b9c-b1f5-46a0-b5dd-da0d2752e902/Medioambiente+-+Formaci%C3%B3n+sobre+el+C%C3%B3digo+de+Conducta+para+Proveedores+%28SPA%29.pdf
7570  Disallow: /.rest/api/v1/documents/static/87fd1a8d-dc59-4e81-ae97-a2cfe591dab0/Salud+y+seguridad+-+Formaci%C3%B3n+sobre+el+C%C3%B3digo+de+Conducta+para+Proveedores+%28SPA%29.pdf
@@ -84,6 +79,8 @@
8479  Disallow: /.rest/api/v1/documents/static/3dfefbdb-6d21-4250-b931-6da5ae7e0cfe/Supplier+Code+of+Conduct+Supplier+Supplement+%28ENG%29+%282%29.pdf
8580  Disallow: /.rest/api/v1/documents/static/13252cff-7d2d-4d1e-9a0d-4b9f53bea6c9/Glencore_Product+Carbon+Footprint+Guidance.pdf
8681  Disallow: /.rest/api/v1/documents/static/551d1418-9701-46e0-a4c4-f335433a4716/Supplier+Code+of+Conduct+-+Mandarin.pdf
82+ Disallow: /.rest/api/v1/documents/f783ed07f6529634aae7d2801136327d/GLT+3286ZI+IsaMill+Broch+8pp+A4+2026-03+%28ESP%29+01-SR.pdf
83+ Disallow: /.rest/api/v1/documents/7a5d3eb7a056308363da09ab224f03a9/GLT+3286A+IsaMill+Broch+8pp+A4+2026-03+%28ENG%29+02-SR.pdf
8784  Disallow: /.rest/api/v1/documents/599c9228f4ec49b3c54710ae10fe0df5/Couverture+des+cales+de+navire+lors+du+d%C3%A9chargement+du+concentr%C3%A9+de+nickel+%E2%80%93+%C3%89tude+de+pr%C3%A9faisabilit%C3%A9.pdf
8885  Disallow: /.rest/api/v1/documents/dc41ac990a2bc1386966ec4a87ce9e0c/Coupa+Supplier+Portal+Onboarding+Guide.pdf
8986  Disallow: /.rest/api/v1/documents/e11fccb4ea7bf956a9a8b067949b5d42/Guide+d%27int%C3%A9gration+-+Portail+Fournisseur+Coupa.pdf
@@ -97,12 +94,15 @@
9794  Disallow: /.rest/api/v1/documents/29270520d8811484274cdcc5b6a55d6d/Formation+CSP+-+Facturation.pdf
9895  Disallow: /.rest/api/v1/documents/44ff436fe002f3f95a6748364b850ab2/Formation+CSP+-+Configuration%2C+Navigation+et+Utilisation.pdf
9996  Disallow: /.rest/api/v1/documents/ec11f20e649d3868966aa0f735ad9a22/Formation+CSP+-+Approvisionnement%2C+Contrats+et+Bons+de+Commande+%281%29.pdf
100- Disallow: /.rest/api/v1/documents/fead04d171ba6a1639a7027cf89bd06e/IsaMill+Design+Improvements+and+Operational+Performance+at+Anglo+Platinum+-+Rule%5B1%5D.pdf
101- Disallow: /.rest/api/v1/documents/459a0eac148b9736d631757eb1bfa594/Joe_Pease.pdf
102- Disallow: /.rest/api/v1/documents/23b7375a3c7cc913e5682ade249db895/CIM+2024_Significant+Potential+of+an+IsaMill%E2%84%A2+in+Secondary+Grinding+Duty_.pdf
10397  Disallow: /.rest/api/v1/documents/9881dbb346fd16ad888307a9906ff1aa/Ligne+de+tir+-+protocole.pdf
10498  Disallow: /.rest/api/v1/documents/90879a10ff0a59a8ba76162239eaeb85/Travaux+en+hauteur.pdf
10599  Disallow: /.rest/api/v1/documents/e7bfa3067fa24b21269479b31991848d/Gestion+des+entrepreneurs.pdf
106100  Disallow: /.rest/api/v1/documents/2c4be5bcf9bf5776ab8973ee6c1bd657/Travail+en+hauteur+%2802%29_outil.pdf
107101  Disallow: /.rest/api/v1/documents/a6ea2e09ae9c60292364dcacb7c1e2e6/QUIZ+EXAMEN_GestionEntrepreneurs_H1913_R03.pdf
108102  Disallow: /.rest/api/v1/documents/ceab977abd9d9b76e03daf10f2a9d8b9/H1913_Presentation.pdf
103+ Disallow: /.rest/api/v1/documents/fead04d171ba6a1639a7027cf89bd06e/IsaMill+Design+Improvements+and+Operational+Performance+at+Anglo+Platinum+-+Rule%5B1%5D.pdf
104+ Disallow: /.rest/api/v1/documents/459a0eac148b9736d631757eb1bfa594/Joe_Pease.pdf
105+ Disallow: /.rest/api/v1/documents/23b7375a3c7cc913e5682ade249db895/CIM+2024_Significant+Potential+of+an+IsaMill%E2%84%A2+in+Secondary+Grinding+Duty_.pdf
106+ Disallow: /.rest/api/v1/documents/static/610492b3-3d6e-4622-aff1-4fc0f747b271/Business%2Bconfirmation%2Bgeneral%2Bterms-purchase.pdf
107+ Disallow: /.rest/api/v1/documents/static/72f40bbd-1240-4e41-8177-5fba47c6323f/Business%2Bconfirmation%2Bgeneral%2Bterms-purchase-ext.pdf
108+ Disallow: /.rest/api/v1/documents/static/975c896c-6824-401f-9def-50bc0d31d097/Business%2Bconfirmation%2Bgeneral%2Bterms-sale.pdf