Al Jazeera / robots.txt
← back to aljazeera.com · change detected 24d ago (2026-07-13T16:47:36Z) · modified +10 −0
What changed
- Added Disallow: /*&fbclid= for *
- Added Disallow: /*&gb= for *
- Added Disallow: /*&playlist= for *
- Added Disallow: /*&q= for *
- Added Disallow: /*&traffic_source= for *
- Added Disallow: /*?fbclid= for *
- Added Disallow: /*?gb= for *
- Added Disallow: /*?playlist= for *
- Added Disallow: /*?q= for *
- Added Disallow: /*?traffic_source= for *
Diff old (2026-06-29T17:50:44Z) → new (2026-07-13T16:47:36Z)
| @@ -18,6 +18,16 @@ | ||
| 18 | 18 | Disallow: /search/ |
| 19 | 19 | Disallow: /home/search?q= |
| 20 | 20 | Disallow: /*/liveblog/*?*update=* |
| 21 | + Disallow: /*?gb= | |
| 22 | + Disallow: /*&gb= | |
| 23 | + Disallow: /*?traffic_source= | |
| 24 | + Disallow: /*&traffic_source= | |
| 25 | + Disallow: /*?fbclid= | |
| 26 | + Disallow: /*&fbclid= | |
| 27 | + Disallow: /*?q= | |
| 28 | + Disallow: /*&q= | |
| 29 | + Disallow: /*?playlist= | |
| 30 | + Disallow: /*&playlist= | |
| 21 | 31 | |
| 22 | 32 | # Allow Rules |
| 23 | 33 |