wikiHow / robots.txt
← back to wikihow.com · change detected 22d ago (2026-10-16T06:49:36Z) · modified +0 −10
What changed
- Formatting/comment-only change (no semantic difference)
Diff old (2026-06-20T01:10:31Z) → new (2026-10-16T06:49:36Z)
| @@ -1,17 +1,7 @@ | ||
| 1 | 1 | # robots.txt for wikiHow |
| 2 | - # based on wikipedia.org's robots.txt | |
| 3 | 2 | # |
| 4 | - # Crawlers that are kind enough to obey, but which we'd rather not have | |
| 5 | - # unless they're feeding search engines. | |
| 6 | 3 | # Sitemap: https://www.wikihow.com/sitemap_index.xml |
| 7 | 4 | # Or: /sitemap.xml on some other domains. |
| 8 | - # | |
| 9 | - # If your bot supports such a thing using the 'Crawl-delay' or another | |
| 10 | - # instruction, we can add it to our robots.txt. | |
| 11 | - # | |
| 12 | - # Friendly, low-speed bots are welcome viewing article pages, but not | |
| 13 | - # dynamically-generated pages please. Article pages contain our site's | |
| 14 | - # real content. | |
| 15 | 5 | # |
| 16 | 6 | # NOTICE: All crawlers and bots, regardless of whether or not they are |
| 17 | 7 | # specified below, are strictly prohibited from using our content for the |