Mark wiki.openwrt.org for robot exclusion?

Hmmm... That's pretty clear. Kind of like a club to the forehead :slight_smile:

I'm looking beyond the current effort to drive people to the new wiki. After we've switched the search engines over to the new wiki, what will people see if they intentionally seek info on oldwiki.openwrt.org?

And can we change it now, so we don't have to think about it in the future? Perhaps we could have:

  • [Historical OpenWrt Wiki] in the title
  • The yellow warning could say,

    This is an archive of the original OpenWrt Wiki. It was last updated in February 2018, and is now read-only. You can search this historical archive using the Search function above.

    Please use the OpenWrt Wiki at https://openwrt.org for current information about the project.

Doing this will keep the site's content correct for all time. The "February 2018" date will help readers understand whether it would be useful to them. (And as that date gets farther in the past, it will be even more obvious.)

It will be like a quiet, charming, little used library where historians (and archaeologists) can come to do their research.

Some playing around:

grafik

I think that can be a bit confusing for newcomers and perhaps have them lost already on the search engine. What I mean is: If I was looking on Google and the like, and saw a “OUTDATED” I wouldn’t click the link in the first place and thus never see the notice of where to find the new wiki, or even know that there is a new wiki.

Therefore I propose the title should be “[OLD OpenWrt Wiki]” as this is short and simple to understand and implies that there is a new one.

EDIT:

Or perhaps even better “[FORMER OpenWrt Wiki]” as this indicates there’s a new one before even clicking on the search result.

Proposals so far:

1 [ARCHIVED OpenWrt Wiki] http://wiki.archive.openwrt.org/
2 [FORMER OpenWrt Wiki] http://oldwiki.openwrt.org/
3 [Historical OpenWrt Wiki] http://oldwiki.openwrt.org/
4 [OLD OpenWrt Wiki] http://oldwiki.openwrt.org/
5 [OUTDATED OpenWrt wiki] http://oldwiki.openwrt.org/
6 [PREVIOUS OpenWrt Wiki] http://oldwiki.openwrt.org/

:+1: on consistency of @takimata suggestion

Of the various titles, the strongest "don't read this" one for me is "outdated"

I agree, but what I’m afraid of is that it doesn’t imply that there’s a new one, unlike with “old” or “former”. If people don’t click it in the first place, how will they know there’s a new wiki if they won’t get the message in the old wiki?

Perhaps excluding the old Wiki from indexing might be better? Just thinking out loud here.

Superseded

Clearly indicates something has been replaced

1 Like

I think we're close enough to consensus on a "good enough" solution that we should move forward and wrap this up.

I slightly prefer [PREVIOUS OpenWrt Wiki] (to [FORMER OpenWrt Wiki]) , but would accept either. Both convey the notion that "this used to be the correct information, but it's not any more." and allows the reader to look further down the search page for current info.

@tmomas - I like the second (of the three) "yellow boxes". Is this something you can do on your own without SSH access? (I know we can't get a live link to "openwrt.org", but readers of the old wiki can figure that out for themselves.)

Other points from my earlier note:

  • Change the name to "oldwiki.openwrt.org" (already requested - Is this complete?)
  • Change the oldwiki title to include [PREVIOUS OpenWrt Wiki] or some such phrase (Mostly decided - I say let @tmomas choose the final wording)
  • Add a "Historical" page to the current wiki that explains the state of the old wiki, and how to find it, and how to use its built-in search facility. (Done - https://openwrt.org/historicalwiki )
  • Fix references to "wiki.openwrt.org" in the current wiki (there are a few dozen). This can happen over time.
  • Change robots.txt to exclude spidering (Perhaps we should change the <title> to include "PREVIOUS", then allow one more round of spidering before excluding spidering...)
1 Like

My favourite is the third yellow box, because the live link to openwrt.org is more prominent here.
I'm afraid, this can only be done with ssh access to wiki.openwrt.org.
If however the wiki subdomain is transfered to the current openwrt.org servers, then it's no problem. In fact, I already put that yellow box in the copy of the old wiki which resides on openwrt.org, i.e. once the subdomain is transfered, it will automatically show up.

I want to stress that this is really a live link (clickable) instead of simple text as with the current yellow box on wiki.openwrt.org.

Thanks for the summary.

@wigyori @jow
We now have a plan, and the only thing that is hindering us in executing the plan is the missing support for the transfer of the wiki subdomain... :frowning:

How can we now move forward?

Sure, I guess sending me an e-mail always worked, I rarely check the forum. :slight_smile: First I can set up the full robot disallow to stop indexing the site, and then we can create the oldwiki.openwrt.org DNS records. I've set up the site alias now in the webserver.

One thing I'd like to avoid is to completely dump the "old" wiki, to have the old content lying around in case anyone is looking for missing or non-merged content on the old wiki.

Regards,
-w-

Don't indiscriminately disallow robots please, it would prompt archive.org to drop all current and historical records of the site. It's better to specifically disallow Google.

I would like to repeat my suggestion to name it wiki.archive.openwrt.org, in line with the already existing forum.archive.openwrt.org.

1 Like

What about disallowing all, but specifically allowing archive.org?

@tmomas - what's your take on the naming? From my end, both are fine.

-w-

The parallel naming seems to have several attractive features including clarity and consistency

I'm undecided with a slight tendency towards oldwiki.

1 Like

@tmomas @wigyori - what about "oldwiki.archive.openwrt.org" ? For the sake of consistency I'd really like to move the wiki below the *.archive.openwrt.org domain.

3 Likes

Sounds good. Still easily recognised as a wiki, but "oldwiki" marks it ancient.

2 Likes

Same opinion as hannu. Make it so.
:slight_smile:

Fair enough. A robots.txt like this should do it:

User-Agent: *
Disallow: /

User-Agent: archive.org_bot
Allow: /

TBH, mostly I am just a bit overly careful about the content. Even though archive.org was not a particularly huge help in collecting the old forum content after its data loss, it helped enough with the layout and some minor aspects. I don't expect anything similar for the wiki, but who knows what's 10 or 20 years down the line. Historical records are important.

1 Like

I like that idea, it's good for posterity.