Global openwrt.org DNS outage

[jow]

Hi all,

it appears that the machine hosting the forum and nameserver for openwrt.org became inaccessible some time between sunday, 6th and monday 7th. We tried to contact the admin about the problem but didn't receive a direct response so far. According to a statement made by Zoltan, a hardware fault is the probable cause for the outage.

Since the server didn't come back online within the last ten hours and since we didn't hear about any ETA on repairs yet, we decided to take the matter to the SPI Inc., the non profit organization handling the openwrt.org domain, and asked them to redelegate the zone to the Digital Ocean name servers which are also already hosting the lede-project.org domain.

At this point in time we unfortunately cannot give any estimation on when these issues will be sorted out as we're still waiting for a positive confirmation from SPI. Depending on the reaction time of SPI's registrar and the time it takes for the DNS changes to propagate it could happen anytime within the next 12 to 96 hours.

It is also possible that the server hosting the authoritative DNS is getting online sooner, intermittently fixing DNS resolving.

---

Update Tuesday, May 8th 07:00 CEST

The authoritative name servers have been changed two hours ago and should slowly propagate down the DNS chain now.

[jow]

If you find yourself to be unable to reach any of the openwrt.org hosts, e.g. http://downloads.openwrt.org or http://archive.openwrt.org and happen to run an OpenWrt or LEDE router, you can temporarily configure it to use the DigitalOcean DNS servers to resolve *.openwrt.org addresses:

• Log into LuCI
• Navigate to Network --> DHCP and DNS
• Enter the following value into the DNS forwardings field: /openwrt.org/173.245.58.51
• Press Save & Apply

[jow]

If you prefer the CLI approach, use the following commands to forward *.openwrt.org:

uci add_list dhcp.@dnsmasq[0].server=/openwrt.org/173.245.58.51
uci commit dhcp
/etc/init.d/dnsmasq restart

If you happen to run dnsmasq on non-OpenWrt systems or if you prefer to use the native configuration, you can add server=/openwrt.org/173.245.58.51 to /etc/dnsmasq.conf as well.

[fuller]

the sad part is;
i actually prefer the vision of a pitiable admin at spi having a really shitty monday over attributing this to malice or negligence

[bmork]

@jow

At this point in time we unfortunately cannot give any estimation on when these issues will be sorted out as we’re still waiting for a positive confirmation from SPI. Depending on the reaction time of SPI’s registrar and the time it takes for the DNS changes to propagate it could happen anytime within the next 12 to 96 hours.

You know you can speed up the process considerably if you still have access to the previously delegated slvaes, and can reconfigure them to pull the zone from the new master? Even only one of them would help at this point, when all the other servers are "gone" (master down and slaves failing). It would bring openwrt.org back online immediately without the need to wait for delegation updates and propgation delays

[lleachii]

@bmork

the previously delegated slvaes

I made a post here:

Not able to downlaod packages from http://downloads.openwrt.org/chaos_calmer

OK...this is true... what were the original A Records' TTL? were the NS Records changed, if so what were their the original TTL? if the NSs changed, do these reflect actual changes at the registrar??? Telling people to make A Records is not good practice...also, this is not how propagation works. Lastly, from what I can see, (at the time of my post) there are no active NS Records for OPENWRT.ORG. at the ORG. Root. The new records should exist.

I now realize the REAL master is offline.

@bmork

if you still have access to the previously delegated slvaes, and can reconfigure them to pull the zone from the new master?

This will not work, unless the real NS records are changed.

[hnyman]

The domain info at the registrar has finally been updated a few hours ago (2018-05-08T03:03:51Z) with new name servers.

http://lists.infradead.org/pipermail/lede-dev/2018-May/012186.html

The correct new info (name servers set for nsX.digitalocean.com):

Domain Name: OPENWRT.ORG
Domain ID: D104186352-LROR
Registrar WHOIS Server: whois.tucows.com
Registrar URL: http://tucowsdomains.com
Updated Date: 2018-05-08T03:03:51Z
Creation Date: 2004-04-02T22:32:12Z
Registrar Registration Expiration Date: 2019-04-02T22:32:12Z
Registrar: TUCOWS, INC.
...
Name Server: NS1.DIGITALOCEAN.COM
Name Server: NS2.DIGITALOCEAN.COM
Name Server: NS3.DIGITALOCEAN.COM

Things should get fixed soon (except regarding forum.openwrt.org that is apparently on the same physical hosts as the old name servers at dune.hu).

[Pilot6]

I still can't update feeds from git.lede-project.org. Is there an IPV4 address to use instead of a domain name?