Stubby issues out of nowhere

Installing and Using OpenWrt
1

Out of nowhere Stubby (which I use for DNSoverTLS) has broken.

Stubby is spitting out this every time it is started by it's start up script.

Sun May 12 07:58:42 2019 daemon.err stubby[5727]: Error loading shared library libyaml-0.so.2: Permission denied (needed by /usr/sbin/stubby)
Sun May 12 07:58:42 2019 daemon.err stubby[5727]: Error loading shared library libgetdns.so.10: Permission denied (needed by /usr/sbin/stubby)
Sun May 12 07:58:42 2019 daemon.err stubby[5727]: Error loading shared library libgcc_s.so.1: Permission denied (needed by /usr/sbin/stubby)
Sun May 12 07:58:42 2019 daemon.err stubby[5727]: Error loading shared library libgcc_s.so.1: Permission denied (needed by /lib/libsetlbf.so)
Sun May 12 07:58:42 2019 daemon.err stubby[5727]: Error relocating /usr/sbin/stubby: yaml_parser_parse: symbol not found
Sun May 12 07:58:42 2019 daemon.err stubby[5727]: Error relocating /usr/sbin/stubby: getdns_list_get_dict: symbol not found
Sun May 12 07:58:42 2019 daemon.err stubby[5727]: Error relocating /usr/sbin/stubby: getdns_dict_remove_name: symbol not found
Sun May 12 07:58:42 2019 daemon.err stubby[5727]: Error relocating /usr/sbin/stubby: getdns_general: symbol not found
Sun May 12 07:58:42 2019 daemon.err stubby[5727]: Error relocating /usr/sbin/stubby: yaml_parser_set_input_string: symbol not found
Sun May 12 07:58:42 2019 daemon.err stubby[5727]: Error relocating /usr/sbin/stubby: getdns_dict_create_with_context: symbol not found
Sun May 12 07:58:42 2019 daemon.err stubby[5727]: Error relocating /usr/sbin/stubby: getdns_str2dict: symbol not found
Sun May 12 07:58:42 2019 daemon.err stubby[5727]: Error relocating /usr/sbin/stubby: getdns_context_get_tls_query_padding_blocksize: symbol not found
Sun May 12 07:58:42 2019 daemon.err stubby[5727]: Error relocating /usr/sbin/stubby: getdns_list_create: symbol not found
Sun May 12 07:58:42 2019 daemon.err stubby[5727]: Error relocating /usr/sbin/stubby: getdns_list_get_bindata: symbol not found
Sun May 12 07:58:42 2019 daemon.err stubby[5727]: Error relocating /usr/sbin/stubby: getdns_context_set_logfunc: symbol not found
Sun May 12 07:58:42 2019 daemon.err stubby[5727]: Error relocating /usr/sbin/stubby: getdns_get_errorstr_by_id: symbol not found
Sun May 12 07:58:42 2019 daemon.err stubby[5727]: Error relocating /usr/sbin/stubby: getdns_dict_get_int: symbol not found
Sun May 12 07:58:42 2019 daemon.err stubby[5727]: Error relocating /usr/sbin/stubby: getdns_context_set_resolution_type: symbol not found
Sun May 12 07:58:42 2019 daemon.err stubby[5727]: Error relocating /usr/sbin/stubby: getdns_reply: symbol not found
Sun May 12 07:58:42 2019 daemon.err stubby[5727]: Error relocating /usr/sbin/stubby: getdns_dict_get_bindata: symbol not found
Sun May 12 07:58:42 2019 daemon.err stubby[5727]: Error relocating /usr/sbin/stubby: getdns_dict_get_list: symbol not found
Sun May 12 07:58:42 2019 daemon.err stubby[5727]: Error relocating /usr/sbin/stubby: getdns_context_create: symbol not found
Sun May 12 07:58:42 2019 daemon.err stubby[5727]: Error relocating /usr/sbin/stubby: getdns_context_get_tls_authentication: symbol not found
Sun May 12 07:58:42 2019 daemon.err stubby[5727]: Error relocating /usr/sbin/stubby: getdns_context_config: symbol not found
Sun May 12 07:58:42 2019 daemon.err stubby[5727]: Error relocating /usr/sbin/stubby: getdns_dict_set_list: symbol not found
Sun May 12 07:58:42 2019 daemon.err stubby[5727]: Error relocating /usr/sbin/stubby: getdns_context_destroy: symbol not found
Sun May 12 07:58:42 2019 daemon.err stubby[5727]: Error relocating /usr/sbin/stubby: getdns_context_get_edns_client_subnet_private: symbol not found
Sun May 12 07:58:42 2019 daemon.err stubby[5727]: Error relocating /usr/sbin/stubby: getdns_dict_destroy: symbol not found
Sun May 12 07:58:42 2019 daemon.err stubby[5727]: Error relocating /usr/sbin/stubby: getdns_context_get_dns_transport_list: symbol not found
Sun May 12 07:58:42 2019 daemon.err stubby[5727]: Error relocating /usr/sbin/stubby: yaml_parser_delete: symbol not found
Sun May 12 07:58:42 2019 daemon.err stubby[5727]: Error relocating /usr/sbin/stubby: yaml_parser_initialize: symbol not found
Sun May 12 07:58:42 2019 daemon.err stubby[5727]: Error relocating /usr/sbin/stubby: getdns_list_get_length: symbol not found
Sun May 12 07:58:42 2019 daemon.err stubby[5727]: Error relocating /usr/sbin/stubby: getdns_context_get_resolution_type: symbol not found
Sun May 12 07:58:42 2019 daemon.err stubby[5727]: Error relocating /usr/sbin/stubby: getdns_dict_set_int: symbol not found
Sun May 12 07:58:42 2019 daemon.err stubby[5727]: Error relocating /usr/sbin/stubby: getdns_context_run: symbol not found
Sun May 12 07:58:42 2019 daemon.err stubby[5727]: Error relocating /usr/sbin/stubby: getdns_pretty_print_dict: symbol not found
Sun May 12 07:58:42 2019 daemon.err stubby[5727]: Error relocating /usr/sbin/stubby: getdns_dict_get_dict: symbol not found
Sun May 12 07:58:42 2019 daemon.err stubby[5727]: Error relocating /usr/sbin/stubby: getdns_context_set_listen_addresses: symbol not found
Sun May 12 07:58:42 2019 daemon.err stubby[5727]: Error relocating /usr/sbin/stubby: getdns_dict_set_dict: symbol not found
Sun May 12 07:58:42 2019 daemon.err stubby[5727]: Error relocating /usr/sbin/stubby: yaml_event_delete: symbol not found
Sun May 12 07:58:42 2019 daemon.err stubby[5727]: Error relocating /usr/sbin/stubby: getdns_context_get_api_information: symbol not found
Sun May 12 07:58:42 2019 daemon.err stubby[5727]: Error relocating /usr/sbin/stubby: getdns_convert_dns_name_to_fqdn: symbol not found
Sun May 12 07:58:42 2019 daemon.err stubby[5727]: Error relocating /usr/sbin/stubby: getdns_dict_get_names: symbol not found
Sun May 12 07:58:42 2019 daemon.err stubby[5727]: Error relocating /usr/sbin/stubby: getdns_list_destroy: symbol not found
Sun May 12 07:58:42 2019 daemon.err stubby[5727]: Error relocating /usr/sbin/stubby: getdns_dict_create: symbol not found
Sun May 12 07:58:42 2019 daemon.info procd: Instance stubby::stubby s in a crash loop 6 crashes, 0 seconds since last crash

If I start it from the shell it works for a little while but then stops when the ssh session closes.

I am at a loss as to what has happened, the only thing I have changed in the last few days is the NTP time servers, but that was a few days ago and the problems have only started a few hours ago (and I have changed them back just to be sure).

I have tried rebooting a bunch of times and I am sure I have internet connectivity.

Does anyone know what has happened?

2

Like the error messages say, stubby does not find all needed libraries.
Error hints to file permissions, but might also be about missing libraries.

Have you installed new packages? Or upgraded some existing ones? Possibly some version mismatch had been created there.

Possibly you need to reinstall the missing libraries with opkg.

Ps. You did not mention if you are using the stable 18.06 or the bleeding edge development master.

1 Like
3

Sorry, it is 18.06.02 (but with the base image and some of the packages compiled with -o3).
I have not installed anything new (nor upgraded) for a few weeks and it has been working fine for over a month.

The only other thing I did in the last little while was turn on firewall logging (but I highly doubt it had anything to do with it).

EDIT: Reinstalling stubby and getdns fixed the issue, so something must of got corrupted somehow (the startup script is the only thing I can think of).

1 Like