Lots of disconnects in goldenorb

I'm using wifix GoldenOrb_2021-01-21 firmware version of openwrt on a Wg3526 router paired with a EM-20G modem. This setup has worked well for the last year. The third party reseller of my ATT sim card has changed a few times during that time. I noticed no speed throttling, or disconnecting during that time.

The last 3 or so weeks, I am getting disconnects very frequently. Sometimes it reconnect and disconnects every few minutes, for more than an hour. Then other times it will stay connected for 4+ hours with no hiccups. I usually see around 120Mb/s on speedtests. During the middle of night off-off peak times, I've seen it as high as 250Mb/s. Last night it was disconnecting every few minutes, but i could still get a 200+Mb/s speedtest. So it doensn't seem to have any issue with throttling, or lack of CA between bands. Without doing any band locking, It will pick 14 and 66.

I have a better than not chance of disconnecting during a speed test, and it seems to disconnect less often after 8pm CST. I am the defacto sys admin for my household, without actually knowing what I'm doing :smiley: , so I need help with understanding what the logfiles might be saying that will shed light on my issue. I've tried troubleshooting anything I could think might be contributing. After each change, I would look at the logfile for any new things that might be obvious error/failures. Nothing I've tried has changed the disconnects. So far that includes the following:
-- Switching from QMI to MBIM.
-- Disabling all ipv6 and rebooting router
-- Running router connection through openvpn (not certain it would disconnect, but connection speed was ~15Mb/s)
-- Updating to current firmware
-- Disabling the band lock that had been in place for around a year.
-- Using SQM Qos to throttle speed to ~50% of normal load (in case tower sees me as bandwidth hog)

That is all the observation and action history up to now. What I really need help with is understanding what the logfiles might be hinting at. I'm grateful for any help anyone can give.
The logfile data wouldn't fit on the first post, so I will post those below this post. The kernel log can be produced on request (it is longer than the others at the moment).

Below is the following raw data:
-- Signal quality numbers
-- Logfile during one connection disconnection cycle.

Signal Quality Numbers

Network :LTE FDD
CSQ :31
Signal Strength : 100%
RSSI :-51 dBm
ECIO3G/RSRQ4G/SS_RSRQ5G: -13 dB
RSCP3G/RSRP4G/SS_RSRP5G : -70 dBm

System Log

Sun Jun 27 16:25:26 2021 user.notice Connection Monitor: Start Connection Monitor for Modem 1
Sun Jun 27 16:25:27 2021 daemon.info dnsmasq[3751]: read /etc/hosts - 4 addresses
Sun Jun 27 16:25:27 2021 daemon.info dnsmasq[3751]: read /tmp/hosts/odhcpd - 4 addresses
Sun Jun 27 16:25:27 2021 daemon.info dnsmasq[3751]: read /tmp/hosts/dhcp.cfg01411c - 2 addresses
Sun Jun 27 16:25:27 2021 daemon.info dnsmasq-dhcp[3751]: read /etc/ethers - 0 addresses
Sun Jun 27 16:25:27 2021 daemon.notice hostapd: wlan0: AP-STA-DISCONNECTED 5c:e0:c5:d9:d9:a6
Sun Jun 27 16:25:30 2021 user.notice firewall: Reloading firewall due to ifup of wan1 (wwan0)
Sun Jun 27 16:25:57 2021 user.notice sms process: Reread SMS Messages on Modem 1
Sun Jun 27 16:28:42 2021 user.notice sms process: Reread SMS Messages on Modem 1
Sun Jun 27 16:28:50 2021 user.notice Connection Monitor: Modem 1 Connection is Down (using Ping Test)
Sun Jun 27 16:29:15 2021 user.notice Connection Monitor: Setting Modem Removal flag
Sun Jun 27 16:29:25 2021 kern.info kernel: [ 5900.808575] usb 1-2: USB disconnect, device number 15
Sun Jun 27 16:29:25 2021 kern.info kernel: [ 5900.814167] option1 ttyUSB0: GSM modem (1-port) converter now disconnected from ttyUSB0
Sun Jun 27 16:29:25 2021 kern.info kernel: [ 5900.822569] option 1-2:1.0: device disconnected
Sun Jun 27 16:29:25 2021 kern.info kernel: [ 5900.828245] option1 ttyUSB1: GSM modem (1-port) converter now disconnected from ttyUSB1
Sun Jun 27 16:29:25 2021 kern.info kernel: [ 5900.836615] option 1-2:1.1: device disconnected
Sun Jun 27 16:29:25 2021 kern.info kernel: [ 5900.842838] option1 ttyUSB2: GSM modem (1-port) converter now disconnected from ttyUSB2
Sun Jun 27 16:29:25 2021 kern.info kernel: [ 5900.851100] option 1-2:1.2: device disconnected
Sun Jun 27 16:29:25 2021 kern.info kernel: [ 5900.856743] option1 ttyUSB3: GSM modem (1-port) converter now disconnected from ttyUSB3
Sun Jun 27 16:29:25 2021 kern.info kernel: [ 5900.865232] option 1-2:1.3: device disconnected
Sun Jun 27 16:29:25 2021 kern.info kernel: [ 5900.870321] cdc_mbim 1-2:1.4 wwan0: unregister 'cdc_mbim' usb-1e1c0000.xhci-2, CDC MBIM
Sun Jun 27 16:29:25 2021 daemon.notice netifd: Network device 'wwan0' link is down
Sun Jun 27 16:29:25 2021 kern.info kernel: [ 5900.930664] do_page_fault(): sending SIGSEGV to gcom for invalid write access to 0041c000
Sun Jun 27 16:29:25 2021 kern.info kernel: [ 5900.938876] epc = 0040364d in comgt[400000+6000]
Sun Jun 27 16:29:25 2021 kern.info kernel: [ 5900.943564] ra  = 00403601 in comgt[400000+6000]
Sun Jun 27 16:29:25 2021 user.notice Quectel Data: AT+CSQ +CSQ: 99,99 OK AT+QENG="SERVINGCELL" +QENG: "SERVINGCELL","SEARCH" OK AT+QRSRP ERROR AT+QCA
Sun Jun 27 16:29:25 2021 user.notice Quectel Data: CAN'T OPEN DEVICE /DEV/TTYUSB2.
Sun Jun 27 16:29:26 2021 daemon.info hostapd: wlan0: STA 5c:e0:c5:d9:d9:a6 IEEE 802.11: authenticated
Sun Jun 27 16:29:26 2021 daemon.info hostapd: wlan0: STA 5c:e0:c5:d9:d9:a6 IEEE 802.11: associated (aid 6)
Sun Jun 27 16:29:26 2021 daemon.notice hostapd: wlan0: AP-STA-CONNECTED 5c:e0:c5:d9:d9:a6
Sun Jun 27 16:29:26 2021 daemon.info hostapd: wlan0: STA 5c:e0:c5:d9:d9:a6 RADIUS: starting accounting session 63CFADAC1CFC96DC
Sun Jun 27 16:29:26 2021 daemon.info hostapd: wlan0: STA 5c:e0:c5:d9:d9:a6 WPA: pairwise key handshake completed (RSN)
Sun Jun 27 16:29:26 2021 daemon.info dnsmasq-dhcp[3751]: DHCPREQUEST(br-lan) 192.168.1.188 5c:e0:c5:d9:d9:a6
Sun Jun 27 16:29:26 2021 daemon.info dnsmasq-dhcp[3751]: DHCPACK(br-lan) 192.168.1.188 5c:e0:c5:d9:d9:a6 ClickyClicky
Sun Jun 27 16:29:26 2021 daemon.info dnsmasq[3751]: read /etc/hosts - 4 addresses
Sun Jun 27 16:29:26 2021 daemon.info dnsmasq[3751]: read /tmp/hosts/odhcpd - 2 addresses
Sun Jun 27 16:29:26 2021 daemon.info dnsmasq[3751]: read /tmp/hosts/dhcp.cfg01411c - 2 addresses
Sun Jun 27 16:29:26 2021 daemon.info dnsmasq-dhcp[3751]: read /etc/ethers - 0 addresses
Sun Jun 27 16:29:27 2021 user.notice URL-DEBUG: hotplug (iface): action='ifdown' interface='wan1'
Sun Jun 27 16:29:27 2021 user.notice MBIM Connect: Stopping network
Sun Jun 27 16:29:27 2021 daemon.notice netifd: wan1 (3732): open failed: : No such file or directory
Sun Jun 27 16:29:27 2021 daemon.notice netifd: wan1 (3732): Command failed: Permission denied
Sun Jun 27 16:29:27 2021 daemon.notice netifd: Interface 'wan1' is now down
Sun Jun 27 16:29:27 2021 daemon.warn dnsmasq[3751]: no servers found in /tmp/resolv.conf.auto, will retry
Sun Jun 27 16:29:27 2021 daemon.info dnsmasq[3751]: read /etc/hosts - 4 addresses
Sun Jun 27 16:29:27 2021 daemon.info dnsmasq[3751]: read /tmp/hosts/odhcpd - 1 addresses
Sun Jun 27 16:29:27 2021 daemon.info dnsmasq[3751]: read /tmp/hosts/dhcp.cfg01411c - 2 addresses
Sun Jun 27 16:29:27 2021 daemon.info dnsmasq-dhcp[3751]: read /etc/ethers - 0 addresses
Sun Jun 27 16:29:27 2021 user.notice mwan3[3731]: Using firewall mask 0x3F00
Sun Jun 27 16:29:27 2021 user.notice mwan3[3731]: Max interface count is 60
Sun Jun 27 16:29:29 2021 daemon.info dnsmasq[3751]: read /etc/hosts - 4 addresses
Sun Jun 27 16:29:29 2021 daemon.info dnsmasq[3751]: read /tmp/hosts/odhcpd - 2 addresses
Sun Jun 27 16:29:29 2021 daemon.info dnsmasq[3751]: read /tmp/hosts/dhcp.cfg01411c - 2 addresses
Sun Jun 27 16:29:29 2021 daemon.info dnsmasq-dhcp[3751]: read /etc/ethers - 0 addresses
Sun Jun 27 16:29:30 2021 user.notice usb-modeswitch: *****************************************************************
Sun Jun 27 16:29:30 2021 user.notice usb-modeswitch: *
Sun Jun 27 16:29:30 2021 user.notice usb-modeswitch: * Remove : 1-2 : Modem1
Sun Jun 27 16:29:30 2021 user.notice usb-modeswitch: *
Sun Jun 27 16:29:30 2021 user.notice usb-modeswitch: *****************************************************************
Sun Jun 27 16:29:30 2021 user.notice usb-modeswitch: *****************************************************************
Sun Jun 27 16:29:30 2021 user.notice usb-modeswitch: *
Sun Jun 27 16:29:30 2021 user.notice usb-modeswitch: * No Modems present
Sun Jun 27 16:29:30 2021 user.notice usb-modeswitch: *
Sun Jun 27 16:29:30 2021 user.notice usb-modeswitch: *****************************************************************
Sun Jun 27 16:29:37 2021 kern.info kernel: [ 5912.951827] usb 1-2: new high-speed USB device number 16 using xhci-mtk
Sun Jun 27 16:29:37 2021 kern.info kernel: [ 5913.135895] option 1-2:1.0: GSM modem (1-port) converter detected
Sun Jun 27 16:29:37 2021 kern.info kernel: [ 5913.142748] usb 1-2: GSM modem (1-port) converter now attached to ttyUSB0
Sun Jun 27 16:29:37 2021 kern.info kernel: [ 5913.151102] option 1-2:1.1: GSM modem (1-port) converter detected
Sun Jun 27 16:29:37 2021 kern.info kernel: [ 5913.157772] usb 1-2: GSM modem (1-port) converter now attached to ttyUSB1
Sun Jun 27 16:29:37 2021 kern.info kernel: [ 5913.166085] option 1-2:1.2: GSM modem (1-port) converter detected
Sun Jun 27 16:29:37 2021 kern.info kernel: [ 5913.172816] usb 1-2: GSM modem (1-port) converter now attached to ttyUSB2
Sun Jun 27 16:29:37 2021 kern.info kernel: [ 5913.181367] option 1-2:1.3: GSM modem (1-port) converter detected
Sun Jun 27 16:29:37 2021 kern.info kernel: [ 5913.188373] usb 1-2: GSM modem (1-port) converter now attached to ttyUSB3
Sun Jun 27 16:29:37 2021 kern.info kernel: [ 5913.212621] cdc_mbim 1-2:1.4: cdc-wdm0: USB WDM device
Sun Jun 27 16:29:37 2021 kern.info kernel: [ 5913.219407] cdc_mbim 1-2:1.4 wwan0: register 'cdc_mbim' at usb-1e1c0000.xhci-2, CDC MBIM, b2:4f:4c:3a:4e:55
Sun Jun 27 16:29:37 2021 user.notice Log Print : Driver Name : 1
Sun Jun 27 16:29:37 2021 user.notice Log Print : Driver Name : 2 option
Sun Jun 27 16:29:37 2021 user.notice Log Print : Driver Name : 3 option
Sun Jun 27 16:29:37 2021 user.notice Log Print : Driver Name : 4 option
Sun Jun 27 16:29:37 2021 user.notice Log Print : Driver Name : 5 option
Sun Jun 27 16:29:37 2021 user.notice Log Print : Driver Name : 6 cdc_mbim
Sun Jun 27 16:29:37 2021 user.notice Log Print : Driver Name : 7 cdc_mbim
Sun Jun 27 16:29:37 2021 user.notice Log Print : Driver Name : 8 cdc_mbim
Sun Jun 27 16:29:37 2021 user.notice usb-modeswitch: Add : 1-2: Manufacturer=Quectel Product=EM20-G Serial=7bc0bd15 2c7c 0620
Sun Jun 27 16:29:37 2021 user.notice usb-modeswitch: *****************************************************************
Sun Jun 27 16:29:38 2021 user.notice usb-modeswitch: *
Sun Jun 27 16:29:38 2021 user.notice usb-modeswitch: * Start of Modem Detection and Connection Information
Sun Jun 27 16:29:38 2021 user.notice usb-modeswitch: *
Sun Jun 27 16:29:38 2021 user.notice usb-modeswitch: * Product=EM20-G 2c7c 0620
Sun Jun 27 16:29:38 2021 user.notice usb-modeswitch: *
Sun Jun 27 16:29:38 2021 user.notice usb-modeswitch: *****************************************************************
Sun Jun 27 16:29:38 2021 user.notice usb-modeswitch: *****************************************************************
Sun Jun 27 16:29:38 2021 user.notice usb-modeswitch: *
Sun Jun 27 16:29:38 2021 user.notice usb-modeswitch: * This device does not have a switch data file
Sun Jun 27 16:29:38 2021 user.notice usb-modeswitch: *
Sun Jun 27 16:29:38 2021 user.notice usb-modeswitch: * Product=EM20-G 2c7c 0620
Sun Jun 27 16:29:38 2021 user.notice usb-modeswitch: *
Sun Jun 27 16:29:38 2021 user.notice usb-modeswitch: *****************************************************************
Sun Jun 27 16:29:48 2021 user.notice usb-modeswitch: *****************************************************************
Sun Jun 27 16:29:48 2021 user.notice usb-modeswitch: *
Sun Jun 27 16:29:48 2021 user.notice usb-modeswitch: * Switched to : 2c7c:0620
Sun Jun 27 16:29:48 2021 user.notice usb-modeswitch: *
Sun Jun 27 16:29:48 2021 user.notice usb-modeswitch: *****************************************************************
Sun Jun 27 16:29:48 2021 user.notice Log Print : Driver Name : 1
Sun Jun 27 16:29:48 2021 user.notice Log Print : Driver Name : 2 option
Sun Jun 27 16:29:48 2021 user.notice Log Print : Driver Name : 3 option
Sun Jun 27 16:29:48 2021 user.notice Log Print : Driver Name : 4 option
Sun Jun 27 16:29:48 2021 user.notice Log Print : Driver Name : 5 option
Sun Jun 27 16:29:48 2021 user.notice Log Print : Driver Name : 6 cdc_mbim
Sun Jun 27 16:29:48 2021 user.notice Log Print : Driver Name : 7 cdc_mbim
Sun Jun 27 16:29:48 2021 user.notice Log Print : Driver Name : 8 cdc_mbim
Sun Jun 27 16:29:48 2021 user.notice usb-modeswitch: *****************************************************************
Sun Jun 27 16:29:48 2021 user.notice usb-modeswitch: *
Sun Jun 27 16:29:48 2021 user.notice usb-modeswitch: * ProtoFind returns : 3
Sun Jun 27 16:29:48 2021 user.notice usb-modeswitch: *
Sun Jun 27 16:29:48 2021 user.notice usb-modeswitch: *****************************************************************
Sun Jun 27 16:29:48 2021 user.notice usb-modeswitch: Found Modem 1
Sun Jun 27 16:29:48 2021 user.notice usb-modeswitch: Connecting a MBIM Modem
Sun Jun 27 16:29:48 2021 user.notice Create Connection: Start MBIM Connection
Sun Jun 27 16:29:53 2021 user.notice Create Connection: MBIM Comm Port : /dev/ttyUSB2
Sun Jun 27 16:30:02 2021 user.notice Create Connection: Quectel Unsolicited Responses Disabled
Sun Jun 27 16:30:16 2021 user.notice Get Profile: Modem 1 is Quectel EM20
Sun Jun 27 16:30:16 2021 user.notice Get Profile: Default Profile Used
Sun Jun 27 16:30:16 2021 user.notice Create Connection: Profile for Modem 1 sets interface to WAN1
Sun Jun 27 16:30:16 2021 user.notice Create Connection: Modem 1 is using WAN1
Sun Jun 27 16:30:16 2021 user.notice Create Connection: Using Provider assigned DNS
Sun Jun 27 16:30:20 2021 user.notice Create Connection: Pincode in script
Sun Jun 27 16:30:20 2021 user.notice Create Connection: Attempting to Connect Modem 1
Sun Jun 27 16:30:32 2021 user.notice Create Connection: Using Netifd Method
Sun Jun 27 16:30:32 2021 user.notice sms process: SMS Supported
Sun Jun 27 16:30:32 2021 daemon.notice netifd: Interface 'wan1' is setting up now
Sun Jun 27 16:30:32 2021 user.notice MBIM Connect: Query radio state
Sun Jun 27 16:30:33 2021 user.notice MBIM Connect: Reading capabilities
Sun Jun 27 16:30:33 2021 user.notice MBIM Connect: Checking subscriber
Sun Jun 27 16:30:33 2021 user.notice MBIM Connect: Checking PIN state
Sun Jun 27 16:30:33 2021 daemon.notice netifd: wan1 (5369): required pin: 3 - pin2
Sun Jun 27 16:30:33 2021 daemon.notice netifd: wan1 (5369): remaining attempts: 3
Sun Jun 27 16:30:33 2021 user.notice MBIM Connect: PIN is not required
Sun Jun 27 16:30:33 2021 user.notice MBIM Connect: Register with network
Sun Jun 27 16:30:33 2021 user.notice MBIM Connect: Attach to network
Sun Jun 27 16:30:33 2021 user.notice MBIM Connect: Connect to network
Sun Jun 27 16:30:34 2021 daemon.notice netifd: wan1 (5369):   sessionid: 0
Sun Jun 27 16:30:34 2021 daemon.notice netifd: wan1 (5369):   activationstate: 0001 - activated
Sun Jun 27 16:30:34 2021 daemon.notice netifd: wan1 (5369):   voicecallstate: 0000 - none
Sun Jun 27 16:30:34 2021 daemon.notice netifd: wan1 (5369):   nwerror: 0000 - unknown
Sun Jun 27 16:30:34 2021 daemon.notice netifd: wan1 (5369):   iptype: 0003 - ipv4v6
Sun Jun 27 16:30:34 2021 user.notice MBIM Connect: Get IP config
Sun Jun 27 16:30:34 2021 daemon.notice netifd: wan1 (5369): IP: 10.202.251.161
Sun Jun 27 16:30:34 2021 daemon.notice netifd: wan1 (5369): IPv6: 2600:380:6821:5184:2cb6:50a8:56e2:b349
Sun Jun 27 16:30:34 2021 daemon.notice netifd: wan1 (5369): DNS1: 172.26.38.1
Sun Jun 27 16:30:34 2021 daemon.notice netifd: wan1 (5369): DNS3: fc00:a:a:0:0:0:0:300
Sun Jun 27 16:30:34 2021 user.notice MBIM Connect: Connected, setting IP
Sun Jun 27 16:30:34 2021 kern.info kernel: [ 5970.263861] 8021q: adding VLAN 0 to HW filter on device wwan0
Sun Jun 27 16:30:34 2021 daemon.notice netifd: Interface 'wan1' is now up
Sun Jun 27 16:30:34 2021 daemon.notice netifd: Network device 'wwan0' link is up
Sun Jun 27 16:30:34 2021 daemon.info dnsmasq[3751]: reading /tmp/resolv.conf.auto
Sun Jun 27 16:30:34 2021 daemon.info dnsmasq[3751]: using local addresses only for domain test
Sun Jun 27 16:30:34 2021 daemon.info dnsmasq[3751]: using local addresses only for domain onion
Sun Jun 27 16:30:34 2021 daemon.info dnsmasq[3751]: using local addresses only for domain localhost
Sun Jun 27 16:30:34 2021 daemon.info dnsmasq[3751]: using local addresses only for domain local
Sun Jun 27 16:30:34 2021 daemon.info dnsmasq[3751]: using local addresses only for domain invalid
Sun Jun 27 16:30:34 2021 daemon.info dnsmasq[3751]: using local addresses only for domain bind
Sun Jun 27 16:30:34 2021 daemon.info dnsmasq[3751]: using local addresses only for domain lan
Sun Jun 27 16:30:34 2021 daemon.info dnsmasq[3751]: using nameserver 172.26.38.1#53
Sun Jun 27 16:30:34 2021 daemon.info dnsmasq[3751]: using nameserver fc00:a:a::300#53
Sun Jun 27 16:30:34 2021 user.notice URL-DEBUG: hotplug (iface): action='ifup' interface='wan1'
Sun Jun 27 16:30:34 2021 user.notice MBIM Connect: Modem 1 Connected
Sun Jun 27 16:30:34 2021 user.notice Connection Monitor: Start Connection Monitor for Modem 1

Ask the people over at GoldenOrb....

3 Likes

specifically here https://forums.whirlpool.net.au/thread/2689577?p=-1&#bottom

2 Likes

Its possible that your connection monitoring settings are maybe a little too aggressive or slightly too often, the line in the log is pointing to the ping check bringing the modem down, try disabling the connection monitoring for a few hours. I had a similar problem last year when my ISP changed something about their network (they switched on ipv6) and I figured that the ping test was running before a connection had been made and sent it into a loop of connect/disconnection. This is just a guess though, and I am suggesting it may be this as your signal numbers look great. I also agree with @frollic about asking on the rooter forum, they will help you out, its fabulous community of cellular modem heads who have developed this branch of openwrt over many years, my home internet is now solid (I never have to reboot the rooter!) and gives 150 to 250 mbps depending on the tower load and its all down to the rooter community

Thanks for the suggestion, but unfortunately, I already ran with no connection monitoring to rule it out as well, and saw no change in my disconnecting.
I think its tower related and being managed by ATT. I pay a 3rd party reseller and I think its a phone plan. My router receives texts from ATT saying "youve used your 16 GB, at 22 you may be throttled.... While throttled is not the same as disconnected, my cycle just started new on the 2nd, and I've had only 1 or 2 disconnects in the last 3+ days.

If I may ask, who do you have your service through? If you don't want to openly say on here, I can give you info to direct message me.

Cheers.

Ah ok, it was worth a try, I'm in France and use a company called SFR-Red, I purchased the sim from them 3 years ago with a 100gb limit but as soon as I got it connected they emailed me and asked if I wanted an unlimited data plan from them for an extra 5 euros per month, so I snatched their hand off for unlimited, Ive found the rooter firmware has dealt with disconnects flawlessly over the past couple of years, but I have had some help from the rooter forums whilst getting it to this robust state. Just for info I have a sierra wireless em7565 (3xCA) B3+B7+B1) are my usual bands, and this modem is in a mikrotik rbm33g.
Try the rooter guys over on whirlpool, I'm sure they'll be able to help although if it is a tower kicking you off I'm not sure what to suggest.

This topic was automatically closed 10 days after the last reply. New replies are no longer allowed.