I have some instability going on with 19.07RC2 64bit x86 build.
dslreports speed test will fail with saying download speed dropped below average. (see attached screenshot)
The intel PCIE driver doesn't support tx/rx flow control on all my NICs, only the onboard supports it.
I've had one LAN interface stop responding requiring a reboot to bring it back up. My WAN and LAN2 were still working.
pfsense works flawlessly on this setup though the ports are utilized differently as my onboard nic is eth0 (WAN) and the add on PCIE card is eth1(LAN1) and eth2 (LAN2).
Openwrt has onboard nic as eth1 (LAN) and Wan (eth0) and eth2 (LAN2) are on the add on card, these are the openwrt defaults as changing them on this version wouldn't work.
edit: I forgot to mention the dslreports problem goes away once I enable sqm.
Here is the kernel log (after a reboot) couldn't get it during the error.
[ 9.990437] e1000e: Intel(R) PRO/1000 Network Driver - 3.2.6-k
[ 9.997883] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.
[ 10.005459] e1000e 0000:00:19.0: Interrupt Throttling Rate (ints/sec) set to simplified (2000-8000 ints) mode
[ 10.017248] e1000e 0000:00:19.0: Interrupt Mode set to 1
[ 10.140212] e1000e 0000:00:19.0 0000:00:19.0 (uninitialized): registered PHC clock
[ 10.261052] e1000e 0000:00:19.0 eth0: (PCI Express:2.5GT/s:Width x1) 30:0e:d5:2e:48:e2
[ 10.270754] e1000e 0000:00:19.0 eth0: Intel(R) PRO/1000 Network Connection
[ 10.279379] e1000e 0000:00:19.0 eth0: MAC: 10, PHY: 11, PBA No: FFFFFF-0FF
[ 10.288012] e1000e 0000:01:00.0: Interrupt Throttling Rate (ints/sec) set to simplified (2000-8000 ints) mode
[ 10.474933] e1000e 0000:01:00.0 eth1: (PCI Express:2.5GT/s:Width x4) 00:15:17:7f:40:de
[ 10.484613] e1000e 0000:01:00.0 eth1: Intel(R) PRO/1000 Network Connection
[ 10.493321] e1000e 0000:01:00.0 eth1: MAC: 0, PHY: 4, PBA No: D56146-003
[ 10.501686] e1000e 0000:01:00.1: Interrupt Throttling Rate (ints/sec) set to simplified (2000-8000 ints) mode
[ 10.694944] e1000e 0000:01:00.1 eth2: (PCI Express:2.5GT/s:Width x4) 00:15:17:7f:40:df
[ 10.704616] e1000e 0000:01:00.1 eth2: Intel(R) PRO/1000 Network Connection
[ 10.713095] e1000e 0000:01:00.1 eth2: MAC: 0, PHY: 4, PBA No: D56146-003
[ 10.721677] ip_tables: (C) 2000-2006 Netfilter Core Team
[ 10.737153] xt_time: kernel timezone is -0000
[ 10.744056] PPP generic driver version 2.4.2
[ 10.749808] NET: Registered protocol family 24
[ 10.756156] kmodloader: done loading kernel modules from /etc/modules.d/*
[ 12.490515] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
[ 12.780445] IPv6: ADDRCONF(NETDEV_UP): eth2: link is not ready
[ 12.788730] 8021q: adding VLAN 0 to HW filter on device eth2
[ 13.070439] IPv6: ADDRCONF(NETDEV_UP): eth1: link is not ready
[ 13.078671] 8021q: adding VLAN 0 to HW filter on device eth1
[ 14.081078] e1000e: eth2 NIC Link is Up 100 Mbps Full Duplex, Flow Control: None
[ 14.091117] e1000e 0000:01:00.1 eth2: 10/100 speed: disabling TSO
[ 14.098706] IPv6: ADDRCONF(NETDEV_CHANGE): eth2: link becomes ready
[ 15.171064] e1000e: eth1 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: None
[ 15.181315] IPv6: ADDRCONF(NETDEV_CHANGE): eth1: link becomes ready
[ 15.356310] e1000e: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: Rx/Tx
[ 15.366582] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
[ 133.902245] e1000e 0000:00:19.0 eth0: Detected Hardware Unit Hang:
[ 133.902245] TDH <13>
[ 133.902245] TDT <17>
[ 133.902245] next_to_use <17>
[ 133.902245] next_to_clean <13>
[ 133.902245] buffer_info[next_to_clean]:
[ 133.902245] time_stamp <ffffbe62>
[ 133.902245] next_to_watch <13>
[ 133.902245] jiffies <ffffbf30>
[ 133.902245] next_to_watch.status <0>
[ 133.902245] MAC Status <80083>
[ 133.902245] PHY Status <796d>
[ 133.902245] PHY 1000BASE-T Status <3c00>
[ 133.902245] PHY Extended Status <3000>
[ 133.902245] PCI Status <10>
[ 135.898999] e1000e 0000:00:19.0 eth0: Detected Hardware Unit Hang:
[ 135.898999] TDH <13>
[ 135.898999] TDT <17>
[ 135.898999] next_to_use <17>
[ 135.898999] next_to_clean <13>
[ 135.898999] buffer_info[next_to_clean]:
[ 135.898999] time_stamp <ffffbe62>
[ 135.898999] next_to_watch <13>
[ 135.898999] jiffies <ffffbff8>
[ 135.898999] next_to_watch.status <0>
[ 135.898999] MAC Status <80083>
[ 135.898999] PHY Status <796d>
[ 135.898999] PHY 1000BASE-T Status <3c00>
[ 135.898999] PHY Extended Status <3000>
[ 135.898999] PCI Status <10>
[ 137.894931] NETDEV WATCHDOG: eth0 (e1000e): transmit queue 0 timed out
[ 137.903640] ------------[ cut here ]------------
[ 137.910224] WARNING: CPU: 0 PID: 0 at 0xffffffff816355d3
[ 137.917550] Modules linked in: pppoe ppp_async pppox ppp_generic nf_conntrack_ipv6 iptable_nat ipt_REJECT ipt_MASQUERADE xt_time xt_tcpudp xt_tcpmss xt_statistic xt_state xt_recent xt_nat xt_multiport xt_mark xt_mac xt_limit xt_length xt_hl xt_helper xt_ecn xt_dscp xt_conntrack xt_connmark xt_connlimit xt_connbytes xt_comment xt_TCPMSS xt_REDIRECT xt_LOG xt_HL xt_FLOWOFFLOAD xt_DSCP xt_CT xt_CLASSIFY slhc r8169 nf_reject_ipv4 nf_nat_redirect nf_nat_masquerade_ipv4 nf_conntrack_ipv4 nf_nat_ipv4 nf_nat nf_log_ipv4 nf_flow_table_hw nf_flow_table nf_defrag_ipv6 nf_defrag_ipv4 nf_conntrack_rtcache iptable_raw iptable_mangle iptable_filter ipt_ECN ip_tables e1000e crc_ccitt bnx2 sch_cake nf_conntrack sch_tbf sch_ingress sch_htb sch_hfsc em_u32 cls_u32 cls_tcindex cls_route cls_matchall cls_fw cls_flow
[ 138.004229] cls_basic act_skbedit act_mirred i2c_dev nf_log_ipv6 nf_log_common ip6table_mangle ip6table_filter ip6_tables ip6t_REJECT x_tables nf_reject_ipv6 igb ifb button_hotplug ptp pps_core mii
[ 138.027151] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 4.14.156 #0
[ 138.046308] task: ffffffff81e11480 task.stack: ffffffff81e00000
[ 138.054618] RIP: 0010:0xffffffff816355d3
[ 138.060740] RSP: 0018:ffff888240203e98 EFLAGS: 00010292
[ 138.068314] RAX: 000000000000003a RBX: 0000000000000000 RCX: 0000000000000000
[ 138.077983] RDX: ffff88824021ba60 RSI: ffff888240216358 RDI: ffff888240216358
[ 138.087586] RBP: ffff888240203ec8 R08: 0000000000000000 R09: 000000000000025c
[ 138.097289] R10: 0000000000000040 R11: 0000000000000000 R12: ffff888234f5c000
[ 138.106929] R13: ffff888235bfa080 R14: 0000000000000001 R15: 0000000000000000
[ 138.116609] FS: 0000000000000000(0000) GS:ffff888240200000(0000) knlGS:0000000000000000
[ 138.127258] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 138.135395] CR2: 000000000051c000 CR3: 0000000001e08001 CR4: 00000000000606f0
[ 138.145151] Call Trace:
[ 138.149723] <IRQ>
[ 138.153857] ? 0xffffffff81635480
[ 138.159359] 0xffffffff810cb6cf
[ 138.164631] 0xffffffff810cb864
[ 138.169914] ? 0xffffffff81041691
[ 138.175300] ? 0xffffffff810d6d90
[ 138.180694] 0xffffffff81a000ba
[ 138.185869] 0xffffffff81088e32
[ 138.190997] 0xffffffff818024d7
[ 138.196098] 0xffffffff81801aec
[ 138.201197] </IRQ>
[ 138.205217] RIP: 0010:0xffffffff815b57d3
[ 138.211224] RSP: 0018:ffffffff81e03e40 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff10
[ 138.221202] RAX: ffff88824021e300 RBX: 0000000000000004 RCX: 000000000000001f
[ 138.230767] RDX: 000000201b2d6fb8 RSI: 00000000296254a9 RDI: 0000000000000000
[ 138.240325] RBP: ffffffff81e03e70 R08: 0000000000000004 R09: 000000000001db40
[ 138.249822] R10: ffffffff81e03e10 R11: 0000000000000000 R12: ffff8882402260a8
[ 138.259376] R13: 000000201b2d6fb8 R14: ffffffff81e43138 R15: 0000000000000000
[ 138.268970] 0xffffffff815b5882
[ 138.274204] 0xffffffff810b2483
[ 138.279441] 0xffffffff810b2620
[ 138.284661] 0xffffffff810b27ff
[ 138.289908] 0xffffffff81716b84
[ 138.295161] 0xffffffff81ebaf63
[ 138.300388] 0xffffffff81eba42a
[ 138.305607] 0xffffffff81eba49e
[ 138.310799] 0xffffffff810000d5
[ 138.315963] Code: 00 00 39 c3 75 c0 eb 41 4c 89 e7 c6 05 f5 dc 84 00 01 e8 01 0b fe ff 89 d9 48 89 c2 4c 89 e6 48 c7 c7 30 fb d3 81 e8 79 5b a8 ff <0f> 0b 49 8b 84 24 f0 01 00 00 4c 89 e7 48 8b 40 78 e8 17 ca 3c
[ 138.340277] ---[ end trace 74c30929fd0cf87e ]---
[ 138.347378] e1000e 0000:00:19.0 eth0: Reset adapter unexpectedly
[ 142.234466] e1000e: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: Rx/Tx
Well, seems this is all related to tx/rx flow control/offloading being enable on my onboard nic by default.
I played around offload with settings in pfsense and when it's enabled lots of errors on the onboard nic (by default it's off which explains why it worked well)
In openwrt disableing it with: "ethtool -K gso off gro off tso off" fixes the problem so far.
system
January 14, 2020, 12:19am
4
This topic was automatically closed 10 days after the last reply. New replies are no longer allowed.
