Netgear R7800 exploration (IPQ8065, QCA9984)

anon98444528 · 2021-05-20T17:59:06.413Z

I figured you wanted 5.10 (I'll use dsa as well unless u request not) - just wanted to know if another device would help. I take that as a yes and see if can't start a test Friday afternoon.

Ansuel · 2021-05-20T18:00:12.946Z

yep but keep a backup image with the stable 5.4 so you can quickly switch it

Ansuel · 2021-05-20T21:56:40.111Z

What if i overclock the cpu cache? let's have some fun with breaking my router... AHAHAH

cache 1.6 Ghz no performance increase SAD

having some fun overclocking +300mhz (cache)

Getting down to business... Doing 10 runs per test.
0       Method: MEMCPY  Elapsed: 0.03877        MiB: 32.00000   Copy: 825.402 MiB/s
1       Method: MEMCPY  Elapsed: 0.03915        MiB: 32.00000   Copy: 817.369 MiB/s
2       Method: MEMCPY  Elapsed: 0.03894        MiB: 32.00000   Copy: 821.693 MiB/s
3       Method: MEMCPY  Elapsed: 0.03861        MiB: 32.00000   Copy: 828.694 MiB/s
4       Method: MEMCPY  Elapsed: 0.03958        MiB: 32.00000   Copy: 808.428 MiB/s
5       Method: MEMCPY  Elapsed: 0.03946        MiB: 32.00000   Copy: 810.907 MiB/s
6       Method: MEMCPY  Elapsed: 0.03996        MiB: 32.00000   Copy: 800.861 MiB/s
7       Method: MEMCPY  Elapsed: 0.03859        MiB: 32.00000   Copy: 829.338 MiB/s
8       Method: MEMCPY  Elapsed: 0.03905        MiB: 32.00000   Copy: 819.483 MiB/s
9       Method: MEMCPY  Elapsed: 0.03871        MiB: 32.00000   Copy: 826.767 MiB/s
AVG     Method: MEMCPY  Elapsed: 0.03908        MiB: 32.00000   Copy: 818.793 MiB/s
0       Method: DUMB    Elapsed: 0.18429        MiB: 32.00000   Copy: 173.640 MiB/s
1       Method: DUMB    Elapsed: 0.18249        MiB: 32.00000   Copy: 175.349 MiB/s
2       Method: DUMB    Elapsed: 0.19500        MiB: 32.00000   Copy: 164.100 MiB/s
3       Method: DUMB    Elapsed: 0.18330        MiB: 32.00000   Copy: 174.581 MiB/s
4       Method: DUMB    Elapsed: 0.18185        MiB: 32.00000   Copy: 175.973 MiB/s
5       Method: DUMB    Elapsed: 0.18443        MiB: 32.00000   Copy: 173.505 MiB/s
6       Method: DUMB    Elapsed: 0.18047        MiB: 32.00000   Copy: 177.314 MiB/s
7       Method: DUMB    Elapsed: 0.18082        MiB: 32.00000   Copy: 176.970 MiB/s
8       Method: DUMB    Elapsed: 0.18877        MiB: 32.00000   Copy: 169.520 MiB/s
9       Method: DUMB    Elapsed: 0.18300        MiB: 32.00000   Copy: 174.861 MiB/s
AVG     Method: DUMB    Elapsed: 0.18444        MiB: 32.00000   Copy: 173.496 MiB/s
0       Method: MCBLOCK Elapsed: 0.04025        MiB: 32.00000   Copy: 794.932 MiB/s
1       Method: MCBLOCK Elapsed: 0.03845        MiB: 32.00000   Copy: 832.185 MiB/s
2       Method: MCBLOCK Elapsed: 0.03792        MiB: 32.00000   Copy: 843.904 MiB/s
3       Method: MCBLOCK Elapsed: 0.03828        MiB: 32.00000   Copy: 835.989 MiB/s
4       Method: MCBLOCK Elapsed: 0.03946        MiB: 32.00000   Copy: 810.948 MiB/s
5       Method: MCBLOCK Elapsed: 0.03855        MiB: 32.00000   Copy: 830.069 MiB/s
6       Method: MCBLOCK Elapsed: 0.03994        MiB: 32.00000   Copy: 801.242 MiB/s
7       Method: MCBLOCK Elapsed: 0.03995        MiB: 32.00000   Copy: 801.021 MiB/s
8       Method: MCBLOCK Elapsed: 0.03934        MiB: 32.00000   Copy: 813.380 MiB/s
9       Method: MCBLOCK Elapsed: 0.04072        MiB: 32.00000   Copy: 785.758 MiB/s
AVG     Method: MCBLOCK Elapsed: 0.03929        MiB: 32.00000   Copy: 814.519 MiB/s

testing
1.7 cache
1.9 cpu

max seems to be 1.8 (limitation of the clk devider)
anyway

Using 262144 bytes as blocks for memcpy block copy test.
Getting down to business... Doing 10 runs per test.
0       Method: MEMCPY  Elapsed: 0.03863        MiB: 32.00000   Copy: 828.393 MiB/s
1       Method: MEMCPY  Elapsed: 0.03860        MiB: 32.00000   Copy: 828.973 MiB/s
2       Method: MEMCPY  Elapsed: 0.05544        MiB: 32.00000   Copy: 577.159 MiB/s
3       Method: MEMCPY  Elapsed: 0.03892        MiB: 32.00000   Copy: 822.284 MiB/s
4       Method: MEMCPY  Elapsed: 0.03857        MiB: 32.00000   Copy: 829.574 MiB/s
5       Method: MEMCPY  Elapsed: 0.03889        MiB: 32.00000   Copy: 822.897 MiB/s
6       Method: MEMCPY  Elapsed: 0.03876        MiB: 32.00000   Copy: 825.551 MiB/s
7       Method: MEMCPY  Elapsed: 0.03848        MiB: 32.00000   Copy: 831.558 MiB/s
8       Method: MEMCPY  Elapsed: 0.03763        MiB: 32.00000   Copy: 850.453 MiB/s
9       Method: MEMCPY  Elapsed: 0.03842        MiB: 32.00000   Copy: 832.835 MiB/s
AVG     Method: MEMCPY  Elapsed: 0.04023        MiB: 32.00000   Copy: 795.335 MiB/s
0       Method: DUMB    Elapsed: 0.17428        MiB: 32.00000   Copy: 183.615 MiB/s
1       Method: DUMB    Elapsed: 0.17283        MiB: 32.00000   Copy: 185.156 MiB/s
2       Method: DUMB    Elapsed: 0.17310        MiB: 32.00000   Copy: 184.860 MiB/s
3       Method: DUMB    Elapsed: 0.17276        MiB: 32.00000   Copy: 185.230 MiB/s
4       Method: DUMB    Elapsed: 0.17340        MiB: 32.00000   Copy: 184.545 MiB/s
5       Method: DUMB    Elapsed: 0.17338        MiB: 32.00000   Copy: 184.565 MiB/s
6       Method: DUMB    Elapsed: 0.17385        MiB: 32.00000   Copy: 184.065 MiB/s
7       Method: DUMB    Elapsed: 0.17261        MiB: 32.00000   Copy: 185.392 MiB/s
8       Method: DUMB    Elapsed: 0.17308        MiB: 32.00000   Copy: 184.882 MiB/s
9       Method: DUMB    Elapsed: 0.17292        MiB: 32.00000   Copy: 185.057 MiB/s
AVG     Method: DUMB    Elapsed: 0.17322        MiB: 32.00000   Copy: 184.735 MiB/s
0       Method: MCBLOCK Elapsed: 0.04003        MiB: 32.00000   Copy: 799.480 MiB/s
1       Method: MCBLOCK Elapsed: 0.03818        MiB: 32.00000   Copy: 838.245 MiB/s
2       Method: MCBLOCK Elapsed: 0.03889        MiB: 32.00000   Copy: 822.812 MiB/s
3       Method: MCBLOCK Elapsed: 0.03868        MiB: 32.00000   Copy: 827.365 MiB/s
4       Method: MCBLOCK Elapsed: 0.03810        MiB: 32.00000   Copy: 839.939 MiB/s
5       Method: MCBLOCK Elapsed: 0.04180        MiB: 32.00000   Copy: 765.514 MiB/s
6       Method: MCBLOCK Elapsed: 0.04049        MiB: 32.00000   Copy: 790.319 MiB/s
7       Method: MCBLOCK Elapsed: 0.03902        MiB: 32.00000   Copy: 820.029 MiB/s
8       Method: MCBLOCK Elapsed: 0.03893        MiB: 32.00000   Copy: 822.052 MiB/s
9       Method: MCBLOCK Elapsed: 0.03759        MiB: 32.00000   Copy: 851.403 MiB/s
AVG     Method: MCBLOCK Elapsed: 0.03917        MiB: 32.00000   Copy: 816.964 MiB/s

sumo · 2021-05-20T22:44:24.838Z

Ansuel:

What if i overclock the cpu cache? let's have some fun with breaking my router... AHAHAH

Admit it, you just need to make space for that AX9000 beast! Ahaahaha.

Ansuel · 2021-05-20T22:46:38.045Z

AHAHAHHAHAHAH
i'm even modifying the gcc driver that has a hard limit of 1.8 ghz

trying to find some excuse to not work on the acceleration patch

i was curious if there were actually perf improvement and free perf...

2.0 ghz + cache at 1.7 ghz (but not stable at all and required 3 reboot to actually boot)

root@No-Lag-Router:~# cd /etc/config/openwrt-r7800-freq-test-master/
root@No-Lag-Router:/etc/config/openwrt-r7800-freq-test-master# ./set_scaling_
set_scaling_governor.sh  set_scaling_max_freq.sh
root@No-Lag-Router:/etc/config/openwrt-r7800-freq-test-master# ./set_scaling_governor.sh performance
root@No-Lag-Router:/etc/config/openwrt-r7800-freq-test-master# ./mbw 32
Long uses 4 bytes. Allocating 2*8388608 elements = 67108864 bytes of memory.
Using 262144 bytes as blocks for memcpy block copy test.
Getting down to business... Doing 10 runs per test.
0       Method: MEMCPY  Elapsed: 0.03975        MiB: 32.00000   Copy: 804.991 MiB/s
1       Method: MEMCPY  Elapsed: 0.03708        MiB: 32.00000   Copy: 862.952 MiB/s
2       Method: MEMCPY  Elapsed: 0.03623        MiB: 32.00000   Copy: 883.319 MiB/s
3       Method: MEMCPY  Elapsed: 0.03687        MiB: 32.00000   Copy: 867.985 MiB/s
4       Method: MEMCPY  Elapsed: 0.03645        MiB: 32.00000   Copy: 877.939 MiB/s
5       Method: MEMCPY  Elapsed: 0.03698        MiB: 32.00000   Copy: 865.403 MiB/s
6       Method: MEMCPY  Elapsed: 0.03695        MiB: 32.00000   Copy: 865.941 MiB/s
7       Method: MEMCPY  Elapsed: 0.03738        MiB: 32.00000   Copy: 856.004 MiB/s
8       Method: MEMCPY  Elapsed: 0.03707        MiB: 32.00000   Copy: 863.278 MiB/s
9       Method: MEMCPY  Elapsed: 0.04603        MiB: 32.00000   Copy: 695.184 MiB/s
AVG     Method: MEMCPY  Elapsed: 0.03808        MiB: 32.00000   Copy: 840.358 MiB/s
0       Method: DUMB    Elapsed: 0.15954        MiB: 32.00000   Copy: 200.572 MiB/s
1       Method: DUMB    Elapsed: 0.15660        MiB: 32.00000   Copy: 204.336 MiB/s
2       Method: DUMB    Elapsed: 0.16267        MiB: 32.00000   Copy: 196.711 MiB/s
3       Method: DUMB    Elapsed: 0.15928        MiB: 32.00000   Copy: 200.904 MiB/s
4       Method: DUMB    Elapsed: 0.15926        MiB: 32.00000   Copy: 200.933 MiB/s
5       Method: DUMB    Elapsed: 0.15673        MiB: 32.00000   Copy: 204.168 MiB/s
6       Method: DUMB    Elapsed: 0.16714        MiB: 32.00000   Copy: 191.457 MiB/s
7       Method: DUMB    Elapsed: 0.15790        MiB: 32.00000   Copy: 202.665 MiB/s
8       Method: DUMB    Elapsed: 0.15875        MiB: 32.00000   Copy: 201.579 MiB/s
9       Method: DUMB    Elapsed: 0.16270        MiB: 32.00000   Copy: 196.675 MiB/s
AVG     Method: DUMB    Elapsed: 0.16006        MiB: 32.00000   Copy: 199.927 MiB/s
0       Method: MCBLOCK Elapsed: 0.04054        MiB: 32.00000   Copy: 789.285 MiB/s
1       Method: MCBLOCK Elapsed: 0.04057        MiB: 32.00000   Copy: 788.780 MiB/s
2       Method: MCBLOCK Elapsed: 0.04028        MiB: 32.00000   Copy: 794.439 MiB/s
3       Method: MCBLOCK Elapsed: 0.03758        MiB: 32.00000   Copy: 851.471 MiB/s
4       Method: MCBLOCK Elapsed: 0.03747        MiB: 32.00000   Copy: 854.062 MiB/s
5       Method: MCBLOCK Elapsed: 0.04009        MiB: 32.00000   Copy: 798.164 MiB/s
6       Method: MCBLOCK Elapsed: 0.03746        MiB: 32.00000   Copy: 854.199 MiB/s
7       Method: MCBLOCK Elapsed: 0.03768        MiB: 32.00000   Copy: 849.302 MiB/s
8       Method: MCBLOCK Elapsed: 0.03711        MiB: 32.00000   Copy: 862.394 MiB/s
9       Method: MCBLOCK Elapsed: 0.03977        MiB: 32.00000   Copy: 804.687 MiB/s
AVG     Method: MCBLOCK Elapsed: 0.03885        MiB: 32.00000   Copy: 823.581 MiB/s
root@No-Lag-Router:/etc/config/openwrt-r7800-freq-test-master# ./mbw 32
Long uses 4 bytes. Allocating 2*8388608 elements = 67108864 bytes of memory.
Using 262144 bytes as blocks for memcpy block copy test.
Getting down to business... Doing 10 runs per test.
0       Method: MEMCPY  Elapsed: 0.03751        MiB: 32.00000   Copy: 853.197 MiB/s
1       Method: MEMCPY  Elapsed: 0.03814        MiB: 32.00000   Copy: 838.992 MiB/s
2       Method: MEMCPY  Elapsed: 0.03706        MiB: 32.00000   Copy: 863.465 MiB/s
3       Method: MEMCPY  Elapsed: 0.03773        MiB: 32.00000   Copy: 848.154 MiB/s
4       Method: MEMCPY  Elapsed: 0.03752        MiB: 32.00000   Copy: 852.969 MiB/s
5       Method: MEMCPY  Elapsed: 0.03761        MiB: 32.00000   Copy: 850.815 MiB/s
6       Method: MEMCPY  Elapsed: 0.03746        MiB: 32.00000   Copy: 854.153 MiB/s
7       Method: MEMCPY  Elapsed: 0.03761        MiB: 32.00000   Copy: 850.770 MiB/s
8       Method: MEMCPY  Elapsed: 0.03798        MiB: 32.00000   Copy: 842.504 MiB/s
9       Method: MEMCPY  Elapsed: 0.03746        MiB: 32.00000   Copy: 854.245 MiB/s
AVG     Method: MEMCPY  Elapsed: 0.03761        MiB: 32.00000   Copy: 850.878 MiB/s
0       Method: DUMB    Elapsed: 0.16620        MiB: 32.00000   Copy: 192.545 MiB/s
1       Method: DUMB    Elapsed: 0.15891        MiB: 32.00000   Copy: 201.373 MiB/s
2       Method: DUMB    Elapsed: 0.16325        MiB: 32.00000   Copy: 196.022 MiB/s
3       Method: DUMB    Elapsed: 0.16159        MiB: 32.00000   Copy: 198.030 MiB/s
4       Method: DUMB    Elapsed: 0.16344        MiB: 32.00000   Copy: 195.791 MiB/s
5       Method: DUMB    Elapsed: 0.16073        MiB: 32.00000   Copy: 199.085 MiB/s
6       Method: DUMB    Elapsed: 0.15921        MiB: 32.00000   Copy: 200.992 MiB/s
7       Method: DUMB    Elapsed: 0.17086        MiB: 32.00000   Copy: 187.283 MiB/s
8       Method: DUMB    Elapsed: 0.15729        MiB: 32.00000   Copy: 203.447 MiB/s
9       Method: DUMB    Elapsed: 0.16091        MiB: 32.00000   Copy: 198.866 MiB/s
AVG     Method: DUMB    Elapsed: 0.16224        MiB: 32.00000   Copy: 197.240 MiB/s
0       Method: MCBLOCK Elapsed: 0.03876        MiB: 32.00000   Copy: 825.529 MiB/s
1       Method: MCBLOCK Elapsed: 0.03883        MiB: 32.00000   Copy: 824.063 MiB/s
2       Method: MCBLOCK Elapsed: 0.03809        MiB: 32.00000   Copy: 840.160 MiB/s
3       Method: MCBLOCK Elapsed: 0.03792        MiB: 32.00000   Copy: 843.815 MiB/s
4       Method: MCBLOCK Elapsed: 0.03853        MiB: 32.00000   Copy: 830.586 MiB/s
5       Method: MCBLOCK Elapsed: 0.03926        MiB: 32.00000   Copy: 814.996 MiB/s
6       Method: MCBLOCK Elapsed: 0.03735        MiB: 32.00000   Copy: 856.875 MiB/s
7       Method: MCBLOCK Elapsed: 0.03790        MiB: 32.00000   Copy: 844.327 MiB/s
8       Method: MCBLOCK Elapsed: 0.03877        MiB: 32.00000   Copy: 825.359 MiB/s
9       Method: MCBLOCK Elapsed: 0.03860        MiB: 32.00000   Copy: 828.930 MiB/s
AVG     Method: MCBLOCK Elapsed: 0.03840        MiB: 32.00000   Copy: 833.296 MiB/s

think 1.7 cache and 1.9 ghz could be stable

root@No-Lag-Router:~# cat /sys/devices/system/cpu/cpufreq/policy0/stats/trans_table
   From  :    To
         :    384000    600000    800000   1000000   1400000   1725000   1900000
   384000:         0         2         3         7        10         7         4
   600000:         6         0        45        12         5         6        37
   800000:         7        37         0        10        11        17        18
  1000000:        10        10         5         0        20        30        55
  1400000:         3         7        17        26         0        18        23
  1725000:         4        10         7        27        24         0        34
  1900000:         3        46        22        48        24        28         0

anon98444528 · 2021-05-22T12:10:20.795Z

R7800 cache scaling issue

The test is to build a custom image with a modded cpufreq driver

Sorry, I need a little hand holding.

Exactly what patch(s)/commits do i need for this or is it already included in the kernel 5.10 commits?

EDIT: After

git fetch upstream
git rebase upstream/master
git branch k510
git checkout k510
git pull upstream pull/4036/head

pr 4036 applies without error. Kernel 5.10 is selected by default in this case, i.e.

"Use the testing kernel version" option in the "global build settings" sub menu of menuconfig will not show up.

END EDIT

Also:

r7500v2 # cat /sys/devices/system/cpu/cpufreq/policy0/scaling_governor
ondemand

r7500v2 # cat /etc/rc.local
...
echo 800000 > /sys/devices/system/cpu/cpu0/cpufreq/scaling_min_freq
echo 800000 > /sys/devices/system/cpu/cpu1/cpufreq/scaling_min_freq
echo 75 > /sys/devices/system/cpu/cpufreq/ondemand/up_threshold
echo 10 > /sys/devices/system/cpu/cpufreq/ondemand/sampling_down_factor
echo 1000000 > /sys/devices/system/cpu/cpufreq/ondemand/sampling_rate

# set to cpu 1 instead of 0
echo 2 > /proc/irq/31/smp_affinity 
echo 2 > /proc/irq/32/smp_affinity

Let me know if u want something different than that.

(I'll see if @facboy's mbw binary works on the r7500v2)

EDIT: it does (kernel 5.4 baseline follows)

r7500v2 # ./mbw 32
Long uses 4 bytes. Allocating 2*8388608 elements = 67108864 bytes of memory.
Using 262144 bytes as blocks for memcpy block copy test.
Getting down to business... Doing 10 runs per test.
0       Method: MEMCPY  Elapsed: 0.05374        MiB: 32.00000   Copy: 595.426 MiB/s
1       Method: MEMCPY  Elapsed: 0.04345        MiB: 32.00000   Copy: 736.479 MiB/s
2       Method: MEMCPY  Elapsed: 0.04292        MiB: 32.00000   Copy: 745.556 MiB/s
3       Method: MEMCPY  Elapsed: 0.04333        MiB: 32.00000   Copy: 738.587 MiB/s
4       Method: MEMCPY  Elapsed: 0.04344        MiB: 32.00000   Copy: 736.580 MiB/s
5       Method: MEMCPY  Elapsed: 0.04360        MiB: 32.00000   Copy: 733.894 MiB/s
6       Method: MEMCPY  Elapsed: 0.04356        MiB: 32.00000   Copy: 734.686 MiB/s
7       Method: MEMCPY  Elapsed: 0.04301        MiB: 32.00000   Copy: 743.927 MiB/s
8       Method: MEMCPY  Elapsed: 0.04291        MiB: 32.00000   Copy: 745.799 MiB/s
9       Method: MEMCPY  Elapsed: 0.04330        MiB: 32.00000   Copy: 739.047 MiB/s
AVG     Method: MEMCPY  Elapsed: 0.04433        MiB: 32.00000   Copy: 721.917 MiB/s
0       Method: DUMB    Elapsed: 0.21548        MiB: 32.00000   Copy: 148.505 MiB/s
1       Method: DUMB    Elapsed: 0.21615        MiB: 32.00000   Copy: 148.045 MiB/s
2       Method: DUMB    Elapsed: 0.21574        MiB: 32.00000   Copy: 148.327 MiB/s
3       Method: DUMB    Elapsed: 0.21583        MiB: 32.00000   Copy: 148.268 MiB/s
4       Method: DUMB    Elapsed: 0.21599        MiB: 32.00000   Copy: 148.156 MiB/s
5       Method: DUMB    Elapsed: 0.21554        MiB: 32.00000   Copy: 148.468 MiB/s
6       Method: DUMB    Elapsed: 0.21621        MiB: 32.00000   Copy: 148.001 MiB/s
7       Method: DUMB    Elapsed: 0.21604        MiB: 32.00000   Copy: 148.122 MiB/s
8       Method: DUMB    Elapsed: 0.21601        MiB: 32.00000   Copy: 148.142 MiB/s
9       Method: DUMB    Elapsed: 0.21596        MiB: 32.00000   Copy: 148.176 MiB/s
AVG     Method: DUMB    Elapsed: 0.21589        MiB: 32.00000   Copy: 148.221 MiB/s
0       Method: MCBLOCK Elapsed: 0.04327        MiB: 32.00000   Copy: 739.577 MiB/s
1       Method: MCBLOCK Elapsed: 0.04370        MiB: 32.00000   Copy: 732.249 MiB/s
2       Method: MCBLOCK Elapsed: 0.04324        MiB: 32.00000   Copy: 739.987 MiB/s
3       Method: MCBLOCK Elapsed: 0.04366        MiB: 32.00000   Copy: 732.970 MiB/s
4       Method: MCBLOCK Elapsed: 0.04317        MiB: 32.00000   Copy: 741.290 MiB/s
5       Method: MCBLOCK Elapsed: 0.04376        MiB: 32.00000   Copy: 731.195 MiB/s
6       Method: MCBLOCK Elapsed: 0.04324        MiB: 32.00000   Copy: 740.141 MiB/s
7       Method: MCBLOCK Elapsed: 0.04362        MiB: 32.00000   Copy: 733.558 MiB/s
8       Method: MCBLOCK Elapsed: 0.04365        MiB: 32.00000   Copy: 733.087 MiB/s
9       Method: MCBLOCK Elapsed: 0.04337        MiB: 32.00000   Copy: 737.786 MiB/s
AVG     Method: MCBLOCK Elapsed: 0.04347        MiB: 32.00000   Copy: 736.165 MiB/s

Ansuel · 2021-05-22T12:22:27.395Z

in theory 5.10 should have all the need thing... test for stability and tell me if it does crash

shelterx · 2021-05-23T12:11:59.214Z

For me 5.10 seems stable, but then again, my router rarely does hard work. I guess I could try iperf and run it for an hour or so.

castiel652 · 2021-05-23T16:20:37.624Z

@Ansuel how do you send patch to mailing list?

I tried using git send-email but I think the port got blocked by my uni.

EDIT: nvm I fixed it. Just a typo in my config lol

anon98444528 · 2021-05-23T19:53:22.929Z

Builds and loads fine. A few hours in, no issues. I plan to do another 5.10 dsa build later today, load that, and then I'll let that one go for as long as I can.

r7500v2 # uptime
 15:49:08 up  4:59,  load average: 0.00, 0.02, 0.05
r7500v2 # mbw 32
Long uses 4 bytes. Allocating 2*8388608 elements = 67108864 bytes of memory.
Using 262144 bytes as blocks for memcpy block copy test.
Getting down to business... Doing 10 runs per test.
0       Method: MEMCPY  Elapsed: 0.04399        MiB: 32.00000   Copy: 727.372 MiB/s
1       Method: MEMCPY  Elapsed: 0.04337        MiB: 32.00000   Copy: 737.769 MiB/s
2       Method: MEMCPY  Elapsed: 0.04375        MiB: 32.00000   Copy: 731.445 MiB/s
3       Method: MEMCPY  Elapsed: 0.04338        MiB: 32.00000   Copy: 737.701 MiB/s
4       Method: MEMCPY  Elapsed: 0.04313        MiB: 32.00000   Copy: 742.012 MiB/s
5       Method: MEMCPY  Elapsed: 0.04322        MiB: 32.00000   Copy: 740.329 MiB/s
6       Method: MEMCPY  Elapsed: 0.04290        MiB: 32.00000   Copy: 745.938 MiB/s
7       Method: MEMCPY  Elapsed: 0.04343        MiB: 32.00000   Copy: 736.886 MiB/s
8       Method: MEMCPY  Elapsed: 0.04314        MiB: 32.00000   Copy: 741.788 MiB/s
9       Method: MEMCPY  Elapsed: 0.04287        MiB: 32.00000   Copy: 746.443 MiB/s
AVG     Method: MEMCPY  Elapsed: 0.04332        MiB: 32.00000   Copy: 738.725 MiB/s
0       Method: DUMB    Elapsed: 0.22585        MiB: 32.00000   Copy: 141.686 MiB/s
1       Method: DUMB    Elapsed: 0.22003        MiB: 32.00000   Copy: 145.434 MiB/s
2       Method: DUMB    Elapsed: 0.21724        MiB: 32.00000   Copy: 147.301 MiB/s
3       Method: DUMB    Elapsed: 0.21546        MiB: 32.00000   Copy: 148.521 MiB/s
4       Method: DUMB    Elapsed: 0.21550        MiB: 32.00000   Copy: 148.494 MiB/s
5       Method: DUMB    Elapsed: 0.22330        MiB: 32.00000   Copy: 143.308 MiB/s
6       Method: DUMB    Elapsed: 0.21580        MiB: 32.00000   Copy: 148.285 MiB/s
7       Method: DUMB    Elapsed: 0.21538        MiB: 32.00000   Copy: 148.575 MiB/s
8       Method: DUMB    Elapsed: 0.21532        MiB: 32.00000   Copy: 148.616 MiB/s
9       Method: DUMB    Elapsed: 0.21756        MiB: 32.00000   Copy: 147.085 MiB/s
AVG     Method: DUMB    Elapsed: 0.21814        MiB: 32.00000   Copy: 146.692 MiB/s
0       Method: MCBLOCK Elapsed: 0.04245        MiB: 32.00000   Copy: 753.846 MiB/s
1       Method: MCBLOCK Elapsed: 0.04873        MiB: 32.00000   Copy: 656.639 MiB/s
2       Method: MCBLOCK Elapsed: 0.04319        MiB: 32.00000   Copy: 740.947 MiB/s
3       Method: MCBLOCK Elapsed: 0.04271        MiB: 32.00000   Copy: 749.169 MiB/s
4       Method: MCBLOCK Elapsed: 0.04331        MiB: 32.00000   Copy: 738.894 MiB/s
5       Method: MCBLOCK Elapsed: 0.04275        MiB: 32.00000   Copy: 748.556 MiB/s
6       Method: MCBLOCK Elapsed: 0.04321        MiB: 32.00000   Copy: 740.518 MiB/s
7       Method: MCBLOCK Elapsed: 0.04291        MiB: 32.00000   Copy: 745.712 MiB/s
8       Method: MCBLOCK Elapsed: 0.04304        MiB: 32.00000   Copy: 743.460 MiB/s
9       Method: MCBLOCK Elapsed: 0.04350        MiB: 32.00000   Copy: 735.598 MiB/s
AVG     Method: MCBLOCK Elapsed: 0.04358        MiB: 32.00000   Copy: 734.265 MiB/s
r7500v2 # uname -a
Linux r7500v2 5.10.39 #0 SMP Sun May 23 11:12:18 2021 armv7l GNU/Linux

shelterx · 2021-05-24T11:18:31.562Z

I've ran iptraf3 for an hour now, temps are around 58C... router is stable, no crashes.
Summary:

[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-3600.01 sec   358 GBytes   855 Mbits/sec    0             sender
[  5]   0.00-3600.00 sec   358 GBytes   855 Mbits/sec                  receiver

open.nya · 2021-05-30T09:42:50.528Z

lesandie:

Here the script corrected with the labels eth0 and eth1

It could be shortened/fixed/unified a little:

#!/bin/sh /etc/rc.common

START=99
set_irq_affinity() {
	local name="$1" val="$2"
	local irq
	case "$name" in
		wifi0)  irq=`grep -E 'qcom-pcie-msi' /proc/interrupts | sed "1q;d" | cut -d: -f1 | tr -d ' '` ;;
		wifi1)  irq=`grep -E 'qcom-pcie-msi' /proc/interrupts | sed "2q;d" | cut -d: -f1 | tr -d ' '` ;;
		*)      irq=`grep -E "$name"         /proc/interrupts | sed "1q;d" | cut -d: -f1 | tr -d ' '` ;;
	esac

	[ -n "$irq" ] || echo "$name irq not found."
	echo "$val" > "/proc/irq/$irq/smp_affinity"
}
boot() {
	set_irq_affinity wifi0 2
	set_irq_affinity wifi1 1
	set_irq_affinity eth0 1
	set_irq_affinity eth1 2
}

shelterx · 2021-06-01T13:51:26.992Z

You can't force set the IRQ affinity for wifi on the R7800, it's always bound to cpu 0.

open.nya · 2021-06-01T19:59:04.654Z

That's NOT correct at least for version 19.07:

# cat /proc/interrupts
           CPU0       CPU1
 16:    4761738   11572469     GIC-0  18 Edge      gp_timer
 18:         33          0     GIC-0  51 Edge      qcom_rpm_ack
 19:          0          0     GIC-0  53 Edge      qcom_rpm_err
 20:          0          0     GIC-0  54 Edge      qcom_rpm_wakeup
 26:          0          0     GIC-0 241 Edge      ahci[29000000.sata]
 27:          0          0     GIC-0 210 Edge      tsens_interrupt
 28:   17348416   38919326     GIC-0  67 Edge      qcom-pcie-msi
 29:         35          0     GIC-0  89 Edge      qcom-pcie-msi
 30:     251968          0     GIC-0 202 Edge      adm_dma
 31:   17039152          0     GIC-0 255 Level     eth0
 32:         27    7491548     GIC-0 258 Level     eth1
 33:          0          0     GIC-0 130 Level     bam_dma
 34:          0          0     GIC-0 128 Level     bam_dma
 35:          0          0   PCI-MSI   0 Edge      aerdrv
 36:   17348416   38919326   PCI-MSI   1 Edge      ath10k_pci
 68:          0          0   PCI-MSI   0 Edge      aerdrv
 69:         35          0   PCI-MSI   1 Edge      ath10k_pci
101:          7          0     GIC-0 184 Level     msm_serial0
102:          2          0   msmgpio   6 Edge      keys
103:          2          0   msmgpio  54 Edge      keys
104:          2          0   msmgpio  65 Edge      keys
105:          0          0     GIC-0 142 Level     xhci-hcd:usb1
106:          0          0     GIC-0 237 Level     xhci-hcd:usb3
IPI0:          0          0  CPU wakeup interrupts
IPI1:          0          0  Timer broadcast interrupts
IPI2:    9684241   17396011  Rescheduling interrupts
IPI3:    3140607    1079852  Function call interrupts
IPI4:          0          0  CPU stop interrupts
IPI5:    3506309    5909129  IRQ work interrupts
IPI6:          0          0  completion interrupts
Err:          0

# uname -a
Linux R7800 4.14.221 #0 SMP Mon Feb 22 15:36:55 2021 armv7l GNU/Linux

# ubus call system board
{
        "kernel": "4.14.221",
        "hostname": "R7800",
        "system": "ARMv7 Processor rev 0 (v7l)",
        "model": "Netgear Nighthawk X4S R7800",
        "board_name": "netgear,r7800",
        "release": {
                "distribution": "OpenWrt",
                "version": "19.07-SNAPSHOT",
                "revision": "r11312-e9c0c5021c",
                "target": "ipq806x/generic",
                "description": "OpenWrt 19.07-SNAPSHOT r11312-e9c0c5021c"
        }
}

Ansuel · 2021-06-01T23:27:11.432Z

Will put this here just for the LULZ
My overclocked router still hasn't crashed
Uptime 7d 5h 15m 23s
(1.9 GHz 1.7 Cache)

shelterx · 2021-06-02T09:18:10.656Z

I have never managed to change it, not on kernel 4.14 or 5.10 running the ath10k-ct driver.

 53:   30060003          0   PCI-MSI 524288 Edge      ath10k_pci
 54:   14394481          0   PCI-MSI 134742016 Edge      ath10k_pci

# echo 2 > /proc/irq/54/smp_affinity
ash: write error: Invalid argument

Also regarding the script, this won't match anything on the R7800:
grep -E 'qcom-pcie-msi' /proc/interrupts

This is what @robimarko said about changing IRQ:

robimarko:

DWC PCI controller only has one MSI interrupt so you can't really balance it out.
Only newer revisions have moved to use the GICv2m MSI extension to handle interrupts dynamically.

open.nya · 2021-06-02T09:55:05.512Z

shelterx:

I have never managed to change it, not on kernel 4.14 or 5.10 running the ath10k-ct driver.

As wrote above I am using 19.07 with 4.14.221 kernel and ath10k-ct driver.
I am using the script mentioned above to relocate IRQs related to WiFi devices.
This script is working flawlessly on my system as you can se from the /proc/interrupts statistics.
Answering your note regarding DWC PCI the script is not trying to relocate PCI devices because it is not possible to perform.
It relocates only GIC MSI IRQs by searching qcom-pcie-msi devices in the interrupts list.

robimarko:

Only newer revisions have moved to use the GICv2m MSI extension to handle interrupts dynamically

Could it be that your R7800 device is of the first revisions not supporting GIC MIS for wireless devices?

shelterx · 2021-06-02T11:24:00.393Z

open.nya:

Could it be that your R7800 device is of the first revisions not supporting GIC MIS for wireless devices?

Perhaps, I don't know, I haven't seen any revisions of the R7800, I know Netgear use different flash memory tho' if I remember correctly.

I know you were replying to another post, but since this is thread is about the R7800, for the script to work people need to change qcom-pcie-msi to ath10k_pci then it will output things correctly. But it's not guaranteed it will allow remapping the IRQ for wifi.

open.nya · 2021-06-02T14:19:59.315Z

By searching the forum you can ensure that other people have 'qcom-pcie-msi' devices on 19.07:

@otnert:

 27:   11421904    5427133     GIC-0  67 Edge      qcom-pcie-msi
 28:    4238296    3960502     GIC-0  89 Edge      qcom-pcie-msi

@fantom-x:

28:   52575564          0     GIC-0  67 Edge      qcom-pcie-msi
 29:   16533508          0     GIC-0  89 Edge      qcom-pcie-msi

Also you could search for '/proc/irq/28/smp_affinity' to ensure that there are many people reporting to have GIC IRQs 28 and 29 in their systems running ver. 19.07.

As I can get you are running system other than 19.07 right now.
Maybe it would be more correct for you to make such categorical statements only regarding the build you are running on?

shelterx · 2021-06-02T17:37:32.611Z

I've been running master builds since the very begining, I'm pretty sure my wifi devices have always been named ath10k_pci for me but I could be wrong. Weird and I'm sorry but I thought the R7800 was the same for all.
Perhaps some developer can explain why some have ath10k_pci and some qcom-pcie-msi? Are there different HW revisions after all? Or is it because of the kernel change?

On kernel 4.14 the IRQ's were 45 and 46 for me.
On kernel 5.10 using DSA which i'm running now the IRQs are 53 and 54.