CAKE w/ Adaptive Bandwidth [August 2022 to March 2024]

Oops, sorry for the language confusion, I apparently was already asleep. About the value I am in no position to tell, this is mostly a policy decision where you need to be comfortable with the resultingbthroughput/responsiveness combination.

Here is what I changed in the code:

Do you see any issues?

The ewma is used throughout for control purposes, but the original is kept and both are logged.

As I mentioned before the default should be to not use low pass filtering here but simply just use the most recent sample veridically.

By the way I'm not sure the use of ewma necessarily increases throughput. On achieved rate ascent and sometimes at bufferbloat the smoothed achieved rate is lower.

Well, according to your graphs I am confident that on average the EWMA here will result in higher throughput and likely in higher delay as well. Not in each and every instance but on average. Why? Well it clearly results in a higher rate estimate at times of bufferbloat, so will result in a less steep rate reduction, and on the rate increases it will also be a bit more sluggish, but there we already act proactively and increase rates once we exceed X% of load. Here the EWMA will gently underestimate the true load, but our increase threshold that still gives us headroom as the real load takes some time to actually reach the current ceiling and if we manage to push the ceiling higher in the time it takes to reach the current ceiling we do not loose much throughput here....

I think the best argument for a mild EWMA could be that smoothing the load estimate will make the control loop less noisy/jumpy, but again this only helps if the underlying rat changes are still slower (or at least not noticeably faster) than the 'slowed' achieved rate estimate.

It seems you are right.

Here are some of the download bufferbloat events:

DATA; 2023-07-23-21:32:25; 1690144345.625993; 1690144345.625275; 18372; 11688; 664; 412; 57; 2; 1690144345.585390; 1.0.0.1; 65; 18366; 63500; 7463; 45134; 41140; 18366; 63500; 7463; 45134; 40666; 3; 3; dl_high_bb; ul_idle_bb; 10519; 18000
DATA; 2023-07-23-21:32:25; 1690144345.631993; 1690144345.631243; 18372; 11688; 664; 412; 111; 2; 1690144345.591870; 8.8.8.8; 65; 19208; 41550; 4642; 22342; 41140; 19208; 41550; 4642; 22342; 40666; 3; 3; dl_high_bb; ul_idle_bb; 10519; 18000
DATA; 2023-07-23-21:32:26; 1690144346.559172; 1690144346.558196; 10725; 11120; 703; 492; 95; 2; 1690144346.495370; 1.1.1.1; 68; 18407; 91500; 4995; 73093; 41199; 18407; 91500; 4995; 73093; 40733; 3; 3; dl_high_bb; ul_idle_bb; 10008; 16362
DATA; 2023-07-23-21:32:26; 1690144346.568081; 1690144346.567163; 10725; 11120; 703; 492; 111; 3; 1690144346.495460; 9.9.9.10; 67; 19045; 116500; 5729; 97455; 41199; 19045; 116500; 5729; 97455; 40733; 4; 4; dl_high_bb; ul_idle_bb; 10008; 16362
DATA; 2023-07-23-21:32:26; 1690144346.583298; 1690144346.580150; 10897; 11075; 720; 537; 110; 3; 1690144346.534110; 1.0.0.1; 68; 18528; 86000; 7463; 67472; 41199; 18528; 86000; 7463; 67472; 40733; 5; 5; dl_high_bb; ul_idle_bb; 10008; 16362
DATA; 2023-07-23-21:32:26; 1690144346.591420; 1690144346.590644; 10897; 11075; 720; 537; 110; 3; 1690144346.581510; 8.8.8.8; 68; 19326; 84500; 4642; 65174; 41199; 19326; 84500; 4642; 65174; 40733; 6; 6; dl_high_bb; ul_idle_bb; 10008; 16362
DATA; 2023-07-23-21:32:26; 1690144346.614099; 1690144346.612757; 10897; 11075; 720; 537; 110; 3; 1690144346.601150; 9.9.9.9; 68; 18872; 42250; 7361; 23378; 41199; 18872; 42250; 7361; 23378; 40733; 5; 5; dl_high_bb; ul_idle_bb; 10008; 16362
DATA; 2023-07-23-21:32:26; 1690144346.660009; 1690144346.657526; 10897; 11075; 720; 537; 110; 3; 1690144346.641780; 9.9.9.10; 68; 19063; 37500; 5729; 18437; 41199; 19063; 37500; 5729; 18437; 40733; 4; 4; dl_high_bb; ul_idle_bb; 10008; 16362
DATA; 2023-07-23-21:32:26; 1690144346.726982; 1690144346.725907; 10897; 11075; 720; 537; 110; 3; 1690144346.707860; 1.1.1.1; 69; 18434; 45500; 4995; 27066; 41199; 18434; 45500; 4995; 27066; 40733; 3; 3; dl_high_bb; ul_idle_bb; 10008; 16362
DATA; 2023-07-23-21:32:28; 1690144348.206888; 1690144348.206003; 10388; 10318; 617; 624; 83; 3; 1690144348.161490; 8.8.4.4; 73; 19928; 88500; 4954; 68572; 41292; 19928; 88500; 4954; 68572; 40806; 3; 3; dl_high_bb; ul_idle_bb; 9286; 14872
DATA; 2023-07-23-21:32:28; 1690144348.213730; 1690144348.212506; 10388; 10318; 617; 624; 111; 4; 1690144348.174080; 9.9.9.10; 73; 19114; 44350; 5729; 25236; 41292; 19114; 44350; 5729; 25236; 40806; 3; 3; dl_high_bb; ul_idle_bb; 9286; 14872
DATA; 2023-07-23-21:32:28; 1690144348.220965; 1690144348.219962; 10388; 10318; 617; 624; 111; 4; 1690144348.179460; 1.1.1.1; 74; 18470; 22000; 4995; 3530; 41292; 18470; 22000; 4995; 3530; 40806; 3; 3; dl_high_bb; ul_idle_bb; 9286; 14872
DATA; 2023-07-23-21:32:28; 1690144348.359826; 1690144348.358888; 8925; 10039; 553; 609; 108; 4; 1690144348.332070; 1.0.0.1; 74; 18730; 73000; 7463; 54270; 41292; 18730; 73000; 7463; 54270; 40806; 4; 4; dl_high_bb; ul_idle_bb; 9286; 14872
DATA; 2023-07-23-21:32:28; 1690144348.366842; 1690144348.366172; 8925; 10039; 553; 609; 108; 4; 1690144348.346090; 8.8.8.8; 74; 19490; 55000; 4642; 35510; 41292; 19490; 55000; 4642; 35510; 40806; 3; 3; dl_high_bb; ul_idle_bb; 9286; 14872
DATA; 2023-07-23-21:32:29; 1690144349.303317; 1690144349.302490; 8098; 8761; 488; 543; 84; 3; 1690144349.267470; 8.8.8.8; 77; 19604; 64000; 4642; 44396; 41522; 19604; 64000; 4642; 44396; 40887; 3; 3; dl_high_bb; ul_idle_bb; 7884; 13518
DATA; 2023-07-23-21:32:29; 1690144349.357478; 1690144349.356513; 7163; 8441; 498; 534; 107; 3; 1690144349.343830; 9.9.9.10; 77; 19216; 26700; 5729; 7484; 41522; 19216; 26700; 5729; 7484; 40887; 3; 3; dl_high_bb; ul_idle_bb; 7884; 13518
DATA; 2023-07-23-21:32:29; 1690144349.374006; 1690144349.373240; 7163; 8441; 498; 534; 107; 3; 1690144349.349660; 8.8.4.4; 77; 20015; 79500; 4954; 59485; 41522; 20015; 79500; 4954; 59485; 40887; 3; 3; dl_high_bb; ul_idle_bb; 7884; 13518
DATA; 2023-07-23-21:32:29; 1690144349.455312; 1690144349.453871; 7163; 8441; 498; 534; 107; 3; 1690144349.440170; 1.1.1.1; 78; 18557; 49250; 4995; 30693; 41522; 18557; 49250; 4995; 30693; 40887; 3; 3; dl_high_bb; ul_idle_bb; 7884; 13518
DATA; 2023-07-23-21:32:36; 1690144356.447748; 1690144356.446585; 27652; 22537; 898; 620; 80; 4; 1690144356.402680; 9.9.9.10; 100; 19535; 89000; 5729; 69465; 40591; 19535; 89000; 5729; 69465; 40920; 3; 3; dl_high_bb; ul_idle_bb; 20283; 13041
DATA; 2023-07-23-21:32:36; 1690144356.460499; 1690144356.459198; 27652; 22537; 898; 620; 111; 4; 1690144356.402790; 1.1.1.1; 101; 18919; 64000; 4995; 45081; 40591; 18919; 64000; 4995; 45081; 40920; 3; 3; dl_high_bb; ul_idle_bb; 20283; 13041
DATA; 2023-07-23-21:32:36; 1690144356.520621; 1690144356.519022; 27652; 22537; 898; 620; 111; 4; 1690144356.497780; 1.0.0.1; 101; 19229; 86500; 7463; 67271; 40591; 19229; 86500; 7463; 67271; 40920; 4; 4; dl_high_bb; ul_idle_bb; 20283; 13041
DATA; 2023-07-23-21:32:36; 1690144356.574980; 1690144356.573690; 27652; 22537; 898; 620; 111; 4; 1690144356.551470; 8.8.4.4; 101; 20305; 63000; 4954; 42695; 40591; 20305; 63000; 4954; 42695; 40920; 5; 5; dl_high_bb; ul_idle_bb; 20283; 13041
DATA; 2023-07-23-21:32:36; 1690144356.626871; 1690144356.625344; 20790; 22187; 801; 656; 109; 5; 1690144356.612130; 9.9.9.9; 101; 19392; 68500; 7361; 49108; 40591; 19392; 68500; 7361; 49108; 40920; 6; 6; dl_high_bb; ul_idle_bb; 20283; 13041
DATA; 2023-07-23-21:32:36; 1690144356.669320; 1690144356.667589; 20790; 22187; 801; 656; 109; 5; 1690144356.647550; 9.9.9.10; 101; 19576; 61000; 5729; 41424; 40591; 19576; 61000; 5729; 41424; 40920; 6; 6; dl_high_bb; ul_idle_bb; 20283; 13041
DATA; 2023-07-23-21:32:36; 1690144356.685878; 1690144356.684835; 20790; 22187; 801; 656; 109; 5; 1690144356.671950; 1.1.1.1; 102; 18948; 48200; 4995; 29252; 40591; 18948; 48200; 4995; 29252; 40920; 5; 5; dl_high_bb; ul_idle_bb; 20283; 13041
DATA; 2023-07-23-21:32:36; 1690144356.765696; 1690144356.764398; 20790; 22187; 801; 656; 109; 5; 1690144356.725480; 1.0.0.1; 102; 19259; 49900; 7463; 30641; 40657; 19259; 49900; 7463; 30641; 41022; 4; 4; dl_high_bb; ul_idle_bb; 18254; 11736
DATA; 2023-07-23-21:32:36; 1690144356.773725; 1690144356.772605; 20790; 22187; 801; 656; 121; 5; 1690144356.743780; 8.8.8.8; 102; 19947; 33950; 4642; 14003; 40657; 19947; 33950; 4642; 14003; 41022; 3; 3; dl_high_bb; ul_idle_bb; 18254; 11736
DATA; 2023-07-23-21:32:37; 1690144357.882179; 1690144357.881280; 17158; 18374; 994; 798; 89; 6; 1690144357.861880; 8.8.4.4; 105; 20544; 115500; 4954; 94956; 40725; 20544; 115500; 4954; 94956; 41012; 3; 2; dl_high_bb; ul_idle; 16536; 11853
DATA; 2023-07-23-21:32:37; 1690144357.910014; 1690144357.908501; 17158; 18374; 994; 798; 111; 6; 1690144357.861980; 9.9.9.9; 105; 19501; 90500; 7361; 70999; 40725; 19501; 90500; 7361; 70999; 41124; 4; 3; dl_high_bb; ul_idle_bb; 16536; 10667
DATA; 2023-07-23-21:32:37; 1690144357.930630; 1690144357.929807; 17158; 18374; 994; 798; 111; 7; 1690144357.886480; 1.1.1.1; 106; 19074; 52500; 4995; 33426; 40725; 19074; 52500; 4995; 33426; 41113; 3; 2; dl_high_bb; ul_idle; 16536; 10773
DATA; 2023-07-23-21:32:37; 1690144357.940266; 1690144357.939152; 17158; 18374; 994; 798; 111; 7; 1690144357.891750; 9.9.9.10; 105; 19741; 80000; 5729; 60259; 40725; 19741; 80000; 5729; 60259; 41113; 3; 3; dl_high_bb; ul_idle_bb; 16536; 10773
DATA; 2023-07-23-21:32:37; 1690144357.949175; 1690144357.948176; 17158; 18374; 994; 798; 111; 7; 1690144357.891840; 1.0.0.1; 106; 19311; 29950; 7463; 10639; 40725; 19311; 29950; 7463; 10639; 41113; 3; 3; dl_high_bb; ul_idle_bb; 16536; 10773
DATA; 2023-07-23-21:32:38; 1690144358.117352; 1690144358.116099; 14192; 17537; 752; 788; 106; 7; 1690144358.104310; 8.8.8.8; 106; 20091; 111000; 4642; 90909; 40725; 20091; 111000; 4642; 90909; 41113; 4; 4; dl_high_bb; ul_idle_bb; 16536; 10773
DATA; 2023-07-23-21:32:38; 1690144358.134056; 1690144358.133153; 14192; 17537; 752; 788; 106; 7; 1690144358.122120; 8.8.4.4; 106; 20618; 95000; 4954; 74382; 40725; 20618; 95000; 4954; 74382; 41113; 4; 4; dl_high_bb; ul_idle_bb; 16536; 10773
DATA; 2023-07-23-21:32:38; 1690144358.167157; 1690144358.166093; 14192; 17537; 752; 788; 106; 7; 1690144358.151780; 9.9.9.9; 106; 19565; 84500; 7361; 64935; 40725; 19565; 84500; 7361; 64935; 41113; 4; 4; dl_high_bb; ul_idle_bb; 16536; 10773
DATA; 2023-07-23-21:32:38; 1690144358.185861; 1690144358.185003; 14192; 17537; 752; 788; 106; 7; 1690144358.151890; 9.9.9.10; 106; 19780; 59500; 5729; 39720; 40806; 19780; 59500; 5729; 39720; 41113; 4; 4; dl_high_bb; ul_idle_bb; 14882; 10773
DATA; 2023-07-23-21:32:38; 1690144358.220846; 1690144358.219823; 14192; 17537; 752; 788; 117; 7; 1690144358.199500; 1.1.1.1; 107; 19113; 58500; 4995; 39387; 40806; 19113; 58500; 4995; 39387; 41237; 3; 3; dl_high_bb; ul_idle_bb; 14882; 9695
DATA; 2023-07-23-21:32:38; 1690144358.227124; 1690144358.226236; 14192; 17537; 752; 788; 117; 8; 1690144358.200310; 1.0.0.1; 107; 19325; 33700; 7463; 14375; 40806; 19325; 33700; 7463; 14375; 41237; 3; 3; dl_high_bb; ul_idle_bb; 14882; 9695
DATA; 2023-07-23-21:32:38; 1690144358.566453; 1690144358.565594; 9910; 15099; 595; 731; 100; 7; 1690144358.534140; 1.1.1.1; 108; 19169; 75500; 4995; 56331; 40887; 19169; 75500; 4995; 56331; 41375; 3; 3; dl_high_bb; ul_idle_bb; 13527; 8725
DATA; 2023-07-23-21:32:38; 1690144358.640297; 1690144358.639579; 9910; 15099; 595; 731; 111; 8; 1690144358.618540; 8.8.8.8; 108; 20162; 67500; 4642; 47338; 40887; 20162; 67500; 4642; 47338; 41375; 4; 4; dl_high_bb; ul_idle_bb; 13527; 8725
DATA; 2023-07-23-21:32:38; 1690144358.648813; 1690144358.648035; 8874; 13854; 573; 699; 102; 8; 1690144358.618660; 1.0.0.1; 108; 19398; 92500; 7463; 73102; 40887; 19398; 92500; 7463; 73102; 41375; 5; 5; dl_high_bb; ul_idle_bb; 13527; 8725
DATA; 2023-07-23-21:32:38; 1690144358.654621; 1690144358.653919; 8874; 13854; 573; 699; 102; 8; 1690144358.618720; 8.8.4.4; 108; 20646; 42250; 4954; 21604; 40887; 20646; 42250; 4954; 21604; 41375; 5; 5; dl_high_bb; ul_idle_bb; 13527; 8725
DATA; 2023-07-23-21:32:38; 1690144358.703240; 1690144358.701991; 8874; 13854; 573; 699; 102; 8; 1690144358.686140; 9.9.9.9; 108; 19647; 51000; 7361; 31353; 40887; 19647; 51000; 7361; 31353; 41375; 4; 4; dl_high_bb; ul_idle_bb; 13527; 8725
DATA; 2023-07-23-21:32:38; 1690144358.710278; 1690144358.709370; 8874; 13854; 573; 699; 102; 8; 1690144358.686260; 9.9.9.10; 108; 19856; 25850; 5729; 5994; 40887; 19856; 25850; 5729; 5994; 41375; 3; 3; dl_high_bb; ul_idle_bb; 13527; 8725
DATA; 2023-07-23-21:32:39; 1690144359.536410; 1690144359.535700; 11084; 11109; 617; 625; 72; 7; 1690144359.505010; 1.0.0.1; 111; 19508; 84000; 7463; 64492; 41200; 19508; 84000; 7463; 64492; 41513; 3; 3; dl_high_bb; ul_idle_bb; 9998; 7930
DATA; 2023-07-23-21:32:39; 1690144359.544175; 1690144359.542681; 11084; 11109; 617; 625; 111; 7; 1690144359.510810; 8.8.8.8; 111; 20294; 62000; 4642; 41706; 41200; 20294; 62000; 4642; 41706; 41513; 3; 3; dl_high_bb; ul_idle_bb; 9998; 7930
DATA; 2023-07-23-21:32:39; 1690144359.566373; 1690144359.565455; 11084; 11109; 617; 625; 111; 7; 1690144359.554790; 9.9.9.9; 111; 19728; 33850; 7361; 14122; 41200; 19728; 33850; 7361; 14122; 41513; 3; 3; dl_high_bb; ul_idle_bb; 9998; 7930
DATA; 2023-07-23-21:32:39; 1690144359.575599; 1690144359.574243; 11084; 11109; 617; 625; 111; 7; 1690144359.554880; 8.8.4.4; 111; 20738; 59000; 4954; 38262; 41200; 20738; 59000; 4954; 38262; 41513; 3; 3; dl_high_bb; ul_idle_bb; 9998; 7930
DATA; 2023-07-23-21:32:39; 1690144359.600695; 1690144359.599107; 11084; 11109; 617; 625; 111; 7; 1690144359.589020; 9.9.9.10; 111; 19906; 25900; 5729; 5994; 41200; 19906; 25900; 5729; 5994; 41513; 3; 3; dl_high_bb; ul_idle_bb; 9998; 7930
DATA; 2023-07-23-21:32:43; 1690144363.650965; 1690144363.649847; 16721; 14504; 1458; 814; 74; 9; 1690144363.617040; 9.9.9.10; 124; 20071; 83000; 5729; 62929; 40919; 20071; 83000; 5729; 62929; 41616; 3; 3; dl_high_bb; ul_low_bb; 13053; 7425
DATA; 2023-07-23-21:32:43; 1690144363.660524; 1690144363.659454; 16721; 14504; 1458; 814; 111; 10; 1690144363.618200; 1.1.1.1; 125; 19482; 58500; 4995; 39018; 40919; 19482; 58500; 4995; 39018; 41616; 3; 3; dl_high_bb; ul_low_bb; 13053; 7425
DATA; 2023-07-23-21:32:43; 1690144363.710536; 1690144363.709263; 15946; 14792; 693; 789; 113; 10; 1690144363.694030; 1.0.0.1; 125; 19758; 71500; 7463; 51742; 40919; 19758; 71500; 7463; 51742; 41616; 4; 4; dl_high_bb; ul_idle_bb; 13053; 7425
DATA; 2023-07-23-21:32:43; 1690144363.719812; 1690144363.719047; 15946; 14792; 693; 789; 113; 10; 1690144363.700840; 8.8.8.8; 125; 20488; 49750; 4642; 29262; 40919; 20488; 49750; 4642; 29262; 41616; 4; 4; dl_high_bb; ul_idle_bb; 13053; 7425
DATA; 2023-07-23-21:32:43; 1690144363.760514; 1690144363.758857; 15946; 14792; 693; 789; 113; 10; 1690144363.745010; 8.8.4.4; 125; 20966; 46800; 4954; 25834; 40919; 20966; 46800; 4954; 25834; 41616; 3; 3; dl_high_bb; ul_idle_bb; 13053; 7425
DATA; 2023-07-23-21:32:43; 1690144363.877960; 1690144363.876847; 11559; 14145; 483; 727; 108; 9; 1690144363.860130; 9.9.9.9; 125; 20040; 79500; 7361; 59460; 40919; 20040; 79500; 7361; 59460; 41616; 3; 3; dl_high_bb; ul_idle_bb; 13053; 7425
DATA; 2023-07-23-21:32:43; 1690144363.908348; 1690144363.907275; 11559; 14145; 483; 727; 108; 9; 1690144363.898480; 9.9.9.10; 125; 20124; 73500; 5729; 53376; 40919; 20124; 73500; 5729; 53376; 41616; 3; 3; dl_high_bb; ul_idle_bb; 13053; 7425
DATA; 2023-07-23-21:32:43; 1690144363.922652; 1690144363.921823; 11559; 14145; 483; 727; 108; 9; 1690144363.913450; 1.1.1.1; 126; 19518; 56000; 4995; 36482; 40919; 19518; 56000; 4995; 36482; 41616; 3; 3; dl_high_bb; ul_idle_bb; 13053; 7425
DATA; 2023-07-23-21:32:45; 1690144365.755739; 1690144365.754722; 14025; 13398; 634; 898; 77; 11; 1690144365.734060; 1.1.1.1; 132; 19613; 63500; 4995; 43887; 40995; 19613; 63500; 4995; 43887; 41584; 3; 2; dl_high_bb; ul_idle; 12058; 7573
DATA; 2023-07-23-21:32:45; 1690144365.786372; 1690144365.785262; 14025; 13398; 634; 898; 111; 11; 1690144365.775600; 1.0.0.1; 132; 19900; 59000; 7463; 39100; 40995; 19900; 59000; 7463; 39100; 41584; 3; 2; dl_high_bb; ul_idle; 12058; 7573
DATA; 2023-07-23-21:32:45; 1690144365.828837; 1690144365.827904; 14025; 13398; 634; 898; 111; 11; 1690144365.811820; 8.8.8.8; 132; 20584; 52000; 4642; 31416; 40995; 20584; 52000; 4642; 31416; 41584; 3; 2; dl_high_bb; ul_idle; 12058; 7573
DATA; 2023-07-23-21:32:48; 1690144368.929204; 1690144368.928102; 19071; 15762; 775; 682; 78; 8; 1690144368.846230; 8.8.8.8; 142; 20785; 65000; 4642; 44215; 40845; 20785; 65000; 4642; 44215; 41709; 3; 3; dl_high_bb; ul_idle_bb; 14185; 7020
DATA; 2023-07-23-21:32:48; 1690144368.941236; 1690144368.938859; 19071; 15762; 775; 682; 111; 9; 1690144368.872430; 8.8.4.4; 142; 20968; 53000; 4954; 32032; 40845; 20968; 53000; 4954; 32032; 41709; 3; 3; dl_high_bb; ul_idle_bb; 14185; 7020
DATA; 2023-07-23-21:33:02; 1690144382.185986; 1690144382.176543; 35405; 32538; 1629; 1809; 113; 14; 1690144382.161730; 1.0.0.1; 186; 20720; 120000; 9933; 99280; 40419; 20720; 120000; 9933; 99280; 40930; 4; 4; dl_high_bb; ul_low_bb; 28639; 12890
DATA; 2023-07-23-21:33:02; 1690144382.215536; 1690144382.213898; 35405; 32538; 1629; 1809; 113; 14; 1690144382.161860; 1.1.1.1; 186; 20522; 145000; 8930; 124478; 40419; 20522; 145000; 8930; 124478; 40930; 5; 5; dl_high_bb; ul_low_bb; 28639; 12890
DATA; 2023-07-23-21:33:02; 1690144382.249917; 1690144382.247860; 35405; 32538; 1629; 1809; 113; 14; 1690144382.168630; 9.9.9.10; 185; 20948; 173500; 8499; 152552; 40419; 20948; 173500; 8499; 152552; 40930; 6; 6; dl_high_bb; ul_low_bb; 28639; 12890
DATA; 2023-07-23-21:33:02; 1690144382.258653; 1690144382.257522; 35405; 32538; 1629; 1809; 113; 14; 1690144382.204070; 8.8.8.8; 186; 21399; 116000; 13559; 94601; 40419; 21399; 116000; 13559; 94601; 40930; 6; 6; dl_high_bb; ul_low_bb; 28639; 12890
DATA; 2023-07-23-21:33:02; 1690144382.267002; 1690144382.266031; 35405; 32538; 1629; 1809; 113; 14; 1690144382.221800; 9.9.9.9; 186; 20817; 74500; 14520; 53683; 40419; 20817; 74500; 14520; 53683; 40930; 6; 6; dl_high_bb; ul_low_bb; 28639; 12890
DATA; 2023-07-23-21:33:02; 1690144382.312111; 1690144382.309957; 20887; 30207; 1784; 1804; 105; 13; 1690144382.228300; 9.9.9.10; 186; 20979; 52500; 8499; 31521; 40465; 20979; 52500; 8499; 31521; 41034; 5; 5; dl_high_bb; ul_low_bb; 25775; 11601
DATA; 2023-07-23-21:33:02; 1690144382.461385; 1690144382.459366; 27731; 29711; 1371; 1717; 115; 14; 1690144382.445980; 1.0.0.1; 187; 20810; 111000; 9933; 90190; 40465; 20810; 111000; 9933; 90190; 41034; 5; 5; dl_high_bb; ul_low_bb; 25775; 11601
DATA; 2023-07-23-21:33:02; 1690144382.641159; 1690144382.640056; 27731; 29711; 1371; 1717; 115; 14; 1690144382.610530; 1.1.1.1; 188; 20569; 68000; 8930; 47431; 40517; 20569; 68000; 8930; 47431; 41149; 5; 5; dl_high_bb; ul_low_bb; 23197; 10440
DATA; 2023-07-23-21:33:02; 1690144382.666597; 1690144382.664900; 25466; 28862; 1258; 1625; 124; 15; 1690144382.643490; 1.0.0.1; 188; 20848; 59500; 9933; 38652; 40517; 20848; 59500; 9933; 38652; 41149; 4; 4; dl_high_bb; ul_low_bb; 23197; 10440
DATA; 2023-07-23-21:33:02; 1690144382.774285; 1690144382.769694; 25466; 28862; 1258; 1625; 124; 15; 1690144382.749100; 8.8.8.8; 188; 21464; 87000; 13559; 65536; 40517; 21464; 87000; 13559; 65536; 41149; 4; 4; dl_high_bb; ul_low_bb; 23197; 10440
DATA; 2023-07-23-21:33:02; 1690144382.800039; 1690144382.796659; 25466; 28862; 1258; 1625; 124; 15; 1690144382.766000; 8.8.4.4; 188; 21565; 68500; 11603; 46935; 40517; 21565; 68500; 11603; 46935; 41149; 4; 4; dl_high_bb; ul_low_bb; 23197; 10440
DATA; 2023-07-23-21:33:02; 1690144382.815582; 1690144382.814582; 25466; 28862; 1258; 1625; 124; 15; 1690144382.772640; 9.9.9.9; 188; 20842; 46800; 14520; 25958; 40517; 20842; 46800; 14520; 25958; 41149; 4; 4; dl_high_bb; ul_low_bb; 23197; 10440
DATA; 2023-07-23-21:33:02; 1690144382.824810; 1690144382.823699; 25466; 28862; 1258; 1625; 124; 15; 1690144382.795800; 9.9.9.10; 188; 20991; 33250; 8499; 12259; 40517; 20991; 33250; 8499; 12259; 41149; 3; 3; dl_high_bb; ul_low_bb; 23197; 10440
DATA; 2023-07-23-21:33:02; 1690144382.981649; 1690144382.979980; 23692; 27828; 1229; 1545; 119; 14; 1690144382.952210; 1.0.0.1; 189; 20888; 61500; 9933; 40612; 40574; 20888; 61500; 9933; 40612; 41138; 3; 2; dl_high_bb; ul_low; 20877; 10544
DATA; 2023-07-23-21:33:03; 1690144383.025098; 1690144383.023523; 23692; 27828; 1229; 1545; 133; 14; 1690144383.006490; 8.8.8.8; 189; 21506; 63500; 13559; 41994; 40574; 21506; 63500; 13559; 41994; 41138; 3; 2; dl_high_bb; ul_low; 20877; 10544
DATA; 2023-07-23-21:33:03; 1690144383.148684; 1690144383.147530; 22812; 26824; 1082; 1452; 128; 13; 1690144383.128970; 9.9.9.9; 189; 20895; 74500; 14520; 53605; 40574; 20895; 74500; 14520; 53605; 41138; 3; 2; dl_high_bb; ul_low; 20877; 10544
DATA; 2023-07-23-21:33:03; 1690144383.301440; 1690144383.300451; 20516; 25562; 1383; 1438; 122; 13; 1690144383.261920; 1.0.0.1; 190; 20932; 65500; 9933; 44568; 40638; 20932; 65500; 9933; 44568; 41264; 4; 3; dl_high_bb; ul_low_bb; 18789; 9489
DATA; 2023-07-23-21:33:03; 1690144383.310996; 1690144383.309474; 20516; 25562; 1383; 1438; 136; 15; 1690144383.262490; 1.1.1.1; 190; 20674; 91000; 8930; 70326; 40638; 20674; 91000; 8930; 70326; 41264; 5; 4; dl_high_bb; ul_low_bb; 18789; 9489
DATA; 2023-07-23-21:33:03; 1690144383.319096; 1690144383.317944; 20516; 25562; 1383; 1438; 136; 15; 1690144383.298050; 8.8.4.4; 190; 21592; 33150; 11603; 11558; 40638; 21592; 33150; 11603; 11558; 41264; 4; 4; dl_high_bb; ul_low_bb; 18789; 9489
DATA; 2023-07-23-21:33:03; 1690144383.424345; 1690144383.422051; 20516; 25562; 1383; 1438; 136; 15; 1690144383.406100; 9.9.9.10; 190; 21007; 37000; 8499; 15993; 40638; 21007; 37000; 8499; 15993; 41264; 3; 3; dl_high_bb; ul_low_bb; 18789; 9489
DATA; 2023-07-23-21:33:03; 1690144383.436813; 1690144383.434504; 20516; 25562; 1383; 1438; 136; 15; 1690144383.407620; 9.9.9.9; 190; 20937; 63000; 14520; 42063; 40638; 20937; 63000; 14520; 42063; 41264; 4; 4; dl_high_bb; ul_low_bb; 18789; 9489
DATA; 2023-07-23-21:33:03; 1690144383.512347; 1690144383.511199; 19182; 24286; 762; 1302; 129; 13; 1690144383.496300; 1.0.0.1; 191; 20943; 31950; 9933; 11007; 40638; 20943; 31950; 9933; 11007; 41264; 3; 3; dl_high_bb; ul_idle_bb; 18789; 9489
DATA; 2023-07-23-21:33:04; 1690144384.860824; 1690144384.859843; 20624; 20904; 1072; 989; 89; 10; 1690144384.792380; 1.0.0.1; 195; 21034; 78000; 9933; 56966; 40637; 21034; 78000; 9933; 56966; 41391; 3; 3; dl_high_bb; ul_low_bb; 18813; 8624
DATA; 2023-07-23-21:33:04; 1690144384.870857; 1690144384.869979; 20624; 20904; 1072; 989; 111; 11; 1690144384.792960; 8.8.4.4; 195; 21677; 27850; 11603; 6173; 40637; 21677; 27850; 11603; 6173; 41391; 3; 3; dl_high_bb; ul_low_bb; 18813; 8624
DATA; 2023-07-23-21:33:05; 1690144385.418262; 1690144385.417169; 17210; 19558; 770; 966; 101; 11; 1690144385.384760; 1.0.0.1; 197; 21091; 73000; 9933; 51909; 40694; 21091; 73000; 9933; 51909; 41530; 3; 3; dl_high_bb; ul_idle_bb; 17271; 7839
DATA; 2023-07-23-21:33:05; 1690144385.427737; 1690144385.426467; 17210; 19558; 770; 966; 113; 12; 1690144385.385820; 8.8.8.8; 197; 21708; 48300; 13559; 26592; 40694; 21708; 48300; 13559; 26592; 41530; 3; 3; dl_high_bb; ul_idle_bb; 17271; 7839
DATA; 2023-07-23-21:33:05; 1690144385.546932; 1690144385.545435; 16420; 18930; 766; 926; 109; 11; 1690144385.529460; 8.8.4.4; 197; 21877; 95000; 11603; 73123; 40694; 21877; 95000; 11603; 73123; 41530; 4; 4; dl_high_bb; ul_idle_bb; 17271; 7839
DATA; 2023-07-23-21:33:05; 1690144385.661273; 1690144385.657675; 16420; 18930; 766; 926; 109; 11; 1690144385.633570; 9.9.9.9; 197; 21208; 122000; 14520; 100792; 40694; 21208; 122000; 14520; 100792; 41530; 5; 5; dl_high_bb; ul_idle_bb; 17271; 7839
DATA; 2023-07-23-21:33:05; 1690144385.675318; 1690144385.674451; 16420; 18930; 766; 926; 109; 11; 1690144385.639340; 9.9.9.10; 197; 21293; 100000; 8499; 78707; 40694; 21293; 100000; 8499; 78707; 41530; 5; 5; dl_high_bb; ul_idle_bb; 17271; 7839
DATA; 2023-07-23-21:33:05; 1690144385.686441; 1690144385.685337; 14398; 18023; 742; 889; 104; 11; 1690144385.646540; 1.1.1.1; 198; 20916; 78500; 8930; 57584; 40694; 20916; 78500; 8930; 57584; 41530; 5; 5; dl_high_bb; ul_idle_bb; 17271; 7839
DATA; 2023-07-23-21:33:05; 1690144385.819462; 1690144385.818630; 14398; 18023; 742; 889; 104; 11; 1690144385.775580; 8.8.8.8; 198; 21778; 92500; 13559; 70722; 40772; 21778; 92500; 13559; 70722; 41700; 5; 5; dl_high_bb; ul_idle_bb; 15543; 7055
DATA; 2023-07-23-21:33:05; 1690144385.826091; 1690144385.825203; 14398; 18023; 742; 889; 115; 12; 1690144385.777670; 1.0.0.1; 198; 21188; 119000; 9933; 97812; 40772; 21188; 119000; 9933; 97812; 41700; 6; 6; dl_high_bb; ul_idle_bb; 15543; 7055
DATA; 2023-07-23-21:33:05; 1690144385.833081; 1690144385.832185; 14398; 18023; 742; 889; 115; 12; 1690144385.777780; 8.8.4.4; 198; 21924; 69000; 11603; 47076; 40772; 21924; 69000; 11603; 47076; 41700; 6; 6; dl_high_bb; ul_idle_bb; 15543; 7055
DATA; 2023-07-23-21:33:05; 1690144385.962999; 1690144385.962070; 13749; 17168; 745; 860; 110; 12; 1690144385.950600; 9.9.9.10; 198; 21376; 105000; 8499; 83624; 40772; 21376; 105000; 8499; 83624; 41700; 6; 6; dl_high_bb; ul_idle_bb; 15543; 7055
DATA; 2023-07-23-21:33:06; 1690144386.044763; 1690144386.040001; 13749; 17168; 745; 860; 110; 12; 1690144386.024120; 1.0.0.1; 199; 21258; 91500; 9933; 70242; 40772; 21258; 91500; 9933; 70242; 41700; 6; 6; dl_high_bb; ul_idle_bb; 15543; 7055
DATA; 2023-07-23-21:33:06; 1690144386.067613; 1690144386.066767; 13749; 17168; 745; 860; 110; 12; 1690144386.025200; 1.1.1.1; 199; 21012; 117500; 8930; 96488; 40772; 21012; 117500; 8930; 96488; 41700; 6; 6; dl_high_bb; ul_idle_bb; 15543; 7055
DATA; 2023-07-23-21:33:06; 1690144386.077460; 1690144386.076555; 13749; 17168; 745; 860; 110; 12; 1690144386.041780; 8.8.4.4; 199; 21952; 50000; 11603; 28048; 40772; 21952; 50000; 11603; 28048; 41700; 5; 5; dl_high_bb; ul_idle_bb; 15543; 7055
DATA; 2023-07-23-21:33:06; 1690144386.136962; 1690144386.135755; 12797; 16293; 776; 843; 104; 11; 1690144386.099480; 9.9.9.10; 199; 21383; 28750; 8499; 7367; 40857; 21383; 28750; 8499; 7367; 41890; 4; 4; dl_high_bb; ul_idle_bb; 13988; 6349
DATA; 2023-07-23-21:33:06; 1690144386.144985; 1690144386.143999; 12797; 16293; 776; 843; 116; 13; 1690144386.100190; 9.9.9.9; 199; 21241; 54500; 14520; 33259; 40857; 21241; 54500; 14520; 33259; 41890; 3; 3; dl_high_bb; ul_idle_bb; 13988; 6349
DATA; 2023-07-23-21:33:14; 1690144394.927761; 1690144394.926207; 20704; 29332; 9492; 15320; 111; 111; 1690144394.907300; 9.9.9.9; 228; 21673; 92000; 14520; 70327; 40454; 21673; 92000; 14520; 70327; 40870; 4; 4; dl_high_bb; ul_high_bb; 26398; 13788
DATA; 2023-07-23-21:33:14; 1690144394.974377; 1690144394.973722; 23983; 28262; 7339; 13723; 107; 99; 1690144394.946720; 9.9.9.10; 228; 21756; 86500; 8499; 64744; 40454; 21756; 86500; 8499; 64744; 40870; 5; 5; dl_high_bb; ul_high_bb; 26398; 13788
DATA; 2023-07-23-21:33:15; 1690144395.077924; 1690144395.076454; 23983; 28262; 7339; 13723; 107; 99; 1690144395.063150; 1.1.1.1; 229; 21436; 119500; 8930; 98064; 40454; 21436; 119500; 8930; 98064; 40870; 6; 6; dl_high_bb; ul_high_bb; 26398; 13788
DATA; 2023-07-23-21:33:15; 1690144395.108863; 1690144395.107406; 23983; 28262; 7339; 13723; 107; 99; 1690144395.093940; 8.8.8.8; 229; 22198; 85000; 13559; 62802; 40454; 22198; 85000; 13559; 62802; 40870; 6; 6; dl_high_bb; ul_high_bb; 26398; 13788
DATA; 2023-07-23-21:33:15; 1690144395.216808; 1690144395.216068; 16677; 25945; 7528; 12484; 98; 90; 1690144395.172380; 9.9.9.9; 229; 21725; 74000; 14520; 52275; 40513; 21725; 74000; 14520; 52275; 41068; 6; 6; dl_high_bb; ul_high_bb; 23350; 11235
DATA; 2023-07-23-21:33:15; 1690144395.229922; 1690144395.229021; 16677; 25945; 7528; 12484; 111; 111; 1690144395.184280; 9.9.9.10; 229; 21788; 54500; 8499; 32712; 40513; 21788; 54500; 8499; 32712; 41068; 5; 5; dl_high_bb; ul_high_bb; 23350; 11235
DATA; 2023-07-23-21:33:15; 1690144395.245919; 1690144395.244618; 16677; 25945; 7528; 12484; 111; 111; 1690144395.232270; 1.1.1.1; 230; 21468; 53500; 8930; 32032; 40513; 21468; 53500; 8930; 32032; 41068; 4; 4; dl_high_bb; ul_high_bb; 23350; 11235
DATA; 2023-07-23-21:33:15; 1690144395.410977; 1690144395.409392; 21070; 24970; 9188; 11824; 106; 105; 1690144395.390700; 8.8.8.8; 230; 22258; 82500; 13559; 60242; 40513; 22258; 82500; 13559; 60242; 41068; 4; 4; dl_high_bb; ul_high_bb; 23350; 11235
DATA; 2023-07-23-21:33:15; 1690144395.423984; 1690144395.422601; 21070; 24970; 9188; 11824; 106; 105; 1690144395.396380; 8.8.4.4; 230; 22306; 60500; 11603; 38194; 40513; 22306; 60500; 11603; 38194; 41068; 3; 3; dl_high_bb; ul_high_bb; 23350; 11235
DATA; 2023-07-23-21:33:22; 1690144402.998826; 1690144402.997878; 33615; 33624; 19514; 22456; 111; 111; 1690144402.982850; 9.9.9.9; 255; 22134; 62000; 14520; 39866; 40396; 22134; 62000; 14520; 39866; 40593; 3; 3; dl_high_bb; ul_high_bb; 30261; 20210
DATA; 2023-07-23-21:33:23; 1690144403.032418; 1690144403.031636; 29605; 32820; 16912; 21347; 108; 105; 1690144403.021240; 9.9.9.10; 255; 22119; 56000; 8499; 33881; 40396; 22119; 56000; 8499; 33881; 40593; 3; 3; dl_high_bb; ul_high_bb; 30261; 20210
DATA; 2023-07-23-21:33:23; 1690144403.084576; 1690144403.083458; 29605; 32820; 16912; 21347; 108; 105; 1690144403.069830; 1.1.1.1; 256; 21881; 55500; 8930; 33619; 40396; 21881; 55500; 8930; 33619; 40593; 3; 3; dl_high_bb; ul_high_bb; 30261; 20210
DATA; 2023-07-23-21:33:25; 1690144405.152805; 1690144405.151482; 31442; 31799; 8624; 12224; 77; 46; 1690144405.095490; 9.9.9.9; 262; 22243; 64500; 14520; 42257; 40419; 22243; 64500; 14520; 42257; 41090; 3; 3; dl_high_bb; ul_low_bb; 28619; 11001
DATA; 2023-07-23-21:33:25; 1690144405.165753; 1690144405.164503; 31442; 31799; 8624; 12224; 111; 111; 1690144405.126480; 9.9.9.10; 262; 22245; 55000; 8499; 32755; 40419; 22245; 55000; 8499; 32755; 41090; 3; 3; dl_high_bb; ul_high_bb; 28619; 11001
DATA; 2023-07-23-21:33:25; 1690144405.192985; 1690144405.191498; 31442; 31799; 8624; 12224; 111; 111; 1690144405.175020; 1.1.1.1; 263; 21993; 54000; 8930; 32007; 40419; 21993; 54000; 8930; 32007; 41090; 3; 3; dl_high_bb; ul_high_bb; 28619; 11001
DATA; 2023-07-23-21:33:25; 1690144405.229557; 1690144405.228302; 31442; 31799; 8624; 12224; 111; 111; 1690144405.205290; 1.0.0.1; 263; 22187; 44050; 9933; 21863; 40419; 22187; 44050; 9933; 21863; 41090; 3; 3; dl_high_bb; ul_high_bb; 28619; 11001
DATA; 2023-07-23-21:33:34; 1690144414.805705; 1690144414.803832; 56797; 52936; 29439; 28453; 66; 81; 1690144414.746370; 9.9.9.9; 294; 22524; 68500; 14520; 45976; 40251; 22524; 68500; 14520; 45976; 40468; 3; 3; dl_high_bb; ul_high_bb; 47642; 25607
DATA; 2023-07-23-21:33:34; 1690144414.815628; 1690144414.814926; 56797; 52936; 29439; 28453; 111; 111; 1690144414.775610; 9.9.9.10; 294; 22485; 58000; 8499; 35515; 40251; 22485; 58000; 8499; 35515; 40468; 3; 3; dl_high_bb; ul_high_bb; 47642; 25607
DATA; 2023-07-23-21:33:34; 1690144414.870673; 1690144414.868604; 56797; 52936; 29439; 28453; 111; 111; 1690144414.847180; 1.1.1.1; 295; 22295; 68500; 8930; 46205; 40251; 22295; 68500; 8930; 46205; 40468; 3; 3; dl_high_bb; ul_high_bb; 47642; 25607
DATA; 2023-07-23-21:33:34; 1690144414.911978; 1690144414.910285; 56797; 52936; 29439; 28453; 111; 111; 1690144414.895650; 1.0.0.1; 295; 22486; 68000; 9933; 45514; 40251; 22486; 68000; 9933; 45514; 40468; 4; 4; dl_high_bb; ul_high_bb; 47642; 25607
DATA; 2023-07-23-21:33:34; 1690144414.967158; 1690144414.966234; 52001; 52749; 27058; 28174; 110; 110; 1690144414.943830; 8.8.8.8; 295; 23153; 67000; 13559; 43847; 40251; 23153; 67000; 13559; 43847; 40468; 5; 5; dl_high_bb; ul_high_bb; 47642; 25607
DATA; 2023-07-23-21:33:34; 1690144414.996394; 1690144414.995587; 52001; 52749; 27058; 28174; 110; 110; 1690144414.985750; 8.8.4.4; 295; 23072; 62500; 11603; 39428; 40251; 23072; 62500; 11603; 39428; 40468; 4; 4; dl_high_bb; ul_high_bb; 47642; 25607
DATA; 2023-07-23-21:33:35; 1690144415.056615; 1690144415.055532; 52001; 52749; 27058; 28174; 110; 110; 1690144415.045950; 9.9.9.9; 295; 22568; 67500; 14520; 44932; 40251; 22568; 67500; 14520; 44932; 40468; 4; 4; dl_high_bb; ul_high_bb; 47642; 25607
DATA; 2023-07-23-21:33:35; 1690144415.125261; 1690144415.124407; 52001; 52749; 27058; 28174; 110; 110; 1690144415.090520; 9.9.9.10; 295; 22527; 65000; 8499; 42473; 40279; 22527; 65000; 8499; 42473; 40520; 5; 5; dl_high_bb; ul_high_bb; 42877; 23046

Here is the data in full: https://easyupload.io/d6v0f1


Will the octave plotter still work with this new data I wonder?

It might depend on the connection though? Here is some data from a circa 300Mbit/s VDSL link:

Doesn't it look there like the EWMA gives a lower bandwidth?

Any clue why things are flipped for VDSL?

Not really, the true rate during the increase phase stays well below the shaper limit, which implies that the shaper is not going to very active during that phase...
And during the rate reduction the EWMA has considerable lag so keeps the shaper at a higher shaping rate for longer...
Now at the start and at the end of that download phase we see a multi-second delay until the EWMA is close to the actual achieved rates, but that is what we expect from a low pass filter....

Sidenote, that vdsl link uses autorate clearly in avdifferent mode than you on your LTE link. There is little room between the baseline and maximal rate, so this is more of a backstop to reign in excessive delay built up during saturating loads, while you seem to run the controller with more 'dynamic' range...

The bigger question is whether using that EWMA results in higher accumulated delay of the latency probes.

But the orange EWMA is always lower on every rate reduction (and this lower value will get used according to 0.9 * achieved rate ewma):

Presumably on this VDSL link 0.95 could be used?

This is a bit of an illusion the EWMA values are actually larger, they roughly intersect the big step down of the achieved rate implying the value is larger (for the achieved rate the actual value is at the bottom of the vertical line down).
On a step down the achieved rate is the new lower rate, but for the EWMA we get a weighted average of the historic rates (dominated by the recent past which was higher than the current rate) and the current rate... this is in almoat all likely cases smaller than the actual current rate.

No I don't think so; the drops in achieved rate are following, not before, the drops in the shaper rate. The drops in the shaper rate occur based on 0.9 * the achieved rate ewma, and most times that is lower.

As compared to on my 4G, it really does seem to me that things are flipped around for VDSL at the critical points (dl_high_bb events) in that with 4G the EWMA was mostly higher, but for VDSL the EWMA is mostly lower.

DATA_HEADER; LOG_DATETIME; LOG_TIMESTAMP; PROC_TIME_US; DL_ACHIEVED_RATE_KBPS; DL_ACHIEVED_RATE_EWMA_KBPS; UL_ACHIEVED_RATE_KBPS; UL_ACHIEVED_RATE_EWMA_KBPS; DL_LOAD_PERCENT; UL_LOAD_PERCENT; RTT_TIMESTAMP; REFLECTOR; SEQUENCE; DL_OWD_BASELINE; DL_OWD_US; DL_OWD_DELTA_EWMA_US; DL_OWD_DELTA_US; DL_ADJ_DELAY_THR; UL_OWD_BASELINE; UL_OWD_US; UL_OWD_DELTA_EWMA_US; UL_OWD_DELTA_US; UL_ADJ_DELAY_THR; SUM_DL_DELAYS; SUM_UL_DELAYS; DL_LOAD_CONDITION; UL_LOAD_CONDITION; CAKE_DL_RATE_KBPS; CAKE_UL_RATE_KBPS
DATA; 2023-07-24-00:12:40; 1690146760.701870; 1690146760.701212; 279062; 219547; 19926; 20126; 70; 20; 1690146760.680500; 208.67.220.2; 29; 19760; 22700; 614; 2940; 2545; 19760; 22700; 614; 2940; 2642; 3; 3; dl_high_bb; ul_low_bb; 279000; 90000
DATA; 2023-07-24-00:12:40; 1690146760.751293; 1690146760.751068; 288211; 233279; 19583; 20017; 83; 22; 1690146760.747030; 94.140.14.141; 30; 29413; 30900; 495; 1487; 2545; 29413; 30900; 495; 1487; 2642; 3; 3; dl_high_bb; ul_low_bb; 279000; 90000
DATA; 2023-07-24-00:12:40; 1690146760.900896; 1690146760.900356; 259707; 238564; 20463; 20106; 85; 22; 1690146760.895690; 156.154.71.2; 30; 25131; 30000; 286; 4869; 2545; 25131; 30000; 286; 4869; 2642; 3; 3; dl_high_bb; ul_low_bb; 279000; 90000
DATA; 2023-07-24-00:12:41; 1690146761.306154; 1690146761.305849; 260502; 242951; 22345; 20553; 85; 22; 1690146761.284560; 208.67.220.2; 31; 19764; 23900; 614; 4136; 2558; 19764; 23900; 614; 4136; 2656; 3; 3; dl_high_bb; ul_low_bb; 218655; 81810
DATA; 2023-07-24-00:12:44; 1690146764.164578; 1690146764.164404; 279657; 264737; 17762; 25285; 85; 30; 1690146764.151950; 185.228.168.9; 41; 25460; 30050; 303; 4590; 2553; 25460; 30050; 303; 4590; 2670; 3; 3; dl_high_bb; ul_low_bb; 238263; 75108
DATA; 2023-07-24-00:12:44; 1690146764.195160; 1690146764.195004; 279657; 264737; 17762; 25285; 111; 33; 1690146764.192790; 156.154.71.2; 41; 25135; 25450; 286; 315; 2553; 25135; 25450; 286; 315; 2670; 3; 3; dl_high_bb; ul_low_bb; 238263; 75108
DATA; 2023-07-24-00:12:44; 1690146764.257838; 1690146764.257665; 279657; 264737; 17762; 25285; 111; 33; 1690146764.255800; 156.154.70.1; 41; 31516; 31900; 454; 384; 2553; 31516; 31900; 454; 384; 2670; 3; 3; dl_high_bb; ul_low_bb; 238263; 75108
DATA; 2023-07-24-00:12:44; 1690146764.284290; 1690146764.284100; 279657; 264737; 17762; 25285; 111; 33; 1690146764.281480; 208.67.220.2; 41; 19656; 19700; 614; 44; 2553; 19656; 19700; 614; 44; 2670; 3; 3; dl_high_bb; ul_low_bb; 238263; 75108
DATA; 2023-07-24-00:12:46; 1690146766.379739; 1690146766.379550; 282317; 261291; 20168; 18482; 84; 24; 1690146766.368200; 156.154.70.1; 48; 31521; 36550; 454; 5029; 2554; 31521; 36550; 454; 5029; 2686; 3; 3; dl_high_bb; ul_low_bb; 235161; 68955
DATA; 2023-07-24-00:12:46; 1690146766.395809; 1690146766.395600; 282317; 261291; 20168; 18482; 111; 26; 1690146766.393420; 208.67.220.2; 48; 19519; 24150; 614; 4631; 2554; 19519; 24150; 614; 4631; 2686; 4; 4; dl_high_bb; ul_low_bb; 235161; 68955
DATA; 2023-07-24-00:12:46; 1690146766.467127; 1690146766.466776; 282317; 261291; 20168; 18482; 111; 26; 1690146766.464360; 94.140.14.141; 49; 29364; 34600; 495; 5236; 2554; 29364; 34600; 495; 5236; 2686; 5; 5; dl_high_bb; ul_low_bb; 235161; 68955
DATA; 2023-07-24-00:12:46; 1690146766.556863; 1690146766.556507; 235457; 256124; 20599; 18905; 108; 27; 1690146766.554320; 185.228.168.9; 49; 25470; 29500; 303; 4030; 2554; 25470; 29500; 303; 4030; 2686; 6; 6; dl_high_bb; ul_low_bb; 235161; 68955
DATA; 2023-07-24-00:12:46; 1690146766.605888; 1690146766.605739; 235457; 256124; 20599; 18905; 108; 27; 1690146766.603250; 156.154.71.2; 49; 25141; 28900; 286; 3759; 2554; 25141; 28900; 286; 3759; 2686; 6; 6; dl_high_bb; ul_low_bb; 235161; 68955
DATA; 2023-07-24-00:12:46; 1690146766.661525; 1690146766.661394; 235457; 256124; 20599; 18905; 108; 27; 1690146766.659620; 156.154.70.1; 49; 31521; 32050; 454; 529; 2554; 31521; 32050; 454; 529; 2686; 5; 5; dl_high_bb; ul_low_bb; 235161; 68955
DATA; 2023-07-24-00:12:46; 1690146766.695957; 1690146766.695802; 235457; 256124; 20599; 18905; 108; 27; 1690146766.684970; 208.67.220.2; 49; 19519; 19700; 614; 181; 2560; 19519; 19700; 614; 181; 2706; 4; 4; dl_high_bb; ul_low_bb; 211644; 62059
DATA; 2023-07-24-00:12:46; 1690146766.756781; 1690146766.756565; 200878; 245074; 22615; 19647; 115; 31; 1690146766.754370; 94.140.14.141; 50; 29351; 29350; 495; -1; 2560; 29351; 29350; 495; -1; 2706; 3; 3; dl_high_bb; ul_low_bb; 211644; 62059
DATA; 2023-07-24-00:12:49; 1690146769.780002; 1690146769.779841; 275156; 259070; 34349; 35655; 83; 50; 1690146769.767490; 94.140.14.141; 60; 29355; 33650; 495; 4295; 2555; 29355; 33650; 495; 4295; 2701; 3; 3; dl_high_bb; ul_low_bb; 233163; 63559
DATA; 2023-07-24-00:12:49; 1690146769.862035; 1690146769.861563; 275156; 259070; 34349; 35655; 111; 56; 1690146769.859420; 185.228.168.9; 60; 25456; 29550; 303; 4094; 2555; 25456; 29550; 303; 4094; 2701; 4; 4; dl_high_bb; ul_high_bb; 233163; 63559
DATA; 2023-07-24-00:12:49; 1690146769.903332; 1690146769.903161; 275156; 259070; 34349; 35655; 111; 56; 1690146769.900980; 156.154.71.2; 60; 25141; 25300; 286; 159; 2555; 25141; 25300; 286; 159; 2701; 4; 4; dl_high_bb; ul_high_bb; 233163; 63559
DATA; 2023-07-24-00:12:49; 1690146769.966052; 1690146769.965883; 223907; 252037; 37579; 36039; 108; 56; 1690146769.963610; 156.154.70.1; 60; 31524; 31600; 454; 76; 2555; 31524; 31600; 454; 76; 2701; 4; 4; dl_high_bb; ul_high_bb; 233163; 63559
DATA; 2023-07-24-00:12:49; 1690146769.992565; 1690146769.992426; 223907; 252037; 37579; 36039; 108; 56; 1690146769.990440; 208.67.220.2; 60; 19505; 19950; 614; 445; 2555; 19505; 19950; 614; 445; 2701; 3; 3; dl_high_bb; ul_high_bb; 233163; 63559
DATA; 2023-07-24-00:12:51; 1690146771.974550; 1690146771.974339; 278143; 252327; 37882; 36833; 81; 48; 1690146771.963080; 185.228.168.9; 67; 25460; 29750; 303; 4290; 2556; 25460; 29750; 303; 4290; 2667; 3; 2; dl_high_bb; ul_low; 227094; 76777
DATA; 2023-07-24-00:12:52; 1690146772.020376; 1690146772.020167; 278143; 252327; 37882; 36833; 111; 47; 1690146772.012750; 156.154.71.2; 67; 25145; 29550; 286; 4405; 2556; 25145; 29550; 286; 4405; 2685; 4; 3; dl_high_bb; ul_low_bb; 227094; 69099
DATA; 2023-07-24-00:12:52; 1690146772.075582; 1690146772.075355; 278143; 252327; 37882; 36833; 111; 53; 1690146772.073300; 156.154.70.1; 67; 31505; 34800; 454; 3295; 2556; 31505; 34800; 454; 3295; 2685; 5; 4; dl_high_bb; ul_high_bb; 227094; 69099
DATA; 2023-07-24-00:12:52; 1690146772.098121; 1690146772.097928; 278143; 252327; 37882; 36833; 111; 53; 1690146772.095860; 208.67.220.2; 67; 19506; 21000; 614; 1494; 2556; 19506; 21000; 614; 1494; 2685; 5; 4; dl_high_bb; ul_high_bb; 227094; 69099
DATA; 2023-07-24-00:12:52; 1690146772.165878; 1690146772.165727; 217084; 245278; 38237; 37113; 108; 53; 1690146772.163780; 94.140.14.141; 68; 29358; 29950; 495; 592; 2556; 29358; 29950; 495; 592; 2685; 4; 3; dl_high_bb; ul_high_bb; 227094; 69099
DATA; 2023-07-24-00:12:52; 1690146772.207627; 1690146772.207442; 217084; 245278; 38237; 37113; 108; 53; 1690146772.205230; 156.154.71.4; 68; 25157; 25600; 235; 443; 2556; 25157; 25600; 235; 443; 2685; 3; 3; dl_high_bb; ul_high_bb; 227094; 69099
DATA; 2023-07-24-00:12:54; 1690146774.628862; 1690146774.628579; 290366; 250890; 16211; 19731; 80; 24; 1690146774.616240; 156.154.71.4; 76; 25163; 28950; 235; 3787; 2556; 25163; 28950; 235; 3787; 2679; 3; 3; dl_high_bb; ul_low_bb; 225801; 71477
DATA; 2023-07-24-00:12:54; 1690146774.665608; 1690146774.665463; 290366; 250890; 16211; 19731; 111; 27; 1690146774.662760; 185.228.168.9; 76; 25462; 27150; 303; 1688; 2556; 25462; 27150; 303; 1688; 2679; 3; 3; dl_high_bb; ul_low_bb; 225801; 71477
DATA; 2023-07-24-00:12:54; 1690146774.711746; 1690146774.711604; 290366; 250890; 16211; 19731; 111; 27; 1690146774.708860; 156.154.71.2; 76; 25145; 25200; 286; 55; 2556; 25145; 25200; 286; 55; 2679; 3; 3; dl_high_bb; ul_low_bb; 225801; 71477

Full data here:

https://gist.githubusercontent.com/rany2/b6961fc913fb01eef42f77dec56d7026/raw/d3eeb7ed2e3737a11c3c79c1824782cbd34ac081/gistfile1.txt

Compare with the 4G case:

This is exactly the behaviour expected from a low pass filter including a delayed time course compared to the input time series. If the input timeseries is modulated with a frequency corresponding to around the petiod of the filter delay the iput and filter signal look like they are phase shifted in regards to each other....

But we can see that for VDSL the achieved rate ewma is mostly lower on dl_high_bb events (resulting in reduced throughput using the ewma), whereas for 4G the achieved rate ewma is mostly higher on dl_high_bb events (resulting in increased throughput using the ewma). I wondered why this is so.

If these plots truly just show the bb timepoints I think they are really hard to interpret. Due to the filters temporal delay we need to see a few point leading up to the samples shown here...

Also in the LTE case this happens mostly in the middle of the rate control range, while for VDSL this happens really close to the max rate, which has an effect on the EWMA value.

The thing is that the achieved rate that is used to determine the updated shaper rate is exactly the one on each log line with dl_high_bb. That is, that line generated a bufferbloat event, and had achieved rate ewma X and thus shaper rate on that line is 0.9*X (so long as that is less than 0.9 * previous_shaper_rate).

What might be misleading is that some of those lines would include lines when the shaper rate wasn't changed owing to the refractory period.

Playing about with this does make me wonder. What if the control was more like: on load high then set shaper rate to twice the achieved rate ewma and on load high bufferbloat set the shaper rate to 0.9 * the achieved rate ewma. So there is always room to grow and correction when needed.

I confess to not yet having tested @patrakov's idea:

Not sure if that's close to the idea above.

BTW @moeller0, here is the trade-off that I am presently working with:

What's a little wacky is that if I stream a 4K video, cake-autorate happily lets the bandwidth shoot up to circa 60-70Mbit/s with the same settings. I don't altogether understand why - is that because my ISP boosts video traffic?

The thought occurred to me that this topic might make a good master's thesis project for a university student. I'll consider reaching out to Cambridge University engineering department.

2 Likes

I keep repeating the shaper rate increases must be smaller than the shaper rate reductions, which is not going to fly with doubling the shaper rate on increases... we really really want s9me dampening elements, as we do not want our controller to sink into detrimental resonance phenomena...
Also this again puts too much trust into the achieved rate being robust and reliable...

I really would dislike the D result, the B result seems 'not great' but also 'not terrible' but I guess the waveform test is not that precise (not to diss waveform, it is just that browsers are not an ideal environment to run high precision data acquisition in).

Possible. Could be nefarious (ISP has a financial relationship with your streaming service) or benign like ISP will accommodate any well predictable sustained traffic. Not sure about the state of net neutrality regulations in the UK and how the national regulatory agency interprets the existing rules.

OFCOM is the UK's communications regulator, but they do not stand up to ISPs:

I see from this document:

Vodafone UK state:

I wonder what form the optimisation of the latter takes. I mean I notice vastly increased cake bandwidth is set in cake-autorate whilst a 4K video stream is active. Does that mean that the whole connection is boosted whilst there is a 4K stream active I wonder.

Likely... but hard to test.