From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mout.gmx.net (mout.gmx.net [212.227.17.22]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by lists.bufferbloat.net (Postfix) with ESMTPS id 6FECC3CB39; Sun, 15 Oct 2023 09:09:32 -0400 (EDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.de; s=s31663417; t=1697375370; x=1697980170; i=moeller0@gmx.de; bh=ZxcPHybLTTIuv39VON2MjMRNLjqK9uVh1rBsCNrBxvY=; h=X-UI-Sender-Class:Subject:From:In-Reply-To:Date:Cc:References:To; b=CjPeltk6ZVWAUXcr8GkGsrD7+ZdyAH450CPGaKA2aNcW0FwIOtR24kKG1Vwn2ZTWWgEjaq89QmQ E+yCV4uUrXusvkoIfbPEm95TblLFKL/EpuMl6lvsGIY1vM8zjp0THBIklnX/CoZn0Z7+lOogaokbk IJjsVQ36nxePtQKPuSEahvqinZOy4/he9WNCXyy3HmSy/NIsZ3Fe59P0/2UJ9OrmjOHHvjQ9UoHvL sHxXG+wTnwGgO/eDuqGGHDxPTQs/6n+MzmcflTA9zfp73FCJOzNJqcKin3TQxn9n5R5orH4dG+tyT 02OnbvI2FbRHrRp6jkacQZ/04RJI/7rnxVdw== X-UI-Sender-Class: 724b4f7f-cbec-4199-ad4e-598c01a50d3a Received: from smtpclient.apple ([77.10.49.66]) by mail.gmx.net (mrgmx105 [212.227.17.168]) with ESMTPSA (Nemesis) id 1MNt0C-1rBlkQ0kVU-00OG4h; Sun, 15 Oct 2023 15:09:30 +0200 Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3696.120.41.1.4\)) From: Sebastian Moeller In-Reply-To: Date: Sun, 15 Oct 2023 15:09:29 +0200 Cc: Jonathan Morton , bloat , codel@lists.bufferbloat.net Content-Transfer-Encoding: quoted-printable Message-Id: <3A02601B-9C7A-45A0-BEC4-6313E1F200BD@gmx.de> References: <3E02B7F5-D0C6-4C33-AFA9-30A2E54B155F@gmail.com> <2F0C6067-1E4E-4CBA-962D-71B3F1F9B9CC@gmx.de> To: =?utf-8?Q?Dave_T=C3=A4ht?= X-Mailer: Apple Mail (2.3696.120.41.1.4) X-Provags-ID: V03:K1:I91iCGdmEOI+Fmfv10RPscabq0oahybbKL4bCKPvvzPw1qBgWbi 66P4Gu/PYwZJ55wBA6yQZoUdfFxXP5f9YXTYwOX/DH0df+ojCqaRxqav4N6hsNRTALBnizK VAXOY6WpJD8N4iGJaEXjKvyLhq3f2zpVNO2+e3vCr6wZwMaqseOd3TPhGkkZ+wqoTITlHS8 FVDd7wREF3ZQwxXQSrNnw== X-Spam-Flag: NO UI-OutboundReport: notjunk:1;M01:P0:RdW/mGTLJ94=;rWG/pgWzr2utvjV5IPWYdYGf856 1WrK1jFH6tMoTIM9O0PU+va9AKWQkgb1eiZLg5vi6Iq81d35VMbLUapAleVmw6ARcJqI2dQRY B3rdFQVp7oVQiYqFEHA7vs+EF9857X+1gJmVNJPXkPeq3E2/jM5Yhyq+6fl5VkqsiYzIFG2Pr Qv1RJKnITRcHBTVE3k7PZNPrgM6vmCixRccXdNGspuNkiWQyVvDpEBVMKeHus7MY+fIoDbCLK /yK0cWwD5p1qqWcrjQeYByNlE986edrxDRv0m+byEF/k1TQcaugTzSsmW4Gb7iG7dUctO+NXP HA1bCDE5pl4kqAgVPr6eOLwVBsKndLQ+4MQpnuT0M7oF7g7rnBKcDPizYZgfMD4Jw0Iz5UF8z nQ41EHBhOuG9+hcgfYGTg+LXuBOw1N5cvH6oEkiUBYXFa3EOa58sseSBmU0JFjYQkrAsHbeqk 1YkkVuDyy9yjyGR8e8yUtOZnqQjwIrX2xL6KF5iVyFRlB4IaZC+6Yf4j/2Pv7TFfCXqxbYJxd pUdO0xJqDduVD9wQqrDTX5mnzi6oJPQ+v8sAFygzSE6QHuyE+w+X3AwiKJeZJYHDH88XRZtDF BZoJRQQEr7wx9sWxws/gugSuSBKlQcLMDqHMrhbmW5W2jJU7EAYvGC9K+u3mMcYfsKQ+jUQql 8z39cYT4qSA4OIBW9TE0RjUdS35c+8Auwu9H8EOs3oLQMbVyhmBRpzWrlHG00Qpli/iFcyt6K DqWdK6+CJlru2P4Sx9tS8P/eVroCTB/Eh5Eyr1Po0NHKVi084gLM5Ktkho0GWVkSCgIyZ+mAl dcNRQEEVM5qrxts99ubikBdbQepXEVCVKf46F0csI1yIIiJA1ENy+g9+hnvI9Url/0O3gx7TA zRwCTWI19Szi4EHaso7yxTya2w6+FX0MirLHQ8g/rPS/S9YLtsXM+vD85nVwg4rq6n6EoIuTR yv3YyDi43DdsQCwYxPc1ehSoovQ= Subject: Re: [Bloat] [Codel] fq_"codel" in apple's gear X-BeenThere: bloat@lists.bufferbloat.net X-Mailman-Version: 2.1.20 Precedence: list List-Id: General list for discussing Bufferbloat List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 15 Oct 2023 13:09:32 -0000 Hi Dave, > On Oct 14, 2023, at 21:46, Dave Taht wrote: >=20 > thank you! A packet capture, however, would be more revealing... will try to get a packet capture later, when the rest of the users are a = sleep... But I want to re-iterate 12.7 is not a recent macos version by any = account, so the data will not be all that extrapolatable... Regards Sebastian >=20 > On Sat, Oct 14, 2023 at 12:44=E2=80=AFPM Sebastian Moeller = wrote: >>=20 >> Hi Dave, >>=20 >>=20 >>> On Oct 14, 2023, at 21:01, Dave Taht wrote: >>>=20 >>> netstat -I en0 -qq >>=20 >> Here is a bit of output from macosx monterey 12.7 (on intel = hardware). I know this is not really recent, ut it is the most recent I = have available... >>=20 >> This is on an realtek based USB3 ethernet dongle that used to support = 1 Gbps, but at from macosx update on it is stuck on 100Mbps = FastEthernet... >>=20 >>=20 >> Here is the output after a flent test: >>=20 >> Out of my "--test-parameter markings=3DCS0,CS1,CS2,CS3,CS4,CS5,CS6,CS7"= it seems only CS1 was honored and put into BK the rest all ended up in = BE... >> I have zero clue what macos uses to steer packets into the different = classes, might be DSCP alone, but then at least using some more exotic = ones than boring CS6/CS7 >> No idea what CTL is, the average packet size mist be around 67 = bytes... >>=20 >>=20 >> macbook:CAKE-autorate user$ netstat -I en3 -qq >> en3: >> [ sched: FQ_CODEL qlength: 0/128 ] >> [ pkts: 522515 bytes: 334464372 dropped pkts: 0 = bytes: 0 ] >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D >> [ pri: CTL (0) srv_cl: 0x480190 quantum: 605 = drr_max: 8 ] >> [ queued pkts: 0 bytes: 0 ] >> [ dequeued pkts: 292918 bytes: 19787064 ] >> [ budget: 0 target qdelay: 10.00 msec update = interval:100.00 msec ] >> [ flow control: 0 feedback: 0 stalls: 0 failed: 0 = overwhelming: 0 ] >> [ drop overflow: 0 early: 0 memfail: 0 duprexmt:0 ] >> [ flows total: 0 new: 0 old: 0 ] >> [ throttle on: 0 off: 0 drop: 0 ] >> [ compressible pkts: 0 compressed pkts: 0] >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D >> [ pri: VO (1) srv_cl: 0x400180 quantum: 605 = drr_max: 8 ] >> [ queued pkts: 0 bytes: 0 ] >> [ dequeued pkts: 0 bytes: 0 ] >> [ budget: 0 target qdelay: 10.00 msec update = interval:100.00 msec ] >> [ flow control: 0 feedback: 0 stalls: 0 failed: 0 = overwhelming: 0 ] >> [ drop overflow: 0 early: 0 memfail: 0 duprexmt:0 ] >> [ flows total: 0 new: 0 old: 0 ] >> [ throttle on: 0 off: 0 drop: 0 ] >> [ compressible pkts: 0 compressed pkts: 0] >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D >> [ pri: VI (2) srv_cl: 0x380100 quantum: 3028 = drr_max: 6 ] >> [ queued pkts: 0 bytes: 0 ] >> [ dequeued pkts: 0 bytes: 0 ] >> [ budget: 0 target qdelay: 10.00 msec update = interval:100.00 msec ] >> [ flow control: 0 feedback: 0 stalls: 0 failed: 0 = overwhelming: 0 ] >> [ drop overflow: 0 early: 0 memfail: 0 duprexmt:0 ] >> [ flows total: 0 new: 0 old: 0 ] >> [ throttle on: 0 off: 0 drop: 0 ] >> [ compressible pkts: 0 compressed pkts: 0] >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D >> [ pri: RV (3) srv_cl: 0x300110 quantum: 3028 = drr_max: 6 ] >> [ queued pkts: 0 bytes: 0 ] >> [ dequeued pkts: 0 bytes: 0 ] >> [ budget: 0 target qdelay: 10.00 msec update = interval:100.00 msec ] >> [ flow control: 0 feedback: 0 stalls: 0 failed: 0 = overwhelming: 0 ] >> [ drop overflow: 0 early: 0 memfail: 0 duprexmt:0 ] >> [ flows total: 0 new: 0 old: 0 ] >> [ throttle on: 0 off: 0 drop: 0 ] >> [ compressible pkts: 0 compressed pkts: 0] >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D >> [ pri: AV (4) srv_cl: 0x280120 quantum: 3028 = drr_max: 6 ] >> [ queued pkts: 0 bytes: 0 ] >> [ dequeued pkts: 0 bytes: 0 ] >> [ budget: 0 target qdelay: 10.00 msec update = interval:100.00 msec ] >> [ flow control: 0 feedback: 0 stalls: 0 failed: 0 = overwhelming: 0 ] >> [ drop overflow: 0 early: 0 memfail: 0 duprexmt:0 ] >> [ flows total: 0 new: 0 old: 0 ] >> [ throttle on: 0 off: 0 drop: 0 ] >> [ compressible pkts: 0 compressed pkts: 0] >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D >> [ pri: OAM (5) srv_cl: 0x200020 quantum: 1514 = drr_max: 4 ] >> [ queued pkts: 0 bytes: 0 ] >> [ dequeued pkts: 0 bytes: 0 ] >> [ budget: 0 target qdelay: 10.00 msec update = interval:100.00 msec ] >> [ flow control: 0 feedback: 0 stalls: 0 failed: 0 = overwhelming: 0 ] >> [ drop overflow: 0 early: 0 memfail: 0 duprexmt:0 ] >> [ flows total: 0 new: 0 old: 0 ] >> [ throttle on: 0 off: 0 drop: 0 ] >> [ compressible pkts: 0 compressed pkts: 0] >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D >> [ pri: RD (6) srv_cl: 0x180010 quantum: 1514 = drr_max: 4 ] >> [ queued pkts: 0 bytes: 0 ] >> [ dequeued pkts: 13 bytes: 6684 ] >> [ budget: 0 target qdelay: 10.00 msec update = interval:100.00 msec ] >> [ flow control: 0 feedback: 0 stalls: 0 failed: 0 = overwhelming: 0 ] >> [ drop overflow: 0 early: 0 memfail: 0 duprexmt:0 ] >> [ flows total: 0 new: 0 old: 0 ] >> [ throttle on: 0 off: 0 drop: 0 ] >> [ compressible pkts: 0 compressed pkts: 0] >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D >> [ pri: BE (7) srv_cl: 0x0 quantum: 1514 drr_max: 4 ] >> [ queued pkts: 0 bytes: 0 ] >> [ dequeued pkts: 225368 bytes: 314071428 ] >> [ budget: 0 target qdelay: 10.00 msec update = interval:100.00 msec ] >> [ flow control: 0 feedback: 0 stalls: 0 failed: 0 = overwhelming: 0 ] >> [ drop overflow: 0 early: 0 memfail: 0 duprexmt:0 ] >> [ flows total: 0 new: 0 old: 0 ] >> [ throttle on: 0 off: 0 drop: 0 ] >> [ compressible pkts: 0 compressed pkts: 0] >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D >> [ pri: BK (8) srv_cl: 0x100080 quantum: 1514 = drr_max: 2 ] >> [ queued pkts: 0 bytes: 0 ] >> [ dequeued pkts: 3831 bytes: 576846 ] >> [ budget: 0 target qdelay: 10.00 msec update = interval:100.00 msec ] >> [ flow control: 0 feedback: 0 stalls: 0 failed: 0 = overwhelming: 0 ] >> [ drop overflow: 0 early: 0 memfail: 0 duprexmt:0 ] >> [ flows total: 0 new: 0 old: 0 ] >> [ throttle on: 0 off: 0 drop: 0 ] >> [ compressible pkts: 0 compressed pkts: 0] >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D >> [ pri: BK_SYS (9) srv_cl: 0x80090 quantum: 1514 drr_max: 2 ] >> [ queued pkts: 0 bytes: 0 ] >> [ dequeued pkts: 385 bytes: 22350 ] >> [ budget: 0 target qdelay: 10.00 msec update = interval:100.00 msec ] >> [ flow control: 0 feedback: 0 stalls: 0 failed: 0 = overwhelming: 0 ] >> [ drop overflow: 0 early: 0 memfail: 0 duprexmt:0 ] >> [ flows total: 0 new: 0 old: 0 ] >> [ throttle on: 0 off: 0 drop: 0 ] >> [ compressible pkts: 375 compressed pkts: 0] >> macbook:CAKE-autorate user$ uname -a >> Darwin macbook.local 21.6.0 Darwin Kernel Version 21.6.0: Fri Sep 15 = 16:17:23 PDT 2023; root:xnu-8020.240.18.703.5~1/RELEASE_X86_64 x86_64 >>=20 >>=20 >> Here is the flent output: >>=20 >> bash-3.2$ echo "IPv4" ; date ; ping -c 10 netperf-eu.bufferbloat.net = ; ./run-flent --ipv4 -l 60 -H netperf-eu.bufferbloat.net rrul_var = --remote-metadata=3Droot@192.168.42.1 = --test-parameter=3Dcpu_stats_hosts=3Droot@192.168.42.1 --step-size=3D.05 = --test-parameter bidir_streams=3D8 --test-parameter = markings=3DCS0,CS1,CS2,CS3,CS4,CS5,CS6,CS7 --test-parameter = ping_hosts=3D1.1.1.1 -D . -t = IPv4_SQM_cake_layer-cake_LLA-ETH_OH34_U097pct45500of46719K-D090pct105000of= 116789K_hms-beagle2_en4TB2_TurrisOmnia-TurrisOS.6.3.2-pppoe-wan-eth2.7_2_b= ridged-FB7520-OpenWrt-r22256-14334c222e-OutdoorMSAN-VDSL100_2_netperf-eu.b= ufferbloat.net --log-file >> IPv4 >> Sat Oct 14 21:19:24 CEST 2023 >> PING demo.tohojo.dk (193.10.227.30): 56 data bytes >> 64 bytes from 193.10.227.30: icmp_seq=3D0 ttl=3D48 time=3D24.259 ms >> 64 bytes from 193.10.227.30: icmp_seq=3D1 ttl=3D48 time=3D22.789 ms >> 64 bytes from 193.10.227.30: icmp_seq=3D2 ttl=3D48 time=3D24.097 ms >> 64 bytes from 193.10.227.30: icmp_seq=3D3 ttl=3D48 time=3D24.433 ms >> 64 bytes from 193.10.227.30: icmp_seq=3D4 ttl=3D48 time=3D24.342 ms >> 64 bytes from 193.10.227.30: icmp_seq=3D5 ttl=3D48 time=3D24.325 ms >> 64 bytes from 193.10.227.30: icmp_seq=3D6 ttl=3D48 time=3D23.456 ms >> 64 bytes from 193.10.227.30: icmp_seq=3D7 ttl=3D48 time=3D22.628 ms >> 64 bytes from 193.10.227.30: icmp_seq=3D8 ttl=3D48 time=3D24.396 ms >> 64 bytes from 193.10.227.30: icmp_seq=3D9 ttl=3D48 time=3D23.521 ms >>=20 >> --- demo.tohojo.dk ping statistics --- >> 10 packets transmitted, 10 packets received, 0.0% packet loss >> round-trip min/avg/max/stddev =3D 22.628/23.825/24.433/0.649 ms >> Starting Flent 2.1.1+git.7b931915 using Python 3.10.8. >> Starting rrul_var test. Expected run time: 70 seconds. >> Data file written to = ./rrul_var-2023-10-14T211934.512820.IPv4_SQM_cake_layer-cake_LLA-ETH_OH34_= U097pct45500of46719K-D090pct105000of116789K_hms-beagle2_en4TB2_TurrisOmnia= -TurrisOS_6_3_2-pppoe-wan-eth2_7_2_bridged-FB7520-OpenWrt-r22256-14334c222= e-OutdoorMSAN-VDSL100.flent.gz >>=20 >> Summary of rrul_var test run from 2023-10-14 19:19:34.512820 >> Title: = 'IPv4_SQM_cake_layer-cake_LLA-ETH_OH34_U097pct45500of46719K-D090pct105000o= f116789K_hms-beagle2_en4TB2_TurrisOmnia-TurrisOS.6.3.2-pppoe-wan-eth2.7_2_= bridged-FB7520-OpenWrt-r22256-14334c222e-OutdoorMSAN-VDSL100_2_netperf-eu.= bufferbloat.net' >>=20 >> avg median = 99th % # data pts >> Ping (ms) ICMP 1.1.1.1 (extra) : 13.10 12.90 = 17.40 ms 1396 >> Ping (ms) avg : 27.07 N/A = N/A ms 1639 >> Ping (ms)::ICMP : 26.15 26.10 = 30.70 ms 1399 >> Ping (ms)::UDP 0 (CS0) : 27.78 27.55 = 32.13 ms 1639 >> Ping (ms)::UDP 1 (CS1) : 29.34 29.51 = 35.09 ms 1639 >> Ping (ms)::UDP 2 (CS2) : 26.18 26.06 = 30.56 ms 1639 >> Ping (ms)::UDP 3 (CS3) : 26.22 26.06 = 30.77 ms 1639 >> Ping (ms)::UDP 4 (CS4) : 26.20 25.98 = 30.93 ms 1639 >> Ping (ms)::UDP 5 (CS5) : 26.20 26.06 = 31.33 ms 1639 >> Ping (ms)::UDP 6 (CS6) : 28.13 28.11 = 32.86 ms 1639 >> Ping (ms)::UDP 7 (CS7) : 26.51 26.44 = 31.39 ms 1639 >> TCP download avg : 11.33 N/A = N/A Mbits/s 1639 >> TCP download sum : 90.62 N/A = N/A Mbits/s 1639 >> TCP download::0 (CS0) : 11.39 11.25 = 17.48 Mbits/s 1639 >> TCP download::1 (CS1) : 10.66 10.21 = 28.97 Mbits/s 1639 >> TCP download::2 (CS2) : 12.17 11.99 = 18.87 Mbits/s 1639 >> TCP download::3 (CS3) : 11.29 11.06 = 18.27 Mbits/s 1639 >> TCP download::4 (CS4) : 11.87 11.34 = 23.51 Mbits/s 1639 >> TCP download::5 (CS5) : 10.51 10.49 = 16.58 Mbits/s 1639 >> TCP download::6 (CS6) : 11.37 11.15 = 18.32 Mbits/s 1639 >> TCP download::7 (CS7) : 11.36 11.25 = 16.99 Mbits/s 1639 >> TCP totals : 130.00 N/A = N/A Mbits/s 1639 >> TCP upload avg : 4.92 N/A = N/A Mbits/s 1639 >> TCP upload sum : 39.38 N/A = N/A Mbits/s 1639 >> TCP upload::0 (CS0) : 5.50 5.48 = 7.94 Mbits/s 1639 >> TCP upload::1 (CS1) : 2.13 2.19 = 2.64 Mbits/s 1639 >> TCP upload::2 (CS2) : 5.47 5.47 = 7.13 Mbits/s 1639 >> TCP upload::3 (CS3) : 5.47 5.48 = 6.97 Mbits/s 1639 >> TCP upload::4 (CS4) : 5.47 5.49 = 7.23 Mbits/s 1639 >> TCP upload::5 (CS5) : 5.46 5.46 = 6.83 Mbits/s 1639 >> TCP upload::6 (CS6) : 4.96 4.95 = 6.25 Mbits/s 1639 >> TCP upload::7 (CS7) : 4.92 4.94 = 6.18 Mbits/s 1639 >> cpu_stats_root@192.168.42.1::load : 0.40 0.42 = 0.83 1243 >> bash-3.2$ >>=20 >>=20 >>=20 >=20 >=20 > --=20 > Oct 30: = https://netdevconf.info/0x17/news/the-maestro-and-the-music-bof.html > Dave T=C3=A4ht CSO, LibreQos