From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mout.gmx.net (mout.gmx.net [212.227.17.21]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by lists.bufferbloat.net (Postfix) with ESMTPS id 4F0063B2A4 for ; Fri, 4 Sep 2020 10:12:44 -0400 (EDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.net; s=badeba3b8450; t=1599228759; bh=LUkD+l3o46lKOaQNw0NrRTY+O1fJvCfhp5QDf/Dnb38=; h=X-UI-Sender-Class:Subject:From:In-Reply-To:Date:Cc:References:To; b=B8O+ktOBOuEBmtskVzqfUVOd/7WepPAeiNDI0EBorIM0gjobiWNX0SIwP1cE3lO8P 2znGwJYpqRo7jcohgzBdiRQbxEjvB0jJNfA8U8UNZElyZBPb0/DUGsI11q4A/jJcZ4 EO1xg/tLfSUaMc62eWZLZ5B2JKdMyoi50MwVbhpc= X-UI-Sender-Class: 01bb95c1-4bf8-414a-932a-4f6e2808ef9c Received: from [192.168.42.229] ([77.0.80.109]) by mail.gmx.com (mrgmx105 [212.227.17.168]) with ESMTPSA (Nemesis) id 1M1Ycl-1kG7481n5P-0034HC; Fri, 04 Sep 2020 16:12:39 +0200 Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.15\)) From: Sebastian Moeller In-Reply-To: Date: Fri, 4 Sep 2020 16:12:35 +0200 Cc: =?utf-8?Q?Toke_H=C3=B8iland-J=C3=B8rgensen?= , bloat@lists.bufferbloat.net Content-Transfer-Encoding: quoted-printable Message-Id: <518E1B74-2C17-4429-B1C8-3714E8CD2EFA@gmx.de> References: <87mu2bjbf8.fsf@toke.dk> <87eennj64i.fsf@toke.dk> To: Mikael Abrahamsson X-Mailer: Apple Mail (2.3445.104.15) X-Provags-ID: V03:K1:GFhDPlabRVJBiWPOl75zvsJb15fHbM8sCSsP5oSu7Xex9n7E069 bhl5adc2cMv3ONi26uKWo2l+1LXGtZfjKw71HMRJHfE/JAW3METYAikLQ0Wzk9TQzL2ju3F UllWQrCUySWGQxIEE+Vld381HCQWTxGgR/bfEubfWHpWk7I2HqTZhZfkXAUn8PAyxsaZu6n LXXBLyoFt+B0FbOE3W0xQ== X-Spam-Flag: NO X-UI-Out-Filterresults: notjunk:1;V03:K0:Jq0D9l2AEkg=:lV13AVOFqYaIaMENr9hMNk igyBA2BcqLTLQpfeiL8Et3Gu/j3CEkvb0KqIe+m7GrMS7WdJeVO+WbR5P7NcJX3i/J4w6NR79 sEp4mSmES2oMwy/WNKnmy+Scv30TFpCN6Z1UZ73PoVsot7O69nyviHnu9YEsCOyUS8kSgPneW EhPnPrxAnvtGjgwtRIyj5seByfCELrodufGE9wfxby11uN4rXudAmW+2cq0G0/wR0+8pmEolb w0ib/N4gOgp8jRf8AGY2uwRC9ztit8j3NEzr74Wn4VmWKGnHU5urlKJjO4hgjM6OUFgtzKWTn KavFz/1rNQK6d1lv0ib8ogF7n13RfnmhDTPQekpqBjswRsZqfc/8GfBtzUdby2Y1RiDzGHYq7 eMZTrQVaCnEwolsdj50g4FIG1p9RaoDPN3OU8PfANAKrtWGPX5+/GsuTp7TRW6/X2DbcpHGKS uA5gB3nTFX+5hEVEoy0ZaxjZ/E3pbrUvAeTaQ8E6ZzVufNF/Ox70RSnvYBE3Xwifh9Hl0g0kt mvZW2ds5mCfKJ7EaDkrZlTstkrJikvNzEuRqwlsa5vwTRvwWn+YGDGNHFqM72/tJN8aj/rHUP Mvskr82I+LrLZ2OB0sCqRnz3e/X7QG9klHvNEdBBEUX+gLv6+umcgIpfMQChHBQn5IaosV8ZZ /K2ANuI6Laq/V7tR4q0zasNNyNvCiQ9BouQKjmZ6KgqsBu2t2KPYH1coiHE/XPdDoVpr8rJ45 kGvUsSMr050RefzzyoCeUaK+N7HnkPO4ZsARDaE0WjoQRnMU7/HXCXeJ3L3kf8V58EvEKTb2p vY2aweRaxqht/44u4KgmG1v4sehOgrIhy6Ngw0bb69149FZ/YHAtUAXkJNJyEfnyapX1AVJ07 T3VrGou0drLSRrD4j0JBkTGvFk+JwzERo4adXuX03Nwmxn7S9BVII6tViwXyQKHL8nHMjWNdL iq9+QpLzkItfkHfW1xUm73m6/BPQjQuq2i7jQeyUBn5jeXpoFbVMMx4m4J7YSvNa/sL2TS5C/ qwAhH8PlErYxFuKByTqzai0IO2X9VjitdxZb2BEfi7smgMWxRtTqWJ+wxt0FDJi1xoQGqR/vV 0QS3e26rIWolJqvFh8OqL2OuuaOi55s3Jiap3wTNC7kFD4pdq5vUrdbbACEUiglhYWjwvbAMt dhZPB3wft2TdMsBS17qNtjvDzF+hAUunDWYSJIUXzUvrAsKu0oR/weP9CwwUkX+T+8bkUVk3H zpVBV/C7XGswy2WEL Subject: Re: [Bloat] CAKE in openwrt high CPU X-BeenThere: bloat@lists.bufferbloat.net X-Mailman-Version: 2.1.20 Precedence: list List-Id: General list for discussing Bufferbloat List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Sep 2020 14:12:44 -0000 Hi Mikael, Thanks! That looks like a fully saturated core, no? I do not know how to = parse the symbols here, so not sure what "class" of load is denoted by = the star, but I would guess something including sirqs? Anyway the = average is ~49% load, while clearly CPU is pegged already. I assume the = htop data is from the HGW... best regards Sebastian > On Sep 4, 2020, at 15:37, Mikael Abrahamsson wrote: >=20 > On Thu, 3 Sep 2020, Sebastian Moeller wrote: >=20 >> Mmmh, how did you measure the sirq percentage? Some top versions = show overall percentage with 100% meaning all CPUs, so 35% in a quadcore = could mean 1 fully maxed out CPU (25%) plus an additional 10% spread = over the other three, or something more benign. Better top (so not = busybox's) or htop versions also can show the load per CPU which is = helpful to pinpoint hotspots... >=20 > If I run iperf3 with 10 parallel sessions then htop shows this (in the = CAKE upstream direction I believe): >=20 > 1 [* = 0.7%] Tasks: 19, 0 thr; 2 running > 2 = [*************************************************************************= ********100.0%] Load average: 0.48 0.16 0.05 > 3 [#*************************************** = 44.4%] Uptime: 10 days, 04:46:37 > 4 [************************************************ = 54.2%] > Mem[|#* = 36.7M/3.84G] > Swp[ = 0K/0K] >=20 > The other direction (-R), typically this: >=20 > 1 [#*********** = 13.0%] Tasks: 19, 0 thr; 2 running > 2 [*********************************************** = 53.9%] Load average: 0.54 0.25 0.09 > 3 [#************************************************* = 55.8%] Uptime: 10 days, 04:47:36 > 4 = [*************************************************************************= * 84.4%] >=20 > Topology is: >=20 > PC - HGW -> Internet >=20 > iperf3 is run on the PC, HGW has CAKE in the -> Internet direction. >=20 >> Best Regards >> Sebastian >>=20 >>>=20 >>> root@OpenWrt:~# tc -s qdisc >>> qdisc noqueue 0: dev lo root refcnt 2 >>> Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0) >>> backlog 0b 0p requeues 0 >>> qdisc cake 8034: dev eth0 root refcnt 9 bandwidth 900Mbit diffserv3 = triple-isolate nonat nowash no-ack-filter split-gso rtt 100.0ms raw = overhead 0 >>> Sent 1111772001 bytes 959703 pkt (dropped 134, overlimits 221223 = requeues 179) >>> backlog 0b 0p requeues 179 >>> memory used: 2751976b of 15140Kb >>> capacity estimate: 900Mbit >>> min/max network layer size: 42 / 1514 >>> min/max overhead-adjusted size: 42 / 1514 >>> average network hdr offset: 14 >>>=20 >>> Bulk Best Effort Voice >>> thresh 56250Kbit 900Mbit 225Mbit >>> target 5.0ms 5.0ms 5.0ms >>> interval 100.0ms 100.0ms 100.0ms >>> pk_delay 0us 22us 232us >>> av_delay 0us 6us 7us >>> sp_delay 0us 4us 5us >>> backlog 0b 0b 0b >>> pkts 0 959747 90 >>> bytes 0 1111935437 39440 >>> way_inds 0 22964 0 >>> way_miss 0 275 2 >>> way_cols 0 0 0 >>> drops 0 134 0 >>> marks 0 0 0 >>> ack_drop 0 0 0 >>> sp_flows 0 3 1 >>> bk_flows 0 1 0 >>> un_flows 0 0 0 >>> max_len 0 68130 3714 >>> quantum 1514 1514 1514 >>>=20 >>>=20 >>> -- >>> Mikael Abrahamsson email: = swmike@swm.pp.se_______________________________________________ >>> Bloat mailing list >>> Bloat@lists.bufferbloat.net >>> https://lists.bufferbloat.net/listinfo/bloat >>=20 >=20 > --=20 > Mikael Abrahamsson email: swmike@swm.pp.se