From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-wr0-x22c.google.com (mail-wr0-x22c.google.com [IPv6:2a00:1450:400c:c0c::22c]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by lists.bufferbloat.net (Postfix) with ESMTPS id 52F413BA8E for ; Sun, 26 Nov 2017 14:18:42 -0500 (EST) Received: by mail-wr0-x22c.google.com with SMTP id k18so19487013wre.1 for ; Sun, 26 Nov 2017 11:18:42 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:subject:from:in-reply-to:date:cc:message-id:references :to; bh=Ne8JXWfhXWfIWIhTRjtCF/KVuGR7c8kbpZ5Yux36HD0=; b=Bao+89tYvYp74pytlSkX7FulxA9xpOwe5c51xnFo55wPk/paTqiWBvhGUbRsT+129x Z3YgMpkBubN1kSp9BbaY5PoU+X+qkjjnVqMG+Mxr7FI4QeexWKAxGUGBD5QXARMPB4ig f/QdB/S73Bpe5ujjS2Jyavnc9ZhcZHuaruEdUSjHEnG7qr1Dq04OzcCLbsormC0zIwqM S7r+cGrl1/9k+5DbEU3tiTEx+6RXpeenOVfWfQRT27OKDzRz8dDvyfzZUptgbYBaLxhp I/w/BI8NE30B/CmQ9XQHDohohJFPR7+Zj5+Ex/vQiB23q8ry0OO9W5gGUqvTPqSs/RrP 7yAw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:subject:from:in-reply-to:date:cc :message-id:references:to; bh=Ne8JXWfhXWfIWIhTRjtCF/KVuGR7c8kbpZ5Yux36HD0=; b=YVWYoSG5t7OZ4efjBHhg+QgqW0c7uryU6aa0yhUhyJdMtvn8QBC/Oo9GKtf88vCNGn LJf22HDHNGb/s1Rnbddi5CaZM6vYckL93gAJDA2amQj2HoGGbdH25m9duuTzQzYIw4jd ekudvtvHSChYlRdiKghIYtL1WWvfC5VcxzDpxMtHw/GBVnADFNWUlnzIzhb2WJVmNDAW xkOZeGuWUz5wXYBF1nJC+d4N7VKyAwORFKE8tJA4TyxpFaPWKIGK7HIYUcpqjGfN/sOF 0We8YJ0dg5ddqtCtbVlB5ZwSNTFhHEBxsVt8jG9ceDqJAgcr3fOO/Xj1ca24/QIpdXiD T73w== X-Gm-Message-State: AJaThX73LTqsMjrZbH40c6RhX5OMMu1fhYyEYpCguzzg8GCw0qidHztx EXbMIXb1Nz/qnAqATljSnx8= X-Google-Smtp-Source: AGs4zMYPCGpgRYlOWNuZZQXq9jaygk7YHy4w5cARqG/Jy7CfIAjI9nhQ7cE1GXFlJtLh0eMg0BHukQ== X-Received: by 10.223.186.81 with SMTP id t17mr15891246wrg.275.1511723921361; Sun, 26 Nov 2017 11:18:41 -0800 (PST) Received: from [10.72.0.130] (h-1169.lbcfree.net. [185.99.119.68]) by smtp.gmail.com with ESMTPSA id o88sm38695338wrc.10.2017.11.26.11.18.40 (version=TLS1 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Sun, 26 Nov 2017 11:18:40 -0800 (PST) Content-Type: multipart/alternative; boundary="Apple-Mail=_A629A473-327D-4992-B030-F6022E4C727E" Mime-Version: 1.0 (Mac OS X Mail 9.3 \(3124\)) From: Pete Heist In-Reply-To: <877eucx5ra.fsf@nemesis.taht.net> Date: Sun, 26 Nov 2017 20:18:43 +0100 Cc: Cake List Message-Id: References: <6BE29FE9-6E32-4324-8B56-6BB3B6E5F033@gmail.com> <877eucx5ra.fsf@nemesis.taht.net> To: Dave Taht X-Mailer: Apple Mail (2.3124) Subject: Re: [Cake] cake flenter results round 0 X-BeenThere: cake@lists.bufferbloat.net X-Mailman-Version: 2.1.20 Precedence: list List-Id: Cake - FQ_codel the next generation List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Nov 2017 19:18:42 -0000 --Apple-Mail=_A629A473-327D-4992-B030-F6022E4C727E Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 > On Nov 26, 2017, at 7:19 PM, Dave Taht wrote: >=20 > Pete Heist > writes: >=20 > I think you can safely drop pfifo from future tests. Yeah, done, chuckled at that actually. I was using pfifo as the =E2=80=9Cc= old pool=E2=80=9D. > I'd rather like combined charts so it is possible to eyeball these > differences directly. Just between fq_codel and cake. Or, is there a > tarball available to browse this stuff? Oh I know, I wanted to make the script do =E2=80=9Ccombination plots=E2=80= =9D at the end but never got to it. I=E2=80=99ll try to make an archive = available next time. Meanwhile I just open up run pages in multiple = browser tabs and keyboard shortcut between them. Tests the visual = memory. BTW each run links to the .flent.gz file, but if you want to review more = runs at once it's a pain to download each of them... > Another nice thing to try capturing is queue depth/loss/marks/etc, = which > is --test-parameter qdisc_stats_hosts=3DX,y,z and = qdisc_stats_interfaces=3D You probably saw the `tc -s` output on teardown right? But can check out = the test param... > There's also capturing the tcp statistics on the server that is > possible. I do =E2=80=94socket-stats and have TCP RTT plots, but you mean = something beyond that? >> * I=E2=80=99m a little surprised that fq_codel holds UDP flow latency = a little lower at >> "target 1ms interval 10ms" than cake=E2=80=99s "rtt 10ms=E2=80=9D. It = almost seems like a trend >> that Cake outperforms at lower bandwidths and fq_codel at higher = bandwidths. >=20 > Since fq_codel supports superpackets and cake peels them, we have a = cpu > and latency hit that originates from that. Also the codel derived > algorithm in cake differs quite significantly from mainline codel, and > my principal gripe about it has been that it has not been extensively > tested against higher delays. Ok, next run is going to show lower bandwidths with nflows=3D32/32 and I = think cake is really going to shine there. >> * Anyone see anything in my =E2=80=9CFlow Isolation Mix=E2=80=9D = tests? Those are a little hard >> to read. :) They used to be combined with a VoIP test but I don=E2=80=99= t have a d-itg >> setup now. >=20 > I look forward to you adding OWD irtt based tests. Me too, going to try to get that in soon... >> *** Plans for Future Rounds *** >>=20 >> - Add flow isolation tests with rtt variation (to look again at = problem I >> reported in an earlier thread) >> - Use netem to make a spread of rtts and bandwidths (maybe the most = useful of >> all?) >=20 > Yes. Thought so, that didn=E2=80=99t make it into round 1 but asap after = that. Round 1 just kicked off for the night. I got most of the changes I = wanted in but only had an hour on it today so nothing more...= --Apple-Mail=_A629A473-327D-4992-B030-F6022E4C727E Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8
On Nov 26, 2017, at 7:19 PM, Dave Taht <dave@taht.net> = wrote:

Pete Heist <peteheist@gmail.com> writes:

I think you can safely drop pfifo from = future tests.

Yeah, done, = chuckled at that actually. I was using pfifo as the =E2=80=9Ccold = pool=E2=80=9D.

I'd rather like combined = charts so it is possible to eyeball these
differences directly. Just between = fq_codel and cake. Or, is there a
tarball available to browse this = stuff?

Oh I know, = I wanted to make the script do =E2=80=9Ccombination plots=E2=80=9D at = the end but never got to it. I=E2=80=99ll try to make an archive = available next time. Meanwhile I just open up run pages in multiple = browser tabs and keyboard shortcut between them. Tests the visual = memory.

BTW each run links to the = .flent.gz file, but if you want to review more runs at once it's a pain = to download each of them...

Another nice thing to try = capturing is queue depth/loss/marks/etc, which
is --test-parameter = qdisc_stats_hosts=3DX,y,z and qdisc_stats_interfaces=3D

You probably saw the `tc -s` output on teardown = right? But can check out the test param...

There's also = capturing the tcp statistics on the server that is
possible.

I do =E2=80=94socket-stats and have TCP RTT plots, = but you mean something beyond that?

* I=E2=80=99m a little = surprised that fq_codel holds UDP flow latency a little lower at
"target 1ms interval 10ms" than cake=E2=80=99s "rtt 10ms=E2=80=9D= . It almost seems like a trend
that Cake outperforms at = lower bandwidths and fq_codel at higher bandwidths.

Since fq_codel supports superpackets and cake = peels them, we have a cpu
and latency hit that originates from = that. Also the codel derived
algorithm in cake differs quite = significantly from mainline codel, and
my principal gripe about it has been that = it has not been extensively
tested against higher delays.

Ok, next run is going to show lower bandwidths = with nflows=3D32/32 and I think cake is really going to shine = there.

* Anyone see anything in my =E2=80=9CFlow Isolation Mix=E2=80=9D= tests? Those are a little hard
to read. :) They used to = be combined with a VoIP test but I don=E2=80=99t have a d-itg
setup now.

I look forward to you adding OWD irtt = based tests.

Me too, = going to try to get that in soon...

*** Plans for Future Rounds = ***

- Add flow isolation tests with rtt = variation (to look again at problem I
reported in an = earlier thread)
- Use netem to make a spread of rtts and = bandwidths (maybe the most useful of
all?)

Yes.

Thought so, = that didn=E2=80=99t make it into round 1 but asap after that. Round 1 = just kicked off for the night. I got most of the changes I wanted in but = only had an hour on it today so nothing = more...
= --Apple-Mail=_A629A473-327D-4992-B030-F6022E4C727E--