From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-oi1-x22d.google.com (mail-oi1-x22d.google.com [IPv6:2607:f8b0:4864:20::22d]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by lists.bufferbloat.net (Postfix) with ESMTPS id 9FFB93CB35 for ; Fri, 5 Apr 2019 12:58:23 -0400 (EDT) Received: by mail-oi1-x22d.google.com with SMTP id v84so5431257oif.4 for ; Fri, 05 Apr 2019 09:58:23 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=wJzwfJ1r/KYCUDMheSI/XQQG6FQnNw04odHoIOIHD6k=; b=DqTfHPnjA8R1OAlv65HP/Pm4l4UubNW1L1OSpjJbLNMeptxNSRZfg+pnJalc8gMUUd 80VF61IRxl/dUXnroA1Vxn5E6/yvUzi/g/5oq4ApDNcaSAnYJrhLW+Gb3JJ31Oot2GuY 2Hib4vAB39YmXcJKOpBzk7BHlV7Rc7U01BesNnl0zYlHnuUoSz1b4TklTpLLP54e6uHV 3qkfZs0EAhEMGyJPetnUhvIETrC33TlW8CuKiruMGnkfEIJcMs/tNO3+gKa/Lp4FZi7S DQj4FWodbgxQXlzIaGWG85fXtX6ZXgzUa9F+8VjD1jICmLwAmzNgGf5kxhOX0ZufpDzT K5Yg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=wJzwfJ1r/KYCUDMheSI/XQQG6FQnNw04odHoIOIHD6k=; b=AAN91ZBmSisnsNagkuAy8jPV6//xj9xt//KImGTiY62xJiY9leTNHylNU68im0w3nh 0lzB1bK/SI8A2e8vQaGEz6TWMWH2TsoqYSZVIBsQi371LWf3x1DDuY6WLOXtKJbKZYlT rsQTMI0JQYh8gy8lt4H5bsxVZxRVzRk9wvxQ53PsYc8cBSpkmxrHbsGiOrT8zxc04HLP 1efQJmSC1uVh0DH648b5h2diXveyEYCcxhPQVWATKwCEh5Cas4Q34pGvu3KUO3sy8rIu oQIqrxdTmcqEp854JgkVBbCzsDunruZCboPVJQxeSex/FBpSj03sTeH5gcqybmuV1UqT 0Q1g== X-Gm-Message-State: APjAAAWdYqATDEZzI+RxlkA/q6QB7DgRzTct8ohq8DrVVBOpOBo4Le24 ASFvz3cTHgwmvteOPxZXpNRsmg8zK4lHI88arlCbFQ== X-Google-Smtp-Source: APXvYqyLsc9/2tUTCdpsFY8oWWeq5vMJI2X7yLVVJGV2CGTG/rRMIRBL11oNybpTG3tDV5xo1PFa37xblFDHoOUa9GY= X-Received: by 2002:aca:d487:: with SMTP id l129mr8270262oig.129.1554483502726; Fri, 05 Apr 2019 09:58:22 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Neal Cardwell Date: Fri, 5 Apr 2019 12:58:06 -0400 Message-ID: To: Dave Taht Cc: ECN-Sane , BBR Development , flent-users Content-Type: multipart/alternative; boundary="000000000000fdbaf80585cb64a5" Subject: Re: [Ecn-sane] [bbr-dev] duplicating the BBRv2 tests at iccrg in flent? X-BeenThere: ecn-sane@lists.bufferbloat.net X-Mailman-Version: 2.1.20 Precedence: list List-Id: Discussion of explicit congestion notification's impact on the Internet List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 05 Apr 2019 16:58:23 -0000 --000000000000fdbaf80585cb64a5 Content-Type: text/plain; charset="UTF-8" On Fri, Apr 5, 2019 at 11:51 AM Dave Taht wrote: > > Was GRO/GSO enabled on the router? host? server? > In this particular invocation of this particular test, the sender, receiver, and router functionality were all running on the same machine, using network namespaces and veth devices; TSO and GRO were enabled. > > > >> > >> 5) What was the result with fq_codel instead? > > > > > > With fq_codel and the same ECN marking threshold (fq_codel ce_threshold > 242us), we see slightly smoother fairness properties (not surprising) but > with slightly higher latency. > > > > The basic summary: > > > > retransmits: 0 > > flow throughput: [46.77 .. 51.48] > > RTT samples at various percentiles: > > % | RTT (ms) > > ------+--------- > > 0 1.009 > > 50 1.334 > > 60 1.416 > > 70 1.493 > > 80 1.569 > > 90 1.655 > > 95 1.725 > > 99 1.902 > > 99.9 2.328 > > 100 6.414 > > This is lovely. Is there an open source tool you are using to generate > this from the packet capture? From wireshark? Or is this from sampling > the TCP_INFO parameter of netperf? Thanks. The results and bandwidth graphs are from an internal test orchestration/evaluation/visualization tool written a few years ago by our BBR team member, Soheil Hassas Yeganeh, and further enhanced by others on our team over the years. We are trying to find the time to open-source it, but haven't yet. It can generate the graphs either from pcap files or "ss" output. This one was from "ss" output. neal --000000000000fdbaf80585cb64a5 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
On Fri, Apr 5, 2019 at 1= 1:51 AM Dave Taht <dave.taht@gmai= l.com> wrote:

Was GRO/GSO enabled on the router? host? server?

<= /div>
In this particular invocation of this particular test, the sender= , receiver, and router functionality were all running on the same machine, = using network namespaces and veth devices; TSO and GRO were enabled.
<= div>=C2=A0
>
>>
>> 5) What was the result with fq_codel instead?
>
>
> With fq_codel and the same ECN marking threshold (fq_codel ce_threshol= d 242us), we see slightly smoother fairness properties (not surprising) but= with slightly higher latency.
>
> The basic summary:
>
> retransmits: 0
> flow throughput: [46.77 .. 51.48]
> RTT samples at various percentiles:
>=C2=A0 =C2=A0%=C2=A0 =C2=A0| RTT (ms)
> ------+---------
>=C2=A0 =C2=A0 0=C2=A0 =C2=A0 1.009
>=C2=A0 =C2=A050=C2=A0 =C2=A0 1.334
>=C2=A0 =C2=A060=C2=A0 =C2=A0 1.416
>=C2=A0 =C2=A070=C2=A0 =C2=A0 1.493
>=C2=A0 =C2=A080=C2=A0 =C2=A0 1.569
>=C2=A0 =C2=A090=C2=A0 =C2=A0 1.655
>=C2=A0 =C2=A095=C2=A0 =C2=A0 1.725
>=C2=A0 =C2=A099=C2=A0 =C2=A0 1.902
>=C2=A0 =C2=A099.9=C2=A0 2.328
>=C2=A0 100=C2=A0 =C2=A0 6.414

This is lovely. Is there an open source tool you are using to generate
this from the packet capture? From wireshark? Or is this from sampling
the TCP_INFO parameter of netperf?

Thanks. = The results and bandwidth graphs are from an internal test orchestration/ev= aluation/visualization tool written a few years ago by our BBR team member,= Soheil Hassas Yeganeh, and further enhanced by others on our team over the= years. We are trying to find the time to open-source it, but haven't y= et. It can generate the graphs either from pcap files or "ss" out= put. This one was from "ss" output.

neal=

--000000000000fdbaf80585cb64a5--