From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-qk0-x22d.google.com (mail-qk0-x22d.google.com [IPv6:2607:f8b0:400d:c09::22d]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by huchra.bufferbloat.net (Postfix) with ESMTPS id AE1A821F3D5 for ; Wed, 24 Jun 2015 18:53:54 -0700 (PDT) Received: by qkhu186 with SMTP id u186so31434025qkh.0 for ; Wed, 24 Jun 2015 18:53:53 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=D328+/h9s4dMpou/h7mMnIb9PILi/t1jHkPb0MWkhgM=; b=IP3GdXMGq99Txj42Zhehpo9j09VqfE2BJo8UwYCBWnVeDq6a31G0tdRe7uOV43A+gM nqNBkMA4ZnFtKQKz03nhnFZI0S0C3TrmIQsSdaZ5crMoi4HESU4OzQpIXSeL0IgsE2dy qeMZEvzbMQ+2N4O/oluzqQkHnoxq1kUYAp5EunSHBd7iuQTtJaSFRRjQX9w5i/8rnB6U 3bgrG2ouYGjOrKh3/GVj0SR4fjQ/BIpLKucY0q/+fPegGT+tYKw2GGXoiYfI8h8AC3F9 ovzBN9txvwWgfbErk8NfyOYA3U3I1CmSITPyJTQo3X03dl4hKhab5Fm5tULcNmnl3hhj BgMw== MIME-Version: 1.0 X-Received: by 10.140.99.65 with SMTP id p59mr56051460qge.46.1435197233063; Wed, 24 Jun 2015 18:53:53 -0700 (PDT) Received: by 10.96.187.71 with HTTP; Wed, 24 Jun 2015 18:53:52 -0700 (PDT) In-Reply-To: References: <26463A88-821B-44B7-A728-64BCB0B7C7BB@gmx.de> <55847E32.9000405@gmail.com> <5584823E.4040207@gmail.com> <0129B5FB-9D1B-45FF-84CA-492A6A0B638B@gmx.de> Date: Wed, 24 Jun 2015 18:53:52 -0700 Message-ID: From: Aaron Wood To: Dave Taht Content-Type: multipart/alternative; boundary=001a113db0d8426d1a05194de52d Cc: cerowrt-devel Subject: Re: [Cerowrt-devel] performance numbers from WRT1200AC (Re: Latest build test - new sqm-scripts seem to work; "cake overhead 40" didn't) X-BeenThere: cerowrt-devel@lists.bufferbloat.net X-Mailman-Version: 2.1.13 Precedence: list List-Id: Development issues regarding the cerowrt test router project List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 25 Jun 2015 01:54:23 -0000 --001a113db0d8426d1a05194de52d Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Here's a long-range (indoors) test result with the 1900AC. I have about 9dB snr at the client (all the way across my house, which has plaster walls): http://www.dslreports.com/speedtest/737736 download buffering is the 1900ac, upload buffering is the mac laptop's driver. Both are trying too hard to deliver those packets, I think. The driver has crazy over-buffering in the face of poor signal conditions. OTOH, I'm amazed at the throughput numbers. But this is an 80Mhz wide 5Ghz channel, in a quiet environment, so it has LOTS of airspace to work in. -Aaron On Wed, Jun 24, 2015 at 9:32 AM, Dave Taht wrote: > On Wed, Jun 24, 2015 at 4:31 AM, Mikael Abrahamsson > wrote: > > On Tue, 23 Jun 2015, Sebastian Moeller wrote: > > > >> As Dave said it would be nice see RRUL data from the same testbed. It > >> would be so nice if flint had a way to send different sized TCP > packets=E2=80=A6 (I > >> guess this might be faked with MSS clamping in the router and relaying > on > >> path MTU discovery?) > > > > > > What kind of tests should I run? I have rrul results now, both at the > same > > time as running iperf3. I set iperf3 to run with 10 parallel streams, > > different MSS per test, and let it run for 30 seconds into the rrul > test. So > > in all the tests, iperf3 session stops running half way into the rrul > test. > > > > I set sqm to 500M up and down on eth0, ECN up and down, and not to squa= sh > > DSCP in any direction. > > > > http://swm.pp.se/aqm/rrul-wrt1200ac-150624.pdf > > From what I see here you are rarely, if ever, engaging fq_codel > properly. Latencies are pretty high. In particular, I would suspect > you are hitting offloads hard, and the current (fixed in linux 4.1) > codel drop algorithm stops dropping below "maxpacket", which was meant > in the ns2 code to be a MTU, but in the linux code ended up being a > TSO sized (64k!) packet. > > tc -s qdisc show # will show the maxpacket. > > > Tell me if there is more information I can provide or tests to run. > > 0) I tend to have a script for everything... I can give you an example > script in another email. > > 1) tc -s qdisc show dev whatever # will show actuall drop/mark statistics > > 2) Please run your flent tests with -x --disable-log > > -x collects more metadata, --disable-log disables the automatic log > scaling which is so hard to discern on these plots. > > Use -t "title" to differentiate between variables under test. > > 3) I also tend to use flent's --remote-metadata=3Droot@your_openwrtbox > to get the stats on that box into the metadata. You have to add your > local .ssh/id_rsa.pub key to > your_openwrtbox:/etc/dropbear/authorized_keys file to do this. > > 4) With all that in hand, sticking up a tarball of the results makes > for easy plotting of various other graphs, and using the flent-gui, > you can combine results from each run easily, also. > > 5) try disabling offloads on all interfaces on the router (or running cak= e) > > My usual suite of tests is rrul, rrul_be, tcp_1up, tcp_1down, and > tcp_2up_delay. > > and rtt_fair (if you have more than one target server available)... > all without the iperf stuff.... > > Your mss changing idea is interesting, and I would like to do a mod to > tcp_2up_delay to sort of match your iperf combination + flent to > totally capture all data. > > 6) I am pretty interested as to what happens *without* sqm at the max > forwarding rate with fq_codel engaged on all these tests. > > > > > -- > > Mikael Abrahamsson email: swmike@swm.pp.se > > > > _______________________________________________ > > Cerowrt-devel mailing list > > Cerowrt-devel@lists.bufferbloat.net > > https://lists.bufferbloat.net/listinfo/cerowrt-devel > > > > > > -- > Dave T=C3=A4ht > worldwide bufferbloat report: > http://www.dslreports.com/speedtest/results/bufferbloat > And: > What will it take to vastly improve wifi for everyone? > https://plus.google.com/u/0/explore/makewififast > _______________________________________________ > Cerowrt-devel mailing list > Cerowrt-devel@lists.bufferbloat.net > https://lists.bufferbloat.net/listinfo/cerowrt-devel > --001a113db0d8426d1a05194de52d Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Here's a long-range (indoors) test result with the 190= 0AC.=C2=A0 I have about 9dB snr at the client (all the way across my house,= which has plaster walls):


download buffering is the 1900ac, upload bufferi= ng is the mac laptop's driver.=C2=A0 Both are trying too hard to delive= r those packets, I think.

The driver has crazy ove= r-buffering in the face of poor signal conditions.=C2=A0 OTOH, I'm amaz= ed at the throughput numbers.=C2=A0 But this is an 80Mhz wide 5Ghz channel,= in a quiet environment, so it has LOTS of airspace to work in.
<= br>
-Aaron

On Wed, Jun 24, 2015 at 9:32 AM, Dave Taht <dave.taht@g= mail.com> wrote:
On Wed, Jun 24, 2015 at 4:31 AM, Mikael Abrahamsson <swmike@swm.pp.se> wrote:
> On Tue, 23 Jun 2015, Sebastian Moeller wrote:
>
>> As Dave said it would be nice see RRUL data from the same testbed.= It
>> would be so nice if flint had a way to send different sized TCP pa= ckets=E2=80=A6 (I
>> guess this might be faked with MSS clamping in the router and rela= ying on
>> path MTU discovery?)
>
>
> What kind of tests should I run? I have rrul results now, both at the = same
> time as running iperf3. I set iperf3 to run with 10 parallel streams,<= br> > different MSS per test, and let it run for 30 seconds into the rrul te= st. So
> in all the tests, iperf3 session stops running half way into the rrul = test.
>
> I set sqm to 500M up and down on eth0, ECN up and down, and not to squ= ash
> DSCP in any direction.
>
> http://swm.pp.se/aqm/rrul-wrt1200ac-150624.pdf

From what I see here you are rarely, if ever, engaging fq_codel
properly. Latencies are pretty high. In particular, I would suspect
you are hitting offloads hard, and the current (fixed in linux 4.1)
codel drop algorithm stops dropping below "maxpacket", which was = meant
in the ns2 code to be a MTU, but in the linux code ended up being a
TSO sized (64k!) packet.

tc -s qdisc show # will show the maxpacket.

> Tell me if there is more information I can provide or tests to run.
0) I tend to have a script for everything... I can give you an examp= le
script in another email.

1) tc -s qdisc show dev whatever # will show actuall drop/mark statistics
2) Please run your flent tests with -x --disable-log

-x collects more metadata, --disable-log disables the automatic log
scaling which is so hard to discern on these plots.

Use -t "title" to differentiate between variables under test.

3) I also tend to use flent's --remote-metadata=3Droot@your_openwrtbox<= br> to get the stats on that box into the metadata. You have to add your
local .ssh/id_rsa.pub key to
your_openwrtbox:/etc/dropbear/authorized_keys file to do this.

4) With all that in hand, sticking up a tarball of the results makes
for easy plotting of various other graphs, and using the flent-gui,
you can combine results from each run easily, also.

5) try disabling offloads on all interfaces on the router (or running cake)=

My usual suite of tests is rrul, rrul_be, tcp_1up, tcp_1down, and tcp_2up_d= elay.

and rtt_fair (if you have more than one target server available)...
all without the iperf stuff....

Your mss changing idea is interesting, and I would like to do a mod to
tcp_2up_delay to sort of match your iperf combination + flent to
totally capture all data.

6) I am pretty interested as to what happens *without* sqm at the max
forwarding rate with fq_codel engaged on all these tests.

>
> --
> Mikael Abrahamsson=C2=A0 =C2=A0 email: swmike@swm.pp.se
>
> _____________________________________= __________
> Cerowrt-devel mailing list
> Cerowrt-devel@l= ists.bufferbloat.net
> https://lists.bufferbloat.net/listinfo/ce= rowrt-devel
>



--
Dave T=C3=A4ht
worldwide bufferbloat report:
http://www.dslreports.com/speedtest/results/b= ufferbloat
And:
What will it take to vastly improve wifi for everyone?
https://plus.google.com/u/0/explore/makewififast=
____________________________= ___________________
Cerowrt-devel mailing list
Cerowrt-devel@lists.= bufferbloat.net
https://lists.bufferbloat.net/listinfo/cerowrt-d= evel

--001a113db0d8426d1a05194de52d--