From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-oi0-x22c.google.com (mail-oi0-x22c.google.com [IPv6:2607:f8b0:4003:c06::22c]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by huchra.bufferbloat.net (Postfix) with ESMTPS id 0D21A21F1E0 for ; Wed, 24 Jun 2015 09:32:14 -0700 (PDT) Received: by oigx81 with SMTP id x81so33735041oig.1 for ; Wed, 24 Jun 2015 09:32:13 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; bh=eVz1xNPOkf9Rn8wx+NWguEH6B1kknyuZVvJ5O2+Mteo=; b=cuSs6WmRd2jxXO5YsdP9Az5r13RavDCmBKQ1KRgskY6i3KUYVl9aM+JquHB6HP+mB1 G6lO5zATJQcwGWeoAhHmYpZY/PGnrJ3Bytd88gmiAIzCS0/Y5aezjGCbHUaBw/gJ/OOZ /uNL5V3uCX+GKSRtDi1ca4Vqrxsn8lnYGad9y8FZwMYhXhWdaubaYwN57FsX1znGzlJZ Nti1u1u2slsttZUdjYt6iUMtA2wvAtcwdh5pkh2O1HMoLBNjIMUDvFnmbrDbhxzqKnAN 5QM+YfBwm7hoGVUYWeaL33Pc7MspQTcuU8Jh6Ur/zaguV5rCBUlUzxovkzCSgYXO5dPY eWbw== MIME-Version: 1.0 X-Received: by 10.60.40.101 with SMTP id w5mr1277631oek.39.1435163533598; Wed, 24 Jun 2015 09:32:13 -0700 (PDT) Received: by 10.202.105.129 with HTTP; Wed, 24 Jun 2015 09:32:13 -0700 (PDT) In-Reply-To: References: <26463A88-821B-44B7-A728-64BCB0B7C7BB@gmx.de> <55847E32.9000405@gmail.com> <5584823E.4040207@gmail.com> <0129B5FB-9D1B-45FF-84CA-492A6A0B638B@gmx.de> Date: Wed, 24 Jun 2015 09:32:13 -0700 Message-ID: From: Dave Taht To: Mikael Abrahamsson Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Cc: cerowrt-devel Subject: Re: [Cerowrt-devel] performance numbers from WRT1200AC (Re: Latest build test - new sqm-scripts seem to work; "cake overhead 40" didn't) X-BeenThere: cerowrt-devel@lists.bufferbloat.net X-Mailman-Version: 2.1.13 Precedence: list List-Id: Development issues regarding the cerowrt test router project List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 24 Jun 2015 16:32:43 -0000 On Wed, Jun 24, 2015 at 4:31 AM, Mikael Abrahamsson wrot= e: > On Tue, 23 Jun 2015, Sebastian Moeller wrote: > >> As Dave said it would be nice see RRUL data from the same testbed. It >> would be so nice if flint had a way to send different sized TCP packets= =E2=80=A6 (I >> guess this might be faked with MSS clamping in the router and relaying o= n >> path MTU discovery?) > > > What kind of tests should I run? I have rrul results now, both at the sam= e > time as running iperf3. I set iperf3 to run with 10 parallel streams, > different MSS per test, and let it run for 30 seconds into the rrul test.= So > in all the tests, iperf3 session stops running half way into the rrul tes= t. > > I set sqm to 500M up and down on eth0, ECN up and down, and not to squash > DSCP in any direction. > > http://swm.pp.se/aqm/rrul-wrt1200ac-150624.pdf >From what I see here you are rarely, if ever, engaging fq_codel properly. Latencies are pretty high. In particular, I would suspect you are hitting offloads hard, and the current (fixed in linux 4.1) codel drop algorithm stops dropping below "maxpacket", which was meant in the ns2 code to be a MTU, but in the linux code ended up being a TSO sized (64k!) packet. tc -s qdisc show # will show the maxpacket. > Tell me if there is more information I can provide or tests to run. 0) I tend to have a script for everything... I can give you an example script in another email. 1) tc -s qdisc show dev whatever # will show actuall drop/mark statistics 2) Please run your flent tests with -x --disable-log -x collects more metadata, --disable-log disables the automatic log scaling which is so hard to discern on these plots. Use -t "title" to differentiate between variables under test. 3) I also tend to use flent's --remote-metadata=3Droot@your_openwrtbox to get the stats on that box into the metadata. You have to add your local .ssh/id_rsa.pub key to your_openwrtbox:/etc/dropbear/authorized_keys file to do this. 4) With all that in hand, sticking up a tarball of the results makes for easy plotting of various other graphs, and using the flent-gui, you can combine results from each run easily, also. 5) try disabling offloads on all interfaces on the router (or running cake) My usual suite of tests is rrul, rrul_be, tcp_1up, tcp_1down, and tcp_2up_d= elay. and rtt_fair (if you have more than one target server available)... all without the iperf stuff.... Your mss changing idea is interesting, and I would like to do a mod to tcp_2up_delay to sort of match your iperf combination + flent to totally capture all data. 6) I am pretty interested as to what happens *without* sqm at the max forwarding rate with fq_codel engaged on all these tests. > > -- > Mikael Abrahamsson email: swmike@swm.pp.se > > _______________________________________________ > Cerowrt-devel mailing list > Cerowrt-devel@lists.bufferbloat.net > https://lists.bufferbloat.net/listinfo/cerowrt-devel > --=20 Dave T=C3=A4ht worldwide bufferbloat report: http://www.dslreports.com/speedtest/results/bufferbloat And: What will it take to vastly improve wifi for everyone? https://plus.google.com/u/0/explore/makewififast