From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-wg0-f47.google.com (mail-wg0-f47.google.com [74.125.82.47]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority" (verified OK)) by huchra.bufferbloat.net (Postfix) with ESMTPS id 94F65202187; Tue, 9 Oct 2012 11:28:23 -0700 (PDT) Received: by mail-wg0-f47.google.com with SMTP id ge7so3516875wgb.28 for ; Tue, 09 Oct 2012 11:28:21 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; bh=5zmJ49m3UYQh1dLuiW5WKD+cphP9pfWmFULZVOXz8K8=; b=lqq/Pgr8TB2FfmWLfay+5LtO8ZsM12X9tzrk3t6OjpNETCoZZvpRsJLV1ykAUnubPJ KPevxdCLGjmhnkp6hWlG2NRwdfaYFDVETbqlma94zJk0+HCU6uYrU8+2o5hH427nNyep w4MPVzVS8NjTGrBLT3wGECYJl9EuvWugf1Axt9Ty2W3eu/ii6Q2GZhXpoSMhEYnJXLrX uhsNPrLQdVZdaKUP97yIl757I9xOdPprcum5TwtWAPJsqapYGmZGnTMXjY8o+6ozYFLQ hLJS3y7dkWtM28UW/n73Nep6ssNu4GUGr0uWTnbyEhm18zc8xspyPGRn4CD+WPLzMc46 /YFw== MIME-Version: 1.0 Received: by 10.180.89.7 with SMTP id bk7mr6589324wib.0.1349807301139; Tue, 09 Oct 2012 11:28:21 -0700 (PDT) Received: by 10.223.129.135 with HTTP; Tue, 9 Oct 2012 11:28:21 -0700 (PDT) In-Reply-To: <507454AA.9060206@hp.com> References: <87d30rra1s.fsf@toke.dk> <507454AA.9060206@hp.com> Date: Tue, 9 Oct 2012 11:28:21 -0700 Message-ID: From: Dave Taht To: Rick Jones Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Cc: =?ISO-8859-1?Q?Toke_H=F8iland=2DJ=F8rgensen?= , codel@lists.bufferbloat.net, bloat@lists.bufferbloat.net Subject: Re: [Bloat] [Codel] better testing, linux 3.6.1, cerowrt credits, other stuff X-BeenThere: bloat@lists.bufferbloat.net X-Mailman-Version: 2.1.13 Precedence: list List-Id: General list for discussing Bufferbloat List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Oct 2012 18:28:24 -0000 On Tue, Oct 9, 2012 at 9:45 AM, Rick Jones wrote: > Toke - > > The script looks reasonable. Certainly cleaner than any Python I've yet > written :) I might be a little worried about skew error though (assuming > I've not mis-read the script and example ini file). That is why I use th= e > "demo mode" of netperf in > http://www.netperf.org/svn/netperf2/trunk/doc/examples/bloat.sh though i= t > does make the post-processing rather more involved. In my case I originally had a preference for writing wrappers in lua (as this is the highest level language available on the router itself) but rapidly ran into snags with the overall lack of additional library support and my own lack of lua expertise. Python is a much easier language to deal with. That said, there is a start at lua wrappers as well as various post-processing scripts for things like gnuplot in my deBloat repo on github. The last time I got serious about getting something more conventionally publishable is in https://github.com/dtaht/deBloat/tree/master/test/results Some stuff that drives gnuplot and does cdf: https://github.com/dtaht/deBloat/tree/master/test/sfqs My most current series of ad-hoc tests are at: https://github.com/dtaht/deBloat/tree/master/test/multiple_codels and I'm painfully aware of how ad-hoc they are, presently. There's multiple flooding tests, as well as multiple setup scripts for htb and hfsc, in there... my primary purpose in this test series was to determine codel vs ns2_codel characteristics. Initial results pointed at the ns2_codel derived versions managing a queue depth better than the linux codel versions... But: It became obvious fast that long RTT tests were needed, which I've been trying to establish the infrastructure to do, and the big flooding tests therein seems to point to a "horizontal standing queue" issue that I wrote efq_codel to start to resolve, as well as issues where the queue size is between 0 and 1 and low bandwidths. And that TCP small queues mess up (improve) the behavior of netperf, invalidating data not collected with that on.... (as well as tso/gso/ufo/gro really mucking with things, so I generally turn them off with the debloat tool) I'm tickled Toke is also dumping stuff into org-mode, which makes publishing content much easier from emacs. I will gladly start collecting tests and test results into that repo if that helps, and grant commit privs. Or start over. There's tons of cruft in there. Good commit logs, tho... > I see you are running the TCP_RR test for less time than the > TCP_STREAM/TCP_MAERTS test. What do you then do to show the latency with= out > the bulk transfer load? We seem to be converging on this as a decent test, as this is similar to tests that blogic and myself run. In my case I had established baseline latency once using TCP_RR, and didn't feel the need to re-establish the number on every test. I also have a voip-like test that uses fping on a 10ms interval instead of TCP_RR. This is useful in wireless especially, as that data is crazy noisy. I find CDF plots very useful of data like that. Coherently tracking certain other variables (such as the actual tc qdisc line and sampling tc -s statistics across an interval) across tests is also needed. Another very useful test is TCP_STREAM + TCP_RR while running the google chrome benchmarks. Obviously standardization on easily repeatable tests is desperately needed!= ! > > You may find > http://www.netperf.org/svn/netperf2/trunk/doc/netperf.html#Omni-Output-Se= lection > in 2.5.0 and 2.6.0 helpful when it comes to getting netperf to emit speci= fic > measurements. > > I was thinking of trying to write a version of bloat.sh in python but bef= ore > I did I wanted to know if python was sufficiently available in most folks > bufferbloat testing environments. I figure in "full-featured" *nix syste= ms > that isn't an issue, but what about in the routers? > > happy benchmarking, > > rick jones > here are some links concerning demo mode: > http://www.netperf.org/svn/netperf2/trunk/doc/netperf.html#Using-_002d_00= 2denable_002ddemo > > http://www.netperf.org/svn/netperf2/trunk/doc/netperf.html#index-g_t_002d= D_002c-Global-22 > _______________________________________________ > Bloat mailing list > Bloat@lists.bufferbloat.net > https://lists.bufferbloat.net/listinfo/bloat --=20 Dave T=E4ht Fixing bufferbloat with cerowrt: http://www.teklibre.com/cerowrt/subscribe.= html