From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-ob0-x236.google.com (mail-ob0-x236.google.com [IPv6:2607:f8b0:4003:c01::236]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by huchra.bufferbloat.net (Postfix) with ESMTPS id 389C121F41F for ; Thu, 20 Nov 2014 08:14:45 -0800 (PST) Received: by mail-ob0-f182.google.com with SMTP id m8so2491988obr.27 for ; Thu, 20 Nov 2014 08:14:45 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type :content-transfer-encoding; bh=3FQk4aMlemOkU/tuam+DDdaKa7JelREcYqjpcAU/2dk=; b=orx9us1Aw0IhnP4ClEvKDEoDBZF+UBVsDmZLRViuke5BflTzN7iMOmdyMtEqX/lY29 O0q4M/omMlw6mpgSCijsri+qVczbKiNyd0O9umJqpJxR/LWCxg+i1GBGZLoi61tyfgvj odDOa+P/h9xN+d3hqaatl7If1EemBQrhjfXzpgbrMhnmqhaC2BrDVu6pS+9NSSfQU+yA 0U2v74HrLgA4GUsC+3M167EqvaRQJMSiASCeQT8+yYbopJhn35kUVKL1eZXOG5Bu6vOS gpv6QZQ7kCELKFmIPve/N2oizI4aTpgqNzhpbV7lIFgPkXzMXzSPTAx/I7+zZlRY6NUh J5Ag== MIME-Version: 1.0 X-Received: by 10.60.179.234 with SMTP id dj10mr41944229oec.17.1416500085084; Thu, 20 Nov 2014 08:14:45 -0800 (PST) Received: by 10.202.227.211 with HTTP; Thu, 20 Nov 2014 08:14:45 -0800 (PST) Date: Thu, 20 Nov 2014 08:14:45 -0800 Message-ID: From: Dave Taht To: bloat , "aqm@ietf.org" Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Subject: [Bloat] A little nearly GigE testing of various AQM and packet scheduling and fair queuing technologies X-BeenThere: bloat@lists.bufferbloat.net X-Mailman-Version: 2.1.13 Precedence: list List-Id: General list for discussing Bufferbloat List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Nov 2014 16:15:14 -0000 I finally my rangeley off of openwrt and onto ubuntu so as to do some testing of variants of codel, pie, sfq, etc, for the first time at gigE speeds, using the tip of net-next throughout (linux 3.18+, which has the new very exciting bulk_xmit support, and some fixes for GSO handling, and a few other tcp fixes I like a lot). All tests done with ecn on on a short path (nuc1 -> rangeley -> nuc2). I am well aware that longer paths are harder and more interesting, it was just that finding hardware on my budget, that could run fast enough to also measure at GigE speeds, has been a problem. (It does appear that I can make netem in this linux release insert delay sanely, finally, so I hope to have time to try to duplicate tokes results at slower speeds using different tools) See: http://snapon.lab.bufferbloat.net/~d/cakewins.png Highlights: * the still under-prototyping cake and cake2 wins on latency and throughput across the board, rate limited or not rate limited (way to go jon!) (note: flowblind mode is with a single queue, so it tests the htb-like-internal scheduler + codel only) * At these rates. BQL is *needed* to keep the hardware busy. (I know, "duh") With insufficient BQL the various algos starve. cake* starves the least, however, compared to htb + algo. Most of the tests ran with BQL =3D 8000, which is not explicitly expressed in the data set. The bql 32000 results were much better. tail drop or head drop, you still need to have enough stuff in the driver to deal with linux scheduler and x86 context switch latency. * Offloads are are needed for best results (GRO in particular). The rangeley still appears to be "loafing" at these speeds but has high context switch overhead... * Limited numbers of hardware queues (the rangeley has 8) hit the birthday problem in quite obvious ways from the data set... * variants of codel beat pie across the board on latency and are an even match on throughput. * The new simplified version of codel compares almost equally with the older one. (whether that holds up at longer RTTs is still a question) * A packet limit of 1000 results in some tail drop behavior on pie and codel with offloads off. Upped it to 10000. (this still points to a byte limit being preferable to a packet limit) rather than do more plots, the relevant netperf-wrapper data set is at: http://snapon.lab.bufferbloat.net/~d/rangeley_routing.tgz useful subsets are *900mbit* and *bql_32000* I would have liked to have got a better grip on xmit_more, and although the rangeley has support for it in its ethernet card, the e1000es in the nucs, dont. --=20 Dave T=C3=A4ht thttp://www.bufferbloat.net/projects/bloat/wiki/Upcoming_Talks