From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-qt0-x22e.google.com (mail-qt0-x22e.google.com [IPv6:2607:f8b0:400d:c0d::22e]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by lists.bufferbloat.net (Postfix) with ESMTPS id 22ED03CB3E for ; Wed, 29 Nov 2017 09:43:33 -0500 (EST) Received: by mail-qt0-x22e.google.com with SMTP id 33so4611744qtv.1 for ; Wed, 29 Nov 2017 06:43:33 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=XfQx80MHxC2j4YV/vkTCXII+gqYKfUA5lg8rWCIS8uI=; b=HYXIzwZA4IJoVfGr6evVYg7VDHsKgEOiAOBZfdHlEnHIqjSNNXCQqH7AzoIL1dCBFC e9BdyhfYB2JnLOaKZ3Kkis/C86PCzDnyEDZuob/S2LVY9JDcMKpkvuuOuctinU33j0hF dQCo+GLpFgxFKV0/5g50IrnuUqp0jmpHEZQkapTkx2f0ssz7wmDqo8Y/Im/xvHoBk0U0 qQE6K/L0nvolXGGe4IFk1vP7yhs22Hlj2MXrqMvYO0X4xdpt+7mqNgzeEG9XBKBU6ig+ yTJkeBN1FgPc3MTN1wYylRTqE23njTQZXuMjyqk6BzHGElVe6Wtfo3EIOYrOtG46WmLb fxGQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=XfQx80MHxC2j4YV/vkTCXII+gqYKfUA5lg8rWCIS8uI=; b=L/PSE2S/jNAnVKdCZgHUeiCTcGpvMUwSNDgpcZiC/MndOUnE8Ang5ePm3BE4qHl57g Dgc8qAFBXBdKJ21lVEHS/p7gcspn36E/9mXCs1p3hBpPk/WFxGQGGgHokSbuHzhmd+SY Bq0yiq3+hjiFFd+Qas/ILFui4LAJDhqdTmMlPGbB9PnIhn14+nOoPDGlY8LuXK0yjsoq lttRby4EJrFQ7/1TgeQcDbTqsllCoaT+GGy7OgrRTjdMaZpEQ/p6vSptajqbcamYVf4f irKKqXr3GzGCLyylH4DioyR2wiDz9ND43ZJX0F2zumdnhQyRTinbqfkkZ+R0UZNZoFL9 fAhw== X-Gm-Message-State: AJaThX59DpPh9GIE0Fdxh9FkWUNsKqrRW9lOpxRm18nOPG3JNEbrCPeN 2xDJGJmIslhbHyAukGfXCNN1+e4NLXBJv67jo2A= X-Google-Smtp-Source: AGs4zMb2wcfQWaDOzF4IC6OP7lbHAMy0T3qdAB/U9PISY/4Q91UuDyVJJ8NzUnyVAlQmtlvqGsKWoU4IPWCVsI6IGfs= X-Received: by 10.200.36.105 with SMTP id d38mr4899933qtd.180.1511966612547; Wed, 29 Nov 2017 06:43:32 -0800 (PST) MIME-Version: 1.0 Received: by 10.140.95.69 with HTTP; Wed, 29 Nov 2017 06:43:32 -0800 (PST) In-Reply-To: References: <745FEC66-95A7-40E1-A8FA-57714D3AB6AC@gmail.com> <87zi76xlw5.fsf@nemesis.taht.net> <6F2894AD-87EA-4EFC-918E-625E49EDA977@gmail.com> <87o9nmxcbg.fsf@nemesis.taht.net> <87bmjmxbgw.fsf@nemesis.taht.net> <3FAFACA8-C918-4325-BF80-B7EBB6B9B4A7@gmail.com> From: Georgios Amanakis Date: Wed, 29 Nov 2017 09:43:32 -0500 Message-ID: To: Dave Taht Cc: Cake List Content-Type: multipart/alternative; boundary="001a113a83ecda6e64055f20284a" Subject: Re: [Cake] cake flenter results round 2 X-BeenThere: cake@lists.bufferbloat.net X-Mailman-Version: 2.1.20 Precedence: list List-Id: Cake - FQ_codel the next generation List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 Nov 2017 14:43:33 -0000 --001a113a83ecda6e64055f20284a Content-Type: text/plain; charset="UTF-8" I am troubled by the number of data points flent reports for some pings and uploads in this setup. A typical ack-filter result, similar to rrul2 I posted before, looks like this: Summary of rrul test run 'rrul_cakeeth_ds3_900mbit_45mbit_ack' (at 2017-11-29 14:37:5 5.719180): avg median # data pts Ping (ms) ICMP : 100.29 100.00 ms 337 Ping (ms) UDP BE : 297.62 100.20 ms 156 Ping (ms) UDP BK : 409.84 100.20 ms 109 Ping (ms) UDP EF : 414.94 100.20 ms 121 Ping (ms) avg : 374.13 100.05 ms 343 TCP download BE : 206.39 217.48 Mbits/s 301 TCP download BK : 163.05 163.81 Mbits/s 301 TCP download CS5 : 206.40 217.50 Mbits/s 301 TCP download EF : 203.18 215.23 Mbits/s 301 TCP download avg : 194.75 202.59 Mbits/s 301 TCP download sum : 779.02 810.36 Mbits/s 301 TCP totals : 781.55 810.66 Mbits/s 301 TCP upload BE : 1.86 24.68 Mbits/s 23 TCP upload BK : 0.15 1.72 Mbits/s 24 TCP upload CS5 : 0.25 2.26 Mbits/s 30 TCP upload EF : 0.27 2.15 Mbits/s 29 TCP upload avg : 0.63 7.59 Mbits/s 36 TCP upload sum : 2.53 30.38 Mbits/s 36 Shouldn't all "# data pts" be ~300? George On Wed, Nov 29, 2017 at 9:34 AM, Georgios Amanakis wrote: > With ack-filter-aggressive I get results similar to rrul1 in ~10% of the > runs, 90% are similar to rrul2. > With ack-filter I haven't managed yet to get a rrul1 result, all of them > are similar to rrul2. > Will experiment more today. > > George > > On Tue, Nov 28, 2017 at 11:01 PM, Dave Taht wrote: > >> the astounding figure is dropping ~70% of all packets, and tcp still >> works at all. >> >> 682411 pkt (dropped 1511579 ...) >> >> is your 2nd result repeatable? What happens with just "ack-filter" not >> aggressive? >> >> I keep thinking that a way to coax more performance out of 40GigE+ >> might be to drop more acks (as correctly as possible) before they even >> hit the server. >> >> --001a113a83ecda6e64055f20284a Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: base64 PGRpdiBkaXI9Imx0ciI+PGRpdj48ZGl2PkkgYW0gdHJvdWJsZWQgYnkgdGhlIG51bWJlciBvZiBk YXRhIHBvaW50cyBmbGVudCByZXBvcnRzIGZvciBzb21lIHBpbmdzIGFuZCB1cGxvYWRzIGluIHRo aXMgc2V0dXAuIEEgdHlwaWNhbCBhY2stZmlsdGVyIHJlc3VsdCwgc2ltaWxhciB0byBycnVsMiBJ IHBvc3RlZCBiZWZvcmUsIGxvb2tzIGxpa2UgdGhpczo8YnI+U3VtbWFyeSBvZiBycnVsIHRlc3Qg cnVuICYjMzk7cnJ1bF9jYWtlZXRoX2RzM185MDBtYml0XzQ1bWJpdF9hY2smIzM5OyAoYXQgMjAx Ny0xMS0yOSAxNDozNzo1PGJyPjUuNzE5MTgwKTo8YnI+PGJyPsKgwqDCoMKgwqDCoMKgwqDCoMKg wqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgIGF2Z8KgwqDCoMKgwqDCoCBtZWRp YW7CoMKgwqDCoMKgwqDCoMKgwqAgIyBkYXRhIHB0czxicj7CoFBpbmcgKG1zKSBJQ01QwqDCoCA6 wqDCoMKgwqDCoMKgIDEwMC4yOcKgwqDCoMKgwqDCoCAxMDAuMDAgbXPCoMKgwqDCoMKgwqDCoMKg wqDCoMKgwqDCoCAzMzc8YnI+wqBQaW5nIChtcykgVURQIEJFIDrCoMKgwqDCoMKgwqAgMjk3LjYy wqDCoMKgwqDCoMKgIDEwMC4yMCBtc8KgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgIDE1Njxicj7C oFBpbmcgKG1zKSBVRFAgQksgOsKgwqDCoMKgwqDCoCA0MDkuODTCoMKgwqDCoMKgwqAgMTAwLjIw IG1zwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgMTA5PGJyPsKgUGluZyAobXMpIFVEUCBFRiA6 wqDCoMKgwqDCoMKgIDQxNC45NMKgwqDCoMKgwqDCoCAxMDAuMjAgbXPCoMKgwqDCoMKgwqDCoMKg wqDCoMKgwqDCoCAxMjE8YnI+wqBQaW5nIChtcykgYXZnwqDCoMKgIDrCoMKgwqDCoMKgwqAgMzc0 LjEzwqDCoMKgwqDCoMKgIDEwMC4wNSBtc8KgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgIDM0Mzxi cj7CoFRDUCBkb3dubG9hZCBCRcKgIDrCoMKgwqDCoMKgwqAgMjA2LjM5wqDCoMKgwqDCoMKgIDIx Ny40OCBNYml0cy9zwqDCoMKgwqDCoMKgwqDCoCAzMDE8YnI+wqBUQ1AgZG93bmxvYWQgQkvCoCA6 wqDCoMKgwqDCoMKgIDE2My4wNcKgwqDCoMKgwqDCoCAxNjMuODEgTWJpdHMvc8KgwqDCoMKgwqDC oMKgwqAgMzAxPGJyPsKgVENQIGRvd25sb2FkIENTNSA6wqDCoMKgwqDCoMKgIDIwNi40MMKgwqDC oMKgwqDCoCAyMTcuNTAgTWJpdHMvc8KgwqDCoMKgwqDCoMKgwqAgMzAxPGJyPsKgVENQIGRvd25s b2FkIEVGwqAgOsKgwqDCoMKgwqDCoCAyMDMuMTjCoMKgwqDCoMKgwqAgMjE1LjIzIE1iaXRzL3PC oMKgwqDCoMKgwqDCoMKgIDMwMTxicj7CoFRDUCBkb3dubG9hZCBhdmcgOsKgwqDCoMKgwqDCoCAx OTQuNzXCoMKgwqDCoMKgwqAgMjAyLjU5IE1iaXRzL3PCoMKgwqDCoMKgwqDCoMKgIDMwMTxicj7C oFRDUCBkb3dubG9hZCBzdW0gOsKgwqDCoMKgwqDCoCA3NzkuMDLCoMKgwqDCoMKgwqAgODEwLjM2 IE1iaXRzL3PCoMKgwqDCoMKgwqDCoMKgIDMwMTxicj7CoFRDUCB0b3RhbHPCoMKgwqDCoMKgwqAg OsKgwqDCoMKgwqDCoCA3ODEuNTXCoMKgwqDCoMKgwqAgODEwLjY2IE1iaXRzL3PCoMKgwqDCoMKg wqDCoMKgIDMwMTxicj7CoFRDUCB1cGxvYWQgQkXCoMKgwqAgOsKgwqDCoMKgwqDCoMKgwqAgMS44 NsKgwqDCoMKgwqDCoMKgIDI0LjY4IE1iaXRzL3PCoMKgwqDCoMKgwqDCoMKgwqAgMjM8YnI+wqBU Q1AgdXBsb2FkIEJLwqDCoMKgIDrCoMKgwqDCoMKgwqDCoMKgIDAuMTXCoMKgwqDCoMKgwqDCoMKg IDEuNzIgTWJpdHMvc8KgwqDCoMKgwqDCoMKgwqDCoCAyNDxicj7CoFRDUCB1cGxvYWQgQ1M1wqDC oCA6wqDCoMKgwqDCoMKgwqDCoCAwLjI1wqDCoMKgwqDCoMKgwqDCoCAyLjI2IE1iaXRzL3PCoMKg wqDCoMKgwqDCoMKgwqAgMzA8YnI+wqBUQ1AgdXBsb2FkIEVGwqDCoMKgIDrCoMKgwqDCoMKgwqDC oMKgIDAuMjfCoMKgwqDCoMKgwqDCoMKgIDIuMTUgTWJpdHMvc8KgwqDCoMKgwqDCoMKgwqDCoCAy OTxicj7CoFRDUCB1cGxvYWQgYXZnwqDCoCA6wqDCoMKgwqDCoMKgwqDCoCAwLjYzwqDCoMKgwqDC oMKgwqDCoCA3LjU5IE1iaXRzL3PCoMKgwqDCoMKgwqDCoMKgwqAgMzY8YnI+wqBUQ1AgdXBsb2Fk IHN1bcKgwqAgOsKgwqDCoMKgwqDCoMKgwqAgMi41M8KgwqDCoMKgwqDCoMKgIDMwLjM4IE1iaXRz L3PCoMKgwqDCoMKgwqDCoMKgwqAgMzY8YnI+PGJyPjwvZGl2PlNob3VsZG4mIzM5O3QgYWxsICZx dW90OyMgZGF0YSBwdHMmcXVvdDsgYmUgfjMwMD88YnI+PGJyPjwvZGl2Pkdlb3JnZTxicj48L2Rp dj48ZGl2IGNsYXNzPSJnbWFpbF9leHRyYSI+PGJyPjxkaXYgY2xhc3M9ImdtYWlsX3F1b3RlIj5P biBXZWQsIE5vdiAyOSwgMjAxNyBhdCA5OjM0IEFNLCBHZW9yZ2lvcyBBbWFuYWtpcyA8c3BhbiBk aXI9Imx0ciI+Jmx0OzxhIGhyZWY9Im1haWx0bzpnYW1hbmFraXNAZ21haWwuY29tIiB0YXJnZXQ9 Il9ibGFuayI+Z2FtYW5ha2lzQGdtYWlsLmNvbTwvYT4mZ3Q7PC9zcGFuPiB3cm90ZTo8YnI+PGJs b2NrcXVvdGUgY2xhc3M9ImdtYWlsX3F1b3RlIiBzdHlsZT0ibWFyZ2luOjAgMCAwIC44ZXg7Ym9y ZGVyLWxlZnQ6MXB4ICNjY2Mgc29saWQ7cGFkZGluZy1sZWZ0OjFleCI+PGRpdiBkaXI9Imx0ciI+ PGRpdj48ZGl2PjxkaXY+V2l0aCBhY2stZmlsdGVyLWFnZ3Jlc3NpdmUgSSBnZXQgcmVzdWx0cyBz aW1pbGFyIHRvIHJydWwxIGluIH4xMCUgb2YgdGhlIHJ1bnMsIDkwJSBhcmUgc2ltaWxhciB0byBy cnVsMi48YnI+PC9kaXY+V2l0aCBhY2stZmlsdGVyIEkgaGF2ZW4mIzM5O3QgbWFuYWdlZCB5ZXQg dG8gZ2V0IGEgcnJ1bDEgcmVzdWx0LCBhbGwgb2YgdGhlbSBhcmUgc2ltaWxhciB0byBycnVsMi4g PGJyPjwvZGl2PldpbGwgZXhwZXJpbWVudCBtb3JlIHRvZGF5Ljxicj48YnI+PC9kaXY+R2Vvcmdl PHNwYW4gY2xhc3M9IiI+PGJyPjxkaXY+PGRpdj48ZGl2PjxkaXY+PGRpdiBjbGFzcz0iZ21haWxf ZXh0cmEiPjxicj48ZGl2IGNsYXNzPSJnbWFpbF9xdW90ZSI+T24gVHVlLCBOb3YgMjgsIDIwMTcg YXQgMTE6MDEgUE0sIERhdmUgVGFodCA8c3BhbiBkaXI9Imx0ciI+Jmx0OzxhIGhyZWY9Im1haWx0 bzpkYXZlLnRhaHRAZ21haWwuY29tIiB0YXJnZXQ9Il9ibGFuayI+ZGF2ZS50YWh0QGdtYWlsLmNv bTwvYT4mZ3Q7PC9zcGFuPiB3cm90ZTo8YnI+PGJsb2NrcXVvdGUgY2xhc3M9ImdtYWlsX3F1b3Rl IiBzdHlsZT0ibWFyZ2luOjAgMCAwIC44ZXg7Ym9yZGVyLWxlZnQ6MXB4ICNjY2Mgc29saWQ7cGFk ZGluZy1sZWZ0OjFleCI+dGhlIGFzdG91bmRpbmcgZmlndXJlIGlzIGRyb3BwaW5nIH43MCUgb2Yg YWxsIHBhY2tldHMsIGFuZCB0Y3Agc3RpbGw8YnI+DQp3b3JrcyBhdCBhbGwuPGJyPg0KPGJyPg0K NjgyNDExIHBrdCAoZHJvcHBlZCAxNTExNTc5IC4uLik8YnI+DQo8YnI+DQppcyB5b3VyIDJuZCBy ZXN1bHQgcmVwZWF0YWJsZT8gV2hhdCBoYXBwZW5zIHdpdGgganVzdCAmcXVvdDthY2stZmlsdGVy JnF1b3Q7IG5vdDxicj4NCmFnZ3Jlc3NpdmU/PGJyPg0KPGJyPg0KSSBrZWVwIHRoaW5raW5nIHRo YXQgYSB3YXkgdG8gY29heCBtb3JlIHBlcmZvcm1hbmNlIG91dCBvZiA0MEdpZ0UrPGJyPg0KbWln aHQgYmUgdG8gZHJvcCBtb3JlIGFja3MgKGFzIGNvcnJlY3RseSBhcyBwb3NzaWJsZSkgYmVmb3Jl IHRoZXkgZXZlbjxicj4NCmhpdCB0aGUgc2VydmVyLjxicj48YnI+PC9ibG9ja3F1b3RlPjwvZGl2 PjwvZGl2PjwvZGl2PjwvZGl2PjwvZGl2PjwvZGl2Pjwvc3Bhbj48L2Rpdj4NCjwvYmxvY2txdW90 ZT48L2Rpdj48YnI+PC9kaXY+DQo= --001a113a83ecda6e64055f20284a--