From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-pg0-x242.google.com (mail-pg0-x242.google.com [IPv6:2607:f8b0:400e:c05::242]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by lists.bufferbloat.net (Postfix) with ESMTPS id 68D7C3B2A0 for ; Sat, 3 Dec 2016 18:15:42 -0500 (EST) Received: by mail-pg0-x242.google.com with SMTP id x23so11852318pgx.3 for ; Sat, 03 Dec 2016 15:15:42 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=message-id:subject:from:to:cc:date:in-reply-to:references :mime-version:content-transfer-encoding; bh=iG9zFPRSZYsa/2zZrSX2fKLCz8ic6+kk2WZjT36DByg=; b=PLpXahoFWGjJBveEdX7KldIbp1mIVj7MBltzmlXIJh+2NssRp01SDHlrXBgCe7GtOD eto7fqr244P7Gl6SuFjkzye51iCrweq+1HuSTWCTURHs2EhYcfaDaWeIdaXlsU6/orKO mnMXzsI4eJ8tZzFtE1tJ5DCX4wfCYvT1lL9UbLuCY+TlHVGoA3AxR4py55eeyb75kcjb t/waXVoRm1gh7wEbF7ppO2N62c6sLzwRJVyID7iKTIzM2bkUqsgrPVTN5lKuNyeW0nfp 55HcfudJFXlPYi7U7kiLmmjJXwMFFLE40ywHhHkV5x1eipyWB0r9I9zdtIdQ17/F3dlC 4//Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:message-id:subject:from:to:cc:date:in-reply-to :references:mime-version:content-transfer-encoding; bh=iG9zFPRSZYsa/2zZrSX2fKLCz8ic6+kk2WZjT36DByg=; b=YtBpW2XZbrpB0vk+7aa4wuDMTsfT0J+WdWwpLjP9L1Y1NJ89Nn0qJdwj/6evdgE0Wx AWj7ICs9IBleT5RVgxykLbEVinAeu5+BAm5XK9OQ2NwmwS2rxDJ+IRdVxqEOqN+ZaCvV TjnWu7tG+qrsOZ5eEjdc8ftYd3z6o7Q5haNCOPvu2UzRLzUsxtYoeVYpL8vVuWEIGbtB WYttEKBGhJOtkku1LV0uhq+0m2PHoMkrZU5iuCOGxFtMVx3ty7axJpnyYXw4h7xqKlVQ eHj1X979RrdQMcC6eGBiykavheEb3XiSzFzWhBSKzIPCN2u2CMAZPk9XVfvTDI0xbIQi QJJg== X-Gm-Message-State: AKaTC00qVS8vjl428F2TOYujVzS1cUN8wwWP/2keoiBqAtPWo0G6wUyS+e5jFhYvWAcYiQ== X-Received: by 10.84.129.100 with SMTP id 91mr109088728plb.73.1480806941619; Sat, 03 Dec 2016 15:15:41 -0800 (PST) Received: from [172.19.250.57] ([172.19.250.57]) by smtp.googlemail.com with ESMTPSA id t20sm17107796pfk.48.2016.12.03.15.15.40 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sat, 03 Dec 2016 15:15:41 -0800 (PST) Message-ID: <1480806940.18162.434.camel@edumazet-glaptop3.roam.corp.google.com> From: Eric Dumazet To: "Steinar H. Gunderson" Cc: Jonathan Morton , Neal Cardwell , "aqm@ietf.org" , bloat Date: Sat, 03 Dec 2016 15:15:40 -0800 In-Reply-To: <20161203230335.GA40411@sesse.net> References: <1480721486.18162.392.camel@edumazet-glaptop3.roam.corp.google.com> <20161203191353.GA972@sesse.net> <1480796415.18162.408.camel@edumazet-glaptop3.roam.corp.google.com> <9A821B94-143B-446F-8852-2EB0158DD57C@gmail.com> <1480799260.18162.418.camel@edumazet-glaptop3.roam.corp.google.com> <20161203213428.GB38041@sesse.net> <1480801837.18162.419.camel@edumazet-glaptop3.roam.corp.google.com> <20161203221338.GC38041@sesse.net> <1480805737.18162.425.camel@edumazet-glaptop3.roam.corp.google.com> <20161203230335.GA40411@sesse.net> Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.10.4-0ubuntu2 Mime-Version: 1.0 Content-Transfer-Encoding: 7bit Subject: Re: [Bloat] TCP BBR paper is now generally available X-BeenThere: bloat@lists.bufferbloat.net X-Mailman-Version: 2.1.20 Precedence: list List-Id: General list for discussing Bufferbloat List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 03 Dec 2016 23:15:42 -0000 On Sun, 2016-12-04 at 00:03 +0100, Steinar H. Gunderson wrote: > On Sat, Dec 03, 2016 at 02:55:37PM -0800, Eric Dumazet wrote: > > Note that starting from linux-4.4, e1000e gets gro_flush_timeout that > > would help this precise workload > > > > https://git.kernel.org/cgit/linux/kernel/git/davem/net.git/commit/?id=32b3e08fff60494cd1d281a39b51583edfd2b18f > > > > Maybe you can redo the experiment in ~5 years when distro catches up ;) > > I can always find a backport, assuming the IPMI is still working. But it > really wasn't like this earlier :-) Perhaps something changed on the path, > unrelated to BBR. If the tcpdump is taken on receiver, how would you explain these gaps ? Like the NIC was frozen for 40 ms ! 11:14:06.023821 IP6 C > S: Flags [.], ack 368888520, win 23422, options [nop,nop,TS val 864457007 ecr 3498315976], length 0 11:14:06.023823 IP6 C > S: Flags [.], ack 368891028, win 23430, options [nop,nop,TS val 864457007 ecr 3498315976], length 0 11:14:06.023829 IP6 C > S: Flags [.], ack 368899248, win 23407, options [nop,nop,TS val 864457007 ecr 3498315976], length 0 11:14:06.023834 IP6 C > S: Flags [.], ack 368907468, win 23415, options [nop,nop,TS val 864457007 ecr 3498315976], length 0 11:14:06.023835 IP6 C > S: Flags [.], ack 368915688, win 23392, options [nop,nop,TS val 864457007 ecr 3498315976], length 0 11:14:06.062751 IP6 C > S: Flags [.], ack 368923908, win 23415, options [nop,nop,TS val 864457007 ecr 3498315977], length 0 11:14:06.062767 IP6 C > S: Flags [.], ack 368929620, win 23400, options [nop,nop,TS val 864457007 ecr 3498315977], length 0 11:14:06.062770 IP6 C > S: Flags [.], ack 368932128, win 23430, options [nop,nop,TS val 864457007 ecr 3498315977], length 0 11:14:06.062771 IP6 C > S: Flags [.], ack 368943204, win 23400, options [nop,nop,TS val 864457007 ecr 3498315977], length 0 11:14:06.062773 IP6 C > S: Flags [.], ack 368948568, win 23422, options [nop,nop,TS val 864457008 ecr 3498315977], length 0 11:14:06.062775 IP6 C > S: Flags [.], ack 368956788, win 23400, options [nop,nop,TS val 864457008 ecr 3498315977], length 0 11:14:06.062776 IP6 C > S: Flags [.], ack 368965008, win 23415, options [nop,nop,TS val 864457008 ecr 3498315977], length 0 11:14:06.062778 IP6 C > S: Flags [.], ack 368976084, win 23385, options [nop,nop,TS val 864457008 ecr 3498315977], length 0