From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-pf0-x242.google.com (mail-pf0-x242.google.com [IPv6:2607:f8b0:400e:c00::242]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by lists.bufferbloat.net (Postfix) with ESMTPS id DC1D33B25E for ; Fri, 21 Oct 2016 06:52:25 -0400 (EDT) Received: by mail-pf0-x242.google.com with SMTP id 128so8360615pfz.1 for ; Fri, 21 Oct 2016 03:52:25 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=message-id:subject:from:to:cc:date:in-reply-to:references :mime-version:content-transfer-encoding; bh=aul65rFzNKEqyNRLhHFi6d8XRuB8R4YKTtNqlvtrGyA=; b=J+4cnb5jn00p1nCAOE3wIZpZczTwMP919IoSbjO2Atx76dvmtkrJWrEk8vp8yohG6L jgXwVUz+i4gQoj5AoePnCXJkOgj77UhSIifxanm3+v6tus2JT2LxDP7P2nxn6H5g8/BL sMP7HzDUOGZdOCPXS8dbdgXpAjFDLh290G8pyWJUFuv4D6LSBW8tKnqkGL3k426a2b3/ WBOxJcEMwiEzWMR9ONlfRHFjXa5ATqbYnMgRuEfUO7hlpf5X5xjbzmJGf9spJv+Qw9uM cntQTb7D66y2+PqfzQfeUwwbnYL5CneRco75jUyCUsuCQhdLjGQIX9ccLshGmCwE4TCA EnEw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:message-id:subject:from:to:cc:date:in-reply-to :references:mime-version:content-transfer-encoding; bh=aul65rFzNKEqyNRLhHFi6d8XRuB8R4YKTtNqlvtrGyA=; b=nMxu8xpp9iSNKGUZFaK/8pwNo+J6lLBR/5WWChv6tkF6RclRpS9GCIJNhZIXjvheYW Ksm+9mKA7OVJa99wLYNA491lfBLwUiyhnwFSEHAeM4pviN2ZVxTUlSYlV9AyfOFbsZ49 Q2mcaS3QlkbcC5vKSMV+qaemkJbzWve+m7n2lHv7J4CwRbOM6BYFFnFo/cdSIo4VJnQA 5SoxqtoRoBzTck0C1M+OWHS8t41rndhzbkGOPRBeSmWAd9kVkN6lYJpp3B8jCAvQXjOU JCaPchinSPvjbJfWwKZoTTIRxU/DNnmvjeGJ9CsVsM+0AIBCqnVFqdgFHjR//12GuHEY S6YQ== X-Gm-Message-State: ABUngvd+sJhEOiY/oSxGp5sUjgWvKcIF2sqW1wpF1jUe+p1WKVM53wPnlA5RPYu/tlCOMQ== X-Received: by 10.98.18.23 with SMTP id a23mr390786pfj.151.1477047145232; Fri, 21 Oct 2016 03:52:25 -0700 (PDT) Received: from [172.29.162.254] ([172.29.162.254]) by smtp.googlemail.com with ESMTPSA id t5sm4189653pfb.58.2016.10.21.03.52.24 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 21 Oct 2016 03:52:24 -0700 (PDT) Message-ID: <1477047144.7065.45.camel@edumazet-glaptop3.roam.corp.google.com> From: Eric Dumazet To: "Steinar H. Gunderson" Cc: bloat Date: Fri, 21 Oct 2016 03:52:24 -0700 In-Reply-To: <20161021104217.GA35316@sesse.net> References: <20161021084726.GA1913@sesse.net> <1477045681.7065.43.camel@edumazet-glaptop3.roam.corp.google.com> <20161021104217.GA35316@sesse.net> Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.10.4-0ubuntu2 Mime-Version: 1.0 Content-Transfer-Encoding: 8bit Subject: Re: [Bloat] "BBR" TCP patches submitted to linux kernel X-BeenThere: bloat@lists.bufferbloat.net X-Mailman-Version: 2.1.20 Precedence: list List-Id: General list for discussing Bufferbloat List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 21 Oct 2016 10:52:26 -0000 On Fri, 2016-10-21 at 12:42 +0200, Steinar H. Gunderson wrote: > On Fri, Oct 21, 2016 at 03:28:01AM -0700, Eric Dumazet wrote: > > Could you provide /proc/sys/net/ipv4/tcp_rmem > > and /proc/sys/net/ipv4/tcp_wmem values on your server ? > > I see I have old sysctl.conf settings here, from tuning way back in the 2.6 > era: > > net/core/rmem_max = 8738140 > net/core/wmem_max = 8738140 > > net/ipv4/tcp_rmem = 4096 873814 8738140 > net/ipv4/tcp_wmem = 4096 873814 8738140 > > Perhaps it's time to kill them, but I don't know what the defaults are :-) > > > What is the rtt between your two hosts ? > > 35.7–36.0 ms. > > /* Steinar */ Ok, you could try 12 MB instead of 8MB to eventually reach line rate. net/ipv4/tcp_rmem = 4096 873814 12000000 net/ipv4/tcp_wmem = 4096 873814 12000000