From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mout.gmx.net (mout.gmx.net [212.227.17.22]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by lists.bufferbloat.net (Postfix) with ESMTPS id 2DCA03B2A4 for ; Mon, 6 Nov 2017 16:02:18 -0500 (EST) Received: from [192.168.10.50] ([93.233.79.61]) by mail.gmx.com (mrgmx103 [212.227.17.168]) with ESMTPSA (Nemesis) id 0Mdrph-1ebK011O05-00PbHY; Mon, 06 Nov 2017 22:02:12 +0100 To: =?UTF-8?Q?Toke_H=c3=b8iland-J=c3=b8rgensen?= , bloat@lists.bufferbloat.net References: <3f789193-f491-8313-5f10-ef1bf73684f2@gmx.net> <877ev5n1hg.fsf@toke.dk> From: Matthias Tafelmeier Message-ID: Date: Mon, 6 Nov 2017 22:02:05 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.2.1 MIME-Version: 1.0 In-Reply-To: <877ev5n1hg.fsf@toke.dk> Content-Type: multipart/signed; micalg=pgp-sha384; protocol="application/pgp-signature"; boundary="AHIfueXkiEDtX3r44OUd5Uwj5BCvOR2De" X-Provags-ID: V03:K0:7cOxsyhIDN539Dr3/HOMI6Yp85p26UXSstYaAxIn+OBdvmQ3N/4 EfIMPvzN9FRtskjJE+pUlLyOcsQ2cEh8F0dWfgtXy9tDKvGSThFSiz+KkRu1NWmIXcqBIXU tj0kNLkHJJduoXqqXubPsvq14qaiLvnniSj43OrEWk7uPWzxnCbwwIIfpu7BRvoIexjDPDX sG8DybHO5zR+/4CAzt4Iw== X-UI-Out-Filterresults: notjunk:1;V01:K0:ykETttXTT0w=:M0mdCO6RLtp7PJAaNB59re apkOerbK2RBcv/yP7WU4G8YI+UlFeTwJ6PyXTHOpMaH4h3qcFLVkiba8sxc2XTz642BuUp7ki lORLPdvvzfHNWv8HbmQcegFNki18LsPJCfp1db8pLaz0EzUkAWRpHbchq41886OaGhcnMXLin 2oXUyp72X+rAY5+96tLjeujibCyjhAuqNbQRRn2MMPCsv8B112V/M9q0LwxWK4ey5pkW6iMKt 2u2Y3wK6st15yhSa6iNKu3RdoNzZD6yQn2LnpAFFP++1t9xbujnu2J3niEusXRtoy7GGKu/AA 2RCU2bw6r8Yc86dfG2A3SUK9tKrtvffau5R3EwV1+S8wT9gxWCkI6UW1N6STzx9IdwmpN6/p1 efzn2yoFXzmVa2FxMYTmPHjukI+3v1g+WV0uSSIe8MjPAFALEklyoYf0+LRAuI0Richmng7cH dQWQe2juSXXPZ2DJQkbErgDeARGdc5ctr1f/5EveNRZgVRkP025pPikbka57hN3komj7V5NTY lHX5kqef+oro6/LoPDSfyiA5Gq5ju3z2O1TM5pSVr3KhTQlq8SlBdTKv+WpKWAqM4yWw8ivda dz3Y1HHRGJ97kR3UGQnN+WCdUn9Cb5gBdu9caEP3QKgXkAE8cBSJN6gihOxCyFRLlTA/6E5rS k9DrEv5eTYe0PFe8EVTjB8pQD82DURGD/9Lhb/g9iCBKzHSbG8hB5/BmwmgP/7igq7tsHqX0S G3/YMat2teMX7CCPPXFyzFkQbYnN9G3LIEvSWhwhPd2i6AJmrvpkGptw9JwBPcm555VCQ59/A Lm5DTvvSjURl00uyXp+CfJbQjbtkw== Subject: Re: [Bloat] generic tcp - window scaling limits X-BeenThere: bloat@lists.bufferbloat.net X-Mailman-Version: 2.1.20 Precedence: list List-Id: General list for discussing Bufferbloat List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 06 Nov 2017 21:02:18 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --AHIfueXkiEDtX3r44OUd5Uwj5BCvOR2De Content-Type: multipart/mixed; boundary="lNc4PMJe3e9xhkDnkGpujiUBmLl7FkoqQ"; protected-headers="v1" From: Matthias Tafelmeier To: =?UTF-8?Q?Toke_H=c3=b8iland-J=c3=b8rgensen?= , bloat@lists.bufferbloat.net Message-ID: Subject: Re: [Bloat] generic tcp - window scaling limits References: <3f789193-f491-8313-5f10-ef1bf73684f2@gmx.net> <877ev5n1hg.fsf@toke.dk> In-Reply-To: <877ev5n1hg.fsf@toke.dk> --lNc4PMJe3e9xhkDnkGpujiUBmLl7FkoqQ Content-Type: multipart/mixed; boundary="------------35085752BE990A5034D13907" Content-Language: de-DE This is a multi-part message in MIME format. --------------35085752BE990A5034D13907 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable > Erm, what exactly are you trying to show here?=20 I wanted to generically isolate the 'geometry' to expect when scaling the TCP advertising mem limits. And I must say, it looks a little askant. Might worth a look at the data structures there. Parallelizing socket buffers would be rather application specific, I guess. Hm ... > As far as I can tell from > the last (1-flow) plot, you are saturating the link in all the tests > (and indeed the BDP for a 1Gbps with 2ms RTT is around 250kb), which > means that the TCP flow is limited by cwin and not rwin; so I'm not sur= e > you are really testing what you say you are. That's correct. Excuses for that one, I was decepted by the latency plots where I surmised to perceive the (reno ~ cubic) saw-toth and the virtualisation was adding a tbf instance on one of the links. All that perfectly explains why I wasn't influencing bandwith at all. > I'm not sure why the latency varies with the different tests, though; > you sure there's not something else varying? Have you tried running > Flent with the --socket-stats option and taking a look at the actual Reran/updated (including --socket-stats) everything and that's now way more comforting. There are not such performance rifts anymore as perceived beforehand - 'no low hanging fruit'. For the per link/peering tuning I mentioned, that's appearing to be more application specific logic (syscall based) then I'd amend. Thanks for having had a look. --=20 Besten Gru=C3=9F Matthias Tafelmeier --------------35085752BE990A5034D13907 Content-Type: application/pgp-keys; name="0x8ADF343B.asc" Content-Transfer-Encoding: quoted-printable Content-Disposition: attachment; filename="0x8ADF343B.asc" -----BEGIN PGP PUBLIC KEY BLOCK----- Version: GnuPG v2 mQENBFJ0FzIBCADZ/hkwcprVGydMOqeqM+2k6v5e5kb4YDMKU7nMbCVmH4sn01T7 Yh9kDwG5LOMLD06BB2txjLBvTY+c0mpK+hE4pWr+i3qhU5CbVvx7jppJqCD6ZT/T A3I7NxsdixRvLIF4UXgKQOMKPIx+aw/sp86NqzCLAMse7F0vXUjAP5YANtJid2rf r/B37BGKhqDGhi4Appz4UZOzpRov/v8JD4XScuvJnl09/oi5cDj3Mn2uqOc/G6hA t7HXsbHh4dKxd3AftqPPzEkJAmm+9Z4ASG9hy8IXms8Czimr+BGL0CnfsJlX6DCU m6mVDqT1GJyzmP4zkWcPi+2fOI4KtpV+C7+bABEBAAG0Ok1hdHRoaWFzIFRhZmVs bWVpZXIgKHByaXZhdCkgPG1hdHRoaWFzLnRhZmVsbWVpZXJAZ214Lm5ldD6JAUEE EwECACsCGwMGCwkIBwMCBhUIAgkKCwQWAgMBAh4BAheAAhkBBQJaAMzNBQkLTxyN AAoJEOAWT1uK3zQ7u+4IAL+W82wbz1FwGfNHhOgOheCh/wlTLssgQ7XVGRduJ/m3 k22aodOKSV5aH3AUy9c9zkgkRHUU5XCG9FRujVeVYhvLP1JTG97oEjk8YGBAOqN7 D4hUHh0c3ZBpTqeE9cndXr504GMauh5mY74qdNl9nL+Gcv7CekENML1nLWBnoDWV NTpvZktPZpHozQHPBV6lk09ICxOocb7VHl+lyorStqiUcLciHTdOByC35ekJebv9 dDZ9oloI8tvLytyle1kuVQLJj0LrpkUjcjLSYoa7ZFVKCNK6FM1pWd1XRHmWqhAn i4+4l92+UHU2TASBFIUVO3kPEDOXn7kK4q6tQ2pRexuJARwEEwECAAYFAlP4qFwA CgkQc1YJs62PXiMJwggAgwa8bM1DVdB5wdWVbsEvjDWgoD4CZOH+3/nCAKFv+eKf d3GrJUtOh3T/QVpmbVgNwnyqqNLGlyIOHltVkrn9WqSC33kuXsIStR6KM+LXnA99 FjyAiTcVbzbfl/XNlIQrgV9+niSSUFCUge5242itPjBBCtlYHUkQ5Y9hsNwV9Hb7 dpVxUf01CJcNKlWscC7lTt2FqjJrIOw2NHxgHWxRlDqo9dFg4uwI+O90orKAyJ6N Sowu2Ca6DXB3jHgoG7WbAh1nEVus/JkyVsnTIMCsfOpwhJNd1fvy6JMVAe7+/p6/ JGZcMjUTadmsHeJHwqOJSVOoX3Y8CZkV8/PHIqmYvokBPgQTAQIAKAUCU/hT+gIb AwUJAeEzgAYLCQgHAwIGFQgCCQoLBBYCAwECHgECF4AACgkQ4BZPW4rfNDvHZAf7 BpqfTpLdR25q72DZ4T6SrkcZCOJ8jJQhQ1K9cAc0snpK+jcWg9iUgCpV8QJiXpGL dAkux/YCu7SRstOSbMv4G4Qb/g8y2bowFI/mAzK1o6s6CYt3URNBe7zRLK6sJbK0 f5fDpWoRufW9/Ppj1/S7dki5JpkUlyGa/y2O+X4C/P0Rh3HfL5HicRHamc7PVElh z/8nVA+KUkcA9ksVJqe50LahTbDyqOmd8cjSdUKlH2dsP/cAmZfU3IAa26UBKWVn rxnQ61VV5QLpcYvW3jTfzBy7xv1s7YSj2rFpIC5WKgPC/p+2gqVMSGI1hRlrNaSA qH9XgWNPCa5NlOxuN4mSN4kBQQQTAQIAKwIbAwYLCQgHAwIGFQgCCQoLBBYCAwEC HgECF4AFCQSrhqYFAlRXtDwCGQEACgkQ4BZPW4rfNDvqmQf/Wa2LXaOvzftegDI+ LAiFOB/Dq5yhFp6urk5+yC+YzCFin8HfP+LVXR8Xkei6fMmFMjfRU0MrNLBxFd3I UrIgRrtmJGaHB+vkIqNGgU8LcpHBdd6nprtIF53IhtOINwkmCgLzWi3sGYJ4yQyj 9OSNnh7j7ENFeZd8LgN/FgB5GjPisN3zJD19z065jlfeXvHIZOL90PaTqih90x6n oTr4dbKhk1t9zZYhY5W812gCMVn2g4wLLO+iijKOe8uNrOw22xDGckoL5UFRE8Vj Twup3eYyzb/2TVpAmM5GhnI+PodZ6GGcQRVKGMYwYyFVLDEcDRxAUpwfXfUzHwvD op2fQ7Q/TWF0dGhpYXMgVGFmZWxtZWllciAoSGFwbG9ycmhpbmkpIDxtYXR0aGlh cy50YWZlbG1laWVyQGdteC5uZXQ+iQEfBDABAgAJBQJWPZtPAh0AAAoJEOAWT1uK 3zQ7FrIH/3OFr/bZ2UQeJrn9n67G9o9neJv4ES9Lcq6xnCIc+ZRHqrBTwsYkfYC5 MEMTF7TMFNUJTr2Np3OG7iKcHVePpeMpHicXppJ4hUsIQ0kwXlynRAScrAqoQHBD IKzu5qHDME0UKIWr9iTASFHJgZGyH6OoPh7LIifV8cGdVPQ/5FF1kqM4YMZ3IygO C3CaYtEaOz0B1L00zJan8rbEnpsI1msZ3hjacGB2SD5kFAUMDbpoXVOOE07GSLF0 KKhMv02WdrKO8iedStubO9BON9Vf7IIq21RpDEhhjAzt4Ui2q0UEodTvnBX4ifFM UEU/+NdC3deuRwdxOq1ozSQlUTzVFASJATQEEwECAB4CGwMCHgECF4ACCwkCFQoC FgMFAlRXs+UFCQSrhqYACgkQ4BZPW4rfNDs/HQf+K5swcPreRRBXQbTBCgTQAoAI JtvG+TLlPPnpYMqkQoKIhw/USN2Je4Gqm3DhRcCteA5wbmhlHj9DbapbCOwE7vfK 3YC/hpntvnmgCl6atT2QbE4Ak7xeT2ljLiRYD1re7oE8fAUqkI2S+vePiK1+b8Cc OKPmuAJYmgAMmNVMKcknryNoFc7xseNEy58T+AoyCKcxV9ZJdyd+6Ye48LkRlmyf lfRnCvgfS74TEq7Gr5uCJPgqcjrl8SS3G6jgUrzPcV2mFROt9EH3d80T+GOIy4pB SeYGdfkeqUbflj0CeRIyazzAZurllCQWjpaeh009Y/wuzLm91zrVWwADP/5oRIkB HAQTAQIABgUCU/ioXAAKCRBzVgmzrY9eI23xB/461lM4c/08tEwmd0oC1jdwyidO ZRCj/vOqZ+Af6oB3FdpWseuKWdJ7zb8NR+BcEUQRqbaF/677cCrKIEnRoq7IzNsw KiqK9K5cFHLtm9TNZ0Mf5QP/PG47Jrex5l59LMMz+LW1Rv/uXJjTQDeQYsrYDAPK mJx2c0OyzZnr+CRrHJKUH0P+oVBvSQEnDTbCT2W9wuLrDIHF6H3YQLAuCS2sslq5 teAinTjTGnPmkP7hKcK3CC0BdiUgFFybIZOGthFm+bTG+V3qGUiam95dqDmQ2VTX QxCetGDTjUrvKdODh5qLFUM+StWLNEP+QtMcymZfrRIHayKS3GyjKBOPoCZpiQE0 BBMBAgAeAhsDBQkB4TOAAh4BAheABQJSdB8LAgsJAhUKAhYDAAoJEOAWT1uK3zQ7 5nMH/iscBMT7fEnIBeYZlFaxiJmFobRVWFP/A2IfzvKVIdY9vDqjN5M5chrRfsk9 HI0EPbiF3kmVwmRdl8J5fgN7O8QFbhW4ojda8UXBAsgF50kurqk2NrdgM+xLy2TI jVZdwQYK+R11SpO9xaf+nqLKV8r9VkQ5mzb+BEzDiaX7z9IBrm28v0BfelDZVRzW cOrskVnwX1PySt3xvCwwo3cwY39yno7H4AlgTXhAvhwI6DQMxZXm4MZcugSfB5b4 2uyslOOxMkgvLW1CmpJxzbWXYT+40vW0DbQAUC1VIr7hiPrunrRAWfbV/RWZl6lr 6gMJJXkLGN70MUX40FF0IhZw5Ja5AQ0EUnQXMgEIAPICr+5yNyuVcmsv5xpmRKnz KoTjJ7xt0EPiru895LEUPN25tJyi8PZmLciNJnEoQ231jjAloQvx1pb3cr35zzGX PTPJ5fEECZDxMWMjVvCMb4XK0YjqCF9i/uKic5zqjwRNAPEGTO/ZgS+e21lUJSmu KR6m5WQcKgBH+tqS3rodgjunnIN4UiNMxbq/VVGICWPjdgoTkqWE3r8QthKLg4Lj zILEH3HbG39l+vTwEKaP4q5xShFZjRUrZC2anBP+gQx/FbBff3ufpCL9LF5dkywZ P3NHVyaa/D8T66CTj7Rynd4NZy/qdqGMjMjEuf0RkgXF7Uar4GXmuOfrIcf/X6EA EQEAAYkBJQQYAQIADwIbDAUCVj2bwwUJB4vrkQAKCRDgFk9bit80O/0ZCACoWtov fl7vH3YNW0K3xWil9wj43X2OxwKiGBdfbI48bW+b6LJQwNwFePFQ/RQCBgg1eerU Oys0ymcmp0VeMdwpw27qWcMcbsDn3Pucqp1C2IUuXesbUcRo+QDqhl96KxAAWY5O JO16dfRrIxyX6Pb0uImqpDetT4Kbr1doTF8cIfRH2rszHKU9BEWag/us9V8H5S8h F7Ws2wH2JlWbQpP8E7/Z5kVM9psdqX9rwbrUAqpyNhtILoC0+zXkdnOxz1WZaBpr ckEYQS4/CQOliYJyd5nXYcwVXCNpdy1Vt53ArN9j/EIvfFxOPCPoBQj1b9nkHqNn qnlCR0LVNOnSE3Eb =3Droc5 -----END PGP PUBLIC KEY BLOCK----- --------------35085752BE990A5034D13907-- --lNc4PMJe3e9xhkDnkGpujiUBmLl7FkoqQ-- --AHIfueXkiEDtX3r44OUd5Uwj5BCvOR2De Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQEcBAEBCQAGBQJaAM3NAAoJEOAWT1uK3zQ7QxAH/ji0gCkPpSJACAbMjCf5Dg2c knaFeet1F5f1MPuOwPYZ4zmEzKLVVCYJH0XtU61JY3vN7rpNNI77oL0yr5OanLoO tAdrZ5zUqSQTlHw+W5OO3Doyelyo2dR1iA55BsI6AaLGNmQlTnQfS4kDr5foTnJW BeYIv1D1GMkxifHDKi6Q0zNlZxR4c0zyBSshCnRnCofHtjiQiIxqoE+nd8/7ZbbY SHjhydGCExGgnpaQIY2ursmjiw/1g+tKUpfL4l2hDekvj3/kFOmSM+WNDfcP9PFl q7kixnTRwIDUNfvHLCRZD11H07LeJZvgGn4VpGrffhEOhSpMBVTBwUqvjA2YTwM= =vVrm -----END PGP SIGNATURE----- --AHIfueXkiEDtX3r44OUd5Uwj5BCvOR2De--