From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-qk0-x22d.google.com (mail-qk0-x22d.google.com [IPv6:2607:f8b0:400d:c09::22d]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by lists.bufferbloat.net (Postfix) with ESMTPS id 1ED8A3B29E for ; Tue, 28 Nov 2017 23:01:49 -0500 (EST) Received: by mail-qk0-x22d.google.com with SMTP id d141so2754043qkc.12 for ; Tue, 28 Nov 2017 20:01:49 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=RN6jPCc6R5bI7QckBtw5f7dDGxuD5nNAfApbc9ZjhvU=; b=jBcLWp3kZsqoZ6Wu0ptfARBTTB7qkRQmziMuGt7EL+m6K4NXKBXGAqW4vxzQe+Iu53 HlosWm0m6nCz7cwHJ9frOYlcbSjQuDxGG8eyZ5K6JhESQCIX+JvKXa98EyGfKmMN7A+j bxskwbGlltRcBarpVUH6atcIzRNQJnJKzkQLoUVG6EKSxumW6mIbuAyuTV2ILD9yPr3V 4qPrPpKN7Kdm0kdYHuTU/mbOuqJUtoqPowIqbjalqpF4tG9jwW1NaOchuKf7qTE/Nz1X ITyyh24aCuGg9uHncSRBV0bv/59W2FOroQEvbQwz77gFmeUJslwlAZJsfbp3F8D8Hyob QTDg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=RN6jPCc6R5bI7QckBtw5f7dDGxuD5nNAfApbc9ZjhvU=; b=tD0pYGIT/XXyNozfWa+EqFCoACy9BKefxXqtK3xiem1KeifpY1pSJc3nuDcpTm6QJl K28w8vbjhp/O9CLXsIbX0e4N0zJQptAMJS8N3M/XY93wOAupP21ZvrB7ovEMx4I/YWF7 hClZgEn462SwXdJIWu16nIRN62zdY1wFhWzZabv1momeEAmXnXXYFg1EVKF7TmYULWpi p+PQtlOhHNgMYAXDxtd0OLZe2TWnDzDaVodbsNnsSLRuTkO8tDptPdQu4m1+6TI2pV1F nDuYuJHlD4zdY4FQLyAqnpqBDrF/L6FbzZzXzxLWGZy24rbpbA4ljz8Fm7damSi9D1Zz 8wfQ== X-Gm-Message-State: AJaThX6SkYJJr0y+7Fofuf2mvLFk1tkG8Ei/QUeZTplqnD7/f2eWGVV0 R5bVxVbQwS3KAm9KaRFKEGqt2SWmNjm4wkPEAPc= X-Google-Smtp-Source: AGs4zMYesoIq6codpNj70i8l96h5+foHLuU7BpWsFq3OC9NgFdzb38K1yHQdAn6JgpMVntaqjUtNXBulI9M5G2RyH5g= X-Received: by 10.55.154.85 with SMTP id c82mr2421997qke.327.1511928108602; Tue, 28 Nov 2017 20:01:48 -0800 (PST) MIME-Version: 1.0 Received: by 10.12.193.93 with HTTP; Tue, 28 Nov 2017 20:01:47 -0800 (PST) In-Reply-To: References: <745FEC66-95A7-40E1-A8FA-57714D3AB6AC@gmail.com> <87zi76xlw5.fsf@nemesis.taht.net> <6F2894AD-87EA-4EFC-918E-625E49EDA977@gmail.com> <87o9nmxcbg.fsf@nemesis.taht.net> <87bmjmxbgw.fsf@nemesis.taht.net> <3FAFACA8-C918-4325-BF80-B7EBB6B9B4A7@gmail.com> From: Dave Taht Date: Tue, 28 Nov 2017 20:01:47 -0800 Message-ID: To: Georgios Amanakis Cc: Cake List Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Subject: Re: [Cake] cake flenter results round 2 X-BeenThere: cake@lists.bufferbloat.net X-Mailman-Version: 2.1.20 Precedence: list List-Id: Cake - FQ_codel the next generation List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 Nov 2017 04:01:49 -0000 the astounding figure is dropping ~70% of all packets, and tcp still works at all. 682411 pkt (dropped 1511579 ...) is your 2nd result repeatable? What happens with just "ack-filter" not aggressive? I keep thinking that a way to coax more performance out of 40GigE+ might be to drop more acks (as correctly as possible) before they even hit the server. On Tue, Nov 28, 2017 at 7:29 PM, Georgios Amanakis wr= ote: > I just ran some rrul tests, but I am getting a strange behaviour. > Setup: > server -- delay -- mbox -- clie= nt > netserver 50ms/50ms 45/900mbit > > cli: > https://drive.google.com/open?id=3D10CwMwLItL6bVSyMTp8-kVXWuFBAG6ft2 > 1) ./vsetup.sh (includes vcake.sh) > 2) ip netns exec server netserver > 3) ip netns exec client flent .... > > rrul1 flent: > https://drive.google.com/open?id=3D1XB1k68fv4PCsRhSbmbCMvqOLk7Dv08bh > rrul1 tc qdisc show: > https://drive.google.com/open?id=3D1mKEYq7iDauOL5A9lCat_jAUgE7Eq6et8 > > rrul2 flent: > https://drive.google.com/open?id=3D19OhJdOtMLcsNM66Jy-Edn7rD8TC9WelJ > rrul2 tc qdisc show: > https://drive.google.com/open?id=3D1HtgjwvmTbr7XQKRp4XOqVvkz8FzCxdTk > > rrul1 looks good, while rrul2 has a very strange trace. Look at the > upload/ping. The setup was exactly the same between these two. If I lower > the mbox bandwidth to 10/200mbit I don't get this behaviour anymore, the > traces look like rrul1. > > Am I doing something wrong? > > George > > On Tue, Nov 28, 2017 at 7:20 PM, Georgios Amanakis > wrote: >> >> >> >> I got Dave's netns scripts working on my server. Will try to run rrul >> tests on a 200/10mbit tonight. >> >> George >> >> On Nov 28, 2017 7:16 PM, "Pete Heist" wrote: >>> >>> >>> > On Nov 28, 2017, at 11:52 PM, Dave Taht wrote: >>> > >>> > A diffserv 200Mbit result would be good. >>> > >>> > We are utterly out of cpu at 900mbits here. >>> > >>> > >>> >>> Wow, I see flent=E2=80=99s combination plots are handy though. >>> >>> Stuff to sort in irtt also. Merely setting the source IP of an outgoing >>> packet doubles allocated heap when it calls into x/net code. Super. >>> >>> Ok, here=E2=80=99s a quick veth try but I gotta get to sleep so I=E2=80= =99m not >>> investigating much =E2=80=99til later. I wonder if 4.9.0-4 is enough: >>> >>> root@apu2a:/home/sysadmin/src/veth# cat settings.example >>> export HOSTS=3D"server client delay mbox" >>> >>> # I=E2=80=99ve been a bad boy and did sudo make install in iproute2-cak= e-next >>> export TC=3D/sbin/tc >>> root@apu2a:/home/sysadmin/src/veth# ./vsetup.sh >>> Cannot remove namespace file "/var/run/netns/server": No such file or >>> directory >>> Cannot remove namespace file "/var/run/netns/client": No such file or >>> directory >>> Cannot remove namespace file "/var/run/netns/delay": No such file or >>> directory >>> Cannot remove namespace file "/var/run/netns/mbox": No such file or >>> directory >>> net.ipv4.ip_forward =3D 1 >>> net.ipv6.conf.all.forwarding =3D 1 >>> net.ipv4.ip_forward =3D 1 >>> net.ipv6.conf.all.forwarding =3D 1 >>> net.ipv4.ip_forward =3D 1 >>> net.ipv6.conf.all.forwarding =3D 1 >>> net.ipv4.ip_forward =3D 1 >>> net.ipv6.conf.all.forwarding =3D 1 >>> RTNETLINK answers: File exists >>> net.ipv4.ip_forward =3D 1 >>> net.ipv6.conf.all.forwarding =3D 1 >>> net.ipv4.ip_forward =3D 1 >>> net.ipv6.conf.all.forwarding =3D 1 >>> net.ipv4.ip_forward =3D 1 >>> net.ipv6.conf.all.forwarding =3D 1 >>> net.ipv4.ip_forward =3D 1 >>> net.ipv6.conf.all.forwarding =3D 1 >>> root@apu2a:/home/sysadmin/src/veth# ./vcake.sh >>> root@apu2a:/home/sysadmin/src/veth# ip netns exec server flent -H >>> 10.10.2.2 rrul_be >>> Started Flent 1.1.1-git-5daa2b3 using Python 2.7.13. >>> Starting rrul_be test. Expected run time: 70 seconds. >>> WARNING: Program exited non-zero. >>> Runner class: NetperfDemoRunner >>> Command: /usr/bin/netperf -P 0 -v 0 -D -0.20 -4 -Y CS0,CS0 -H 10.10.2.2 >>> -p 12865 -t UDP_RR -l 70 -F /dev/urandom -- -H 10.10.2.2 -k >>> THROUGHPUT,LOCAL_CONG_CONTROL,REMOTE_CONG_CONTROL,TRANSPORT_MSS,LOCAL_T= RANSPORT_RETRANS,REMOTE_TRANSPORT_RETRANS,LOCAL_SOCKET_TOS,REMOTE_SOCKET_TO= S,DIRECTION,ELAPSED_TIME,PROTOCOL,LOCAL_SEND_SIZE,LOCAL_RECV_SIZE,REMOTE_SE= ND_SIZE,REMOTE_RECV_SIZE >>> Return code: 255 >>> Stdout: establish control: are you sure there is a netserver listening = on >>> 10.10.2.2 at port 12865? >>> establish_control could not establish the control connection from 0.0.0= .0 >>> port 0 address family AF_INET to 10.10.2.2 port 12865 address family AF= _INET >>> >>> ... >>> _______________________________________________ >>> Cake mailing list >>> Cake@lists.bufferbloat.net >>> https://lists.bufferbloat.net/listinfo/cake >> >> > > > _______________________________________________ > Cake mailing list > Cake@lists.bufferbloat.net > https://lists.bufferbloat.net/listinfo/cake > --=20 Dave T=C3=A4ht CEO, TekLibre, LLC http://www.teklibre.com Tel: 1-669-226-2619