From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-wr1-x442.google.com (mail-wr1-x442.google.com [IPv6:2a00:1450:4864:20::442]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by lists.bufferbloat.net (Postfix) with ESMTPS id C13273BA8E for ; Sun, 3 Mar 2019 02:19:03 -0500 (EST) Received: by mail-wr1-x442.google.com with SMTP id w2so2034718wrt.11 for ; Sat, 02 Mar 2019 23:19:03 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=heistp.net; s=google; h=from:message-id:mime-version:subject:date:in-reply-to:cc:to :references; bh=ZRgvxLWTd7elhKG5xoNLK4WvL/gRvDAL5eyHdR+zghs=; b=WLAwBNqmb6L5fjeSI7pFV7JRwGCJOM7swVivo/qPw0DAGe9Ec2OqaULUDG3X2aVSxl FcQApYhtaacqmkrP0ynkufPdziIthJ4Kdi7265ZXZT+2uyCegtIA3J9jXoR9WPWHK+zB RRXIHZ1re7/yHVJmHiyAbVV3uQuIBv2cJ2HdUC4bb5wcUwZ6sXMGTkZgfYfJWJaBDWZ2 zRWvbLRdpaTbU7BwXfbqAhoXmAI9A6WRlSdV9Z3e3PK4q7bdMNgzP8+eaKG4VUEUhpte DxXWmnzW4Rs5k9bNBBEnmm/YX9RSLzHoxcKCpgmvAnSWvHgEUmbLoJ/b8f68hzejeMs3 8FVA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:message-id:mime-version:subject:date :in-reply-to:cc:to:references; bh=ZRgvxLWTd7elhKG5xoNLK4WvL/gRvDAL5eyHdR+zghs=; b=jd8hx4H93I4Wi5uXhZbYZg0NiaLIK/tqJ/WKrdJt3VaPpv/8C3ZIOiLsU05K4bMupW 7kPqc2gUHDKBwJe+JXT91HyEGsJE6Z7jr0qOvc7n68HarLHQLHGrgwJVS+Kcj6DLHJv8 ev7WXMVZtH+6wVUQbuBfjKu0F1rN4JiU8Ab9UskZVQBHVzKVzCWR8SUVKkusH6y4+5UK +pluUjE5igvYrIrPkHejPY6UBBTxwaqsOtYsMfyaFvTzejmog+l/mU31rSEsUmatv1Yi 3ypAE8fqPuiaLceNmGzglBV52HuLr9PHPojSqc3mLNFr9go8E+Dj310iO21yyNbx84bI 0fYw== X-Gm-Message-State: APjAAAV4In1qV+tK8b+KznwwspXWo7ZpABdCMHXuSrazFWCyupJ4Dft3 rmA/oJ2a9tYyEiC4WTZKWmtauw== X-Google-Smtp-Source: APXvYqwHpfZLR2zBhkfYCCCczXIdvV6kvURK70IhCA7orqCtqRix3TaZMUtYwqtVS9OFx8BMyP2pGQ== X-Received: by 2002:a05:6000:128f:: with SMTP id f15mr8336183wrx.74.1551597542732; Sat, 02 Mar 2019 23:19:02 -0800 (PST) Received: from tron.luk.heistp.net (h-1169.lbcfree.net. [185.193.85.130]) by smtp.gmail.com with ESMTPSA id p6sm11911223wre.63.2019.03.02.23.19.01 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sat, 02 Mar 2019 23:19:01 -0800 (PST) From: Pete Heist Message-Id: Content-Type: multipart/alternative; boundary="Apple-Mail=_58F8C2EF-686E-4A3C-9F60-48C0237ACFC3" Mime-Version: 1.0 (Mac OS X Mail 11.5 \(3445.9.1\)) Date: Sun, 3 Mar 2019 08:19:00 +0100 In-Reply-To: Cc: =?utf-8?Q?Toke_H=C3=B8iland-J=C3=B8rgensen?= , Cake List To: George Amanakis References: <72193310-7502-47B8-9554-7F8F9FA23204@heistp.net> <874l8mn9iy.fsf@toke.dk> X-Mailer: Apple Mail (2.3445.9.1) Subject: Re: [Cake] Upstream submission of dual-mode fairness patch X-BeenThere: cake@lists.bufferbloat.net X-Mailman-Version: 2.1.20 Precedence: list List-Id: Cake - FQ_codel the next generation List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 03 Mar 2019 07:19:04 -0000 --Apple-Mail=_58F8C2EF-686E-4A3C-9F60-48C0237ACFC3 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 Oops, sorry I didn=E2=80=99t notice this before but it=E2=80=99s the = ingress keyword that makes the difference: qdisc cake 802c: dev ifbLink2 parent 1:1 bandwidth unlimited besteffort = dual-dsthost nonat nowash ingress no-ack-filter no-split-gso rtt 100.0ms = raw overhead 0=20 IP1, 1 up: 46.8 Mbit IP2, 16 up: 46.8 Mbit IP1, 16 down: 41.9 Mbit IP2, 1 down: 51.1 Mbit qdisc cake 803a: dev ifbLink2 parent 1:1 bandwidth unlimited besteffort = dual-dsthost nonat nowash no-ack-filter no-split-gso rtt 100.0ms raw = overhead 0=20 IP1, 1 up: 46.6 Mbit IP2, 16 up: 46.5 Mbit IP1, 16 down: 46.4 Mbit IP2, 1 down: 46.5 Mbit Also, my setup is different in that I use cake as a leaf to either hfsc = or htb. But, it=E2=80=99s adding the ingress keyword that causes the = imbalance for me. > On Mar 2, 2019, at 11:20 AM, Pete Heist wrote: >=20 > Great, thanks for trying it. That strongly suggests a problem with the = kernel (or driver) I=E2=80=99m using. Feels better to know it works as = it should in recent kernels though... >=20 >> On Mar 2, 2019, at 5:47 AM, George Amanakis = wrote: >>=20 >> On Fri, 2019-03-01 at 22:02 -0500, George Amanakis wrote: >>>=20 >>> I will setup a vlan and try again. >>>=20 >>=20 >> I replicated Pete's VLAN setup, and I am getting fairness: >>=20 >> IP1,2 <---> router enp1s0 / router enp1s0.100 <---> server >>=20 >> IP1, 1 up: 46.73 mbit/s >> IP2, 32 up: 46.91 >> IP1, 32 down: 46.70 >> IP2, 1 down: 46.89 >>=20 >> qdisc cake 8006: dev enp1s0.100 root refcnt 2 bandwidth 100Mbit >> diffserv3 dual-srchost nonat nowash no-ack-filter split-gso nofwmark >> rtt 100.0ms noatm overhead 4 >>=20 >> qdisc cake 8002: dev ifb0 root refcnt 2 bandwidth 100Mbit diffserv3 >> dual-dsthost nonat nowash no-ack-filter split-gso nofwmark rtt = 100.0ms >> noatm overhead 4 >>=20 >>=20 >>=20 >=20 --Apple-Mail=_58F8C2EF-686E-4A3C-9F60-48C0237ACFC3 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8 Oops,= sorry I didn=E2=80=99t notice this before but it=E2=80=99s the ingress = keyword that makes the difference:

qdisc cake 802c: dev ifbLink2 parent = 1:1 bandwidth unlimited besteffort dual-dsthost nonat nowash ingress = no-ack-filter no-split-gso rtt 100.0ms raw overhead 0 

IP1, 1 up: 46.8 = Mbit
IP2, 16 up: 46.8 Mbit
IP1, 16 down: 41.9 Mbit
IP2, 1 down: 51.1 Mbit

qdisc cake = 803a: dev ifbLink2 parent 1:1 bandwidth unlimited besteffort = dual-dsthost nonat nowash no-ack-filter no-split-gso rtt 100.0ms raw = overhead 0 

IP1, 1 up: 46.6 Mbit
IP2, = 16 up: 46.5 Mbit
IP1, 16 down: 46.4 = Mbit
IP2, 1 down: 46.5 Mbit

Also, my setup is different in that I = use cake as a leaf to either hfsc or htb. But, it=E2=80=99s adding the = ingress keyword that causes the imbalance for = me.

On = Mar 2, 2019, at 11:20 AM, Pete Heist <pete@heistp.net> = wrote:

Great, thanks for trying it. That strongly suggests a problem = with the kernel (or driver) I=E2=80=99m using. Feels better to know it = works as it should in recent kernels though...

On Mar 2, 2019, at 5:47 = AM, George Amanakis <gamanakis@gmail.com> wrote:

On Fri, 2019-03-01 at 22:02 -0500, George Amanakis wrote:

I will = setup a vlan and try again.


I replicated Pete's VLAN setup, and I am getting fairness:

IP1,2 <---> router enp1s0 / router = enp1s0.100 <---> server

IP1, 1 up: =      46.73 mbit/s
IP2, 32 up: =     46.91
IP1, 32 down: =   46.70
IP2, 1 down:    46.89

qdisc cake 8006: dev enp1s0.100 root refcnt 2 = bandwidth 100Mbit
diffserv3 dual-srchost nonat nowash = no-ack-filter split-gso nofwmark
rtt 100.0ms noatm = overhead 4

qdisc cake 8002: dev ifb0 root = refcnt 2 bandwidth 100Mbit diffserv3
dual-dsthost nonat = nowash no-ack-filter split-gso nofwmark rtt 100.0ms
noatm = overhead 4





= --Apple-Mail=_58F8C2EF-686E-4A3C-9F60-48C0237ACFC3--