From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-io1-xd35.google.com (mail-io1-xd35.google.com [IPv6:2607:f8b0:4864:20::d35]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by lists.bufferbloat.net (Postfix) with ESMTPS id 3EF5D3B29E for ; Thu, 4 Mar 2021 15:44:44 -0500 (EST) Received: by mail-io1-xd35.google.com with SMTP id f20so31265261ioo.10 for ; Thu, 04 Mar 2021 12:44:44 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=gCmV7wncINezFKEOfPyOHDJIn12+4KC++GqWSi1EPl8=; b=BHzG4OfZfxh5JWnE1lpv9CqfCTqw24DAlg8Xp7asVROihgmbFuhw942c94TGK9AYGa FwTE6TTEolPqcaxYlyFTYllqfbBau4T/3ZtjoBMrCK181lA4/hlwDGjdTbJK5Yk81221 Va8HbDwFWGNhs/exLRf9dzUkgxDiqD1w4aa2qEhepL24tfw2yLfevONbcjK8n5YA1NRz xjEpZ+kU+hCtanLlqbxozpLmw4nZzRYzl0FZtyBmcBNsE17uhMcCwk6HYcVcy+oZ7HIa 4umVfAimLErOXgDnCk1q9bBWQjpD4xKU0MXHcrLdFS/ioWPv+6M65rewv6P1872Q7ecB gCHA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=gCmV7wncINezFKEOfPyOHDJIn12+4KC++GqWSi1EPl8=; b=UGwsCgyXvgaRHFM4cl9yBUr/djSy3W9Q4lx9xWkWfs4vl5kUJvA60iwKd2SafwpzAd +2Op77KOO/IRfvm65mIB2jaBMHI31+zoiVc2FUL3l4bDmdepkBr6K0Ejw+Qtx5sxy8sW ZYTdmaNdUNwiGE/FE4pffGUfP24GIeMeHb83v1cD3gcHKdqSEryqgepF2yLD6ftbx2Cj oSY70G09mTvHs0HjlCO6w9M+ldqiays+yeY44OkPuMuUnHmBUvPa6kEiQu1bHhwf8kN6 vjoPWy24IB8rt3efAayxXnw55eigq2xzQqsWZ/cooSZ2bM0vru0lPDTz6Sm8l5Fbbcnt 8f9g== X-Gm-Message-State: AOAM531OtVYqy5yFczaHPajJjaJfn6Thq6QuGZNEWglFxu5ZB2FwpBzx TNwQTjkWz5qXL6vd4Urafbhca1KpGUrvinCLEK6isdRV5y1aww== X-Google-Smtp-Source: ABdhPJwF3bTjsUH7dwW3Ccx3CFgSoN4VVr3fsSMrhisCZPubp/nco1DtAQkwxmhIKlBTrhwGg7xizs3k1FyASSw0xBQ= X-Received: by 2002:a02:ca13:: with SMTP id i19mr6064755jak.47.1614890683174; Thu, 04 Mar 2021 12:44:43 -0800 (PST) MIME-Version: 1.0 From: Gustavo Lapido Loureiro Date: Thu, 4 Mar 2021 17:44:31 -0300 Message-ID: To: cake@lists.bufferbloat.net Content-Type: multipart/alternative; boundary="0000000000008591a805bcbc099c" Subject: [Cake] Need help troubleshooting cake X-BeenThere: cake@lists.bufferbloat.net X-Mailman-Version: 2.1.20 Precedence: list List-Id: Cake - FQ_codel the next generation List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 04 Mar 2021 20:44:44 -0000 --0000000000008591a805bcbc099c Content-Type: text/plain; charset="UTF-8" Hello, new member here. First, thank you all involved in making this great piece of software, which I have already experienced without issues during a couple of months. Back then, it was on Openwrt, in a TP-LINK Archer C-7 router, bandwidth capped to 60 Mbps (on the device's limits, but still making Internet usage much smoother to all users). Then I moved the router to a debian 10 Celeron J1900 mini-ITX, 4 GB of RAM, two entry level Gigabit cards. So far I couldn't get the stable A's in dslreports test I was getting with the previous setup. The point is that my Internet has been upgraded from 60 Mbps to 240/20 Mbps. SInce most, if not all, devices are still 100 Mbps, I'm currently capping cake at 85/18. I basically "transported" the cake settings from Openwrt to debian, basically adjusting the speed limits. I would like to know where I start troubleshooting this, to help identify what is causing bufferbloat on this new setup. Follow cake settings, then tc, then network hardware info *CAKE* # Uplink and Downlink values are in kbps UPLINK=17500 #DOWNLINK=216000 DOWNLINK=90000 # SQM recipe to use. For more information, see /usr/lib/sqm/*.help SCRIPT=piece_of_cake.qos # Optional/advanced config ENABLED=1 QDISC=cake #LLAM=tc_stab LINKLAYER=ethernet OVERHEAD=22 #STAB_MTU=2047 #STAB_TSIZE=512 #STAB_MPU=0 #ILIMIT= #ELIMIT= #ITARGET= #ETARGET= # ECN ingress resp. egress. Values are ECN or NOECN. IECN=ECN EECN=NOECN # Extra qdisc options ingress resp. egress IQDISC_OPTS="nat dual-dsthost" EQDISC_OPTS="nat dual-srchost ack-filter" # CoDel target #TARGET=5ms #ZERO_DSCP_INGRESS=1 #IGNORE_DSCP_INGRESS=1 *TC SETTINGS:* qdisc noqueue 0: dev lo root refcnt 2 qdisc pfifo_fast 0: dev enp2s0 root refcnt 2 bands 3 priomap 1 2 2 2 1 2 0 0 1 1 1 1 1 1 1 1 qdisc cake 801b: dev enp3s0 root refcnt 2 bandwidth 17500Kbit besteffort dual-srchost nat nowash ack-filter split-gso rtt 100.0ms noatm overhead 22 qdisc ingress ffff: dev enp3s0 parent ffff:fff1 ---------------- qdisc cake 801c: dev ifb4enp3s0 root refcnt 2 bandwidth 90Mbit besteffort dual-dsthost nat wash no-ack-filter split-gso rtt 100.0ms noatm overhead 22 *NETWORK HARDWARE:* SCSI *-network description: Ethernet interface product: RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller vendor: Realtek Semiconductor Co., Ltd. physical id: 0 bus info: pci@0000:02:00.0 logical name: enp2s0 version: 06 serial: c4:e9:84:00:1d:7b size: 1Gbit/s capacity: 1Gbit/s width: 64 bits clock: 33MHz capabilities: pm msi pciexpress msix vpd bus_master cap_list ethernet physical tp mii 10bt 10bt-fd 100bt 100bt-fd 1000bt 1000bt-fd autonegotiation configuration: autonegotiation=on broadcast=yes driver=r8169 duplex=full firmware=rtl_nic/rtl8168e-2.fw ip=192.168.1.1 latency=0 link=yes multicast=yes port=MII speed=1Gbit/s resources: irq:17 ioport:e000(size=256) memory:d0704000-d0704fff memory:d0700000-d0703fff *-network description: Ethernet interface product: RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller vendor: Realtek Semiconductor Co., Ltd. physical id: 0 bus info: pci@0000:03:00.0 logical name: enp3s0 version: 0c serial: 44:8a:5b:94:96:37 size: 1Gbit/s capacity: 1Gbit/s width: 64 bits clock: 33MHz capabilities: pm msi pciexpress msix vpd bus_master cap_list ethernet physical tp aui bnc mii fibre 10bt 10bt-fd 100bt 100bt-fd 1000bt-fd autonegotiation configuration: autonegotiation=on broadcast=yes driver=r8169 duplex=full firmware=rtl8168g-2_0.0.1 02/06/13 ip=179.210.1.62 latency=0 link=yes multicast=yes port=MII speed=1Gbit/s resources: irq:18 ioport:d000(size=256) memory:d0604000-d0604fff memory:d0600000-d0603fff *-network:0 description: Ethernet interface physical id: 1 logical name: ifb4enp3s0 serial: 76:6b:66:3c:6d:e9 capabilities: ethernet physical configuration: broadcast=yes *-network:1 DISABLED description: Ethernet interface physical id: 2 logical name: ifb1 serial: 02:9e:3d:12:6e:16 capabilities: ethernet physical configuration: broadcast=yes *-network:2 DISABLED description: Ethernet interface physical id: 3 logical name: ifb0 serial: 32:fe:93:2e:3a:1d capabilities: ethernet physical configuration: broadcast=yes --0000000000008591a805bcbc099c Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hello, new member here.
First, thank you al= l involved in making this great piece of software, which I have already exp= erienced without issues during a couple of months.
Back then, it = was on Openwrt, in a TP-LINK Archer C-7 router, bandwidth capped to 60 Mbps= (on the device's limits, but still making Internet usage much smoother= to all users).
Then I moved the router to a debian 10 Celeron J1= 900 mini-ITX, 4 GB of RAM, two entry level Gigabit cards.
So far = I couldn't get the stable A's in dslreports test I was getting with= the previous setup.
The point is that my Internet has been upgra= ded from 60 Mbps to 240/20 Mbps. SInce most, if not all, devices are still = 100 Mbps, I'm currently capping cake at 85/18.
I basically &q= uot;transported" the cake settings from Openwrt to debian, basically a= djusting the speed limits.
I would like to know where I start tro= ubleshooting this, to help identify what is causing bufferbloat on this new= setup.

Follow cake settings, then tc, then networ= k hardware info

CAKE

# Uplink and Downlink values are in kbps
UPLINK=3D17500
#DOWNL= INK=3D216000
DOWNLINK=3D90000

# SQM recipe to use. For more infor= mation, see /usr/lib/sqm/*.help
SCRIPT=3Dpiece_of_cake.qos

# Opti= onal/advanced config

ENABLED=3D1
QDISC=3Dcake

#LLAM=3Dtc_s= tab
LINKLAYER=3Dethernet
OVERHEAD=3D22
#STAB_MTU=3D2047
#STAB_T= SIZE=3D512
#STAB_MPU=3D0

#ILIMIT=3D
#ELIMIT=3D
#ITARGET=3D<= br>#ETARGET=3D

# ECN ingress resp. egress. Values are ECN or NOECN.<= br>IECN=3DECN
EECN=3DNOECN

# Extra qdisc options ingress resp. eg= ress
IQDISC_OPTS=3D"nat dual-dsthost"
EQDISC_OPTS=3D"n= at dual-srchost ack-filter"

# CoDel target
#TARGET=3D5ms
=
#ZERO_DSCP_INGRESS=3D1
#IGNORE_DSCP_INGRESS=3D1

=
TC SETTINGS:

qdisc noqueue 0: dev = lo root refcnt 2
qdisc pfifo_fast 0: dev enp2s0 root refcnt 2 bands 3 p= riomap =C2=A01 2 2 2 1 2 0 0 1 1 1 1 1 1 1 1
qdisc cake 801b: dev enp3s0= root refcnt 2 bandwidth 17500Kbit besteffort dual-srchost nat nowash ack-f= ilter split-gso rtt 100.0ms noatm overhead 22
qdisc ingress ffff: dev e= np3s0 parent ffff:fff1 ----------------
qdisc cake 801c: dev ifb4enp3s0= root refcnt 2 bandwidth 90Mbit besteffort dual-dsthost nat wash no-ack-fil= ter split-gso rtt 100.0ms noatm overhead 22

<= b>NETWORK HARDWARE:

SCSI =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0
=C2=A0 *-= network =C2=A0 =C2=A0 =C2=A0 =C2=A0
=C2=A0 =C2=A0 =C2=A0 =C2=A0descripti= on: Ethernet interface
=C2=A0 =C2=A0 =C2=A0 =C2=A0product: RTL8111/8168/= 8411 PCI Express Gigabit Ethernet Controller
=C2=A0 =C2=A0 =C2=A0 =C2=A0= vendor: Realtek Semiconductor Co., Ltd.
=C2=A0 =C2=A0 =C2=A0 =C2=A0physi= cal id: 0
=C2=A0 =C2=A0 =C2=A0 =C2=A0bus info: pci@0000:02:00.0
=C2= =A0 =C2=A0 =C2=A0 =C2=A0logical name: enp2s0
=C2=A0 =C2=A0 =C2=A0 =C2=A0= version: 06
=C2=A0 =C2=A0 =C2=A0 =C2=A0serial: c4:e9:84:00:1d:7b
=C2= =A0 =C2=A0 =C2=A0 =C2=A0size: 1Gbit/s
=C2=A0 =C2=A0 =C2=A0 =C2=A0capacit= y: 1Gbit/s
=C2=A0 =C2=A0 =C2=A0 =C2=A0width: 64 bits
=C2=A0 =C2=A0 = =C2=A0 =C2=A0clock: 33MHz
=C2=A0 =C2=A0 =C2=A0 =C2=A0capabilities: pm ms= i pciexpress msix vpd bus_master cap_list ethernet physical tp mii 10bt 10b= t-fd 100bt 100bt-fd 1000bt 1000bt-fd autonegotiation
=C2=A0 =C2=A0 =C2= =A0 =C2=A0configuration: autonegotiation=3Don broadcast=3Dyes driver=3Dr816= 9 duplex=3Dfull firmware=3Drtl_nic/rtl8168e-2.fw ip=3D192.168.1.1 latency= =3D0 link=3Dyes multicast=3Dyes port=3DMII speed=3D1Gbit/s
=C2=A0 =C2=A0= =C2=A0 =C2=A0resources: irq:17 ioport:e000(size=3D256) memory:d0704000-d07= 04fff memory:d0700000-d0703fff
=C2=A0 *-network
=C2=A0 =C2=A0 =C2=A0 = =C2=A0description: Ethernet interface
=C2=A0 =C2=A0 =C2=A0 =C2=A0product= : RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller
=C2=A0 =C2= =A0 =C2=A0 =C2=A0vendor: Realtek Semiconductor Co., Ltd.
=C2=A0 =C2=A0 = =C2=A0 =C2=A0physical id: 0
=C2=A0 =C2=A0 =C2=A0 =C2=A0bus info: pci@000= 0:03:00.0
=C2=A0 =C2=A0 =C2=A0 =C2=A0logical name: enp3s0
=C2=A0 =C2= =A0 =C2=A0 =C2=A0version: 0c
=C2=A0 =C2=A0 =C2=A0 =C2=A0serial: 44:8a:5b= :94:96:37
=C2=A0 =C2=A0 =C2=A0 =C2=A0size: 1Gbit/s
=C2=A0 =C2=A0 =C2= =A0 =C2=A0capacity: 1Gbit/s
=C2=A0 =C2=A0 =C2=A0 =C2=A0width: 64 bits=C2=A0 =C2=A0 =C2=A0 =C2=A0clock: 33MHz
=C2=A0 =C2=A0 =C2=A0 =C2=A0capa= bilities: pm msi pciexpress msix vpd bus_master cap_list ethernet physical = tp aui bnc mii fibre 10bt 10bt-fd 100bt 100bt-fd 1000bt-fd autonegotiation<= br>=C2=A0 =C2=A0 =C2=A0 =C2=A0configuration: autonegotiation=3Don broadcast= =3Dyes driver=3Dr8169 duplex=3Dfull firmware=3Drtl8168g-2_0.0.1 02/06/13 ip= =3D179.210.1.62 latency=3D0 link=3Dyes multicast=3Dyes port=3DMII speed=3D1= Gbit/s
=C2=A0 =C2=A0 =C2=A0 =C2=A0resources: irq:18 ioport:d000(size=3D2= 56) memory:d0604000-d0604fff memory:d0600000-d0603fff
=C2=A0 *-network:0=
=C2=A0 =C2=A0 =C2=A0 =C2=A0description: Ethernet interface
=C2=A0 = =C2=A0 =C2=A0 =C2=A0physical id: 1
=C2=A0 =C2=A0 =C2=A0 =C2=A0logical na= me: ifb4enp3s0
=C2=A0 =C2=A0 =C2=A0 =C2=A0serial: 76:6b:66:3c:6d:e9
= =C2=A0 =C2=A0 =C2=A0 =C2=A0capabilities: ethernet physical
=C2=A0 =C2=A0= =C2=A0 =C2=A0configuration: broadcast=3Dyes
=C2=A0 *-network:1 DISABLED=
=C2=A0 =C2=A0 =C2=A0 =C2=A0description: Ethernet interface
=C2=A0 = =C2=A0 =C2=A0 =C2=A0physical id: 2
=C2=A0 =C2=A0 =C2=A0 =C2=A0logical na= me: ifb1
=C2=A0 =C2=A0 =C2=A0 =C2=A0serial: 02:9e:3d:12:6e:16
=C2=A0 = =C2=A0 =C2=A0 =C2=A0capabilities: ethernet physical
=C2=A0 =C2=A0 =C2=A0= =C2=A0configuration: broadcast=3Dyes
=C2=A0 *-network:2 DISABLED
=C2= =A0 =C2=A0 =C2=A0 =C2=A0description: Ethernet interface
=C2=A0 =C2=A0 = =C2=A0 =C2=A0physical id: 3
=C2=A0 =C2=A0 =C2=A0 =C2=A0logical name: ifb= 0
=C2=A0 =C2=A0 =C2=A0 =C2=A0serial: 32:fe:93:2e:3a:1d
=C2=A0 =C2=A0 = =C2=A0 =C2=A0capabilities: ethernet physical
=C2=A0 =C2=A0 =C2=A0 =C2=A0= configuration: broadcast=3Dyes
--0000000000008591a805bcbc099c--