From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-il1-x12c.google.com (mail-il1-x12c.google.com [IPv6:2607:f8b0:4864:20::12c]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by lists.bufferbloat.net (Postfix) with ESMTPS id 40C4B3B2A4 for ; Wed, 27 Jan 2021 12:49:33 -0500 (EST) Received: by mail-il1-x12c.google.com with SMTP id p15so1928068ilq.8 for ; Wed, 27 Jan 2021 09:49:33 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:references:in-reply-to:subject:date:message-id :mime-version:content-transfer-encoding:thread-index :content-language; bh=FswGlb8s7m9tNCxoSsyzgt8xFG3zRiqLVvlGIy0NUa0=; b=ljlF7ENQEWyKx2iw+3bhEJV/pa4396smyR2lo9jQKjz0ZSktQljucl2xuiCx6Z+Azy KFy0lepGZ8cY3QWyj/BD/5nTKajJjAbpP9CpOjO8StojtAZMdhKG3gMiiR5+nSbvmXou qQhVsrrHFcjn4He7QBO5oNy1uYq5nmMpkeOH0SacYhOqNuvWohbZeQNlqSSzjbctS3AU pz9l6StBsxj6YjfrIIYHL+VGFWO0HsjtI+pzwc/QYBYAFL9sTil5MBd5q0i/GUoxiRxv khXOHdjaA1fPIBhOOVwXSNwAoz+/HwLvmofzy/16uNN0rS8j/OPPVeCxj6RUnLIOHtu0 WOgw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:references:in-reply-to:subject:date :message-id:mime-version:content-transfer-encoding:thread-index :content-language; bh=FswGlb8s7m9tNCxoSsyzgt8xFG3zRiqLVvlGIy0NUa0=; b=G3mS9BLTnNffr8sZwQWSyiR+KDTWyB/U7vsEPTPZAP9EqX4kIodWTPIpa6eWEmH2Qg 3V7F+UxV0Ct11wu0AWXzbgLO/6isI13aXirrfjMWcxn8cuib+tEKgASaArJaaH6ejpRu BYEzoNYq7b6tENJSBveV6gYEUU+LXwiVvoT3MdEdmSeUIhu6Nddiyd7aSOnWtX+b/Ipb R59vqqfS5X338nOHbxeT8s+SqPEAgiD0xp2eAFmqjDrRmb2LnmY/TP5IVtyKauoXilc2 /RhX2i4gVf4ye9dGcNPKh/QvckJG36n0FwlKqIFywddLMTsNQvhva/8xSprz7TAnVNKC B3pw== X-Gm-Message-State: AOAM532zSUtU4pmXzOAnC+xp1/YJPtPmoUuT/R4typ/5Cmxqhgv0O2BJ 4naaa0fGI5Umd5Wx0J6ddbrOntqlxcs= X-Google-Smtp-Source: ABdhPJwUEPCo9iqbbe5WCfefWFUxQBEj0RiDtub7NN9eTBssL/X1IkJlsKOOIcYZAeM5DsyEWdTgMA== X-Received: by 2002:a92:611:: with SMTP id x17mr9912168ilg.152.1611769772278; Wed, 27 Jan 2021 09:49:32 -0800 (PST) Received: from DESKTOP9N211S3 ([75.9.254.211]) by smtp.gmail.com with ESMTPSA id v7sm1334773iln.79.2021.01.27.09.49.31 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Wed, 27 Jan 2021 09:49:31 -0800 (PST) From: To: "'Dave Taht'" Cc: "'Cake List'" References: <005701d6f442$6d620e90$48262bb0$@gmail.com> In-Reply-To: Date: Wed, 27 Jan 2021 11:49:29 -0600 Message-ID: <008401d6f4d4$c39479a0$4abd6ce0$@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Mailer: Microsoft Outlook 16.0 Thread-Index: AQHEdOoyFE3vL2PYmlilCAayho7IYwIyPklmqk8bG+A= Content-Language: en-us Subject: Re: [Cake] Trouble getting decent performance with CAKE X-BeenThere: cake@lists.bufferbloat.net X-Mailman-Version: 2.1.20 Precedence: list List-Id: Cake - FQ_codel the next generation List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Jan 2021 17:49:33 -0000 Thanks so much for getting back to me. First, I am not so expert in these things, so please excuse my questions = about providing the info you have requested and implementing your = suggestions. 1. I don=E2=80=99t know what imq0 is used for, either.=20 I don't have a script to run CAKE at system start because I haven't = got it working well enough. So, at reboot, the out-of-the box qdiscs = are: qdisc ingress ffff: dev eth0 parent ffff:fff1 ---------------- qdisc pfifo_fast 0: dev imq0 root refcnt 2 bands 3 priomap 1 2 2 2 1 2 = 0 0 1 1 1 1 1 1 1 1 qdisc pfifo_fast 0: dev ifb0 root refcnt 2 bands 3 priomap 1 2 2 2 1 2 = 0 0 1 1 1 1 1 1 1 1 You can see that the imq0 device is present at startup. A quick = search suggests that Ubiquiti uses this for native QOS during egress. If = it's not clear what it's doing and if it's interfering, I will happily = remove it, if I knew how. The worst that happens is that the system = crashes and I have to reboot. 2. At startup (so no CAKE), sudo tc qdisc -s show: qdisc ingress ffff: dev eth0 parent ffff:fff1 ---------------- Sent 2055477419 bytes 2270158 pkt (dropped 0, overlimits 0 requeues 0) backlog 0b 0p requeues 0 qdisc pfifo_fast 0: dev imq0 root refcnt 2 bands 3 priomap 1 2 2 2 1 2 = 0 0 1 1 1 1 1 1 1 1 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0) backlog 0b 0p requeues 0 qdisc pfifo_fast 0: dev ifb0 root refcnt 2 bands 3 priomap 1 2 2 2 1 2 = 0 0 1 1 1 1 1 1 1 1 Sent 2087261885 bytes 2270207 pkt (dropped 0, overlimits 0 requeues 1) backlog 0b 0p requeues 1 3. I set up CAKE with the following commands: sudo tc qdisc add dev eth0 root handle 1:0 cake bandwidth...[switches] =09 sudo set interfaces input ifb0 sudo set interfaces ethernet eth0 redirect ifb0 sudo tc qdisc add dev ifb0 root handle 2:0 cake bandwidth...[switches] Do these commands make CAKE the default, or can I choose a qdisc to = use when running flent? If so, how do I do this? 4. Regarding your suggestion: "the download setting up tc mirred I = assume you are doing with sqm? Do that." This is outside my knowledge, and I have not done anything like = that. =20 I have read an alternative (older?) way to set up CAKE for ingress: = sudo ip link add name ifb4eth0 type ifb sudo tc qdisc del dev eth0 ingress sudo tc qdisc add dev eth0 handle ffff: ingress sudo tc qdisc del dev ifb4eth0 root sudo tc qdisc add dev ifb4eth0 root cake bandwidth... sudo ifconfig ifb4eth1 up sudo tc filter add dev eth1 parent ffff: protocol all prio 10 u32 match = u32 0 0 flowid 1:1 action mirred egress redirect dev ifb4eth1 I suspect the first 6 lines of this code achieve the same thing as = the first two lines of code that I used (see point 3, above). Am I = right? Is the filter that is specified in the last line what you are = suggesting I add? This is about as much as I can address with what you have suggested, = without a super long email. Please feel free to correct my mistakes in understanding. If you have suggestions based on what I have written, I would so = grateful. I am really looking forward to hearing what you think. This learning curve is a little steep. Many thanks. -----Original Message----- From: Dave Taht =20 Sent: Tuesday, January 26, 2021 11:19 PM To: jmarks2@gmail.com Cc: Cake List Subject: Re: [Cake] Trouble getting decent performance with CAKE As much as I like to get the fustest with the mostest with the rrul = test, it is often easier to test up and down separately. do : tc qdisc delete ifb0 root tc qdisc delete eth0 root I am not sure what imq is being used for.... Can you share the output of tc -s instead? a simple upload test would then be: (unless you made cake the default) flent -t pfifo_fast -H wherever --socket-stats -x = --te=3Dupload_streams=3D4 tcp_nup tc qdisc add dev eth0 root cake all_your_options flent -t cake -H wherever --socket-stats -x --te=3Dupload_streams=3D4 = tcp_nup the download setting up tc mirred I assume you are doing with sqm? Do = that. flent -t -H wherever --socket-stats -x --te=3Ddownload_streams=3D4 = tcp_ndown then send tc -s It's entirely feasible your so-called 100mbit service is running at far = far less than 100mbit in the first place. Another thing to check is if your modem is connecting to the device at = 100Mbit or a gbit. SOME - not enough - dsl modems actually connect at = 100Mbit and/or joy of joys excert hw flow control. 95Mbit is gonna be slightly too high in former case for cake to control = things, try 92mbit, or less. On Tue, Jan 26, 2021 at 4:22 PM wrote: > > Dear CAKE experts, > > I write for your help in getting CAKE to perform on my router as I = understand it should. > > > > I replaced my aging Asus home router with a Ubiquiti Edgerouter 4 = specifically so I could take advantage of the port of CAKE to it. > > > > I am in the US, with VDSL2 service provided by AT&T at 100/20. I now = have all unfiltered traffic delivered by the AT&T modem to the eth0 port = on the router. > > > > My desktop runs Windows. So, to take advantage of flent to quantify = CAKE performance, I stood up a Linux Mint VM and ran flent rrul tests = before CAKE installation, and after. > > > > The first attached datafile, labeled qdisc pfifo fast, is the = performance before CAKE. The other file, called 20/95 ack filtered = bridged ptm, is my latest attempt with configuring CAKE flags. > > My major issue is with Ingress. Egress seems fine. > > For ingress, I see very little difference between performances with = and without CAKE. And the overall throughput is far less than 100 mbit. > > > > The queuing disciplines on the router are: > > > > jeremymarks@ubnt:~$ sudo tc qdisc show > > > > qdisc cake 1: dev eth0 root refcnt 2 bandwidth 20Mbit besteffort=20 > dual-srchost nat nowash ack-filter split-gso rtt 100.0ms ptm overhead=20 > 22 no-sce > > qdisc ingress ffff: dev eth0 parent ffff:fff1 ---------------- > > qdisc pfifo_fast 0: dev imq0 root refcnt 2 bands 3 priomap 1 2 2 2 1=20 > 2 0 0 1 1 1 1 1 1 1 1 > > qdisc cake 2: dev ifb0 root refcnt 2 bandwidth 95Mbit besteffort=20 > dual-dsthost nat nowash ingress ack-filter split-gso rtt 100.0ms ptm=20 > overhead 22 no-sce > > > > I must be making a major mistake in configuring CAKE. > > > > I would be grateful for any help or advice in getting this amazing = program to work as it should. > > > > Many thanks for any help. > > Jeremy > > > > > > _______________________________________________ > Cake mailing list > Cake@lists.bufferbloat.net > https://lists.bufferbloat.net/listinfo/cake -- "For a successful technology, reality must take precedence over public = relations, for Mother Nature cannot be fooled" - Richard Feynman dave@taht.net CTO, TekLibre, LLC Tel: 1-831-435-0729