From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-il1-x132.google.com (mail-il1-x132.google.com [IPv6:2607:f8b0:4864:20::132]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by lists.bufferbloat.net (Postfix) with ESMTPS id 2A90A3B2A4 for ; Wed, 27 Jan 2021 12:51:32 -0500 (EST) Received: by mail-il1-x132.google.com with SMTP id y17so2654834ili.12 for ; Wed, 27 Jan 2021 09:51:32 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=fEyEkyTCE/TfuywSqGHC+1CiE4Pw1lpX355Ba7Fipyk=; b=DBpWk6cq6l9s2AzmO+lxj2wBhPalo8ZHkl4P3o8fjdc1Ir8pe8h68KTXvSNdJ2xSJa DUo81VZOK8fJFAHm+r3gkPo7hfJJ+LuwNdKEtQ4Ea7K+y1bsjvexbVf6zEtnMR4Zn7RN 7f6wjfagtbAEwMb89RyufRiaL7Y+2+GJlPLitiGtVHKSWiW7vCMymVqkL1J8I3lwAIXL 8l7oG6zKcURLBYcePF24v+KV2eonM+tvQ7Bv9rLCICn8to4U9YXB3cxf7YuQPUsEg7hM CAYB3Im9wwlFTh6U+X40W223G7MPasUilfoEnkI/hR7aEec5ANczyzGpl/qX9eMOdA1P UpMA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=fEyEkyTCE/TfuywSqGHC+1CiE4Pw1lpX355Ba7Fipyk=; b=RXJk6EESZprW06GdwC0CqcdWzoBU83GE6gd8JP1TngspPwfKCwPUSz2LMLF+JlK35l OJ6dnHCLWiz/9GoU5sthGq2OBc5xCL13xkKG1zCe3JY7GbNpxWv90TAKWIxM5JCh0H1O rU+QyyX2eu673l4SCpjXbjkyTOEIGgwP2ZTfGPaLnm+b4fnhrr7hdx6bHOZW41YzO8oQ HHLnMsO+OCRIAmdI6M18jlo2E+8vJBQBiVfzm/yGFj/aTh7EF0SAotMUsiwkaZiY/MDO N9XpS2ZCXaC4OUviNFW7Pzu4CS+aq3q9wLd3GqPuFjicT1yT2iImKRMZyowT7ZMCxCn8 Lxww== X-Gm-Message-State: AOAM533ssh8S8hMedZ28F+jM36JHgnn5ylXTTP0g9oECp9gUCAeLc4kV wV6kff2pY40nJVNeadr55ndFozSbsr8/i60NjU4= X-Google-Smtp-Source: ABdhPJy3KPE0EMfoSkBcFG12BQWo/vpAfWjoh9zpwVzbTCCYsKlS5hoPlk6fohggj/zplbMGYNpwoprUiqDjxj/C0a8= X-Received: by 2002:a92:d44d:: with SMTP id r13mr9384978ilm.0.1611769891522; Wed, 27 Jan 2021 09:51:31 -0800 (PST) MIME-Version: 1.0 References: <005701d6f442$6d620e90$48262bb0$@gmail.com> <008401d6f4d4$c39479a0$4abd6ce0$@gmail.com> In-Reply-To: <008401d6f4d4$c39479a0$4abd6ce0$@gmail.com> From: Dave Taht Date: Wed, 27 Jan 2021 09:51:19 -0800 Message-ID: To: jmarks2@gmail.com Cc: Cake List Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Subject: Re: [Cake] Trouble getting decent performance with CAKE X-BeenThere: cake@lists.bufferbloat.net X-Mailman-Version: 2.1.20 Precedence: list List-Id: Cake - FQ_codel the next generation List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Jan 2021 17:51:32 -0000 You need the tc mirred to get stuff into ifb0. I don't know what the redirect command you are using does. tc -s qdisc will show stats for the cake instance if that was all you need on this platform. On Wed, Jan 27, 2021 at 9:49 AM wrote: > > Thanks so much for getting back to me. > First, I am not so expert in these things, so please excuse my questions = about providing the info you have requested and implementing your suggestio= ns. > > 1. I don=E2=80=99t know what imq0 is used for, either. > I don't have a script to run CAKE at system start because I haven't = got it working well enough. So, at reboot, the out-of-the box qdiscs are: > > qdisc ingress ffff: dev eth0 parent ffff:fff1 ---------------- > qdisc pfifo_fast 0: dev imq0 root refcnt 2 bands 3 priomap 1 2 2= 2 1 2 0 0 1 1 1 1 1 1 1 1 > qdisc pfifo_fast 0: dev ifb0 root refcnt 2 bands 3 priomap 1 2 2= 2 1 2 0 0 1 1 1 1 1 1 1 1 > > You can see that the imq0 device is present at startup. A quick sear= ch suggests that Ubiquiti uses this for native QOS during egress. If it's n= ot clear what it's doing and if it's interfering, I will happily remove it,= if I knew how. The worst that happens is that the system crashes and I hav= e to reboot. > > 2. At startup (so no CAKE), sudo tc qdisc -s show: > > qdisc ingress ffff: dev eth0 parent ffff:fff1 ---------------- > Sent 2055477419 bytes 2270158 pkt (dropped 0, overlimits 0 reque= ues 0) > backlog 0b 0p requeues 0 > > qdisc pfifo_fast 0: dev imq0 root refcnt 2 bands 3 priomap 1 2 2= 2 1 2 0 0 1 1 1 1 1 1 1 1 > Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0) > backlog 0b 0p requeues 0 > > qdisc pfifo_fast 0: dev ifb0 root refcnt 2 bands 3 priomap 1 2 2= 2 1 2 0 0 1 1 1 1 1 1 1 1 > Sent 2087261885 bytes 2270207 pkt (dropped 0, overlimits 0 reque= ues 1) > backlog 0b 0p requeues 1 > > 3. I set up CAKE with the following commands: > sudo tc qdisc add dev eth0 root handle 1:0 cake bandwidth...[swit= ches] > > sudo set interfaces input ifb0 > sudo set interfaces ethernet eth0 redirect ifb0 > sudo tc qdisc add dev ifb0 root handle 2:0 cake bandwidth...[swit= ches] > > Do these commands make CAKE the default, or can I choose a qdisc to = use when running flent? If so, how do I do this? > > 4. Regarding your suggestion: "the download setting up tc mirred I assume= you are doing with sqm? Do that." > > This is outside my knowledge, and I have not done anything like that= . > I have read an alternative (older?) way to set up CAKE for ingress: > sudo ip link add name ifb4eth0 type ifb > sudo tc qdisc del dev eth0 ingress > sudo tc qdisc add dev eth0 handle ffff: ingress > sudo tc qdisc del dev ifb4eth0 root > sudo tc qdisc add dev ifb4eth0 root cake bandwidth... > sudo ifconfig ifb4eth1 up > sudo tc filter add dev eth1 parent ffff: protocol all prio 10 u32= match u32 0 0 flowid 1:1 action mirred egress redirect dev ifb4eth1 > > I suspect the first 6 lines of this code achieve the same thing as th= e first two lines of code that I used (see point 3, above). Am I right? > Is the filter that is specified in the last line what you are suggest= ing I add? > > This is about as much as I can address with what you have suggested, with= out a super long email. > > Please feel free to correct my mistakes in understanding. > If you have suggestions based on what I have written, I would so grateful= . I am really looking forward to hearing what you think. > This learning curve is a little steep. > > Many thanks. > > > -----Original Message----- > From: Dave Taht > Sent: Tuesday, January 26, 2021 11:19 PM > To: jmarks2@gmail.com > Cc: Cake List > Subject: Re: [Cake] Trouble getting decent performance with CAKE > > As much as I like to get the fustest with the mostest with the rrul test,= it is often easier to test up and down separately. > > do : > > tc qdisc delete ifb0 root > tc qdisc delete eth0 root > > I am not sure what imq is being used for.... > > Can you share the output of tc -s > > instead? > > a simple upload test would then be: > > (unless you made cake the default) > > flent -t pfifo_fast -H wherever --socket-stats -x --te=3Dupload_streams= =3D4 tcp_nup > > tc qdisc add dev eth0 root cake all_your_options > > flent -t cake -H wherever --socket-stats -x --te=3Dupload_streams=3D4 tcp= _nup > > the download setting up tc mirred I assume you are doing with sqm? Do tha= t. > > flent -t -H wherever --socket-stats -x --te=3Ddownload_streams=3D4 tcp_nd= own > > then send tc -s > > It's entirely feasible your so-called 100mbit service is running at far f= ar less than 100mbit in the first place. > > Another thing to check is if your modem is connecting to the device at 10= 0Mbit or a gbit. SOME - not enough - dsl modems actually connect at 100Mbit= and/or joy of joys excert hw flow control. > 95Mbit is gonna be slightly too high in former case for cake to control t= hings, try 92mbit, or less. > > On Tue, Jan 26, 2021 at 4:22 PM wrote: > > > > Dear CAKE experts, > > > > I write for your help in getting CAKE to perform on my router as I unde= rstand it should. > > > > > > > > I replaced my aging Asus home router with a Ubiquiti Edgerouter 4 speci= fically so I could take advantage of the port of CAKE to it. > > > > > > > > I am in the US, with VDSL2 service provided by AT&T at 100/20. I now ha= ve all unfiltered traffic delivered by the AT&T modem to the eth0 port on t= he router. > > > > > > > > My desktop runs Windows. So, to take advantage of flent to quantify CAK= E performance, I stood up a Linux Mint VM and ran flent rrul tests before C= AKE installation, and after. > > > > > > > > The first attached datafile, labeled qdisc pfifo fast, is the performan= ce before CAKE. The other file, called 20/95 ack filtered bridged ptm, is m= y latest attempt with configuring CAKE flags. > > > > My major issue is with Ingress. Egress seems fine. > > > > For ingress, I see very little difference between performances with and= without CAKE. And the overall throughput is far less than 100 mbit. > > > > > > > > The queuing disciplines on the router are: > > > > > > > > jeremymarks@ubnt:~$ sudo tc qdisc show > > > > > > > > qdisc cake 1: dev eth0 root refcnt 2 bandwidth 20Mbit besteffort > > dual-srchost nat nowash ack-filter split-gso rtt 100.0ms ptm overhead > > 22 no-sce > > > > qdisc ingress ffff: dev eth0 parent ffff:fff1 ---------------- > > > > qdisc pfifo_fast 0: dev imq0 root refcnt 2 bands 3 priomap 1 2 2 2 1 > > 2 0 0 1 1 1 1 1 1 1 1 > > > > qdisc cake 2: dev ifb0 root refcnt 2 bandwidth 95Mbit besteffort > > dual-dsthost nat nowash ingress ack-filter split-gso rtt 100.0ms ptm > > overhead 22 no-sce > > > > > > > > I must be making a major mistake in configuring CAKE. > > > > > > > > I would be grateful for any help or advice in getting this amazing prog= ram to work as it should. > > > > > > > > Many thanks for any help. > > > > Jeremy > > > > > > > > > > > > _______________________________________________ > > Cake mailing list > > Cake@lists.bufferbloat.net > > https://lists.bufferbloat.net/listinfo/cake > > > > -- > "For a successful technology, reality must take precedence over public re= lations, for Mother Nature cannot be fooled" - Richard Feynman > > dave@taht.net CTO, TekLibre, LLC Tel: 1-831-435-0729 > --=20 "For a successful technology, reality must take precedence over public relations, for Mother Nature cannot be fooled" - Richard Feynman dave@taht.net CTO, TekLibre, LLC Tel: 1-831-435-0729