G'day, Just a small update on the Unifi security gateway stuff. They have a new range of devices which are a lot more powerful. ( https://store.ui.com/us/en/collections/cloud-gateway-ultra/products/ucg-ultra ) The good news is that the limits set in the GUI now match exactly the "rate" set in the qcdisc. root@UCG-Ultra:~# *tc -p -s -d qdisc show dev eth4* qdisc htb 1: root refcnt 5 r2q 10 default 0x2 direct_packets_stat 0 ver 3.17 direct_qlen 1000 Sent 13112672757 bytes 41407610 pkt (dropped 2863, overlimits 12123381 requeues 0) backlog 0b 0p requeues 0 qdisc fq_codel 2: parent 1:2 limit 2000p flows 1024 quantum 300 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64 Sent 13112672757 bytes 41407610 pkt (dropped 2863, overlimits 0 requeues 0) backlog 0b 0p requeues 0 maxpacket 27888 drop_overlimit 0 new_flow_count 9175282 ecn_mark 0 new_flows_len 1 old_flows_len 3 qdisc ingress ffff: parent ffff:fff1 ---------------- Sent 104038056896 bytes 143646981 pkt (dropped 0, overlimits 0 requeues 0) backlog 0b 0p requeues 0 root@UCG-Ultra:/etc/systemd# *tc -d class show dev eth4* class htb 1:1 root rate 35Mbit ceil 35Mbit linklayer ethernet burst 1491b/1 mpu 0b cburst 1491b/1 mpu 0b level 7 class htb 1:2 parent 1:1 leaf 2: prio 7 quantum 1514 rate 64bit ceil 35Mbit linklayer ethernet burst 1500b/1 mpu 0b cburst 1491b/1 mpu 0b level 0 class fq_codel 2:1bf parent 2: class fq_codel 2:274 parent 2: class fq_codel 2:296 parent 2: class fq_codel 2:2ca parent 2: class fq_codel 2:34a parent 2: class fq_codel 2:364 parent 2: root@UCG-Ultra:~# *tc -p -s -d qdisc show dev ifbeth4* qdisc htb 1: root refcnt 2 r2q 10 default 0x2 direct_packets_stat 0 ver 3.17 direct_qlen 1000 Sent 108770017013 bytes 143572868 pkt (dropped 24028, overlimits 43487579 requeues 0) backlog 0b 0p requeues 0 qdisc fq_codel 2: parent 1:2 limit 2000p flows 1024 quantum 1514 target 5ms interval 100ms memory_limit 4Mb ecn drop_batch 64 Sent 108770017013 bytes 143572868 pkt (dropped 24028, overlimits 0 requeues 0) backlog 0b 0p requeues 0 maxpacket 69876 drop_overlimit 10448 new_flow_count 14414347 ecn_mark 0 drop_overmemory 10448 new_flows_len 1 old_flows_len 2 root@UCG-Ultra:/etc/systemd# *tc -d class show dev ifbeth4* class htb 1:1 root rate 800Mbit ceil 800Mbit linklayer ethernet burst 1400b/1 mpu 0b cburst 1400b/1 mpu 0b level 7 class htb 1:2 parent 1:1 leaf 2: prio 7 quantum 1514 rate 64bit ceil 800Mbit linklayer ethernet burst 1500b/1 mpu 0b cburst 1400b/1 mpu 0b level 0 class fq_codel 2:111 parent 2: class fq_codel 2:3cc parent 2: So 35Mb/s and 800Mb/s match what is configured in the GUI. [image: image.png] The bad news is still no cake. The bottleneck in my house is now the air interfaces. I'll run some flent tests soon. Thanks, Dave Seddon Other device details.... root@UCG-Ultra:~# uname -a Linux UCG-Ultra 5.4.213-ui-ipq5322 #5.4.213 SMP PREEMPT Fri Jan 26 01:53:55 CST 2024 aarch64 GNU/Linux root@UCG-Ultra:~# cat /proc/cpuinfo processor : 0 BogoMIPS : 48.00 Features : fp asimd evtstrm aes pmull sha1 sha2 crc32 cpuid CPU implementer : 0x51 CPU architecture: 8 CPU variant : 0xa CPU part : 0x801 CPU revision : 4 processor : 1 BogoMIPS : 48.00 Features : fp asimd evtstrm aes pmull sha1 sha2 crc32 cpuid CPU implementer : 0x51 CPU architecture: 8 CPU variant : 0xa CPU part : 0x801 CPU revision : 4 processor : 2 BogoMIPS : 48.00 Features : fp asimd evtstrm aes pmull sha1 sha2 crc32 cpuid CPU implementer : 0x51 CPU architecture: 8 CPU variant : 0xa CPU part : 0x801 CPU revision : 4 processor : 3 BogoMIPS : 48.00 Features : fp asimd evtstrm aes pmull sha1 sha2 crc32 cpuid CPU implementer : 0x51 CPU architecture: 8 CPU variant : 0xa CPU part : 0x801 CPU revision : 4 root@UCG-Ultra:~# cat /proc/interrupts CPU0 CPU1 CPU2 CPU3 4: 49385470 71684295 74561605 77496134 GIC-0 20 Level arch_timer 6: 0 0 0 0 GIC-0 39 Level arch_mem_timer 8: 0 0 0 0 GIC-0 195 Level edma_txcmpl_4 9: 0 0 0 0 GIC-0 196 Level edma_txcmpl_5 10: 0 0 0 0 GIC-0 197 Level edma_txcmpl_6 11: 0 0 0 0 GIC-0 198 Level edma_txcmpl_7 12: 1301701 0 0 0 GIC-0 199 Level edma_txcmpl_8 13: 16537922 0 0 0 GIC-0 200 Level edma_txcmpl_9 14: 16902391 0 0 0 GIC-0 201 Level edma_txcmpl_10 15: 19093638 0 0 0 GIC-0 202 Level edma_txcmpl_11 16: 218358 0 0 0 GIC-0 203 Level edma_txcmpl_12 17: 14172534 0 0 0 GIC-0 204 Level edma_txcmpl_13 18: 12228644 0 0 0 GIC-0 205 Level edma_txcmpl_14 19: 14848643 0 0 0 GIC-0 206 Level edma_txcmpl_15 20: 141424886 0 0 0 GIC-0 171 Level edma_rxdesc_12 21: 10923594 0 0 0 GIC-0 172 Level edma_rxdesc_13 22: 10953671 0 0 0 GIC-0 173 Level edma_rxdesc_14 23: 13031550 0 0 0 GIC-0 174 Level edma_rxdesc_15 24: 0 0 0 0 GIC-0 223 Level edma_misc 33: 5199506 0 0 0 GIC-0 321 Level bam_dma 34: 929 0 0 0 GIC-0 322 Level msm_serial0 35: 10465714 0 0 0 GIC-0 345 Level mmc0 36: 3 0 0 0 GIC-0 348 Level 7804000.sdhci 37: 40125 0 0 0 GIC-0 324 Level 78b5000.spi 38: 5187812 0 0 0 GIC-0 326 Level 78b7000.spi 39: 9865790 0 0 0 GIC-0 325 Level i2c_qup 45: 0 0 0 0 GIC-0 450 Edge smp2p 46: 0 0 0 0 GIC-0 453 Edge q6v5 wdog 47: 0 0 0 0 GIC-0 352 Edge tsens_interrupt 48: 0 0 0 0 GIC-0 23 Level arm-pmu 49: 0 0 0 0 GIC-0 299 Edge tzerror 50: 360 0 0 0 GIC-0 96 Level xhci-hcd:usb1 51: 0 0 0 0 smp2p 0 Edge q6v5 fatal 52: 0 0 0 0 smp2p 1 Edge q6v5 ready 53: 0 0 0 0 smp2p 2 Edge q6v5 handover 54: 0 0 0 0 smp2p 3 Edge q6v5 stop 55: 0 0 0 0 smp2p 8 Edge q6v5_wcss_userpd1_fatal 56: 0 0 0 0 smp2p 9 Edge q6v5_wcss_userpd1_ready 57: 0 0 0 0 smp2p 12 Edge q6v5_wcss_userpd1_spawn_ack 58: 0 0 0 0 smp2p 11 Edge q6v5_wcss_userpd1_stop_ack 59: 0 0 0 0 msmgpio 52 Edge Reset Button IPI0: 11014796 16872295 17455146 17378253 Rescheduling interrupts IPI1: 54693 31818397 30245960 124867604 Function call interrupts IPI2: 0 0 0 0 CPU stop interrupts IPI3: 0 0 0 0 CPU stop (for crash dump) interrupts IPI4: 0 0 0 0 Timer broadcast interrupts IPI5: 914 0 0 0 IRQ work interrupts IPI6: 0 0 0 0 CPU wake-up interrupts Err: 0 On Tue, Jan 9, 2024 at 3:28 PM Nils Andreas Svee wrote: > Well my NIC has 4 queues as far as I can tell, so it could likely work, > but as you say it’s like killing a mosquito with a gatling gun. > > Those graphs are sweet though, and it’s been in my backlog for awhile to > do something with Grafana to get something similar, like this one from a > few years ago you’ve seen too: > https://forum.openwrt.org/t/sqm-reporting/59960/96 > > Best Regards, > Nils Andreas Svee > > On Jan 9, 2024, at 18:17, Dave Taht wrote: > > Principal limitation for libreqos on a small box is has to have > multiple hardware queues and support eBPF. > > Seriously folks, running libreqos at home is *serious overkill*, > although I have to admit the traffic graphs are mesmerizing!!! One of > our ISPs has been setting them to music: > https://www.youtube.com/@trendaltoews7143 > > Herbert has been working on adding all sorts of other analytics to it also. > > On Tue, Jan 9, 2024 at 12:07 PM dave seddon > wrote: > > > Nils - I guess you could run LibreQoS on N100? > > On Tue, Jan 9, 2024 at 8:57 AM Nils Andreas Svee via Cake < > cake@lists.bufferbloat.net> wrote: > > > On Jan 9, 2024, at 17:05, Dave Taht wrote: > > On Tue, Jan 9, 2024 at 10:40 AM Nils Andreas Svee via Cake > wrote: > > Though frankly, I don’t plan on updating the sch_cake and tc binaries when > new firmwares are released anymore, as they don’t publish the GPL archives > on their webpage after the redesign, and they don’t respond to requests for > them either by the looks of the forums. So if it breaks there’s not much I > can do anymore. > > > This irks me enormously. It is the direct outcome of the cambium > elevate lawsuit, where both companies lost, the ISPs lost, open source > practices long established about publishing sources, lost, and the > lawyers went on to other nasty things leaving this trail of awful > precedents in their wake. > > https://www.mtin.net/blog/ubnt-vs-cambium/ > > Wow, hadn’t read about that. They even sued an ISP just for using > Cambium’s software on their hardware? > That is crazy, just evil corporate lawyers doing their thing I guess. > > I do not know what to do about it. It also irks me that as a > contributor to "smart queues" they are not maintaining it well. > > It leaves something to be desired yes, and I would’ve hoped to see CAKE > included too of course, > but even WireGuard is only available in the latest release candidates with > the redesigned web UI, so I’m not holding my breath. > > I still have an EdgeRouter 4 that serves the family farm and one of the > 8-port switches under my desk, if only because I don’t wanna spend money on > replacing them, and they do serve their purpose. > > I’ve since moved though, and now live in an area that has FTTH, so I > needed something beefier to handle CAKE on a 750/750 subscription, because > obviously there’s still bloat even on that ;) > > One of those Chinese boxes with a N100 in it and OpenWrt on top works > wonders :) > > Best Regards, > Nils Andreas Svee > _______________________________________________ > Cake mailing list > Cake@lists.bufferbloat.net > https://lists.bufferbloat.net/listinfo/cake > > > > > -- > Regards, > Dave Seddon > +1 415 857 5102 > > > > > -- > 40 years of net history, a couple songs: > https://www.youtube.com/watch?v=D9RGX6QFm5E > Dave Täht CSO, LibreQos > > > -- Regards, Dave Seddon +1 415 857 5102