From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-wm1-x32a.google.com (mail-wm1-x32a.google.com [IPv6:2a00:1450:4864:20::32a]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by lists.bufferbloat.net (Postfix) with ESMTPS id 7049E3CB36 for ; Thu, 27 Dec 2018 19:17:29 -0500 (EST) Received: by mail-wm1-x32a.google.com with SMTP id d15so17854226wmb.3 for ; Thu, 27 Dec 2018 16:17:29 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=heistp.net; s=google; h=from:content-transfer-encoding:mime-version:subject:message-id:date :to; bh=pHKseJgfGLxE/UaMY0ytDb8KA9LV7p3lDUesF0zCTY0=; b=FYulv1is9qye8uUTrRa6B1g2FpMT9kxIVDg5C0arN2fnMcLZmlyrlWLpbAUTglhPwW AtVnvb1EXbIJAmahnASZhBvbGGHkF9zKS7Rl2heql6G33K6n1HIyiL8eSd6fRxHwLRfZ p1vM/BSqNkKwBTJvO9vTFZw54COVGCCrcHoFikwkGfCrVV1F6i2qJKypT/amzo2IC0W1 qY0v1hDx9MuIUD7mWDm5jeJgdoX6paF8/oIgWwosg2TmfwYoSPpg0U3zjqkk+/YE9fwx BgFcntNZ9jPgpBRUowWjaxcoWYOYDEFX1h22liIhBQr5j5n9NYuxscZRPcVt2dusnOe+ qQUA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:content-transfer-encoding:mime-version :subject:message-id:date:to; bh=pHKseJgfGLxE/UaMY0ytDb8KA9LV7p3lDUesF0zCTY0=; b=iVSPoTpsABo1ygC4PDMZttWk8OpoFAxTz9eRn99HDmENMS8nc+019Cujhb+pFG4CNM 6Gx9gU5J3nxUX7+MjPShiTuaB30Zaoy2M5FB8/ANz//j3Xm7P0OOmUV4Gd26zxxLCklT LOJegESvfl74Q9buxjovuxxv/pxLS0LUnMvoLFQ7ee082I5TYMOlxkSNG6c04HgjXa+I yHwDqwriHgfIga73hIBzHNRy7Jqqe/TdyWdESwOWo2639WLfJE71YX5fAUsHCU/Mcz7t lPJUu/m/Y01/TFD0LjbhNgKr2tE5vlHjZNl1oM096ETxliy2WWLHpGLvXR02qSMElsrt 4aXg== X-Gm-Message-State: AJcUukfYLkelLPFYijkchkvNCkicG+BvId6T6lJqsybRaFMqt0Zb1BXx 6kgsNrFqHzWHsbfV4kK4ihEmD+ejHcE= X-Google-Smtp-Source: ALg8bN65EE24vYPEvdCkXE+T1WC8jYSbx486jJALS+sERME1OxBu77yMcEtUO/HqdxRq93S7vMd46w== X-Received: by 2002:a1c:2408:: with SMTP id k8mr21906311wmk.110.1545956248299; Thu, 27 Dec 2018 16:17:28 -0800 (PST) Received: from tron.luk.heistp.net (h-1169.lbcfree.net. [185.193.85.130]) by smtp.gmail.com with ESMTPSA id z12sm28737667wrh.35.2018.12.27.16.17.27 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 27 Dec 2018 16:17:27 -0800 (PST) From: Pete Heist Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 11.5 \(3445.9.1\)) Message-Id: Date: Fri, 28 Dec 2018 01:17:26 +0100 To: Cake List X-Mailer: Apple Mail (2.3445.9.1) Subject: [Cake] cake and hfsc rate limiters outperforming htb on one-armed router X-BeenThere: cake@lists.bufferbloat.net X-Mailman-Version: 2.1.20 Precedence: list List-Id: Cake - FQ_codel the next generation List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 28 Dec 2018 00:17:29 -0000 For whatever reason, I=E2=80=99m seeing the rate limiters in cake and = hfsc vastly outperform htb in the one-armed router configuration I = described in my previous thread. To simplify things, I apply the qdiscs = with a single class only at egress of eth0 on apu1a: apu2a <=E2=80=94 default VLAN =E2=80=94> apu1a <=E2=80=94 VLAN = 3300 =E2=80=94> apu2b I use iperf3 from apu2a to apu2b and find the rate at which things break = down. Whereas cake and hfsc can both reach around 850mbit, htb is = breaking down at around 200mbit, which seems rather strange. This could = be a function of the older kernel I have to use, the hardware, or maybe = htb just isn=E2=80=99t suited well to this task for some reason. I wish = I knew, as I=E2=80=99d rather be using htb for this task than hfsc = (especially given the lockup issue with cake)... =E2=80=94=E2=80=94 #!/bin/bash=20 # point where iperf3 throughput drops below ~93% of theoretical: # htb: 200mbit # hfsc: 850mbit # cake: 850mbit IFACE=3Deth0 RATE=3D850mbit start_htb() { stop tc qdisc add dev $IFACE root handle 1: htb default 1 tc class add dev $IFACE parent 1: classid 1:1 htb rate $RATE = ceil $RATE tc qdisc add dev $IFACE parent 1:1 handle 10: fq_codel } start_hfsc() { stop tc qdisc add dev $IFACE root handle 1: hfsc default 1 tc class add dev $IFACE parent 1: classid 1:1 hfsc sc rate $RATE = ul rate $RATE tc qdisc add dev $IFACE parent 1:1 handle 10: fq_codel } start_cake() { stop tc qdisc add dev $IFACE root cake bandwidth $RATE } stop() { tc qdisc del dev $IFACE root &>/dev/null tc qdisc del dev $IFACE ingress &>/dev/null } "$@=E2=80=9C =E2=80=94=E2=80=94 root@apu1a:~/rate_limiters# uname -a Linux apu1a 3.16.7-ckt9-voyage #1 SMP Thu Apr 23 11:10:44 HKT 2015 i686 = GNU/Linux root@apu1a:~/rate_limiters# cat /proc/cpuinfo=20 processor : 0 vendor_id : AuthenticAMD cpu family : 20 model : 2 model name : AMD G-T40E Processor stepping : 0 microcode : 0x5000101 cpu MHz : 800.000 cache size : 512 KB physical id : 0 siblings : 2 core id : 0 cpu cores : 2 apicid : 0 initial apicid : 0 fdiv_bug : no f00f_bug : no coma_bug : no fpu : yes fpu_exception : yes cpuid level : 6 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge = mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext = fxsr_opt pdpe1gb rdtscp lm constant_tsc nonstop_tsc extd_apicid = aperfmperf pni monitor ssse3 cx16 popcnt lahf_lm cmp_legacy svm extapic = cr8_legacy abm sse4a misalignsse 3dnowprefetch ibs skinit wdt arat = hw_pstate npt lbrv svm_lock nrip_save pausefilter vmmcall bogomips : 1999.83 clflush size : 64 cache_alignment : 64 address sizes : 36 bits physical, 48 bits virtual power management: ts ttp tm stc 100mhzsteps hwpstate processor : 1 vendor_id : AuthenticAMD cpu family : 20 model : 2 model name : AMD G-T40E Processor stepping : 0 microcode : 0x5000101 cpu MHz : 800.000 cache size : 512 KB physical id : 0 siblings : 2 core id : 1 cpu cores : 2 apicid : 1 initial apicid : 1 fdiv_bug : no f00f_bug : no coma_bug : no fpu : yes fpu_exception : yes cpuid level : 6 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge = mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext = fxsr_opt pdpe1gb rdtscp lm constant_tsc nonstop_tsc extd_apicid = aperfmperf pni monitor ssse3 cx16 popcnt lahf_lm cmp_legacy svm extapic = cr8_legacy abm sse4a misalignsse 3dnowprefetch ibs skinit wdt arat = hw_pstate npt lbrv svm_lock nrip_save pausefilter vmmcall bogomips : 1999.83 clflush size : 64 cache_alignment : 64 address sizes : 36 bits physical, 48 bits virtual power management: ts ttp tm stc 100mhzsteps hwpstate root@apu1a:~/rate_limiters# ethtool -i eth0 driver: r8169 version: 2.3LK-NAPI firmware-version: rtl_nic/rtl8168e-2.fw bus-info: 0000:01:00.0 supports-statistics: yes supports-test: no supports-eeprom-access: no supports-register-dump: yes supports-priv-flags: no