From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mout.gmx.net (mout.gmx.net [212.227.15.15]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "mout.gmx.net", Issuer "TeleSec ServerPass DE-1" (verified OK)) by huchra.bufferbloat.net (Postfix) with ESMTPS id 23FAA21FF0B for ; Fri, 10 Jul 2015 12:40:33 -0700 (PDT) Received: from hms-beagle-7.home.lan ([217.237.70.193]) by mail.gmx.com (mrgmx001) with ESMTPSA (Nemesis) id 0MaaOf-1ZXmPG2eNd-00K5ZI; Fri, 10 Jul 2015 21:40:31 +0200 Content-Type: text/plain; charset=windows-1252 Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\)) From: Sebastian Moeller In-Reply-To: <55A01E2A.4050508@imap.cc> Date: Fri, 10 Jul 2015 21:40:30 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: References: <559FA8D4.2030305@imap.cc> <559FDC38.9010400@imap.cc> <559FE294.60801@gmail.com> <55A00E06.3000000@imap.cc> <55A01E2A.4050508@imap.cc> To: Fred Stratton X-Mailer: Apple Mail (2.1878.6) X-Provags-ID: V03:K0:WhOeD+ztGbgLnepNb4/Ia6vI+u0wSEs61E9JiGEcmbJgXs+inEy 2XL4SBSOxtxm1RR4I8jZi4qIUDFTvuMN3jd8pou7kYRjFl8RFDb218HtdtTStFtZPTRoERj i9z8kaYHQQboyETB/DsibidQh0Tnfx9QXHmUkb1W5Ox9RDUItv8Kgt9rsKSzqWN5IDcZ2wm MFYDBAIuP6eBhLjaT8nEQ== X-UI-Out-Filterresults: notjunk:1;V01:K0:al7hTiOfqQc=:VbTFHpPA/MyOpy3jlXKwWQ vzQYp5JPEP2dQvDfDIaW/TFld1b0HwdeDA5LkEKi2UjM5CmMV1zsUvDrk+3bXzrf+Tfda/517 NtiIou9nVOoo3CwtOKzEOTt14zrX2ZLciKHhNikAfk7tEPGdUCJyXkldhRoZGs9LzdsyHhPo0 E2zFNiOz7WZIJm3gMqwN2hIpbilEgFUWJz3k+CtfbjvzOqoDUY0e4xFShe+a09b8wLE6A3YiY WYctwwKRMT9Mgapv6IKLv14iZZd9MEzhS5Pq5Df7n0sTCtXtaBdLaR1OCngp46Ej5iudNVkru 1pYkOvRv3IYvCO6HxwlybJUxRk22omAeDVTiU7Qa7zjxUljVhT/9i+suLW3bH4HMdcUZzKsq1 AEfe2jI1fpC9CS46x9o9+OZVGc2OpKIpl1h2lWQoL/k1hK69s4axORWmcRQcjNhaphVrF69z5 FW/ujT8WPbgi+WvQGUTem2kfruIu06Bf01CwYUKOWFKmiRLPAehf/aA4dKJwf6BgU+hH8yxmV agpCMT5UGNE6IwK+aL/YlmEzbK/Zt19i8wANIQm1JaZSFLCIVd5TcMh047kvPKab+FwN2O2Nq o76okjAJeTzZUx9l+FiB2mHtYmpi67LMhOoUz7zLEd+f+HS1ifHR1zZ9R4bNrGeAOww9wZsT1 DsX3UW3hrbQiIWDH0zmYrGrPOLNymfutNtIksVnT7NxI5hUXIrgZDnSErY/kF0ctbFgA= Cc: cerowrt-devel@lists.bufferbloat.net Subject: Re: [Cerowrt-devel] Correct syntax for cake commands and atm issues. X-BeenThere: cerowrt-devel@lists.bufferbloat.net X-Mailman-Version: 2.1.13 Precedence: list List-Id: Development issues regarding the cerowrt test router project List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Jul 2015 19:41:02 -0000 Hi Fred, On Jul 10, 2015, at 21:34 , Fred Stratton wrote: > bridge sync is circa 10 000 kbit/s >=20 > with the cake option in sqm enabled >=20 > config queue 'eth1' > option qdisc_advanced '0' > option enabled '1' > option interface 'pppoe-wan' > option upload '850' > option qdisc 'cake' > option script 'simple_pppoe.qos' > option linklayer 'atm' > option overhead '40' > option download =918500' So this looks reasonable. Then again, if the DSLAM is under = provisioned/oversubscribed (=3D congested) shaping uypur DSL link might = not fix all buffer bloat.. >=20 > tc -s qdisc show dev pppoe-wan > qdisc htb 1: root refcnt 2 r2q 10 default 12 direct_packets_stat 0 = direct_qlen 3 > Sent 101336 bytes 440 pkt (dropped 2, overlimits 66 requeues 0) > backlog 0b 0p requeues 0 > qdisc cake 110: parent 1:11 unlimited diffserv4 flows raw > Sent 4399 bytes 25 pkt (dropped 0, overlimits 0 requeues 0) > backlog 0b 0p requeues 0 > Class 0 Class 1 Class 2 Class 3 > rate 0bit 0bit 0bit 0bit > target 5.0ms 5.0ms 5.0ms 5.0ms > interval 100.0ms 100.0ms 100.0ms 100.0ms > Pk delay 0us 0us 7us 2us > Av delay 0us 0us 0us 0us > Sp delay 0us 0us 0us 0us > pkts 0 0 22 3 > way inds 0 0 0 0 > way miss 0 0 22 2 > way cols 0 0 0 0 > bytes 0 0 3392 1007 > drops 0 0 0 0 > marks 0 0 0 0 > qdisc cake 120: parent 1:12 unlimited diffserv4 flows raw > Sent 96937 bytes 415 pkt (dropped 2, overlimits 0 requeues 0) > backlog 0b 0p requeues 0 > Class 0 Class 1 Class 2 Class 3 > rate 0bit 0bit 0bit 0bit > target 5.0ms 5.0ms 5.0ms 5.0ms > interval 100.0ms 100.0ms 100.0ms 100.0ms > Pk delay 0us 28.0ms 0us 0us > Av delay 0us 1.2ms 0us 0us > Sp delay 0us 4us 0us 0us > pkts 0 417 0 0 > way inds 0 0 0 0 > way miss 0 23 0 0 > way cols 0 0 0 0 > bytes 0 98951 0 0 > drops 0 2 0 0 > marks 0 0 0 0 > qdisc cake 130: parent 1:13 unlimited diffserv4 flows raw > Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0) > backlog 0b 0p requeues 0 > Class 0 Class 1 Class 2 Class 3 > rate 0bit 0bit 0bit 0bit > target 5.0ms 5.0ms 5.0ms 5.0ms > interval 100.0ms 100.0ms 100.0ms 100.0ms > Pk delay 0us 0us 0us 0us > Av delay 0us 0us 0us 0us > Sp delay 0us 0us 0us 0us > pkts 0 0 0 0 > way inds 0 0 0 0 > way miss 0 0 0 0 > way cols 0 0 0 0 > bytes 0 0 0 0 > drops 0 0 0 0 > marks 0 0 0 0 > qdisc cake 140: parent 1:14 unlimited diffserv4 flows raw > Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0) > backlog 0b 0p requeues 0 > Class 0 Class 1 Class 2 Class 3 > rate 0bit 0bit 0bit 0bit > target 5.0ms 5.0ms 5.0ms 5.0ms > interval 100.0ms 100.0ms 100.0ms 100.0ms > Pk delay 0us 0us 0us 0us > Av delay 0us 0us 0us 0us > Sp delay 0us 0us 0us 0us > pkts 0 0 0 0 > way inds 0 0 0 0 > way miss 0 0 0 0 > way cols 0 0 0 0 > bytes 0 0 0 0 > drops 0 0 0 0 > marks 0 0 0 0 > qdisc ingress ffff: parent ffff:fff1 ---------------- > Sent 273341 bytes 435 pkt (dropped 0, overlimits 0 requeues 0) > backlog 0b 0p requeues 0 But this is the hallmark of out of date sqm-scripts, this just = uses cake as leaf qdisc and keeps HTB as the main shaper; a = configuration that is useful for testing. I assume this is the old set = of sqm-scripts not the update I just sent as attachment? If so could you = retry with the newer scripts, please? Best Regards Sebastian >=20 >=20 >=20 >=20 > On 10/07/15 19:46, Sebastian Moeller wrote: >> Hi Fred, >>=20 >> your results seem to indicate that cake is not active at all, as the = latency under load is abysmal (a quick check is to look at the median in = relation to the min and the 90% number, in your examples all of these = are terrible). Could you please post the result of the following = commands on your router: >> 1) cat /etc/config/sqm >> 2) tc -d qdisc >> 3) tc -d class show dev pppoe-wan >> 4) tc -d class show dev ifb4pppoe-wqn >> 5) /etc/init.d/sqm stop >> 6) /etc/init.d/sqm start >>=20 >> hopefully these give some insight what might have happened. >>=20 >> And finally I would love to learn the output of: >> sh betterspeedtest.sh -4 -H netperf-eu.bufferbloat.net -t 150 -p = netperf-eu.bufferbloat.net -n 4 ; sh netperfrunner.sh -4 -H = netperf-eu.bufferbloat.net -t 150 -p netperf-eu.bufferbloat.net -n 4 >>=20 >>=20 >> Many Thanks & Best Regards >> Sebastian >>=20 >> On Jul 10, 2015, at 20:25 , Fred Stratton = wrote: >>=20 >>> By your command >>> Rebooted to rerun qdisc script, rather than changing qdiscs from the = command-line, so suboptimal process as end-point changed. >>>=20 >>> script configuring qdiscs and overhead 40 on >>>=20 >>> sh netperfrunner.sh -H netperf-eu.bufferbloat.net -p 2.96.48.1 >>> 2015-07-10 18:22:08 Testing netperf-eu.bufferbloat.net (ipv4) with 4 = streams down and up while pinging 2.96.48.1. Takes about 60 seconds. >>> Download: 6.73 Mbps >>> Upload: 0.58 Mbps >>> Latency: (in msec, 62 pings, 0.00% packet loss) >>> Min: 24.094 >>> 10pct: 172.654 >>> Median: 260.563 >>> Avg: 253.580 >>> 90pct: 330.003 >>> Max: 411.145 >>>=20 >>> script configuring qdiscs on flows raw >>>=20 >>> sh netperfrunner.sh -H netperf-eu.bufferbloat.net -p >>> 78.145.32.1 >>> 2015-07-10 18:49:21 Testing netperf-eu.bufferbloat.net (ipv4) with 4 = streams down and up while pinging 78.145.32.1. Takes about 60 seconds. >>> Download: 6.75 Mbps >>> Upload: 0.59 Mbps >>> Latency: (in msec, 59 pings, 0.00% packet loss) >>> Min: 23.605 >>> 10pct: 169.789 >>> Median: 282.155 >>> Avg: 267.099 >>> 90pct: 333.283 >>> Max: 376.509 >>>=20 >>> script configuring qdiscs and overhead 36 on >>>=20 >>> sh netperfrunner.sh -H netperf-eu.bufferbloat.net -p >>> 80.44.96.1 >>> 2015-07-10 19:20:18 Testing netperf-eu.bufferbloat.net (ipv4) with 4 = streams down and up while pinging 80.44.96.1. Takes about 60 seconds. >>> Download: 6.56 Mbps >>> Upload: 0.59 Mbps >>> Latency: (in msec, 62 pings, 0.00% packet loss) >>> Min: 22.975 >>> 10pct: 195.473 >>> Median: 281.756 >>> Avg: 271.609 >>> 90pct: 342.130 >>> Max: 398.573 >>>=20 >>>=20 >>> On 10/07/15 16:19, Alan Jenkins wrote: >>>> I'm glad to hear there's a working version (even if it's not in the = current build :). >>>>=20 >>>> Do you have measurable improvements with overhead configured (v.s. = unconfigured)? >>>>=20 >>>> I've used netperfrunner from CeroWrtScripts, e.g. >>>>=20 >>>> sh netperfrunner.sh -H netperf-eu.bufferbloat.net -p $ISP_ROUTER >>>>=20 >>>> I believe accounting for overhead helps on this two-way test, = because a) it saturates the uplink b) about half that bandwidth is tiny = ack packets (depending on bandwidth asymmetry). And small packets have = proportionally high overhead. >>>>=20 >>>> (But it seems to only make a small difference for me, which always = surprises Seb). >>>>=20 >>>> Alan >>>>=20 >>>> On 10/07/15 15:52, Fred Stratton wrote: >>>>> You are absolutely correct. >>>>>=20 >>>>> I tried both a numeric overhead value, and alternatively = 'pppoe-vcmux' >>>>> and 'ether-fcs' in the build I crafted based on r46006, which is = lupin >>>>> undeclared version 2. Everything works as stated. >>>>>=20 >>>>> On lupin undeclared version 4, the current release based on = r46117, the >>>>> values were not recognised. >>>>>=20 >>>>> Thank you. >>>>>=20 >>>>> I had cake running on a Lantiq ADSL gateway running the same = r46006 >>>>> build. Unfortunately this was bricked by attempts to get homenet >>>>> working, so I have nothing to report about gateway usage at = present. >>>>>=20 >>>>>=20 >>>>>=20 >>>>> On 10/07/15 13:57, Jonathan Morton wrote: >>>>>> You're already using correct syntax - I've written it to be quite >>>>>> lenient and use sensible defaults for missing information. There = are >>>>>> several sets of keywords and parameters which are mutually = orthogonal, >>>>>> and don't depend on each other, so "besteffort" has nothing to do = with >>>>>> "overhead" or "atm". >>>>>>=20 >>>>>> What's probably happening is that you're using a slightly old = version >>>>>> of the cake kernel module which lacks the overhead parameter = entirely, >>>>>> but a more up to date tc which does support it. We've seen this >>>>>> combination crop up ourselves recently. >>>>>>=20 >>>>>> - Jonathan Morton >>>>>>=20 >>> _______________________________________________ >>> Cerowrt-devel mailing list >>> Cerowrt-devel@lists.bufferbloat.net >>> https://lists.bufferbloat.net/listinfo/cerowrt-devel >=20