From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from out3-smtp.messagingengine.com (out3-smtp.messagingengine.com [66.111.4.27]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by huchra.bufferbloat.net (Postfix) with ESMTPS id AF2F121FEFF for ; Fri, 10 Jul 2015 12:34:04 -0700 (PDT) Received: from compute3.internal (compute3.nyi.internal [10.202.2.43]) by mailout.nyi.internal (Postfix) with ESMTP id 8D100204FD; Fri, 10 Jul 2015 15:34:03 -0400 (EDT) Received: from frontend2 ([10.202.2.161]) by compute3.internal (MEProxy); Fri, 10 Jul 2015 15:34:03 -0400 DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d=imap.cc; h= content-transfer-encoding:content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-sasl-enc :x-sasl-enc; s=mesmtp; bh=deHaa//0Xmx1RuwUlnOQ976mv1w=; b=Gc2Hdd fyn3KR3aXb9637XnB+qbqVMuuavv3euBaPDunXQqAzTrqC0ddSchgUlUAKu1gRD0 JEaFLZrG67g0iv7mh9L1E2RT+JmRydm/xr+XDpS1N3jmLUZVf8DaHuWHGeW6YXwR bAtuZV/OpbpwVGBnEem4MmSdpeXpJWcqcEhI8= DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d= messagingengine.com; h=content-transfer-encoding:content-type :date:from:in-reply-to:message-id:mime-version:references :subject:to:x-sasl-enc:x-sasl-enc; s=smtpout; bh=deHaa//0Xmx1Ruw UlnOQ976mv1w=; b=PWZxmkb4fj/SvqbUbbxI8M6JjOt0ueE+Nshz25yHgybyrvf zGj4O53cC3eyCe6fbsnXuQWZk4jXawEhd8NNb8F5Pp7fapbnuCzjW2+na4AfFNOX 3eEEbXbrnwCS5OPRKMPEh5oQ/MyAHtb0iYFovar+rZs9tCKg53BAzdMscUQA= X-Sasl-enc: g3AOul96KWiQOjwTJAuSFU2ZHPviuNuIeFcTe05EhluQ 1436556843 Received: from [192.168.42.126] (80-44-98-163.dynamic.dsl.as9105.com [80.44.98.163]) by mail.messagingengine.com (Postfix) with ESMTPA id DCF6268013F; Fri, 10 Jul 2015 15:34:02 -0400 (EDT) To: Sebastian Moeller , cerowrt-devel@lists.bufferbloat.net References: <559FA8D4.2030305@imap.cc> <559FDC38.9010400@imap.cc> <559FE294.60801@gmail.com> <55A00E06.3000000@imap.cc> From: Fred Stratton Message-ID: <55A01E2A.4050508@imap.cc> Date: Fri, 10 Jul 2015 20:34:02 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:38.0) Gecko/20100101 Thunderbird/38.0.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit Subject: Re: [Cerowrt-devel] Correct syntax for cake commands and atm issues. X-BeenThere: cerowrt-devel@lists.bufferbloat.net X-Mailman-Version: 2.1.13 Precedence: list List-Id: Development issues regarding the cerowrt test router project List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Jul 2015 19:34:34 -0000 bridge sync is circa 10 000 kbit/s with the cake option in sqm enabled config queue 'eth1' option qdisc_advanced '0' option enabled '1' option interface 'pppoe-wan' option upload '850' option qdisc 'cake' option script 'simple_pppoe.qos' option linklayer 'atm' option overhead '40' option download '8500' tc -s qdisc show dev pppoe-wan qdisc htb 1: root refcnt 2 r2q 10 default 12 direct_packets_stat 0 direct_qlen 3 Sent 101336 bytes 440 pkt (dropped 2, overlimits 66 requeues 0) backlog 0b 0p requeues 0 qdisc cake 110: parent 1:11 unlimited diffserv4 flows raw Sent 4399 bytes 25 pkt (dropped 0, overlimits 0 requeues 0) backlog 0b 0p requeues 0 Class 0 Class 1 Class 2 Class 3 rate 0bit 0bit 0bit 0bit target 5.0ms 5.0ms 5.0ms 5.0ms interval 100.0ms 100.0ms 100.0ms 100.0ms Pk delay 0us 0us 7us 2us Av delay 0us 0us 0us 0us Sp delay 0us 0us 0us 0us pkts 0 0 22 3 way inds 0 0 0 0 way miss 0 0 22 2 way cols 0 0 0 0 bytes 0 0 3392 1007 drops 0 0 0 0 marks 0 0 0 0 qdisc cake 120: parent 1:12 unlimited diffserv4 flows raw Sent 96937 bytes 415 pkt (dropped 2, overlimits 0 requeues 0) backlog 0b 0p requeues 0 Class 0 Class 1 Class 2 Class 3 rate 0bit 0bit 0bit 0bit target 5.0ms 5.0ms 5.0ms 5.0ms interval 100.0ms 100.0ms 100.0ms 100.0ms Pk delay 0us 28.0ms 0us 0us Av delay 0us 1.2ms 0us 0us Sp delay 0us 4us 0us 0us pkts 0 417 0 0 way inds 0 0 0 0 way miss 0 23 0 0 way cols 0 0 0 0 bytes 0 98951 0 0 drops 0 2 0 0 marks 0 0 0 0 qdisc cake 130: parent 1:13 unlimited diffserv4 flows raw Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0) backlog 0b 0p requeues 0 Class 0 Class 1 Class 2 Class 3 rate 0bit 0bit 0bit 0bit target 5.0ms 5.0ms 5.0ms 5.0ms interval 100.0ms 100.0ms 100.0ms 100.0ms Pk delay 0us 0us 0us 0us Av delay 0us 0us 0us 0us Sp delay 0us 0us 0us 0us pkts 0 0 0 0 way inds 0 0 0 0 way miss 0 0 0 0 way cols 0 0 0 0 bytes 0 0 0 0 drops 0 0 0 0 marks 0 0 0 0 qdisc cake 140: parent 1:14 unlimited diffserv4 flows raw Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0) backlog 0b 0p requeues 0 Class 0 Class 1 Class 2 Class 3 rate 0bit 0bit 0bit 0bit target 5.0ms 5.0ms 5.0ms 5.0ms interval 100.0ms 100.0ms 100.0ms 100.0ms Pk delay 0us 0us 0us 0us Av delay 0us 0us 0us 0us Sp delay 0us 0us 0us 0us pkts 0 0 0 0 way inds 0 0 0 0 way miss 0 0 0 0 way cols 0 0 0 0 bytes 0 0 0 0 drops 0 0 0 0 marks 0 0 0 0 qdisc ingress ffff: parent ffff:fff1 ---------------- Sent 273341 bytes 435 pkt (dropped 0, overlimits 0 requeues 0) backlog 0b 0p requeues 0 On 10/07/15 19:46, Sebastian Moeller wrote: > Hi Fred, > > your results seem to indicate that cake is not active at all, as the latency under load is abysmal (a quick check is to look at the median in relation to the min and the 90% number, in your examples all of these are terrible). Could you please post the result of the following commands on your router: > 1) cat /etc/config/sqm > 2) tc -d qdisc > 3) tc -d class show dev pppoe-wan > 4) tc -d class show dev ifb4pppoe-wqn > 5) /etc/init.d/sqm stop > 6) /etc/init.d/sqm start > > hopefully these give some insight what might have happened. > > And finally I would love to learn the output of: > sh betterspeedtest.sh -4 -H netperf-eu.bufferbloat.net -t 150 -p netperf-eu.bufferbloat.net -n 4 ; sh netperfrunner.sh -4 -H netperf-eu.bufferbloat.net -t 150 -p netperf-eu.bufferbloat.net -n 4 > > > Many Thanks & Best Regards > Sebastian > > On Jul 10, 2015, at 20:25 , Fred Stratton wrote: > >> By your command >> Rebooted to rerun qdisc script, rather than changing qdiscs from the command-line, so suboptimal process as end-point changed. >> >> script configuring qdiscs and overhead 40 on >> >> sh netperfrunner.sh -H netperf-eu.bufferbloat.net -p 2.96.48.1 >> 2015-07-10 18:22:08 Testing netperf-eu.bufferbloat.net (ipv4) with 4 streams down and up while pinging 2.96.48.1. Takes about 60 seconds. >> Download: 6.73 Mbps >> Upload: 0.58 Mbps >> Latency: (in msec, 62 pings, 0.00% packet loss) >> Min: 24.094 >> 10pct: 172.654 >> Median: 260.563 >> Avg: 253.580 >> 90pct: 330.003 >> Max: 411.145 >> >> script configuring qdiscs on flows raw >> >> sh netperfrunner.sh -H netperf-eu.bufferbloat.net -p >> 78.145.32.1 >> 2015-07-10 18:49:21 Testing netperf-eu.bufferbloat.net (ipv4) with 4 streams down and up while pinging 78.145.32.1. Takes about 60 seconds. >> Download: 6.75 Mbps >> Upload: 0.59 Mbps >> Latency: (in msec, 59 pings, 0.00% packet loss) >> Min: 23.605 >> 10pct: 169.789 >> Median: 282.155 >> Avg: 267.099 >> 90pct: 333.283 >> Max: 376.509 >> >> script configuring qdiscs and overhead 36 on >> >> sh netperfrunner.sh -H netperf-eu.bufferbloat.net -p >> 80.44.96.1 >> 2015-07-10 19:20:18 Testing netperf-eu.bufferbloat.net (ipv4) with 4 streams down and up while pinging 80.44.96.1. Takes about 60 seconds. >> Download: 6.56 Mbps >> Upload: 0.59 Mbps >> Latency: (in msec, 62 pings, 0.00% packet loss) >> Min: 22.975 >> 10pct: 195.473 >> Median: 281.756 >> Avg: 271.609 >> 90pct: 342.130 >> Max: 398.573 >> >> >> On 10/07/15 16:19, Alan Jenkins wrote: >>> I'm glad to hear there's a working version (even if it's not in the current build :). >>> >>> Do you have measurable improvements with overhead configured (v.s. unconfigured)? >>> >>> I've used netperfrunner from CeroWrtScripts, e.g. >>> >>> sh netperfrunner.sh -H netperf-eu.bufferbloat.net -p $ISP_ROUTER >>> >>> I believe accounting for overhead helps on this two-way test, because a) it saturates the uplink b) about half that bandwidth is tiny ack packets (depending on bandwidth asymmetry). And small packets have proportionally high overhead. >>> >>> (But it seems to only make a small difference for me, which always surprises Seb). >>> >>> Alan >>> >>> On 10/07/15 15:52, Fred Stratton wrote: >>>> You are absolutely correct. >>>> >>>> I tried both a numeric overhead value, and alternatively 'pppoe-vcmux' >>>> and 'ether-fcs' in the build I crafted based on r46006, which is lupin >>>> undeclared version 2. Everything works as stated. >>>> >>>> On lupin undeclared version 4, the current release based on r46117, the >>>> values were not recognised. >>>> >>>> Thank you. >>>> >>>> I had cake running on a Lantiq ADSL gateway running the same r46006 >>>> build. Unfortunately this was bricked by attempts to get homenet >>>> working, so I have nothing to report about gateway usage at present. >>>> >>>> >>>> >>>> On 10/07/15 13:57, Jonathan Morton wrote: >>>>> You're already using correct syntax - I've written it to be quite >>>>> lenient and use sensible defaults for missing information. There are >>>>> several sets of keywords and parameters which are mutually orthogonal, >>>>> and don't depend on each other, so "besteffort" has nothing to do with >>>>> "overhead" or "atm". >>>>> >>>>> What's probably happening is that you're using a slightly old version >>>>> of the cake kernel module which lacks the overhead parameter entirely, >>>>> but a more up to date tc which does support it. We've seen this >>>>> combination crop up ourselves recently. >>>>> >>>>> - Jonathan Morton >>>>> >> _______________________________________________ >> Cerowrt-devel mailing list >> Cerowrt-devel@lists.bufferbloat.net >> https://lists.bufferbloat.net/listinfo/cerowrt-devel