From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-qc0-x236.google.com (mail-qc0-x236.google.com [IPv6:2607:f8b0:400d:c01::236]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by huchra.bufferbloat.net (Postfix) with ESMTPS id CA4C521F3DC for ; Thu, 5 Mar 2015 11:05:21 -0800 (PST) Received: by qcvx3 with SMTP id x3so16807868qcv.8 for ; Thu, 05 Mar 2015 11:05:20 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=d2dCjxHyJ7nHgPQgiW1JE1ocxXsSyj/KrDbFG2E9+Io=; b=dzatKIQR1mBmHrUE+p0M+dIznRG5dXSIMEWTMr7nUnRzQyIlo0lPP+8thkxWg/Uzmm 3+8QMicbujHNqpayZC3/31UQCKQJUO1lTrbsE15c4nYgkRhR3cclsk5t0fsMB2vClYZC q82cYi5oUI7BG4GM3pV3IZokO8FLWJ5x0OLeq0e/NAoRA0Oj1T2xVALyMKTwKnqTWdfp ymtECzckNS5d76DapVkJ2GINV2sUK5jWzXyp8mb6fo7kBWxX828d4Kqk9Vo9fCGEAlzC 6N76KAoD/F2WJuLgrqI5+3PO+9SeKCugci/0d/Jx8+mafx7ijdwujiCi+ID3jMURHwCX xMoQ== MIME-Version: 1.0 X-Received: by 10.55.22.151 with SMTP id 23mr21649849qkw.29.1425582320329; Thu, 05 Mar 2015 11:05:20 -0800 (PST) Received: by 10.96.197.100 with HTTP; Thu, 5 Mar 2015 11:05:20 -0800 (PST) In-Reply-To: <54F87AF9.5070509@gmail.com> References: <54F877C5.3070300@gmail.com> <54F87AF9.5070509@gmail.com> Date: Thu, 5 Mar 2015 11:05:20 -0800 Message-ID: From: Aaron Wood To: William Katsak Content-Type: multipart/alternative; boundary=001a1147a83ecd36d205108f3fd2 Cc: "cerowrt-devel@lists.bufferbloat.net" Subject: Re: [Cerowrt-devel] Comcast Uplink Buffers X-BeenThere: cerowrt-devel@lists.bufferbloat.net X-Mailman-Version: 2.1.13 Precedence: list List-Id: Development issues regarding the cerowrt test router project List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Mar 2015 19:05:50 -0000 --001a1147a83ecd36d205108f3fd2 Content-Type: text/plain; charset=UTF-8 Bill, I'd recommend setting the bandwidth values low (very low) at first, just to establish that the setup is working correctly. I'm able to get better control of latency at those bitrates on an WNDR3800: http://burntchrome.blogspot.com/2014/05/fixing-bufferbloat-on-comcasts-blast.html I'd start slow, and then start raising the limits until you see issues. But it's possible something else is causing issues. Is your netperf source wired to the Atom? (for bandwidth levels that ruler flat, I normally assume wired. I've seen wifi give odd 30ms jumps in latency, but those normally come with an drop in bandwidth as well). What else is running on the Atom box? -Aaron On Thu, Mar 5, 2015 at 7:49 AM, William Katsak wrote: > Dave, > > Thanks for the reply. I should have made it clearer that I am not running > this on a Netgear 3800, I am running the sqm system on an Atom D510 box at > 1.66 GHz (two cores + hyperthreads) with 2 GB RAM and good Intel NICs. > While running the rrul, the CPU is barely breaking a sweat. > > The OS is Ubuntu server and I've made a nice wrapper to run simple.qos via > the if-pre-up/post-down hooks. > > Can you suggest any tweaks to the settings that would better take > advantage of the extra CPU that I have? > > Thanks, > Bill > > > > > On 03/05/2015 10:43 AM, Dave Taht wrote: > >> well, cerowrt's inbound shaper runs out of cpu at +60mbits. That is >> possibly part of your problem. >> >> the peaks you are seeing are not bad - but to me, probably indicative >> of running out of cpu, which will among other things, drop packets >> burstily. >> >> As comcast has rolled out 100mbit+ service in a ton of places >> (including my home), we really, really, really need to find a way to >> do better rate shaping at higher speeds (or develop a faster policer) >> on some successor hardware. >> >> If you turn off inbound shaping (0 for that parameter) my measurements >> typically show over 600ms of latency on inbound on comcast at 100mbit >> down, but at least, doing the tcp_upload tests, we can hold the upload >> more under control. It is a totally unsatisfactory thing to have >> downloads got so much out of control, it really messes up other >> things, inside of a few seconds, on big downloads, but at this point I >> have to recommend turning off inbound shaping and just living with it. >> >> Very high on my list now is finally writing (or tom sawyering someone >> into writing!) "bobbie - the kinder, gentler policer" in the hope that >> that could actually run faster and better than shaping does on this >> low end hardware. >> >> >> >> On Thu, Mar 5, 2015 at 7:35 AM, William Katsak wrote: >> >>> Hello all, >>> >>> I just moved and had to switch my ISP from Optimum (Cablevision) to >>> Comcast >>> (100/10 link). >>> >>> I am running my own port of simple.qos over to Debian/Ubuntu, and it >>> worked >>> fine on Cablevision (I basically use scripts in if-pre-up.d and >>> if-post-down.d to set the variables set up/tear down simple.qos). >>> >>> However, since I moved over to Comcast, I am seeing something like 600 >>> ms of >>> uplink buffering according to Netlyzer. Also, the Internet browsing >>> "feels" >>> slow when Netflix is in use elsewhere in the apartment (like before I >>> knew >>> anything about bufferbloat). >>> >>> My config looks like this: >>> UPLINK=7500 >>> DOWNLINK=85000 >>> QDISC=fq_codel >>> LLAM="tc_stab" >>> LINKLAYER="none" >>> OVERHEAD=0 >>> STAB_MTU=2047 >>> STAB_MPU=0 >>> STAB_TSIZE=512 >>> AUTOFLOW=0 >>> LIMIT=1001 # sane global default for *LIMIT for fq_codel on a small >>> memory >>> device >>> ILIMIT= >>> ELIMIT= >>> ITARGET="auto" >>> ETARGET="auto" >>> IECN="ECN" >>> EECN="NOECN" >>> SQUASH_DSCP="1" >>> SQUASH_INGRESS="0" >>> IQDISC_OPTS="" >>> EQDISC_OPTS="" >>> TC=`which tc` >>> #TC="sqm_logger tc"# this redirects all tc calls into the log >>> IP=$( which ip ) >>> INSMOD=`which modprobe` >>> TARGET="5ms" >>> IPT_MASK="0xff" >>> IPT_MASK_STRING="/${IPT_MASK}" # for set-mark >>> >>> I've also attached the output of a run of rrul against >>> netperf.bufferbloat.net. >>> >>> Any insight? >>> >>> Thanks, >>> Bill >>> >>> >>> -- >>> **************************************** >>> William Katsak >>> **************************************** >>> >>> _______________________________________________ >>> Cerowrt-devel mailing list >>> Cerowrt-devel@lists.bufferbloat.net >>> https://lists.bufferbloat.net/listinfo/cerowrt-devel >>> >>> >> >> >> > -- > **************************************** > William Katsak > **************************************** > _______________________________________________ > Cerowrt-devel mailing list > Cerowrt-devel@lists.bufferbloat.net > https://lists.bufferbloat.net/listinfo/cerowrt-devel > --001a1147a83ecd36d205108f3fd2 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Bill,

I'd recommend setting the ban= dwidth values low (very low) at first, just to establish that the setup is = working correctly.=C2=A0 I'm able to get better control of latency at t= hose bitrates on an WNDR3800:


I'd start slow, and then start r= aising the limits until you see issues. =C2=A0

But= it's possible something else is causing issues.=C2=A0 Is your netperf = source wired to the Atom? =C2=A0(for bandwidth levels that ruler flat, I no= rmally assume wired.=C2=A0 I've seen wifi give odd 30ms jumps in latenc= y, but those normally come with an drop in bandwidth as well).
What else is running on the Atom box?

-Aaron




On Thu, Mar 5, 2015 at 7:49= AM, William Katsak <wkatsak@gmail.com> wrote:
Dave,

Thanks for the reply. I should have made it clearer that I am not running t= his on a Netgear 3800, I am running the sqm system on an Atom D510 box at 1= .66 GHz (two cores + hyperthreads) with 2 GB RAM and good Intel NICs. While= running the rrul, the CPU is barely breaking a sweat.

The OS is Ubuntu server and I've made a nice wrapper to run simple.qos = via the if-pre-up/post-down hooks.

Can you suggest any tweaks to the settings that would better take advantage= of the extra CPU that I have?

Thanks,
Bill




On 03/05/2015 10:43 AM, Dave Taht wrote:
well, cerowrt's inbound shaper runs out of cpu at +60mbits. That is
possibly part of your problem.

the peaks you are seeing are not bad - but to me, probably indicative
of running out of cpu, which will among other things, drop packets
burstily.

As comcast has rolled out 100mbit+ service in a ton of places
(including my home), we really, really, really need to find a way to
do better rate shaping at higher speeds (or develop a faster policer)
on some successor hardware.

If you turn off inbound shaping (0 for that parameter) my measurements
typically show over 600ms of latency on inbound on comcast at 100mbit
down, but at least, doing the tcp_upload tests, we can hold the upload
more under control. It is a totally unsatisfactory thing to have
downloads got so much out of control, it really messes up other
things, inside of a few seconds, on big downloads, but at this point I
have to recommend turning off inbound shaping and just living with it.

Very high on my list now is finally writing (or tom sawyering someone
into writing!) "bobbie - the kinder, gentler policer" in the hope= that
that could actually run faster and better than shaping does on this
low end hardware.



On Thu, Mar 5, 2015 at 7:35 AM, William Katsak <wkatsak@gmail.com> wrote:
Hello all,

I just moved and had to switch my ISP from Optimum (Cablevision) to Comcast=
(100/10 link).

I am running my own port of simple.qos over to Debian/Ubuntu, and it worked=
fine on Cablevision (I basically use scripts in if-pre-up.d and
if-post-down.d to set the variables set up/tear down simple.qos).

However, since I moved over to Comcast, I am seeing something like 600 ms o= f
uplink buffering according to Netlyzer. Also, the Internet browsing "f= eels"
slow when Netflix is in use elsewhere in the apartment (like before I knew<= br> anything about bufferbloat).

My config looks like this:
UPLINK=3D7500
DOWNLINK=3D85000
QDISC=3Dfq_codel
LLAM=3D"tc_stab"
LINKLAYER=3D"none"
OVERHEAD=3D0
STAB_MTU=3D2047
STAB_MPU=3D0
STAB_TSIZE=3D512
AUTOFLOW=3D0
LIMIT=3D1001=C2=A0 =C2=A0# sane global default for *LIMIT for fq_codel on a= small memory
device
ILIMIT=3D
ELIMIT=3D
ITARGET=3D"auto"
ETARGET=3D"auto"
IECN=3D"ECN"
EECN=3D"NOECN"
SQUASH_DSCP=3D"1"
SQUASH_INGRESS=3D"0"
IQDISC_OPTS=3D""
EQDISC_OPTS=3D""
TC=3D`which tc`
#TC=3D"sqm_logger tc"# this redirects all tc calls into the log IP=3D$( which ip )
INSMOD=3D`which modprobe`
TARGET=3D"5ms"
IPT_MASK=3D"0xff"
IPT_MASK_STRING=3D"/${IPT_MASK}"=C2=A0 =C2=A0 =C2=A0# for set-mar= k

I've also attached the output of a run of rrul against
netperf.buffer= bloat.net.

Any insight?

Thanks,
Bill


--
****************************************
William Katsak <w= katsak@gmail.com>
****************************************

_______________________________________________
Cerowrt-devel mailing list
Ce= rowrt-devel@lists.bufferbloat.net
https://lists.bufferbloat.net/listinfo/cerowrt-devel





--
****************************************
William Katsak <w= katsak@gmail.com>
****************************************
_______________________________________________
Cerowrt-devel mailing list
Ce= rowrt-devel@lists.bufferbloat.net
https://lists.bufferbloat.net/listinfo/cerowrt-devel

--001a1147a83ecd36d205108f3fd2--