From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-ob0-x232.google.com (mail-ob0-x232.google.com [IPv6:2607:f8b0:4003:c01::232]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by huchra.bufferbloat.net (Postfix) with ESMTPS id 52D9721F2E2 for ; Thu, 5 Mar 2015 11:14:56 -0800 (PST) Received: by obcvb8 with SMTP id vb8so11993488obc.10 for ; Thu, 05 Mar 2015 11:14:56 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; bh=nvQmzL4mBJ20Wb1OlJaLF4Ob4QWLrvd4Gz6HuljoQvg=; b=v+txVQ2uODzeUH5OO2ADvxN+BZR9KAfOQiB8N+0ieq5EJvjuBq98m5aa4210WJkmLr 9HNLQJPWipsQ3PFp1e3L0eI2WgsTQD7Swx8MDaWGWU8RFRnh1rcYaYdhDyvSCgtiIJ10 EC69KialQRy/59xzmC7DmRt9/BSt+3nPUCaULGVtwSPhoxkUPIsGE2oTiEZqJgZuDhs1 XfqYujx9p1cOh+0XmDwOkXaOaIOdZ2Jbj+NcInG10uwMAovCLAa1u8LXXPWfrSXME4GP WPyNB6I4ZTqq+z4fmJE7IT5RhkeRBtZBz5euUYTxAVNjHP7nZVeuprDxHzUQvAkTgkJ1 0fHQ== MIME-Version: 1.0 X-Received: by 10.182.144.136 with SMTP id sm8mr8045650obb.63.1425582896126; Thu, 05 Mar 2015 11:14:56 -0800 (PST) Received: by 10.202.51.66 with HTTP; Thu, 5 Mar 2015 11:14:56 -0800 (PST) In-Reply-To: References: <54F877C5.3070300@gmail.com> <54F87AF9.5070509@gmail.com> Date: Thu, 5 Mar 2015 11:14:56 -0800 Message-ID: From: Dave Taht To: Aaron Wood Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Cc: "cerowrt-devel@lists.bufferbloat.net" Subject: Re: [Cerowrt-devel] Comcast Uplink Buffers X-BeenThere: cerowrt-devel@lists.bufferbloat.net X-Mailman-Version: 2.1.13 Precedence: list List-Id: Development issues regarding the cerowrt test router project List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Mar 2015 19:15:25 -0000 kill offloads. On Thu, Mar 5, 2015 at 11:05 AM, Aaron Wood wrote: > Bill, > > I'd recommend setting the bandwidth values low (very low) at first, just = to > establish that the setup is working correctly. I'm able to get better > control of latency at those bitrates on an WNDR3800: > > http://burntchrome.blogspot.com/2014/05/fixing-bufferbloat-on-comcasts-bl= ast.html > > I'd start slow, and then start raising the limits until you see issues. > > But it's possible something else is causing issues. Is your netperf sour= ce > wired to the Atom? (for bandwidth levels that ruler flat, I normally ass= ume > wired. I've seen wifi give odd 30ms jumps in latency, but those normally > come with an drop in bandwidth as well). > > What else is running on the Atom box? > > -Aaron > > > > > On Thu, Mar 5, 2015 at 7:49 AM, William Katsak wrote: >> >> Dave, >> >> Thanks for the reply. I should have made it clearer that I am not runnin= g >> this on a Netgear 3800, I am running the sqm system on an Atom D510 box = at >> 1.66 GHz (two cores + hyperthreads) with 2 GB RAM and good Intel NICs. W= hile >> running the rrul, the CPU is barely breaking a sweat. >> >> The OS is Ubuntu server and I've made a nice wrapper to run simple.qos v= ia >> the if-pre-up/post-down hooks. >> >> Can you suggest any tweaks to the settings that would better take >> advantage of the extra CPU that I have? >> >> Thanks, >> Bill >> >> >> >> >> On 03/05/2015 10:43 AM, Dave Taht wrote: >>> >>> well, cerowrt's inbound shaper runs out of cpu at +60mbits. That is >>> possibly part of your problem. >>> >>> the peaks you are seeing are not bad - but to me, probably indicative >>> of running out of cpu, which will among other things, drop packets >>> burstily. >>> >>> As comcast has rolled out 100mbit+ service in a ton of places >>> (including my home), we really, really, really need to find a way to >>> do better rate shaping at higher speeds (or develop a faster policer) >>> on some successor hardware. >>> >>> If you turn off inbound shaping (0 for that parameter) my measurements >>> typically show over 600ms of latency on inbound on comcast at 100mbit >>> down, but at least, doing the tcp_upload tests, we can hold the upload >>> more under control. It is a totally unsatisfactory thing to have >>> downloads got so much out of control, it really messes up other >>> things, inside of a few seconds, on big downloads, but at this point I >>> have to recommend turning off inbound shaping and just living with it. >>> >>> Very high on my list now is finally writing (or tom sawyering someone >>> into writing!) "bobbie - the kinder, gentler policer" in the hope that >>> that could actually run faster and better than shaping does on this >>> low end hardware. >>> >>> >>> >>> On Thu, Mar 5, 2015 at 7:35 AM, William Katsak wrot= e: >>>> >>>> Hello all, >>>> >>>> I just moved and had to switch my ISP from Optimum (Cablevision) to >>>> Comcast >>>> (100/10 link). >>>> >>>> I am running my own port of simple.qos over to Debian/Ubuntu, and it >>>> worked >>>> fine on Cablevision (I basically use scripts in if-pre-up.d and >>>> if-post-down.d to set the variables set up/tear down simple.qos). >>>> >>>> However, since I moved over to Comcast, I am seeing something like 600 >>>> ms of >>>> uplink buffering according to Netlyzer. Also, the Internet browsing >>>> "feels" >>>> slow when Netflix is in use elsewhere in the apartment (like before I >>>> knew >>>> anything about bufferbloat). >>>> >>>> My config looks like this: >>>> UPLINK=3D7500 >>>> DOWNLINK=3D85000 >>>> QDISC=3Dfq_codel >>>> LLAM=3D"tc_stab" >>>> LINKLAYER=3D"none" >>>> OVERHEAD=3D0 >>>> STAB_MTU=3D2047 >>>> STAB_MPU=3D0 >>>> STAB_TSIZE=3D512 >>>> AUTOFLOW=3D0 >>>> LIMIT=3D1001 # sane global default for *LIMIT for fq_codel on a smal= l >>>> memory >>>> device >>>> ILIMIT=3D >>>> ELIMIT=3D >>>> ITARGET=3D"auto" >>>> ETARGET=3D"auto" >>>> IECN=3D"ECN" >>>> EECN=3D"NOECN" >>>> SQUASH_DSCP=3D"1" >>>> SQUASH_INGRESS=3D"0" >>>> IQDISC_OPTS=3D"" >>>> EQDISC_OPTS=3D"" >>>> TC=3D`which tc` >>>> #TC=3D"sqm_logger tc"# this redirects all tc calls into the log >>>> IP=3D$( which ip ) >>>> INSMOD=3D`which modprobe` >>>> TARGET=3D"5ms" >>>> IPT_MASK=3D"0xff" >>>> IPT_MASK_STRING=3D"/${IPT_MASK}" # for set-mark >>>> >>>> I've also attached the output of a run of rrul against >>>> netperf.bufferbloat.net. >>>> >>>> Any insight? >>>> >>>> Thanks, >>>> Bill >>>> >>>> >>>> -- >>>> **************************************** >>>> William Katsak >>>> **************************************** >>>> >>>> _______________________________________________ >>>> Cerowrt-devel mailing list >>>> Cerowrt-devel@lists.bufferbloat.net >>>> https://lists.bufferbloat.net/listinfo/cerowrt-devel >>>> >>> >>> >>> >> >> -- >> **************************************** >> William Katsak >> **************************************** >> _______________________________________________ >> Cerowrt-devel mailing list >> Cerowrt-devel@lists.bufferbloat.net >> https://lists.bufferbloat.net/listinfo/cerowrt-devel > > --=20 Dave T=C3=A4ht Let's make wifi fast, less jittery and reliable again! https://plus.google.com/u/0/107942175615993706558/posts/TVX3o84jjmb