From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-qa0-x236.google.com (mail-qa0-x236.google.com [IPv6:2607:f8b0:400d:c00::236]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by huchra.bufferbloat.net (Postfix) with ESMTPS id AEA9D21F5A4; Fri, 25 Jul 2014 05:09:40 -0700 (PDT) Received: by mail-qa0-f54.google.com with SMTP id k15so4503145qaq.27 for ; Fri, 25 Jul 2014 05:09:39 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=content-type:mime-version:subject:from:in-reply-to:date:cc :message-id:references:to; bh=9nLoN1ANoTrZ8r0NjWhAtuMcPKLmbSuFwZ8969H7Mp4=; b=S5d14lG28KqhKJdvciceg2OPJOORfz1yV0nM4qu1KU+/XbAKdEQf/AXH9zfoytHrbE 20MeWqyPOl2hHWqYostX1BmmPaA38uxcKM7RhJVXf26V6zjrOS4+hReBcdQeoWeTz+Am ogcpC/O/DCf5BUeUyV7VKxbC+BsqF/KB2ePkVT8KW6Qn5lXmj/yEaFktPcZqTHD0lbli yLQvsxdpZozCs0CNJ4QM1idOgmYE+D5H67m5GIwTdIAPUXrNQvLjibah2TWe153n8ZE7 7FiHNxdeLZmFtFWTZRh+Rq6BGg0YOtiGvPGaMT+rPk7AwTPuR5J2G9KI1LOXEYCbnD/h +dKg== X-Received: by 10.224.11.130 with SMTP id t2mr26311193qat.101.1406290179374; Fri, 25 Jul 2014 05:09:39 -0700 (PDT) Received: from richs-mbp-5319.home.lan (pool-72-95-118-52.phlapa.east.myfairpoint.net. [72.95.118.52]) by mx.google.com with ESMTPSA id l69sm11118758qgd.17.2014.07.25.05.09.38 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Fri, 25 Jul 2014 05:09:38 -0700 (PDT) Content-Type: multipart/signed; boundary="Apple-Mail=_00E1B351-F0C1-4409-9DAE-E8123067AF31"; protocol="application/pgp-signature"; micalg=pgp-sha512 Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\)) From: Rich Brown In-Reply-To: <03292B76-5273-4912-BB18-90E95C16A9F5@pnsol.com> Date: Fri, 25 Jul 2014 08:09:31 -0400 Message-Id: References: <03292B76-5273-4912-BB18-90E95C16A9F5@pnsol.com> To: Neil Davies X-Mailer: Apple Mail (2.1878.6) Cc: cerowrt-devel , bloat Subject: Re: [Cerowrt-devel] [Bloat] Check out www.speedof.me - no Flash X-BeenThere: cerowrt-devel@lists.bufferbloat.net X-Mailman-Version: 2.1.13 Precedence: list List-Id: Development issues regarding the cerowrt test router project List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 25 Jul 2014 12:09:41 -0000 --Apple-Mail=_00E1B351-F0C1-4409-9DAE-E8123067AF31 Content-Type: multipart/alternative; boundary="Apple-Mail=_88978180-1720-4ACA-B6FF-A32B7B1427AF" --Apple-Mail=_88978180-1720-4ACA-B6FF-A32B7B1427AF Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=windows-1252 Neil, Thanks for the note and the observations. My thoughts: 1) I note that speedof.me does seem to overstate the speed results. At = my home, it reports 5.98mbps down, and 638kbps up, while = betterspeedtest.sh shows 5.49/0.61 mbps. (speedtest.net gives numbers = similar to the betterspeedtest.net script.) 2) I think we're in agreement about the peak upload rate that you point = out is too high. Their measurement code runs in the browser. It seems = likely that the browser pumps out a few big packets before getting flow = control information, thus giving the impression that they can send at a = higher rate. This comports with the obvious decay that ramps toward the = long-term rate.=20 3) But that long-term speed should be at or below the theoretical = long-term rate, not above it.=20 Two experiments for you to try: a) What does betterspeedtest.sh show? (It's in the latest CeroWrt, in = /usr/lib/CeroWrtScripts, or get it from github: = https://github.com/richb-hanover/CeroWrtScripts ) b) What does www.speedtest.net show? I will add your question (about the inaccuracy) to the note that I want = to send out to speedof.me this weekend. I will also ask that they = include min/max latency measurements to their test, and an option to = send for > 10 seconds to minimize any effect of PowerBoost... Best regards, Rich On Jul 25, 2014, at 5:10 AM, Neil Davies wrote: > Rich >=20 > You may want to check how accurate they are to start. >=20 > I just ran a =93speed test=94 on my line (which I have complete = control and visibility over the various network elements) and it reports = an average =93speed=94 (in the up direction) that is in excess of the = capacity of the line, it reports the maximum rate at nearly twice the = best possible rate of the ADSL connection. >=20 > Doesn=92t matter how pretty it is, if its not accurate it is of no = use. This is rather ironic as the web site claims it is the =93smartest = and most accurate=94! >=20 > Neil >=20 > >=20 > PS pretty clear to me what mistake they=92ve made in the measurement = process - its to do with incorrect inference and hence missing the = buffering effects. >=20 > On 20 Jul 2014, at 14:19, Rich Brown wrote: >=20 >> Doc Searls = (http://blogs.law.harvard.edu/doc/2014/07/20/the-cliff-peronal-clouds-need= -to-climb/) mentioned in passing that he uses a new speed test website. = I checked it out, and it was very cool=85 >>=20 >> www.speedof.me is an all-HTML5 website that seems to make accurate = measurements of the up and download speeds of your internet connection. = It=92s also very attractive, and the real-time plots of the speed show = interesting info. (screen shot at: http://richb-hanover.com/speedof-me/) >>=20 >> Now if we could get them to a) allow longer/bigger tests to = circumvent PowerBoost, and b) include a latency measurement so people = could point out their bufferbloated equipment.=20 >>=20 >> I'm going to send them a note. Anything else I should add? >>=20 >> Rich >> _______________________________________________ >> Bloat mailing list >> Bloat@lists.bufferbloat.net >> https://lists.bufferbloat.net/listinfo/bloat >=20 --Apple-Mail=_88978180-1720-4ACA-B6FF-A32B7B1427AF Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=windows-1252 Neil,

Thanks for the note and the = observations. My thoughts:

1) I note that speedof.me does seem to overstate the = speed results. At my home, it reports 5.98mbps down, and 638kbps up, = while betterspeedtest.sh shows 5.49/0.61 mbps. (speedtest.net gives numbers similar to = the betterspeedtest.net = script.)

2) I think we're in agreement about = the peak upload rate that you point out is too high. Their measurement = code runs in the browser. It seems likely that the browser pumps out a = few big packets before getting flow control information, thus giving the = impression that they can send at a higher rate. This comports with the = obvious decay that ramps toward the long-term = rate. 

3) But that long-term speed should = be at or below the theoretical long-term rate, not above = it. 

Two experiments for you to = try:

a) What does betterspeedtest.sh show? = (It's in the latest CeroWrt, in /usr/lib/CeroWrtScripts, or get it from = github: https://github.co= m/richb-hanover/CeroWrtScripts )

b) = What does www.speedtest.net = show?

I will add your question (about the = inaccuracy) to the note that I want to send out to speedof.me this weekend. I will also ask = that they include min/max latency measurements to their test, and an = option to send for > 10 seconds to minimize any effect of = PowerBoost...

Best = regards,

Rich


=

On Jul 25, 2014, at 5:10 AM, Neil Davies <neil.davies@pnsol.com> = wrote:

Rich

You may want to check how = accurate they are to start.

I just ran a =93speed= test=94 on my line (which I have complete control and visibility over = the various network elements) and it reports an average =93speed=94 (in = the up direction) that is in excess of the capacity of the line, it = reports the maximum rate at nearly twice the best possible rate of the = ADSL connection.

Doesn=92t matter how pretty it = is, if its not accurate it is of no use. This is rather ironic as the = web site claims it is the =93smartest and most = accurate=94!

Neil

= <speedof_me_14-07-25.png>

PS = pretty clear to me what mistake they=92ve made in the measurement = process - its to do with incorrect inference and hence missing the = buffering effects.

On 20 Jul 2014, at = 14:19, Rich Brown <richb.hanover@gmail.com> = wrote:

Doc Searls (http://blogs.law.harvard.edu/doc/2014/07/20/the-cliff-p= eronal-clouds-need-to-climb/) mentioned in passing that he uses a = new speed test website. I checked it out, and it was very = cool=85

www.speedof.me is = an all-HTML5 website that seems to make accurate measurements of the up = and download speeds of your internet connection. It=92s also very = attractive, and the real-time plots of the speed show interesting info. = (screen shot at: http://richb-hanover.com/spe= edof-me/)

Now if we could get them to a) allow longer/bigger = tests to circumvent PowerBoost, and b) include a latency measurement so = people could point out their bufferbloated equipment.

I'm going = to send them a note. Anything else I should = add?

Rich
_______________________________________________
Blo= at mailing list
Bloat@lists.bufferbloat.net
https://lists.buffer= bloat.net/listinfo/bloat


= --Apple-Mail=_88978180-1720-4ACA-B6FF-A32B7B1427AF-- --Apple-Mail=_00E1B351-F0C1-4409-9DAE-E8123067AF31 Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- Comment: GPGTools - https://gpgtools.org iQEcBAEBCgAGBQJT0kkAAAoJEH4agC/0z73/Fh0IAKTutWb5eO+d18KTFvuq9Eth 1JcsSzHda+gQmyDwCVhmQMzw7NhsU3wTSeW3Cx8lCuVXwyeisbIlF5Ywo37FLTVz ZdyNcULssPKeuOkxq+8pnBs3MgvcW3YfMKJNtRMwJJwk4x8EUwGoL2yc60fRLPyp MXRqU6PII2aDxX9A5R4zZ7g2kCrTB/tNRHCg7ypm9VNEWGfvQbgjY2Xp9Q4XeTC/ xr3Yyf+h6pOSO4P/P6xsEHDPSlJ/aoH7AgSrDVTNrYUemJKeM+dIp+ONKKthr7Ic 5kuCaP3m60JjDYALxpeKK8zB3oABr97Wv3f4qhURKlFBScYLNu4nu0QTHqRuPBk= =85x/ -----END PGP SIGNATURE----- --Apple-Mail=_00E1B351-F0C1-4409-9DAE-E8123067AF31--