General list for discussing Bufferbloat
 help / color / mirror / Atom feed
From: jb <justin@dslr.net>
To: bloat@lists.bufferbloat.net
Subject: Re: [Bloat] DSLReports Speed Test has latency measurement built-in
Date: Mon, 20 Apr 2015 09:21:59 +1000	[thread overview]
Message-ID: <CAH3Ss95e1wa23i-eU86bnVJbxGaOFBUso+WU+sn5G5HmatdzPw@mail.gmail.com> (raw)
In-Reply-To: <CCE3C03D-5760-4E88-BE52-45DD43A76F63@gmail.com>

[-- Attachment #1: Type: text/plain, Size: 5699 bytes --]

I just woke up.
I'm sure there are some questions missed however I'll just put some info in
here and the plans. If I missed something please reply direct or to the
list?

1, the latency is done with web socket pings, they are light weight. They
are done to dslreports.com not to any of the participating servers in a
speed test. I could change this to pick a participating server but unless
there is a really good reason to, it is easier to worry about one web
socket server rather than 21+ of them.

2. The test does not do latency pinging on 3G and GPRS
because of a concern I had that with slower lines (a lot of 3G results are
less than half a megabit) the pings would make the speed measured
unreliable. And/or, a slow android phone would be being asked to do too
much. I'll do some tests with and without pinging on a 56kbit shaped line
and see if there is a difference. If there is not, I can enable it.

3. The graph of latency post-test is log X-axis at the moment
because one spike can render the whole graph almost useless with axis
scaling. What I might do is X-Axis breaking, and see if that looks ok.
Alternatively, a two panel graph, one with 0-200ms axis, the other in full
perspective. Or just live with the spike. Or scale to the 95% highest
number and let the other 5% crop. There are tool-tips after all to show the
actual numbers.

4. The selection of speed test locations to use
I have been spending most time getting it right for USA users, and all
servers are mine, not donated ISP servers, so we're only at an early stage
for a testing network. Even so I think having a sever in your city, or ISP,
is no longer as critical as it would be with a single TCP stream. But if
you're on fiber and not in USA then it might take a bit longer before this
is solved. And I'm betting in some cases some ISPs will just not have every
inbound route capable of driving their fastest products to maximum, so
locations may have to be probed by speed, not latency...

5. Displaying latencies while the test is running
could be as simple as displaying some numbers. e.g., 95% confidence and
peak, in three categories: idle, up and down. Or it could be a calculation
showing number of packets in in flight (determined by current speed vs
current latency). Or it could be a bunch of small coloured boxes that light
up in a grid, indicating a queue, one per 1500 byte packet. Or it could be
a color-coded gauge that goes to yellow and red as the bandwidth delay
product rises. Probably there is a simple way to start, and a better way to
do it after some consideration.

6. The congestion window, re-transmits, and bandwidth per stream tables are
very early stage.
I don't think I'll be showing a giant table for too much longer. Instead
the numbers have to be summarised by location and only shown with another
click. Typically if an ISP has a great connection to location X and a poor
one to location Y, then all streams from X show high bandwidth, low RTT,
low RTT variability and appropriate congestion window. Whereas all streams
from Y show high re-transmits, high RTT and big congestion window and/or
slow speeds. The difference between these stats for a google fiber user in
Kansas city. and a poorer quality ISP is startling to say the least.
I also need to do something with PMTU/MSS and TCP option information for
cases where there is weird stuff there. Finally, on the server, tcptrace
can be run and report back much more detailed statistics but if you've used
tcptrace you know there is a huge amount of data, including xplot files,
that just one transfer will generate. But if necessary we can go there.
I try to keep in mind that 99.9% of the people using the tests just want an
upload and download number, and perhaps a statement that says compared to
their peers, things are great. Everything else provokes confusion.

that's all I can think of right now..

On Mon, Apr 20, 2015 at 7:57 AM, Rich Brown <richb.hanover@gmail.com> wrote:

> Hi folks,
>
> A couple comments re: the DSLReports Speed Test.
>
> 1) It's just becoming daylight for Justin, so he hasn't had a chance to
> respond to all these notes. :-)
>
> 2) In a private note earlier this week, he mentioned that he uses
> "websocket pings" which he believes are pretty speedy/low latency.
>
> 3) He does have plans to incorporate stats from the server end's TCP stack
> (cwnd, packet loss, retransmissions, etc.) in a future version of the speed
> test. I imagine it would help him to know what you'd like to see...
>
> Best,
>
> Rich
>
> On Apr 19, 2015, at 1:15 PM, Mikael Abrahamsson <swmike@swm.pp.se> wrote:
>
> > On Sun, 19 Apr 2015, Toke Høiland-Jørgensen wrote:
> >
> >> The upload latency figures are definitely iffy, but the download ones
> seem to match roughly what I've measured myself on this link.
> >
> > Also, I don't trust parallel latency measures done by for instance ICMP
> ping. Yes, they indicate something, but what?
> >
> > We need insight into the TCP stack. So how can an application like
> dslresports that runs in a browser, get meaningful performance metrics on
> its measurement TCP-sessions from the OS TCP stack? This is a multi-layer
> problem and I don't see any meaningful progress in this area...
> >
> > --
> > Mikael Abrahamsson    email:
> swmike@swm.pp.se_______________________________________________
> > Bloat mailing list
> > Bloat@lists.bufferbloat.net
> > https://lists.bufferbloat.net/listinfo/bloat
>
> _______________________________________________
> Bloat mailing list
> Bloat@lists.bufferbloat.net
> https://lists.bufferbloat.net/listinfo/bloat
>

[-- Attachment #2: Type: text/html, Size: 6751 bytes --]

  reply	other threads:[~2015-04-19 23:22 UTC|newest]

Thread overview: 170+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2015-04-19 12:56 jb
2015-04-19 13:10 ` Toke Høiland-Jørgensen
2015-04-19 13:53   ` jb
2015-04-19 15:38     ` Toke Høiland-Jørgensen
2015-04-19 16:38       ` Toke Høiland-Jørgensen
2015-04-19 17:15         ` Mikael Abrahamsson
2015-04-19 17:43           ` Dave Taht
2015-04-19 19:22             ` Dave Taht
2015-04-23 17:03               ` Dave Taht
2015-04-23 18:04                 ` Mikael Abrahamsson
2015-04-23 18:08                   ` Jonathan Morton
2015-04-23 20:19                   ` jb
2015-04-23 20:39                     ` Dave Taht
2015-04-24 21:45                     ` Rich Brown
2015-04-25  1:14                       ` jb
2015-04-23 21:44                   ` Rich Brown
2015-04-23 22:22                     ` Dave Taht
2015-04-23 22:29                       ` Dave Taht
2015-04-24  1:58                       ` Rich Brown
2015-04-24  2:40                         ` Dave Taht
2015-04-24  3:20                           ` Jim Gettys
2015-04-24  3:39                             ` Dave Taht
2015-04-24  4:04                               ` Dave Taht
2015-04-24  4:17                                 ` Dave Taht
2015-04-24 16:13                                   ` Rick Jones
2015-04-24  5:00                                 ` jb
2015-04-27 16:28                                   ` Dave Taht
2015-04-24 16:09                               ` Rick Jones
2015-04-24 13:49                         ` Pedro Tumusok
2015-04-23 22:51                     ` David Lang
2015-04-24  1:38                       ` Rich Brown
2015-04-24  4:16                   ` Mikael Abrahamsson
2015-04-24  4:24                     ` Dave Taht
2015-04-19 17:45           ` Toke Høiland-Jørgensen
2015-04-19 18:26             ` Jonathan Morton
2015-04-19 18:30               ` Toke Høiland-Jørgensen
2015-04-19 19:15                 ` Jonathan Morton
2015-04-20  3:15                 ` Aaron Wood
2015-04-20  7:00                   ` jb
     [not found]                     ` <CACQiMXbF9Uk3H=81at-Z9a2fdYKrRtRorSXRg5dBcPB8-aR4Cw@mail.gmail.com>
2015-04-20  8:11                       ` jb
2015-04-19 19:19             ` Mikael Abrahamsson
2015-04-19 21:57           ` Rich Brown
2015-04-19 23:21             ` jb [this message]
2015-04-20 14:51               ` David Lang
2015-04-20 15:51                 ` Dave Taht
2015-04-20 16:15                   ` Dave Taht
  -- strict thread matches above, loose matches on Subject: below --
2015-04-19  5:26 jb
2015-04-19  7:36 ` David Lang
2015-04-19  7:48   ` David Lang
2015-04-19  9:33   ` jb
2015-04-19 10:45     ` David Lang
2015-04-19  8:28 ` Alex Burr
2015-04-19 10:20 ` Sebastian Moeller
2015-04-19 10:46   ` Jonathan Morton
2015-04-19 16:30     ` Sebastian Moeller
2015-04-19 17:41       ` Jonathan Morton
2015-04-19 19:40         ` Sebastian Moeller
2015-04-19 20:53           ` Jonathan Morton
2015-04-21  2:56             ` Simon Barber
2015-04-21  4:15               ` jb
2015-04-21  4:47                 ` David Lang
2015-04-21  7:35                   ` jb
2015-04-21  9:14                     ` Steinar H. Gunderson
2015-04-21 14:20                     ` David Lang
2015-04-21 14:25                       ` David Lang
2015-04-21 14:28                         ` David Lang
2015-04-21 22:13                           ` jb
2015-04-21 22:39                             ` Aaron Wood
2015-04-21 23:17                             ` jb
2015-04-22  2:14                               ` Simon Barber
2015-04-22  2:56                                 ` jb
2015-04-22 14:32                       ` Simon Barber
2015-04-22 17:35                         ` David Lang
2015-04-23  1:37                           ` Simon Barber
2015-04-24 16:54                             ` David Lang
2015-04-24 17:00                               ` Rick Jones
2015-04-21  9:37                 ` Jonathan Morton
2015-04-21 10:35                   ` jb
2015-04-22  4:04                     ` Steinar H. Gunderson
2015-04-22  4:28                       ` Eric Dumazet
2015-04-22  8:51                         ` [Bloat] RE : " luca.muscariello
2015-04-22 13:50                           ` [Bloat] " Eric Dumazet
2015-04-22 14:09                             ` Steinar H. Gunderson
2015-04-22 15:26                             ` [Bloat] RE : " luca.muscariello
2015-04-22 15:44                               ` [Bloat] " Eric Dumazet
2015-04-22 16:35                                 ` MUSCARIELLO Luca IMT/OLN
2015-04-22 17:16                                   ` Eric Dumazet
2015-04-22 17:24                                     ` Steinar H. Gunderson
2015-04-22 17:28                                     ` MUSCARIELLO Luca IMT/OLN
2015-04-22 17:45                                       ` MUSCARIELLO Luca IMT/OLN
2015-04-23  5:27                                         ` MUSCARIELLO Luca IMT/OLN
2015-04-23  6:48                                           ` Eric Dumazet
     [not found]                                             ` <CAH3Ss96VwE_fWNMOMOY4AgaEnVFtCP3rPDHSudOcHxckSDNMqQ@mail.gmail.com>
2015-04-23 10:08                                               ` jb
2015-04-24  8:18                                                 ` Sebastian Moeller
2015-04-24  8:29                                                   ` Toke Høiland-Jørgensen
2015-04-24  8:55                                                     ` Sebastian Moeller
2015-04-24  9:02                                                       ` Toke Høiland-Jørgensen
2015-04-24 13:32                                                         ` jb
2015-04-24 13:58                                                           ` Toke Høiland-Jørgensen
2015-04-24 16:51                                                           ` David Lang
2015-04-25  3:15                                                       ` Simon Barber
2015-04-25  4:04                                                         ` Dave Taht
2015-04-25  4:26                                                           ` Simon Barber
2015-04-25  6:03                                                             ` Sebastian Moeller
2015-04-27 16:39                                                               ` Dave Taht
2015-04-28  7:18                                                                 ` Sebastian Moeller
2015-04-28  8:01                                                                   ` David Lang
2015-04-28  8:19                                                                     ` Toke Høiland-Jørgensen
2015-04-28 15:42                                                                       ` David Lang
2015-04-28  8:38                                                                     ` Sebastian Moeller
2015-04-28 12:09                                                                       ` Rich Brown
2015-04-28 15:26                                                                         ` David Lang
2015-04-28 15:39                                                                       ` David Lang
2015-04-28 11:04                                                                     ` Mikael Abrahamsson
2015-04-28 11:49                                                                       ` Sebastian Moeller
2015-04-28 12:24                                                                         ` Mikael Abrahamsson
2015-04-28 13:44                                                                           ` Sebastian Moeller
2015-04-28 19:09                                                                             ` Rick Jones
2015-04-28 14:06                                                                       ` Dave Taht
2015-04-28 14:02                                                                   ` Dave Taht
2015-05-06  5:08                                                               ` Simon Barber
2015-05-06  8:50                                                                 ` Sebastian Moeller
2015-05-06 15:30                                                                   ` Jim Gettys
2015-05-06 18:03                                                                     ` Sebastian Moeller
2015-05-06 20:25                                                                     ` Jonathan Morton
2015-05-06 20:43                                                                       ` Toke Høiland-Jørgensen
2015-05-07  7:33                                                                         ` Sebastian Moeller
2015-05-07  4:29                                                                       ` Mikael Abrahamsson
2015-05-07  7:08                                                                         ` jb
2015-05-07  7:18                                                                           ` Jonathan Morton
2015-05-07  7:24                                                                             ` Mikael Abrahamsson
2015-05-07  7:40                                                                               ` Sebastian Moeller
2015-05-07  9:16                                                                                 ` Mikael Abrahamsson
2015-05-07 10:44                                                                                   ` jb
2015-05-07 11:36                                                                                     ` Sebastian Moeller
2015-05-07 11:44                                                                                     ` Mikael Abrahamsson
2015-05-07 13:10                                                                                       ` Jim Gettys
2015-05-07 13:18                                                                                         ` Mikael Abrahamsson
2015-05-07 13:14                                                                                       ` jb
2015-05-07 13:26                                                                                         ` Neil Davies
2015-05-07 14:45                                                                                         ` Simon Barber
2015-05-07 22:27                                                                                           ` Dave Taht
2015-05-07 22:45                                                                                             ` Dave Taht
2015-05-07 23:09                                                                                             ` Dave Taht
2015-05-08  2:05                                                                                               ` jb
2015-05-08  4:16                                                                                                 ` David Lang
2015-05-08  3:54                                                                                               ` Eric Dumazet
2015-05-08  4:20                                                                                                 ` Dave Taht
2015-05-07  7:37                                                                             ` Sebastian Moeller
2015-05-07  7:19                                                                           ` Mikael Abrahamsson
2015-05-07  6:19                                                                       ` Sebastian Moeller
2015-04-25  3:23                                                       ` Simon Barber
2015-04-24 15:20                                                     ` Bill Ver Steeg (versteb)
2015-04-25  2:24                                                   ` Simon Barber
2015-04-23 10:17                                             ` renaud sallantin
2015-04-23 14:10                                               ` Eric Dumazet
2015-04-23 14:38                                                 ` renaud sallantin
2015-04-23 15:52                                                   ` Jonathan Morton
2015-04-23 16:00                                                     ` Simon Barber
2015-04-23 13:17                                             ` MUSCARIELLO Luca IMT/OLN
2015-04-22 18:22                                       ` Eric Dumazet
2015-04-19 12:14 ` Toke Høiland-Jørgensen
2015-04-19  0:57 Rich Brown
2015-04-19  4:01 ` Dave Taht
2015-04-20 14:33   ` Colin Dearborn
2015-04-19  8:29 ` Dave Taht
2015-04-19  8:38   ` Dave Taht
2015-04-19 12:21     ` jb
2015-04-19  9:17   ` MUSCARIELLO Luca IMT/OLN
2015-04-19 12:03     ` jb
2015-04-19 10:53 ` dikshie
2015-04-19 12:11   ` jb

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

  List information: https://lists.bufferbloat.net/postorius/lists/bloat.lists.bufferbloat.net/

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=CAH3Ss95e1wa23i-eU86bnVJbxGaOFBUso+WU+sn5G5HmatdzPw@mail.gmail.com \
    --to=justin@dslr.net \
    --cc=bloat@lists.bufferbloat.net \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox