Many ISPs need the kinds of quality shaping cake can do
 help / color / mirror / Atom feed
From: Sebastian Moeller <moeller0@gmx.de>
To: "Dave Täht" <dave.taht@gmail.com>
Cc: Jeremy Austin <jeremy@aterlo.com>,
	Dave Taht via Starlink <starlink@lists.bufferbloat.net>,
	dan <dandenson@gmail.com>,
	libreqos <libreqos@lists.bufferbloat.net>,
	Rpm <rpm@lists.bufferbloat.net>,
	rjmcmahon <rjmcmahon@rjmcmahon.com>,
	bloat <bloat@lists.bufferbloat.net>
Subject: Re: [LibreQoS] [Bloat] [Starlink] [Rpm] [EXTERNAL] Re: Researchers Seeking Probe Volunteers in USA
Date: Mon, 13 Mar 2023 17:19:22 +0100	[thread overview]
Message-ID: <ACF50579-D7E4-479F-85E6-561C50995CB3@gmx.de> (raw)
In-Reply-To: <CAA93jw6W_g_RFF7XaMS9QjtDTmBkxmuFhAykKK9w5rpcQ8ZcTQ@mail.gmail.com>

Hi Dave,

> On Mar 13, 2023, at 17:06, Dave Taht <dave.taht@gmail.com> wrote:
> 
> On Mon, Mar 13, 2023 at 8:50 AM Sebastian Moeller via Bloat
> <bloat@lists.bufferbloat.net> wrote:
>> 
>> Hi Jeremy,
>> 
>>> On Mar 13, 2023, at 16:08, Jeremy Austin <jeremy@aterlo.com> wrote:
>>> 
>>> 
>>> 
>>> On Mon, Mar 13, 2023 at 3:02 AM Sebastian Moeller via Starlink <starlink@lists.bufferbloat.net> wrote:
>>> Hi Dan,
>>> 
>>> 
>>>> On Jan 9, 2023, at 20:56, dan via Rpm <rpm@lists.bufferbloat.net> wrote:
>>>> 
>>>> You don't need to generate the traffic on a link to measure how
>>>> much traffic a link can handle.
>>> 
>>>        [SM] OK, I will bite, how do you measure achievable throughput without actually generating it? Packet-pair techniques are notoriously imprecise and have funny failure modes.
>>> 
>>> I am also looking forward to the full answer to this question. While one can infer when a link is saturated by mapping network topology onto latency sampling, it can have on the order of 30% error, given that there are multiple causes of increased latency beyond proximal congestion.
>> 
>>        So in the "autorates" a family of automatic tracking/setting methods for a cake shaper that (in friendly competition to each other) we use active measurements of RTT/OWD increases and there we try to vary our set of reflectors and then take a vote over a set of reflectors to decide "is it cake^W congestion", that helps to weed out a few alternative reasons for congestion detection (like distal congestion to individual reflectors). But that dies not answer the tricky question how to estimate capacity without actually creating a sufficient load (and doubly so on variable rate links).
>> 
>> 
>>> A question I commonly ask network engineers or academics is "How can I accurately distinguish a constraint in suppl from a reduction in demand?"
>> 
>>        Good question. The autorates can not, but then they do not need to as they basically work by upping the shaper limit in correlation with the offered load until it detects sufficiently increased delay and reduces the shaper rates. A reduction n demand will lead to a reduction in load and bufferbloat... so the shaper is adapted based on the demand, aka "give the user as much thoughput as can be done within the users configured delay threshold, but not more"...
>> 
>> If we had a reliable method to "measure how much traffic a link can handle." without having to track load and delay that would save us a ton of work ;)
> 
> My hope has generally been that a public API to how much bandwidth the
> ISP can reliabily provide at that moment would arise. There is one for
> at least one PPOe server, and I thought about trying to define one for
> dhcp and dhcpv6, but a mere get request to some kind of json that did
> up/down/link type would be nice.

	[SM] The incumbent telco over here (and one of its competitors) indeed encode the rate the traffic shaper for an individual link is set via the PPPoE AuthACK message field (both ISPs use a slightly different format with one giving net rate and the other gross rates, but that can be dealt with). However this is not adjusted during load periods. So this still describes the most likely bottleneck link well (albeit only once per PPPoE session, so either every 24 hours or in the limit every 180 days with the incumbent) but does little for transient congestion of up- or downstream elements (in their defense the incumbent mostly removed its old aggregation network between DSLAMs and PPPOE termination points so there is little on that side than can get congested).
If this was a pony ranch, I would ask for:
downstream gross shaper rate
downstream per packet overhead
downstream MTU
downstream mpu

upstream gross shaper rate
upstream per packet overhead
upstream MTU
upstream mpu

the last three likely are identical for both directions, so we are essentially talking about 5 numbers, of which only two can be expected to fluctuate under load.

Now, a competent ISP would ask why do my users want to know that and the simply implement sufficiently competent AQM/traffic shaping at the download side ;) in addition to these 5 numbers.

Regards
Sebastian


> 
> 
>> 
>> Regards
>>        Sebastian
>> 
>> 
>>> 
>>> --
>>> --
>>> Jeremy Austin
>>> Sr. Product Manager
>>> Preseem | Aterlo Networks
>>> preseem.com
>>> 
>>> Book a Call: https://app.hubspot.com/meetings/jeremy548
>>> Phone: 1-833-733-7336 x718
>>> Email: jeremy@preseem.com
>>> 
>>> Stay Connected with Newsletters & More: https://preseem.com/stay-connected/
>> 
>> _______________________________________________
>> Bloat mailing list
>> Bloat@lists.bufferbloat.net
>> https://lists.bufferbloat.net/listinfo/bloat
> 
> 
> 
> -- 
> Come Heckle Mar 6-9 at: https://www.understandinglatency.com/
> Dave Täht CEO, TekLibre, LLC


  reply	other threads:[~2023-03-13 16:19 UTC|newest]

Thread overview: 183+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
     [not found] <mailman.2651.1672779463.1281.starlink@lists.bufferbloat.net>
     [not found] ` <1672786712.106922180@apps.rackspace.com>
     [not found]   ` <F4CA66DA-516C-438A-8D8A-5F172E5DFA75@cable.comcast.com>
2023-01-09 15:26     ` [LibreQoS] [Starlink] " Dave Taht
2023-01-09 17:00       ` Sebastian Moeller
2023-01-09 17:04       ` Jeremy Austin
2023-01-09 18:33         ` Dave Taht
2023-01-09 18:54       ` [LibreQoS] [EXTERNAL] " Livingood, Jason
2023-01-09 19:19         ` [LibreQoS] [Rpm] " rjmcmahon
2023-01-09 19:56           ` dan
2023-01-09 21:00             ` rjmcmahon
2023-03-13 10:02             ` Sebastian Moeller
2023-03-13 15:08               ` [LibreQoS] [Starlink] [Rpm] [EXTERNAL] " Jeremy Austin
2023-03-13 15:50                 ` Sebastian Moeller
2023-03-13 16:06                   ` [LibreQoS] [Bloat] " Dave Taht
2023-03-13 16:19                     ` Sebastian Moeller [this message]
2023-03-13 16:12                   ` [LibreQoS] " dan
2023-03-13 16:36                     ` Sebastian Moeller
2023-03-13 17:26                       ` dan
2023-03-13 17:37                         ` Jeremy Austin
2023-03-13 18:34                           ` Sebastian Moeller
2023-03-13 18:14                         ` Sebastian Moeller
2023-03-13 18:42                           ` rjmcmahon
2023-03-13 18:51                             ` Sebastian Moeller
2023-03-13 19:32                               ` rjmcmahon
2023-03-13 20:00                                 ` Sebastian Moeller
2023-03-13 20:28                                   ` rjmcmahon
2023-03-14  4:27                                     ` [LibreQoS] On FiWi rjmcmahon
2023-03-14 11:10                                       ` [LibreQoS] [Starlink] " Mike Puchol
2023-03-14 16:54                                         ` [LibreQoS] [Rpm] " Robert McMahon
2023-03-14 17:06                                           ` Robert McMahon
2023-03-14 17:11                                             ` [LibreQoS] [Bloat] " Sebastian Moeller
2023-03-14 17:35                                               ` Robert McMahon
2023-03-14 17:54                                                 ` dan
2023-03-14 18:14                                                   ` Robert McMahon
2023-03-14 19:18                                                     ` dan
2023-03-14 19:30                                                       ` Dave Taht
2023-03-14 20:06                                                         ` rjmcmahon
2023-03-14 19:30                                                       ` rjmcmahon
2023-03-14 23:30                                                         ` [LibreQoS] [Starlink] [Bloat] [Rpm] " Bruce Perens
2023-03-15  0:11                                                           ` Robert McMahon
2023-03-15  5:20                                                             ` Bruce Perens
2023-03-15 16:17                                                               ` [LibreQoS] [Rpm] [Starlink] [Bloat] " Aaron Wood
2023-03-15 17:05                                                                 ` Bruce Perens
2023-03-15 17:44                                                                   ` rjmcmahon
2023-03-15 19:22                                                                   ` [LibreQoS] [Bloat] [Rpm] [Starlink] " David Lang
2023-03-15 17:32                                                               ` [LibreQoS] [Starlink] [Bloat] [Rpm] " rjmcmahon
2023-03-15 17:42                                                                 ` dan
2023-03-15 19:33                                                                   ` [LibreQoS] [Bloat] [Starlink] " David Lang
2023-03-15 19:39                                                                     ` [LibreQoS] [Rpm] [Bloat] [Starlink] " Dave Taht
2023-03-15 21:52                                                                       ` David Lang
2023-03-15 22:04                                                                         ` Dave Taht
2023-03-15 22:08                                                                           ` dan
2023-03-15 17:43                                                                 ` [LibreQoS] [Bloat] [Starlink] [Rpm] " Sebastian Moeller
2023-03-15 17:49                                                                   ` rjmcmahon
2023-03-15 17:53                                                                     ` [LibreQoS] [Rpm] [Bloat] [Starlink] " Dave Taht
2023-03-15 17:59                                                                       ` dan
2023-03-15 19:39                                                                       ` rjmcmahon
2023-03-17 16:38                                         ` [LibreQoS] [Rpm] " Dave Taht
2023-03-17 18:21                                           ` Mike Puchol
2023-03-17 19:01                                           ` [LibreQoS] [Starlink] [Rpm] " Sebastian Moeller
2023-03-17 19:19                                             ` [LibreQoS] [Rpm] [Starlink] " rjmcmahon
2023-03-17 20:37                                               ` [LibreQoS] [Starlink] [Rpm] " Bruce Perens
2023-03-17 20:57                                                 ` rjmcmahon
2023-03-17 22:50                                                   ` Bruce Perens
2023-03-18 18:18                                                     ` rjmcmahon
2023-03-18 19:57                                                       ` dan
2023-03-18 20:40                                                         ` rjmcmahon
2023-03-19 10:26                                                           ` Michael Richardson
2023-03-19 21:00                                                             ` [LibreQoS] On metrics rjmcmahon
2023-03-20  0:26                                                               ` dan
2023-03-20  3:03                                                                 ` [LibreQoS] [Starlink] " David Lang
2023-03-20 20:46                                                             ` [LibreQoS] [Rpm] [Starlink] On FiWi Frantisek Borsik
2023-03-20 21:28                                                               ` dan
2023-03-20 21:38                                                                 ` Frantisek Borsik
2023-03-20 22:02                                                                   ` [LibreQoS] On FiWi power envelope rjmcmahon
2023-03-20 23:47                                                                     ` [LibreQoS] [Starlink] " Bruce Perens
2023-03-21  0:10                                                                 ` [LibreQoS] [Starlink] [Rpm] On FiWi Brandon Butterworth
2023-03-21  5:21                                                                   ` Frantisek Borsik
2023-03-21 11:26                                                                     ` [LibreQoS] Annoyed at 5/1 Mbps Rich Brown
2023-03-21 12:31                                                                       ` [LibreQoS] [Starlink] " Sebastian Moeller
2023-03-21 12:53                                                                         ` Rich Brown
2023-03-21 17:22                                                                         ` dan
2023-03-21 19:04                                                                           ` Sebastian Moeller
2023-03-23 18:23                                                                             ` dan
2023-03-21 12:29                                                                     ` [LibreQoS] [Starlink] [Rpm] On FiWi Brandon Butterworth
2023-03-21 12:30                                                                   ` [LibreQoS] [Rpm] [Starlink] " Sebastian Moeller
2023-03-21 17:42                                                                     ` rjmcmahon
2023-03-21 18:08                                                                       ` rjmcmahon
2023-03-21 18:51                                                                         ` Frantisek Borsik
2023-03-21 19:58                                                                           ` rjmcmahon
2023-03-21 20:06                                                                             ` [LibreQoS] [Bloat] " David Lang
2023-03-25 19:39                                                                             ` [LibreQoS] On fiber as critical infrastructure w/Comcast chat rjmcmahon
2023-03-25 20:09                                                                               ` [LibreQoS] [Starlink] " Bruce Perens
2023-03-25 20:47                                                                                 ` rjmcmahon
2023-03-25 20:15                                                                               ` [LibreQoS] [Bloat] " Sebastian Moeller
2023-03-25 20:43                                                                                 ` rjmcmahon
2023-03-25 21:08                                                                                   ` [LibreQoS] [Starlink] " Bruce Perens
2023-03-25 22:04                                                                                     ` Robert McMahon
2023-03-25 22:50                                                                                       ` dan
2023-03-25 23:21                                                                                         ` Robert McMahon
2023-03-25 23:35                                                                                           ` [LibreQoS] [Bloat] [Starlink] " David Lang
2023-03-26  0:04                                                                                             ` Robert McMahon
2023-03-26  0:07                                                                                               ` Nathan Owens
2023-03-26  0:50                                                                                                 ` Robert McMahon
2023-03-26  8:45                                                                                                 ` Livingood, Jason
2023-03-26 18:54                                                                                                   ` rjmcmahon
2023-03-26  0:28                                                                                               ` David Lang
2023-03-26  0:57                                                                                                 ` Robert McMahon
2023-03-25 22:57                                                                                       ` [LibreQoS] [Starlink] [Bloat] " Bruce Perens
2023-03-25 23:33                                                                                         ` [LibreQoS] [Bloat] [Starlink] " David Lang
2023-03-25 23:38                                                                                         ` [LibreQoS] [Starlink] [Bloat] " Robert McMahon
2023-03-25 23:20                                                                                       ` [LibreQoS] [Bloat] [Starlink] " David Lang
2023-03-26 18:29                                                                                         ` rjmcmahon
2023-03-26 10:34                                                                                   ` [LibreQoS] [Bloat] " Sebastian Moeller
2023-03-26 18:12                                                                                     ` rjmcmahon
2023-03-26 20:57                                                                                     ` David Lang
2023-03-26 21:11                                                                                       ` Sebastian Moeller
2023-03-26 21:26                                                                                         ` David Lang
2023-03-28 17:06                                                                                         ` [LibreQoS] [Starlink] " Larry Press
2023-03-28 17:47                                                                                           ` rjmcmahon
2023-03-28 18:11                                                                                             ` Frantisek Borsik
2023-03-28 18:46                                                                                               ` rjmcmahon
2023-03-28 20:37                                                                                                 ` David Lang
2023-03-28 21:31                                                                                                   ` rjmcmahon
2023-03-28 22:18                                                                                                     ` dan
2023-03-28 22:42                                                                                                       ` rjmcmahon
2023-03-29  8:28                                                                                             ` Sebastian Moeller
     [not found]                                                                                               ` <a2857ec4-a6ea-e9eb-cf99-17ef7ea08ef2@indexexchange.com>
     [not found]                                                                                                 ` <716ECAAD-E2EE-4647-9E73-D60BF8BF9C1E@searls.com>
2023-03-29 13:40                                                                                                   ` [LibreQoS] Enabling a production model Dave Taht
2023-03-29 14:54                                                                                                     ` dan
2023-03-29 16:53                                                                                                       ` Jeremy Austin
2023-03-29 18:33                                                                                                         ` [LibreQoS] [Starlink] " Sebastian Moeller
2023-03-29 17:13                                                                                                       ` [LibreQoS] [Bloat] " David Lang
2023-03-29 17:34                                                                                                         ` dan
2023-03-29 20:03                                                                                                           ` David Lang
2023-04-02 12:00                                                                                                           ` [LibreQoS] [Starlink] " Sebastian Moeller
2023-03-29 17:46                                                                                                         ` Rich Brown
2023-03-29 19:02                                                                                                           ` tom
2023-03-29 19:08                                                                                                             ` Dave Taht
2023-03-29 19:31                                                                                                               ` tom
2023-03-29 19:11                                                                                                           ` Dave Collier-Brown
2023-04-02 11:39                                                                                                             ` [LibreQoS] [Bloat] [Starlink] " Sebastian Moeller
2023-03-29 13:46                                                                                               ` [LibreQoS] [Starlink] [Bloat] On fiber as critical infrastructure w/Comcast chat Frantisek Borsik
2023-03-29 14:57                                                                                                 ` Dave Taht
2023-03-29 19:23                                                                                                   ` Sebastian Moeller
2023-03-29 19:02                                                                                               ` rjmcmahon
2023-03-29 19:37                                                                                                 ` dan
2023-03-25 20:27                                                                               ` [LibreQoS] " rjmcmahon
2023-03-17 23:15                                             ` [LibreQoS] [Bloat] [Starlink] [Rpm] On FiWi David Lang
2023-03-13 19:33                           ` [LibreQoS] [Starlink] [Rpm] [EXTERNAL] Re: Researchers Seeking Probe Volunteers in USA dan
2023-03-13 19:52                             ` Jeremy Austin
2023-03-13 21:00                               ` Sebastian Moeller
2023-03-13 21:27                                 ` dan
2023-03-14  9:11                                   ` Sebastian Moeller
2023-03-13 20:45                             ` Sebastian Moeller
2023-03-13 21:02                               ` [LibreQoS] When do you drop? Always! Dave Taht
2023-03-13 16:04                 ` [LibreQoS] UnderBloat on fiber and wisps Dave Taht
2023-03-13 16:09                   ` Sebastian Moeller
2023-01-09 20:49         ` [LibreQoS] [EXTERNAL] Re: [Starlink] Researchers Seeking Probe Volunteers in USA Dave Taht
2023-01-09 19:13       ` [LibreQoS] [Rpm] " rjmcmahon
2023-01-09 19:47         ` [LibreQoS] [Starlink] [Rpm] " Sebastian Moeller
2023-01-11 18:32           ` Rodney W. Grimes
2023-01-11 20:01             ` Sebastian Moeller
2023-01-11 21:46               ` Dick Roy
2023-01-12  8:22                 ` Sebastian Moeller
2023-01-12 18:02                   ` rjmcmahon
2023-01-12 21:34                     ` Dick Roy
2023-01-12 20:39                   ` Dick Roy
2023-01-13  7:33                     ` Sebastian Moeller
2023-01-13  8:26                       ` Dick Roy
2023-01-13  7:40                     ` rjmcmahon
2023-01-13  8:10                       ` Dick Roy
2023-01-15 23:09                         ` rjmcmahon
2023-01-11 20:09             ` rjmcmahon
2023-01-12  8:14               ` Sebastian Moeller
2023-01-12 17:49                 ` Robert McMahon
2023-01-12 21:57                   ` Dick Roy
2023-01-13  7:44                     ` Sebastian Moeller
2023-01-13  8:01                       ` Dick Roy
2023-01-09 20:20         ` [LibreQoS] [Rpm] [Starlink] " Dave Taht
2023-01-09 20:46           ` rjmcmahon
2023-01-09 20:59             ` Dave Taht
2023-01-09 21:06               ` rjmcmahon
2023-01-09 21:18                 ` rjmcmahon
2023-01-09 21:02             ` [LibreQoS] [Starlink] [Rpm] " Dick Roy
2023-01-10 17:36         ` [LibreQoS] [Rpm] [Starlink] " David P. Reed

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

  List information: https://lists.bufferbloat.net/postorius/lists/libreqos.lists.bufferbloat.net/

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=ACF50579-D7E4-479F-85E6-561C50995CB3@gmx.de \
    --to=moeller0@gmx.de \
    --cc=bloat@lists.bufferbloat.net \
    --cc=dandenson@gmail.com \
    --cc=dave.taht@gmail.com \
    --cc=jeremy@aterlo.com \
    --cc=libreqos@lists.bufferbloat.net \
    --cc=rjmcmahon@rjmcmahon.com \
    --cc=rpm@lists.bufferbloat.net \
    --cc=starlink@lists.bufferbloat.net \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox