From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-oi1-x22d.google.com (mail-oi1-x22d.google.com [IPv6:2607:f8b0:4864:20::22d]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by lists.bufferbloat.net (Postfix) with ESMTPS id D8FA33B29E for ; Fri, 12 Aug 2022 10:23:25 -0400 (EDT) Received: by mail-oi1-x22d.google.com with SMTP id p132so1288886oif.9 for ; Fri, 12 Aug 2022 07:23:25 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=in-reply-to:from:references:to:content-language:subject:user-agent :mime-version:date:message-id:from:to:cc; bh=00hTeIoFBqfCqA/vYpoR5rJKIE71ao1D1Fin9MlR0OE=; b=qJBuWomq5/6VK2BBM4xh4/OAXIlFI3/I9kF7u52mIdGrwrp65pTyMO3XR/XLUEl3nw g1iv90on4lJ7CVEMwakoOCYenba+OU9M+6ayKj4zuzcKjV0zbisF/SfDe4FEsHLSHH9n yE4DsE9GqJGUM/YnIC74IxH1Of2tPsaMOFZEKfu7X7asG9eLpP640o0eURmkk6ER/ZAU 3xhhmy+h+9VFUO01FGGNVsbEvvqTNSwu6maarLHVpOueV3wDrbGOdMgWp+YRkDCW+iQM 3gOgS/UFU+DTMnK4pMWUXHppd2Sirj7o46uGO+kDIe8QtS065dUiNiIb1PpP//0v/vrD deIA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=in-reply-to:from:references:to:content-language:subject:user-agent :mime-version:date:message-id:x-gm-message-state:from:to:cc; bh=00hTeIoFBqfCqA/vYpoR5rJKIE71ao1D1Fin9MlR0OE=; b=5gZ5DF2m9Vze6Rf3K4y70Qrn5vuf/ZZPk1yk1jlQZTfwFXqxL4XoaOoToBgsyAMHQa 7ht7rZUJ2JRcO8p3Cnkw9GsLvHv9397AyH2hfDjFQP4cj+Xah65jShN1wekm51bR2OHQ odt4W0YFaWNtD2ZdsaG7e5rsK9DvgifFuruADoN18LF7Pm2IhsSk8rKYHN/awKLAL6rH 5NKGF9RNzwJ0FOLRJcds4BkBQMBlQk7YLnyCNp4xDLebHh24iJK0KUzpwajmQhAXlVji t3h2rd1LcdTzC+PObX739pPH2WqW7bCi9DQr9F4OzdCKuyHvavfafAU/WhZybV/INXbv nkGQ== X-Gm-Message-State: ACgBeo1/HK31ur/0N0geWkvHQBp3IZX1GZaLnkH105+wZceLtXk8S2ca JGtHaUeSeRhxVFRZG8+wwCmJs/Xn91Y= X-Google-Smtp-Source: AA6agR4BdcFFZeE3nSf8Hg8TUTjVnN9OG9/jV6zYo/N9LSEJKOUHLyvaEFBtUBnDp/0JoyvchaxxyA== X-Received: by 2002:aca:a8c9:0:b0:343:275e:1288 with SMTP id r192-20020acaa8c9000000b00343275e1288mr5462611oie.263.1660314204765; Fri, 12 Aug 2022 07:23:24 -0700 (PDT) Received: from ?IPV6:2602:306:cc88:d6e9:4426:1d43:f992:8a74? ([2602:306:cc88:d6e9:4426:1d43:f992:8a74]) by smtp.gmail.com with ESMTPSA id c9-20020a056830314900b00636de0819a4sm374549ots.72.2022.08.12.07.23.23 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Fri, 12 Aug 2022 07:23:24 -0700 (PDT) Content-Type: multipart/alternative; boundary="------------epiIUQkJNcoI0Ojo7qUiAbtj" Message-ID: Date: Fri, 12 Aug 2022 07:23:22 -0700 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Thunderbird/91.12.0 Content-Language: en-US To: starlink@lists.bufferbloat.net References: <1660246489.6578887@apps.rackspace.com> <717DCEA7-7701-462B-B5F1-D789531D34B0@cable.comcast.com> From: Hesham ElBakoury In-Reply-To: <717DCEA7-7701-462B-B5F1-D789531D34B0@cable.comcast.com> Subject: Re: [Starlink] SIGCOMM MIT paper: Starvation in e2e congestion control X-BeenThere: starlink@lists.bufferbloat.net X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Starlink has bufferbloat. Bad." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 12 Aug 2022 14:23:26 -0000 This is a multi-part message in MIME format. --------------epiIUQkJNcoI0Ojo7qUiAbtj Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit I already notified the authors. Hesham On 8/12/2022 7:21 AM, Livingood, Jason via Starlink wrote: > > IMO this is all good feedback for the authors to have. I don’t know > them but will send them a note that this list may have feedback on the > paper as well as for future research*. > > JL > > * I will also note that this research is the kind of thing a grant > program I lead at work might be interested in for 2023. > > *From: *Starlink on behalf of > "David P. Reed via Starlink" > *Reply-To: *"David P. Reed" > *Date: *Thursday, August 11, 2022 at 15:34 > *To: *"starlink@lists.bufferbloat.net" > *Subject: *Re: [Starlink] SIGCOMM MIT paper: Starvation in e2e > congestion control > > On Thursday, August 11, 2022 10:29am, > starlink-request@lists.bufferbloat.net said: > > > From: Hesham ElBakoury > > To: "David P. Reed" , > > starlink@lists.bufferbloat.net > > Subject: Re: [Starlink] SIGCOMM MIT paper: Starvation in e2e > > congestion control > > > > Hi David, > > > > I think someone such as Professor Hari who got many awards including the > > sigcomm 2021 life-achievement award or his student Venkat need to be > > educated on Fair Queuing. There are many publications and text books > > which describe FQ. The results of this paper is for network paths that > > do not use FQ or ECN. Venkat/Hari can provide more details. > > I would think that he knows about FQ in AQM, too. He should. > > My point is that this paper, which talks about *starvation*, doesn't > mention FQ at all, even though it is well known to mitigate > "starvation effects" - it was invented to solve exactly that problem! > > I'd suggest at minimum that the paper should point out that it > *excludes* FQ from consideration. And if possible, explain why it was > excluded... > > I can think of reasons for excluding FQ in the specific paper, but > shouldn't the title and abstract say  it applies only narrowly: > Proposed revised title: "Starvation in e2e congestion control if FQ is > excluded within the network" > > Particularly since the paper makes *broad* generalizations - the only > 2-out-of-3 argument is stated as if it applies to ALL congestion control. > > > > > For the CAP theorem, do you think I can get C,A,P, if this is what I > > need ? if this is the case, then this theorem is wrong or has limited > > applicability, correct ? > > It has limited applicability for sure. Yet, it has become fashionable > to act as if it is a completely general truth. > > The CAP theorem, in the limited space of its assumptions, appears to > be correct. But because it is so easily trivialized, as encouraged by > the "you can have any two of C A an P, but not 3" without any > qualification, problems with the definitions of the words C A and P - > serious problems indeed that matter to a first order in real > distributed systems - it is often used to derive "impossibility". > > I'll give you another example of a serious misuse of a theorem outside > its range of applicability: > > Shannon proved a channel capacity theorem: C = W log(S / N). The proof > is mathematical, and correct. > > But hiding in the assumptions are some very strong and rarely > applicable conditions. It was a very useful result in founding > information theory. > > But... it is now called "Shannon's Law" and asserted to be true and > applicable to ALL communications systems. > > This turns out not to be correct. And it is hardly ever correct in > practice. An example of non-correct application turns out to be when > multiple transmissions of electromagnetic waves occur at the same > time. EE practice is to treat "all other signals" as Gaussian Noise. > They are not - they never are. > > So, later information theorists discovered that where there are > multiple signals received by a single receiving antenna, and only a > little noise (usually from the RF Front End of the receiver, not the > environment) the Slepian-Wolf capacity theorem applies C = W > log(\sum(S[i]. i=1,N) /W). That's a LOT more capacity than Shannon's > Law predicts, especially in narrowband signalling. > > And noise itself is actually "measurement error" at the receiver, > which is rarely Gaussian, in fact it really is quite predictable > and/or removable. > > So a theorem can be correct (based on its assumptions) and > inapplicable in most cases, because of its narrowness. > > And this is why a limited (not very general) theorem of the 2-out-of-3 > form is dangerous. > > As for the CAP theorem, my Ph.D. thesis was in this very area - > multi-copy consistency in distributed data systems. That was in 1978, > 45 years ago.  I've followed that work since the time - both the > pragmatics and the theory. I think I fully understand both the context > and how the axioms chosen by Brewer simplify reality in radical ways. > > C A and P are not booleans or binary quantities. So in a real sense > the CAP theorem is always inapplicable. But worse, the proof structure > falls apart as a mathematical proof if you assume any metric for C A > or P that isn't homomorphic to boolean algebraic quantities. > > And worse, there is no standard measure of C A and P that captures > what matters on any dimension. > > So, aside from an intuition that maybe C, A, and P trade off in some > way in some model of reality, the theorem is meaningless, and not very > useful. > > I hope this helps understand what's behind my comments. > > At core, a referee ought to have asked - how is this conclusion > justified as a general conclusion about ALL e2e congestion control in > all networks, when it is only shown in a narrow, unrealistic case? > > In my nearly 50 years of publishing in the computing and > communications world, I've done a LOT of refereeing, and served on > program committees as well. The obligation of a referee is to look at > the conclusions of the paper, in the context of the state of the > science, and figure out if the conclusion is supported by the paper's > contents. > > I'm not sure why this didn't happen here. > > David > > PS: compared to the post-publication comments to my first CS > publication, in a letter to my mentor from Edsgar Dijkstra, I think > I'm being gentle. It's motivated by getting the science right. > > > > > Thanks > > > > Hesham > > > _______________________________________________ > Starlink mailing list > Starlink@lists.bufferbloat.net > https://lists.bufferbloat.net/listinfo/starlink --------------epiIUQkJNcoI0Ojo7qUiAbtj Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 8bit

I already notified the authors.

Hesham

On 8/12/2022 7:21 AM, Livingood, Jason via Starlink wrote:

IMO this is all good feedback for the authors to have. I don’t know them but will send them a note that this list may have feedback on the paper as well as for future research*.

 

JL

 

* I will also note that this research is the kind of thing a grant program I lead at work might be interested in for 2023.  

 

From: Starlink <starlink-bounces@lists.bufferbloat.net> on behalf of "David P. Reed via Starlink" <starlink@lists.bufferbloat.net>
Reply-To: "David P. Reed" <dpreed@deepplum.com>
Date: Thursday, August 11, 2022 at 15:34
To: "starlink@lists.bufferbloat.net" <starlink@lists.bufferbloat.net>
Subject: Re: [Starlink] SIGCOMM MIT paper: Starvation in e2e congestion control

 

 

On Thursday, August 11, 2022 10:29am, starlink-request@lists.bufferbloat.net said:

> From: Hesham ElBakoury <helbakoury@gmail.com>
> To: "David P. Reed" <dpreed@deepplum.com>,
> starlink@lists.bufferbloat.net
> Subject: Re: [Starlink] SIGCOMM MIT paper: Starvation in e2e
> congestion control
>
> Hi David,
>
> I think someone such as Professor Hari who got many awards including the
> sigcomm 2021 life-achievement award or his student Venkat need to be
> educated on Fair Queuing. There are many publications and text books
> which describe FQ. The results of this paper is for network paths that
> do not use FQ or ECN. Venkat/Hari can provide more details.

 

I would think that he knows about FQ in AQM, too. He should.

My point is that this paper, which talks about *starvation*, doesn't mention FQ at all, even though it is well known to mitigate "starvation effects" - it was invented to solve exactly that problem!

I'd suggest at minimum that the paper should point out that it *excludes* FQ from consideration. And if possible, explain why it was excluded...

 

I can think of reasons for excluding FQ in the specific paper, but shouldn't the title and abstract say  it applies only narrowly: Proposed revised title: "Starvation in e2e congestion control if FQ is excluded within the network"

 

Particularly since the paper makes *broad* generalizations - the only 2-out-of-3 argument is stated as if it applies to ALL congestion control.

>
> For the CAP theorem, do you think I can get C,A,P, if this is what I
> need ? if this is the case, then this theorem is wrong or has limited
> applicability, correct ?

 

It has limited applicability for sure. Yet, it has become fashionable to act as if it is a completely general truth.

 

The CAP theorem, in the limited space of its assumptions, appears to be correct. But because it is so easily trivialized, as encouraged by the "you can have any two of C A an P, but not 3" without any qualification, problems with the definitions of the words C A and P - serious problems indeed that matter to a first order in real distributed systems - it is often used to derive "impossibility".

 

I'll give you another example of a serious misuse of a theorem outside its range of applicability:

 

Shannon proved a channel capacity theorem: C = W log(S / N). The proof is mathematical, and correct.

But hiding in the assumptions are some very strong and rarely applicable conditions. It was a very useful result in founding information theory.

 

But... it is now called "Shannon's Law" and asserted to be true and applicable to ALL communications systems. 

 

This turns out not to be correct. And it is hardly ever correct in practice. An example of non-correct application turns out to be when multiple transmissions of electromagnetic waves occur at the same time. EE practice is to treat "all other signals" as Gaussian Noise. They are not - they never are.

So, later information theorists discovered that where there are multiple signals received by a single receiving antenna, and only a little noise (usually from the RF Front End of the receiver, not the environment) the Slepian-Wolf capacity theorem applies C = W log(\sum(S[i]. i=1,N) /W). That's a LOT more capacity than Shannon's Law predicts, especially in narrowband signalling.

And noise itself is actually "measurement error" at the receiver, which is rarely Gaussian, in fact it really is quite predictable and/or removable.

 

So a theorem can be correct (based on its assumptions) and inapplicable in most cases, because of its narrowness.

 

And this is why a limited (not very general) theorem of the 2-out-of-3 form is dangerous.

 

As for the CAP theorem, my Ph.D. thesis was in this very area - multi-copy consistency in distributed data systems. That was in 1978, 45 years ago.  I've followed that work since the time - both the pragmatics and the theory. I think I fully understand both the context and how the axioms chosen by Brewer simplify reality in radical ways.

 

C A and P are not booleans or binary quantities. So in a real sense the CAP theorem is always inapplicable. But worse, the proof structure falls apart as a mathematical proof if you assume any metric for C A or P that isn't homomorphic to boolean algebraic quantities.

 

And worse, there is no standard measure of C A and P that captures what matters on any dimension.

 

So, aside from an intuition that maybe C, A, and P trade off in some way in some model of reality, the theorem is meaningless, and not very useful.

 

I hope this helps understand what's behind my comments.

 

At core, a referee ought to have asked - how is this conclusion justified as a general conclusion about ALL e2e congestion control in all networks, when it is only shown in a narrow, unrealistic case?

 

In my nearly 50 years of publishing in the computing and communications world, I've done a LOT of refereeing, and served on program committees as well. The obligation of a referee is to look at the conclusions of the paper, in the context of the state of the science, and figure out if the conclusion is supported by the paper's contents.

 

I'm not sure why this didn't happen here.

 

David

 

PS: compared to the post-publication comments to my first CS publication, in a letter to my mentor from Edsgar Dijkstra, I think I'm being gentle. It's motivated by getting the science right.

 

>
> Thanks
>
> Hesham


_______________________________________________
Starlink mailing list
Starlink@lists.bufferbloat.net
https://lists.bufferbloat.net/listinfo/starlink
--------------epiIUQkJNcoI0Ojo7qUiAbtj--