Development issues regarding the cerowrt test router project
 help / color / mirror / Atom feed
From: Alan Jenkins <alan.christopher.jenkins@gmail.com>
To: BBR Development <bbr-dev@googlegroups.com>
Cc: swmike@swm.pp.se, bloat@lists.bufferbloat.net,
	cerowrt-devel@lists.bufferbloat.net
Subject: Re: [Cerowrt-devel] taking apart BBR's behaviors in flent
Date: Thu, 22 Sep 2016 05:09:15 -0700 (PDT)	[thread overview]
Message-ID: <d86deca8-3d8f-42a1-9038-2c0f8c14181a@googlegroups.com> (raw)
In-Reply-To: <CAA93jw5Y=6rJKuFK3N5zMpw-LrMz4ta1jB6UD2Cg07xw8OfQpg@mail.gmail.com>


[-- Attachment #1.1: Type: text/plain, Size: 2511 bytes --]

On Wednesday, 21 September 2016 20:25:32 UTC+1, Dave Taht wrote:
>
> > Looking at cake_flowblind_noecn, BBR1 and BBR4 just kills both CUBIC 
> flows. 
> > Same with PIE. 
>
> Yep. The single queue AQMs expect their induced drops to matter to all 
> flows. BBR disregards them as noise. I think there's hope though, if 
> BBR can treat ECN CE as a clear indication of of congestion and not 
> filter it as it does drops.
>

Extra credit assignment: get the next version of DOCSIS PIE to turn on ECN?

https://tools.ietf.org/html/draft-ietf-aqm-docsis-pie-02#section-4.7
 

> But cake/fq_codel is just fine with different cc's in the mix, and I'm 
> dying to look at the captures for what happens there.
>

Very glad to see that, I can keep using fq_codel :).

> So it seems my intuition was wrong, at least for these scenarios. It 
> wasn't 
> > CUBIC that would kill BBR, it's the other way around.


So (from the other thread) BBR is designed to use the traditional 
recommendation of 1 BDP's worth of buffer.  In the absence of other CC's, 
it would limit itself to that.  Understandable for bottlenecks in end-site 
modems or wifi.

Shallower buffers cause somewhat increased packet loss (given multiple 
competing BBR streams).  BBR is designed to survive this without difficulty 
(incurring retransmit latency).  Competing loss-based CCs will suffer badly.

The patch says it's designed to improve throughput "on today's high-speed 
long-haul links using commodity switches with shallow buffers" by not 
"[over-reacting] to losses caused by transient traffic bursts".

If there is systemic congestion at those switches[1]...

[1] ex
https://www.ncta.com/sites/prod/files/MIT-Congestion-DC.pdf
http://groups.csail.mit.edu/ana/Measurement-and-Analysis-of-Internet-Interconnection-and-Congestion-September2014.pdf

...I wait with interest to see what the ACM article says.

My intuition was that "delay based TCPs can't work on the internet!" - 
> and was wrong, also. 
>

> > Great to have testing 
> > tools! Thanks Flent! 
>
> Thx, toke! I try not to remember just how hard it was to do this sort 
> of analysis on complex network flows when we started.
>

And thanks for the matrix of test results!

It shows how powerful a tool it is, to see points raised so quickly.

If I'm reading the drops graph right, I can see multi-second periods >= 10% 
packet loss when the buffer is limited to 25ms (bfifo_64k, 
bw=20Mbit-rtt=48ms-flows=2-noecn-bbr).  Clearly explains why normal CUBIC 
gets crushed :).

Alan

[-- Attachment #1.2: Type: text/html, Size: 3432 bytes --]

  parent reply	other threads:[~2016-09-22 12:09 UTC|newest]

Thread overview: 5+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2016-09-21 19:25 Dave Taht
2016-09-21 19:45 ` [Cerowrt-devel] [bbr-dev] " Neal Cardwell
2016-09-22  0:09 ` [Cerowrt-devel] " Dave Taht
2016-09-22 12:09 ` Alan Jenkins [this message]
2016-09-26 19:02   ` [Cerowrt-devel] [bbr-dev] " Neal Cardwell

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

  List information: https://lists.bufferbloat.net/postorius/lists/cerowrt-devel.lists.bufferbloat.net/

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=d86deca8-3d8f-42a1-9038-2c0f8c14181a@googlegroups.com \
    --to=alan.christopher.jenkins@gmail.com \
    --cc=bbr-dev@googlegroups.com \
    --cc=bloat@lists.bufferbloat.net \
    --cc=cerowrt-devel@lists.bufferbloat.net \
    --cc=swmike@swm.pp.se \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox