From: Dave Taht <dave.taht@gmail.com>
To: "Toke Høiland-Jørgensen" <toke@toke.dk>
Cc: "Greg White" <g.white@cablelabs.com>, "Dave Täht" <dave@taht.net>,
tsvwg@ietf.org, bloat <bloat@lists.bufferbloat.net>
Subject: Re: [Bloat] quick review and rant of "Identifying and Handling Non Queue Building Flows in a Bottleneck Link"
Date: Thu, 1 Nov 2018 12:13:19 -0700 [thread overview]
Message-ID: <CAA93jw5er8OpO2tB=BVrXOhamOZSaJ1JXfh5w8nu708iXee=Eg@mail.gmail.com> (raw)
In-Reply-To: <874ld1q6aa.fsf@toke.dk>
On Thu, Nov 1, 2018 at 6:25 AM Toke Høiland-Jørgensen <toke@toke.dk> wrote:
>
> Greg White <g.white@CableLabs.com> writes:
>
> > Hi Toke, thanks for the pointer to your paper, I had not seen it
> > before.
>
> You're welcome :)
>
> > I agree that could be a candidate algorithm. It is certainly simple.
> > It may not be the only (or perhaps even the best) solution for the
> > dual-queue case though. I'm thinking in the context of an L4S TCP
> > flow, which can respond quickly to "new" ECN markings and achieve link
> > saturation with ultra low (but not zero) queuing delay. A good
> > property for a queue protection algorithm would be that these L4S
> > flows could be consistently placed in the NQB queue. I think that the
> > simple approach you mentioned would result in many L4S flows being
> > deemed Queue Building.
>
> Yes, I think you are right (depending on traffic mix, of course). It
> might be possible to tweak it to work better, though. E.g., by changing
> the threshold (moving flows to QB if they end up with more than X ms of
> queue). This would only work if you start out all flows at NQB, with the
> associated aggressive marking behaviour; so I'm not sure if a normal TCP
> flow would ever manage to get to QB state before getting clobbered by
> the NQB markings...
>
> > Additionally, we've observed applications that send variable sized
> > "messages" at a fixed rate (e.g. 20 messages/second) where the message
> > sometimes exceeds the MTU and results in two closely spaced (possibly
> > back-to-back) packets. This is a flow that I think should be
> > considered to be NQB, but would get flagged as QB by the simple
> > approach. You described this case in your paper, where you state that
> > the first Q bytes of each burst will be treated as NQB (the first
> > packet in the case we're talking about here), but the rest will be
> > treated as QB. Assuming that message latency is important for these
> > sorts of applications, this is equivalent to saying that the entire
> > burst is considered as QB. In the fq_codel case, the message latency
> > would be something like Q(n-1)(N+1)/R (assuming no other sparse flow
> > arrivals), something like 1.3ms using the example values in your paper
> > (plus n=2, N=10) which may be ok. In the dual-queue case it is a
> > bigger deal, because the remaining packets would be put at the end of
> > the QB queue, which could have a latency of 10 or 20 ms.
>
> Sure, it's by no means a perfect mechanism. But it makes up for that by
> it's simplicity, IMO. And it does work really well for *a lot* of
> today's latency-sensitive traffic.
>
> (In your case of two-MTU messages, you could tune the quantum to allow
> those; but of course you can construct examples that won't work).
sch_fq has a default quantum of 2 mtu, with a initial burst of 10.
There's all sorts of interesting work inside that to "right-size" the
ongoing gso offloads and a major new advance over there on calculating
rtts properly is described here:
https://lwn.net/Articles/766564/
...
there was at one point, a fq_pie implementation that used the rbtree
in sch_fq to
achieve perfect fairness.
we often tune fq_codel's quantum as low as 300, at low rates.
> > So, a queue protection function that provides a bit more (but still
> > limited) allowance for a flow to have packets in queue would likely
> > work better in the dual-queue case.
For inbound shaping sch_cake defaults to 2mtu at higher rates.
This kind of opens a question in that, what is a typical target
bandwidth for l4s applications?
the videoconferencing paper I dissed in my earlier rant focused only
at 2mbits (and drew the conclusion that sfq was the best option for
the cc algo's 300ms desired range)
I have generally been focused on badwidths in the 4mbit-40gbit range.
>
> Yeah, that's tricky, especially if you want it to be very accurate in
> its distinction; which I sort of gather that you do, right?
In part, that is why I would like the language in the problem
statement clarified. To give a concrete counterexample,
think upon the ultimate choice of a crc32 algorithm and the parameters
that drove that choice.
If an accuracy of identifying "sparse flows" or NQB flows can be
specified, then all sorts of algorithms can be thrown into the fray.
AI. Bloom filters. rbtrees. regexes. cookoo++ hashes... and boring
old fq tech. :)
> -Toke
> _______________________________________________
> Bloat mailing list
> Bloat@lists.bufferbloat.net
> https://lists.bufferbloat.net/listinfo/bloat
--
Dave Täht
CTO, TekLibre, LLC
http://www.teklibre.com
Tel: 1-831-205-9740
next prev parent reply other threads:[~2018-11-01 19:13 UTC|newest]
Thread overview: 12+ messages / expand[flat|nested] mbox.gz Atom feed top
2018-10-29 4:02 Dave Taht
2018-10-29 14:15 ` Toke Høiland-Jørgensen
2018-10-31 0:12 ` Greg White
2018-11-01 13:25 ` Toke Høiland-Jørgensen
2018-11-01 19:13 ` Dave Taht [this message]
2018-11-06 4:17 ` Greg White
2018-11-12 22:19 ` Dave Taht
2018-11-01 10:39 ` Michael Welzl
2018-11-01 14:20 ` Dave Taht
2018-11-04 18:16 ` [Bloat] [tsvwg] " Michael Welzl
[not found] ` <alpine.DEB.2.02.1811011030500.24927@nftneq.ynat.uz>
2018-11-01 18:15 ` [Bloat] " David Lang
2018-11-01 19:12 ` [Bloat] [tsvwg] " Michael Welzl
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
List information: https://lists.bufferbloat.net/postorius/lists/bloat.lists.bufferbloat.net/
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to='CAA93jw5er8OpO2tB=BVrXOhamOZSaJ1JXfh5w8nu708iXee=Eg@mail.gmail.com' \
--to=dave.taht@gmail.com \
--cc=bloat@lists.bufferbloat.net \
--cc=dave@taht.net \
--cc=g.white@cablelabs.com \
--cc=toke@toke.dk \
--cc=tsvwg@ietf.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox