From: Jesper Dangaard Brouer <jdb@comx.dk>
To: Eric Dumazet <eric.dumazet@gmail.com>
Cc: Van Jacobson <van@parc.com>,
bloat-devel@lists.bufferbloat.net, herbert@gondor.apana.org.au,
bloat@lists.bufferbloat.net
Subject: GSO (was: Please enter issues into the issue tracker - Issue system organisation needed)
Date: Fri, 25 Feb 2011 12:21:52 +0100 [thread overview]
Message-ID: <1298632912.21810.33.camel@traveldev.cxnet.dk> (raw)
In-Reply-To: <1298575769.2659.10.camel@edumazet-laptop>
On Thu, 2011-02-24 at 20:29 +0100, Eric Dumazet wrote:
> - Its important to set TSO off (ethtool -K eth0 tso off), or else we
> send big packets (up to 64Kbytes) and this used to break SFQ fairness.
> This can really hurt latencies of interactive flows.
Don't you mean "GSO" Generic-Segmentation-Offload (ethtool -K eth0 gso
off) as this happens in the stack. While TSO Tcp-Segmentation-Offload
happens in hardware, and you will not see it in the SFQ qdisc?
I recommend that both is turned off, on small bandwidth links where
latency matters.
I'm wondering if LRO (Large-Receive-Offload) affect you, when you are
using SFQ on ingress?
Recently had some "funny" issues with GRO, where a 100 Mbit/s customer
could "only" get approx 90 Mbit/s throughput to our speed test server
(other customers, in another appartment building could get approx 96
Mbit/s). The issue was resolved by disabling GSO on the speed test
server. The theory is that some switch on the path cannot handle the
bursts generated by GSO, which is max 64K (I think, correct me if I'm
wrong).
When adjusting buffer sizes, its important to take this bursty TCP
behavior into account, which is created by both GSO and TSO. I'm not
saying that the queue size needs to be above 64K. For smaller links, it
might make sense to set it, significantly below 64K, to avoid a GSO
enabled Linux machine to ramp up its window size, which makes it capable
of bursting.
--
Best regards
Jesper Brouer
ComX Networks A/S
Linux Network Kernel Developer
Cand. Scient Datalog / MSc.CS
Author of http://adsl-optimizer.dk
LinkedIn: http://www.linkedin.com/in/brouer
next prev parent reply other threads:[~2011-02-25 11:22 UTC|newest]
Thread overview: 19+ messages / expand[flat|nested] mbox.gz Atom feed top
2011-02-24 14:19 Please enter issues into the issue tracker - Issue system organisation needed Jim Gettys
2011-02-24 15:00 ` [Bloat] " Fred Baker
2011-02-24 16:32 ` Jim Gettys
2011-02-24 17:08 ` Eric Dumazet
2011-02-24 18:31 ` Dave Täht
2011-02-24 19:29 ` Eric Dumazet
2011-02-25 11:21 ` Jesper Dangaard Brouer [this message]
2011-02-25 11:54 ` GSO (was: Please enter issues into the issue tracker - Issue system organisation needed) Eric Dumazet
2011-02-25 15:48 ` Jesper Dangaard Brouer
2011-02-25 16:19 ` Eric Dumazet
2011-02-25 16:33 ` Eric Dumazet
2011-02-25 17:15 ` Jesper Dangaard Brouer
2011-02-26 2:41 ` GSO Dave Täht
2011-03-02 8:30 ` GSO Jesper Dangaard Brouer
2011-03-04 2:23 ` GSO Dave Täht
2011-02-24 23:15 ` debloat-testing: Kitten not eaten - was Re: [Bloat] Please enter issues into the issue tracker - Issue system organisation needed Jim Gettys
2011-02-24 23:18 ` Dave Täht
2011-02-24 23:31 ` Jim Gettys
2011-02-25 15:40 ` John W. Linville
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1298632912.21810.33.camel@traveldev.cxnet.dk \
--to=jdb@comx.dk \
--cc=bloat-devel@lists.bufferbloat.net \
--cc=bloat@lists.bufferbloat.net \
--cc=eric.dumazet@gmail.com \
--cc=herbert@gondor.apana.org.au \
--cc=van@parc.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox