From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-ot0-x231.google.com (mail-ot0-x231.google.com [IPv6:2607:f8b0:4003:c0f::231]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by lists.bufferbloat.net (Postfix) with ESMTPS id 976E63B2A4 for ; Thu, 26 Jan 2017 13:36:48 -0500 (EST) Received: by mail-ot0-x231.google.com with SMTP id 32so22628304oth.3 for ; Thu, 26 Jan 2017 10:36:48 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=IBI8fGdFdlo31c2ASE1gaD6bRgePsc/Ouf7B/UhtVpQ=; b=SaEQfgw6Wm/16gVgdPGR2Gj6rKbIYMjFxXDW8UFKhn+qvYTfEz1mFtnrW2TBe4KzLd G3IYRP3zrLXZ2/rYTG+qMmhkA+5PFDW8A0cA6ANlvX80FjtsKeZMT1rY5dH5umHmkCqq qIC++qX0Svbv6sCC5I9PRHxpxLUXmmvy+tl6Lw/Xj+TAUMV7ZAxxWJhf+LdimU5mca+N /y+crXlzXK59iBK/8fU+ESO29acrWRze/izvJVESGoBn6Vl2aL24/bvGYp24p+xJ1kDu dY2UmtHQLH/634cXKudfl8pA3It/JAQUnZ5vM00wts1Teapk3+fF5MuR/efoFZuvTNdo YIqQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=IBI8fGdFdlo31c2ASE1gaD6bRgePsc/Ouf7B/UhtVpQ=; b=ZBv2sJ9WP2SKcAuH0InotApep0OKzG9SvBmXkbCXQaciUMAYpRKvd5cVrHS1UteT8y +/12sC3ZMgSZXCU3R+SWwt5FMe3L38TbLkyCZaPFSlXVsW3BMuu6Ep5VVNuLjSOQa6HC 0MROqfQwnYRuWeWtlf0FPiEbYLLYWkhTfy2UR0JplYZvp6fdbHsi3ykmY5WfnEAj1gOv ZFElMvZ8GEKJhL8Am4Gf0Umvqax7V0zzm4va7Hg0Mt56chBHumBZjkqKvANzMk44Ovar R/qTjxG0L1Z4PVkb5NtBqqG1cdd4DhholWdahelpHQWDvEJ14BOuyOZW6Rb8FLzVNCWH 3BEw== X-Gm-Message-State: AIkVDXKDGXPzZwBhCqNPnAInLe4ITAP4sFizuoOrqhnTw8uYdsk3uFJUxMJHV1InpGL32M3yql5JNSjMyhxkQw== X-Received: by 10.157.53.42 with SMTP id o39mr2117617otc.157.1485455807855; Thu, 26 Jan 2017 10:36:47 -0800 (PST) MIME-Version: 1.0 Received: by 10.157.1.21 with HTTP; Thu, 26 Jan 2017 10:36:47 -0800 (PST) From: Hans-Kristian Bakke Date: Thu, 26 Jan 2017 19:36:47 +0100 Message-ID: To: bloat Content-Type: multipart/alternative; boundary=001a11c00e4ec1c257054703a17e Subject: [Bloat] Excessive throttling with fq X-BeenThere: bloat@lists.bufferbloat.net X-Mailman-Version: 2.1.20 Precedence: list List-Id: General list for discussing Bufferbloat List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 26 Jan 2017 18:36:48 -0000 --001a11c00e4ec1c257054703a17e Content-Type: text/plain; charset=UTF-8 Another day, another fq issue (or user error). I try to do the seeminlig simple task of downloading a single large file over local gigabit LAN from a physical server running kernel 4.8 and sch_fq on intel server NICs. For some reason it wouldn't go past around 25 MB/s. After having replaced SSL with no SSL, replaced apache with nginx and verified that there is plenty of bandwith available between my client and the server I tried to change qdisc from fq to pfifo_fast. It instantly shot up to around the expected 85-90 MB/s. The same happened with fq_codel in place of fq. I then checked the statistics for fq and the throttled counter is increasing massively every second (eth0 and eth1 is LACPed using Linux bonding so both is seen here): qdisc fq 8007: root refcnt 2 limit 10000p flow_limit 100p buckets 1024 orphan_mask 1023 quantum 3028 initial_quantum 15140 refill_delay 40.0ms Sent 787131797 bytes 520082 pkt (dropped 15, overlimits 0 requeues 0) backlog 98410b 65p requeues 0 15 flows (14 inactive, 1 throttled) 0 gc, 2 highprio, 259920 throttled, 15 flows_plimit qdisc fq 8008: root refcnt 2 limit 10000p flow_limit 100p buckets 1024 orphan_mask 1023 quantum 3028 initial_quantum 15140 refill_delay 40.0ms Sent 2533167 bytes 6731 pkt (dropped 0, overlimits 0 requeues 0) backlog 0b 0p requeues 0 24 flows (24 inactive, 0 throttled) 0 gc, 2 highprio, 397 throttled Do you have any suggestions? Regards, Hans-Kristian --001a11c00e4ec1c257054703a17e Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Another day, another fq issue (or user error).

I try to d= o the seeminlig simple task of downloading a single large file over local g= igabit =C2=A0LAN from a physical server running kernel 4.8 and sch_fq on in= tel server NICs.

For some reason it wouldn't go past around 25 MB/= s. After having replaced SSL with no SSL, replaced apache with nginx and ve= rified that there is plenty of bandwith available between my client and the= server I tried to change qdisc from fq to pfifo_fast. It instantly shot up= to around the expected 85-90 MB/s. The same happened with fq_codel in plac= e of fq.

I then checked the statistics for fq and the throttled counte= r is increasing massively every second (eth0 and eth1 is LACPed using Linux= bonding so both is seen here):

qdisc fq = 8007: root refcnt 2 limit 10000p flow_limit 100p buckets 1024 orphan_mask 1= 023 quantum 3028 initial_quantum 15140 refill_delay 40.0ms
=C2=A0Sent 787131797 bytes 520082 pkt (dropped 15, overl= imits 0 requeues 0)
=C2=A0backlog 98410b = 65p requeues 0
=C2=A0 15 flows (14 inacti= ve, 1 throttled)
=C2=A0 0 gc, 2 highprio,= 259920 throttled, 15 flows_plimit
qdisc = fq 8008: root refcnt 2 limit 10000p flow_limit 100p buckets 1024 orphan_mas= k 1023 quantum 3028 initial_quantum 15140 refill_delay 40.0ms
=C2=A0Sent 2533167 bytes 6731 pkt (dropped 0, overlimi= ts 0 requeues 0)
=C2=A0backlog 0b 0p requ= eues 0
=C2=A0 24 flows (24 inactive, 0 th= rottled)
=C2=A0 0 gc, 2 highprio, 397 thr= ottled

Do you have any suggestions?

=
Regards,
Hans-Kristian
--001a11c00e4ec1c257054703a17e--