From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <toke@toke.dk>
Received: from mail.toke.dk (mail.toke.dk [IPv6:2001:470:dc45:1000::1])
 (using TLSv1.2 with cipher ADH-AES256-GCM-SHA384 (256/256 bits))
 (No client certificate requested)
 by lists.bufferbloat.net (Postfix) with ESMTPS id 103CF3BA8E
 for <cake@lists.bufferbloat.net>; Tue,  3 Jul 2018 06:27:54 -0400 (EDT)
From: Toke =?utf-8?Q?H=C3=B8iland-J=C3=B8rgensen?= <toke@toke.dk>
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=toke.dk; s=20161023;
 t=1530613670; bh=C8HycUy39hw7Gn+pIG6x64UxbMfGGYvZbUnVNYdfhlY=;
 h=From:To:Cc:Subject:In-Reply-To:References:Date:From;
 b=gUPKkgF3RgPjDM80G7tUElxA4e5ZGN+EzqkxBvR63Jt2fgdNIEWVOtAtzBluS+KEl
 Z+6Zuhwu8N0fdlDk24xwymiizP83GzoxAR84qdeHcmbXvg7MAiAfElc+KgMRMvG1F9
 Dpza43wjsfr1Y9s9m4Iytn+WiNEpOMrYP1GhU51Z7jqFJqIZXE6aqOP848tIDDYFhd
 VUxUPxO/eTPOh47iCCNG4H+015asdid5nyuNqthw4/wueN0ZkfzKQVc95gzoVtSQDo
 p0A35OJ8z2Hw3NrNhrlpLRcZVz+vWwRzLUy4j4Domk81+XQerUAHEVNMGVg89KJ43x
 D0NRYRLsOQfMw==
To: Jonathan Morton <chromatix99@gmail.com>
Cc: Georgios Amanakis <gamanakis@gmail.com>,
 Cake List <cake@lists.bufferbloat.net>
In-Reply-To: <73DD74AD-C2E7-4A12-AE49-C06D4486660E@gmail.com>
References: <mailman.381.1530347349.3512.cake@lists.bufferbloat.net>
 <94C9790F-E9BC-4D59-9845-17C305E4B910@darbyshire-bryant.me.uk>
 <DD0F4A27-F63A-4CB2-889E-9AF94C963A27@heistp.net>
 <BE434450-4605-43D2-920D-15D0F638B7AE@darbyshire-bryant.me.uk>
 <B012E417-C2FE-4BF9-9A88-4257C8F681BE@heistp.net>
 <17AF79A0-0213-44E3-95B9-62795A644A47@heistp.net> <87lgatj13k.fsf@toke.dk>
 <D43CE745-E5AC-4AC1-879A-2975545BC8B8@heistp.net> <87fu11ipir.fsf@toke.dk>
 <mailman.407.1530550780.3512.cake@lists.bufferbloat.net>
 <A17BCC62-D57E-44AC-8D75-82EF278E745A@darbyshire-bryant.me.uk>
 <871scligay.fsf@toke.dk>
 <2AE036E5-BD3D-4176-9476-9EC824EC1D18@darbyshire-bryant.me.uk>
 <87r2klh1fz.fsf@toke.dk>
 <CAA93jw4kzYqr2b0hLwpBZVGp202ZzJ7s3a0XkgbADB0tiFenqA@mail.gmail.com>
 <87lgath01v.fsf@toke.dk> <52B2B44D-4382-404C-8F6D-03F12A72B11F@heistp.net>
 <31667353-48F2-4FAB-AC05-163680451719@toke.dk>
 <CACvFP_g+4VbfqdUu32=KMD_0b-fSjaKaktu+nHu89MtyAUW=iw@mail.gmail.com>
 <48ECB6C8-5D22-4785-A6CE-696D87EC5496@toke.dk>
 <73DD74AD-C2E7-4A12-AE49-C06D4486660E@gmail.com>
Date: Tue, 03 Jul 2018 12:27:36 +0200
X-Clacks-Overhead: GNU Terry Pratchett
Message-ID: <87fu10haw7.fsf@toke.dk>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
Subject: Re: [Cake] cake at 60gbit
X-BeenThere: cake@lists.bufferbloat.net
X-Mailman-Version: 2.1.20
Precedence: list
List-Id: Cake - FQ_codel the next generation <cake.lists.bufferbloat.net>
List-Unsubscribe: <https://lists.bufferbloat.net/options/cake>,
 <mailto:cake-request@lists.bufferbloat.net?subject=unsubscribe>
List-Archive: <https://lists.bufferbloat.net/pipermail/cake>
List-Post: <mailto:cake@lists.bufferbloat.net>
List-Help: <mailto:cake-request@lists.bufferbloat.net?subject=help>
List-Subscribe: <https://lists.bufferbloat.net/listinfo/cake>,
 <mailto:cake-request@lists.bufferbloat.net?subject=subscribe>
X-List-Received-Date: Tue, 03 Jul 2018 10:27:54 -0000

Jonathan Morton <chromatix99@gmail.com> writes:

>> On 3 Jul, 2018, at 1:23 am, Toke H=C3=B8iland-J=C3=B8rgensen <toke@toke.=
dk> wrote:
>>=20
>> My hunch is that this has something to do with the way mlx5 uses
>> multiple receive queues (and thus multiple CPUs). Which is probably
>> different from veth...
>
> At this stage I'm pretty confident it has nothing to do with Cake, and
> everything to do with the Mellanox hardware and driver. It does strike
> me that Linux' default handling of multiqueue hardware doesn't map
> very well to the qdisc interface.

Well, it doesn't happen with fq_codel, so even if it is a driver bug, it
is being triggered by cake specifically...

-Toke