From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-wr0-x236.google.com (mail-wr0-x236.google.com [IPv6:2a00:1450:400c:c0c::236]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by lists.bufferbloat.net (Postfix) with ESMTPS id F395D3BA8E for ; Tue, 3 Jul 2018 06:41:14 -0400 (EDT) Received: by mail-wr0-x236.google.com with SMTP id j33-v6so1446097wrj.5 for ; Tue, 03 Jul 2018 03:41:14 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=heistp.net; s=google; h=mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=q9VmmhhOaBMVQKgkRmn3sb6CknXcif7PoxTiCGmIiC8=; b=KQ5x/d12uI4tuj1jAdBYlSBrCdCmEayM+dWiNWEQTB0Iz8/XstRgYwzLajuzBzbutS p5REuQmaRI46jmm2FwzjiczXco3xsP8hUqTHaS14gbufzA5V57qau5o1dkF/BG8ENeKf /X9hvt6Fwi9bScABXszef+RkVIDIic9KnP8vo9JyixFHyFRLjviHZEZG87uwdD6BOlyU wRm6Ft9D9mGRmQByVS36OD7vAZ178N+XQnzHEXJmVPeQu+CC9G9WK+GU+A9l2lGNdTAT jHIFu+8qGBW7cuMq32MkZQ5GkI+XSMGeNP8Yb6h+u+YKlqY9m9F0s+KHlIhEs8SF9tG2 61Gg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=q9VmmhhOaBMVQKgkRmn3sb6CknXcif7PoxTiCGmIiC8=; b=bkIJhtr0v7gOFsb4yMR3IOCn1zF/rOUw4SfDdf+UkcsjcslfPzTkgvmKMzGdAyUUgV fcCfHXGW7OTkzi/sr41DB2IoYLw6aTeDZ+JxlOZbqshytXtzCla1lPUlFTB95DqPTR3k 9ZUgS9wLMCgUmhaSbQQNUuUiv95yA4Jbozaxuq4wbDu6VKEyLrGFXyx0s6EyHf5rCxZh e4LK5T8kyRjrTc+95r9SMHgdQ+JG6ebFZhF8jhYr4225FfUPW1zE5D6teeFyMk88+47U +ciUmA+OS4o0TycVdvce9pDx3BxbCo9QLE2LfV97oeVUrJZZDvihLWhkGJAOSopGMzPS Zk9A== X-Gm-Message-State: APt69E0cgaKtXT4dj6nv8iuoGdSQ2q4WcwLbLrBQkdeaqGIaNZn1lRnU 9/HZTXgGiVX2SrU8htcAk61Tvw== X-Google-Smtp-Source: AAOMgpdhBZSElXLfPpmLQlLh7GNsJ6rzDTDJegI9tQKidSl+iatQ44uWN2r8xCIsyV/QnSK9N6E3IA== X-Received: by 2002:a5d:4acc:: with SMTP id y12-v6mr9671487wrs.132.1530614474018; Tue, 03 Jul 2018 03:41:14 -0700 (PDT) Received: from tron.luk.heistp.net (h-1169.lbcfree.net. [185.193.85.130]) by smtp.gmail.com with ESMTPSA id 136-v6sm2510991wmr.18.2018.07.03.03.41.13 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Tue, 03 Jul 2018 03:41:13 -0700 (PDT) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 11.4 \(3445.8.2\)) From: Pete Heist In-Reply-To: <87fu10haw7.fsf@toke.dk> Date: Tue, 3 Jul 2018 12:41:12 +0200 Cc: Jonathan Morton , Cake List Content-Transfer-Encoding: quoted-printable Message-Id: <15DD8A50-8959-49B6-9187-76EAAA168436@heistp.net> References: <94C9790F-E9BC-4D59-9845-17C305E4B910@darbyshire-bryant.me.uk> <17AF79A0-0213-44E3-95B9-62795A644A47@heistp.net> <87lgatj13k.fsf@toke.dk> <87fu11ipir.fsf@toke.dk> <871scligay.fsf@toke.dk> <2AE036E5-BD3D-4176-9476-9EC824EC1D18@darbyshire-bryant.me.uk> <87r2klh1fz.fsf@toke.dk> <87lgath01v.fsf@toke.dk> <52B2B44D-4382-404C-8F6D-03F12A72B11F@heistp.net> <31667353-48F2-4FAB-AC05-163680451719@toke.dk> <48ECB6C8-5D22-4785-A6CE-696D87EC5496@toke.dk> <73DD74AD-C2E7-4A12-AE49-C06D4486660E@gmail.com> <87fu10haw7.fsf@toke.dk> To: =?utf-8?Q?Toke_H=C3=B8iland-J=C3=B8rgensen?= X-Mailer: Apple Mail (2.3445.8.2) Subject: Re: [Cake] cake at 60gbit X-BeenThere: cake@lists.bufferbloat.net X-Mailman-Version: 2.1.20 Precedence: list List-Id: Cake - FQ_codel the next generation List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Jul 2018 10:41:15 -0000 > On Jul 3, 2018, at 12:27 PM, Toke H=C3=B8iland-J=C3=B8rgensen = wrote: >=20 > Jonathan Morton writes: >=20 >>> On 3 Jul, 2018, at 1:23 am, Toke H=C3=B8iland-J=C3=B8rgensen = wrote: >>>=20 >>> My hunch is that this has something to do with the way mlx5 uses >>> multiple receive queues (and thus multiple CPUs). Which is probably >>> different from veth... >>=20 >> At this stage I'm pretty confident it has nothing to do with Cake, = and >> everything to do with the Mellanox hardware and driver. It does = strike >> me that Linux' default handling of multiqueue hardware doesn't map >> very well to the qdisc interface. >=20 > Well, it doesn't happen with fq_codel, so even if it is a driver bug, = it > is being triggered by cake specifically=E2=80=A6 Does fq_codel run at the full 100gbit on your hardware?=