From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-wm0-x22d.google.com (mail-wm0-x22d.google.com [IPv6:2a00:1450:400c:c09::22d]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by lists.bufferbloat.net (Postfix) with ESMTPS id 1F1CC3B2A4 for ; Fri, 6 Jul 2018 15:24:57 -0400 (EDT) Received: by mail-wm0-x22d.google.com with SMTP id z6-v6so6090723wma.0 for ; Fri, 06 Jul 2018 12:24:57 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=heistp.net; s=google; h=from:message-id:mime-version:subject:date:in-reply-to:cc:to :references; bh=HZVv9Eaawz2QxyB/TgfEJZaEKrxT/tIo7KCUlyqLuWc=; b=Jm56Q/nDkVpBZzYTlhKid8tZ14i/PrsvmL7iEm1HnVrMLQJFGFh1Rz9LpuVWqiHIVh hjlVJ2zot77LCLKHJI57KDovvVtc5zd7fhtjhWj5ahjyqGqCtUgmz2gw/jOXzgM724C0 RvaoEzL4yIADmIVInpuv/EgebB1TveL+z9WlcDj+fhCzQsu/pgHITc5Ot0HWMF26SJQA 1UVDr1CNC9gSamoN5PEpBGSInRK2Z9JoHbuMm/B5TWm9HOcrgy4hdo2RoUDcuWRz77mW mA3ry4MQhJ81xA5ZtkPDZYchFnRnrU5CiZm/It4PxT2R785LIvaI8drq3XrrRBO+u/S5 o+AQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:message-id:mime-version:subject:date :in-reply-to:cc:to:references; bh=HZVv9Eaawz2QxyB/TgfEJZaEKrxT/tIo7KCUlyqLuWc=; b=O3zV2FSQU+As4Y8QY3DjZBu3M060UfS69+D1Qawu0zjiFK0BcymIqsx0BJ9XQud6C2 51/7cTekw1J+fYbnMKUQQxHz/l8EZdo9mm1MqGj7z4/S1pvUauowuhrY25CysoRH52fU IReK56DHgn9NRkpQ7ypxJKtnITra56s0DjdZNkIcqJkt3AKfgitfdujqj8Q1uur7qrk1 kZJ5pM+zYWA3kUShsCwR9awcmKXNiYa+as+1VnLY/MKhUSTOT3dn5KTZRNUqpvPsqCgh UtlQoMd0ZXbgi0cEFlpIJt75+yamNODg7ADY3OuAetUW6AVO0lhzOI446WJUf58+dRf8 18wA== X-Gm-Message-State: APt69E0vA5puIpOQiTr+E1icav2w3/s+Hxf5U9wY1IW/98SfvsJ8JfCo YQd4nkdh05I797N3asPZZrmnPKADOq4= X-Google-Smtp-Source: AAOMgpdEfoqhVlh2v1MFw4n9S4DxWUdCzRnbgqxys4o5dOfICkoWEcQHuWrMpBPK8IbV1Gq5jA/7sg== X-Received: by 2002:a1c:b9cf:: with SMTP id j198-v6mr7584650wmf.93.1530905096086; Fri, 06 Jul 2018 12:24:56 -0700 (PDT) Received: from tron.luk.heistp.net (h-1169.lbcfree.net. [185.193.85.130]) by smtp.gmail.com with ESMTPSA id g62-v6sm2895249wmc.2.2018.07.06.12.24.54 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 06 Jul 2018 12:24:55 -0700 (PDT) From: Pete Heist Message-Id: <82EEB9CD-E441-4639-9592-A2429681EE0E@heistp.net> Content-Type: multipart/mixed; boundary="Apple-Mail=_1B4B6302-D729-4E6A-BEE9-5CB148556B9C" Mime-Version: 1.0 (Mac OS X Mail 11.4 \(3445.8.2\)) Date: Fri, 6 Jul 2018 21:24:54 +0200 In-Reply-To: <1CFA01E7-2B3C-42C7-B102-3D0516EDCE43@heistp.net> Cc: cake@lists.bufferbloat.net To: =?utf-8?Q?Toke_H=C3=B8iland-J=C3=B8rgensen?= References: <761C7004-247B-42B4-B56C-2527816826C7@heistp.net> <87y3eoa3wn.fsf@toke.dk> <1CFA01E7-2B3C-42C7-B102-3D0516EDCE43@heistp.net> X-Mailer: Apple Mail (2.3445.8.2) Subject: Re: [Cake] lockup with cake and veth X-BeenThere: cake@lists.bufferbloat.net X-Mailman-Version: 2.1.20 Precedence: list List-Id: Cake - FQ_codel the next generation List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 06 Jul 2018 19:24:57 -0000 --Apple-Mail=_1B4B6302-D729-4E6A-BEE9-5CB148556B9C Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 > On Jul 6, 2018, at 3:37 PM, Pete Heist wrote: >=20 > I=E2=80=99m also satisfied for now that this shouldn=E2=80=99t hold us = up. However, what I=E2=80=99ll also want to try next is netem on a = separate veth device from cake. I believe Dave=E2=80=99s veth testing = earlier was using three namespaces / veth devices, maybe for this = reason(?) So under the category of =E2=80=9Cunsurprising=E2=80=9D, with netem as a = root qdisc in a separate namespace/veth device from cake, there is no = lockup. The attached script creates an environment with 6 namespaces = (client, client qdisc, client delay, server delay, server qdisc, server) = with veth devices / bridges between. It=E2=80=99s easy to switch the = qdisc or netem params, if anyone needs such a thing. Only, I wonder if high BDP links can be emulated with netem. Say I want = 10gbit with 100ms rtt. If I use =E2=80=9Cnetem delay 50ms=E2=80=9D each = direction, rtt is correct, but throughput for iperf3 drops from 30Gbit = to 450Mbit. CPU is a few percent, so that=E2=80=99s not the issue. = Fiddling with TCP window (iperf3 -w) just seems to make it worse. So = I=E2=80=99m still figuring out netem, I guess... Pete --Apple-Mail=_1B4B6302-D729-4E6A-BEE9-5CB148556B9C Content-Disposition: attachment; filename=veth_qm.tgz Content-Type: application/octet-stream; x-unix-mode=0644; name="veth_qm.tgz" Content-Transfer-Encoding: base64 H4sIAMTAP1sAA+1YWW/bOBDOq/krpopRNIv1fQHOARRJHgKk3TbpLrDYLgJZom0hEqWItNsgyH/v DKnTduIWTS9U82CaQ843w2MOasnV/OomaO18Q2ojjQYDajujQbvYprTT6fU6o1G/3R12d9qd7mg4 3IHBtzQqpYVUdgywI2+l7QaeeGjetvFflJbJ+ccLcTX1uVBNOX9qHdvOvzfoJuff63VHOK8zwHYH 2k9tyCb6zc9/91lr4onWxJZzxrwIBFdCAv/IHZDxkrqSx0seM+lzHkGH7YIfOteLCOZ2FHGc+8FT c3DDD8IPbfdKqpjbgYSjQ+jDNIwh4H9CKCC4hZuF7TacMOYrehzfA331oOFDpw2NhkQNXDXwZJTE ruJSNSI7tgOueLym67APyomuBPFRvtnpNvGHRdee7xcW8KN3+uek1P8vTl+evDptqo/q6XWQjw/7 /Qf9fzDop/7fb/dG6P/9/qhX+f/3oNd/vTtl7GIhgKOT3Kq5J2ZgS4jDUDUZuzx99/cbxs4E7hJ6 kxfxeNoDFQLmC1BzbjhAHtrMZhlntoVL3mfGcwEzaATY5fHF2Zt3l4zdcLHEzIORYgwSXRYWOkR8 CONrEOj3MrIdLqEFN64nHQkvAjw3mHANO+EYaLjGlHusxl1PwcwPJ7YvwUZdYUQGOHNbzHgK0CJ4 HoAOK5JR+tNLQSPGBCqztSIqK2bHZDhfR278dDoGl/sILDdY/1NGoGL+TzfgqXVsy//dQv3XaY90 /m/3K///HlTK/7vanYoXf70iSEYbmJg78Pyo5fJlSyzQ659nJcJ6ek+FFAwxvzuFLP2j1/+7U+r/ SQz7Jjq2+P9g0B6m+X84wloA8z92Kv//HlTy/+Pzs6u3J2eXx4eWxY7fvko7jn3NkXFynjJM7sRU Z9/CoB1IC1P5Y6OXq1iXF//kmjDu5FlyjD0MGQ36wQxLvZsg7eEbgi84BLawZ1jS45jrZ2NaIfIk 8UzRn/MII+GtYmBUS8fYLvaxXgj9cHabWAIHjSOywbSur1uZtgkfMWgZWemSLgd5B0Ho8nHszeaq NYk9d8ZbPp+qIzigWdi4XDrYmErkiIIwzU0qkzEceBGOkggIPWxA8vHCkP5bFGRCvtiDO1bDR5vt A5lyaNU71j7IuTdVKZ8s2cQn00p8rK6ceQgNDtZ70SCCOoFCnSDgRZ0k9sbvBZ5qLcsDtuuaCch0 bMkTGU+wml4rFm2JQi8qm5GwaV1CrgwhvO+Ja42OWQjqd6TivumDuo04UGSDiOOBa9PqdwbkvhkX ZPHAVmSNxcbaWq2cypJZaCUpjc26sFNCeEwq05nrW0QosL/PauZY9z5vzat2x4/brXdgk/7Y6P8B W/mgSX5m0oPTyczEEiMzMXaaLfwMXeWtC2xJ3xUysC8E8L8WYJJfAtrYR7zhK4//wUsbf/mVIWv/ IFN1QLA8sbR9z80jn441Y+PpFk37iK+yTiLIpe0UA8Qm72L3jIXCRK9d0OIhvlLjOERryaAGhRMd cynkJgG8hmgmflKxahmulRecrW6fgjarFUWpj3JJYKWYbm3KFRaF/ZJO7BYFMSlYxcRjUb4oCjhl AcomVjF7WZRoSrY5ZdsoD1mbcqFFqaosafInCeu0QKksEc33o4v7oQ3ULqXztnkg4+FM4T+w6llN YMGzQ7As+H+f3vFi7cYQvnKMeBZIkIkXhj4mQI7EalMvx09Lg634uPR1/Jsgx0+RyvhYl5ycnr/8 dys+HsY6vuvn+ClSCT+re7bhy034yMT4YfAzpDL+5+6P3LQ/yMzxN+5PVoltxUd/WsePlzl+iqTx TaWw6uN0SSL6xISPQHwPeoBXsPAaJJefTo3PZ4LoGeZylznkGGUOOVeJI9c5a1JUuSUx7HX+ocl8 xXGbFpkUc3ojKGMW2oc/gvgcQx5QgK5esRVVVFFFFVVUUUUVVVTRL0CfACtW98EAKAAA --Apple-Mail=_1B4B6302-D729-4E6A-BEE9-5CB148556B9C--