From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-pj1-x1030.google.com (mail-pj1-x1030.google.com [IPv6:2607:f8b0:4864:20::1030]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by lists.bufferbloat.net (Postfix) with ESMTPS id 112133B2A4 for ; Sat, 12 Nov 2022 11:44:56 -0500 (EST) Received: by mail-pj1-x1030.google.com with SMTP id f5-20020a17090a4a8500b002131bb59d61so9485761pjh.1 for ; Sat, 12 Nov 2022 08:44:56 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=networkplumber-org.20210112.gappssmtp.com; s=20210112; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:subject:cc:to:from:date:from:to:cc:subject:date :message-id:reply-to; bh=mJW4xhd/QIZvneSD29UsGHpd4ojmco7I0Oeq25Pyo2o=; b=FpoCN46JF72NuEcUQRN0GF35k6Oyk6SKrectwrTS9YDcGeTIoBRXeUTHkBePvr5LJa Ds6F8hbwUTNxJWv0NfBlZaN5P4mNzz1L8ZdqXy7RVruQdmO+pdb5jzE7Qq3uPq4nrobw fTCcY2MfBhVsiHY3e/7bL1LrYsDf0A1RUQy1KjgrTx7X7B8R/hTfOt8p/LMjekZ/0fId f5L070gYhS79I9KgBubpZa2EHwWv+KujDiJQzyvZzHmGHE9r/343ykKMHGeE1o9SeF7V sBBk7vv0mOHCaC9wQYVkpZHEAVz2Auycgm19OEVcaud5G0Vsgxd2DdvI7GZp8k3kEYx2 WJ9w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:subject:cc:to:from:date:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=mJW4xhd/QIZvneSD29UsGHpd4ojmco7I0Oeq25Pyo2o=; b=Kh3OmGT/Eg8i2jGfKU5POdXjl2/+dxWq+15utbuo1DL7e/ki/Y+2hHKiHFUmoVK3oQ Vz3SB6FnJO1iBllukVJUFWXBKGzAywx56yTA5aXAEfA8D+sj7erWLZrkI3DiA3C7fXRt 0OAIuVoECVDPD5yLsD5mxOy7YsdNIUBsOkE4MvPkOKti6fzjpqCSsUPL9LGXfaDrOoiJ X9LBQcDevqngxp9RjDcyxw0CipnA/xtPZ92RK/P4dN6wEvi3OoYCBqsTxJe+eseh/cSL QsN2kMt3p0kVq4onu9onKmOPrCcvJ6ACxkIvilursdrsAWe18O9KnbzAnbhI8pV39c3Y cb9g== X-Gm-Message-State: ANoB5pmj88g6hq0tuwufc/qi3fxzMYU5cu6LPuQxlYFHoS7pNXZpTwLk Nm7ChQKyishV6KDb1425pBJD5Q== X-Google-Smtp-Source: AA0mqf4iPeUxrN2NcL2Jc9lI4j9pwICqcdNmzrVRWYEC8Mmrfx9GUhX66ANW11FwqYIElllYC9AJCw== X-Received: by 2002:a17:902:ebcb:b0:188:5240:50ec with SMTP id p11-20020a170902ebcb00b00188524050ecmr7210617plg.168.1668271495883; Sat, 12 Nov 2022 08:44:55 -0800 (PST) Received: from hermes.local (204-195-120-218.wavecable.com. [204.195.120.218]) by smtp.gmail.com with ESMTPSA id gk9-20020a17090b118900b00205db4ff6dfsm3414765pjb.46.2022.11.12.08.44.55 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sat, 12 Nov 2022 08:44:55 -0800 (PST) Date: Sat, 12 Nov 2022 08:44:53 -0800 From: Stephen Hemminger To: Dave Taht Cc: libreqos , "aapasqual@gmail.com" Message-ID: <20221112084453.58fd2916@hermes.local> In-Reply-To: References: MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Mailman-Approved-At: Sat, 12 Nov 2022 11:45:55 -0500 Subject: Re: [LibreQoS] libreqos vs a vs paraqum X-BeenThere: libreqos@lists.bufferbloat.net X-Mailman-Version: 2.1.20 Precedence: list List-Id: Many ISPs need the kinds of quality shaping cake can do List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 12 Nov 2022 16:44:57 -0000 On Sat, 12 Nov 2022 07:54:02 -0800 Dave Taht wrote: > I (personally) have zero interest in dpdk and vpp. I don't want to > give up all the other nifty things a linux box can do by using it, so > I followed along on the xdp work - but I concede that these > technologies are probably always going to be faster than xdp, and > there are a ton of products deployed using it. I'd hoped someone would > fund open sourcing a fq_codel or cake implementation for it. (Same > goes for freebsd and pfsense which could use a native BQL + fq_codel > implementation. The BSD packet buffering scheme is really alien to > me). DPDK and vpp were born of the recognition that with conventional > processors, the bottleneck is more on the read side than the write > side, once you crack 10gbit. Linux and BSD has to solve the general purpose problem (lots of devices, any application, etc) and therefore has lots of locking an other overhead. All that overhead keeps it in the 1 to 4 Million packets/second/core forwarding range. With BPF some of this can be bypassed but then most of the interesting stuff is gone and still limited to 10Mpps. The dedicated stuff gets much higher PPS but at a cost, limited HW suppor, no generic locking etc. Doing research before diving into CAKE on DPDK, the real issue is that there is no supported flow classification model in DPDK. There was a limited/dead library and doing the full classification like Linux gets harder.