From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-io1-xd36.google.com (mail-io1-xd36.google.com [IPv6:2607:f8b0:4864:20::d36]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by lists.bufferbloat.net (Postfix) with ESMTPS id 4FADD3CB35 for ; Tue, 27 Aug 2019 17:41:15 -0400 (EDT) Received: by mail-io1-xd36.google.com with SMTP id s21so1690721ioa.1 for ; Tue, 27 Aug 2019 14:41:15 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=k9+9Hu8LtaqV2cw1LoTggAA9L3QKuBbHOdCcyf8AI58=; b=nGag63u/hue8uakpghxzvLChIUygqGosUm4kD2OBI3caD89k1bt58M2O+hGBOIgsRH EVe7USVeRpRgc7HlH2QL6fCrx+gQN86LitEdecrnEmrT8RIgoz7uuW+t/28HsQpJ7Ypq gUCWgfWsTCJcDOQDv/ajo2fDpn9iFmlCPX0didOLxSIUmWAlGuBvQIjlN6V6vYlVRHgt DFZapKCP4ub7ihF7qjLQ3lBwZCOaEiZc/ztlZX55zsE8BXBA4D7Csv+kQuneeNAz1QQA 0Q184xFpVz6DZwYblpeUqMCD4wGfpCw3jCWRmnKWjtBzJO8U+9gSixHhTL3DfK5H1ho9 Fcxw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=k9+9Hu8LtaqV2cw1LoTggAA9L3QKuBbHOdCcyf8AI58=; b=RS8A3aXrXA8y5bKAi2ekTNOV5XZkJ81Pza+x519r0TSOwQKVMJ0x6blE3Kczu4pqtp RgHBRDf9VjHxv9mmF53DJ79hmiE/Mina9R0tw7eBqROgIyydtSZhk8y3VnDm4icXRsan EABqlFSHeTixo4/iasb0LyQLFGPcS/k0g3SLTmaIZ3dUEE26vN3j5V9euzlWf5htUSo/ c0uB9Vx3oyM8QTS8erHVxFMBSSmNp0pTEJFDafJasTFv3fyGmWf1HJBi2FbiZp5g3Jxh yo1LpX06BXtB48+JYb+lY+AlEUXy8uqXw6UDvB8EMXaRrhDLh/0epV1KzW3+hX4CjJ9l eD2w== X-Gm-Message-State: APjAAAVx1M7w4uPkTl5el3bQyihuBqoDYL1EyM0JZu+QcLTvEWZm7aMy yVtpBCuew4jVRA7JON66ki35dl6dp00YQTEbRLo= X-Google-Smtp-Source: APXvYqyT9Cd8H5KzbIgeFP5EbHOWjNdeCOslOptbKoLhSMF3J2FwHIEjNRpT4u6+0EEVwn+Lphqn7QBB5xTb1Dcu6M0= X-Received: by 2002:a02:cd82:: with SMTP id l2mr991852jap.97.1566942074523; Tue, 27 Aug 2019 14:41:14 -0700 (PDT) MIME-Version: 1.0 References: <9cbefe10-b172-ae2a-0ac7-d972468eb7a2@gmail.com> <48a3284b-e8ba-f169-6a2d-9611f8538f07@gmail.com> In-Reply-To: <48a3284b-e8ba-f169-6a2d-9611f8538f07@gmail.com> From: Dave Taht Date: Tue, 27 Aug 2019 14:41:05 -0700 Message-ID: To: Eric Dumazet Cc: Cong Wang , Akshat Kakkar , Anton Danilov , NetFilter , lartc , netdev , bloat Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Subject: Re: [Bloat] Unable to create htb tc classes more than 64K X-BeenThere: bloat@lists.bufferbloat.net X-Mailman-Version: 2.1.20 Precedence: list List-Id: General list for discussing Bufferbloat List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Aug 2019 21:41:15 -0000 On Tue, Aug 27, 2019 at 2:09 PM Eric Dumazet wrote= : > > > > On 8/27/19 10:53 PM, Dave Taht wrote: > > > > Although this is very cool, I think in this case the OP is being > > a router, not server? > > This mechanism is generic. EDT has not been designed for servers only. > > One HTB class (with one associated qdisc per leaf) per rate limiter > does not scale, and consumes a _lot_ more memory. > > We have abandoned HTB at Google for these reasons. > > Nice thing with EDT is that you can stack arbitrary number of rate limite= rs, > and still keep a single queue (in FQ or another layer downstream) There's a lot of nice things about EDT! I'd followed along on the theory, timerwheels, virtual clocks, etc, and went seeking ethernet hw that could do it (directly) on the low end and came up empty - and doing anything with the concept required a complete rethink on everything we were already doing in wifi/fq_codel/cake ;(, and after we shipped cake in 4.19, I bought a sailboat, and logged out for a while. The biggest problem bufferbloat.net has left is more efficient inbound shaping/policing on cheap hw. I don't suppose you've solved that already? :puppy dog eyes: Next year's version of openwrt we can maybe try to do something coherent with EDT. > --=20 Dave T=C3=A4ht CTO, TekLibre, LLC http://www.teklibre.com Tel: 1-831-205-9740