From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-il1-x135.google.com (mail-il1-x135.google.com [IPv6:2607:f8b0:4864:20::135]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by lists.bufferbloat.net (Postfix) with ESMTPS id B87173B2A4 for ; Thu, 24 Jun 2021 09:33:42 -0400 (EDT) Received: by mail-il1-x135.google.com with SMTP id v5so6283385ilo.5 for ; Thu, 24 Jun 2021 06:33:42 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=g9KXo5tCgQS6QoS2PN/GX6daXqW02KSabiMXg96oSLw=; b=Gslied8t2nm8UUvC3/reCcOop0CC6ytGoo8mOosmxgWKtq1Dbuqi3GF296/uyvG/SD 0ZWwMbtSdj14PJlgRUb4dT+c+Prlbbnl9KcgrhUeHPyjJMBMNIgo6HQyS/4DJDQTSnVt RRhB7nuUIAT0qyXQR9bIwwk/MyNiQj+WSOqnUoBXqo6oKsdQmU/iDzZhZHh3nqx0YHhP EvM13/X+D4gPflHSuKWLNtbTHjsxyTr4dZ+j8ByYs68K+U/SRITnoLZEysfrJU4xfTib MFECFoSU31C0R+ATpL/7D0dydlUphaBE6r+jZnKz0gbruUKg/+YTCUOTKbSXkOHfmdyU NBJQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=g9KXo5tCgQS6QoS2PN/GX6daXqW02KSabiMXg96oSLw=; b=eTUyA/aBg7w229zIMuUXNDRFETPr+WDANxw5NvuAeV8EhAXuPleq4+ec4ZReiSs1GQ sJmXaJbfTI6Ry0D2IGZ5syfUTn5VA1F6qSjOR/J0lTRYlQLgku+o4L40SdIcvcNCEGBn iorHFJbpwjpyZN0pW4+xVM2iJ6bA60FWyW6iZPLbh0wWWzsroAaSApeAp9gj8ZPqLRm8 hCbo1bc/PnMkQCA4Gn/GUXXAEugGAniXYb3wVuOdTGWymKga6mBSc0lHSGRKoGWhwpJ4 mQ4a/Vsxsh9KhQQH/+ahytRV95Nipjaje3t0snlJPMnFBbzwf1k+FIa9u37N9YnNjcxZ e3UA== X-Gm-Message-State: AOAM531v5WfK8TqsvOapOW6T39VUjmoHdkvmKBo2mF4H/0Y2x99uvSTy Ew2sDu5eEJWqB/g6vFxgbXvrHhwjJuKxhRLrAzU= X-Google-Smtp-Source: ABdhPJyRqHDeYlTA1vo+wVTpNPNiUM5vKi6WeCuZeHdfqKTxkLu0Hnvw1VIlK65KFy/hvcFk+DWtFIHtKbN8ATSrsrw= X-Received: by 2002:a92:b74b:: with SMTP id c11mr3787212ilm.246.1624541622059; Thu, 24 Jun 2021 06:33:42 -0700 (PDT) MIME-Version: 1.0 References: <3d529e0b78ef8ea54021d8f8e93285e9a474cba1.camel@heistp.net> In-Reply-To: From: Dave Taht Date: Thu, 24 Jun 2021 06:33:30 -0700 Message-ID: To: Pete Heist Cc: Cake List Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Subject: Re: [Cake] Cake memory usage after 1TB X-BeenThere: cake@lists.bufferbloat.net X-Mailman-Version: 2.1.20 Precedence: list List-Id: Cake - FQ_codel the next generation List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 24 Jun 2021 13:33:42 -0000 it would be interesting to turn the ack-filter on in this environment. On Thu, Jun 24, 2021 at 6:27 AM Pete Heist wrote: > > Hmm, since I see in the code that this could lead to drops, I've > restarted it and upped the limit to 16M. I haven't had reports of > widespread problems, but I'll keep an eye on this more closely. :) > > Pete > > On Thu, 2021-06-24 at 15:06 +0200, Pete Heist wrote: > > I'm using Cake on an EdgeRouter-X at a site that does around 50- > > 100GB/day, and we're quite happy with it so far. Egress and ingress > > stats are below after ~1TB download and ~100GB upload. > > > > I use "memlimit 8M", and noticed that it's reporting 8389696 bytes > > used > > on egress, which is at the maximum (slightly over actually). Around > > 6M > > is used on ingress. Should I then raise these limits, or is it normal > > for it to settle in around the maximum over time? > > > > Pete > > > > > > Egress: > > ------- > > > > qdisc cake 8008: dev eth4 root refcnt 2 bandwidth 8Mbit diffserv4 > > dual- > > srchost nat nowash no-ack-filter split-gso rtt 100.0ms raw overhead 0 > > fwmark 0xf no-sce > > Sent 102655686381 bytes 386831397 pkt (dropped 377557, overlimits > > 230324326 requeues 0) > > backlog 0b 0p requeues 0 > > memory used: 8389696b of 8Mb > > capacity estimate: 8Mbit > > min/max network layer size: 42 / 1514 > > min/max overhead-adjusted size: 42 / 1514 > > average network hdr offset: 14 > > > > Bulk Best Effort Video Voice > > thresh 500Kbit 8Mbit 4Mbit 2Mbit > > target 36.3ms 5.0ms 5.0ms 9.1ms > > interval 131.3ms 100.0ms 100.0ms 104.1ms > > pk_delay 17.5ms 4.1ms 1.7ms 2.0ms > > av_delay 4.5ms 232us 82us 382us > > sp_delay 14us 23us 6us 7us > > backlog 0b 0b 0b 0b > > pkts 165781 324229040 61032588 1781545 > > bytes 45344666 98316181815 4518083349 291035866 > > way_inds 42 18492140 7782656 34167 > > way_miss 4289 6575635 77917 62650 > > way_cols 0 340 0 0 > > sce 0 0 0 0 > > marks 7 19542 1 0 > > drops 8 377528 15 6 > > ack_drop 0 0 0 0 > > sp_flows 0 2 0 1 > > bk_flows 0 1 0 0 > > un_flows 0 0 0 0 > > max_len 1514 1514 1514 1514 > > quantum 300 300 300 300 > > > > Ingress: > > -------- > > > > qdisc cake 1: dev ifb4eth4 root refcnt 2 bandwidth 40Mbit diffserv4 > > dual-dsthost nat nowash no-ack-filter split-gso rtt 100.0ms raw > > overhead 0 fwmark 0xf no-sce > > Sent 1081750548776 bytes 839670608 pkt (dropped 1616216, overlimits > > 657093747 requeues 0) > > backlog 0b 0p requeues 0 > > memory used: 6027328b of 8Mb > > capacity estimate: 40Mbit > > min/max network layer size: 60 / 1514 > > min/max overhead-adjusted size: 60 / 1514 > > average network hdr offset: 14 > > > > Bulk Best Effort Video Voice > > thresh 2500Kbit 40Mbit 20Mbit 10Mbit > > target 7.3ms 5.0ms 5.0ms 5.0ms > > interval 102.3ms 100.0ms 100.0ms 100.0ms > > pk_delay 2.0ms 6.5ms 692us 1.1ms > > av_delay 248us 2.6ms 88us 139us > > sp_delay 12us 16us 7us 6us > > backlog 0b 0b 0b 0b > > pkts 29132 682090182 155330794 3836716 > > bytes 25452377 850788764602 230875228776 2357107850 > > way_inds 3 37939194 21198287 71120 > > way_miss 9448 6525310 97141 51428 > > way_cols 0 107 0 0 > > sce 0 0 0 0 > > marks 0 206496 203 30 > > drops 30 1534636 80809 741 > > ack_drop 0 0 0 0 > > sp_flows 0 2 0 0 > > bk_flows 0 1 0 0 > > un_flows 0 0 0 0 > > max_len 1484 1514 1514 1514 > > quantum 300 1220 610 305 > > > > > > > _______________________________________________ > Cake mailing list > Cake@lists.bufferbloat.net > https://lists.bufferbloat.net/listinfo/cake --=20 Latest Podcast: https://www.linkedin.com/feed/update/urn:li:activity:6791014284936785920/ Dave T=C3=A4ht CTO, TekLibre, LLC