From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-wm0-x241.google.com (mail-wm0-x241.google.com [IPv6:2a00:1450:400c:c09::241]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by lists.bufferbloat.net (Postfix) with ESMTPS id A51FC3B29E for ; Fri, 7 Sep 2018 12:02:32 -0400 (EDT) Received: by mail-wm0-x241.google.com with SMTP id y139-v6so15125437wmc.2 for ; Fri, 07 Sep 2018 09:02:32 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=heistp.net; s=google; h=from:message-id:mime-version:subject:date:in-reply-to:cc:to :references; bh=gRdU/4HUv8djRhGytsrK+VZZl5j75dQ8/++jy8l858s=; b=Vwh1zbQQldWlPzzkt+VGdR5SIx/cj7wIU7eaRb24Hfl89p7lqJJViBT6He2KRF48oB hf+TbSF6lhg4Uy2jp8ZUWwT/ngxovzthcJGmKW7qePlDnoCFyAnLn8yDkgCN5aJyIh0H CSdId7YAoMBv54reQpFs1X7eUubtYddrbQeG4TCd2dXw6s5hdjnYAog2w2WG7zM+2x8M yiBwkTdhOb97emCYz56iQcWe+vY7m764Lt0B5Qmcc9yFZjKHXU1A9nkbNIZj38S13w4S UDHRv1p0znf7FA5cfmm2YiQYs/aO+157UbpZWpczfERdDa4ybDQc/Y4vG1zpbawduFSQ 27tA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:message-id:mime-version:subject:date :in-reply-to:cc:to:references; bh=gRdU/4HUv8djRhGytsrK+VZZl5j75dQ8/++jy8l858s=; b=ldBWvXLJmhvfNtAB639FCtKe66CHgahtj9R+mE8TPjKH88OIQ/2gdE8Z9ZEW65+a7t Zz2hUiP+wabv6o41hwWkm097CzW88+yX0Hm0R1K8/D9p9sNDAkgzzjQ7iqe3G6hyJyNT Qv7KCOsV+tgDXdP5aG1Q04S5HGi4st9MbR8Y17oW2LhEgX5t4Zwxqp8udeseZfyOIVen GX+WslPyb7ZOIQwwNclVn4c6aqb3BtCYuvqXipUWgQs1mvrhRaWfB4dbVGawseSXI4ps RGxRJTqXz4q2PETbINdb+U/yWrjqIqBJBjvWXiYttQQceMY1UR7ManCS8kEs5UiqkrAB VRYw== X-Gm-Message-State: APzg51C3PkYfQzL3iDCbncq41B1vKgun4rRuKd6iNNzPZa/b4Gd2YC6G Yq6/eLn02hesP3ZYkx1rv/jyiQ== X-Google-Smtp-Source: ANB0VdZxmyZZn1LqCVJIzNoMg0EM2hb/Xqv7IohNebVAHsm0iHNSMx3idtRZ+7VrBauH7JxT6R0r9g== X-Received: by 2002:a1c:cb4d:: with SMTP id b74-v6mr6136728wmg.123.1536336151691; Fri, 07 Sep 2018 09:02:31 -0700 (PDT) Received: from tron.luk.heistp.net (h-1169.lbcfree.net. [185.193.85.130]) by smtp.gmail.com with ESMTPSA id 75-v6sm16246835wml.21.2018.09.07.09.02.30 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 07 Sep 2018 09:02:30 -0700 (PDT) From: Pete Heist Message-Id: <29F732DA-1AF6-4642-A03E-82950F2348AB@heistp.net> Content-Type: multipart/alternative; boundary="Apple-Mail=_991DD767-2169-4019-BD19-6B1F4E5B533D" Mime-Version: 1.0 (Mac OS X Mail 11.5 \(3445.9.1\)) Date: Fri, 7 Sep 2018 18:02:29 +0200 In-Reply-To: Cc: Cake List To: Dave Taht References: <2CB335A2-E18F-430F-9331-9AD9B3238D84@heistp.net> <1CFBCFB1-AC8B-4172-A4EB-1CE65DE62EF6@gmail.com> <3BA06BE5-FBD2-4FC8-86BB-786679A66147@heistp.net> X-Mailer: Apple Mail (2.3445.9.1) Subject: Re: [Cake] FreeNet backhaul X-BeenThere: cake@lists.bufferbloat.net X-Mailman-Version: 2.1.20 Precedence: list List-Id: Cake - FQ_codel the next generation List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 Sep 2018 16:02:33 -0000 --Apple-Mail=_991DD767-2169-4019-BD19-6B1F4E5B533D Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 > On Sep 7, 2018, at 3:59 PM, Dave Taht wrote: >=20 > you are making me pull out my mrtg stats, I'll post one. In the > debloating universe, 5 minute averages > really obscure the bufferbloat problem. What's important are > drops/marks, reschedules, queue depths, and overlimits. I get about > 3000 drops/day (debloats). I wish I could extrapolate what that and > the reschedules means in terms of induced latency on other flows, > easily. The reminders are useful, but sorry if those mrtg stats gives you = flashbacks to 2001, XP and Napster rips. :) As I look at different router configs, queue management looks like = it=E2=80=99s being applied inconsistently, sometimes on the backhaul = interfaces, and most often just on the customer facing interfaces = (interfaces connected to the point-to-multipoint APs). I would only do it on the point-to-point links, as I would think you = need airtime fairness and queues per station to do much good on ptmp. = Failing that, I would probably just let the APs do what they will(?) = That said, the Ethernet interfaces to NSM5s are 100Mbit, and in that = case, a qdisc on egress towards the AP makes sense. SmokePing should be public. On this AP, eth0 is the ptmp radio and eth1 = the backhaul, which has pfifo_fast, so yeah, there=E2=80=99s work to do, = and quite a few overlimits on at least one hfsc qdisc... = http://smokeping.lbcfree.net/cgi-bin/smokeping.cgi?filter=3Djerab;target=3D= Frantiskov.Fjerab = --Apple-Mail=_991DD767-2169-4019-BD19-6B1F4E5B533D Content-Type: multipart/mixed; boundary="Apple-Mail=_B77C5453-7EC0-48F9-A949-7763DC58220D" --Apple-Mail=_B77C5453-7EC0-48F9-A949-7763DC58220D Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8

On Sep 7, 2018, at 3:59 PM, = Dave Taht <dave.taht@gmail.com> wrote:

you = are making me pull out my mrtg stats, I'll post one. In the
debloating universe, 5 minute averages
really = obscure the bufferbloat problem. What's important are
drops/marks, reschedules, queue depths, and overlimits. I get = about
3000 drops/day (debloats). I wish I could = extrapolate what that and
the reschedules means in terms = of induced latency on other flows,
easily.

The = reminders are useful, but sorry if those mrtg stats gives you flashbacks = to 2001, XP and Napster rips. :)

As = I look at different router configs, queue management looks like it=E2=80=99= s being applied inconsistently, sometimes on the backhaul interfaces, = and most often just on the customer facing interfaces (interfaces = connected to the point-to-multipoint APs).

I would only do it on the point-to-point links, as = I would think you need airtime fairness and queues per station to do = much good on ptmp. Failing that, I would probably just let the APs do = what they will(?) That said, the Ethernet interfaces to NSM5s are = 100Mbit, and in that case, a qdisc on egress towards the AP makes = sense.

SmokePing should be = public. On this AP, eth0 is the ptmp radio and eth1 the backhaul, which = has pfifo_fast, so yeah, there=E2=80=99s work to do, and quite a few = overlimits on at least one hfsc qdisc...


= --Apple-Mail=_B77C5453-7EC0-48F9-A949-7763DC58220D Content-Disposition: attachment; filename=tc_jerab.txt Content-Type: text/plain; x-unix-mode=0644; name="tc_jerab.txt" Content-Transfer-Encoding: quoted-printable FreeNetJerab:~# tc -s -d qdisc show dev eth0 qdisc prio 1: root bands 3 priomap 2 2 2 2 2 2 0 0 2 2 2 2 2 2 2 2 Sent 758499377670 bytes 553404355 pkt (dropped 243, overlimits 0 = requeues 0)=20 rate 0bit 0pps backlog 0b 0p requeues 0=20 qdisc esfq 11: parent 1:1 quantum 1514b limit 128p flows 128/1024 = perturb 10sec hash: dst Sent 16655331 bytes 55403 pkt (dropped 0, overlimits 0 requeues 0)=20 rate 0bit 0pps backlog 0b 0p requeues 0=20 qdisc esfq 12: parent 1:2 quantum 1514b limit 128p flows 128/1024 = perturb 10sec hash: dst Sent 302689276925 bytes 227433380 pkt (dropped 0, overlimits 0 requeues = 0)=20 rate 0bit 0pps backlog 0b 0p requeues 0=20 qdisc hfsc 13: parent 1:3 default 111=20 Sent 455793445414 bytes 325915572 pkt (dropped 243, overlimits = 233425034 requeues 0)=20 rate 0bit 0pps backlog 0b 0p requeues 0=20 qdisc esfq 111: parent 13:111 quantum 1514b limit 128p flows 128/1024 = perturb 10sec hash: dst Sent 171713351551 bytes 120321398 pkt (dropped 462, overlimits 0 = requeues 0)=20 rate 0bit 0pps backlog 0b 0p requeues 0=20 qdisc esfq 112: parent 13:112 quantum 1514b limit 128p flows 128/1024 = perturb 10sec hash: dst Sent 283808986833 bytes 205401869 pkt (dropped 24, overlimits 0 = requeues 0)=20 rate 0bit 0pps backlog 0b 0p requeues 0=20 qdisc esfq 113: parent 13:113 quantum 1514b limit 128p flows 128/1024 = perturb 10sec hash: dst Sent 271107030 bytes 192305 pkt (dropped 0, overlimits 0 requeues 0)=20 rate 0bit 0pps backlog 0b 0p requeues 0=20 qdisc esfq 114: parent 13:114 quantum 1514b limit 128p flows 128/1024 = perturb 10sec hash: dst Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)=20 rate 0bit 0pps backlog 0b 0p requeues 0=20 -------------------- FreeNetJerab:~# tc -s -d class show dev eth0 class prio 1:1 parent 1: leaf 11:=20 Sent 16655331 bytes 55403 pkt (dropped 0, overlimits 0 requeues 0)=20 backlog 0b 0p requeues 0=20 class prio 1:2 parent 1: leaf 12:=20 Sent 302689276925 bytes 227433380 pkt (dropped 0, overlimits 0 requeues = 0)=20 backlog 0b 0p requeues 0=20 class prio 1:3 parent 1: leaf 13:=20 Sent 455793447887 bytes 325915583 pkt (dropped 243, overlimits = 233425034 requeues 0)=20 backlog 0b 0p requeues 0=20 class hfsc 13: root=20 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)=20 rate 0bit 0pps backlog 0b 0p requeues 0=20 period 0 level 2=20 class hfsc 13:1 parent 13: ls m1 0bit d 0us m2 70000Kbit ul m1 0bit d = 0us m2 70000Kbit=20 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)=20 rate 0bit 0pps backlog 0b 0p requeues 0=20 period 105456403 work 455793447887 bytes level 1=20 class hfsc 13:111 parent 13:1 leaf 111: ls m1 0bit d 0us m2 34968Kbit ul = m1 0bit d 0us m2 70000Kbit=20 Sent 171713351605 bytes 120321399 pkt (dropped 231, overlimits 0 = requeues 0)=20 rate 0bit 0pps backlog 0b 0p requeues 0=20 period 23695738 work 171713351605 bytes level 0=20 class hfsc 13:112 parent 13:1 leaf 112: ls m1 0bit d 0us m2 20980Kbit ul = m1 0bit d 0us m2 70000Kbit=20 Sent 283808989252 bytes 205401879 pkt (dropped 12, overlimits 0 = requeues 0)=20 rate 0bit 0pps backlog 0b 0p requeues 0=20 period 83433005 work 283808989252 bytes level 0=20 class hfsc 13:113 parent 13:1 leaf 113: ls m1 0bit d 0us m2 13987Kbit ul = m1 0bit d 0us m2 70000Kbit=20 Sent 271107030 bytes 192305 pkt (dropped 0, overlimits 0 requeues 0)=20 rate 0bit 0pps backlog 0b 0p requeues 0=20 period 33674 work 271107030 bytes level 0=20 class hfsc 13:114 parent 13:1 leaf 114: ls m1 0bit d 0us m2 64000bit ul = m1 0bit d 0us m2 128000bit=20 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)=20 rate 0bit 0pps backlog 0b 0p requeues 0=20 period 0 level 0=20 -------------------- FreeNetJerab:~# tc -s -d filter show dev eth0 filter parent 1: protocol ip pref 1 fw=20 filter parent 1: protocol ip pref 1 fw handle 0x1 classid 1:1=20 filter parent 1: protocol ip pref 49152 fw=20 filter parent 1: protocol ip pref 49152 fw handle 0x2 classid 1:2=20 -------------------- FreeNetJerab:~# tc -s -d qdisc show dev eth1=20 qdisc pfifo_fast 0: root bands 3 priomap 1 2 2 2 1 2 0 0 1 1 1 1 1 1 1 = 1 Sent 31015622705 bytes 215778566 pkt (dropped 0, overlimits 0 requeues = 0)=20 rate 0bit 0pps backlog 0b 0p requeues 0=20 --Apple-Mail=_B77C5453-7EC0-48F9-A949-7763DC58220D Content-Transfer-Encoding: 7bit Content-Type: text/html; charset=us-ascii
--Apple-Mail=_B77C5453-7EC0-48F9-A949-7763DC58220D-- --Apple-Mail=_991DD767-2169-4019-BD19-6B1F4E5B533D--