From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from smtp88.ord1d.emailsrvr.com (smtp88.ord1d.emailsrvr.com [184.106.54.88]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by lists.bufferbloat.net (Postfix) with ESMTPS id 2B3953BA8E for ; Tue, 15 Jan 2019 19:54:31 -0500 (EST) Received: from smtp20.relay.ord1d.emailsrvr.com (localhost [127.0.0.1]) by smtp20.relay.ord1d.emailsrvr.com (SMTP Server) with ESMTP id D3D7EC00A5; Tue, 15 Jan 2019 19:54:30 -0500 (EST) X-SMTPDoctor-Processed: csmtpprox beta Received: from smtp20.relay.ord1d.emailsrvr.com (localhost [127.0.0.1]) by smtp20.relay.ord1d.emailsrvr.com (SMTP Server) with ESMTP id D0BD6C03B4; Tue, 15 Jan 2019 19:54:30 -0500 (EST) X-Auth-ID: dev@logicalwebhost.com Received: by smtp20.relay.ord1d.emailsrvr.com (Authenticated sender: dev-AT-logicalwebhost.com) with ESMTPSA id 624C9C00A5; Tue, 15 Jan 2019 19:54:30 -0500 (EST) X-Sender-Id: dev@logicalwebhost.com Received: from [10.1.10.3] (97-90-101-114.static.mdfd.or.charter.com [97.90.101.114]) (using TLSv1.2 with cipher DHE-RSA-AES256-GCM-SHA384) by 0.0.0.0:25 (trex/5.7.12); Tue, 15 Jan 2019 19:54:30 -0500 From: Dev Message-Id: Content-Type: multipart/alternative; boundary="Apple-Mail=_24CAE05A-3B21-47B3-8CD8-AA6D3FD1CE13" Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Date: Tue, 15 Jan 2019 16:54:29 -0800 In-Reply-To: <875zv4yx4u.fsf@toke.dk> Cc: bloat To: =?utf-8?Q?Toke_H=C3=B8iland-J=C3=B8rgensen?= References: <9B37BCD5-9ADE-4E7D-8B5C-82830051831B@logicalwebhost.com> <87d0pdy5ik.fsf@toke.dk> <989E8F77-A96E-46AB-AEBD-2B47C5822924@logicalwebhost.com> <18FA4204-3E2E-48D6-9B51-7B1AC7767AA9@logicalwebhost.com> <875zv4yx4u.fsf@toke.dk> X-Mailer: Apple Mail (2.3445.102.3) Subject: Re: [Bloat] fq_codel on bridge throughput test/config X-BeenThere: bloat@lists.bufferbloat.net X-Mailman-Version: 2.1.20 Precedence: list List-Id: General list for discussing Bufferbloat List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Jan 2019 00:54:31 -0000 --Apple-Mail=_24CAE05A-3B21-47B3-8CD8-AA6D3FD1CE13 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 Okay, here=E2=80=99s what I have to get fq_codel enabled on bridge on = boot: crontab -e=20 # m h dom mon dow command @reboot /usr/src/start.fq_codel.sh vi /usr/src/start.fq_codel.sh #!/bin/bash /sbin/tc qdisc add dev enp1s0 root fq_codel /sbin/tc qdisc add dev enp2s0 root fq_codel chmod 755 /usr/src/start.fq_codel.sh it seems to be working under load (so far) though load will increase in = the next 24 hours so I=E2=80=99ll watch it, but here=E2=80=99s what I = get: tc -s qdisc show dev enp2s0 qdisc fq_codel 8002: root refcnt 2 limit 10240p flows 1024 quantum = 1514 target 5.0ms interval 100.0ms memory_limit 32Mb ecn Sent 4273930406 bytes 3059139 pkt (dropped 0, overlimits 0 requeues = 1269) backlog 0b 0p requeues 1269 maxpacket 54504 drop_overlimit 0 new_flow_count 401 ecn_mark 0 new_flows_len 0 old_flows_len 0 Should I change any settings? Where can I learn more about what my = requeues should be, or really any of the other settings? - Dev=20 > On Jan 4, 2019, at 12:40 PM, Toke H=C3=B8iland-J=C3=B8rgensen = wrote: >=20 > Dev > writes: >=20 >> Okay, thanks to some help from the list, I=E2=80=99ve configured a = transparent bridge running fq_codel which works for multiple subnet = traffic. Here=E2=80=99s my setup: >>=20 >> Machine A =E2=80=94=E2=80=94=E2=80=94 192.168.10.200 =E2=80=94 =E2=80=94= bridge fq_codel machine B =E2=80=94=E2=80=94 laptop C 192.168.10.150 >> Machine D =E2=80=94=E2=80=94=E2=80=94 192.168.3.50 =E2=80=94 =E2=80=94|= =20 >>=20 >> On Machine A: >>=20 >> straight gigE interface 192.168.10.200 >>=20 >> Bridge Machine B: enp3s0 mgmt interface >> enp2s0 bridge interface 1 >> enp1s0 bridge interface 2 >> br0 bridge for 1 and 2 >> =09 >> # The loopback network interface=20 >> auto lo br0=20 >> iface lo inet loopback=20 >>=20 >> # The primary network interface=20 >> allow-hotplug enp3s0=20 >> iface enp3s0 inet static=20 >> address 172.16.0.5/24=20 >> gateway 172.16.0.5=20 >> dns-nameservers 8.8.8.8 >>=20 >> iface enp1s0 inet manual=20 >> tc qdisc add dev enp1s0 root fq_codel=20 >>=20 >> iface enp2s0 inet manual=20 >> tc qdisc add dev enp2s0 root fq_codel=20 >>=20 >> # Bridge setup=20 >> iface br0 inet static=20 >> bridge_ports enp1s0 enp2s0=20 >> address 192.168.3.75=20 >> broadcast 192.168.3.255=20 >> netmask 255.255.255.0=20 >> gateway 192.168.3 >>=20 >> note: I still have to run this command later, will troubleshoot at >> some point (unless you have suggestions to make it work): >=20 > You can try setting the default qdisc to fq_codel; put: >=20 > net.core.default_qdisc=3Dfq_codel >=20 > in /etc/sysctl.conf >=20 > -Toke --Apple-Mail=_24CAE05A-3B21-47B3-8CD8-AA6D3FD1CE13 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8 Okay,= here=E2=80=99s what I have to get fq_codel enabled on bridge on = boot:

crontab = -e 

# m h  dom mon dow   command
@reboot /usr/src/start.fq_codel.sh

vi /usr/src/start.fq_codel.sh
  #!/bin/bash

  /sbin/tc qdisc add dev enp1s0 = root fq_codel
  /sbin/tc qdisc add dev enp2s0 = root fq_codel

chmod 755 /usr/src/start.fq_codel.sh

it seems to be working under load (so = far) though load will increase in the next 24 hours so I=E2=80=99ll = watch it, but here=E2=80=99s what I get:

tc -s qdisc show dev = enp2s0
  qdisc fq_codel 8002: root refcnt 2 = limit 10240p flows 1024 quantum 1514 target 5.0ms interval 100.0ms = memory_limit 32Mb ecn
  Sent 4273930406 bytes = 3059139 pkt (dropped 0, overlimits 0 requeues 1269)
  backlog 0b 0p requeues 1269
  = maxpacket 54504 drop_overlimit 0 new_flow_count 401 ecn_mark 0
  new_flows_len 0 old_flows_len 0

Should I change any settings? Where can I learn = more about what my requeues should be, or really any of the other = settings?

- Dev 

On Jan = 4, 2019, at 12:40 PM, Toke H=C3=B8iland-J=C3=B8rgensen <toke@toke.dk> = wrote:

Dev <dev@logicalwebhost.com> writes:

Okay, thanks to some help from the = list, I=E2=80=99ve configured a transparent bridge running fq_codel = which works for multiple subnet traffic. Here=E2=80=99s my setup:

Machine A =E2=80=94=E2=80=94=E2=80=94 = 192.168.10.200 =E2=80=94 =E2=80=94 bridge fq_codel machine B =E2=80=94=E2=80= =94 laptop C 192.168.10.150
Machine D =E2=80=94=E2=80=94=E2=80= =94 192.168.3.50 =E2=80=94 =E2=80=94| 

On Machine A:

straight gigE = interface 192.168.10.200

Bridge Machine B: = enp3s0 mgmt interface
enp2s0 bridge interface 1
= = = = enp1s0 bridge interface 2
br0 = bridge for 1 and 2

# The = loopback network interface 
auto lo = br0 
iface lo = inet loopback 

# The primary network = interface 
= allow-hotplug enp3s0 
iface = enp3s0 inet static 
= =  address = 172.16.0.5/24 
= =  gateway = 172.16.0.5 
= = dns-nameservers 8.8.8.8

iface = enp1s0 inet manual 
= =  tc qdisc add = dev enp1s0 root fq_codel 

=  iface enp2s0 = inet manual 
= = tc qdisc add dev enp2s0 root fq_codel 

=  # Bridge = setup 
= iface br0 inet static 
= bridge_ports enp1s0 enp2s0 
address = 192.168.3.75 
= = broadcast 192.168.3.255 
netmask = 255.255.255.0 
= = gateway 192.168.3

note: I still have = to run this command later, will troubleshoot at
some point = (unless you have suggestions to make it work):

You can try setting the default qdisc to fq_codel; = put:

net.core.default_qdisc=3Dfq_codel

in /etc/sysctl.conf

-Toke

= --Apple-Mail=_24CAE05A-3B21-47B3-8CD8-AA6D3FD1CE13--