From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-qt1-x836.google.com (mail-qt1-x836.google.com [IPv6:2607:f8b0:4864:20::836]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by lists.bufferbloat.net (Postfix) with ESMTPS id EE37A3BA8E for ; Fri, 4 Jan 2019 13:57:26 -0500 (EST) Received: by mail-qt1-x836.google.com with SMTP id e5so41366266qtr.12 for ; Fri, 04 Jan 2019 10:57:26 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=I2D7fQdJfXDlWuDZd4AYVn082FA2MhsKWiUQpZYar64=; b=ozzQVnOPBwAfNSX7xK4CaZe+GiE3Q5MTO7ZGbJaticF4wxHTROCTL1zkzUHCQfh+o0 x5grCWWwXbVwCjwEys9R1a8nttgtkc3PEEULo1w/cV8GyQSzWAWNYzfo5xG7ncozTxGi S+TcJyA2KeTQsFGCHcRY5gC2D25tB9u08bsXrzWRX4jArbs86KSUBDJQvqGoEhC0ps5f uY2iH5Dj22bFSEVSSEiX5Najdx5oBW62MVl2aaiBAWZ/E3i/M3cPd7Yrcwo92GJhfbwS sa4/zIUp7Nly7Vi3idBRUiOoEf9XpDEQqkQViI0PIX+bUc7m+JHoQWgD9+ZVbwy5im/g oJqA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=I2D7fQdJfXDlWuDZd4AYVn082FA2MhsKWiUQpZYar64=; b=a5jJHvmMAovCizFCpepGq8UN/lw1NF5+53zvwnj0V8yoa1+9wQcwYnbIO98GpvFAac jLxVdKcy9fOQ8S8ERUI2PATZE/NzfP8XmmNVMTm80QFyFMUWbVpeI1+U7vynUAy1cYG6 DzHw9lvhZc98GVynIk9rnQQfmda2f3yFpHzzt5Zuo87hFKaNe6xA50ENB/WdI8t5MTk4 fBwUerRMHP0wFkaPljGE8+rPyrBBXZqYjPICoKlILYvwK4qCOU7rHzEG2t3csy6W2NDg tCW03gmdA6pejdpQ5zQ4G2SLOWmviN/mJApqxG5LaV/veQ5tc5ESvSEo1vVkSdhNAZ03 mfWg== X-Gm-Message-State: AJcUukd02N7bzSJaEshNyl68AofJV7zLeJ1VxszdnW2cxX2WWcZocj1d TBCyuj4o2qoH9X1ylxkUjtlNBA7CGaBvzMNL0ZFx3Q== X-Google-Smtp-Source: ALg8bN4cEEwdNJ/lxi0I0qlPNJuIMnZUl3pQKBJcigMolSARG65IrYivOr0tWrDNCUtJ+SNVspJermZnHs3xBsR+cj0= X-Received: by 2002:a0c:8a5a:: with SMTP id 26mr50940068qvu.94.1546628246446; Fri, 04 Jan 2019 10:57:26 -0800 (PST) MIME-Version: 1.0 References: <9B37BCD5-9ADE-4E7D-8B5C-82830051831B@logicalwebhost.com> <87d0pdy5ik.fsf@toke.dk> <989E8F77-A96E-46AB-AEBD-2B47C5822924@logicalwebhost.com> In-Reply-To: <989E8F77-A96E-46AB-AEBD-2B47C5822924@logicalwebhost.com> From: Dave Taht Date: Fri, 4 Jan 2019 10:57:12 -0800 Message-ID: To: Dev Cc: Pete Heist , bloat Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Subject: Re: [Bloat] fq_codel on bridge multiple subnets? X-BeenThere: bloat@lists.bufferbloat.net X-Mailman-Version: 2.1.20 Precedence: list List-Id: General list for discussing Bufferbloat List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Jan 2019 18:57:27 -0000 Well, good nics are best. :) One reason why the apu2 series is so popular is because it uses the extremely good intel chipset. On Fri, Jan 4, 2019 at 10:20 AM Dev wrote: > > I want to pass multiple hundreds of Mbps across this bridge very consiste= ntly, and across multiple subnets to different enterprise gateways which th= en connect to the internet, will plan a little test to see how this does un= der load. Hopefully I don=E2=80=99t need special NIC=E2=80=99s to handle it= ? > > > On Jan 4, 2019, at 1:19 AM, Pete Heist wrote: > > > > It=E2=80=99s a little different for me in that I=E2=80=99m rate limitin= g on one of the physical interfaces, but otherwise, your setup should reduc= e latency under load when the Ethernet devices are being used at line rate. > > > > If your WAN interface is enp8s0 and goes out to the Internet, you may w= ant to shape there (htb+fq_codel or cake) depending on what upstream device= is in use. > > > > If enp7s6 and enp9s2 are only carrying LAN traffic, and not traffic tha= t goes out to the Internet, fq_codel=E2=80=99s target and interval could be= reduced. > > > >> On Jan 4, 2019, at 6:22 AM, Dev wrote: > >> > >> Okay, so this is what I have for /etc/network/interfaces (replaced eth= 0-2 with what Debian Buster actually calls them): > >> > >> auto lo br0 > >> iface lo inet loopback > >> > >> allow-hotplug enp8s0 > >> iface enp8s0 inet static > >> address 192.168.10.200 > >> netmask 255.255.255.0 > >> gateway 192.168.10.1 > >> dns-nameservers 8.8.8.8 > >> > >> iface enp7s6 inet manual > >> tc qdisc add dev enp7s6 root fq_codel > >> > >> iface enp9s2 inet manual > >> tc qdisc add dev enp9s2 root fq_codel > >> > >> # Bridge setup > >> iface br0 inet static > >> bridge_ports enp7s6 enp9s2 > >> #bridge_stp on > >> address 192.168.3.50 > >> broadcast 192.168.3.255 > >> netmask 255.255.255.0 > >> gateway 192.168.3.1 > >> dns-nameservers 8.8.8.8 > >> > >> so my bridge interfaces now show: > >> > >>> : tc -s qdisc show dev enp7s6 > >> qdisc fq_codel 0: root refcnt 2 limit 10240p flows 1024 quantum 1514 t= arget 5.0ms interval 100.0ms memory_limit 32Mb ecn > >> Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0) > >> backlog 0b 0p requeues 0 > >> maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0 > >> new_flows_len 0 old_flows_len 0 > >> > >> and > >> > >>> : tc -s qdisc show dev enp9s2 > >> qdisc fq_codel 0: root refcnt 2 limit 10240p flows 1024 quantum 1514 t= arget 5.0ms interval 100.0ms memory_limit 32Mb ecn > >> Sent 12212 bytes 80 pkt (dropped 0, overlimits 0 requeues 0) > >> backlog 0b 0p requeues 0 > >> maxpacket 0 drop_overlimit 0 new_flow_count 0 ecn_mark 0 > >> new_flows_len 0 old_flows_len 0 > >> > >> with my bridge like: > >> > >> ip a > >> > >> 5: br0: mtu 1500 qdisc noqueue state= UP group default qlen 1000 > >> link/ether 00:04:5a:86:a2:84 brd ff:ff:ff:ff:ff:ff > >> inet 192.168.3.50/24 brd 192.168.3.255 scope global br0 > >> valid_lft forever preferred_lft forever > >> inet6 fe80::204:5aff:fe86:a284/64 scope link > >> valid_lft forever preferred_lft forever > >> > >> So do I have it configured right or should I change something? I haven= =E2=80=99t gotten a chance to stress test it yet, but will try tomorrow. > >> > >> - Dev > >> > >>> On Jan 3, 2019, at 10:54 AM, Pete Heist wrote: > >>> > >>> > >>>> On Jan 3, 2019, at 7:12 PM, Toke H=C3=B8iland-J=C3=B8rgensen wrote: > >>>> > >>>> Dev writes: > >>>> > >>>>> I=E2=80=99m trying to create a bridge on eth1 and eth2, with a mana= gement > >>>>> interface on eth0, then enable fq_codel on the bridge. My bridge > >>>>> interface looks like: > >>>> > >>>> You'll probably want to put FQ-CoDel on the underlying physical > >>>> interfaces, as those are the ones actually queueing the traffic... > >>> > >>> I can confirm that. I'm currently using a bridge on my home router. e= th3 and eth4 are bridged, eth4 is connected to the CPE device which goes ou= t to the Internet, eth4 is where queue management is applied, and this work= s. It does not work to add this to br0=E2=80=A6 > >>> > >> > > > > _______________________________________________ > Bloat mailing list > Bloat@lists.bufferbloat.net > https://lists.bufferbloat.net/listinfo/bloat --=20 Dave T=C3=A4ht CTO, TekLibre, LLC http://www.teklibre.com Tel: 1-831-205-9740