From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-wr0-x241.google.com (mail-wr0-x241.google.com [IPv6:2a00:1450:400c:c0c::241]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by lists.bufferbloat.net (Postfix) with ESMTPS id 139F73B29E for ; Sat, 4 Nov 2017 14:45:27 -0400 (EDT) Received: by mail-wr0-x241.google.com with SMTP id u40so5091141wrf.10 for ; Sat, 04 Nov 2017 11:45:27 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:subject:from:in-reply-to:date:cc:message-id:references :to; bh=e5O0lHgaStuEoftB7uNTnjoNSgUaSRvjbxXU4umjoQc=; b=DsFMZ+M2FROzTZP/ZwJWhnCQiLsDMq0pci34FlDO9t/Tmjq2yjSskO9MGO9tumIS+g GskmOgOtngzc/RrkRj/18Ma58WHiwOWMCh9gitmou515I0Ig/Fc4Mqn7kJieI/DnZHei IgRvKIkkg8qrRUCp5SXWp0/bnah9wN4YsQy8SL/8vKKw1a6mOI7X+p5SsS1Bio9M2aHe L3rjvWRB6pMjjLY0Z97tA2R71ept0TlsU0GDAetZwEb1t5wm9S8h4lUD9yCGsPn0nTuL R8/1NP/N4NGRRHeJwvBJG3rNf7Lz8lHpI0A/RkwHmMLDeMjIEfmLnkBjsStYPSjuVN+k yQ7A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:subject:from:in-reply-to:date:cc :message-id:references:to; bh=e5O0lHgaStuEoftB7uNTnjoNSgUaSRvjbxXU4umjoQc=; b=JD0BwvAULYvdt1SVSY+XoLzgXFxOxGMdXHlQdG9Fz3L+pXZvX91x50SKvNf9zPhIUW pEQ4DBhKFSkkktIMYaSZI2s62QXHWjAC5OR6kwr29+A0/wNridE6U48733Sbi/HbyVVP J3r1XES0eXo3a2SUbNP92Qxca9bw486aqhKBH1Z8JDGtQ7DUs4KlivtykFMFfYVzdr6n liRxewH3lu9xz1ws2u30lnmMeSEp+Wg+pFgp+vQJoNSmqOyPrpHXn3gcIvqlLxN8X2Jw 26AjvhMksZRMmqnb2OLpIh8OvsRast8sv8g6fKlybodTl8im+d51Mjw8No3wcQnnhfwh +vYQ== X-Gm-Message-State: AMCzsaVsC0rdsMjPBZT4fZlZnV19HjopKzRoSZXzSyL1wx2YfweNS/gU /jA+9GSeOe8nW4Yb9xaP+Sk= X-Google-Smtp-Source: ABhQp+SFFdlVhrNx8X/qcQ+oaKA1u7oRex9hjtqH/iiDDQmUwRIyVS4R9Nbr8C0BrzAufJBlO4ZCnA== X-Received: by 10.223.196.174 with SMTP id m43mr9606578wrf.7.1509821127012; Sat, 04 Nov 2017 11:45:27 -0700 (PDT) Received: from [10.72.0.130] (h-1169.lbcfree.net. [185.99.119.68]) by smtp.gmail.com with ESMTPSA id c67sm4421545wmd.25.2017.11.04.11.45.25 (version=TLS1 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Sat, 04 Nov 2017 11:45:26 -0700 (PDT) Content-Type: multipart/alternative; boundary="Apple-Mail=_243EE419-7582-48E0-84E8-1CF2760D5B55" Mime-Version: 1.0 (Mac OS X Mail 9.3 \(3124\)) From: Pete Heist In-Reply-To: <2A142BA8-7F40-48CE-8814-D09FD3FA99A7@gmx.de> Date: Sat, 4 Nov 2017 19:45:24 +0100 Cc: make-wifi-fast@lists.bufferbloat.net Message-Id: <6ECC360D-8974-4364-8BC5-689FCE32B2F3@gmail.com> References: <535CD0D7-CB3A-4C42-AB13-548313F9002A@gmail.com> <11277896-AEBE-4C29-8E9F-35CC4307DA35@gmx.de> <2A142BA8-7F40-48CE-8814-D09FD3FA99A7@gmx.de> To: Sebastian Moeller X-Mailer: Apple Mail (2.3124) Subject: Re: [Make-wifi-fast] Flent test hardware X-BeenThere: make-wifi-fast@lists.bufferbloat.net X-Mailman-Version: 2.1.20 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 04 Nov 2017 18:45:28 -0000 --Apple-Mail=_243EE419-7582-48E0-84E8-1CF2760D5B55 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 > On Nov 4, 2017, at 6:25 PM, Sebastian Moeller wrote: >=20 > Hi Pete, >=20 >> or =E2=80=9Cethtool -i eth0=E2=80=9D, >=20 > user@work-horse:~$ ethtool -i eth0 > driver: tg3 > version: 3.137 > firmware-version: 5720-v1.37 NCSI v1.3.12.0 > expansion-rom-version:=20 > bus-info: 0000:03:00.0 > supports-statistics: yes > supports-test: yes > supports-eeprom-access: yes > supports-register-dump: yes > supports-priv-flags: no >=20 > user@work-horse:~$ ethtool -k eth0 > Features for eth0: > rx-checksumming: on > tx-checksumming: on > tx-checksum-ipv4: on > tx-checksum-ip-generic: off [fixed] > tx-checksum-ipv6: on > tx-checksum-fcoe-crc: off [fixed] > tx-checksum-sctp: off [fixed] > scatter-gather: on > tx-scatter-gather: on > tx-scatter-gather-fraglist: off [fixed] > tcp-segmentation-offload: on > tx-tcp-segmentation: on > tx-tcp-ecn-segmentation: on > tx-tcp-mangleid-segmentation: off > tx-tcp6-segmentation: on > udp-fragmentation-offload: off [fixed] > generic-segmentation-offload: on > generic-receive-offload: on > large-receive-offload: off [fixed] > rx-vlan-offload: on [fixed] > tx-vlan-offload: on [fixed] > ntuple-filters: off [fixed] > receive-hashing: off [fixed] > highdma: on > rx-vlan-filter: off [fixed] > vlan-challenged: off [fixed] > tx-lockless: off [fixed] > netns-local: off [fixed] > tx-gso-robust: off [fixed] > tx-fcoe-segmentation: off [fixed] > tx-gre-segmentation: off [fixed] > tx-gre-csum-segmentation: off [fixed] > tx-ipxip4-segmentation: off [fixed] > tx-ipxip6-segmentation: off [fixed] > tx-udp_tnl-segmentation: off [fixed] > tx-udp_tnl-csum-segmentation: off [fixed] > tx-gso-partial: off [fixed] > tx-sctp-segmentation: off [fixed] > fcoe-mtu: off [fixed] > tx-nocache-copy: off > loopback: off [fixed] > rx-fcs: off [fixed] > rx-all: off [fixed] > tx-vlan-stag-hw-insert: off [fixed] > rx-vlan-stag-hw-parse: off [fixed] > rx-vlan-stag-filter: off [fixed] > l2-fwd-offload: off [fixed] > busy-poll: off [fixed] > hw-tc-offload: off [fixed] It=E2=80=99s tg3 indeed, super, thanks. I may have to be disabling some = of those offloads, but that=E2=80=99s typical. >> or similar? If so, I see BQL support in that code, >=20 > I believe sometime in the past I confirmed BQL working, but my = memory is hazy and this might have been a different machine=E2=80=A6 I=E2=80=99m sure it works, from what I see in tg3.c. Support was added = in Nov. 2011 by people with experience doing this, and it uses the = multi-queue interfaces also. It looks good. = https://github.com/torvalds/linux/commit/298376d3e8f00147548c426959ce79efc= 47b669a = = https://github.com/torvalds/linux/commit/5cb917bc4f3882ecee870644831110230= 86757d3 = >> I see a Gen 10 available here for slightly more with the same BCM5720 = NIC, and a AMD Opteron X3216 instead, plus 8 gigs of RAM, which I = don=E2=80=99t need really, but I can search more for similar hardware: = https://www.alza.cz/hpe-proliant-microserver-gen10-d5127723.htm?o=3D1 = >=20 > Then gen10 microserver while newer comes with a soldered in = pre-ZEN amd cpu and seems less extensible then the gen8, but then the = gen10 probly is also a decent machine. There is a difference in TDP (35W for gen 8 and 15W for gen 10), which I = might appreciate in the smaller space I have for it, otherwise the CPU = benchmark differences look minimal. As is often the case, the new = generation may be as much about lowering costs as anything else. The = Czech retailer I use only has the gen 10 now, so I=E2=80=99ll probably = choose it if only because of that. I wonder if this would be enough of a machine to run both the client and = server, one on each NIC, then I could use a USB NIC for management. Have = you tried this with Flent? There would be no time sync issue. :) I would = not be surprised if this affects the results on higher counts of streams = though, or I might be missing other reasons why this is a bad idea. I=E2=80=99ll go for at least one of these, but still deciding if to have = an early Christmas and go for two=E2=80=A6 --Apple-Mail=_243EE419-7582-48E0-84E8-1CF2760D5B55 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8
On Nov 4, 2017, at 6:25 PM, Sebastian Moeller <moeller0@gmx.de> = wrote:

Hi Pete,

or = =E2=80=9Cethtool -i eth0=E2=80=9D,

user@work-horse:~$ = ethtool -i eth0
driver: tg3
version: 3.137
firmware-version: = 5720-v1.37 NCSI v1.3.12.0
expansion-rom-version: 
bus-info: = 0000:03:00.0
supports-statistics: yes
supports-test: = yes
supports-eeprom-access: yes
supports-register-dump: yes
supports-priv-flags: no

user@work-horse:~$ ethtool -k = eth0
Features for eth0:
rx-checksumming: on
tx-checksumming: = on
tx-checksum-ipv4: on
tx-checksum-ip-generic: off [fixed]
tx-checksum-ipv6: = on
tx-checksum-fcoe-crc: off [fixed]
tx-checksum-sctp: = off [fixed]
scatter-gather: on
= tx-scatter-gather: on
tx-scatter-gather-fraglist: off [fixed]
tcp-segmentation-offload: on
= tx-tcp-segmentation: on
tx-tcp-ecn-segmentation: on
= tx-tcp-mangleid-segmentation: = off
tx-tcp6-segmentation: on
udp-fragmentation-offload: off [fixed]
generic-segmentation-offload: on
generic-receive-offload: on
large-receive-offload: off = [fixed]
rx-vlan-offload: on [fixed]
tx-vlan-offload: on = [fixed]
ntuple-filters: off [fixed]
receive-hashing: = off [fixed]
highdma: on
rx-vlan-filter: off [fixed]
vlan-challenged: = off [fixed]
tx-lockless: off [fixed]
netns-local: off = [fixed]
tx-gso-robust: off [fixed]
tx-fcoe-segmentation:= off [fixed]
tx-gre-segmentation: off [fixed]
tx-gre-csum-segmentation: off [fixed]
tx-ipxip4-segmentation: off [fixed]
tx-ipxip6-segmentation: off [fixed]
tx-udp_tnl-segmentation: off [fixed]
tx-udp_tnl-csum-segmentation: off [fixed]
tx-gso-partial: off = [fixed]
tx-sctp-segmentation: off [fixed]
fcoe-mtu: off = [fixed]
tx-nocache-copy: off
loopback: off = [fixed]
rx-fcs: off [fixed]
rx-all: off = [fixed]
tx-vlan-stag-hw-insert: off [fixed]
rx-vlan-stag-hw-parse: off [fixed]
rx-vlan-stag-filter: = off [fixed]
l2-fwd-offload: off [fixed]
busy-poll: off = [fixed]
hw-tc-offload: off [fixed]

It=E2=80=99s tg3 indeed, super, thanks. I may have = to be disabling some of those offloads, but that=E2=80=99s = typical.

or similar? If so, I see BQL support in that code,

I believe sometime in the past I confirmed BQL = working, but my memory is hazy and this might have been a different = machine=E2=80=A6

I=E2=80=99m sure it works, from what I see in = tg3.c. Support was added in Nov. 2011 by people with experience doing = this, and it uses the multi-queue interfaces also. It looks = good.



I see a Gen 10 available = here for slightly more with the same BCM5720 NIC, and a AMD Opteron = X3216 instead, plus 8 gigs of RAM, which I don=E2=80=99t need really, = but I can search more for similar hardware: https://www.alza.cz/hpe-proliant-microserver-gen10-d5127723.htm= ?o=3D1

= Then gen10 microserver while newer comes = with a soldered in pre-ZEN amd cpu and seems less extensible then the = gen8, but then the gen10 probly is also a decent machine.

There is a difference in TDP (35W for gen 8 = and 15W for gen 10), which I might appreciate in the smaller space I = have for it, otherwise the CPU benchmark differences look minimal. As is = often the case, the new generation may be as much about lowering costs = as anything else. The Czech retailer I use only has the gen 10 now, so = I=E2=80=99ll probably choose it if only because of that.

I wonder if this would = be enough of a machine to run both the client and server, one on each = NIC, then I could use a USB NIC for management. Have you tried this with = Flent? There would be no time sync issue. :) I would not be surprised if = this affects the results on higher counts of streams though, or I might = be missing other reasons why this is a bad idea.

I=E2=80=99ll go for at least one of = these, but still deciding if to have an early Christmas and go for = two=E2=80=A6

= --Apple-Mail=_243EE419-7582-48E0-84E8-1CF2760D5B55--