From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-ej1-x62d.google.com (mail-ej1-x62d.google.com [IPv6:2a00:1450:4864:20::62d]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by lists.bufferbloat.net (Postfix) with ESMTPS id 33F743CB37 for ; Thu, 3 Feb 2022 10:28:55 -0500 (EST) Received: by mail-ej1-x62d.google.com with SMTP id ka4so9885887ejc.11 for ; Thu, 03 Feb 2022 07:28:55 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :content-transfer-encoding; bh=jtSsz4ysaSDIhlvRMpwjj9NdeqSX0d9XblxUnFlCXwo=; b=IOXENmF5cdSXyXoc0SGDatQcr5ykdsAunfHHp2zVr8m1cVWwu43ylY+e+OYGUQ8p7p 7Dpr9H6dKYEVfLOPYXw7MueV7g6RrILg3Q5ucYQS1Q0g068xn54ncfeKQqjsOAGwNOff KXibTekxYfLxp6j/vFjOqCFm2kTtrEOwox+MJ1mgC7wmJqxyaMcdiFAQ4YXVfnrt2zHn NnDrPUXY/ouV8w3ngKW4CKK0q0lWm7ueZXvM3mtKNPt13MdchXh9xizIxT5z9goZhQbz 2/d8j2Eeyba4/NRUgy6FVr2ANG3Qq3pediJSCLXmaETz+GnQ3P+l8LKSKa7JQvWndN8K Paiw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:content-transfer-encoding; bh=jtSsz4ysaSDIhlvRMpwjj9NdeqSX0d9XblxUnFlCXwo=; b=OLdvjMrhbGcaPOl+VAhlqC4c+H5++Qu+ufEU81BliBUmB+PFjrj/jqUkUv0rzQ3+1g jOKIGiPn6EE6IwJf5BTUETDJH5/cNX5n1uW3ljHtfhqpeVVTXsT9OJzleD11p8HmUhOu S72m2GgBaYMM6BdnQJjHDw3sLMXOEqwNlwkUcG/QwThmKlpGtLtSrwnRb1H26QasbC28 45DfNXUwmQy4p3T5cByej7LE0ohUglNEjzSnSBafzi4ZXetg1ZC0sXOeAPrVuwOtrKOL mX9p6uByOaG5F5DGQKlZq1yNaSIUz1TajotyIyLkDlIhqCojN4/euLaRFx7gP4VcR/4Q 7EBw== X-Gm-Message-State: AOAM532jo7oVqyUZh2iI1G/AgoO5LBezSqkpfhg3EYu6bIdFI2Kllq6o Ai85WUZsbogD9xIEAgrdfSw/uVvFOb1CniVt8MGwH9BFtTs= X-Google-Smtp-Source: ABdhPJy/uVO2FOwkciFB9TUlitv/bimyZY6c6tYJlvwUMWrm319+y1UJy0QwPSWMpuOimvPXvoXylC0d66W4hro6LQw= X-Received: by 2002:a17:907:7ba3:: with SMTP id ne35mr21295864ejc.128.1643902133928; Thu, 03 Feb 2022 07:28:53 -0800 (PST) MIME-Version: 1.0 References: <20220203015140.3022854-1-eric.dumazet@gmail.com> In-Reply-To: <20220203015140.3022854-1-eric.dumazet@gmail.com> From: Dave Taht Date: Thu, 3 Feb 2022 07:28:42 -0800 Message-ID: To: bloat Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Subject: [Bloat] On the road to 100Gbit... Fwd: [PATCH net-next 00/15] tcp: BIG TCP implementation X-BeenThere: bloat@lists.bufferbloat.net X-Mailman-Version: 2.1.20 Precedence: list List-Id: General list for discussing Bufferbloat List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 03 Feb 2022 15:28:55 -0000 ---------- Forwarded message --------- From: Eric Dumazet Date: Thu, Feb 3, 2022 at 12:05 AM Subject: [PATCH net-next 00/15] tcp: BIG TCP implementation To: David S . Miller , Jakub Kicinski Cc: netdev , Eric Dumazet , Coco Li , Eric Dumazet From: Eric Dumazet This series implements BIG TCP as presented in netdev 0x15: https://netdevconf.info/0x15/session.html?BIG-TCP Standard TSO/GRO packet limit is 64KB With BIG TCP, we allow bigger TSO/GRO packet sizes for IPv6 traffic. Note that this feature is by default not enabled, because it might break some eBPF programs assuming TCP header immediately follows IPv6 heade= r. Reducing number of packets traversing networking stack usually improves performance, as shown on this experiment using a 100Gbit NIC, and 4K MTU. 'Standard' performance with current (74KB) limits. for i in {1..10}; do ./netperf -t TCP_RR -H iroa23 -- -r80000,80000 -O MIN_LATENCY,P90_LATENCY,P99_LATENCY,THROUGHPUT|tail -1; done 77 138 183 8542.19 79 143 178 8215.28 70 117 164 9543.39 80 144 176 8183.71 78 126 155 9108.47 80 146 184 8115.19 71 113 165 9510.96 74 113 164 9518.74 79 137 178 8575.04 73 111 171 9561.73 Now enable BIG TCP on both hosts. ip link set dev eth0 gro_ipv6_max_size 185000 gso_ipv6_max_size 185000 for i in {1..10}; do ./netperf -t TCP_RR -H iroa23 -- -r80000,80000 -O MIN_LATENCY,P90_LATENCY,P99_LATENCY,THROUGHPUT|tail -1; done 57 83 117 13871.38 64 118 155 11432.94 65 116 148 11507.62 60 105 136 12645.15 60 103 135 12760.34 60 102 134 12832.64 62 109 132 10877.68 58 82 115 14052.93 57 83 124 14212.58 57 82 119 14196.01 We see an increase of transactions per second, and lower latencies as well. Coco Li (3): ipv6: Add hop-by-hop header to jumbograms in ip6_output ipvlan: enable BIG TCP Packets mlx5: support BIG TCP packets Eric Dumazet (11): net: add netdev->tso_ipv6_max_size attribute ipv6: add dev->gso_ipv6_max_size tcp_cubic: make hystart_ack_delay() aware of BIG TCP ipv6: add struct hop_jumbo_hdr definition ipv6/gso: remove temporary HBH/jumbo header ipv6/gro: insert temporary HBH/jumbo header net: increase MAX_SKB_FRAGS net: loopback: enable BIG TCP packets bonding: update dev->tso_ipv6_max_size macvlan: enable BIG TCP Packets mlx4: support BIG TCP packets Signed-off-by: Coco Li (1): ipv6: add GRO_IPV6_MAX_SIZE drivers/net/bonding/bond_main.c | 3 + .../net/ethernet/mellanox/mlx4/en_netdev.c | 3 + drivers/net/ethernet/mellanox/mlx4/en_tx.c | 47 ++++++++--- .../net/ethernet/mellanox/mlx5/core/en_main.c | 1 + .../net/ethernet/mellanox/mlx5/core/en_tx.c | 81 +++++++++++++++---- drivers/net/ipvlan/ipvlan_main.c | 1 + drivers/net/loopback.c | 2 + drivers/net/macvlan.c | 1 + include/linux/ipv6.h | 1 + include/linux/netdevice.h | 32 ++++++++ include/linux/skbuff.h | 14 +--- include/net/ipv6.h | 42 ++++++++++ include/uapi/linux/if_link.h | 3 + net/core/dev.c | 4 + net/core/gro.c | 20 ++++- net/core/rtnetlink.c | 33 ++++++++ net/core/skbuff.c | 21 ++++- net/core/sock.c | 6 ++ net/ipv4/tcp_cubic.c | 4 +- net/ipv6/ip6_offload.c | 32 +++++++- net/ipv6/ip6_output.c | 22 ++++- tools/include/uapi/linux/if_link.h | 3 + 22 files changed, 329 insertions(+), 47 deletions(-) -- 2.35.0.rc2.247.g8bbb082509-goog --=20 I tried to build a better future, a few times: https://wayforward.archive.org/?site=3Dhttps%3A%2F%2Fwww.icei.org Dave T=C3=A4ht CEO, TekLibre, LLC