From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from NAM02-BL2-obe.outbound.protection.outlook.com (mail-eopbgr750070.outbound.protection.outlook.com [40.107.75.70]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by lists.bufferbloat.net (Postfix) with ESMTPS id 9C33F3B29D for ; Mon, 16 Dec 2019 18:37:20 -0500 (EST) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=Aj6PXZ2n+ba70mTQkPJwyU2cNgXnMT7hvUOH64FbSqHcXyI0IxG2dkgAiL6vHP9iuwTu+jT//5ZpYZYn9SaUCZB06/y14GA9K08iY5rLTNIZYVppqjbRZf4PZ1TUBdkvDSelxHLFP/uftQlFVjk0YKyI5bOobCjvNVCpMOnaICkvMz3wg1KEUC11QNttcXsq64dKW8wKOrERozh4nismzoRFs2LFcmrSbFRXoEp1INba3IFhFS+wdCseDzNavI4Qzzl+V5vUxw828147ViT880Rw/afvPan9d3DtsW5QhgkBLa4jFFd4kagJJj1iDleJrDiqlRK0EEbPM4kdOJ32Cg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=x9MpKfGOvJhm7HuIrl9SZd03aINeYFO5+Ko/8tJJtak=; b=Kujr912cTqvnZilF8zsfyWI0wJofNhOQHNdm/ywzcDZe6OMrUEwHXFDk6ydeVULsda1yOe4WkyX73bjAbI2n4FRGKJ5wP5tOpPjIgzyEBdYR/S7x2vxmBah9GoeYp8EIs4wBRNcu3gU9SCs/rjbn8b55BRUt0opVAMT22mqQLkbgvw+JdaOtykdeQdB2ufVUb4PGvyX3HKeQyydAK4gfXJlpc7JRr9GxU7w0VyPUw+LtLF72JD3pgTPviEccpL7NcIdR5LZ0ksA4cPOxk9nUy7Y/Vs9sVomFMs5mhPxw3plVecliZGqpZ1LsjaLY9qj3RvIjoq07RDUB96yllBxNpw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=micron.com; dmarc=pass action=none header.from=micron.com; dkim=pass header.d=micron.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=micron.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=x9MpKfGOvJhm7HuIrl9SZd03aINeYFO5+Ko/8tJJtak=; b=PTsbvgmuxNn8c1K+zsnxz0wg+Zj2w1CXGf0Culw54+Adotm6Sx+N7zryGOdAGir/nnkNWe2aMZ7C3iOL7ed0IgB4Qoy1DAOHACSqlnbNaUaCaZ3X3+EyhvvIf+glMk3/uwfe8zyT8vZcFtudjeulZxGPoK0rewb/YJAQEE0C/fc= Received: from SN6PR08MB5599.namprd08.prod.outlook.com (20.177.255.223) by SN6PR08MB4543.namprd08.prod.outlook.com (52.135.113.202) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2538.15; Mon, 16 Dec 2019 23:37:19 +0000 Received: from SN6PR08MB5599.namprd08.prod.outlook.com ([fe80::e40f:788d:69f:b0c5]) by SN6PR08MB5599.namprd08.prod.outlook.com ([fe80::e40f:788d:69f:b0c5%7]) with mapi id 15.20.2538.019; Mon, 16 Dec 2019 23:37:19 +0000 From: "Andrew Falanga (afalanga)" To: "bloat@lists.bufferbloat.net" Thread-Topic: Tuning fq_codel for 40Gb rates Thread-Index: AQHVtGg1gI2waM37t0u40Wd2XnA1vg== Date: Mon, 16 Dec 2019 23:37:19 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: spf=none (sender IP is ) smtp.mailfrom=afalanga@micron.com; x-originating-ip: [104.129.198.251] x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: e58fc896-6277-46bf-5e56-08d78280e43e x-ms-traffictypediagnostic: SN6PR08MB4543:|SN6PR08MB4543:|SN6PR08MB4543: x-microsoft-antispam-prvs: x-ms-exchange-transport-forked: True x-ms-oob-tlc-oobclassifiers: OLM:9508; x-forefront-prvs: 02530BD3AA x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(4636009)(396003)(39860400002)(136003)(366004)(376002)(346002)(199004)(189003)(33656002)(186003)(55236004)(26005)(81156014)(966005)(478600001)(71200400001)(66476007)(52536014)(7696005)(66946007)(86362001)(9686003)(55016002)(66446008)(316002)(5660300002)(8676002)(2906002)(66556008)(64756008)(6916009)(8936002)(81166006)(76116006)(6506007); DIR:OUT; SFP:1101; SCL:1; SRVR:SN6PR08MB4543; H:SN6PR08MB5599.namprd08.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; A:1; MX:1; received-spf: None (protection.outlook.com: micron.com does not designate permitted sender hosts) x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: 9yPKAp+sijAeiP8qvjWyKbisx+7tnZ7nhSDcceBGe6oQbCXdNG2MscGMB+6sYUT+QhvAF5nL1UXmQJQs2dCOgpq8BBatfmZBm5FJrsIuSmvEhhAQs2Cfd18cPKOhDo8qi046S/wVcnBEUtE9O7EKavYh2bPh651llARBo3g7x33GmlQHXKMvRaPbQh/9QQLWnjs6I4BzAmMQgT5HLmO9NWMRzMmi1evJSkFolxrDijkEUsAENhSERBDX45r46Ho1BWCBU69v3UjiXP0gtjjahZMP5FxAnxGBIFWr9Eypoa2LVMpwIzGV8KTptNvA3dtOljsiauUsd5Uik+yCp+sNm4Vvjo9eIYrEX5wDWxVTolKgQh5rZIPRKXPgG9EjYEhJaHIYye+n+sTuz6tBAocIqYM80TdZAJ19m7nfp4M/68SXuWEjsNjsV4nJnYk4pJn4f/w4XMOmEfvJzy7IKCzLDgmGI42QOXVXElyhnUdZXY0= Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: micron.com X-MS-Exchange-CrossTenant-Network-Message-Id: e58fc896-6277-46bf-5e56-08d78280e43e X-MS-Exchange-CrossTenant-originalarrivaltime: 16 Dec 2019 23:37:19.1802 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: f38a5ecd-2813-4862-b11b-ac1d563c806f X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: PKFRe6gD523iBhlfifNgT6PaQki/kjwRC221gQb+NgDuzXFnK9+OZwybf297AIM4s7Bfa16MEEPiwLWrA+YMtg== X-MS-Exchange-Transport-CrossTenantHeadersStamped: SN6PR08MB4543 Subject: [Bloat] Tuning fq_codel for 40Gb rates X-BeenThere: bloat@lists.bufferbloat.net X-Mailman-Version: 2.1.20 Precedence: list List-Id: General list for discussing Bufferbloat List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 16 Dec 2019 23:37:20 -0000 Hello,=0A= =0A= I've been reading over some papers on the Buffer Bloat site.=A0 This one in= particular has been quite informative: https://www.bufferbloat.net/project= s/codel/wiki/Best_practices_for_benchmarking_Codel_and_FQ_Codel/#tuning-fq-= codel.=A0 I have a private LAN in which several systems are connected via a= n enterprise class 40Gb switch.=A0I'm tuning the settings for fq_codel, the= QDisc chosen to eliminate many problems seen earlier.=A0 This article ment= ions how fq_codel is well tuned for 1 and 10Gb speeds and makes mention of = slower speeds.=A0 Are there suggestions about how to tune the parameters fo= r 40Gb? I'm adjusting the parameters and the BQL values attempting to achi= eve as close to 40Gb speeds as possible. The systems are CentOS 7.6 (kerne= l 3.10.0) and a Mellanox NIC (Connectx 4). The network is configured for 9= 000 byte MTUs.=A0 In lieu of this, I'm setting the quantum value to 9014.= =0A= =0A= =0A= =0A= Andrew Falanga=0A= ENGINEER - SIG SYSTEM SOFTWARE=0A= MSIG Equipment Engineering=0A= Micron Technology, Inc.=0A= Office:=A0+1 (208) 368-4022 =A0Fax:=A0(208)368-2807=0A= =0A= Email: =0A= afalanga@micron.com=