From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from CAN01-YT3-obe.outbound.protection.outlook.com (mail-yt3can01on2129.outbound.protection.outlook.com [40.107.115.129]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by lists.bufferbloat.net (Postfix) with ESMTPS id EDC4D3B2A4 for ; Sun, 23 Oct 2022 10:08:04 -0400 (EDT) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=I73N4WFJc18mA3DyTIKePFJOm6owx4Jd7MEVKBrj1giAuCU5vHy/ixMyDdCNATrGYvZONZzt2qZsVYkX1FkNKvsQnsYqRMpRT4lHWEEJMapIE394T01l/yschjaYYbKhdmeXgV1EXChXRV4xLbp7YldosH8pwQFcX799V5dj89wB16/HDClzTDb3sU5ZCMYhooDegt1/pTaB/vEbviICeaRPoUODkvBlLAjsgAeTXFKMLJVBwL2qR9xmw5QFepK3UPZ23LuXZT2FpRXNUMPCb/khut2Ie3lpeNjoP7SAKbhziyhS2PSVgSD0vrR10aHkuANeebDR4KB0+Ab7HdXsUw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=YmRhfIbmMK0NMB76pqL7T7QUcqmJgNLeANx9c1QmtSk=; b=hbNSVXCg8pZAR+uWo+Ipmg7+k8u8v2PEFOoVtXK2l1R65gotC5QlSMb41cI1qvg4UgRmhv17keI3PFxZSYnRI+ipmFD3BgUIHEGD9nrataZSdn2yaGTnP+jjKvQg+co7QoBa2Z/Q+R/bOEvjLR2ryBxvFIFLSNOpmaz3TkjDkfUwrhykOS9EJ36ubJQVpp2XvfaXyf/4csJ+HOHUkaWWVYOLn5Og3ogJKMU1LResP9YDMXX6oZ51+NgA3vHiFGEGfAvIER3w2qGQj0eiWNkyNM+7yDDJNcbnUa6/+U06CwTnTStB33xyO9ToDeOGrZKrTIe8u4Z6d4O6/1rG+HQXAw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=indexexchange.com; dmarc=pass action=none header.from=indexexchange.com; dkim=pass header.d=indexexchange.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=indexexchange.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=YmRhfIbmMK0NMB76pqL7T7QUcqmJgNLeANx9c1QmtSk=; b=IxOdjYrRZsokfPGDVrAuPcHTOTI4gtX0NLeQabMbO8BA9TjQah71TJI8dGxr1PfLumiqkWJ4f9j1FuWiIpSA+B1+ZFiDl3Y+P0KBf1WNP31lGITej9XXqgE4UH5exxzck37M7C+CbohqDV8+UAiSPUEr9wMkZ3zAkU2LITaom20= Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=indexexchange.com; Received: from YQXPR01MB4756.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c01:1e::12) by YT3PR01MB8868.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:b01:7d::9) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5746.21; Sun, 23 Oct 2022 14:08:02 +0000 Received: from YQXPR01MB4756.CANPRD01.PROD.OUTLOOK.COM ([fe80::d3d7:5363:e565:8944]) by YQXPR01MB4756.CANPRD01.PROD.OUTLOOK.COM ([fe80::d3d7:5363:e565:8944%9]) with mapi id 15.20.5746.023; Sun, 23 Oct 2022 14:08:02 +0000 Content-Type: multipart/alternative; boundary="------------064fGbelvfqcA7coGJSOPesP" Message-ID: <1575107a-ce9f-e5ce-7611-74ea1496cbd5@indexexchange.com> Date: Sun, 23 Oct 2022 10:08:01 -0400 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.2.2 Content-Language: en-US To: Sebastian Moeller Cc: starlink@lists.bufferbloat.net References: <339AB8BC-9628-40E2-9339-77FCFA74488D@gmx.de> <0e811787-cc55-8db9-2a4b-7706813769da@indexexchange.com> <850ACED5-3345-441E-9A92-BF27B21EABF5@gmx.de> <78ae1fce-b23a-ef67-e486-72c26d2bbe30@indexexchange.com> <93A92B00-AB22-414A-9A05-B887262E5A8E@gmx.de> From: Dave Collier-Brown In-Reply-To: <93A92B00-AB22-414A-9A05-B887262E5A8E@gmx.de> X-ClientProxiedBy: YT3PR01CA0026.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:b01:86::14) To YQXPR01MB4756.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c01:1e::12) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: YQXPR01MB4756:EE_|YT3PR01MB8868:EE_ X-MS-Office365-Filtering-Correlation-Id: 43a1d7c8-a7be-43f3-d07c-08dab4ffff99 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: K+npdqydiKqH9Hsi1z5HQUFs4lhY+MPGOwZvnV9ync6GGhohKT9FlKZXK1ViNv4p0UelWO2r1Iaff9IahEMIXYSjptXmoFqSXVgPBH5pBFuKTXaCgrjnFrXdYHydCumEZleRpZHq8gF0lAHqklnk2sm9iyhWrOGrU71wLPN8d9ca7N3dxhRKNSiNNxNN3k6y1MogxWVR3l8SmRoWiNReqy0Jpk85ezbmrDsNO4BXHs1eNCEF7zKHjm4daF2BwTd4Sb61o94wnjRLWhaRmwpuRXY525DtEN/OKrhOL2xl2rFP67eNH2JsBeRe+vesuE65maT3givvy+t2H4rua32NUWoHlOhDLQICA8MIcZVQOywu/qTzUmLwbhXOlqvOhcAC+1ubW3oxGU2KA7cE2dmAO71wVYpRp0jsdS3cpVCp75Wz2+xh/S4DgXmSfBZRCoJwj9+nQ4YPRbWA8KioraUYgHm3quy0IREuDWohC5c9GjxpAjvKKPd8wYSJjQGt+Es2tK0IIc3QNugYqynUpngT2zoeFIBY5MMPCBxoK+dhrv5wAAgYDbnt/Ai5DB1MKXkwb7SYjI/C8qhz2rGVMIe3E1zTf/wyLBYZgoo8ChhNjSHGY2KxFwxeIBMTrR4JNXrVmsfYJvjZujzdlMofxD9a7v8Rm6/okkaSQYV+/mLKneXk6mTHJKRF87XDaEzE4/S7xwWjfK9THKkrqLA+EyPCTEOw02mRtJb9qiBkCZRPfyQI1OihigPZ4zYZOb74FJ1NfhN7mWxMxpcwuNxpkkndnJdf/Fu+KNUfBI6d8xGmK9Pd/JYaVOJbjfsqcPkZIJhx1KH5VEc2MjyZVQydaMHPQkuzyJLvguOwUYY616ADuLM= X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:YQXPR01MB4756.CANPRD01.PROD.OUTLOOK.COM; PTR:; CAT:NONE; SFS:(13230022)(4636009)(346002)(39850400004)(366004)(376002)(396003)(136003)(451199015)(4326008)(33964004)(53546011)(66556008)(66476007)(66946007)(8676002)(6916009)(6506007)(86362001)(316002)(30864003)(40140700001)(36756003)(41300700001)(2616005)(83380400001)(2906002)(31696002)(186003)(6512007)(66899015)(26005)(5660300002)(8936002)(66574015)(45080400002)(6486002)(478600001)(38100700002)(966005)(31686004)(166002)(43740500002)(45980500001); DIR:OUT; SFP:1102; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?c2RLK01CMFNJa2piMXJGaDdUVXhvZzUwa3dJYVhSZ0gwM0NkckxRd3pNSVVN?= =?utf-8?B?eGRVZi9ySVdrZURkWUk1ekx3cVF6b1FmVHRrMlBhYUVoZENwbXNYRnFVWDNr?= =?utf-8?B?a1lSRVI4d0FpT0tMVkdrbFh0bUJtY3F6anQwaWVsY01CNFFqcmlQdGJqTlBj?= =?utf-8?B?MFowZzZyU1FFSVhuVmg4YlN3S2E5UFM0bnhvU2Z6d28zTy9MT1BPTWpYSjhZ?= =?utf-8?B?SVI0UjBZRmFCSkZFaXJDcytoWm1PS3E4UzA4SVUwcDIycGZWZ1BudTJveS9U?= =?utf-8?B?RjJ4NXVxTWNlVCtDK3lUdjBKTFlrdWJDMHI2elEyZDlkSFZteXRkcEJ5Rnhv?= =?utf-8?B?dkdua0hLSnpHRllUOTdBT1RndmNwa1dSUU9MV1c2dmZLcFlrSXNERlQ2cGRr?= =?utf-8?B?TUxxQnBBb1FqUSttSWlKOTNzOU44dDhLVXpXMFN4N1Nhdld1bUN4d2lKVGhF?= =?utf-8?B?RXF3NnpnRzhLZFRvNmdsSkdXbGh3aTJ4VERkMlYvSk1qVlRUeEphTy9UZWFw?= =?utf-8?B?a3ZxaE1MOVVDVWZiQy9QQ25hRUxQNytlY3NmbEdMTElyYnNiRWdvdVBQT08w?= =?utf-8?B?czlHajRCbXpLdHVGK1AwaVVaT1N1OVhMR2V5TVlkZGR5dUs0a1l0YUFkY0tw?= =?utf-8?B?UDg0N05jSUFPeFZaSUtlanU0Q0FSQndrZ2FTS294dlFPRHhkTzQ3WVJ2THhW?= =?utf-8?B?WGRKVi9vSEo2WmlsdE00MlJLVndrYVlaVTd0ejUyZ3o4TURFREtheEdvdVA3?= =?utf-8?B?NS9xTGxPMW5QWk9KZXQ2Wmx1UyttR2M5N3E3c0pqSDM4cFdTQWtMYS8rbysv?= =?utf-8?B?UHVlMVQxYTRmN29qMVR5WnFLVGxybHBXY2JXU0RwTmlJMGNnUjFYVG1WblFK?= =?utf-8?B?S2dsY3BmUTI0SGtta0IxeHVHY3dTSGhid1hEblpKcUYrUVlyOTdieklaVWZ0?= =?utf-8?B?U0NWemFadG1TMDZrVTl3QkhIY3BFK0UycFF1T01TYVFxRE1Xd3REdUVVbWZT?= =?utf-8?B?bWpsb0tnUjArZXoxUDY4dUNSbThXR1dEK05uZU9aUG93bHJMSTZXZE5OMkEr?= =?utf-8?B?RUpFZkJDY0pqZk5sRDRPQlhsTWdsMjhWVysyZkppN0FvUDJSUXpxZEZoSmt2?= =?utf-8?B?ZVpuR0lxR2w3dmRYLzcrZTdJU1BjVHFVNk1XWTUrQXg4QWNmMDFYbGh1ek9J?= =?utf-8?B?L0VtcWkvc2JBdDVNWnVoRHZ5OEVtbzVZN1l1MWpFTkNHbUFHOHM1b1hiTGhU?= =?utf-8?B?MWVSQ0M2VGRPSkZFalJSMXIrOUVxL1FwaVhNL3VleTFyMEFDS3MzbEMyMEwr?= =?utf-8?B?dzl2a1N5dU5Kd1FacXBrSEwrNVM0QlRSQy9YN09FWGFJb3VZWGpOT1BHdWhT?= =?utf-8?B?L3hjWkJUaVc1aTErbk4rbFRSb2NMUHErcjZjT01DUzFpQVF1K1N5VUpSMmp0?= =?utf-8?B?NUZqWXRHT1JhT0pqajcvVmxuRDRDNmhiOGpCTVpldXlOTHQvekZsTXNEQmtt?= =?utf-8?B?aGVSaGFIZ3paK2Z2dU13NldYMXFnSW9ncGpVb3FZQVphYVZ5TzhONWlKQktL?= =?utf-8?B?MjZ2YkRWN1oxZEVJNUFRQU9vTUdrakJpd1VlZXAzQlFaYlpjWE1KWXE0bENY?= =?utf-8?B?YlIxZER3SVk2TGVldjI5SnBaaHFTMVVCYW0zTTV4WWU4QjZFUlBPMUJJQkRz?= =?utf-8?B?RkxlL3lMWVY0S3Q2ZDkvYWU0V3JLYzdOdWQxcWl5RFJKUEN4YzNWbDQ1Rklh?= =?utf-8?B?UXBxemN3RjM0dzhja2RwTTl2d1pWUmU0N0QyN01MTzlJdFFOT2FYVXFGb2Y5?= =?utf-8?B?RlBTcmF6cG1oYjd3My9vOEpnc0NDNEwyVEdCRVNZbnBUcjlYcmljU2N6NC81?= =?utf-8?B?ZEUyV1dxMlVRRWtrM2o2cHlXV1EwY3ovd0Z2c2ZTbmxZRmVqVUJjU0F5RTM4?= =?utf-8?B?Q3BaV2lWS3NCUTIvWVdUOXZOejEwUU1qckFwL1A4UGpCdmpjcmp6Q2tVdEEw?= =?utf-8?B?S3FRYkJFVE1ZVFBnSUFXN2pjZ0lsU2tIQ0owSWlpRWYxbjFrcXlFM3FNc2s2?= =?utf-8?B?bytNZkxDVUszcnBhWW1tYlJ0N1VIbEh5ako1R1N6RStYRDdXVFRyREFJL2Mr?= =?utf-8?B?K3NYejQ3QlorOTRIKzd3ZDVvZGVHbm14eUEzL3NJZjFYcXdlN2dPOUdsNTgx?= =?utf-8?Q?o8l5oQYBV3GPvworRbGnBiE=3D?= X-OriginatorOrg: indexexchange.com X-MS-Exchange-CrossTenant-Network-Message-Id: 43a1d7c8-a7be-43f3-d07c-08dab4ffff99 X-MS-Exchange-CrossTenant-AuthSource: YQXPR01MB4756.CANPRD01.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 23 Oct 2022 14:08:02.5214 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: b07c0690-22b8-4366-8d8d-7b845d088e18 X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: giBzEfwk1y7Cbwxx3sGb8oVuEUZD4pc7teQxKpQWKT3dxS6CD797klnV77XSo50Oupi6DY1RzITNsOurNf6f0vYmdm1KYUCmRBDx6Wix9q3CIUFJBO1BbyECtvwfDUuU X-MS-Exchange-Transport-CrossTenantHeadersStamped: YT3PR01MB8868 Subject: Re: [Starlink] [Rpm] [M-Lab-Discuss] misery metrics & consequences X-BeenThere: starlink@lists.bufferbloat.net X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Starlink has bufferbloat. Bad." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 23 Oct 2022 14:08:05 -0000 --------------064fGbelvfqcA7coGJSOPesP Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: base64 T0ssIGl0J3MgcHJldHR5IGNsZWFyIHRoYXQgd2UncmUgYWxyZWFkeSBtZWFzdXJpbmcgYW5k IGFkYXB0aW5nIHRvIA0KbWlzZXJ5LCBkb2VzIGFueW9uZSBoYXZlIGEgZ29vZCByZWFzb24g dG8gd2FudCB0byBwcm92aWRlIGEgIm1pc2VyeSBtZXRlciI/DQoNCkknZCBub3JtYWxseSBi ZSB0ZW1wdGVkLCBidXQgSSdtIHdvcmtpbmcgaW4gdGhlIE1MIHRlYW0gaW4gYSBzdGFydHVw LCANCmFuZCBoYXZlIGJlZW4gaGF2aW5nIHRyb3VibGUgZXZlbiAvcmVhZGluZy8gZW1haWwg dGhpcyB5ZWFyICg7LSkpDQoNCi0tZGF2ZQ0KDQoNCg0KT24gMTAvMjMvMjIgMDk6NTIsIFNl YmFzdGlhbiBNb2VsbGVyIHdyb3RlOg0KPiBbRVhURVJOQUxdIFRoaXMgZW1haWwgb3JpZ2lu YXRlZCBmcm9tIG91dHNpZGUgdGhlIG9yZ2FuaXphdGlvbi4gRG8gbm90IGNsaWNrIGxpbmtz IG9yIG9wZW4gYXR0YWNobWVudHMgdW5sZXNzIHlvdSByZWNvZ25pemUgdGhlIHNlbmRlciBh bmQga25vdyB0aGUgY29udGVudCBpcyBzYWZlLg0KPg0KPiBIaSBEYXZpZCwNCj4NCj4NCj4+ IE9uIE9jdCAyMywgMjAyMiwgYXQgMTU6MTEsIERhdmUgQ29sbGllci1Ccm93bjxkYXZlLmNv bGxpZXItQnJvd25AaW5kZXhleGNoYW5nZS5jb20+ICB3cm90ZToNCj4+DQo+PiBPbiAxMC8y My8yMiAwODoyNiwgU2ViYXN0aWFuIE1vZWxsZXIgd3JvdGU6DQo+Pg0KPj4+ICAgICAgICAg IFtTTV0gS2F0aHkgTmljaG9scycgcHBpbmcgKGh0dHBzOi8vY2FuMDEuc2FmZWxpbmtzLnBy b3RlY3Rpb24ub3V0bG9vay5jb20vP3VybD1odHRwcyUzQSUyRiUyRmdpdGh1Yi5jb20lMkZw b2xsZXJlJTJGcHBpbmcmYW1wO2RhdGE9MDUlN0MwMSU3QyU3QzBkZTFjMGRkZjUxZjQxYWVm NzBjMDhkYWI0ZmRlNWFkJTdDYjA3YzA2OTAyMmI4NDM2NjhkOGQ3Yjg0NWQwODhlMTglN0Mx JTdDMCU3QzYzODAyMTI5OTgxNzg3MjE1NiU3Q1Vua25vd24lN0NUV0ZwYkdac2IzZDhleUpX SWpvaU1DNHdMakF3TURBaUxDSlFJam9pVjJsdU16SWlMQ0pCVGlJNklrMWhhV3dpTENKWFZD STZNbjAlM0QlN0MzMDAwJTdDJTdDJTdDJmFtcDtzZGF0YT1Kc05ra0VEVHp3Q2ludFg3SDJL aHN2aUl1YzJTNHI3UkZZSWV2dWNuS2VBJTNEJmFtcDtyZXNlcnZlZD0wKSBtaWdodCBiZSBh biBvcHRpb24sIGVpdGhlciBvbiB0aGUgSVNQIHNpZGUgb3IgcnVuIG9uIENQRXMgd2l0aCBz b21lIG1ldGhvZCB0byBoYXJ2ZXN0IHRoZSBjb2xsZWN0ZWQgZGF0YSBmcm9tIHRoZSBJU1Ag c2lkZS4NCj4+IFllczogSSB1c2UgcHBpbmcgdG8gaW52ZXN0aWdhdGUgb2NjYXNpb25hbCBw cm9ibGVtcyBhdCB3b3JrLCBidXQgSSB3YXMgdGhpbmtpbmcgbW9yZSBhYm91dCBob21lIG5l dHdvcmtzLCB3aGVyZSBzb21lIGJpZyBzcGVlZC1jaGFuZ2VzIGhhcHBlbiBhbmQgbG9jYWwg Y29uZ2VzdGlvbiBoYXBwZW5zLg0KPiAgICAgICAgICBbU01dIE9rYXkuIEluIHRoZSBjb250 ZXh0IG9mIGNha2UtYXV0b3JhdGUgKGh0dHBzOi8vY2FuMDEuc2FmZWxpbmtzLnByb3RlY3Rp b24ub3V0bG9vay5jb20vP3VybD1odHRwcyUzQSUyRiUyRmdpdGh1Yi5jb20lMkZseW54dGhl Y2F0JTJGQ0FLRS1hdXRvcmF0ZSUyRmJsb2IlMkZtYWluJTJGUkVBRE1FLm1kJmFtcDtkYXRh PTA1JTdDMDElN0MlN0MwZGUxYzBkZGY1MWY0MWFlZjcwYzA4ZGFiNGZkZTVhZCU3Q2IwN2Mw NjkwMjJiODQzNjY4ZDhkN2I4NDVkMDg4ZTE4JTdDMSU3QzAlN0M2MzgwMjEyOTk4MTc4NzIx NTYlN0NVbmtub3duJTdDVFdGcGJHWnNiM2Q4ZXlKV0lqb2lNQzR3TGpBd01EQWlMQ0pRSWpv aVYybHVNeklpTENKQlRpSTZJazFoYVd3aUxDSlhWQ0k2TW4wJTNEJTdDMzAwMCU3QyU3QyU3 QyZhbXA7c2RhdGE9THdQJTJGNDUlMkZJZElKZ2RGR0lURkVnWWEyZWdnNHh5UUVxa0UyMUhZ S2Iwbk0lM0QmYW1wO3Jlc2VydmVkPTApIHdlIGltcGxlbWVudGVkIGEgZmxpZ2h0IHJlY29y ZGVyIHR5cGUgbG9nZ2luZyB0aGF0IGNvbnRpbnVvdXNseSBsb2dzIHRoZSBsYXN0IFggKGNv bmZpZ3VyYWJsZSkgZXBvY2ggYW5kIHN0b3JlcyBib3Qgc2hhcGVyIGFuZCBhY2hpZXZlZCBy YXRlcyBhcyB3ZWxsIGFzIHRoZSByZXN1bHRzIGZyb20gdGhlIGxhdGVuY3kgcHJvYmVzLiBU aGlzIHNjcmlwdCBjYW4gYmUgdXNlZCB3aXRoIHJhdGUgc2V0dGluZyBkaXNhYmxlZCB0byBy ZWNvcmQgcmVsZXZhbnQgZGF0YSBhbmQgdGhlIHVzZXIganVzdCBuZWVkcyB0byByZW1lbWJl ciB0byBleHBvcnQgdGhlIGRhdGEgYWZ0ZXIgZXhwZXJpZW5jaW5nIGludGVyZXN0aW5nL2Fi bm9ybWFsIGV2ZW50cy4gU3VyZSB0aGlzIGRvZXMgbm90IGhhdmUgcGVyIGFwcGxpY2F0aW9u IHJlc29sdXRpb24sIGJ1dCBzaG91bGQgZ2l2ZSBzb21lIGlkZWEgYWJvdXQgY3VycmVudCBs YXRlbmN5IGFzIHdlbGwgYXMgY3VycmVudCB0cmFmZmljLiBJIHdpbGwgYWRtaXQgdGhvdWdo IHRoYXQgdGhpcyBsb2dnaW5nIGlzIG5vdCBleGFjdGx5IGNoZWFwIENQVS13aXNlIGFuZCBs YWNrcyB0aGUgcHJlY2lzaW9uIG9mIHBhY2tldCBjYXB0dXJlcy4uLiBidXQgaXQgY2FuIGJl IG9wZXJhdGVkIGFzIGZsaWdodCByZWNvcmRlciB3aGVyZSByZWxldmFudCBldmVudHMgY2Fu IGJlIGV4cG9ydGVkL3N0b3JlZCBwb3N0LWhvYy4uLg0KPg0KPg0KPj4+IFByb3RvY29scyB3 aXRoIGxlc3MgZmllbGRzIHJlYWRhYmxlIGxpa2UgUVVJQyB3b3VsZCByZXF1aXJlIHNwZWNp YWwgY2FyZSB0byBldmFsdWF0ZSB0aGUgc3Bpbi1iaXQgaWYgdGhhdCBleGlzdHMuIE9yIGp1 c3QgcmVzb3J0IHRvIGFjdGl2ZSBwb2xsaW5nIGFuZCBwaW5nKiBlYWNoIENQRSBvbmNlIHBl ciBzZWNvbmQgb3Igc28gKGZvciBhIGNvdXJzZSByZXNvbHV0aW9uLCB5b3UgY291bGQgaW5j cmVhc2UgdGhlIHBvbGxpbmcgcmF0ZSBvbiBkZXRlY3RpbmcgYW5vbWFsaWVzIHRoZXJlYnkg cmlza2luZyB0byBtYWtlIGNvbmdlc3Rpb24gc2xpZ2h0bHkgd29yc2UpLiBOb25lIG9mIHRo aXMgd2lsbCBhbGxvdyB0byBtZWFzdXJlIHdpdGhpbiBob21lIG5ldHdvcmsgY29uZ2VzdGlv biB0aG91Z2gsIGJ1dCBpdCBtaWdodCBzdGlsbCBiZSBhIHdvcnR3aGlsZSBkaWFnbm9zdGlj IHRvIGtub3cgdGhhdCB0aGUgYWNjZXNzIGxpbmsgaXMgT0ssIHdoaWxlIHRoZSB1c2VyIHJl cG9ydHMgbGF0ZW5jeSBpc3N1ZXMuDQo+PiBJZiBvbmUgaGFzIGEgZ29vZCB3YXkgdG8gY2Fw dHVyZSBSVFQgYW5kIGRhdGEgcmF0ZSBmb3Igb25lIHByb2JsZW1hdGljIGFwcCwgc2F5IHpv b20sIHRoZW4gb25lIGNvdWxkIHNlZSB0aGF0IG5ldHdvcmsgcHJvYmxlbXMgd2VyZSBoYXBw ZW5pbmcgYXQgdGhlIHNhbWUgdGltZSBhcyBsYWdzIGFuZCBkcm9wb3V0cy4NCj4gICAgICAg ICAgW1NNXSBBcyBhYm92ZSBsb2dnaW5nIGFsbCB0cmFmZmljIGlzIHJlbGF0aXZlbHkgZWFz eSwgcGVyIGFwcGxpY2F0aW9uIG9yIHBlciBmbG93IHdpbGwgcmVxdWlyZSBkaWZmZXJlbnQg dG9vbHMgb3IgcGFja2V0IGNhcHR1cmVzLi4uDQo+DQo+PiBJU1BzIHdvdWxkIHBvc2l0aXZl bHkgaGF0ZSB0aGF0LCBvZiBjb3Vyc2UuDQo+ICAgICAgICAgIFtTTV0gQXNzdW1pbmcgdGhl eSBjb21lIG91dCBvZiB0aGlzIGxvb2tpbmcgYmFkLCBpZiB0aGUgb3V0Y29tZSBpcyB0byBp bXBseSB0aGUgbG9jYWwgV2lGaSBiZWluZyB0aGUgcm9vdCBjYXVzZSBJU1BzIG1pZ2h0IGFj dHVhbGx5IGFwcHJlY2lhdGUgaXQgOykNCj4NCj4gUmVnYXJkcw0KPiAgICAgICAgICBTZWJh c3RpYW4NCj4NCj4+IC0tZGF2ZQ0KPj4NCj4+DQo+Pg0KPj4NCj4+PiBSZWdhcmRzDQo+Pj4g ICAgICAgICAgU2ViYXN0aWFuDQo+Pj4NCj4+PiAqKSBJIHRoaW5rIHRoZXJlIGFyZSBkZWRp Y2F0ZWQgZGV2aWNlcyBhdmFpbGFibGUgdGhhdCBhbGxvdyB0byBwaW5nIGxhcmdlIG51bWJl cnMgb2YgSVBzIGluIGEgcGVyaW9kaWMgZmFzaGlvbi4NCj4+Pg0KPj4+DQo+Pj4NCj4+Pj4g LS1kYXZlDQo+Pj4+DQo+Pj4+DQo+Pj4+DQo+Pj4+IE9uIDEwLzIzLzIyIDA3OjU3LCBTZWJh c3RpYW4gTW9lbGxlciB2aWEgU3Rhcmxpbmsgd3JvdGU6DQo+Pj4+DQo+Pj4+PiBIaSBHbGVu biwNCj4+Pj4+DQo+Pj4+Pg0KPj4+Pj4NCj4+Pj4+DQo+Pj4+Pj4gT24gT2N0IDIzLCAyMDIy LCBhdCAwMjoxNywgR2xlbm4gRmlzaGJpbmUgdmlhIFJwbTxycG1AbGlzdHMuYnVmZmVyYmxv YXQubmV0Pg0KPj4+Pj4+DQo+Pj4+Pj4gICB3cm90ZToNCj4+Pj4+Pg0KPj4+Pj4+IEFzIGEg Y2xhc3NpYyBkaWVkIGluIHRoZSB3b29sIGVtcGlyaWNpc3QsIGdyYW50ZWQgdGhhdCB5b3Ug Y2FuIGlkZW50aWZ5ICJtaXNlcnkiIGZhY3RvcnMsIGdpdmVuIGEgcG9wdWxhdGlvbiBvZiAx LDAwMCB1c2VycywgaG93IGRvIHlvdSBwcm9wb3NlIGRlcml2aW5nIGEgbWlzZXJ5IGluZGV4 IGZvciB0aGF0IHBvcHVsYXRpb24/DQo+Pj4+Pj4NCj4+Pj4+PiBXZSBjYW4gbWVhc3VyZSBk b3dubG9hZCwgdXBsb2FkLCBwaW5nLCBqaXR0ZXIgcHJldHR5IG11Y2ggd2l0aG91dCB1c2Vy IGludGVydmVudGlvbi4gIEZvciB0aGUgbWVhc3VyZW1lbnRzIHlvdSBoeXBvdGhlc2l6ZSwg aG93IHlvdSB5b3UgYXV0b21hdGljYWxseSBleHRyYWN0IHRob3NlIGluZGVjaWVzIHdpdGhv dXQgc3ViamVjdGl2ZSB1c2VyIGNvbnRhbWluYXRpb24uDQo+Pj4+Pj4NCj4+Pj4+PiBJLmUu ICBteSBkb3dubG9hZCBzcGVlZCBzdWNrcy4gTWVhc3VyZSB0aGUgZG93bmxvYWQgc3BlZWQu DQo+Pj4+Pj4NCj4+Pj4+PiBNeSBpc3AgZG9lc24ndCBmaXggbXkgcHJvYmxlbS4gTWVhc3Vy ZSB3aGF0PyBIb3c/DQo+Pj4+Pj4NCj4+Pj4+PiBIdW1hbiBzdXJ2ZXkgdGVjaG5vbG9neSBp cyA3MCsgeWVhcnMgb2xkIGFuZCBpdCBzdGlsbCBoYXMgcHJvYmxlbXMgZmlndXJpbmcgb3V0 IGhvdyB0byBjb3JyZWxhdGUgb3BpbmlvbiB3aXRoIGZhY3QuDQo+Pj4+Pj4NCj4+Pj4+PiBX aXRob3V0IGFuIG9iamVjdGl2ZSBtZWFzdXJlbWVudCBzY2hlbWUgdGhhdCBkb2Vzbid0IHJl cXVpcmUgaHVtYW4gaW50ZXJhY3Rpb24sIHRoZSBtaXNlcnkgaW5kZXggaXMgYSBjb29sIGh5 cG90aGVzaXMgd2l0aCBubyB3YXkgdG8gbGluayB0byBhY3R1YWwgZGF0YS4gIFdoYXQgb2Jq ZWN0aXZlIG1lYXN1cmVtZW50cyBjYW4gYmUgbWFkZT8gIEFuc3dlciB0aGF0IGFuZCB0aGUg aW5kZXggYmVjb21lcyB1c2VmdWwuIE90aGVyd2lzZSBpdCdzIGp1c3QgY29uc3VtZXIgd2hp bmluZy4NCj4+Pj4+Pg0KPj4+Pj4+IE5vdCB0cnlpbmcgdG8gYmUgY29tYmF0aXZlIGhlcmUs IGluIGZhY3QgSSBsaWtlIHRoZSBjb25jZXB0IHlvdSBzdXBwb3J0LCBidXQgSSdtIGhhcmQg cHJlc3NlZCB0byBzZWUgaG93IHRoZSBjb25jZXB0IGNhbiBsZWFkIHRvIGRhdGEsIGFuZCB0 aGUgZGF0YSBsZWFkIHRvIHBvbGljeSBwcm9wb3NhbHMuDQo+Pj4+Pj4NCj4+Pj4+Pg0KPj4+ Pj4gICAgICAgW1NNXSBTbyBpdCBzZWVtcyB0aGF0IG91dHNpZGUgb2Ygc2VlbWluZ2x5IHNp bXBsZSB0byB0ZXN0IHRocm91Z2hwdXQgbnVtYmVycyosIHRoZSBuZXh0IG1vc3QgaW1wb3J0 YW50IHF1YWxpdHkgbnVtYmVyIChvciB0aGUgbW9zdCBpbXBvcnRhbnQgZGVwZW5kaW5nIG9u IHN1YmplY3RpdmUgcmFua2luZykgaXMgaG93IGRvZXMgbGF0ZW5jeSBjaGFuZ2UgdW5kZXIg ImxvYWQiLiBBYnNvbHV0ZSBsYXRlbmN5IGlzIGFsc28gaW1wb3J0YW50IGFsYmVpdCBzdGF0 aWMgaGlnaCBsYXRlbmN5IGNhbiBiZSB3b3JrZWQgYXJvdW5kIHdpdGhpbiBsaW1pdHMgc28g dGhlIGNoYW5nZSB1bmRlciBsb2FkIHNlZW1zIG1vcmUgcmVsZXZhbnQuDQo+Pj4+PiAgICAg ICBBbGwgb2YgZmxlbnQncyBSUlVMIHRlc3QsIGFwcGxlJ3MgbmV0d29ya1F1YWxpdHkvUlBN LCBhbmQgaXBlcmYyJ3MgYm91bmNlYmFjayB0ZXN0IG9mZmVyIG1ldGhvZHMgdG8gYXNzZXMg bGF0ZW5jeSBjaGFuZ2UgdW5kZXIgbG9hZCoqLCBhcyBkbyB3YXZlZm9ybXMgYnVmZmVyYmxv YXQgdGVzdHMgYW5kIGV2ZW4gdG8gYSBkZWdyZWUgT29rbGEncyBzcGVlZHRlc3QubmV0LiBJ TUhPIHNvbWV0aGluZyBsaWtlIGxhdGVuY3kgaW5jcmVhc2UgdW5kZXIgbG9hZCBvciBhcHBs ZSdzIHJlc3BvbnNpdmVuZXNzIG1lYXN1cmUgUlBNIChiYXNpY2FsbHkgdGhlIGludmVyc2Ug b2YgdGhlIGxhdGVuY3kgdW5kZXIgbG9hZCBjYWxjdWxhdGVkIG9uIGEgcGVyIG1pbnV0ZSBi YXNpcywgc28gaXQgc2NhbGVzIGluIHRoZSB0eXBpY2FsIGhpZ2hlciBudW1iZXJzIGFyZSBi ZXR0ZXIgd2F5LCB1bmxpa2UgcmF3IGxhdGVuY3kgdW5kZXIgbG9hZCBudW1iZXJzIHdoZXJl IHNtYWxsZXIgaXMgYmV0dGVyKS4NCj4+Pj4+ICAgICAgIElNSE8gd2hhdCBuZXR3b3JrUXVh bGl0eSBpcyBtaXNzaW5nIEFUTSBpcyB0byBtZWFzdXJlIGFuZCByZXBvcnQgdGhlIHVubG9h ZGVkIFJQTSBhcyB3ZWxsIGFzIHRoZSBsb2FkZWQgdGhlIGZpcnN0IGdpdmVzIGEgbWVhc3Vy ZSBvdmVyIHRoZSBzdGF0aWMgbGF0ZW5jeSB0aGUgc2Vjb25kIG92ZXIgaG93IHdlbGwgdGhp bmdzIGtlZXAgd29ya2luZyBpZiBjYXBhY2l0eSBnZXRzIHRpZ2h0LiBUaGV5IHJlcG9ydCB0 aGUgYmFzZSBSVFQgd2hpY2ggY2FuIGJlIGNvbnZlcnRlZCB0byBSUE0uIEFzIGFuIGV4YW1w bGU6DQo+Pj4+Pg0KPj4+Pj4gbWFjYm9vazp+IHVzZXIkIG5ldHdvcmtRdWFsaXR5IC12DQo+ Pj4+PiA9PT09IFNVTU1BUlkgPT09PQ0KPj4+Pj4gVXBsb2FkIGNhcGFjaXR5OiAyNC4zNDEg TWJwcw0KPj4+Pj4gRG93bmxvYWQgY2FwYWNpdHk6IDkxLjk1MSBNYnBzDQo+Pj4+PiBVcGxv YWQgZmxvd3M6IDIwDQo+Pj4+PiBEb3dubG9hZCBmbG93czogMTYNCj4+Pj4+IFJlc3BvbnNp dmVuZXNzOiBIaWdoICgyMTIzIFJQTSkNCj4+Pj4+IEJhc2UgUlRUOiAxNg0KPj4+Pj4gU3Rh cnQ6IDEwLzIzLzIyLCAxMzo0NDozOQ0KPj4+Pj4gRW5kOiAxMC8yMy8yMiwgMTM6NDQ6NTMN Cj4+Pj4+IE9TIFZlcnNpb246IFZlcnNpb24gMTIuNiAoQnVpbGQgMjFHMTE1KQ0KPj4+Pj4N Cj4+Pj4+IEhlcmUgUlBNIDIxMzMgY29ycmVzcG9uZHMgdG8gNjAwMDAvMjEyMyA9IDI4LjI2 IG1zIGxhdGVuY3kgdW5kZXIgbG9hZCwgd2hpbGUgdGhlIEJhc2UgUlRUIG9mIDE2bXMgY29y cmVzcG9uZHMgdG8gNjAwMDAvMTYgPSAzNzUwIFJQTSwgc29uIG9uIHRoaXMgbGluayBsb2Fk IHJlZHVjZXMgdGhlIHJlc3BvbnNpdmVuZXNzIGJ5IDM3NTAtMjEyMyA9IDE2MjcgUlBNIGEg cmVkdWN0aW9uIGJ5IDEwMC0xMDAqMjEyMy8zNzUwID0gNDMuNCUsIGFuZCB0aGF0IGlzIHdp dGggY29tcGV0ZW50IEFRTSBhbmQgc2NoZWR1bGluZyBvbiB0aGUgcm91dGVyLg0KPj4+Pj4N Cj4+Pj4+IFdpdGhvdXQgY29tcGV0ZW50IEFRTS9zaGFwaW5nIEkgZ2V0Og0KPj4+Pj4gPT09 PSBTVU1NQVJZID09PT0NCj4+Pj4+IFVwbG9hZCBjYXBhY2l0eTogMTUuMTAxIE1icHMNCj4+ Pj4+IERvd25sb2FkIGNhcGFjaXR5OiA5Ny42NjQgTWJwcw0KPj4+Pj4gVXBsb2FkIGZsb3dz OiAyMA0KPj4+Pj4gRG93bmxvYWQgZmxvd3M6IDEyDQo+Pj4+PiBSZXNwb25zaXZlbmVzczog TWVkaXVtICg0MjcgUlBNKQ0KPj4+Pj4gQmFzZSBSVFQ6IDE2DQo+Pj4+PiBTdGFydDogMTAv MjMvMjIsIDEzOjUxOjUwDQo+Pj4+PiBFbmQ6IDEwLzIzLzIyLCAxMzo1MjowNg0KPj4+Pj4g T1MgVmVyc2lvbjogVmVyc2lvbiAxMi42IChCdWlsZCAyMUcxMTUpDQo+Pj4+PiBsYXRlbmN5 IHVuZGVyIGxvYWQ6IDYwMDAwLzQyNyA9IDE0MC41MiBtcw0KPj4+Pj4gYmFzZSBSUE06IDYw MDAwLzE2ID0gMzc1MCBSUE0NCj4+Pj4+IHJlZHVjdGlvbiBSUE06IDEwMC0xMDAqNDI3LzM3 NTAgPSA4OC42JQ0KPj4+Pj4NCj4+Pj4+DQo+Pj4+PiBJIHVuZGVyc3RhbmQgYXBwbGUncyBk ZXNpcmUgdG8gaGF2ZSBhIHNpbmdsZSByZXBvcnRlZCBudW1iZXIgd2l0aCBhIHNpbmdsZSBx dWFsaWZpZXIgbWVkaXVtL2hpZ2gvLi4uIGJlY2F1c2UgaW4gdGhlIGVuZCBhIGxpbmsgaXMg b25seSByZWxpYWJseSB1c2FibGUgaWYgcmVzcG9uc2l2ZW5lc3MgdW5kZXIgbG9hZCBzdGF5 cyBhY2NlcHRhYmxlLCBidXQgd2l0aCB0d28gbnVtYmVycyBpdCBpcyBlYXNpZXIgdG8gc2Vl IHdoYXQgb25lJ3MgSVNQIGNvdWxkIGRvIHRvIGhlbHAuIChJIGd1ZXNzIHNvbWUgSVNQcyBt aWdodCBhbHJlYWR5IGJlIHVuaGFwcHkgd2l0aCB0aGUgc2luZ2xlIG51bWJlciwgc28gdGhp cyBuZWVkcyBzb21lIGRpcGxvbWFjeS90YWN0KQ0KPj4+Pj4NCj4+Pj4+IFJlZ2FyZHMNCj4+ Pj4+ICAgICAgIFNlYmFzdGlhbg0KPj4+Pj4NCj4+Pj4+DQo+Pj4+Pg0KPj4+Pj4gKikgU2Vl bWluZ2x5IGFzIHF1aXRlIHNvbWUgSVNQcyBvcGVyYXRlIHRoZWlyIG93biBzcGVlZHRlc3Qg c2VydmVycyBpbiB0aGVpciBuZXR3b3JrIGFuZCBpZ25vcmUgY3VzdG9tZXJzIG5vdCByZWFj aGluZyB0aGUgY29udHJhY3RlZCByYXRlcyBpbnRvIHNwZWVkdGVzdC1zZXJ2ZXJzIGxvY2F0 ZWQgaW4gZGlmZmVyZW50IEFTcy4gQXMgdGhlIHByb2R1Y3QgaXMgY2FsbGVkIGludGVybmV0 IGFjY2VzcyBJIGEgaW5jbGluZWQgdG8gZXhwZWN0IHRoYXQgbXkgSVNQIG1haW50YWlucyBz dWZmaWNpZW50IHBlZXJpbmcvdHJhbnNpdCBjYXBhY2l0eSB0byByZWFjaCB0aGUgbmV4dCB0 aWVyIG9mIEFTIGF0IG15IGNvbnRyYWN0ZWQgcmF0ZSAodGhlIEVVIGxlZ2lzbGF0aXZlIHNl ZW1zIHRvIGFncmVlLCBzZWUgRVUgZGlyZWN0aXZlIDIwMTUvMjEyMCkuDQo+Pj4+Pg0KPj4+ Pj4gKiopIE1vc3QgZG8gYnkgY3JlYXRpbmcgbG9hZCB0aGVtc2VsdmVzIGFuZCBtZWFzdXJp bmcgdGhyb3VnaHB1dCBhdCB0aGUgc2FtZSB0aW1lLCBib3VuY2ViYWNrIElJVUMgd2lsbCBm b2N1cyBvbiB0aGUgbGF0ZW5jeSBtZWFzdXJlbWVudCBhbmQgbGVhdmUgdGhlIGxvYWQgZ2Vu ZXJhdGlvbiBvcHRpb25hbCAoc28gb2ZmZXJzIGEgbW9kZSB0byBtZWFzdXJlIHJlc3BvbnNp dmVuZXNzIG9mIGEgbGl2ZSBuZXR3b3JrIHdpdGggbWluaW1hbCBtZWFzdXJlbWVudCB0cmFm ZmljKS4gQEJvYiwgcGxlYXNlIGNvcnJlY3QgbWUgaWYgdGhpcyBpcyB3cm9uZy4NCj4+Pj4+ DQo+Pj4+Pg0KPj4+Pj4NCj4+Pj4+DQo+Pj4+Pj4gT24gRnJpLCBPY3QgMjEsIDIwMjIsIDU6 MjAgUE0gRGF2ZSBUYWh0DQo+Pj4+Pj4NCj4+Pj4+PiA8ZGF2ZS50YWh0QGdtYWlsLmNvbT4N Cj4+Pj4+Pg0KPj4+Pj4+ICAgd3JvdGU6DQo+Pj4+Pj4gT25lIG9mIHRoZSBiZXN0IHRhbGtz IEkndmUgZXZlciBzZWVuIG9uIGhvdyB0byBtZWFzdXJlIGN1c3RvbWVyDQo+Pj4+Pj4gc2F0 aXNmYWN0aW9uIHByb3Blcmx5IGp1c3Qgd2VudCB1cCBhZnRlciB0aGUgUDk5IENvbmZlcmVu Y2UuDQo+Pj4+Pj4NCj4+Pj4+PiBJdCdzIGNhbGxlZCBNaXNlcnkgTWV0cmljcy4NCj4+Pj4+ Pg0KPj4+Pj4+IEFmdGVyIGdvaW5nIHRocm91Z2ggYSBkZWVwIGRpdmUgYXMgdG8gd2h5IGFu ZCBob3cgd2UgdGhpbmsgYW5kIGFjdCBvbg0KPj4+Pj4+IHBlcmNlbnRpbGVzLCBiaW5zLCBh bmQgb3RoZXIgc3RhdGlzdGljYWwgbWV0aG9kcyBhcyB0byBob3cgd2UgdXNlIHRoZQ0KPj4+ Pj4+IHdlYiBhbmQgaW50ZXJuZXQgYXJlICpzbyB3cm9uZyogKHdlbGwgd29ydGggd2F0Y2hp bmcgYW5kIHRoaW5raW5nDQo+Pj4+Pj4gYWJvdXQgaWYgeW91IGFyZSByZWx5aW5nIG9uIG9y IGNyZWF0aW5nIG5ldHdvcmsgbWV0cmljcyB0b2RheSksIGl0DQo+Pj4+Pj4gdGhlbiBwb2lu dHMgdG8gdGhlIHJlYWwgbWV0cmljcyB0aGF0IG1hdHRlciB0byB1c2VycyBhbmQgdGhlIHVs dGltYXRlDQo+Pj4+Pj4gc3VjY2VzcyBvZiBhbiBpbnRlcm5ldCBidXNpbmVzczogVGltZW91 dHMsIHJldHJpZXMsIG1pc3NlcywgZmFpbGVkDQo+Pj4+Pj4gcXVlcmllcywgYW5ncnkgcGhv bmUgY2FsbHMsIGFiYW5kb25lZCBzaG9wcGluZyBjYXJ0cyBhbmQgbG9zcyBvZg0KPj4+Pj4+ IGVuZ2FnZW1lbnQuDQo+Pj4+Pj4NCj4+Pj4+Pg0KPj4+Pj4+DQo+Pj4+Pj4gaHR0cHM6Ly9j YW4wMS5zYWZlbGlua3MucHJvdGVjdGlvbi5vdXRsb29rLmNvbS8/dXJsPWh0dHBzJTNBJTJG JTJGd3d3LnA5OWNvbmYuaW8lMkZzZXNzaW9uJTJGbWlzZXJ5LW1ldHJpY3MtY29uc2VxdWVu Y2VzJTJGJmFtcDtkYXRhPTA1JTdDMDElN0MlN0MwZGUxYzBkZGY1MWY0MWFlZjcwYzA4ZGFi NGZkZTVhZCU3Q2IwN2MwNjkwMjJiODQzNjY4ZDhkN2I4NDVkMDg4ZTE4JTdDMSU3QzAlN0M2 MzgwMjEyOTk4MTc4NzIxNTYlN0NVbmtub3duJTdDVFdGcGJHWnNiM2Q4ZXlKV0lqb2lNQzR3 TGpBd01EQWlMQ0pRSWpvaVYybHVNeklpTENKQlRpSTZJazFoYVd3aUxDSlhWQ0k2TW4wJTNE JTdDMzAwMCU3QyU3QyU3QyZhbXA7c2RhdGE9JTJGT2UyZW85ZjdKUThiblFSQjIzSEVhZVhx Nkc5UXhTUSUyRlprTmIlMkY2Y3R5VSUzRCZhbXA7cmVzZXJ2ZWQ9MA0KPj4+Pj4+DQo+Pj4+ Pj4NCj4+Pj4+Pg0KPj4+Pj4+IFRoZSBlbmRpbmcgYWR2aWNlIHdhcyAtIGRvbid0IGFpbSB0 byBtYWtlIGEgc3BlY2lmaWMgcGVyY2VudGlsZQ0KPj4+Pj4+IGFjY2VwdGFibGUsIGFpbSBm b3IgYW4gYWNjZXB0YWJsZSAlIG9mIG1pc2VyeS4NCj4+Pj4+Pg0KPj4+Pj4+IEkgZW5qb3ll ZCB0aGUgcDk5IGNvbmZlcmVuY2UgbW9yZSB0aGFuIGFueSBjb25mZXJlbmNlIEkndmUgYXR0 ZW5kZWQgaW4geWVhcnMuDQo+Pj4+Pj4NCj4+Pj4+PiAtLQ0KPj4+Pj4+IFRoaXMgc29uZyBn b2VzIG91dCB0byBhbGwgdGhlIGZvbGsgdGhhdCB0aG91Z2h0IFN0YWRpYSB3b3VsZCB3b3Jr Og0KPj4+Pj4+DQo+Pj4+Pj4NCj4+Pj4+PiBodHRwczovL2NhbjAxLnNhZmVsaW5rcy5wcm90 ZWN0aW9uLm91dGxvb2suY29tLz91cmw9aHR0cHMlM0ElMkYlMkZ3d3cubGlua2VkaW4uY29t JTJGcG9zdHMlMkZkdGFodF90aGUtbXVzaHJvb20tc29uZy1hY3Rpdml0eS02OTgxMzY2NjY1 NjA3MzUyMzIwLUZYdHomYW1wO2RhdGE9MDUlN0MwMSU3QyU3QzBkZTFjMGRkZjUxZjQxYWVm NzBjMDhkYWI0ZmRlNWFkJTdDYjA3YzA2OTAyMmI4NDM2NjhkOGQ3Yjg0NWQwODhlMTglN0Mx JTdDMCU3QzYzODAyMTI5OTgxNzg3MjE1NiU3Q1Vua25vd24lN0NUV0ZwYkdac2IzZDhleUpX SWpvaU1DNHdMakF3TURBaUxDSlFJam9pVjJsdU16SWlMQ0pCVGlJNklrMWhhV3dpTENKWFZD STZNbjAlM0QlN0MzMDAwJTdDJTdDJTdDJmFtcDtzZGF0YT1BTEtYNHFrblRnSkJBaUJFVDlq MnlmZHlodUVtTTVyczJOZzMlMkIwOXJhdDQlM0QmYW1wO3Jlc2VydmVkPTANCj4+Pj4+Pg0K Pj4+Pj4+DQo+Pj4+Pj4gRGF2ZSBUw6RodCBDRU8sIFRla0xpYnJlLCBMTEMNCj4+Pj4+Pg0K Pj4+Pj4+IC0tDQo+Pj4+Pj4gWW91IHJlY2VpdmVkIHRoaXMgbWVzc2FnZSBiZWNhdXNlIHlv dSBhcmUgc3Vic2NyaWJlZCB0byB0aGUgR29vZ2xlIEdyb3VwcyAiZGlzY3VzcyIgZ3JvdXAu DQo+Pj4+Pj4gVG8gdW5zdWJzY3JpYmUgZnJvbSB0aGlzIGdyb3VwIGFuZCBzdG9wIHJlY2Vp dmluZyBlbWFpbHMgZnJvbSBpdCwgc2VuZCBhbiBlbWFpbCB0bw0KPj4+Pj4+DQo+Pj4+Pj4g ZGlzY3Vzcyt1bnN1YnNjcmliZUBtZWFzdXJlbWVudGxhYi5uZXQNCj4+Pj4+Pg0KPj4+Pj4+ IC4NCj4+Pj4+PiBUbyB2aWV3IHRoaXMgZGlzY3Vzc2lvbiBvbiB0aGUgd2ViIHZpc2l0DQo+ Pj4+Pj4NCj4+Pj4+PiBodHRwczovL2NhbjAxLnNhZmVsaW5rcy5wcm90ZWN0aW9uLm91dGxv b2suY29tLz91cmw9aHR0cHMlM0ElMkYlMkZncm91cHMuZ29vZ2xlLmNvbSUyRmElMkZtZWFz dXJlbWVudGxhYi5uZXQlMkZkJTJGbXNnaWQlMkZkaXNjdXNzJTJGQ0FBOTNqdzR3MjdhMUVP X1FRRzdOTmtpaCUyNTJCQzNRUWRlNSUyNTNEXzdPcUdlUzl4eTluQjZ3a2clMjU0MG1haWwu Z21haWwuY29tJmFtcDtkYXRhPTA1JTdDMDElN0MlN0MwZGUxYzBkZGY1MWY0MWFlZjcwYzA4 ZGFiNGZkZTVhZCU3Q2IwN2MwNjkwMjJiODQzNjY4ZDhkN2I4NDVkMDg4ZTE4JTdDMSU3QzAl N0M2MzgwMjEyOTk4MTc4NzIxNTYlN0NVbmtub3duJTdDVFdGcGJHWnNiM2Q4ZXlKV0lqb2lN QzR3TGpBd01EQWlMQ0pRSWpvaVYybHVNeklpTENKQlRpSTZJazFoYVd3aUxDSlhWQ0k2TW4w JTNEJTdDMzAwMCU3QyU3QyU3QyZhbXA7c2RhdGE9SFZrOXRndTk3RWxSZHZkSGlpRTNQU3VF elQ2UE03MzFBZzRYTUlWREpJVSUzRCZhbXA7cmVzZXJ2ZWQ9MA0KPj4+Pj4+DQo+Pj4+Pj4g Lg0KPj4+Pj4+IF9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fDQo+Pj4+Pj4gUnBtIG1haWxpbmcgbGlzdA0KPj4+Pj4+DQo+Pj4+Pj4NCj4+Pj4+PiBS cG1AbGlzdHMuYnVmZmVyYmxvYXQubmV0DQo+Pj4+Pj4gaHR0cHM6Ly9jYW4wMS5zYWZlbGlu a3MucHJvdGVjdGlvbi5vdXRsb29rLmNvbS8/dXJsPWh0dHBzJTNBJTJGJTJGbGlzdHMuYnVm ZmVyYmxvYXQubmV0JTJGbGlzdGluZm8lMkZycG0mYW1wO2RhdGE9MDUlN0MwMSU3QyU3QzBk ZTFjMGRkZjUxZjQxYWVmNzBjMDhkYWI0ZmRlNWFkJTdDYjA3YzA2OTAyMmI4NDM2NjhkOGQ3 Yjg0NWQwODhlMTglN0MxJTdDMCU3QzYzODAyMTI5OTgxNzg3MjE1NiU3Q1Vua25vd24lN0NU V0ZwYkdac2IzZDhleUpXSWpvaU1DNHdMakF3TURBaUxDSlFJam9pVjJsdU16SWlMQ0pCVGlJ NklrMWhhV3dpTENKWFZDSTZNbjAlM0QlN0MzMDAwJTdDJTdDJTdDJmFtcDtzZGF0YT05UWQy V0lQME9OZTJ6dCUyRlgzcjB3czNRUU1rUk5qZm1lWTdkbDlMSDZUOWslM0QmYW1wO3Jlc2Vy dmVkPTANCj4+Pj4+IF9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fDQo+Pj4+PiBTdGFybGluayBtYWlsaW5nIGxpc3QNCj4+Pj4+DQo+Pj4+Pg0KPj4+ Pj4gU3RhcmxpbmtAbGlzdHMuYnVmZmVyYmxvYXQubmV0DQo+Pj4+PiBodHRwczovL2NhbjAx LnNhZmVsaW5rcy5wcm90ZWN0aW9uLm91dGxvb2suY29tLz91cmw9aHR0cHMlM0ElMkYlMkZs aXN0cy5idWZmZXJibG9hdC5uZXQlMkZsaXN0aW5mbyUyRnN0YXJsaW5rJmFtcDtkYXRhPTA1 JTdDMDElN0MlN0MwZGUxYzBkZGY1MWY0MWFlZjcwYzA4ZGFiNGZkZTVhZCU3Q2IwN2MwNjkw MjJiODQzNjY4ZDhkN2I4NDVkMDg4ZTE4JTdDMSU3QzAlN0M2MzgwMjEyOTk4MTc4NzIxNTYl N0NVbmtub3duJTdDVFdGcGJHWnNiM2Q4ZXlKV0lqb2lNQzR3TGpBd01EQWlMQ0pRSWpvaVYy bHVNeklpTENKQlRpSTZJazFoYVd3aUxDSlhWQ0k2TW4wJTNEJTdDMzAwMCU3QyU3QyU3QyZh bXA7c2RhdGE9aEV1d00ySWFsRnQ2N2N4JTJGa3FRdUhOUiUyRkwlMkI4cHdIMFBLdE1DaUZN YjZ5VSUzRCZhbXA7cmVzZXJ2ZWQ9MA0KPj4+PiAtLQ0KPj4+PiBEYXZpZCBDb2xsaWVyLUJy b3duLCAgICAgICAgIHwgQWx3YXlzIGRvIHJpZ2h0LiBUaGlzIHdpbGwgZ3JhdGlmeQ0KPj4+ PiBTeXN0ZW0gUHJvZ3JhbW1lciBhbmQgQXV0aG9yIHwgc29tZSBwZW9wbGUgYW5kIGFzdG9u aXNoIHRoZSByZXN0DQo+Pj4+DQo+Pj4+DQo+Pj4+IGRhdmUuY29sbGllci1icm93bkBpbmRl eGV4Y2hhbmdlLmNvbQ0KPj4+PiAgIHwgICAgICAgICAgICAgIC0tIE1hcmsgVHdhaW4NCj4+ Pj4NCj4+Pj4gQ09ORklERU5USUFMSVRZIE5PVElDRSBBTkQgRElTQ0xBSU1FUiA6IFRoaXMg dGVsZWNvbW11bmljYXRpb24sIGluY2x1ZGluZyBhbnkgYW5kIGFsbCBhdHRhY2htZW50cywg Y29udGFpbnMgY29uZmlkZW50aWFsIGluZm9ybWF0aW9uIGludGVuZGVkIG9ubHkgZm9yIHRo ZSBwZXJzb24ocykgdG8gd2hvbSBpdCBpcyBhZGRyZXNzZWQuIEFueSBkaXNzZW1pbmF0aW9u LCBkaXN0cmlidXRpb24sIGNvcHlpbmcgb3IgZGlzY2xvc3VyZSBpcyBzdHJpY3RseSBwcm9o aWJpdGVkIGFuZCBpcyBub3QgYSB3YWl2ZXIgb2YgY29uZmlkZW50aWFsaXR5LiBJZiB5b3Ug aGF2ZSByZWNlaXZlZCB0aGlzIHRlbGVjb21tdW5pY2F0aW9uIGluIGVycm9yLCBwbGVhc2Ug bm90aWZ5IHRoZSBzZW5kZXIgaW1tZWRpYXRlbHkgYnkgcmV0dXJuIGVsZWN0cm9uaWMgbWFp bCBhbmQgZGVsZXRlIHRoZSBtZXNzYWdlIGZyb20geW91ciBpbmJveCBhbmQgZGVsZXRlZCBp dGVtcyBmb2xkZXJzLiBUaGlzIHRlbGVjb21tdW5pY2F0aW9uIGRvZXMgbm90IGNvbnN0aXR1 dGUgYW4gZXhwcmVzcyBvciBpbXBsaWVkIGFncmVlbWVudCB0byBjb25kdWN0IHRyYW5zYWN0 aW9ucyBieSBlbGVjdHJvbmljIG1lYW5zLCBub3IgZG9lcyBpdCBjb25zdGl0dXRlIGEgY29u dHJhY3Qgb2ZmZXIsIGEgY29udHJhY3QgYW1lbmRtZW50IG9yIGFuIGFjY2VwdGFuY2Ugb2Yg YSBjb250cmFjdCBvZmZlci4gQ29udHJhY3QgdGVybXMgY29udGFpbmVkIGluIHRoaXMgdGVs ZWNvbW11bmljYXRpb24gYXJlIHN1YmplY3QgdG8gbGVnYWwgcmV2aWV3IGFuZCB0aGUgY29t cGxldGlvbiBvZiBmb3JtYWwgZG9jdW1lbnRhdGlvbiBhbmQgYXJlIG5vdCBiaW5kaW5nIHVu dGlsIHNhbWUgaXMgY29uZmlybWVkIGluIHdyaXRpbmcgYW5kIGhhcyBiZWVuIHNpZ25lZCBi eSBhbiBhdXRob3JpemVkIHNpZ25hdG9yeS4NCj4+Pj4NCj4+Pj4gX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18NCj4+Pj4gU3RhcmxpbmsgbWFpbGlu ZyBsaXN0DQo+Pj4+DQo+Pj4+IFN0YXJsaW5rQGxpc3RzLmJ1ZmZlcmJsb2F0Lm5ldA0KPj4+ PiBodHRwczovL2NhbjAxLnNhZmVsaW5rcy5wcm90ZWN0aW9uLm91dGxvb2suY29tLz91cmw9 aHR0cHMlM0ElMkYlMkZsaXN0cy5idWZmZXJibG9hdC5uZXQlMkZsaXN0aW5mbyUyRnN0YXJs aW5rJmFtcDtkYXRhPTA1JTdDMDElN0MlN0MwZGUxYzBkZGY1MWY0MWFlZjcwYzA4ZGFiNGZk ZTVhZCU3Q2IwN2MwNjkwMjJiODQzNjY4ZDhkN2I4NDVkMDg4ZTE4JTdDMSU3QzAlN0M2Mzgw MjEyOTk4MTc4NzIxNTYlN0NVbmtub3duJTdDVFdGcGJHWnNiM2Q4ZXlKV0lqb2lNQzR3TGpB d01EQWlMQ0pRSWpvaVYybHVNeklpTENKQlRpSTZJazFoYVd3aUxDSlhWQ0k2TW4wJTNEJTdD MzAwMCU3QyU3QyU3QyZhbXA7c2RhdGE9aEV1d00ySWFsRnQ2N2N4JTJGa3FRdUhOUiUyRkwl MkI4cHdIMFBLdE1DaUZNYjZ5VSUzRCZhbXA7cmVzZXJ2ZWQ9MA0KPj4gLS0NCj4+IERhdmlk IENvbGxpZXItQnJvd24sICAgICAgICAgfCBBbHdheXMgZG8gcmlnaHQuIFRoaXMgd2lsbCBn cmF0aWZ5DQo+PiBTeXN0ZW0gUHJvZ3JhbW1lciBhbmQgQXV0aG9yIHwgc29tZSBwZW9wbGUg YW5kIGFzdG9uaXNoIHRoZSByZXN0DQo+Pg0KPj4gZGF2ZS5jb2xsaWVyLWJyb3duQGluZGV4 ZXhjaGFuZ2UuY29tICB8ICAgICAgICAgICAgICAtLSBNYXJrIFR3YWluDQoNCi0tIA0KRGF2 aWQgQ29sbGllci1Ccm93biwgICAgICAgICB8IEFsd2F5cyBkbyByaWdodC4gVGhpcyB3aWxs IGdyYXRpZnkNClN5c3RlbSBQcm9ncmFtbWVyIGFuZCBBdXRob3IgfCBzb21lIHBlb3BsZSBh bmQgYXN0b25pc2ggdGhlIHJlc3QNCmRhdmUuY29sbGllci1icm93bkBpbmRleGV4Y2hhbmdl LmNvbSAgfCAgICAgICAgICAgICAgLS0gTWFyayBUd2Fpbg0KDQo= --------------064fGbelvfqcA7coGJSOPesP Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable

OK, it's pretty clear that we're already measuring and adapting to misery, does anyone have a good reason to want to provide a "misery meter"? 

I'd normally be tempted, but I'm working in the ML team in a startup, and have been having trouble even reading email this year (;-))

--dave



On 10/23/22 09:52, Sebastian Moeller wrote:
[EXTERNAL] This email originat=
ed from outside the organization. Do not click links or open attachments un=
less you recognize the sender and know the content is safe.

Hi David,



On Oct 23, 2022, at 15:11, D=
ave Collier-Brown <dave.collier-Brown@indexexchange.com>=
 wrote:

On 10/23/22 08:26, Sebastian Moeller wrote:


        [SM] Kathy Nichols=
' pping (https://can01.safelinks.protection.outlook.com/?url=3Dhttps=
%3A%2F%2Fgithub.com%2Fpollere%2Fpping&amp;data=3D05%7C01%7C%7C0de1c0ddf=
51f41aef70c08dab4fde5ad%7Cb07c069022b843668d8d7b845d088e18%7C1%7C0%7C638021=
299817872156%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLC=
JBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&amp;sdata=3DJsNkkEDTzwCint=
X7H2KhsviIuc2S4r7RFYIevucnKeA%3D&amp;reserved=3D0) might be an opti=
on, either on the ISP side or run on CPEs with some method to harvest the c=
ollected data from the ISP side.

Yes: I use pping to investig=
ate occasional problems at work, but I was thinking more about home network=
s, where some big speed-changes happen and local congestion happens.

        [SM] Okay. In the context of cake-autorate (https://can01.safelinks.protection.outlook.com/?ur=
l=3Dhttps%3A%2F%2Fgithub.com%2Flynxthecat%2FCAKE-autorate%2Fblob%2Fmain%2FR=
EADME.md&amp;data=3D05%7C01%7C%7C0de1c0ddf51f41aef70c08dab4fde5ad%7Cb07=
c069022b843668d8d7b845d088e18%7C1%7C0%7C638021299817872156%7CUnknown%7CTWFp=
bGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%=
7C3000%7C%7C%7C&amp;sdata=3DLwP%2F45%2FIdIJgdFGITFEgYa2egg4xyQEqkE21HYK=
b0nM%3D&amp;reserved=3D0) we implemented a flight recorder type log=
ging that continuously logs the last X (configurable) epoch and stores bot =
shaper and achieved rates as well as the results from the latency probes. T=
his script can be used with rate setting disabled to record relevant data a=
nd the user just needs to remember to export the data after experiencing in=
teresting/abnormal events. Sure this does not have per application resoluti=
on, but should give some idea about current latency as well as current traf=
fic. I will admit though that this logging is not exactly cheap CPU-wise an=
d lacks the precision of packet captures... but it can be operated as fligh=
t recorder where relevant events can be exported/stored post-hoc...




        

          
Protocols with less fields=
 readable like QUIC would require special care to evaluate the spin-bit if =
that exists. Or just resort to active polling and ping* each CPE once per s=
econd or so (for a course resolution, you could increase the polling rate o=
n detecting anomalies thereby risking to make congestion slightly worse). N=
one of this will allow to measure within home network congestion though, bu=
t it might still be a wortwhile diagnostic to know that the access link is =
OK, while the user reports latency issues.


        

        
If one has a good way to cap=
ture RTT and data rate for one problematic app, say zoom, then one could se=
e that network problems were happening at the same time as lags and dropout=
s.


      

      
        [SM] As above logging all traffic is relatively easy, per applicati=
on or per flow will require different tools or packet captures...



      

        
ISPs would positively hate t=
hat, of course.


      

      
        [SM] Assuming they come out of this looking bad, if the outcome is =
to imply the local WiFi being the root cause ISPs might actually appreciate=
 it ;)

Regards
        Sebastian



      

        
--dave






        

          
Regards
        Sebastian

*) I think there are dedicated devices available that allow to ping large n=
umbers of IPs in a periodic fashion.





          

            
--dave



On 10/23/22 07:57, Sebastian Moeller via Starlink wrote:



            

              
Hi Glenn,






              

                
On Oct 23, 2022, at =
02:17, Glenn Fishbine via Rpm <rpm@lists.bufferbloat.net>

 wrote:

As a classic died in the wool empiricist, granted that you can identify &qu=
ot;misery" factors, given a population of 1,000 users, how do you prop=
ose deriving a misery index for that population?

We can measure download, upload, ping, jitter pretty much without user inte=
rvention.  For the measurements you hypothesize, how you you automatically =
extract those indecies without subjective user contamination.

I.e.  my download speed sucks. Measure the download speed.

My isp doesn't fix my problem. Measure what? How?

Human survey technology is 70+ years old and it still has problems figuring=
 out how to correlate opinion with fact.

Without an objective measurement scheme that doesn't require human interact=
ion, the misery index is a cool hypothesis with no way to link to actual da=
ta.  What objective measurements can be made?  Answer that and the index be=
comes useful. Otherwise it's just consumer whining.

Not trying to be combative here, in fact I like the concept you support, bu=
t I'm hard pressed to see how the concept can lead to data, and the data le=
ad to policy proposals.




              

              
     [SM] So it seems =
that outside of seemingly simple to test throughput numbers*, the next most=
 important quality number (or the most important depending on subjective ra=
nking) is how does latency change under "load". Absolute latency =
is also important albeit static high latency can be worked around within li=
mits so the change under load seems more relevant.
     All of flent's RRUL test, apple's networkQuality/RPM, and iperf2's bou=
nceback test offer methods to asses latency change under load**, as do wave=
forms bufferbloat tests and even to a degree Ookla's speedtest.net. IMHO so=
mething like latency increase under load or apple's responsiveness measure =
RPM (basically the inverse of the latency under load calculated on a per mi=
nute basis, so it scales in the typical higher numbers are better way, unli=
ke raw latency under load numbers where smaller is better).
     IMHO what networkQuality is missing ATM is to measure and report the u=
nloaded RPM as well as the loaded the first gives a measure over the static=
 latency the second over how well things keep working if capacity gets tigh=
t. They report the base RTT which can be converted to RPM. As an example:

macbook:~ user$ networkQuality -v
=3D=3D=3D=3D SUMMARY =3D=3D=3D=3D
Upload capacity: 24.341 Mbps
Download capacity: 91.951 Mbps
Upload flows: 20
Download flows: 16
Responsiveness: High (2123 RPM)
Base RTT: 16
Start: 10/23/22, 13:44:39
End: 10/23/22, 13:44:53
OS Version: Version 12.6 (Build 21G115)

Here RPM 2133 corresponds to 60000/2123 =3D 28.26 ms latency under load, wh=
ile the Base RTT of 16ms corresponds to 60000/16 =3D 3750 RPM, son on this =
link load reduces the responsiveness by 3750-2123 =3D 1627 RPM a reduction =
by 100-100*2123/3750 =3D 43.4%, and that is with competent AQM and scheduli=
ng on the router.

Without competent AQM/shaping I get:
=3D=3D=3D=3D SUMMARY =3D=3D=3D=3D
Upload capacity: 15.101 Mbps
Download capacity: 97.664 Mbps
Upload flows: 20
Download flows: 12
Responsiveness: Medium (427 RPM)
Base RTT: 16
Start: 10/23/22, 13:51:50
End: 10/23/22, 13:52:06
OS Version: Version 12.6 (Build 21G115)
latency under load: 60000/427 =3D 140.52 ms
base RPM: 60000/16 =3D 3750 RPM
reduction RPM: 100-100*427/3750 =3D 88.6%


I understand apple's desire to have a single reported number with a single =
qualifier medium/high/... because in the end a link is only reliably usable=
 if responsiveness under load stays acceptable, but with two numbers it is =
easier to see what one's ISP could do to help. (I guess some ISPs might alr=
eady be unhappy with the single number, so this needs some diplomacy/tact)

Regards
     Sebastian



*) Seemingly as quite some ISPs operate their own speedtest servers in thei=
r network and ignore customers not reaching the contracted rates into speed=
test-servers located in different ASs. As the product is called internet ac=
cess I a inclined to expect that my ISP maintains sufficient peering/transi=
t capacity to reach the next tier of AS at my contracted rate (the EU legis=
lative seems to agree, see EU directive 2015/2120).

**) Most do by creating load themselves and measuring throughput at the sam=
e time, bounceback IIUC will focus on the latency measurement and leave the=
 load generation optional (so offers a mode to measure responsiveness of a =
live network with minimal measurement traffic). @Bob, please correct me if =
this is wrong.






              

                
On Fri, Oct 21, 2022=
, 5:20 PM Dave Taht

<=
dave.taht@gmail.com>

 wrote:
One of the best talks I've ever seen on how to measure customer
satisfaction properly just went up after the P99 Conference.

It's called Misery Metrics.

After going through a deep dive as to why and how we think and act on
percentiles, bins, and other statistical methods as to how we use the
web and internet are *so wrong* (well worth watching and thinking
about if you are relying on or creating network metrics today), it
then points to the real metrics that matter to users and the ultimate
success of an internet business: Timeouts, retries, misses, failed
queries, angry phone calls, abandoned shopping carts and loss of
engagement.



https://can01.safelinks.protectio=
n.outlook.com/?url=3Dhttps%3A%2F%2Fwww.p99conf.io%2Fsession%2Fmisery-metric=
s-consequences%2F&amp;data=3D05%7C01%7C%7C0de1c0ddf51f41aef70c08dab4fde=
5ad%7Cb07c069022b843668d8d7b845d088e18%7C1%7C0%7C638021299817872156%7CUnkno=
wn%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVC=
I6Mn0%3D%7C3000%7C%7C%7C&amp;sdata=3D%2FOe2eo9f7JQ8bnQRB23HEaeXq6G9QxSQ=
%2FZkNb%2F6ctyU%3D&amp;reserved=3D0



The ending advice was - don't aim to make a specific percentile
acceptable, aim for an acceptable % of misery.

I enjoyed the p99 conference more than any conference I've attended in year=
s.

--
This song goes out to all the folk that thought Stadia would work:


https://ca=
n01.safelinks.protection.outlook.com/?url=3Dhttps%3A%2F%2Fwww.linkedin.com%=
2Fposts%2Fdtaht_the-mushroom-song-activity-6981366665607352320-FXtz&amp=
;data=3D05%7C01%7C%7C0de1c0ddf51f41aef70c08dab4fde5ad%7Cb07c069022b843668d8=
d7b845d088e18%7C1%7C0%7C638021299817872156%7CUnknown%7CTWFpbGZsb3d8eyJWIjoi=
MC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&=
amp;amp;sdata=3DALKX4qknTgJBAiBET9j2yfdyhuEmM5rs2Ng3%2B09rat4%3D&amp;re=
served=3D0


Dave T=C3=A4ht CEO, TekLibre, LLC

--
You received this message because you are subscribed to the Google Groups &=
quot;discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an e=
mail to

discuss+unsubscribe@measurementlab.net

.
To view this discussion on the web visit

https://can01.safelinks.pr=
otection.outlook.com/?url=3Dhttps%3A%2F%2Fgroups.google.com%2Fa%2Fmeasureme=
ntlab.net%2Fd%2Fmsgid%2Fdiscuss%2FCAA93jw4w27a1EO_QQG7NNkih%252BC3QQde5%253=
D_7OqGeS9xy9nB6wkg%2540mail.gmail.com&amp;data=3D05%7C01%7C%7C0de1c0ddf=
51f41aef70c08dab4fde5ad%7Cb07c069022b843668d8d7b845d088e18%7C1%7C0%7C638021=
299817872156%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLC=
JBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&amp;sdata=3DHVk9tgu97ElRdv=
dHiiE3PSuEzT6PM731Ag4XMIVDJIU%3D&amp;reserved=3D0

.
_______________________________________________
Rpm mailing list


Rpm@lists.bufferbloat.net
https://can01.safelinks.protection.outlook.com/?url=3Dht=
tps%3A%2F%2Flists.bufferbloat.net%2Flistinfo%2Frpm&amp;data=3D05%7C01%7=
C%7C0de1c0ddf51f41aef70c08dab4fde5ad%7Cb07c069022b843668d8d7b845d088e18%7C1=
%7C0%7C638021299817872156%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQI=
joiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&amp;sdata=3D9=
Qd2WIP0ONe2zt%2FX3r0ws3QQMkRNjfmeY7dl9LH6T9k%3D&amp;reserved=3D0


              

              
______________________=
_________________________
Starlink mailing list


Starlink@lists.bufferbloat.net
https://can01.safelinks.protection.outlook.com/=
?url=3Dhttps%3A%2F%2Flists.bufferbloat.net%2Flistinfo%2Fstarlink&amp;da=
ta=3D05%7C01%7C%7C0de1c0ddf51f41aef70c08dab4fde5ad%7Cb07c069022b843668d8d7b=
845d088e18%7C1%7C0%7C638021299817872156%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4=
wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&=
;amp;sdata=3DhEuwM2IalFt67cx%2FkqQuHNR%2FL%2B8pwH0PKtMCiFMb6yU%3D&amp;r=
eserved=3D0


            

            
--
David Collier-Brown,         | Always do right. This will gratify
System Programmer and Author | some people and astonish the rest


dave.collier-brown@indexexchange.com
 |              -- Mark Twain

CONFIDENTIALITY NOTICE AND DISCLAIMER : This telecommunication, including a=
ny and all attachments, contains confidential information intended only for=
 the person(s) to whom it is addressed. Any dissemination, distribution, co=
pying or disclosure is strictly prohibited and is not a waiver of confident=
iality. If you have received this telecommunication in error, please notify=
 the sender immediately by return electronic mail and delete the message fr=
om your inbox and deleted items folders. This telecommunication does not co=
nstitute an express or implied agreement to conduct transactions by electro=
nic means, nor does it constitute a contract offer, a contract amendment or=
 an acceptance of a contract offer. Contract terms contained in this teleco=
mmunication are subject to legal review and the completion of formal docume=
ntation and are not binding until same is confirmed in writing and has been=
 signed by an authorized signatory.

_______________________________________________
Starlink mailing list

Starlink@lists.bufferbloat.net
https://can01.safelinks.protection.outlook.com/=
?url=3Dhttps%3A%2F%2Flists.bufferbloat.net%2Flistinfo%2Fstarlink&amp;da=
ta=3D05%7C01%7C%7C0de1c0ddf51f41aef70c08dab4fde5ad%7Cb07c069022b843668d8d7b=
845d088e18%7C1%7C0%7C638021299817872156%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4=
wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&=
;amp;sdata=3DhEuwM2IalFt67cx%2FkqQuHNR%2FL%2B8pwH0PKtMCiFMb6yU%3D&amp;r=
eserved=3D0


          

        

        
--
David Collier-Brown,         | Always do right. This will gratify
System Programmer and Author | some people and astonish the rest

dave.collier-brown@indexexchange.com |              -- =
Mark Twain


      

      

    

    
--=20
David Collier-Brown,         | Always do right. This will gratify
System Programmer and Author | some people and astonish the rest
dave.collier-brown@indexexchange.com |              -- =
Mark Twain

  


--------------064fGbelvfqcA7coGJSOPesP--