From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from CAN01-YT3-obe.outbound.protection.outlook.com (mail-yt3can01on2124.outbound.protection.outlook.com [40.107.115.124]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by lists.bufferbloat.net (Postfix) with ESMTPS id D2F933B29D for ; Sat, 22 Oct 2022 17:00:44 -0400 (EDT) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=CouWtIBtVaJasLXv+1wXTgaFMm9MVy5k9TSGLR0TWWfQHgtw/tmfrPy5i7iPayxz27fkdsrUBhiv5CQiSVm45zD9nSTHSnM0jXYMAb8zyNZIzr+IDgk9AGun87imL6m5vvUjRyC8K/YFaE1W/IKLmPwvWLazZaBf+32gnsr+Fi9NsLfZ1lh1+LiciyI8PatNKFsVo+cohGObnQ8l7Y3NssYnVQDKcAodJfNej0rnmCU7lmp8hlntEr1EuD5xsnGHmORKrxq08dIgNS3OBkKSJI38jdsEhyap+Is1MKMMKUZZ5ollC2kzidN/c+AQ2u2cQOKeq3iDywEMLSC+iBteYg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=SR9Jep7mFGNRagAewAZcR4jbOyAqTqWeV5xrsinlwTI=; b=oRn719iPAJFU0KimsYeR69wwGL/cTvlcX048EiG5Eo3DUpbM0WiWkA6fUNrbUcvJ+cbAmQ0qONpfvECwBHp7LhRoYmeqtsHSlTK8pOvuF2VL2ID5jhnpYSIlcQAY2Zblow0U15yRgneKq5XApj1R4sjpgUjJIAh2X77PqAaIvWVztBtyazBJLPn+6GAQ9OVZRP50GLQAKQuWsizU57IqO50tpyh9BeB9v+VRsjvPlb2BCGw9EWu8+8W4xZiCBasHXt8y0OcdhjCk++ZTeHUHjvLLlfzClsn3WUoWsSVoFMMCfts1HgKJB7NdTlmABi9ItqqXpW6kdST2SiMO4S+0Xg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=indexexchange.com; dmarc=pass action=none header.from=indexexchange.com; dkim=pass header.d=indexexchange.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=indexexchange.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=SR9Jep7mFGNRagAewAZcR4jbOyAqTqWeV5xrsinlwTI=; b=4MJRkP63qdnyxYNwJ250R2n39L0eLFFrOV1OSunF2TQLcbjSH6YWWX4U9AhwabzPjCTl8BNeRzdW87hF/6ByK4A9uR8Pryi/RL/ZKkDMD5XEJKAPndUVGRIunP8Bgy5DsF59RRSrPYxCRCDTv2a/vexJ1O40+nTz43KdUqqBk/A= Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=indexexchange.com; Received: from YQXPR01MB4756.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c01:1e::12) by YT3PR01MB5682.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:b01:6a::8) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5746.21; Sat, 22 Oct 2022 21:00:43 +0000 Received: from YQXPR01MB4756.CANPRD01.PROD.OUTLOOK.COM ([fe80::d3d7:5363:e565:8944]) by YQXPR01MB4756.CANPRD01.PROD.OUTLOOK.COM ([fe80::d3d7:5363:e565:8944%9]) with mapi id 15.20.5746.021; Sat, 22 Oct 2022 21:00:43 +0000 Message-ID: <3d243599-8153-4244-07f4-f0b0fc3cc762@indexexchange.com> Date: Sat, 22 Oct 2022 17:00:42 -0400 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.2.2 Content-Language: en-US To: starlink@lists.bufferbloat.net References: From: Dave Collier-Brown In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: quoted-printable X-ClientProxiedBy: YT1PR01CA0126.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:b01:2c::35) To YQXPR01MB4756.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c01:1e::12) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: YQXPR01MB4756:EE_|YT3PR01MB5682:EE_ X-MS-Office365-Filtering-Correlation-Id: c7aa582f-411d-4a1c-e731-08dab4707ba5 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: s+873Glx8RsgDysMJMKxHwW53JoDOQA8+V614SOPbDyrtFOBmTqd1kIeAedKiqFqEDZyeiJCFaNaBYAW1WY9yANx94ODkwJ+DCVh60JYpoV2qWtgCZ/FIacVSibpANdD6KAl3S+j6esycz8GIeiEVCT+6aUoiuWVNIgzLC4W3xvr4H/YI5kw3QaSxV5bYL7zbYeZ2R7iTz3vzkdekkczROLoE+zQTbuAE6htGeJCMO+9mAoG5gPO14A3PQPsx7vBdrDDW+nnSaaBfI5GPsrSwXma60mrtottiJ3Uzb5eytexkI1YThQZyx58xxH322uQMfG0Fgbb/0On8OsclM0XqMab20+N+9o3PTFw8pXt0Kd/rJeAHEH3XpzGgq3cgjhrALGIVSqGx839lER1HmSZ5L4rlUxW71JyPUvl+Et1wuUJuKJab1EyxMkoXyY7q28E6Sj8Z2Z8eqnYdTjxh9znn/awvOFfuRLHfyADTciaUnG8U/5/wDXSb2CuQfIpvrk04+olFSaKyImkIRuJb7MTDQQoQ1bn3aQVHE/TUR7Buf1vkiHbqUHA7eH+HOS0tultYBIrBD2zUKzs/Z2R+zdgUW489SXR0jClAbI9JFI5PtBoGT5zl7DW2cNRvYkDkFIIqWO41G+EhR4NXnqvoJA1wMY403DW5qlsK05KB39mIU1GMV6iavmlDvCth/G6fGbpxqWhLyX4abTtkYt/KPnmefUZvSBtNaQwqB3rR4TpB6Y7o/RDG6d5VUlnLYJilqKxp/t0MVwEarhTf2BQ2X6kNdchyKC1s8Xzt3dypo+QItB4/H79seoqB1xsLQMZpfxn X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:YQXPR01MB4756.CANPRD01.PROD.OUTLOOK.COM; PTR:; CAT:NONE; SFS:(13230022)(4636009)(39850400004)(366004)(136003)(346002)(396003)(376002)(451199015)(36756003)(31686004)(6486002)(66899015)(86362001)(31696002)(38100700002)(2906002)(66574015)(2616005)(186003)(83380400001)(53546011)(6506007)(966005)(6512007)(26005)(316002)(66476007)(6916009)(66946007)(66556008)(8676002)(5660300002)(41300700001)(8936002)(478600001)(45980500001)(43740500002); DIR:OUT; SFP:1102; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?bldHeGdYZWQ5c3IrRW94VHY5YU1hbEtZVHdBQnRNcy8rMnJ5bDFBMzdIUUdD?= =?utf-8?B?SVNVUTE5OG9ZOHEySGpWNXV4djhhczlFMzI0ZkhHNTBReGhxU3dPZU4wY2hv?= =?utf-8?B?aUsyNklTU0lwaW5sU0dScmJNOVl4d1E5YTNZKzZnSkxhT0JTS2E3dmlXUyt2?= =?utf-8?B?R3pBekJXRGlkdldrK1Z1NFZ4OThXdSsrRjdCQzR4Q2puSytmc0N0YUJSZUJU?= =?utf-8?B?ZW1qRFdUaW0wUDhnaHJXWEZZSjFYZ2wyeVRQVUhSQStXaHhNVWkwRlFwYUtM?= =?utf-8?B?eU1mMjUxVnJHZGl2ZUs5ZXZsbWJDS1VUdDVLTllVcEtjN2ZDbm56Zk9VWmh4?= =?utf-8?B?V09ROWlBckoxRVlwYXJ4ZU1kNHIrOEtNMVVuSXpYaEhvc0R4Q1VMTE9ya0wx?= =?utf-8?B?N29UazdlZ1NHQlZIMHJxb0ZRbDdYMWY1Zm1xanJqaE5FbTNrYlhDR2RZSHJ4?= =?utf-8?B?Mmp0WWtlQTZWVXdqMlpFc2FUVDVDeDRyL0ozTlE5NkF2eUpZakdmcUoxQlpL?= =?utf-8?B?VHc0bHEvMEJ4Q0EwUWlJRFp2SEZobXIweG1icnB5dmVXa2pJcERPeFV4UnlQ?= =?utf-8?B?NUdmbWhiVVJMVmxpd0U4U2xVbzVPclR4d251dHBveHBmRHBtWUZqSkxOeXFM?= =?utf-8?B?SjcrcXZlbGptdDZ6MmIzWGg0YjBjVmd0WUN4NXo0UnZ2NlFJajFpNG9WVEQx?= =?utf-8?B?bTFacWVZbUJscS9OTmJpRjRGOXdXbFhhVU5hRS9BZE5uL0NCN2s3Zi9FT1FJ?= =?utf-8?B?Q2d5US84VGhLQjg0dEl1TGRidGd0Q2FrdTI2YjZwczFSR2ptL2dUUEovaUtE?= =?utf-8?B?Q0ZHOEE1VnVLMzN4TjRTc3A5OTFPL0ZuRUVBa0pwdGlrZFM4aFNib1o0Rk5u?= =?utf-8?B?NnpuV2hKMkRySUFJV1ozeUdSckpRdHBzc29qVXN4ZzBvMGN3a0lwYzBBbFJU?= =?utf-8?B?WlpxaDJtWWdTWW9JeVkxTndWWEFPTHozUlNKaUZXMDdEZnZWMFAzTnhlUWZ5?= =?utf-8?B?SzFBdHlwZEpHbXdtaHR3ZkRlNjdza2o5REViQktDWlNQTEE3Vmppd05PV2NO?= =?utf-8?B?SFlZZVNrNTYxZ1FPZzVEdXRzMFMvOHhyVG1mU3YwU0dFaTZEN0xFMTk1OVQ1?= =?utf-8?B?eEtJZmdpdDVHa0NCQzl6TVdVb3F0M21aemlWQWN4d1crOFhuRERBZTVONzFH?= =?utf-8?B?Tm1NU29pc2x2OWhQczQwMTkxSEMvSGl0ZXBwOHZYWVovVnFpdk5QQkFFWWpp?= =?utf-8?B?N2IwZFlWSkdUMEZUeVhDU2hTV0NCU3RNQVBOSDlVUk1abHBRd2YrUGp3NzQ3?= =?utf-8?B?TWw2UzgvTktEZG9razZlSDFsMHFNdkFpOXVoZ1ZlaWU3cHZzNldJVU5nYXZD?= =?utf-8?B?dFVlNFVvd1VJRWxJeE1iRFBCSnluSDQ0Wk1oV3o5ZEptWmhpZ0twV3UzdEZa?= =?utf-8?B?MlVDVnBoZGl6NVpMeXRxeHJjWkY4ME1QZ3ZMODNxaDhmUzlKeng4MUtLNFFD?= =?utf-8?B?NVRqNTF4SFFrcmpUM0RQNVlrZnZkWE4zdUg5NE1iYkl0T1NGZjhsTXI1bEZ1?= =?utf-8?B?TzdtaitpNko4OU5jbUtyR2RhUm5WRGpyMnpMZXpLUytCTk1EN3h4UlFQZE9i?= =?utf-8?B?UHhjcDFtVGtHYWtnRzlSMy9qU2U2UU9Md2xpb1h4SkhuUTRjWGtTd0Ircndk?= =?utf-8?B?L2FldlBqbWtqdHVyZjl6aXJxWnR6NlJTeUNVUGZRUFdWS284MzBHVkVtbmF2?= =?utf-8?B?d0ZuWldwWXBkbE9mTkxBWkpUbUs2T1hTbFJzMDBFMEFnM24xUGJ4NGpYK0k0?= =?utf-8?B?WnVXODl2em5WRk9TN1VpREE3d0E4cmpOWUNubHNMa1hZNDQ0SFFVTkRXSlNu?= =?utf-8?B?Y0dSU1VrSUlYSlRTTDhSWlBXNFBRYy9BVkVDbUJOUHNydnZKY054Y1N6cEY5?= =?utf-8?B?ZDZodmpkZ0R6QnBiSGxMMWxjS3lST2hvQzhRNmtwTHFXV0ZSekFRNnBOeEsv?= =?utf-8?B?dUVmRHVIV0w5U09vL1pBMXJYVk5mZ1FmL1VHK1ZZK2lHWFVkbVNTbUd1TGNl?= =?utf-8?B?dEx5eC82SGV5MWNUL3BsY0MveEZHb2pJbWZXTGVaaFFFYlRXcWtreGJpME84?= =?utf-8?B?bmhKNzFKQUY5SGp6RkIwRTdvZHRvTWRBdUFCS0JubXB1S2FUeVJ2bDlhbWJR?= =?utf-8?Q?Cksg5D7hWIQ6EQ7C66zmqBo=3D?= X-OriginatorOrg: indexexchange.com X-MS-Exchange-CrossTenant-Network-Message-Id: c7aa582f-411d-4a1c-e731-08dab4707ba5 X-MS-Exchange-CrossTenant-AuthSource: YQXPR01MB4756.CANPRD01.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 22 Oct 2022 21:00:43.2497 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: b07c0690-22b8-4366-8d8d-7b845d088e18 X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: KHEZHGnyjCqYTru9EtR5aVhwcBn6D8uNf+zmHjok4cd30TwrA2yRRFcGljPbwjP3oJN1FSj0VqoBHntXgC8qsIwhNGuIl7S86Wo5mxJ20YRJX0UxSA3fCOaDuWhwPg2D X-MS-Exchange-Transport-CrossTenantHeadersStamped: YT3PR01MB5682 Subject: Re: [Starlink] misery metrics & consequences X-BeenThere: starlink@lists.bufferbloat.net X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Starlink has bufferbloat. Bad." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 22 Oct 2022 21:00:44 -0000 I love it: older programs at work always reported number of timeouts vs load. I figured I'd rather have response time vs load, but I now see why we report timeouts: they accurately track the number of miserable customers (;-)) --dave (I know some of the original authors: they're no dummies) On 10/21/22 17:04, Dave Taht via Starlink wrote: > One of the best talks I've ever seen on how to measure customer > satisfaction properly just went up after the P99 Conference. > > It's called Misery Metrics. > > After going through a deep dive as to why and how we think and act on > percentiles, bins, and other statistical methods as to how we use the > web and internet are *so wrong* (well worth watching and thinking > about if you are relying on or creating network metrics today), it > then points to the real metrics that matter to users and the ultimate > success of an internet business: Timeouts, retries, misses, failed > queries, angry phone calls, abandoned shopping carts and loss of > engagement. > > https://www.p99conf.io/session/misery-metrics-consequences/ > > The ending advice was - don't aim to make a specific percentile > acceptable, aim for an acceptable % of misery. > > I enjoyed the p99 conference more than any conference I've attended in ye= ars. > -- David Collier-Brown, | Always do right. This will gratify System Programmer and Author | some people and astonish the rest dave.collier-brown@indexexchange.com | -- Mark Twain CONFIDENTIALITY NOTICE AND DISCLAIMER : This telecommunication, including a= ny and all attachments, contains confidential information intended only for= the person(s) to whom it is addressed. Any dissemination, distribution, co= pying or disclosure is strictly prohibited and is not a waiver of confident= iality. If you have received this telecommunication in error, please notify= the sender immediately by return electronic mail and delete the message fr= om your inbox and deleted items folders. This telecommunication does not co= nstitute an express or implied agreement to conduct transactions by electro= nic means, nor does it constitute a contract offer, a contract amendment or= an acceptance of a contract offer. Contract terms contained in this teleco= mmunication are subject to legal review and the completion of formal docume= ntation and are not binding until same is confirmed in writing and has been= signed by an authorized signatory.