<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body>
<p>I read the talk as saying we should <i>measure and report the failures rather than the successes</i>.</p>
<p>Let's say download speed is the problem, and I'm Rogers, an ISP with lots of subnets. For each I plot the number of downloads per net per hour which were slower than X kb/s, not counting ones whose total time were less than 2 seconds.
<br>
</p>
<p>That gives you a measurement that fairly closely models the degree of human annoyance you're causing (;-))</p>
<p>And Rogers causes a lot, but it's usually on concalls, not downloads.<br>
</p>
<p>--dave</p>
<p>[I might use a poll to see if a claimed huge improvement worked, but I don't trust human estimations any more that you do (:-)]</p>
<p><br>
</p>
<div class="moz-cite-prefix">On 10/22/22 20:17, Glenn Fishbine via Starlink wrote:<br>
</div>
<blockquote type="cite" cite="mid:CABs+J_DhaLPp8nba=hqrg6Z_Db3DBH1__FymBsqEXgSDo+8-5w@mail.gmail.com">
<div dir="auto">As a classic died in the wool empiricist, granted that you can identify "misery" factors, given a population of 1,000 users, how do you propose deriving a misery index for that population?
<div dir="auto"><br>
</div>
<div dir="auto">We can measure download, upload, ping, jitter pretty much without user intervention. For the measurements you hypothesize, how you you automatically extract those indecies without subjective user contamination.</div>
<div dir="auto"><br>
</div>
<div dir="auto">I.e. my download speed sucks. Measure the download speed.</div>
<div dir="auto"><br>
</div>
<div dir="auto">My isp doesn't fix my problem. Measure what? How?</div>
<div dir="auto"><br>
</div>
<div dir="auto">Human survey technology is 70+ years old and it still has problems figuring out how to correlate opinion with fact.</div>
<div dir="auto"><br>
</div>
<div dir="auto">Without an objective measurement scheme that doesn't require human interaction, the misery index is a cool hypothesis with no way to link to actual data. What objective measurements can be made? Answer that and the index becomes useful. Otherwise
it's just consumer whining.</div>
<div dir="auto"><br>
</div>
<div dir="auto">Not trying to be combative here, in fact I like the concept you support, but I'm hard pressed to see how the concept can lead to data, and the data lead to policy proposals.</div>
<div dir="auto"><br>
</div>
</div>
<br>
<div class="gmail_quote">
<div dir="ltr" class="gmail_attr">On Fri, Oct 21, 2022, 5:20 PM Dave Taht <<a href="mailto:dave.taht@gmail.com" moz-do-not-send="true" class="moz-txt-link-freetext">dave.taht@gmail.com</a>> wrote:<br>
</div>
<blockquote class="gmail_quote" style="margin:0 0 0
.8ex;border-left:1px #ccc solid;padding-left:1ex">
One of the best talks I've ever seen on how to measure customer<br>
satisfaction properly just went up after the P99 Conference.<br>
<br>
It's called Misery Metrics.<br>
<br>
After going through a deep dive as to why and how we think and act on<br>
percentiles, bins, and other statistical methods as to how we use the<br>
web and internet are *so wrong* (well worth watching and thinking<br>
about if you are relying on or creating network metrics today), it<br>
then points to the real metrics that matter to users and the ultimate<br>
success of an internet business: Timeouts, retries, misses, failed<br>
queries, angry phone calls, abandoned shopping carts and loss of<br>
engagement.<br>
<br>
<a href="https://www.p99conf.io/session/misery-metrics-consequences/" rel="noreferrer noreferrer" target="_blank" moz-do-not-send="true" class="moz-txt-link-freetext">https://www.p99conf.io/session/misery-metrics-consequences/</a><br>
<br>
The ending advice was - don't aim to make a specific percentile<br>
acceptable, aim for an acceptable % of misery.<br>
<br>
I enjoyed the p99 conference more than any conference I've attended in years.<br>
<br>
-- <br>
This song goes out to all the folk that thought Stadia would work:<br>
<a href="https://www.linkedin.com/posts/dtaht_the-mushroom-song-activity-6981366665607352320-FXtz" rel="noreferrer noreferrer" target="_blank" moz-do-not-send="true" class="moz-txt-link-freetext">https://www.linkedin.com/posts/dtaht_the-mushroom-song-activity-6981366665607352320-FXtz</a><br>
Dave Täht CEO, TekLibre, LLC<br>
<br>
-- <br>
You received this message because you are subscribed to the Google Groups "discuss" group.<br>
To unsubscribe from this group and stop receiving emails from it, send an email to
<a href="mailto:discuss%2Bunsubscribe@measurementlab.net" target="_blank" rel="noreferrer" moz-do-not-send="true">
discuss+unsubscribe@measurementlab.net</a>.<br>
To view this discussion on the web visit <a href="https://groups.google.com/a/measurementlab.net/d/msgid/discuss/CAA93jw4w27a1EO_QQG7NNkih%2BC3QQde5%3D_7OqGeS9xy9nB6wkg%40mail.gmail.com" rel="noreferrer noreferrer" target="_blank" moz-do-not-send="true" class="moz-txt-link-freetext">
https://groups.google.com/a/measurementlab.net/d/msgid/discuss/CAA93jw4w27a1EO_QQG7NNkih%2BC3QQde5%3D_7OqGeS9xy9nB6wkg%40mail.gmail.com</a>.<br>
</blockquote>
</div>
<br>
<fieldset class="moz-mime-attachment-header"></fieldset>
<pre class="moz-quote-pre" wrap="">_______________________________________________
Starlink mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Starlink@lists.bufferbloat.net">Starlink@lists.bufferbloat.net</a>
<a class="moz-txt-link-freetext" href="https://lists.bufferbloat.net/listinfo/starlink">https://lists.bufferbloat.net/listinfo/starlink</a>
</pre>
</blockquote>
<pre class="moz-signature" cols="72">--
David Collier-Brown, | Always do right. This will gratify
System Programmer and Author | some people and astonish the rest
<a class="moz-txt-link-abbreviated" href="mailto:dave.collier-brown@indexexchange.com">dave.collier-brown@indexexchange.com</a> | -- Mark Twain</pre>
<br>
<p><strong><em><span style="color: #212121;">CONFIDENTIALITY NOTICE AND DISCLAIMER</span></em></strong><em><span style="color: #212121;"> : This telecommunication, including any and all attachments, contains confidential information intended only for the person(s)
to whom it is addressed. Any dissemination, distribution, copying or disclosure is strictly prohibited and is not a waiver of confidentiality. If you have received this telecommunication in error, please notify the sender immediately by return electronic mail
and delete the message from your inbox and deleted items folders. This telecommunication does not constitute an express or implied agreement to conduct transactions by electronic means, nor does it constitute a contract offer, a contract amendment or an acceptance
of a contract offer. Contract terms contained in this telecommunication are subject to legal review and the completion of formal documentation and are not binding until same is confirmed in writing and has been signed by an authorized signatory.</span></em></p>
</body>
</html>