<html xmlns="http://www.w3.org/1999/xhtml">
<head>
<title></title>
</head>
<body>
<div name="messageBodySection">
<div dir="auto">So the GPS is an STA8090 automotive-grade, makes sense as Dishy gets proper hot! Also supports sensor fusion for eg pointing in the right azimuth. <a href="https://www.st.com/en/automotive-infotainment-and-telematics/gnss-ics.html" target="_blank">https://www.st.com/en/automotive-infotainment-and-telematics/gnss-ics.html</a><br />
<br />
However, the beauty of GPS sync is we can choose our own time base external to Dishy :-)</div>
</div>
<div name="messageSignatureSection"><br />
Best,<br />
<br />
Mike</div>
<div name="messageReplySection">On Jun 12, 2021, 01:00 +0200, Dave Taht <davet@teklibre.net>, wrote:<br />
<blockquote type="cite" style="border-left-color: grey; border-left-width: thin; border-left-style: solid; margin: 5px 5px;padding-left: 10px;"><br class="" />
<div><br class="" />
<blockquote type="cite" class="">
<div class="">On Jun 11, 2021, at 3:39 PM, Dave Taht <<a href="mailto:davet@teklibre.net" class="">davet@teklibre.net</a>> wrote:</div>
<br class="Apple-interchange-newline" />
<div class="">
<meta charset="UTF-8" class="" />
<div style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 24px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""><br class="Apple-interchange-newline" />
<br class="" />
<blockquote type="cite" class="">
<div class="">On Jun 11, 2021, at 3:34 PM, Mike Puchol <<a href="mailto:mike@starlink.sx" class="">mike@starlink.sx</a>> wrote:</div>
<br class="Apple-interchange-newline" />
<div class="">
<div class="">
<div name="messageBodySection" class="">
<div dir="auto" class="">We know that Starlink recalculates topology every 15 seconds (this guy, who obviously has way too much spare time, came up with an indirect observation of this interval: <a href="https://blog.beerriot.com/2021/02/14/starlink-raster-scan/" target="_blank" class="">https://blog.beerriot.com/2021/02/14/starlink-raster-scan/</a> )<br class="" />
<br class="" />
If we could align with this, we could at least know when potential changes in path delays happen, and try to observe other changes that happen at a similar cadence.<br class="" />
<br class="" />
Other thoughts, try to plug more details out of the gRPC data, setup GPS-synced probes with a device at the exit PoP, measure differences between time-sync probes to an array of endpoints.<br class="" />
<br class="" /></div>
</div>
</div>
</div>
</blockquote>
<div class=""><br class="" /></div>
It’s ironic that the device has to have gps in it, and thus should be able to provide perfect time to clients directly behind it, isn’t.</div>
<div style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 24px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""><br class="" /></div>
<div style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 24px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class="">I haven’t captured a dhcp or dhcpv6 transaction yet myself,</div>
<div style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 24px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class="">do they have a ntp option?</div>
<div style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 24px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""><br class="" /></div>
<div style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 24px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class="">What gps software or driver might they have used? (esr’s gpsd is quite popular, but there are others) </div>
<div style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 24px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""><br class="" /></div>
<div style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 24px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class="">What’s the gps chip?</div>
<div style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 24px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""><br class="" /></div>
</div>
</blockquote>
<div><br class="" /></div>
<div>It would be good to have solid time everywhere, as I am seeing clocks not synced even close to 40ms accuracy of late.</div>
<div><br class="" /></div>
<div>BTW, Eric Raymond (esr) is also one of the driving forces behind ntpsec, along with gary and a few other people now on our list.</div>
<div><br class="" /></div>
<div>For more details, see:</div>
<div><a href="https://www.ntpsec.org/" class="">https://www.ntpsec.org/</a></div>
<div><br class="" /></div>
<div>Once upon a time, I sat in esr's basement hearing him rip much crud out of the old ntpd codebase over the course of a very few days. The shouts “What? WHAAAT?” and most of the other pithy comments he made never made the git log. </div>
<div><br class="" /></div>
<div>Over the years following the codebase got better and better, but adoption has been slow.</div>
<div><br class="" /></div>
<div>An intro to that woefully underfunded project:</div>
<div><br class="" /></div>
<div>
<div class="paragraph" style="color: rgb(0, 102, 0); font-family: verdana, sans-serif; font-size: medium; font-variant-ligatures: normal; orphans: 2; widows: 2; background-color: rgb(253, 241, 225); text-decoration-thickness: initial;">
<div style="margin-top: 0.5em; margin-bottom: 0.5em;" class="">NTPsec project - a secure, hardened, and improved implementation of Network Time Protocol derived from NTP Classic, Dave Mills’s original.</div>
</div>
<div class="paragraph" style="color: rgb(0, 102, 0); font-family: verdana, sans-serif; font-size: medium; font-variant-ligatures: normal; orphans: 2; widows: 2; background-color: rgb(253, 241, 225); text-decoration-thickness: initial;">
<div style="margin-top: 0.5em; margin-bottom: 0.5em;" class="">NTPsec, as its name implies, is a more secure NTP. Our goal is to deliver code that can be used with confidence in deployments with the most stringent security, availability, and assurance requirements.</div>
</div>
<div class="paragraph" style="color: rgb(0, 102, 0); font-family: verdana, sans-serif; font-size: medium; font-variant-ligatures: normal; orphans: 2; widows: 2; background-color: rgb(253, 241, 225); text-decoration-thickness: initial;">
<div style="margin-top: 0.5em; margin-bottom: 0.5em;" class="">Towards that end we apply best practices and state-of-the art technology in code auditing, verification, and testing. We begin with the most important best practice: true open-source code review. The NTPsec code is available in a public git repository. One of our goals is to support broader community participation.</div>
<div style="margin-top: 0.5em; margin-bottom: 0.5em;" class=""><br class="" /></div>
</div>
</div>
<blockquote type="cite" class="">
<div class="">
<div style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 24px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""><br class="" />
<blockquote type="cite" class="">
<div class="">
<div class="">
<div name="messageBodySection" class="">
<div dir="auto" class="">Has nobody attacked the JTAG connector on a Dishy yet?</div>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</blockquote>
<div><br class="" /></div>
I reached out to one of the teardown folk (mike (mikeonsoftware?)) months ago to get the debris but the rightest answer was to drill down into it on a still-alive ones.</div>
<div><br class="" />
<blockquote type="cite" class="">
<div class="">
<div style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 24px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class="">
<blockquote type="cite" class="">
<div class="">
<div class="">
<div name="messageSignatureSection" class=""><br class="" />
Best,<br class="" />
<br class="" />
Mike</div>
<div name="messageReplySection" class="">On Jun 12, 2021, 00:14 +0200, David Collier-Brown <<a href="mailto:davecb.42@gmail.com" class="">davecb.42@gmail.com</a>>, wrote:<br class="" />
<blockquote type="cite" class="" style="border-left-color: grey; border-left-width: thin; border-left-style: solid; margin: 5px; padding-left: 10px;">
<div class="">
<p class="">OK,<span class="Apple-converted-space"> </span><i class="">Oh Smarter Colleagues</i>, the challenge to you is to say if there is a "natural" place to capture state changes to get the data we want, and if so, is it common or similar enough between drivers to be worthy of attention?<br class="" /></p>
<p class="">--dave<br class="" /></p>
<div class="moz-cite-prefix">On 2021-06-09 9:15 a.m., Dave Taht wrote:<br class="" /></div>
<blockquote type="cite" cite="mid:950B8EAF-90B9-41A6-951D-91821F591D41@teklibre.net" class=""><br class="" />
<div class=""><br class="" />
<blockquote type="cite" class="">
<div class="">Begin forwarded message:</div>
<br class="Apple-interchange-newline" />
<div class="" style="margin: 0px;"><span class="" style="font-family: -webkit-system-font, "Helvetica Neue", Helvetica, sans-serif;"><b class="">From:</b></span><span class="Apple-converted-space"> </span><span class="" style="font-family: -webkit-system-font, "Helvetica Neue", Helvetica, sans-serif;">David Collier-Brown <<a href="mailto:davecb.42@gmail.com" class="" moz-do-not-send="true">davecb.42@gmail.com</a>><br class="" /></span></div>
<div class="" style="margin: 0px;"><span class="" style="font-family: -webkit-system-font, "Helvetica Neue", Helvetica, sans-serif;"><b class="">Subject:</b></span><span class="Apple-converted-space"> </span><span class="" style="font-family: -webkit-system-font, "Helvetica Neue", Helvetica, sans-serif;"><b class="">Microstate Accounting and the Nyquist problem</b><br class="" /></span></div>
<div class="" style="margin: 0px;"><span class="" style="font-family: -webkit-system-font, "Helvetica Neue", Helvetica, sans-serif;"><b class="">Date:</b></span><span class="Apple-converted-space"> </span><span class="" style="font-family: -webkit-system-font, "Helvetica Neue", Helvetica, sans-serif;">June 9, 2021 at 4:44:14 AM PDT<br class="" /></span></div>
<div class="" style="margin: 0px;"><span class="" style="font-family: -webkit-system-font, "Helvetica Neue", Helvetica, sans-serif;"><b class="">To:</b></span><span class="Apple-converted-space"> </span><span class="" style="font-family: -webkit-system-font, "Helvetica Neue", Helvetica, sans-serif;">Dave Taht <<a href="mailto:davet@teklibre.net" class="" moz-do-not-send="true">davet@teklibre.net</a>><br class="" /></span></div>
<div class="" style="margin: 0px;"><span class="" style="font-family: -webkit-system-font, "Helvetica Neue", Helvetica, sans-serif;"><b class="">Cc:</b></span><span class="Apple-converted-space"> </span><span class="" style="font-family: -webkit-system-font, "Helvetica Neue", Helvetica, sans-serif;">Dave Collier-Brown <<a href="mailto:dave.collier-brown@indexexchange.com" class="" moz-do-not-send="true">dave.collier-brown@indexexchange.com</a>><br class="" /></span></div>
<div class="" style="margin: 0px;"><span class="" style="font-family: -webkit-system-font, "Helvetica Neue", Helvetica, sans-serif;"><b class="">Reply-To:</b></span><span class="Apple-converted-space"> </span><span class="" style="font-family: -webkit-system-font, "Helvetica Neue", Helvetica, sans-serif;"><a href="mailto:davecb@spamcop.net" class="" moz-do-not-send="true">davecb@spamcop.net</a><br class="" /></span></div>
<br class="" />
<div class="">
<div class="">
<p class="">A million years ago (roughly around Solaris 9), Sun was suffering from the same problems in measuring their dispatcher as you are with "sloshing".</p>
<p class="">A CPU would be 100% busy in one microsecond, 10% busy in the next gazillion, and the average CPU utilization for our sample period would be<span class="Apple-converted-space"> </span><i class="">maybe</i><span class="Apple-converted-space"> </span>10.1, if the sampler happened to sample right when the spike was happening.</p>
<p class="">This was utterly useless for things like the fair-share scheduler, so it got fixed in Solaris 10, by having the dispatcher record the time a process (well, kernel thread) had spent in a state when the state changed.<br class="" /></p>
<p class="">Initially "microstate accounting" could be toggled on and off, but the branch-around cost more time than always doing the calculation (as discovered by my mad friend Fred) and the kernel folks left it on. It's on to this day.</p>
<p class="">In Simon Sundberg's talk, the opportunity to measure occurs every 1,000 packets, when a suitable timestamp is provided. While the eBPF program can look at every packet and do after-the-fact book-keeping in a map, that's only good if the phenomenon you're measuring is persistent enough that it's around for ~2,000 packets.</p>
<p class="">I'm going to suggest that the right place to record the information you want is right where the event happens. Preferably in c code, as performance is easy to mess up, but perhaps with an eBPF mechanism to export it.</p>
<p class="">In previous Solaris work, I reliably found that exporting kstats was a darn sight harder than collecting them, and in Eric's blog post[1] he notes that converting time is expensive and best done long after collecting, when someone wanted to read the data.</p>
<p class="">There was an effort to do kstats in Linux[2], but it had supposedly poor performance, and actual trouble when the clock frequency changed.<br class="" /></p>
<p class="">Is there, in your opinion, a "natural" place to capture state changes to get the data you want, and if so, is it common or similar enough between drivers to be worthy of attention?</p>
<p class="">--dave<br class="" /></p>
<p class=""><br class="" /></p>
<p class="">References:</p>
<ol class="">
<li class="">Solaris:<span class="Apple-converted-space"> </span><a class="moz-txt-link-freetext" href="https://can01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdtrace.org%2Fblogs%2Feschrock%2F2004%2F10%2F13%2Fmicrostate-accounting-in-solaris-10%2F&data=04%7C01%7C%7C7f7cd5aab2ca42e2e7e908d92d25e27f%7Cb07c069022b843668d8d7b845d088e18%7C1%7C0%7C637590463000477252%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=fdZDOtRCcBk%2BO1ksiTOSU%2FltR8IMwueHyj0kQG4UkHw%3D&reserved=0" originalsrc="http://dtrace.org/blogs/eschrock/2004/10/13/microstate-accounting-in-solaris-10/" shash="r++8CBJzd3EiHdQD4yln/JywHEgcQZcRkADLM58pY3y4GIQM79qWqmhLCC/gRJFmrZMcTsRTXYWsjJvwqLaUNTcyJvdbeC+sFPghSwQwf0ml5RWpT/hdeHE62U3EYo3yqhk0XWHHRmrDgD5wIcJPF8LNpbygu6zdFrcp5AUtudE=" moz-do-not-send="true">http://dtrace.org/blogs/eschrock/2004/10/13/microstate-accounting-in-solaris-10/</a><br class="" /></li>
<li class="">A failing Linux effort:<span class="Apple-converted-space"> </span><a class="moz-txt-link-freetext" href="https://can01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flwn.net%2FArticles%2F127296%2F&data=04%7C01%7C%7C7f7cd5aab2ca42e2e7e908d92d25e27f%7Cb07c069022b843668d8d7b845d088e18%7C1%7C0%7C637590463000487248%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=uN0gq8vi0GJHMPpjKVYRjX6G5nQOc%2BugxUwUEk3%2BWJ8%3D&reserved=0" originalsrc="https://lwn.net/Articles/127296/" shash="NeRrtMZSW/w5Z16EVp+L4mx76CnciKROysvnuvIYMwhpmHy1kPIu8UIvlSNPVJr3mrf6T8eg/A9RZFdY3ToSPDwOK9AXprKGFxF5bfPklETFT2/wyZDMQg+32h2Au2fNqlAk1p20ndsJ2B3+iEmm08ARfHCVl7c8Z3RpgKoan60=" moz-do-not-send="true">https://lwn.net/Articles/127296/</a>,<span class="Apple-converted-space"> </span><a class="moz-txt-link-freetext" href="https://can01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fsourceforge.net%2Fprojects%2Fmicrostate%2F&data=04%7C01%7C%7C7f7cd5aab2ca42e2e7e908d92d25e27f%7Cb07c069022b843668d8d7b845d088e18%7C1%7C0%7C637590463000497242%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=iMNi40Pl9hMmd1h7WrLFP5jmHQ60mJl7zehhO8miJv4%3D&reserved=0" originalsrc="https://sourceforge.net/projects/microstate/" shash="EaATi/ge264upYiz/waLkJTFhNT5ya2c8AUQqq5JoVbfuWm//GeW5inxQP8rULFqg7ezIt8agie84EjTPfOKSsmTlrVx7IVrdUIQdV3qSc0D2gNrGzTCYSEeYSd1AQhTNbTx3c8CCg2k4xiUArgx1w5vfMhPymyvv501lHYtKH4=" moz-do-not-send="true">https://sourceforge.net/projects/microstate/</a><br class="" /></li>
</ol>
<pre class="moz-signature" cols="72">--
David Collier-Brown, | Always do right. This will gratify
System Programmer and Author | some people and astonish the rest
<a class="moz-txt-link-abbreviated" href="mailto:davecb@spamcop.net" moz-do-not-send="true">davecb@spamcop.net</a> | -- Mark Twain
</pre></div>
</div>
</blockquote>
</div>
<br class="" /></blockquote>
</div>
_______________________________________________<br class="" />
Starlink mailing list<br class="" />
<a href="mailto:Starlink@lists.bufferbloat.net" class="">Starlink@lists.bufferbloat.net</a><br class="" />
<a href="https://lists.bufferbloat.net/listinfo/starlink" class="">https://lists.bufferbloat.net/listinfo/starlink</a><br class="" /></blockquote>
</div>
</div>
_______________________________________________<br class="" />
Starlink mailing list<br class="" />
<a href="mailto:Starlink@lists.bufferbloat.net" class="">Starlink@lists.bufferbloat.net</a><br class="" />
<a href="https://lists.bufferbloat.net/listinfo/starlink" class="">https://lists.bufferbloat.net/listinfo/starlink</a><br class="" /></div>
</blockquote>
</div>
<br class="" style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 24px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" />
<span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 24px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">_______________________________________________</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 24px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class="" />
<span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 24px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">Starlink mailing list</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 24px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class="" />
<a href="mailto:Starlink@lists.bufferbloat.net" style="font-family: Helvetica; font-size: 24px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px;" class="">Starlink@lists.bufferbloat.net</a><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 24px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class="" />
<a href="https://lists.bufferbloat.net/listinfo/starlink" style="font-family: Helvetica; font-size: 24px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px;" class="">https://lists.bufferbloat.net/listinfo/starlink</a></div>
</blockquote>
</div>
<br class="" /></blockquote>
</div>
</body>
</html>