From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail.lang.hm (unknown [66.167.227.145]) (using TLSv1.2 with cipher ADH-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by lists.bufferbloat.net (Postfix) with ESMTPS id 120EE3B29E for ; Fri, 16 Jul 2021 13:09:02 -0400 (EDT) Received: from dlang-laptop.local (unknown [10.2.0.162]) by mail.lang.hm (Postfix) with ESMTP id DFBBCFF341; Fri, 16 Jul 2021 10:09:01 -0700 (PDT) Date: Fri, 16 Jul 2021 10:08:56 -0700 (PDT) From: David Lang X-X-Sender: dlang@dlang-laptop To: "Wheelock, Ian" cc: David Lang , "David P. Reed" , "starlink@lists.bufferbloat.net" In-Reply-To: Message-ID: References: <1625856001.74681750@apps.rackspace.com> User-Agent: Alpine 2.21.1 (DEB 209 2017-03-23) MIME-Version: 1.0 Content-Type: multipart/mixed; BOUNDARY=_002_BD260482EDC1486698262B09B06D9415commscopecom_ Content-ID: Subject: Re: [Starlink] Starlink and bufferbloat status? X-BeenThere: starlink@lists.bufferbloat.net X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Starlink has bufferbloat. Bad." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 16 Jul 2021 17:09:03 -0000 This message is in MIME format. The first part should be readable text, while the remaining parts are likely unreadable without MIME-aware tools. --_002_BD260482EDC1486698262B09B06D9415commscopecom_ Content-Type: text/plain; CHARSET=utf-8; format=flowed Content-Transfer-Encoding: 8BIT Content-ID: <5DF642F3D57C4E4F80EE452A2D50A151@namprd14.prod.outlook.com> I think it depends on if you are looking at datacenter-to-datacenter latency of home to remote datacenter latency :-) my rule of thumb for cross US ping time has been 80-100ms latency (but it's been a few years since I tested it). I note that an article I saw today said that Elon is saying that latency will improve significantly in the near future, that up/down latency is ~20ms and the additional delays pushing it to the 80ms range are 'stupid packet routing' problems that they are working on. If they are still in that level of optimization, it doesn't surprise me that they haven't really focused on the bufferbloat issue, they have more obvious stuff to fix first. David Lang On Fri, 16 Jul 2021, Wheelock, Ian wrote: > Date: Fri, 16 Jul 2021 10:21:52 +0000 > From: "Wheelock, Ian" > To: David Lang , David P. Reed > Cc: "starlink@lists.bufferbloat.net" > Subject: Re: [Starlink] Starlink and bufferbloat status? > > Hi David > In terms of the Latency that David (Reed) mentioned for California to Massachusetts of about 17ms over the public internet, it seems a bit faster than what I would expect. My own traceroute via my VDSL link shows 14ms just to get out of the operator network. > > https://www.wondernetwork.com is a handy tool for checking geographic ping perf between cities, and it shows a min of about 66ms for pings between Boston and San Diego https://wondernetwork.com/pings/boston/San%20Diego (so about 33ms for 1-way transfer). > > Distance wise this is about 4,100 KM (2,500 M), and @2/3 speed of light (through a pure fibre link of that distance) the propagation time is just over 20ms. If the network equipment between the Boston and San Diego is factored in, with some buffering along the way, 33ms does seem quite reasonable over the 20ms for speed of light in fibre for that 1-way transfer > > -Ian Wheelock > > From: Starlink on behalf of David Lang > Date: Friday 9 July 2021 at 23:59 > To: "David P. Reed" > Cc: "starlink@lists.bufferbloat.net" > Subject: Re: [Starlink] Starlink and bufferbloat status? > > IIRC, the definition of 'low latency' for the FCC was something like 100ms, and Musk was predicting <40ms. roughly competitive with landlines, and worlds better than geostationary satellite (and many > External (mailto:david@lang.hm) >   https://shared.outlook.inky.com/report?id=Y29tbXNjb3BlL2lhbi53aGVlbG9ja0Bjb21tc2NvcGUuY29tL2I1MzFjZDA4OTZmMWI0Yzc5NzdiOTIzNmY3MTAzM2MxLzE2MjU4NzE1NDkuNjU=#key=19e8545676e28e577c813de83a4cf1dc  https://www.inky.com/banner-faq/  https://www.inky.com > > IIRC, the definition of 'low latency' for the FCC was something like 100ms, and > Musk was predicting <40ms. >   > roughly competitive with landlines, and worlds better than geostationary > satellite (and many wireless ISPs) >   > but when doing any serious testing of latency, you need to be wired to the > router, wifi introduces so much variability that it swamps the signal. >   > David Lang >   > On Fri, 9 Jul 2021, David P. Reed wrote: >   >> Date: Fri, 9 Jul 2021 14:40:01 -0400 (EDT) >> From: David P. Reed >> To: starlink@lists.bufferbloat.net >> Subject: [Starlink] Starlink and bufferbloat status? >> >> >> Early measurements of performance of Starlink have shown significant bufferbloat, as Dave Taht has shown. >> >> But...  Starlink is a moving target. The bufferbloat isn't a hardware issue, it should be completely manageable, starting by simple firmware changes inside the Starlink system itself. For example, implementing fq_codel so that bottleneck links just drop packets according to the Best Practices RFC, >> >> So I'm hoping this has improved since Dave's measurements. How much has it improved? What's the current maximum packet latency under full load,  Ive heard anecdotally that a friend of a friend gets 84 msec. *ping times under full load*, but he wasn't using flent or some other measurement tool of good quality that gives a true number. >> >> 84 msec is not great - it's marginal for Zoom quality experience (you want latencies significantly less than 100 msec. as a rule of thumb for teleconferencing quality). But it is better than Dave's measurements showed. >> >> Now Musk bragged that his network was "low latency" unlike other high speed services, which means low end-to-end latency.  That got him permission from the FCC to operate Starlink at all. His number was, I think, < 5 msec. 84 is a lot more than 5. (I didn't believe 5, because he probably meant just the time from the ground station to the terminal through the satellite. But I regularly get 17 msec. between California and Massachusetts over the public Internet) >> >> So 84 might be the current status. That would mean that someone at Srarlink might be paying some attention, but it is a long way from what Musk implied. >> >> >> PS: I forget the number of the RFC, but the number of packets queued on an egress link should be chosen by taking the hardware bottleneck throughput of any path, combined with an end-to-end Internet underlying delay of about 10 msec. to account for hops between source and destination. Lets say Starlink allocates 50 Mb/sec to each customer, packets are limited to 10,000 bits (1500 * 8), so the outbound queues should be limited to about 0.01 * 50,000,000 / 10,000, which comes out to about 250 packets from each terminal of buffering, total, in the path from terminal to public Internet, assuming the connection to the public Internet is not a problem. > _______________________________________________ > Starlink mailing list > Starlink@lists.bufferbloat.net > https://secure-web.cisco.com/1sNc_-1HhGCW7xdirt_lAoAy5Nn5T6UA85Scjn5BR7QHXtumhrf6RKn78SuRJG7DUKI3duggU9g6hJKW-Ze07HTczYqB9mBpIeALqk5drQ7nMvM8K7JbWfUbPR7JSNrI75UjiNXQk0wslBfoOTvkMlRj5eMOZhps7DMGBRQTVAeTd5vwXoQtDgS6zLCcJkrcO2S9MRSCC4f1I17SzgQJIwqo3LEwuN6lD-pkX0MFLqGr2zzsHw5eapd-VBlHu5reC4-OEn2zHkb7HNzS1pcueF6tsUE1vFRsWs2SIOwU5MvbKe3J3Q6NRQ40cHI1AGd-i/https://lists.bufferbloat.net/listinfo/starlink > > --_002_BD260482EDC1486698262B09B06D9415commscopecom_ Content-Type: image/png; NAME=image001.png Content-Transfer-Encoding: BASE64 Content-ID: Content-Description: image001.png Content-Disposition: ATTACHMENT; FILENAME=image001.png; SIZE=4138; CREATION-DATE="Fri, 16 Jul 2021 10:21:52 GMT"; MODIFICATION-DATE="Fri, 16 Jul 2021 10:21:52 GMT" iVBORw0KGgoAAAANSUhEUgAAAKgAAAAxCAYAAABOIuI/AAAP70lEQVR4nO2cB6xURRfHh0cH6b33 3kWkRHpRCCUUEVQQQdQQYkBQUKyAEJViAQSiIIqNoIAUlQ5SlC69F+m9I32+/E7eubm7e5fdhx/k fvnuP5nsvp1y5575z5kz5xxIZq21JkAAnyIhWJgAfkZA0AC+RkDQAL5GQNAAvkZA0AC+RkDQAL5G QNAAvkZA0AC+RkDQAL5GQNAAvkZA0AC+RkDQ/zFcvXrV3Lp16//mfVNEq9i0aZNZsWKF2bZtmzlz 5oxJnz69KVWqlKlVq5Z5+OGHow545coVs3TpUrN27Vqzb98+c/v2bVOgQAFTpUoVU7duXZMlS5Y7 9v3rr7/M9evXTebMmU2lSpVivsDFixelD4uWPXt2U65cOafuxo0bUnf58mWTOnVqmXdCwp335LVr 18y6detkDg888ICpWrVqRJuzZ8+amTNnyjteuHBB5NKyZUtTtmzZmPM9evSoyGfjxo3myJEjJlmy ZKZw4cLmoYceMvXq1TPp0qXz7Dd//nxpX7BgQZMvXz6Z3/Hjx83NmzdNkSJFTIkSJTz7If8//vjD nDt3ziRPntykSpVK1pIxKOHYvXu32bFjh7Rlbl7jpUyZ0lSvXt1kyJDBbNiwwWzdulXaM/9cuXLF lEGSYMOwevVq27ZtW5sqVSqynCJKsmTJbMuWLe3GjRvDu9qxY8fasmXLevajFCpUyA4dOtReuXIl oi9Ys2aNTZkypbTNnDmz3b9/v2c7Nz766CNn/Lp164bUHTx40ObJk0fqGHfZsmUxx5s+fbpNnjy5 9ClSpIi9evVqSP28efM83zFDhgz2iy++iDru0aNH7csvv2xz5MgRVT4VK1a0P/zwg71165bT788/ /7SPP/64HTRokD1w4IDdsWOH7dSpk82VK5fTD1m1aNFC5BeOf/75x3O+WbJksbVr17bjx4+3N2/e dHq9+eabUefnLtu2bbO7d++2vXr1ssOHD7fvvPOOfe+996Ku7d0ihKAsdurUqWUCLFLz5s3t66+/ bocMGWL79u0rL6STzJ07twgdnDx50rZq1SqkrkOHDrZfv362f//+IlAWW+sZZ+/evRFTXrRoUYgQ Ro8efcfXun37tq1Ro4bTvnz58iH1CDFdunROfZ8+fWKKqWPHjk57yHTq1Cmnbu3atUJE6rJnz26f f/55++qrr9o6deo4m2DlypURY65YscKWLl3aGbdatWqysMh1wIABtnXr1s64lJkzZ0q/iRMnChEh Ldi+fbvNmzdvVNKkT5/ejhs3LuTZELRChQpSX6xYMZFXiRIlnE1IYQPQDrz99tvOWFWrVrUPPvhg SKlSpYqtWbOmPXLkiJ0yZYr97LPPbLt27ezAgQPtiBEj7ObNm++Sit5wCDps2DBnwmjQDRs2RHRg Z0MiXrJz5872xo0b9sKFC7ZevXrSDzKgIU+cOBHRl3Zo2Jw5c0rbMmXK2MOHD4e0+fnnn6WORWCx GzRocMfJr1u3zqZIkcIWLFhQNlbhwoXt9evXnXo0SkJCgmwYToTixYtHaEQ32HCZMmWS9iwQ3/ft 2+e0aN++vcwPskF+t1yeeuopR3ZuoAGzZcsmdWgyyOeeo2LXrl0iU8h09uxZO3XqVOnz1VdfOW2a NGkSl3ZzkxTiVapUSX6fMGGCzPXy5cui/dgcStRRo0ZJezQhf9evX1/mSbl27VpI0fnPnz/f9u7d 23777bf2448/tq+88orn2v8bGH0QC8nEeEgs8IKXLl2SVi+88IKjUSBvLGzatMkWLVpU+jRt2jTk OGMxdJEhMOTbuXNn1BHfeOMNad+zZ08hARqPxVUsXrxY6lnY6tWry/eFCxdGHY8FpE337t2FhDxf NQIbTOf95ZdfRvSFsLVq1RKS6TudPn3a0ZzUhW9ILzB/NgUbBPkoDh06ZLNmzRoXQdOkSWNXrVoV QVA32RWstxISoAn5u2HDhjHnimmAWTNy5Eg7ePBgu3Tp0ph9kgouEqK6mRRHTVKwZMkSsUnpy46P FxyDevR+9913Tq9PPvlEfsOcgCR859jwApqQowrNOHv2bJsxY0Yp2J0KtBVjoN3eeust+f7SSy9F nWXjxo2lzbRp05xjUY9siIOm1vpowOygAMwj2ufLly9kXrGgmvq3335zWu7Zs0c0ejwEdROM9VWC YjKEY/ny5c79AGBH8nes08sNtKYqrP82ErjhcWvlZjd06NAkXbDGjBmDBjYtWrQwbdu2jbtfjRo1 TJcuXeT7p59+avRfneAtANz0GzVqJN+nTZvmOcbKlSvNrl27xKvAbZ9bPDfwS5cuOW24uQJu8E2a NJHvM2bMEG9BOBhryZIl4nFgTHXl6HiZMmUyJUuWlO8jRoxw5hoObr6U06dPmwkTJkht//79Tf78 +eOSDTfoqVOnmhw5coR4S+jPbT9eLFiwwKxatcqkSBHVUSPg9u2FWN4ON5gr/LkXSMBdAho3bizu knhx4sQJs2jRImndtWvXJE/tmWeekc/Vq1eLK8skum9MonBwSeHOwNW1ZcuWiP4sImjVqpXJkyeP fMf14iaojodrBLdI3rx5zYEDB8TNEw7kQH82W86cOZ0F0vEgHUTj999//93UqVPHTJw4MSpRly1b Zo4dO2ayZctmnnjiibjlMmfOHJkvriNcbQrcQ4MGDYpJODd++eWXmG10DXmeSZSVSfS3Mn/cYu6C q4u1v1//lC0BYQN8WEkB/jImGs1XGAv4K9EI+CqVgKrxICb+NHyDaLJZs2aFjHb+/HnRrOx+CIWw 0qZNK59eGpTFZWHZhGD69Okh47Eo33//vXxv3bq1fKpGcI/XsGFDM3nyZNEYzJmNWa1aNTNgwABz 8ODBkDHxDwK0IO3jBf5R9/Pd4F1nz54tmzce4Mvm3VRLpkmTxunFKcK7DBkyRP5u06aNfOrJgfat XLmyZ3nsscdk3e4HEvbs2SOPifcIUpw8eVK+5c6dWxy2SQWE4jgF7FTj0njqrG7evLl8Qkb3jl28 eLHsZEyFYsWKibNa5+AmlGo3NhFAsADC42BXrF+/Xpzuery7+xAIcKNjx46i9Xv16iXE27t3rywy m0mPdHD48GH5RGvfjVwxEbyAqYLWwzTD1EBGbEAvnDp1SjShngbjx4+XTUUf5tupUyd5Pzbuc889 FzKCBgJQQu7C/KLN7V7grkOdGmX4N6pejxMVoGo81R5NmzaV50Ae9zH/008/yafuencfN6GU8Eq2 +vXry7EJeZYvX+60QysxF6JBujn0001kRaFChczIkSPNmjVrzODBg2Vzs3jdunUzkyZNCpFLUuWj csUU2b9/f9Q2mCy9e/cW04SjHEURDpWvAmJjlvC+mFVssD59+pgff/xRFIYbjI/MwwtamagWp9z9 QAKhMxB+RMWCHlvYJUqspABNxyIAtSEJSQLVhhUrVhTzAQ05b948+Q3SzZ07V7QGhDKJJoGS0MsG 1fEwGzimjcs+40jTI79du3ZOXyU85kQ0IDuOd+xkvdT17dtXSK023aFDh5IkFw0V8ly9H8RCgwYN zMCBAyNaYUtzrCtR27dvL1p39OjRQlJOjmHDhnmegBkzZpTQbXgpX768hFW9wqD3Agm1a9eWYbn1 JQVFixYVYWLLsEBJBcJh8SBXhQoVRIhKUIRjEm+YeswjUMCzMAmwmYsXLy6/oYFVyG6NpxtHxzOJ dhz49ddfRbuhSbAXS5cuLSaDQse7E0EVmAaff/65XIg4VtHOOhbmgJow8YCcBcXw4cNlvHhQs2bN iFZ4N5CN2pV4WtC6PXr0MM2aNfOMxSv8kpCSoARYuHCh2bx5c9wdIaca62PHjk3yUTZu3Dj5xBZi R0Imt0tHofPDaId8HC8g/GasGlQJxXyU8O7xsOEgLJc8Cjd62mIuuC8ROp4SniMcez0aYTn2lVyQ Xi9HaPFvvvkmbrlg1qh5wQnTvXv3uC4knGRuoOF0Myq83Gt+h2hQ1DaT79evX5Kmy04EeAJGjRoV dz8uPVOmTJHvPXv2lE+IoIRScphELcDCY1uiRXHfcPzqhUcRTiguB7ogbg2KOcExDykxG5TwbnvW eIzHpYh5cCRGgz4PctC/c+fO8vf7779v9DIaC5xMHTp0cFphfqD57tSfCw3a1g00JDfu+3XbvmfA 8U8kRiMQhA01EhINJHpoZKRbt27Sj1j4pEmTYsYR5syZI5k09Hn00UedTJotW7ZIaJEwXXgiiUaB yAGgTZs2bSLG7dGjh7Tp0qWL/E2SR4ECBeQ3oiVuEFHR5BLmQiSNiIsbH3zwgbTRDCmNUROVCW8L 1q9f70THyHgCx48fl/wAfuMZ7ri+FwghE1o9duyYk4WlhaSR1157TfILLl68KL2J3hDNa9SoUUhb Ek80l8Id6vSKJIVD35Mx/QAnWeTdd991XpDYNalp4UQ9f/68/frrr2XhCYXx8ufOnbOPPPKI05fY vFdGC6Qjs0nT6YhRu8N/xI75nWQSMmXc0KQPfYZXWJWsIuqUvH///bezEYj/u0FcmxQ1He/DDz+M GG/MmDEOIQE5AWnTppXfXnzxRZGFgsQLjfVXrlxZiKYg9q+ZSsTyJ0+eLHF9N9ikxLHJ8mLOzH3B ggXO89yF5A5kR4JOuXLlPMOcPENxtwQlQ+vMmTOSTxBe+N2doncvEZJuR/qXOw0L4kE4Mlaefvpp W7JkSaeOtCtNRSPdjji+1hEfJ/mga9euomHRlMTJtZ668FxPFkRjwgjADbJnWHjq0SwIKZpgVeNt 3brVeR6ZQuEgp1U1P2ls4dDEFTSgakwytXTMUqVK2WeffTYkN5MED6+Emblz5zpxfJOYyUVSCXIl ZY/0NXeiB8k7YNasWXdMrwsvbDo3OW0iQTkpqL9TvqpCTyvNEkMZuUv+/PklBwL53neC2sQMoGbN moUQ1V1YMF7CiyTsUHIIowmQnU/yh+YeukEChhLfK+mVbBlIHi3Zg3Qv+qPJbGLuJoksaGQ0Zjg4 CUi+iJYgM2PGDNHabBh3hhRHv2pmd2HeSiwvkGyMGULWVzRyQVpMHTc4eUiccW/w8IKmffLJJyP6 2kSC6prEY4KRzYTc3CdWeOEU9ErHvBeI+v+D4nrBEU0SBYY2LgkuUzhw3THicOCz5MZNf26hDE9f fJr0jfZPGohO7Ny5UxJFyAkI97NxAcFXy1juS5SCCAe3ci5EhFG5cOFY5mZepkyZCMcy78Q/SeGm 7fXPULgcbd++XRJN8P+5+3Nh4XLFfJkLlyeiMfEkTCATokDc9PFcZM2aVVxceDO4IEUDSSS4AulL oAG54pxHpvhBcdV5AfcdffEmIFdcYXcC3gDkHC2JhOdSx5zDnfv3AsF/YBvA1wj+VWcAXyMgaABf IyBoAF8jIGgAXyMgaABfIyBoAF8jIGgAXyMgaABfIyBoAF8jIGgAXyMgaABfIyBoAF8jIGgAXyMg aABfIyBoAP/CGPMfwvROPtNEexQAAAAASUVORK5CYIIAAA== --_002_BD260482EDC1486698262B09B06D9415commscopecom_--