From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from au-smtp-delivery-117.mimecast.com (au-smtp-delivery-117.mimecast.com [103.96.23.117]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by lists.bufferbloat.net (Postfix) with ESMTPS id 924D33B29E for ; Thu, 20 Apr 2023 20:03:46 -0400 (EDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=auckland.ac.nz; s=mimecast20200506; t=1682035423; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=A9yTStfSCatLe6D3hajyIrFMiNvasbsXokvdkmYKGtg=; b=M/sJzrpy8FWGwEsr/Xwm4Eh8KFPMJ3L8m7wbDatNsMIF3pkgzp2cC0iJxTXchv0LSJwOvF OQ62VF2UKMoGfZzkiBHxyGvBlhKmgZeGm8hJn++wnyAlSvyCuqEPPRAwE42hsf4lhqVtix aDhid4dyBqK3suGXgVQXDl1X2eXOVvU= Received: from AUS01-SY4-obe.outbound.protection.outlook.com (mail-sy4aus01lp2175.outbound.protection.outlook.com [104.47.71.175]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id au-mta-104-l6R1Q7xiNIOymrPcOPqRyg-1; Fri, 21 Apr 2023 10:03:42 +1000 X-MC-Unique: l6R1Q7xiNIOymrPcOPqRyg-1 Received: from SY4PR01MB6979.ausprd01.prod.outlook.com (2603:10c6:10:142::13) by MEYPR01MB6549.ausprd01.prod.outlook.com (2603:10c6:220:11d::6) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6319.22; Fri, 21 Apr 2023 00:03:41 +0000 Received: from SY4PR01MB6979.ausprd01.prod.outlook.com ([fe80::68d5:4e6b:745e:197e]) by SY4PR01MB6979.ausprd01.prod.outlook.com ([fe80::68d5:4e6b:745e:197e%6]) with mapi id 15.20.6319.022; Fri, 21 Apr 2023 00:03:41 +0000 Message-ID: Date: Fri, 21 Apr 2023 12:03:38 +1200 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Thunderbird/102.10.0 To: "starlink@lists.bufferbloat.net" From: Ulrich Speidel X-ClientProxiedBy: SYBPR01CA0092.ausprd01.prod.outlook.com (2603:10c6:10:3::32) To SY4PR01MB6979.ausprd01.prod.outlook.com (2603:10c6:10:142::13) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: SY4PR01MB6979:EE_|MEYPR01MB6549:EE_ X-MS-Office365-Filtering-Correlation-Id: 65b1b95c-1253-43b9-bfaa-08db41fbdd80 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0 X-Microsoft-Antispam-Message-Info: L8If8ukHhZU54iPHUuW48F6lVioCRYtRy5O2CCDzLcnhSsQVLAEwY+wnoLTwzGcaNOaokXtfH5aC6ecG+JLMf5BnJNTMNzK/hA93uL/qBZ7S2g/3smmtlafxnJL1brCHJjqsaewVpq8x/IseW4xrjgzqNptzXGHQIr9lhHmBM50vqaUQJ3H18GT0dGMMP/hhEnC6eeeGRfMgMp0k3eRLVZpNfxN6s878XFiUZhXLBTNOWegZt7HJNLqE9hnmZd60ujmmsmlVpna+Lo3gK+h8r5icwHNfnwC3AIAqnBSs5NkLtcSRw/1w9/6uTJubX3ItkvXCZUU1hsjekUxje7+nEtfCQtZLxviQ8KgzPcBZ/Ki2y14mzzfC6b9gLUEa9rOc8JModPE0oUWlTGxgW/34oZ5f08aTswV7vXWCO2r44v84MuX6NBGKJY8e4EchHOGAVbMZezf2IwopOFQzxtmdi8uEbrmHG3+1phtEq2kWpdqz1qkWtF75nFWQcNTvge8H9unTGW5wJ8LxydpDFrfMd+8IM1Mynvx8lWoTPm36zumLL8AsNiTZJYOHAZzfu/CvRRU8mn99XN2yncUxNJe7mQh4dG8oWxJqORMnlXfELlgoeTrVxYX6izz/ENNly1j5hEQqSk9TktAveuZhPYsQBw== X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:SY4PR01MB6979.ausprd01.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230028)(4636009)(376002)(136003)(366004)(346002)(396003)(39860400002)(451199021)(966005)(83380400001)(6512007)(6506007)(3480700007)(316002)(786003)(6916009)(66476007)(66556008)(66946007)(6666004)(6486002)(2616005)(31686004)(186003)(31696002)(36756003)(86362001)(8676002)(38100700002)(2906002)(5660300002)(8936002)(7116003)(478600001)(41300700001)(43740500002)(45980500001); DIR:OUT; SFP:1101 X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?YUREK0tYSmJPRWwwNlk2cG05ZDhpUHpDSnRLdEdiWTVkcHdYUG9sZEtyVmpJ?= =?utf-8?B?L0R4cWkrYlZsL01UUDIvMlJuM3dNenR0R0pScXZCb2k2akxhQVY5TlRYakRJ?= =?utf-8?B?clpUSGFCdlpEV2FETkMwVE1yaTZjcFVLbzlaUnh1enZGeEh3aTUrd3JqN2xR?= =?utf-8?B?M1RZcXVZUWZLZHRVRVNLV1JPSXZZZ2EwYjUvQXVBc3JmNi9SQ1R2NTdBRnhz?= =?utf-8?B?aHB1QmdqQk1uTzZpdHAzTkI4enAyNkZCcTJLdjJQS3JvdEtwamZBQnJoTnlV?= =?utf-8?B?ck1MNjZUR0FqYXdBNDEzSkdkTllUWG1Xeng5WXdyOHA4MjNuM0p2SmduU2x5?= =?utf-8?B?eU5BTzZsaHdsbHBFTVNzMkg5S2dkSThrQVA1Y3ZzOHJNYWZoVGNPSzExbEFw?= =?utf-8?B?N2pOMnFHUzhBQ3NqdkkyZHFyWmxFdUN3T1NlNHh3RjJvWjVlaHoxTFZPckxn?= =?utf-8?B?RkZpNnpqem12TjNCL3RsbWRHN0hJdFQ0RjVUNWQ2T2F4eStTSXFpWjYwbmlD?= =?utf-8?B?WVRvZzFyZ1o4TlMwamN4U1c3bVJ6NjBIU3Vmb0FIRjNvR2lnS0tKcjA3eEFX?= =?utf-8?B?dlVWSlE1N2JyRjhQU0lQNUNxT1BoZDYvK0I5RmszV0dlcURUVURHdmVZdDM5?= =?utf-8?B?MUxBZUpzQTUzZDZzTld0VGp5UnlmcUNXdERpcytYcTJoa3BOeGc4TThoby9L?= =?utf-8?B?Y0dZQnBVa01IQkwwSFI4VEdPQXZBNURUSWhNTDl5Wit6MVorMFpKZHppcExC?= =?utf-8?B?ckN6eExxV3E0SzI3MUpzSXB4a3dzTzN2MGx4dkNDRHM4ZGRUTHc1UkdHT3lF?= =?utf-8?B?SElnY2NNTEV2K2hJU0tIRTY2d1VmME5ocXVMMlhNNytrWUxoN3FiNmNmZmxo?= =?utf-8?B?QlVyQm1zVGJGdkNLNEFLSU5ydGJyQ1FITXV6U2ZZRmdpK3NxUHJOaEJkUVdz?= =?utf-8?B?K09ER1pnYlo2L0dvaEVYNUE0aVdScW5zNmxkNXFBN2s4Sk9DUDJYd3F4RCtZ?= =?utf-8?B?RmpxZ2QxbUdxcmdsTzIwSW81NEd2ZG42NDNZSldYaHRET3JKeGN3cnJMUFRH?= =?utf-8?B?eDk1YzRBbjJhWG1lSWVpV1ZDcEp6SWljNUVscE4zb20wMDE5QTRRb3Z6VEF2?= =?utf-8?B?SDNiTnI4Y2JnYWVJbElIK09XeFF4Y0MycnNZcDhOYlRIL09wOTV1MWVMZkJ4?= =?utf-8?B?U0pOUXRBS3RObEJ6UXBEODNVQ0hUYlR0UFpTY3F6K3E3TzJFTEQ0NUhLTzBl?= =?utf-8?B?YmVyWUdqMWh5R1MxYU0vT3ptUHI2Z1lpaVhUbUpTYXZYbTJkOUNnNWNvcDFo?= =?utf-8?B?N1pjazBYeTh6b0M5TkthcTh6OTNwSmdvZmJDS0IzSC9XU1dlS0YzTklnUjRH?= =?utf-8?B?dytmd1p1b0YzUGdZb0tqUThFc3psTGJ4UGVmNlcxWnBJbUZLZDBXckdEYlhq?= =?utf-8?B?Qlo1R09pRVV0MmFwVU1rNnFqWTU3TXlueUFxYUYwcDUxdk8xRW1CMFd1OEZ1?= =?utf-8?B?WXNMeVlFbVova2hLdzBKNDJXTURNaFFWTkJHYlZvUHp3eThwcTZEQWRMd2wr?= =?utf-8?B?K3hBTmlTU1RRVlNPUTF4bXc0YkZrL29hTlF1cVVTcUhzQWNuQWJHbjloby9G?= =?utf-8?B?VWxJNjU3Rkg3RlpEWHFVUThGOFdHT2o4b0FWS2JhOC9FQTBxOWdGYTlqZGxi?= =?utf-8?B?TzJYSGt5Z0lidTZ4Tko0bXMvVTZJQzkyaW1GWHlTUVlNQVF5U1BWbThZOSsw?= =?utf-8?B?TzVLWXFQQm1vNGVCdHdZVy80K28rRTZIOXhlN1hiSmV0eGRpUEQ5K2ZNcVd6?= =?utf-8?B?djlUSERqanh2M3JwTFNWK0NYdmhqc1N4MjNuZ0FCSWdmV1pRWFlJb29QVlpr?= =?utf-8?B?Y3lrSGhna05QSUY2aDNyTUJaanpuS0J5VFJNQ1hBblBqN3gxMlViaURKSThN?= =?utf-8?B?dHl2TWJjM2l1QVNiZnlwcVVmYmpGZFJCeEZGT2dkL1BoNmRYT002OFk0Ujgx?= =?utf-8?B?ZjBEeldhWUZ0RGZCQ0d0ODRKcjd1TkxxVk9pZDNuOCtxamFXUTZudjJGK0Ny?= =?utf-8?B?d3lSVVFSRkdvOW80NXVGamR4a01LVHlVYUFXQUVhNTg2SlF3UzZhNmtlVldp?= =?utf-8?B?NW1tWmVsN3ZEcURlbzVuMEdnT2gwWjVFZlFwcTdjRUZFVmJUZzVxSFRTVjNy?= =?utf-8?B?V2JIejlKQno2dGhabEE5alhjNmlTeXpES1dEdmRpSzRCVzE2cm9nMHNQVVpY?= =?utf-8?B?OEFXRmhDY1dIdDJyRmx1QTlZRVdnPT0=?= X-OriginatorOrg: auckland.ac.nz X-MS-Exchange-CrossTenant-Network-Message-Id: 65b1b95c-1253-43b9-bfaa-08db41fbdd80 X-MS-Exchange-CrossTenant-AuthSource: SY4PR01MB6979.ausprd01.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 21 Apr 2023 00:03:41.2849 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: d1b36e95-0d50-42e9-958f-b63fa906beaa X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: ky35grhww+v+pVRhtE5NJpkqkYR5mOojTP+GP3LHxwlvnPbuqr+ziq+v9zB+R20PwZ1IH8DH9FQ+Xq+SoC7WKZjdcDpLWJ9g4uHaev/g1+8= X-MS-Exchange-Transport-CrossTenantHeadersStamped: MEYPR01MB6549 X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: auckland.ac.nz Content-Language: en-US Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: quoted-printable Subject: [Starlink] Starlink in Kiribati X-BeenThere: starlink@lists.bufferbloat.net X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Starlink has bufferbloat. Bad." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 21 Apr 2023 00:03:47 -0000 Some interesting insight yesterday: One of my PhD student Wayne Reiher's=20 contacts on Tarawa atoll in Kiribati (pronounced "Kiri-bus"), Karotu=20 Tannang, operates a Starlink kit there, around 4,200 km north of=20 Auckland, New Zealand. Wayne asked him to run a few traceroutes and five=20 minute pings with large packets to get us an initial idea as to how well=20 it worked and how the signal got back to the rest of the world. Tarawa is well out of bent-pipe range of any known Starlink gateways, so=20 would have to rely on laser ISLs. All traces (to NZ, Chile, the US, Germany and Japan) exited the SpaceX=20 address space in New Zealand to a variety of upstream providers. IP=20 addresses on the Starlink side of the trace beyond Dishy are, in order=20 of appearance in the traces: 100.64.0.1, 172.16.249.6, followed by=20 149.19.109.30 if exiting to Hurricane Electric as upstream or=20 149.19.109.34 if exiting to Kinect. All those addresses have RTT=20 indicating that they are in NZ. Lowest RTT seen to the first NZ hop was 65 ms, with values between 100=20 and 200 ms being the most common. RTTs to the US were mostly in the high 200 ms. Packet loss was atrocious: about 5% to NZ, 8% to Japan and Chile, 9% to=20 the US. Hard to say whether this was just due to variation on the leg to=20 NZ or whether anything got dropped further down the road. First thoughts: 1) There is no 53 / 53.2 deg orbital plane for Starlink that is=20 simultaneously visible from both Tarawa and NZ. Unless the traceroutes=20 all happened to be piggybacking on one of the few polar orbit passing=20 overhead, this implies at least some degree of cross-plane forwarding.=20 We'll ask Karotu to run a few more tests for us at different times. 2) The fact that we don't see more than the "usual" number of Starlink=20 IP addresses in the tracreroutes indicates that whatever IP routing may=20 be happening on satellites that handle the traffic via ISLs happens at a=20 tunnel layer further down the stack. 3) The fact that the traffic emerges in New Zealand regardless of global=20 destination also indicates that the Starlink network uses a tunnel based=20 on Dishy location and a nearby gateway but does not attempt to route to=20 final destination at this point in time. The 65 ms RTT also tells us a few things. For one, at 4,200 km great=20 circle distance on the ground, the dishy-to-gateway physical path would=20 be at least 5,000 km even if all lined up with a polar orbital plane=20 involved. That makes 10,000 km of RTT path, which translates into about=20 33 ms of propagation RTT. If cross-plane routing were involved here,=20 we'd get a zig-zag path - so roughly 1 1/2 times longer. Makes about 50=20 ms. In-plane only routing would involve a gateway in Australia (similar=20 length physical path dishy to gateway) along with a 2,000 km=20 trans-Tasman cable leg. The 2000 km cable leg would be equivalent to=20 about 20 ms of additional RTT over the 10,000 km space RTT path, so that=20 could in principle also work. Quite why everything would emerge in=20 Auckland though in this case would be a mystery to me. --=20 **************************************************************** Dr. Ulrich Speidel School of Computer Science Room 303S.594 (City Campus) The University of Auckland u.speidel@auckland.ac.nz http://www.cs.auckland.ac.nz/~ulrich/ ****************************************************************