From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from ma1-aaemail-dr-lapp01.apple.com (ma1-aaemail-dr-lapp01.apple.com [17.171.2.60]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by lists.bufferbloat.net (Postfix) with ESMTPS id 66BB53B29E for ; Tue, 13 Jul 2021 16:26:57 -0400 (EDT) Received: from pps.filterd (ma1-aaemail-dr-lapp01.apple.com [127.0.0.1]) by ma1-aaemail-dr-lapp01.apple.com (8.16.0.42/8.16.0.42) with SMTP id 16DKCUO6011584; Tue, 13 Jul 2021 13:26:55 -0700 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=apple.com; h=mime-version : content-transfer-encoding : content-type : date : from : to : cc : subject : message-id : references : in-reply-to; s=20180706; bh=ZOHLc3zK0X0/NGNi2nvN5QEg3/Jeqc1SwU+1ytzYPyE=; b=JxsJgHI4svmQQwL0naVPHndGd9YkM8otBj6z8Zie93uDq2zAlB6LaElJJzTSLY7/Qmnd 8UhOcHMCr38pgp/VEDvNceUyAJwFBEFYRv0MklSdWFoL3AQhzQXg5kUGKsaer1L+4qvO xHKhfmkCYpgTR6iGxnnwQ5mNXSmYli5TUpyE2w2BzLG23YvCB1ovt+XaYzDiGvhw6s6U uFFncMW4eAdpkw1R21wRzPnrG5RLWKW0tsTTq0RT68u4fHLh5v6h54Rh3jksgY7Ex6NB bO+Ok5JQT2vW3wl49TkCip6ZEjxEOOlXC60sgzG8/0LznpeTWLteLpuVROjUsjVESQv3 LA== Received: from rn-mailsvcp-mta-lapp03.rno.apple.com (rn-mailsvcp-mta-lapp03.rno.apple.com [10.225.203.151]) by ma1-aaemail-dr-lapp01.apple.com with ESMTP id 39qa73aetj-2 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NO); Tue, 13 Jul 2021 13:26:55 -0700 Received: from rn-mailsvcp-mmp-lapp01.rno.apple.com (rn-mailsvcp-mmp-lapp01.rno.apple.com [17.179.253.14]) by rn-mailsvcp-mta-lapp03.rno.apple.com (Oracle Communications Messaging Server 8.1.0.9.20210415 64bit (built Apr 15 2021)) with ESMTPS id <0QW700HGHA4VZXD0@rn-mailsvcp-mta-lapp03.rno.apple.com>; Tue, 13 Jul 2021 13:26:55 -0700 (PDT) Received: from process_milters-daemon.rn-mailsvcp-mmp-lapp01.rno.apple.com by rn-mailsvcp-mmp-lapp01.rno.apple.com (Oracle Communications Messaging Server 8.1.0.9.20210415 64bit (built Apr 15 2021)) id <0QW700X00A44B800@rn-mailsvcp-mmp-lapp01.rno.apple.com>; Tue, 13 Jul 2021 13:26:55 -0700 (PDT) X-Va-A: X-Va-T-CD: d256e6bf93d4a1310ff100a6b6d80f34 X-Va-E-CD: 18beb78395c319db8fed2aeaa2fc2266 X-Va-R-CD: 9f3f2ed48b1c789a3d7cdd486f86b176 X-Va-CD: 0 X-Va-ID: 7c443987-fd60-452a-8125-5799eb85b9fa X-V-A: X-V-T-CD: d256e6bf93d4a1310ff100a6b6d80f34 X-V-E-CD: 18beb78395c319db8fed2aeaa2fc2266 X-V-R-CD: 9f3f2ed48b1c789a3d7cdd486f86b176 X-V-CD: 0 X-V-ID: 11b1b672-42c0-4257-98bd-63250fe0317c X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.391, 18.0.790 definitions=2021-07-13_12:2021-07-13, 2021-07-13 signatures=0 MIME-version: 1.0 Content-transfer-encoding: 8BIT Content-disposition: inline Content-type: text/plain; charset=utf-8 Received: from localhost ([17.192.155.247]) by rn-mailsvcp-mmp-lapp01.rno.apple.com (Oracle Communications Messaging Server 8.1.0.9.20210415 64bit (built Apr 15 2021)) with ESMTPSA id <0QW7011NXA4VFK10@rn-mailsvcp-mmp-lapp01.rno.apple.com>; Tue, 13 Jul 2021 13:26:55 -0700 (PDT) Date: Tue, 13 Jul 2021 13:26:55 -0700 From: Christoph Paasch To: Jonathan Foulkes Cc: Rich Brown , rpm@lists.bufferbloat.net Message-id: References: <60B61FF6-E02E-40D1-9909-B4A047C2B6DA@gmail.com> In-reply-to: X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.391, 18.0.790 definitions=2021-07-13_12:2021-07-13, 2021-07-13 signatures=0 Subject: Re: [Rpm] RPM test / checkNetworkQuality.sh script X-BeenThere: rpm@lists.bufferbloat.net X-Mailman-Version: 2.1.20 Precedence: list List-Id: revolutions per minute - a new metric for measuring responsiveness List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 13 Jul 2021 20:26:57 -0000 On 07/13/21 - 15:04, Jonathan Foulkes wrote: > Hi Christoph, > > Is there a means of running the RPM test on an iOS 15 beta 2 (public beta) on an iPad Pro? It’s the only device I can spare to run the beta on, and I’m not on the Apple Developer program (I was for decades, but then went into the networking world ;) ) You can install the "WiFi profile" from https://developer.apple.com/bug-reporting/profiles-and-logs/?name=wifi. That will make a "Responsiveness" UI appear in Settings -> WiFi -> Your WiFi AP -> Diagnostics > Like Rich, I’ve spotted inconsistencies from run to run, even on a line with just the router and my laptop connected. Is there a means of increasing the test runtime? No, there is no way to increase the test runtime. As I mentioned to Rich, pcaps, logs,... will allow to understand what is going on. Some variance is expected over the Internet. Rich's variance does not look outrageous to me, besides 2 outliers (one at ~800 and one at ~1500). The tool gives a guidance on how bad the bufferbloat is. Accurately measuring bufferbloat is extremely hard in fact because it is not trivial to keep the buffers reliably full with standard HTTP/2 traffic. Christoph > > Rich, I like the ideas. > > Regards, > > Jonathan Foulkes > > > On Jul 13, 2021, at 2:53 PM, Christoph Paasch via Rpm wrote: > > > > Hello Rich, > > > > On 07/10/21 - 17:14, Rich Brown via Rpm wrote: > >> I'm so glad to see this mailing list. I started to play with the RPM test, and now I know where I can send feedback. > > > > please note that this mailing-list is not an "official" place to provide > > feedback on Apple's "networkQuality" tool. The proper channel for that is > > the Apple Feedback Assistant. > > > >> I recently installed Monterey b2 on a Parallels Desktop VM on macOS 10.15.7 on a 2019 MBP. I have several observations/requests: > >> > >> 1. I felt the urge to include identifying information along with the networkQuality program's output. I wrote a script that includes a date/time stamp plus a text parameter to identify the test. (Prior "art" - my coffee-shop-bloat-test.sh at https://github.com/richb-hanover/coffee-shop-bloat-test.) Here's the checkNetworkQuality.sh script: > >> > >> ======== > >> #/bin/bash > >> # checkNetworkQuality.sh - display RPMs for this network > >> # Parameter is a user-entered description for the test condition/location/etc. > >> > >> echo `date`: $1 > >> /usr/bin/networkQuality -v > >> ======== > >> > >> 2. Feature Requests: From this experience, I would like to see /usr/bin/networkQuality enhanced to (always?) display the date/time of the run, and to include an optional parameter for a test name/information. These parameters should also be included as new properties of the "-c" output. In addition, it might be good to include the build number in the output > > > > Let me see what can be done here... > > > >> 3. I ran the test several times on my connection through an IQrouter v2, with 25/25 mbps fiber optic service. I notice significant variance in the RPM numbers, and do not believe there was any other significant traffic at the time. Is this variance expected? > > > > No, it is not expected. Please collect the RPM-numbers, pcaps and log-output > > from the command "log stream --info --debug --style compact --process networkQuality" > > > >> 4. I do not know what happened to the network at 12:06:56 EDT (see below). It obviously recovered 15 seconds later... > > > > When you hit something like that, you can always run "sysdiagnose" > > after-the-fact and share the resulting archive with me or via Apple Feedback > > Assistant. > > > > > > Cheers, > > Christoph > > > >> > >> Thanks for listening! > >> > >> Rich > >> > >> > >> richb@Mac ~ % sh checkNetworkQuality.sh "SQM On" > >> Thu Jul 8 11:54:43 EDT 2021 SQM On > >> ==== SUMMARY ==== > >> Upload capacity: 21.601 Mbps > >> Download capacity: 22.342 Mbps > >> Upload flows: 12 > >> Download flows: 12 > >> Responsiveness: Medium (936 RPM) > >> Base RTT: 29 > >> richb@Mac ~ % nano checkNetworkQuality.sh > >> richb@Mac ~ % sh checkNetworkQuality.sh "SQM On" > >> Thu Jul 8 11:55:11 EDT 2021: SQM On > >> ==== SUMMARY ==== > >> Upload capacity: 22.279 Mbps > >> Download capacity: 23.015 Mbps > >> Upload flows: 12 > >> Download flows: 12 > >> Responsiveness: High (1299 RPM) > >> Base RTT: 21 > >> richb@Mac ~ % /usr/bin/networkQuality -c > >> > >> { > >> "lud_self_ul_h2" : [ > >> 50.168037414550781, > >> 79.007026672363281, > >> 34.090042114257812, > >> 60.513019561767578, > >> 149.68597412109375, > >> 160.39801025390625, > >> 194.803955078125, > >> 194.86808776855469, > >> 331.38299560546875 > >> ], > >> "responsiveness" : 1246, > >> "ul_throughput" : 22345152, > >> "lud_foreign_tcp_handshake_443" : [ > >> 27, > >> 31, > >> 31, > >> 27, > >> 29, > >> 29, > >> 29, > >> 29 > >> ], > >> "dl_flows" : 12, > >> "ul_flows" : 12, > >> "dl_throughput" : 22535718, > >> "lud_foreign_h2_req_resp" : [ > >> 46, > >> 61, > >> 51, > >> 52, > >> 53, > >> 61, > >> 117, > >> 97 > >> ] > >> } > >> richb@Mac ~ % sh checkNetworkQuality.sh "SQM On" > >> Thu Jul 8 12:03:49 EDT 2021: SQM On > >> ==== SUMMARY ==== > >> Upload capacity: 21.356 Mbps > >> Download capacity: 22.686 Mbps > >> Upload flows: 12 > >> Download flows: 20 > >> Responsiveness: High (1391 RPM) > >> Base RTT: 18 > >> richb@Mac ~ % sh checkNetworkQuality.sh > >> Thu Jul 8 12:04:34 EDT 2021: > >> ==== SUMMARY ==== > >> Upload capacity: 22.430 Mbps > >> Download capacity: 21.363 Mbps > >> Upload flows: 12 > >> Download flows: 12 > >> Responsiveness: High (1592 RPM) > >> Base RTT: 27 > >> richb@Mac ~ % sh checkNetworkQuality.sh "SQM Enabled" > >> Thu Jul 8 12:05:02 EDT 2021: SQM Enabled > >> ==== SUMMARY ==== > >> Upload capacity: 22.672 Mbps > >> Download capacity: 21.199 Mbps > >> Upload flows: 16 > >> Download flows: 20 > >> Responsiveness: High (1028 RPM) > >> Base RTT: 16 > >> richb@Mac ~ % sh checkNetworkQuality.sh "SQM Enabled" > >> Thu Jul 8 12:06:29 EDT 2021: SQM Enabled > >> ==== SUMMARY ==== > >> Upload capacity: 22.240 Mbps > >> Download capacity: 22.584 Mbps > >> Upload flows: 12 > >> Download flows: 12 > >> Responsiveness: High (1516 RPM) > >> Base RTT: 16 > >> richb@Mac ~ % sh checkNetworkQuality.sh "SQM Enabled" > >> Thu Jul 8 12:06:42 EDT 2021: SQM Enabled > >> ==== SUMMARY ==== > >> Upload capacity: 22.405 Mbps > >> Download capacity: 21.679 Mbps > >> Upload flows: 12 > >> Download flows: 12 > >> Responsiveness: Medium (924 RPM) > >> Base RTT: 21 > >> richb@Mac ~ % sh checkNetworkQuality.sh "SQM Enabled" > >> Thu Jul 8 12:06:56 EDT 2021: SQM Enabled > >> ==== SUMMARY ==== > >> Upload capacity: 0.000 bps > >> Download capacity: 0.000 bps > >> Upload flows: 0 > >> Download flows: 0 > >> Responsiveness: Low (0 RPM) > >> Base RTT: 23 > >> Error: Error Domain=NSURLErrorDomain Code=-1005 "The network connection was lost." UserInfo={NSLocalizedDescription=The network connection was lost., NSErrorFailingURLStringKey=https://mensura.cdn-apple.com/api/v1/seed/large, NSErrorFailingURLKey=https://mensura.cdn-apple.com/api/v1/seed/large, _NSURLErrorRelatedURLSessionTaskErrorKey=( > >> "LocalDataTask .<1>" > >> ), _NSURLErrorFailingURLSessionTaskErrorKey=LocalDataTask .<1>, NSUnderlyingError=0x600001c35f80 {Error Domain=kCFErrorDomainCFNetwork Code=-1005 "(null)" UserInfo={NSErrorPeerAddressKey={length = 16, capacity = 16, bytes = 0x100201bb11fd0f0f0000000000000000}}}} > >> richb@Mac ~ % sh checkNetworkQuality.sh "SQM Enabled" > >> Thu Jul 8 12:07:16 EDT 2021: SQM Enabled > >> ==== SUMMARY ==== > >> Upload capacity: 21.850 Mbps > >> Download capacity: 22.660 Mbps > >> Upload flows: 12 > >> Download flows: 20 > >> Responsiveness: Medium (873 RPM) > >> Base RTT: 21 > >> richb@Mac ~ % sh checkNetworkQuality.sh "SQM Enabled" > >> Thu Jul 8 12:07:38 EDT 2021: SQM Enabled > >> ==== SUMMARY ==== > >> Upload capacity: 21.991 Mbps > >> Download capacity: 22.442 Mbps > >> Upload flows: 12 > >> Download flows: 12 > >> Responsiveness: High (1212 RPM) > >> Base RTT: 16 > >> richb@Mac ~ % sh checkNetworkQuality.sh "SQM Enabled" > >> Thu Jul 8 12:07:52 EDT 2021: SQM Enabled > >> ==== SUMMARY ==== > >> Upload capacity: 21.988 Mbps > >> Download capacity: 22.328 Mbps > >> Upload flows: 12 > >> Download flows: 12 > >> Responsiveness: High (1278 RPM) > >> Base RTT: 16 > >> richb@Mac ~ % sh checkNetworkQuality.sh "SQM Enabled" > >> Thu Jul 8 12:08:10 EDT 2021: SQM Enabled > >> ==== SUMMARY ==== > >> Upload capacity: 22.292 Mbps > >> Download capacity: 22.615 Mbps > >> Upload flows: 12 > >> Download flows: 20 > >> Responsiveness: High (1456 RPM) > >> Base RTT: 14 > >> richb@Mac ~ % sh checkNetworkQuality.sh "SQM Enabled" > >> Thu Jul 8 12:08:39 EDT 2021: SQM Enabled > >> ==== SUMMARY ==== > >> Upload capacity: 21.950 Mbps > >> Download capacity: 22.231 Mbps > >> Upload flows: 12 > >> Download flows: 12 > >> Responsiveness: High (1329 RPM) > >> Base RTT: 16 > >> richb@Mac ~ % > >> _______________________________________________ > >> Rpm mailing list > >> Rpm@lists.bufferbloat.net > >> https://lists.bufferbloat.net/listinfo/rpm > > _______________________________________________ > > Rpm mailing list > > Rpm@lists.bufferbloat.net > > https://lists.bufferbloat.net/listinfo/rpm >