* [Bloat] Announcing the LibreQoS Bufferbloat Test Platform @ 2025-06-15 12:00 Frantisek Borsik 2025-06-15 16:20 ` [Bloat] [Starlink] " the keyboard of geoff goodfellow ` (3 more replies) 0 siblings, 4 replies; 10+ messages in thread From: Frantisek Borsik @ 2025-06-15 12:00 UTC (permalink / raw) To: libreqos, bloat, Dave Taht via Starlink, Jeremy Austin via Rpm, bloat-ietf, Cake List, codel Cc: Robert Chacón, Herbert Wolverson [-- Attachment #1: Type: text/plain, Size: 4574 bytes --] Hello to all, We're excited to announce the release of the *LibreQoS Bufferbloat Test* – an open-source bufferbloat testing solution designed specifically for ISPs and network operators to deploy for their customers. *Link* https://test.libreqos.com *What Makes This Different* While there are several bufferbloat testing tools available, this platform addresses a critical gap: ISP-deployable infrastructure that provides both traditional testing and realistic household simulation. As Dave Täht highlighted in his influential article "What's Wrong with Speed Tests" <https://blog.cerowrt.org/post/speedtests/>, traditional speed tests fail to measure what users actually experience. We tried to address Dave's points to make a better speed test that focuses on the metric that matters: latency under load in realistic usage scenarios. *Two Complementary Test Modes* *Single User Test Mode* - Traditional sequential load testing (baseline → download → upload → bidirectional) - Measures working latency and jitter during each phase - Familiar A+ to F grading based on latency under load increases - Comparable to existing tools like DSLReports Speed Test and Waveform Bufferbloat Test *Virtual Household Mode (The Innovation)* Process-isolated simulation of 4 concurrent users with authentic traffic patterns: - Alex (Gaming): 1.5 Mbps constant, jitter-sensitive for competitive gaming - Sarah (Video Conference): 2.5 Mbps bidirectional, Teams simulation with working latency monitoring - Jake (Netflix HD): 25 Mbps bursts (1s on, 4s off), realistic streaming patterns - Computer (Background): Up to 200 Mbps continuous download, system updates Real-world relevance: Tests latency under load when multiple family members are online simultaneously Advanced grading: Network fairness, jitter measurement, and per-user working latency analysis *Why (not only) ISPs Need This* *The traditional approach of sending customers to third-party speed test sites has limitations:* - No control over test methodology or server placement - Limited correlation with customer support tickets - Generic results that don't reflect real-world usage patterns - No integration with ISP operational systems *This platform enables (not only) ISPs to:* - Host their own testing infrastructure with full control - Integrate with support systems via telemetry APIs - Provide customers with realistic household testing scenarios - Correlate test results with network performance and customer complaints *Open Source & Community* The entire platform is open source and available here: https://github.com/LibreQoE/bufferbloat_test We've designed this to be: - Easy to deploy for (not only) ISPs of any size - Scientifically meaningful in its measurement methodology - Realistic in its simulation of actual household usage - Integrable with existing ISP operational workflows *Community Feedback Requested* We'd love feedback from the bufferbloat.net community on: - Test methodology: Are we measuring the right metrics? - Grading thresholds: Do our A+ to F grades align with real-world impact? - Virtual household scenarios: What other realistic usage patterns should we simulate? - ISP adoption: What barriers exist for ISP deployment? *Technical Discussion* We'd welcome discussion about: - Measurement accuracy for working latency and jitter in virtual household mode - Traffic pattern authenticity (gaming, video conferencing, streaming) - Grading methodology for latency under load in complex multi-user scenarios - Integration approaches for ISP operational systems The platform represents our attempt to bridge the gap between academic bufferbloat research and practical ISP operations, building on the foundational work of researchers like Dave Täht and the broader bufferbloat community. We believe that widespread ISP deployment of proper bufferbloat testing infrastructure will ultimately benefit the entire internet ecosystem. *Looking forward to the community's thoughts and feedback!* Best regards, The LibreQoS Team *In loving memory of Dave Täht: *1965-2025 https://libreqos.io/2025/04/01/in-loving-memory-of-dave/ https://www.linkedin.com/in/frantisekborsik Signal, Telegram, WhatsApp: +421919416714 iMessage, mobile: +420775230885 Skype: casioa5302ca frantisek.borsik@gmail.com [-- Attachment #2: Type: text/html, Size: 6149 bytes --] ^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [Bloat] [Starlink] Announcing the LibreQoS Bufferbloat Test Platform 2025-06-15 12:00 [Bloat] Announcing the LibreQoS Bufferbloat Test Platform Frantisek Borsik @ 2025-06-15 16:20 ` the keyboard of geoff goodfellow 2025-06-15 16:52 ` [Bloat] [Starlink] Announcing the LibreQoS Bufferbloat TestPlatform Nils Andreas Svee 2025-06-15 17:27 ` [Bloat] [Starlink] Announcing the LibreQoS Bufferbloat Test Platform J Pan 2025-06-15 19:23 ` [Bloat] " Michael Richardson ` (2 subsequent siblings) 3 siblings, 2 replies; 10+ messages in thread From: the keyboard of geoff goodfellow @ 2025-06-15 16:20 UTC (permalink / raw) To: Frantisek Borsik Cc: libreqos, bloat, Dave Taht via Starlink, Jeremy Austin via Rpm, bloat-ietf, Cake List, codel, Herbert Wolverson, Robert Chacón [-- Attachment #1: Type: text/plain, Size: 5606 bytes --] re: *thoughts and feedback!* your https://test.libreqos.com tests of [Single User Test] & [Virtual Household Mode] both give yours truly bufferbloat grades of *A+ * whereas the https://www.waveform.com/tools/bufferbloat test gives yours truly a bufferbloat brade grade of *C* https://www.waveform.com/tools/bufferbloat?test-id=b13810f2-e999-4045-8e8b-ab3ab8b957c5 #1.) Why/What's the difference? #2.) Who/Which one to believe¿ g On Sun, Jun 15, 2025 at 4:58 AM Frantisek Borsik via Starlink < starlink@lists.bufferbloat.net> wrote: > Hello to all, > > We're excited to announce the release of the *LibreQoS Bufferbloat Test* > – an open-source bufferbloat testing solution designed specifically for > ISPs and network operators to deploy for their customers. > > *Link* > https://test.libreqos.com > > *What Makes This Different* > > While there are several bufferbloat testing tools available, this platform > addresses a critical gap: ISP-deployable infrastructure that provides both > traditional testing and realistic household simulation. > > As Dave Täht highlighted in his influential article "What's Wrong with > Speed Tests" <https://blog.cerowrt.org/post/speedtests/>, traditional > speed tests fail to measure what users actually experience. We tried to > address Dave's points to make a better speed test that focuses on the > metric that matters: latency under load in realistic usage scenarios. > > *Two Complementary Test Modes* > > *Single User Test Mode* > > - Traditional sequential load testing (baseline → download → upload → > bidirectional) > - Measures working latency and jitter during each phase > - Familiar A+ to F grading based on latency under load increases > - Comparable to existing tools like DSLReports Speed Test and Waveform > Bufferbloat Test > > > *Virtual Household Mode (The Innovation)* > > Process-isolated simulation of 4 concurrent users with authentic traffic > patterns: > > - Alex (Gaming): 1.5 Mbps constant, jitter-sensitive for competitive > gaming > - Sarah (Video Conference): 2.5 Mbps bidirectional, Teams simulation > with working latency monitoring > - Jake (Netflix HD): 25 Mbps bursts (1s on, 4s off), realistic > streaming patterns > - Computer (Background): Up to 200 Mbps continuous download, system > updates > > > Real-world relevance: Tests latency under load when multiple family > members are online simultaneously > > Advanced grading: Network fairness, jitter measurement, and per-user > working latency analysis > > *Why (not only) ISPs Need This* > > *The traditional approach of sending customers to third-party speed test > sites has limitations:* > > - No control over test methodology or server placement > - Limited correlation with customer support tickets > - Generic results that don't reflect real-world usage patterns > - No integration with ISP operational systems > > *This platform enables (not only) ISPs to:* > > - Host their own testing infrastructure with full control > - Integrate with support systems via telemetry APIs > - Provide customers with realistic household testing scenarios > - Correlate test results with network performance and customer > complaints > > > *Open Source & Community* > > The entire platform is open source and available here: > https://github.com/LibreQoE/bufferbloat_test > > We've designed this to be: > > - Easy to deploy for (not only) ISPs of any size > - Scientifically meaningful in its measurement methodology > - Realistic in its simulation of actual household usage > - Integrable with existing ISP operational workflows > > > > *Community Feedback Requested* > We'd love feedback from the bufferbloat.net community on: > > - Test methodology: Are we measuring the right metrics? > - Grading thresholds: Do our A+ to F grades align with real-world > impact? > - Virtual household scenarios: What other realistic usage patterns > should we simulate? > - ISP adoption: What barriers exist for ISP deployment? > > > > *Technical Discussion* > We'd welcome discussion about: > > - Measurement accuracy for working latency and jitter in virtual > household mode > - Traffic pattern authenticity (gaming, video conferencing, streaming) > - Grading methodology for latency under load in complex multi-user > scenarios > - Integration approaches for ISP operational systems > > > The platform represents our attempt to bridge the gap between academic > bufferbloat research and practical ISP operations, building on the > foundational work of researchers like Dave Täht and the broader bufferbloat > community. We believe that widespread ISP deployment of proper bufferbloat > testing infrastructure will ultimately benefit the entire internet > ecosystem. > > > *Looking forward to the community's thoughts and feedback!* > Best regards, > > The LibreQoS Team > > > *In loving memory of Dave Täht: *1965-2025 > > https://libreqos.io/2025/04/01/in-loving-memory-of-dave/ > > > https://www.linkedin.com/in/frantisekborsik > > Signal, Telegram, WhatsApp: +421919416714 > > iMessage, mobile: +420775230885 > > Skype: casioa5302ca > > frantisek.borsik@gmail.com > _______________________________________________ > Starlink mailing list > Starlink@lists.bufferbloat.net > https://lists.bufferbloat.net/listinfo/starlink > -- Geoff.Goodfellow@iconia.com living as The Truth is True [-- Attachment #2: Type: text/html, Size: 9280 bytes --] ^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [Bloat] [Starlink] Announcing the LibreQoS Bufferbloat TestPlatform 2025-06-15 16:20 ` [Bloat] [Starlink] " the keyboard of geoff goodfellow @ 2025-06-15 16:52 ` Nils Andreas Svee 2025-06-15 17:32 ` [Bloat] [Cake] " dave seddon 2025-06-15 17:27 ` [Bloat] [Starlink] Announcing the LibreQoS Bufferbloat Test Platform J Pan 1 sibling, 1 reply; 10+ messages in thread From: Nils Andreas Svee @ 2025-06-15 16:52 UTC (permalink / raw) To: the keyboard of geoff goodfellow, Frantisek Borsik Cc: Jeremy Austin, Herbert Wolverson, libreqos, Dave Taht, codel, bloat, Cake List, bloat-ietf, Robert Chacón [-- Attachment #1: Type: text/plain, Size: 6224 bytes --] Just tried it too: https://imgur.com/a/F2cNZd4, also getting A+ overall, and "only" A for bidirectional. I seem to be getting a 200+ ms spike right at the beginning of the baseline test, which skews the results. This happened at least on a couple of tests, but after a few tries it got better. At least with ICMP ping separately I don't see any spikes like that. Best Regards Nils On Sun, Jun 15, 2025, at 23:20, the keyboard of geoff goodfellow via Bloat wrote: > re: *thoughts and feedback!* > > your https://test.libreqos.com tests of [Single User Test] & [Virtual Household Mode] both give yours truly bufferbloat grades of *A+ * > > whereas the https://www.waveform.com/tools/bufferbloat test gives yours truly a bufferbloat brade grade of *C* > > https://www.waveform.com/tools/bufferbloat?test-id=b13810f2-e999-4045-8e8b-ab3ab8b957c5 > > #1.) Why/What's the difference? > > #2.) Who/Which one to believe¿ > > g > > > On Sun, Jun 15, 2025 at 4:58 AM Frantisek Borsik via Starlink <starlink@lists.bufferbloat.net> wrote: >> Hello to all, >> >> We're excited to announce the release of the *LibreQoS Bufferbloat Test* – an open-source bufferbloat testing solution designed specifically for ISPs and network operators to deploy for their customers. >> >> *Link* >> https://test.libreqos.com >> >> *What Makes This Different* >> >> While there are several bufferbloat testing tools available, this platform addresses a critical gap: ISP-deployable infrastructure that provides both traditional testing and realistic household simulation. >> >> As Dave Täht highlighted in his influential article "What's Wrong with Speed Tests" <https://blog.cerowrt.org/post/speedtests/>, traditional speed tests fail to measure what users actually experience. We tried to address Dave's points to make a better speed test that focuses on the metric that matters: latency under load in realistic usage scenarios. >> >> *Two Complementary Test Modes* >> >> *Single User Test Mode* >> • Traditional sequential load testing (baseline → download → upload → bidirectional) >> • Measures working latency and jitter during each phase >> • Familiar A+ to F grading based on latency under load increases >> • Comparable to existing tools like DSLReports Speed Test and Waveform Bufferbloat Test >> >> *Virtual Household Mode (The Innovation)* >> >> Process-isolated simulation of 4 concurrent users with authentic traffic patterns: >> • Alex (Gaming): 1.5 Mbps constant, jitter-sensitive for competitive gaming >> • Sarah (Video Conference): 2.5 Mbps bidirectional, Teams simulation with working latency monitoring >> • Jake (Netflix HD): 25 Mbps bursts (1s on, 4s off), realistic streaming patterns >> • Computer (Background): Up to 200 Mbps continuous download, system updates >> >> Real-world relevance: Tests latency under load when multiple family members are online simultaneously >> >> Advanced grading: Network fairness, jitter measurement, and per-user working latency analysis >> >> *Why (not only) ISPs Need This* >> >> *The traditional approach of sending customers to third-party speed test sites has limitations:* >> • No control over test methodology or server placement >> • Limited correlation with customer support tickets >> • Generic results that don't reflect real-world usage patterns >> • No integration with ISP operational systems >> *This platform enables (not only) ISPs to:* >> • Host their own testing infrastructure with full control >> • Integrate with support systems via telemetry APIs >> • Provide customers with realistic household testing scenarios >> • Correlate test results with network performance and customer complaints >> >> *Open Source & Community* >> >> The entire platform is open source and available here: https://github.com/LibreQoE/bufferbloat_test >> >> We've designed this to be: >> • Easy to deploy for (not only) ISPs of any size >> • Scientifically meaningful in its measurement methodology >> • Realistic in its simulation of actual household usage >> • Integrable with existing ISP operational workflows >> >> *Community Feedback Requested * >> We'd love feedback from the bufferbloat.net community on: >> • Test methodology: Are we measuring the right metrics? >> • Grading thresholds: Do our A+ to F grades align with real-world impact? >> • Virtual household scenarios: What other realistic usage patterns should we simulate? >> • ISP adoption: What barriers exist for ISP deployment? >> >> *Technical Discussion * >> We'd welcome discussion about: >> • Measurement accuracy for working latency and jitter in virtual household mode >> • Traffic pattern authenticity (gaming, video conferencing, streaming) >> • Grading methodology for latency under load in complex multi-user scenarios >> • Integration approaches for ISP operational systems >> >> The platform represents our attempt to bridge the gap between academic bufferbloat research and practical ISP operations, building on the foundational work of researchers like Dave Täht and the broader bufferbloat community. We believe that widespread ISP deployment of proper bufferbloat testing infrastructure will ultimately benefit the entire internet ecosystem. >> >> *Looking forward to the community's thoughts and feedback! * >> Best regards, >> >> The LibreQoS Team >> >> *__In loving memory of Dave Täht: *1965-2025 >> __https://libreqos.io/2025/04/01/in-loving-memory-of-dave/ >> >> https://www.linkedin.com/in/frantisekborsik____ >> Signal, Telegram, WhatsApp: +421919416714 ____ >> iMessage, mobile: +420775230885____ >> Skype: casioa5302ca____ >> frantisek.borsik@gmail.com >> _______________________________________________ >> Starlink mailing list >> Starlink@lists.bufferbloat.net >> https://lists.bufferbloat.net/listinfo/starlink > > > -- > Geoff.Goodfellow@iconia.com > > living as The Truth is True > > _______________________________________________ > Bloat mailing list > Bloat@lists.bufferbloat.net > https://lists.bufferbloat.net/listinfo/bloat > [-- Attachment #2: Type: text/html, Size: 11469 bytes --] ^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [Bloat] [Cake] [Starlink] Announcing the LibreQoS Bufferbloat TestPlatform 2025-06-15 16:52 ` [Bloat] [Starlink] Announcing the LibreQoS Bufferbloat TestPlatform Nils Andreas Svee @ 2025-06-15 17:32 ` dave seddon 2025-06-15 18:05 ` Robert Chacón 0 siblings, 1 reply; 10+ messages in thread From: dave seddon @ 2025-06-15 17:32 UTC (permalink / raw) To: Nils Andreas Svee Cc: the keyboard of geoff goodfellow, Frantisek Borsik, Dave Taht, Herbert Wolverson, libreqos, Jeremy Austin, codel, bloat, Cake List, bloat-ietf, Robert Chacón [-- Attachment #1: Type: text/plain, Size: 8581 bytes --] Very cool Frank! When I run it, it says all of my latency is 0.0ms. This is firefox-139.0.1 on NixOS unstable. I guess soem of the CORS headers are screwed up? Cross-Origin Request Blocked: The Same Origin Policy disallows reading the remote resource at https://test-elp.libreqos.com:8005/ping?cb=242578. (Reason: CORS request did not succeed). Status code: (null). I don't know, I guess you probably _do_ want these objects to be cacheable via the CDN? GET /ping?cb=819806 HTTP/1.1 Host: test-elp.libreqos.com:8005 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:139.0) Gecko/20100101 Firefox/139.0 Accept: */* Accept-Language: en-US,en;q=0.5 Accept-Encoding: gzip, deflate, br, zstd Pragma: no-cache Cache-Control: no-store, no-cache, must-revalidate X-Priority: high X-Ping-Attempt: 0 Referer: https://test.libreqos.com/ Origin: https://test.libreqos.com Connection: keep-alive Sec-Fetch-Dest: empty Sec-Fetch-Mode: cors Sec-Fetch-Site: same-site HTTP/1.1 200 OK date: Sun, 15 Jun 2025 17:13:55 GMT server: uvicorn cache-control: no-store, no-cache, must-revalidate pragma: no-cache x-ping-server: dedicated x-priority-processed: true x-ping-timeouts-seen: 0 content-length: 4 content-type: text/plain; charset=utf-8 access-control-allow-origin: * access-control-allow-credentials: true Your Nginx server also can have caching enabled for the favorite icon, and the javascript, which should make it faster to load. HTTP/2 200 server: nginx/1.18.0 (Ubuntu) date: Sun, 15 Jun 2025 17:13:35 GMT content-type: text/javascript; charset=utf-8 vary: Accept-Encoding last-modified: Tue, 10 Jun 2025 04:28:53 GMT strict-transport-security: max-age=63072000 x-content-type-options: nosniff x-frame-options: SAMEORIGIN content-encoding: gzip X-Firefox-Spdy: h2 I've found that you can set the caching for the CORS "preflight" requests too and it definitely helps. e.g. access-control-max-age 345600 On Sun, Jun 15, 2025 at 9:53 AM Nils Andreas Svee via Cake < cake@lists.bufferbloat.net> wrote: > Just tried it too: https://imgur.com/a/F2cNZd4, also getting A+ overall, > and "only" A for bidirectional. > > I seem to be getting a 200+ ms spike right at the beginning of the > baseline test, which skews the results. > This happened at least on a couple of tests, but after a few tries it got > better. At least with ICMP ping separately I don't see any spikes like that. > > Best Regards > Nils > > On Sun, Jun 15, 2025, at 23:20, the keyboard of geoff goodfellow via Bloat > wrote: > > re: *thoughts and feedback!* > > your https://test.libreqos.com tests of [Single User Test] & [Virtual > Household Mode] both give yours truly bufferbloat grades of *A+ * > > whereas the https://www.waveform.com/tools/bufferbloat test gives yours > truly a bufferbloat brade grade of *C* > > > https://www.waveform.com/tools/bufferbloat?test-id=b13810f2-e999-4045-8e8b-ab3ab8b957c5 > > #1.) Why/What's the difference? > > #2.) Who/Which one to believe¿ > > g > > > On Sun, Jun 15, 2025 at 4:58 AM Frantisek Borsik via Starlink < > starlink@lists.bufferbloat.net> wrote: > > Hello to all, > > We're excited to announce the release of the *LibreQoS Bufferbloat Test* > – an open-source bufferbloat testing solution designed specifically for > ISPs and network operators to deploy for their customers. > > *Link* > https://test.libreqos.com > > *What Makes This Different* > > While there are several bufferbloat testing tools available, this platform > addresses a critical gap: ISP-deployable infrastructure that provides both > traditional testing and realistic household simulation. > > As Dave Täht highlighted in his influential article "What's Wrong with > Speed Tests" <https://blog.cerowrt.org/post/speedtests/>, traditional > speed tests fail to measure what users actually experience. We tried to > address Dave's points to make a better speed test that focuses on the > metric that matters: latency under load in realistic usage scenarios. > > *Two Complementary Test Modes* > > *Single User Test Mode* > > - Traditional sequential load testing (baseline → download → upload → > bidirectional) > - Measures working latency and jitter during each phase > - Familiar A+ to F grading based on latency under load increases > - Comparable to existing tools like DSLReports Speed Test and Waveform > Bufferbloat Test > > > *Virtual Household Mode (The Innovation)* > > Process-isolated simulation of 4 concurrent users with authentic traffic > patterns: > > - Alex (Gaming): 1.5 Mbps constant, jitter-sensitive for competitive > gaming > - Sarah (Video Conference): 2.5 Mbps bidirectional, Teams simulation > with working latency monitoring > - Jake (Netflix HD): 25 Mbps bursts (1s on, 4s off), realistic > streaming patterns > - Computer (Background): Up to 200 Mbps continuous download, system > updates > > > Real-world relevance: Tests latency under load when multiple family > members are online simultaneously > > Advanced grading: Network fairness, jitter measurement, and per-user > working latency analysis > > *Why (not only) ISPs Need This* > > *The traditional approach of sending customers to third-party speed test > sites has limitations:* > > - No control over test methodology or server placement > - Limited correlation with customer support tickets > - Generic results that don't reflect real-world usage patterns > - No integration with ISP operational systems > > *This platform enables (not only) ISPs to:* > > - Host their own testing infrastructure with full control > - Integrate with support systems via telemetry APIs > - Provide customers with realistic household testing scenarios > - Correlate test results with network performance and customer > complaints > > > *Open Source & Community* > > The entire platform is open source and available here: > https://github.com/LibreQoE/bufferbloat_test > > We've designed this to be: > > - Easy to deploy for (not only) ISPs of any size > - Scientifically meaningful in its measurement methodology > - Realistic in its simulation of actual household usage > - Integrable with existing ISP operational workflows > > > > *Community Feedback Requested* > We'd love feedback from the bufferbloat.net community on: > > - Test methodology: Are we measuring the right metrics? > - Grading thresholds: Do our A+ to F grades align with real-world > impact? > - Virtual household scenarios: What other realistic usage patterns > should we simulate? > - ISP adoption: What barriers exist for ISP deployment? > > > > *Technical Discussion* > We'd welcome discussion about: > > - Measurement accuracy for working latency and jitter in virtual > household mode > - Traffic pattern authenticity (gaming, video conferencing, streaming) > - Grading methodology for latency under load in complex multi-user > scenarios > - Integration approaches for ISP operational systems > > > The platform represents our attempt to bridge the gap between academic > bufferbloat research and practical ISP operations, building on the > foundational work of researchers like Dave Täht and the broader bufferbloat > community. We believe that widespread ISP deployment of proper bufferbloat > testing infrastructure will ultimately benefit the entire internet > ecosystem. > > > *Looking forward to the community's thoughts and feedback!* > Best regards, > > The LibreQoS Team > > > *In loving memory of Dave Täht: *1965-2025 > > https://libreqos.io/2025/04/01/in-loving-memory-of-dave/ > > > https://www.linkedin.com/in/frantisekborsik > > Signal, Telegram, WhatsApp: +421919416714 > > iMessage, mobile: +420775230885 > > Skype: casioa5302ca > > frantisek.borsik@gmail.com > _______________________________________________ > Starlink mailing list > Starlink@lists.bufferbloat.net > https://lists.bufferbloat.net/listinfo/starlink > > > > -- > Geoff.Goodfellow@iconia.com > > living as The Truth is True > > _______________________________________________ > Bloat mailing list > Bloat@lists.bufferbloat.net > https://lists.bufferbloat.net/listinfo/bloat > > > _______________________________________________ > Cake mailing list > Cake@lists.bufferbloat.net > https://lists.bufferbloat.net/listinfo/cake > -- Regards, Dave Seddon +1 415 857 5102 [-- Attachment #2: Type: text/html, Size: 14242 bytes --] ^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [Bloat] [Cake] [Starlink] Announcing the LibreQoS Bufferbloat TestPlatform 2025-06-15 17:32 ` [Bloat] [Cake] " dave seddon @ 2025-06-15 18:05 ` Robert Chacón 2025-06-15 20:12 ` dave seddon 0 siblings, 1 reply; 10+ messages in thread From: Robert Chacón @ 2025-06-15 18:05 UTC (permalink / raw) To: dave seddon Cc: Nils Andreas Svee, the keyboard of geoff goodfellow, Frantisek Borsik, Dave Taht, Herbert Wolverson, libreqos, Jeremy Austin, codel, bloat, Cake List, bloat-ietf [-- Attachment #1: Type: text/plain, Size: 9570 bytes --] Nils, I've now fixed the issue where the initial latency spike skews baseline results by switching to using 75th percentile for baseline calculation. Thanks for catching that. Geoff, I may have fixed that now. Our Vultr VPS was hitting its bandwidth limit apparently, and they throttled it. Switched to hosting it locally in El Paso as fast as I could. Now tests can achieve saturation throughput. Dave, If you try it again does it still fail to ping currently? Thanks, Robert On Sun, Jun 15, 2025 at 11:32 AM dave seddon <dave.seddon.ca@gmail.com> wrote: > Very cool Frank! > > When I run it, it says all of my latency is 0.0ms. This > is firefox-139.0.1 on NixOS unstable. > > I guess soem of the CORS headers are screwed up? > Cross-Origin Request Blocked: The Same Origin Policy disallows reading the > remote resource at https://test-elp.libreqos.com:8005/ping?cb=242578. > (Reason: CORS request did not succeed). Status code: (null). > > I don't know, I guess you probably _do_ want these objects to be > cacheable via the CDN? > > GET /ping?cb=819806 HTTP/1.1 > Host: test-elp.libreqos.com:8005 > User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:139.0) Gecko/20100101 > Firefox/139.0 > Accept: */* > Accept-Language: en-US,en;q=0.5 > Accept-Encoding: gzip, deflate, br, zstd > Pragma: no-cache > Cache-Control: no-store, no-cache, must-revalidate > X-Priority: high > X-Ping-Attempt: 0 > Referer: https://test.libreqos.com/ > Origin: https://test.libreqos.com > Connection: keep-alive > Sec-Fetch-Dest: empty > Sec-Fetch-Mode: cors > Sec-Fetch-Site: same-site > > HTTP/1.1 200 OK > date: Sun, 15 Jun 2025 17:13:55 GMT > server: uvicorn > cache-control: no-store, no-cache, must-revalidate > pragma: no-cache > x-ping-server: dedicated > x-priority-processed: true > x-ping-timeouts-seen: 0 > content-length: 4 > content-type: text/plain; charset=utf-8 > access-control-allow-origin: * > access-control-allow-credentials: true > > Your Nginx server also can have caching enabled for the favorite icon, and > the javascript, which should make it faster to load. > > HTTP/2 200 > server: nginx/1.18.0 (Ubuntu) > date: Sun, 15 Jun 2025 17:13:35 GMT > content-type: text/javascript; charset=utf-8 > vary: Accept-Encoding > last-modified: Tue, 10 Jun 2025 04:28:53 GMT > strict-transport-security: max-age=63072000 > x-content-type-options: nosniff > x-frame-options: SAMEORIGIN > content-encoding: gzip > X-Firefox-Spdy: h2 > > I've found that you can set the caching for the CORS "preflight" requests > too and it definitely helps. e.g. access-control-max-age 345600 > > On Sun, Jun 15, 2025 at 9:53 AM Nils Andreas Svee via Cake < > cake@lists.bufferbloat.net> wrote: > >> Just tried it too: https://imgur.com/a/F2cNZd4, also getting A+ overall, >> and "only" A for bidirectional. >> >> I seem to be getting a 200+ ms spike right at the beginning of the >> baseline test, which skews the results. >> This happened at least on a couple of tests, but after a few tries it got >> better. At least with ICMP ping separately I don't see any spikes like that. >> >> Best Regards >> Nils >> >> On Sun, Jun 15, 2025, at 23:20, the keyboard of geoff goodfellow via >> Bloat wrote: >> >> re: *thoughts and feedback!* >> >> your https://test.libreqos.com tests of [Single User Test] & [Virtual >> Household Mode] both give yours truly bufferbloat grades of *A+ * >> >> whereas the https://www.waveform.com/tools/bufferbloat test gives yours >> truly a bufferbloat brade grade of *C* >> >> >> https://www.waveform.com/tools/bufferbloat?test-id=b13810f2-e999-4045-8e8b-ab3ab8b957c5 >> >> #1.) Why/What's the difference? >> >> #2.) Who/Which one to believe¿ >> >> g >> >> >> On Sun, Jun 15, 2025 at 4:58 AM Frantisek Borsik via Starlink < >> starlink@lists.bufferbloat.net> wrote: >> >> Hello to all, >> >> We're excited to announce the release of the *LibreQoS Bufferbloat Test* >> – an open-source bufferbloat testing solution designed specifically for >> ISPs and network operators to deploy for their customers. >> >> *Link* >> https://test.libreqos.com >> >> *What Makes This Different* >> >> While there are several bufferbloat testing tools available, this >> platform addresses a critical gap: ISP-deployable infrastructure that >> provides both traditional testing and realistic household simulation. >> >> As Dave Täht highlighted in his influential article "What's Wrong with >> Speed Tests" <https://blog.cerowrt.org/post/speedtests/>, traditional >> speed tests fail to measure what users actually experience. We tried to >> address Dave's points to make a better speed test that focuses on the >> metric that matters: latency under load in realistic usage scenarios. >> >> *Two Complementary Test Modes* >> >> *Single User Test Mode* >> >> - Traditional sequential load testing (baseline → download → upload → >> bidirectional) >> - Measures working latency and jitter during each phase >> - Familiar A+ to F grading based on latency under load increases >> - Comparable to existing tools like DSLReports Speed Test and >> Waveform Bufferbloat Test >> >> >> *Virtual Household Mode (The Innovation)* >> >> Process-isolated simulation of 4 concurrent users with authentic traffic >> patterns: >> >> - Alex (Gaming): 1.5 Mbps constant, jitter-sensitive for competitive >> gaming >> - Sarah (Video Conference): 2.5 Mbps bidirectional, Teams simulation >> with working latency monitoring >> - Jake (Netflix HD): 25 Mbps bursts (1s on, 4s off), realistic >> streaming patterns >> - Computer (Background): Up to 200 Mbps continuous download, system >> updates >> >> >> Real-world relevance: Tests latency under load when multiple family >> members are online simultaneously >> >> Advanced grading: Network fairness, jitter measurement, and per-user >> working latency analysis >> >> *Why (not only) ISPs Need This* >> >> *The traditional approach of sending customers to third-party speed test >> sites has limitations:* >> >> - No control over test methodology or server placement >> - Limited correlation with customer support tickets >> - Generic results that don't reflect real-world usage patterns >> - No integration with ISP operational systems >> >> *This platform enables (not only) ISPs to:* >> >> - Host their own testing infrastructure with full control >> - Integrate with support systems via telemetry APIs >> - Provide customers with realistic household testing scenarios >> - Correlate test results with network performance and customer >> complaints >> >> >> *Open Source & Community* >> >> The entire platform is open source and available here: >> https://github.com/LibreQoE/bufferbloat_test >> >> We've designed this to be: >> >> - Easy to deploy for (not only) ISPs of any size >> - Scientifically meaningful in its measurement methodology >> - Realistic in its simulation of actual household usage >> - Integrable with existing ISP operational workflows >> >> >> >> *Community Feedback Requested* >> We'd love feedback from the bufferbloat.net community on: >> >> - Test methodology: Are we measuring the right metrics? >> - Grading thresholds: Do our A+ to F grades align with real-world >> impact? >> - Virtual household scenarios: What other realistic usage patterns >> should we simulate? >> - ISP adoption: What barriers exist for ISP deployment? >> >> >> >> *Technical Discussion* >> We'd welcome discussion about: >> >> - Measurement accuracy for working latency and jitter in virtual >> household mode >> - Traffic pattern authenticity (gaming, video conferencing, streaming) >> - Grading methodology for latency under load in complex multi-user >> scenarios >> - Integration approaches for ISP operational systems >> >> >> The platform represents our attempt to bridge the gap between academic >> bufferbloat research and practical ISP operations, building on the >> foundational work of researchers like Dave Täht and the broader bufferbloat >> community. We believe that widespread ISP deployment of proper bufferbloat >> testing infrastructure will ultimately benefit the entire internet >> ecosystem. >> >> >> *Looking forward to the community's thoughts and feedback!* >> Best regards, >> >> The LibreQoS Team >> >> >> *In loving memory of Dave Täht: *1965-2025 >> >> https://libreqos.io/2025/04/01/in-loving-memory-of-dave/ >> >> >> https://www.linkedin.com/in/frantisekborsik >> >> Signal, Telegram, WhatsApp: +421919416714 >> >> iMessage, mobile: +420775230885 >> >> Skype: casioa5302ca >> >> frantisek.borsik@gmail.com >> _______________________________________________ >> Starlink mailing list >> Starlink@lists.bufferbloat.net >> https://lists.bufferbloat.net/listinfo/starlink >> >> >> >> -- >> Geoff.Goodfellow@iconia.com >> >> living as The Truth is True >> >> _______________________________________________ >> Bloat mailing list >> Bloat@lists.bufferbloat.net >> https://lists.bufferbloat.net/listinfo/bloat >> >> >> _______________________________________________ >> Cake mailing list >> Cake@lists.bufferbloat.net >> https://lists.bufferbloat.net/listinfo/cake >> > > > -- > Regards, > Dave Seddon > +1 415 857 5102 > -- ROBERT CHACÓN FOUNDER +1-915-730-1472 LibreQoS.com [-- Attachment #2: Type: text/html, Size: 17847 bytes --] ^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [Bloat] [Cake] [Starlink] Announcing the LibreQoS Bufferbloat TestPlatform 2025-06-15 18:05 ` Robert Chacón @ 2025-06-15 20:12 ` dave seddon 0 siblings, 0 replies; 10+ messages in thread From: dave seddon @ 2025-06-15 20:12 UTC (permalink / raw) To: Robert Chacón Cc: Nils Andreas Svee, the keyboard of geoff goodfellow, Frantisek Borsik, Dave Taht, Herbert Wolverson, libreqos, Jeremy Austin, codel, bloat, Cake List, bloat-ietf [-- Attachment #1.1: Type: text/plain, Size: 10270 bytes --] Works now! Thanks [image: image.png] [image: image.png] ... Not sure why my latency is so high though. I'm ~13-16ms from downtown LA. I'm using fq_codel, cos the unifi firewall doesn't do cake [image: image.png] On Sun, Jun 15, 2025 at 11:05 AM Robert Chacón <robert@libreqos.io> wrote: > Nils, > > I've now fixed the issue where the initial latency spike skews baseline > results by switching to using 75th percentile for baseline calculation. > Thanks for catching that. > > Geoff, > > I may have fixed that now. Our Vultr VPS was hitting its bandwidth limit > apparently, and they throttled it. Switched to hosting it locally in El > Paso as fast as I could. Now tests can achieve saturation throughput. > > Dave, > > If you try it again does it still fail to ping currently? > > Thanks, > Robert > > On Sun, Jun 15, 2025 at 11:32 AM dave seddon <dave.seddon.ca@gmail.com> > wrote: > >> Very cool Frank! >> >> When I run it, it says all of my latency is 0.0ms. This >> is firefox-139.0.1 on NixOS unstable. >> >> I guess soem of the CORS headers are screwed up? >> Cross-Origin Request Blocked: The Same Origin Policy disallows reading >> the remote resource at https://test-elp.libreqos.com:8005/ping?cb=242578. >> (Reason: CORS request did not succeed). Status code: (null). >> >> I don't know, I guess you probably _do_ want these objects to be >> cacheable via the CDN? >> >> GET /ping?cb=819806 HTTP/1.1 >> Host: test-elp.libreqos.com:8005 >> User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:139.0) Gecko/20100101 >> Firefox/139.0 >> Accept: */* >> Accept-Language: en-US,en;q=0.5 >> Accept-Encoding: gzip, deflate, br, zstd >> Pragma: no-cache >> Cache-Control: no-store, no-cache, must-revalidate >> X-Priority: high >> X-Ping-Attempt: 0 >> Referer: https://test.libreqos.com/ >> Origin: https://test.libreqos.com >> Connection: keep-alive >> Sec-Fetch-Dest: empty >> Sec-Fetch-Mode: cors >> Sec-Fetch-Site: same-site >> >> HTTP/1.1 200 OK >> date: Sun, 15 Jun 2025 17:13:55 GMT >> server: uvicorn >> cache-control: no-store, no-cache, must-revalidate >> pragma: no-cache >> x-ping-server: dedicated >> x-priority-processed: true >> x-ping-timeouts-seen: 0 >> content-length: 4 >> content-type: text/plain; charset=utf-8 >> access-control-allow-origin: * >> access-control-allow-credentials: true >> >> Your Nginx server also can have caching enabled for the favorite icon, >> and the javascript, which should make it faster to load. >> >> HTTP/2 200 >> server: nginx/1.18.0 (Ubuntu) >> date: Sun, 15 Jun 2025 17:13:35 GMT >> content-type: text/javascript; charset=utf-8 >> vary: Accept-Encoding >> last-modified: Tue, 10 Jun 2025 04:28:53 GMT >> strict-transport-security: max-age=63072000 >> x-content-type-options: nosniff >> x-frame-options: SAMEORIGIN >> content-encoding: gzip >> X-Firefox-Spdy: h2 >> >> I've found that you can set the caching for the CORS "preflight" requests >> too and it definitely helps. e.g. access-control-max-age 345600 >> >> On Sun, Jun 15, 2025 at 9:53 AM Nils Andreas Svee via Cake < >> cake@lists.bufferbloat.net> wrote: >> >>> Just tried it too: https://imgur.com/a/F2cNZd4, also getting A+ >>> overall, and "only" A for bidirectional. >>> >>> I seem to be getting a 200+ ms spike right at the beginning of the >>> baseline test, which skews the results. >>> This happened at least on a couple of tests, but after a few tries it >>> got better. At least with ICMP ping separately I don't see any spikes like >>> that. >>> >>> Best Regards >>> Nils >>> >>> On Sun, Jun 15, 2025, at 23:20, the keyboard of geoff goodfellow via >>> Bloat wrote: >>> >>> re: *thoughts and feedback!* >>> >>> your https://test.libreqos.com tests of [Single User Test] & [Virtual >>> Household Mode] both give yours truly bufferbloat grades of *A+ * >>> >>> whereas the https://www.waveform.com/tools/bufferbloat test gives yours >>> truly a bufferbloat brade grade of *C* >>> >>> >>> https://www.waveform.com/tools/bufferbloat?test-id=b13810f2-e999-4045-8e8b-ab3ab8b957c5 >>> >>> #1.) Why/What's the difference? >>> >>> #2.) Who/Which one to believe¿ >>> >>> g >>> >>> >>> On Sun, Jun 15, 2025 at 4:58 AM Frantisek Borsik via Starlink < >>> starlink@lists.bufferbloat.net> wrote: >>> >>> Hello to all, >>> >>> We're excited to announce the release of the *LibreQoS Bufferbloat Test* >>> – an open-source bufferbloat testing solution designed specifically for >>> ISPs and network operators to deploy for their customers. >>> >>> *Link* >>> https://test.libreqos.com >>> >>> *What Makes This Different* >>> >>> While there are several bufferbloat testing tools available, this >>> platform addresses a critical gap: ISP-deployable infrastructure that >>> provides both traditional testing and realistic household simulation. >>> >>> As Dave Täht highlighted in his influential article "What's Wrong with >>> Speed Tests" <https://blog.cerowrt.org/post/speedtests/>, traditional >>> speed tests fail to measure what users actually experience. We tried to >>> address Dave's points to make a better speed test that focuses on the >>> metric that matters: latency under load in realistic usage scenarios. >>> >>> *Two Complementary Test Modes* >>> >>> *Single User Test Mode* >>> >>> - Traditional sequential load testing (baseline → download → upload >>> → bidirectional) >>> - Measures working latency and jitter during each phase >>> - Familiar A+ to F grading based on latency under load increases >>> - Comparable to existing tools like DSLReports Speed Test and >>> Waveform Bufferbloat Test >>> >>> >>> *Virtual Household Mode (The Innovation)* >>> >>> Process-isolated simulation of 4 concurrent users with authentic traffic >>> patterns: >>> >>> - Alex (Gaming): 1.5 Mbps constant, jitter-sensitive for competitive >>> gaming >>> - Sarah (Video Conference): 2.5 Mbps bidirectional, Teams simulation >>> with working latency monitoring >>> - Jake (Netflix HD): 25 Mbps bursts (1s on, 4s off), realistic >>> streaming patterns >>> - Computer (Background): Up to 200 Mbps continuous download, system >>> updates >>> >>> >>> Real-world relevance: Tests latency under load when multiple family >>> members are online simultaneously >>> >>> Advanced grading: Network fairness, jitter measurement, and per-user >>> working latency analysis >>> >>> *Why (not only) ISPs Need This* >>> >>> *The traditional approach of sending customers to third-party speed test >>> sites has limitations:* >>> >>> - No control over test methodology or server placement >>> - Limited correlation with customer support tickets >>> - Generic results that don't reflect real-world usage patterns >>> - No integration with ISP operational systems >>> >>> *This platform enables (not only) ISPs to:* >>> >>> - Host their own testing infrastructure with full control >>> - Integrate with support systems via telemetry APIs >>> - Provide customers with realistic household testing scenarios >>> - Correlate test results with network performance and customer >>> complaints >>> >>> >>> *Open Source & Community* >>> >>> The entire platform is open source and available here: >>> https://github.com/LibreQoE/bufferbloat_test >>> >>> We've designed this to be: >>> >>> - Easy to deploy for (not only) ISPs of any size >>> - Scientifically meaningful in its measurement methodology >>> - Realistic in its simulation of actual household usage >>> - Integrable with existing ISP operational workflows >>> >>> >>> >>> *Community Feedback Requested* >>> We'd love feedback from the bufferbloat.net community on: >>> >>> - Test methodology: Are we measuring the right metrics? >>> - Grading thresholds: Do our A+ to F grades align with real-world >>> impact? >>> - Virtual household scenarios: What other realistic usage patterns >>> should we simulate? >>> - ISP adoption: What barriers exist for ISP deployment? >>> >>> >>> >>> *Technical Discussion* >>> We'd welcome discussion about: >>> >>> - Measurement accuracy for working latency and jitter in virtual >>> household mode >>> - Traffic pattern authenticity (gaming, video conferencing, >>> streaming) >>> - Grading methodology for latency under load in complex multi-user >>> scenarios >>> - Integration approaches for ISP operational systems >>> >>> >>> The platform represents our attempt to bridge the gap between academic >>> bufferbloat research and practical ISP operations, building on the >>> foundational work of researchers like Dave Täht and the broader bufferbloat >>> community. We believe that widespread ISP deployment of proper bufferbloat >>> testing infrastructure will ultimately benefit the entire internet >>> ecosystem. >>> >>> >>> *Looking forward to the community's thoughts and feedback!* >>> Best regards, >>> >>> The LibreQoS Team >>> >>> >>> *In loving memory of Dave Täht: *1965-2025 >>> >>> https://libreqos.io/2025/04/01/in-loving-memory-of-dave/ >>> >>> >>> https://www.linkedin.com/in/frantisekborsik >>> >>> Signal, Telegram, WhatsApp: +421919416714 >>> >>> iMessage, mobile: +420775230885 >>> >>> Skype: casioa5302ca >>> >>> frantisek.borsik@gmail.com >>> _______________________________________________ >>> Starlink mailing list >>> Starlink@lists.bufferbloat.net >>> https://lists.bufferbloat.net/listinfo/starlink >>> >>> >>> >>> -- >>> Geoff.Goodfellow@iconia.com >>> >>> living as The Truth is True >>> >>> _______________________________________________ >>> Bloat mailing list >>> Bloat@lists.bufferbloat.net >>> https://lists.bufferbloat.net/listinfo/bloat >>> >>> >>> _______________________________________________ >>> Cake mailing list >>> Cake@lists.bufferbloat.net >>> https://lists.bufferbloat.net/listinfo/cake >>> >> >> >> -- >> Regards, >> Dave Seddon >> +1 415 857 5102 >> > > > -- > > ROBERT CHACÓN > > FOUNDER > > +1-915-730-1472 > > LibreQoS.com > > > -- Regards, Dave Seddon +1 415 857 5102 [-- Attachment #1.2: Type: text/html, Size: 19017 bytes --] [-- Attachment #2: image.png --] [-- Type: image/png, Size: 116458 bytes --] [-- Attachment #3: image.png --] [-- Type: image/png, Size: 137116 bytes --] [-- Attachment #4: image.png --] [-- Type: image/png, Size: 177252 bytes --] ^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [Bloat] [Starlink] Announcing the LibreQoS Bufferbloat Test Platform 2025-06-15 16:20 ` [Bloat] [Starlink] " the keyboard of geoff goodfellow 2025-06-15 16:52 ` [Bloat] [Starlink] Announcing the LibreQoS Bufferbloat TestPlatform Nils Andreas Svee @ 2025-06-15 17:27 ` J Pan 1 sibling, 0 replies; 10+ messages in thread From: J Pan @ 2025-06-15 17:27 UTC (permalink / raw) To: the keyboard of geoff goodfellow Cc: Frantisek Borsik, Jeremy Austin via Rpm, Herbert Wolverson, libreqos, Dave Taht via Starlink, codel, bloat, Cake List, bloat-ietf, Robert Chacón depending on where the test server is? better if isp/cdn providers can host such tests too -- J Pan, UVic CSc, ECS566, 250-472-5796 (NO VM), Pan@UVic.CA, Web.UVic.CA/~pan On Sun, Jun 15, 2025 at 9:21 AM the keyboard of geoff goodfellow via Starlink <starlink@lists.bufferbloat.net> wrote: > > re: thoughts and feedback! > > your https://test.libreqos.com tests of [Single User Test] & [Virtual Household Mode] both give yours truly bufferbloat grades of A+ > > whereas the https://www.waveform.com/tools/bufferbloat test gives yours truly a bufferbloat brade grade of C > > https://www.waveform.com/tools/bufferbloat?test-id=b13810f2-e999-4045-8e8b-ab3ab8b957c5 > > #1.) Why/What's the difference? > > #2.) Who/Which one to believe¿ > > g > > > On Sun, Jun 15, 2025 at 4:58 AM Frantisek Borsik via Starlink <starlink@lists.bufferbloat.net> wrote: >> >> Hello to all, >> >> We're excited to announce the release of the LibreQoS Bufferbloat Test – an open-source bufferbloat testing solution designed specifically for ISPs and network operators to deploy for their customers. >> >> Link >> https://test.libreqos.com >> >> What Makes This Different >> >> While there are several bufferbloat testing tools available, this platform addresses a critical gap: ISP-deployable infrastructure that provides both traditional testing and realistic household simulation. >> >> As Dave Täht highlighted in his influential article "What's Wrong with Speed Tests", traditional speed tests fail to measure what users actually experience. We tried to address Dave's points to make a better speed test that focuses on the metric that matters: latency under load in realistic usage scenarios. >> >> Two Complementary Test Modes >> >> Single User Test Mode >> >> Traditional sequential load testing (baseline → download → upload → bidirectional) >> Measures working latency and jitter during each phase >> Familiar A+ to F grading based on latency under load increases >> Comparable to existing tools like DSLReports Speed Test and Waveform Bufferbloat Test >> >> >> Virtual Household Mode (The Innovation) >> >> Process-isolated simulation of 4 concurrent users with authentic traffic patterns: >> >> Alex (Gaming): 1.5 Mbps constant, jitter-sensitive for competitive gaming >> Sarah (Video Conference): 2.5 Mbps bidirectional, Teams simulation with working latency monitoring >> Jake (Netflix HD): 25 Mbps bursts (1s on, 4s off), realistic streaming patterns >> Computer (Background): Up to 200 Mbps continuous download, system updates >> >> >> Real-world relevance: Tests latency under load when multiple family members are online simultaneously >> >> Advanced grading: Network fairness, jitter measurement, and per-user working latency analysis >> >> Why (not only) ISPs Need This >> >> The traditional approach of sending customers to third-party speed test sites has limitations: >> >> No control over test methodology or server placement >> Limited correlation with customer support tickets >> Generic results that don't reflect real-world usage patterns >> No integration with ISP operational systems >> >> This platform enables (not only) ISPs to: >> >> Host their own testing infrastructure with full control >> Integrate with support systems via telemetry APIs >> Provide customers with realistic household testing scenarios >> Correlate test results with network performance and customer complaints >> >> >> Open Source & Community >> >> The entire platform is open source and available here: https://github.com/LibreQoE/bufferbloat_test >> >> We've designed this to be: >> >> Easy to deploy for (not only) ISPs of any size >> Scientifically meaningful in its measurement methodology >> Realistic in its simulation of actual household usage >> Integrable with existing ISP operational workflows >> >> >> Community Feedback Requested >> >> We'd love feedback from the bufferbloat.net community on: >> >> Test methodology: Are we measuring the right metrics? >> Grading thresholds: Do our A+ to F grades align with real-world impact? >> Virtual household scenarios: What other realistic usage patterns should we simulate? >> ISP adoption: What barriers exist for ISP deployment? >> >> >> Technical Discussion >> >> We'd welcome discussion about: >> >> Measurement accuracy for working latency and jitter in virtual household mode >> Traffic pattern authenticity (gaming, video conferencing, streaming) >> Grading methodology for latency under load in complex multi-user scenarios >> Integration approaches for ISP operational systems >> >> >> The platform represents our attempt to bridge the gap between academic bufferbloat research and practical ISP operations, building on the foundational work of researchers like Dave Täht and the broader bufferbloat community. We believe that widespread ISP deployment of proper bufferbloat testing infrastructure will ultimately benefit the entire internet ecosystem. >> >> Looking forward to the community's thoughts and feedback! >> >> Best regards, >> >> The LibreQoS Team >> >> >> In loving memory of Dave Täht: 1965-2025 >> >> https://libreqos.io/2025/04/01/in-loving-memory-of-dave/ >> >> >> https://www.linkedin.com/in/frantisekborsik >> >> Signal, Telegram, WhatsApp: +421919416714 >> >> iMessage, mobile: +420775230885 >> >> Skype: casioa5302ca >> >> frantisek.borsik@gmail.com >> >> _______________________________________________ >> Starlink mailing list >> Starlink@lists.bufferbloat.net >> https://lists.bufferbloat.net/listinfo/starlink > > > > -- > Geoff.Goodfellow@iconia.com > living as The Truth is True > > _______________________________________________ > Starlink mailing list > Starlink@lists.bufferbloat.net > https://lists.bufferbloat.net/listinfo/starlink ^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [Bloat] Announcing the LibreQoS Bufferbloat Test Platform 2025-06-15 12:00 [Bloat] Announcing the LibreQoS Bufferbloat Test Platform Frantisek Borsik 2025-06-15 16:20 ` [Bloat] [Starlink] " the keyboard of geoff goodfellow @ 2025-06-15 19:23 ` Michael Richardson 2025-06-16 19:03 ` [Bloat] [Cake] " David P. Reed 2025-06-17 15:27 ` [Bloat] " jf 3 siblings, 0 replies; 10+ messages in thread From: Michael Richardson @ 2025-06-15 19:23 UTC (permalink / raw) To: Frantisek Borsik Cc: libreqos, bloat, Dave Taht via Starlink, Jeremy Austin via Rpm, bloat-ietf, Cake List, codel, Herbert Wolverson, =?UTF-8?Q?Robert_Chac=C3=B3n?= [-- Attachment #1: Type: text/plain, Size: 914 bytes --] Hi, thanks for this. I've share it with multiple ISP (suppliers), and maybe there is a reason to deploy it within CREDIL's R&D datacenter. > - Grading methodology for latency under load in complex multi-user > scenarios Perhaps, it would be good to have a RIPE BCOP as a result for the criteria? >We believe that widespread ISP deployment of proper bufferbloat >testing infrastructure will ultimately benefit the entire internet >ecosystem. I'm reading the README.md from the git repo. Wow. Amazing job! I'm not seeing a CLI option to run the client test, but I see lots of API end-points, so I'm guessing that there might be one, or it might easy to do this. -- ] Never tell me the odds! | ipv6 mesh networks [ ] Michael Richardson, Sandelman Software Works | IoT architect [ ] mcr@sandelman.ca http://www.sandelman.ca/ | ruby on rails [ [-- Attachment #2: signature.asc --] [-- Type: application/pgp-signature, Size: 511 bytes --] ^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [Bloat] [Cake] Announcing the LibreQoS Bufferbloat Test Platform 2025-06-15 12:00 [Bloat] Announcing the LibreQoS Bufferbloat Test Platform Frantisek Borsik 2025-06-15 16:20 ` [Bloat] [Starlink] " the keyboard of geoff goodfellow 2025-06-15 19:23 ` [Bloat] " Michael Richardson @ 2025-06-16 19:03 ` David P. Reed 2025-06-17 15:27 ` [Bloat] " jf 3 siblings, 0 replies; 10+ messages in thread From: David P. Reed @ 2025-06-16 19:03 UTC (permalink / raw) To: Frantisek Borsik Cc: libreqos, bloat, Dave Taht via Starlink, Jeremy Austin via Rpm, bloat-ietf, Cake List, codel, Herbert Wolverson, Robert Chacón [-- Attachment #1: Type: text/plain, Size: 5460 bytes --] I plan to test this out as "being my own ISP" using one of my personal cloud servers that is in one of Vultur's hosting sites as the server. (and from various mobile devices as I travel around among WiFi sites, if I can). The thing I immediately want to know, though, is: has anybody done a serious security review of the system? I'm a "trust but verify" kind of personality. I don't have the energy or time to do the detailed review. I trust that the folks who built this are not black hats - you're my "friends" after all - we care about similar things. But I'd like to verify that trust. Also, any suggestions people might have with regard to making it work? I'll send feedback as I explore, promise! Great work! David On Sunday, June 15, 2025 08:00, "Frantisek Borsik via Cake" <cake@lists.bufferbloat.net> said: Hello to all, We're excited to announce the release of the LibreQoS Bufferbloat Test – an open-source bufferbloat testing solution designed specifically for ISPs and network operators to deploy for their customers. Link [ https://test.libreqos.com ]( https://test.libreqos.com ) What Makes This Different While there are several bufferbloat testing tools available, this platform addresses a critical gap: ISP-deployable infrastructure that provides both traditional testing and realistic household simulation. As Dave Täht highlighted in his influential article [ "What's Wrong with Speed Tests" ]( https://blog.cerowrt.org/post/speedtests/ ), traditional speed tests fail to measure what users actually experience. We tried to address Dave's points to make a better speed test that focuses on the metric that matters: latency under load in realistic usage scenarios. Two Complementary Test Modes Single User Test Mode Traditional sequential load testing (baseline → download → upload → bidirectional) Measures working latency and jitter during each phase Familiar A+ to F grading based on latency under load increases Comparable to existing tools like DSLReports Speed Test and Waveform Bufferbloat Test Virtual Household Mode (The Innovation) Process-isolated simulation of 4 concurrent users with authentic traffic patterns: Alex (Gaming): 1.5 Mbps constant, jitter-sensitive for competitive gaming Sarah (Video Conference): 2.5 Mbps bidirectional, Teams simulation with working latency monitoring Jake (Netflix HD): 25 Mbps bursts (1s on, 4s off), realistic streaming patterns Computer (Background): Up to 200 Mbps continuous download, system updates Real-world relevance: Tests latency under load when multiple family members are online simultaneously Advanced grading: Network fairness, jitter measurement, and per-user working latency analysis Why (not only) ISPs Need This The traditional approach of sending customers to third-party speed test sites has limitations: No control over test methodology or server placement Limited correlation with customer support tickets Generic results that don't reflect real-world usage patterns No integration with ISP operational systemsThis platform enables (not only) ISPs to: Host their own testing infrastructure with full control Integrate with support systems via telemetry APIs Provide customers with realistic household testing scenarios Correlate test results with network performance and customer complaints Open Source & Community The entire platform is open source and available here: [ https://github.com/LibreQoE/bufferbloat_test ]( https://github.com/LibreQoE/bufferbloat_test ) We've designed this to be: Easy to deploy for (not only) ISPs of any size Scientifically meaningful in its measurement methodology Realistic in its simulation of actual household usage Integrable with existing ISP operational workflows Community Feedback Requested We'd love feedback from the [ bufferbloat.net ]( http://bufferbloat.net ) community on: Test methodology: Are we measuring the right metrics? Grading thresholds: Do our A+ to F grades align with real-world impact? Virtual household scenarios: What other realistic usage patterns should we simulate? ISP adoption: What barriers exist for ISP deployment? Technical Discussion We'd welcome discussion about: Measurement accuracy for working latency and jitter in virtual household mode Traffic pattern authenticity (gaming, video conferencing, streaming) Grading methodology for latency under load in complex multi-user scenarios Integration approaches for ISP operational systems The platform represents our attempt to bridge the gap between academic bufferbloat research and practical ISP operations, building on the foundational work of researchers like Dave Täht and the broader bufferbloat community. We believe that widespread ISP deployment of proper bufferbloat testing infrastructure will ultimately benefit the entire internet ecosystem. Looking forward to the community's thoughts and feedback! Best regards, The LibreQoS Team In loving memory of Dave Täht: 1965-2025 [ https://libreqos.io/2025/04/01/in-loving-memory-of-dave/ ]( https://libreqos.io/2025/04/01/in-loving-memory-of-dave/ ) [ https://www.linkedin.com/in/frantisekborsik ]( https://www.linkedin.com/in/frantisekborsik ) Signal, Telegram, WhatsApp: +421919416714 iMessage, mobile: +420775230885 Skype: casioa5302ca [ frantisek.borsik@gmail.com ]( mailto:frantisek.borsik@gmail.com ) [-- Attachment #2: Type: text/html, Size: 8657 bytes --] ^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [Bloat] Announcing the LibreQoS Bufferbloat Test Platform 2025-06-15 12:00 [Bloat] Announcing the LibreQoS Bufferbloat Test Platform Frantisek Borsik ` (2 preceding siblings ...) 2025-06-16 19:03 ` [Bloat] [Cake] " David P. Reed @ 2025-06-17 15:27 ` jf 3 siblings, 0 replies; 10+ messages in thread From: jf @ 2025-06-17 15:27 UTC (permalink / raw) To: Frantisek Borsik Cc: libreqos, bloat, Dave Taht via Starlink, Jeremy Austin via Rpm, bloat-ietf, Cake List, codel, Herbert Wolverson, Robert Chacón [-- Attachment #1: Type: text/plain, Size: 5212 bytes --] First, a huge thank you for this excellent tool; the field needed this one. Secondly, kudos for giving a nod to our late friend, Dave Taht. My face lit up when I saw the thumbs-up icon on the A+ result! I instantly recognized him. Thank you so much for this; well done.  My household test result  Cheers, Jonathan Foulkes > On Jun 15, 2025, at 8:00 AM, Frantisek Borsik via Bloat <bloat@lists.bufferbloat.net> wrote: > > Hello to all, > > We're excited to announce the release of the LibreQoS Bufferbloat Test – an open-source bufferbloat testing solution designed specifically for ISPs and network operators to deploy for their customers. > > Link > https://test.libreqos.com <https://test.libreqos.com/> > > What Makes This Different > > While there are several bufferbloat testing tools available, this platform addresses a critical gap: ISP-deployable infrastructure that provides both traditional testing and realistic household simulation. > > As Dave Täht highlighted in his influential article "What's Wrong with Speed Tests" <https://blog.cerowrt.org/post/speedtests/>, traditional speed tests fail to measure what users actually experience. We tried to address Dave's points to make a better speed test that focuses on the metric that matters: latency under load in realistic usage scenarios. > > Two Complementary Test Modes > > Single User Test Mode > Traditional sequential load testing (baseline → download → upload → bidirectional) > Measures working latency and jitter during each phase > Familiar A+ to F grading based on latency under load increases > Comparable to existing tools like DSLReports Speed Test and Waveform Bufferbloat Test > > Virtual Household Mode (The Innovation) > > Process-isolated simulation of 4 concurrent users with authentic traffic patterns: > Alex (Gaming): 1.5 Mbps constant, jitter-sensitive for competitive gaming > Sarah (Video Conference): 2.5 Mbps bidirectional, Teams simulation with working latency monitoring > Jake (Netflix HD): 25 Mbps bursts (1s on, 4s off), realistic streaming patterns > Computer (Background): Up to 200 Mbps continuous download, system updates > > Real-world relevance: Tests latency under load when multiple family members are online simultaneously > > Advanced grading: Network fairness, jitter measurement, and per-user working latency analysis > > Why (not only) ISPs Need This > > The traditional approach of sending customers to third-party speed test sites has limitations: > No control over test methodology or server placement > Limited correlation with customer support tickets > Generic results that don't reflect real-world usage patterns > No integration with ISP operational systems > This platform enables (not only) ISPs to: > Host their own testing infrastructure with full control > Integrate with support systems via telemetry APIs > Provide customers with realistic household testing scenarios > Correlate test results with network performance and customer complaints > > Open Source & Community > > The entire platform is open source and available here: https://github.com/LibreQoE/bufferbloat_test > > We've designed this to be: > Easy to deploy for (not only) ISPs of any size > Scientifically meaningful in its measurement methodology > Realistic in its simulation of actual household usage > Integrable with existing ISP operational workflows > > Community Feedback Requested > > We'd love feedback from the bufferbloat.net <http://bufferbloat.net/> community on: > Test methodology: Are we measuring the right metrics? > Grading thresholds: Do our A+ to F grades align with real-world impact? > Virtual household scenarios: What other realistic usage patterns should we simulate? > ISP adoption: What barriers exist for ISP deployment? > > Technical Discussion > > We'd welcome discussion about: > Measurement accuracy for working latency and jitter in virtual household mode > Traffic pattern authenticity (gaming, video conferencing, streaming) > Grading methodology for latency under load in complex multi-user scenarios > Integration approaches for ISP operational systems > > The platform represents our attempt to bridge the gap between academic bufferbloat research and practical ISP operations, building on the foundational work of researchers like Dave Täht and the broader bufferbloat community. We believe that widespread ISP deployment of proper bufferbloat testing infrastructure will ultimately benefit the entire internet ecosystem. > > Looking forward to the community's thoughts and feedback! > > Best regards, > > The LibreQoS Team > > > In loving memory of Dave Täht: 1965-2025 > > https://libreqos.io/2025/04/01/in-loving-memory-of-dave/ > > > > https://www.linkedin.com/in/frantisekborsik > > Signal, Telegram, WhatsApp: +421919416714 > > iMessage, mobile: +420775230885 > > Skype: casioa5302ca > > frantisek.borsik@gmail.com <mailto:frantisek.borsik@gmail.com>_______________________________________________ > Bloat mailing list > Bloat@lists.bufferbloat.net > https://lists.bufferbloat.net/listinfo/bloat [-- Attachment #2.1: Type: text/html, Size: 7400 bytes --] [-- Attachment #2.2: DaveThat_ThumbsUp.png --] [-- Type: image/png, Size: 36966 bytes --] [-- Attachment #2.3: LibreQoS-Virtual-Household-Test-Result-2025-06-15.png --] [-- Type: image/png, Size: 279088 bytes --] ^ permalink raw reply [flat|nested] 10+ messages in thread
end of thread, other threads:[~2025-06-17 15:27 UTC | newest] Thread overview: 10+ messages (download: mbox.gz / follow: Atom feed) -- links below jump to the message on this page -- 2025-06-15 12:00 [Bloat] Announcing the LibreQoS Bufferbloat Test Platform Frantisek Borsik 2025-06-15 16:20 ` [Bloat] [Starlink] " the keyboard of geoff goodfellow 2025-06-15 16:52 ` [Bloat] [Starlink] Announcing the LibreQoS Bufferbloat TestPlatform Nils Andreas Svee 2025-06-15 17:32 ` [Bloat] [Cake] " dave seddon 2025-06-15 18:05 ` Robert Chacón 2025-06-15 20:12 ` dave seddon 2025-06-15 17:27 ` [Bloat] [Starlink] Announcing the LibreQoS Bufferbloat Test Platform J Pan 2025-06-15 19:23 ` [Bloat] " Michael Richardson 2025-06-16 19:03 ` [Bloat] [Cake] " David P. Reed 2025-06-17 15:27 ` [Bloat] " jf
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox