From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail.siobud.com (mail.siobud.com [165.227.221.230]) (using TLSv1.2 with cipher ADH-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by lists.bufferbloat.net (Postfix) with ESMTPS id 6D0393B29E for ; Thu, 4 Mar 2021 14:09:31 -0500 (EST) Date: Thu, 4 Mar 2021 11:09:27 -0800 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=siobud.com; s=mail; t=1614884781; bh=75BV2Da8CPEwPiufWDTFMXBq3kVNvWHBsLagQ7aIKis=; h=From:To:Cc:Subject:References:In-Reply-To; b=W/+5Myip4grPz72IwibkdpDJUt+XvWXRU5zfLvS4ZuQ9bHLZigILQ0JPuxCnto3Di 8BLYHr1YH4o5dQJhwXlsoVxs/n+XybM1wSIboarIuxGabAk6GzZFTp1bD5Q7lI7aSH kJIuAA7MDYWnO1Tf71IkjrEvBA8YQM8MnkpwhKI0= From: Sean DuBois To: Luca Muscariello Cc: Dave Taht , bloat , galene@lists.galene.org Message-ID: References: Mime-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: X-Mailman-Approved-At: Thu, 04 Mar 2021 14:13:31 -0500 Subject: Re: [Bloat] [Galene] Re: testing latency under load on webrtc with galene? X-BeenThere: bloat@lists.bufferbloat.net X-Mailman-Version: 2.1.20 Precedence: list List-Id: General list for discussing Bufferbloat List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 04 Mar 2021 19:09:31 -0000 I would really love to build a general WebRTC tester. Spinning up lots of Chromium instances is super expensive. Even if you do the mock webcam you are doing way more then needed. I created[0] which spins up many PeerConnections to load test a server. I think this would be a great alternative to the testing that exists today. * You can send pre-encoded video or RTP packets directly. * You can receive RTP and not pay the costs of processing * You get direct access to Receiver Reports, Transport Wide Congestion Control and Receiver Estimated Max Bandwidth. * Way easier to deploy. We can build a small static binary. If anyone is interested would love to help them kick off a project. We can make it general enough to test Galene, Janus, Jitsi, Ion etc... If it gets acceptance from the greater WebRTC community it could really grow! [0] https://github.com/pion/rtsp-bench/blob/master/client/main.go On Tue, Mar 02, 2021 at 05:01:42PM +0100, Luca Muscariello wrote: > Dave, > > we have done extensive WebRTC (and several other online meeting > apps) testing lately and this paper > https://ieeexplore.ieee.org/document/9153228 reports a > methodology for WebRTC based on Chromium and Selenium Grid and > as test orchestrator Jitsi Torture. > > I would avoid feeding clients with BBB as video as it is not > representative of a meeting as encoders are optimized for > different kinds of video. There are several video samples > out there. > > We have scaled up clients to hundreds with this methodology. > The paper is short so many details have been omitted but there > are not many other options to do this kind of test at scale. > > Luca > > > > > > > > describes the methodology > > > > On Tue, Mar 2, 2021 at 2:15 AM Dave Taht wrote: > > > Given that we have a worldwide network of flent servers... > > > > Given how easy galene is to hack on... and a 10 minute install... > > > > given some webrtc scripting... a few more stats... some javascript... > > skull sweat... funding... > > > > It seems plausible to be able to construct a suite of tests that could > > indeed track jitter > > delay and loss across the internet over webrtc. Perpetually uploading > > bigbuckbunny or some > > other suitable movie might be an option, but I have a fondness for > > extracting a sub 30 second segment from "Max Headroom", which if > > those here have not seen it, predicted much of the fine mess we're all > > in now. > > > > I guess my question is mostly, is a "headless" test feasible? In the > > context of samknow's lack of webrtc test... lowpowered hw.... > > > > -- > > "For a successful technology, reality must take precedence over public > > relations, for Mother Nature cannot be fooled" - Richard Feynman > > > > dave@taht.net CTO, TekLibre, LLC Tel: 1-831-435-0729 > > _______________________________________________ > > Bloat mailing list > > Bloat@lists.bufferbloat.net > > https://lists.bufferbloat.net/listinfo/bloat > > > _______________________________________________ > Galene mailing list -- galene@lists.galene.org > To unsubscribe send an email to galene-leave@lists.galene.org