<html><head><meta http-equiv="Content-Type" content="text/html charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><br class=""><div><blockquote type="cite" class=""><div class="">On Feb 10, 2017, at 12:35 PM, Sebastian Moeller <<a href="mailto:moeller0@gmx.de" class="">moeller0@gmx.de</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">Hi Pete,</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><blockquote type="cite" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">On Feb 10, 2017, at 12:08, Pete Heist <<a href="mailto:peteheist@gmail.com" class="">peteheist@gmail.com</a>> wrote:<br class=""><br class="">Not a problem. I’ll run a spread of Cake and fq_codel over Ethernet at various bandwidths. It will be through their Apple USB Ethernet adapters (used now for management), which are also connected through a switch, but I think that setup should be fine for this purpose. Should be done in a hour or so and we’ll see…<br class=""></blockquote><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><span class="Apple-tab-span" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: pre; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;"> </span><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">I believe the Apple USB dongles are fastEthernet only, at least the USB2 types I have available here, which for your tested bandwidth would work, but it will not allow you test at what shaper rate things go pear shaped… Also it wifi creates a bit more CPU load than wired ethernet, it _might_ make sense to concurrently excercise the WIFI cards just to re-create the SIRQ load (but probably not as the first experiment ;) ).</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">Best Regards</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><span class="Apple-tab-span" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: pre; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;"> </span><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">Sebastian<span class="Apple-converted-space"> </span></span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""></div></blockquote></div><br class=""><div class="">Hi Sebastian, yes, they’re only 100 Mbit, but that’s enough to cover the rates where I was seeing the problem with Wi-Fi. Also in my test setup there are four nodes connected as described under Configuration #1:</div><div class=""><br class=""></div><div class=""><a href="http://www.drhleny.cz/bufferbloat/wifi_bufferbloat.html" class="">http://www.drhleny.cz/bufferbloat/wifi_bufferbloat.html</a></div><div class=""><br class=""></div><div class="">I’m running Cake on ‘mini’ and ‘mbp’, and the Wi-Fi radios are only on ‘om1’ and ‘om2’, so the CPU load shouldn’t be different for mini and mbp when connected directly via Ethernet, instead of via Ethernet and a Wi-Fi link, I suppose.</div><div class=""><br class=""></div><div class="">I think we just wanted to see if the throughput shifting would reproduce over Ethernet at the same rates, but so far it didn’t for me, although there are other anomalies that don’t look like the throughput shifts I sent before (there’s a throughput anomaly for Cake 20Mbit and latency anomalies for fq_codel 60Mbit and 90Mbit):</div><div class=""><br class=""></div><div class=""><a href="http://www.drhleny.cz/bufferbloat/cake_hd-eth_10mbit/index.html" class="">http://www.drhleny.cz/bufferbloat/cake_hd-eth_10mbit/index.html</a></div><div class=""><br class=""></div><div class=""><a href="http://www.drhleny.cz/bufferbloat/cake_hd-eth_20mbit/index.html" class="">http://www.drhleny.cz/bufferbloat/cake_hd-eth_20mbit/index.html</a></div><div class=""><br class=""></div><div class=""><a href="http://www.drhleny.cz/bufferbloat/cake_hd-eth_30mbit/index.html" class="">http://www.drhleny.cz/bufferbloat/cake_hd-eth_30mbit/index.html</a></div><div class=""><br class=""></div><div class=""><a href="http://www.drhleny.cz/bufferbloat/cake_hd-eth_40mbit/index.html" class="">http://www.drhleny.cz/bufferbloat/cake_hd-eth_40mbit/index.html</a></div><div class=""><br class=""></div><div class=""><a href="http://www.drhleny.cz/bufferbloat/cake_hd-eth_50mbit/index.html" class="">http://www.drhleny.cz/bufferbloat/cake_hd-eth_50mbit/index.html</a></div><div class=""><br class=""></div><div class=""><a href="http://www.drhleny.cz/bufferbloat/cake_hd-eth_60mbit/index.html" class="">http://www.drhleny.cz/bufferbloat/cake_hd-eth_60mbit/index.html</a></div><div class=""><br class=""></div><div class=""><a href="http://www.drhleny.cz/bufferbloat/cake_hd-eth_70mbit/index.html" class="">http://www.drhleny.cz/bufferbloat/cake_hd-eth_70mbit/index.html</a></div><div class=""><br class=""></div><div class=""><a href="http://www.drhleny.cz/bufferbloat/cake_hd-eth_75mbit/index.html" class="">http://www.drhleny.cz/bufferbloat/cake_hd-eth_75mbit/index.html</a></div><div class=""><br class=""></div><div class=""><a href="http://www.drhleny.cz/bufferbloat/cake_hd-eth_80mbit/index.html" class="">http://www.drhleny.cz/bufferbloat/cake_hd-eth_80mbit/index.html</a></div><div class=""><br class=""></div><div class=""><a href="http://www.drhleny.cz/bufferbloat/cake_hd-eth_85mbit/index.html" class="">http://www.drhleny.cz/bufferbloat/cake_hd-eth_85mbit/index.html</a></div><div class=""><br class=""></div><div class=""><a href="http://www.drhleny.cz/bufferbloat/cake_hd-eth_90mbit/index.html" class="">http://www.drhleny.cz/bufferbloat/cake_hd-eth_90mbit/index.html</a></div><div class=""><br class=""></div><div class=""><a href="http://www.drhleny.cz/bufferbloat/cake_hd-eth_100mbit/index.html" class="">http://www.drhleny.cz/bufferbloat/cake_hd-eth_100mbit/index.html</a></div><div class=""><br class=""></div><div class="">fq_codel:</div><div class=""><br class=""></div><div class=""><a href="http://www.drhleny.cz/bufferbloat/fq_codel_hd-eth_10mbit/index.html" class="">http://www.drhleny.cz/bufferbloat/fq_codel_hd-eth_10mbit/index.html</a></div><div class=""><br class=""></div><div class=""><a href="http://www.drhleny.cz/bufferbloat/fq_codel_hd-eth_20mbit/index.html" class="">http://www.drhleny.cz/bufferbloat/fq_codel_hd-eth_20mbit/index.html</a><br class=""></div><div class=""><br class=""></div><div class=""><a href="http://www.drhleny.cz/bufferbloat/fq_codel_hd-eth_30mbit/index.html" class="">http://www.drhleny.cz/bufferbloat/fq_codel_hd-eth_30mbit/index.html</a></div><div class=""><br class=""></div><div class=""><a href="http://www.drhleny.cz/bufferbloat/fq_codel_hd-eth_40mbit/index.html" class="">http://www.drhleny.cz/bufferbloat/fq_codel_hd-eth_40mbit/index.html</a></div><div class=""><br class=""></div><div class=""><a href="http://www.drhleny.cz/bufferbloat/fq_codel_hd-eth_50mbit/index.html" class="">http://www.drhleny.cz/bufferbloat/fq_codel_hd-eth_50mbit/index.html</a></div><div class=""><br class=""></div><div class=""><a href="http://www.drhleny.cz/bufferbloat/fq_codel_hd-eth_60mbit/index.html" class="">http://www.drhleny.cz/bufferbloat/fq_codel_hd-eth_60mbit/index.html</a></div><div class=""><br class=""></div><div class=""><a href="http://www.drhleny.cz/bufferbloat/fq_codel_hd-eth_70mbit/index.html" class="">http://www.drhleny.cz/bufferbloat/fq_codel_hd-eth_70mbit/index.html</a></div><div class=""><br class=""></div><div class=""><a href="http://www.drhleny.cz/bufferbloat/fq_codel_hd-eth_75mbit/index.html" class="">http://www.drhleny.cz/bufferbloat/fq_codel_hd-eth_75mbit/index.html</a></div><div class=""><br class=""></div><div class=""><a href="http://www.drhleny.cz/bufferbloat/fq_codel_hd-eth_80mbit/index.html" class="">http://www.drhleny.cz/bufferbloat/fq_codel_hd-eth_80mbit/index.html</a></div><div class=""><br class=""></div><div class=""><a href="http://www.drhleny.cz/bufferbloat/fq_codel_hd-eth_85mbit/index.html" class="">http://www.drhleny.cz/bufferbloat/fq_codel_hd-eth_85mbit/index.html</a></div><div class=""><br class=""></div><div class=""><a href="http://www.drhleny.cz/bufferbloat/fq_codel_hd-eth_90mbit/index.html" class="">http://www.drhleny.cz/bufferbloat/fq_codel_hd-eth_90mbit/index.html</a></div><div class=""><br class=""></div><div class=""><a href="http://www.drhleny.cz/bufferbloat/fq_codel_hd-eth_100mbit/index.html" class="">http://www.drhleny.cz/bufferbloat/fq_codel_hd-eth_100mbit/index.html</a></div><div class=""><br class=""></div><div class="">So that suggests that the throughput shifting problem may also be somehow related to Wi-Fi. I’m still going to be testing Chaos Calmer, as well as two Ubiquiti NanoStation M5’s, though this will take some more time. We might learn some more from this, or if you can reproduce it with ath9k hardware that would be good too...</div><div class=""><br class=""></div><div class="">Thanks,</div><div class="">Pete</div><div class=""><br class=""></div></body></html>