Re: [Make-wifi-fast] hacking on the candelatech and qca ath10k firmware

["Toke Høiland-Jørgensen" <toke@toke.dk>]

Dave Taht <dave.taht@gmail.com> writes:

> On Thu, May 5, 2016 at 10:05 AM, Aaron Wood <woody77@gmail.com> wrote:
>> I think you might be mis-reading the box-plots as error-bars (since their
>> quartile plots).  I'll need to crunch the numbers, but I'm pretty sure that
>> the fq results are going to show a higher median throughput (and lower
>> median latency), with a fair bit of significance.  I'll see if I can figure
>> out how to calculate the SD of the mean (and other quartiles) from the flent
>> output (I have scripts that can do this for iperf3's json output).
>
> Thanks in advance!!!
>
> I hate box plots honestly. They often lie. I'd rather look at a
> detailed time series first, and the box plot *only* after I verified
> that that was sane. And I'm not good at reading box plots right!

Also note that a box plot of a single test will show you "error bars"
which are really computed from the samples of the single flow; so they
are not independent samples, and so care should be taken when
interpreting them.

-Toke