Development issues regarding the cerowrt test router project
 help / color / mirror / Atom feed
* [Cerowrt-devel] that latest build I did is looking good
@ 2015-06-25 17:34 Dave Taht
  2015-06-25 20:15 ` Sebastian Moeller
  2015-06-26 13:53 ` Joel Wirāmu Pauling
  0 siblings, 2 replies; 5+ messages in thread
From: Dave Taht @ 2015-06-25 17:34 UTC (permalink / raw)
  To: cerowrt-devel

I have been abusing it on a picostation and nanostation now for 48
hours. The archer c7v2 (as a source specific gateway) for a week. A
couple wndr3800s. No crashes. Can still trigger the dreaded wifi TX
DMA bug, but it seems harder now. DID regularly crash the iwl in one
box. [3]

My mission was to get to something that I could deploy here at a small
scale and just let run for a month while away in the eu, and that was
looking dicy there for a while. (I am glad to have basically started
in april!)

So... we do, finally, have an openwrt build that uses cake, has the
minstrel-blues patches, and andrews minimum variance patches, working
dnssec (we hope!), and a new version of babel with ecn enabled, has
snmp, that does dhcp-pd fairly right, and works with comcast. I also
have things (odhcp6c is way better than isc, dibbler, wide) working
fairly well with another debian based firewall.

If/when new cake or sqm stuff arrives my plan (barring other major
bugs elsewhere) is to just incrementally build that and tc-adv out of
the above frozen repo. [1]

:whew: Have to go climb a couple trees this week. Have 3 source
specific gateways up, might get two more. [2]

* babel bug - channel diversity routing does not autodetect the actual
channel you are on. Setting it manually works, but is a pita to
remember to do... fixing it is a mere matter of grokking the iw
nl80211 code.

* Juliusz does not like having a routing protocol that uses ecn but
does not respond to it (yet!), (I agree partially) but me, what I see
is routing suffering from congestive failures periodically, and I am
most interested in what is going on at precisely the point of
congestion... particularly the rtt timestamps now in babel... so I
left it in. DID prove that even a minimalistic routing protocol in a
fq_codel environment on present day wifi can suffer from significant
congestive loss. (or in this case, get CE marked). Distinguishing
between path connectivity loss - and congestion - seems worthwhile in
a routing protocol.....

Pull up wireshark on:
http://snapon.lab.bufferbloat.net/~d/newrouters/linuxcap.cap
use a ipv6.traffic_class.ce == 1 filter in wireshark.

An observation: routing stuff that does not use IP (like arp, and I
think batman and ISIS) cannot use ecn at all...

- I did not bother testing hnetd. Simply not enough time to test it.
What I plan to do is just backhaul a few fixed ipv6 prefixes to the
core locations that can use them after finishing up:
https://github.com/dtaht/ipv6_selfassign - and try to do more to
figure out hnetd at ietf, or look over dhcp-pd again for internal use.

- did not do package signing

[1] If you have any missing packages you need from that repo, tell me
now. But the goal is to push up tc-adv and cake into the openwrt
mainline repos next.... running on things like the linksys 1200ac...
then get minstrel-blues straightened out... and start on per station
queueing... - and I am still not in a position to do another
cerowrt-like effort. Where do we go with this? I feel like we are
limping along....

Still, if you want to play along, knowing full well we will be stuck
here for months or forever:

 http://snapon.lab.bufferbloat.net/~cero3/lupin/ar71xx/

[2] a pita in my environment is to get the picos and nanos setup right
(unbridged, adhoc, snmp, etc) , so I am doing separate builds for
that.

[3] Some flent data here: snapon.lab.bufferbloat.net/~d/newrouters.tgz

everything with the word "linux" in the title was a the iwl using
linux box. the other tests were driven by OSX. It was
interesting/depressing to see how much more airtime the osx box
grabbed, while the linux box was quite fair to the AP. Do not have any
longer range tests... that awaits tree-climbing.

-- 
Dave Täht
worldwide bufferbloat report:
http://www.dslreports.com/speedtest/results/bufferbloat
And:
What will it take to vastly improve wifi for everyone?
https://plus.google.com/u/0/explore/makewififast

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: [Cerowrt-devel] that latest build I did is looking good
  2015-06-25 17:34 [Cerowrt-devel] that latest build I did is looking good Dave Taht
@ 2015-06-25 20:15 ` Sebastian Moeller
  2015-06-25 22:26   ` Dave Taht
  2015-06-26 13:53 ` Joel Wirāmu Pauling
  1 sibling, 1 reply; 5+ messages in thread
From: Sebastian Moeller @ 2015-06-25 20:15 UTC (permalink / raw)
  To: Dave Täht; +Cc: cerowrt-devel

Hi Dave,

this looks really great, thanks a lot. As I want to take part in the cake party, this looks like the easiest/best way to start.


On Jun 25, 2015, at 19:34 , Dave Taht <dave.taht@gmail.com> wrote:

> I have been abusing it on a picostation and nanostation now for 48
> hours. The archer c7v2 (as a source specific gateway) for a week. A
> couple wndr3800s. No crashes. Can still trigger the dreaded wifi TX
> DMA bug, but it seems harder now. DID regularly crash the iwl in one
> box. [3]
> 
> My mission was to get to something that I could deploy here at a small
> scale and just let run for a month while away in the eu, and that was
> looking dicy there for a while. (I am glad to have basically started
> in april!)
> 
> So... we do, finally, have an openwrt build that uses cake, has the
> minstrel-blues patches, and andrews minimum variance patches, working
> dnssec (we hope!), and a new version of babel with ecn enabled, has
> snmp, that does dhcp-pd fairly right, and works with comcast. I also
> have things (odhcp6c is way better than isc, dibbler, wide) working
> fairly well with another debian based firewall.
> 
> If/when new cake or sqm stuff arrives my plan (barring other major
> bugs elsewhere) is to just incrementally build that and tc-adv out of
> the above frozen repo. [1]

	Question: sqm is from the openwrt repository or from ceropackages-3.10? I ask as the latest changes are only in ceropackages 3.10, since they certainly require testing before being inflicted on the openwrt crowd…

Best Regards
	Sebastian

> 
> -- 
> Dave Täht
> worldwide bufferbloat report:
> http://www.dslreports.com/speedtest/results/bufferbloat
> And:
> What will it take to vastly improve wifi for everyone?
> https://plus.google.com/u/0/explore/makewififast
> _______________________________________________
> Cerowrt-devel mailing list
> Cerowrt-devel@lists.bufferbloat.net
> https://lists.bufferbloat.net/listinfo/cerowrt-devel


^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: [Cerowrt-devel] that latest build I did is looking good
  2015-06-25 20:15 ` Sebastian Moeller
@ 2015-06-25 22:26   ` Dave Taht
  2015-06-26 10:03     ` Sebastian Moeller
  0 siblings, 1 reply; 5+ messages in thread
From: Dave Taht @ 2015-06-25 22:26 UTC (permalink / raw)
  To: Sebastian Moeller; +Cc: cerowrt-devel

On Thu, Jun 25, 2015 at 1:15 PM, Sebastian Moeller <moeller0@gmx.de> wrote:
> Hi Dave,
>
> this looks really great, thanks a lot. As I want to take part in the cake party, this looks like the easiest/best way to start.

Gui support for cake would be nice. TIA. :)

In other news I am loving having an easy to parse set of rc_stats_csv
to play with:

http://pastebin.com/05nZcmVu

Not that I can remember what all the fields mean.

>
> On Jun 25, 2015, at 19:34 , Dave Taht <dave.taht@gmail.com> wrote:
>
>> I have been abusing it on a picostation and nanostation now for 48
>> hours. The archer c7v2 (as a source specific gateway) for a week. A
>> couple wndr3800s. No crashes. Can still trigger the dreaded wifi TX
>> DMA bug, but it seems harder now. DID regularly crash the iwl in one
>> box. [3]
>>
>> My mission was to get to something that I could deploy here at a small
>> scale and just let run for a month while away in the eu, and that was
>> looking dicy there for a while. (I am glad to have basically started
>> in april!)
>>
>> So... we do, finally, have an openwrt build that uses cake, has the
>> minstrel-blues patches, and andrews minimum variance patches, working
>> dnssec (we hope!), and a new version of babel with ecn enabled, has
>> snmp, that does dhcp-pd fairly right, and works with comcast. I also
>> have things (odhcp6c is way better than isc, dibbler, wide) working
>> fairly well with another debian based firewall.
>>
>> If/when new cake or sqm stuff arrives my plan (barring other major
>> bugs elsewhere) is to just incrementally build that and tc-adv out of
>> the above frozen repo. [1]
>
>         Question: sqm is from the openwrt repository or from ceropackages-3.10? I ask as the latest changes are only in ceropackages 3.10, since they certainly require testing before being inflicted on the openwrt crowd…
>
> Best Regards
>         Sebastian
>
>>
>> --
>> Dave Täht
>> worldwide bufferbloat report:
>> http://www.dslreports.com/speedtest/results/bufferbloat
>> And:
>> What will it take to vastly improve wifi for everyone?
>> https://plus.google.com/u/0/explore/makewififast
>> _______________________________________________
>> Cerowrt-devel mailing list
>> Cerowrt-devel@lists.bufferbloat.net
>> https://lists.bufferbloat.net/listinfo/cerowrt-devel
>



-- 
Dave Täht
worldwide bufferbloat report:
http://www.dslreports.com/speedtest/results/bufferbloat
And:
What will it take to vastly improve wifi for everyone?
https://plus.google.com/u/0/explore/makewififast

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: [Cerowrt-devel] that latest build I did is looking good
  2015-06-25 22:26   ` Dave Taht
@ 2015-06-26 10:03     ` Sebastian Moeller
  0 siblings, 0 replies; 5+ messages in thread
From: Sebastian Moeller @ 2015-06-26 10:03 UTC (permalink / raw)
  To: Dave Täht, Toke Høiland-Jørgensen; +Cc: cerowrt-devel

Hi Dave,


On Jun 26, 2015, at 00:26 , Dave Taht <dave.taht@gmail.com> wrote:

> On Thu, Jun 25, 2015 at 1:15 PM, Sebastian Moeller <moeller0@gmx.de> wrote:
>> Hi Dave,
>> 
>> this looks really great, thanks a lot. As I want to take part in the cake party, this looks like the easiest/best way to start.
> 
> Gui support for cake would be nice. TIA. :)

	What is missing?  As far as I know the latest luci-app-sqm in ceropackages-3.10 should work well with cake, just select cake as qdisc and you should be set. 
(I want to move "cake as a shaper" into its own cake.qos script, but still implement the possibility to use cake as leaf qdisc (which might already work out of the box). Currently selecting cake as qdisc will use cake as shaper automatically, which might be a bit surprising). If that does not work let me know, I think I tried on the test machine you gave me access to. The issues were that cake was somehow not accepting the overhead parameter, but it should still work to select cake and have it take over… NOTE these changes are not in the openwrt packages repository yet, as I want some positive testing results before asking Toke to pull them. Currently they seem to not break stuff, so I does not look like they will cause a regression, and hence might be fine to pull just to increase the circle of potential testers/bug-reporters...


Best Regards
	Sebastian




> 
> In other news I am loving having an easy to parse set of rc_stats_csv
> to play with:
> 
> http://pastebin.com/05nZcmVu
> 
> Not that I can remember what all the fields mean.
> 
>> 
>> On Jun 25, 2015, at 19:34 , Dave Taht <dave.taht@gmail.com> wrote:
>> 
>>> I have been abusing it on a picostation and nanostation now for 48
>>> hours. The archer c7v2 (as a source specific gateway) for a week. A
>>> couple wndr3800s. No crashes. Can still trigger the dreaded wifi TX
>>> DMA bug, but it seems harder now. DID regularly crash the iwl in one
>>> box. [3]
>>> 
>>> My mission was to get to something that I could deploy here at a small
>>> scale and just let run for a month while away in the eu, and that was
>>> looking dicy there for a while. (I am glad to have basically started
>>> in april!)
>>> 
>>> So... we do, finally, have an openwrt build that uses cake, has the
>>> minstrel-blues patches, and andrews minimum variance patches, working
>>> dnssec (we hope!), and a new version of babel with ecn enabled, has
>>> snmp, that does dhcp-pd fairly right, and works with comcast. I also
>>> have things (odhcp6c is way better than isc, dibbler, wide) working
>>> fairly well with another debian based firewall.
>>> 
>>> If/when new cake or sqm stuff arrives my plan (barring other major
>>> bugs elsewhere) is to just incrementally build that and tc-adv out of
>>> the above frozen repo. [1]
>> 
>>        Question: sqm is from the openwrt repository or from ceropackages-3.10? I ask as the latest changes are only in ceropackages 3.10, since they certainly require testing before being inflicted on the openwrt crowd…
>> 
>> Best Regards
>>        Sebastian
>> 
>>> 
>>> --
>>> Dave Täht
>>> worldwide bufferbloat report:
>>> http://www.dslreports.com/speedtest/results/bufferbloat
>>> And:
>>> What will it take to vastly improve wifi for everyone?
>>> https://plus.google.com/u/0/explore/makewififast
>>> _______________________________________________
>>> Cerowrt-devel mailing list
>>> Cerowrt-devel@lists.bufferbloat.net
>>> https://lists.bufferbloat.net/listinfo/cerowrt-devel
>> 
> 
> 
> 
> -- 
> Dave Täht
> worldwide bufferbloat report:
> http://www.dslreports.com/speedtest/results/bufferbloat
> And:
> What will it take to vastly improve wifi for everyone?
> https://plus.google.com/u/0/explore/makewififast


^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: [Cerowrt-devel] that latest build I did is looking good
  2015-06-25 17:34 [Cerowrt-devel] that latest build I did is looking good Dave Taht
  2015-06-25 20:15 ` Sebastian Moeller
@ 2015-06-26 13:53 ` Joel Wirāmu Pauling
  1 sibling, 0 replies; 5+ messages in thread
From: Joel Wirāmu Pauling @ 2015-06-26 13:53 UTC (permalink / raw)
  To: Taht, Dave; +Cc: cerowrt-devel

[-- Attachment #1: Type: text/plain, Size: 4815 bytes --]

On Jun 25, 2015 10:35 AM, "Dave Taht" <dave.taht@gmail.com> wrote:
>
> I have been abusing it on a picostation and nanostation now for 48
> hours. The archer c7v2 (as a source specific gateway) for a week. A
> couple wndr3800s. No crashes. Can still trigger the dreaded wifi TX
> DMA bug, but it seems harder now. DID regularly crash the iwl in one
> box. [3]

Did you update with the latest Qualcomm v5 ath10k firmware and associated
mac80211 patches that were committed into upstream openwrt trunk a couple
of days ago?

My last builds from end of May died several days ago after around a month
of uptime. Probably due to the power zone bugs in wifi but I can't check
until I get back to Vancouver tonight (currently in Mountain View)

> My mission was to get to something that I could deploy here at a small
> scale and just let run for a month while away in the eu, and that was
> looking dicy there for a while. (I am glad to have basically started
> in april!)
>
> So... we do, finally, have an openwrt build that uses cake, has the
> minstrel-blues patches, and andrews minimum variance patches, working
> dnssec (we hope!), and a new version of babel with ecn enabled, has
> snmp, that does dhcp-pd fairly right, and works with comcast. I also
> have things (odhcp6c is way better than isc, dibbler, wide) working
> fairly well with another debian based firewall.
>
> If/when new cake or sqm stuff arrives my plan (barring other major
> bugs elsewhere) is to just incrementally build that and tc-adv out of
> the above frozen repo. [1]
>
> :whew: Have to go climb a couple trees this week. Have 3 source
> specific gateways up, might get two more. [2]
>
> * babel bug - channel diversity routing does not autodetect the actual
> channel you are on. Setting it manually works, but is a pita to
> remember to do... fixing it is a mere matter of grokking the iw
> nl80211 code.
>
> * Juliusz does not like having a routing protocol that uses ecn but
> does not respond to it (yet!), (I agree partially) but me, what I see
> is routing suffering from congestive failures periodically, and I am
> most interested in what is going on at precisely the point of
> congestion... particularly the rtt timestamps now in babel... so I
> left it in. DID prove that even a minimalistic routing protocol in a
> fq_codel environment on present day wifi can suffer from significant
> congestive loss. (or in this case, get CE marked). Distinguishing
> between path connectivity loss - and congestion - seems worthwhile in
> a routing protocol.....
>
> Pull up wireshark on:
> http://snapon.lab.bufferbloat.net/~d/newrouters/linuxcap.cap
> use a ipv6.traffic_class.ce == 1 filter in wireshark.
>
> An observation: routing stuff that does not use IP (like arp, and I
> think batman and ISIS) cannot use ecn at all...
>
> - I did not bother testing hnetd. Simply not enough time to test it.
> What I plan to do is just backhaul a few fixed ipv6 prefixes to the
> core locations that can use them after finishing up:
> https://github.com/dtaht/ipv6_selfassign - and try to do more to
> figure out hnetd at ietf, or look over dhcp-pd again for internal use.
>
> - did not do package signing
>
> [1] If you have any missing packages you need from that repo, tell me
> now. But the goal is to push up tc-adv and cake into the openwrt
> mainline repos next.... running on things like the linksys 1200ac...
> then get minstrel-blues straightened out... and start on per station
> queueing... - and I am still not in a position to do another
> cerowrt-like effort. Where do we go with this? I feel like we are
> limping along....
>
> Still, if you want to play along, knowing full well we will be stuck
> here for months or forever:
>
>  http://snapon.lab.bufferbloat.net/~cero3/lupin/ar71xx/
>
> [2] a pita in my environment is to get the picos and nanos setup right
> (unbridged, adhoc, snmp, etc) , so I am doing separate builds for
> that.
>
> [3] Some flent data here: snapon.lab.bufferbloat.net/~d/newrouters.tgz
>
> everything with the word "linux" in the title was a the iwl using
> linux box. the other tests were driven by OSX. It was
> interesting/depressing to see how much more airtime the osx box
> grabbed, while the linux box was quite fair to the AP. Do not have any
> longer range tests... that awaits tree-climbing.
>
> --
> Dave Täht
> worldwide bufferbloat report:
> http://www.dslreports.com/speedtest/results/bufferbloat
> And:
> What will it take to vastly improve wifi for everyone?
> https://plus.google.com/u/0/explore/makewififast
> _______________________________________________
> Cerowrt-devel mailing list
> Cerowrt-devel@lists.bufferbloat.net
> https://lists.bufferbloat.net/listinfo/cerowrt-devel

[-- Attachment #2: Type: text/html, Size: 6127 bytes --]

^ permalink raw reply	[flat|nested] 5+ messages in thread

end of thread, other threads:[~2015-06-26 13:53 UTC | newest]

Thread overview: 5+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2015-06-25 17:34 [Cerowrt-devel] that latest build I did is looking good Dave Taht
2015-06-25 20:15 ` Sebastian Moeller
2015-06-25 22:26   ` Dave Taht
2015-06-26 10:03     ` Sebastian Moeller
2015-06-26 13:53 ` Joel Wirāmu Pauling

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox