From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-lb0-f171.google.com (mail-lb0-f171.google.com [209.85.217.171]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (Client did not present a certificate) by huchra.bufferbloat.net (Postfix) with ESMTPS id DDBAB200B33 for ; Fri, 7 Sep 2012 01:55:07 -0700 (PDT) Received: by lbol12 with SMTP id l12so3839148lbo.16 for ; Fri, 07 Sep 2012 01:55:05 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:from:date :x-google-sender-auth:message-id:subject:to:cc:content-type; bh=vVMsBgMyyIrCn9FTNcmP3xNlcVJDVRI7hAwU7orLCGU=; b=PCT6cCKh0q1ECHPIsPWVFTHR0kWzXOieMyWpcQ+pBsl0z05jjAjzJt01c8tu5SKWCB bk8V4yzy4u0STOTsVl/3cJV2b67h2681POlRN4MnM9cVOx4trqxfquo1g99C3TVLCiBa ZiWtJXdnfU0uWpQSRsi8OpHmbMOw2TFRFGZVs35ZvlS5uc6p4aVCxu1uqVVCdASjAWH0 4Sq+HqmgAEl92NyRGdmBLTZC5wOAgZdSoF7ThnwpcsAOSnUh5cz41HD5ONM/2Bk0wCxr JlLbdCZ0Cg6v7oHfQCXrFvMO4AAASIsAO+MBg6AGr19bUtmb+RvbSXFCXrGV2cpjuBXX yqsQ== Received: by 10.112.41.161 with SMTP id g1mr1872189lbl.59.1347008105137; Fri, 07 Sep 2012 01:55:05 -0700 (PDT) MIME-Version: 1.0 Sender: andyswebmail@gmail.com Received: by 10.112.44.103 with HTTP; Fri, 7 Sep 2012 01:54:43 -0700 (PDT) In-Reply-To: References: From: Andy S Date: Fri, 7 Sep 2012 09:54:43 +0100 X-Google-Sender-Auth: NLJYuqSE-GKRDRIjhvnmsxjJrqs Message-ID: To: Dave Taht Content-Type: multipart/alternative; boundary=485b390f7bba9dc71204c918c3d9 Cc: cerowrt-devel@lists.bufferbloat.net Subject: Re: [Cerowrt-devel] Ubnt builds X-BeenThere: cerowrt-devel@lists.bufferbloat.net X-Mailman-Version: 2.1.13 Precedence: list List-Id: Development issues regarding the cerowrt test router project List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 Sep 2012 08:55:08 -0000 --485b390f7bba9dc71204c918c3d9 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable On 6 September 2012 17:20, Dave Taht wrote: > The ubnt builds are a bit out of date (part of my test deployment of > fq_codel at a campground here - the yurtlab! > http://snapon.lab.bufferbloat.net/~d/lupin/yurtlab.jpg which is > blessedly free > of competing wifi signals) > > They are also a little specialized. Among other things, they have my > ssh public key in them, > and are keyed to local dns, they rely on the babel protocol to route > and mesh together, although they do come up presently on a fixed ip > address that needs to be changed, instead of relying on AHCP for their > IPs and dns. > > All of quagga (including OSPF) IS built, it's just that babel is the > default. > > In working with this build and test deployment I exposed some problems > with memory usage in codel and the ath9k driver. Quagga will get > OOM-killed under heavy loads, such as RTP and UDP flooding across > multiple diffserv values, on the 2HP boxes in AP mode. The p2p > backbone (nanostation M5s) has never crashed on me. > > This points long term towards developing a "mfq_codel", which would > have one qdisc and *one* set of buffers that controls all four > hardware queues. However, try as I might, I haven't wrapped my head > around how to merge the code for sch_mq and sch_fq_codel, in a way > that would work. (?) > > Aside from that it's working rather well, and the hacks I have in > place now to reduce skb size seem to help a lot. > > Now that the memory problems are mostly beaten I will be doing a > respin and re-deployment towards the end of the month. If I can build > something a little more generic and easy to deploy on ubnt for others, > I will do so, getting to where all this code runs well in 32MB is > rather important to me. > > Let me know. > > On Thu, Sep 6, 2012 at 4:17 AM, Andy S wrote: > > I see that there are UBNT builds available for specific deployment > > scenarios; we use Ubiquiti Bullet M5's on some parts of our (city-wide) > > 5.8Ghz wireless network, but they don't support OSPF, so if any of the > > builds of Cerowrt support Bullet M5 and OSPF (I see the Quagga-ospf > modules > > available in the main devel builds) - we would be interested to > hear/test! > > > > Cheers, > > > > A > > -- > > http://www.bristolwireless.net/ | 0117 325 0067 | > > sip:info@bristolwireless.net > > Bristol Wireless > > Windmill Hill City Farm > > Philip Street > > Bedminster > > Bristol BS3 4EA > > > > > > _______________________________________________ > > Cerowrt-devel mailing list > > Cerowrt-devel@lists.bufferbloat.net > > https://lists.bufferbloat.net/listinfo/cerowrt-devel > > > > > > -- > Dave T=E4ht > http://www.bufferbloat.net/projects/cerowrt/wiki - "3.3.8-17 is out > with fq_codel!" > Sounds great, still none the wiser as to whether your builds will work on the Bullet or not, as the Bullet and NanoStation run different software by default. Most of what you guys do is waaay over my head, but I'm keen to try stuff out, although this may necessitate a sacrificial Bullet! Keep us posted! A --=20 *http://www.bristolwireless.net/* * | **0= 117 325 0067 | **sip:info@bristolwireless.net* *Bristol Wireless** Windmill Hill City Farm Philip Street Bedminster Bristol BS3 4EA* --485b390f7bba9dc71204c918c3d9 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
On 6 September 2012 17:20, Dave Taht <dav= e.taht@gmail.com> wrote:
The ubnt builds are a bit out of date (part of my test deployment of
fq_codel at a campground here - the yurtlab!
http://snapon.lab.bufferbloat.net/~d/lupin/yurtlab.jpg whic= h is
blessedly free
of competing wifi signals)

They are also a little specialized. Among other things, they have my
ssh public key in them,
and are keyed to local dns, they rely on the babel protocol to route
and mesh together, although they do come up presently on a fixed ip
address that needs to be changed, instead of relying on AHCP for their
IPs and dns.

All of quagga (including OSPF) IS built, it's just that babel is the de= fault.

In working with this build and test deployment I exposed some problems
with memory usage in codel and the ath9k driver. Quagga will get
OOM-killed under heavy loads, such as RTP and UDP flooding across
multiple diffserv values, on the 2HP boxes in AP mode. The p2p
backbone (nanostation M5s) has never crashed on me.

This points long term towards developing a "mfq_codel", which wou= ld
have one qdisc and *one* set of buffers that controls all four
hardware queues. However, try as I might, I haven't wrapped my head
around how to merge the code for sch_mq and sch_fq_codel, in a way
that would work. (?)

Aside from that it's working rather well, and the hacks I have in
place now to reduce skb size seem to help a lot.

Now that the memory problems are mostly beaten I will be doing a
respin and re-deployment towards the end of the month. If I can build
something a little more generic and easy to deploy on ubnt for others,
I will do so, getting to where all this code runs well in 32MB is
rather important to me.

Let me know.

On Thu, Sep 6, 2012 at 4:17 AM, Andy S <andys@bristolwireless.net> wrote:
> I see that there are UBNT builds available for specific deployment
> scenarios; we use Ubiquiti Bullet M5's on some parts of our (city-= wide)
> 5.8Ghz wireless network, but they don't support OSPF, so if any of= the
> builds of Cerowrt support Bullet M5 and OSPF (I see the Quagga-ospf = =A0modules
> available in the main devel builds) - we would be interested to hear/t= est!
>
> Cheers,
>
> A
> --
> http://w= ww.bristolwireless.net/ =A0| 0117 325 0067 |
> sip:info@bristolwire= less.net
> Bristol Wireless
> Windmill Hill City Farm
> Philip Street
> Bedminster
> Bristol BS3 4EA
>
>
> _______________________________________________
> Cerowrt-devel mailing list
> Cerowrt-devel@l= ists.bufferbloat.net
> https://lists.bufferbloat.net/listinfo/cerowrt-devel
>



--
Dave T=E4ht
http://www.bufferbloat.net/projects/cerowrt/wiki - "3.3.8-17 i= s out
with fq_codel!"

Sounds great, still none the wiser as to whether your b= uilds will work on the Bullet or not, as the Bullet and NanoStation run dif= ferent software by default.

Most of what you guys do is waaay over my head, but I'm keen to try=20 stuff out, although this may necessitate a sacrificial Bullet!

Keep us posted!

A


--
http://www.bristolwireless.net/=A0=A0|=A00117 325 0067 | =A0sip:info@bristolwireless.net
Bristol Wireless
Windmill Hill City Farm
Philip Street
Bedminster
Bristol=A0BS3 4EA

--485b390f7bba9dc71204c918c3d9--