[Codel] CoDel + 3.3 kernel

[Codel] CoDel + 3.3 kernel

[Amogh Vasekar]

[-- Attachment #1: Type: text/plain, Size: 1423 bytes --]

Hello Developers,

This is Amogh here, a Masters student at Stanford University. As a first
step towards exploring CoDel, we're trying to reproduce the results on EC2
using OpenFlow + Mininet and then take it from there.

So far, I have CoDel with kernel 3.3 (Thanks for the deb packages! More on
kernel 3.4 later), with the codel specific iproute2 patch installed.

With htb qdisc at root, and CoDel children I have an output as follows :

---------
tc -s qdisc show dev eth0

qdisc htb 1: root refcnt 2 r2q 10 default 12 direct_packets_stat 770
 Sent 112338 bytes 961 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc codel 110: parent 1:11 [Unknown qdisc, optlen=32]
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc codel 120: parent 1:12 [Unknown qdisc, optlen=32]
 Sent 6364 bytes 56 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
qdisc codel 130: parent 1:13 [Unknown qdisc, optlen=32]
 Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
 backlog 0b 0p requeues 0
-------------------

I was wondering why I get an Unknown qdisc, optlen=32 error, even after
using the codel-specific iproute2 from Git. I noticed that the Git package
has fq_codel specific code (I am using base Codel in kernel 3.3), is it not
configured to handle this?

Thanks for your help, excited about CoDel !! Let us know if you have any
suggestions.

Amogh

[-- Attachment #2: Type: text/html, Size: 1549 bytes --]

Re: [Codel] CoDel + 3.3 kernel

[Dave Taht]

you didn't install the tc utility properly.

what I usually do is

TC=/path/to/my/codel/repo/tc/tc
export TC
$TC -s qdisc show dev whatever

you will see on these lists pointers to a netperf script, called bloat.sh
which could use some improvement. Also, netperf from svn has multiple
new features useful in exploring this stuff, notably remote control
of different congestion control algorithms, tos/diffserv bit setting, etc.

I note that it helps to turn BQL down to minimal values.

I note also that fq_codel is pretty amazing, too. So is qfq + codel.

Happy explorations.

See also the debloat, and simple_qos.sh scripts in my deBloat github repository.

We look forward to hearing about your results.

On Wed, May 23, 2012 at 11:02 PM, Amogh Vasekar <amoghvk@stanford.edu> wrote:
> Hello Developers,
>
> This is Amogh here, a Masters student at Stanford University. As a first
> step towards exploring CoDel, we're trying to reproduce the results on EC2
> using OpenFlow + Mininet and then take it from there.
>
> So far, I have CoDel with kernel 3.3 (Thanks for the deb packages! More on
> kernel 3.4 later), with the codel specific iproute2 patch installed.
>
> With htb qdisc at root, and CoDel children I have an output as follows :
>
> ---------
> tc -s qdisc show dev eth0
>
> qdisc htb 1: root refcnt 2 r2q 10 default 12 direct_packets_stat 770
>  Sent 112338 bytes 961 pkt (dropped 0, overlimits 0 requeues 0)
>  backlog 0b 0p requeues 0
> qdisc codel 110: parent 1:11 [Unknown qdisc, optlen=32]
>  Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
>  backlog 0b 0p requeues 0
> qdisc codel 120: parent 1:12 [Unknown qdisc, optlen=32]
>  Sent 6364 bytes 56 pkt (dropped 0, overlimits 0 requeues 0)
>  backlog 0b 0p requeues 0
> qdisc codel 130: parent 1:13 [Unknown qdisc, optlen=32]
>  Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
>  backlog 0b 0p requeues 0
> -------------------
>
> I was wondering why I get an Unknown qdisc, optlen=32 error, even after
> using the codel-specific iproute2 from Git. I noticed that the Git package
> has fq_codel specific code (I am using base Codel in kernel 3.3), is it not
> configured to handle this?
>
> Thanks for your help, excited about CoDel !! Let us know if you have any
> suggestions.
>
> Amogh
>
> _______________________________________________
> Codel mailing list
> Codel@lists.bufferbloat.net
> https://lists.bufferbloat.net/listinfo/codel
>



-- 
Dave Täht
SKYPE: davetaht
US Tel: 1-239-829-5608
http://www.bufferbloat.net

Re: [Codel] CoDel + 3.3 kernel

[Rishita Rajal Anubhai]

Hi CoDel enthusiasts,

Along with Amogh, I am working with kernel 3.4 for CoDel.
While trying to use the deb package for linux kernel 3.4,
I got an error requesting me to use the libc6 version >=2.14.
I manually installed libc6 2.15* and the got the kernel
running after that.

The problem now is, while trying to 'make' from the codel
repo (to run tc), all the other packages I need such as flex, 
bison, etc. all seem to require the older version (libc6 2.13*) 
to be installed. Is the expected next step, to install all the
required packages manually in some way?

Thanks,
Rishita



----- Original Message -----
From: "Dave Taht" <dave.taht@gmail.com>
To: amoghvk@stanford.edu
Cc: codel@lists.bufferbloat.net, cs244-spr1112-staff@lists.stanford.edu, "Rishita Anubhai" <rishita@stanford.edu>
Sent: Wednesday, May 23, 2012 3:36:49 PM
Subject: Re: [Codel] CoDel + 3.3 kernel

you didn't install the tc utility properly.

what I usually do is

TC=/path/to/my/codel/repo/tc/tc
export TC
$TC -s qdisc show dev whatever

you will see on these lists pointers to a netperf script, called bloat.sh
which could use some improvement. Also, netperf from svn has multiple
new features useful in exploring this stuff, notably remote control
of different congestion control algorithms, tos/diffserv bit setting, etc.

I note that it helps to turn BQL down to minimal values.

I note also that fq_codel is pretty amazing, too. So is qfq + codel.

Happy explorations.

See also the debloat, and simple_qos.sh scripts in my deBloat github repository.

We look forward to hearing about your results.

On Wed, May 23, 2012 at 11:02 PM, Amogh Vasekar <amoghvk@stanford.edu> wrote:
> Hello Developers,
>
> This is Amogh here, a Masters student at Stanford University. As a first
> step towards exploring CoDel, we're trying to reproduce the results on EC2
> using OpenFlow + Mininet and then take it from there.
>
> So far, I have CoDel with kernel 3.3 (Thanks for the deb packages! More on
> kernel 3.4 later), with the codel specific iproute2 patch installed.
>
> With htb qdisc at root, and CoDel children I have an output as follows :
>
> ---------
> tc -s qdisc show dev eth0
>
> qdisc htb 1: root refcnt 2 r2q 10 default 12 direct_packets_stat 770
>  Sent 112338 bytes 961 pkt (dropped 0, overlimits 0 requeues 0)
>  backlog 0b 0p requeues 0
> qdisc codel 110: parent 1:11 [Unknown qdisc, optlen=32]
>  Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
>  backlog 0b 0p requeues 0
> qdisc codel 120: parent 1:12 [Unknown qdisc, optlen=32]
>  Sent 6364 bytes 56 pkt (dropped 0, overlimits 0 requeues 0)
>  backlog 0b 0p requeues 0
> qdisc codel 130: parent 1:13 [Unknown qdisc, optlen=32]
>  Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
>  backlog 0b 0p requeues 0
> -------------------
>
> I was wondering why I get an Unknown qdisc, optlen=32 error, even after
> using the codel-specific iproute2 from Git. I noticed that the Git package
> has fq_codel specific code (I am using base Codel in kernel 3.3), is it not
> configured to handle this?
>
> Thanks for your help, excited about CoDel !! Let us know if you have any
> suggestions.
>
> Amogh
>
> _______________________________________________
> Codel mailing list
> Codel@lists.bufferbloat.net
> https://lists.bufferbloat.net/listinfo/codel
>



-- 
Dave Täht
SKYPE: davetaht
US Tel: 1-239-829-5608
http://www.bufferbloat.net

Re: [Codel] CoDel + 3.3 kernel

[Jonathan Morton]

On 24 May, 2012, at 3:00 am, Rishita Rajal Anubhai wrote:

> The problem now is, while trying to 'make' from the codel
> repo (to run tc), all the other packages I need such as flex, 
> bison, etc. all seem to require the older version (libc6 2.13*) 
> to be installed. Is the expected next step, to install all the
> required packages manually in some way?

That sounds like a pretty broken distro to me.  Glibc spends a huge amount of effort on ABI backwards compatibility, so having a newer version of it should not break binaries built for an older version.

 - Jonathan Morton

Re: [Codel] CoDel + 3.3 kernel

[Dave Taht]

On Thu, May 24, 2012 at 1:00 AM, Rishita Rajal Anubhai
<rishita@stanford.edu> wrote:
> Hi CoDel enthusiasts,
>
> Along with Amogh, I am working with kernel 3.4 for CoDel.
> While trying to use the deb package for linux kernel 3.4,
> I got an error requesting me to use the libc6 version >=2.14.
> I manually installed libc6 2.15* and the got the kernel
> running after that.

There's a 3.4 package? Oh, that's net-next. It's actually mostly
what was going into 3.5, not 3.4.

Secondly, that deb was built for ubuntu 12.4, not debian.

we need to clearly spin up and out pre-packaged versions
for the top X major Oses somehow.

I also note that those prebuilt packages have a slightly out of
date fq_codel in them, eric added a fix that should handle
torrent better...

Presently the only versions of codel that are truly current and built
in binary form from the
latest codel sources are the 37 architectures and 150 platforms
supported by openwrt (as well as cerowrt). This includes x86 and kvm.

It is probably best for you to build kernel debs from sources
at this point, as we are lacking infrastructure to get the builds done
for the other OSes, as I write. I believe ubuntu and fedora
folk are working on getting standard fq_codel enabled builds out
through their own systems (launchpad, etc)
but I am behind on my mail..

>
> The problem now is, while trying to 'make' from the codel
> repo (to run tc), all the other packages I need such as flex,
> bison, etc. all seem to require the older version (libc6 2.13*)
> to be installed. Is the expected next step, to install all the
> required packages manually in some way?

I usually do an apt-get install build-essential first.

./configure in the iproute repo

Also the main iproute2 git repo is rumored to have all the
codel stuff in it now, so mine is obsolete.

I took a couple days off and the world obsoleted everything!!

and I'm still trying to take a vacation...

Happy codeling!
>
> Thanks,
> Rishita
>
>
>
> ----- Original Message -----
> From: "Dave Taht" <dave.taht@gmail.com>
> To: amoghvk@stanford.edu
> Cc: codel@lists.bufferbloat.net, cs244-spr1112-staff@lists.stanford.edu, "Rishita Anubhai" <rishita@stanford.edu>
> Sent: Wednesday, May 23, 2012 3:36:49 PM
> Subject: Re: [Codel] CoDel + 3.3 kernel
>
> you didn't install the tc utility properly.
>
> what I usually do is
>
> TC=/path/to/my/codel/repo/tc/tc
> export TC
> $TC -s qdisc show dev whatever
>
> you will see on these lists pointers to a netperf script, called bloat.sh
> which could use some improvement. Also, netperf from svn has multiple
> new features useful in exploring this stuff, notably remote control
> of different congestion control algorithms, tos/diffserv bit setting, etc.
>
> I note that it helps to turn BQL down to minimal values.
>
> I note also that fq_codel is pretty amazing, too. So is qfq + codel.
>
> Happy explorations.
>
> See also the debloat, and simple_qos.sh scripts in my deBloat github repository.
>
> We look forward to hearing about your results.
>
> On Wed, May 23, 2012 at 11:02 PM, Amogh Vasekar <amoghvk@stanford.edu> wrote:
>> Hello Developers,
>>
>> This is Amogh here, a Masters student at Stanford University. As a first
>> step towards exploring CoDel, we're trying to reproduce the results on EC2
>> using OpenFlow + Mininet and then take it from there.
>>
>> So far, I have CoDel with kernel 3.3 (Thanks for the deb packages! More on
>> kernel 3.4 later), with the codel specific iproute2 patch installed.
>>
>> With htb qdisc at root, and CoDel children I have an output as follows :
>>
>> ---------
>> tc -s qdisc show dev eth0
>>
>> qdisc htb 1: root refcnt 2 r2q 10 default 12 direct_packets_stat 770
>>  Sent 112338 bytes 961 pkt (dropped 0, overlimits 0 requeues 0)
>>  backlog 0b 0p requeues 0
>> qdisc codel 110: parent 1:11 [Unknown qdisc, optlen=32]
>>  Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
>>  backlog 0b 0p requeues 0
>> qdisc codel 120: parent 1:12 [Unknown qdisc, optlen=32]
>>  Sent 6364 bytes 56 pkt (dropped 0, overlimits 0 requeues 0)
>>  backlog 0b 0p requeues 0
>> qdisc codel 130: parent 1:13 [Unknown qdisc, optlen=32]
>>  Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
>>  backlog 0b 0p requeues 0
>> -------------------
>>
>> I was wondering why I get an Unknown qdisc, optlen=32 error, even after
>> using the codel-specific iproute2 from Git. I noticed that the Git package
>> has fq_codel specific code (I am using base Codel in kernel 3.3), is it not
>> configured to handle this?
>>
>> Thanks for your help, excited about CoDel !! Let us know if you have any
>> suggestions.
>>
>> Amogh
>>
>> _______________________________________________
>> Codel mailing list
>> Codel@lists.bufferbloat.net
>> https://lists.bufferbloat.net/listinfo/codel
>>
>
>
>
> --
> Dave Täht
> SKYPE: davetaht
> US Tel: 1-239-829-5608
> http://www.bufferbloat.net



-- 
Dave Täht
SKYPE: davetaht
US Tel: 1-239-829-5608
http://www.bufferbloat.net

Re: [Codel] CoDel + 3.3 kernel

[Jonathan Morton]

On 24 May, 2012, at 3:00 am, Rishita Rajal Anubhai wrote:

> The problem now is, while trying to 'make' from the codel
> repo (to run tc), all the other packages I need such as flex, 
> bison, etc. all seem to require the older version (libc6 2.13*) 
> to be installed. Is the expected next step, to install all the
> required packages manually in some way?

That sounds like a pretty broken distro to me.  Glibc spends a huge amount of effort on ABI backwards compatibility, so having a newer version of it should not break binaries built for an older version.

 - Jonathan Morton

Re: [Codel] CoDel + 3.3 kernel

[Rishita Rajal Anubhai]

Hi all,

I built the kernel from source (net-next) and have the exact same 
issue of the 'unknown qdisc'. Any thoughts on what could be wrong 
with the config or debugging ideas would be very helpful.

Thanks,
Rishita



----- Original Message -----
From: "Dave Taht" <dave.taht@gmail.com>
To: amoghvk@stanford.edu
Cc: codel@lists.bufferbloat.net, cs244-spr1112-staff@lists.stanford.edu, "Rishita Anubhai" <rishita@stanford.edu>
Sent: Wednesday, May 23, 2012 3:36:49 PM
Subject: Re: [Codel] CoDel + 3.3 kernel

you didn't install the tc utility properly.

what I usually do is

TC=/path/to/my/codel/repo/tc/tc
export TC
$TC -s qdisc show dev whatever

you will see on these lists pointers to a netperf script, called bloat.sh
which could use some improvement. Also, netperf from svn has multiple
new features useful in exploring this stuff, notably remote control
of different congestion control algorithms, tos/diffserv bit setting, etc.

I note that it helps to turn BQL down to minimal values.

I note also that fq_codel is pretty amazing, too. So is qfq + codel.

Happy explorations.

See also the debloat, and simple_qos.sh scripts in my deBloat github repository.

We look forward to hearing about your results.

On Wed, May 23, 2012 at 11:02 PM, Amogh Vasekar <amoghvk@stanford.edu> wrote:
> Hello Developers,
>
> This is Amogh here, a Masters student at Stanford University. As a first
> step towards exploring CoDel, we're trying to reproduce the results on EC2
> using OpenFlow + Mininet and then take it from there.
>
> So far, I have CoDel with kernel 3.3 (Thanks for the deb packages! More on
> kernel 3.4 later), with the codel specific iproute2 patch installed.
>
> With htb qdisc at root, and CoDel children I have an output as follows :
>
> ---------
> tc -s qdisc show dev eth0
>
> qdisc htb 1: root refcnt 2 r2q 10 default 12 direct_packets_stat 770
>  Sent 112338 bytes 961 pkt (dropped 0, overlimits 0 requeues 0)
>  backlog 0b 0p requeues 0
> qdisc codel 110: parent 1:11 [Unknown qdisc, optlen=32]
>  Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
>  backlog 0b 0p requeues 0
> qdisc codel 120: parent 1:12 [Unknown qdisc, optlen=32]
>  Sent 6364 bytes 56 pkt (dropped 0, overlimits 0 requeues 0)
>  backlog 0b 0p requeues 0
> qdisc codel 130: parent 1:13 [Unknown qdisc, optlen=32]
>  Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
>  backlog 0b 0p requeues 0
> -------------------
>
> I was wondering why I get an Unknown qdisc, optlen=32 error, even after
> using the codel-specific iproute2 from Git. I noticed that the Git package
> has fq_codel specific code (I am using base Codel in kernel 3.3), is it not
> configured to handle this?
>
> Thanks for your help, excited about CoDel !! Let us know if you have any
> suggestions.
>
> Amogh
>
> _______________________________________________
> Codel mailing list
> Codel@lists.bufferbloat.net
> https://lists.bufferbloat.net/listinfo/codel
>



-- 
Dave Täht
SKYPE: davetaht
US Tel: 1-239-829-5608
http://www.bufferbloat.net

Re: [Codel] CoDel + 3.3 kernel

[Roger Jørgensen]

On Sat, May 26, 2012 at 11:01 AM, Rishita Rajal Anubhai
<rishita@stanford.edu> wrote:
> Hi all,
>
> I built the kernel from source (net-next) and have the exact same
> issue of the 'unknown qdisc'. Any thoughts on what could be wrong
> with the config or debugging ideas would be very helpful.

Don't know which version or where you've downloaded iproute source,
but the issue sound familiar to what I had for a while - the short
explanation is that you're using the wrong binary.
Try running it directly from the installation directory
# ./tc/tc qdisc show

Anyway, you've probably done make install and that didn't work for the
source I had, the Makefile tried to install everything into
"ROOTDIR=$(DESTDIR)" but DESTDIR was never defined, as soon as I did
that everything worked smooth.



--- Roger J ---

>
> Thanks,
> Rishita
>
>
>
> ----- Original Message -----
> From: "Dave Taht" <dave.taht@gmail.com>
> To: amoghvk@stanford.edu
> Cc: codel@lists.bufferbloat.net, cs244-spr1112-staff@lists.stanford.edu, "Rishita Anubhai" <rishita@stanford.edu>
> Sent: Wednesday, May 23, 2012 3:36:49 PM
> Subject: Re: [Codel] CoDel + 3.3 kernel
>
> you didn't install the tc utility properly.
>
> what I usually do is
>
> TC=/path/to/my/codel/repo/tc/tc
> export TC
> $TC -s qdisc show dev whatever
>
> you will see on these lists pointers to a netperf script, called bloat.sh
> which could use some improvement. Also, netperf from svn has multiple
> new features useful in exploring this stuff, notably remote control
> of different congestion control algorithms, tos/diffserv bit setting, etc.
>
> I note that it helps to turn BQL down to minimal values.
>
> I note also that fq_codel is pretty amazing, too. So is qfq + codel.
>
> Happy explorations.
>
> See also the debloat, and simple_qos.sh scripts in my deBloat github repository.
>
> We look forward to hearing about your results.
>
> On Wed, May 23, 2012 at 11:02 PM, Amogh Vasekar <amoghvk@stanford.edu> wrote:
>> Hello Developers,
>>
>> This is Amogh here, a Masters student at Stanford University. As a first
>> step towards exploring CoDel, we're trying to reproduce the results on EC2
>> using OpenFlow + Mininet and then take it from there.
>>
>> So far, I have CoDel with kernel 3.3 (Thanks for the deb packages! More on
>> kernel 3.4 later), with the codel specific iproute2 patch installed.
>>
>> With htb qdisc at root, and CoDel children I have an output as follows :
>>
>> ---------
>> tc -s qdisc show dev eth0
>>
>> qdisc htb 1: root refcnt 2 r2q 10 default 12 direct_packets_stat 770
>>  Sent 112338 bytes 961 pkt (dropped 0, overlimits 0 requeues 0)
>>  backlog 0b 0p requeues 0
>> qdisc codel 110: parent 1:11 [Unknown qdisc, optlen=32]
>>  Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
>>  backlog 0b 0p requeues 0
>> qdisc codel 120: parent 1:12 [Unknown qdisc, optlen=32]
>>  Sent 6364 bytes 56 pkt (dropped 0, overlimits 0 requeues 0)
>>  backlog 0b 0p requeues 0
>> qdisc codel 130: parent 1:13 [Unknown qdisc, optlen=32]
>>  Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
>>  backlog 0b 0p requeues 0
>> -------------------
>>
>> I was wondering why I get an Unknown qdisc, optlen=32 error, even after
>> using the codel-specific iproute2 from Git. I noticed that the Git package
>> has fq_codel specific code (I am using base Codel in kernel 3.3), is it not
>> configured to handle this?
>>
>> Thanks for your help, excited about CoDel !! Let us know if you have any
>> suggestions.
>>
>> Amogh
>>
>> _______________________________________________
>> Codel mailing list
>> Codel@lists.bufferbloat.net
>> https://lists.bufferbloat.net/listinfo/codel
>>
>
>
>
> --
> Dave Täht
> SKYPE: davetaht
> US Tel: 1-239-829-5608
> http://www.bufferbloat.net
> _______________________________________________
> Codel mailing list
> Codel@lists.bufferbloat.net
> https://lists.bufferbloat.net/listinfo/codel



-- 

Roger Jorgensen           | ROJO9-RIPE
rogerj@gmail.com          | - IPv6 is The Key!
http://www.jorgensen.no   | roger@jorgensen.no