Skip to contentSkip to conversation

u32 clarification...limits on 2000>???

LARTC Trevor Warren 4 participants 8 messages Jun 24, 2003 – Jun 29, 2003

lore
Share & tools
lore
#0 lore raw

Hello,

If this isn't a limit of U32 filters then whats wrong with the way i
have set things up???. The issue has to be somewhere right.

Also, i do appreciate you not wanting to give me your config. But at
least give me a couple of lines of your U32 filter usage such that i can make 5000> filters using it and test. Only passing your u32 filter config.....if its your equivalent to IP then its fine with me...:)

I will have the test script mailed across to all. I am in DESPERATE
need for help on this part......:(

Trevor

Quoted 67 lines · Catalin BOIE
Quoted 1 line

Hello,

Hello!

Quoted 3 lines

I do understand that limits on u32 filters > 2000 have never been
encountered. Run this script which is base on htb and lemme know. You will need 2.4.20 > and tc compiled for htb.

It gives me a lot of "RTNETLINK answers: File exists". This doesn't seems to be a limit.

Quoted 2 lines

Can you please send me your config and lemme compare the same against
mine.

I have main in a database. I cannot give it to you, but trust me that are 50000 filters.

Try to use hashes to reduce the kernel pressure.

Quoted 36 lines

Trevor

Quoted 25 lines · Catalin BOIE
Quoted 6 lines · Trevor Warren

Can some one please confirm which would be the best place to clarify these U32 issues and 2048 U32 filter limitations as i had posted in my previous mail.

Trevor

We have 50000 filters and still working.
I don't think there is a limit.

Quoted 4 lines

--
( >- GNU/LINUX, It's all about CHOICE -< )
/~\ __ [email protected] __ /~\

Quoted 8 lines
|  \) /  Pre Sales Consultant - Red Hat     \ (/ |
|_|_  \    9820349221(M) | 22881326(O)      / _|_|
       \___________________________________/

_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/

Quoted 6 lines

---
Catalin(ux) BOIE
[email protected]
_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/

Quoted 7 lines

--
( >- GNU/LINUX, It's all about CHOICE -< )
/~\ __ [email protected] __ /~\

|  \) /  Pre Sales Consultant - Red Hat     \ (/ |
|_|_  \    9820349221(M) | 22881326(O)      / _|_|
       \___________________________________/

---
Catalin(ux) BOIE
[email protected]
_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/

Signature · 9 lines
( >-        LINUX, It's all about CHOICE      -< )
/~\    __        [email protected]       __   /~\
|  \) /  Pre Sales Consultant - Red Hat     \ (/ |
|_|_  \    9820349221(M) | 22881326(O)      / _|_|
       \___________________________________/

_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/
#1 lore raw

HELP....!!!!!!

Trevor

Quoted 61 lines · Catalin BOIE
Quoted 1 line

Hello,

Hello!

Quoted 3 lines

I do understand that limits on u32 filters > 2000 have never been
encountered. Run this script which is base on htb and lemme know. You will need 2.4.20 > and tc compiled for htb.

It gives me a lot of "RTNETLINK answers: File exists". This doesn't seems to be a limit.

Quoted 2 lines

Can you please send me your config and lemme compare the same against
mine.

I have main in a database. I cannot give it to you, but trust me that are 50000 filters.

Try to use hashes to reduce the kernel pressure.

Quoted 36 lines

Trevor

Quoted 25 lines · Catalin BOIE
Quoted 6 lines · Trevor Warren

Can some one please confirm which would be the best place to clarify these U32 issues and 2048 U32 filter limitations as i had posted in my previous mail.

Trevor

We have 50000 filters and still working.
I don't think there is a limit.

Quoted 4 lines

--
( >- GNU/LINUX, It's all about CHOICE -< )
/~\ __ [email protected] __ /~\

Quoted 8 lines
|  \) /  Pre Sales Consultant - Red Hat     \ (/ |
|_|_  \    9820349221(M) | 22881326(O)      / _|_|
       \___________________________________/

_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/

Quoted 6 lines

---
Catalin(ux) BOIE
[email protected]
_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/

Quoted 7 lines

--
( >- GNU/LINUX, It's all about CHOICE -< )
/~\ __ [email protected] __ /~\

|  \) /  Pre Sales Consultant - Red Hat     \ (/ |
|_|_  \    9820349221(M) | 22881326(O)      / _|_|
       \___________________________________/
Quoted 2 lines

---
Catalin(ux) BOIE

[email protected]

Signature · 9 lines
( >-        LINUX, It's all about CHOICE      -< )
/~\    __        [email protected]       __   /~\
|  \) /  Pre Sales Consultant - Red Hat     \ (/ |
|_|_  \    9820349221(M) | 22881326(O)      / _|_|
       \___________________________________/

_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/
#2 lore raw
In reply to Trevor Warren
Quoted 1 line

Hello,

Hello!

Quoted 3 lines

I do understand that limits on u32 filters > 2000 have never been
encountered. Run this script which is base on htb and lemme know. You will need 2.4.20 > and tc compiled for htb.

It gives me a lot of "RTNETLINK answers: File exists". This doesn't seems to be a limit.

Quoted 2 lines

Can you please send me your config and lemme compare the same against
mine.

I have main in a database. I cannot give it to you, but trust me that are 50000 filters.

Try to use hashes to reduce the kernel pressure.

Quoted 36 lines

Trevor

Quoted 25 lines · Catalin BOIE
Quoted 6 lines · Trevor Warren

Can some one please confirm which would be the best place to clarify these U32 issues and 2048 U32 filter limitations as i had posted in my previous mail.

Trevor

We have 50000 filters and still working.
I don't think there is a limit.

Quoted 4 lines

--
( >- GNU/LINUX, It's all about CHOICE -< )
/~\ __ [email protected] __ /~\

Quoted 8 lines
|  \) /  Pre Sales Consultant - Red Hat     \ (/ |
|_|_  \    9820349221(M) | 22881326(O)      / _|_|
       \___________________________________/

_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/

Quoted 6 lines

---
Catalin(ux) BOIE
[email protected]
_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/

Quoted 7 lines

--
( >- GNU/LINUX, It's all about CHOICE -< )
/~\ __ [email protected] __ /~\

|  \) /  Pre Sales Consultant - Red Hat     \ (/ |
|_|_  \    9820349221(M) | 22881326(O)      / _|_|
       \___________________________________/

---
Catalin(ux) BOIE
[email protected]
_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/

#3 lore raw
In reply to Trevor Warren

----- Original Message -----
From: "Trevor Warren" <[email protected]>
To: "Catalin BOIE" <[email protected]>
Cc: "lartc" <[email protected]>; "Stef Coene" <[email protected]>
Sent: Τετάρτη, 25 Ιουνίου 2003 1:14 πμ
Subject: Re: [LARTC] u32 clarification...limits on 2000>???

Quoted 1 line

HELP....!!!!!!

OK, OK!
Send me your script again and I will try it...

- Giannis

_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/

#4 lore raw
In reply to Trevor Warren

Hi,

This is the script I'm using to create tc configuration to shape currently about 8000 ips separately so that each ip has guaranteed bandwith and cannot exceed it. The script can be used to shape up to class B. The configuration is using double hashing for filtering rules. I haven't used it in production yet, but it shows pretty good result on a testbed.
To test it further I've created configuration to shape range 192.168.1.0-192.168.254.0 (almost class B), i.e.about 65000 classes and about 65000 filters. It takes very long time to apply on my rather slow (P166mmx) test machine, but it doesn't throw a word of complaint.

Creating configuration:

root@test:~/perl/qos# time ./qos.conf
real    0m42.733s
user    0m40.950s
sys     0m0.490s

It creates file rc.qos. Applying configuration:

root@test:~/perl/qos# time . ./rc.qos
real    125m48.033s
user    28m40.660s
sys     95m59.420s
root@radtest:~/perl/qos# tc qdisc ls | wc -l
  64520
root@radtest:~/perl/qos# tc filter ls dev eth0 parent 13:0 | wc -l
 129042
(2 output lines for a filter).

So the answer to your question most likely is no. There's no limit.
Hint: I've experienced something like that when I tried to use precompiled binary (actually I compiled it myself but on different machine). The errors were gone after I recompiled tc from the same sources on the machine where it's being used. Could be some libraries incompatibilities or changes made to some header files.
So look at the script if you're interested.

Michael

p.s. I'm not sure that larts list manager will allow attachment through. If it doesn't and you want the script - email me.

Quoted 50 lines · Trevor Warren

Hello,

If this isn't a limit of U32 filters then whats wrong with the way i
have set things up???. The issue has to be somewhere right.

Also, i do appreciate you not wanting to give me your config. But at
least give me a couple of lines of your U32 filter usage such that i can make 5000> filters using it and test. Only passing your u32 filter config.....if its your equivalent to IP then its fine with me...:)

I will have the test script mailed across to all. I am in DESPERATE
need for help on this part......:(

Trevor

Quoted 33 lines · Catalin BOIE
Quoted 1 line

Hello,

Hello!

Quoted 3 lines

I do understand that limits on u32 filters > 2000 have never been
encountered. Run this script which is base on htb and lemme know. You will need 2.4.20 > and tc compiled for htb.

It gives me a lot of "RTNETLINK answers: File exists". This doesn't seems to be a limit.

Quoted 2 lines

Can you please send me your config and lemme compare the same against
mine.

I have main in a database. I cannot give it to you, but trust me that are 50000 filters.

Try to use hashes to reduce the kernel pressure.

Quoted 16 lines

Trevor

Quoted 11 lines · Catalin BOIE
Quoted 6 lines · Trevor Warren

Can some one please confirm which would be the best place to clarify these U32 issues and 2048 U32 filter limitations as i had posted in my previous mail.

Trevor

We have 50000 filters and still working.
I don't think there is a limit.

#5 lore raw
In reply to Trevor Warren

Thanks a ton for the same Michael. I am downloading tc from source and will have the same compiled. Am actually using tc as distributed by Martin of HTB fame.

So you saying...probably the tc binary distributed by it could be and issue???. Anyway, i will have the same tried out and let you know.

Trevor

Quoted 99 lines · Michael Ulitskiy

Hi,

This is the script I'm using to create tc configuration to shape currently about 8000 ips separately so that each ip has guaranteed bandwith and cannot exceed it. The script can be used to shape up to class B. The configuration is using double hashing for filtering rules. I haven't used it in production yet, but it shows pretty good result on a testbed.
To test it further I've created configuration to shape range 192.168.1.0-192.168.254.0 (almost class B), i.e.about 65000 classes and about 65000 filters. It takes very long time to apply on my rather slow (P166mmx) test machine, but it doesn't throw a word of complaint.

Creating configuration:

root@test:~/perl/qos# time ./qos.conf
real    0m42.733s
user    0m40.950s
sys     0m0.490s

It creates file rc.qos. Applying configuration:

root@test:~/perl/qos# time . ./rc.qos
real    125m48.033s
user    28m40.660s
sys     95m59.420s
root@radtest:~/perl/qos# tc qdisc ls | wc -l
  64520
root@radtest:~/perl/qos# tc filter ls dev eth0 parent 13:0 | wc -l
 129042
(2 output lines for a filter).

So the answer to your question most likely is no. There's no limit.
Hint: I've experienced something like that when I tried to use precompiled binary (actually I compiled it myself but on different machine). The errors were gone after I recompiled tc from the same sources on the machine where it's being used. Could be some libraries incompatibilities or changes made to some header files.
So look at the script if you're interested.

Michael

p.s. I'm not sure that larts list manager will allow attachment through. If it doesn't and you want the script - email me.

Quoted 50 lines · Trevor Warren

Hello,

If this isn't a limit of U32 filters then whats wrong with the way i
have set things up???. The issue has to be somewhere right.

Also, i do appreciate you not wanting to give me your config. But at
least give me a couple of lines of your U32 filter usage such that i can make 5000> filters using it and test. Only passing your u32 filter config.....if its your equivalent to IP then its fine with me...:)

I will have the test script mailed across to all. I am in DESPERATE
need for help on this part......:(

Trevor

Quoted 33 lines · Catalin BOIE
Quoted 1 line

Hello,

Hello!

Quoted 3 lines

I do understand that limits on u32 filters > 2000 have never been
encountered. Run this script which is base on htb and lemme know. You will need 2.4.20 > and tc compiled for htb.

It gives me a lot of "RTNETLINK answers: File exists". This doesn't seems to be a limit.

Quoted 2 lines

Can you please send me your config and lemme compare the same against
mine.

I have main in a database. I cannot give it to you, but trust me that are 50000 filters.

Try to use hashes to reduce the kernel pressure.

Quoted 16 lines

Trevor

Quoted 11 lines · Catalin BOIE
Quoted 6 lines · Trevor Warren

Can some one please confirm which would be the best place to clarify these U32 issues and 2048 U32 filter limitations as i had posted in my previous mail.

Trevor

We have 50000 filters and still working.
I don't think there is a limit.

Signature · 9 lines
( >-        LINUX, It's all about CHOICE      -< )
/~\    __        [email protected]       __   /~\
|  \) /  Pre Sales Consultant - Red Hat     \ (/ |
|_|_  \    9820349221(M) | 22881326(O)      / _|_|
       \___________________________________/

_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/
#6 lore raw
In reply to Trevor Warren

No, this is of cause incorrect. Just forgot to change it. Should be 192.168.0.0/16

Michael

Quoted 4 lines · you
/root/bin/tc filter add dev eth0 protocol ip parent 13:0 prio 5 u32 ht 800:: \
    match ip dst 66.114.0.0/16 hashkey mask 0x0000ff00 at 16 link 2:
/root/bin/tc filter add dev eth0 protocol ip parent 13:0 prio 5 u32 ht 800:: \
    match ip dst 66.114.0.0/16 hashkey mask 0x000000ff at 16 link 3:
Quoted 112 lines

#--- end of filters ---

Is it correct ?( the hashkey seems to me it matches the 168 and X from 192.168.X.Y)

Alex

Quoted 103 lines · Michael Ulitskiy

Hi,

This is the script I'm using to create tc configuration to shape currently about 8000 ips separately so that each ip has guaranteed bandwith and cannot exceed it. The script can be used to shape up to class B. The configuration is using double hashing for filtering rules. I haven't used it in production yet, but it shows pretty good result on a testbed.
To test it further I've created configuration to shape range 192.168.1.0-192.168.254.0 (almost class B), i.e.about 65000 classes and about 65000 filters. It takes very long time to apply on my rather slow (P166mmx) test machine, but it doesn't throw a word of complaint.

Creating configuration:

root@test:~/perl/qos# time ./qos.conf
real    0m42.733s
user    0m40.950s
sys     0m0.490s

It creates file rc.qos. Applying configuration:

root@test:~/perl/qos# time . ./rc.qos
real    125m48.033s
user    28m40.660s
sys     95m59.420s
root@radtest:~/perl/qos# tc qdisc ls | wc -l
  64520
root@radtest:~/perl/qos# tc filter ls dev eth0 parent 13:0 | wc -l
 129042
(2 output lines for a filter).

So the answer to your question most likely is no. There's no limit.
Hint: I've experienced something like that when I tried to use precompiled binary (actually I compiled it myself but on different machine). The errors were gone after I recompiled tc from the same sources on the machine where it's being used. Could be some libraries incompatibilities or changes made to some header files.
So look at the script if you're interested.

Michael

p.s. I'm not sure that larts list manager will allow attachment through. If it doesn't and you want the script - email me.

Quoted 10 lines · Trevor Warren

Hello,

If this isn't a limit of U32 filters then whats wrong with the way i
have set things up???. The issue has to be somewhere right.

Also, i do appreciate you not wanting to give me your config. But at
least give me a couple of lines of your U32 filter usage such that i can make 5000> filters using it and test. Only passing your u32 filter config.....if its your equivalent to IP then its fine with me...:)

Quoted 40 lines

I will have the test script mailed across to all. I am in DESPERATE
need for help on this part......:(

Trevor

Quoted 33 lines · Catalin BOIE
Quoted 1 line

Hello,

Hello!

Quoted 3 lines

I do understand that limits on u32 filters > 2000 have never been
encountered. Run this script which is base on htb and lemme know. You will need 2.4.20 > and tc compiled for htb.

It gives me a lot of "RTNETLINK answers: File exists". This doesn't seems to be a limit.

Quoted 2 lines

Can you please send me your config and lemme compare the same against
mine.

I have main in a database. I cannot give it to you, but trust me that are 50000 filters.

Try to use hashes to reduce the kernel pressure.

Quoted 16 lines

Trevor

Quoted 11 lines · Catalin BOIE
Quoted 6 lines · Trevor Warren

Can some one please confirm which would be the best place to clarify these U32 issues and 2048 U32 filter limitations as i had posted in my previous mail.

Trevor

We have 50000 filters and still working.
I don't think there is a limit.

------------------------------------------------------------------------
Name: qos.conf
qos.conf Type: Perl Program (application/x-perl)
Encoding: 7bit

_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/

#7 lore raw
In reply to Trevor Warren

Hello Michael,

Lemme again thank you for your helpful insight. You have mentioned that
use of tc and iproute from source hasn't given you any issues.

I am gonna following the same instead of using RH packaged tools. Will
let you know the outcome.

Stef....you have any idea about this issue with RH tools???

Trevor

Quoted 125 lines · Michael Ulitskiy
Quoted 6 lines · you

Thanks a ton for the same Michael. I am downloading tc from source and will have the same compiled. Am actually using tc as distributed by Martin of HTB fame.

So you saying...probably the tc binary distributed by it could be and issue???. Anyway, i will have the same tried out and let you know.

Honestly, I don't know. I'm using iproute2-2.4.7-now-ss020116-try.tar.gz and htb3.6-020525.tgz patch and it seems to work fine.
It's already in production and looks good so far.

Michael

Quoted 111 lines

Trevor

Quoted 99 lines · Michael Ulitskiy

Hi,

This is the script I'm using to create tc configuration to shape currently about 8000 ips separately so that each ip has guaranteed bandwith and cannot exceed it. The script can be used to shape up to class B. The configuration is using double hashing for filtering rules. I haven't used it in production yet, but it shows pretty good result on a testbed.
To test it further I've created configuration to shape range 192.168.1.0-192.168.254.0 (almost class B), i.e.about 65000 classes and about 65000 filters. It takes very long time to apply on my rather slow (P166mmx) test machine, but it doesn't throw a word of complaint.

Creating configuration:

root@test:~/perl/qos# time ./qos.conf
real    0m42.733s
user    0m40.950s
sys     0m0.490s

It creates file rc.qos. Applying configuration:

root@test:~/perl/qos# time . ./rc.qos
real    125m48.033s
user    28m40.660s
sys     95m59.420s
root@radtest:~/perl/qos# tc qdisc ls | wc -l
  64520
root@radtest:~/perl/qos# tc filter ls dev eth0 parent 13:0 | wc -l
 129042
(2 output lines for a filter).

So the answer to your question most likely is no. There's no limit.
Hint: I've experienced something like that when I tried to use precompiled binary (actually I compiled it myself but on different machine). The errors were gone after I recompiled tc from the same sources on the machine where it's being used. Could be some libraries incompatibilities or changes made to some header files.
So look at the script if you're interested.

Michael

p.s. I'm not sure that larts list manager will allow attachment through. If it doesn't and you want the script - email me.

Quoted 50 lines · Trevor Warren

Hello,

If this isn't a limit of U32 filters then whats wrong with the way i
have set things up???. The issue has to be somewhere right.

Also, i do appreciate you not wanting to give me your config. But at
least give me a couple of lines of your U32 filter usage such that i can make 5000> filters using it and test. Only passing your u32 filter config.....if its your equivalent to IP then its fine with me...:)

I will have the test script mailed across to all. I am in DESPERATE
need for help on this part......:(

Trevor

Quoted 33 lines · Catalin BOIE
Quoted 1 line

Hello,

Hello!

Quoted 3 lines

I do understand that limits on u32 filters > 2000 have never been
encountered. Run this script which is base on htb and lemme know. You will need 2.4.20 > and tc compiled for htb.

It gives me a lot of "RTNETLINK answers: File exists". This doesn't seems to be a limit.

Quoted 2 lines

Can you please send me your config and lemme compare the same against
mine.

I have main in a database. I cannot give it to you, but trust me that are 50000 filters.

Try to use hashes to reduce the kernel pressure.

Quoted 16 lines

Trevor

Quoted 11 lines · Catalin BOIE
Quoted 6 lines · Trevor Warren

Can some one please confirm which would be the best place to clarify these U32 issues and 2048 U32 filter limitations as i had posted in my previous mail.

Trevor

We have 50000 filters and still working.
I don't think there is a limit.

Signature · 5 lines
( >-        LINUX, It's all about CHOICE      -< )
/~\    __        [email protected]       __   /~\
|  \) /  Pre Sales Consultant - Red Hat     \ (/ |
|_|_  \    9820349221(M) | 22881326(O)      / _|_|
       \___________________________________/
Signature · 9 lines
( >-        LINUX, It's all about CHOICE      -< )
/~\    __        [email protected]       __   /~\
|  \) /  Pre Sales Consultant - Red Hat     \ (/ |
|_|_  \    9820349221(M) | 22881326(O)      / _|_|
       \___________________________________/

_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/