Skip to contentSkip to conversation

tc filter scalability

LARTC John Hanlon - Central Coast Internet 3 participants 4 messages Dec 17, 2003 – Dec 19, 2003

lore
Share & tools
lore
#0 lore raw

Has anyone tested the scalability of using tc filters? I have a box
which I require to traffic shape each individual client by IP Address using u32 identifiers. My concern though, is that each client requires 2 filters (data from and to the box) and there are a few hundred clients minimum. Which means each packet may have to pass through a few hundred or possibly thousand filters to determine its path. Is this going to give significant latency issues? Or excessive server load?

Is there a simpler way to restrict each client to a given rate (there
are three separate rates that different clients are assigned)?

Kind regards,

John Hanlon.
Central Coast Internet.

_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/

#1 lore raw

I no longer use the filters, instead I use the netfilter module CLASSIFY to mark packets for certain queues....

----- Original Message -----
From: "John Hanlon - Central Coast Internet" <[email protected]>
To: <[email protected]>
Sent: Tuesday, December 16, 2003 8:06 PM
Subject: [LARTC] tc filter scalability

Quoted 2 lines

Has anyone tested the scalability of using tc filters? I have a box
which I require to traffic shape each individual client by IP Address

using

Quoted 9 lines

u32 identifiers. My concern though, is that each client requires 2 filters (data from and to the box) and there are a few hundred clients minimum. Which means each packet may have to pass through a few hundred or possibly thousand filters to determine its path. Is this going to give significant latency issues? Or excessive server load?

Is there a simpler way to restrict each client to a given rate (there
are three separate rates that different clients are assigned)?

Quoted 9 lines

Kind regards,

John Hanlon.
Central Coast Internet.

_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/

_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/

#2 lore raw
In reply to John Hanlon - Central Coast Internet
Quoted 7 lines · John Hanlon - Central Coast Internet

Has anyone tested the scalability of using tc filters? I have a box
which I require to traffic shape each individual client by IP Address using u32 identifiers. My concern though, is that each client requires 2 filters (data from and to the box) and there are a few hundred clients minimum. Which means each packet may have to pass through a few hundred or possibly thousand filters to determine its path. Is this going to give significant latency issues? Or excessive server load?

One thing -- u32 is not a "cascade" (or chain) of filters. If you enter 10000 filter matches for src address, it will _NOT_ mean that to find 10000th host, you would have to "go through" 9999 other. It would be the case if you used ip tables. u32 is a hash table. A hash key is calculated from packet entering the kernel, and then this key is looked up in the table, so there is no difference in speed when getting first or 10000th target. :-)

Regards,
Dawid

_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/

#3 lore raw
In reply to John Hanlon - Central Coast Internet

So server load does not change during filtering from the u32 hash into the relevant class? If there is an individual class for each user however (i.e. thousands of seperate classes), does that increase load during the CBQ's polling of each class? Or is the effect negligible?

Kind regards,

John Hanlon.

Quoted 19 lines · you
Quoted 2 lines · John Hanlon - Central Coast Internet

Has anyone tested the scalability of using tc filters? I have a box
which I require to traffic shape each individual client by IP Address

using

Quoted 5 lines

u32 identifiers. My concern though, is that each client requires 2 filters (data from and to the box) and there are a few hundred clients minimum. Which means each packet may have to pass through a few hundred or possibly thousand filters to determine its path. Is this going to give significant latency issues? Or excessive server load?

One thing -- u32 is not a "cascade" (or chain) of filters. If you enter 10000 filter matches for src address, it will _NOT_ mean that to find 10000th host, you would have to "go through" 9999 other. It would be the case if you used ip tables. u32 is a hash table. A hash key is calculated from packet entering the kernel, and then this key is looked up in the table, so there is no difference in speed when getting first or 10000th target. :-)

Quoted 2 lines

Regards,
Dawid

_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/