Skip to contentSkip to conversation

Need some help on HTB and IMQ

LARTC hanumantha kavuluru 6 participants 12 messages Feb 24, 2003 – Mar 4, 2003

lore
Share & tools
lore
#0 lore raw

Hi All,

I am fairly new to Linux and TC. I am currently implementing Bandwidth Management/Traffic Control for a gateway product which is based on Linux 2.4.18 kernel. I am required to implement some kind of a user based traffic control where each user(source IP) is allocated a fixed amount of bandwidth. I also need to do traffic shaping both for the eggress and ingress traffic. Going through LARTC documentation , I found that IMQ with HTB will suit my requirement. Is anybody using IMQ with HTB? Can HTB and IMQ work with 2.4.18 kernel? If so, where can i download all the patches? It is difficult for us to migrate to 2.4.20 kernel as most of the software has already been developed using 2.4.18 kernel.

I really appreciate any help in this regard.

Thanks,

Hemanth

---------------------------------
Do you Yahoo!?
Yahoo! Tax Center - forms, calculators, tips, and more

#1 lore raw
Quoted 12 lines · hanumantha kavuluru

Hi All,

I am fairly new to Linux and TC. I am currently implementing Bandwidth Management/Traffic Control for a gateway product which is based on Linux 2.4.18 kernel. I am required to implement some kind of a user based traffic control where each user(source IP) is allocated a fixed amount of bandwidth. I also need to do traffic shaping both for the eggress and ingress traffic. Going through LARTC documentation , I found that IMQ with HTB will suit my requirement. Is anybody using IMQ with HTB? Can HTB and IMQ work with 2.4.18 kernel? If so, where can i download all the patches? It is difficult for us to migrate to 2.4.20 kernel as most of the software has already been developed using 2.4.18 kernel.

http://luxik.cdi.cz/~patrick/imq/
http://luxik.cdi.cz/~devik/qos/htb/
And you don't need imq. If you have a gateway, you can shape on both interface so you can control up- and download traffic.

Just wondering, what kind of software do you developped so you can not use kernel 2.4.20 ??

Stef

Signature · 8 lines
[email protected]
 "Using Linux as bandwidth manager"
     http://www.docum.org/
     #lartc @ irc.oftc.net

_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/
#2 lore raw
In reply to hanumantha kavuluru

Hi All,
Thanks for the help. Stef, our product is already out in the market with 2.4.18 kernel. So if we change the kernel, we will have to go through a full QA cycle which is something we don't want to do :). BTW, I would like to have global limits on the Bandwidth per user irrespective of which interface the traffic might go.Can i do this without using IMQ? Also i want to do my own classification by setting the skb->priority field with the appropriate class ID. Is it possible to use this kind of classification with IMQ and HTB? i really appreciate your help.
Thanks,
Hemanth

Quoted 12 lines · hanumantha kavuluru

Hi All,

I am fairly new to Linux and TC. I am currently implementing Bandwidth Management/Traffic Control for a gateway product which is based on Linux 2.4.18 kernel. I am required to implement some kind of a user based traffic control where each user(source IP) is allocated a fixed amount of bandwidth. I also need to do traffic shaping both for the eggress and ingress traffic. Going through LARTC documentation , I found that IMQ with HTB will suit my requirement. Is anybody using IMQ with HTB? Can HTB and IMQ work with 2.4.18 kernel? If so, where can i download all the patches? It is difficult for us to migrate to 2.4.20 kernel as most of the software has already been developed using 2.4.18 kernel.

http://luxik.cdi.cz/~patrick/imq/
http://luxik.cdi.cz/~devik/qos/htb/
And you don't need imq. If you have a gateway, you can shape on both interface so you can control up- and download traffic.

Just wondering, what kind of software do you developped so you can not use kernel 2.4.20 ??

Stef

Signature · 13 lines
[email protected]
"Using Linux as bandwidth manager"
http://www.docum.org/
#lartc @ irc.oftc.net

_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/


---------------------------------
Do you Yahoo!?
Yahoo! Tax Center - forms, calculators, tips, and more
#3 lore raw
In reply to hanumantha kavuluru
Quoted 4 lines · hanumantha kavuluru

Hi All,
Thanks for the help. Stef, our product is already out in the market with 2.4.18 kernel. So if we change the kernel, we will have to go through a full QA cycle which is something we don't want to do :).

Ok

Quoted 3 lines

BTW, I would like
to have global limits on the Bandwidth per user irrespective of which interface the traffic might go.Can i do this without using IMQ?

So you want up + down = fixed bandwidth? Then you need IMQ.

Quoted 4 lines

Also i want
to do my own classification by setting the skb->priority field with the appropriate class ID. Is it possible to use this kind of classification with IMQ and HTB?

I don't know the internals of tc, but I think you can do.

Stef

Signature · 8 lines
[email protected]
 "Using Linux as bandwidth manager"
     http://www.docum.org/
     #lartc @ irc.oftc.net

_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/
#4 lore raw
In reply to hanumantha kavuluru

Stef,
That is right. I want to do up+down = fixed bandwidth. Thanks for your help. Hemanth

Quoted 4 lines · hanumantha kavuluru

Hi All,
Thanks for the help. Stef, our product is already out in the market with 2.4.18 kernel. So if we change the kernel, we will have to go through a full QA cycle which is something we don't want to do :).

Ok

Quoted 3 lines

BTW, I would like
to have global limits on the Bandwidth per user irrespective of which interface the traffic might go.Can i do this without using IMQ?

So you want up + down = fixed bandwidth? Then you need IMQ.

Quoted 4 lines

Also i want
to do my own classification by setting the skb->priority field with the appropriate class ID. Is it possible to use this kind of classification with IMQ and HTB?

I don't know the internals of tc, but I think you can do.

Stef

Signature · 13 lines
[email protected]
"Using Linux as bandwidth manager"
http://www.docum.org/
#lartc @ irc.oftc.net

_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/


---------------------------------
Do you Yahoo!?
Yahoo! Tax Center - forms, calculators, tips, and more
#5 lore raw
In reply to hanumantha kavuluru

Hi,

There is no options at all to 'shape' upload+download=fixed bandwidth without using IMQ virtual device ? So if somebody is planning to give customer fixed bandwidth regarless if a customer is 'uploading' or 'downloading',he (or she:) MUST use IMQ virtual device ? Anybody did some tests of configuring same traffic shaping with and without using IMQ device ? How IMQ device (kernel) will behave on heavy load traffic (like VoIP,gaming,other 'real-time' traffic) comparing on mashine without using IMQ virtual device ?
Does anybody did some test on using u32 filter and fw filter ? How does each one behave on same mashine,same kernel,same traffic shaping configuration ?

f2zubac

Quoted 12 lines · Stef Coene
Quoted 4 lines · hanumantha kavuluru

Hi All,
Thanks for the help. Stef, our product is already out in the market with 2.4.18 kernel. So if we change the kernel, we will have to go through a full QA cycle which is something we don't want to do :).

Ok

Quoted 3 lines

BTW, I would like
to have global limits on the Bandwidth per user irrespective of which interface the traffic might go.Can i do this without using IMQ?

So you want up + down = fixed bandwidth? Then you need IMQ.

Quoted 19 lines
Quoted 4 lines

Also i want
to do my own classification by setting the skb->priority field with the appropriate class ID. Is it possible to use this kind of classification with IMQ and HTB?

I don't know the internals of tc, but I think you can do.

Stef

Signature · 8 lines
[email protected]
 "Using Linux as bandwidth manager"
     http://www.docum.org/
     #lartc @ irc.oftc.net

_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/

_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/

#6 lore raw
In reply to hanumantha kavuluru
Quoted 4 lines · Dragan Zubac

Hi,

There is no options at all to 'shape' upload+download=fixed bandwidth without using IMQ virtual device ?

You can only control traffic that leaves an interface and you can't combine 2 interfaces. But with the imq device, you can redirect whatever-you-want traffic to the 1 device. So you can redirect traffic that leaves eth0 and eth1 to the same device, you can combine both interfaces.

Quoted 5 lines

So if somebody is planning to give
customer fixed bandwidth regarless if a customer is 'uploading' or 'downloading',he (or she:) MUST use IMQ virtual device ? Anybody did some tests of configuring same traffic shaping with and without using IMQ device ?

No. But sometimes you need the imq device.

Quoted 3 lines

How IMQ device (kernel) will behave on heavy load traffic (like VoIP,gaming,other 'real-time' traffic) comparing on mashine without using IMQ virtual device ?

Good.

Quoted 3 lines

Does anybody did some test on using u32 filter and fw filter ? How does each one behave on same mashine,same kernel,same traffic shaping configuration ?

As long as you don't have more then 10^6 filter rules, you are fine :) You should be more worry about active classes. I once created 5000 active classes on a 486, 25Mhz, 8MB Ram and I was able to shape 10mbit without remarkable delays.

Stef

Signature · 7 lines
[email protected]
 "Using Linux as bandwidth manager"
     http://www.docum.org/
     #lartc @ irc.oftc.net
_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/
#7 lore raw
In reply to hanumantha kavuluru

Hi Stef

i was going through this thread
you mentioned if iam using this Linux box as a gateway, i dont required IMQ to control ingress and egress

how can do with out IMQ, can you point me

i have 2 interface eth0 and eth1
like to control bandwidth for my users
both up and down

thanks
hare
----- Original Message -----
From: "Stef Coene" <[email protected]>
To: "hanumantha kavuluru" <[email protected]>; <[email protected]>
Sent: Tuesday, February 25, 2003 1:12 AM
Subject: Re: [LARTC] Need some help on HTB and IMQ

Quoted 6 lines · hanumantha kavuluru
Quoted 5 lines

Hi All,

I am fairly new to Linux and TC. I am currently implementing Bandwidth Management/Traffic Control for a gateway product which is based on Linux 2.4.18 kernel. I am required to implement some kind of a user based

traffic

Quoted 3 lines
Quoted 3 lines

control where each user(source IP) is allocated a fixed amount of bandwidth. I also need to do traffic shaping both for the eggress and ingress traffic. Going through LARTC documentation , I found that IMQ

with

Quoted 2 lines
Quoted 2 lines

HTB will suit my requirement. Is anybody using IMQ with HTB? Can HTB and IMQ work with 2.4.18 kernel? If so, where can i download all the

patches?

Quoted 1 line
Quoted 1 line

It is difficult for us to migrate to 2.4.20 kernel as most of the

software

Quoted 13 lines
Quoted 1 line

has already been developed using 2.4.18 kernel.

http://luxik.cdi.cz/~patrick/imq/
http://luxik.cdi.cz/~devik/qos/htb/
And you don't need imq. If you have a gateway, you can shape on both interface so you can control up- and download traffic.

Just wondering, what kind of software do you developped so you can not use kernel 2.4.20 ??

Stef

--

Quoted 9 lines

[email protected]
"Using Linux as bandwidth manager"
http://www.docum.org/
#lartc @ irc.oftc.net

_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/

_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/

#8 lore raw
In reply to hanumantha kavuluru

This question comes up pretty often. Conceptually, we can do it in two ways.

1. All outgoing traffic is shaped on the interface which is internet facing say eth0. Then the incoming traffic will go the LAN thro' eth1. In this case shaping outgoing traffic on eth1 is nearly equivalent to shaping incoming traffic on eth0 ( assuming all traffic is for the LAN and not for the host). Another option to limit incoming traffic on eth0 is to use the ingress qdisc and police rates to a cap and shape the bandwidth utilised on eth1 to the LAN.

In the case above, bandwidth is apportioned as incoming and outgoing separately. In the case of many ISPs, they would like to allocate bandwidth for incoming + outgoing instead of dividing what is allotted further between incoming and outgoing.

In such a case, IMQ device is used. Shaping IMQ will shape the aggregated traffic of incoming+outgoing.

Mohan
-----Original Message-----
From: [email protected] [mailto:[email protected]]On Behalf Of hare ram
Sent: 04 March 2003 11:54
To: Stef Coene; [email protected]
Subject: Re: [LARTC] Need some help on HTB and IMQ

Hi Stef

i was going through this thread
you mentioned if iam using this Linux box as a gateway, i dont required IMQ to control ingress and egress

how can do with out IMQ, can you point me

i have 2 interface eth0 and eth1
like to control bandwidth for my users
both up and down

thanks
hare
----- Original Message -----
From: "Stef Coene" <[email protected]>
To: "hanumantha kavuluru" <[email protected]>; <[email protected]>
Sent: Tuesday, February 25, 2003 1:12 AM
Subject: Re: [LARTC] Need some help on HTB and IMQ

Quoted 6 lines · hanumantha kavuluru
Quoted 5 lines

Hi All,

I am fairly new to Linux and TC. I am currently implementing Bandwidth Management/Traffic Control for a gateway product which is based on Linux 2.4.18 kernel. I am required to implement some kind of a user based

traffic

Quoted 3 lines
Quoted 3 lines

control where each user(source IP) is allocated a fixed amount of bandwidth. I also need to do traffic shaping both for the eggress and ingress traffic. Going through LARTC documentation , I found that IMQ

with

Quoted 2 lines
Quoted 2 lines

HTB will suit my requirement. Is anybody using IMQ with HTB? Can HTB and IMQ work with 2.4.18 kernel? If so, where can i download all the

patches?

Quoted 1 line
Quoted 1 line

It is difficult for us to migrate to 2.4.20 kernel as most of the

software

Quoted 13 lines
Quoted 1 line

has already been developed using 2.4.18 kernel.

http://luxik.cdi.cz/~patrick/imq/
http://luxik.cdi.cz/~devik/qos/htb/
And you don't need imq. If you have a gateway, you can shape on both interface so you can control up- and download traffic.

Just wondering, what kind of software do you developped so you can not use kernel 2.4.20 ??

Stef

--

Quoted 9 lines

[email protected]
"Using Linux as bandwidth manager"
http://www.docum.org/
#lartc @ irc.oftc.net

_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/

_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/

_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/

#9 lore raw
In reply to hanumantha kavuluru

Hi Mohan

thanks for the brief explanation... about the IMQ

so when IMQ should be used when the both in/out traffic same ? like fixed ( 64kbps, irrespective of in and out)

or like IN is less and OUT is more ? or IN more and OUT less ? ( like 32 up and 32 down or 16 up and 48 down)

thanks
hare

----- Original Message -----
From: "S Mohan" <[email protected]>
To: <[email protected]>
Sent: Tuesday, March 04, 2003 11:57 AM
Subject: RE: [LARTC] Need some help on HTB and IMQ

Quoted 2 lines

This question comes up pretty often. Conceptually, we can do it in two

ways.

Quoted 2 lines

1. All outgoing traffic is shaped on the interface which is internet

facing

Quoted 1 line

say eth0. Then the incoming traffic will go the LAN thro' eth1. In this

case

Quoted 2 lines

shaping outgoing traffic on eth1 is nearly equivalent to shaping incoming traffic on eth0 ( assuming all traffic is for the LAN and not for the

host).

Quoted 1 line

Another option to limit incoming traffic on eth0 is to use the ingress

qdisc

Quoted 5 lines

and police rates to a cap and shape the bandwidth utilised on eth1 to the LAN.

In the case above, bandwidth is apportioned as incoming and outgoing separately. In the case of many ISPs, they would like to allocate

bandwidth

Quoted 1 line

for incoming + outgoing instead of dividing what is allotted further

between

Quoted 26 lines

incoming and outgoing.

In such a case, IMQ device is used. Shaping IMQ will shape the aggregated traffic of incoming+outgoing.

Mohan
-----Original Message-----
From: [email protected] [mailto:[email protected]]On Behalf Of hare ram
Sent: 04 March 2003 11:54
To: Stef Coene; [email protected]
Subject: Re: [LARTC] Need some help on HTB and IMQ

Hi Stef

i was going through this thread
you mentioned if iam using this Linux box as a gateway, i dont required IMQ to control ingress and egress

how can do with out IMQ, can you point me

i have 2 interface eth0 and eth1
like to control bandwidth for my users
both up and down

Quoted 14 lines

thanks
hare
----- Original Message -----
From: "Stef Coene" <[email protected]>
To: "hanumantha kavuluru" <[email protected]>; <[email protected]>
Sent: Tuesday, February 25, 2003 1:12 AM
Subject: Re: [LARTC] Need some help on HTB and IMQ

Quoted 5 lines · hanumantha kavuluru
Quoted 4 lines

Hi All,

I am fairly new to Linux and TC. I am currently implementing Bandwidth Management/Traffic Control for a gateway product which is based on

Linux

Quoted 7 lines
Quoted 1 line
Quoted 1 line

2.4.18 kernel. I am required to implement some kind of a user based

traffic

Quoted 3 lines
Quoted 3 lines

control where each user(source IP) is allocated a fixed amount of bandwidth. I also need to do traffic shaping both for the eggress and ingress traffic. Going through LARTC documentation , I found that IMQ

with

Quoted 1 line
Quoted 1 line

HTB will suit my requirement. Is anybody using IMQ with HTB? Can HTB

and

Quoted 11 lines
Quoted 1 line
Quoted 1 line

IMQ work with 2.4.18 kernel? If so, where can i download all the

patches?

Quoted 1 line
Quoted 1 line

It is difficult for us to migrate to 2.4.20 kernel as most of the

software

Quoted 7 lines
Quoted 1 line

has already been developed using 2.4.18 kernel.

http://luxik.cdi.cz/~patrick/imq/
http://luxik.cdi.cz/~devik/qos/htb/
And you don't need imq. If you have a gateway, you can shape on both interface so you can control up- and download traffic.

Just wondering, what kind of software do you developped so you can not

use

Quoted 16 lines
Quoted 6 lines

kernel 2.4.20 ??

Stef

--

Quoted 9 lines

[email protected]
"Using Linux as bandwidth manager"
http://www.docum.org/
#lartc @ irc.oftc.net

_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/

Quoted 8 lines

_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/

_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/

_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/

#10 lore raw
In reply to hanumantha kavuluru

Hare,

: i was going through this thread you mentioned if iam using this Linux : box as a gateway, i dont required IMQ to control ingress and egress how : can do with out IMQ, can you point me
:
: i have 2 interface eth0 and eth1 like to control bandwidth for my users : both up and down

Since the router can only shape traffic it sends, you can shape your outbound (upload) traffic on your Internet connected interface, and you can shape your inbound (download) traffic on the internal interface as you transmit to your internal network. Another way to shape the download bandwidth is to use policing or ingress filters with IMQ.

http://linux-ip.net/htb-script

As Mohan explained, traffic control can delay packets already received from the Internet before sending them to the internal network application, thus simulating a user-specified download bandwidth. Similarly, upload bandwidth can be controlled/shaped by delaying packets bound for the Internet before sending them up to the gateway.

By the way, Stef is on vacation this week. I believe he said he'd be skiing.

Good luck,

-Martin

P.S. I'm thinking of changing my name to "A-router-can-only-shape-the-
traffic-it-sends." I forgot this *again* when I was writing this script. Maybe then I'd remember!

Signature · 5 lines
Martin A. Brown --- SecurePipe, Inc. --- [email protected]

_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/
#11 lore raw
In reply to hanumantha kavuluru

Hi

tthanks, if the IMQ used, then if its keep queing the packets and send and receive.

how about the performance, if like 2000 users or more connection. and latency of the box

hare
----- Original Message -----
From: "Martin A. Brown" <[email protected]>
To: "hare ram" <[email protected]>
Cc: <[email protected]>
Sent: Tuesday, March 04, 2003 2:03 PM
Subject: Re: [LARTC] Need some help on HTB and IMQ

Quoted 29 lines

Hare,

: i was going through this thread you mentioned if iam using this Linux : box as a gateway, i dont required IMQ to control ingress and egress how : can do with out IMQ, can you point me
:
: i have 2 interface eth0 and eth1 like to control bandwidth for my users : both up and down

Since the router can only shape traffic it sends, you can shape your outbound (upload) traffic on your Internet connected interface, and you can shape your inbound (download) traffic on the internal interface as you transmit to your internal network. Another way to shape the download bandwidth is to use policing or ingress filters with IMQ.

http://linux-ip.net/htb-script

As Mohan explained, traffic control can delay packets already received from the Internet before sending them to the internal network application, thus simulating a user-specified download bandwidth. Similarly, upload bandwidth can be controlled/shaped by delaying packets bound for the Internet before sending them up to the gateway.

By the way, Stef is on vacation this week. I believe he said he'd be skiing.

Good luck,

Quoted 10 lines

-Martin

P.S. I'm thinking of changing my name to "A-router-can-only-shape-the-
traffic-it-sends." I forgot this *again* when I was writing this script. Maybe then I'd remember!

--
Martin A. Brown --- SecurePipe, Inc. --- [email protected]

_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/