sangoma WAN boards with lartc
Hi
anyone using sangoma hardware with lartc? pls let me know
Thanks
Imthiyaz
Original Message:
-----------------
From: [email protected]
Date: Fri, 15 Jun 2007 12:00:07 +0200 (CEST)
To: [email protected]
Subject: LARTC Digest, Vol 28, Issue 23
Send LARTC mailing list submissions to
[email protected]
To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.ds9a.nl/cgi-bin/mailman/listinfo/lartc
or, via email, send a message with subject or body 'help' to
[email protected]
You can reach the person managing the list at
[email protected]
When replying, please edit your Subject line so it is more specific than "Re: Contents of LARTC digest..."
Today's Topics:
1. RE: Re: PQ questions (Tim Enos)
2. Re: PQ questions (Christian Benvenuti)
3. RE: Re: PQ questions (Salim S I)
4. Re: PQ questions (Christian Benvenuti)
5. RE: Re: PQ questions (Salim S I)
6. RE: Re: multiple routing tables for internal router programs (Salim S I)
----------------------------------------------------------------------
Message: 1
Date: Fri, 15 Jun 2007 02:43:21 -0400
From: "Tim Enos" <[email protected]>
Subject: RE: [LARTC] Re: PQ questions
To: "'Christian Benvenuti'" <[email protected]>,
<[email protected]>
Message-ID: <[email protected]>
Content-Type: text/plain; charset="us-ascii"
Hi Christian,
Thanks for the help. Please see my in-line comments:
Quoted 62 lines
-----Original Message-----
From: [email protected] [mailto:[email protected]] On Behalf Of Christian Benvenuti
Sent: Thursday, June 14, 2007 4:44 PM
To: [email protected]
Subject: [LARTC] Re: PQ questionsHi,
Quoted 6 lines
Hi all,
First, let me say I've been most impressed with how quickly and professionally people on this list ask and answer questions.
Next, let me say that with which I need help is properly configuring
strict
Quoted 3 lines
PQ, and gathering certain stats. Specifically:
- I need to create a priority queue with four queues (let's say they are
of
Quoted 26 lines
high, medium, normal, and low priority)
- I need to use tc filters such that:
- EF (
0xB8) goes to the high priority queue- AF21 (
0x50) goes to the medium priority queue- AF11 (
0x28) goes to the normal priority queue, and- BE traffic goes to the low priority queue
- For stat collection, I need to see:
- how many bytes and packets are in each of the four queues
- My configuration thus far is:
tc qdisc add dev
eml_testroot handle 1: prio bands 4 priomap 0 1 2 3tc filter add dev
eml_testparent 1:0 prio 1 protocol ip u32 match ip tos0xb80xffflowid 1:1tc filter add dev
eml_testparent 1:0 prio 2 protocol ip u32 match ip tos0x800xffflowid 1:2Quoted 6 lines
tc filter add dev
eml_testparent 1:0 prio 3 protocol ip u32 match ip tos0x500xffflowid 1:3tc filter add dev
eml_testparent 1:0 prio 4 protocol ip u32 match ip tos0x000xffflowid 1:4
__________Here is an article you may find useful:
http://citeseer.ist.psu.edu/539891.htmlHere is the description of the configuration parameters of the PRIO qdisc:
http://www.lartc.org/howto/lartc.qdisc.classful.html#AEN903
(just in case you did not know what the "priomap" option is
used for)
Quoted 8 lines
Quoted 3 lines
My questions are:
- What if anything is missing/requiring change in my config given the
stated
Quoted 1 line
requirements?
Your config does not prevent an higher priority class from starving a lower priority class.
Exactly. That is requirement.
Quoted 2 lines
You can prevent it in two different ways (at
least):
Don't want to prevent it right now.
Quoted 20 lines
1) You can assign a TBF qdisc (Token Bucket) to the PRIO classes
TBF: http://www.lartc.org/howto/lartc.qdisc.classless.html#AEN6912) You can replace the PRIO qdisc with something like HTB/CBQ
CBQ: http://www.lartc.org/howto/lartc.qdisc.classful.html#AEN939
HTB: http://luxik.cdi.cz/~devik/qos/htb/Quoted 1 line
- What if any command should I use to view how many bytes and packets are
in
Quoted 1 line
each of the four queues?
The PRIO qdisc does not return statistics for its classes. However, a simple workaround consists of explicitly adding a qdisc to the four classes.
By default the PRIO qdisc assigns a pFIFO (packet FIFO) qdisc to its classes.
Here is how you can replace the 4 default pFIFO qdisc with 4 explicit pFIFO qdisc:
Quoted 7 lines
tc qdisc add dev
eml_testparent 1:1 pfifo limit 1000 tc qdisc add deveml_testparent 1:2 pfifo limit 1000 tc qdisc add deveml_testparent 1:3 pfifo limit 1000 tc qdisc add deveml_testparent 1:4 pfifo limit 1000Now you can get the stats with:
tc -s -d qdisc list deveml_test
Those stats are nice to have, but the ones I must have are for how many bytes/packets are enqueued at whatever time I check the queues.
Quoted 5 lines
Regards
/Christian
[ http://benve.info ]
I have tried to configure PQ to have two queues per filter with no success. Is it even possible to have (what I'll call) hierarchical PQ? I have yet to find it.
Quoted 8 lines
_______________________________________________
LARTC mailing list
[email protected]
http://mailman.ds9a.nl/cgi-bin/mailman/listinfo/lartc
------------------------------
Message: 2
Date: Fri, 15 Jun 2007 09:32:06 +0200
From: Christian Benvenuti <[email protected]>
Subject: [LARTC] Re: PQ questions
To: [email protected]
Message-ID: <1181892726.2702.7.camel@benve-laptop>
Content-Type: text/plain
Hi,
Quoted 4 lines
Quoted 2 lines
Your config does not prevent an higher priority class from starving a lower priority class.
Exactly. That is requirement.
OK
Quoted 2 lines
Those stats are nice to have, but the ones I must have are for how many bytes/packets are enqueued at whatever time I check the queues.
That information is there. Here is an example:
(b=bytes p=packets)
#tc -s -d qdisc list dev eth1
qdisc prio 1: root bands 3 priomap 1 2 2 2 1 2 0 0 1 1 1 1 1 1 1 1
Sent 85357186 bytes 59299 pkt (dropped 0, overlimits 0 requeues 0) rate 0bit 0pps backlog 0b 35p requeues 0
+-> This field is not initialized for this
qdisc type
qdisc pfifo 10: parent 1:1 limit 1000p
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
rate 0bit 0pps backlog 0b 0p requeues 0
^^^^^^^^^^^^^
qdisc pfifo 20: parent 1:2 limit 1000p
Sent 85357120 bytes 59298 pkt (dropped 0, overlimits 0 requeues 0)
rate 0bit 0pps backlog 50470b 35p requeues 0
^^^^^^^^^^^^^^^^^^
qdisc pfifo 30: parent 1:3 limit 1000p
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
rate 0bit 0pps backlog 0b 0p requeues 0
^^^^^^^^^^^^^Quoted 1 line
I have tried to configure PQ to have two queues per filter with no
success.
What do you mean?
Quoted 1 line
Is it even possible to have (what I'll call) hierarchical PQ? I have yet
to
Quoted 1 line
find it.
Something like this?
tc qdisc add dev eth1 handle 1: root prio
tc qdisc add dev eth1 parent 1:1 handle 10 prio
tc qdisc add dev eth1 parent 1:2 handle 20 prio
tc qdisc add dev eth1 parent 1:3 handle 30 prio
Regards
/Christian
[ http://benve.info ]
------------------------------
Message: 3
Date: Fri, 15 Jun 2007 15:46:31 +0800
From: "Salim S I" <[email protected]>
Subject: RE: [LARTC] Re: PQ questions
To: "'Christian Benvenuti'" <[email protected]>,
<[email protected]>
Message-ID: <001801c7af21$4d9a5510$5964a8c0@SalimSi>
Content-Type: text/plain; charset="us-ascii"
Slightly offtopic... Has anyone really experienced starving of low priority traffic with PRIO qdisc?
In my setup, I never achieved that, though I also wanted exactly that situation. I gave both the classes same amount of traffic at the same time. High prio got more bandwidth, but no starvation, even after I sent more traffic than the link capacity.
Quoted 2 lines
-----Original Message-----
From: [email protected]
[mailto:[email protected]]
Quoted 8 lines
On Behalf Of Christian Benvenuti
Sent: Friday, June 15, 2007 3:32 PM
To: [email protected]
Subject: [LARTC] Re: PQ questionsHi,
Quoted 1 line
Quoted 1 line
Your config does not prevent an higher priority class from
starving
Quoted 7 lines
Quoted 3 lines
Quoted 1 line
a lower priority class.
Exactly. That is requirement.
OK
Quoted 1 line
Those stats are nice to have, but the ones I must have are for how
many
Quoted 25 lines
Quoted 1 line
bytes/packets are enqueued at whatever time I check the queues.
That information is there. Here is an example:
(b=bytes p=packets)#tc -s -d qdisc list dev eth1
qdisc prio 1: root bands 3 priomap 1 2 2 2 1 2 0 0 1 1 1 1 1 1 1 1
Sent 85357186 bytes 59299 pkt (dropped 0, overlimits 0 requeues 0) rate 0bit 0pps backlog 0b 35p requeues 0+-> This field is not initialized for this qdisc type qdisc pfifo 10: parent 1:1 limit 1000p Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0) rate 0bit 0pps backlog 0b 0p requeues 0 ^^^^^^^^^^^^^ qdisc pfifo 20: parent 1:2 limit 1000p Sent 85357120 bytes 59298 pkt (dropped 0, overlimits 0 requeues 0) rate 0bit 0pps backlog 50470b 35p requeues 0 ^^^^^^^^^^^^^^^^^^ qdisc pfifo 30: parent 1:3 limit 1000p Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0) rate 0bit 0pps backlog 0b 0p requeues 0 ^^^^^^^^^^^^^
Quoted 6 lines
Quoted 1 line
I have tried to configure PQ to have two queues per filter with no
success.
What do you mean?
Quoted 1 line
Is it even possible to have (what I'll call) hierarchical PQ? I have
yet
Quoted 15 lines
to
Quoted 1 line
find it.
Something like this?
tc qdisc add dev eth1 handle 1: root prio
tc qdisc add dev eth1 parent 1:1 handle 10 prio
tc qdisc add dev eth1 parent 1:2 handle 20 prio
tc qdisc add dev eth1 parent 1:3 handle 30 prioRegards
/Christian
[ http://benve.info ]
Quoted 4 lines
_______________________________________________
LARTC mailing list
[email protected]
http://mailman.ds9a.nl/cgi-bin/mailman/listinfo/lartc
------------------------------
Message: 4
Date: Fri, 15 Jun 2007 10:16:12 +0200
From: Christian Benvenuti <[email protected]>
Subject: [LARTC] Re: PQ questions
To: [email protected]
Message-ID: <1181895372.2702.20.camel@benve-laptop>
Content-Type: text/plain
Hi,
a class is starved only if those with higher priority are
always (of pretty often) backlogged and do not give the lower priority classes a chance to transmit.
Therefore, if you transmit at a rate smaller than your CPU/s and NIC/s can handle you will not experience any starving.
For example, if you generate 50Mbit traffic on a 100Mbit NIC it is likely that you won't see any starving (unless your system is not able to handle 50Mbit traffic because of a complex TC or iptables configuration that consumes lot of CPU).
Regards
/Christian
[ http://benve.info ]
Quoted 52 lines · Salim S I
Slightly offtopic... Has anyone really experienced starving of low priority traffic with PRIO qdisc?
In my setup, I never achieved that, though I also wanted exactly that situation. I gave both the classes same amount of traffic at the same time. High prio got more bandwidth, but no starvation, even after I sent more traffic than the link capacity.Quoted 2 lines
-----Original Message-----
From: [email protected][mailto:[email protected]]
Quoted 8 lines
On Behalf Of Christian Benvenuti
Sent: Friday, June 15, 2007 3:32 PM
To: [email protected]
Subject: [LARTC] Re: PQ questionsHi,
Quoted 1 line
Quoted 1 line
Your config does not prevent an higher priority class from
starving
Quoted 7 lines
Quoted 3 lines
Quoted 1 line
a lower priority class.
Exactly. That is requirement.
OK
Quoted 1 line
Those stats are nice to have, but the ones I must have are for how
many
Quoted 25 lines
Quoted 1 line
bytes/packets are enqueued at whatever time I check the queues.
That information is there. Here is an example:
(b=bytes p=packets)#tc -s -d qdisc list dev eth1
qdisc prio 1: root bands 3 priomap 1 2 2 2 1 2 0 0 1 1 1 1 1 1 1 1
Sent 85357186 bytes 59299 pkt (dropped 0, overlimits 0 requeues 0) rate 0bit 0pps backlog 0b 35p requeues 0+-> This field is not initialized for this qdisc type qdisc pfifo 10: parent 1:1 limit 1000p Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0) rate 0bit 0pps backlog 0b 0p requeues 0 ^^^^^^^^^^^^^ qdisc pfifo 20: parent 1:2 limit 1000p Sent 85357120 bytes 59298 pkt (dropped 0, overlimits 0 requeues 0) rate 0bit 0pps backlog 50470b 35p requeues 0 ^^^^^^^^^^^^^^^^^^ qdisc pfifo 30: parent 1:3 limit 1000p Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0) rate 0bit 0pps backlog 0b 0p requeues 0 ^^^^^^^^^^^^^
Quoted 20 lines
Quoted 6 lines
Quoted 1 line
I have tried to configure PQ to have two queues per filter with no
success.
What do you mean?
Quoted 1 line
Is it even possible to have (what I'll call) hierarchical PQ? I have
yet
Quoted 13 lines
to
Quoted 1 line
find it.
Something like this?
tc qdisc add dev eth1 handle 1: root prio
tc qdisc add dev eth1 parent 1:1 handle 10 prio
tc qdisc add dev eth1 parent 1:2 handle 20 prio
tc qdisc add dev eth1 parent 1:3 handle 30 prioRegards
/Christian
[ http://benve.info ]
------------------------------
Message: 5
Date: Fri, 15 Jun 2007 17:13:48 +0800
From: "Salim S I" <[email protected]>
Subject: RE: [LARTC] Re: PQ questions
To: "'Christian Benvenuti'" <[email protected]>,
<[email protected]>
Message-ID: <001901c7af2d$7c6e21d0$5964a8c0@SalimSi>
Content-Type: text/plain; charset="us-ascii"
I tested on wireless link. It could give a maximum of 45Mbps. And I sent 30Mbps of both low prio and high prio traffic. Total of 60Mbps. My test was done with UDP, using tcpdump. When I increased the bandwidth to 40Mbps each, the high priority class got lesser bandwidth. (maybe the effect of the known issue that large amount of low prio traffic can starve high prio traffic)
Quoted 2 lines
-----Original Message-----
From: [email protected]
[mailto:[email protected]]
Quoted 17 lines
On Behalf Of Christian Benvenuti
Sent: Friday, June 15, 2007 4:16 PM
To: [email protected]
Subject: [LARTC] Re: PQ questionsHi,
a class is starved only if those with higher priority are
always (of pretty often) backlogged and do not give the lower priority classes a chance to transmit.
Therefore, if you transmit at a rate smaller than your CPU/s and NIC/s can handle you will not experience any starving.For example, if you generate 50Mbit traffic on a 100Mbit NIC it is likely that you won't see any starving (unless your system is not able to handle 50Mbit traffic because of a complex TC or iptables configuration that consumes lot of CPU).
Quoted 8 lines
Regards
/Christian
[ http://benve.info ]Quoted 3 lines · Salim S I
Slightly offtopic... Has anyone really experienced starving of low priority traffic with PRIO qdisc?
In my setup, I never achieved that, though I also wanted exactly
that
Quoted 1 line
Quoted 1 line
situation. I gave both the classes same amount of traffic at the
same
Quoted 1 line
Quoted 1 line
time. High prio got more bandwidth, but no starvation, even after I
sent
Quoted 13 lines
Quoted 13 lines
more traffic than the link capacity.
Quoted 2 lines
-----Original Message-----
From: [email protected][mailto:[email protected]]
Quoted 8 lines
On Behalf Of Christian Benvenuti
Sent: Friday, June 15, 2007 3:32 PM
To: [email protected]
Subject: [LARTC] Re: PQ questionsHi,
Quoted 1 line
Quoted 1 line
Your config does not prevent an higher priority class from
Quoted 8 lines
Quoted 8 lines
starving
Quoted 7 lines
Quoted 3 lines
Quoted 1 line
a lower priority class.
Exactly. That is requirement.
OK
Quoted 1 line
Those stats are nice to have, but the ones I must have are for
how
Quoted 9 lines
Quoted 9 lines
many
Quoted 8 lines
Quoted 1 line
bytes/packets are enqueued at whatever time I check the queues.
That information is there. Here is an example:
(b=bytes p=packets)#tc -s -d qdisc list dev eth1
qdisc prio 1: root bands 3 priomap 1 2 2 2 1 2 0 0 1 1 1 1 1 1 1
1
Quoted 1 line
Quoted 1 line
Quoted 1 line
Sent 85357186 bytes 59299 pkt (dropped 0, overlimits 0 requeues
0)
Quoted 2 lines
Quoted 2 lines
Quoted 2 lines
rate 0bit 0pps backlog 0b 35p requeues 0
+-> This field is not initialized for
this
Quoted 7 lines
Quoted 7 lines
Quoted 7 lines
qdisc type
qdisc pfifo 10: parent 1:1 limit 1000p
Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0)
rate 0bit 0pps backlog 0b 0p requeues 0^^^^^^^^^^^^^qdisc pfifo 20: parent 1:2 limit 1000p
Sent 85357120 bytes 59298 pkt (dropped 0, overlimits 0 requeues
0)
Quoted 8 lines
Quoted 8 lines
Quoted 8 lines
rate 0bit 0pps backlog 50470b 35p requeues 0
^^^^^^^^^^^^^^^^^^ qdisc pfifo 30: parent 1:3 limit 1000p Sent 0 bytes 0 pkt (dropped 0, overlimits 0 requeues 0) rate 0bit 0pps backlog 0b 0p requeues 0 ^^^^^^^^^^^^^Quoted 1 line
I have tried to configure PQ to have two queues per filter with
no
Quoted 5 lines
Quoted 5 lines
Quoted 5 lines
success.
What do you mean?
Quoted 1 line
Is it even possible to have (what I'll call) hierarchical PQ? I
have
Quoted 16 lines
Quoted 14 lines
yet
Quoted 13 lines
to
Quoted 1 line
find it.
Something like this?
tc qdisc add dev eth1 handle 1: root prio tc qdisc add dev eth1 parent 1:1 handle 10 prio tc qdisc add dev eth1 parent 1:2 handle 20 prio tc qdisc add dev eth1 parent 1:3 handle 30 prio
Regards
/Christian
[ http://benve.info ]
Quoted 4 lines
_______________________________________________
LARTC mailing list
[email protected]
http://mailman.ds9a.nl/cgi-bin/mailman/listinfo/lartc
------------------------------
Message: 6
Date: Fri, 15 Jun 2007 17:36:20 +0800
From: "Salim S I" <[email protected]>
Subject: RE: [LARTC] Re: multiple routing tables for internal router
programs
To: "'Peter Rabbitson'" <[email protected]>
Cc: [email protected]
Message-ID: <001a01c7af30$a4c23330$5964a8c0@SalimSi>
Content-Type: text/plain; charset="us-ascii"
Quoted 2 lines
-----Original Message-----
From: [email protected]
[mailto:[email protected]]
Quoted 6 lines
On Behalf Of Peter Rabbitson
Sent: Friday, June 15, 2007 2:30 PM
Cc: [email protected]
Subject: Re: [LARTC] Re: multiple routing tables for internal router programs
Well then you are certainly ahead of the game. Still I would suggest
to
Quoted 1 line
avoid the complexity of bit mask marks - it is rather error prone and
is
Quoted 3 lines
pretty hard to maintain, while the same result can usually be achieved by other means (like in my SNAT example). As far as your original problem goes - it seems like a mark is getting eaten away or is not
set
Quoted 1 line
somewhere in the first place. I have not had any problems like the
ones
Quoted 1 line
you describe.
Those different MARKs are used for policy-routing, load balancing, firewall, traffic control, virtual server, user-group profiles etc. I think eventually you may have to use it, warts and all, or find some other way for integrating all those. :-) I will soon run out of bits, it seems.
I've replaced that multipath rule for local packets with a single route, and change it on failovers. No balancing for local traffic, but there isn't much local traffic anyway.
------------------------------
_______________________________________________
LARTC mailing list
[email protected]
http://mailman.ds9a.nl/cgi-bin/mailman/listinfo/lartc
End of LARTC Digest, Vol 28, Issue 23
*************************************
--------------------------------------------------------------------
mail2web LIVE – Free email based on Microsoft® Exchange technology -
http://link.mail2web.com/LIVE
_______________________________________________
LARTC mailing list
[email protected]
http://mailman.ds9a.nl/cgi-bin/mailman/listinfo/lartc