Strange pings.
Hi.
The configuration script is at the bottom.
My configuration looks similar to this:
imq0
|
1:1 (12mbit)
|
1:2 (10mbit)
|
3:0
|
3:1 (256kbit)
/ \ 3:2 3:3
icmp (rest)
both 3:2 and 3:3 have rate 1kbit ceil 256kbit
Icmp bucklet have priority 1 (better), "rest" bucklet have prio 2 (worse)
I tested the script with heavy download from machine 192.168.1.2 in the background. While the download was going I pinged 192.168.1.1.
All works fine, except pings...
They should be low, and they almost are :)
Pings are fine (0.4ms) for about 120 seconds, then i got pings similar to this:
64 bytes from 192.168.1.1: icmp_seq� ttld time=0.3 ms 64 bytes from 192.168.1.1: icmp_seq� ttld time=0.4 ms 64 bytes from 192.168.1.1: icmp_seq� ttld time�.0 ms 64 bytes from 192.168.1.1: icmp_seq� ttld time#.0 ms 64 bytes from 192.168.1.1: icmp_seq� ttld timeW.0 ms 64 bytes from 192.168.1.1: icmp_seq� ttld time�.0 ms 64 bytes from 192.168.1.1: icmp_seq� ttld time(.0 ms 64 bytes from 192.168.1.1: icmp_seq� ttld timea.0 ms 64 bytes from 192.168.1.1: icmp_seq� ttld time�.0 ms 64 bytes from 192.168.1.1: icmp_seq� ttld time2.0 ms 64 bytes from 192.168.1.1: icmp_seq0 ttld timee.0 ms 64 bytes from 192.168.1.1: icmp_seq1 ttld time=4.0 ms 64 bytes from 192.168.1.1: icmp_seq2 ttld time6.0 ms 64 bytes from 192.168.1.1: icmp_seq3 ttld timei.0 ms 64 bytes from 192.168.1.1: icmp_seq4 ttld time=8.0 ms 64 bytes from 192.168.1.1: icmp_seq5 ttld [email protected] ms 64 bytes from 192.168.1.1: icmp_seq6 ttld times.0 ms 64 bytes from 192.168.1.1: icmp_seq7 ttld time.0 ms 64 bytes from 192.168.1.1: icmp_seq8 ttld time=0.3 ms 64 bytes from 192.168.1.1: icmp_seq9 ttld time=0.3 ms
Then it is stable (0.4ms) for some time.
The same situation repeats in about 60 second delay.
Maybe someone solved this problem?
Thanks for any advice.
Yours sincerly
Maciek
PS. Please don't ask me why this configuration is so strange, I have some reasons to use schemes like this one.
PPS. Is it possible to create a filter that will match all packets?
##### script
iptables -t mangle -F PREROUTING
iptables -t mangle -F POSTROUTING
iptables -t mangle -A PREROUTING -i ! lo -j IMQ --todev 0 iptables -t mangle -A POSTROUTING -o ! lo -j IMQ --todev 1
tc qdisc del root dev imq0
tc qdisc del root dev imq1
tc qdisc add dev imq0 root handle 1 htb default 2
tc qdisc add dev imq1 root handle 1 htb default 2
tc class add dev imq0 parent 1:0 classid 1:1 htb rate 12mbit burst 2k prio 1 quantum 2048 tc class add dev imq1 parent 1:0 classid 1:1 htb rate 12mbit burst 2k prio 1 quantum 2048 tc class add dev imq0 parent 1:1 classid 1:2 htb rate 10mbit burst 2k prio 1 quantum 2048 tc class add dev imq1 parent 1:1 classid 1:2 htb rate 10mbit burst 2k prio 1 quantum 2048 tc qdisc add dev imq0 parent 1:2 handle 3 htb default 3
tc qdisc add dev imq1 parent 1:2 handle 3 htb default 3
tc class add dev imq0 parent 3:0 classid 3:1 htb rate 256kbit burst 2k prio 1 quantum 2048 tc class add dev imq1 parent 3:0 classid 3:1 htb rate 64kbit burst 2k prio 1 quantum 2048
tc class add dev imq0 parent 3:1 classid 3:2 htb rate 1kbit ceil 256kbit burst 2k prio 1 quantum 2048 tc class add dev imq1 parent 3:1 classid 3:2 htb rate 1kbit ceil 64kbit burst 2k prio 1 quantum 2048 tc class add dev imq0 parent 3:1 classid 3:3 htb rate 1kbit ceil 256kbit burst 2k prio 2 quantum 2048 tc class add dev imq1 parent 3:1 classid 3:3 htb rate 1kbit ceil 64kbit burst 2k prio 2 quantum 2048
tc qdisc add dev imq0 parent 3:2 handle 12:0 pfifo limit 4 tc qdisc add dev imq1 parent 3:2 handle 12:0 pfifo limit 4 tc qdisc add dev imq0 parent 3:3 handle 13:0 pfifo limit 4 tc qdisc add dev imq1 parent 3:3 handle 13:0 pfifo limit 4
tc filter add dev imq0 protocol ip parent 3:0 prio 1 u32 match ip protocol 1 0xFF flowid 3:2 tc filter add dev imq1 protocol ip parent 3:0 prio 1 u32 match ip protocol 1 0xFF flowid 3:2
_______________________________________________
LARTC mailing list
[email protected]
http://mailman.ds9a.nl/cgi-bin/mailman/listinfo/lartc
Quoted 1 line · [email protected] wrote:
64 bytes from 192.168.1.1: icmp_seq• ttld time‰.0 ms
Which is about 2 packets @ 256kbit. I tested and got the same behaviour with a simple setup, but max ping about 45 because htb dequeues in pairs by default. If you change #define hysteresis from 1 to 0 in net/sched/sch_htb.c then it's more accurate. Setting Quantum to your MTU may also help.
Quoted 5 lines
Then it is stable (0.4ms) for some time.
The same situation repeats in about 60 second delay.
Maybe someone solved this problem?
Give interactive class more rate than it needs. Latency was OK for me with ICMP class rate 255kbit ceil 256kbit.
Quoted 2 lines
PPS. Is it possible to create a filter that will match all packets?
I don't know about all, but all per protocol like -
.. protocol ip prio 10 u32 match u32 0 0 ..
.. protocol arp prio 11 u32 match u32 0 0 ..
Andy.
_______________________________________________
LARTC mailing list
[email protected]
http://mailman.ds9a.nl/cgi-bin/mailman/listinfo/lartc
Quoted 10 lines · you
Which is about 2 packets @ 256kbit. I tested and got the same behaviour with a simple setup, but max ping about 45 because htb dequeues in pairs by default. If you change #define hysteresis from 1 to 0 in
net/sched/sch_htb.cthen it's more accurate. Setting Quantum to your MTU may also help... protocol ip prio 10 u32 match u32 0 0 ..
.. protocol arp prio 11 u32 match u32 0 0 ..Andy.
Thank you Andy. I'll try your tips in few days.
Yours sincerly
Maciek
_______________________________________________
LARTC mailing list
[email protected]
http://mailman.ds9a.nl/cgi-bin/mailman/listinfo/lartc
Quoted 9 lines · you
Quoted 1 line · [email protected] wrote:
64 bytes from 192.168.1.1: icmp_seq• ttld time‰.0 ms
Which is about 2 packets @ 256kbit. I tested and got the same behaviour with a simple setup, but max ping about 45 because htb dequeues in pairs by default. If you change #define hysteresis from 1 to 0 in
net/sched/sch_htb.cthen it's more accurate. Setting Quantum to your MTU may also help.
ok. I changed hysteresis and I changed quantum.
Quoted 10 lines
Quoted 6 lines
Then it is stable (0.4ms) for some time.
The same situation repeats in about 60 second delay.
Maybe someone solved this problem?
Give interactive class more rate than it needs. Latency was OK for me with ICMP class rate 255kbit ceil 256kbit.
I can't give 255 kbit to icmp traffic :) But for me 4kbit seems to be enough. On testing environment it works fine. But on "real" configuration the pings are still too long.
I wonder if one-level configuration (with just one root qdisc) would give better latency.
Quoted 8 lines
Quoted 2 lines
PPS. Is it possible to create a filter that will match all packets?
I don't know about all, but all per protocol like -
.. protocol ip prio 10 u32 match u32 0 0 ..
.. protocol arp prio 11 u32 match u32 0 0 ..
It works ok for me, but only with prio 0.
Thanks for help.
Maciek.
_______________________________________________
LARTC mailing list
[email protected]
http://mailman.ds9a.nl/cgi-bin/mailman/listinfo/lartc
Quoted 5 lines · [email protected] wrote:
I can't give 255 kbit to icmp traffic :) But for me 4kbit seems to be enough. On testing environment it works fine. But on "real" configuration the pings are still too long.
I wonder if one-level configuration (with just one root qdisc) would give better latency.
I don't know - but I tested with just one root.
Quoted 11 lines
Quoted 9 lines
Quoted 3 lines
PPS. Is it possible to create a filter that will match all packets?
I don't know about all, but all per protocol like -
.. protocol ip prio 10 u32 match u32 0 0 ..
.. protocol arp prio 11 u32 match u32 0 0 ..It works ok for me, but only with prio 0.
FWIW prio 1 is the highest for filters 0 is highest for htb.
If you set 0 you end up with a really high pref - have a look with
tc -s filter ls dev ....
What prio to use depends on what you want, the 10 and 11 are meaningless really unless you have other filters and order matters so the match all can become match all the packets that didn't match a higher prio filter.
Andy.
_______________________________________________
LARTC mailing list
[email protected]
http://mailman.ds9a.nl/cgi-bin/mailman/listinfo/lartc
Quoted 7 lines · Andy Furniss
Quoted 1 line
PPS. Is it possible to create a filter that will match all packets?
I don't know about all, but all per protocol like -
.. protocol ip prio 10 u32 match u32 0 0 ..
.. protocol arp prio 11 u32 match u32 0 0 ..
You can use
.. protocol all prio 1 u32 match u32 0 0 ..
for some reason when I tried, it gave an error - I must have made a mistake as I have just run a script which uses it and it's OK.
Andy
_______________________________________________
LARTC mailing list
[email protected]
http://mailman.ds9a.nl/cgi-bin/mailman/listinfo/lartc