HTB: Filtering flat out not working :(
Please please help, i've lost lots of sleep over this.
Here's my set-up:
4 computers on a LAN in my house, having IPs 192.168.0.7, 192.168.0.50, 192.168.0.52, 192.168.0.58.
A router/linux-box (which runs the shaping/tc_commands), which is the default gateway of the 4 machines: 192.168.0.1. It masquerades the internet connection.
Internet connection: ADSL PPPoE. The ADSL modem is connected to eth0 of the router, and PPPoE makes ppp0. eth1 is the LAN. Yes, kernel is compiled correctly (has advanced router option, patched with HTB, etc).
Here's my script. Essentially what I want to do is give each of the 4 ppl a fourth of the bandwidth, giving myself a higher ceiling because I use more bandwidth than they do.
---------------------------------
tc qdisc add dev eth1 root handle 1: htb default 14
tc class add dev eth1 parent 1: classid 1:1 htb rate 12kbps ceil 12kbps
tc class add dev eth1 parent 1:1 classid 1:10 htb rate 4kbps ceil 10kbps burst 1k prio 1 tc class add dev eth1 parent 1:1 classid 1:11 htb rate 4kbps ceil 7kbps burst 1k prio 2 tc class add dev eth1 parent 1:1 classid 1:12 htb rate 4kbps ceil 7kbps burst 1k prio 2 tc class add dev eth1 parent 1:1 classid 1:13 htb rate 4kbps ceil 7kbps burst 1k prio 2 tc class add dev eth1 parent 1:1 classid 1:14 htb rate 1kbps ceil 10kbps burst 1k prio 2
# use SFQ (stochastic fair queueing) for everything tc qdisc add dev eth1 parent 1:10 handle 10: sfq perturb 10 tc qdisc add dev eth1 parent 1:11 handle 11: sfq perturb 10 tc qdisc add dev eth1 parent 1:12 handle 12: sfq perturb 10 tc qdisc add dev eth1 parent 1:13 handle 13: sfq perturb 10 tc qdisc add dev eth1 parent 1:14 handle 14: sfq perturb 10
# matchings tc filter add dev eth1 parent 1:0 protocol ip prio 1 u32 match ip src 192.168.0.7/32 flowid 1:10 tc filter add dev eth1 parent 1:0 protocol ip prio 1 u32 match ip src 192.168.0.58/32 flowid 1:11 tc filter add dev eth1 parent 1:0 protocol ip prio 1 u32 match ip src 192.168.0.50/32 flowid 1:12 tc filter add dev eth1 parent 1:0 protocol ip prio 1 u32 match ip src 192.168.0.52/32 flowid 1:13 --------------------------------------
The PROBLEM: no matter how hard I try, NO packets EVER get onto any flow but the default, 1:14. Eg. my computer (192.168.0.7) can send many packets thru the gateway, and none of them get put on flow 1:10 like they should, they all go onto 1:14, the default. Why?
Add'l QUESTIONS: Which interface should I be using?! Ideally i'd like to use ppp0, but I guess I can't because i'm masquerading? Therefore I should use eth1, the internal lan-side ethernet card? Also, have I got the SFQ tied in right? Perhaps my matchings/filters should use 10:something instead of 1:10 etc? ... I've tried MARKing packets with IPtables, that doesn't work either. Is that a better method ? (I feel that it isn't, right now...)
Lots of questions eh?! All answers appreciated!
Thanks,
Tim Carr
Tim Carr wrote:
I guess that's because your router does masquerading so source addresses are changed , and filters don't match.
Quoted 39 lines
Please please help, i've lost lots of sleep over this. Here's my
set-up: 4 computers on a LAN in my house, having IPs 192.168.0.7, 192.168.0.50, 192.168.0.52, 192.168.0.58.A router/linux-box (which runs the shaping/tc_commands), which is the default gateway of the 4
machines: 192.168.0.1. It masquerades the internet connection.Internet
connection: ADSL PPPoE. The ADSL modem is connected to eth0 of the router, and PPPoE makes ppp0. eth1 is the LAN. Yes, kernel is compiled correctly (has advanced router option, patched with HTB, etc). Here's my script. Essentially what I want to do is give each of the 4 ppl a fourth of the bandwidth, giving myself a higher ceiling because I use more bandwidth than they do. ---------------------------------tc qdisc add dev eth1 root handle 1:
htb default 14 tc class add dev eth1 parent 1: classid 1:1 htb rate 12kbps ceil 12kbpstc class add dev eth1 parent 1:1 classid 1:10 htb rate 4kbps ceil 10kbps burst 1k prio 1tc class add dev eth1 parent 1:1 classid 1:11 htb rate 4kbps ceil 7kbps burst 1k prio 2tc class add dev eth1 parent 1:1 classid 1:12 htb rate 4kbps ceil 7kbps burst 1k prio 2tc class add dev eth1 parent 1:1 classid 1:13 htb rate 4kbps ceil 7kbps burst 1k prio 2tc class add dev eth1 parent 1:1 classid 1:14 htb rate 1kbps ceil 10kbps burst 1k prio 2# use SFQ (stochastic fair queueing) for everything tc qdisc add dev eth1 parent 1:10 handle 10: sfq perturb 10 tc qdisc add dev eth1 parent 1:11 handle 11: sfq perturb 10 tc qdisc add dev eth1 parent 1:12 handle 12: sfq perturb 10 tc qdisc add dev eth1 parent 1:13 handle 13: sfq perturb 10 tc qdisc add dev eth1 parent 1:14 handle 14: sfq perturb 10 # matchings tc filter add dev eth1 parent 1:0 protocol ip prio 1 u32 match ip src 192.168.0.7/32 flowid 1:10 tc filter add dev eth1 parent 1:0 protocol ip prio 1 u32 match ip src 192.168.0.58/32 flowid 1:11 tc filter add dev eth1 parent 1:0 protocol ip prio 1 u32 match ip src 192.168.0.50/32 flowid 1:12 tc filter add dev eth1 parent 1:0 protocol ip prio 1 u32 match ip src 192.168.0.52/32 flowid 1:13-------------------------------------- The PROBLEM: no matter how hard I try, NO packets EVER get onto any flow but the default, 1:14. Eg. my computer (192.168.0.7) can send many packets thru the gateway, and none of them get put on flow 1:10 like they should, they all go onto 1:14, the default. Why? Add'l
Quoted 8 lines
QUESTIONS: Which interface should I be using?! Ideally i'd like to use ppp0, but I guess I can't because i'm masquerading? Therefore I should use eth1, the internal lan-side ethernet card? Also, have I got the SFQ tied in right? Perhaps my matchings/filters should use 10:something instead of 1:10 etc? ... I've tried MARKing packets with IPtables, that doesn't work either. Is that a better method ? (I feel that it isn't, right now...) Lots of questions eh?! All answers appreciated! Thanks, Tim Carr
--
Vincent EGAL
Email : [email protected]
Quoted 11 lines
4 computers on a LAN in my house, having IPs 192.168.0.7,
192.168.0.50, 192.168.0.52, 192.168.0.58. A router/linux-box (which
runs the shaping/tc_commands), which is the default gateway of the 4
machines: 192.168.0.1. It masquerades the internet connection.
Internet connection: ADSL PPPoE. The ADSL modem is connected to eth0
of the router, and PPPoE makes ppp0. eth1 is the LAN. Yes, kernel is
compiled correctly (has advanced router option, patched with HTB,
etc).
[...]
tc filter add dev eth1 parent 1:0 protocol ip prio 1 u32 match ip src 192.168.0.52/32 flowid 1:13
Quoted 4 lines
The PROBLEM: no matter how hard I try, NO packets EVER get onto any flow but the default, 1:14. Eg. my computer (192.168.0.7) can send many packets thru the gateway, and none of them get put on flow 1:10 like they should, they all go onto 1:14, the default. Why?
eth1 is your LAN so that you are QoSing packets going toward you. Then use "dst 192.168.0.52/32" instead of "src 192.168.0.52/32" in your filters.
Quoted 3 lines
Add'l QUESTIONS: Which interface should I be using?! Ideally i'd like to use ppp0, but I guess I can't because i'm masquerading? Therefore I should use eth1, the internal lan-side ethernet card? Also, have I got
depends what direction you want to masquerade ;)
devik
_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/
Quoted 9 lines
From: Martin Devera <[email protected]>
To: Tim Carr <[email protected]>
CC: [email protected]
Subject: Re: [LARTC] HTB: Filtering flat out not working :(
Date: Thu, 28 Feb 2002 09:54:31 +0100 (CET)
Quoted 3 lines
eth1 is your LAN so that you are QoSing packets going toward you. Then use "dst 192.168.0.52/32" instead of "src 192.168.0.52/32" in your filters.
Ahh right. So i'm trying to do the impossible, shape the packets coming from the lan... crap. But if I do things on destination like you've mentioned, things still don't get picked up (same problem, still doesn't work). My guess is this is because the returned masqueraded packets don't have a clean destination of 192.168.0.x etc, they have some funky return address so they aren't matching the filters (still). Argh. Is there no solution for QoSing masq'd connections?! Another person suggested MARKing the packets, but as I already wrote, I haven't had luck with this either.
Tim
_________________________________________________________________
Chat with friends online, try MSN Messenger: http://messenger.msn.com
_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/
Absolutely, but you'll notice in my follow up post that nowhere does it tell you how to use 'tc' to throw the MARKed packets into a certain flow. The HOWTO tells you how to route marked packets, not how to shape them... ideas? do you happen to know the TC command sytax? All i need is one example....
tim
Quoted 25 lines
From: Ben <[email protected]>
To: Tim Carr <[email protected]>
Subject: Re: [LARTC] HTB: Filtering flat out not working :(
Date: Thu, 28 Feb 2002 09:54:44 -0800 (PST)Actually, somebody replied with the idea of using fwmarks. That sounds perfect to me.... mark on the internal interface, and then sort on the external interface.
Quoted 3 lines · Tim Carr
Quoted 3 lines
My understanding - and it's not very complete because I also just sent
out
Quoted 3 lines
Quoted 3 lines
mail about my htb setup not working :) - is that you want to place the qdisc on the output interface - in this case, ppp. And in your case, I think you're right, you can't do that, because you're doing masq.
There's
Quoted 3 lines
Quoted 1 line
something called ingres policing you might look at.
So you don't think HTB could work for masquerading at all?! My idea was
to
Quoted 2 lines
put it on ETH1 (local lan side). That way packets get shaped before they even hit the masquerading. I guess the masquerading is happening even
Quoted 16 lines
before
Quoted 3 lines
eth1's filtering rules get used.
What about setting up a virtual ethernet adapter or something of the
like;
Quoted 1 line
setting that as the gateway for the LAN machines, doing the shaping,
THEN
Quoted 8 lines
forwarding it to ETH1?
Tim
_________________________________________________________________
Chat with friends online, try MSN Messenger: http://messenger.msn.com
_________________________________________________________________
Chat with friends online, try MSN Messenger: http://messenger.msn.com
_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/
Hi,
this one is borrowed and modified from one example in the iproute2-package (Edge..):
###############################################################################
# DS-marking packets using iptables fw-marking
TC=tc
IP=ip
EGDEV="dev eth0"
# Flush chain
iptables -F OUTPUT -t mangle
# Mark Packets according to destination port number
iptables -I OUTPUT -t mangle -p udp --destination-port 5003 -j MARK --set-mark 3 iptables -I OUTPUT -t mangle -p udp --destination-port 5002 -j MARK --set-mark 2 iptables -I OUTPUT -t mangle -p udp --destination-port 5001 -j MARK --set-mark 1
iptables -L OUTPUT -t mangle
echo
# attach a dsmarker
#
$TC qdisc add $EGDEV handle 1:0 root dsmark indices 64 set_tc_index
#
# values of the DSCP to change depending on the class
#
#becomes EF
$TC class change $EGDEV classid 1:1 dsmark mask 0x3 \
value 0xb8
#becomes AF11
$TC class change $EGDEV classid 1:2 dsmark mask 0x3 \
value 0x28
#becomes AF21
$TC class change $EGDEV classid 1:3 dsmark mask 0x3 \
value 0x48
#
#
# The class mapping
#
$TC filter add $EGDEV parent 1:0 protocol ip prio 4 handle 1 fw flowid 1:1
$TC filter add $EGDEV parent 1:0 protocol ip prio 4 handle 2 fw flowid 1:2
$TC filter add $EGDEV parent 1:0 protocol ip prio 4 handle 3 fw flowid 1:3
#echo "---- qdisc parameters Egress ----------"
$TC qdisc ls $EGDEV
echo "---- Class parameters Egress ----------"
$TC class ls $EGDEV
echo "---- filter parameters Egress ----------"
$TC filter ls $EGDEV parent 1:0
Quoted 55 lines · Tim Carr
Absolutely, but you'll notice in my follow up post that nowhere does it tell you how to use 'tc' to throw the MARKed packets into a certain flow. The HOWTO tells you how to route marked packets, not how to shape them... ideas? do you happen to know the TC command sytax? All i need is one example....
tim
Quoted 27 lines
From: Ben <[email protected]>
To: Tim Carr <[email protected]>
Subject: Re: [LARTC] HTB: Filtering flat out not working :(
Date: Thu, 28 Feb 2002 09:54:44 -0800 (PST)Actually, somebody replied with the idea of using fwmarks. That sounds perfect to me.... mark on the internal interface, and then sort on the external interface.
Quoted 3 lines · Tim Carr
Quoted 3 lines
My understanding - and it's not very complete because I also just
sent out
Quoted 1 line
Quoted 1 line
mail about my htb setup not working :) - is that you want to place
the
Quoted 1 line
Quoted 1 line
qdisc on the output interface - in this case, ppp. And in your
case, I
Quoted 1 line
Quoted 1 line
think you're right, you can't do that, because you're doing masq.
There's
Quoted 3 lines
Quoted 1 line
something called ingres policing you might look at.
So you don't think HTB could work for masquerading at all?! My idea
was to
Quoted 1 line
put it on ETH1 (local lan side). That way packets get shaped before
they
Quoted 17 lines
Quoted 1 line
even hit the masquerading. I guess the masquerading is happening
even before
Quoted 3 lines
eth1's filtering rules get used.
What about setting up a virtual ethernet adapter or something of
the like;
Quoted 1 line
setting that as the gateway for the LAN machines, doing the
shaping, THEN
Quoted 8 lines
forwarding it to ETH1?
Tim
_________________________________________________________________
Chat with friends online, try MSN Messenger: http://messenger.msn.com
Quoted 7 lines
_________________________________________________________________
Chat with friends online, try MSN Messenger: http://messenger.msn.com_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/
_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/
I've seen examples like this, but what I'm not clear on is if the filter handle has to be the same as the fwmark or if the flowid has to be <class parent>:<fwmark>. Either way seems not right, but nothing else seems to make sense, based on the examples I've seen.
Quoted 14 lines · Viktor Kemmet
# Mark Packets according to destination port number
iptables -I OUTPUT -t mangle -p udp --destination-port 5003 -j MARK --set-mark 3 iptables -I OUTPUT -t mangle -p udp --destination-port 5002 -j MARK --set-mark 2 iptables -I OUTPUT -t mangle -p udp --destination-port 5001 -j MARK --set-mark 1$TC class change $EGDEV classid 1:1 dsmark mask 0x3 \ value 0xb8 #becomes AF11 $TC class change $EGDEV classid 1:2 dsmark mask 0x3 \ value 0x28 #becomes AF21 $TC class change $EGDEV classid 1:3 dsmark mask 0x3 \ value 0x48
Quoted 3 lines
$TC filter add $EGDEV parent 1:0 protocol ip prio 4 handle 1 fw flowid 1:1 $TC filter add $EGDEV parent 1:0 protocol ip prio 4 handle 2 fw flowid 1:2 $TC filter add $EGDEV parent 1:0 protocol ip prio 4 handle 3 fw flowid 1:3
_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/
being honest, I don't understand the "handle" keyword in this command ;-) The numbers 1, 2, 3, I think they belong to the "fw" keyword.
Quoted 22 lines · Ben
I've seen examples like this, but what I'm not clear on is if the filter handle has to be the same as the fwmark or if the flowid has to be <class parent>:<fwmark>. Either way seems not right, but nothing else seems to make sense, based on the examples I've seen.
Quoted 14 lines · Viktor Kemmet
# Mark Packets according to destination port number
iptables -I OUTPUT -t mangle -p udp --destination-port 5003 -j MARK --set-mark 3 iptables -I OUTPUT -t mangle -p udp --destination-port 5002 -j MARK --set-mark 2 iptables -I OUTPUT -t mangle -p udp --destination-port 5001 -j MARK --set-mark 1$TC class change $EGDEV classid 1:1 dsmark mask 0x3 \ value 0xb8 #becomes AF11 $TC class change $EGDEV classid 1:2 dsmark mask 0x3 \ value 0x28 #becomes AF21 $TC class change $EGDEV classid 1:3 dsmark mask 0x3 \ value 0x48
Quoted 10 lines
Quoted 4 lines
$TC filter add $EGDEV parent 1:0 protocol ip prio 4 handle 1 fw flowid 1:1 $TC filter add $EGDEV parent 1:0 protocol ip prio 4 handle 2 fw flowid 1:2 $TC filter add $EGDEV parent 1:0 protocol ip prio 4 handle 3 fw flowid 1:3
_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/
_______________________________________________
LARTC mailing list / [email protected]
http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/
Quoted 2 lines · Viktor Kemmet
being honest, I don't understand the "handle" keyword in this command ;-) The numbers 1, 2, 3, I think they belong to the "fw" keyword.
They do.
Signature · 6 lines
http://www.PowerDNS.com Versatile DNS Software & Services http://www.tk the dot in .tk http://lartc.org Linux Advanced Routing & Traffic Control HOWTO _______________________________________________ LARTC mailing list / [email protected] http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/
Quoted 5 lines · you
Absolutely, but you'll notice in my follow up post that nowhere does it tell you how to use 'tc' to throw the MARKed packets into a certain flow. The HOWTO tells you how to route marked packets, not how to shape them... ideas? do you happen to know the TC command sytax? All i need is one example....
I use the fw filter all the time. I have a lot of examples on docum.org. The idea is simple. You mark a packet and you use that mark to catch the packets with the fw filter.
The number of the mark is not important and has nothing to do with the class. The handle keyword is to say wich mark the filter has to use. So handle 10 will catch all packets with mark 10.
Stef
Signature · 6 lines
[email protected] More QOS info : http://www.docum.org/ Title : "Using Linux as bandwidth manager" _______________________________________________ LARTC mailing list / [email protected] http://mailman.ds9a.nl/mailman/listinfo/lartc HOWTO: http://lartc.org/