-j MARK in raw vs. mangle (was Re: xfrm by MARK: tcp problems when mark for in and out differ)
Subsystems (3)
Hi Jamal,
thanks for your help.
Quoted 6 lines
Quoted 3 lines
So it seems like the
fl->markis never initialized with the packet mark in the first place. What would be the correct stage in the kernel network stack to do that?Can you try a simple setup without xfrm/ipsec and see if this reverse path works? Was there a kernel where it worked?
I just tried opening a simple tcp connection without any xfrm or other weird stuff. I just had one iptables rule in place:
-t raw -A OUTPUT -d 192.168.5.200 -j MARK --set-mark 99
192.168.5.200 is the other system I open the tcp connection from. So this should mark all response packets to the client.
But the moment __xfrm_lookup is called (this is where my debug printk sits), fl->mark is always 0.
By chance I changed the rule over to the mangle table:
-t mangle -A OUTPUT -d 192.168.5.200 -j MARK --set-mark 99
Now it works, the mark in the flow is 99!
So it seems this has nothing to do with xfrm, but that the MARK target has different effects when used in raw than in mangle. I was using raw because I had to set conntrack zones too and it was more conveniant to do both in one place.
Can one of the netfilter guys comment on this? Is using MARK in raw not fully supported or has known deficiencies?
Kind regards,
Gerd
PS: sorry for the double post, had an old netfilter-devel address in my mailer.
Signature · 2 lines
Address (better: trap) for people I really don't want to get mail from: [email protected]
Quoted 28 lines · Gerd v. Egidy
Hi Jamal,
thanks for your help.
Quoted 6 lines
Quoted 3 lines
So it seems like the
fl->markis never initialized with the packet mark in the first place. What would be the correct stage in the kernel network stack to do that?Can you try a simple setup without xfrm/ipsec and see if this reverse path works? Was there a kernel where it worked?
I just tried opening a simple tcp connection without any xfrm or other weird stuff. I just had one iptables rule in place:
-t raw -A OUTPUT -d 192.168.5.200 -j MARK --set-mark 99
192.168.5.200 is the other system I open the tcp connection from. So this should mark all response packets to the client.
But the moment
__xfrm_lookupis called (this is where my debug printk sits),fl->markis always 0.By chance I changed the rule over to the mangle table:
-t mangle -A OUTPUT -d 192.168.5.200 -j MARK --set-mark 99
Now it works, the mark in the flow is 99!
Quoted 7 lines
So it seems this has nothing to do with xfrm, but that the MARK target has different effects when used in raw than in mangle. I was using raw because I had to set conntrack zones too and it was more conveniant to do both in one place.
Can one of the netfilter guys comment on this? Is using MARK in raw not fully supported or has known deficiencies?
No, the problem is most likely that for outgoing packets, the XFRM lookup is done with the route lookup before the packet is even sent, so once it hits the raw or mangle table, it is too late. mangle however performs rerouting when the mark value changes, at which point a new XFRM lookup is performed.
Hi Patrick,
Quoted 5 lines
Quoted 5 lines
So it seems this has nothing to do with xfrm, but that the MARK target has different effects when used in raw than in mangle. I was using raw because I had to set conntrack zones too and it was more conveniant to do both in one place.
Quoted 8 lines
Quoted 2 lines
Can one of the netfilter guys comment on this? Is using MARK in raw not fully supported or has known deficiencies?
No, the problem is most likely that for outgoing packets, the XFRM lookup is done with the route lookup before the packet is even sent, so once it hits the raw or mangle table, it is too late. mangle however performs rerouting when the mark value changes, at which point a new XFRM lookup is performed.
ah, this would explain it. Thanks for the explanation. I'll just stick with mangle for marking.
Kind regards,
Gerd
Signature · 2 lines
Address (better: trap) for people I really don't want to get mail from: [email protected]