Skip to contentSkip to conversation

-j MARK in raw vs. mangle (was Re: xfrm by MARK: tcp problems when mark for in and out differ)

DISCUSSION Gerd v. Egidy 2 participants 3 messages Oct 14, 2010 – Oct 15, 2010

Subsystems (3)
lore
Share & tools
lore
#0 lore raw

Hi Jamal,

thanks for your help.

Quoted 6 lines
Quoted 3 lines

So it seems like the fl->mark is never initialized with the packet mark in the first place. What would be the correct stage in the kernel network stack to do that?

Can you try a simple setup without xfrm/ipsec and see if this reverse path works? Was there a kernel where it worked?

I just tried opening a simple tcp connection without any xfrm or other weird stuff. I just had one iptables rule in place:

-t raw -A OUTPUT -d 192.168.5.200 -j MARK --set-mark 99

192.168.5.200 is the other system I open the tcp connection from. So this should mark all response packets to the client.

But the moment __xfrm_lookup is called (this is where my debug printk sits), fl->mark is always 0.

By chance I changed the rule over to the mangle table:

-t mangle -A OUTPUT -d 192.168.5.200 -j MARK --set-mark 99

Now it works, the mark in the flow is 99!

So it seems this has nothing to do with xfrm, but that the MARK target has different effects when used in raw than in mangle. I was using raw because I had to set conntrack zones too and it was more conveniant to do both in one place.

Can one of the netfilter guys comment on this? Is using MARK in raw not fully supported or has known deficiencies?

Kind regards,

Gerd

PS: sorry for the double post, had an old netfilter-devel address in my mailer.

Signature · 2 lines
Address (better: trap) for people I really don't want to get mail from:
[email protected]
#1 lore raw
Quoted 28 lines · Gerd v. Egidy

Hi Jamal,

thanks for your help.

Quoted 6 lines
Quoted 3 lines

So it seems like the fl->mark is never initialized with the packet mark in the first place. What would be the correct stage in the kernel network stack to do that?

Can you try a simple setup without xfrm/ipsec and see if this reverse path works? Was there a kernel where it worked?

I just tried opening a simple tcp connection without any xfrm or other weird stuff. I just had one iptables rule in place:

-t raw -A OUTPUT -d 192.168.5.200 -j MARK --set-mark 99

192.168.5.200 is the other system I open the tcp connection from. So this should mark all response packets to the client.

But the moment __xfrm_lookup is called (this is where my debug printk sits), fl->mark is always 0.

By chance I changed the rule over to the mangle table:

-t mangle -A OUTPUT -d 192.168.5.200 -j MARK --set-mark 99

Now it works, the mark in the flow is 99!

Quoted 7 lines

So it seems this has nothing to do with xfrm, but that the MARK target has different effects when used in raw than in mangle. I was using raw because I had to set conntrack zones too and it was more conveniant to do both in one place.

Can one of the netfilter guys comment on this? Is using MARK in raw not fully supported or has known deficiencies?

No, the problem is most likely that for outgoing packets, the XFRM lookup is done with the route lookup before the packet is even sent, so once it hits the raw or mangle table, it is too late. mangle however performs rerouting when the mark value changes, at which point a new XFRM lookup is performed.

#2 lore raw

Hi Patrick,

Quoted 5 lines
Quoted 5 lines

So it seems this has nothing to do with xfrm, but that the MARK target has different effects when used in raw than in mangle. I was using raw because I had to set conntrack zones too and it was more conveniant to do both in one place.

Quoted 8 lines
Quoted 2 lines

Can one of the netfilter guys comment on this? Is using MARK in raw not fully supported or has known deficiencies?

No, the problem is most likely that for outgoing packets, the XFRM lookup is done with the route lookup before the packet is even sent, so once it hits the raw or mangle table, it is too late. mangle however performs rerouting when the mark value changes, at which point a new XFRM lookup is performed.

ah, this would explain it. Thanks for the explanation. I'll just stick with mangle for marking.

Kind regards,

Gerd

Signature · 2 lines
Address (better: trap) for people I really don't want to get mail from:
[email protected]