Skip to contentSkip to conversation

dev_forward_skb: do not scrub skb mark within the same name space

PATCH Applied Nicolas Dichtel 3 participants 6 messages Jun 24, 2021 – Jun 25, 2021

Subsystems (2)
lore
Share & tools
lore
#0 lore raw

PATCH 1/1 dev_forward_skb: do not scrub skb mark within the same name space

The goal is to keep the mark during a bpf_redirect(), like it is done for legacy encapsulation / decapsulation, when there is no x-netns. This was initially done in commit 213dd74aee76 ("skbuff: Do not scrub skb mark within the same name space").

When the call to skb_scrub_packet() was added in dev_forward_skb() (commit 8b27f27797ca ("skb: allow skb_scrub_packet() to be used by tunnels")), the second argument (xnet) was set to true to force a call to skb_orphan(). At this time, the mark was always cleanned up by skb_scrub_packet(), whatever xnet value was.
This call to skb_orphan() was removed later in commit 9c4c325252c5 ("skbuff: preserve sock reference when scrubbing the skb."). But this 'true' stayed here without any real reason.

Let's correctly set xnet in ____dev_forward_skb(), this function has access to the previous interface and to the new interface.

---
 include/linux/netdevice.h | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
include/linux/netdevice.h +1 -1
index 5cbc950b34df..5ab2d1917ca1 100644
@@ -4114,7 +4114,7 @@ static __always_inline int ____dev_forward_skb(struct net_device *dev,
 		return NET_RX_DROP;
 	}
 
-	skb_scrub_packet(skb, true);
+	skb_scrub_packet(skb, !net_eq(dev_net(dev), dev_net(skb->dev)));
 	skb->priority = 0;
 	return 0;
 }
Signature · 1 line
2.30.0
#1 lore raw

Hi Nicholas,

Quoted 14 lines · Nicolas Dichtel

The goal is to keep the mark during a bpf_redirect(), like it is done for legacy encapsulation / decapsulation, when there is no x-netns. This was initially done in commit 213dd74aee76 ("skbuff: Do not scrub skb mark within the same name space").

When the call to skb_scrub_packet() was added in dev_forward_skb() (commit 8b27f27797ca ("skb: allow skb_scrub_packet() to be used by tunnels")), the second argument (xnet) was set to true to force a call to skb_orphan(). At this time, the mark was always cleanned up by skb_scrub_packet(), whatever xnet value was.
This call to skb_orphan() was removed later in commit 9c4c325252c5 ("skbuff: preserve sock reference when scrubbing the skb."). But this 'true' stayed here without any real reason.

Quoted 2 lines

Let's correctly set xnet in ____dev_forward_skb(), this function has access to the previous interface and to the new interface.

This change was suggested in the past [1] and I think one of the main concerns was breaking existing callers which assume the mark would be cleared [2].

Personally, I think the suggestion made in [3] adding a flag to bpf_redirect() makes a lot of sense for this use case.

Eyal.

[1] https://lore.kernel.org/netdev/[email protected]/

[2] https://lore.kernel.org/netdev/20180315112150.58586758@halley/

[3] https://lore.kernel.org/netdev/[email protected]/

Quoted 20 lines
---
  include/linux/netdevice.h | 2 +-
  1 file changed, 1 insertion(+), 1 deletion(-)
include/linux/netdevice.h +1 -1
index 5cbc950b34df..5ab2d1917ca1 100644
@@ -4114,7 +4114,7 @@ static __always_inline int ____dev_forward_skb(struct net_device *dev,
  		return NET_RX_DROP;
  	}
 
-	skb_scrub_packet(skb, true);
+	skb_scrub_packet(skb, !net_eq(dev_net(dev), dev_net(skb->dev)));
  	skb->priority = 0;
  	return 0;
  }
#2 lore raw

Hi Eyal,

Le 24/06/2021 à 14:16, Eyal Birger a écrit :

Quoted 17 lines

Hi Nicholas,

Quoted 14 lines · Nicolas Dichtel

The goal is to keep the mark during a bpf_redirect(), like it is done for legacy encapsulation / decapsulation, when there is no x-netns. This was initially done in commit 213dd74aee76 ("skbuff: Do not scrub skb mark within the same name space").

When the call to skb_scrub_packet() was added in dev_forward_skb() (commit 8b27f27797ca ("skb: allow skb_scrub_packet() to be used by tunnels")), the second argument (xnet) was set to true to force a call to skb_orphan(). At this time, the mark was always cleanned up by skb_scrub_packet(), whatever xnet value was.
This call to skb_orphan() was removed later in commit 9c4c325252c5 ("skbuff: preserve sock reference when scrubbing the skb."). But this 'true' stayed here without any real reason.

Quoted 5 lines
Quoted 2 lines

Let's correctly set xnet in ____dev_forward_skb(), this function has access to the previous interface and to the new interface.

This change was suggested in the past [1] and I think one of the main concerns was breaking existing callers which assume the mark would be cleared [2].

Thank you for the pointers!

Quoted 3 lines

Personally, I think the suggestion made in [3] adding a flag to bpf_redirect() makes a lot of sense for this use case.

I began with this approach, but actually, as I tried to explain in the commit log, this looks more like a bug. This function is called almost everywhere in the kernel (except for openvswitch and wireguard) with the xnet argument reflecting a netns change. In other words, the behavior is different between legacy encapsulation and the one made with ebpf :/

Regards,
Nicolas

Quoted 11 lines

Eyal.

[1]
https://lore.kernel.org/netdev/[email protected]/

[2] https://lore.kernel.org/netdev/20180315112150.58586758@halley/

[3]
https://lore.kernel.org/netdev/[email protected]/

#3 lore raw
Quoted 28 lines · Nicolas Dichtel

Hi Eyal,

Le 24/06/2021 à 14:16, Eyal Birger a écrit :

Quoted 17 lines

Hi Nicholas,

Quoted 14 lines · Nicolas Dichtel

The goal is to keep the mark during a bpf_redirect(), like it is done for legacy encapsulation / decapsulation, when there is no x-netns. This was initially done in commit 213dd74aee76 ("skbuff: Do not scrub skb mark within the same name space").

When the call to skb_scrub_packet() was added in dev_forward_skb() (commit 8b27f27797ca ("skb: allow skb_scrub_packet() to be used by tunnels")), the second argument (xnet) was set to true to force a call to skb_orphan(). At this time, the mark was always cleanned up by skb_scrub_packet(), whatever xnet value was.
This call to skb_orphan() was removed later in commit 9c4c325252c5 ("skbuff: preserve sock reference when scrubbing the skb."). But this 'true' stayed here without any real reason.

Quoted 5 lines
Quoted 2 lines

Let's correctly set xnet in ____dev_forward_skb(), this function has access to the previous interface and to the new interface.

This change was suggested in the past [1] and I think one of the main concerns was breaking existing callers which assume the mark would be cleared [2].

Thank you for the pointers!

Quoted 1 line
Quoted 8 lines
Quoted 2 lines

Personally, I think the suggestion made in [3] adding a flag to bpf_redirect() makes a lot of sense for this use case.

I began with this approach, but actually, as I tried to explain in the commit log, this looks more like a bug. This function is called almost everywhere in the kernel (except for openvswitch and wireguard) with the xnet argument reflecting a netns change. In other words, the behavior is different between legacy encapsulation and the one made with ebpf :/

I agree, and was also surprised that ebpf redirection scrubs the mark in the same ns - and only on ingress! - so I think keeping the mark should have been the default behavior. As noted in the thread though it is not clear whether this would break existing deployments both for ebpf and veth pairs on the same ns.

Eyal.

#4 lore raw

Le 25/06/2021 à 10:45, Eyal Birger a écrit :

Quoted 40 lines · Nicolas Dichtel
Quoted 28 lines

Hi Eyal,

Le 24/06/2021 à 14:16, Eyal Birger a écrit :

Quoted 17 lines

Hi Nicholas,

Quoted 14 lines · Nicolas Dichtel

The goal is to keep the mark during a bpf_redirect(), like it is done for legacy encapsulation / decapsulation, when there is no x-netns. This was initially done in commit 213dd74aee76 ("skbuff: Do not scrub skb mark within the same name space").

When the call to skb_scrub_packet() was added in dev_forward_skb() (commit 8b27f27797ca ("skb: allow skb_scrub_packet() to be used by tunnels")), the second argument (xnet) was set to true to force a call to skb_orphan(). At this time, the mark was always cleanned up by skb_scrub_packet(), whatever xnet value was.
This call to skb_orphan() was removed later in commit 9c4c325252c5 ("skbuff: preserve sock reference when scrubbing the skb."). But this 'true' stayed here without any real reason.

Quoted 5 lines
Quoted 2 lines

Let's correctly set xnet in ____dev_forward_skb(), this function has access to the previous interface and to the new interface.

This change was suggested in the past [1] and I think one of the main concerns was breaking existing callers which assume the mark would be cleared [2].

Thank you for the pointers!

Quoted 1 line
Quoted 8 lines
Quoted 2 lines

Personally, I think the suggestion made in [3] adding a flag to bpf_redirect() makes a lot of sense for this use case.

I began with this approach, but actually, as I tried to explain in the commit log, this looks more like a bug. This function is called almost everywhere in the kernel (except for openvswitch and wireguard) with the xnet argument reflecting a netns change. In other words, the behavior is different between legacy encapsulation and the one made with ebpf :/

Quoted 2 lines

I agree, and was also surprised that ebpf redirection scrubs the mark in the same ns - and only on ingress! - so I think keeping the mark should have been

Yes, there is also this asymmetry :/

Quoted 2 lines

the default behavior. As noted in the thread though it is not clear whether this would break existing deployments both for ebpf and veth pairs on the same ns.

To summarize:
- it's not consistent between legacy tunnels and ebpf;
- it's not consistent between ingress and egress;
- it was already fixed in the past for legacy tunnel (commit 213dd74aee76);
- this kind of patch has already been done in the past, see commit
+ 963a88b31ddb ("tunnels: harmonize cleanup done on skb on xmit path");
+ ea23192e8e57 ("tunnels: harmonize cleanup done on skb on rx path");
- nobody stated (on netdev at least) that he relied on this behavior.

For all those reasons, I'm inclined to think that this patch is acceptable. Obviously, it's not my decision ;-)

Note also that clearing the mark is possible directly in the ebpf prog, preserving it not. It means that, in the worst case of someone relying on this, the bug can be fixed without patching the kernel. A trade-off could be to reset the mark in the veth case only.

Side note: the mark was not cleared (for veth) between 2.6.34 and 3.4, see commit 59b9997baba5 ("Revert "net: maintain namespace isolation between vlan and real device"") and the revert was not done due to this ;-)

Comments are welcomed.

Regards,
Nicolas

#5 lore raw
In reply to Nicolas Dichtel
This patch was applied to netdev/net.git (refs/heads/master):

Hello:

This patch was applied to netdev/net.git (refs/heads/master):

Quoted 14 lines · On Thu, 24 Jun 2021 10:05:05 +0200 you wrote:

The goal is to keep the mark during a bpf_redirect(), like it is done for legacy encapsulation / decapsulation, when there is no x-netns. This was initially done in commit 213dd74aee76 ("skbuff: Do not scrub skb mark within the same name space").

When the call to skb_scrub_packet() was added in dev_forward_skb() (commit 8b27f27797ca ("skb: allow skb_scrub_packet() to be used by tunnels")), the second argument (xnet) was set to true to force a call to skb_orphan(). At this time, the mark was always cleanned up by skb_scrub_packet(), whatever xnet value was.
This call to skb_orphan() was removed later in commit 9c4c325252c5 ("skbuff: preserve sock reference when scrubbing the skb."). But this 'true' stayed here without any real reason.

Quoted 1 line

[...]

Here is the summary with links:
- [net] dev_forward_skb: do not scrub skb mark within the same name space

    https://git.kernel.org/netdev/net/c/ff70202b2d1a

You are awesome, thank you!
--
Deet-doot-dot, I am a bot.
https://korg.docs.kernel.org/patchwork/pwbot.html