Skip to contentSkip to conversation

packet: Deliver VLAN TPID to userspace

PATCH RESEND Superseded Atzm Watanabe 4 participants 7 messages Oct 22, 2013 – Nov 7, 2013

Subsystems (3)

v1 of 4 Superseded Latest is v4 →

lore
Share & tools
lore
#0 lore raw

PATCH RESEND 1/1 packet: Deliver VLAN TPID to userspace

After the 802.1AD support, userspace packet receivers (packet dumper, software switch, and the like) need how to know VLAN TPID in order to reassemble original tagged frame.

---
struct tpacket_hdr_variant1 looks like that is allowed to grow, as the length combined with struct tpacket3_hdr is explicit at run-time.

 include/uapi/linux/if_packet.h | 5 +++--
 net/packet/af_packet.c         | 8 ++++++--
 2 files changed, 9 insertions(+), 4 deletions(-)
include/uapi/linux/if_packet.h +3 -2
index dbf0666..6e36e0a 100644
@@ -83,7 +83,7 @@ struct tpacket_auxdata {
 	__u16		tp_mac;
 	__u16		tp_net;
 	__u16		tp_vlan_tci;
-	__u16		tp_padding;
+	__u16		tp_vlan_tpid;
 };
 
 /* Rx ring - header status */
@@ -132,12 +132,13 @@ struct tpacket2_hdr {
 	__u32		tp_sec;
 	__u32		tp_nsec;
 	__u16		tp_vlan_tci;
-	__u16		tp_padding;
+	__u16		tp_vlan_tpid;
 };
 
 struct tpacket_hdr_variant1 {
 	__u32	tp_rxhash;
 	__u32	tp_vlan_tci;
+	__u32	tp_vlan_tpid;
 };
 
 struct tpacket3_hdr {
net/packet/af_packet.c +6 -2
index 2e8286b..fbcc882 100644
@@ -895,9 +895,11 @@ static void prb_fill_vlan_info(struct tpacket_kbdq_core *pkc,
 {
 	if (vlan_tx_tag_present(pkc->skb)) {
 		ppd->hv1.tp_vlan_tci = vlan_tx_tag_get(pkc->skb);
+		ppd->hv1.tp_vlan_tpid = (__force __u32)ntohs(pkc->skb->vlan_proto);
 		ppd->tp_status = TP_STATUS_VLAN_VALID;
 	} else {
 		ppd->hv1.tp_vlan_tci = 0;
+		ppd->hv1.tp_vlan_tpid = 0;
 		ppd->tp_status = TP_STATUS_AVAILABLE;
 	}
 }
@@ -1836,11 +1838,12 @@ static int tpacket_rcv(struct sk_buff *skb, struct net_device *dev,
 		h.h2->tp_nsec = ts.tv_nsec;
 		if (vlan_tx_tag_present(skb)) {
 			h.h2->tp_vlan_tci = vlan_tx_tag_get(skb);
+			h.h2->tp_vlan_tpid = ntohs(skb->vlan_proto);
 			status |= TP_STATUS_VLAN_VALID;
 		} else {
 			h.h2->tp_vlan_tci = 0;
+			h.h2->tp_vlan_tpid = 0;
 		}
-		h.h2->tp_padding = 0;
 		hdrlen = sizeof(*h.h2);
 		break;
 	case TPACKET_V3:
@@ -2788,11 +2791,12 @@ static int packet_recvmsg(struct kiocb *iocb, struct socket *sock,
 		aux.tp_net = skb_network_offset(skb);
 		if (vlan_tx_tag_present(skb)) {
 			aux.tp_vlan_tci = vlan_tx_tag_get(skb);
+			aux.tp_vlan_tpid = ntohs(skb->vlan_proto);
 			aux.tp_status |= TP_STATUS_VLAN_VALID;
 		} else {
 			aux.tp_vlan_tci = 0;
+			aux.tp_vlan_tpid = 0;
 		}
-		aux.tp_padding = 0;
 		put_cmsg(msg, SOL_PACKET, PACKET_AUXDATA, sizeof(aux), &aux);
 	}
 
Signature · 1 line
1.8.1.5
maintainer
#1 lore raw

From: Atzm Watanabe <[email protected]>
Date: Tue, 22 Oct 2013 17:39:40 +0900

include/uapi/linux/if_packet.h struct tpacket2_hdr { · line 142

Quoted 6 lines

struct tpacket_hdr_variant1 {

include/uapi/linux/if_packet.h +1 -0
 	__u32	tp_rxhash;
 	__u32	tp_vlan_tci;
+	__u32	tp_vlan_tpid;
 };

You cannot do this, the header length is not variable.

This patch has been submitted several times, each of which you have been shown ways in which your changes break userspace in one way or another.

#2 lore raw
Quoted 11 lines · David Miller

From: Atzm Watanabe <[email protected]>
Date: Tue, 22 Oct 2013 17:39:40 +0900

include/uapi/linux/if_packet.h struct tpacket2_hdr { · line 142

Quoted 6 lines

struct tpacket_hdr_variant1 {

include/uapi/linux/if_packet.h +1 -0
 	__u32	tp_rxhash;
 	__u32	tp_vlan_tci;
+	__u32	tp_vlan_tpid;
 };

You cannot do this, the header length is not variable.

Well it is variable to an extent. This is used as a member of the final anonymous union member of struct tpacket3_hdr, and the latter is specified to be tail-padded to a multiple of 16 bytes (TPACKET_ALIGNMENT). Since its current size is 36 bytes, I think it can safely grow by 12 bytes, so long as userland doesn't depend on getsockopt(..., PACKET_HDRLEN, ...) returning only specific values.

Possibly there should be a separate struct tpacket_hdr_variant2 which includes the extra member. Possibly there should also be a status flag to indicate that this member is present.

Quoted 3 lines

This patch has been submitted several times, each of which you have been shown ways in which your changes break userspace in one way or another.

I think we established that struct tpacket3_hdr can't grow arbitrarily, but not that it can't grow at all.

Ben.

Signature · 3 lines
Ben Hutchings, Staff Engineer, Solarflare
Not speaking for my employer; that's the marketing department's job.
They asked us to note that Solarflare product names are trademarked.
#3 lore raw

At Mon, 28 Oct 2013 20:11:14 +0000,

Quoted 21 lines · Ben Hutchings
Quoted 11 lines · David Miller

From: Atzm Watanabe <[email protected]>
Date: Tue, 22 Oct 2013 17:39:40 +0900

include/uapi/linux/if_packet.h struct tpacket2_hdr { · line 142

Quoted 6 lines

struct tpacket_hdr_variant1 {

include/uapi/linux/if_packet.h +1 -0
 	__u32	tp_rxhash;
 	__u32	tp_vlan_tci;
+	__u32	tp_vlan_tpid;
 };

You cannot do this, the header length is not variable.

Well it is variable to an extent. This is used as a member of the final anonymous union member of struct tpacket3_hdr, and the latter is specified to be tail-padded to a multiple of 16 bytes (TPACKET_ALIGNMENT). Since its current size is 36 bytes, I think it can safely grow by 12 bytes, so long as userland doesn't depend on getsockopt(..., PACKET_HDRLEN, ...) returning only specific values.

Quoted 3 lines

Possibly there should be a separate struct tpacket_hdr_variant2 which includes the extra member. Possibly there should also be a status flag to indicate that this member is present.

Should it be structures as below?

struct tpacket_hdr_variant1 {
        __u32   tp_rxhash;
        __u32   tp_vlan_tci;
};
struct tpacket_hdr_variant2 {
        __u32   tp_rxhash;
        __u32   tp_vlan_tci;
        __u32   tp_vlan_tpid;
};
struct tpacket3_hdr {
        __u32           tp_next_offset;
        __u32           tp_sec;
        __u32           tp_nsec;
        __u32           tp_snaplen;
        __u32           tp_len;
        __u32           tp_status;
        __u16           tp_mac;
        __u16           tp_net;
        /* pkt_hdr variants */
        union {
                struct tpacket_hdr_variant1 hv1;
                struct tpacket_hdr_variant2 hv2;
        };
};

If it's ok, I'd like to send the patch v2.

Quoted 6 lines
Quoted 3 lines

This patch has been submitted several times, each of which you have been shown ways in which your changes break userspace in one way or another.

I think we established that struct tpacket3_hdr can't grow arbitrarily, but not that it can't grow at all.

I think so, too.

#4 lore raw

On Wed, 2013-10-30 at 16:03 +0900, Atzm Watanabe wrote:
[...]

Quoted 29 lines

Should it be structures as below?

struct tpacket_hdr_variant1 {
        __u32   tp_rxhash;
        __u32   tp_vlan_tci;
};
struct tpacket_hdr_variant2 {
        __u32   tp_rxhash;
        __u32   tp_vlan_tci;
        __u32   tp_vlan_tpid;
};
struct tpacket3_hdr {
        __u32           tp_next_offset;
        __u32           tp_sec;
        __u32           tp_nsec;
        __u32           tp_snaplen;
        __u32           tp_len;
        __u32           tp_status;
        __u16           tp_mac;
        __u16           tp_net;
        /* pkt_hdr variants */
        union {
                struct tpacket_hdr_variant1 hv1;
                struct tpacket_hdr_variant2 hv2;
        };
};
Quoted 1 line

If it's ok, I'd like to send the patch v2.

[...]

I think this makes sense.

Also add a BUILD_BUG_ON(TPACKET3_HDRLEN != 48) somewhere.

Ben.

Signature · 3 lines
Ben Hutchings, Staff Engineer, Solarflare
Not speaking for my employer; that's the marketing department's job.
They asked us to note that Solarflare product names are trademarked.
#5 lore raw
Quoted 31 lines · Ben Hutchings

On Wed, 2013-10-30 at 16:03 +0900, Atzm Watanabe wrote:
[...]

Quoted 29 lines

Should it be structures as below?

struct tpacket_hdr_variant1 {
         __u32   tp_rxhash;
         __u32   tp_vlan_tci;
};
struct tpacket_hdr_variant2 {
         __u32   tp_rxhash;
         __u32   tp_vlan_tci;
         __u32   tp_vlan_tpid;
};
struct tpacket3_hdr {
         __u32           tp_next_offset;
         __u32           tp_sec;
         __u32           tp_nsec;
         __u32           tp_snaplen;
         __u32           tp_len;
         __u32           tp_status;
         __u16           tp_mac;
         __u16           tp_net;
         /* pkt_hdr variants */
         union {
                 struct tpacket_hdr_variant1 hv1;
                 struct tpacket_hdr_variant2 hv2;
         };
};
Quoted 6 lines
Quoted 1 line

If it's ok, I'd like to send the patch v2.

[...]

I think this makes sense.

Also add a BUILD_BUG_ON(TPACKET3_HDRLEN != 48) somewhere.

Sorry for coming late into this discussion.

I think the packet_mmap API with its 3 different API versions already is a "bit" terrible, and should only be further extended for user space if there is a _*huge*_ (!) improvement somewhere (e.g. in terms of packet capturing/transmission performance) that would justify it. I'm thinking that this could e.g. be in terms of packet capturing and transmission performance.

Otherwise, each time we want to add a new member, we add yet another subheader for userspace into tpacket, making it even more complicated to use, and adding more "legacy" API fragments?

To solve your problem, why don't you add a socket option that, if _enabled_, would reconstruct the vlan header as it was seen on the "wire" and push that up to userspace, just like libpcap does internally. It's not perfect either, but perhaps a better way to go. What do you think?

#6 lore raw

At Mon, 04 Nov 2013 19:33:52 +0100,

Quoted 49 lines · Daniel Borkmann
Quoted 31 lines · Ben Hutchings

On Wed, 2013-10-30 at 16:03 +0900, Atzm Watanabe wrote:
[...]

Quoted 29 lines

Should it be structures as below?

struct tpacket_hdr_variant1 {
         __u32   tp_rxhash;
         __u32   tp_vlan_tci;
};
struct tpacket_hdr_variant2 {
         __u32   tp_rxhash;
         __u32   tp_vlan_tci;
         __u32   tp_vlan_tpid;
};
struct tpacket3_hdr {
         __u32           tp_next_offset;
         __u32           tp_sec;
         __u32           tp_nsec;
         __u32           tp_snaplen;
         __u32           tp_len;
         __u32           tp_status;
         __u16           tp_mac;
         __u16           tp_net;
         /* pkt_hdr variants */
         union {
                 struct tpacket_hdr_variant1 hv1;
                 struct tpacket_hdr_variant2 hv2;
         };
};
Quoted 6 lines
Quoted 1 line

If it's ok, I'd like to send the patch v2.

[...]

I think this makes sense.

Also add a BUILD_BUG_ON(TPACKET3_HDRLEN != 48) somewhere.

Sorry for coming late into this discussion.

I think the packet_mmap API with its 3 different API versions already is a "bit" terrible, and should only be further extended for user space if there is a _*huge*_ (!) improvement somewhere (e.g. in terms of packet capturing/transmission performance) that would justify it. I'm thinking that this could e.g. be in terms of packet capturing and transmission performance.

Quoted 3 lines

Otherwise, each time we want to add a new member, we add yet another subheader for userspace into tpacket, making it even more complicated to use, and adding more "legacy" API fragments?

Thank you for the comments.

Indeed, your worry will become reality if we often want to add new members as other aims, but I also think that VLAN related members perhaps won't be added anymore because the VLAN only contains TCI and ethertype.

Quoted 5 lines

To solve your problem, why don't you add a socket option that, if _enabled_, would reconstruct the vlan header as it was seen on the "wire" and push that up to userspace, just like libpcap does internally. It's not perfect either, but perhaps a better way to go. What do you think?

Sounds good to me, but I also think that a socket option should be added when we want to add new members to enable userspace to reassemble the pakcet for reasons other than the VLAN. Because TCI is already put into the tpacket headers or auxdata, userspace may want to get TPID by same way.

However, if we cannot add new members into the header anyway, we need to avoid that by other ways like you proposed.

Thanks!