xdp: fix zero-copy frame layout
Subsystems (5)
PATCH 1/1 xdp: fix zero-copy frame layout
xdp_convert_zc_to_xdp_frame() clones an XSK packet into an order-0 page and advertises PAGE_SIZE as its frame size. It allows the copied frame to occupy the page tail needed by skb_shared_info and records zero headroom even when metadata separates the frame header from packet data. An AF_XDP zero-copy packet redirected through cpumap can therefore make the skb overlap skb_shared_info or place it beyond the allocated page.
Limit the copied layout to SKB_WITH_OVERHEAD(PAGE_SIZE) and include the metadata length in frame headroom. Redirect callers already handle a NULL conversion result.
BUG: KASAN: slab-out-of-bounds in skb_gro_receive Write of size 4 at addr ffff88800cf37004 by task cpumap/1/map:1/146 Call Trace: skb_gro_receive (net/core/gro.c:174) udp_gro_receive (net/ipv4/udp_offload.c:812) inet_gro_receive (net/ipv4/af_inet.c:1539) dev_gro_receive (net/core/gro.c:515) gro_receive_skb (net/core/gro.c:633) cpu_map_kthread_run (kernel/bpf/cpumap.c:395) kthread (kernel/kthread.c:436) ret_from_fork (arch/x86/kernel/process.c:164) ret_from_fork_asm (arch/x86/entry/entry_64.S:255) Kernel panic - not syncing: KASAN: panic_on_warn set ...
--- net/core/xdp.c | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-)
net/core/xdp.c +2 -2
@@ -585,7 +585,7 @@ struct xdp_frame *xdp_convert_zc_to_xdp_frame(struct xdp_buff *xdp) xdp->data - xdp->data_meta; totsize = xdp->data_end - xdp->data + metasize; -if (sizeof (*xdpf) + totsize >PAGE_SIZE ) +if (sizeof (*xdpf) + totsize >SKB_WITH_OVERHEAD (PAGE_SIZE ))return NULL ; page =dev_alloc_page ();
@@ -602,7 +602,7 @@ struct xdp_frame *xdp_convert_zc_to_xdp_frame(struct xdp_buff *xdp) xdpf->data = addr + metasize; xdpf->len = totsize - metasize; - xdpf->headroom =0 ; + xdpf->headroom = metasize; xdpf->metasize = metasize; xdpf->frame_sz =PAGE_SIZE ; xdpf->mem_type =MEM_TYPE_PAGE_ORDER0 ;
Signature · 1 line
2.55.0
[email protected]
AI reviewThank you for your contribution! Sashiko AI review found 2 potential issue(s) to consider:
Thank you for your contribution! Sashiko AI review found 2 potential issue(s) to consider:
Pre-existing issues:
- [Critical] Double free of XSK buffer and memory leak of xdp_frame page on redirect enqueue error.
- [High] Silent truncation of fragmented AF_XDP (MEM_TYPE_XSK_BUFF_POOL) multi-buffer packets during redirect. --
--- Patch [1]: [PATCH net] xdp: fix zero-copy frame layout --- commit 300f3eb2043fb6dcf3006d467327612f861ccc98
Author: Weiming Shi <[email protected]>
xdp: fix zero-copy frame layout
xdp_convert_zc_to_xdp_frame() clones an XSK packet into an order-0 page and advertises PAGE_SIZE as its frame size. It allows the copied frame to occupy the page tail needed by skb_shared_info and records zero headroom even when metadata separates the frame header from packet data.
net/core/xdp.c struct xdp_frame *xdp_convert_zc_to_xdp_frame(struct xdp_buff *xdp) · line 589
Quoted 11 lines
net/core/xdp.c +1
-1@@ -585,7 +585,7 @@ struct xdp_frame *xdp_convert_zc_to_xdp_frame(struct xdp_buff *xdp) xdp->data - xdp->data_meta; totsize = xdp->data_end - xdp->data + metasize; -if (sizeof (*xdpf) + totsize >PAGE_SIZE ) +if (sizeof (*xdpf) + totsize >SKB_WITH_OVERHEAD (PAGE_SIZE ))return NULL ;
[Severity: High]
This isn't a bug introduced by this patch, but does this function silently drop fragments when an AF_XDP zero-copy buffer contains them?
Looking at xdp_convert_zc_to_xdp_frame() in net/core/xdp.c, totsize is calculated using only xdp->data_end - xdp->data. It ignores xdp_buff_has_frags(xdp), meaning it allocates an order-0 page and copies only the linear data.
Any attached fragments in the tailroom's skb_shared_info seem to be ignored, and while they are freed via xsk_buff_free(xdp), the resulting xdp_frame is silently truncated.
Quoted 2 lines
net/core/xdp.c +0
-0page =dev_alloc_page ();
[ ... ]
net/core/xdp.c struct xdp_frame *xdp_convert_zc_to_xdp_frame(struct xdp_buff *xdp) · line 608
Quoted 9 lines
net/core/xdp.c +1
-1@@ -602,7 +602,7 @@ struct xdp_frame *xdp_convert_zc_to_xdp_frame(struct xdp_buff *xdp) xdpf->data = addr + metasize; xdpf->len = totsize - metasize; - xdpf->headroom =0 ; + xdpf->headroom = metasize; xdpf->metasize = metasize; xdpf->frame_sz =PAGE_SIZE ; xdpf->mem_type =MEM_TYPE_PAGE_ORDER0 ;
[Severity: Critical]
This is a pre-existing issue, but does freeing the zero-copy buffer at the end of this function cause a double-free and memory leak if the subsequent enqueue operation fails?
In net/core/xdp.c:xdp_convert_zc_to_xdp_frame(), the original buffer is explicitly freed via xsk_buff_free(xdp) upon successful conversion. It then returns the new xdp_frame to xdp_do_redirect():
net/core/filter.c:xdp_do_redirect() {
...
return __xdp_do_redirect_frame(ri, dev, xdp_convert_buff_to_frame(xdp),
xdp_prog);
}If __xdp_do_redirect_frame() fails, it returns the error code without freeing the xdp_frame parameter:
net/core/filter.c:__xdp_do_redirect_frame() {
...
err:
_trace_xdp_redirect_map_err(dev, xdp_prog, fwd, map_type, map_id, ri->tgt_index, err);
return err;
}Since the pointer is not saved in xdp_do_redirect(), the newly allocated page appears to be leaked.
Additionally, because the error propagates back to the calling driver, the driver might assume the subsystem did not consume the packet and proceed to free the original ZC buffer again, potentially causing a double-free in the XSK pool.
Signature · 1 line
Sashiko AI review · https://sashiko.dev/#/patchset/[email protected]?part=1
This patch was applied to netdev/net.git (main) by Jakub Kicinski <[email protected]>:
Hello:
This patch was applied to netdev/net.git (main)
by Jakub Kicinski <[email protected]>:
Quoted 8 lines · On Tue, 18 Aug 2026 23:45:15 +0800 you wrote:
xdp_convert_zc_to_xdp_frame()clones an XSK packet into an order-0 page and advertisesPAGE_SIZEas its frame size. It allows the copied frame to occupy the page tail needed byskb_shared_infoand records zero headroom even when metadata separates the frame header from packet data. AnAF_XDPzero-copy packet redirected through cpumap can therefore make the skb overlapskb_shared_infoor place it beyond the allocated page.[...]
Here is the summary with links:
- [net] xdp: fix zero-copy frame layout
https://git.kernel.org/netdev/net/c/71283aaa6c65
You are awesome, thank you!
Signature · 2 lines
Deet-doot-dot, I am a bot. https://korg.docs.kernel.org/patchwork/pwbot.html