net: skb: fix cross-cache free of KFENCE-allocated skb head
Subsystems (3)
PATCH v2 1/1 net: skb: fix cross-cache free of KFENCE-allocated skb head
SKB_SMALL_HEAD_CACHE_SIZE is intentionally set to a non-power-of-2 value (e.g. 704 on x86_64) to avoid collisions with generic kmalloc bucket sizes. This ensures that skb_kfree_head() can reliably use skb_end_offset to distinguish skb heads allocated from skb_small_head_cache vs. generic kmalloc caches.
However, when KFENCE is enabled, kfence_ksize() returns the exact requested allocation size instead of the slab bucket size. If a caller (e.g. bpf_test_init) allocates skb head data via kzalloc() and the requested size happens to equal SKB_SMALL_HEAD_CACHE_SIZE, then slab_build_skb() -> ksize() returns that exact value. After subtracting skb_shared_info overhead, skb_end_offset ends up matching SKB_SMALL_HEAD_HEADROOM, causing skb_kfree_head() to incorrectly free the object to skb_small_head_cache instead of back to the original kmalloc cache, resulting in a slab cross-cache free:
kmem_cache_free(skbuff_small_head): Wrong slab cache. Expected skbuff_small_head but got kmalloc-1k
Fix this by always calling kfree(head) in skb_kfree_head(). This keeps the free path generic and avoids allocator-specific misclassification for KFENCE objects.
---v1->v2: https://lore.kernel.org/netdev/[email protected]/
- switch skb_kfree_head() to plain kfree(head)
--- net/core/skbuff.c | 5 +---- 1 file changed, 1 insertion(+), 4 deletions(-)
net/core/skbuff.c +1 -4
@@ -1083,10 +1083,7 @@ static int skb_pp_frag_ref(struct sk_buff *skb)static void skb_kfree_head (void *head,unsigned int end_offset) { -if (end_offset ==SKB_SMALL_HEAD_HEADROOM ) -kmem_cache_free (net_hotdata.skb_small_head_cache, head); -else -kfree (head); +kfree (head); }static void skb_free_head (struct sk_buff *skb)
Signature · 1 line
2.43.0
Quoted 20 lines · Jiayuan Chen
SKB_SMALL_HEAD_CACHE_SIZEis intentionally set to a non-power-of-2 value (e.g. 704 onx86_64) to avoid collisions with generic kmalloc bucket sizes. This ensures thatskb_kfree_head()can reliably useskb_end_offsetto distinguish skb heads allocated fromskb_small_head_cachevs. generic kmalloc caches.However, when KFENCE is enabled,
kfence_ksize()returns the exact requested allocation size instead of the slab bucket size. If a caller (e.g.bpf_test_init) allocates skb head data viakzalloc()and the requested size happens to equalSKB_SMALL_HEAD_CACHE_SIZE, thenslab_build_skb()->ksize()returns that exact value. After subtractingskb_shared_infooverhead,skb_end_offsetends up matchingSKB_SMALL_HEAD_HEADROOM, causingskb_kfree_head()to incorrectly free the object toskb_small_head_cacheinstead of back to the original kmalloc cache, resulting in a slab cross-cache free:
kmem_cache_free(skbuff_small_head): Wrong slab cache. Expectedskbuff_small_headbut got kmalloc-1k
Quoted 8 lines
Fix this by always calling kfree(head) in
skb_kfree_head(). This keeps the free path generic and avoids allocator-specific misclassification for KFENCE objects.Fixes bf9f1baa279f ("net: add dedicated kmem_cache for typical/small skb->head")Reported-by Antonius <[email protected]>Closes https://lore.kernel.org/netdev/CAK8a0jxC5L5N7hq-DT2_NhUyjBxrPocoiDazzsBk4TGgT1r4-A@mail.gmail.com/ open hereSigned-off-by Jiayuan Chen <[email protected]>
Quoted 26 lines · Eric Dumazet
Quoted 24 lines · Jiayuan Chen
SKB_SMALL_HEAD_CACHE_SIZEis intentionally set to a non-power-of-2 value (e.g. 704 onx86_64) to avoid collisions with generic kmalloc bucket sizes. This ensures thatskb_kfree_head()can reliably useskb_end_offsetto distinguish skb heads allocated fromskb_small_head_cachevs. generic kmalloc caches.However, when KFENCE is enabled,
kfence_ksize()returns the exact requested allocation size instead of the slab bucket size. If a caller (e.g.bpf_test_init) allocates skb head data viakzalloc()and the requested size happens to equalSKB_SMALL_HEAD_CACHE_SIZE, thenslab_build_skb()->ksize()returns that exact value. After subtractingskb_shared_infooverhead,skb_end_offsetends up matchingSKB_SMALL_HEAD_HEADROOM, causingskb_kfree_head()to incorrectly free the object toskb_small_head_cacheinstead of back to the original kmalloc cache, resulting in a slab cross-cache free:
kmem_cache_free(skbuff_small_head): Wrong slab cache. Expectedskbuff_small_headbut got kmalloc-1kFix this by always calling kfree(head) in
skb_kfree_head(). This keeps the free path generic and avoids allocator-specific misclassification for KFENCE objects.
Quoted 6 lines
Quoted 4 lines
Fixes bf9f1baa279f ("net: add dedicated kmem_cache for typical/small skb->head")Reported-by Antonius <[email protected]>Closes https://lore.kernel.org/netdev/CAK8a0jxC5L5N7hq-DT2_NhUyjBxrPocoiDazzsBk4TGgT1r4-A@mail.gmail.com/ open hereSigned-off-by Jiayuan Chen <[email protected]>Reviewed-by Eric Dumazet <[email protected]>
Note: we can later in net-next remove skb_kfree_head() completely.
This patch was applied to netdev/net.git (main) by Jakub Kicinski <[email protected]>:
Hello:
This patch was applied to netdev/net.git (main)
by Jakub Kicinski <[email protected]>:
Quoted 16 lines · On Fri, 3 Apr 2026 09:45:12 +0800 you wrote:
SKB_SMALL_HEAD_CACHE_SIZEis intentionally set to a non-power-of-2 value (e.g. 704 onx86_64) to avoid collisions with generic kmalloc bucket sizes. This ensures thatskb_kfree_head()can reliably useskb_end_offsetto distinguish skb heads allocated fromskb_small_head_cachevs. generic kmalloc caches.However, when KFENCE is enabled,
kfence_ksize()returns the exact requested allocation size instead of the slab bucket size. If a caller (e.g.bpf_test_init) allocates skb head data viakzalloc()and the requested size happens to equalSKB_SMALL_HEAD_CACHE_SIZE, thenslab_build_skb()->ksize()returns that exact value. After subtractingskb_shared_infooverhead,skb_end_offsetends up matchingSKB_SMALL_HEAD_HEADROOM, causingskb_kfree_head()to incorrectly free the object toskb_small_head_cacheinstead of back to the original kmalloc cache, resulting in a slab cross-cache free:
Quoted 1 line
[...]
Here is the summary with links:
- [net,v2] net: skb: fix cross-cache free of KFENCE-allocated skb head
https://git.kernel.org/netdev/net/c/0f42e3f4fe2a
You are awesome, thank you!
Signature · 2 lines
Deet-doot-dot, I am a bot. https://korg.docs.kernel.org/patchwork/pwbot.html