slub: fix kmalloc_pagealloc_invalid_free unit test
Subsystems (2)
PATCH 1/1 slub: fix kmalloc_pagealloc_invalid_free unit test
The unit test kmalloc_pagealloc_invalid_free makes sure that for the higher order slub allocation which goes to page allocator, the free is called with the correct address i.e. the virtual address of the head page.
The commit f227f0faf63b ("slub: fix unreclaimable slab stat for bulk free") unified the free code paths for page allocator based slub allocations but instead of using the address passed by the caller, it extracted the address from the page. Thus making the unit test kmalloc_pagealloc_invalid_free moot. So, fix this by using the address passed by the caller.
Should we fix this? I think yes because dev expect kasan to catch these type of programming bugs.
--- mm/slub.c | 8 ++++---- 1 file changed, 4 insertions(+), 4 deletions(-)
mm/slub.c +4 -4
@@ -3236,12 +3236,12 @@ struct detached_freelist {struct kmem_cache *s; }; -static inline void free_nonslab_page (struct page *page) +static inline void free_nonslab_page (struct page *page,void *object) {unsigned int order =compound_order (page);VM_BUG_ON_PAGE (!PageCompound (page), page); -kfree_hook (page_address (page)); +kfree_hook (object);mod_lruvec_page_state (page,NR_SLAB_UNRECLAIMABLE_B , -(PAGE_SIZE << order));__free_pages (page, order); }
@@ -3282,7 +3282,7 @@ int build_detached_freelist(struct kmem_cache *s, size_t size,if (!s) {/* Handle kalloc'ed objects */ if (unlikely (!PageSlab (page))) { -free_nonslab_page (page); +free_nonslab_page (page, object); p[size] =NULL ;/* mark object processed */ return size; }
@@ -4258,7 +4258,7 @@ void kfree(const void *x) page =virt_to_head_page (x);if (unlikely (!PageSlab (page))) { -free_nonslab_page (page); +free_nonslab_page (page, object);return ; }slab_free (page->slab_cache, page, object,NULL ,1 , _RET_IP_);
Signature · 1 line
2.32.0.554.ge1b32706d8-goog
Quoted 15 lines · Shakeel Butt
The unit test
kmalloc_pagealloc_invalid_freemakes sure that for the higher order slub allocation which goes to page allocator, the free is called with the correct address i.e. the virtual address of the head page.The commit
f227f0faf63b("slub: fix unreclaimable slab stat for bulk free") unified the free code paths for page allocator based slub allocations but instead of using the address passed by the caller, it extracted the address from the page. Thus making the unit testkmalloc_pagealloc_invalid_freemoot. So, fix this by using the address passed by the caller.Should we fix this? I think yes because dev expect kasan to catch these type of programming bugs.
Quoted 12 lines
Fixes f227f0faf63b ("slub: fix unreclaimable slab stat for bulk free")Signed-off-by Shakeel Butt <[email protected]>Reported-by Nathan Chancellor <[email protected]>Cc Michal Hocko <[email protected]>Cc Roman Gushchin <[email protected]>Cc Muchun Song <[email protected]>Cc Christoph Lameter <[email protected]>Cc Pekka Enberg <[email protected]>Cc David Rientjes <[email protected]>Cc Joonsoo Kim <[email protected]>Cc Vlastimil Babka <[email protected]>Cc Andrew Morton <[email protected]>
Thank you for the quick fix! It passes my tests on arm64 and x86_64 in QEMU with a few different clang versions.
Quoted 45 lines
--- mm/slub.c | 8 ++++---- 1 file changed, 4 insertions(+), 4 deletions(-)mm/slub.c +4
-4@@ -3236,12 +3236,12 @@ struct detached_freelist {struct kmem_cache *s; }; -static inline void free_nonslab_page (struct page *page) +static inline void free_nonslab_page (struct page *page,void *object) {unsigned int order =compound_order (page);VM_BUG_ON_PAGE (!PageCompound (page), page); -kfree_hook (page_address (page)); +kfree_hook (object);mod_lruvec_page_state (page,NR_SLAB_UNRECLAIMABLE_B , -(PAGE_SIZE << order));__free_pages (page, order); }@@ -3282,7 +3282,7 @@ int build_detached_freelist(struct kmem_cache *s, size_t size,if (!s) {/* Handle kalloc'ed objects */ if (unlikely (!PageSlab (page))) { -free_nonslab_page (page); +free_nonslab_page (page, object); p[size] =NULL ;/* mark object processed */ return size; }@@ -4258,7 +4258,7 @@ void kfree(const void *x) page =virt_to_head_page (x);if (unlikely (!PageSlab (page))) { -free_nonslab_page (page); +free_nonslab_page (page, object);return ; }slab_free (page->slab_cache, page, object,NULL ,1 , _RET_IP_);Signature · 1 line
2.32.0.554.ge1b32706d8-goog
Quoted 12 lines · Shakeel Butt
The unit test
kmalloc_pagealloc_invalid_freemakes sure that for the higher order slub allocation which goes to page allocator, the free is called with the correct address i.e. the virtual address of the head page.The commit
f227f0faf63b("slub: fix unreclaimable slab stat for bulk free") unified the free code paths for page allocator based slub allocations but instead of using the address passed by the caller, it extracted the address from the page. Thus making the unit testkmalloc_pagealloc_invalid_freemoot. So, fix this by using the address passed by the caller.
Quoted 2 lines
Should we fix this? I think yes because dev expect kasan to catch these type of programming bugs.
I think so too.
Thanks!