mm/huge_memory: splitting set mapping+index before unfreeze
Subsystems (3)
[email protected]
maintainerPATCH 22/31 mm/huge_memory: splitting set mapping+index before unfreeze
From: Hugh Dickins <[email protected]>
Subject: mm/huge_memory: splitting set mapping+index before unfreeze
Huge tmpfs stress testing has occasionally hit shmem_undo_range()'s VM_BUG_ON_PAGE(page_to_pgoff(page) != index, page).
Move the setting of mapping and index up before the page_ref_unfreeze() in __split_huge_page_tail() to fix this: so that a page cache lookup cannot get a reference while the tail's mapping and index are unstable.
In fact, might as well move them up before the smp_wmb(): I don't see an actual need for that, but if I'm missing something, this way round is safer than the other, and no less efficient.
You might argue that VM_BUG_ON_PAGE(page_to_pgoff(page) != index, page) is misplaced, and should be left until after the trylock_page(); but left as is has not crashed since, and gives more stringent assurance.
Requires: 605ca5ede764 ("mm/huge_memory.c: reorder operations in __split_huge_page_tail()")
---
mm/huge_memory.c | 12 ++++++------ 1 file changed, 6 insertions(+), 6 deletions(-)
mm/huge_memory.c renamed from mm/huge_memory.c~mm-huge_memory-splitting-set-mappingindex-before-unfreeze +6 -6
@@ -2402,6 +2402,12 @@ static void __split_huge_page_tail(struc (1L << PG_unevictable) | (1L << PG_dirty))); +/* ->mapping in first tail page is compound_mapcount */ +VM_BUG_ON_PAGE (tail >2 && page_tail->mapping !=TAIL_MAPPING , + page_tail); + page_tail->mapping = head->mapping; + page_tail->index = head->index + tail; +/* Page flags must be visible before we make the page non-compound. */ smp_wmb ();
@@ -2422,12 +2428,6 @@ static void __split_huge_page_tail(strucif (page_is_idle (head))set_page_idle (page_tail); -/* ->mapping in first tail page is compound_mapcount */ -VM_BUG_ON_PAGE (tail >2 && page_tail->mapping !=TAIL_MAPPING , - page_tail); - page_tail->mapping = head->mapping; - - page_tail->index = head->index + tail;page_cpupid_xchg_last (page_tail,page_cpupid_last (head));/*
_