Patch "mm: workingset: fix crash in shadow node shrinker caused by replace_page_cache_page()" has been added to the 4.4-stable tree
Subsystems (6)
This is a note to let you know that I've just added the patch titled
mm: workingset: fix crash in shadow node shrinker caused by replace_page_cache_page()
to the 4.4-stable tree which can be found at:
http://www.kernel.org/git/?p=linux/kernel/git/stable/stable-queue.git;a=summary
The filename of the patch is:
mm-workingset-fix-crash-in-shadow-node-shrinker-caused-by-replace_page_cache_page.patch
and it can be found in the queue-4.4 subdirectory.
If you, or anyone else, feels it should not be added to the stable tree, please let <[email protected]> know about it.
Quoted 1 line
From
22f2ac51b6d643666f4db093f13144f773ff3f3aMon Sep 17 00:00:00 2001
From: Johannes Weiner <[email protected]>
Date: Fri, 30 Sep 2016 15:11:29 -0700
Subject: mm: workingset: fix crash in shadow node shrinker caused by replace_page_cache_page()
From: Johannes Weiner <[email protected]>
commit 22f2ac51b6d643666f4db093f13144f773ff3f3a upstream.
Antonio reports the following crash when using fuse under memory pressure:
kernel BUG at /build/linux-a2WvEb/linux-4.4.0/mm/workingset.c:346! invalid opcode: 0000 [#1] SMP
Modules linked in: all of them
CPU: 2 PID: 63 Comm: kswapd0 Not tainted 4.4.0-36-generic #55-Ubuntu
Hardware name: System manufacturer System Product Name/P8H67-M PRO, BIOS 3904 04/27/2013
task: ffff88040cae6040 ti: ffff880407488000 task.ti: ffff880407488000
RIP: shadow_lru_isolate+0x181/0x190
Call Trace:
__list_lru_walk_one.isra.3+0x8f/0x130
list_lru_walk_one+0x23/0x30
scan_shadow_nodes+0x34/0x50
shrink_slab.part.40+0x1ed/0x3d0
shrink_zone+0x2ca/0x2e0
kswapd+0x51e/0x990
kthread+0xd8/0xf0
ret_from_fork+0x3f/0x70which corresponds to the following sanity check in the shadow node tracking:
BUG_ON(node->count & RADIX_TREE_COUNT_MASK);
The workingset code tracks radix tree nodes that exclusively contain shadow entries of evicted pages in them, and this (somewhat obscure) line checks whether there are real pages left that would interfere with reclaim of the radix tree node under memory pressure.
While discussing ways how fuse might sneak pages into the radix tree past the workingset code, Miklos pointed to replace_page_cache_page(), and indeed there is a problem there: it properly accounts for the old page being removed - __delete_from_page_cache() does that - but then does a raw raw radix_tree_insert(), not accounting for the replacement page. Eventually the page count bits in node->count underflow while leaving the node incorrectly linked to the shadow node LRU.
To address this, make sure replace_page_cache_page() uses the tracked page insertion code, page_cache_tree_insert(). This fixes the page accounting and makes sure page-containing nodes are properly unlinked from the shadow node LRU again.
Also, make the sanity checks a bit less obscure by using the helpers for checking the number of pages and shadows in a radix tree node.
--- include/linux/swap.h | 2 + mm/filemap.c | 86 +++++++++++++++++++++++++-------------------------- mm/workingset.c | 10 ++--- 3 files changed, 49 insertions(+), 49 deletions(-)
include/linux/swap.h +2 -0
@@ -266,6 +266,7 @@ static inline void workingset_node_pagesstatic inline void workingset_node_pages_dec (struct radix_tree_node *node) { +VM_BUG_ON (!workingset_node_pages (node)); node->count--; }
@@ -281,6 +282,7 @@ static inline void workingset_node_shadostatic inline void workingset_node_shadows_dec (struct radix_tree_node *node) { +VM_BUG_ON (!workingset_node_shadows (node)); node->count -=1U <<RADIX_TREE_COUNT_SHIFT ; }
mm/filemap.c +43 -43
104 lines not on this page · raw message
mm/workingset.c +4 -6
@@ -341,21 +341,19 @@ static enum lru_status shadow_lru_isolat* no pages, so we expect to be able to remove them all and * delete and free the empty node afterwards. */ - -BUG_ON (!node->count); -BUG_ON (node->count &RADIX_TREE_COUNT_MASK ); +BUG_ON (!workingset_node_shadows (node)); +BUG_ON (workingset_node_pages (node));for (i =0 ; i <RADIX_TREE_MAP_SIZE ; i++) {if (node->slots[i]) {BUG_ON (!radix_tree_exceptional_entry (node->slots[i])); node->slots[i] =NULL ; -BUG_ON (node->count < (1U <<RADIX_TREE_COUNT_SHIFT )); - node->count -=1U <<RADIX_TREE_COUNT_SHIFT ; +workingset_node_shadows_dec (node);BUG_ON (!mapping->nrshadows); mapping->nrshadows--; } } -BUG_ON (node->count); +BUG_ON (workingset_node_shadows (node));inc_zone_state (page_zone (virt_to_page (node)),WORKINGSET_NODERECLAIM );if (!__radix_tree_delete_node (&mapping->page_tree, node))BUG ();
Patches currently in stable-queue which might be from [email protected] are
queue-4.4/mm-filemap-fix-mapping-nrpages-double-accounting-in-fuse.patch queue-4.4/mm-filemap-don-t-plant-shadow-entries-without-radix-tree-node.patch queue-4.4/mm-workingset-fix-crash-in-shadow-node-shrinker-caused-by-replace_page_cache_page.patch queue-4.4/using-bug_on-as-an-assert-is-_never_-acceptable.patch