mm/migrate: fix page state accounting type conversion underflow
Subsystems (2)
PATCH 1/1 mm/migrate: fix page state accounting type conversion underflow
Similarly to commit 2da9f6305f306 ("mm/vmscan: fix NR_ISOLATED_FILE corruption on 64-bit"), fix -ve int -> unsigned int -> long bug.
--- mm/migrate.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
mm/migrate.c +1 -1
@@ -2068,7 +2068,7 @@ int migrate_misplaced_page(struct page *page, struct vm_area_struct *vma,LIST_HEAD (migratepages);new_page_t *new;bool compound; -unsigned int nr_pages =thp_nr_pages (page); +int nr_pages =thp_nr_pages (page);/* * PTE mapped THP or HugeTLB page can't reach here so the page could
Signature · 1 line
2.23.0
Quoted 16 lines · Nicholas Piggin
Similarly to commit
2da9f6305f306("mm/vmscan: fixNR_ISOLATED_FILEcorruption on 64-bit"), fix -ve int -> unsigned int -> long bug.Reported-by Alexey Kardashevskiy <[email protected]>Fixes c5fc5c3ae0c84 ("mm: migrate: account THP NUMA migration counters correctly")Signed-off-by Nicholas Piggin <[email protected]>--- mm/migrate.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)mm/migrate.c +0
-0
mm/migrate.c int migrate_misplaced_page(struct page *page, struct vm_area_struct *vma, · line 2074
Quoted 8 lines
mm/migrate.c +1
-1@@ -2068,7 +2068,7 @@ int migrate_misplaced_page(struct page *page, struct vm_area_struct *vma,LIST_HEAD (migratepages);new_page_t *new;bool compound; -unsigned int nr_pages =thp_nr_pages (page); +int nr_pages =thp_nr_pages (page);/* * PTE mapped THP or HugeTLB page can't reach here so the page could
This is too fragile to silently break again IMHO. Should we similarly to 2da9f6305f306 handle the conversion explicitly inside the mod_node_page_state() call?
Signature · 3 lines
Thanks, David / dhildenb
Andrew Morton
maintainerQuoted 22 lines · On Thu, 22 Jul 2021 09:27:50 +0200 David Hildenbrand <[email protected]> wrote:
Quoted 21 lines · Nicholas Piggin
Similarly to commit
2da9f6305f306("mm/vmscan: fixNR_ISOLATED_FILEcorruption on 64-bit"), fix -ve int -> unsigned int -> long bug.Reported-by Alexey Kardashevskiy <[email protected]>Fixes c5fc5c3ae0c84 ("mm: migrate: account THP NUMA migration counters correctly")Signed-off-by Nicholas Piggin <[email protected]>--- mm/migrate.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)mm/migrate.c +1
-1@@ -2068,7 +2068,7 @@ int migrate_misplaced_page(struct page *page, struct vm_area_struct *vma,LIST_HEAD (migratepages);new_page_t *new;bool compound; -unsigned int nr_pages =thp_nr_pages (page); +int nr_pages =thp_nr_pages (page);
Quoted 7 lines
mm/migrate.c int migrate_misplaced_page(struct page *page, struct vm_area_struct *vma, · line 2074
Quoted 3 lines
mm/migrate.c +0
-0/* * PTE mapped THP or HugeTLB page can't reach here so the page could This is too fragile to silently break again IMHO. Should we similarly to
2da9f6305f306handle the conversion explicitly inside themod_node_page_state()call?
And please don't send us off to loo at another commit to understand this one. A full standalone changelog, please.
Preferably with a description of user-visible effects. 2da9f6305f306 said "Symptoms include CMA allocations hanging forever holding the cma_mutex due to alloc_contig_range->...->isolate_migratepages_block waiting forever in "while (unlikely(too_many_isolated(pgdat)))". Is that also the case with this bug?
Excerpts from David Hildenbrand's message of July 22, 2021 5:27 pm:
Quoted 22 lines · Nicholas Piggin
Quoted 21 lines
Similarly to commit
2da9f6305f306("mm/vmscan: fixNR_ISOLATED_FILEcorruption on 64-bit"), fix -ve int -> unsigned int -> long bug.Reported-by Alexey Kardashevskiy <[email protected]>Fixes c5fc5c3ae0c84 ("mm: migrate: account THP NUMA migration counters correctly")Signed-off-by Nicholas Piggin <[email protected]>--- mm/migrate.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)mm/migrate.c +1
-1@@ -2068,7 +2068,7 @@ int migrate_misplaced_page(struct page *page, struct vm_area_struct *vma,LIST_HEAD (migratepages);new_page_t *new;bool compound; -unsigned int nr_pages =thp_nr_pages (page); +int nr_pages =thp_nr_pages (page);
Quoted 7 lines
mm/migrate.c int migrate_misplaced_page(struct page *page, struct vm_area_struct *vma, · line 2074
Quoted 3 lines
mm/migrate.c +0
-0/* * PTE mapped THP or HugeTLB page can't reach here so the page could This is too fragile to silently break again IMHO. Should we similarly to
2da9f6305f306handle the conversion explicitly inside themod_node_page_state()call?
Casting to signed still has the fragility that the variable is unsigned so negating it somewhere else would break. I was somewhat inconsistent in the fixes, but there is less code that uses the variable here so it's simpler to change the type IMO.
Negating an unsigned type always gives you a non-negative number. Unfortunately types matter.
Thanks,
Nick
Quoted 15 lines · Nicholas Piggin
Similarly to commit
2da9f6305f306("mm/vmscan: fixNR_ISOLATED_FILEcorruption on 64-bit"), fix -ve int -> unsigned int -> long bug.Reported-by Alexey Kardashevskiy <[email protected]>Fixes c5fc5c3ae0c84 ("mm: migrate: account THP NUMA migration counters correctly")Signed-off-by Nicholas Piggin <[email protected]>--- mm/migrate.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)mm/migrate.c +0
-0
mm/migrate.c int migrate_misplaced_page(struct page *page, struct vm_area_struct *vma, · line 2071
Quoted 5 lines
mm/migrate.c +1
-1@@ -2068,7 +2068,7 @@ int migrate_misplaced_page(struct page *page, struct vm_area_struct *vma,LIST_HEAD (migratepages);new_page_t *new;bool compound; -unsigned int nr_pages =thp_nr_pages (page); +int nr_pages =thp_nr_pages (page);
This has prompted me to go off and look through the folio work. There are a number of similar problems. It's sad that gcc doesn't have a warning that catched this (although Clang does!) I've filed
https://gcc.gnu.org/bugzilla/show_bug.cgi?id=101645
In the meantime, I'm going to change:
- folio_nr_pages() now returns 'long' instead of 'unsigned long'.
- Everywhere that assigns it to a variable changes its type from 'int' or 'unsigned int' or 'unsigned long' to 'long'.
The only place this looks a little dodgy is:
+static inline bool folio_contains(struct folio *folio, pgoff_t index) +{
+ /* HugeTLBfs indexes the page cache in units of hpage_size */
+ if (folio_test_hugetlb(folio))
+ return folio->index == index;
+ return index - folio_index(folio) < folio_nr_pages(folio);
+}
but i'm pretty sure that's OK because index & folio_index are both unsigned long, and by my reading of the C spec, that promotes long to unsigned long, and so we do an unsigned comparison (meaning that index 3, folio_index() 4 will wrap around to ULONG_MAX and the comparison will return false, as expected.
I also intend to change update_lru_size() to take a long.
This patch is insufficient ... mem_cgroup_move_account() has the same bug. I'm not quite sure how to handle this patch -- I'm going to replace all this in 5.15, but this should be backported to earlier kernels.
Quoted 1 line · Matthew Wilcox
This patch is insufficient ...
mem_cgroup_move_account()has the same bug.
Do we have similar issue mem_cgroup_move_account()?
void __mod_lruvec_state(struct lruvec *lruvec, enum node_stat_item idx,
int val)
{
/* Update node */
__mod_node_page_state(lruvec_pgdat(lruvec), idx, val);the int val -> long val update happens as expected right?
-aneesh