mm: move_pages: report the number of non-attempted pages
Subsystems (3)
PATCH v3 1/1 mm: move_pages: report the number of non-attempted pages
Since commit 49bd4d71637 ("mm, numa: rework do_pages_move"), the semantic of move_pages() has changed to return the number of non-migrated pages if they were result of a non-fatal reasons (usually a busy page). This was an unintentional change that hasn't been noticed except for LTP tests which checked for the documented behavior.
There are two ways to go around this change. We can even get back to the original behavior and return -EAGAIN whenever migrate_pages is not able to migrate pages due to non-fatal reasons. Another option would be to simply continue with the changed semantic and extend move_pages documentation to clarify that -errno is returned on an invalid input or when migration simply cannot succeed (e.g. -ENOMEM, -EBUSY) or the number of pages that couldn't have been migrated due to ephemeral reasons (e.g. page is pinned or locked for other reasons).
This patch implements the second option because this behavior is in place for some time without anybody complaining and possibly new users depending on it. Also it allows to have a slightly easier error handling as the caller knows that it is worth to retry when err > 0.
But since the new semantic would be aborted immediately if migration is failed due to ephemeral reasons, need include the number of non-attempted pages in the return value too.
---
v3: Rephrased the commit log per Michal and added Michal's Acked-by
v2: Rebased on top of the latest mainline kernel per Andrew
mm/migrate.c | 24 ++++++++++++++++++++++-- 1 file changed, 22 insertions(+), 2 deletions(-)
mm/migrate.c +22 -2
@@ -1627,8 +1627,18 @@ static int do_pages_move(struct mm_struct *mm, nodemask_t task_nodes, start = i; }else if (node != current_node) { err =do_move_pages_to_node (mm, &pagelist, current_node); -if (err) +if (err) { +/* +* Possitive err means the number of failed +* pages to migrate. Since we are going to +* abort and return the number of non-migrated +* pages, so need incude the rest of the +* nr_pages that have not attempted as well. +*/ +if (err >0 ) + err += nr_pages - i -1 ; goto out; + } err =store_status (status, start, current_node, i - start);if (err) goto out;
@@ -1659,8 +1669,11 @@ static int do_pages_move(struct mm_struct *mm, nodemask_t task_nodes, goto out_flush; err =do_move_pages_to_node (mm, &pagelist, current_node); -if (err) +if (err) { +if (err >0 ) + err += nr_pages - i -1 ; goto out; + }if (i > start) { err =store_status (status, start, current_node, i - start);if (err)
@@ -1674,6 +1687,13 @@ static int do_pages_move(struct mm_struct *mm, nodemask_t task_nodes,/* Make sure we do not overwrite the existing error */ err1 =do_move_pages_to_node (mm, &pagelist, current_node); +/* +* Don't have to report non-attempted pages here since: +* - If the above loop is done gracefully there is not non-attempted +* page. +* - If the above loop is aborted to it means more fatal error +* happened, should return err. +*/ if (!err1) err1 =store_status (status, start, current_node, i - start);if (!err)
Signature · 1 line
1.8.3.1
mm/migrate.c static int do_pages_move(struct mm_struct *mm, nodemask_t task_nodes, · line 1632
Quoted 8 lines
mm/migrate.c +3
-1@@ -1627,8 +1627,18 @@ static int do_pages_move(struct mm_struct *mm, nodemask_t task_nodes, start = i; }else if (node != current_node) { err =do_move_pages_to_node (mm, &pagelist, current_node); -if (err) +if (err) { +/* +* Possitive err means the number of failed
"positive"
mm/migrate.c static int do_pages_move(struct mm_struct *mm, nodemask_t task_nodes, · line 1635
Quoted 3 lines
mm/migrate.c +3
-0+* pages to migrate. Since we are going to +* abort and return the number of non-migrated +* pages, so need incude the rest of the
"need to include"
mm/migrate.c static int do_pages_move(struct mm_struct *mm, nodemask_t task_nodes, · line 1636
Quoted 1 line
mm/migrate.c +1
-0+* nr_pages that have not attempted as well.
"have not been attempted"
mm/migrate.c static int do_pages_move(struct mm_struct *mm, nodemask_t task_nodes, · line 1692
Quoted 7 lines
mm/migrate.c +3
-0@@ -1674,6 +1687,13 @@ static int do_pages_move(struct mm_struct *mm, nodemask_t task_nodes,/* Make sure we do not overwrite the existing error */ err1 =do_move_pages_to_node (mm, &pagelist, current_node); +/* +* Don't have to report non-attempted pages here since: +* - If the above loop is done gracefully there is not non-attempted
"all pages have been attempted"
mm/migrate.c static int do_pages_move(struct mm_struct *mm, nodemask_t task_nodes, · line 1694
Quoted 2 lines
mm/migrate.c +2
-0+* page. +* - If the above loop is aborted to it means more fatal error
s/to// s/more/a/
mm/migrate.c static int do_pages_move(struct mm_struct *mm, nodemask_t task_nodes, · line 1696
Quoted 2 lines
mm/migrate.c +2
-0+* happened, should return err. +*/
I'd also be tempted to rename "err" to "ret" since it has meanings beyond "error" now.
Quoted 27 lines · Matthew Wilcox
mm/migrate.c static int do_pages_move(struct mm_struct *mm, nodemask_t task_nodes, · line 1632
Quoted 8 lines
mm/migrate.c +3
-1@@ -1627,8 +1627,18 @@ static int do_pages_move(struct mm_struct *mm, nodemask_t task_nodes, start = i; }else if (node != current_node) { err =do_move_pages_to_node (mm, &pagelist, current_node); -if (err) +if (err) { +/* +* Possitive err means the number of failed "positive"
mm/migrate.c static int do_pages_move(struct mm_struct *mm, nodemask_t task_nodes, · line 1635
Quoted 3 lines
mm/migrate.c +3
-0+* pages to migrate. Since we are going to +* abort and return the number of non-migrated +* pages, so need incude the rest of the "need to include"
mm/migrate.c static int do_pages_move(struct mm_struct *mm, nodemask_t task_nodes, · line 1636
Quoted 1 line
mm/migrate.c +1
-0+* nr_pages that have not attempted as well. "have not been attempted"
mm/migrate.c static int do_pages_move(struct mm_struct *mm, nodemask_t task_nodes, · line 1692
Quoted 7 lines
mm/migrate.c +3
-0@@ -1674,6 +1687,13 @@ static int do_pages_move(struct mm_struct *mm, nodemask_t task_nodes,/* Make sure we do not overwrite the existing error */ err1 =do_move_pages_to_node (mm, &pagelist, current_node); +/* +* Don't have to report non-attempted pages here since: +* - If the above loop is done gracefully there is not non-attempted "all pages have been attempted"
Quoted 8 lines
mm/migrate.c static int do_pages_move(struct mm_struct *mm, nodemask_t task_nodes, · line 1694
Quoted 2 lines
mm/migrate.c +2
-0+* page. +* - If the above loop is aborted to it means more fatal error s/to// s/more/a/
mm/migrate.c static int do_pages_move(struct mm_struct *mm, nodemask_t task_nodes, · line 1696
Quoted 2 lines
mm/migrate.c +2
-0+* happened, should return err. +*/ I'd also be tempted to rename "err" to "ret" since it has meanings beyond "error" now.
Thanks for catching these problems. Will fix in v4.
Quoted 1 line
Btw. please do not forget to update the man page as well. Thanks!
Signature · 2 lines
Michal Hocko SUSE Labs
Quoted 2 lines · Michal Hocko
Btw. please do not forget to update the man page as well. Thanks!
Sure.