mm/vmscan.c: not inherit classzone_idx from previous reclaim
Subsystems (3)
RFC PATCH 1/1 mm/vmscan.c: not inherit classzone_idx from previous reclaim
Before commit e716f2eb24de ("mm, vmscan: prevent kswapd sleeping prematurely due to mismatched classzone_idx"), classzone_idx could have two possibilities on a new loop based on whether there is a wakeup during reclaiming:
* 0 if no wakeup
* the classzone_idx request by wakeup
As described in the changelog, this commit is willing to change the first case to (MAX_NR_ZONES - 1) to avoid some premature sleep. But it does not achieve the goal.
There are two versions of kswapd_classzone_idx() since this change:
* commit e716f2eb24de ("mm, vmscan: prevent kswapd sleeping prematurely due to mismatched classzone_idx")
* commit dffcac2cb88e ("mm/vmscan.c: prevent useless kswapd loops")
Both of them would return the classzone_idx we passed as the 2nd parameter when (pgdat->kswapd_classzone_idx == MAX_NR_ZONES). This means if there is no wakeup during reclaiming, we would use classzone_idx in previous round to sleep.
This patch fixes the logic by using (MAX_NR_ZONES - 1) for the first case.
--- mm/vmscan.c | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-)
mm/vmscan.c +2 -2
@@ -3879,7 +3879,7 @@ static void kswapd_try_to_sleep(pg_data_t *pgdat, int alloc_order, int reclaim_ostatic int kswapd (void *p) {unsigned int alloc_order, reclaim_order; -unsigned int classzone_idx =MAX_NR_ZONES -1 ; +unsigned int classzone_idx;pg_data_t *pgdat = (pg_data_t *)p;struct task_struct *tsk = current;const struct cpumask *cpumask =cpumask_of_node (pgdat->node_id);
@@ -3908,7 +3908,7 @@ static int kswapd(void *p)bool ret; alloc_order = reclaim_order = pgdat->kswapd_order; - classzone_idx =kswapd_classzone_idx (pgdat, classzone_idx); + classzone_idx =kswapd_classzone_idx (pgdat,MAX_NR_ZONES -1 ); kswapd_try_sleep: kswapd_try_to_sleep(pgdat, alloc_order, reclaim_order,
Signature · 1 line
2.17.1
Quoted 14 lines · Wei Yang
Before commit
e716f2eb24de("mm, vmscan: prevent kswapd sleeping prematurely due to mismatchedclasszone_idx"),classzone_idxcould have two possibilities on a new loop based on whether there is a wakeup during reclaiming:* 0 if no wakeup
* theclasszone_idxrequest by wakeupAs described in the changelog, this commit is willing to change the first case to (
MAX_NR_ZONES- 1) to avoid some premature sleep. But it does not achieve the goal.There are two versions of
kswapd_classzone_idx()since this change:
Quoted 9 lines
* commit
e716f2eb24de("mm, vmscan: prevent kswapd sleeping prematurely due to mismatchedclasszone_idx")
* commitdffcac2cb88e("mm/vmscan.c: prevent useless kswapd loops")Both of them would return the
classzone_idxwe passed as the 2nd parameter when (pgdat->kswapd_classzone_idx==MAX_NR_ZONES). This means if there is no wakeup during reclaiming, we would useclasszone_idxin previous round to sleep.
This is somewhat intended.
Quoted 3 lines
This patch fixes the logic by using (
MAX_NR_ZONES- 1) for the first case.
Ok, what is the user-visible impact that is fixed by this patch or is this based on code review only? Please describe the test case exactly and the before and after results. I ask because this area is a magnet for regressions and intuitive ideas often lead to counter-intuitive results.
Signature · 2 lines
Mel Gorman SUSE Labs
Quoted 27 lines · Mel Gorman
Quoted 14 lines · Wei Yang
Before commit
e716f2eb24de("mm, vmscan: prevent kswapd sleeping prematurely due to mismatchedclasszone_idx"),classzone_idxcould have two possibilities on a new loop based on whether there is a wakeup during reclaiming:* 0 if no wakeup
* theclasszone_idxrequest by wakeupAs described in the changelog, this commit is willing to change the first case to (
MAX_NR_ZONES- 1) to avoid some premature sleep. But it does not achieve the goal.There are two versions of
kswapd_classzone_idx()since this change:Quoted 9 lines
* commit
e716f2eb24de("mm, vmscan: prevent kswapd sleeping prematurely due to mismatchedclasszone_idx")
* commitdffcac2cb88e("mm/vmscan.c: prevent useless kswapd loops")Both of them would return the
classzone_idxwe passed as the 2nd parameter when (pgdat->kswapd_classzone_idx==MAX_NR_ZONES). This means if there is no wakeup during reclaiming, we would useclasszone_idxin previous round to sleep.This is somewhat intended.
Quoted 9 lines
Quoted 3 lines
This patch fixes the logic by using (
MAX_NR_ZONES- 1) for the first case.Ok, what is the user-visible impact that is fixed by this patch or is this based on code review only? Please describe the test case exactly and the before and after results. I ask because this area is a magnet for regressions and intuitive ideas often lead to counter-intuitive results.
This is based on code review only. I know your concern. This is an area more like art then engineering :-)
Would you mind sharing some idea why we intend to inherit the classzone_idx? And for kswapd_order, we would restart at 0 if no wakeup during reclaim.
I am curious about the idea behind this design :-)
Quoted 3 lines
Signature · 2 lines
Mel Gorman SUSE Labs
Signature · 2 lines
Wei Yang Help you, Help me
Quoted 32 lines · Wei Yang
Quoted 31 lines · Mel Gorman
Quoted 14 lines · Wei Yang
Before commit
e716f2eb24de("mm, vmscan: prevent kswapd sleeping prematurely due to mismatchedclasszone_idx"),classzone_idxcould have two possibilities on a new loop based on whether there is a wakeup during reclaiming:* 0 if no wakeup
* theclasszone_idxrequest by wakeupAs described in the changelog, this commit is willing to change the first case to (
MAX_NR_ZONES- 1) to avoid some premature sleep. But it does not achieve the goal.There are two versions of
kswapd_classzone_idx()since this change:Quoted 9 lines
* commit
e716f2eb24de("mm, vmscan: prevent kswapd sleeping prematurely due to mismatchedclasszone_idx")
* commitdffcac2cb88e("mm/vmscan.c: prevent useless kswapd loops")Both of them would return the
classzone_idxwe passed as the 2nd parameter when (pgdat->kswapd_classzone_idx==MAX_NR_ZONES). This means if there is no wakeup during reclaiming, we would useclasszone_idxin previous round to sleep.This is somewhat intended.
Quoted 3 lines
This patch fixes the logic by using (
MAX_NR_ZONES- 1) for the first case.
Quoted 9 lines
Quoted 5 lines
Ok, what is the user-visible impact that is fixed by this patch or is this based on code review only? Please describe the test case exactly and the before and after results. I ask because this area is a magnet for regressions and intuitive ideas often lead to counter-intuitive results.
This is based on code review only. I know your concern. This is an area more like art then engineering :-)
Then I'm afraid that until there is a corner case identified and a description of the impact it's
Quoted 3 lines
Would you mind sharing some idea why we intend to inherit the
classzone_idx? And forkswapd_order, we would restart at 0 if no wakeup during reclaim.
Broadly speaking it was driven by cases whereby kswapd either a) fell asleep prematurely and there were many stalls in direct reclaim before kswapd recovered, b) stalls in direct reclaim immediately after kswapd went to sleep or c) kswapd reclaimed for lower zones and went to sleep while parallel tasks were direct reclaiming in higher zones or higher orders.
Signature · 2 lines
Mel Gorman SUSE Labs
Quoted 39 lines · Mel Gorman
Quoted 38 lines · Wei Yang
Quoted 36 lines · Mel Gorman
Quoted 14 lines · Wei Yang
Before commit
e716f2eb24de("mm, vmscan: prevent kswapd sleeping prematurely due to mismatchedclasszone_idx"),classzone_idxcould have two possibilities on a new loop based on whether there is a wakeup during reclaiming:* 0 if no wakeup
* theclasszone_idxrequest by wakeupAs described in the changelog, this commit is willing to change the first case to (
MAX_NR_ZONES- 1) to avoid some premature sleep. But it does not achieve the goal.There are two versions of
kswapd_classzone_idx()since this change:Quoted 9 lines
* commit
e716f2eb24de("mm, vmscan: prevent kswapd sleeping prematurely due to mismatchedclasszone_idx")
* commitdffcac2cb88e("mm/vmscan.c: prevent useless kswapd loops")Both of them would return the
classzone_idxwe passed as the 2nd parameter when (pgdat->kswapd_classzone_idx==MAX_NR_ZONES). This means if there is no wakeup during reclaiming, we would useclasszone_idxin previous round to sleep.This is somewhat intended.
Quoted 3 lines
This patch fixes the logic by using (
MAX_NR_ZONES- 1) for the first case.Ok, what is the user-visible impact that is fixed by this patch or is this based on code review only? Please describe the test case exactly and the before and after results. I ask because this area is a magnet for regressions and intuitive ideas often lead to counter-intuitive results.
Quoted 9 lines
Quoted 3 lines
This is based on code review only. I know your concern. This is an area more like art then engineering :-)
Then I'm afraid that until there is a corner case identified and a description of the impact it's
Nacked-by Mel Gorman <[email protected]>
Yep, no problem. I am glad if I could get some idea from you.
Quoted 10 lines
Quoted 3 lines
Would you mind sharing some idea why we intend to inherit the
classzone_idx? And forkswapd_order, we would restart at 0 if no wakeup during reclaim.Broadly speaking it was driven by cases whereby kswapd either a) fell asleep prematurely and there were many stalls in direct reclaim before kswapd recovered, b) stalls in direct reclaim immediately after kswapd went to sleep or c) kswapd reclaimed for lower zones and went to sleep while parallel tasks were direct reclaiming in higher zones or higher orders.
Thanks for your explanation. I am trying to understand the connection between those cases and the behavior of kswapd.
In summary, all three cases are related to direct reclaim, while happens in three different timing of kswapd:
a) premature sleep
b) full sleep
c) full sleep after reclaim lower zone
Hmm... I am not sure the difference between b) and c). Looks both face direct reclaim when kswapd is sleeping.
If I am correct, direct reclaim here is performed by function __perform_reclaim(). Its scan order and zone_idx is retrieved from allocation parameters, so it doesn't affect pgdat{.kswapd_order, .kswapd_classzone_idx} if I am correct.
Direct reclaim do affect the pgdat status. After reclaiming, we may have more available pages. But I am stuck in the connection between direct reclaim and kswapd. Would you mind sharing more light on this part?
Quoted 3 lines
Signature · 2 lines
Mel Gorman SUSE Labs
Signature · 2 lines
Wei Yang Help you, Help me
Quoted 7 lines · Wei Yang
Quoted 5 lines · Mel Gorman
Broadly speaking it was driven by cases whereby kswapd either a) fell asleep prematurely and there were many stalls in direct reclaim before kswapd recovered, b) stalls in direct reclaim immediately after kswapd went to sleep or c) kswapd reclaimed for lower zones and went to sleep while parallel tasks were direct reclaiming in higher zones or higher orders.
Quoted 5 lines
Thanks for your explanation. I am trying to understand the connection between those cases and the behavior of kswapd.
In summary, all three cases are related to direct reclaim, while happens in three different timing of kswapd:
Reclaim performed by kswapd is the opposite of direct reclaim. Direct reclaim is reclaim initiated by a task which is trying to allocate memory. If a task cannot perform direct reclaim itself, it may ask kswapd to attempt to reclaim memory for it.
Quoted 11 lines · Matthew Wilcox
Quoted 10 lines · Wei Yang
Quoted 5 lines · Mel Gorman
Broadly speaking it was driven by cases whereby kswapd either a) fell asleep prematurely and there were many stalls in direct reclaim before kswapd recovered, b) stalls in direct reclaim immediately after kswapd went to sleep or c) kswapd reclaimed for lower zones and went to sleep while parallel tasks were direct reclaiming in higher zones or higher orders.
Thanks for your explanation. I am trying to understand the connection between those cases and the behavior of kswapd.
Quoted 7 lines
Quoted 2 lines
In summary, all three cases are related to direct reclaim, while happens in three different timing of kswapd:
Reclaim performed by kswapd is the opposite of direct reclaim. Direct reclaim is reclaim initiated by a task which is trying to allocate memory. If a task cannot perform direct reclaim itself, it may ask kswapd to attempt to reclaim memory for it.
Not totally opposite, I think.
They both reclaim some memory, while after direct reclaim, some freed memory will be allocated.
Is this the difference you want to mention?
Signature · 2 lines
Wei Yang Help you, Help me