sched/wait: Fix a kthread_park race with wait_woken()
PATCH v2 1/1 sched/wait: Fix a kthread_park race with wait_woken()
From: Arve Hjønnevåg <[email protected]>
kthread_park and wait_woken have a similar race that kthread_stop and wait_woken used to have before it was fixed in commit cb6538e740d7 ("sched/wait: Fix a kthread race with wait_woken()"). Extend that fix to also cover kthread_park.
Cc Ingo Molnar <[email protected]>
Cc Peter Zijlstra <[email protected]>
Cc Juri Lelli <[email protected]>
Cc Vincent Guittot <[email protected]>
Cc Dietmar Eggemann <[email protected]>
Cc Steven Rostedt <[email protected]>
Cc Ben Segall <[email protected]>
Cc Mel Gorman <[email protected]>
Cc Daniel Bristot de Oliveira <[email protected]>
Cc Valentin Schneider <[email protected]>
Cc android-kernel-team <[email protected]>
Signed-off-by Arve Hjønnevåg <[email protected]>
[jstultz: Made changes suggested by Peter to optimize
memory loads]
Signed-off-by John Stultz <[email protected]>
---
v2:
* Commit message tweaks, suggested by Peter
* Move logic to kthread.c & optimize to avoid duplicate memory loads, also suggested by Peter
--- include/linux/kthread.h | 1 + kernel/kthread.c | 10 ++++++++++ kernel/sched/wait.c | 7 +------ 3 files changed, 12 insertions(+), 6 deletions(-)
include/linux/kthread.h +1 -0
@@ -89,6 +89,7 @@ int kthread_stop(struct task_struct *k);bool kthread_should_stop (void );bool kthread_should_park (void );bool __kthread_should_park (struct task_struct *k); +bool kthread_should_stop_or_park (void );bool kthread_freezable_should_stop (bool *was_frozen);void *kthread_func (struct task_struct *k);void *kthread_data (struct task_struct *k);
kernel/kthread.c +10 -0
@@ -182,6 +182,16 @@ bool kthread_should_park(void) }EXPORT_SYMBOL_GPL (kthread_should_park); +bool kthread_should_stop_or_park (void ) +{ +struct kthread *kthread =__to_kthread (current); + +if (!kthread) +return false; + +return kthread->flags & (BIT (KTHREAD_SHOULD_STOP ) |BIT (KTHREAD_SHOULD_PARK )); +} +/** * kthread_freezable_should_stop - should this freezable kthread return now? * @was_frozen: optional out parameter, indicates whether %current was frozen
kernel/sched/wait.c +1 -6
@@ -425,11 +425,6 @@ int autoremove_wake_function(struct wait_queue_entry *wq_entry, unsigned mode, i }EXPORT_SYMBOL (autoremove_wake_function); -static inline bool is_kthread_should_stop (void ) -{ -return (current->flags &PF_KTHREAD ) &&kthread_should_stop (); -} -/* * DEFINE_WAIT_FUNC(wait, woken_wake_func); *
@@ -459,7 +454,7 @@ long wait_woken(struct wait_queue_entry *wq_entry, unsigned mode, long timeout)* or woken_wake_function() sees our store to current->state. */ set_current_state (mode);/* A */ -if (!(wq_entry->flags &WQ_FLAG_WOKEN ) && !is_kthread_should_stop ()) +if (!(wq_entry->flags &WQ_FLAG_WOKEN ) && !kthread_should_stop_or_park ()) timeout =schedule_timeout (timeout);__set_current_state (TASK_RUNNING );
Signature · 1 line
2.40.1.606.ga4b1b128d6-goog