clocksource: Use pr_info() for "Checking clocksource synchronization" message
PATCH 1/2 clocksource: Use pr_info() for "Checking clocksource synchronization" message
The "Checking clocksource synchronization" message is normally printed when clocksource_verify_percpu() is called for a given clocksource if both the CLOCK_SOURCE_UNSTABLE and CLOCK_SOURCE_VERIFY_PERCPU flags are set. It is an informational message and so pr_info() should be used instead of pr_warn().
--- kernel/time/clocksource.c | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-)
kernel/time/clocksource.c +2 -1
@@ -382,7 +382,8 @@ void clocksource_verify_percpu(struct clocksource *cs)return ; } testcpu =smp_processor_id (); -pr_warn ("Checking clocksource %s synchronization from CPU %d to CPUs %*pbl.\n" , cs->name, testcpu,cpumask_pr_args (&cpus_chosen)); +pr_info ("Checking clocksource %s synchronization from CPU %d to CPUs %*pbl.\n" , + cs->name, testcpu,cpumask_pr_args (&cpus_chosen));for_each_cpu (cpu, &cpus_chosen) {if (cpu == testcpu)continue ;
Signature · 1 line
2.47.1
PATCH 2/2 clocksource: Defer preempt_disable() after clocksource_verify_choose_cpus()
The following bug report happened in a PREEMPT_RT kernel.
[ 30.957705] BUG: sleeping function called from invalid context at kernel/locking/spinlock_rt.c:48
[ 30.957711] in_atomic(): 1, irqs_disabled(): 0, non_block: 0, pid: 2012, name: kwatchdog
[ 30.962673] preempt_count: 1, expected: 0
[ 30.962676] RCU nest depth: 0, expected: 0
[ 30.962680] 3 locks held by kwatchdog/2012:
[ 30.962684] #0: ffffffff8af2da60 (clocksource_mutex){+.+.}-{3:3}, at: clocksource_watchdog_kthread+0x13/0x50
[ 30.967703] #1: ffffffff8aa8d4d0 (cpu_hotplug_lock){++++}-{0:0}, at: clocksource_verify_percpu.part.0+0x5c/0x330
[ 30.972774] #2: ffff9fe02f5f33e0 ((batched_entropy_u32.lock)){+.+.}-{2:2}, at: get_random_u32+0x4f/0x110
[ 30.977827] Preemption disabled at:
[ 30.977830] [<ffffffff88c1fe56>] clocksource_verify_percpu.part.0+0x66/0x330
[ 30.982837] CPU: 33 PID: 2012 Comm: kwatchdog Not tainted 5.14.0-503.23.1.el9_5.x86_64+rt-debug #1
[ 30.982843] Hardware name: HPE ProLiant DL385 Gen10 Plus/ProLiant DL385 Gen10 Plus, BIOS A42 04/29/2021
[ 30.982846] Call Trace:
[ 30.982850] <TASK>
[ 30.983821] dump_stack_lvl+0x57/0x81
[ 30.983821] __might_resched.cold+0xf4/0x12f
[ 30.983824] rt_spin_lock+0x4c/0x100
[ 30.988833] get_random_u32+0x4f/0x110
[ 30.988833] clocksource_verify_choose_cpus+0xab/0x1a0
[ 30.988833] clocksource_verify_percpu.part.0+0x6b/0x330
[ 30.993894] __clocksource_watchdog_kthread+0x193/0x1a0
[ 30.993898] clocksource_watchdog_kthread+0x18/0x50
[ 30.993898] kthread+0x114/0x140
[ 30.993898] ret_from_fork+0x2c/0x50
[ 31.002864] </TASK>It is due to the fact that get_random_u32() is called in clocksource_verify_choose_cpus() with preemption disabled. If crng_ready() is true by the time get_random_u32() is called, The batched_entropy_32 local lock will be acquired. In PREEMPT_RT kernel, it is a rtmutex and we can't acquire it with preemption disabled.
To avoid this problem, we can't call get_random_u32() with preemption disabled. However, smp_processor_id() has to be called with preemption disabled though and we have to exclude the current CPU from the cpus_chosen list to be tested.
Extract current CPU removal code out from clocksource_verify_choose_cpus() and defer the preempt_disable() call to after clocksource_verify_choose_cpus() and before current CPU removal. Also use raw_smp_processor_id() in clocksource_verify_choose_cpus().
--- kernel/time/clocksource.c | 19 +++++++++++-------- 1 file changed, 11 insertions(+), 8 deletions(-)
kernel/time/clocksource.c +11 -8
@@ -313,7 +313,6 @@ static void clocksource_verify_choose_cpus(void)if (n <0 ) {/* Check all of the CPUs. */ cpumask_copy (&cpus_chosen, cpu_online_mask); -cpumask_clear_cpu (smp_processor_id (), &cpus_chosen);return ; }
@@ -322,9 +321,13 @@ static void clocksource_verify_choose_cpus(void)if (n ==0 ||num_online_cpus () <=1 )return ; -/* Make sure to select at least one CPU other than the current CPU. */ +/* +* Make sure to select at least one CPU other than the current CPU. +* raw_smp_processor_id() is used opportunistically here as +* preemption isn't disabled. +*/ cpu =cpumask_first (cpu_online_mask); -if (cpu ==smp_processor_id ()) +if (cpu ==raw_smp_processor_id ()) cpu =cpumask_next (cpu, cpu_online_mask);if (WARN_ON_ONCE (cpu >= nr_cpu_ids))return ;
@@ -349,9 +352,6 @@ static void clocksource_verify_choose_cpus(void)if (!WARN_ON_ONCE (cpu >= nr_cpu_ids))cpumask_set_cpu (cpu, &cpus_chosen); } - -/* Don't verify ourselves. */ -cpumask_clear_cpu (smp_processor_id (), &cpus_chosen); }static void clocksource_verify_one_cpu (void *csin)
@@ -373,15 +373,18 @@ void clocksource_verify_percpu(struct clocksource *cs)cpumask_clear (&cpus_ahead);cpumask_clear (&cpus_behind);cpus_read_lock (); -preempt_disable ();clocksource_verify_choose_cpus (); +preempt_disable (); + +/* Don't verify ourselves. */ + testcpu =smp_processor_id (); +cpumask_clear_cpu (testcpu, &cpus_chosen);if (cpumask_empty (&cpus_chosen)) {preempt_enable ();cpus_read_unlock ();pr_warn ("Not enough CPUs to check clocksource '%s'.\n" , cs->name);return ; } - testcpu =smp_processor_id ();pr_info ("Checking clocksource %s synchronization from CPU %d to CPUs %*pbl.\n" , cs->name, testcpu,cpumask_pr_args (&cpus_chosen));for_each_cpu (cpu, &cpus_chosen) {
Signature · 1 line
2.47.1
Re: [PATCH 2/2] clocksource: Defer preempt_disable() after clocksource_verify_choose_cpus()
Quoted 39 lines · Waiman Long
The following bug report happened in a
PREEMPT_RTkernel.[ 30.957705] BUG: sleeping function called from invalid context at kernel/locking/spinlock_rt.c:48 [ 30.957711] in_atomic(): 1, irqs_disabled(): 0, non_block: 0, pid: 2012, name: kwatchdog [ 30.962673] preempt_count: 1, expected: 0 [ 30.962676] RCU nest depth: 0, expected: 0 [ 30.962680] 3 locks held by kwatchdog/2012: [ 30.962684] #0: ffffffff8af2da60 (clocksource_mutex){+.+.}-{3:3}, at: clocksource_watchdog_kthread+0x13/0x50 [ 30.967703] #1: ffffffff8aa8d4d0 (cpu_hotplug_lock){++++}-{0:0}, at: clocksource_verify_percpu.part.0+0x5c/0x330 [ 30.972774] #2: ffff9fe02f5f33e0 ((batched_entropy_u32.lock)){+.+.}-{2:2}, at: get_random_u32+0x4f/0x110 [ 30.977827] Preemption disabled at: [ 30.977830] [<ffffffff88c1fe56>] clocksource_verify_percpu.part.0+0x66/0x330 [ 30.982837] CPU: 33 PID: 2012 Comm: kwatchdog Not tainted 5.14.0-503.23.1.el9_5.x86_64+rt-debug #1 [ 30.982843] Hardware name: HPE ProLiant DL385 Gen10 Plus/ProLiant DL385 Gen10 Plus, BIOS A42 04/29/2021 [ 30.982846] Call Trace: [ 30.982850] <TASK> [ 30.983821] dump_stack_lvl+0x57/0x81 [ 30.983821] __might_resched.cold+0xf4/0x12f [ 30.983824] rt_spin_lock+0x4c/0x100 [ 30.988833] get_random_u32+0x4f/0x110 [ 30.988833] clocksource_verify_choose_cpus+0xab/0x1a0 [ 30.988833] clocksource_verify_percpu.part.0+0x6b/0x330 [ 30.993894] __clocksource_watchdog_kthread+0x193/0x1a0 [ 30.993898] clocksource_watchdog_kthread+0x18/0x50 [ 30.993898] kthread+0x114/0x140 [ 30.993898] ret_from_fork+0x2c/0x50 [ 31.002864] </TASK>It is due to the fact that
get_random_u32()is called inclocksource_verify_choose_cpus()with preemption disabled. Ifcrng_ready()is true by the timeget_random_u32()is called, Thebatched_entropy_32local lock will be acquired. InPREEMPT_RTkernel, it is a rtmutex and we can't acquire it with preemption disabled.To avoid this problem, we can't call
get_random_u32()with preemption disabled. However,smp_processor_id()has to be called with preemption disabled though and we have to exclude the current CPU from thecpus_chosenlist to be tested.
Quoted 8 lines
Extract current CPU removal code out from
clocksource_verify_choose_cpus()and defer thepreempt_disable()call to afterclocksource_verify_choose_cpus()and before current CPU removal. Also useraw_smp_processor_id()inclocksource_verify_choose_cpus().Fixes 7560c02bdffb ("clocksource: Check per-CPU clock synchronization when marked unstable")Signed-off-by Waiman Long <[email protected]>
Good catch!
But we don't need cryptographically secure random numbers (or blistering speed) here. Substituting something like torture_random()%nr_cpu_ids for get_random_u32_below() work?
Thanx, Paul
Quoted 66 lines
--- kernel/time/clocksource.c | 19 +++++++++++-------- 1 file changed, 11 insertions(+), 8 deletions(-)kernel/time/clocksource.c +11
-8@@ -313,7 +313,6 @@ static void clocksource_verify_choose_cpus(void)if (n <0 ) {/* Check all of the CPUs. */ cpumask_copy (&cpus_chosen, cpu_online_mask); -cpumask_clear_cpu (smp_processor_id (), &cpus_chosen);return ; }@@ -322,9 +321,13 @@ static void clocksource_verify_choose_cpus(void)if (n ==0 ||num_online_cpus () <=1 )return ; -/* Make sure to select at least one CPU other than the current CPU. */ +/* +* Make sure to select at least one CPU other than the current CPU. +* raw_smp_processor_id() is used opportunistically here as +* preemption isn't disabled. +*/ cpu =cpumask_first (cpu_online_mask); -if (cpu ==smp_processor_id ()) +if (cpu ==raw_smp_processor_id ()) cpu =cpumask_next (cpu, cpu_online_mask);if (WARN_ON_ONCE (cpu >= nr_cpu_ids))return ;@@ -349,9 +352,6 @@ static void clocksource_verify_choose_cpus(void)if (!WARN_ON_ONCE (cpu >= nr_cpu_ids))cpumask_set_cpu (cpu, &cpus_chosen); } - -/* Don't verify ourselves. */ -cpumask_clear_cpu (smp_processor_id (), &cpus_chosen); }static void clocksource_verify_one_cpu (void *csin)@@ -373,15 +373,18 @@ void clocksource_verify_percpu(struct clocksource *cs)cpumask_clear (&cpus_ahead);cpumask_clear (&cpus_behind);cpus_read_lock (); -preempt_disable ();clocksource_verify_choose_cpus (); +preempt_disable (); + +/* Don't verify ourselves. */ + testcpu =smp_processor_id (); +cpumask_clear_cpu (testcpu, &cpus_chosen);if (cpumask_empty (&cpus_chosen)) {preempt_enable ();cpus_read_unlock ();pr_warn ("Not enough CPUs to check clocksource '%s'.\n" , cs->name);return ; } - testcpu =smp_processor_id ();pr_info ("Checking clocksource %s synchronization from CPU %d to CPUs %*pbl.\n" , cs->name, testcpu,cpumask_pr_args (&cpus_chosen));for_each_cpu (cpu, &cpus_chosen) {Signature · 1 line
2.47.1
Re: [PATCH 2/2] clocksource: Defer preempt_disable() after clocksource_verify_choose_cpus()
Quoted 48 lines · Paul E. McKenney
Quoted 39 lines · Waiman Long
The following bug report happened in a
PREEMPT_RTkernel.[ 30.957705] BUG: sleeping function called from invalid context at kernel/locking/spinlock_rt.c:48 [ 30.957711] in_atomic(): 1, irqs_disabled(): 0, non_block: 0, pid: 2012, name: kwatchdog [ 30.962673] preempt_count: 1, expected: 0 [ 30.962676] RCU nest depth: 0, expected: 0 [ 30.962680] 3 locks held by kwatchdog/2012: [ 30.962684] #0: ffffffff8af2da60 (clocksource_mutex){+.+.}-{3:3}, at: clocksource_watchdog_kthread+0x13/0x50 [ 30.967703] #1: ffffffff8aa8d4d0 (cpu_hotplug_lock){++++}-{0:0}, at: clocksource_verify_percpu.part.0+0x5c/0x330 [ 30.972774] #2: ffff9fe02f5f33e0 ((batched_entropy_u32.lock)){+.+.}-{2:2}, at: get_random_u32+0x4f/0x110 [ 30.977827] Preemption disabled at: [ 30.977830] [<ffffffff88c1fe56>] clocksource_verify_percpu.part.0+0x66/0x330 [ 30.982837] CPU: 33 PID: 2012 Comm: kwatchdog Not tainted 5.14.0-503.23.1.el9_5.x86_64+rt-debug #1 [ 30.982843] Hardware name: HPE ProLiant DL385 Gen10 Plus/ProLiant DL385 Gen10 Plus, BIOS A42 04/29/2021 [ 30.982846] Call Trace: [ 30.982850] <TASK> [ 30.983821] dump_stack_lvl+0x57/0x81 [ 30.983821] __might_resched.cold+0xf4/0x12f [ 30.983824] rt_spin_lock+0x4c/0x100 [ 30.988833] get_random_u32+0x4f/0x110 [ 30.988833] clocksource_verify_choose_cpus+0xab/0x1a0 [ 30.988833] clocksource_verify_percpu.part.0+0x6b/0x330 [ 30.993894] __clocksource_watchdog_kthread+0x193/0x1a0 [ 30.993898] clocksource_watchdog_kthread+0x18/0x50 [ 30.993898] kthread+0x114/0x140 [ 30.993898] ret_from_fork+0x2c/0x50 [ 31.002864] </TASK>It is due to the fact that
get_random_u32()is called inclocksource_verify_choose_cpus()with preemption disabled. Ifcrng_ready()is true by the timeget_random_u32()is called, Thebatched_entropy_32local lock will be acquired. InPREEMPT_RTkernel, it is a rtmutex and we can't acquire it with preemption disabled.To avoid this problem, we can't call
get_random_u32()with preemption disabled. However,smp_processor_id()has to be called with preemption disabled though and we have to exclude the current CPU from thecpus_chosenlist to be tested.Quoted 8 lines
Extract current CPU removal code out from
clocksource_verify_choose_cpus()and defer thepreempt_disable()call to afterclocksource_verify_choose_cpus()and before current CPU removal. Also useraw_smp_processor_id()inclocksource_verify_choose_cpus().Fixes 7560c02bdffb ("clocksource: Check per-CPU clock synchronization when marked unstable")Signed-off-by Waiman Long <[email protected]>
Quoted 7 lines
Good catch!
But we don't need cryptographically secure random numbers (or blistering speed) here. Substituting something like torture_random()%nr_cpu_ids for
get_random_u32_below()work?Thanx, Paul
That should work too. I can update the patch to use a less random generator if others have no objection.
Cheers,
Longman
Quoted 67 lines
Quoted 67 lines
--- kernel/time/clocksource.c | 19 +++++++++++-------- 1 file changed, 11 insertions(+), 8 deletions(-)kernel/time/clocksource.c +11
-8@@ -313,7 +313,6 @@ static void clocksource_verify_choose_cpus(void)if (n <0 ) {/* Check all of the CPUs. */ cpumask_copy (&cpus_chosen, cpu_online_mask); -cpumask_clear_cpu (smp_processor_id (), &cpus_chosen);return ; }@@ -322,9 +321,13 @@ static void clocksource_verify_choose_cpus(void)if (n ==0 ||num_online_cpus () <=1 )return ; -/* Make sure to select at least one CPU other than the current CPU. */ +/* +* Make sure to select at least one CPU other than the current CPU. +* raw_smp_processor_id() is used opportunistically here as +* preemption isn't disabled. +*/ cpu =cpumask_first (cpu_online_mask); -if (cpu ==smp_processor_id ()) +if (cpu ==raw_smp_processor_id ()) cpu =cpumask_next (cpu, cpu_online_mask);if (WARN_ON_ONCE (cpu >= nr_cpu_ids))return ;@@ -349,9 +352,6 @@ static void clocksource_verify_choose_cpus(void)if (!WARN_ON_ONCE (cpu >= nr_cpu_ids))cpumask_set_cpu (cpu, &cpus_chosen); } - -/* Don't verify ourselves. */ -cpumask_clear_cpu (smp_processor_id (), &cpus_chosen); }static void clocksource_verify_one_cpu (void *csin)@@ -373,15 +373,18 @@ void clocksource_verify_percpu(struct clocksource *cs)cpumask_clear (&cpus_ahead);cpumask_clear (&cpus_behind);cpus_read_lock (); -preempt_disable ();clocksource_verify_choose_cpus (); +preempt_disable (); + +/* Don't verify ourselves. */ + testcpu =smp_processor_id (); +cpumask_clear_cpu (testcpu, &cpus_chosen);if (cpumask_empty (&cpus_chosen)) {preempt_enable ();cpus_read_unlock ();pr_warn ("Not enough CPUs to check clocksource '%s'.\n" , cs->name);return ; } - testcpu =smp_processor_id ();pr_info ("Checking clocksource %s synchronization from CPU %d to CPUs %*pbl.\n" , cs->name, testcpu,cpumask_pr_args (&cpus_chosen));for_each_cpu (cpu, &cpus_chosen) {Signature · 1 line
2.47.1
Re: [PATCH 2/2] clocksource: Defer preempt_disable() after clocksource_verify_choose_cpus()
In reply to Paul E. McKenneyQuoted 46 lines · Paul E. McKenney
Quoted 45 lines · Waiman Long
The following bug report happened in a
PREEMPT_RTkernel.[ 30.957705] BUG: sleeping function called from invalid context at kernel/locking/spinlock_rt.c:48 [ 30.957711] in_atomic(): 1, irqs_disabled(): 0, non_block: 0, pid: 2012, name: kwatchdog [ 30.962673] preempt_count: 1, expected: 0 [ 30.962676] RCU nest depth: 0, expected: 0 [ 30.962680] 3 locks held by kwatchdog/2012: [ 30.962684] #0: ffffffff8af2da60 (clocksource_mutex){+.+.}-{3:3}, at: clocksource_watchdog_kthread+0x13/0x50 [ 30.967703] #1: ffffffff8aa8d4d0 (cpu_hotplug_lock){++++}-{0:0}, at: clocksource_verify_percpu.part.0+0x5c/0x330 [ 30.972774] #2: ffff9fe02f5f33e0 ((batched_entropy_u32.lock)){+.+.}-{2:2}, at: get_random_u32+0x4f/0x110 [ 30.977827] Preemption disabled at: [ 30.977830] [<ffffffff88c1fe56>] clocksource_verify_percpu.part.0+0x66/0x330 [ 30.982837] CPU: 33 PID: 2012 Comm: kwatchdog Not tainted 5.14.0-503.23.1.el9_5.x86_64+rt-debug #1 [ 30.982843] Hardware name: HPE ProLiant DL385 Gen10 Plus/ProLiant DL385 Gen10 Plus, BIOS A42 04/29/2021 [ 30.982846] Call Trace: [ 30.982850] <TASK> [ 30.983821] dump_stack_lvl+0x57/0x81 [ 30.983821] __might_resched.cold+0xf4/0x12f [ 30.983824] rt_spin_lock+0x4c/0x100 [ 30.988833] get_random_u32+0x4f/0x110 [ 30.988833] clocksource_verify_choose_cpus+0xab/0x1a0 [ 30.988833] clocksource_verify_percpu.part.0+0x6b/0x330 [ 30.993894] __clocksource_watchdog_kthread+0x193/0x1a0 [ 30.993898] clocksource_watchdog_kthread+0x18/0x50 [ 30.993898] kthread+0x114/0x140 [ 30.993898] ret_from_fork+0x2c/0x50 [ 31.002864] </TASK>It is due to the fact that
get_random_u32()is called inclocksource_verify_choose_cpus()with preemption disabled. Ifcrng_ready()is true by the timeget_random_u32()is called, Thebatched_entropy_32local lock will be acquired. InPREEMPT_RTkernel, it is a rtmutex and we can't acquire it with preemption disabled.To avoid this problem, we can't call
get_random_u32()with preemption disabled. However,smp_processor_id()has to be called with preemption disabled though and we have to exclude the current CPU from thecpus_chosenlist to be tested.Extract current CPU removal code out from
clocksource_verify_choose_cpus()and defer thepreempt_disable()call to afterclocksource_verify_choose_cpus()and before current CPU removal. Also useraw_smp_processor_id()inclocksource_verify_choose_cpus().
Quoted 8 lines
Quoted 2 lines
Fixes 7560c02bdffb ("clocksource: Check per-CPU clock synchronization when marked unstable")Signed-off-by Waiman Long <[email protected]>Good catch!
But we don't need cryptographically secure random numbers (or blistering speed) here. Substituting something like torture_random()%nr_cpu_ids for
get_random_u32_below()work?
I suppose I should add my concern... If we don't have preemption disabled across this code, we cannot reliably avoid attempting to IPI ourselves.
Thanx, Paul
Quoted 66 lines
Quoted 66 lines
--- kernel/time/clocksource.c | 19 +++++++++++-------- 1 file changed, 11 insertions(+), 8 deletions(-)kernel/time/clocksource.c +11
-8@@ -313,7 +313,6 @@ static void clocksource_verify_choose_cpus(void)if (n <0 ) {/* Check all of the CPUs. */ cpumask_copy (&cpus_chosen, cpu_online_mask); -cpumask_clear_cpu (smp_processor_id (), &cpus_chosen);return ; }@@ -322,9 +321,13 @@ static void clocksource_verify_choose_cpus(void)if (n ==0 ||num_online_cpus () <=1 )return ; -/* Make sure to select at least one CPU other than the current CPU. */ +/* +* Make sure to select at least one CPU other than the current CPU. +* raw_smp_processor_id() is used opportunistically here as +* preemption isn't disabled. +*/ cpu =cpumask_first (cpu_online_mask); -if (cpu ==smp_processor_id ()) +if (cpu ==raw_smp_processor_id ()) cpu =cpumask_next (cpu, cpu_online_mask);if (WARN_ON_ONCE (cpu >= nr_cpu_ids))return ;@@ -349,9 +352,6 @@ static void clocksource_verify_choose_cpus(void)if (!WARN_ON_ONCE (cpu >= nr_cpu_ids))cpumask_set_cpu (cpu, &cpus_chosen); } - -/* Don't verify ourselves. */ -cpumask_clear_cpu (smp_processor_id (), &cpus_chosen); }static void clocksource_verify_one_cpu (void *csin)@@ -373,15 +373,18 @@ void clocksource_verify_percpu(struct clocksource *cs)cpumask_clear (&cpus_ahead);cpumask_clear (&cpus_behind);cpus_read_lock (); -preempt_disable ();clocksource_verify_choose_cpus (); +preempt_disable (); + +/* Don't verify ourselves. */ + testcpu =smp_processor_id (); +cpumask_clear_cpu (testcpu, &cpus_chosen);if (cpumask_empty (&cpus_chosen)) {preempt_enable ();cpus_read_unlock ();pr_warn ("Not enough CPUs to check clocksource '%s'.\n" , cs->name);return ; } - testcpu =smp_processor_id ();pr_info ("Checking clocksource %s synchronization from CPU %d to CPUs %*pbl.\n" , cs->name, testcpu,cpumask_pr_args (&cpus_chosen));for_each_cpu (cpu, &cpus_chosen) {Signature · 1 line
2.47.1
Re: [PATCH 2/2] clocksource: Defer preempt_disable() after clocksource_verify_choose_cpus()
Quoted 49 lines · Paul E. McKenney
Quoted 48 lines · Paul E. McKenney
Quoted 47 lines · Waiman Long
The following bug report happened in a
PREEMPT_RTkernel.[ 30.957705] BUG: sleeping function called from invalid context at kernel/locking/spinlock_rt.c:48 [ 30.957711] in_atomic(): 1, irqs_disabled(): 0, non_block: 0, pid: 2012, name: kwatchdog [ 30.962673] preempt_count: 1, expected: 0 [ 30.962676] RCU nest depth: 0, expected: 0 [ 30.962680] 3 locks held by kwatchdog/2012: [ 30.962684] #0: ffffffff8af2da60 (clocksource_mutex){+.+.}-{3:3}, at: clocksource_watchdog_kthread+0x13/0x50 [ 30.967703] #1: ffffffff8aa8d4d0 (cpu_hotplug_lock){++++}-{0:0}, at: clocksource_verify_percpu.part.0+0x5c/0x330 [ 30.972774] #2: ffff9fe02f5f33e0 ((batched_entropy_u32.lock)){+.+.}-{2:2}, at: get_random_u32+0x4f/0x110 [ 30.977827] Preemption disabled at: [ 30.977830] [<ffffffff88c1fe56>] clocksource_verify_percpu.part.0+0x66/0x330 [ 30.982837] CPU: 33 PID: 2012 Comm: kwatchdog Not tainted 5.14.0-503.23.1.el9_5.x86_64+rt-debug #1 [ 30.982843] Hardware name: HPE ProLiant DL385 Gen10 Plus/ProLiant DL385 Gen10 Plus, BIOS A42 04/29/2021 [ 30.982846] Call Trace: [ 30.982850] <TASK> [ 30.983821] dump_stack_lvl+0x57/0x81 [ 30.983821] __might_resched.cold+0xf4/0x12f [ 30.983824] rt_spin_lock+0x4c/0x100 [ 30.988833] get_random_u32+0x4f/0x110 [ 30.988833] clocksource_verify_choose_cpus+0xab/0x1a0 [ 30.988833] clocksource_verify_percpu.part.0+0x6b/0x330 [ 30.993894] __clocksource_watchdog_kthread+0x193/0x1a0 [ 30.993898] clocksource_watchdog_kthread+0x18/0x50 [ 30.993898] kthread+0x114/0x140 [ 30.993898] ret_from_fork+0x2c/0x50 [ 31.002864] </TASK>It is due to the fact that
get_random_u32()is called inclocksource_verify_choose_cpus()with preemption disabled. Ifcrng_ready()is true by the timeget_random_u32()is called, Thebatched_entropy_32local lock will be acquired. InPREEMPT_RTkernel, it is a rtmutex and we can't acquire it with preemption disabled.To avoid this problem, we can't call
get_random_u32()with preemption disabled. However,smp_processor_id()has to be called with preemption disabled though and we have to exclude the current CPU from thecpus_chosenlist to be tested.Extract current CPU removal code out from
clocksource_verify_choose_cpus()and defer thepreempt_disable()call to afterclocksource_verify_choose_cpus()and before current CPU removal. Also useraw_smp_processor_id()inclocksource_verify_choose_cpus().Fixes 7560c02bdffb ("clocksource: Check per-CPU clock synchronization when marked unstable")Signed-off-by Waiman Long <[email protected]>
Quoted 7 lines
Quoted 5 lines
Good catch!
But we don't need cryptographically secure random numbers (or blistering speed) here. Substituting something like torture_random()%nr_cpu_ids for
get_random_u32_below()work?I suppose I should add my concern... If we don't have preemption disabled across this code, we cannot reliably avoid attempting to IPI ourselves.
Does the CPU choosing process itsself needs to have preemption disabled? I thought it was because of need to use smp_processor_id() and have the current CPU excluded. Preemption is still disabled after that.
Cheers,
Longman
Re: [PATCH 2/2] clocksource: Defer preempt_disable() after clocksource_verify_choose_cpus()
Quoted 55 lines · Waiman Long
Quoted 54 lines · Paul E. McKenney
Quoted 53 lines · Paul E. McKenney
Quoted 39 lines · Waiman Long
The following bug report happened in a
PREEMPT_RTkernel.[ 30.957705] BUG: sleeping function called from invalid context at kernel/locking/spinlock_rt.c:48 [ 30.957711] in_atomic(): 1, irqs_disabled(): 0, non_block: 0, pid: 2012, name: kwatchdog [ 30.962673] preempt_count: 1, expected: 0 [ 30.962676] RCU nest depth: 0, expected: 0 [ 30.962680] 3 locks held by kwatchdog/2012: [ 30.962684] #0: ffffffff8af2da60 (clocksource_mutex){+.+.}-{3:3}, at: clocksource_watchdog_kthread+0x13/0x50 [ 30.967703] #1: ffffffff8aa8d4d0 (cpu_hotplug_lock){++++}-{0:0}, at: clocksource_verify_percpu.part.0+0x5c/0x330 [ 30.972774] #2: ffff9fe02f5f33e0 ((batched_entropy_u32.lock)){+.+.}-{2:2}, at: get_random_u32+0x4f/0x110 [ 30.977827] Preemption disabled at: [ 30.977830] [<ffffffff88c1fe56>] clocksource_verify_percpu.part.0+0x66/0x330 [ 30.982837] CPU: 33 PID: 2012 Comm: kwatchdog Not tainted 5.14.0-503.23.1.el9_5.x86_64+rt-debug #1 [ 30.982843] Hardware name: HPE ProLiant DL385 Gen10 Plus/ProLiant DL385 Gen10 Plus, BIOS A42 04/29/2021 [ 30.982846] Call Trace: [ 30.982850] <TASK> [ 30.983821] dump_stack_lvl+0x57/0x81 [ 30.983821] __might_resched.cold+0xf4/0x12f [ 30.983824] rt_spin_lock+0x4c/0x100 [ 30.988833] get_random_u32+0x4f/0x110 [ 30.988833] clocksource_verify_choose_cpus+0xab/0x1a0 [ 30.988833] clocksource_verify_percpu.part.0+0x6b/0x330 [ 30.993894] __clocksource_watchdog_kthread+0x193/0x1a0 [ 30.993898] clocksource_watchdog_kthread+0x18/0x50 [ 30.993898] kthread+0x114/0x140 [ 30.993898] ret_from_fork+0x2c/0x50 [ 31.002864] </TASK>It is due to the fact that
get_random_u32()is called inclocksource_verify_choose_cpus()with preemption disabled. Ifcrng_ready()is true by the timeget_random_u32()is called, Thebatched_entropy_32local lock will be acquired. InPREEMPT_RTkernel, it is a rtmutex and we can't acquire it with preemption disabled.To avoid this problem, we can't call
get_random_u32()with preemption disabled. However,smp_processor_id()has to be called with preemption disabled though and we have to exclude the current CPU from thecpus_chosenlist to be tested.Quoted 8 lines
Extract current CPU removal code out from
clocksource_verify_choose_cpus()and defer thepreempt_disable()call to afterclocksource_verify_choose_cpus()and before current CPU removal. Also useraw_smp_processor_id()inclocksource_verify_choose_cpus().Fixes 7560c02bdffb ("clocksource: Check per-CPU clock synchronization when marked unstable")Signed-off-by Waiman Long <[email protected]>Good catch!
But we don't need cryptographically secure random numbers (or blistering speed) here. Substituting something like torture_random()%nr_cpu_ids for
get_random_u32_below()work?
Quoted 6 lines
Quoted 2 lines
I suppose I should add my concern... If we don't have preemption disabled across this code, we cannot reliably avoid attempting to IPI ourselves.
Does the CPU choosing process itsself needs to have preemption disabled? I thought it was because of need to use
smp_processor_id()and have the current CPU excluded. Preemption is still disabled after that.
If the function is migrated from one CPU to another, the check against raw_smp_processor_id() doesn't mean much. At that point, you might as well just rely in the calling function clearing it.
And the extra preemption happens only in an error condition were extra debugging is enabled. Plus clocksource_verify_choose_cpus() should be pretty quick. So do we really care about the additional disabling of preemption?
Thanx, Paul
Re: [PATCH 2/2] clocksource: Defer preempt_disable() after clocksource_verify_choose_cpus()
Quoted 61 lines · Paul E. McKenney
Quoted 52 lines · Waiman Long
Quoted 51 lines · Paul E. McKenney
Quoted 50 lines · Paul E. McKenney
Quoted 39 lines · Waiman Long
The following bug report happened in a
PREEMPT_RTkernel.[ 30.957705] BUG: sleeping function called from invalid context at kernel/locking/spinlock_rt.c:48 [ 30.957711] in_atomic(): 1, irqs_disabled(): 0, non_block: 0, pid: 2012, name: kwatchdog [ 30.962673] preempt_count: 1, expected: 0 [ 30.962676] RCU nest depth: 0, expected: 0 [ 30.962680] 3 locks held by kwatchdog/2012: [ 30.962684] #0: ffffffff8af2da60 (clocksource_mutex){+.+.}-{3:3}, at: clocksource_watchdog_kthread+0x13/0x50 [ 30.967703] #1: ffffffff8aa8d4d0 (cpu_hotplug_lock){++++}-{0:0}, at: clocksource_verify_percpu.part.0+0x5c/0x330 [ 30.972774] #2: ffff9fe02f5f33e0 ((batched_entropy_u32.lock)){+.+.}-{2:2}, at: get_random_u32+0x4f/0x110 [ 30.977827] Preemption disabled at: [ 30.977830] [<ffffffff88c1fe56>] clocksource_verify_percpu.part.0+0x66/0x330 [ 30.982837] CPU: 33 PID: 2012 Comm: kwatchdog Not tainted 5.14.0-503.23.1.el9_5.x86_64+rt-debug #1 [ 30.982843] Hardware name: HPE ProLiant DL385 Gen10 Plus/ProLiant DL385 Gen10 Plus, BIOS A42 04/29/2021 [ 30.982846] Call Trace: [ 30.982850] <TASK> [ 30.983821] dump_stack_lvl+0x57/0x81 [ 30.983821] __might_resched.cold+0xf4/0x12f [ 30.983824] rt_spin_lock+0x4c/0x100 [ 30.988833] get_random_u32+0x4f/0x110 [ 30.988833] clocksource_verify_choose_cpus+0xab/0x1a0 [ 30.988833] clocksource_verify_percpu.part.0+0x6b/0x330 [ 30.993894] __clocksource_watchdog_kthread+0x193/0x1a0 [ 30.993898] clocksource_watchdog_kthread+0x18/0x50 [ 30.993898] kthread+0x114/0x140 [ 30.993898] ret_from_fork+0x2c/0x50 [ 31.002864] </TASK>It is due to the fact that
get_random_u32()is called inclocksource_verify_choose_cpus()with preemption disabled. Ifcrng_ready()is true by the timeget_random_u32()is called, Thebatched_entropy_32local lock will be acquired. InPREEMPT_RTkernel, it is a rtmutex and we can't acquire it with preemption disabled.To avoid this problem, we can't call
get_random_u32()with preemption disabled. However,smp_processor_id()has to be called with preemption disabled though and we have to exclude the current CPU from thecpus_chosenlist to be tested.Quoted 8 lines
Extract current CPU removal code out from
clocksource_verify_choose_cpus()and defer thepreempt_disable()call to afterclocksource_verify_choose_cpus()and before current CPU removal. Also useraw_smp_processor_id()inclocksource_verify_choose_cpus().Fixes 7560c02bdffb ("clocksource: Check per-CPU clock synchronization when marked unstable")Signed-off-by Waiman Long <[email protected]>Good catch!
Quoted 8 lines
Quoted 5 lines
Quoted 3 lines
But we don't need cryptographically secure random numbers (or blistering speed) here. Substituting something like torture_random()%nr_cpu_ids for
get_random_u32_below()work?I suppose I should add my concern... If we don't have preemption disabled across this code, we cannot reliably avoid attempting to IPI ourselves.
Does the CPU choosing process itsself needs to have preemption disabled? I thought it was because of need to use
smp_processor_id()and have the current CPU excluded. Preemption is still disabled after that.
Quoted 8 lines
If the function is migrated from one CPU to another, the check against
raw_smp_processor_id()doesn't mean much. At that point, you might as well just rely in the calling function clearing it.And the extra preemption happens only in an error condition were extra debugging is enabled. Plus
clocksource_verify_choose_cpus()should be pretty quick. So do we really care about the additional disabling of preemption?
I understand your concern about using raw_smp_processor_id().
Anyway, I took your suggestion of using another less random pseudo-random generator and call it a day. Unfortunately, I can't use torture_random() as it is only available if CONFIG_TORTURE_TEST is set :-(. Please let me know if you are OK with the v2 patch.
Cheers,
Longman
Quoted 8 lines · Waiman Long
The "Checking clocksource synchronization" message is normally printed when
clocksource_verify_percpu()is called for a given clocksource if both theCLOCK_SOURCE_UNSTABLEandCLOCK_SOURCE_VERIFY_PERCPUflags are set. It is an informational message and sopr_info()should be used instead ofpr_warn().Signed-off-by Waiman Long <[email protected]>
Thanks for sending this!
-john
Quoted 7 lines · Waiman Long
The "Checking clocksource synchronization" message is normally printed when
clocksource_verify_percpu()is called for a given clocksource if both theCLOCK_SOURCE_UNSTABLEandCLOCK_SOURCE_VERIFY_PERCPUflags are set. It is an informational message and sopr_info()should be used instead ofpr_warn().Signed-off-by Waiman Long <[email protected]>
Quoted 21 lines
--- kernel/time/clocksource.c | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-)kernel/time/clocksource.c +2
-1@@ -382,7 +382,8 @@ void clocksource_verify_percpu(struct clocksource *cs)return ; } testcpu =smp_processor_id (); -pr_warn ("Checking clocksource %s synchronization from CPU %d to CPUs %*pbl.\n" , cs->name, testcpu,cpumask_pr_args (&cpus_chosen)); +pr_info ("Checking clocksource %s synchronization from CPU %d to CPUs %*pbl.\n" , + cs->name, testcpu,cpumask_pr_args (&cpus_chosen));for_each_cpu (cpu, &cpus_chosen) {if (cpu == testcpu)continue ;Signature · 1 line
2.47.1