2.6.27-rc5 couldn't boot on tulsa machine randomly
On my tulsa x86-64 machine, kernel 2.6.25-rc5 couldn't boot randomly.
Basically, function __enable_runtime forgets to reset rt_rq->rt_throttled to 0. When every cpu is up, per-cpu migration_thread is created and it runs very fast, sometimes to mark the corresponding rt_rq->rt_throttled to 1 very quickly. After all cpus are up, with below calling chain,sched_init_smp => arch_init_sched_domains => build_sched_domains => ...
=> cpu_attach_domain => rq_attach_root => set_rq_online => ... => __enable_runtime, __enable_runtime is called against every rt_rq again, so rt_rq->rt_time is reset to 0, but rt_rq->rt_throttled might be still 1. Later on function do_sched_rt_period_timer couldn't reset it, and all RT tasks couldn't be scheduled to run on that cpu. here is RT task migration_thread which is woken up when a task is migrated to another cpu.
Below patch fixes it against 2.6.27-rc5.
Signed-off-by: Zhang Yanmin <[email protected]>
---
kernel/sched_rt.c +1 -0
@@ -350,6 +350,7 @@ static void __enable_runtime(struct rq *spin_lock (&rt_rq->rt_runtime_lock); rt_rq->rt_runtime = rt_b->rt_runtime; rt_rq->rt_time =0 ; + rt_rq->rt_throttled =0 ;spin_unlock (&rt_rq->rt_runtime_lock);spin_unlock (&rt_b->rt_runtime_lock); }
Quoted 3 lines · Yanmin
On my tulsa x86-64 machine, kernel 2.6.25-rc5 couldn't boot randomly.
Basically, function
__enable_runtimeforgets to resetrt_rq->rt_throttledto 0.
Peter,
Is there any issue with the patch?
I tested 2.6.27-rc6 and it still couldn't boot on my tulsa machine. With my patch, kernel could boot.
Yanmin
Quoted 34 lines
When every cpu is up, per-cpu
migration_threadis created and it runs very fast, sometimes to mark the correspondingrt_rq->rt_throttledto 1 very quickly. After all cpus are up, with below calling chain,sched_init_smp=>arch_init_sched_domains=>build_sched_domains=> ...
=>cpu_attach_domain=>rq_attach_root=>set_rq_online=> ... => __enable_runtime, __enable_runtime is called against everyrt_rqagain, sort_rq->rt_timeis reset to 0, but rt_rq->rt_throttled might be still 1. Later on functiondo_sched_rt_period_timercouldn't reset it, and all RT tasks couldn't be scheduled to run on that cpu. here is RT taskmigration_threadwhich is woken up when a task is migrated to another cpu.Below patch fixes it against 2.6.27-rc5.
Signed-off-by: Zhang Yanmin <[email protected]>
---
diff -Nraup
linux-2.6.27-rc5/kernel/sched_rt.clinux-2.6.27-rc5_fix/kernel/sched_rt.ckernel/sched_rt.c +1
-1@@ -350,6 +350,7 @@ static void __enable_runtime(struct rq *spin_lock (&rt_rq->rt_runtime_lock); rt_rq->rt_runtime = rt_b->rt_runtime; rt_rq->rt_time =0 ; + rt_rq->rt_throttled =0 ;spin_unlock (&rt_rq->rt_runtime_lock);spin_unlock (&rt_b->rt_runtime_lock); } --To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/
Peter Zijlstra
Acked-byQuoted 7 lines · Yanmin
Quoted 3 lines · Yanmin
On my tulsa x86-64 machine, kernel 2.6.25-rc5 couldn't boot randomly.
Basically, function
__enable_runtimeforgets to resetrt_rq->rt_throttledto 0.Peter,
Is there any issue with the patch?
No, just got lost in my inbox due to me getting distracted at the wrong moment, sorry!
Quoted 16 lines
I tested 2.6.27-rc6 and it still couldn't boot on my tulsa machine. With my patch, kernel could boot.
Quoted 13 lines
When every cpu is up, per-cpu
migration_threadis created and it runs very fast, sometimes to mark the correspondingrt_rq->rt_throttledto 1 very quickly. After all cpus are up, with below calling chain,sched_init_smp=>arch_init_sched_domains=>build_sched_domains=> ...
=>cpu_attach_domain=>rq_attach_root=>set_rq_online=> ... => __enable_runtime, __enable_runtime is called against everyrt_rqagain, sort_rq->rt_timeis reset to 0, but rt_rq->rt_throttled might be still 1. Later on functiondo_sched_rt_period_timercouldn't reset it, and all RT tasks couldn't be scheduled to run on that cpu. here is RT taskmigration_threadwhich is woken up when a task is migrated to another cpu.Below patch fixes it against 2.6.27-rc5.
Signed-off-by: Zhang Yanmin <[email protected]>
Ingo, please push to Linus.
Quoted 21 lines
Quoted 20 lines
---
diff -Nraup
linux-2.6.27-rc5/kernel/sched_rt.clinux-2.6.27-rc5_fix/kernel/sched_rt.ckernel/sched_rt.c +1
-1@@ -350,6 +350,7 @@ static void __enable_runtime(struct rq *spin_lock (&rt_rq->rt_runtime_lock); rt_rq->rt_runtime = rt_b->rt_runtime; rt_rq->rt_time =0 ; + rt_rq->rt_throttled =0 ;spin_unlock (&rt_rq->rt_runtime_lock);spin_unlock (&rt_b->rt_runtime_lock); } --To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/
Quoted 11 lines · Peter Zijlstra
Quoted 7 lines · Yanmin
Quoted 3 lines · Yanmin
On my tulsa x86-64 machine, kernel 2.6.25-rc5 couldn't boot randomly.
Basically, function
__enable_runtimeforgets to resetrt_rq->rt_throttledto 0.Peter,
Is there any issue with the patch?
No, just got lost in my inbox due to me getting distracted at the wrong moment, sorry!
there's no issue with the patch, it was already queued up in tip/sched/urgent, for -rc7.
Ingo