Skip to contentSkip to conversation

kvm: RCU warning in async pf

DISCUSSION Applied Sasha Levin 5 participants 17 messages Apr 2, 2012 – Apr 16, 2012

Subsystems (3)
lore
Share & tools
lore
#0 lore raw

Hi all,

I got the spew at the bottom of the mail in a KVM guest using the KVM tools and running trinity.

I'm not quite sure how default_idle managed to trigger a pagefault, so that part looks odd to me.

[12140.220507] ===============================
[12140.220507] [ INFO: suspicious RCU usage. ]
[12140.220507] 3.4.0-rc1-next-20120402-sasha #46 Tainted: G        W   
[12140.220507] -------------------------------
[12140.220507] include/linux/rcupdate.h:729 rcu_read_lock() used illegally while idle!
[12140.220507] 
[12140.220507] other info that might help us debug this:
[12140.220507] 
[12140.220507] 
[12140.220507] RCU used illegally from idle CPU!
[12140.220507] rcu_scheduler_active = 1, debug_locks = 1
[12140.220507] RCU used illegally from extended quiescent state!
[12140.220507] 4 locks held by swapper/1/0:
[12140.253991]  #0:  (&(&async_pf_sleepers[i].lock)->rlock){..-...}, at: [<ffffffff8107cdc8>] kvm_async_pf_task_wake+0x48/0x130
[12140.253991]  #1:  (&n.wq){......}, at: [<ffffffff810e200d>] __wake_up+0x2d/0x70
[12140.253991]  #2:  (&p->pi_lock){-.-.-.}, at: [<ffffffff810ec404>] try_to_wake_up+0x34/0x290
[12140.253991]  #3:  (rcu_read_lock){.+.+..}, at: [<ffffffff810f3c80>] select_task_rq_fair+0xb0/0x5c0
[12140.253991] 
[12140.253991] stack backtrace:
[12140.253991] Pid: 0, comm: swapper/1 Tainted: G        W    3.4.0-rc1-next-20120402-sasha #46
[12140.253991] Call Trace:
[12140.253991]  [<ffffffff81114173>] lockdep_rcu_suspicious+0x113/0x130
[12140.253991]  [<ffffffff810f3ce5>] select_task_rq_fair+0x115/0x5c0
[12140.253991]  [<ffffffff810f3c80>] ? select_task_rq_fair+0xb0/0x5c0
[12140.253991]  [<ffffffff810ec404>] ? try_to_wake_up+0x34/0x290
[12140.253991]  [<ffffffff810ec404>] ? try_to_wake_up+0x34/0x290
[12140.253991]  [<ffffffff810ec561>] try_to_wake_up+0x191/0x290
[12140.253991]  [<ffffffff81114850>] ? __lock_acquired+0x1c0/0x210
[12140.253991]  [<ffffffff810ec66d>] default_wake_function+0xd/0x10
[12140.253991]  [<ffffffff810d7208>] autoremove_wake_function+0x18/0x40
[12140.253991]  [<ffffffff810e11e2>] __wake_up_common+0x52/0x90
[12140.253991]  [<ffffffff810e200d>] ? __wake_up+0x2d/0x70
[12140.253991]  [<ffffffff810e2023>] __wake_up+0x43/0x70
[12140.253991]  [<ffffffff8107cb07>] apf_task_wake_one+0x87/0x90
[12140.253991]  [<ffffffff8107cdf5>] kvm_async_pf_task_wake+0x75/0x130
[12140.253991]  [<ffffffff8107d1e6>] do_async_page_fault+0x86/0xa0
[12140.253991]  [<ffffffff82657a55>] async_page_fault+0x25/0x30
[12140.253991]  [<ffffffff8107d626>] ? native_safe_halt+0x6/0x10
[12140.253991]  [<ffffffff81116fed>] ? trace_hardirqs_on+0xd/0x10
[12140.253991]  [<ffffffff8105857d>] default_idle+0x4d/0xa0
[12140.253991]  [<ffffffff810582af>] cpu_idle+0x11f/0x180
[12140.253991]  [<ffffffff8264b9e0>] ? setup_APIC_timer+0x88/0x8c
[12140.253991]  [<ffffffff8264b004>] start_secondary+0xe1/0xe8
[12140.253991] 
[12140.253991] ===============================
[12140.253991] [ INFO: suspicious RCU usage. ]
[12140.253991] 3.4.0-rc1-next-20120402-sasha #46 Tainted: G        W   
[12140.253991] -------------------------------
[12140.253991] kernel/sched/fair.c:2716 suspicious rcu_dereference_check() usage!
[12140.253991] 
[12140.253991] other info that might help us debug this:
[12140.253991] 
[12140.253991] 
[12140.253991] RCU used illegally from idle CPU!
[12140.253991] rcu_scheduler_active = 1, debug_locks = 1
[12140.253991] RCU used illegally from extended quiescent state!
[12140.253991] 4 locks held by swapper/1/0:
[12140.253991]  #0:  (&(&async_pf_sleepers[i].lock)->rlock){..-...}, at: [<ffffffff8107cdc8>] kvm_async_pf_task_wake+0x48/0x130
[12140.253991]  #1:  (&n.wq){......}, at: [<ffffffff810e200d>] __wake_up+0x2d/0x70
[12140.253991]  #2:  (&p->pi_lock){-.-.-.}, at: [<ffffffff810ec404>] try_to_wake_up+0x34/0x290
[12140.253991]  #3:  (rcu_read_lock){.+.+..}, at: [<ffffffff810f3c80>] select_task_rq_fair+0xb0/0x5c0
[12140.253991] 
[12140.253991] stack backtrace:
[12140.253991] Pid: 0, comm: swapper/1 Tainted: G        W    3.4.0-rc1-next-20120402-sasha #46
[12140.253991] Call Trace:
[12140.253991]  [<ffffffff81114173>] lockdep_rcu_suspicious+0x113/0x130
[12140.253991]  [<ffffffff810f3d4c>] select_task_rq_fair+0x17c/0x5c0
[12140.253991]  [<ffffffff810f3c80>] ? select_task_rq_fair+0xb0/0x5c0
[12140.253991]  [<ffffffff810ec404>] ? try_to_wake_up+0x34/0x290
[12140.253991]  [<ffffffff810ec404>] ? try_to_wake_up+0x34/0x290
[12140.253991]  [<ffffffff810ec561>] try_to_wake_up+0x191/0x290
[12140.253991]  [<ffffffff81114850>] ? __lock_acquired+0x1c0/0x210
[12140.253991]  [<ffffffff810ec66d>] default_wake_function+0xd/0x10
[12140.253991]  [<ffffffff810d7208>] autoremove_wake_function+0x18/0x40
[12140.253991]  [<ffffffff810e11e2>] __wake_up_common+0x52/0x90
[12140.253991]  [<ffffffff810e200d>] ? __wake_up+0x2d/0x70
[12140.253991]  [<ffffffff810e2023>] __wake_up+0x43/0x70
[12140.253991]  [<ffffffff8107cb07>] apf_task_wake_one+0x87/0x90
[12140.253991]  [<ffffffff8107cdf5>] kvm_async_pf_task_wake+0x75/0x130
[12140.253991]  [<ffffffff8107d1e6>] do_async_page_fault+0x86/0xa0
[12140.253991]  [<ffffffff82657a55>] async_page_fault+0x25/0x30
[12140.253991]  [<ffffffff8107d626>] ? native_safe_halt+0x6/0x10
[12140.253991]  [<ffffffff81116fed>] ? trace_hardirqs_on+0xd/0x10
[12140.253991]  [<ffffffff8105857d>] default_idle+0x4d/0xa0
[12140.253991]  [<ffffffff810582af>] cpu_idle+0x11f/0x180
[12140.253991]  [<ffffffff8264b9e0>] ? setup_APIC_timer+0x88/0x8c
[12140.253991]  [<ffffffff8264b004>] start_secondary+0xe1/0xe8
[12140.253991] 
[12140.253991] ===============================
[12140.253991] [ INFO: suspicious RCU usage. ]
[12140.253991] 3.4.0-rc1-next-20120402-sasha #46 Tainted: G        W   
[12140.253991] -------------------------------
[12140.253991] kernel/sched/fair.c:2660 suspicious rcu_dereference_check() usage!
[12140.253991] 
[12140.253991] other info that might help us debug this:
[12140.253991] 
[12140.253991] 
[12140.253991] RCU used illegally from idle CPU!
[12140.253991] rcu_scheduler_active = 1, debug_locks = 1
[12140.253991] RCU used illegally from extended quiescent state!
[12140.253991] 4 locks held by swapper/1/0:
[12140.253991]  #0:  (&(&async_pf_sleepers[i].lock)->rlock){..-...}, at: [<ffffffff8107cdc8>] kvm_async_pf_task_wake+0x48/0x130
[12140.253991]  #1:  (&n.wq){......}, at: [<ffffffff810e200d>] __wake_up+0x2d/0x70
[12140.253991]  #2:  (&p->pi_lock){-.-.-.}, at: [<ffffffff810ec404>] try_to_wake_up+0x34/0x290
[12140.253991]  #3:  (rcu_read_lock){.+.+..}, at: [<ffffffff810f3c80>] select_task_rq_fair+0xb0/0x5c0
[12140.253991] 
[12140.253991] stack backtrace:
[12140.253991] Pid: 0, comm: swapper/1 Tainted: G        W    3.4.0-rc1-next-20120402-sasha #46
[12140.253991] Call Trace:
[12140.253991]  [<ffffffff81114173>] lockdep_rcu_suspicious+0x113/0x130
[12140.253991]  [<ffffffff810f062f>] select_idle_sibling+0xaf/0x1c0
[12140.253991]  [<ffffffff810f3f51>] select_task_rq_fair+0x381/0x5c0
[12140.253991]  [<ffffffff810f3c80>] ? select_task_rq_fair+0xb0/0x5c0
[12140.253991]  [<ffffffff810ec404>] ? try_to_wake_up+0x34/0x290
[12140.253991]  [<ffffffff810ec404>] ? try_to_wake_up+0x34/0x290
[12140.253991]  [<ffffffff810ec561>] try_to_wake_up+0x191/0x290
[12140.253991]  [<ffffffff81114850>] ? __lock_acquired+0x1c0/0x210
[12140.253991]  [<ffffffff810ec66d>] default_wake_function+0xd/0x10
[12140.253991]  [<ffffffff810d7208>] autoremove_wake_function+0x18/0x40
[12140.253991]  [<ffffffff810e11e2>] __wake_up_common+0x52/0x90
[12140.253991]  [<ffffffff810e200d>] ? __wake_up+0x2d/0x70
[12140.253991]  [<ffffffff810e2023>] __wake_up+0x43/0x70
[12140.253991]  [<ffffffff8107cb07>] apf_task_wake_one+0x87/0x90
[12140.253991]  [<ffffffff8107cdf5>] kvm_async_pf_task_wake+0x75/0x130
[12140.253991]  [<ffffffff8107d1e6>] do_async_page_fault+0x86/0xa0
[12140.253991]  [<ffffffff82657a55>] async_page_fault+0x25/0x30
[12140.253991]  [<ffffffff8107d626>] ? native_safe_halt+0x6/0x10
[12140.253991]  [<ffffffff81116fed>] ? trace_hardirqs_on+0xd/0x10
[12140.253991]  [<ffffffff8105857d>] default_idle+0x4d/0xa0
[12140.253991]  [<ffffffff810582af>] cpu_idle+0x11f/0x180
[12140.253991]  [<ffffffff8264b9e0>] ? setup_APIC_timer+0x88/0x8c
[12140.253991]  [<ffffffff8264b004>] start_secondary+0xe1/0xe8
[12140.253991] 
[12140.253991] ===============================
[12140.253991] [ INFO: suspicious RCU usage. ]
[12140.253991] 3.4.0-rc1-next-20120402-sasha #46 Tainted: G        W   
[12140.253991] -------------------------------
[12140.253991] include/linux/rcupdate.h:750 rcu_read_unlock() used illegally while idle!
[12140.253991] 
[12140.253991] other info that might help us debug this:
[12140.253991] 
[12140.253991] 
[12140.253991] RCU used illegally from idle CPU!
[12140.253991] rcu_scheduler_active = 1, debug_locks = 1
[12140.253991] RCU used illegally from extended quiescent state!
[12140.253991] 4 locks held by swapper/1/0:
[12140.253991]  #0:  (&(&async_pf_sleepers[i].lock)->rlock){..-...}, at: [<ffffffff8107cdc8>] kvm_async_pf_task_wake+0x48/0x130
[12140.253991]  #1:  (&n.wq){......}, at: [<ffffffff810e200d>] __wake_up+0x2d/0x70
[12140.253991]  #2:  (&p->pi_lock){-.-.-.}, at: [<ffffffff810ec404>] try_to_wake_up+0x34/0x290
[12140.253991]  #3:  (rcu_read_lock){.+.+..}, at: [<ffffffff810f3c80>] select_task_rq_fair+0xb0/0x5c0
[12140.253991] 
[12140.253991] stack backtrace:
[12140.253991] Pid: 0, comm: swapper/1 Tainted: G        W    3.4.0-rc1-next-20120402-sasha #46
[12140.253991] Call Trace:
[12140.253991]  [<ffffffff81114173>] lockdep_rcu_suspicious+0x113/0x130
[12140.253991]  [<ffffffff810f412a>] select_task_rq_fair+0x55a/0x5c0
[12140.253991]  [<ffffffff810f3c80>] ? select_task_rq_fair+0xb0/0x5c0
[12140.253991]  [<ffffffff810ec404>] ? try_to_wake_up+0x34/0x290
[12140.253991]  [<ffffffff810ec404>] ? try_to_wake_up+0x34/0x290
[12140.253991]  [<ffffffff810ec561>] try_to_wake_up+0x191/0x290
[12140.253991]  [<ffffffff81114850>] ? __lock_acquired+0x1c0/0x210
[12140.253991]  [<ffffffff810ec66d>] default_wake_function+0xd/0x10
[12140.253991]  [<ffffffff810d7208>] autoremove_wake_function+0x18/0x40
[12140.253991]  [<ffffffff810e11e2>] __wake_up_common+0x52/0x90
[12140.253991]  [<ffffffff810e200d>] ? __wake_up+0x2d/0x70
[12140.253991]  [<ffffffff810e2023>] __wake_up+0x43/0x70
[12140.253991]  [<ffffffff8107cb07>] apf_task_wake_one+0x87/0x90
[12140.253991]  [<ffffffff8107cdf5>] kvm_async_pf_task_wake+0x75/0x130
[12140.253991]  [<ffffffff8107d1e6>] do_async_page_fault+0x86/0xa0
[12140.253991]  [<ffffffff82657a55>] async_page_fault+0x25/0x30
[12140.253991]  [<ffffffff8107d626>] ? native_safe_halt+0x6/0x10
[12140.253991]  [<ffffffff81116fed>] ? trace_hardirqs_on+0xd/0x10
[12140.253991]  [<ffffffff8105857d>] default_idle+0x4d/0xa0
[12140.253991]  [<ffffffff810582af>] cpu_idle+0x11f/0x180
[12140.253991]  [<ffffffff8264b9e0>] ? setup_APIC_timer+0x88/0x8c
[12140.253991]  [<ffffffff8264b004>] start_secondary+0xe1/0xe8
[12140.623131] 
[12140.623131] ===============================
[12140.623131] [ INFO: suspicious RCU usage. ]
[12140.623131] 3.4.0-rc1-next-20120402-sasha #46 Tainted: G        W   
[12140.623131] -------------------------------
[12140.623131] include/linux/rcupdate.h:729 rcu_read_lock() used illegally while idle!
[12140.623131] 
[12140.623131] other info that might help us debug this:
[12140.623131] 
[12140.623131] 
[12140.623131] RCU used illegally from idle CPU!
[12140.623131] rcu_scheduler_active = 1, debug_locks = 1
[12140.623131] RCU used illegally from extended quiescent state!
[12140.623131] 4 locks held by swapper/1/0:
[12140.623131]  #0:  (&(&async_pf_sleepers[i].lock)->rlock){..-...}, at: [<ffffffff8107cdc8>] kvm_async_pf_task_wake+0x48/0x130
[12140.623131]  #1:  (&n.wq){......}, at: [<ffffffff810e200d>] __wake_up+0x2d/0x70
[12140.623131]  #2:  (&p->pi_lock){-.-.-.}, at: [<ffffffff810ec404>] try_to_wake_up+0x34/0x290
[12140.623131]  #3:  (rcu_read_lock){.+.+..}, at: [<ffffffff810ea4c0>] ttwu_stat+0x50/0x230
[12140.623131] 
[12140.623131] stack backtrace:
[12140.623131] Pid: 0, comm: swapper/1 Tainted: G        W    3.4.0-rc1-next-20120402-sasha #46
[12140.623131] Call Trace:
[12140.623131]  [<ffffffff81114173>] lockdep_rcu_suspicious+0x113/0x130
[12140.623131]  [<ffffffff810ea537>] ttwu_stat+0xc7/0x230
[12140.623131]  [<ffffffff810ea4c0>] ? ttwu_stat+0x50/0x230
[12140.623131]  [<ffffffff810ec404>] ? try_to_wake_up+0x34/0x290
[12140.623131]  [<ffffffff810ec62a>] try_to_wake_up+0x25a/0x290
[12140.623131]  [<ffffffff81114850>] ? __lock_acquired+0x1c0/0x210
[12140.623131]  [<ffffffff810ec66d>] default_wake_function+0xd/0x10
[12140.623131]  [<ffffffff810d7208>] autoremove_wake_function+0x18/0x40
[12140.623131]  [<ffffffff810e11e2>] __wake_up_common+0x52/0x90
[12140.623131]  [<ffffffff810e200d>] ? __wake_up+0x2d/0x70
[12140.623131]  [<ffffffff810e2023>] __wake_up+0x43/0x70
[12140.623131]  [<ffffffff8107cb07>] apf_task_wake_one+0x87/0x90
[12140.623131]  [<ffffffff8107cdf5>] kvm_async_pf_task_wake+0x75/0x130
[12140.623131]  [<ffffffff8107d1e6>] do_async_page_fault+0x86/0xa0
[12140.623131]  [<ffffffff82657a55>] async_page_fault+0x25/0x30
[12140.623131]  [<ffffffff8107d626>] ? native_safe_halt+0x6/0x10
[12140.623131]  [<ffffffff81116fed>] ? trace_hardirqs_on+0xd/0x10
[12140.623131]  [<ffffffff8105857d>] default_idle+0x4d/0xa0
[12140.623131]  [<ffffffff810582af>] cpu_idle+0x11f/0x180
[12140.623131]  [<ffffffff8264b9e0>] ? setup_APIC_timer+0x88/0x8c
[12140.623131]  [<ffffffff8264b004>] start_secondary+0xe1/0xe8
[12140.623131] 
[12140.623131] ===============================
[12140.623131] [ INFO: suspicious RCU usage. ]
[12140.623131] 3.4.0-rc1-next-20120402-sasha #46 Tainted: G        W   
[12140.623131] -------------------------------
[12140.623131] kernel/sched/core.c:1375 suspicious rcu_dereference_check() usage!
[12140.623131] 
[12140.623131] other info that might help us debug this:
[12140.623131] 
[12140.623131] 
[12140.623131] RCU used illegally from idle CPU!
[12140.623131] rcu_scheduler_active = 1, debug_locks = 1
[12140.623131] RCU used illegally from extended quiescent state!
[12140.623131] 4 locks held by swapper/1/0:
[12140.623131]  #0:  (&(&async_pf_sleepers[i].lock)->rlock){..-...}, at: [<ffffffff8107cdc8>] kvm_async_pf_task_wake+0x48/0x130
[12140.623131]  #1:  (&n.wq){......}, at: [<ffffffff810e200d>] __wake_up+0x2d/0x70
[12140.623131]  #2:  (&p->pi_lock){-.-.-.}, at: [<ffffffff810ec404>] try_to_wake_up+0x34/0x290
[12140.623131]  #3:  (rcu_read_lock){.+.+..}, at: [<ffffffff810ea4c0>] ttwu_stat+0x50/0x230
[12140.623131] 
[12140.623131] stack backtrace:
[12140.623131] Pid: 0, comm: swapper/1 Tainted: G        W    3.4.0-rc1-next-20120402-sasha #46
[12140.623131] Call Trace:
[12140.623131]  [<ffffffff81114173>] lockdep_rcu_suspicious+0x113/0x130
[12140.623131]  [<ffffffff810ea5a8>] ttwu_stat+0x138/0x230
[12140.623131]  [<ffffffff810ea4c0>] ? ttwu_stat+0x50/0x230
[12140.623131]  [<ffffffff810ec404>] ? try_to_wake_up+0x34/0x290
[12140.623131]  [<ffffffff810ec62a>] try_to_wake_up+0x25a/0x290
[12140.623131]  [<ffffffff81114850>] ? __lock_acquired+0x1c0/0x210
[12140.623131]  [<ffffffff810ec66d>] default_wake_function+0xd/0x10
[12140.623131]  [<ffffffff810d7208>] autoremove_wake_function+0x18/0x40
[12140.623131]  [<ffffffff810e11e2>] __wake_up_common+0x52/0x90
[12140.623131]  [<ffffffff810e200d>] ? __wake_up+0x2d/0x70
[12140.623131]  [<ffffffff810e2023>] __wake_up+0x43/0x70
[12140.623131]  [<ffffffff8107cb07>] apf_task_wake_one+0x87/0x90
[12140.623131]  [<ffffffff8107cdf5>] kvm_async_pf_task_wake+0x75/0x130
[12140.623131]  [<ffffffff8107d1e6>] do_async_page_fault+0x86/0xa0
[12140.623131]  [<ffffffff82657a55>] async_page_fault+0x25/0x30
[12140.623131]  [<ffffffff8107d626>] ? native_safe_halt+0x6/0x10
[12140.623131]  [<ffffffff81116fed>] ? trace_hardirqs_on+0xd/0x10
[12140.623131]  [<ffffffff8105857d>] default_idle+0x4d/0xa0
[12140.623131]  [<ffffffff810582af>] cpu_idle+0x11f/0x180
[12140.623131]  [<ffffffff8264b9e0>] ? setup_APIC_timer+0x88/0x8c
[12140.623131]  [<ffffffff8264b004>] start_secondary+0xe1/0xe8
[12140.623131] 
[12140.623131] ===============================
[12140.623131] [ INFO: suspicious RCU usage. ]
[12140.623131] 3.4.0-rc1-next-20120402-sasha #46 Tainted: G        W   
[12140.623131] -------------------------------
[12140.623131] include/linux/rcupdate.h:750 rcu_read_unlock() used illegally while idle!
[12140.623131] 
[12140.623131] other info that might help us debug this:
[12140.623131] 
[12140.623131] 
[12140.623131] RCU used illegally from idle CPU!
[12140.623131] rcu_scheduler_active = 1, debug_locks = 1
[12140.623131] RCU used illegally from extended quiescent state!
[12140.623131] 4 locks held by swapper/1/0:
[12140.623131]  #0:  (&(&async_pf_sleepers[i].lock)->rlock){..-...}, at: [<ffffffff8107cdc8>] kvm_async_pf_task_wake+0x48/0x130
[12140.623131]  #1:  (&n.wq){......}, at: [<ffffffff810e200d>] __wake_up+0x2d/0x70
[12140.623131]  #2:  (&p->pi_lock){-.-.-.}, at: [<ffffffff810ec404>] try_to_wake_up+0x34/0x290
[12140.623131]  #3:  (rcu_read_lock){.+.+..}, at: [<ffffffff810ea4c0>] ttwu_stat+0x50/0x230
[12140.623131] 
[12140.623131] stack backtrace:
[12140.623131] Pid: 0, comm: swapper/1 Tainted: G        W    3.4.0-rc1-next-20120402-sasha #46
[12140.623131] Call Trace:
[12140.623131]  [<ffffffff81114173>] lockdep_rcu_suspicious+0x113/0x130
[12140.623131]  [<ffffffff810ea643>] ttwu_stat+0x1d3/0x230
[12140.623131]  [<ffffffff810ea4c0>] ? ttwu_stat+0x50/0x230
[12140.623131]  [<ffffffff810ec404>] ? try_to_wake_up+0x34/0x290
[12140.623131]  [<ffffffff810ec62a>] try_to_wake_up+0x25a/0x290
[12140.623131]  [<ffffffff81114850>] ? __lock_acquired+0x1c0/0x210
[12140.623131]  [<ffffffff810ec66d>] default_wake_function+0xd/0x10
[12140.623131]  [<ffffffff810d7208>] autoremove_wake_function+0x18/0x40
[12140.623131]  [<ffffffff810e11e2>] __wake_up_common+0x52/0x90
[12140.623131]  [<ffffffff810e200d>] ? __wake_up+0x2d/0x70
[12140.623131]  [<ffffffff810e2023>] __wake_up+0x43/0x70
[12140.623131]  [<ffffffff8107cb07>] apf_task_wake_one+0x87/0x90
[12140.623131]  [<ffffffff8107cdf5>] kvm_async_pf_task_wake+0x75/0x130
[12140.623131]  [<ffffffff8107d1e6>] do_async_page_fault+0x86/0xa0
[12140.623131]  [<ffffffff82657a55>] async_page_fault+0x25/0x30
[12140.623131]  [<ffffffff8107d626>] ? native_safe_halt+0x6/0x10
[12140.623131]  [<ffffffff81116fed>] ? trace_hardirqs_on+0xd/0x10
[12140.623131]  [<ffffffff8105857d>] default_idle+0x4d/0xa0
[12140.623131]  [<ffffffff810582af>] cpu_idle+0x11f/0x180
[12140.623131]  [<ffffffff8264b9e0>] ? setup_APIC_timer+0x88/0x8c
[12140.623131]  [<ffffffff8264b004>] start_secondary+0xe1/0xe8
Signature · 1 line
Sasha.
#1 lore raw
Quoted 6 lines · Sasha Levin

Hi all,

I got the spew at the bottom of the mail in a KVM guest using the KVM tools and running trinity.

I'm not quite sure how default_idle managed to trigger a pagefault, so that part looks odd to me.

This is not regular page fault. This is async page fault that tells the guest that a page, previously swapped out by hypervisor, is now swapped back in and it can happen while vcpu is idle. The code does not leave idle state properly though. We probably need to call rcu_irq_enter() there. Will look into it.

Quoted 297 lines
[12140.220507] ===============================
[12140.220507] [ INFO: suspicious RCU usage. ]
[12140.220507] 3.4.0-rc1-next-20120402-sasha #46 Tainted: G        W   
[12140.220507] -------------------------------
[12140.220507] include/linux/rcupdate.h:729 rcu_read_lock() used illegally while idle!
[12140.220507] 
[12140.220507] other info that might help us debug this:
[12140.220507] 
[12140.220507] 
[12140.220507] RCU used illegally from idle CPU!
[12140.220507] rcu_scheduler_active = 1, debug_locks = 1
[12140.220507] RCU used illegally from extended quiescent state!
[12140.220507] 4 locks held by swapper/1/0:
[12140.253991]  #0:  (&(&async_pf_sleepers[i].lock)->rlock){..-...}, at: [<ffffffff8107cdc8>] kvm_async_pf_task_wake+0x48/0x130
[12140.253991]  #1:  (&n.wq){......}, at: [<ffffffff810e200d>] __wake_up+0x2d/0x70
[12140.253991]  #2:  (&p->pi_lock){-.-.-.}, at: [<ffffffff810ec404>] try_to_wake_up+0x34/0x290
[12140.253991]  #3:  (rcu_read_lock){.+.+..}, at: [<ffffffff810f3c80>] select_task_rq_fair+0xb0/0x5c0
[12140.253991] 
[12140.253991] stack backtrace:
[12140.253991] Pid: 0, comm: swapper/1 Tainted: G        W    3.4.0-rc1-next-20120402-sasha #46
[12140.253991] Call Trace:
[12140.253991]  [<ffffffff81114173>] lockdep_rcu_suspicious+0x113/0x130
[12140.253991]  [<ffffffff810f3ce5>] select_task_rq_fair+0x115/0x5c0
[12140.253991]  [<ffffffff810f3c80>] ? select_task_rq_fair+0xb0/0x5c0
[12140.253991]  [<ffffffff810ec404>] ? try_to_wake_up+0x34/0x290
[12140.253991]  [<ffffffff810ec404>] ? try_to_wake_up+0x34/0x290
[12140.253991]  [<ffffffff810ec561>] try_to_wake_up+0x191/0x290
[12140.253991]  [<ffffffff81114850>] ? __lock_acquired+0x1c0/0x210
[12140.253991]  [<ffffffff810ec66d>] default_wake_function+0xd/0x10
[12140.253991]  [<ffffffff810d7208>] autoremove_wake_function+0x18/0x40
[12140.253991]  [<ffffffff810e11e2>] __wake_up_common+0x52/0x90
[12140.253991]  [<ffffffff810e200d>] ? __wake_up+0x2d/0x70
[12140.253991]  [<ffffffff810e2023>] __wake_up+0x43/0x70
[12140.253991]  [<ffffffff8107cb07>] apf_task_wake_one+0x87/0x90
[12140.253991]  [<ffffffff8107cdf5>] kvm_async_pf_task_wake+0x75/0x130
[12140.253991]  [<ffffffff8107d1e6>] do_async_page_fault+0x86/0xa0
[12140.253991]  [<ffffffff82657a55>] async_page_fault+0x25/0x30
[12140.253991]  [<ffffffff8107d626>] ? native_safe_halt+0x6/0x10
[12140.253991]  [<ffffffff81116fed>] ? trace_hardirqs_on+0xd/0x10
[12140.253991]  [<ffffffff8105857d>] default_idle+0x4d/0xa0
[12140.253991]  [<ffffffff810582af>] cpu_idle+0x11f/0x180
[12140.253991]  [<ffffffff8264b9e0>] ? setup_APIC_timer+0x88/0x8c
[12140.253991]  [<ffffffff8264b004>] start_secondary+0xe1/0xe8
[12140.253991] 
[12140.253991] ===============================
[12140.253991] [ INFO: suspicious RCU usage. ]
[12140.253991] 3.4.0-rc1-next-20120402-sasha #46 Tainted: G        W   
[12140.253991] -------------------------------
[12140.253991] kernel/sched/fair.c:2716 suspicious rcu_dereference_check() usage!
[12140.253991] 
[12140.253991] other info that might help us debug this:
[12140.253991] 
[12140.253991] 
[12140.253991] RCU used illegally from idle CPU!
[12140.253991] rcu_scheduler_active = 1, debug_locks = 1
[12140.253991] RCU used illegally from extended quiescent state!
[12140.253991] 4 locks held by swapper/1/0:
[12140.253991]  #0:  (&(&async_pf_sleepers[i].lock)->rlock){..-...}, at: [<ffffffff8107cdc8>] kvm_async_pf_task_wake+0x48/0x130
[12140.253991]  #1:  (&n.wq){......}, at: [<ffffffff810e200d>] __wake_up+0x2d/0x70
[12140.253991]  #2:  (&p->pi_lock){-.-.-.}, at: [<ffffffff810ec404>] try_to_wake_up+0x34/0x290
[12140.253991]  #3:  (rcu_read_lock){.+.+..}, at: [<ffffffff810f3c80>] select_task_rq_fair+0xb0/0x5c0
[12140.253991] 
[12140.253991] stack backtrace:
[12140.253991] Pid: 0, comm: swapper/1 Tainted: G        W    3.4.0-rc1-next-20120402-sasha #46
[12140.253991] Call Trace:
[12140.253991]  [<ffffffff81114173>] lockdep_rcu_suspicious+0x113/0x130
[12140.253991]  [<ffffffff810f3d4c>] select_task_rq_fair+0x17c/0x5c0
[12140.253991]  [<ffffffff810f3c80>] ? select_task_rq_fair+0xb0/0x5c0
[12140.253991]  [<ffffffff810ec404>] ? try_to_wake_up+0x34/0x290
[12140.253991]  [<ffffffff810ec404>] ? try_to_wake_up+0x34/0x290
[12140.253991]  [<ffffffff810ec561>] try_to_wake_up+0x191/0x290
[12140.253991]  [<ffffffff81114850>] ? __lock_acquired+0x1c0/0x210
[12140.253991]  [<ffffffff810ec66d>] default_wake_function+0xd/0x10
[12140.253991]  [<ffffffff810d7208>] autoremove_wake_function+0x18/0x40
[12140.253991]  [<ffffffff810e11e2>] __wake_up_common+0x52/0x90
[12140.253991]  [<ffffffff810e200d>] ? __wake_up+0x2d/0x70
[12140.253991]  [<ffffffff810e2023>] __wake_up+0x43/0x70
[12140.253991]  [<ffffffff8107cb07>] apf_task_wake_one+0x87/0x90
[12140.253991]  [<ffffffff8107cdf5>] kvm_async_pf_task_wake+0x75/0x130
[12140.253991]  [<ffffffff8107d1e6>] do_async_page_fault+0x86/0xa0
[12140.253991]  [<ffffffff82657a55>] async_page_fault+0x25/0x30
[12140.253991]  [<ffffffff8107d626>] ? native_safe_halt+0x6/0x10
[12140.253991]  [<ffffffff81116fed>] ? trace_hardirqs_on+0xd/0x10
[12140.253991]  [<ffffffff8105857d>] default_idle+0x4d/0xa0
[12140.253991]  [<ffffffff810582af>] cpu_idle+0x11f/0x180
[12140.253991]  [<ffffffff8264b9e0>] ? setup_APIC_timer+0x88/0x8c
[12140.253991]  [<ffffffff8264b004>] start_secondary+0xe1/0xe8
[12140.253991] 
[12140.253991] ===============================
[12140.253991] [ INFO: suspicious RCU usage. ]
[12140.253991] 3.4.0-rc1-next-20120402-sasha #46 Tainted: G        W   
[12140.253991] -------------------------------
[12140.253991] kernel/sched/fair.c:2660 suspicious rcu_dereference_check() usage!
[12140.253991] 
[12140.253991] other info that might help us debug this:
[12140.253991] 
[12140.253991] 
[12140.253991] RCU used illegally from idle CPU!
[12140.253991] rcu_scheduler_active = 1, debug_locks = 1
[12140.253991] RCU used illegally from extended quiescent state!
[12140.253991] 4 locks held by swapper/1/0:
[12140.253991]  #0:  (&(&async_pf_sleepers[i].lock)->rlock){..-...}, at: [<ffffffff8107cdc8>] kvm_async_pf_task_wake+0x48/0x130
[12140.253991]  #1:  (&n.wq){......}, at: [<ffffffff810e200d>] __wake_up+0x2d/0x70
[12140.253991]  #2:  (&p->pi_lock){-.-.-.}, at: [<ffffffff810ec404>] try_to_wake_up+0x34/0x290
[12140.253991]  #3:  (rcu_read_lock){.+.+..}, at: [<ffffffff810f3c80>] select_task_rq_fair+0xb0/0x5c0
[12140.253991] 
[12140.253991] stack backtrace:
[12140.253991] Pid: 0, comm: swapper/1 Tainted: G        W    3.4.0-rc1-next-20120402-sasha #46
[12140.253991] Call Trace:
[12140.253991]  [<ffffffff81114173>] lockdep_rcu_suspicious+0x113/0x130
[12140.253991]  [<ffffffff810f062f>] select_idle_sibling+0xaf/0x1c0
[12140.253991]  [<ffffffff810f3f51>] select_task_rq_fair+0x381/0x5c0
[12140.253991]  [<ffffffff810f3c80>] ? select_task_rq_fair+0xb0/0x5c0
[12140.253991]  [<ffffffff810ec404>] ? try_to_wake_up+0x34/0x290
[12140.253991]  [<ffffffff810ec404>] ? try_to_wake_up+0x34/0x290
[12140.253991]  [<ffffffff810ec561>] try_to_wake_up+0x191/0x290
[12140.253991]  [<ffffffff81114850>] ? __lock_acquired+0x1c0/0x210
[12140.253991]  [<ffffffff810ec66d>] default_wake_function+0xd/0x10
[12140.253991]  [<ffffffff810d7208>] autoremove_wake_function+0x18/0x40
[12140.253991]  [<ffffffff810e11e2>] __wake_up_common+0x52/0x90
[12140.253991]  [<ffffffff810e200d>] ? __wake_up+0x2d/0x70
[12140.253991]  [<ffffffff810e2023>] __wake_up+0x43/0x70
[12140.253991]  [<ffffffff8107cb07>] apf_task_wake_one+0x87/0x90
[12140.253991]  [<ffffffff8107cdf5>] kvm_async_pf_task_wake+0x75/0x130
[12140.253991]  [<ffffffff8107d1e6>] do_async_page_fault+0x86/0xa0
[12140.253991]  [<ffffffff82657a55>] async_page_fault+0x25/0x30
[12140.253991]  [<ffffffff8107d626>] ? native_safe_halt+0x6/0x10
[12140.253991]  [<ffffffff81116fed>] ? trace_hardirqs_on+0xd/0x10
[12140.253991]  [<ffffffff8105857d>] default_idle+0x4d/0xa0
[12140.253991]  [<ffffffff810582af>] cpu_idle+0x11f/0x180
[12140.253991]  [<ffffffff8264b9e0>] ? setup_APIC_timer+0x88/0x8c
[12140.253991]  [<ffffffff8264b004>] start_secondary+0xe1/0xe8
[12140.253991] 
[12140.253991] ===============================
[12140.253991] [ INFO: suspicious RCU usage. ]
[12140.253991] 3.4.0-rc1-next-20120402-sasha #46 Tainted: G        W   
[12140.253991] -------------------------------
[12140.253991] include/linux/rcupdate.h:750 rcu_read_unlock() used illegally while idle!
[12140.253991] 
[12140.253991] other info that might help us debug this:
[12140.253991] 
[12140.253991] 
[12140.253991] RCU used illegally from idle CPU!
[12140.253991] rcu_scheduler_active = 1, debug_locks = 1
[12140.253991] RCU used illegally from extended quiescent state!
[12140.253991] 4 locks held by swapper/1/0:
[12140.253991]  #0:  (&(&async_pf_sleepers[i].lock)->rlock){..-...}, at: [<ffffffff8107cdc8>] kvm_async_pf_task_wake+0x48/0x130
[12140.253991]  #1:  (&n.wq){......}, at: [<ffffffff810e200d>] __wake_up+0x2d/0x70
[12140.253991]  #2:  (&p->pi_lock){-.-.-.}, at: [<ffffffff810ec404>] try_to_wake_up+0x34/0x290
[12140.253991]  #3:  (rcu_read_lock){.+.+..}, at: [<ffffffff810f3c80>] select_task_rq_fair+0xb0/0x5c0
[12140.253991] 
[12140.253991] stack backtrace:
[12140.253991] Pid: 0, comm: swapper/1 Tainted: G        W    3.4.0-rc1-next-20120402-sasha #46
[12140.253991] Call Trace:
[12140.253991]  [<ffffffff81114173>] lockdep_rcu_suspicious+0x113/0x130
[12140.253991]  [<ffffffff810f412a>] select_task_rq_fair+0x55a/0x5c0
[12140.253991]  [<ffffffff810f3c80>] ? select_task_rq_fair+0xb0/0x5c0
[12140.253991]  [<ffffffff810ec404>] ? try_to_wake_up+0x34/0x290
[12140.253991]  [<ffffffff810ec404>] ? try_to_wake_up+0x34/0x290
[12140.253991]  [<ffffffff810ec561>] try_to_wake_up+0x191/0x290
[12140.253991]  [<ffffffff81114850>] ? __lock_acquired+0x1c0/0x210
[12140.253991]  [<ffffffff810ec66d>] default_wake_function+0xd/0x10
[12140.253991]  [<ffffffff810d7208>] autoremove_wake_function+0x18/0x40
[12140.253991]  [<ffffffff810e11e2>] __wake_up_common+0x52/0x90
[12140.253991]  [<ffffffff810e200d>] ? __wake_up+0x2d/0x70
[12140.253991]  [<ffffffff810e2023>] __wake_up+0x43/0x70
[12140.253991]  [<ffffffff8107cb07>] apf_task_wake_one+0x87/0x90
[12140.253991]  [<ffffffff8107cdf5>] kvm_async_pf_task_wake+0x75/0x130
[12140.253991]  [<ffffffff8107d1e6>] do_async_page_fault+0x86/0xa0
[12140.253991]  [<ffffffff82657a55>] async_page_fault+0x25/0x30
[12140.253991]  [<ffffffff8107d626>] ? native_safe_halt+0x6/0x10
[12140.253991]  [<ffffffff81116fed>] ? trace_hardirqs_on+0xd/0x10
[12140.253991]  [<ffffffff8105857d>] default_idle+0x4d/0xa0
[12140.253991]  [<ffffffff810582af>] cpu_idle+0x11f/0x180
[12140.253991]  [<ffffffff8264b9e0>] ? setup_APIC_timer+0x88/0x8c
[12140.253991]  [<ffffffff8264b004>] start_secondary+0xe1/0xe8
[12140.623131] 
[12140.623131] ===============================
[12140.623131] [ INFO: suspicious RCU usage. ]
[12140.623131] 3.4.0-rc1-next-20120402-sasha #46 Tainted: G        W   
[12140.623131] -------------------------------
[12140.623131] include/linux/rcupdate.h:729 rcu_read_lock() used illegally while idle!
[12140.623131] 
[12140.623131] other info that might help us debug this:
[12140.623131] 
[12140.623131] 
[12140.623131] RCU used illegally from idle CPU!
[12140.623131] rcu_scheduler_active = 1, debug_locks = 1
[12140.623131] RCU used illegally from extended quiescent state!
[12140.623131] 4 locks held by swapper/1/0:
[12140.623131]  #0:  (&(&async_pf_sleepers[i].lock)->rlock){..-...}, at: [<ffffffff8107cdc8>] kvm_async_pf_task_wake+0x48/0x130
[12140.623131]  #1:  (&n.wq){......}, at: [<ffffffff810e200d>] __wake_up+0x2d/0x70
[12140.623131]  #2:  (&p->pi_lock){-.-.-.}, at: [<ffffffff810ec404>] try_to_wake_up+0x34/0x290
[12140.623131]  #3:  (rcu_read_lock){.+.+..}, at: [<ffffffff810ea4c0>] ttwu_stat+0x50/0x230
[12140.623131] 
[12140.623131] stack backtrace:
[12140.623131] Pid: 0, comm: swapper/1 Tainted: G        W    3.4.0-rc1-next-20120402-sasha #46
[12140.623131] Call Trace:
[12140.623131]  [<ffffffff81114173>] lockdep_rcu_suspicious+0x113/0x130
[12140.623131]  [<ffffffff810ea537>] ttwu_stat+0xc7/0x230
[12140.623131]  [<ffffffff810ea4c0>] ? ttwu_stat+0x50/0x230
[12140.623131]  [<ffffffff810ec404>] ? try_to_wake_up+0x34/0x290
[12140.623131]  [<ffffffff810ec62a>] try_to_wake_up+0x25a/0x290
[12140.623131]  [<ffffffff81114850>] ? __lock_acquired+0x1c0/0x210
[12140.623131]  [<ffffffff810ec66d>] default_wake_function+0xd/0x10
[12140.623131]  [<ffffffff810d7208>] autoremove_wake_function+0x18/0x40
[12140.623131]  [<ffffffff810e11e2>] __wake_up_common+0x52/0x90
[12140.623131]  [<ffffffff810e200d>] ? __wake_up+0x2d/0x70
[12140.623131]  [<ffffffff810e2023>] __wake_up+0x43/0x70
[12140.623131]  [<ffffffff8107cb07>] apf_task_wake_one+0x87/0x90
[12140.623131]  [<ffffffff8107cdf5>] kvm_async_pf_task_wake+0x75/0x130
[12140.623131]  [<ffffffff8107d1e6>] do_async_page_fault+0x86/0xa0
[12140.623131]  [<ffffffff82657a55>] async_page_fault+0x25/0x30
[12140.623131]  [<ffffffff8107d626>] ? native_safe_halt+0x6/0x10
[12140.623131]  [<ffffffff81116fed>] ? trace_hardirqs_on+0xd/0x10
[12140.623131]  [<ffffffff8105857d>] default_idle+0x4d/0xa0
[12140.623131]  [<ffffffff810582af>] cpu_idle+0x11f/0x180
[12140.623131]  [<ffffffff8264b9e0>] ? setup_APIC_timer+0x88/0x8c
[12140.623131]  [<ffffffff8264b004>] start_secondary+0xe1/0xe8
[12140.623131] 
[12140.623131] ===============================
[12140.623131] [ INFO: suspicious RCU usage. ]
[12140.623131] 3.4.0-rc1-next-20120402-sasha #46 Tainted: G        W   
[12140.623131] -------------------------------
[12140.623131] kernel/sched/core.c:1375 suspicious rcu_dereference_check() usage!
[12140.623131] 
[12140.623131] other info that might help us debug this:
[12140.623131] 
[12140.623131] 
[12140.623131] RCU used illegally from idle CPU!
[12140.623131] rcu_scheduler_active = 1, debug_locks = 1
[12140.623131] RCU used illegally from extended quiescent state!
[12140.623131] 4 locks held by swapper/1/0:
[12140.623131]  #0:  (&(&async_pf_sleepers[i].lock)->rlock){..-...}, at: [<ffffffff8107cdc8>] kvm_async_pf_task_wake+0x48/0x130
[12140.623131]  #1:  (&n.wq){......}, at: [<ffffffff810e200d>] __wake_up+0x2d/0x70
[12140.623131]  #2:  (&p->pi_lock){-.-.-.}, at: [<ffffffff810ec404>] try_to_wake_up+0x34/0x290
[12140.623131]  #3:  (rcu_read_lock){.+.+..}, at: [<ffffffff810ea4c0>] ttwu_stat+0x50/0x230
[12140.623131] 
[12140.623131] stack backtrace:
[12140.623131] Pid: 0, comm: swapper/1 Tainted: G        W    3.4.0-rc1-next-20120402-sasha #46
[12140.623131] Call Trace:
[12140.623131]  [<ffffffff81114173>] lockdep_rcu_suspicious+0x113/0x130
[12140.623131]  [<ffffffff810ea5a8>] ttwu_stat+0x138/0x230
[12140.623131]  [<ffffffff810ea4c0>] ? ttwu_stat+0x50/0x230
[12140.623131]  [<ffffffff810ec404>] ? try_to_wake_up+0x34/0x290
[12140.623131]  [<ffffffff810ec62a>] try_to_wake_up+0x25a/0x290
[12140.623131]  [<ffffffff81114850>] ? __lock_acquired+0x1c0/0x210
[12140.623131]  [<ffffffff810ec66d>] default_wake_function+0xd/0x10
[12140.623131]  [<ffffffff810d7208>] autoremove_wake_function+0x18/0x40
[12140.623131]  [<ffffffff810e11e2>] __wake_up_common+0x52/0x90
[12140.623131]  [<ffffffff810e200d>] ? __wake_up+0x2d/0x70
[12140.623131]  [<ffffffff810e2023>] __wake_up+0x43/0x70
[12140.623131]  [<ffffffff8107cb07>] apf_task_wake_one+0x87/0x90
[12140.623131]  [<ffffffff8107cdf5>] kvm_async_pf_task_wake+0x75/0x130
[12140.623131]  [<ffffffff8107d1e6>] do_async_page_fault+0x86/0xa0
[12140.623131]  [<ffffffff82657a55>] async_page_fault+0x25/0x30
[12140.623131]  [<ffffffff8107d626>] ? native_safe_halt+0x6/0x10
[12140.623131]  [<ffffffff81116fed>] ? trace_hardirqs_on+0xd/0x10
[12140.623131]  [<ffffffff8105857d>] default_idle+0x4d/0xa0
[12140.623131]  [<ffffffff810582af>] cpu_idle+0x11f/0x180
[12140.623131]  [<ffffffff8264b9e0>] ? setup_APIC_timer+0x88/0x8c
[12140.623131]  [<ffffffff8264b004>] start_secondary+0xe1/0xe8
[12140.623131] 
[12140.623131] ===============================
[12140.623131] [ INFO: suspicious RCU usage. ]
[12140.623131] 3.4.0-rc1-next-20120402-sasha #46 Tainted: G        W   
[12140.623131] -------------------------------
[12140.623131] include/linux/rcupdate.h:750 rcu_read_unlock() used illegally while idle!
[12140.623131] 
[12140.623131] other info that might help us debug this:
[12140.623131] 
[12140.623131] 
[12140.623131] RCU used illegally from idle CPU!
[12140.623131] rcu_scheduler_active = 1, debug_locks = 1
[12140.623131] RCU used illegally from extended quiescent state!
[12140.623131] 4 locks held by swapper/1/0:
[12140.623131]  #0:  (&(&async_pf_sleepers[i].lock)->rlock){..-...}, at: [<ffffffff8107cdc8>] kvm_async_pf_task_wake+0x48/0x130
[12140.623131]  #1:  (&n.wq){......}, at: [<ffffffff810e200d>] __wake_up+0x2d/0x70
[12140.623131]  #2:  (&p->pi_lock){-.-.-.}, at: [<ffffffff810ec404>] try_to_wake_up+0x34/0x290
[12140.623131]  #3:  (rcu_read_lock){.+.+..}, at: [<ffffffff810ea4c0>] ttwu_stat+0x50/0x230
[12140.623131] 
[12140.623131] stack backtrace:
[12140.623131] Pid: 0, comm: swapper/1 Tainted: G        W    3.4.0-rc1-next-20120402-sasha #46
[12140.623131] Call Trace:
[12140.623131]  [<ffffffff81114173>] lockdep_rcu_suspicious+0x113/0x130
[12140.623131]  [<ffffffff810ea643>] ttwu_stat+0x1d3/0x230
[12140.623131]  [<ffffffff810ea4c0>] ? ttwu_stat+0x50/0x230
[12140.623131]  [<ffffffff810ec404>] ? try_to_wake_up+0x34/0x290
[12140.623131]  [<ffffffff810ec62a>] try_to_wake_up+0x25a/0x290
[12140.623131]  [<ffffffff81114850>] ? __lock_acquired+0x1c0/0x210
[12140.623131]  [<ffffffff810ec66d>] default_wake_function+0xd/0x10
[12140.623131]  [<ffffffff810d7208>] autoremove_wake_function+0x18/0x40
[12140.623131]  [<ffffffff810e11e2>] __wake_up_common+0x52/0x90
[12140.623131]  [<ffffffff810e200d>] ? __wake_up+0x2d/0x70
[12140.623131]  [<ffffffff810e2023>] __wake_up+0x43/0x70
[12140.623131]  [<ffffffff8107cb07>] apf_task_wake_one+0x87/0x90
[12140.623131]  [<ffffffff8107cdf5>] kvm_async_pf_task_wake+0x75/0x130
Quoted 12 lines
[12140.623131]  [<ffffffff8107d1e6>] do_async_page_fault+0x86/0xa0
[12140.623131]  [<ffffffff82657a55>] async_page_fault+0x25/0x30
[12140.623131]  [<ffffffff8107d626>] ? native_safe_halt+0x6/0x10
[12140.623131]  [<ffffffff81116fed>] ? trace_hardirqs_on+0xd/0x10
[12140.623131]  [<ffffffff8105857d>] default_idle+0x4d/0xa0
[12140.623131]  [<ffffffff810582af>] cpu_idle+0x11f/0x180
[12140.623131]  [<ffffffff8264b9e0>] ? setup_APIC_timer+0x88/0x8c
[12140.623131]  [<ffffffff8264b004>] start_secondary+0xe1/0xe8
Signature · 1 line
Sasha.

--
Gleb.

#2 lore raw
Quoted 5 lines · Gleb Natapov
Quoted 4 lines · Sasha Levin

Hi all,

I got the spew at the bottom of the mail in a KVM guest using the KVM tools and running trinity.

Quoted 8 lines
Quoted 2 lines

I'm not quite sure how default_idle managed to trigger a pagefault, so that part looks odd to me.

This is not regular page fault. This is async page fault that tells the guest that a page, previously swapped out by hypervisor, is now swapped back in and it can happen while vcpu is idle. The code does not leave idle state properly though. We probably need to call rcu_irq_enter() there. Will look into it.

The patch below solves it for me:

"Page ready" async PF can kick vcpu out of idle state much like IRQ. We need to tell RCU about this.

arch/x86/kernel/kvm.c +4 -0
index f0c6fd6..380079f 100644
@@ -38,6 +38,7 @@
 #include <asm/traps.h>
 #include <asm/desc.h>
 #include <asm/tlbflush.h>
+#include <asm/idle.h>
 
 static int kvmapf = 1;
 
@@ -253,7 +254,10 @@ do_async_page_fault(struct pt_regs *regs, unsigned long error_code)
 		kvm_async_pf_task_wait((u32)read_cr2());
 		break;
 	case KVM_PV_REASON_PAGE_READY:
+		rcu_irq_enter();
+		exit_idle();
 		kvm_async_pf_task_wake((u32)read_cr2());
+		rcu_irq_exit();
 		break;
 	}
 }

--
Gleb.

Reviewed-by
#3 lore raw
Quoted 15 lines · Gleb Natapov
Quoted 5 lines · Gleb Natapov
Quoted 4 lines · Sasha Levin

Hi all,

I got the spew at the bottom of the mail in a KVM guest using the KVM tools and running trinity.

Quoted 8 lines
Quoted 2 lines

I'm not quite sure how default_idle managed to trigger a pagefault, so that part looks odd to me.

This is not regular page fault. This is async page fault that tells the guest that a page, previously swapped out by hypervisor, is now swapped back in and it can happen while vcpu is idle. The code does not leave idle state properly though. We probably need to call rcu_irq_enter() there. Will look into it.

Quoted 4 lines

The patch below solves it for me:

"Page ready" async PF can kick vcpu out of idle state much like IRQ. We need to tell RCU about this.

This is invoked from an exception or interrupt handler, not from process-level code? If so:

Quoted 27 lines
arch/x86/kernel/kvm.c +4 -1
index f0c6fd6..380079f 100644
@@ -38,6 +38,7 @@
 #include <asm/traps.h>
 #include <asm/desc.h>
 #include <asm/tlbflush.h>
+#include <asm/idle.h>
 
 static int kvmapf = 1;
 
@@ -253,7 +254,10 @@ do_async_page_fault(struct pt_regs *regs, unsigned long error_code)
 		kvm_async_pf_task_wait((u32)read_cr2());
 		break;
 	case KVM_PV_REASON_PAGE_READY:
+		rcu_irq_enter();
+		exit_idle();
 		kvm_async_pf_task_wake((u32)read_cr2());
+		rcu_irq_exit();
 		break;
 	}
 }
--

Gleb.

#4 lore raw
Quoted 52 lines · Paul E. McKenney
Quoted 15 lines · Gleb Natapov
Quoted 5 lines · Gleb Natapov
Quoted 4 lines · Sasha Levin

Hi all,

I got the spew at the bottom of the mail in a KVM guest using the KVM tools and running trinity.

Quoted 8 lines
Quoted 2 lines

I'm not quite sure how default_idle managed to trigger a pagefault, so that part looks odd to me.

This is not regular page fault. This is async page fault that tells the guest that a page, previously swapped out by hypervisor, is now swapped back in and it can happen while vcpu is idle. The code does not leave idle state properly though. We probably need to call rcu_irq_enter() there. Will look into it.

Quoted 4 lines

The patch below solves it for me:

"Page ready" async PF can kick vcpu out of idle state much like IRQ. We need to tell RCU about this.

This is invoked from an exception or interrupt handler, not from process-level code? If so:

From an exception.

Quoted 24 lines
arch/x86/kernel/kvm.c +4 -0
index f0c6fd6..380079f 100644
@@ -38,6 +38,7 @@
 #include <asm/traps.h>
 #include <asm/desc.h>
 #include <asm/tlbflush.h>
+#include <asm/idle.h>
 
 static int kvmapf = 1;
 
@@ -253,7 +254,10 @@ do_async_page_fault(struct pt_regs *regs, unsigned long error_code)
 		kvm_async_pf_task_wait((u32)read_cr2());
 		break;
 	case KVM_PV_REASON_PAGE_READY:
+		rcu_irq_enter();
+		exit_idle();
 		kvm_async_pf_task_wake((u32)read_cr2());
+		rcu_irq_exit();
 		break;
 	}
 }
Quoted 8 lines
Quoted 3 lines

--
Gleb.

--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/

--
Gleb.

#5 lore raw
In reply to Gleb Natapov
Quoted 15 lines · Gleb Natapov
Quoted 5 lines · Gleb Natapov
Quoted 4 lines · Sasha Levin

Hi all,

I got the spew at the bottom of the mail in a KVM guest using the KVM tools and running trinity.

Quoted 8 lines
Quoted 2 lines

I'm not quite sure how default_idle managed to trigger a pagefault, so that part looks odd to me.

This is not regular page fault. This is async page fault that tells the guest that a page, previously swapped out by hypervisor, is now swapped back in and it can happen while vcpu is idle. The code does not leave idle state properly though. We probably need to call rcu_irq_enter() there. Will look into it.

Quoted 4 lines

The patch below solves it for me:

"Page ready" async PF can kick vcpu out of idle state much like IRQ. We need to tell RCU about this.

Looks good here.

Applied
#6 lore raw
In reply to Gleb Natapov
Quoted 15 lines · Gleb Natapov
Quoted 5 lines · Gleb Natapov
Quoted 4 lines · Sasha Levin

Hi all,

I got the spew at the bottom of the mail in a KVM guest using the KVM tools and running trinity.

Quoted 8 lines
Quoted 2 lines

I'm not quite sure how default_idle managed to trigger a pagefault, so that part looks odd to me.

This is not regular page fault. This is async page fault that tells the guest that a page, previously swapped out by hypervisor, is now swapped back in and it can happen while vcpu is idle. The code does not leave idle state properly though. We probably need to call rcu_irq_enter() there. Will look into it.

Quoted 6 lines

The patch below solves it for me:

"Page ready" async PF can kick vcpu out of idle state much like IRQ. We need to tell RCU about this.

Applied it, thanks.

Signature · 1 line
error compiling committee.c: too many arguments to function
#7 lore raw
In reply to Gleb Natapov

arch/x86/kernel/kvm.c do_async_page_fault(struct pt_regs *regs, unsigned long error_code) · line 263

Quoted 12 lines · Gleb Natapov
arch/x86/kernel/kvm.c +3 -0
@@ -253,7 +254,10 @@ do_async_page_fault(struct pt_regs *regs, unsigned long error_code)
 		kvm_async_pf_task_wait((u32)read_cr2());
 		break;
 	case KVM_PV_REASON_PAGE_READY:
+		rcu_irq_enter();
+		exit_idle();
 		kvm_async_pf_task_wake((u32)read_cr2());
+		rcu_irq_exit();
 		break;
 	}
 }

Wouldn't irq_enter() / irq_exit() be more appropriate? You're basically taking an interrupt/exception from idle, irq_enter() will fix up everything that needs fixing up, including time sources (which the scheduler expects to be up-to-date).

#8 lore raw
Quoted 19 lines · Peter Zijlstra

arch/x86/kernel/kvm.c do_async_page_fault(struct pt_regs *regs, unsigned long error_code) · line 263

Quoted 12 lines · Gleb Natapov
arch/x86/kernel/kvm.c +3 -0
@@ -253,7 +254,10 @@ do_async_page_fault(struct pt_regs *regs, unsigned long error_code)
 		kvm_async_pf_task_wait((u32)read_cr2());
 		break;
 	case KVM_PV_REASON_PAGE_READY:
+		rcu_irq_enter();
+		exit_idle();
 		kvm_async_pf_task_wake((u32)read_cr2());
+		rcu_irq_exit();
 		break;
 	}
 }

Wouldn't irq_enter() / irq_exit() be more appropriate? You're basically taking an interrupt/exception from idle, irq_enter() will fix up everything that needs fixing up, including time sources (which the scheduler expects to be up-to-date).

You are right. Will send a patch.

--
Gleb.

#9 lore raw
Quoted 20 lines · Gleb Natapov
Quoted 19 lines · Peter Zijlstra

Review do_async_page_fault(struct pt_regs *regs, unsigned long error_code) · line 263

Quoted 12 lines · Gleb Natapov
(quoted diff) +3 -0
@@ -253,7 +254,10 @@ do_async_page_fault(struct pt_regs *regs, unsigned long error_code)
 		kvm_async_pf_task_wait((u32)read_cr2());
 		break;
 	case KVM_PV_REASON_PAGE_READY:
+		rcu_irq_enter();
+		exit_idle();
 		kvm_async_pf_task_wake((u32)read_cr2());
+		rcu_irq_exit();
 		break;
 	}
 }

Wouldn't irq_enter() / irq_exit() be more appropriate? You're basically taking an interrupt/exception from idle, irq_enter() will fix up everything that needs fixing up, including time sources (which the scheduler expects to be up-to-date).

Quoted 2 lines

You are right. Will send a patch.

KVM: Call irq_enter() instead of rcu_irq_enter() during async PF.

As Peter noted there are more things that should be done when leaving idle state. irq_(enter|exit)() does them and also call rcu functions.

arch/x86/kernel/kvm.c +2 -2
index b8ba6e4..83a48f6 100644
@@ -254,10 +254,10 @@ do_async_page_fault(struct pt_regs *regs, unsigned long error_code)
 		kvm_async_pf_task_wait((u32)read_cr2());
 		break;
 	case KVM_PV_REASON_PAGE_READY:
-		rcu_irq_enter();
+		irq_enter();
 		exit_idle();
 		kvm_async_pf_task_wake((u32)read_cr2());
-		rcu_irq_exit();
+		irq_exit();
 		break;
 	}
 }

--
Gleb.

#10 lore raw

arch/x86/kernel/kvm.c do_async_page_fault(struct pt_regs *regs, unsigned long error_code) · line 258

Quoted 3 lines · Gleb Natapov
arch/x86/kernel/kvm.c +1 -1
-               rcu_irq_enter();
+               irq_enter();
                exit_idle(); 

Do we really need the exit_idle()? I can't remember other interrupt handlers doing that.

#11 lore raw
Quoted 7 lines · Peter Zijlstra

arch/x86/kernel/kvm.c do_async_page_fault(struct pt_regs *regs, unsigned long error_code) · line 258

Quoted 3 lines · Gleb Natapov
arch/x86/kernel/kvm.c +1 -1
-               rcu_irq_enter();
+               irq_enter();
                exit_idle(); 

Do we really need the exit_idle()? I can't remember other interrupt handlers doing that.

They do. That's where I got the idea.

--
Gleb.

#12 lore raw
Quoted 9 lines · Gleb Natapov
Quoted 7 lines · Peter Zijlstra

arch/x86/kernel/kvm.c do_async_page_fault(struct pt_regs *regs, unsigned long error_code) · line 258

Quoted 3 lines · Gleb Natapov
arch/x86/kernel/kvm.c +1 -1
-               rcu_irq_enter();
+               irq_enter();
                exit_idle(); 

Do we really need the exit_idle()? I can't remember other interrupt handlers doing that.

They do. That's where I got the idea.

Some do.. some don't.. /me goes have a look what this exit_idle nonsense is all about. Looks to be something broken.

#13 lore raw
Quoted 7 lines · Peter Zijlstra
Quoted 6 lines · Gleb Natapov
Quoted 5 lines · Peter Zijlstra
Quoted 3 lines · Gleb Natapov
arch/x86/kernel/kvm.c +1 -1
-               rcu_irq_enter();
+               irq_enter();
                exit_idle(); 
Quoted 6 lines
Quoted 3 lines
Quoted 2 lines

Do we really need the exit_idle()? I can't remember other interrupt handlers doing that.

They do. That's where I got the idea.

Some do.. some don't.. /me goes have a look what this exit_idle nonsense is all about. Looks to be something broken.

Yeah, its broken and the whole implementation is crap anyway. There's only one user (drivers/idle/i7300_idle.c) so it likely doesn't matter (much) anyway.

Thomas, can we rip that stuff out? or do we have to like actually fix it?

#14 lore raw
Quoted 10 lines · Peter Zijlstra
Quoted 9 lines · Peter Zijlstra
Quoted 8 lines · Gleb Natapov
Quoted 7 lines · Peter Zijlstra

arch/x86/kernel/kvm.c do_async_page_fault(struct pt_regs *regs, unsigned long error_code) · line 258

Quoted 3 lines · Gleb Natapov
arch/x86/kernel/kvm.c +1 -1
-               rcu_irq_enter();
+               irq_enter();
                exit_idle(); 

Do we really need the exit_idle()? I can't remember other interrupt handlers doing that.

Quoted 9 lines
Quoted 4 lines
Quoted 1 line

They do. That's where I got the idea.

Some do.. some don't.. /me goes have a look what this exit_idle nonsense is all about. Looks to be something broken.

Yeah, its broken and the whole implementation is crap anyway. There's only one user (drivers/idle/i7300_idle.c) so it likely doesn't matter (much) anyway.

Should I resend the patch with removal of exit_idle() call or it will be removed by a patch that removes exit_idle() completely later?

Quoted 2 lines

Thomas, can we rip that stuff out? or do we have to like actually fix it?

--
Gleb.

#15 lore raw
Quoted 3 lines · Gleb Natapov

Should I resend the patch with removal of exit_idle() call or it will be removed by a patch that removes exit_idle() completely later?

I think we can do the latter, once we decided what to do with that stuff we can clean it up/remove it whole sale.

#16 lore raw
In reply to Sasha Levin
Quoted 5 lines · Sasha Levin

Hi all,

I got the spew at the bottom of the mail in a KVM guest using the KVM tools and running trinity.

I'm not quite sure how default_idle managed to trigger a pagefault, so that part looks odd to me.

Wrapping the offending RCU read-side critical section in RCU_NONIDLE() is the intended solution -- though that assumes that you can tell where the page fault will occur.

Thanx, Paul

Quoted 310 lines
[12140.220507] ===============================
[12140.220507] [ INFO: suspicious RCU usage. ]
[12140.220507] 3.4.0-rc1-next-20120402-sasha #46 Tainted: G        W   
[12140.220507] -------------------------------
[12140.220507] include/linux/rcupdate.h:729 rcu_read_lock() used illegally while idle!
[12140.220507] 
[12140.220507] other info that might help us debug this:
[12140.220507] 
[12140.220507] 
[12140.220507] RCU used illegally from idle CPU!
[12140.220507] rcu_scheduler_active = 1, debug_locks = 1
[12140.220507] RCU used illegally from extended quiescent state!
[12140.220507] 4 locks held by swapper/1/0:
[12140.253991]  #0:  (&(&async_pf_sleepers[i].lock)->rlock){..-...}, at: [<ffffffff8107cdc8>] kvm_async_pf_task_wake+0x48/0x130
[12140.253991]  #1:  (&n.wq){......}, at: [<ffffffff810e200d>] __wake_up+0x2d/0x70
[12140.253991]  #2:  (&p->pi_lock){-.-.-.}, at: [<ffffffff810ec404>] try_to_wake_up+0x34/0x290
[12140.253991]  #3:  (rcu_read_lock){.+.+..}, at: [<ffffffff810f3c80>] select_task_rq_fair+0xb0/0x5c0
[12140.253991] 
[12140.253991] stack backtrace:
[12140.253991] Pid: 0, comm: swapper/1 Tainted: G        W    3.4.0-rc1-next-20120402-sasha #46
[12140.253991] Call Trace:
[12140.253991]  [<ffffffff81114173>] lockdep_rcu_suspicious+0x113/0x130
[12140.253991]  [<ffffffff810f3ce5>] select_task_rq_fair+0x115/0x5c0
[12140.253991]  [<ffffffff810f3c80>] ? select_task_rq_fair+0xb0/0x5c0
[12140.253991]  [<ffffffff810ec404>] ? try_to_wake_up+0x34/0x290
[12140.253991]  [<ffffffff810ec404>] ? try_to_wake_up+0x34/0x290
[12140.253991]  [<ffffffff810ec561>] try_to_wake_up+0x191/0x290
[12140.253991]  [<ffffffff81114850>] ? __lock_acquired+0x1c0/0x210
[12140.253991]  [<ffffffff810ec66d>] default_wake_function+0xd/0x10
[12140.253991]  [<ffffffff810d7208>] autoremove_wake_function+0x18/0x40
[12140.253991]  [<ffffffff810e11e2>] __wake_up_common+0x52/0x90
[12140.253991]  [<ffffffff810e200d>] ? __wake_up+0x2d/0x70
[12140.253991]  [<ffffffff810e2023>] __wake_up+0x43/0x70
[12140.253991]  [<ffffffff8107cb07>] apf_task_wake_one+0x87/0x90
[12140.253991]  [<ffffffff8107cdf5>] kvm_async_pf_task_wake+0x75/0x130
[12140.253991]  [<ffffffff8107d1e6>] do_async_page_fault+0x86/0xa0
[12140.253991]  [<ffffffff82657a55>] async_page_fault+0x25/0x30
[12140.253991]  [<ffffffff8107d626>] ? native_safe_halt+0x6/0x10
[12140.253991]  [<ffffffff81116fed>] ? trace_hardirqs_on+0xd/0x10
[12140.253991]  [<ffffffff8105857d>] default_idle+0x4d/0xa0
[12140.253991]  [<ffffffff810582af>] cpu_idle+0x11f/0x180
[12140.253991]  [<ffffffff8264b9e0>] ? setup_APIC_timer+0x88/0x8c
[12140.253991]  [<ffffffff8264b004>] start_secondary+0xe1/0xe8
[12140.253991] 
[12140.253991] ===============================
[12140.253991] [ INFO: suspicious RCU usage. ]
[12140.253991] 3.4.0-rc1-next-20120402-sasha #46 Tainted: G        W   
[12140.253991] -------------------------------
[12140.253991] kernel/sched/fair.c:2716 suspicious rcu_dereference_check() usage!
[12140.253991] 
[12140.253991] other info that might help us debug this:
[12140.253991] 
[12140.253991] 
[12140.253991] RCU used illegally from idle CPU!
[12140.253991] rcu_scheduler_active = 1, debug_locks = 1
[12140.253991] RCU used illegally from extended quiescent state!
[12140.253991] 4 locks held by swapper/1/0:
[12140.253991]  #0:  (&(&async_pf_sleepers[i].lock)->rlock){..-...}, at: [<ffffffff8107cdc8>] kvm_async_pf_task_wake+0x48/0x130
[12140.253991]  #1:  (&n.wq){......}, at: [<ffffffff810e200d>] __wake_up+0x2d/0x70
[12140.253991]  #2:  (&p->pi_lock){-.-.-.}, at: [<ffffffff810ec404>] try_to_wake_up+0x34/0x290
[12140.253991]  #3:  (rcu_read_lock){.+.+..}, at: [<ffffffff810f3c80>] select_task_rq_fair+0xb0/0x5c0
[12140.253991] 
[12140.253991] stack backtrace:
[12140.253991] Pid: 0, comm: swapper/1 Tainted: G        W    3.4.0-rc1-next-20120402-sasha #46
[12140.253991] Call Trace:
[12140.253991]  [<ffffffff81114173>] lockdep_rcu_suspicious+0x113/0x130
[12140.253991]  [<ffffffff810f3d4c>] select_task_rq_fair+0x17c/0x5c0
[12140.253991]  [<ffffffff810f3c80>] ? select_task_rq_fair+0xb0/0x5c0
[12140.253991]  [<ffffffff810ec404>] ? try_to_wake_up+0x34/0x290
[12140.253991]  [<ffffffff810ec404>] ? try_to_wake_up+0x34/0x290
[12140.253991]  [<ffffffff810ec561>] try_to_wake_up+0x191/0x290
[12140.253991]  [<ffffffff81114850>] ? __lock_acquired+0x1c0/0x210
[12140.253991]  [<ffffffff810ec66d>] default_wake_function+0xd/0x10
[12140.253991]  [<ffffffff810d7208>] autoremove_wake_function+0x18/0x40
[12140.253991]  [<ffffffff810e11e2>] __wake_up_common+0x52/0x90
[12140.253991]  [<ffffffff810e200d>] ? __wake_up+0x2d/0x70
[12140.253991]  [<ffffffff810e2023>] __wake_up+0x43/0x70
[12140.253991]  [<ffffffff8107cb07>] apf_task_wake_one+0x87/0x90
[12140.253991]  [<ffffffff8107cdf5>] kvm_async_pf_task_wake+0x75/0x130
[12140.253991]  [<ffffffff8107d1e6>] do_async_page_fault+0x86/0xa0
[12140.253991]  [<ffffffff82657a55>] async_page_fault+0x25/0x30
[12140.253991]  [<ffffffff8107d626>] ? native_safe_halt+0x6/0x10
[12140.253991]  [<ffffffff81116fed>] ? trace_hardirqs_on+0xd/0x10
[12140.253991]  [<ffffffff8105857d>] default_idle+0x4d/0xa0
[12140.253991]  [<ffffffff810582af>] cpu_idle+0x11f/0x180
[12140.253991]  [<ffffffff8264b9e0>] ? setup_APIC_timer+0x88/0x8c
[12140.253991]  [<ffffffff8264b004>] start_secondary+0xe1/0xe8
[12140.253991] 
[12140.253991] ===============================
[12140.253991] [ INFO: suspicious RCU usage. ]
[12140.253991] 3.4.0-rc1-next-20120402-sasha #46 Tainted: G        W   
[12140.253991] -------------------------------
[12140.253991] kernel/sched/fair.c:2660 suspicious rcu_dereference_check() usage!
[12140.253991] 
[12140.253991] other info that might help us debug this:
[12140.253991] 
[12140.253991] 
[12140.253991] RCU used illegally from idle CPU!
[12140.253991] rcu_scheduler_active = 1, debug_locks = 1
[12140.253991] RCU used illegally from extended quiescent state!
[12140.253991] 4 locks held by swapper/1/0:
[12140.253991]  #0:  (&(&async_pf_sleepers[i].lock)->rlock){..-...}, at: [<ffffffff8107cdc8>] kvm_async_pf_task_wake+0x48/0x130
[12140.253991]  #1:  (&n.wq){......}, at: [<ffffffff810e200d>] __wake_up+0x2d/0x70
[12140.253991]  #2:  (&p->pi_lock){-.-.-.}, at: [<ffffffff810ec404>] try_to_wake_up+0x34/0x290
[12140.253991]  #3:  (rcu_read_lock){.+.+..}, at: [<ffffffff810f3c80>] select_task_rq_fair+0xb0/0x5c0
[12140.253991] 
[12140.253991] stack backtrace:
[12140.253991] Pid: 0, comm: swapper/1 Tainted: G        W    3.4.0-rc1-next-20120402-sasha #46
[12140.253991] Call Trace:
[12140.253991]  [<ffffffff81114173>] lockdep_rcu_suspicious+0x113/0x130
[12140.253991]  [<ffffffff810f062f>] select_idle_sibling+0xaf/0x1c0
[12140.253991]  [<ffffffff810f3f51>] select_task_rq_fair+0x381/0x5c0
[12140.253991]  [<ffffffff810f3c80>] ? select_task_rq_fair+0xb0/0x5c0
[12140.253991]  [<ffffffff810ec404>] ? try_to_wake_up+0x34/0x290
[12140.253991]  [<ffffffff810ec404>] ? try_to_wake_up+0x34/0x290
[12140.253991]  [<ffffffff810ec561>] try_to_wake_up+0x191/0x290
[12140.253991]  [<ffffffff81114850>] ? __lock_acquired+0x1c0/0x210
[12140.253991]  [<ffffffff810ec66d>] default_wake_function+0xd/0x10
[12140.253991]  [<ffffffff810d7208>] autoremove_wake_function+0x18/0x40
[12140.253991]  [<ffffffff810e11e2>] __wake_up_common+0x52/0x90
[12140.253991]  [<ffffffff810e200d>] ? __wake_up+0x2d/0x70
[12140.253991]  [<ffffffff810e2023>] __wake_up+0x43/0x70
[12140.253991]  [<ffffffff8107cb07>] apf_task_wake_one+0x87/0x90
[12140.253991]  [<ffffffff8107cdf5>] kvm_async_pf_task_wake+0x75/0x130
[12140.253991]  [<ffffffff8107d1e6>] do_async_page_fault+0x86/0xa0
[12140.253991]  [<ffffffff82657a55>] async_page_fault+0x25/0x30
[12140.253991]  [<ffffffff8107d626>] ? native_safe_halt+0x6/0x10
[12140.253991]  [<ffffffff81116fed>] ? trace_hardirqs_on+0xd/0x10
[12140.253991]  [<ffffffff8105857d>] default_idle+0x4d/0xa0
[12140.253991]  [<ffffffff810582af>] cpu_idle+0x11f/0x180
[12140.253991]  [<ffffffff8264b9e0>] ? setup_APIC_timer+0x88/0x8c
[12140.253991]  [<ffffffff8264b004>] start_secondary+0xe1/0xe8
[12140.253991] 
[12140.253991] ===============================
[12140.253991] [ INFO: suspicious RCU usage. ]
[12140.253991] 3.4.0-rc1-next-20120402-sasha #46 Tainted: G        W   
[12140.253991] -------------------------------
[12140.253991] include/linux/rcupdate.h:750 rcu_read_unlock() used illegally while idle!
[12140.253991] 
[12140.253991] other info that might help us debug this:
[12140.253991] 
[12140.253991] 
[12140.253991] RCU used illegally from idle CPU!
[12140.253991] rcu_scheduler_active = 1, debug_locks = 1
[12140.253991] RCU used illegally from extended quiescent state!
[12140.253991] 4 locks held by swapper/1/0:
[12140.253991]  #0:  (&(&async_pf_sleepers[i].lock)->rlock){..-...}, at: [<ffffffff8107cdc8>] kvm_async_pf_task_wake+0x48/0x130
[12140.253991]  #1:  (&n.wq){......}, at: [<ffffffff810e200d>] __wake_up+0x2d/0x70
[12140.253991]  #2:  (&p->pi_lock){-.-.-.}, at: [<ffffffff810ec404>] try_to_wake_up+0x34/0x290
[12140.253991]  #3:  (rcu_read_lock){.+.+..}, at: [<ffffffff810f3c80>] select_task_rq_fair+0xb0/0x5c0
[12140.253991] 
[12140.253991] stack backtrace:
[12140.253991] Pid: 0, comm: swapper/1 Tainted: G        W    3.4.0-rc1-next-20120402-sasha #46
[12140.253991] Call Trace:
[12140.253991]  [<ffffffff81114173>] lockdep_rcu_suspicious+0x113/0x130
[12140.253991]  [<ffffffff810f412a>] select_task_rq_fair+0x55a/0x5c0
[12140.253991]  [<ffffffff810f3c80>] ? select_task_rq_fair+0xb0/0x5c0
[12140.253991]  [<ffffffff810ec404>] ? try_to_wake_up+0x34/0x290
[12140.253991]  [<ffffffff810ec404>] ? try_to_wake_up+0x34/0x290
[12140.253991]  [<ffffffff810ec561>] try_to_wake_up+0x191/0x290
[12140.253991]  [<ffffffff81114850>] ? __lock_acquired+0x1c0/0x210
[12140.253991]  [<ffffffff810ec66d>] default_wake_function+0xd/0x10
[12140.253991]  [<ffffffff810d7208>] autoremove_wake_function+0x18/0x40
[12140.253991]  [<ffffffff810e11e2>] __wake_up_common+0x52/0x90
[12140.253991]  [<ffffffff810e200d>] ? __wake_up+0x2d/0x70
[12140.253991]  [<ffffffff810e2023>] __wake_up+0x43/0x70
[12140.253991]  [<ffffffff8107cb07>] apf_task_wake_one+0x87/0x90
[12140.253991]  [<ffffffff8107cdf5>] kvm_async_pf_task_wake+0x75/0x130
[12140.253991]  [<ffffffff8107d1e6>] do_async_page_fault+0x86/0xa0
[12140.253991]  [<ffffffff82657a55>] async_page_fault+0x25/0x30
[12140.253991]  [<ffffffff8107d626>] ? native_safe_halt+0x6/0x10
[12140.253991]  [<ffffffff81116fed>] ? trace_hardirqs_on+0xd/0x10
[12140.253991]  [<ffffffff8105857d>] default_idle+0x4d/0xa0
[12140.253991]  [<ffffffff810582af>] cpu_idle+0x11f/0x180
[12140.253991]  [<ffffffff8264b9e0>] ? setup_APIC_timer+0x88/0x8c
[12140.253991]  [<ffffffff8264b004>] start_secondary+0xe1/0xe8
[12140.623131] 
[12140.623131] ===============================
[12140.623131] [ INFO: suspicious RCU usage. ]
[12140.623131] 3.4.0-rc1-next-20120402-sasha #46 Tainted: G        W   
[12140.623131] -------------------------------
[12140.623131] include/linux/rcupdate.h:729 rcu_read_lock() used illegally while idle!
[12140.623131] 
[12140.623131] other info that might help us debug this:
[12140.623131] 
[12140.623131] 
[12140.623131] RCU used illegally from idle CPU!
[12140.623131] rcu_scheduler_active = 1, debug_locks = 1
[12140.623131] RCU used illegally from extended quiescent state!
[12140.623131] 4 locks held by swapper/1/0:
[12140.623131]  #0:  (&(&async_pf_sleepers[i].lock)->rlock){..-...}, at: [<ffffffff8107cdc8>] kvm_async_pf_task_wake+0x48/0x130
[12140.623131]  #1:  (&n.wq){......}, at: [<ffffffff810e200d>] __wake_up+0x2d/0x70
[12140.623131]  #2:  (&p->pi_lock){-.-.-.}, at: [<ffffffff810ec404>] try_to_wake_up+0x34/0x290
[12140.623131]  #3:  (rcu_read_lock){.+.+..}, at: [<ffffffff810ea4c0>] ttwu_stat+0x50/0x230
[12140.623131] 
[12140.623131] stack backtrace:
[12140.623131] Pid: 0, comm: swapper/1 Tainted: G        W    3.4.0-rc1-next-20120402-sasha #46
[12140.623131] Call Trace:
[12140.623131]  [<ffffffff81114173>] lockdep_rcu_suspicious+0x113/0x130
[12140.623131]  [<ffffffff810ea537>] ttwu_stat+0xc7/0x230
[12140.623131]  [<ffffffff810ea4c0>] ? ttwu_stat+0x50/0x230
[12140.623131]  [<ffffffff810ec404>] ? try_to_wake_up+0x34/0x290
[12140.623131]  [<ffffffff810ec62a>] try_to_wake_up+0x25a/0x290
[12140.623131]  [<ffffffff81114850>] ? __lock_acquired+0x1c0/0x210
[12140.623131]  [<ffffffff810ec66d>] default_wake_function+0xd/0x10
[12140.623131]  [<ffffffff810d7208>] autoremove_wake_function+0x18/0x40
[12140.623131]  [<ffffffff810e11e2>] __wake_up_common+0x52/0x90
[12140.623131]  [<ffffffff810e200d>] ? __wake_up+0x2d/0x70
[12140.623131]  [<ffffffff810e2023>] __wake_up+0x43/0x70
[12140.623131]  [<ffffffff8107cb07>] apf_task_wake_one+0x87/0x90
[12140.623131]  [<ffffffff8107cdf5>] kvm_async_pf_task_wake+0x75/0x130
[12140.623131]  [<ffffffff8107d1e6>] do_async_page_fault+0x86/0xa0
[12140.623131]  [<ffffffff82657a55>] async_page_fault+0x25/0x30
[12140.623131]  [<ffffffff8107d626>] ? native_safe_halt+0x6/0x10
[12140.623131]  [<ffffffff81116fed>] ? trace_hardirqs_on+0xd/0x10
[12140.623131]  [<ffffffff8105857d>] default_idle+0x4d/0xa0
[12140.623131]  [<ffffffff810582af>] cpu_idle+0x11f/0x180
[12140.623131]  [<ffffffff8264b9e0>] ? setup_APIC_timer+0x88/0x8c
[12140.623131]  [<ffffffff8264b004>] start_secondary+0xe1/0xe8
[12140.623131] 
[12140.623131] ===============================
[12140.623131] [ INFO: suspicious RCU usage. ]
[12140.623131] 3.4.0-rc1-next-20120402-sasha #46 Tainted: G        W   
[12140.623131] -------------------------------
[12140.623131] kernel/sched/core.c:1375 suspicious rcu_dereference_check() usage!
[12140.623131] 
[12140.623131] other info that might help us debug this:
[12140.623131] 
[12140.623131] 
[12140.623131] RCU used illegally from idle CPU!
[12140.623131] rcu_scheduler_active = 1, debug_locks = 1
[12140.623131] RCU used illegally from extended quiescent state!
[12140.623131] 4 locks held by swapper/1/0:
[12140.623131]  #0:  (&(&async_pf_sleepers[i].lock)->rlock){..-...}, at: [<ffffffff8107cdc8>] kvm_async_pf_task_wake+0x48/0x130
[12140.623131]  #1:  (&n.wq){......}, at: [<ffffffff810e200d>] __wake_up+0x2d/0x70
[12140.623131]  #2:  (&p->pi_lock){-.-.-.}, at: [<ffffffff810ec404>] try_to_wake_up+0x34/0x290
[12140.623131]  #3:  (rcu_read_lock){.+.+..}, at: [<ffffffff810ea4c0>] ttwu_stat+0x50/0x230
[12140.623131] 
[12140.623131] stack backtrace:
[12140.623131] Pid: 0, comm: swapper/1 Tainted: G        W    3.4.0-rc1-next-20120402-sasha #46
[12140.623131] Call Trace:
[12140.623131]  [<ffffffff81114173>] lockdep_rcu_suspicious+0x113/0x130
[12140.623131]  [<ffffffff810ea5a8>] ttwu_stat+0x138/0x230
[12140.623131]  [<ffffffff810ea4c0>] ? ttwu_stat+0x50/0x230
[12140.623131]  [<ffffffff810ec404>] ? try_to_wake_up+0x34/0x290
[12140.623131]  [<ffffffff810ec62a>] try_to_wake_up+0x25a/0x290
[12140.623131]  [<ffffffff81114850>] ? __lock_acquired+0x1c0/0x210
[12140.623131]  [<ffffffff810ec66d>] default_wake_function+0xd/0x10
[12140.623131]  [<ffffffff810d7208>] autoremove_wake_function+0x18/0x40
[12140.623131]  [<ffffffff810e11e2>] __wake_up_common+0x52/0x90
[12140.623131]  [<ffffffff810e200d>] ? __wake_up+0x2d/0x70
[12140.623131]  [<ffffffff810e2023>] __wake_up+0x43/0x70
[12140.623131]  [<ffffffff8107cb07>] apf_task_wake_one+0x87/0x90
[12140.623131]  [<ffffffff8107cdf5>] kvm_async_pf_task_wake+0x75/0x130
[12140.623131]  [<ffffffff8107d1e6>] do_async_page_fault+0x86/0xa0
[12140.623131]  [<ffffffff82657a55>] async_page_fault+0x25/0x30
[12140.623131]  [<ffffffff8107d626>] ? native_safe_halt+0x6/0x10
[12140.623131]  [<ffffffff81116fed>] ? trace_hardirqs_on+0xd/0x10
[12140.623131]  [<ffffffff8105857d>] default_idle+0x4d/0xa0
[12140.623131]  [<ffffffff810582af>] cpu_idle+0x11f/0x180
[12140.623131]  [<ffffffff8264b9e0>] ? setup_APIC_timer+0x88/0x8c
[12140.623131]  [<ffffffff8264b004>] start_secondary+0xe1/0xe8
[12140.623131] 
[12140.623131] ===============================
[12140.623131] [ INFO: suspicious RCU usage. ]
[12140.623131] 3.4.0-rc1-next-20120402-sasha #46 Tainted: G        W   
[12140.623131] -------------------------------
[12140.623131] include/linux/rcupdate.h:750 rcu_read_unlock() used illegally while idle!
[12140.623131] 
[12140.623131] other info that might help us debug this:
[12140.623131] 
[12140.623131] 
[12140.623131] RCU used illegally from idle CPU!
[12140.623131] rcu_scheduler_active = 1, debug_locks = 1
[12140.623131] RCU used illegally from extended quiescent state!
[12140.623131] 4 locks held by swapper/1/0:
[12140.623131]  #0:  (&(&async_pf_sleepers[i].lock)->rlock){..-...}, at: [<ffffffff8107cdc8>] kvm_async_pf_task_wake+0x48/0x130
[12140.623131]  #1:  (&n.wq){......}, at: [<ffffffff810e200d>] __wake_up+0x2d/0x70
[12140.623131]  #2:  (&p->pi_lock){-.-.-.}, at: [<ffffffff810ec404>] try_to_wake_up+0x34/0x290
[12140.623131]  #3:  (rcu_read_lock){.+.+..}, at: [<ffffffff810ea4c0>] ttwu_stat+0x50/0x230
[12140.623131] 
[12140.623131] stack backtrace:
[12140.623131] Pid: 0, comm: swapper/1 Tainted: G        W    3.4.0-rc1-next-20120402-sasha #46
[12140.623131] Call Trace:
[12140.623131]  [<ffffffff81114173>] lockdep_rcu_suspicious+0x113/0x130
[12140.623131]  [<ffffffff810ea643>] ttwu_stat+0x1d3/0x230
[12140.623131]  [<ffffffff810ea4c0>] ? ttwu_stat+0x50/0x230
[12140.623131]  [<ffffffff810ec404>] ? try_to_wake_up+0x34/0x290
[12140.623131]  [<ffffffff810ec62a>] try_to_wake_up+0x25a/0x290
[12140.623131]  [<ffffffff81114850>] ? __lock_acquired+0x1c0/0x210
[12140.623131]  [<ffffffff810ec66d>] default_wake_function+0xd/0x10
[12140.623131]  [<ffffffff810d7208>] autoremove_wake_function+0x18/0x40
[12140.623131]  [<ffffffff810e11e2>] __wake_up_common+0x52/0x90
[12140.623131]  [<ffffffff810e200d>] ? __wake_up+0x2d/0x70
[12140.623131]  [<ffffffff810e2023>] __wake_up+0x43/0x70
[12140.623131]  [<ffffffff8107cb07>] apf_task_wake_one+0x87/0x90
[12140.623131]  [<ffffffff8107cdf5>] kvm_async_pf_task_wake+0x75/0x130
[12140.623131]  [<ffffffff8107d1e6>] do_async_page_fault+0x86/0xa0
[12140.623131]  [<ffffffff82657a55>] async_page_fault+0x25/0x30
[12140.623131]  [<ffffffff8107d626>] ? native_safe_halt+0x6/0x10
[12140.623131]  [<ffffffff81116fed>] ? trace_hardirqs_on+0xd/0x10
[12140.623131]  [<ffffffff8105857d>] default_idle+0x4d/0xa0
[12140.623131]  [<ffffffff810582af>] cpu_idle+0x11f/0x180
[12140.623131]  [<ffffffff8264b9e0>] ? setup_APIC_timer+0x88/0x8c
[12140.623131]  [<ffffffff8264b004>] start_secondary+0xe1/0xe8
Signature · 1 line
Sasha.