Skip to contentSkip to conversation

New: vCPUs >= 64 can't be online and hotplugged in some scenarios

Bug 210213 [email protected] 1 participant 1 message Nov 16, 2020 KVM

lore
Share & tools
lore
#0 lore raw

https://bugzilla.kernel.org/show_bug.cgi?id=210213

            Bug ID: 210213
           Summary: vCPUs >= 64 can't be online and hotplugged in some
                    scenarios
           Product: Virtualization
           Version: unspecified
    Kernel Version: 5.10-rc4
          Hardware: x86-64
                OS: Linux
              Tree: Mainline
            Status: NEW
          Severity: normal
          Priority: P1
         Component: kvm
          Assignee: [email protected]
          Reporter: [email protected]
        Regression: No

Created attachment 293685
--> https://bugzilla.kernel.org/attachment.cgi?id=293685&action=edit
Here is a workaround to fix this issue

In VM, if no-kvmclock-vsyscall is set, lscpu shows online 0-63 vcpus are online vcpus >= 64 are offline and if we attempting to hotplug them, they will return -ENOMEM.
This issue also happened in VM which are on TSC unstable host.
bash-14295 [040] .... 64209.953702: cpuhp_enter: cpu: 0064 target: 199 step:
64 (kvmclock_setup_percpu)

            bash-14295 [040] .... 64209.953702: cpuhp_exit:  cpu: 0064  state: 

64 step: 64 ret: -12
----------------------------

[root@iZwz9208df47apaoyvbmm3Z processor]# cat /sys/kernel/debug/tracing/trace # tracer: nop
#
# entries-in-buffer/entries-written: 166/166 #P:49
#
# _-----=> irqs-off
# / _----=> need-resched

#                            | / _---=> hardirq/softirq
#                            || / _--=> preempt-depth
#                            ||| /     delay
#           TASK-PID   CPU#  ||||    TIMESTAMP  FUNCTION
#              | |       |   ||||       |         |
            bash-14295 [040] .... 64209.953675: cpuhp_enter: cpu: 0064 target:
199 step:   1 (smpboot_create_threads)
            bash-14295 [040] .... 64209.953676: cpuhp_exit:  cpu: 0064  state: 
 1 step:   1 ret: 0
            bash-14295 [040] .... 64209.953676: cpuhp_enter: cpu: 0064 target:
199 step:   2 (perf_event_init_cpu)
            bash-14295 [040] .... 64209.953677: cpuhp_exit:  cpu: 0064  state: 
 2 step:   2 ret: 0
            bash-14295 [040] .... 64209.953678: cpuhp_enter: cpu: 0064 target:
199 step:  35 (workqueue_prepare_cpu)
            bash-14295 [040] .... 64209.953678: cpuhp_exit:  cpu: 0064  state: 
35 step:  35 ret: 0
            bash-14295 [040] .... 64209.953678: cpuhp_enter: cpu: 0064 target:
199 step:  37 (hrtimers_prepare_cpu)
            bash-14295 [040] .... 64209.953679: cpuhp_exit:  cpu: 0064  state: 
37 step:  37 ret: 0
            bash-14295 [040] .... 64209.953679: cpuhp_enter: cpu: 0064 target:
199 step:  40 (smpcfd_prepare_cpu)
            bash-14295 [040] .... 64209.953692: cpuhp_exit:  cpu: 0064  state: 
40 step:  40 ret: 0
            bash-14295 [040] .... 64209.953693: cpuhp_enter: cpu: 0064 target:
199 step:  41 (relay_prepare_cpu)
            bash-14295 [040] .... 64209.953693: cpuhp_exit:  cpu: 0064  state: 
41 step:  41 ret: 0
            bash-14295 [040] .... 64209.953693: cpuhp_enter: cpu: 0064 target:
199 step:  44 (rcutree_prepare_cpu)
            bash-14295 [040] .... 64209.953694: cpuhp_exit:  cpu: 0064  state: 
44 step:  44 ret: 0
            bash-14295 [040] .... 64209.953694: cpuhp_enter: cpu: 0064 target:
199 step:  53 (topology_add_dev)
            bash-14295 [040] .... 64209.953699: cpuhp_exit:  cpu: 0064  state: 
53 step:  53 ret: 0
            bash-14295 [040] .... 64209.953700: cpuhp_multi_enter: cpu: 0064
target: 199 step:  56 (trace_rb_cpu_prepare)
            bash-14295 [040] .... 64209.953700: cpuhp_exit:  cpu: 0064  state: 
56 step:  56 ret: 0
            bash-14295 [040] .... 64209.953700: cpuhp_multi_enter: cpu: 0064
target: 199 step:  56 (trace_rb_cpu_prepare)
            bash-14295 [040] .... 64209.953700: cpuhp_exit:  cpu: 0064  state: 
56 step:  56 ret: 0
            bash-14295 [040] .... 64209.953701: cpuhp_multi_enter: cpu: 0064
target: 199 step:  56 (trace_rb_cpu_prepare)
            bash-14295 [040] .... 64209.953701: cpuhp_exit:  cpu: 0064  state: 
56 step:  56 ret: 0
            bash-14295 [040] .... 64209.953701: cpuhp_enter: cpu: 0064 target:
199 step:  62 (timers_prepare_cpu)
            bash-14295 [040] .... 64209.953701: cpuhp_exit:  cpu: 0064  state: 
62 step:  62 ret: 0
            bash-14295 [040] .... 64209.953702: cpuhp_enter: cpu: 0064 target:
199 step:  64 (kvmclock_setup_percpu)
            bash-14295 [040] .... 64209.953702: cpuhp_exit:  cpu: 0064  state: 

64 step: 64 ret: -12

Signature · 2 lines
You are receiving this mail because:
You are watching the assignee of the bug.