x86/xen: Make idle tasks reliable
Subsystems (3)
Miroslav Benes
maintainerv3 cover x86/xen: Make idle tasks reliable
The unwinder reports idle tasks' stack on XEN PV as unreliable which complicates things for at least live patching. The two patches in the series try to amend that by using similar approach as non-XEN x86 does.
v2->v3:
- change prototype of asm_cpu_bringup_and_idle()
- replace %_ASM_SP with %rsp and %esp respectively
- fix build for !CONFIG_XEN_PV_SMP
v1->v2:
- call instruction used instead of push+jmp
- initial_stack used directly
v1 https://lore.kernel.org/live-patching/[email protected]/
v2 https://lore.kernel.org/live-patching/[email protected]/
Miroslav Benes (2):
x86/xen: Make the boot CPU idle task reliable x86/xen: Make the secondary CPU idle tasks reliable
arch/x86/xen/smp_pv.c | 3 ++- arch/x86/xen/xen-head.S | 18 ++++++++++++++++-- 2 files changed, 18 insertions(+), 3 deletions(-)
Signature · 1 line
2.25.1
Miroslav Benes
maintainerPATCH v3 1/2 x86/xen: Make the boot CPU idle task reliable
The unwinder reports the boot CPU idle task's stack on XEN PV as unreliable, which affects at least live patching. There are two reasons for this. First, the task does not follow the x86 convention that its stack starts at the offset right below saved pt_regs. It allows the unwinder to easily detect the end of the stack and verify it. Second, startup_xen() function does not store the return address before jumping to xen_start_kernel() which confuses the unwinder.
Amend both issues by moving the starting point of initial stack in startup_xen() and storing the return address before the jump, which is exactly what call instruction does.
--- arch/x86/xen/xen-head.S | 8 ++++++-- 1 file changed, 6 insertions(+), 2 deletions(-)
arch/x86/xen/xen-head.S +6 -2
@@ -35,7 +35,11 @@ SYM_CODE_START(startup_xen) rep __ASM_SIZE(stos) mov %_ASM_SI, xen_start_info - mov $init_thread_union+THREAD_SIZE, %_ASM_SP +#ifdef CONFIG_X86_64 + mov initial_stack(%rip), %rsp +#else + mov pa(initial_stack), %esp +#endif #ifdef CONFIG_X86_64 /* Set up %gs.
@@ -51,7 +55,7 @@ SYM_CODE_START(startup_xen) wrmsr #endif - jmp xen_start_kernel + call xen_start_kernel SYM_CODE_END(startup_xen) __FINIT #endif
Signature · 1 line
2.25.1
Re: [PATCH v3 1/2] x86/xen: Make the boot CPU idle task reliable
Quoted 8 lines · Miroslav Benes
The unwinder reports the boot CPU idle task's stack on XEN PV as unreliable, which affects at least live patching. There are two reasons for this. First, the task does not follow the x86 convention that its stack starts at the offset right below saved
pt_regs. It allows the unwinder to easily detect the end of the stack and verify it. Second,startup_xen()function does not store the return address before jumping toxen_start_kernel()which confuses the unwinder.
Quoted 5 lines
Amend both issues by moving the starting point of initial stack in
startup_xen()and storing the return address before the jump, which is exactly what call instruction does.Signed-off-by Miroslav Benes <[email protected]>
Juergen
Miroslav Benes
maintainerPATCH v3 2/2 x86/xen: Make the secondary CPU idle tasks reliable
In reply to Miroslav BenesThe unwinder reports the secondary CPU idle tasks' stack on XEN PV as unreliable, which affects at least live patching. cpu_initialize_context() sets up the context of the CPU through VCPUOP_initialise hypercall. After it is woken up, the idle task starts in cpu_bringup_and_idle() function and its stack starts at the offset right below pt_regs. The unwinder correctly detects the end of stack there but it is confused by NULL return address in the last frame.
Introduce a wrapper in assembly, which just calls cpu_bringup_and_idle(). The return address is thus pushed on the stack and the wrapper contains the annotation hint for the unwinder regarding the stack state.
--- arch/x86/xen/smp_pv.c | 3 ++- arch/x86/xen/xen-head.S | 10 ++++++++++ 2 files changed, 12 insertions(+), 1 deletion(-)
arch/x86/xen/smp_pv.c +2 -1
@@ -53,6 +53,7 @@ static DEFINE_PER_CPU(struct xen_common_irq, xen_irq_work) = { .irq = -1 }; static DEFINE_PER_CPU(struct xen_common_irq, xen_pmu_irq) = { .irq = -1 };static irqreturn_t xen_irq_work_interrupt (int irq,void *dev_id); +void asm_cpu_bringup_and_idle (void );static void cpu_bringup (void ) {
@@ -309,7 +310,7 @@ cpu_initialize_context(unsigned int cpu, struct task_struct *idle)* pointing just below where pt_regs would be if it were a normal * kernel entry. */ - ctxt->user_regs.eip = (unsigned long )cpu_bringup_and_idle; + ctxt->user_regs.eip = (unsigned long )asm_cpu_bringup_and_idle; ctxt->flags =VGCF_IN_KERNEL ; ctxt->user_regs.eflags =0x1000 ;/* IOPL_RING1 */ ctxt->user_regs.ds = __USER_DS;
arch/x86/xen/xen-head.S +10 -0
@@ -58,6 +58,16 @@ SYM_CODE_START(startup_xen) call xen_start_kernel SYM_CODE_END(startup_xen) __FINIT + +#ifdef CONFIG_XEN_PV_SMP +.pushsection .text +SYM_CODE_START(asm_cpu_bringup_and_idle) + UNWIND_HINT_EMPTY + + call cpu_bringup_and_idle +SYM_CODE_END(asm_cpu_bringup_and_idle) +.popsection +#endif #endif .pushsection .text
Signature · 1 line
2.25.1
Re: [PATCH v3 2/2] x86/xen: Make the secondary CPU idle tasks reliable
Quoted 8 lines · Miroslav Benes
The unwinder reports the secondary CPU idle tasks' stack on XEN PV as unreliable, which affects at least live patching.
cpu_initialize_context()sets up the context of the CPU throughVCPUOP_initialisehypercall. After it is woken up, the idle task starts incpu_bringup_and_idle()function and its stack starts at the offset right belowpt_regs. The unwinder correctly detects the end of stack there but it is confused by NULL return address in the last frame.
Quoted 6 lines
Introduce a wrapper in assembly, which just calls
cpu_bringup_and_idle(). The return address is thus pushed on the stack and the wrapper contains the annotation hint for the unwinder regarding the stack state.Signed-off-by Miroslav Benes <[email protected]>
Juergen