Skip to contentSkip to conversation

x86/efistub: disable paging at mixed mode entry

PATCH In review Ard Biesheuvel 3 participants 6 messages Dec 23, 2019 – Dec 24, 2019

Subsystems (2)
lore
Share & tools
lore

Ard Biesheuvel

author maintainer
#0 lore raw

PATCH 1/1 x86/efistub: disable paging at mixed mode entry

The EFI mixed mode entry code goes through the ordinary startup_32() routine before jumping into the kernel's EFI boot code in 64-bit mode. The 32-bit startup code must be entered with paging disabled, but this is not documented as a requirement for the EFI handover protocol, and so we should disable paging explicitly when entering the kernel from 32-bit EFI firmware.

---
 arch/x86/boot/compressed/head_64.S | 5 +++++
 1 file changed, 5 insertions(+)
arch/x86/boot/compressed/head_64.S +5 -0
index 58a512e33d8d..ee60b81944a7 100644
@@ -244,6 +244,11 @@ SYM_FUNC_START(efi32_stub_entry)
 	leal	efi32_config(%ebp), %eax
 	movl	%eax, efi_config(%ebp)
 
+	/* Disable paging */
+	movl	%cr0, %eax
+	btrl	$X86_CR0_PG_BIT, %eax
+	movl	%eax, %cr0
+
 	jmp	startup_32
 SYM_FUNC_END(efi32_stub_entry)
 #endif
Signature · 1 line
2.20.1
#1 lore raw
Quoted 7 lines · Ard Biesheuvel

The EFI mixed mode entry code goes through the ordinary startup_32() routine before jumping into the kernel's EFI boot code in 64-bit mode. The 32-bit startup code must be entered with paging disabled, but this is not documented as a requirement for the EFI handover protocol, and so we should disable paging explicitly when entering the kernel from 32-bit EFI firmware.

Does this mean that EFI is allowed to call the kernel with paging on but the text identity-mapped? Have you seen this happen in practice?

If the kernel is entered with paging on and the text not identity-mapped, this is going to blow up badly.

--Andy

#2 lore raw
Quoted 10 lines · Andy Lutomirski
Quoted 7 lines · Ard Biesheuvel

The EFI mixed mode entry code goes through the ordinary startup_32() routine before jumping into the kernel's EFI boot code in 64-bit mode. The 32-bit startup code must be entered with paging disabled, but this is not documented as a requirement for the EFI handover protocol, and so we should disable paging explicitly when entering the kernel from 32-bit EFI firmware.

Quoted 2 lines

Does this mean that EFI is allowed to call the kernel with paging on but the text identity-mapped?

Yes. This is explicitly mentioned in the spec. Paging may be on or off, but all memory must be mapped 1:1

Quoted 2 lines

Have you seen this happen in practice?

Yes. GRUB and OVMF both implement the EFI handover protocol, but OVMF doesn't disable paging before calling the 32-bit entry point, and so it explodes in startup_32(). GRUB calls the EFI handover entrypoint with paging disabled, and so then everything works fine.

Quoted 3 lines

If the kernel is entered with paging on and the text not identity-mapped, this is going to blow up badly.

Not just text: all of system memory is guaranteed to be 1:1 mapped if paging is on when entering the kernel from EFI, so this should be safe.
Note that this change only affects mixed mode configurations that use OVMF instead of GRUB.

We are using OVMF/qemu in kernelCI for test coverage of the EFI stub for all architectures, and this is the missing puzzle piece to get it working in x86 mixed mode as well.

#3 lore raw
Quoted 39 lines · Ard Biesheuvel
Quoted 10 lines · Andy Lutomirski
Quoted 9 lines · Ard Biesheuvel

The EFI mixed mode entry code goes through the ordinary startup_32() routine before jumping into the kernel's EFI boot code in 64-bit mode. The 32-bit startup code must be entered with paging disabled, but this is not documented as a requirement for the EFI handover protocol, and so we should disable paging explicitly when entering the kernel from 32-bit EFI firmware.

Quoted 2 lines

Does this mean that EFI is allowed to call the kernel with paging on but the text identity-mapped?

Yes. This is explicitly mentioned in the spec. Paging may be on or off, but all memory must be mapped 1:1

Quoted 2 lines

Have you seen this happen in practice?

Yes. GRUB and OVMF both implement the EFI handover protocol, but OVMF doesn't disable paging before calling the 32-bit entry point, and so it explodes in startup_32(). GRUB calls the EFI handover entrypoint with paging disabled, and so then everything works fine.

Quoted 3 lines

If the kernel is entered with paging on and the text not identity-mapped, this is going to blow up badly.

Not just text: all of system memory is guaranteed to be 1:1 mapped if paging is on when entering the kernel from EFI, so this should be safe.
Note that this change only affects mixed mode configurations that use OVMF instead of GRUB.

Quoted 3 lines

We are using OVMF/qemu in kernelCI for test coverage of the EFI stub for all architectures, and this is the missing puzzle piece to get it working in x86 mixed mode as well.

Sounds good to me, then.

I admit to being a bit confused, since I would have sworn that I’ve personally tested mixed mode with OVMF.

#4 lore raw
Quoted 40 lines · Andy Lutomirski
Quoted 40 lines · Ard Biesheuvel
Quoted 10 lines · Andy Lutomirski
Quoted 9 lines · Ard Biesheuvel

The EFI mixed mode entry code goes through the ordinary startup_32() routine before jumping into the kernel's EFI boot code in 64-bit mode. The 32-bit startup code must be entered with paging disabled, but this is not documented as a requirement for the EFI handover protocol, and so we should disable paging explicitly when entering the kernel from 32-bit EFI firmware.

Quoted 2 lines

Does this mean that EFI is allowed to call the kernel with paging on but the text identity-mapped?

Yes. This is explicitly mentioned in the spec. Paging may be on or off, but all memory must be mapped 1:1

Quoted 2 lines

Have you seen this happen in practice?

Yes. GRUB and OVMF both implement the EFI handover protocol, but OVMF doesn't disable paging before calling the 32-bit entry point, and so it explodes in startup_32(). GRUB calls the EFI handover entrypoint with paging disabled, and so then everything works fine.

Quoted 3 lines

If the kernel is entered with paging on and the text not identity-mapped, this is going to blow up badly.

Not just text: all of system memory is guaranteed to be 1:1 mapped if paging is on when entering the kernel from EFI, so this should be safe.
Note that this change only affects mixed mode configurations that use OVMF instead of GRUB.

Quoted 7 lines
Quoted 3 lines

We are using OVMF/qemu in kernelCI for test coverage of the EFI stub for all architectures, and this is the missing puzzle piece to get it working in x86 mixed mode as well.

Sounds good to me, then.

I admit to being a bit confused, since I would have sworn that I’ve personally tested mixed mode with OVMF.

Interesting that you should say that. I thought exactly the same, but after noticing that it didn't work, I went back years testing old kernels and old builds of OVMF, and no combination that I tried would actually work without a change like the one in this patch. This is using both KVM and emulation, so it doesn't seem likely that this is caused by a change in QEMU.

#5 lore raw
Quoted 51 lines · Ard Biesheuvel
Quoted 46 lines · Andy Lutomirski
Quoted 40 lines
Quoted 4 lines · Ard Biesheuvel
Quoted 10 lines · Andy Lutomirski
Quoted 9 lines · Ard Biesheuvel

The EFI mixed mode entry code goes through the ordinary startup_32() routine before jumping into the kernel's EFI boot code in 64-bit mode. The 32-bit startup code must be entered with paging disabled, but this is not documented as a requirement for the EFI handover protocol, and so we should disable paging explicitly when entering the kernel from 32-bit EFI firmware.

Quoted 2 lines

Does this mean that EFI is allowed to call the kernel with paging on but the text identity-mapped?

Yes. This is explicitly mentioned in the spec. Paging may be on or off, but all memory must be mapped 1:1

Quoted 2 lines

Have you seen this happen in practice?

Yes. GRUB and OVMF both implement the EFI handover protocol, but OVMF doesn't disable paging before calling the 32-bit entry point, and so it explodes in startup_32(). GRUB calls the EFI handover entrypoint with paging disabled, and so then everything works fine.

Quoted 3 lines

If the kernel is entered with paging on and the text not identity-mapped, this is going to blow up badly.

Not just text: all of system memory is guaranteed to be 1:1 mapped if paging is on when entering the kernel from EFI, so this should be safe.
Note that this change only affects mixed mode configurations that use OVMF instead of GRUB.

Quoted 3 lines

We are using OVMF/qemu in kernelCI for test coverage of the EFI stub for all architectures, and this is the missing puzzle piece to get it working in x86 mixed mode as well.

Sounds good to me, then.

Quoted 8 lines
Quoted 1 line

I admit to being a bit confused, since I would have sworn that I’ve personally tested mixed mode with OVMF.

Interesting that you should say that. I thought exactly the same, but after noticing that it didn't work, I went back years testing old kernels and old builds of OVMF, and no combination that I tried would actually work without a change like the one in this patch. This is using both KVM and emulation, so it doesn't seem likely that this is caused by a change in QEMU.

It would have been a build from Red Hat or Fedora, possibly a prerelease I got from Peter Jones. And I reproduced a severe bug in the kernel that I had found by inspection, so it wasn’t totally my imagination. Maybe I actually had OVMF chaining to GRUB?

The bug in question was that an NMI hitting EFI code would explode back when EFI mixed mode worked by fiddling with EFER to exit long mode. I think I tested by running perf while reading efivars.

I probably passed -kernel to QEMU while also telling QEMU to use OVMF.

Anyway, it’s okay if this mystery doesn’t get solved.