Skip to contentSkip to conversation

KVM: arm64: Unregister HYP sections from kmemleak in protected mode

PATCH In review Marc Zyngier 3 participants 4 messages Jul 29, 2021 – Aug 2, 2021

Subsystems (4)
lore
Share & tools
lore

Marc Zyngier

author maintainer
#0 lore raw

PATCH 1/1 KVM: arm64: Unregister HYP sections from kmemleak in protected mode

Booting a KVM host in protected mode with kmemleak quickly results in a pretty bad crash, as kmemleak doesn't know that the HYP sections have been taken away.

Make the unregistration from kmemleak part of marking the sections as HYP-private. The rest of the HYP-specific data is obtained via the page allocator, which is not subjected to kmemleak.

Fixes 90134ac9cabb ("KVM: arm64: Protect the .hyp sections from the host")
Cc Quentin Perret <[email protected]>
Cc Catalin Marinas <[email protected]>
---
 arch/arm64/kvm/arm.c | 7 ++++++-
 1 file changed, 6 insertions(+), 1 deletion(-)
arch/arm64/kvm/arm.c +6 -1
index e9a2b8f27792..23f12e602878 100644
@@ -15,6 +15,7 @@
 #include <linux/fs.h>
 #include <linux/mman.h>
 #include <linux/sched.h>
+#include <linux/kmemleak.h>
 #include <linux/kvm.h>
 #include <linux/kvm_irqfd.h>
 #include <linux/irqbypass.h>
@@ -1960,8 +1961,12 @@ static inline int pkvm_mark_hyp(phys_addr_t start, phys_addr_t end)
 }
 
 #define pkvm_mark_hyp_section(__section)		\
+({							\
+	u64 sz = __section##_end - __section##_start;	\
+	kmemleak_free_part(__section##_start, sz);	\
 	pkvm_mark_hyp(__pa_symbol(__section##_start),	\
-			__pa_symbol(__section##_end))
+		      __pa_symbol(__section##_end));	\
+})
 
 static int finalize_hyp_mode(void)
 {
Signature · 1 line
2.30.2
Reviewed-by on v1 1/1
#1 lore raw
Quoted 30 lines · Marc Zyngier

Booting a KVM host in protected mode with kmemleak quickly results in a pretty bad crash, as kmemleak doesn't know that the HYP sections have been taken away.

Make the unregistration from kmemleak part of marking the sections as HYP-private. The rest of the HYP-specific data is obtained via the page allocator, which is not subjected to kmemleak.

Fixes 90134ac9cabb ("KVM: arm64: Protect the .hyp sections from the host")
Cc Quentin Perret <[email protected]>
Cc Catalin Marinas <[email protected]>
---
 arch/arm64/kvm/arm.c | 7 ++++++-
 1 file changed, 6 insertions(+), 1 deletion(-)
arch/arm64/kvm/arm.c +1 -0
index e9a2b8f27792..23f12e602878 100644
@@ -15,6 +15,7 @@
 #include <linux/fs.h>
 #include <linux/mman.h>
 #include <linux/sched.h>
+#include <linux/kmemleak.h>
 #include <linux/kvm.h>
 #include <linux/kvm_irqfd.h>
 #include <linux/irqbypass.h>

arch/arm64/kvm/arm.c static inline int pkvm_mark_hyp(phys_addr_t start, phys_addr_t end) · line 1969

Quoted 10 lines
arch/arm64/kvm/arm.c +5 -1
@@ -1960,8 +1961,12 @@ static inline int pkvm_mark_hyp(phys_addr_t start, phys_addr_t end)
 }
 
 #define pkvm_mark_hyp_section(__section)		\
+({							\
+	u64 sz = __section##_end - __section##_start;	\
+	kmemleak_free_part(__section##_start, sz);	\
 	pkvm_mark_hyp(__pa_symbol(__section##_start),	\
-			__pa_symbol(__section##_end))
+		      __pa_symbol(__section##_end));	\
+})

At some point we should also look into unmapping these sections from EL1 stage-1 as well, as that should lead to better error messages in case the host accesses hyp-private memory some other way. But this patch makes sense on its own, so:

Thanks,
Quentin
_______________________________________________
kvmarm mailing list
[email protected]
https://lists.cs.columbia.edu/mailman/listinfo/kvmarm

maintainer
#2 lore raw
In reply to Marc Zyngier
Quoted 30 lines · Marc Zyngier

Booting a KVM host in protected mode with kmemleak quickly results in a pretty bad crash, as kmemleak doesn't know that the HYP sections have been taken away.

Make the unregistration from kmemleak part of marking the sections as HYP-private. The rest of the HYP-specific data is obtained via the page allocator, which is not subjected to kmemleak.

Fixes 90134ac9cabb ("KVM: arm64: Protect the .hyp sections from the host")
Cc Quentin Perret <[email protected]>
Cc Catalin Marinas <[email protected]>
---
 arch/arm64/kvm/arm.c | 7 ++++++-
 1 file changed, 6 insertions(+), 1 deletion(-)
arch/arm64/kvm/arm.c +1 -0
index e9a2b8f27792..23f12e602878 100644
@@ -15,6 +15,7 @@
 #include <linux/fs.h>
 #include <linux/mman.h>
 #include <linux/sched.h>
+#include <linux/kmemleak.h>
 #include <linux/kvm.h>
 #include <linux/kvm_irqfd.h>
 #include <linux/irqbypass.h>

arch/arm64/kvm/arm.c static inline int pkvm_mark_hyp(phys_addr_t start, phys_addr_t end) · line 1969

Quoted 10 lines
arch/arm64/kvm/arm.c +5 -1
@@ -1960,8 +1961,12 @@ static inline int pkvm_mark_hyp(phys_addr_t start, phys_addr_t end)
 }
 
 #define pkvm_mark_hyp_section(__section)		\
+({							\
+	u64 sz = __section##_end - __section##_start;	\
+	kmemleak_free_part(__section##_start, sz);	\
 	pkvm_mark_hyp(__pa_symbol(__section##_start),	\
-			__pa_symbol(__section##_end))
+		      __pa_symbol(__section##_end));	\
+})

Using kmemleak_free_part() is fine in principle as this is not a slab object. However, the above would call the function even for ranges that are not tracked at all by kmemleak (text, idmap). Luckily Kmemleak won't complain, unless you #define DEBUG in the file (initially I tried to warn all the time but I couldn't fix all the callbacks).

If it was just the BSS, I would move the kmemleak_free_part() call to finalize_hyp_mode() but there's the __hyp_rodata section as well.

I think we have some inconsistency with .hyp.rodata which falls under _sdata.._edata while the kernel's own .rodata goes immediately after _etext. Should we move __hyp_rodata outside _sdata.._edata as well? It would benefit from the RO NX marking (probably more useful without the protected mode). If this works, we'd only need to call kmemleak once for the BSS.

Signature · 1 line
Catalin
author maintainer
#3 lore raw
Quoted 34 lines · Catalin Marinas
Quoted 32 lines · Marc Zyngier

Booting a KVM host in protected mode with kmemleak quickly results in a pretty bad crash, as kmemleak doesn't know that the HYP sections have been taken away.

Make the unregistration from kmemleak part of marking the sections as HYP-private. The rest of the HYP-specific data is obtained via the page allocator, which is not subjected to kmemleak.

Fixes 90134ac9cabb ("KVM: arm64: Protect the .hyp sections from the host")
Cc Quentin Perret <[email protected]>
Cc Catalin Marinas <[email protected]>
---
 arch/arm64/kvm/arm.c | 7 ++++++-
 1 file changed, 6 insertions(+), 1 deletion(-)
arch/arm64/kvm/arm.c +1 -0
index e9a2b8f27792..23f12e602878 100644
@@ -15,6 +15,7 @@
 #include <linux/fs.h>
 #include <linux/mman.h>
 #include <linux/sched.h>
+#include <linux/kmemleak.h>
 #include <linux/kvm.h>
 #include <linux/kvm_irqfd.h>
 #include <linux/irqbypass.h>
@@ -1960,8 +1961,12 @@ static inline int pkvm_mark_hyp(phys_addr_t start, phys_addr_t end)
 }
 
Quoted 14 lines

arch/arm64/kvm/arm.c static inline int pkvm_mark_hyp(phys_addr_t start, phys_addr_t end) · line 1969

Quoted 8 lines
arch/arm64/kvm/arm.c +5 -1
 #define pkvm_mark_hyp_section(__section)		\
+({							\
+	u64 sz = __section##_end - __section##_start;	\
+	kmemleak_free_part(__section##_start, sz);	\
 	pkvm_mark_hyp(__pa_symbol(__section##_start),	\
-			__pa_symbol(__section##_end))
+		      __pa_symbol(__section##_end));	\
+})

Using kmemleak_free_part() is fine in principle as this is not a slab object. However, the above would call the function even for ranges that are not tracked at all by kmemleak (text, idmap). Luckily Kmemleak won't complain, unless you #define DEBUG in the file (initially I tried to warn all the time but I couldn't fix all the callbacks).

Yeah, I had a look last week, and this fires everywhere (KVM only adds a drop in an ocean of warnings).

Quoted 9 lines

If it was just the BSS, I would move the kmemleak_free_part() call to finalize_hyp_mode() but there's the __hyp_rodata section as well.

I think we have some inconsistency with .hyp.rodata which falls under _sdata.._edata while the kernel's own .rodata goes immediately after _etext. Should we move __hyp_rodata outside _sdata.._edata as well? It would benefit from the RO NX marking (probably more useful without the protected mode). If this works, we'd only need to call kmemleak once for the BSS.

That's a good idea, and pretty easy to implement. I'll post a respin shortly.

Thanks,

	M.
Signature · 1 line
Without deviation from the norm, progress is not possible.