Skip to contentSkip to conversation

KVM: SEV: Enable AMD SEV-ES DebugSwap

PATCH Applied Alexey Kardashevskiy 6 participants 28 messages Jan 20, 2023 – Mar 29, 2023

Subsystems (3)

v3 of 5 Applied Latest is v5 →

lore
Share & tools
lore
#0 lore raw

v3 cover KVM: SEV: Enable AMD SEV-ES DebugSwap

This is to use another AMD SEV-ES hardware assisted register swap, more detail in 2/3. The patches are fairly independend but required in this order.

The previous conversation is here:
https://lore.kernel.org/all/[email protected]/

This is based on sha1
195df42eb64d Ingo Molnar "Merge branch into tip/master: 'x86/platform'" in order to have recently added X86_FEATURE_NO_NESTED_DATA_BP cpu feature.

Please comment. Thanks.

Alexey Kardashevskiy (3):
x86/amd: Cache debug register values in percpu variables
KVM: SEV: Enable data breakpoints in SEV-ES x86/sev: Do not handle #VC for DR7 read/write

 arch/x86/include/asm/debugreg.h        |  9 +++-
 arch/x86/include/asm/msr-index.h       |  1 +
 arch/x86/include/asm/svm.h             |  1 +
 arch/x86/kvm/svm/svm.h                 | 16 +++++--
 tools/arch/x86/include/asm/msr-index.h |  1 +
 arch/x86/kernel/cpu/amd.c              | 47 ++++++++++++++------
 arch/x86/kernel/hw_breakpoint.c        |  4 +-
 arch/x86/kernel/sev.c                  |  6 +++
 arch/x86/kvm/svm/sev.c                 | 29 ++++++++++++
 arch/x86/kvm/svm/svm.c                 |  3 +-
 10 files changed, 94 insertions(+), 23 deletions(-)
Signature · 1 line
2.38.1
#1 lore raw

PATCH v3 1/3 x86/amd: Cache debug register values in percpu variables

Reading DR[0-3]_ADDR_MASK MSRs takes about 250 cycles which is going to be noticeable with the AMD KVM SEV-ES DebugSwap feature enabled. KVM is going to store host's DR[0-3] and DR[0-3]_ADDR_MASK before switching to a guest; the hardware is going to swap these on VMRUN and VMEXIT.

Store MSR values passed to set_dr_addr_mask() in percpu variables (when changed) and return them via new amd_get_dr_addr_mask(). The gain here is about 10x.

As set_dr_addr_mask() uses the array too, change the @dr type to unsigned to avoid checking for <0. And give it the amd_ prefix to match the new helper as the whole DR_ADDR_MASK feature is AMD-specific anyway.

While at it, replace deprecated boot_cpu_has() with cpu_feature_enabled() in set_dr_addr_mask().

---
Changes:
v3:
* fixed commit log
* amd_msr_dr_addr_masks do not do "-1"
* store processor id in a local variable
* s/set_dr_addr_mask/amd_set_dr_addr_mask/

v2:
* reworked to use arrays
* set() skips wrmsr() when the mask is not changed
* added stub for get_dr_addr_mask()
* changed @dr type to unsigned
* s/boot_cpu_has/cpu_feature_enabled/
* added amd_ prefix

---
 arch/x86/include/asm/debugreg.h |  9 +++-
 arch/x86/kernel/cpu/amd.c       | 47 ++++++++++++++------
 arch/x86/kernel/hw_breakpoint.c |  4 +-
 3 files changed, 42 insertions(+), 18 deletions(-)
arch/x86/include/asm/debugreg.h +7 -2
index b049d950612f..f126b2ee890f 100644
@@ -126,9 +126,14 @@ static __always_inline void local_db_restore(unsigned long dr7)
 }
 
 #ifdef CONFIG_CPU_SUP_AMD
-extern void set_dr_addr_mask(unsigned long mask, int dr);
+extern void amd_set_dr_addr_mask(unsigned long mask, unsigned int dr);
+extern unsigned long amd_get_dr_addr_mask(unsigned int dr);
 #else
-static inline void set_dr_addr_mask(unsigned long mask, int dr) { }
+static inline void amd_set_dr_addr_mask(unsigned long mask, unsigned int dr) { }
+static inline unsigned long amd_get_dr_addr_mask(unsigned int dr)
+{
+	return 0;
+}
 #endif
 
 #endif /* _ASM_X86_DEBUGREG_H */
arch/x86/kernel/cpu/amd.c +33 -14

57 lines not on this page · raw message

arch/x86/kernel/hw_breakpoint.c +2 -2
index bbb0f737aab1..b01644c949b2 100644
@@ -127,7 +127,7 @@ int arch_install_hw_breakpoint(struct perf_event *bp)
 
 	set_debugreg(*dr7, 7);
 	if (info->mask)
-		set_dr_addr_mask(info->mask, i);
+		amd_set_dr_addr_mask(info->mask, i);
 
 	return 0;
 }
@@ -166,7 +166,7 @@ void arch_uninstall_hw_breakpoint(struct perf_event *bp)
 
 	set_debugreg(dr7, 7);
 	if (info->mask)
-		set_dr_addr_mask(0, i);
+		amd_set_dr_addr_mask(0, i);
 
 	/*
 	 * Ensure the write to cpu_dr7 is after we've set the DR7 register.
Signature · 1 line
2.38.1
#2 lore raw

[tip: x86/cpu] x86/amd: Cache debug register values in percpu variables

The following commit has been merged into the x86/cpu branch of tip:

The following commit has been merged into the x86/cpu branch of tip:

Commit-ID:     7914695743d598b189d549f2f57af24aa5633705
Gitweb:        https://git.kernel.org/tip/7914695743d598b189d549f2f57af24aa5633705
Author:        Alexey Kardashevskiy <[email protected]>
AuthorDate:    Fri, 20 Jan 2023 14:10:45 +11:00
Committer:     Borislav Petkov (AMD) <[email protected]>
CommitterDate: Tue, 31 Jan 2023 20:09:26 +01:00

x86/amd: Cache debug register values in percpu variables

Reading DR[0-3]_ADDR_MASK MSRs takes about 250 cycles which is going to be noticeable with the AMD KVM SEV-ES DebugSwap feature enabled. KVM is going to store host's DR[0-3] and DR[0-3]_ADDR_MASK before switching to a guest; the hardware is going to swap these on VMRUN and VMEXIT.

Store MSR values passed to set_dr_addr_mask() in percpu variables (when changed) and return them via new amd_get_dr_addr_mask(). The gain here is about 10x.

As set_dr_addr_mask() uses the array too, change the @dr type to unsigned to avoid checking for <0. And give it the amd_ prefix to match the new helper as the whole DR_ADDR_MASK feature is AMD-specific anyway.

While at it, replace deprecated boot_cpu_has() with cpu_feature_enabled() in set_dr_addr_mask().

---
 arch/x86/include/asm/debugreg.h |  9 ++++--
 arch/x86/kernel/cpu/amd.c       | 47 ++++++++++++++++++++++----------
 arch/x86/kernel/hw_breakpoint.c |  4 +--
 3 files changed, 42 insertions(+), 18 deletions(-)
arch/x86/include/asm/debugreg.h +7 -2
index b049d95..f126b2e 100644
@@ -126,9 +126,14 @@ static __always_inline void local_db_restore(unsigned long dr7)
 }
 
 #ifdef CONFIG_CPU_SUP_AMD
-extern void set_dr_addr_mask(unsigned long mask, int dr);
+extern void amd_set_dr_addr_mask(unsigned long mask, unsigned int dr);
+extern unsigned long amd_get_dr_addr_mask(unsigned int dr);
 #else
-static inline void set_dr_addr_mask(unsigned long mask, int dr) { }
+static inline void amd_set_dr_addr_mask(unsigned long mask, unsigned int dr) { }
+static inline unsigned long amd_get_dr_addr_mask(unsigned int dr)
+{
+	return 0;
+}
 #endif
 
 #endif /* _ASM_X86_DEBUGREG_H */
arch/x86/kernel/cpu/amd.c +33 -14

57 lines not on this page · raw message

arch/x86/kernel/hw_breakpoint.c +2 -2
index bbb0f73..b01644c 100644
@@ -127,7 +127,7 @@ int arch_install_hw_breakpoint(struct perf_event *bp)
 
 	set_debugreg(*dr7, 7);
 	if (info->mask)
-		set_dr_addr_mask(info->mask, i);
+		amd_set_dr_addr_mask(info->mask, i);
 
 	return 0;
 }
@@ -166,7 +166,7 @@ void arch_uninstall_hw_breakpoint(struct perf_event *bp)
 
 	set_debugreg(dr7, 7);
 	if (info->mask)
-		set_dr_addr_mask(0, i);
+		amd_set_dr_addr_mask(0, i);
 
 	/*
 	 * Ensure the write to cpu_dr7 is after we've set the DR7 register.
#3 lore raw

PATCH v3 2/3 KVM: SEV: Enable data breakpoints in SEV-ES

In reply to Alexey Kardashevskiy

Prior to SEV-ES, KVM stored/loaded host debug registers upon switching to/from a VM. Changing those registers inside a running SEV VM triggered #VC exit to KVM.

SEV-ES added the encrypted state (ES) which uses an encrypted guest page for the VM state (VMSA). The hardware saves/restores certain registers on VMRUN/VMEXIT according to a swap type (A, B, C), see
"Table B-3. Swap Types" in the AMD Architecture Programmer’s Manual volume 2.

AMD Milan (Fam 19h) introduces support for the debug registers swapping. DR6 and DR7 are always swapped. DR[0-3] and DR[0-3]_ADDR_MASK are swapped a type B when SEV_FEATURES[5] ("DebugSwap") is set.

Enable DebugSwap in VMSA. But only do so if CPUID Fn80000021_EAX[0] ("NoNestedDataBp", "Processor ignores nested data breakpoints") is supported by the SOC as otherwise a malicious SEV-ES guest can set up data breakpoints on the #VC IDT entry/stack and cause an infinite loop.

Eliminate DR7 and #DB intercepts as:
- they are not needed when DebugSwap is supported;
- #VC for these intercepts is most likely not supported anyway and kills the VM.
Keep DR7 intercepted unless DebugSwap enabled to prevent the infinite #DB loop DoS.

---
Changes:
v3:
* rewrote the commit log again
* rebased on tip/master to use recently defined X86_FEATURE_NO_NESTED_DATA_BP
* s/boot_cpu_has/cpu_feature_enabled/

v2:
* debug_swap moved from vcpu to module_param
* rewrote commit log

---
Tested with:
===
int x;
int main(int argc, char *argv[])

{
        x = 1;
        return 0;
}

===
gcc -g a.c
rsync a.out ruby-954vm:~/
ssh -t ruby-954vm 'gdb -ex "file a.out" -ex "watch x" -ex r'

where ruby-954vm is a VM.

With "/sys/module/kvm_amd/parameters/debug_swap = 0", gdb does not stop on the watchpoint, with "= 1" - gdb does.

---
 arch/x86/include/asm/svm.h |  1 +
 arch/x86/kvm/svm/svm.h     | 16 ++++++++---
 arch/x86/kvm/svm/sev.c     | 29 ++++++++++++++++++++
 arch/x86/kvm/svm/svm.c     |  3 +-
 4 files changed, 44 insertions(+), 5 deletions(-)
arch/x86/include/asm/svm.h +1 -0
index cb1ee53ad3b1..665515c7edae 100644
@@ -278,6 +278,7 @@ enum avic_ipi_failure_cause {
 #define AVIC_HPA_MASK	~((0xFFFULL << 52) | 0xFFF)
 #define VMCB_AVIC_APIC_BAR_MASK		0xFFFFFFFFFF000ULL
 
+#define SVM_SEV_FEAT_DEBUG_SWAP                        BIT(5)
 
 struct vmcb_seg {
 	u16 selector;
arch/x86/kvm/svm/svm.h +12 -4
index 4826e6cc611b..61f2cad1cbaf 100644
@@ -389,6 +389,8 @@ static inline bool vmcb12_is_intercept(struct vmcb_ctrl_area_cached *control, u3
 	return test_bit(bit, (unsigned long *)&control->intercepts);
 }
 
+extern bool sev_es_is_debug_swap_enabled(void);
+
 static inline void set_dr_intercepts(struct vcpu_svm *svm)
 {
 	struct vmcb *vmcb = svm->vmcb01.ptr;
@@ -410,8 +412,10 @@ static inline void set_dr_intercepts(struct vcpu_svm *svm)
 		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR6_WRITE);
 	}
 
-	vmcb_set_intercept(&vmcb->control, INTERCEPT_DR7_READ);
-	vmcb_set_intercept(&vmcb->control, INTERCEPT_DR7_WRITE);
+	if (!sev_es_guest(svm->vcpu.kvm) || !sev_es_is_debug_swap_enabled()) {
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR7_READ);
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR7_WRITE);
+	}
 
 	recalc_intercepts(svm);
 }
@@ -422,8 +426,12 @@ static inline void clr_dr_intercepts(struct vcpu_svm *svm)
 
 	vmcb->control.intercepts[INTERCEPT_DR] = 0;
 
-	/* DR7 access must remain intercepted for an SEV-ES guest */
-	if (sev_es_guest(svm->vcpu.kvm)) {
+	/*
+	 * DR7 access must remain intercepted for an SEV-ES guest unless DebugSwap
+	 * (depends on NO_NESTED_DATA_BP) is enabled as otherwise a VM writing to DR7
+	 * from the #DB handler may trigger infinite loop of #DB's.
+	 */
+	if (sev_es_guest(svm->vcpu.kvm) && !sev_es_is_debug_swap_enabled()) {
 		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR7_READ);
 		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR7_WRITE);
 	}
arch/x86/kvm/svm/sev.c +29 -0
index 86d6897f4806..e989a6f4953d 100644
@@ -21,6 +21,7 @@
 #include <asm/pkru.h>
 #include <asm/trapnr.h>
 #include <asm/fpu/xcr.h>
+#include <asm/debugreg.h>
 
 #include "mmu.h"
 #include "x86.h"
@@ -52,11 +53,21 @@ module_param_named(sev, sev_enabled, bool, 0444);
 /* enable/disable SEV-ES support */
 static bool sev_es_enabled = true;
 module_param_named(sev_es, sev_es_enabled, bool, 0444);
+
+/* enable/disable SEV-ES DebugSwap support */
+static bool sev_es_debug_swap_enabled = true;
+module_param_named(debug_swap, sev_es_debug_swap_enabled, bool, 0644);
 #else
 #define sev_enabled false
 #define sev_es_enabled false
+#define sev_es_debug_swap false
 #endif /* CONFIG_KVM_AMD_SEV */
 
+bool sev_es_is_debug_swap_enabled(void)
+{
+	return sev_es_debug_swap_enabled;
+}
+
 static u8 sev_enc_bit;
 static DECLARE_RWSEM(sev_deactivate_lock);
 static DEFINE_MUTEX(sev_bitmap_lock);
@@ -604,6 +615,9 @@ static int sev_es_sync_vmsa(struct vcpu_svm *svm)
 	save->xss  = svm->vcpu.arch.ia32_xss;
 	save->dr6  = svm->vcpu.arch.dr6;
 
+	if (sev_es_is_debug_swap_enabled())
+		save->sev_features |= SVM_SEV_FEAT_DEBUG_SWAP;
+
 	pr_debug("Virtual Machine Save Area (VMSA):\n");
 	print_hex_dump_debug("", DUMP_PREFIX_NONE, 16, 1, save, sizeof(*save), false);
 
@@ -2249,6 +2263,9 @@ void __init sev_hardware_setup(void)
 out:
 	sev_enabled = sev_supported;
 	sev_es_enabled = sev_es_supported;
+	if (sev_es_debug_swap_enabled)
+		sev_es_debug_swap_enabled = sev_es_enabled &&
+			cpu_feature_enabled(X86_FEATURE_NO_NESTED_DATA_BP);
 #endif
 }
 
@@ -3027,6 +3044,18 @@ void sev_es_prepare_switch_to_guest(struct sev_es_save_area *hostsa)
 
 	/* MSR_IA32_XSS is restored on VMEXIT, save the currnet host value */
 	hostsa->xss = host_xss;
+
+	/* The DebugSwap SEV feature does Type B swaps of DR[0-3] */
+	if (sev_es_is_debug_swap_enabled()) {
+		hostsa->dr0 = native_get_debugreg(0);
+		hostsa->dr1 = native_get_debugreg(1);
+		hostsa->dr2 = native_get_debugreg(2);
+		hostsa->dr3 = native_get_debugreg(3);
+		hostsa->dr0_addr_mask = amd_get_dr_addr_mask(0);
+		hostsa->dr1_addr_mask = amd_get_dr_addr_mask(1);
+		hostsa->dr2_addr_mask = amd_get_dr_addr_mask(2);
+		hostsa->dr3_addr_mask = amd_get_dr_addr_mask(3);
+	}
 }
 
 void sev_vcpu_deliver_sipi_vector(struct kvm_vcpu *vcpu, u8 vector)
arch/x86/kvm/svm/svm.c +2 -1
index 60c7c880266b..6c54a3c9d442 100644
@@ -1190,7 +1190,8 @@ static void init_vmcb(struct kvm_vcpu *vcpu)
 	set_exception_intercept(svm, UD_VECTOR);
 	set_exception_intercept(svm, MC_VECTOR);
 	set_exception_intercept(svm, AC_VECTOR);
-	set_exception_intercept(svm, DB_VECTOR);
+	if (!sev_es_is_debug_swap_enabled())
+		set_exception_intercept(svm, DB_VECTOR);
 	/*
 	 * Guest access to VMware backdoor ports could legitimately
 	 * trigger #GP because of TSS I/O permission bitmap.
Signature · 1 line
2.38.1
maintainer
#4 lore raw

Re: [PATCH kernel v3 2/3] KVM: SEV: Enable data breakpoints in SEV-ES

Hey Sean,

Quoted 19 lines · Alexey Kardashevskiy

Prior to SEV-ES, KVM stored/loaded host debug registers upon switching to/from a VM. Changing those registers inside a running SEV VM triggered #VC exit to KVM.

SEV-ES added the encrypted state (ES) which uses an encrypted guest page for the VM state (VMSA). The hardware saves/restores certain registers on VMRUN/VMEXIT according to a swap type (A, B, C), see
"Table B-3. Swap Types" in the AMD Architecture Programmer’s Manual volume 2.

AMD Milan (Fam 19h) introduces support for the debug registers swapping. DR6 and DR7 are always swapped. DR[0-3] and DR[0-3]_ADDR_MASK are swapped a type B when SEV_FEATURES[5] ("DebugSwap") is set.

Enable DebugSwap in VMSA. But only do so if CPUID Fn80000021_EAX[0] ("NoNestedDataBp", "Processor ignores nested data breakpoints") is supported by the SOC as otherwise a malicious SEV-ES guest can set up data breakpoints on the #VC IDT entry/stack and cause an infinite loop.

Quoted 6 lines

Eliminate DR7 and #DB intercepts as:
- they are not needed when DebugSwap is supported;
- #VC for these intercepts is most likely not supported anyway and kills the VM.
Keep DR7 intercepted unless DebugSwap enabled to prevent the infinite #DB loop DoS.

...

ok to take this through the tip tree?

Thx.

Signature · 4 lines
Regards/Gruss,
    Boris.

https://people.kernel.org/tglx/notes-about-netiquette
#5 lore raw

Re: [PATCH kernel v3 2/3] KVM: SEV: Enable data breakpoints in SEV-ES

Quoted 29 lines · Borislav Petkov

Hey Sean,

Quoted 19 lines · Alexey Kardashevskiy

Prior to SEV-ES, KVM stored/loaded host debug registers upon switching to/from a VM. Changing those registers inside a running SEV VM triggered #VC exit to KVM.

SEV-ES added the encrypted state (ES) which uses an encrypted guest page for the VM state (VMSA). The hardware saves/restores certain registers on VMRUN/VMEXIT according to a swap type (A, B, C), see
"Table B-3. Swap Types" in the AMD Architecture Programmer’s Manual volume 2.

AMD Milan (Fam 19h) introduces support for the debug registers swapping. DR6 and DR7 are always swapped. DR[0-3] and DR[0-3]_ADDR_MASK are swapped a type B when SEV_FEATURES[5] ("DebugSwap") is set.

Enable DebugSwap in VMSA. But only do so if CPUID Fn80000021_EAX[0] ("NoNestedDataBp", "Processor ignores nested data breakpoints") is supported by the SOC as otherwise a malicious SEV-ES guest can set up data breakpoints on the #VC IDT entry/stack and cause an infinite loop.

Quoted 6 lines

Eliminate DR7 and #DB intercepts as:
- they are not needed when DebugSwap is supported;
- #VC for these intercepts is most likely not supported anyway and kills the VM.
Keep DR7 intercepted unless DebugSwap enabled to prevent the infinite #DB loop DoS.

Quoted 3 lines

...

ok to take this through the tip tree?

I would prefer to take this through KVM, there's enough subtle complexity in this code that it'd be nice to have it close by.

If you're happy with patch 1, maybe ack that one and take it through KVM, and route patch 3 through tip?

#6 lore raw

Re: [PATCH kernel v3 2/3] KVM: SEV: Enable data breakpoints in SEV-ES

Quoted 32 lines · Sean Christopherson
Quoted 31 lines · Borislav Petkov

Hey Sean,

Quoted 25 lines · Alexey Kardashevskiy

Prior to SEV-ES, KVM stored/loaded host debug registers upon switching to/from a VM. Changing those registers inside a running SEV VM triggered #VC exit to KVM.

SEV-ES added the encrypted state (ES) which uses an encrypted guest page for the VM state (VMSA). The hardware saves/restores certain registers on VMRUN/VMEXIT according to a swap type (A, B, C), see
"Table B-3. Swap Types" in the AMD Architecture Programmer’s Manual volume 2.

AMD Milan (Fam 19h) introduces support for the debug registers swapping. DR6 and DR7 are always swapped. DR[0-3] and DR[0-3]_ADDR_MASK are swapped a type B when SEV_FEATURES[5] ("DebugSwap") is set.

Enable DebugSwap in VMSA. But only do so if CPUID Fn80000021_EAX[0] ("NoNestedDataBp", "Processor ignores nested data breakpoints") is supported by the SOC as otherwise a malicious SEV-ES guest can set up data breakpoints on the #VC IDT entry/stack and cause an infinite loop.

Eliminate DR7 and #DB intercepts as:
- they are not needed when DebugSwap is supported;
- #VC for these intercepts is most likely not supported anyway and kills the VM.
Keep DR7 intercepted unless DebugSwap enabled to prevent the infinite #DB loop DoS.

...

Quoted 7 lines
Quoted 1 line

ok to take this through the tip tree?

I would prefer to take this through KVM, there's enough subtle complexity in this code that it'd be nice to have it close by.

If you're happy with patch 1, maybe ack that one and take it through KVM, and route patch 3 through tip?

Ah, you've already applied 1. That works too. I don't think KVM support for DebugSwap is going to make v6.3 no matter who takes what, so just base on the next version of this patch on tip/x86/cpu and I'll make a mental note to not try to grab this until after v6.3-rc1.

maintainer
#7 lore raw

Re: [PATCH kernel v3 2/3] KVM: SEV: Enable data breakpoints in SEV-ES

Quoted 4 lines · Sean Christopherson

Ah, you've already applied 1. That works too. I don't think KVM support for DebugSwap is going to make v6.3 no matter who takes what, so just base on the next version of this patch on tip/x86/cpu and I'll make a mental note to not try to grab this until after v6.3-rc1.

Yeah, I was thinking the same thing, seeing how you guys are swamped with stuff. (Who isn't?! ;-\). So yeah, let's do that and if there's change of plans, just ping me.

Thx.

Signature · 4 lines
Regards/Gruss,
    Boris.

https://people.kernel.org/tglx/notes-about-netiquette
#8 lore raw

Re: [PATCH kernel v3 2/3] KVM: SEV: Enable data breakpoints in SEV-ES

In reply to Alexey Kardashevskiy
Quoted 14 lines · Alexey Kardashevskiy
arch/x86/kvm/svm/svm.h +2 -0
index 4826e6cc611b..61f2cad1cbaf 100644
@@ -389,6 +389,8 @@ static inline bool vmcb12_is_intercept(struct vmcb_ctrl_area_cached *control, u3
 	return test_bit(bit, (unsigned long *)&control->intercepts);
 }
 
+extern bool sev_es_is_debug_swap_enabled(void);
+
 static inline void set_dr_intercepts(struct vcpu_svm *svm)
 {
 	struct vmcb *vmcb = svm->vmcb01.ptr;

arch/x86/kvm/svm/svm.h static inline void set_dr_intercepts(struct vcpu_svm *svm) · line 415

Quoted 6 lines
arch/x86/kvm/svm/svm.h +1 -2
@@ -410,8 +412,10 @@ static inline void set_dr_intercepts(struct vcpu_svm *svm)
 		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR6_WRITE);
 	}
 
-	vmcb_set_intercept(&vmcb->control, INTERCEPT_DR7_READ);
-	vmcb_set_intercept(&vmcb->control, INTERCEPT_DR7_WRITE);
+	if (!sev_es_guest(svm->vcpu.kvm) || !sev_es_is_debug_swap_enabled()) {

Looking below, doesn't this do the wrong thing if set_dr_intercepts() is called before SVM_SEV_FEAT_DEBUG_SWAP is set? I.e. when this is called before LAUNCH_UPDATE? Seems like this should check SVM_SEV_FEAT_DEBUG_SWAP in sev_features regardless of when SVM_SEV_FEAT_DEBUG_SWAP is set.

And if KVM checks sev_features, then I _think_ we can avoid having to expose sev_es_debug_swap_enabled to svm.{c,h} (though why on earth {set,clr}_dr_intercepts() is in svm.h is another question for the future).

Follow-up question: does KVM _have_ to wait until KVM_SEV_LAUNCH_UPDATE_VMSA to set the flag?

Quoted 23 lines
arch/x86/kvm/svm/svm.h +9 -2
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR7_READ);
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR7_WRITE);
+	}
 
 	recalc_intercepts(svm);
 }
@@ -422,8 +426,12 @@ static inline void clr_dr_intercepts(struct vcpu_svm *svm)
 
 	vmcb->control.intercepts[INTERCEPT_DR] = 0;
 
-	/* DR7 access must remain intercepted for an SEV-ES guest */
-	if (sev_es_guest(svm->vcpu.kvm)) {
+	/*
+	 * DR7 access must remain intercepted for an SEV-ES guest unless DebugSwap
+	 * (depends on NO_NESTED_DATA_BP) is enabled as otherwise a VM writing to DR7
+	 * from the #DB handler may trigger infinite loop of #DB's.
+	 */
+	if (sev_es_guest(svm->vcpu.kvm) && !sev_es_is_debug_swap_enabled()) {
 		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR7_READ);
 		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR7_WRITE);
 	}

arch/x86/kvm/svm/svm.h module_param_named(sev, sev_enabled, bool, 0444); · line 59

Quoted 7 lines
arch/x86/kvm/svm/svm.h +4 -0
@@ -52,11 +53,21 @@ module_param_named(sev, sev_enabled, bool, 0444);
 /* enable/disable SEV-ES support */
 static bool sev_es_enabled = true;
 module_param_named(sev_es, sev_es_enabled, bool, 0444);
+
+/* enable/disable SEV-ES DebugSwap support */
+static bool sev_es_debug_swap_enabled = true;
+module_param_named(debug_swap, sev_es_debug_swap_enabled, bool, 0644);

Module param needs 0444 permissions, i.e. shouldn't be writable after KVM is loaded. Though I don't know that providing a module param is warranted in this case. KVM provides module params for SEV and SEV-ES because there are legitimate reasons to turn them off, but at a glance, I don't see why we'd want that for this feature.

arch/x86/kvm/svm/svm.h module_param_named(sev, sev_enabled, bool, 0444); · line 63

Quoted 4 lines
arch/x86/kvm/svm/svm.h +1 -0
 #else
 #define sev_enabled false
 #define sev_es_enabled false
+#define sev_es_debug_swap false

This needs to be sev_es_debug_swap_enabled, otherwise things fall apart with CONFIG_KVM_AMD_SEV=n.

arch/x86/kvm/svm/sev.c: In function ‘sev_es_is_debug_swap_enabled’:
arch/x86/kvm/svm/sev.c:69:16: error: ‘sev_es_debug_swap_enabled’ undeclared (first use in this function); did you mean ‘sev_es_is_debug_swap_enabled’?

   69 |         return sev_es_debug_swap_enabled;
      |                ^~~~~~~~~~~~~~~~~~~~~~~~~
      |                sev_es_is_debug_swap_enabled
Quoted 6 lines
arch/x86/kvm/svm/svm.h +4 -0
 #endif /* CONFIG_KVM_AMD_SEV */
 
+bool sev_es_is_debug_swap_enabled(void)
+{
+	return sev_es_debug_swap_enabled;
+}

...

Quoted 11 lines
arch/x86/kvm/svm/svm.h +3 -0
@@ -604,6 +615,9 @@ static int sev_es_sync_vmsa(struct vcpu_svm *svm)
 	save->xss  = svm->vcpu.arch.ia32_xss;
 	save->dr6  = svm->vcpu.arch.dr6;
 
+	if (sev_es_is_debug_swap_enabled())
+		save->sev_features |= SVM_SEV_FEAT_DEBUG_SWAP;
+
 	pr_debug("Virtual Machine Save Area (VMSA):\n");
 	print_hex_dump_debug("", DUMP_PREFIX_NONE, 16, 1, save, sizeof(*save), false);
 

arch/x86/kvm/svm/svm.h void __init sev_hardware_setup(void) · line 2268

Quoted 6 lines
arch/x86/kvm/svm/svm.h +3 -0
@@ -2249,6 +2263,9 @@ void __init sev_hardware_setup(void)
 out:
 	sev_enabled = sev_supported;
 	sev_es_enabled = sev_es_supported;
+	if (sev_es_debug_swap_enabled)
+		sev_es_debug_swap_enabled = sev_es_enabled &&
+			cpu_feature_enabled(X86_FEATURE_NO_NESTED_DATA_BP);

Slight preference for:

	if (!sev_es_enabled || !cpu_feature_enabled(X86_FEATURE_NO_NESTED_DATA_BP))
		sev_es_debug_swap_enabled = false;

KVM does short-circuit some checks on module param values, but usually only to avoid additional setup.

Quoted 27 lines
arch/x86/kvm/svm/svm.h +12 -0
 #endif
 }
 
@@ -3027,6 +3044,18 @@ void sev_es_prepare_switch_to_guest(struct sev_es_save_area *hostsa)
 
 	/* MSR_IA32_XSS is restored on VMEXIT, save the currnet host value */
 	hostsa->xss = host_xss;
+
+	/* The DebugSwap SEV feature does Type B swaps of DR[0-3] */
+	if (sev_es_is_debug_swap_enabled()) {
+		hostsa->dr0 = native_get_debugreg(0);
+		hostsa->dr1 = native_get_debugreg(1);
+		hostsa->dr2 = native_get_debugreg(2);
+		hostsa->dr3 = native_get_debugreg(3);
+		hostsa->dr0_addr_mask = amd_get_dr_addr_mask(0);
+		hostsa->dr1_addr_mask = amd_get_dr_addr_mask(1);
+		hostsa->dr2_addr_mask = amd_get_dr_addr_mask(2);
+		hostsa->dr3_addr_mask = amd_get_dr_addr_mask(3);
+	}
 }
 
 void sev_vcpu_deliver_sipi_vector(struct kvm_vcpu *vcpu, u8 vector)
arch/x86/kvm/svm/svm.c +0 -0
index 60c7c880266b..6c54a3c9d442 100644

arch/x86/kvm/svm/svm.c static void init_vmcb(struct kvm_vcpu *vcpu) · line 1194

Quoted 6 lines
arch/x86/kvm/svm/svm.c +2 -1
@@ -1190,7 +1190,8 @@ static void init_vmcb(struct kvm_vcpu *vcpu)
 	set_exception_intercept(svm, UD_VECTOR);
 	set_exception_intercept(svm, MC_VECTOR);
 	set_exception_intercept(svm, AC_VECTOR);
-	set_exception_intercept(svm, DB_VECTOR);
+	if (!sev_es_is_debug_swap_enabled())
+		set_exception_intercept(svm, DB_VECTOR);

This is wrong. KVM needs to intercept #DBs when debugging non-SEV-ES VMs. This _could_ be tied to X86_FEATURE_NO_NESTED_DATA_BP, but the KVM would need to toggle the intercept depending on whether or not userspace wants to debug the guest.

Similar to the DR7 interception, can this check sev_features directly?

#9 lore raw

Re: [PATCH kernel v3 2/3] KVM: SEV: Enable data breakpoints in SEV-ES

Quoted 27 lines · Sean Christopherson
Quoted 14 lines · Alexey Kardashevskiy
arch/x86/kvm/svm/svm.h +2 -0
index 4826e6cc611b..61f2cad1cbaf 100644
@@ -389,6 +389,8 @@ static inline bool vmcb12_is_intercept(struct vmcb_ctrl_area_cached *control, u3
  	return test_bit(bit, (unsigned long *)&control->intercepts);
  }
 
+extern bool sev_es_is_debug_swap_enabled(void);
+
  static inline void set_dr_intercepts(struct vcpu_svm *svm)
  {
  	struct vmcb *vmcb = svm->vmcb01.ptr;

arch/x86/kvm/svm/svm.h static inline void set_dr_intercepts(struct vcpu_svm *svm) · line 415

Quoted 6 lines
arch/x86/kvm/svm/svm.h +1 -2
@@ -410,8 +412,10 @@ static inline void set_dr_intercepts(struct vcpu_svm *svm)
  		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR6_WRITE);
  	}
 
-	vmcb_set_intercept(&vmcb->control, INTERCEPT_DR7_READ);
-	vmcb_set_intercept(&vmcb->control, INTERCEPT_DR7_WRITE);
+	if (!sev_es_guest(svm->vcpu.kvm) || !sev_es_is_debug_swap_enabled()) {

Looking below, doesn't this do the wrong thing if set_dr_intercepts() is called before SVM_SEV_FEAT_DEBUG_SWAP is set? I.e. when this is called before LAUNCH_UPDATE? Seems like this should check SVM_SEV_FEAT_DEBUG_SWAP in sev_features regardless of when SVM_SEV_FEAT_DEBUG_SWAP is set.

Quoted 3 lines

And if KVM checks sev_features, then I _think_ we can avoid having to expose sev_es_debug_swap_enabled to svm.{c,h} (though why on earth {set,clr}_dr_intercepts() is in svm.h is another question for the future).

883b0a91f41a ("KVM: SVM: Move Nested SVM Implementation to nested.c") did that. Makes sense for things like vmcb_set_intercept() but {set,clr}_dr_intercepts() are still only called from svm.c so I'll move them there (btw do I need a separate patch for that? usually yes)

Quoted 3 lines

Follow-up question: does KVM _have_ to wait until KVM_SEV_LAUNCH_UPDATE_VMSA to set the flag?

Nope. Will repost soon as a reply to this mail.

Quoted 35 lines
Quoted 23 lines
arch/x86/kvm/svm/svm.h +9 -2
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR7_READ);
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR7_WRITE);
+	}
 
  	recalc_intercepts(svm);
  }
@@ -422,8 +426,12 @@ static inline void clr_dr_intercepts(struct vcpu_svm *svm)
 
  	vmcb->control.intercepts[INTERCEPT_DR] = 0;
 
-	/* DR7 access must remain intercepted for an SEV-ES guest */
-	if (sev_es_guest(svm->vcpu.kvm)) {
+	/*
+	 * DR7 access must remain intercepted for an SEV-ES guest unless DebugSwap
+	 * (depends on NO_NESTED_DATA_BP) is enabled as otherwise a VM writing to DR7
+	 * from the #DB handler may trigger infinite loop of #DB's.
+	 */
+	if (sev_es_guest(svm->vcpu.kvm) && !sev_es_is_debug_swap_enabled()) {
  		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR7_READ);
  		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR7_WRITE);
  	}

arch/x86/kvm/svm/svm.h module_param_named(sev, sev_enabled, bool, 0444); · line 59

Quoted 7 lines
arch/x86/kvm/svm/svm.h +4 -0
@@ -52,11 +53,21 @@ module_param_named(sev, sev_enabled, bool, 0444);
  /* enable/disable SEV-ES support */
  static bool sev_es_enabled = true;
  module_param_named(sev_es, sev_es_enabled, bool, 0444);
+
+/* enable/disable SEV-ES DebugSwap support */
+static bool sev_es_debug_swap_enabled = true;
+module_param_named(debug_swap, sev_es_debug_swap_enabled, bool, 0644);

Module param needs 0444 permissions, i.e. shouldn't be writable after KVM is loaded. Though I don't know that providing a module param is warranted in this case.

Quoted 3 lines

KVM provides module params for SEV and SEV-ES because there are legitimate reasons to turn them off, but at a glance, I don't see why we'd want that for this feature.

/me confused. You suggested this in the first place for (I think) for the case if the feature is found to be broken later on so admins can disable it.

And I was using it to verify "x86/debug: Fix stack recursion caused by DR7 accesses" which is convenient but it is a minor thing.

Quoted 71 lines

arch/x86/kvm/svm/svm.h module_param_named(sev, sev_enabled, bool, 0444); · line 63

Quoted 4 lines
arch/x86/kvm/svm/svm.h +1 -0
  #else
  #define sev_enabled false
  #define sev_es_enabled false
+#define sev_es_debug_swap false

This needs to be sev_es_debug_swap_enabled, otherwise things fall apart with CONFIG_KVM_AMD_SEV=n.

arch/x86/kvm/svm/sev.c: In function ‘sev_es_is_debug_swap_enabled’:
arch/x86/kvm/svm/sev.c:69:16: error: ‘sev_es_debug_swap_enabled’ undeclared (first use in this function); did you mean ‘sev_es_is_debug_swap_enabled’?

    69 |         return sev_es_debug_swap_enabled;
       |                ^~~~~~~~~~~~~~~~~~~~~~~~~
       |                sev_es_is_debug_swap_enabled
Quoted 6 lines
arch/x86/kvm/svm/svm.h +4 -0
  #endif /* CONFIG_KVM_AMD_SEV */
 
+bool sev_es_is_debug_swap_enabled(void)
+{
+	return sev_es_debug_swap_enabled;
+}

...

Quoted 11 lines
arch/x86/kvm/svm/svm.h +3 -0
@@ -604,6 +615,9 @@ static int sev_es_sync_vmsa(struct vcpu_svm *svm)
  	save->xss  = svm->vcpu.arch.ia32_xss;
  	save->dr6  = svm->vcpu.arch.dr6;
 
+	if (sev_es_is_debug_swap_enabled())
+		save->sev_features |= SVM_SEV_FEAT_DEBUG_SWAP;
+
  	pr_debug("Virtual Machine Save Area (VMSA):\n");
  	print_hex_dump_debug("", DUMP_PREFIX_NONE, 16, 1, save, sizeof(*save), false);
 

arch/x86/kvm/svm/svm.h void __init sev_hardware_setup(void) · line 2268

Quoted 6 lines
arch/x86/kvm/svm/svm.h +3 -0
@@ -2249,6 +2263,9 @@ void __init sev_hardware_setup(void)
  out:
  	sev_enabled = sev_supported;
  	sev_es_enabled = sev_es_supported;
+	if (sev_es_debug_swap_enabled)
+		sev_es_debug_swap_enabled = sev_es_enabled &&
+			cpu_feature_enabled(X86_FEATURE_NO_NESTED_DATA_BP);

Slight preference for:

	if (!sev_es_enabled || !cpu_feature_enabled(X86_FEATURE_NO_NESTED_DATA_BP))
		sev_es_debug_swap_enabled = false;

KVM does short-circuit some checks on module param values, but usually only to avoid additional setup.

Quoted 21 lines
arch/x86/kvm/svm/svm.h +12 -0
  #endif
  }
 
@@ -3027,6 +3044,18 @@ void sev_es_prepare_switch_to_guest(struct sev_es_save_area *hostsa)
 
  	/* MSR_IA32_XSS is restored on VMEXIT, save the currnet host value */
  	hostsa->xss = host_xss;
+
+	/* The DebugSwap SEV feature does Type B swaps of DR[0-3] */
+	if (sev_es_is_debug_swap_enabled()) {
+		hostsa->dr0 = native_get_debugreg(0);
+		hostsa->dr1 = native_get_debugreg(1);
+		hostsa->dr2 = native_get_debugreg(2);
+		hostsa->dr3 = native_get_debugreg(3);
+		hostsa->dr0_addr_mask = amd_get_dr_addr_mask(0);
+		hostsa->dr1_addr_mask = amd_get_dr_addr_mask(1);
+		hostsa->dr2_addr_mask = amd_get_dr_addr_mask(2);
+		hostsa->dr3_addr_mask = amd_get_dr_addr_mask(3);
+	}
  }
 
Quoted 14 lines

arch/x86/kvm/svm/svm.c static void init_vmcb(struct kvm_vcpu *vcpu) · line 1194

Quoted 12 lines
arch/x86/kvm/svm/svm.h +0 -0
  void sev_vcpu_deliver_sipi_vector(struct kvm_vcpu *vcpu, u8 vector)
arch/x86/kvm/svm/svm.c +2 -1
index 60c7c880266b..6c54a3c9d442 100644
@@ -1190,7 +1190,8 @@ static void init_vmcb(struct kvm_vcpu *vcpu)
  	set_exception_intercept(svm, UD_VECTOR);
  	set_exception_intercept(svm, MC_VECTOR);
  	set_exception_intercept(svm, AC_VECTOR);
-	set_exception_intercept(svm, DB_VECTOR);
+	if (!sev_es_is_debug_swap_enabled())
+		set_exception_intercept(svm, DB_VECTOR);

This is wrong. KVM needs to intercept #DBs when debugging non-SEV-ES VMs.

Sorry, not following. The #DB intercept for non-SEV-ES is enabled here. Thanks,

Quoted 5 lines

This _could_ be tied to X86_FEATURE_NO_NESTED_DATA_BP, but the KVM would need to toggle the intercept depending on whether or not userspace wants to debug the guest.

Similar to the DR7 interception, can this check sev_features directly?

Signature · 1 line
Alexey
#10 lore raw

PATCH v4 1/1 KVM: SEV: Enable data breakpoints in SEV-ES

Prior to SEV-ES, KVM stored/loaded host debug registers upon switching to/from a VM. Changing those registers inside a running SEV VM triggered #VC exit to KVM.

SEV-ES added the encrypted state (ES) which uses an encrypted guest page for the VM state (VMSA). The hardware saves/restores certain registers on VMRUN/VMEXIT according to a swap type (A, B, C), see
"Table B-3. Swap Types" in the AMD Architecture Programmer’s Manual volume 2.

AMD Milan (Fam 19h) introduces support for the debug registers swapping. DR6 and DR7 are always swapped. DR[0-3] and DR[0-3]_ADDR_MASK are swapped a type B when SEV_FEATURES[5] ("DebugSwap") is set.

Enable DebugSwap in VMSA. But only do so if CPUID Fn80000021_EAX[0] ("NoNestedDataBp", "Processor ignores nested data breakpoints") is supported by the SOC as otherwise a malicious SEV-ES guest can set up data breakpoints on the #VC IDT entry/stack and cause an infinite loop.

Eliminate DR7 and #DB intercepts as:
- they are not needed when DebugSwap is supported;
- #VC for these intercepts is most likely not supported anyway and kills the VM.
Keep DR7 intercepted unless DebugSwap enabled to prevent the infinite #DB loop DoS.

While at this, move set_/clr_dr_intercepts to .c and move #DB intercept next to DR7 intercept.

---
Changes:
v4:
* removed sev_es_is_debug_swap_enabled() helper
* made sev_es_debug_swap_enabled (module param) static
* set sev_feature early in sev_es_init_vmcb() and made intercepts dependend on it vs. module param
* move set_/clr_dr_intercepts to .c

v3:
* rewrote the commit log again
* rebased on tip/master to use recently defined X86_FEATURE_NO_NESTED_DATA_BP
* s/boot_cpu_has/cpu_feature_enabled/

v2:
* debug_swap moved from vcpu to module_param
* rewrote commit log

---
Tested with:
===
int x;
int main(int argc, char *argv[])

{
        x = 1;
        return 0;
}

===
gcc -g a.c
rsync a.out ruby-954vm:~/
ssh -t ruby-954vm 'gdb -ex "file a.out" -ex "watch x" -ex r'

where ruby-954vm is a VM.

With "/sys/module/kvm_amd/parameters/debug_swap = 0", gdb does not stop on the watchpoint, with "= 1" - gdb does.

---
 arch/x86/include/asm/svm.h |  1 +
 arch/x86/kvm/svm/svm.h     | 42 -------------
 arch/x86/kvm/svm/sev.c     | 24 ++++++++
 arch/x86/kvm/svm/svm.c     | 65 +++++++++++++++++++-
 4 files changed, 87 insertions(+), 45 deletions(-)
arch/x86/include/asm/svm.h +1 -0
index cb1ee53ad3b1..665515c7edae 100644
@@ -278,6 +278,7 @@ enum avic_ipi_failure_cause {
 #define AVIC_HPA_MASK	~((0xFFFULL << 52) | 0xFFF)
 #define VMCB_AVIC_APIC_BAR_MASK		0xFFFFFFFFFF000ULL
 
+#define SVM_SEV_FEAT_DEBUG_SWAP                        BIT(5)
 
 struct vmcb_seg {
 	u16 selector;
arch/x86/kvm/svm/svm.h +0 -42

48 lines not on this page · raw message

arch/x86/kvm/svm/sev.c +24 -0
index 86d6897f4806..af775410c5eb 100644
@@ -21,6 +21,7 @@
 #include <asm/pkru.h>
 #include <asm/trapnr.h>
 #include <asm/fpu/xcr.h>
+#include <asm/debugreg.h>
 
 #include "mmu.h"
 #include "x86.h"
@@ -52,9 +53,14 @@ module_param_named(sev, sev_enabled, bool, 0444);
 /* enable/disable SEV-ES support */
 static bool sev_es_enabled = true;
 module_param_named(sev_es, sev_es_enabled, bool, 0444);
+
+/* enable/disable SEV-ES DebugSwap support */
+static bool sev_es_debug_swap_enabled = true;
+module_param_named(debug_swap, sev_es_debug_swap_enabled, bool, 0644);
 #else
 #define sev_enabled false
 #define sev_es_enabled false
+#define sev_es_debug_swap false
 #endif /* CONFIG_KVM_AMD_SEV */
 
 static u8 sev_enc_bit;
@@ -2249,6 +2255,8 @@ void __init sev_hardware_setup(void)
 out:
 	sev_enabled = sev_supported;
 	sev_es_enabled = sev_es_supported;
+	if (!sev_es_enabled || !cpu_feature_enabled(X86_FEATURE_NO_NESTED_DATA_BP))
+		sev_es_debug_swap_enabled = false;
 #endif
 }
 
@@ -2940,6 +2948,7 @@ int sev_es_string_io(struct vcpu_svm *svm, int size, unsigned int port, int in)
 static void sev_es_init_vmcb(struct vcpu_svm *svm)
 {
 	struct kvm_vcpu *vcpu = &svm->vcpu;
+	struct sev_es_save_area *save = svm->sev_es.vmsa;
 
 	svm->vmcb->control.nested_ctl |= SVM_NESTED_CTL_SEV_ES_ENABLE;
 	svm->vmcb->control.virt_ext |= LBR_CTL_ENABLE_MASK;
@@ -2988,6 +2997,9 @@ static void sev_es_init_vmcb(struct vcpu_svm *svm)
 		if (guest_cpuid_has(&svm->vcpu, X86_FEATURE_RDTSCP))
 			svm_clr_intercept(svm, INTERCEPT_RDTSCP);
 	}
+
+	if (sev_es_debug_swap_enabled)
+		save->sev_features |= SVM_SEV_FEAT_DEBUG_SWAP;
 }
 
 void sev_init_vmcb(struct vcpu_svm *svm)
@@ -3027,6 +3039,18 @@ void sev_es_prepare_switch_to_guest(struct sev_es_save_area *hostsa)
 
 	/* MSR_IA32_XSS is restored on VMEXIT, save the currnet host value */
 	hostsa->xss = host_xss;
+
+	/* The DebugSwap SEV feature does Type B swaps of DR[0-3] */
+	if (sev_es_debug_swap_enabled) {
+		hostsa->dr0 = native_get_debugreg(0);
+		hostsa->dr1 = native_get_debugreg(1);
+		hostsa->dr2 = native_get_debugreg(2);
+		hostsa->dr3 = native_get_debugreg(3);
+		hostsa->dr0_addr_mask = amd_get_dr_addr_mask(0);
+		hostsa->dr1_addr_mask = amd_get_dr_addr_mask(1);
+		hostsa->dr2_addr_mask = amd_get_dr_addr_mask(2);
+		hostsa->dr3_addr_mask = amd_get_dr_addr_mask(3);
+	}
 }
 
 void sev_vcpu_deliver_sipi_vector(struct kvm_vcpu *vcpu, u8 vector)
arch/x86/kvm/svm/svm.c +62 -3

87 lines not on this page · raw message

Signature · 1 line
2.39.1
#11 lore raw

Re: [PATCH kernel v4] KVM: SEV: Enable data breakpoints in SEV-ES

Ping? Thanks,

Quoted 305 lines · Alexey Kardashevskiy

Prior to SEV-ES, KVM stored/loaded host debug registers upon switching to/from a VM. Changing those registers inside a running SEV VM triggered #VC exit to KVM.

SEV-ES added the encrypted state (ES) which uses an encrypted guest page for the VM state (VMSA). The hardware saves/restores certain registers on VMRUN/VMEXIT according to a swap type (A, B, C), see
"Table B-3. Swap Types" in the AMD Architecture Programmer’s Manual volume 2.

AMD Milan (Fam 19h) introduces support for the debug registers swapping. DR6 and DR7 are always swapped. DR[0-3] and DR[0-3]_ADDR_MASK are swapped a type B when SEV_FEATURES[5] ("DebugSwap") is set.

Enable DebugSwap in VMSA. But only do so if CPUID Fn80000021_EAX[0] ("NoNestedDataBp", "Processor ignores nested data breakpoints") is supported by the SOC as otherwise a malicious SEV-ES guest can set up data breakpoints on the #VC IDT entry/stack and cause an infinite loop.

Eliminate DR7 and #DB intercepts as:
- they are not needed when DebugSwap is supported;
- #VC for these intercepts is most likely not supported anyway and kills the VM.
Keep DR7 intercepted unless DebugSwap enabled to prevent the infinite #DB loop DoS.

While at this, move set_/clr_dr_intercepts to .c and move #DB intercept next to DR7 intercept.

---
Changes:
v4:
* removed sev_es_is_debug_swap_enabled() helper
* made sev_es_debug_swap_enabled (module param) static
* set sev_feature early in sev_es_init_vmcb() and made intercepts dependend on it vs. module param
* move set_/clr_dr_intercepts to .c

v3:
* rewrote the commit log again
* rebased on tip/master to use recently defined X86_FEATURE_NO_NESTED_DATA_BP
* s/boot_cpu_has/cpu_feature_enabled/

v2:
* debug_swap moved from vcpu to module_param
* rewrote commit log

---
Tested with:
===
int x;
int main(int argc, char *argv[])

{
         x = 1;
         return 0;
}

===
gcc -g a.c
rsync a.out ruby-954vm:~/
ssh -t ruby-954vm 'gdb -ex "file a.out" -ex "watch x" -ex r'

where ruby-954vm is a VM.

With "/sys/module/kvm_amd/parameters/debug_swap = 0", gdb does not stop on the watchpoint, with "= 1" - gdb does.

---
  arch/x86/include/asm/svm.h |  1 +
  arch/x86/kvm/svm/svm.h     | 42 -------------
  arch/x86/kvm/svm/sev.c     | 24 ++++++++
  arch/x86/kvm/svm/svm.c     | 65 +++++++++++++++++++-
  4 files changed, 87 insertions(+), 45 deletions(-)
arch/x86/include/asm/svm.h +1 -0
index cb1ee53ad3b1..665515c7edae 100644
@@ -278,6 +278,7 @@ enum avic_ipi_failure_cause {
  #define AVIC_HPA_MASK	~((0xFFFULL << 52) | 0xFFF)
  #define VMCB_AVIC_APIC_BAR_MASK		0xFFFFFFFFFF000ULL
 
+#define SVM_SEV_FEAT_DEBUG_SWAP                        BIT(5)
 
  struct vmcb_seg {
  	u16 selector;
arch/x86/kvm/svm/svm.h +0 -42
index 4826e6cc611b..653fd09929df 100644
@@ -389,48 +389,6 @@ static inline bool vmcb12_is_intercept(struct vmcb_ctrl_area_cached *control, u3
  	return test_bit(bit, (unsigned long *)&control->intercepts);
  }
 
-static inline void set_dr_intercepts(struct vcpu_svm *svm)
-{
-	struct vmcb *vmcb = svm->vmcb01.ptr;
-
-	if (!sev_es_guest(svm->vcpu.kvm)) {
-		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR0_READ);
-		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR1_READ);
-		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR2_READ);
-		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR3_READ);
-		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR4_READ);
-		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR5_READ);
-		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR6_READ);
-		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR0_WRITE);
-		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR1_WRITE);
-		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR2_WRITE);
-		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR3_WRITE);
-		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR4_WRITE);
-		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR5_WRITE);
-		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR6_WRITE);
-	}
-
-	vmcb_set_intercept(&vmcb->control, INTERCEPT_DR7_READ);
-	vmcb_set_intercept(&vmcb->control, INTERCEPT_DR7_WRITE);
-
-	recalc_intercepts(svm);
-}
-
-static inline void clr_dr_intercepts(struct vcpu_svm *svm)
-{
-	struct vmcb *vmcb = svm->vmcb01.ptr;
-
-	vmcb->control.intercepts[INTERCEPT_DR] = 0;
-
-	/* DR7 access must remain intercepted for an SEV-ES guest */
-	if (sev_es_guest(svm->vcpu.kvm)) {
-		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR7_READ);
-		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR7_WRITE);
-	}
-
-	recalc_intercepts(svm);
-}
-
  static inline void set_exception_intercept(struct vcpu_svm *svm, u32 bit)
  {
  	struct vmcb *vmcb = svm->vmcb01.ptr;
arch/x86/kvm/svm/sev.c +24 -0
index 86d6897f4806..af775410c5eb 100644
@@ -21,6 +21,7 @@
  #include <asm/pkru.h>
  #include <asm/trapnr.h>
  #include <asm/fpu/xcr.h>
+#include <asm/debugreg.h>
 
  #include "mmu.h"
  #include "x86.h"
@@ -52,9 +53,14 @@ module_param_named(sev, sev_enabled, bool, 0444);
  /* enable/disable SEV-ES support */
  static bool sev_es_enabled = true;
  module_param_named(sev_es, sev_es_enabled, bool, 0444);
+
+/* enable/disable SEV-ES DebugSwap support */
+static bool sev_es_debug_swap_enabled = true;
+module_param_named(debug_swap, sev_es_debug_swap_enabled, bool, 0644);
  #else
  #define sev_enabled false
  #define sev_es_enabled false
+#define sev_es_debug_swap false
  #endif /* CONFIG_KVM_AMD_SEV */
 
  static u8 sev_enc_bit;
@@ -2249,6 +2255,8 @@ void __init sev_hardware_setup(void)
  out:
  	sev_enabled = sev_supported;
  	sev_es_enabled = sev_es_supported;
+	if (!sev_es_enabled || !cpu_feature_enabled(X86_FEATURE_NO_NESTED_DATA_BP))
+		sev_es_debug_swap_enabled = false;
  #endif
  }
 
@@ -2940,6 +2948,7 @@ int sev_es_string_io(struct vcpu_svm *svm, int size, unsigned int port, int in)
  static void sev_es_init_vmcb(struct vcpu_svm *svm)
  {
  	struct kvm_vcpu *vcpu = &svm->vcpu;
+	struct sev_es_save_area *save = svm->sev_es.vmsa;
 
  	svm->vmcb->control.nested_ctl |= SVM_NESTED_CTL_SEV_ES_ENABLE;
  	svm->vmcb->control.virt_ext |= LBR_CTL_ENABLE_MASK;
@@ -2988,6 +2997,9 @@ static void sev_es_init_vmcb(struct vcpu_svm *svm)
  		if (guest_cpuid_has(&svm->vcpu, X86_FEATURE_RDTSCP))
  			svm_clr_intercept(svm, INTERCEPT_RDTSCP);
  	}
+
+	if (sev_es_debug_swap_enabled)
+		save->sev_features |= SVM_SEV_FEAT_DEBUG_SWAP;
  }
 
  void sev_init_vmcb(struct vcpu_svm *svm)
@@ -3027,6 +3039,18 @@ void sev_es_prepare_switch_to_guest(struct sev_es_save_area *hostsa)
 
  	/* MSR_IA32_XSS is restored on VMEXIT, save the currnet host value */
  	hostsa->xss = host_xss;
+
+	/* The DebugSwap SEV feature does Type B swaps of DR[0-3] */
+	if (sev_es_debug_swap_enabled) {
+		hostsa->dr0 = native_get_debugreg(0);
+		hostsa->dr1 = native_get_debugreg(1);
+		hostsa->dr2 = native_get_debugreg(2);
+		hostsa->dr3 = native_get_debugreg(3);
+		hostsa->dr0_addr_mask = amd_get_dr_addr_mask(0);
+		hostsa->dr1_addr_mask = amd_get_dr_addr_mask(1);
+		hostsa->dr2_addr_mask = amd_get_dr_addr_mask(2);
+		hostsa->dr3_addr_mask = amd_get_dr_addr_mask(3);
+	}
  }
 
  void sev_vcpu_deliver_sipi_vector(struct kvm_vcpu *vcpu, u8 vector)
arch/x86/kvm/svm/svm.c +62 -3
index 60c7c880266b..f8e222bee22a 100644
@@ -671,6 +671,65 @@ static int svm_cpu_init(int cpu)
 
  }
 
+static void set_dr_intercepts(struct vcpu_svm *svm)
+{
+	struct vmcb *vmcb = svm->vmcb01.ptr;
+	bool intercept;
+
+	if (!sev_es_guest(svm->vcpu.kvm)) {
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR0_READ);
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR1_READ);
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR2_READ);
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR3_READ);
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR4_READ);
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR5_READ);
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR6_READ);
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR0_WRITE);
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR1_WRITE);
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR2_WRITE);
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR3_WRITE);
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR4_WRITE);
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR5_WRITE);
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR6_WRITE);
+	}
+
+	if (sev_es_guest(svm->vcpu.kvm)) {
+		struct sev_es_save_area *save = svm->sev_es.vmsa;
+
+		intercept = !(save->sev_features & SVM_SEV_FEAT_DEBUG_SWAP);
+	} else {
+		intercept = true;
+	}
+
+	if (intercept) {
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR7_READ);
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR7_WRITE);
+		set_exception_intercept(svm, DB_VECTOR);
+	}
+
+	recalc_intercepts(svm);
+}
+
+static void clr_dr_intercepts(struct vcpu_svm *svm)
+{
+	struct vmcb *vmcb = svm->vmcb01.ptr;
+	struct sev_es_save_area *save = svm->sev_es.vmsa;
+
+	vmcb->control.intercepts[INTERCEPT_DR] = 0;
+
+	/*
+	 * DR7 access must remain intercepted for an SEV-ES guest unless DebugSwap
+	 * (depends on NO_NESTED_DATA_BP) is enabled as otherwise a VM writing to DR7
+	 * from the #DB handler may trigger infinite loop of #DB's.
+	 */
+	if (sev_es_guest(svm->vcpu.kvm) && (save->sev_features & SVM_SEV_FEAT_DEBUG_SWAP)) {
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR7_READ);
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR7_WRITE);
+	}
+
+	recalc_intercepts(svm);
+}
+
  static int direct_access_msr_slot(u32 msr)
  {
  	u32 i;
@@ -1184,13 +1243,11 @@ static void init_vmcb(struct kvm_vcpu *vcpu)
  	if (!kvm_vcpu_apicv_active(vcpu))
  		svm_set_intercept(svm, INTERCEPT_CR8_WRITE);
 
-	set_dr_intercepts(svm);
-
  	set_exception_intercept(svm, PF_VECTOR);
  	set_exception_intercept(svm, UD_VECTOR);
  	set_exception_intercept(svm, MC_VECTOR);
  	set_exception_intercept(svm, AC_VECTOR);
-	set_exception_intercept(svm, DB_VECTOR);
+
  	/*
  	 * Guest access to VMware backdoor ports could legitimately
  	 * trigger #GP because of TSS I/O permission bitmap.
@@ -1308,6 +1365,8 @@ static void init_vmcb(struct kvm_vcpu *vcpu)
  	if (sev_guest(vcpu->kvm))
  		sev_init_vmcb(svm);
 
+	set_dr_intercepts(svm);
+
  	svm_hv_init_vmcb(vmcb);
  	init_vmcb_after_set_cpuid(vcpu);
 
Signature · 1 line
Alexey
#12 lore raw

Re: [PATCH kernel v4] KVM: SEV: Enable data breakpoints in SEV-ES

Ping? Thanks,

Quoted 301 lines · Alexey Kardashevskiy

Ping? Thanks,

Quoted 297 lines · Alexey Kardashevskiy

Prior to SEV-ES, KVM stored/loaded host debug registers upon switching to/from a VM. Changing those registers inside a running SEV VM triggered #VC exit to KVM.

SEV-ES added the encrypted state (ES) which uses an encrypted guest page for the VM state (VMSA). The hardware saves/restores certain registers on VMRUN/VMEXIT according to a swap type (A, B, C), see
"Table B-3. Swap Types" in the AMD Architecture Programmer’s Manual volume 2.

AMD Milan (Fam 19h) introduces support for the debug registers swapping. DR6 and DR7 are always swapped. DR[0-3] and DR[0-3]_ADDR_MASK are swapped a type B when SEV_FEATURES[5] ("DebugSwap") is set.

Enable DebugSwap in VMSA. But only do so if CPUID Fn80000021_EAX[0] ("NoNestedDataBp", "Processor ignores nested data breakpoints") is supported by the SOC as otherwise a malicious SEV-ES guest can set up data breakpoints on the #VC IDT entry/stack and cause an infinite loop.

Eliminate DR7 and #DB intercepts as:
- they are not needed when DebugSwap is supported;
- #VC for these intercepts is most likely not supported anyway and kills the VM.
Keep DR7 intercepted unless DebugSwap enabled to prevent the infinite #DB loop DoS.

While at this, move set_/clr_dr_intercepts to .c and move #DB intercept next to DR7 intercept.

---
Changes:
v4:
* removed sev_es_is_debug_swap_enabled() helper
* made sev_es_debug_swap_enabled (module param) static
* set sev_feature early in sev_es_init_vmcb() and made intercepts dependend on it vs. module param
* move set_/clr_dr_intercepts to .c

v3:
* rewrote the commit log again
* rebased on tip/master to use recently defined X86_FEATURE_NO_NESTED_DATA_BP
* s/boot_cpu_has/cpu_feature_enabled/

v2:
* debug_swap moved from vcpu to module_param
* rewrote commit log

---
Tested with:
===
int x;
int main(int argc, char *argv[])
{
         x = 1;
         return 0;
}
===
gcc -g a.c
rsync a.out ruby-954vm:~/
ssh -t ruby-954vm 'gdb -ex "file a.out" -ex "watch x" -ex r'

where ruby-954vm is a VM.

With "/sys/module/kvm_amd/parameters/debug_swap = 0", gdb does not stop on the watchpoint, with "= 1" - gdb does.
---
  arch/x86/include/asm/svm.h |  1 +

  arch/x86/kvm/svm/svm.h     | 42 -------------
  arch/x86/kvm/svm/sev.c     | 24 ++++++++
  arch/x86/kvm/svm/svm.c     | 65 +++++++++++++++++++-
  4 files changed, 87 insertions(+), 45 deletions(-)
arch/x86/include/asm/svm.h +1 -0
index cb1ee53ad3b1..665515c7edae 100644
@@ -278,6 +278,7 @@ enum avic_ipi_failure_cause {
   #define AVIC_HPA_MASK    ~((0xFFFULL << 52) | 0xFFF)
   #define VMCB_AVIC_APIC_BAR_MASK        0xFFFFFFFFFF000ULL
+#define SVM_SEV_FEAT_DEBUG_SWAP                        BIT(5)
   struct vmcb_seg {
       u16 selector;
arch/x86/kvm/svm/svm.h +0 -0
index 4826e6cc611b..653fd09929df 100644
@@ -389,48 +389,6 @@ static inline bool vmcb12_is_intercept(struct 

vmcb_ctrl_area_cached *control, u3
      return test_bit(bit, (unsigned long *)&control->intercepts); }

arch/x86/kvm/svm/svm.h +0 -42
-static inline void set_dr_intercepts(struct vcpu_svm *svm)
-{
-    struct vmcb *vmcb = svm->vmcb01.ptr;
-
-    if (!sev_es_guest(svm->vcpu.kvm)) {
-        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR0_READ);
-        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR1_READ);
-        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR2_READ);
-        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR3_READ);
-        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR4_READ);
-        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR5_READ);
-        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR6_READ);
-        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR0_WRITE);
-        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR1_WRITE);
-        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR2_WRITE);
-        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR3_WRITE);
-        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR4_WRITE);
-        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR5_WRITE);
-        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR6_WRITE);
-    }
-
-    vmcb_set_intercept(&vmcb->control, INTERCEPT_DR7_READ);
-    vmcb_set_intercept(&vmcb->control, INTERCEPT_DR7_WRITE);
-
-    recalc_intercepts(svm);
-}
-
-static inline void clr_dr_intercepts(struct vcpu_svm *svm)
-{
-    struct vmcb *vmcb = svm->vmcb01.ptr;
-
-    vmcb->control.intercepts[INTERCEPT_DR] = 0;
-
-    /* DR7 access must remain intercepted for an SEV-ES guest */
-    if (sev_es_guest(svm->vcpu.kvm)) {
-        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR7_READ);
-        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR7_WRITE);
-    }
-
-    recalc_intercepts(svm);
-}
-

  static inline void set_exception_intercept(struct vcpu_svm *svm, u32 bit) {
      struct vmcb *vmcb = svm->vmcb01.ptr;

arch/x86/kvm/svm/sev.c +6 -0
index 86d6897f4806..af775410c5eb 100644
@@ -21,6 +21,7 @@
   #include <asm/pkru.h>
   #include <asm/trapnr.h>
   #include <asm/fpu/xcr.h>
+#include <asm/debugreg.h>
   #include "mmu.h"
   #include "x86.h"
@@ -52,9 +53,14 @@ module_param_named(sev, sev_enabled, bool, 0444);
   /* enable/disable SEV-ES support */
   static bool sev_es_enabled = true;
   module_param_named(sev_es, sev_es_enabled, bool, 0444);
+
+/* enable/disable SEV-ES DebugSwap support */
+static bool sev_es_debug_swap_enabled = true;
+module_param_named(debug_swap, sev_es_debug_swap_enabled, bool, 0644);
   #else
   #define sev_enabled false
   #define sev_es_enabled false
+#define sev_es_debug_swap false
   #endif /* CONFIG_KVM_AMD_SEV */
   static u8 sev_enc_bit;
@@ -2249,6 +2255,8 @@ void __init sev_hardware_setup(void)

  out:
      sev_enabled = sev_supported; sev_es_enabled = sev_es_supported;
+    if (!sev_es_enabled || !cpu_feature_enabled(X86_FEATURE_NO_NESTED_DATA_BP)) +        sev_es_debug_swap_enabled = false; #endif
  }

arch/x86/kvm/svm/sev.c +16 -0
@@ -2940,6 +2948,7 @@ int sev_es_string_io(struct vcpu_svm *svm, int 
 size, unsigned int port, int in)
   static void sev_es_init_vmcb(struct vcpu_svm *svm)
   {
       struct kvm_vcpu *vcpu = &svm->vcpu;
+    struct sev_es_save_area *save = svm->sev_es.vmsa;
       svm->vmcb->control.nested_ctl |= SVM_NESTED_CTL_SEV_ES_ENABLE;
       svm->vmcb->control.virt_ext |= LBR_CTL_ENABLE_MASK;
@@ -2988,6 +2997,9 @@ static void sev_es_init_vmcb(struct vcpu_svm *svm)
           if (guest_cpuid_has(&svm->vcpu, X86_FEATURE_RDTSCP))
               svm_clr_intercept(svm, INTERCEPT_RDTSCP);
       }
+
+    if (sev_es_debug_swap_enabled)
+        save->sev_features |= SVM_SEV_FEAT_DEBUG_SWAP;
   }
   void sev_init_vmcb(struct vcpu_svm *svm)
@@ -3027,6 +3039,18 @@ void sev_es_prepare_switch_to_guest(struct 
 sev_es_save_area *hostsa)
       /* MSR_IA32_XSS is restored on VMEXIT, save the currnet host value */
       hostsa->xss = host_xss;
+
+    /* The DebugSwap SEV feature does Type B swaps of DR[0-3] */
+    if (sev_es_debug_swap_enabled) {
+        hostsa->dr0 = native_get_debugreg(0);
+        hostsa->dr1 = native_get_debugreg(1);
+        hostsa->dr2 = native_get_debugreg(2);
+        hostsa->dr3 = native_get_debugreg(3);
+        hostsa->dr0_addr_mask = amd_get_dr_addr_mask(0);
+        hostsa->dr1_addr_mask = amd_get_dr_addr_mask(1);
+        hostsa->dr2_addr_mask = amd_get_dr_addr_mask(2);
+        hostsa->dr3_addr_mask = amd_get_dr_addr_mask(3);
+    }
   }
   void sev_vcpu_deliver_sipi_vector(struct kvm_vcpu *vcpu, u8 vector)
arch/x86/kvm/svm/svm.c +48 -0
index 60c7c880266b..f8e222bee22a 100644
@@ -671,6 +671,65 @@ static int svm_cpu_init(int cpu)
   }
+static void set_dr_intercepts(struct vcpu_svm *svm)
+{
+    struct vmcb *vmcb = svm->vmcb01.ptr;
+    bool intercept;
+
+    if (!sev_es_guest(svm->vcpu.kvm)) {
+        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR0_READ);
+        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR1_READ);
+        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR2_READ);
+        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR3_READ);
+        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR4_READ);
+        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR5_READ);
+        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR6_READ);
+        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR0_WRITE);
+        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR1_WRITE);
+        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR2_WRITE);
+        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR3_WRITE);
+        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR4_WRITE);
+        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR5_WRITE);
+        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR6_WRITE);
+    }
+
+    if (sev_es_guest(svm->vcpu.kvm)) {
+        struct sev_es_save_area *save = svm->sev_es.vmsa;
+
+        intercept = !(save->sev_features & SVM_SEV_FEAT_DEBUG_SWAP);
+    } else {
+        intercept = true;
+    }
+
+    if (intercept) {
+        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR7_READ);
+        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR7_WRITE);
+        set_exception_intercept(svm, DB_VECTOR);
+    }
+
+    recalc_intercepts(svm);
+}
+
+static void clr_dr_intercepts(struct vcpu_svm *svm)
+{
+    struct vmcb *vmcb = svm->vmcb01.ptr;
+    struct sev_es_save_area *save = svm->sev_es.vmsa;
+
+    vmcb->control.intercepts[INTERCEPT_DR] = 0;
+
+    /*
+     * DR7 access must remain intercepted for an SEV-ES guest unless 

DebugSwap
+     * (depends on NO_NESTED_DATA_BP) is enabled as otherwise a VM writing to DR7
+     * from the #DB handler may trigger infinite loop of #DB's. +     */
+    if (sev_es_guest(svm->vcpu.kvm) && (save->sev_features & SVM_SEV_FEAT_DEBUG_SWAP)) {
+        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR7_READ); +        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR7_WRITE); +    }

arch/x86/kvm/svm/svm.c +4 -0
+
+    recalc_intercepts(svm);
+}
+

  static int direct_access_msr_slot(u32 msr)
  {
      u32 i;

arch/x86/kvm/svm/svm.c +3 -3
@@ -1184,13 +1243,11 @@ static void init_vmcb(struct kvm_vcpu *vcpu)
       if (!kvm_vcpu_apicv_active(vcpu))
           svm_set_intercept(svm, INTERCEPT_CR8_WRITE);
-    set_dr_intercepts(svm);
-
       set_exception_intercept(svm, PF_VECTOR);
       set_exception_intercept(svm, UD_VECTOR);
       set_exception_intercept(svm, MC_VECTOR);
       set_exception_intercept(svm, AC_VECTOR);
-    set_exception_intercept(svm, DB_VECTOR);
+
       /*
        * Guest access to VMware backdoor ports could legitimately
        * trigger #GP because of TSS I/O permission bitmap.
@@ -1308,6 +1365,8 @@ static void init_vmcb(struct kvm_vcpu *vcpu)
       if (sev_guest(vcpu->kvm))
           sev_init_vmcb(svm);
+    set_dr_intercepts(svm);
+
       svm_hv_init_vmcb(vmcb);
       init_vmcb_after_set_cpuid(vcpu);
Signature · 1 line
Alexey
#13 lore raw

Re: [PATCH kernel v4] KVM: SEV: Enable data breakpoints in SEV-ES

Ping? (I am told that pinging once a week is ok) Thanks,

Quoted 306 lines · Alexey Kardashevskiy

Ping? Thanks,

Quoted 301 lines · Alexey Kardashevskiy

Ping? Thanks,

Quoted 297 lines · Alexey Kardashevskiy

Prior to SEV-ES, KVM stored/loaded host debug registers upon switching to/from a VM. Changing those registers inside a running SEV VM triggered #VC exit to KVM.

SEV-ES added the encrypted state (ES) which uses an encrypted guest page for the VM state (VMSA). The hardware saves/restores certain registers on VMRUN/VMEXIT according to a swap type (A, B, C), see
"Table B-3. Swap Types" in the AMD Architecture Programmer’s Manual volume 2.

AMD Milan (Fam 19h) introduces support for the debug registers swapping. DR6 and DR7 are always swapped. DR[0-3] and DR[0-3]_ADDR_MASK are swapped a type B when SEV_FEATURES[5] ("DebugSwap") is set.

Enable DebugSwap in VMSA. But only do so if CPUID Fn80000021_EAX[0] ("NoNestedDataBp", "Processor ignores nested data breakpoints") is supported by the SOC as otherwise a malicious SEV-ES guest can set up data breakpoints on the #VC IDT entry/stack and cause an infinite loop.

Eliminate DR7 and #DB intercepts as:
- they are not needed when DebugSwap is supported;
- #VC for these intercepts is most likely not supported anyway and kills the VM.
Keep DR7 intercepted unless DebugSwap enabled to prevent the infinite #DB loop DoS.

While at this, move set_/clr_dr_intercepts to .c and move #DB intercept next to DR7 intercept.

---
Changes:
v4:
* removed sev_es_is_debug_swap_enabled() helper
* made sev_es_debug_swap_enabled (module param) static
* set sev_feature early in sev_es_init_vmcb() and made intercepts dependend on it vs. module param
* move set_/clr_dr_intercepts to .c

v3:
* rewrote the commit log again
* rebased on tip/master to use recently defined X86_FEATURE_NO_NESTED_DATA_BP
* s/boot_cpu_has/cpu_feature_enabled/

v2:
* debug_swap moved from vcpu to module_param
* rewrote commit log

---
Tested with:
===
int x;
int main(int argc, char *argv[])
{
         x = 1;
         return 0;
}
===
gcc -g a.c
rsync a.out ruby-954vm:~/
ssh -t ruby-954vm 'gdb -ex "file a.out" -ex "watch x" -ex r'

where ruby-954vm is a VM.

With "/sys/module/kvm_amd/parameters/debug_swap = 0", gdb does not stop on the watchpoint, with "= 1" - gdb does.
---
  arch/x86/include/asm/svm.h |  1 +

  arch/x86/kvm/svm/svm.h     | 42 -------------
  arch/x86/kvm/svm/sev.c     | 24 ++++++++
  arch/x86/kvm/svm/svm.c     | 65 +++++++++++++++++++-
  4 files changed, 87 insertions(+), 45 deletions(-)
arch/x86/include/asm/svm.h +1 -0
index cb1ee53ad3b1..665515c7edae 100644
@@ -278,6 +278,7 @@ enum avic_ipi_failure_cause {
   #define AVIC_HPA_MASK    ~((0xFFFULL << 52) | 0xFFF)
   #define VMCB_AVIC_APIC_BAR_MASK        0xFFFFFFFFFF000ULL
+#define SVM_SEV_FEAT_DEBUG_SWAP                        BIT(5)
   struct vmcb_seg {
       u16 selector;
arch/x86/kvm/svm/svm.h +0 -0
index 4826e6cc611b..653fd09929df 100644
@@ -389,48 +389,6 @@ static inline bool vmcb12_is_intercept(struct 

vmcb_ctrl_area_cached *control, u3
      return test_bit(bit, (unsigned long *)&control->intercepts); }

arch/x86/kvm/svm/svm.h +0 -42
-static inline void set_dr_intercepts(struct vcpu_svm *svm)
-{
-    struct vmcb *vmcb = svm->vmcb01.ptr;
-
-    if (!sev_es_guest(svm->vcpu.kvm)) {
-        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR0_READ);
-        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR1_READ);
-        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR2_READ);
-        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR3_READ);
-        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR4_READ);
-        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR5_READ);
-        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR6_READ);
-        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR0_WRITE);
-        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR1_WRITE);
-        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR2_WRITE);
-        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR3_WRITE);
-        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR4_WRITE);
-        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR5_WRITE);
-        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR6_WRITE);
-    }
-
-    vmcb_set_intercept(&vmcb->control, INTERCEPT_DR7_READ);
-    vmcb_set_intercept(&vmcb->control, INTERCEPT_DR7_WRITE);
-
-    recalc_intercepts(svm);
-}
-
-static inline void clr_dr_intercepts(struct vcpu_svm *svm)
-{
-    struct vmcb *vmcb = svm->vmcb01.ptr;
-
-    vmcb->control.intercepts[INTERCEPT_DR] = 0;
-
-    /* DR7 access must remain intercepted for an SEV-ES guest */
-    if (sev_es_guest(svm->vcpu.kvm)) {
-        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR7_READ);
-        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR7_WRITE);
-    }
-
-    recalc_intercepts(svm);
-}
-

  static inline void set_exception_intercept(struct vcpu_svm *svm, u32 bit) {
      struct vmcb *vmcb = svm->vmcb01.ptr;

arch/x86/kvm/svm/sev.c +6 -0
index 86d6897f4806..af775410c5eb 100644
@@ -21,6 +21,7 @@
   #include <asm/pkru.h>
   #include <asm/trapnr.h>
   #include <asm/fpu/xcr.h>
+#include <asm/debugreg.h>
   #include "mmu.h"
   #include "x86.h"
@@ -52,9 +53,14 @@ module_param_named(sev, sev_enabled, bool, 0444);
   /* enable/disable SEV-ES support */
   static bool sev_es_enabled = true;
   module_param_named(sev_es, sev_es_enabled, bool, 0444);
+
+/* enable/disable SEV-ES DebugSwap support */
+static bool sev_es_debug_swap_enabled = true;
+module_param_named(debug_swap, sev_es_debug_swap_enabled, bool, 0644);
   #else
   #define sev_enabled false
   #define sev_es_enabled false
+#define sev_es_debug_swap false
   #endif /* CONFIG_KVM_AMD_SEV */
   static u8 sev_enc_bit;
@@ -2249,6 +2255,8 @@ void __init sev_hardware_setup(void)

  out:
      sev_enabled = sev_supported; sev_es_enabled = sev_es_supported;
+    if (!sev_es_enabled || !cpu_feature_enabled(X86_FEATURE_NO_NESTED_DATA_BP)) +        sev_es_debug_swap_enabled = false; #endif
  }

arch/x86/kvm/svm/sev.c +16 -0
@@ -2940,6 +2948,7 @@ int sev_es_string_io(struct vcpu_svm *svm, int 
 size, unsigned int port, int in)
   static void sev_es_init_vmcb(struct vcpu_svm *svm)
   {
       struct kvm_vcpu *vcpu = &svm->vcpu;
+    struct sev_es_save_area *save = svm->sev_es.vmsa;
       svm->vmcb->control.nested_ctl |= SVM_NESTED_CTL_SEV_ES_ENABLE;
       svm->vmcb->control.virt_ext |= LBR_CTL_ENABLE_MASK;
@@ -2988,6 +2997,9 @@ static void sev_es_init_vmcb(struct vcpu_svm *svm)
           if (guest_cpuid_has(&svm->vcpu, X86_FEATURE_RDTSCP))
               svm_clr_intercept(svm, INTERCEPT_RDTSCP);
       }
+
+    if (sev_es_debug_swap_enabled)
+        save->sev_features |= SVM_SEV_FEAT_DEBUG_SWAP;
   }
   void sev_init_vmcb(struct vcpu_svm *svm)
@@ -3027,6 +3039,18 @@ void sev_es_prepare_switch_to_guest(struct 
 sev_es_save_area *hostsa)
       /* MSR_IA32_XSS is restored on VMEXIT, save the currnet host value */
       hostsa->xss = host_xss;
+
+    /* The DebugSwap SEV feature does Type B swaps of DR[0-3] */
+    if (sev_es_debug_swap_enabled) {
+        hostsa->dr0 = native_get_debugreg(0);
+        hostsa->dr1 = native_get_debugreg(1);
+        hostsa->dr2 = native_get_debugreg(2);
+        hostsa->dr3 = native_get_debugreg(3);
+        hostsa->dr0_addr_mask = amd_get_dr_addr_mask(0);
+        hostsa->dr1_addr_mask = amd_get_dr_addr_mask(1);
+        hostsa->dr2_addr_mask = amd_get_dr_addr_mask(2);
+        hostsa->dr3_addr_mask = amd_get_dr_addr_mask(3);
+    }
   }
   void sev_vcpu_deliver_sipi_vector(struct kvm_vcpu *vcpu, u8 vector)
arch/x86/kvm/svm/svm.c +48 -0
index 60c7c880266b..f8e222bee22a 100644
@@ -671,6 +671,65 @@ static int svm_cpu_init(int cpu)
   }
+static void set_dr_intercepts(struct vcpu_svm *svm)
+{
+    struct vmcb *vmcb = svm->vmcb01.ptr;
+    bool intercept;
+
+    if (!sev_es_guest(svm->vcpu.kvm)) {
+        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR0_READ);
+        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR1_READ);
+        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR2_READ);
+        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR3_READ);
+        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR4_READ);
+        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR5_READ);
+        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR6_READ);
+        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR0_WRITE);
+        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR1_WRITE);
+        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR2_WRITE);
+        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR3_WRITE);
+        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR4_WRITE);
+        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR5_WRITE);
+        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR6_WRITE);
+    }
+
+    if (sev_es_guest(svm->vcpu.kvm)) {
+        struct sev_es_save_area *save = svm->sev_es.vmsa;
+
+        intercept = !(save->sev_features & SVM_SEV_FEAT_DEBUG_SWAP);
+    } else {
+        intercept = true;
+    }
+
+    if (intercept) {
+        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR7_READ);
+        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR7_WRITE);
+        set_exception_intercept(svm, DB_VECTOR);
+    }
+
+    recalc_intercepts(svm);
+}
+
+static void clr_dr_intercepts(struct vcpu_svm *svm)
+{
+    struct vmcb *vmcb = svm->vmcb01.ptr;
+    struct sev_es_save_area *save = svm->sev_es.vmsa;
+
+    vmcb->control.intercepts[INTERCEPT_DR] = 0;
+
+    /*
+     * DR7 access must remain intercepted for an SEV-ES guest unless 

DebugSwap
+     * (depends on NO_NESTED_DATA_BP) is enabled as otherwise a VM writing to DR7
+     * from the #DB handler may trigger infinite loop of #DB's. +     */
+    if (sev_es_guest(svm->vcpu.kvm) && (save->sev_features & SVM_SEV_FEAT_DEBUG_SWAP)) {
+        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR7_READ); +        vmcb_set_intercept(&vmcb->control, INTERCEPT_DR7_WRITE); +    }

arch/x86/kvm/svm/svm.c +4 -0
+
+    recalc_intercepts(svm);
+}
+

  static int direct_access_msr_slot(u32 msr)
  {
      u32 i;

arch/x86/kvm/svm/svm.c +3 -3
@@ -1184,13 +1243,11 @@ static void init_vmcb(struct kvm_vcpu *vcpu)
       if (!kvm_vcpu_apicv_active(vcpu))
           svm_set_intercept(svm, INTERCEPT_CR8_WRITE);
-    set_dr_intercepts(svm);
-
       set_exception_intercept(svm, PF_VECTOR);
       set_exception_intercept(svm, UD_VECTOR);
       set_exception_intercept(svm, MC_VECTOR);
       set_exception_intercept(svm, AC_VECTOR);
-    set_exception_intercept(svm, DB_VECTOR);
+
       /*
        * Guest access to VMware backdoor ports could legitimately
        * trigger #GP because of TSS I/O permission bitmap.
@@ -1308,6 +1365,8 @@ static void init_vmcb(struct kvm_vcpu *vcpu)
       if (sev_guest(vcpu->kvm))
           sev_init_vmcb(svm);
+    set_dr_intercepts(svm);
+
       svm_hv_init_vmcb(vmcb);
       init_vmcb_after_set_cpuid(vcpu);
Signature · 1 line
Alexey
#14 lore raw

Re: [PATCH kernel v4] KVM: SEV: Enable data breakpoints in SEV-ES

In reply to Alexey Kardashevskiy
Quoted 2 lines · Alexey Kardashevskiy

While at this, move set_/clr_dr_intercepts to .c and move #DB intercept next to DR7 intercept.

Please do non-trivial code movement in separate patches unless the functional change is trivial. Moving and changing at the same time makes the patch difficult to review.

Review module_param_named(sev, sev_enabled, bool, 0444); · line 59

Quoted 8 lines
(quoted diff) +4 -0
@@ -52,9 +53,14 @@ module_param_named(sev, sev_enabled, bool, 0444);
 /* enable/disable SEV-ES support */
 static bool sev_es_enabled = true;
 module_param_named(sev_es, sev_es_enabled, bool, 0444);
+
+/* enable/disable SEV-ES DebugSwap support */
+static bool sev_es_debug_swap_enabled = true;
+module_param_named(debug_swap, sev_es_debug_swap_enabled, bool, 0644);

Needs to be 0444, otherwise userspace can turn on the knob after KVM is loaded, which would allow enabling the feature on unsupported platforms, amongst many other problems.

Quoted 25 lines
(quoted diff) +0 -0
 void sev_vcpu_deliver_sipi_vector(struct kvm_vcpu *vcpu, u8 vector)
arch/x86/kvm/svm/svm.c +16 -0
index 60c7c880266b..f8e222bee22a 100644
@@ -671,6 +671,65 @@ static int svm_cpu_init(int cpu)
 
 }
 
+static void set_dr_intercepts(struct vcpu_svm *svm)
+{
+	struct vmcb *vmcb = svm->vmcb01.ptr;
+	bool intercept;
+
+	if (!sev_es_guest(svm->vcpu.kvm)) {
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR0_READ);
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR1_READ);
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR2_READ);
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR3_READ);
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR4_READ);
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR5_READ);
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR6_READ);
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR0_WRITE);
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR1_WRITE);
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR2_WRITE);

arch/x86/kvm/svm/svm.c static int svm_cpu_init(int cpu) · line 699

Quoted 10 lines
arch/x86/kvm/svm/svm.c +10 -0
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR3_WRITE);
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR4_WRITE);
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR5_WRITE);
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR6_WRITE);
+	}
+
+	if (sev_es_guest(svm->vcpu.kvm)) {
+		struct sev_es_save_area *save = svm->sev_es.vmsa;
+
+		intercept = !(save->sev_features & SVM_SEV_FEAT_DEBUG_SWAP);

Blech, the VMCB vs. SEV and SEV-ES code is a mess. E.g. init_vmcb() does

/*
* Guest access to VMware backdoor ports could legitimately
* trigger #GP because of TSS I/O permission bitmap.
* We intercept those #GP and allow access to them anyway
* as VMware does. Don't intercept #GP for SEV guests as KVM can't
* decrypt guest memory to decode the faulting instruction. */
if (enable_vmware_backdoor && !sev_guest(vcpu->kvm))
set_exception_intercept(svm, GP_VECTOR);

but then sev_es_init_vmcb() also does:

	/* No support for enable_vmware_backdoor */
	clr_exception_intercept(svm, GP_VECTOR);

DR interception is a similar trainwreck. svm_sync_dirty_debug_regs() bails if guest_state_protected is true, i.e. is a nop for SEV-ES guests, but only after the vCPU has done LAUNCH_UPDATE_VMSA. IIUC, that's nonsensical because even before guest state is encrypted, #DB will be reflected as #VC into the guest. And, again IIUC, except for DR7, DRs are never intercepted for SEV-ES guests and so trying to debug from the host is futile as the guest can clobber DRs at any time.

Similarly, flowing into dr_interception() on an SEV-ES VMGEXITis just dumb. KVM _knows_ it can't give the guest control of DR7, but it mucks with the intercepts anyways. That the GHCB spec even allows SVM_EXIT_{READ,WRITE}_DR7 is just asinine, but that's a moot point. Anyways, the GHCB spec's "suggestion" effectively says KVM's responsibility is purely to make a read of DR7 return the last written value. And of course KVM's disaster of a flow doesn't even do that unless the host is debugging the guest.

Currently, hardware debug traps aren’t supported for an SEV-ES guest. The hypervisor must set the intercept for both read and write of the debug control register (DR7). With the intercepts in place, the #VC handler will be invoked when the guest accesses DR7. For a write to DR7, the #VC handler should perform Standard VMGExit processing. The #VC handler must not update the actual DR7 register, but rather it should cache the DR7 value being written.

I bring this up because of the subtle dependency that checking SVM_SEV_FEAT_DEBUG_SWAP
creates: set_dr_intercepts() needs to be called after sev_init_vmcb(). I believe this approach also fails to handle intrahost migration; at the very least, what exactly will happen when sev_migrate_from() invokes sev_init_vmcb() is unclear. And I really don't want to pile even more gunk on top of the existing mess.

So, can you (and by "you" I really mean "the folks at AMD working on SEV stuff") start with the below diff (not intended to be a single patch), disallow kvm_arch_vcpu_ioctl_set_guest_debug() entirely for SEV-ES guests (will likely take some back and forth to figure out how we want to do this), and then fill in the blanks? I.e. get KVM to a state where all the intercept shenanigans for SEV and SEV-ES are reasonably contained in sev.c, and then enable the debug_swap stuff on top?

arch/x86/kvm/svm/sev.c +7 -2
index c25aeb550cd9..ff7a4d68731c 100644
@@ -2968,8 +2968,7 @@ static void sev_es_init_vmcb(struct vcpu_svm *svm)
        svm_set_intercept(svm, TRAP_CR4_WRITE);
        svm_set_intercept(svm, TRAP_CR8_WRITE);
 
-       /* No support for enable_vmware_backdoor */
-       clr_exception_intercept(svm, GP_VECTOR);
+       <debug register stuff goes here>
 
        /* Can't intercept XSETBV, HV can't modify XCR0 directly */
        svm_clr_intercept(svm, INTERCEPT_XSETBV);
@@ -2996,6 +2995,12 @@ void sev_init_vmcb(struct vcpu_svm *svm)
        svm->vmcb->control.nested_ctl |= SVM_NESTED_CTL_SEV_ENABLE;
        clr_exception_intercept(svm, UD_VECTOR);
 
+       /*
+        * Don't intercept #GP for SEV guests, e.g. for the VMware backdoor, as
+        * KVM can't decrypt guest memory to decode the faulting instruction.
+        */
+       clr_exception_intercept(svm, GP_VECTOR);
+
        if (sev_es_guest(svm->vcpu.kvm))
                sev_es_init_vmcb(svm);
 }
arch/x86/kvm/svm/svm.c +4 -5
index e0ec95f1f068..89753d7fd821 100644
@@ -1209,10 +1209,9 @@ static void init_vmcb(struct kvm_vcpu *vcpu)
         * Guest access to VMware backdoor ports could legitimately
         * trigger #GP because of TSS I/O permission bitmap.
         * We intercept those #GP and allow access to them anyway
-        * as VMware does.  Don't intercept #GP for SEV guests as KVM can't
-        * decrypt guest memory to decode the faulting instruction.
+        * as VMware does.
         */
-       if (enable_vmware_backdoor && !sev_guest(vcpu->kvm))
+       if (enable_vmware_backdoor)
                set_exception_intercept(svm, GP_VECTOR);
 
        svm_set_intercept(svm, INTERCEPT_INTR);
@@ -1950,7 +1949,7 @@ static void svm_sync_dirty_debug_regs(struct kvm_vcpu *vcpu)
 {
        struct vcpu_svm *svm = to_svm(vcpu);
 
-       if (vcpu->arch.guest_state_protected)
+       if (WARN_ON_ONCE(sev_es_guest(vcpu->kvm)))
                return;
 
        get_debugreg(vcpu->arch.db[0], 0);
@@ -2681,7 +2680,7 @@ static int dr_interception(struct kvm_vcpu *vcpu)
        unsigned long val;
        int err = 0;
 
-       if (vcpu->guest_debug == 0) {
+       if (vcpu->guest_debug == 0 && !sev_es_guest(vcpu->kvm)) {
                /*
                 * No more DR vmexits; force a reload of the debug registers
                 * and reenter on this instruction.  The next vmexit will
arch/x86/kvm/svm/svm.h +22 -20

58 lines not on this page · raw message

#15 lore raw

Re: [PATCH kernel v4] KVM: SEV: Enable data breakpoints in SEV-ES

Quoted 70 lines · Sean Christopherson
Quoted 2 lines · Alexey Kardashevskiy

While at this, move set_/clr_dr_intercepts to .c and move #DB intercept next to DR7 intercept.

Please do non-trivial code movement in separate patches unless the functional change is trivial. Moving and changing at the same time makes the patch difficult to review.

Review module_param_named(sev, sev_enabled, bool, 0444); · line 59

Quoted 8 lines
(quoted diff) +4 -0
@@ -52,9 +53,14 @@ module_param_named(sev, sev_enabled, bool, 0444);
  /* enable/disable SEV-ES support */
  static bool sev_es_enabled = true;
  module_param_named(sev_es, sev_es_enabled, bool, 0444);
+
+/* enable/disable SEV-ES DebugSwap support */
+static bool sev_es_debug_swap_enabled = true;
+module_param_named(debug_swap, sev_es_debug_swap_enabled, bool, 0644);

Needs to be 0444, otherwise userspace can turn on the knob after KVM is loaded, which would allow enabling the feature on unsupported platforms, amongst many other problems.

Quoted 25 lines
(quoted diff) +0 -0
  void sev_vcpu_deliver_sipi_vector(struct kvm_vcpu *vcpu, u8 vector)
arch/x86/kvm/svm/svm.c +16 -0
index 60c7c880266b..f8e222bee22a 100644
@@ -671,6 +671,65 @@ static int svm_cpu_init(int cpu)
 
  }
 
+static void set_dr_intercepts(struct vcpu_svm *svm)
+{
+	struct vmcb *vmcb = svm->vmcb01.ptr;
+	bool intercept;
+
+	if (!sev_es_guest(svm->vcpu.kvm)) {
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR0_READ);
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR1_READ);
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR2_READ);
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR3_READ);
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR4_READ);
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR5_READ);
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR6_READ);
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR0_WRITE);
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR1_WRITE);
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR2_WRITE);

arch/x86/kvm/svm/svm.c static int svm_cpu_init(int cpu) · line 699

Quoted 10 lines
arch/x86/kvm/svm/svm.c +10 -0
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR3_WRITE);
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR4_WRITE);
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR5_WRITE);
+		vmcb_set_intercept(&vmcb->control, INTERCEPT_DR6_WRITE);
+	}
+
+	if (sev_es_guest(svm->vcpu.kvm)) {
+		struct sev_es_save_area *save = svm->sev_es.vmsa;
+
+		intercept = !(save->sev_features & SVM_SEV_FEAT_DEBUG_SWAP);

Blech, the VMCB vs. SEV and SEV-ES code is a mess. E.g. init_vmcb() does

/*
* Guest access to VMware backdoor ports could legitimately
* trigger #GP because of TSS I/O permission bitmap.
* We intercept those #GP and allow access to them anyway
* as VMware does. Don't intercept #GP for SEV guests as KVM can't
* decrypt guest memory to decode the faulting instruction. */
if (enable_vmware_backdoor && !sev_guest(vcpu->kvm))
set_exception_intercept(svm, GP_VECTOR);

but then sev_es_init_vmcb() also does:

Quoted 7 lines
	/* No support for enable_vmware_backdoor */
	clr_exception_intercept(svm, GP_VECTOR);

DR interception is a similar trainwreck. svm_sync_dirty_debug_regs() bails if guest_state_protected is true, i.e. is a nop for SEV-ES guests, but only after the vCPU has done LAUNCH_UPDATE_VMSA. IIUC, that's nonsensical because even before guest state is encrypted, #DB will be reflected as #VC into the guest. And, again

A guest can't run before the LAUNCH_UPDATE process is complete, so there can't be a #VC before guest_state_proteced is true.

Quoted 8 lines

IIUC, except for DR7, DRs are never intercepted for SEV-ES guests and so trying to debug from the host is futile as the guest can clobber DRs at any time.

Similarly, flowing into dr_interception() on an SEV-ES VMGEXITis just dumb. KVM _knows_ it can't give the guest control of DR7, but it mucks with the intercepts anyways. That the GHCB spec even allows SVM_EXIT_{READ,WRITE}_DR7 is just asinine, but that's a moot point. Anyways, the GHCB spec's "suggestion" effectively says KVM's responsibility is purely to make a read of DR7 return the last written value.

That's not KVM's responsibility, that is the responsibility of the guest #VC handler. So a DR7 read, while intercepted, should never get to KVM.

Quoted 78 lines

And of course KVM's disaster of a flow doesn't even do that unless the host is debugging the guest.

Currently, hardware debug traps aren’t supported for an SEV-ES guest. The hypervisor must set the intercept for both read and write of the debug control register (DR7). With the intercepts in place, the #VC handler will be invoked when the guest accesses DR7. For a write to DR7, the #VC handler should perform Standard VMGExit processing. The #VC handler must not update the actual DR7 register, but rather it should cache the DR7 value being written.

I bring this up because of the subtle dependency that checking SVM_SEV_FEAT_DEBUG_SWAP
creates: set_dr_intercepts() needs to be called after sev_init_vmcb(). I believe this approach also fails to handle intrahost migration; at the very least, what exactly will happen when sev_migrate_from() invokes sev_init_vmcb() is unclear. And I really don't want to pile even more gunk on top of the existing mess.

So, can you (and by "you" I really mean "the folks at AMD working on SEV stuff") start with the below diff (not intended to be a single patch), disallow kvm_arch_vcpu_ioctl_set_guest_debug() entirely for SEV-ES guests (will likely take some back and forth to figure out how we want to do this), and then fill in the blanks? I.e. get KVM to a state where all the intercept shenanigans for SEV and SEV-ES are reasonably contained in sev.c, and then enable the debug_swap stuff on top?

arch/x86/kvm/svm/sev.c +7 -2
index c25aeb550cd9..ff7a4d68731c 100644
@@ -2968,8 +2968,7 @@ static void sev_es_init_vmcb(struct vcpu_svm *svm)
         svm_set_intercept(svm, TRAP_CR4_WRITE);
         svm_set_intercept(svm, TRAP_CR8_WRITE);
 
-       /* No support for enable_vmware_backdoor */
-       clr_exception_intercept(svm, GP_VECTOR);
+       <debug register stuff goes here>
 
         /* Can't intercept XSETBV, HV can't modify XCR0 directly */
         svm_clr_intercept(svm, INTERCEPT_XSETBV);
@@ -2996,6 +2995,12 @@ void sev_init_vmcb(struct vcpu_svm *svm)
         svm->vmcb->control.nested_ctl |= SVM_NESTED_CTL_SEV_ENABLE;
         clr_exception_intercept(svm, UD_VECTOR);
 
+       /*
+        * Don't intercept #GP for SEV guests, e.g. for the VMware backdoor, as
+        * KVM can't decrypt guest memory to decode the faulting instruction.
+        */
+       clr_exception_intercept(svm, GP_VECTOR);
+
         if (sev_es_guest(svm->vcpu.kvm))
                 sev_es_init_vmcb(svm);
  }
arch/x86/kvm/svm/svm.c +3 -4
index e0ec95f1f068..89753d7fd821 100644
@@ -1209,10 +1209,9 @@ static void init_vmcb(struct kvm_vcpu *vcpu)
          * Guest access to VMware backdoor ports could legitimately
          * trigger #GP because of TSS I/O permission bitmap.
          * We intercept those #GP and allow access to them anyway
-        * as VMware does.  Don't intercept #GP for SEV guests as KVM can't
-        * decrypt guest memory to decode the faulting instruction.
+        * as VMware does.
          */
-       if (enable_vmware_backdoor && !sev_guest(vcpu->kvm))
+       if (enable_vmware_backdoor)
                 set_exception_intercept(svm, GP_VECTOR);
 
         svm_set_intercept(svm, INTERCEPT_INTR);
@@ -1950,7 +1949,7 @@ static void svm_sync_dirty_debug_regs(struct kvm_vcpu *vcpu)
  {
         struct vcpu_svm *svm = to_svm(vcpu);
 
-       if (vcpu->arch.guest_state_protected)
+       if (WARN_ON_ONCE(sev_es_guest(vcpu->kvm)))
                 return;
 
         get_debugreg(vcpu->arch.db[0], 0);

arch/x86/kvm/svm/svm.c static int dr_interception(struct kvm_vcpu *vcpu) · line 2683

Quoted 5 lines
arch/x86/kvm/svm/svm.c +1 -1
@@ -2681,7 +2680,7 @@ static int dr_interception(struct kvm_vcpu *vcpu)
         unsigned long val;
         int err = 0;
 
-       if (vcpu->guest_debug == 0) {
+       if (vcpu->guest_debug == 0 && !sev_es_guest(vcpu->kvm)) {

This will change the current flow of an SEV-ES guest. With SEV-ES, vcpu->guest_debug can never be anything other than 0 and currently always takes this path.

So what is really needed is:

	if (vcpu->guest_debug == 0) {
		if (!sev_es_guest(vcpu->kvm)) {
			...
		}

		return 1;
	}
Quoted 54 lines
arch/x86/kvm/svm/svm.c +0 -0
                 /*
                  * No more DR vmexits; force a reload of the debug registers
                  * and reenter on this instruction.  The next vmexit will
arch/x86/kvm/svm/svm.h +19 -15
index f44751dd8d5d..7c99a7d55476 100644
@@ -409,23 +409,25 @@ static inline void set_dr_intercepts(struct vcpu_svm *svm)
  {
         struct vmcb *vmcb = svm->vmcb01.ptr;
 
-       if (!sev_es_guest(svm->vcpu.kvm)) {
-               vmcb_set_intercept(&vmcb->control, INTERCEPT_DR0_READ);
-               vmcb_set_intercept(&vmcb->control, INTERCEPT_DR1_READ);
-               vmcb_set_intercept(&vmcb->control, INTERCEPT_DR2_READ);
-               vmcb_set_intercept(&vmcb->control, INTERCEPT_DR3_READ);
-               vmcb_set_intercept(&vmcb->control, INTERCEPT_DR4_READ);
-               vmcb_set_intercept(&vmcb->control, INTERCEPT_DR5_READ);
-               vmcb_set_intercept(&vmcb->control, INTERCEPT_DR6_READ);
-               vmcb_set_intercept(&vmcb->control, INTERCEPT_DR0_WRITE);
-               vmcb_set_intercept(&vmcb->control, INTERCEPT_DR1_WRITE);
-               vmcb_set_intercept(&vmcb->control, INTERCEPT_DR2_WRITE);
-               vmcb_set_intercept(&vmcb->control, INTERCEPT_DR3_WRITE);
-               vmcb_set_intercept(&vmcb->control, INTERCEPT_DR4_WRITE);
-               vmcb_set_intercept(&vmcb->control, INTERCEPT_DR5_WRITE);
-               vmcb_set_intercept(&vmcb->control, INTERCEPT_DR6_WRITE);
+       if (sev_es_guest(svm->vcpu.kvm)) {
+               WARN_ON_ONCE(svm->vcpu.arch.last_vmentry_cpu != -1);
+               return;
         }
 
+       vmcb_set_intercept(&vmcb->control, INTERCEPT_DR0_READ);
+       vmcb_set_intercept(&vmcb->control, INTERCEPT_DR1_READ);
+       vmcb_set_intercept(&vmcb->control, INTERCEPT_DR2_READ);
+       vmcb_set_intercept(&vmcb->control, INTERCEPT_DR3_READ);
+       vmcb_set_intercept(&vmcb->control, INTERCEPT_DR4_READ);
+       vmcb_set_intercept(&vmcb->control, INTERCEPT_DR5_READ);
+       vmcb_set_intercept(&vmcb->control, INTERCEPT_DR6_READ);
+       vmcb_set_intercept(&vmcb->control, INTERCEPT_DR0_WRITE);
+       vmcb_set_intercept(&vmcb->control, INTERCEPT_DR1_WRITE);
+       vmcb_set_intercept(&vmcb->control, INTERCEPT_DR2_WRITE);
+       vmcb_set_intercept(&vmcb->control, INTERCEPT_DR3_WRITE);
+       vmcb_set_intercept(&vmcb->control, INTERCEPT_DR4_WRITE);
+       vmcb_set_intercept(&vmcb->control, INTERCEPT_DR5_WRITE);
+       vmcb_set_intercept(&vmcb->control, INTERCEPT_DR6_WRITE);
         vmcb_set_intercept(&vmcb->control, INTERCEPT_DR7_READ);
         vmcb_set_intercept(&vmcb->control, INTERCEPT_DR7_WRITE);
 
@@ -436,13 +438,13 @@ static inline void clr_dr_intercepts(struct vcpu_svm *svm)
  {
         struct vmcb *vmcb = svm->vmcb01.ptr;
 
+       if (WARN_ON_ONCE(sev_es_guest(svm->vcpu.kvm)))
+               return;

arch/x86/kvm/svm/svm.h static inline void clr_dr_intercepts(struct vcpu_svm *svm) · line 447

Quoted 10 lines
arch/x86/kvm/svm/svm.h +3 -5
+
         vmcb->control.intercepts[INTERCEPT_DR] = 0;
 
-       /* DR7 access must remain intercepted for an SEV-ES guest */
-       if (sev_es_guest(svm->vcpu.kvm)) {
-               vmcb_set_intercept(&vmcb->control, INTERCEPT_DR7_READ);
-               vmcb_set_intercept(&vmcb->control, INTERCEPT_DR7_WRITE);
-       }
+       vmcb_set_intercept(&vmcb->control, INTERCEPT_DR7_READ);
+       vmcb_set_intercept(&vmcb->control, INTERCEPT_DR7_WRITE);

If we never call clr_dr_intercepts() anymore for an SEV-ES guest, then the above two lines should be removed. They only were executed for an SEV-ES guest and now they would be executed for any guest.

Thanks,
Tom

Quoted 4 lines
arch/x86/kvm/svm/svm.h +0 -0
         recalc_intercepts(svm);
  }
 
#16 lore raw

Re: [PATCH kernel v3 2/3] KVM: SEV: Enable data breakpoints in SEV-ES

In reply to Alexey Kardashevskiy
Quoted 4 lines · Alexey Kardashevskiy
Quoted 2 lines

Follow-up question: does KVM _have_ to wait until KVM_SEV_LAUNCH_UPDATE_VMSA to set the flag?

Nope. Will repost soon as a reply to this mail.

Please, please do not post new versions In-Reply-To the previous version, and especially not In-Reply-To a random mail buried deep in the thread. b4, which is imperfect but makes my life sooo much easier, gets confused by all the threading and partial rerolls. The next version also buries _this_ reply, which is partly why I haven't responded until now. I simply missed this the below questions because I saw v4 and assumed all my feedback was addressed, i.e. that I could handle this in the context of 6.4 and not earlier.

Continuing on that topic, please do not post a new version until open questions from the previous version are resolved. Posting a new version when there are unresolved questions might feel like it helps things move faster, but more often than not it has the comlete opposite effect.

Quoted 12 lines
Quoted 10 lines

arch/x86/kvm/svm/sev.c module_param_named(sev, sev_enabled, bool, 0444); · line 59

Quoted 3 lines
arch/x86/kvm/svm/sev.c +3 -0
+/* enable/disable SEV-ES DebugSwap support */
+static bool sev_es_debug_swap_enabled = true;
+module_param_named(debug_swap, sev_es_debug_swap_enabled, bool, 0644);

Module param needs 0444 permissions, i.e. shouldn't be writable after KVM is loaded. Though I don't know that providing a module param is warranted in this case.
KVM provides module params for SEV and SEV-ES because there are legitimate reasons to turn them off, but at a glance, I don't see why we'd want that for this feature.

Quoted 2 lines

/me confused. You suggested this in the first place for (I think) for the case if the feature is found to be broken later on so admins can disable it.

Hrm, so I did. Right, IIUC, this has guest visible effects, i.e. guest can read/write DRs, and so the admin might want the ability to disable the feature.

Speaking of past me, no one answered my question about how this will interact with SNP, where the VM can maniuplate the VMSA.

: > @@ -604,6 +607,9 @@ static int sev_es_sync_vmsa(struct vcpu_svm *svm)

  : >       save->xss  = svm->vcpu.arch.ia32_xss;
  : >       save->dr6  = svm->vcpu.arch.dr6;

: >
: > + if (sev->debug_swap)
: > + save->sev_features |= SVM_SEV_FEAT_DEBUG_SWAP;
:
: Resurrecting my objection to "AP Creation NAE event"[*], what happens if a hypervisor : supports GHCB_HV_FT_SNP_AP_CREATION but not DebugSwap? IIUC, a guest can corrupt : host DRs by enabling DebugSwap in the VMSA of an AP vCPU, e.g. the CPU will load : zeros on VM-Exit if the host hasn't stuffed the host save area fields. :
: KVM can obviously just make sure to save its DRs if hardware supports DebugSwap, : but what if DebugSwap is buggy and needs to be disabled? And what about the next : feature that can apparently be enabled by the guest?
:
: [*] https://lore.kernel.org/all/[email protected]

Quoted 2 lines

And I was using it to verify "x86/debug: Fix stack recursion caused by DR7 accesses" which is convenient but it is a minor thing.

...

Quoted 14 lines
Quoted 5 lines
Quoted 5 lines
arch/x86/kvm/svm/svm.c +0 -0
index 60c7c880266b..6c54a3c9d442 100644
@@ -1190,7 +1190,8 @@ static void init_vmcb(struct kvm_vcpu *vcpu)
Quoted 8 lines

arch/x86/kvm/svm/svm.c static void init_vmcb(struct kvm_vcpu *vcpu) · line 1194

Quoted 6 lines
arch/x86/kvm/svm/svm.c +2 -1
  	set_exception_intercept(svm, UD_VECTOR);
  	set_exception_intercept(svm, MC_VECTOR);
  	set_exception_intercept(svm, AC_VECTOR);
-	set_exception_intercept(svm, DB_VECTOR);
+	if (!sev_es_is_debug_swap_enabled())
+		set_exception_intercept(svm, DB_VECTOR);

This is wrong. KVM needs to intercept #DBs when debugging non-SEV-ES VMs.

Quoted 1 line

Sorry, not following. The #DB intercept for non-SEV-ES is enabled here.

The helper in this version (v3) just queries whether or not the feature is enabled, it doesn't differentiate between SEV-ES and other VM types. I.e. loading KVM with SEV-ES and DebugSwap enabled would break non-SEV-ES VMs running on the same host.

+bool sev_es_is_debug_swap_enabled(void)
+{
+ return sev_es_debug_swap_enabled;
+}

Looks like this was fixed in v4.

Quoted 5 lines
Quoted 5 lines

This _could_ be tied to X86_FEATURE_NO_NESTED_DATA_BP, but the KVM would need to toggle the intercept depending on whether or not userspace wants to debug the guest.

Similar to the DR7 interception, can this check sev_features directly?

#17 lore raw

Re: [PATCH kernel v3 2/3] KVM: SEV: Enable data breakpoints in SEV-ES

Quoted 6 lines · Sean Christopherson
Quoted 4 lines · Alexey Kardashevskiy
Quoted 2 lines

Follow-up question: does KVM _have_ to wait until KVM_SEV_LAUNCH_UPDATE_VMSA to set the flag?

Nope. Will repost soon as a reply to this mail.

Quoted 7 lines

Please, please do not post new versions In-Reply-To the previous version, and especially not In-Reply-To a random mail buried deep in the thread. b4, which is imperfect but makes my life sooo much easier, gets confused by all the threading and partial rerolls. The next version also buries _this_ reply, which is partly why I haven't responded until now. I simply missed this the below questions because I saw v4 and assumed all my feedback was addressed, i.e. that I could handle this in the context of 6.4 and not earlier.

Ok, noted. Sorry for the mess.

Quoted 4 lines

Continuing on that topic, please do not post a new version until open questions from the previous version are resolved. Posting a new version when there are unresolved questions might feel like it helps things move faster, but more often than not it has the comlete opposite effect.

Well I thought keeping the history in one place/thread is helping. Oh well...

Quoted 21 lines
Quoted 12 lines
Quoted 10 lines

arch/x86/kvm/svm/sev.c module_param_named(sev, sev_enabled, bool, 0444); · line 59

Quoted 3 lines
arch/x86/kvm/svm/sev.c +3 -0
+/* enable/disable SEV-ES DebugSwap support */
+static bool sev_es_debug_swap_enabled = true;
+module_param_named(debug_swap, sev_es_debug_swap_enabled, bool, 0644);

Module param needs 0444 permissions, i.e. shouldn't be writable after KVM is loaded. Though I don't know that providing a module param is warranted in this case.
KVM provides module params for SEV and SEV-ES because there are legitimate reasons to turn them off, but at a glance, I don't see why we'd want that for this feature.

Quoted 2 lines

/me confused. You suggested this in the first place for (I think) for the case if the feature is found to be broken later on so admins can disable it.

Hrm, so I did. Right, IIUC, this has guest visible effects, i.e. guest can read/write DRs, and so the admin might want the ability to disable the feature.

Speaking of past me, no one answered my question about how this will interact with SNP, where the VM can maniuplate the VMSA.

Quoted 11 lines
   : > @@ -604,6 +607,9 @@ static int sev_es_sync_vmsa(struct vcpu_svm *svm)
   : >       save->xss  = svm->vcpu.arch.ia32_xss;
   : >       save->dr6  = svm->vcpu.arch.dr6;
   : >
   : > +     if (sev->debug_swap)
   : > +             save->sev_features |= SVM_SEV_FEAT_DEBUG_SWAP;
   :
   : Resurrecting my objection to "AP Creation NAE event"[*], what happens if a hypervisor
   : supports GHCB_HV_FT_SNP_AP_CREATION but not DebugSwap?  IIUC, a guest can corrupt
   : host DRs by enabling DebugSwap in the VMSA of an AP vCPU, e.g. the CPU will load
   : zeros on VM-Exit if the host hasn't stuffed the host save area fields.

I was convinced it was answered (by Tom). (...10min later...) now I can see it was an internal email :-/

The host will have to save DRs and masks to the host save area for SNP and non-SNP guests (until we get the hw which allows masking features). Which patchset will do this - it depends on what gets accepted first - this or the SNP support.

Quoted 31 lines

: KVM can obviously just make sure to save its DRs if hardware supports DebugSwap, : but what if DebugSwap is buggy and needs to be disabled? And what about the next : feature that can apparently be enabled by the guest?
:

   : [*] https://lore.kernel.org/all/[email protected]
Quoted 2 lines

And I was using it to verify "x86/debug: Fix stack recursion caused by DR7 accesses" which is convenient but it is a minor thing.

...

Quoted 14 lines
Quoted 5 lines
Quoted 5 lines
arch/x86/kvm/svm/svm.c +0 -0
index 60c7c880266b..6c54a3c9d442 100644
@@ -1190,7 +1190,8 @@ static void init_vmcb(struct kvm_vcpu *vcpu)
Quoted 8 lines

arch/x86/kvm/svm/svm.c static void init_vmcb(struct kvm_vcpu *vcpu) · line 1194

Quoted 6 lines
arch/x86/kvm/svm/svm.c +2 -1
   	set_exception_intercept(svm, UD_VECTOR);
   	set_exception_intercept(svm, MC_VECTOR);
   	set_exception_intercept(svm, AC_VECTOR);
-	set_exception_intercept(svm, DB_VECTOR);
+	if (!sev_es_is_debug_swap_enabled())
+		set_exception_intercept(svm, DB_VECTOR);

This is wrong. KVM needs to intercept #DBs when debugging non-SEV-ES VMs.

Quoted 1 line

Sorry, not following. The #DB intercept for non-SEV-ES is enabled here.

The helper in this version (v3) just queries whether or not the feature is enabled, it doesn't differentiate between SEV-ES and other VM types. I.e. loading KVM with SEV-ES and DebugSwap enabled would break non-SEV-ES VMs running on the same host.

Quoted 6 lines

+bool sev_es_is_debug_swap_enabled(void)
+{
+ return sev_es_debug_swap_enabled;
+}

Looks like this was fixed in v4.

Right. I'll try addressing the comments from the other big reply of yours and send the patches. Thanks for all comments!

Quoted 5 lines
Quoted 5 lines
Quoted 5 lines

This _could_ be tied to X86_FEATURE_NO_NESTED_DATA_BP, but the KVM would need to toggle the intercept depending on whether or not userspace wants to debug the guest.

Similar to the DR7 interception, can this check sev_features directly?

Signature · 1 line
Alexey
#18 lore raw

PATCH v3 3/3 x86/sev: Do not handle #VC for DR7 read/write

In reply to Alexey Kardashevskiy

With MSR_AMD64_SEV_DEBUG_SWAP enabled, the VM should not get #VC events for DR7 read/write which it rather avoided.

---
Changes:
v2:
* use new bit definition

---
 arch/x86/include/asm/msr-index.h       | 1 +
 tools/arch/x86/include/asm/msr-index.h | 1 +
 arch/x86/kernel/sev.c                  | 6 ++++++
 3 files changed, 8 insertions(+)
arch/x86/include/asm/msr-index.h +1 -0
index cb3d0f6e6ac2..e15afe3500ff 100644
@@ -574,6 +574,7 @@
 #define MSR_AMD64_SEV_ENABLED		BIT_ULL(MSR_AMD64_SEV_ENABLED_BIT)
 #define MSR_AMD64_SEV_ES_ENABLED	BIT_ULL(MSR_AMD64_SEV_ES_ENABLED_BIT)
 #define MSR_AMD64_SEV_SNP_ENABLED	BIT_ULL(MSR_AMD64_SEV_SNP_ENABLED_BIT)
+#define MSR_AMD64_SEV_DEBUG_SWAP	BIT_ULL(7)
 
 #define MSR_AMD64_VIRT_SPEC_CTRL	0xc001011f
 
tools/arch/x86/include/asm/msr-index.h +1 -0
index 37ff47552bcb..27c1c349e49b 100644
@@ -565,6 +565,7 @@
 #define MSR_AMD64_SEV_ENABLED		BIT_ULL(MSR_AMD64_SEV_ENABLED_BIT)
 #define MSR_AMD64_SEV_ES_ENABLED	BIT_ULL(MSR_AMD64_SEV_ES_ENABLED_BIT)
 #define MSR_AMD64_SEV_SNP_ENABLED	BIT_ULL(MSR_AMD64_SEV_SNP_ENABLED_BIT)
+#define MSR_AMD64_SEV_DEBUG_SWAP	BIT_ULL(7)
 
 #define MSR_AMD64_VIRT_SPEC_CTRL	0xc001011f
 
arch/x86/kernel/sev.c +6 -0
index 679026a640ef..8184f8ba4edc 100644
@@ -1618,6 +1618,9 @@ static enum es_result vc_handle_dr7_write(struct ghcb *ghcb,
 	long val, *reg = vc_insn_get_rm(ctxt);
 	enum es_result ret;
 
+	if (sev_status & MSR_AMD64_SEV_DEBUG_SWAP)
+		return ES_VMM_ERROR;
+
 	if (!reg)
 		return ES_DECODE_FAILED;
 
@@ -1655,6 +1658,9 @@ static enum es_result vc_handle_dr7_read(struct ghcb *ghcb,
 	struct sev_es_runtime_data *data = this_cpu_read(runtime_data);
 	long *reg = vc_insn_get_rm(ctxt);
 
+	if (sev_status & MSR_AMD64_SEV_DEBUG_SWAP)
+		return ES_VMM_ERROR;
+
 	if (!reg)
 		return ES_DECODE_FAILED;
 
Signature · 1 line
2.38.1
#19 lore raw

Re: [PATCH kernel v3 3/3] x86/sev: Do not handle #VC for DR7 read/write

Quoted 3 lines · Alexey Kardashevskiy

With MSR_AMD64_SEV_DEBUG_SWAP enabled, the VM should not get #VC events for DR7 read/write which it rather avoided.

SNP guest feature negotiation patch is part of tip now: https://lore.kernel.org/lkml/167414649850.4906.1693185384677559889.tip-bot2@tip-bot2/

MSR_AMD64_SNP_DEBUG_SWAP is already defined. As this requires guest side changes, please add MSR_AMD64_SNP_DEBUG_SWAP as part of SNP_FEATURES_PRESENT bit mask.

Regards
Nikunj

#20 lore raw

Re: [PATCH kernel v3 3/3] x86/sev: Do not handle #VC for DR7 read/write

Quoted 6 lines · Nikunj A. Dadhania
Quoted 3 lines · Alexey Kardashevskiy

With MSR_AMD64_SEV_DEBUG_SWAP enabled, the VM should not get #VC events for DR7 read/write which it rather avoided.

SNP guest feature negotiation patch is part of tip now: https://lore.kernel.org/lkml/167414649850.4906.1693185384677559889.tip-bot2@tip-bot2/

Worth mentioning it is tip/x86/urgent (which does not have X86_FEATURE_NO_NESTED_DATA_BP), not tip/master (which has X86_FEATURE_NO_NESTED_DATA_BP).

Quoted 2 lines

MSR_AMD64_SNP_DEBUG_SWAP is already defined. As this requires guest side changes, please add MSR_AMD64_SNP_DEBUG_SWAP as part of SNP_FEATURES_PRESENT bit mask.

It is MSR_AMD64_SEV_DEBUG_SWAP (SEV, not SNP), it is an SEV-ES thing. Why is that feature negotiation SNP-only and not SEV?

Signature · 1 line
Alexey
maintainer
#21 lore raw

Re: [PATCH kernel v3 3/3] x86/sev: Do not handle #VC for DR7 read/write

Quoted 3 lines · Alexey Kardashevskiy

Worth mentioning it is tip/x86/urgent (which does not have X86_FEATURE_NO_NESTED_DATA_BP), not tip/master (which has X86_FEATURE_NO_NESTED_DATA_BP).

Yeah, when you submit patches for tip, you can always use tip/master which has the latest lineup of all branches and should have all the required bits.

Thx.

Signature · 4 lines
Regards/Gruss,
    Boris.

https://people.kernel.org/tglx/notes-about-netiquette
#22 lore raw

Re: [PATCH kernel v3 3/3] x86/sev: Do not handle #VC for DR7 read/write

Quoted 7 lines · Borislav Petkov
Quoted 3 lines · Alexey Kardashevskiy

Worth mentioning it is tip/x86/urgent (which does not have X86_FEATURE_NO_NESTED_DATA_BP), not tip/master (which has X86_FEATURE_NO_NESTED_DATA_BP).

Yeah, when you submit patches for tip, you can always use tip/master which has the latest lineup of all branches and should have all the required bits.

The tip/master's head just a few days ago was 195df42eb64dcb "Merge branch into tip/master: 'x86/platform'" and did have dcf67f724b8ada "x86/cpu, kvm: Add the NO_NESTED_DATA_BP feature" but now tip/master does not have it - 8272720be044 "Merge x86/cache into tip/master". /me confused. What tree is the tree?

Quoted 3 lines

Thx.

Signature · 1 line
Alexey
maintainer
#23 lore raw

Re: [PATCH kernel v3 3/3] x86/sev: Do not handle #VC for DR7 read/write

Quoted 3 lines · Alexey Kardashevskiy

The tip/master's head just a few days ago was 195df42eb64dcb "Merge branch into tip/master: 'x86/platform'" and did have dcf67f724b8ada "x86/cpu, kvm:
Add the NO_NESTED_DATA_BP feature" but now tip/master does not have it -

Yeah, it had to be backed out. A new version will be queued soon.

Quoted 2 lines

8272720be044 "Merge x86/cache into tip/master". /me confused. What tree is the tree?

It still is *the* tree - just there were some issues with the KVM side of Kim's series so it had to be dropped but he sent a new version which I need to queue soon. Then I'll have a look at yours.

Thx.

Signature · 4 lines
Regards/Gruss,
    Boris.

https://people.kernel.org/tglx/notes-about-netiquette
#24 lore raw

Re: [PATCH kernel v3 3/3] x86/sev: Do not handle #VC for DR7 read/write

In reply to Alexey Kardashevskiy
Quoted 1 line · Alexey Kardashevskiy

It is MSR_AMD64_SEV_DEBUG_SWAP (SEV, not SNP), it is an SEV-ES thing.

Yes, noticed that, earlier analysis was that Debug Swap shouldn't need any guest side changes, but it does need it.

Quoted 1 line

Why is that feature negotiation SNP-only and not SEV?

As per the spec, GHCB termination request: reason code: 0x2 is SNP features specific.

Regards
Nikunj

#25 lore raw

Re: [PATCH kernel v3 3/3] x86/sev: Do not handle #VC for DR7 read/write

On 24/1/23 21:37, Nikunj A. Dadhania wrote:>> It is MSR_AMD64_SEV_DEBUG_SWAP (SEV, not SNP), it is an SEV-ES thing.> Yes, noticed that, earlier analysis was that Debug Swap shouldn't need any guest side changes, but it does need it.>>> Why is that feature negotiation SNP-only and not SEV?> > As per the spec, GHCB termination request: reason code: 0x2 is SNP features specific. Does the guest really need to terminate in such case? A VM could just not do the GHCB thing if it does not want to.

Signature · 1 line
Alexey
#26 lore raw

Re: [PATCH kernel v3 3/3] x86/sev: Do not handle #VC for DR7 read/write

Quoted 10 lines · Alexey Kardashevskiy
Quoted 1 line · Nikunj A. Dadhania

It is MSR_AMD64_SEV_DEBUG_SWAP (SEV, not SNP), it is an SEV-ES thing.

Yes, noticed that, earlier analysis was that Debug Swap shouldn't need any guest side changes, but it does need it.

Quoted 3 lines
Quoted 1 line

Why is that feature negotiation SNP-only and not SEV?

As per the spec, GHCB termination request: reason code: 0x2 is SNP features specific.

Does the guest really need to terminate in such case?

The termination is from the guest that do not have implementation for the hypervisor enabled feature, in this case DebugSwap. If DebugSwap is enabled by the hypervisor and not handled in guest #VC, then DR7 read/write can be intercepted by the malicious hypervisor, which can return unexpected values.

Quoted 1 line

A VM could just not do the GHCB thing if it does not want to.

In that case, the VM can have unexpected failures.

Regards
Nikunj

#27 lore raw

PATCH v4 3/3 x86/sev: Do not handle #VC for DR7 read/write

In reply to Alexey Kardashevskiy

With MSR_AMD64_SEV_DEBUG_SWAP enabled, the VM should not get #VC events for DR7 read/write which it rather avoided.

Update the SNP_FEATURES_PRESENT mask with MSR_AMD64_SNP_DEBUG_SWAP so an SNP guest can gracefully terminate during SNP feature negotiation. For SEV-ES (which does not negotiate features) and enabled DebugSwap, fail to handle DR7's #VC and return en error which in turn causes panic() as there is no goot reason for the HV to keep intercepting DR7.

---

1/3 and 2/3 are the same as in v3 and fairly independent from this one.

The question now is what should SNP-feature-negotiation-aware guest do when KVM enables DebugSwap.

"x86/sev: Add SEV-SNP guest feature negotiation support" is going to reach the upstream long before any of these three from this thread.

It does not matter now as there is no SNP in upstream KVM.

---
Changes:
v4:
* rebased on top of SNP feature negotiation

v2:
* use new bit definition

---
 arch/x86/boot/compressed/sev.c | 2 +-
 arch/x86/kernel/sev.c          | 6 ++++++
 2 files changed, 7 insertions(+), 1 deletion(-)
arch/x86/boot/compressed/sev.c +1 -1
index d63ad8f99f83..ac86f458951d 100644
@@ -315,7 +315,7 @@ static void enforce_vmpl0(void)
  * by the guest kernel. As and when a new feature is implemented in the
  * guest kernel, a corresponding bit should be added to the mask.
  */
-#define SNP_FEATURES_PRESENT (0)
+#define SNP_FEATURES_PRESENT	MSR_AMD64_SNP_DEBUG_SWAP
 
 void snp_check_features(void)
 {
arch/x86/kernel/sev.c +6 -0
index 679026a640ef..f29e60c496d7 100644
@@ -1618,6 +1618,9 @@ static enum es_result vc_handle_dr7_write(struct ghcb *ghcb,
 	long val, *reg = vc_insn_get_rm(ctxt);
 	enum es_result ret;
 
+	if (sev_status & MSR_AMD64_SNP_DEBUG_SWAP)
+		return ES_VMM_ERROR;
+
 	if (!reg)
 		return ES_DECODE_FAILED;
 
@@ -1655,6 +1658,9 @@ static enum es_result vc_handle_dr7_read(struct ghcb *ghcb,
 	struct sev_es_runtime_data *data = this_cpu_read(runtime_data);
 	long *reg = vc_insn_get_rm(ctxt);
 
+	if (sev_status & MSR_AMD64_SNP_DEBUG_SWAP)
+		return ES_VMM_ERROR;
+
 	if (!reg)
 		return ES_DECODE_FAILED;
 
Signature · 1 line
2.39.1