KVM: x86: Add CMCI and UCNA emulation
v5 cover KVM: x86: Add CMCI and UCNA emulation
This patch series implement emulation for Corrected Machine Check Interrupt (CMCI) signaling and UnCorrectable No Action required (UCNA) error injection.
UCNA errors signaled via CMCI allow a guest to be notified as soon as uncorrectable memory errors get detected by some background threads, e.g., threads that migrate guest memory across hosts or threads that constantly scan system memory for errors [1].
Upon receiving UCNAs, guest kernel isolates the poisoned pages which may still be free, preventing future accesses that may cause fatal MCEs.
1. https://lore.kernel.org/linux-mm/[email protected]/t/
Patch 1-3 clean up KVM APIC LVT logic in preparation to adding APIC_LVTCMCI.
Patch 4 adds APIC_LVTCMCI emulation.
Patch 5 updates mce_banks to use array allocation api.
Patch 6 adds emulation for MSR_IA32_MCx_CTL2 registers that provide per bank control of CMCI signaling.
Patch 7 enables MCG_CMCI_P and handles injected UCNA errors.
Patch 8 adds a KVM self test that validates UCNA injection and CMCI emulation.
v5 changes
- Incorporate feedback from David Matlack <[email protected]>
- Rewrite the change log to be more concise and accurate.
- Removes several duplicated checks in UCNA injection code.
- Add test cases that validate CMCI emulation to self test.
v4 changes
- Incorporate feedback from David Matlack <[email protected]>
- Rewrite the change logs to be more descriptive.
- Add a KVM self test.
v3 changes
- Incorporate feedback from Sean Christopherson <[email protected]>
- Split clean up to KVM APIC LVT logic to 3 patches.
- Put the clean up of mce_array allocation in a separate patch.
- Base the MCi_CTL2 register emulation on Sean's clean up and fix series [2]
- Fix bugs around MCi_CTL2 register offset validation and the free of mci_ctl2_banks array.
- Rewrite the change log with more details in architectural information about CMCI, UCNA and MCG_CMCI_P.
- Fix various comments and wrapping style.
2. https://lore.kernel.org/lkml/[email protected]/T/
v2 chanegs
- Incorporate feedback from Sean Christopherson <[email protected]>
- Split the single patch into 4:
1). clean up KVM APIC LVT logic
2). add CMCI emulation to lapic
3). add emulation of MSR_IA32_MCx_CTL2
4). enable MCG_CMCI_P and handle injected UCNAs
- Fix various style issues.
Jue Wang (8):
KVM: x86: Make APIC_VERSION capture only the magic 0x14UL.
KVM: x86: Fill apic_lvt_mask with enums / explicit entries.
KVM: x86: Add APIC_LVTx() macro.
KVM: x86: Add Corrected Machine Check Interrupt (CMCI) emulation to
lapic.
KVM: x86: Use kcalloc to allocate the mce_banks array.
KVM: x86: Add emulation for MSR_IA32_MCx_CTL2 MSRs.
KVM: x86: Enable CMCI capability by default and handle injected UCNA
errors
KVM: selftests: Add a self test for CMCI and UCNA emulations.
arch/x86/include/asm/kvm_host.h | 1 + arch/x86/kvm/lapic.c | 66 ++-- arch/x86/kvm/lapic.h | 16 +- arch/x86/kvm/vmx/vmx.c | 1 + arch/x86/kvm/x86.c | 178 ++++++--- tools/testing/selftests/kvm/.gitignore | 1 + tools/testing/selftests/kvm/Makefile | 1 + .../selftests/kvm/include/x86_64/apic.h | 1 + .../selftests/kvm/include/x86_64/mce.h | 25 ++ .../selftests/kvm/include/x86_64/processor.h | 1 + .../selftests/kvm/lib/x86_64/processor.c | 2 +- .../kvm/x86_64/ucna_injection_test.c | 347 ++++++++++++++++++ 12 files changed, 573 insertions(+), 67 deletions(-) create mode 100644 tools/testing/selftests/kvm/include/x86_64/mce.h create mode 100644 tools/testing/selftests/kvm/x86_64/ucna_injection_test.c
Signature · 1 line
2.36.1.255.ge46751e96f-goog
PATCH v5 1/8 KVM: x86: Make APIC_VERSION capture only the magic 0x14UL.
Refactor APIC_VERSION so that the maximum number of LVT entries is inserted at runtime rather than compile time. This will be used in a subsequent commit to expose the LVT CMCI Register to VMs that support Corrected Machine Check error counting/signaling (IA32_MCG_CAP.MCG_CMCI_P=1).
--- arch/x86/kvm/lapic.c | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-)
arch/x86/kvm/lapic.c +2 -2
@@ -54,7 +54,7 @@#define PRIo64 "o"/* 14 is the version for Xeon and Pentium 8.4.8*/ -#define APIC_VERSION (0x14UL | ((KVM_APIC_LVT_NUM - 1) << 16)) +#define APIC_VERSION 0x14UL#define LAPIC_MMIO_LENGTH (1 << 12)/* followed define is not in apicdef.h */ #define MAX_APIC_VECTOR 256
@@ -401,7 +401,7 @@ static inline int apic_lvt_nmi_mode(u32 lvt_val)void kvm_apic_set_version (struct kvm_vcpu *vcpu) {struct kvm_lapic *apic = vcpu->arch.apic; -u32 v =APIC_VERSION ; +u32 v =APIC_VERSION | ((KVM_APIC_LVT_NUM -1 ) <<16 );if (!lapic_in_kernel (vcpu))return ;
Signature · 1 line
2.36.1.255.ge46751e96f-goog
PATCH v5 2/8 KVM: x86: Fill apic_lvt_mask with enums / explicit entries.
In reply to Jue WangThis patch defines a lapic_lvt_entry enum used as explicit indices to the apic_lvt_mask array. In later patches a LVT_CMCI will be added to implement the Corrected Machine Check Interrupt signaling.
--- arch/x86/kvm/lapic.c | 19 ++++++++++--------- arch/x86/kvm/lapic.h | 12 +++++++++++- 2 files changed, 21 insertions(+), 10 deletions(-)
arch/x86/kvm/lapic.c +10 -9
@@ -401,7 +401,7 @@ static inline int apic_lvt_nmi_mode(u32 lvt_val)void kvm_apic_set_version (struct kvm_vcpu *vcpu) {struct kvm_lapic *apic = vcpu->arch.apic; -u32 v =APIC_VERSION | ((KVM_APIC_LVT_NUM -1 ) <<16 ); +u32 v =APIC_VERSION | ((KVM_APIC_MAX_NR_LVT_ENTRIES -1 ) <<16 );if (!lapic_in_kernel (vcpu))return ;
@@ -419,12 +419,13 @@ void kvm_apic_set_version(struct kvm_vcpu *vcpu)kvm_lapic_set_reg (apic,APIC_LVR , v); } -static const unsigned int apic_lvt_mask[KVM_APIC_LVT_NUM ] = { -LVT_MASK ,/* part LVTT mask, timer mode mask added at runtime */ -LVT_MASK |APIC_MODE_MASK ,/* LVTTHMR */ -LVT_MASK |APIC_MODE_MASK ,/* LVTPC */ -LINT_MASK ,LINT_MASK ,/* LVT0-1 */ -LVT_MASK /* LVTERR */ +static const unsigned int apic_lvt_mask[KVM_APIC_MAX_NR_LVT_ENTRIES ] = { + [LVT_TIMER ] =LVT_MASK ,/* timer mode mask added at runtime */ + [LVT_THERMAL_MONITOR ] =LVT_MASK |APIC_MODE_MASK , + [LVT_PERFORMANCE_COUNTER ] =LVT_MASK |APIC_MODE_MASK , + [LVT_LINT0 ] =LINT_MASK , + [LVT_LINT1 ] =LINT_MASK , + [LVT_ERROR ] =LVT_MASK };static int find_highest_vector (void *bitmap)
@@ -2084,7 +2085,7 @@ static int kvm_lapic_reg_write(struct kvm_lapic *apic, u32 reg, u32 val)int i;u32 lvt_val; -for (i =0 ; i <KVM_APIC_LVT_NUM ; i++) { +for (i =0 ; i <KVM_APIC_MAX_NR_LVT_ENTRIES ; i++) { lvt_val =kvm_lapic_get_reg (apic,APIC_LVTT +0x10 * i); kvm_lapic_set_reg(apic, APIC_LVTT + 0x10 * i,
@@ -2383,7 +2384,7 @@ void kvm_lapic_reset(struct kvm_vcpu *vcpu, bool init_event)kvm_apic_set_xapic_id (apic, vcpu->vcpu_id);kvm_apic_set_version (apic->vcpu); -for (i =0 ; i <KVM_APIC_LVT_NUM ; i++) +for (i =0 ; i <KVM_APIC_MAX_NR_LVT_ENTRIES ; i++)kvm_lapic_set_reg (apic,APIC_LVTT +0x10 * i,APIC_LVT_MASKED );apic_update_lvtt (apic); if (kvm_vcpu_is_reset_bsp(vcpu) &&
arch/x86/kvm/lapic.h +11 -1
@@ -10,7 +10,6 @@#define KVM_APIC_INIT 0#define KVM_APIC_SIPI 1 -#define KVM_APIC_LVT_NUM 6#define APIC_SHORT_MASK 0xc0000#define APIC_DEST_NOSHORT 0x0
@@ -29,6 +28,17 @@ enum lapic_mode { LAPIC_MODE_X2APIC = MSR_IA32_APICBASE_ENABLE | X2APIC_ENABLE, }; +enum lapic_lvt_entry { +LVT_TIMER , +LVT_THERMAL_MONITOR , +LVT_PERFORMANCE_COUNTER , +LVT_LINT0 , +LVT_LINT1 , +LVT_ERROR , + +KVM_APIC_MAX_NR_LVT_ENTRIES , +}; +struct kvm_timer {struct hrtimer timer;s64 period;/* unit: ns */
Signature · 1 line
2.36.1.255.ge46751e96f-goog
PATCH v5 3/8 KVM: x86: Add APIC_LVTx() macro.
In reply to Jue WangAn APIC_LVTx macro is introduced to calcualte the APIC_LVTx register offset based on the index in the lapic_lvt_entry enum. Later patches will extend the APIC_LVTx macro to support the APIC_LVTCMCI register in order to implement Corrected Machine Check Interrupt signaling.
--- arch/x86/kvm/lapic.c | 7 +++---- arch/x86/kvm/lapic.h | 2 ++ 2 files changed, 5 insertions(+), 4 deletions(-)
arch/x86/kvm/lapic.c +3 -4
@@ -2086,9 +2086,8 @@ static int kvm_lapic_reg_write(struct kvm_lapic *apic, u32 reg, u32 val)u32 lvt_val;for (i =0 ; i <KVM_APIC_MAX_NR_LVT_ENTRIES ; i++) { - lvt_val =kvm_lapic_get_reg (apic, -APIC_LVTT +0x10 * i); -kvm_lapic_set_reg (apic,APIC_LVTT +0x10 * i, + lvt_val =kvm_lapic_get_reg (apic,APIC_LVTx (i)); +kvm_lapic_set_reg (apic,APIC_LVTx (i), lvt_val |APIC_LVT_MASKED ); }apic_update_lvtt (apic);
@@ -2385,7 +2384,7 @@ void kvm_lapic_reset(struct kvm_vcpu *vcpu, bool init_event)kvm_apic_set_version (apic->vcpu);for (i =0 ; i <KVM_APIC_MAX_NR_LVT_ENTRIES ; i++) -kvm_lapic_set_reg (apic,APIC_LVTT +0x10 * i,APIC_LVT_MASKED ); +kvm_lapic_set_reg (apic,APIC_LVTx (i),APIC_LVT_MASKED );apic_update_lvtt (apic);if (kvm_vcpu_is_reset_bsp (vcpu) &&kvm_check_has_quirk (vcpu->kvm,KVM_X86_QUIRK_LINT0_REENABLED ))
arch/x86/kvm/lapic.h +2 -0
@@ -39,6 +39,8 @@ enum lapic_lvt_entry { KVM_APIC_MAX_NR_LVT_ENTRIES, }; +#define APIC_LVTx (x) (APIC_LVTT + 0x10 * (x)) +struct kvm_timer {struct hrtimer timer;s64 period;/* unit: ns */
Signature · 1 line
2.36.1.255.ge46751e96f-goog
PATCH v5 4/8 KVM: x86: Add Corrected Machine Check Interrupt (CMCI) emulation to lapic.
In reply to Jue WangThis patch calculates the number of lvt entries as part of KVM_X86_MCE_SETUP conditioned on the presence of MCG_CMCI_P bit in MCG_CAP and stores result in kvm_lapic. It translats from APIC_LVTx register to index in lapic_lvt_entry enum. It extends the APIC_LVTx macro as well as other lapic write/reset handling etc to support Corrected Machine Check Interrupt.
--- arch/x86/kvm/lapic.c | 48 ++++++++++++++++++++++++++++++-------------- arch/x86/kvm/lapic.h | 4 +++- arch/x86/kvm/x86.c | 2 ++ 3 files changed, 38 insertions(+), 16 deletions(-)
arch/x86/kvm/lapic.c +33 -15
@@ -27,6 +27,7 @@#include <linux/math64.h> #include <linux/slab.h> #include <asm/processor.h> +#include <asm/mce.h> #include <asm/msr.h> #include <asm/page.h> #include <asm/current.h>
@@ -398,14 +399,21 @@ static inline int apic_lvt_nmi_mode(u32 lvt_val)return (lvt_val & (APIC_MODE_MASK |APIC_LVT_MASKED )) ==APIC_DM_NMI ; } +static inline bool kvm_lapic_lvt_supported (struct kvm_lapic *apic,int lvt_index) +{ +return apic->nr_lvt_entries > lvt_index; +} +void kvm_apic_set_version (struct kvm_vcpu *vcpu) {struct kvm_lapic *apic = vcpu->arch.apic; -u32 v =APIC_VERSION | ((KVM_APIC_MAX_NR_LVT_ENTRIES -1 ) <<16 ); +u32 v =0 ;if (!lapic_in_kernel (vcpu))return ; + v =APIC_VERSION | ((apic->nr_lvt_entries -1 ) <<16 ); +/* * KVM emulates 82093AA datasheet (with in-kernel IOAPIC implementation) * which doesn't have EOI register; Some buggy OSes (e.g. Windows with
@@ -425,7 +433,8 @@ static const unsigned int apic_lvt_mask[KVM_APIC_MAX_NR_LVT_ENTRIES] = { [LVT_PERFORMANCE_COUNTER] = LVT_MASK | APIC_MODE_MASK, [LVT_LINT0] = LINT_MASK, [LVT_LINT1] = LINT_MASK, - [LVT_ERROR] = LVT_MASK + [LVT_ERROR] = LVT_MASK, + [LVT_CMCI] = LVT_MASK | APIC_MODE_MASK };static int find_highest_vector (void *bitmap)
@@ -1445,6 +1454,9 @@ static int kvm_lapic_reg_read(struct kvm_lapic *apic, u32 offset, int len,APIC_REG_MASK (APIC_TMCCT ) |APIC_REG_MASK (APIC_TDCR ); +if (kvm_lapic_lvt_supported (apic,LVT_CMCI )) + valid_reg_mask |=APIC_REG_MASK (APIC_LVTCMCI ); +/* * ARBPRI and ICR2 are not valid in x2APIC mode. WARN if KVM reads ICR * in x2APIC mode as it's an 8-byte register in x2APIC and needs to be
@@ -2039,6 +2051,15 @@ static void apic_manage_nmi_watchdog(struct kvm_lapic *apic, u32 lvt0_val) } } +static int get_lvt_index (u32 reg) { +if (reg ==APIC_LVTCMCI ) +return LVT_CMCI ; +if (reg <APIC_LVTT || reg >APIC_LVTERR ) +return -1 ; +return array_index_nospec ( + (reg -APIC_LVTT ) >>4 ,KVM_APIC_MAX_NR_LVT_ENTRIES ); +} +static int kvm_lapic_reg_write (struct kvm_lapic *apic,u32 reg,u32 val) {int ret =0 ;
@@ -2083,12 +2104,10 @@ static int kvm_lapic_reg_write(struct kvm_lapic *apic, u32 reg, u32 val)apic_set_spiv (apic, val & mask);if (!(val &APIC_SPIV_APIC_ENABLED )) {int i; -u32 lvt_val; -for (i =0 ; i <KVM_APIC_MAX_NR_LVT_ENTRIES ; i++) { - lvt_val =kvm_lapic_get_reg (apic,APIC_LVTx (i)); +for (i =0 ; i < apic->nr_lvt_entries; i++) {kvm_lapic_set_reg (apic,APIC_LVTx (i), - lvt_val |APIC_LVT_MASKED ); +kvm_lapic_get_reg (apic,APIC_LVTx (i)) |APIC_LVT_MASKED ); }apic_update_lvtt (apic);atomic_set (&apic->lapic_timer.pending,0 );
@@ -2117,16 +2136,15 @@ static int kvm_lapic_reg_write(struct kvm_lapic *apic, u32 reg, u32 val)case APIC_LVTTHMR :case APIC_LVTPC :case APIC_LVT1 : -case APIC_LVTERR : { -/* TODO: Check vector */ -size_t size; -u32 index; - +case APIC_LVTERR : +case APIC_LVTCMCI : { +u32 index =get_lvt_index (reg); +if (!kvm_lapic_lvt_supported (apic, index)) { + ret =1 ; +break ; + }if (!kvm_apic_sw_enabled (apic)) val |=APIC_LVT_MASKED ; - size =ARRAY_SIZE (apic_lvt_mask); - index =array_index_nospec ( - (reg -APIC_LVTT ) >>4 , size); val &= apic_lvt_mask[index];kvm_lapic_set_reg (apic, reg, val);break ;
@@ -2383,7 +2401,7 @@ void kvm_lapic_reset(struct kvm_vcpu *vcpu, bool init_event)kvm_apic_set_xapic_id (apic, vcpu->vcpu_id);kvm_apic_set_version (apic->vcpu); -for (i =0 ; i <KVM_APIC_MAX_NR_LVT_ENTRIES ; i++) +for (i =0 ; i < apic->nr_lvt_entries; i++)kvm_lapic_set_reg (apic,APIC_LVTx (i),APIC_LVT_MASKED );apic_update_lvtt (apic); if (kvm_vcpu_is_reset_bsp(vcpu) &&
arch/x86/kvm/lapic.h +3 -1
@@ -35,11 +35,12 @@ enum lapic_lvt_entry { LVT_LINT0,LVT_LINT1 ,LVT_ERROR , +LVT_CMCI , KVM_APIC_MAX_NR_LVT_ENTRIES, }; -#define APIC_LVTx (x) (APIC_LVTT + 0x10 * (x)) +#define APIC_LVTx (x) ((x) == LVT_CMCI ? APIC_LVTCMCI : APIC_LVTT + 0x10 * (x))struct kvm_timer {struct hrtimer timer;
@@ -78,6 +79,7 @@ struct kvm_lapic {struct gfn_to_hva_cache vapic_cache;unsigned long pending_events;unsigned int sipi_vector; +int nr_lvt_entries; };struct dest_map ;
arch/x86/kvm/x86.c +2 -0
@@ -4772,6 +4772,8 @@ static int kvm_vcpu_ioctl_x86_setup_mce(struct kvm_vcpu *vcpu,/* Init IA32_MCi_CTL to all 1s */ for (bank =0 ; bank < bank_num; bank++) vcpu->arch.mce_banks[bank*4 ] = ~(u64 )0 ; + vcpu->arch.apic->nr_lvt_entries = +KVM_APIC_MAX_NR_LVT_ENTRIES - !(mcg_cap &MCG_CMCI_P );static_call (kvm_x86_setup_mce)(vcpu); out:
Signature · 1 line
2.36.1.255.ge46751e96f-goog
Re: [PATCH v5 4/8] KVM: x86: Add Corrected Machine Check Interrupt (CMCI) emulation to lapic.
On 6/11/2022 1:11 AM, Jue Wang wrote:
...
arch/x86/kvm/x86.c static int kvm_vcpu_ioctl_x86_setup_mce(struct kvm_vcpu *vcpu, · line 4776
Quoted 10 lines
arch/x86/kvm/x86.c +2
-0@@ -4772,6 +4772,8 @@ static int kvm_vcpu_ioctl_x86_setup_mce(struct kvm_vcpu *vcpu,/* Init IA32_MCi_CTL to all 1s */ for (bank =0 ; bank < bank_num; bank++) vcpu->arch.mce_banks[bank*4 ] = ~(u64 )0 ; + vcpu->arch.apic->nr_lvt_entries = +KVM_APIC_MAX_NR_LVT_ENTRIES - !(mcg_cap &MCG_CMCI_P );
vcpu->arch.apic->nr_lvt_entries needs to be initialized as KVM_APIC_MAX_NR_LVT_ENTREIS - 1 when creating lapic.
What if userspace doesn't call KVM_X86_SETUP_MCE at all?
Quoted 3 lines
arch/x86/kvm/x86.c +0
-0static_call (kvm_x86_setup_mce)(vcpu); out:
Re: [PATCH v5 4/8] KVM: x86: Add Corrected Machine Check Interrupt (CMCI) emulation to lapic.
Quoted 17 lines · Xiaoyao Li
On 6/11/2022 1:11 AM, Jue Wang wrote:
...arch/x86/kvm/x86.c static int kvm_vcpu_ioctl_x86_setup_mce(struct kvm_vcpu *vcpu, · line 4776
Quoted 10 lines
arch/x86/kvm/x86.c +2
-0@@ -4772,6 +4772,8 @@ static int kvm_vcpu_ioctl_x86_setup_mce(struct kvm_vcpu *vcpu,/* Init IA32_MCi_CTL to all 1s */ for (bank =0 ; bank < bank_num; bank++) vcpu->arch.mce_banks[bank*4 ] = ~(u64 )0 ; + vcpu->arch.apic->nr_lvt_entries = +KVM_APIC_MAX_NR_LVT_ENTRIES - !(mcg_cap &MCG_CMCI_P );
vcpu->arch.apic->nr_lvt_entriesneeds to be initialized asKVM_APIC_MAX_NR_LVT_ENTREIS- 1 when creating lapic.
Quoted 1 line
What if userspace doesn't call
KVM_X86_SETUP_MCEat all?
Good catch.
Paolo / Sean, should another patch be sent to fix this or do you recommend some other means to address the nr_lvt_entries initialization issue that Xiaoyao pointed out?
Thanks a lot,
-Jue
Quoted 5 lines
Quoted 4 lines
arch/x86/kvm/x86.c +0
-0static_call (kvm_x86_setup_mce)(vcpu); out:
Re: [PATCH v5 4/8] KVM: x86: Add Corrected Machine Check Interrupt (CMCI) emulation to lapic.
In reply to Xiaoyao LiI have sent out two patches to address this bug and an #GP reported by syzkaller.
https://lore.kernel.org/kvm/[email protected]/
Thanks again for the review and reporting of this issue!
Best regards,
-Jue
Quoted 23 lines · Xiaoyao Li
On 6/11/2022 1:11 AM, Jue Wang wrote:
...arch/x86/kvm/x86.c static int kvm_vcpu_ioctl_x86_setup_mce(struct kvm_vcpu *vcpu, · line 4776
Quoted 10 lines
arch/x86/kvm/x86.c +2
-0@@ -4772,6 +4772,8 @@ static int kvm_vcpu_ioctl_x86_setup_mce(struct kvm_vcpu *vcpu,/* Init IA32_MCi_CTL to all 1s */ for (bank =0 ; bank < bank_num; bank++) vcpu->arch.mce_banks[bank*4 ] = ~(u64 )0 ; + vcpu->arch.apic->nr_lvt_entries = +KVM_APIC_MAX_NR_LVT_ENTRIES - !(mcg_cap &MCG_CMCI_P );
vcpu->arch.apic->nr_lvt_entriesneeds to be initialized asKVM_APIC_MAX_NR_LVT_ENTREIS- 1 when creating lapic.What if userspace doesn't call
KVM_X86_SETUP_MCEat all?Quoted 3 lines
arch/x86/kvm/x86.c +0
-0static_call (kvm_x86_setup_mce)(vcpu); out:
PATCH v5 5/8 KVM: x86: Use kcalloc to allocate the mce_banks array.
In reply to Jue WangThis patch updates the allocation of mce_banks with the array allocation API (kcalloc) as a precedent for the later mci_ctl2_banks to implement per-bank control of Corrected Machine Check Interrupt (CMCI).
--- arch/x86/kvm/x86.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
arch/x86/kvm/x86.c +1 -1
@@ -11226,7 +11226,7 @@ int kvm_arch_vcpu_create(struct kvm_vcpu *vcpu) goto fail_free_lapic; vcpu->arch.pio_data =page_address (page); - vcpu->arch.mce_banks =kzalloc (KVM_MAX_MCE_BANKS *sizeof (u64) *4 , + vcpu->arch.mce_banks =kcalloc (KVM_MAX_MCE_BANKS *4 ,sizeof (u64),GFP_KERNEL_ACCOUNT );if (!vcpu->arch.mce_banks) goto fail_free_pio_data;
Signature · 1 line
2.36.1.255.ge46751e96f-goog
PATCH v5 6/8 KVM: x86: Add emulation for MSR_IA32_MCx_CTL2 MSRs.
In reply to Jue WangThis patch adds the emulation of IA32_MCi_CTL2 registers to KVM. A separate mci_ctl2_banks array is used to keep the existing mce_banks register layout intact.
In Machine Check Architecture, in addition to MCG_CMCI_P, bit 30 of the per-bank register IA32_MCi_CTL2 controls whether Corrected Machine Check error reporting is enabled.
--- arch/x86/include/asm/kvm_host.h | 1 + arch/x86/kvm/x86.c | 130 ++++++++++++++++++++++---------- 2 files changed, 92 insertions(+), 39 deletions(-)
arch/x86/include/asm/kvm_host.h +1 -0
@@ -806,6 +806,7 @@ struct kvm_vcpu_arch {u64 mcg_ctl;u64 mcg_ext_ctl;u64 *mce_banks; +u64 *mci_ctl2_banks;/* Cache MMIO info */ u64 mmio_gva;
arch/x86/kvm/x86.c +91 -39
211 lines not on this page · raw message
Signature · 1 line
2.36.1.255.ge46751e96f-goog
PATCH v5 7/8 KVM: x86: Enable CMCI capability by default and handle injected UCNA errors
In reply to Jue WangThis patch enables MCG_CMCI_P by default in kvm_mce_cap_supported. It reuses ioctl KVM_X86_SET_MCE to implement injection of UnCorrectable No Action required (UCNA) errors, signaled via Corrected Machine Check Interrupt (CMCI).
Neither of the CMCI and UCNA emulations depends on hardware.
--- arch/x86/kvm/vmx/vmx.c | 1 + arch/x86/kvm/x86.c | 44 +++++++++++++++++++++++++++++++++++++++++- 2 files changed, 44 insertions(+), 1 deletion(-)
arch/x86/kvm/vmx/vmx.c +1 -0
@@ -8037,6 +8037,7 @@ static __init int hardware_setup(void) } kvm_mce_cap_supported |=MCG_LMCE_P ; + kvm_mce_cap_supported |=MCG_CMCI_P ;if (pt_mode !=PT_MODE_SYSTEM && pt_mode !=PT_MODE_HOST_GUEST )return -EINVAL ;
arch/x86/kvm/x86.c +43 -1
62 lines not on this page · raw message
Signature · 1 line
2.36.1.255.ge46751e96f-goog
PATCH v5 8/8 KVM: selftests: Add a self test for CMCI and UCNA emulations.
In reply to Jue WangThis patch add a self test that verifies user space can inject UnCorrectable No Action required (UCNA) memory errors to the guest. It also verifies that incorrectly configured MSRs for Corrected Machine Check Interrupt (CMCI) emulation will result in #GP.
--- tools/testing/selftests/kvm/.gitignore | 1 + tools/testing/selftests/kvm/Makefile | 1 + .../selftests/kvm/include/x86_64/apic.h | 1 + .../selftests/kvm/include/x86_64/mce.h | 25 ++ .../selftests/kvm/include/x86_64/processor.h | 1 + .../selftests/kvm/lib/x86_64/processor.c | 2 +- .../kvm/x86_64/ucna_injection_test.c | 347 ++++++++++++++++++ 7 files changed, 377 insertions(+), 1 deletion(-) create mode 100644 tools/testing/selftests/kvm/include/x86_64/mce.h create mode 100644 tools/testing/selftests/kvm/x86_64/ucna_injection_test.c
tools/testing/selftests/kvm/.gitignore +1 -0
@@ -37,6 +37,7 @@ /x86_64/tsc_scaling_sync /x86_64/sync_regs_test /x86_64/tsc_msrs_test +/x86_64/ucna_injection_test /x86_64/userspace_io_test /x86_64/userspace_msr_exit_test /x86_64/vmx_apic_access_test
tools/testing/selftests/kvm/Makefile +1 -0
@@ -66,6 +66,7 @@ TEST_GEN_PROGS_x86_64 += x86_64/vmx_preemption_timer_test TEST_GEN_PROGS_x86_64 += x86_64/svm_vmcall_test TEST_GEN_PROGS_x86_64 += x86_64/svm_int_ctl_test TEST_GEN_PROGS_x86_64 += x86_64/sync_regs_test +TEST_GEN_PROGS_x86_64 += x86_64/ucna_injection_test TEST_GEN_PROGS_x86_64 += x86_64/userspace_io_test TEST_GEN_PROGS_x86_64 += x86_64/userspace_msr_exit_test TEST_GEN_PROGS_x86_64 += x86_64/vmx_apic_access_test
tools/testing/selftests/kvm/include/x86_64/apic.h +1 -0
@@ -35,6 +35,7 @@#define APIC_SPIV_APIC_ENABLED (1 << 8)#define APIC_IRR 0x200#define APIC_ICR 0x300 +#define APIC_LVTCMCI 0x2f0#define APIC_DEST_SELF 0x40000#define APIC_DEST_ALLINC 0x80000#define APIC_DEST_ALLBUT 0xC0000
tools/testing/selftests/kvm/include/x86_64/mce.h new file +25 -0
@@ -0,0 +1,25 @@ +/* SPDX-License-Identifier: GPL-2.0-only */ +/* +* tools/testing/selftests/kvm/include/x86_64/mce.h +* +* Copyright (C) 2022, Google LLC. +*/ + +#ifndef SELFTEST_KVM_MCE_H +#define SELFTEST_KVM_MCE_H + +#define MCG_CTL_P BIT_ULL(8)/* MCG_CTL register available */ +#define MCG_SER_P BIT_ULL(24)/* MCA recovery/new status bits */ +#define MCG_LMCE_P BIT_ULL(27)/* Local machine check supported */ +#define MCG_CMCI_P BIT_ULL(10)/* CMCI supported */ +#define KVM_MAX_MCE_BANKS 32 +#define MCG_CAP_BANKS_MASK 0xff/* Bit 0-7 of the MCG_CAP register are #banks */ +#define MCI_STATUS_VAL (1ULL << 63)/* valid error */ +#define MCI_STATUS_UC (1ULL << 61)/* uncorrected error */ +#define MCI_STATUS_EN (1ULL << 60)/* error enabled */ +#define MCI_STATUS_MISCV (1ULL << 59)/* misc error reg. valid */ +#define MCI_STATUS_ADDRV (1ULL << 58)/* addr reg. valid */ +#define MCM_ADDR_PHYS 2/* physical address */ +#define MCI_CTL2_CMCI_EN BIT_ULL(30) + +#endif /* SELFTEST_KVM_MCE_H */
tools/testing/selftests/kvm/include/x86_64/processor.h +1 -0
@@ -481,6 +481,7 @@ struct kvm_cpuid2 *kvm_get_supported_hv_cpuid(void);void vcpu_set_hv_cpuid (struct kvm_vm *vm,uint32_t vcpuid);struct kvm_cpuid2 *vcpu_get_supported_hv_cpuid (struct kvm_vm *vm,uint32_t vcpuid);void vm_xsave_req_perm (int bit); +void vcpu_setup (struct kvm_vm *vm,int vcpuid);enum x86_page_size {X86_PAGE_SIZE_4K =0 ,
tools/testing/selftests/kvm/lib/x86_64/processor.c +1 -1
@@ -580,7 +580,7 @@ static void kvm_setup_tss_64bit(struct kvm_vm *vm, struct kvm_segment *segp,kvm_seg_fill_gdt_64bit (vm, segp); } -static void vcpu_setup (struct kvm_vm *vm,int vcpuid) +void vcpu_setup (struct kvm_vm *vm,int vcpuid) {struct kvm_sregs sregs;
tools/testing/selftests/kvm/x86_64/ucna_injection_test.c new file +347 -0
347 lines not on this page · raw message
Signature · 1 line
2.36.1.255.ge46751e96f-goog
Paolo Bonzini
maintainerQuoted 88 lines · Jue Wang
This patch series implement emulation for Corrected Machine Check Interrupt (CMCI) signaling and UnCorrectable No Action required (UCNA) error injection.
UCNA errors signaled via CMCI allow a guest to be notified as soon as uncorrectable memory errors get detected by some background threads, e.g., threads that migrate guest memory across hosts or threads that constantly scan system memory for errors [1].
Upon receiving UCNAs, guest kernel isolates the poisoned pages which may still be free, preventing future accesses that may cause fatal MCEs.
1. https://lore.kernel.org/linux-mm/[email protected]/t/
Patch 1-3 clean up KVM APIC LVT logic in preparation to adding
APIC_LVTCMCI.Patch 4 adds
APIC_LVTCMCIemulation.Patch 5 updates
mce_banksto use array allocation api.Patch 6 adds emulation for
MSR_IA32_MCx_CTL2registers that provide per bank control of CMCI signaling.Patch 7 enables
MCG_CMCI_Pand handles injected UCNA errors.Patch 8 adds a KVM self test that validates UCNA injection and CMCI emulation.
v5 changes
- Incorporate feedback from David Matlack <[email protected]>
- Rewrite the change log to be more concise and accurate.
- Removes several duplicated checks in UCNA injection code.
- Add test cases that validate CMCI emulation to self test.v4 changes
- Incorporate feedback from David Matlack <[email protected]>
- Rewrite the change logs to be more descriptive.
- Add a KVM self test.v3 changes
- Incorporate feedback from Sean Christopherson <[email protected]>
- Split clean up to KVM APIC LVT logic to 3 patches.
- Put the clean up ofmce_arrayallocation in a separate patch.
- Base theMCi_CTL2register emulation on Sean's clean up and fix series [2]
- Fix bugs aroundMCi_CTL2register offset validation and the free ofmci_ctl2_banksarray.
- Rewrite the change log with more details in architectural information about CMCI, UCNA andMCG_CMCI_P.
- Fix various comments and wrapping style.2. https://lore.kernel.org/lkml/[email protected]/T/
v2 chanegs
- Incorporate feedback from Sean Christopherson <[email protected]>
- Split the single patch into 4:
1). clean up KVM APIC LVT logic
2). add CMCI emulation to lapic
3). add emulation ofMSR_IA32_MCx_CTL2
4). enableMCG_CMCI_Pand handle injected UCNAs
- Fix various style issues.Jue Wang (8):
KVM: x86: MakeAPIC_VERSIONcapture only the magic0x14UL.
KVM: x86: Fillapic_lvt_maskwith enums / explicit entries.
KVM: x86: AddAPIC_LVTx()macro.
KVM: x86: Add Corrected Machine Check Interrupt (CMCI) emulation to
lapic.
KVM: x86: Use kcalloc to allocate themce_banksarray.
KVM: x86: Add emulation forMSR_IA32_MCx_CTL2MSRs.
KVM: x86: Enable CMCI capability by default and handle injected UCNA
errors
KVM: selftests: Add a self test for CMCI and UCNA emulations.arch/x86/include/asm/kvm_host.h | 1 + arch/x86/kvm/lapic.c | 66 ++-- arch/x86/kvm/lapic.h | 16 +- arch/x86/kvm/vmx/vmx.c | 1 + arch/x86/kvm/x86.c | 178 ++++++--- tools/testing/selftests/kvm/.gitignore | 1 + tools/testing/selftests/kvm/Makefile | 1 + .../selftests/kvm/include/x86_64/apic.h | 1 + .../selftests/kvm/include/x86_64/mce.h | 25 ++ .../selftests/kvm/include/x86_64/processor.h | 1 + .../selftests/kvm/lib/x86_64/processor.c | 2 +- .../kvm/x86_64/ucna_injection_test.c | 347 ++++++++++++++++++ 12 files changed, 573 insertions(+), 67 deletions(-)
Quoted 3 lines
create mode 100644
tools/testing/selftests/kvm/include/x86_64/mce.hcreate mode 100644tools/testing/selftests/kvm/x86_64/ucna_injection_test.c
Queued, thanks. The test of course required some changes to adapt to the new API.
Paolo
Quoted 4 lines · Jue Wang
This patch series implement emulation for Corrected Machine Check Interrupt (CMCI) signaling and UnCorrectable No Action required (UCNA) error injection.
It seems the main purpose of this series is to allow UCNA error injection and notify it to guest via CMCI.
But it doesn't emulate CMCI fully. E.g., guest's error threshold of MCi_CTL2 doesn't work. It's still controlled by host's value.
Quoted 7 lines · Xiaoyao Li
Quoted 4 lines · Jue Wang
This patch series implement emulation for Corrected Machine Check Interrupt (CMCI) signaling and UnCorrectable No Action required (UCNA) error injection.
Quoted 6 lines
It seems the main purpose of this series is to allow UCNA error injection and notify it to guest via CMCI.
But it doesn't emulate CMCI fully. E.g., guest's error threshold of
MCi_CTL2doesn't work. It's still controlled by host's value.
Both of the above points are correct.
In fact, this series does not enable injecting corrected errors into a KVM guest at all, for:
1. It is not necessary since corrected errors are transparent to software executions (host / guest).
2. Corrected errors can be fully managed on the host side (monitor, re-act).
3. Prevent guest initiated row-hammer attack based on the injected corrected errors feedback loop.
Thanks,
-Jue