KVM: SVM: Advertise TCE to userspace
v2 cover KVM: SVM: Advertise TCE to userspace
Advertise TCE to userspace, allowing guests to set EFER.TCE, potentially gaining some performance. Patchees 1 & 2 are prep work suggested by Sean.
v1: https://lore.kernel.org/kvm/[email protected]/
Venkatesh Srinivas (1):
KVM: SVM: Advertise Translation Cache Extensions to userspace
Yosry Ahmed (2):
KVM: x86: Move some EFER bits enablement to common code
KVM: x86: Use kvm_cpu_cap_has() for EFER bits enablement checks
arch/x86/kvm/cpuid.c | 1 + arch/x86/kvm/svm/svm.c | 7 ------- arch/x86/kvm/vmx/vmx.c | 4 ---- arch/x86/kvm/x86.c | 20 ++++++++++++++++++++ 4 files changed, 21 insertions(+), 11 deletions(-)
base-commit: 5128b972fb2801ad9aca54d990a75611ab5283a9
Signature · 1 line
2.53.0.473.g4a7958ca14-goog
PATCH v2 1/3 KVM: x86: Move some EFER bits enablement to common code
Move EFER bits enablement that only depend on CPU support to common code, as there is no reason to do it in vendor code. Leave EFER.SVME and EFER.LMSLE enablement in SVM code as they depend on vendor module parameters.
Having the enablement in common code ensures that if a vendor starts supporting an existing feature, KVM doesn't end up advertising to userspace but not allowing the EFER bit to be set.
No functional change intended.
--- arch/x86/kvm/svm/svm.c | 7 ------- arch/x86/kvm/vmx/vmx.c | 4 ---- arch/x86/kvm/x86.c | 14 ++++++++++++++ 3 files changed, 14 insertions(+), 11 deletions(-)
arch/x86/kvm/svm/svm.c +0 -7
@@ -5556,14 +5556,10 @@ static __init int svm_hardware_setup(void)pr_err_ratelimited ("NX (Execute Disable) not supported\n" );return -EOPNOTSUPP ; } -kvm_enable_efer_bits (EFER_NX ); kvm_caps.supported_xcr0 &= ~(XFEATURE_MASK_BNDREGS |XFEATURE_MASK_BNDCSR ); -if (boot_cpu_has (X86_FEATURE_FXSR_OPT )) -kvm_enable_efer_bits (EFER_FFXSR ); -if (tsc_scaling) {if (!boot_cpu_has (X86_FEATURE_TSCRATEMSR )) { tsc_scaling = false;
@@ -5577,9 +5573,6 @@ static __init int svm_hardware_setup(void) tsc_aux_uret_slot =kvm_add_user_return_msr (MSR_TSC_AUX ); -if (boot_cpu_has (X86_FEATURE_AUTOIBRS )) -kvm_enable_efer_bits (EFER_AUTOIBRS ); -/* Check for pause filtering support */ if (!boot_cpu_has (X86_FEATURE_PAUSEFILTER )) { pause_filter_count =0 ;
arch/x86/kvm/vmx/vmx.c +0 -4
@@ -8583,10 +8583,6 @@ __init int vmx_hardware_setup(void)vmx_setup_user_return_msrs (); - -if (boot_cpu_has (X86_FEATURE_NX )) -kvm_enable_efer_bits (EFER_NX ); -if (boot_cpu_has (X86_FEATURE_MPX )) {rdmsrq (MSR_IA32_BNDCFGS , host_bndcfgs);WARN_ONCE (host_bndcfgs,"BNDCFGS in host will be lost" );
arch/x86/kvm/x86.c +14 -0
@@ -10025,6 +10025,18 @@ void kvm_setup_xss_caps(void) }EXPORT_SYMBOL_FOR_KVM_INTERNAL (kvm_setup_xss_caps); +static void kvm_setup_efer_caps (void ) +{ +if (boot_cpu_has (X86_FEATURE_NX )) +kvm_enable_efer_bits (EFER_NX ); + +if (boot_cpu_has (X86_FEATURE_FXSR_OPT )) +kvm_enable_efer_bits (EFER_FFXSR ); + +if (boot_cpu_has (X86_FEATURE_AUTOIBRS )) +kvm_enable_efer_bits (EFER_AUTOIBRS ); +} +static inline void kvm_ops_update (struct kvm_x86_init_ops *ops) {memcpy (&kvm_x86_ops, ops->runtime_ops,sizeof (kvm_x86_ops));
@@ -10161,6 +10173,8 @@ int kvm_x86_vendor_init(struct kvm_x86_init_ops *ops)if (r !=0 ) goto out_mmu_exit; +kvm_setup_efer_caps (); + enable_device_posted_irqs &= enable_apicv &&irq_remapping_cap (IRQ_POSTING_CAP );
Signature · 1 line
2.53.0.473.g4a7958ca14-goog
PATCH v2 2/3 KVM: x86: Use kvm_cpu_cap_has() for EFER bits enablement checks
In reply to Yosry AhmedInstead of checking that the hardware supports underlying features for EFER bits, check if KVM supports them. It is practically the same, but this removes a subtle dependency on kvm_set_cpu_caps() enabling the relevant CPUID features.
No functional change intended.
--- arch/x86/kvm/x86.c | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-)
arch/x86/kvm/x86.c +3 -3
@@ -10027,13 +10027,13 @@ EXPORT_SYMBOL_FOR_KVM_INTERNAL(kvm_setup_xss_caps);static void kvm_setup_efer_caps (void ) { -if (boot_cpu_has (X86_FEATURE_NX )) +if (kvm_cpu_cap_has (X86_FEATURE_NX ))kvm_enable_efer_bits (EFER_NX ); -if (boot_cpu_has (X86_FEATURE_FXSR_OPT )) +if (kvm_cpu_cap_has (X86_FEATURE_FXSR_OPT ))kvm_enable_efer_bits (EFER_FFXSR ); -if (boot_cpu_has (X86_FEATURE_AUTOIBRS )) +if (kvm_cpu_cap_has (X86_FEATURE_AUTOIBRS ))kvm_enable_efer_bits (EFER_AUTOIBRS ); }
Signature · 1 line
2.53.0.473.g4a7958ca14-goog
PATCH v2 3/3 KVM: SVM: Advertise Translation Cache Extensions to userspace
In reply to Yosry AhmedFrom: Venkatesh Srinivas <[email protected]>
TCE augments the behavior of TLB invalidating instructions (INVLPG, INVLPGB, and INVPCID) to only invalidate translations for relevant intermediate mappings to the address range, rather than ALL intermdiate translations.
The Linux kernel has been setting EFER.TCE if supported by the CPU since commit 440a65b7d25f ("x86/mm: Enable AMD translation cache extensions"), as it may improve performance.
KVM does not need to do anything to virtualize the feature, only advertise it and allow setting EFER.TCE. If a TLB invalidating instruction is not intercepted, it will behave according to the guest's setting of EFER.TCE as the value will be loaded on VM-Enter. Otherwise, KVM's emulation may invalidate more TLB entries, which is perfectly fine as the CPU is allowed to invalidate more TLB entries that it strictly needs to.
Advertise X86_FEATURE_TCE to userspace, and allow the guest to set EFER.TCE if available.
--- arch/x86/kvm/cpuid.c | 1 + arch/x86/kvm/x86.c | 6 ++++++ 2 files changed, 7 insertions(+)
arch/x86/kvm/cpuid.c +1 -0
@@ -1112,6 +1112,7 @@ void kvm_initialize_cpu_caps(void)F (XOP ),/* SKINIT, WDT, LWP */ F (FMA4 ), +F (TCE ),F (TBM ),F (TOPOEXT ), VENDOR_F(PERFCTR_CORE),
arch/x86/kvm/x86.c +6 -0
@@ -1743,6 +1743,9 @@ static bool __kvm_valid_efer(struct kvm_vcpu *vcpu, u64 efer)if (efer &EFER_NX && !guest_cpu_cap_has (vcpu,X86_FEATURE_NX ))return false; +if (efer &EFER_TCE && !guest_cpu_cap_has (vcpu,X86_FEATURE_TCE )) +return false; +return true; }
@@ -10035,6 +10038,9 @@ static void kvm_setup_efer_caps(void)if (kvm_cpu_cap_has (X86_FEATURE_AUTOIBRS ))kvm_enable_efer_bits (EFER_AUTOIBRS ); + +if (kvm_cpu_cap_has (X86_FEATURE_TCE )) +kvm_enable_efer_bits (EFER_TCE ); }static inline void kvm_ops_update (struct kvm_x86_init_ops *ops)
Signature · 1 line
2.53.0.473.g4a7958ca14-goog
Re: [PATCH v2 3/3] KVM: SVM: Advertise Translation Cache Extensions to userspace
Quoted 19 lines
From: Venkatesh Srinivas <[email protected]>
TCE augments the behavior of TLB invalidating instructions (INVLPG, INVLPGB, and INVPCID) to only invalidate translations for relevant intermediate mappings to the address range, rather than ALL intermdiate translations.
The Linux kernel has been setting EFER.TCE if supported by the CPU since commit
440a65b7d25f("x86/mm: Enable AMD translation cache extensions"), as it may improve performance.KVM does not need to do anything to virtualize the feature, only advertise it and allow setting EFER.TCE. If a TLB invalidating instruction is not intercepted, it will behave according to the guest's setting of EFER.TCE as the value will be loaded on VM-Enter. Otherwise, KVM's emulation may invalidate more TLB entries, which is perfectly fine as the CPU is allowed to invalidate more TLB entries that it strictly needs to.
Quoted 6 lines
Advertise
X86_FEATURE_TCEto userspace, and allow the guest to set EFER.TCE if available.Signed-off-by Venkatesh Srinivas <[email protected]>Co-developed-by Yosry Ahmed <[email protected]>Signed-off-by Yosry Ahmed <[email protected]>
I'll repeat what I said on that referenced patch.
What's the point? AMD have said that TCE doesn't exist any more; it's a bit that's no longer wired into anything.
You've got to get to pre-Zen hardware before this has any behavioural effect, at which point the breath of testing is almost 0.
~Andrew
Re: [PATCH v2 3/3] KVM: SVM: Advertise Translation Cache Extensions to userspace
Quoted 27 lines · Andrew Cooper
Quoted 20 lines
From: Venkatesh Srinivas <[email protected]>
TCE augments the behavior of TLB invalidating instructions (INVLPG, INVLPGB, and INVPCID) to only invalidate translations for relevant intermediate mappings to the address range, rather than ALL intermdiate translations.
The Linux kernel has been setting EFER.TCE if supported by the CPU since commit
440a65b7d25f("x86/mm: Enable AMD translation cache extensions"), as it may improve performance.KVM does not need to do anything to virtualize the feature, only advertise it and allow setting EFER.TCE. If a TLB invalidating instruction is not intercepted, it will behave according to the guest's setting of EFER.TCE as the value will be loaded on VM-Enter. Otherwise, KVM's emulation may invalidate more TLB entries, which is perfectly fine as the CPU is allowed to invalidate more TLB entries that it strictly needs to.
Quoted 6 lines
Advertise
X86_FEATURE_TCEto userspace, and allow the guest to set EFER.TCE if available.Signed-off-by Venkatesh Srinivas <[email protected]>Co-developed-by Yosry Ahmed <[email protected]>Signed-off-by Yosry Ahmed <[email protected]>
Quoted 7 lines
I'll repeat what I said on that referenced patch.
What's the point? AMD have said that TCE doesn't exist any more; it's a bit that's no longer wired into anything.
You've got to get to pre-Zen hardware before this has any behavioural effect, at which point the breath of testing is almost 0.
Oh, I did not know that, thanks for pointing it out.
I'll leave it up to Sean whether to pick this up (because Linux guests still set the bit), just pick up patches 1-2 as cleanups, or drop this entirely.
Sean Christopherson
maintainerRe: [PATCH v2 3/3] KVM: SVM: Advertise Translation Cache Extensions to userspace
Quoted 33 lines · Yosry Ahmed
Quoted 32 lines · Andrew Cooper
Quoted 20 lines
From: Venkatesh Srinivas <[email protected]>
TCE augments the behavior of TLB invalidating instructions (INVLPG, INVLPGB, and INVPCID) to only invalidate translations for relevant intermediate mappings to the address range, rather than ALL intermdiate translations.
The Linux kernel has been setting EFER.TCE if supported by the CPU since commit
440a65b7d25f("x86/mm: Enable AMD translation cache extensions"), as it may improve performance.KVM does not need to do anything to virtualize the feature, only advertise it and allow setting EFER.TCE. If a TLB invalidating instruction is not intercepted, it will behave according to the guest's setting of EFER.TCE as the value will be loaded on VM-Enter. Otherwise, KVM's emulation may invalidate more TLB entries, which is perfectly fine as the CPU is allowed to invalidate more TLB entries that it strictly needs to.
Quoted 6 lines
Advertise
X86_FEATURE_TCEto userspace, and allow the guest to set EFER.TCE if available.Signed-off-by Venkatesh Srinivas <[email protected]>Co-developed-by Yosry Ahmed <[email protected]>Signed-off-by Yosry Ahmed <[email protected]>I'll repeat what I said on that referenced patch.
What's the point? AMD have said that TCE doesn't exist any more; it's a bit that's no longer wired into anything.
Quoted 8 lines
Quoted 2 lines
You've got to get to pre-Zen hardware before this has any behavioural effect, at which point the breath of testing is almost 0.
Oh, I did not know that, thanks for pointing it out.
I'll leave it up to Sean whether to pick this up (because Linux guests still set the bit), just pick up patches 1-2 as cleanups, or drop this entirely.
I'll grab 1-2 and leave 3 alone, at least for now. It _should_ do no harm, but it would really suck to discover that pre-Zen hardware has a TLB bug that affects TCE, or worse, affects TCE but only for ASID!=0 translations or something.
If new CPUs ever use TCE, it'll be trivial to enable at that time.
Re: [PATCH v2 3/3] KVM: SVM: Advertise Translation Cache Extensions to userspace
Quoted 7 lines
Quoted 3 lines
I'll leave it up to Sean whether to pick this up (because Linux guests still set the bit), just pick up patches 1-2 as cleanups, or drop this entirely.
I'll grab 1-2 and leave 3 alone, at least for now. It _should_ do no harm, but it would really suck to discover that pre-Zen hardware has a TLB bug that affects TCE, or worse, affects TCE but only for ASID!=0 translations or something.
Sounds good to me, thanks.
Re: [PATCH v2 3/3] KVM: SVM: Advertise Translation Cache Extensions to userspace
In reply to Andrew CooperQuoted 27 lines · Andrew Cooper
Quoted 20 lines
From: Venkatesh Srinivas <[email protected]>
TCE augments the behavior of TLB invalidating instructions (INVLPG, INVLPGB, and INVPCID) to only invalidate translations for relevant intermediate mappings to the address range, rather than ALL intermdiate translations.
The Linux kernel has been setting EFER.TCE if supported by the CPU since commit
440a65b7d25f("x86/mm: Enable AMD translation cache extensions"), as it may improve performance.KVM does not need to do anything to virtualize the feature, only advertise it and allow setting EFER.TCE. If a TLB invalidating instruction is not intercepted, it will behave according to the guest's setting of EFER.TCE as the value will be loaded on VM-Enter. Otherwise, KVM's emulation may invalidate more TLB entries, which is perfectly fine as the CPU is allowed to invalidate more TLB entries that it strictly needs to.
Quoted 6 lines
Advertise
X86_FEATURE_TCEto userspace, and allow the guest to set EFER.TCE if available.Signed-off-by Venkatesh Srinivas <[email protected]>Co-developed-by Yosry Ahmed <[email protected]>Signed-off-by Yosry Ahmed <[email protected]>
Quoted 7 lines
I'll repeat what I said on that referenced patch.
What's the point? AMD have said that TCE doesn't exist any more; it's a bit that's no longer wired into anything.
You've got to get to pre-Zen hardware before this has any behavioural effect, at which point the breath of testing is almost 0.
Interesting, I missed that. Do you know where AMD said that? (If so, why did we take 440a65b7d25f ("x86/mm: Enable AMD translation cache extensions")?)
Thanks,
-- vs;
Sean Christopherson
maintainerQuoted 10 lines · Yosry Ahmed
Advertise TCE to userspace, allowing guests to set EFER.TCE, potentially gaining some performance. Patchees 1 & 2 are prep work suggested by Sean.
v1: https://lore.kernel.org/kvm/[email protected]/
Venkatesh Srinivas (1):
KVM: SVM: Advertise Translation Cache Extensions to userspace[...]
Applied 1-2 to kvm-x86 misc (several weeks ago, I forgot to send emails before disappearing). Thanks!
[1/2] KVM: x86: Move some EFER bits enablement to common code
https://github.com/kvm-x86/linux/commit/3b27c82ba2f3 [2/2] KVM: x86: Use kvm_cpu_cap_has() for EFER bits enablement checks https://github.com/kvm-x86/linux/commit/d216449f253c
[3/3] KVM: SVM: Advertise Translation Cache Extensions to userspace
DROP