KVM: x86: TDP level cleanups and shadow NPT fix
cover KVM: x86: TDP level cleanups and shadow NPT fix
The primary purpose of this series is to implement a suggestion from Paolo to have the MMU make the decision between 4 and 5 level EPT/TDP (when 5-level page tables are supported). Having the MMU "own" the decision of whether or not to use 5-level paging leads to a variety of nice cleanups, and ultimately gets rid of another kvm_x86_ops.
Patch 1 is a fix for SVM's shadow NPT that is compile tested only. I don't know enough about the shadow NPT details to know if it's a "real" bug or just a supericial oddity that can't actually cause problems.
"Remove temporary WARN on expected vs. actual EPTP level mismatch" could easily be squashed with "Pull the PGD's level from the MMU instead of recalculating it", I threw it in as a separate patch to provide a bisection helper in case things go sideways.
Sean Christopherson (9):
KVM: nSVM: Correctly set the shadow NPT root level in its MMU role
KVM: x86/mmu: Add separate helper for shadow NPT root page role calc
KVM: VMX: Drop a duplicate declaration of construct_eptp()
KVM: VMX: Make vmx_load_mmu_pgd() static
KVM: x86: Pull the PGD's level from the MMU instead of recalculating
it
KVM: VXM: Remove temporary WARN on expected vs. actual EPTP level
mismatch
KVM: x86: Dynamically calculate TDP level from max level and
MAXPHYADDR
KVM: x86/mmu: Rename max_page_level to max_huge_page_level
KVM: x86: Specify max TDP level via kvm_configure_mmu()
arch/x86/include/asm/kvm_host.h | 9 ++--- arch/x86/kvm/cpuid.c | 2 -- arch/x86/kvm/mmu.h | 10 ++++-- arch/x86/kvm/mmu/mmu.c | 63 +++++++++++++++++++++++++-------- arch/x86/kvm/svm/nested.c | 1 - arch/x86/kvm/svm/svm.c | 8 ++--- arch/x86/kvm/vmx/nested.c | 2 +- arch/x86/kvm/vmx/vmx.c | 31 +++++++--------- arch/x86/kvm/vmx/vmx.h | 6 ++-- arch/x86/kvm/x86.c | 1 - 10 files changed, 81 insertions(+), 52 deletions(-)
Signature · 1 line
2.26.0
PATCH 1/9 KVM: nSVM: Correctly set the shadow NPT root level in its MMU role
Move the initialization of shadow NPT MMU's shadow_root_level into kvm_init_shadow_npt_mmu() and explicitly set the level in the shadow NPT MMU's role to be the TDP level. This ensures the role and MMU levels are synchronized and also initialized before __kvm_mmu_new_pgd(), which consumes the level when attempting a fast PGD switch.
--- arch/x86/kvm/mmu/mmu.c | 3 +++ arch/x86/kvm/svm/nested.c | 1 - 2 files changed, 3 insertions(+), 1 deletion(-)
arch/x86/kvm/mmu/mmu.c +3 -0
@@ -4963,6 +4963,9 @@ void kvm_init_shadow_npt_mmu(struct kvm_vcpu *vcpu, u32 cr0, u32 cr4, u32 efer,union kvm_mmu_role new_role =kvm_calc_shadow_mmu_root_page_role (vcpu, false); + new_role.base.level = vcpu->arch.tdp_level; + context->shadow_root_level = new_role.base.level; +__kvm_mmu_new_pgd (vcpu, nested_cr3, new_role.base, false, false);if (new_role.as_u64 != context->mmu_role.as_u64)
arch/x86/kvm/svm/nested.c +0 -1
@@ -85,7 +85,6 @@ static void nested_svm_init_mmu_context(struct kvm_vcpu *vcpu) vcpu->arch.mmu->get_guest_pgd = nested_svm_get_tdp_cr3; vcpu->arch.mmu->get_pdptr = nested_svm_get_tdp_pdptr; vcpu->arch.mmu->inject_page_fault = nested_svm_inject_npf_exit; - vcpu->arch.mmu->shadow_root_level = vcpu->arch.tdp_level;reset_shadow_zero_bits_mask (vcpu, vcpu->arch.mmu); vcpu->arch.walk_mmu = &vcpu->arch.nested_mmu; }
Signature · 1 line
2.26.0
Re: [PATCH 1/9] KVM: nSVM: Correctly set the shadow NPT root level in its MMU role
Quoted 34 lines · Sean Christopherson
Move the initialization of shadow NPT MMU's
shadow_root_levelintokvm_init_shadow_npt_mmu()and explicitly set the level in the shadow NPT MMU's role to be the TDP level. This ensures the role and MMU levels are synchronized and also initialized before__kvm_mmu_new_pgd(), which consumes the level when attempting a fast PGD switch.Cc Vitaly Kuznetsov <[email protected]>Fixes 9fa72119b24db ("kvm: x86: Introduce kvm_mmu_calc_root_page_role()")Fixes a506fdd223426 ("KVM: nSVM: implement nested_svm_load_cr3() and use it for host->guest switch")Signed-off-by Sean Christopherson <[email protected]>--- arch/x86/kvm/mmu/mmu.c | 3 +++ arch/x86/kvm/svm/nested.c | 1 - 2 files changed, 3 insertions(+), 1 deletion(-)arch/x86/kvm/mmu/mmu.c +3
-0@@ -4963,6 +4963,9 @@ void kvm_init_shadow_npt_mmu(struct kvm_vcpu *vcpu, u32 cr0, u32 cr4, u32 efer,union kvm_mmu_role new_role =kvm_calc_shadow_mmu_root_page_role (vcpu, false); + new_role.base.level = vcpu->arch.tdp_level; + context->shadow_root_level = new_role.base.level; +__kvm_mmu_new_pgd (vcpu, nested_cr3, new_role.base, false, false);if (new_role.as_u64 != context->mmu_role.as_u64)arch/x86/kvm/svm/nested.c +0
-0
arch/x86/kvm/svm/nested.c static void nested_svm_init_mmu_context(struct kvm_vcpu *vcpu) · line 90
Quoted 7 lines
arch/x86/kvm/svm/nested.c +0
-1@@ -85,7 +85,6 @@ static void nested_svm_init_mmu_context(struct kvm_vcpu *vcpu) vcpu->arch.mmu->get_guest_pgd = nested_svm_get_tdp_cr3; vcpu->arch.mmu->get_pdptr = nested_svm_get_tdp_pdptr; vcpu->arch.mmu->inject_page_fault = nested_svm_inject_npf_exit; - vcpu->arch.mmu->shadow_root_level = vcpu->arch.tdp_level;reset_shadow_zero_bits_mask (vcpu, vcpu->arch.mmu); vcpu->arch.walk_mmu = &vcpu->arch.nested_mmu; }
FWIW,
Signature · 1 line
Vitaly
PATCH 2/9 KVM: x86/mmu: Add separate helper for shadow NPT root page role calc
In reply to Sean ChristophersonRefactor the shadow NPT role calculation into a separate helper to better differentiate it from the non-nested shadow MMU, e.g. the NPT variant is never direct and derives its root level from the TDP level.
--- arch/x86/kvm/mmu/mmu.c | 30 +++++++++++++++++++++++++----- 1 file changed, 25 insertions(+), 5 deletions(-)
arch/x86/kvm/mmu/mmu.c +25 -5
@@ -4908,7 +4908,7 @@ static void init_kvm_tdp_mmu(struct kvm_vcpu *vcpu) }static union kvm_mmu_role -kvm_calc_shadow_mmu_root_page_role (struct kvm_vcpu *vcpu,bool base_only) +kvm_calc_shadow_root_page_role_common (struct kvm_vcpu *vcpu,bool base_only) {union kvm_mmu_role role =kvm_calc_mmu_role_common (vcpu, base_only);
@@ -4916,9 +4916,19 @@ kvm_calc_shadow_mmu_root_page_role(struct kvm_vcpu *vcpu, bool base_only) !is_write_protection (vcpu); role.base.smap_andnot_wp = role.ext.cr4_smap && !is_write_protection (vcpu); - role.base.direct = !is_paging (vcpu); role.base.gpte_is_8_bytes = !!is_pae (vcpu); +return role; +} + +static union kvm_mmu_role +kvm_calc_shadow_mmu_root_page_role (struct kvm_vcpu *vcpu,bool base_only) +{ +union kvm_mmu_role role = +kvm_calc_shadow_root_page_role_common (vcpu, base_only); + + role.base.direct = !is_paging (vcpu); +if (!is_long_mode (vcpu)) role.base.level =PT32E_ROOT_LEVEL ;else if (is_la57_mode (vcpu))
@@ -4956,14 +4966,24 @@ static void kvm_init_shadow_mmu(struct kvm_vcpu *vcpu, u32 cr0, u32 cr4, u32 efeshadow_mmu_init_context (vcpu, context, cr0, cr4, efer, new_role); } +static union kvm_mmu_role +kvm_calc_shadow_npt_root_page_role (struct kvm_vcpu *vcpu) +{ +union kvm_mmu_role role = +kvm_calc_shadow_root_page_role_common (vcpu, false); + + role.base.direct = false; + role.base.level = vcpu->arch.tdp_level; + +return role; +} +void kvm_init_shadow_npt_mmu (struct kvm_vcpu *vcpu,u32 cr0,u32 cr4,u32 efer,gpa_t nested_cr3) {struct kvm_mmu *context = &vcpu->arch.guest_mmu; -union kvm_mmu_role new_role = -kvm_calc_shadow_mmu_root_page_role (vcpu, false); +union kvm_mmu_role new_role =kvm_calc_shadow_npt_root_page_role (vcpu); - new_role.base.level = vcpu->arch.tdp_level; context->shadow_root_level = new_role.base.level;__kvm_mmu_new_pgd (vcpu, nested_cr3, new_role.base, false, false);
Signature · 1 line
2.26.0
Re: [PATCH 2/9] KVM: x86/mmu: Add separate helper for shadow NPT root page role calc
Quoted 61 lines · Sean Christopherson
Refactor the shadow NPT role calculation into a separate helper to better differentiate it from the non-nested shadow MMU, e.g. the NPT variant is never direct and derives its root level from the TDP level.
Signed-off-by Sean Christopherson <[email protected]>--- arch/x86/kvm/mmu/mmu.c | 30 +++++++++++++++++++++++++----- 1 file changed, 25 insertions(+), 5 deletions(-)arch/x86/kvm/mmu/mmu.c +24
-2@@ -4908,7 +4908,7 @@ static void init_kvm_tdp_mmu(struct kvm_vcpu *vcpu) }static union kvm_mmu_role -kvm_calc_shadow_mmu_root_page_role (struct kvm_vcpu *vcpu,bool base_only) +kvm_calc_shadow_root_page_role_common (struct kvm_vcpu *vcpu,bool base_only) {union kvm_mmu_role role =kvm_calc_mmu_role_common (vcpu, base_only);@@ -4916,9 +4916,19 @@ kvm_calc_shadow_mmu_root_page_role(struct kvm_vcpu *vcpu, bool base_only) !is_write_protection (vcpu); role.base.smap_andnot_wp = role.ext.cr4_smap && !is_write_protection (vcpu); - role.base.direct = !is_paging (vcpu); role.base.gpte_is_8_bytes = !!is_pae (vcpu); +return role; +} + +static union kvm_mmu_role +kvm_calc_shadow_mmu_root_page_role (struct kvm_vcpu *vcpu,bool base_only) +{ +union kvm_mmu_role role = +kvm_calc_shadow_root_page_role_common (vcpu, base_only); + + role.base.direct = !is_paging (vcpu); +if (!is_long_mode (vcpu)) role.base.level =PT32E_ROOT_LEVEL ;else if (is_la57_mode (vcpu))@@ -4956,14 +4966,24 @@ static void kvm_init_shadow_mmu(struct kvm_vcpu *vcpu, u32 cr0, u32 cr4, u32 efeshadow_mmu_init_context (vcpu, context, cr0, cr4, efer, new_role); } +static union kvm_mmu_role +kvm_calc_shadow_npt_root_page_role (struct kvm_vcpu *vcpu) +{ +union kvm_mmu_role role = +kvm_calc_shadow_root_page_role_common (vcpu, false); + + role.base.direct = false; + role.base.level = vcpu->arch.tdp_level; + +return role; +} +void kvm_init_shadow_npt_mmu (struct kvm_vcpu *vcpu,u32 cr0,u32 cr4,u32 efer,gpa_t nested_cr3)
arch/x86/kvm/mmu/mmu.c static void kvm_init_shadow_mmu(struct kvm_vcpu *vcpu, u32 cr0, u32 cr4, u32 efe · line 4989
Quoted 10 lines
arch/x86/kvm/mmu/mmu.c +1
-3{struct kvm_mmu *context = &vcpu->arch.guest_mmu; -union kvm_mmu_role new_role = -kvm_calc_shadow_mmu_root_page_role (vcpu, false); +union kvm_mmu_role new_role =kvm_calc_shadow_npt_root_page_role (vcpu); - new_role.base.level = vcpu->arch.tdp_level; context->shadow_root_level = new_role.base.level;__kvm_mmu_new_pgd (vcpu, nested_cr3, new_role.base, false, false);
Signature · 1 line
Vitaly
PATCH 3/9 KVM: VMX: Drop a duplicate declaration of construct_eptp()
In reply to Sean ChristophersonRemove an extra declaration of construct_eptp() from vmx.h.
--- arch/x86/kvm/vmx/vmx.h | 2 -- 1 file changed, 2 deletions(-)
arch/x86/kvm/vmx/vmx.h +0 -2
@@ -537,8 +537,6 @@ static inline struct vmcs *alloc_vmcs(bool shadow) GFP_KERNEL_ACCOUNT); } -u64 construct_eptp (struct kvm_vcpu *vcpu,unsigned long root_hpa); -static inline void decache_tsc_multiplier (struct vcpu_vmx *vmx) { vmx->current_tsc_ratio = vmx->vcpu.arch.tsc_scaling_ratio;
Signature · 1 line
2.26.0
PATCH 4/9 KVM: VMX: Make vmx_load_mmu_pgd() static
In reply to Sean ChristophersonMake vmx_load_mmu_pgd() static as it is no longer invoked directly by nested VMX (or any code for that matter).
No functional change intended.
--- arch/x86/kvm/vmx/vmx.c | 2 +- arch/x86/kvm/vmx/vmx.h | 1 - 2 files changed, 1 insertion(+), 2 deletions(-)
arch/x86/kvm/vmx/vmx.c +1 -1
@@ -3092,7 +3092,7 @@ u64 construct_eptp(struct kvm_vcpu *vcpu, unsigned long root_hpa)return eptp; } -void vmx_load_mmu_pgd (struct kvm_vcpu *vcpu,unsigned long pgd) +static void vmx_load_mmu_pgd (struct kvm_vcpu *vcpu,unsigned long pgd) {struct kvm *kvm = vcpu->kvm;bool update_guest_cr3 = true;
arch/x86/kvm/vmx/vmx.h +0 -1
@@ -338,7 +338,6 @@ void vmx_set_efer(struct kvm_vcpu *vcpu, u64 efer);void vmx_set_cr0 (struct kvm_vcpu *vcpu,unsigned long cr0);int vmx_set_cr4 (struct kvm_vcpu *vcpu,unsigned long cr4);void set_cr4_guest_host_mask (struct vcpu_vmx *vmx); -void vmx_load_mmu_pgd (struct kvm_vcpu *vcpu,unsigned long cr3);void ept_save_pdptrs (struct kvm_vcpu *vcpu);void vmx_get_segment (struct kvm_vcpu *vcpu,struct kvm_segment *var,int seg);void vmx_set_segment (struct kvm_vcpu *vcpu,struct kvm_segment *var,int seg);
Signature · 1 line
2.26.0
PATCH 5/9 KVM: x86: Pull the PGD's level from the MMU instead of recalculating it
In reply to Sean ChristophersonUse the shadow_root_level from the current MMU as the root level for the PGD, i.e. for VMX's EPTP. This eliminates the weird dependency between VMX and the MMU where both must independently calculate the same root level for things to work correctly. Temporarily keep VMX's calculation of the level and use it to WARN if the incoming level diverges.
Opportunistically refactor kvm_mmu_load_pgd() to avoid indentation hell, and rename a 'cr3' param in the load_mmu_pgd prototype that managed to survive the cr3 purge.
No functional change intended.
--- arch/x86/include/asm/kvm_host.h | 3 ++- arch/x86/kvm/mmu.h | 10 +++++++--- arch/x86/kvm/svm/svm.c | 3 ++- arch/x86/kvm/vmx/nested.c | 2 +- arch/x86/kvm/vmx/vmx.c | 18 ++++++++++++------ arch/x86/kvm/vmx/vmx.h | 3 ++- 6 files changed, 26 insertions(+), 13 deletions(-)
arch/x86/include/asm/kvm_host.h +2 -1
@@ -1136,7 +1136,8 @@ struct kvm_x86_ops {int (*get_tdp_level)(struct kvm_vcpu *vcpu);u64 (*get_mt_mask)(struct kvm_vcpu *vcpu,gfn_t gfn,bool is_mmio); -void (*load_mmu_pgd)(struct kvm_vcpu *vcpu,unsigned long cr3); +void (*load_mmu_pgd)(struct kvm_vcpu *vcpu,unsigned long pgd, +int pgd_level);bool (*has_wbinvd_exit)(void );
arch/x86/kvm/mmu.h +7 -3
@@ -90,9 +90,13 @@ static inline unsigned long kvm_get_active_pcid(struct kvm_vcpu *vcpu)static inline void kvm_mmu_load_pgd (struct kvm_vcpu *vcpu) { -if (VALID_PAGE (vcpu->arch.mmu->root_hpa)) - kvm_x86_ops.load_mmu_pgd (vcpu, vcpu->arch.mmu->root_hpa | -kvm_get_active_pcid (vcpu)); +u64 root_hpa = vcpu->arch.mmu->root_hpa; + +if (!VALID_PAGE (root_hpa)) +return ; + + kvm_x86_ops.load_mmu_pgd (vcpu, root_hpa |kvm_get_active_pcid (vcpu), + vcpu->arch.mmu->shadow_root_level); } int kvm_tdp_page_fault(struct kvm_vcpu *vcpu, gpa_t gpa, u32 error_code,
arch/x86/kvm/svm/svm.c +2 -1
@@ -3541,7 +3541,8 @@ static __no_kcsan fastpath_t svm_vcpu_run(struct kvm_vcpu *vcpu)return exit_fastpath; } -static void svm_load_mmu_pgd (struct kvm_vcpu *vcpu,unsigned long root) +static void svm_load_mmu_pgd (struct kvm_vcpu *vcpu,unsigned long root, +int root_level) {struct vcpu_svm *svm =to_svm (vcpu);unsigned long cr3;
arch/x86/kvm/vmx/nested.c +1 -1
@@ -2162,7 +2162,7 @@ static void prepare_vmcs02_constant_state(struct vcpu_vmx *vmx)* consistency checks. */ if (enable_ept && nested_early_check) -vmcs_write64 (EPT_POINTER ,construct_eptp (&vmx->vcpu,0 )); +vmcs_write64 (EPT_POINTER ,construct_eptp (&vmx->vcpu,0 ,4 ));/* All VMFUNCs are currently emulated through L0 vmexits. */ if (cpu_has_vmx_vmfunc ())
arch/x86/kvm/vmx/vmx.c +12 -6
@@ -2933,14 +2933,16 @@ static void vmx_flush_tlb_all(struct kvm_vcpu *vcpu)static void vmx_flush_tlb_current (struct kvm_vcpu *vcpu) { -u64 root_hpa = vcpu->arch.mmu->root_hpa; +struct kvm_mmu *mmu = vcpu->arch.mmu; +u64 root_hpa = mmu->root_hpa;/* No flush required if the current context is invalid. */ if (!VALID_PAGE (root_hpa))return ;if (enable_ept) -ept_sync_context (construct_eptp (vcpu, root_hpa)); +ept_sync_context (construct_eptp (vcpu, root_hpa, + mmu->shadow_root_level));else if (!is_guest_mode (vcpu))vpid_sync_context (to_vmx (vcpu)->vpid);else
@@ -3078,11 +3080,12 @@ static int get_ept_level(struct kvm_vcpu *vcpu)return vmx_get_tdp_level (vcpu); } -u64 construct_eptp (struct kvm_vcpu *vcpu,unsigned long root_hpa) +u64 construct_eptp (struct kvm_vcpu *vcpu,unsigned long root_hpa, +int root_level) {u64 eptp =VMX_EPTP_MT_WB ; - eptp |= (get_ept_level (vcpu) ==5 ) ?VMX_EPTP_PWL_5 :VMX_EPTP_PWL_4 ; + eptp |= (root_level ==5 ) ?VMX_EPTP_PWL_5 :VMX_EPTP_PWL_4 ;if (enable_ept_ad_bits && (!is_guest_mode (vcpu) ||nested_ept_ad_enabled (vcpu)))
@@ -3092,7 +3095,8 @@ u64 construct_eptp(struct kvm_vcpu *vcpu, unsigned long root_hpa)return eptp; } -static void vmx_load_mmu_pgd (struct kvm_vcpu *vcpu,unsigned long pgd) +static void vmx_load_mmu_pgd (struct kvm_vcpu *vcpu,unsigned long pgd, +int pgd_level) {struct kvm *kvm = vcpu->kvm;bool update_guest_cr3 = true;
@@ -3100,7 +3104,9 @@ static void vmx_load_mmu_pgd(struct kvm_vcpu *vcpu, unsigned long pgd)u64 eptp;if (enable_ept) { - eptp =construct_eptp (vcpu, pgd); +WARN_ON (pgd_level !=get_ept_level (vcpu)); + + eptp =construct_eptp (vcpu, pgd, pgd_level);vmcs_write64 (EPT_POINTER , eptp);if (kvm_x86_ops.tlb_remote_flush) {
arch/x86/kvm/vmx/vmx.h +2 -1
@@ -341,7 +341,8 @@ void set_cr4_guest_host_mask(struct vcpu_vmx *vmx);void ept_save_pdptrs (struct kvm_vcpu *vcpu);void vmx_get_segment (struct kvm_vcpu *vcpu,struct kvm_segment *var,int seg);void vmx_set_segment (struct kvm_vcpu *vcpu,struct kvm_segment *var,int seg); -u64 construct_eptp (struct kvm_vcpu *vcpu,unsigned long root_hpa); +u64 construct_eptp (struct kvm_vcpu *vcpu,unsigned long root_hpa, +int root_level);void update_exception_bitmap (struct kvm_vcpu *vcpu);void vmx_update_msr_bitmap (struct kvm_vcpu *vcpu);bool vmx_nmi_blocked (struct kvm_vcpu *vcpu);
Signature · 1 line
2.26.0
Re: [PATCH 5/9] KVM: x86: Pull the PGD's level from the MMU instead of recalculating it
Quoted 76 lines · Sean Christopherson
Use the
shadow_root_levelfrom the current MMU as the root level for the PGD, i.e. for VMX's EPTP. This eliminates the weird dependency between VMX and the MMU where both must independently calculate the same root level for things to work correctly. Temporarily keep VMX's calculation of the level and use it to WARN if the incoming level diverges.Opportunistically refactor
kvm_mmu_load_pgd()to avoid indentation hell, and rename a 'cr3' param in theload_mmu_pgdprototype that managed to survive the cr3 purge.No functional change intended.
Signed-off-by Sean Christopherson <[email protected]>--- arch/x86/include/asm/kvm_host.h | 3 ++- arch/x86/kvm/mmu.h | 10 +++++++--- arch/x86/kvm/svm/svm.c | 3 ++- arch/x86/kvm/vmx/nested.c | 2 +- arch/x86/kvm/vmx/vmx.c | 18 ++++++++++++------ arch/x86/kvm/vmx/vmx.h | 3 ++- 6 files changed, 26 insertions(+), 13 deletions(-)arch/x86/include/asm/kvm_host.h +2
-1@@ -1136,7 +1136,8 @@ struct kvm_x86_ops {int (*get_tdp_level)(struct kvm_vcpu *vcpu);u64 (*get_mt_mask)(struct kvm_vcpu *vcpu,gfn_t gfn,bool is_mmio); -void (*load_mmu_pgd)(struct kvm_vcpu *vcpu,unsigned long cr3); +void (*load_mmu_pgd)(struct kvm_vcpu *vcpu,unsigned long pgd, +int pgd_level);bool (*has_wbinvd_exit)(void );arch/x86/kvm/mmu.h +7
-3@@ -90,9 +90,13 @@ static inline unsigned long kvm_get_active_pcid(struct kvm_vcpu *vcpu)static inline void kvm_mmu_load_pgd (struct kvm_vcpu *vcpu) { -if (VALID_PAGE (vcpu->arch.mmu->root_hpa)) - kvm_x86_ops.load_mmu_pgd (vcpu, vcpu->arch.mmu->root_hpa | -kvm_get_active_pcid (vcpu)); +u64 root_hpa = vcpu->arch.mmu->root_hpa; + +if (!VALID_PAGE (root_hpa)) +return ; + + kvm_x86_ops.load_mmu_pgd (vcpu, root_hpa |kvm_get_active_pcid (vcpu), + vcpu->arch.mmu->shadow_root_level); } int kvm_tdp_page_fault(struct kvm_vcpu *vcpu, gpa_t gpa, u32 error_code,arch/x86/kvm/svm/svm.c +2
-1@@ -3541,7 +3541,8 @@ static __no_kcsan fastpath_t svm_vcpu_run(struct kvm_vcpu *vcpu)return exit_fastpath; } -static void svm_load_mmu_pgd (struct kvm_vcpu *vcpu,unsigned long root) +static void svm_load_mmu_pgd (struct kvm_vcpu *vcpu,unsigned long root, +int root_level) {struct vcpu_svm *svm =to_svm (vcpu);unsigned long cr3;arch/x86/kvm/vmx/nested.c +0
-0
arch/x86/kvm/vmx/nested.c static void prepare_vmcs02_constant_state(struct vcpu_vmx *vmx) · line 2165
Quoted 5 lines
arch/x86/kvm/vmx/nested.c +1
-1@@ -2162,7 +2162,7 @@ static void prepare_vmcs02_constant_state(struct vcpu_vmx *vmx)* consistency checks. */ if (enable_ept && nested_early_check) -vmcs_write64 (EPT_POINTER ,construct_eptp (&vmx->vcpu,0 )); +vmcs_write64 (EPT_POINTER ,construct_eptp (&vmx->vcpu,0 ,4 ));
Nit: could we use MMU's PT64_ROOT_4LEVEL instead of '4' here?
Quoted 76 lines
arch/x86/kvm/vmx/nested.c +0
-0/* All VMFUNCs are currently emulated through L0 vmexits. */ if (cpu_has_vmx_vmfunc ())arch/x86/kvm/vmx/vmx.c +12
-6@@ -2933,14 +2933,16 @@ static void vmx_flush_tlb_all(struct kvm_vcpu *vcpu)static void vmx_flush_tlb_current (struct kvm_vcpu *vcpu) { -u64 root_hpa = vcpu->arch.mmu->root_hpa; +struct kvm_mmu *mmu = vcpu->arch.mmu; +u64 root_hpa = mmu->root_hpa;/* No flush required if the current context is invalid. */ if (!VALID_PAGE (root_hpa))return ;if (enable_ept) -ept_sync_context (construct_eptp (vcpu, root_hpa)); +ept_sync_context (construct_eptp (vcpu, root_hpa, + mmu->shadow_root_level));else if (!is_guest_mode (vcpu))vpid_sync_context (to_vmx (vcpu)->vpid);else @@ -3078,11 +3080,12 @@ static int get_ept_level(struct kvm_vcpu *vcpu)return vmx_get_tdp_level (vcpu); } -u64 construct_eptp (struct kvm_vcpu *vcpu,unsigned long root_hpa) +u64 construct_eptp (struct kvm_vcpu *vcpu,unsigned long root_hpa, +int root_level) {u64 eptp =VMX_EPTP_MT_WB ; - eptp |= (get_ept_level (vcpu) ==5 ) ?VMX_EPTP_PWL_5 :VMX_EPTP_PWL_4 ; + eptp |= (root_level ==5 ) ?VMX_EPTP_PWL_5 :VMX_EPTP_PWL_4 ;if (enable_ept_ad_bits && (!is_guest_mode (vcpu) ||nested_ept_ad_enabled (vcpu)))@@ -3092,7 +3095,8 @@ u64 construct_eptp(struct kvm_vcpu *vcpu, unsigned long root_hpa)return eptp; } -static void vmx_load_mmu_pgd (struct kvm_vcpu *vcpu,unsigned long pgd) +static void vmx_load_mmu_pgd (struct kvm_vcpu *vcpu,unsigned long pgd, +int pgd_level) {struct kvm *kvm = vcpu->kvm;bool update_guest_cr3 = true;@@ -3100,7 +3104,9 @@ static void vmx_load_mmu_pgd(struct kvm_vcpu *vcpu, unsigned long pgd)u64 eptp;if (enable_ept) { - eptp =construct_eptp (vcpu, pgd); +WARN_ON (pgd_level !=get_ept_level (vcpu)); + + eptp =construct_eptp (vcpu, pgd, pgd_level);vmcs_write64 (EPT_POINTER , eptp);if (kvm_x86_ops.tlb_remote_flush) {arch/x86/kvm/vmx/vmx.h +2
-1@@ -341,7 +341,8 @@ void set_cr4_guest_host_mask(struct vcpu_vmx *vmx);void ept_save_pdptrs (struct kvm_vcpu *vcpu);void vmx_get_segment (struct kvm_vcpu *vcpu,struct kvm_segment *var,int seg);void vmx_set_segment (struct kvm_vcpu *vcpu,struct kvm_segment *var,int seg); -u64 construct_eptp (struct kvm_vcpu *vcpu,unsigned long root_hpa); +u64 construct_eptp (struct kvm_vcpu *vcpu,unsigned long root_hpa, +int root_level);void update_exception_bitmap (struct kvm_vcpu *vcpu);void vmx_update_msr_bitmap (struct kvm_vcpu *vcpu);bool vmx_nmi_blocked (struct kvm_vcpu *vcpu);
Signature · 1 line
Vitaly
Re: [PATCH 5/9] KVM: x86: Pull the PGD's level from the MMU instead of recalculating it
Quoted 13 lines · Vitaly Kuznetsov
arch/x86/kvm/vmx/nested.c static void prepare_vmcs02_constant_state(struct vcpu_vmx *vmx) · line 2165
Quoted 10 lines · Sean Christopherson
arch/x86/kvm/vmx/nested.c +1
-1@@ -2162,7 +2162,7 @@ static void prepare_vmcs02_constant_state(struct vcpu_vmx *vmx)* consistency checks. */ if (enable_ept && nested_early_check) -vmcs_write64 (EPT_POINTER ,construct_eptp (&vmx->vcpu,0 )); +vmcs_write64 (EPT_POINTER ,construct_eptp (&vmx->vcpu,0 ,4 ));Nit: could we use MMU's
PT64_ROOT_4LEVELinstead of '4' here?
My strategy of procrastinating until Paolo queued the series paid off.
Short answer, yes, that could be done. But to be consistent we'd want to change vmx_get_max_tdp_level() and kvm_mmu_get_tdp_level() to also use PT64_ROOT_4LEVEL and PT64_ROOT_5LEVEL, and for me at least that doesn't improve readability.
PATCH 6/9 KVM: VXM: Remove temporary WARN on expected vs. actual EPTP level mismatch
In reply to Sean ChristophersonRemove the WARN in vmx_load_mmu_pgd() that was temporarily added to aid bisection/debug in the event the current MMU's shadow root level didn't match VMX's computed EPTP level.
--- arch/x86/kvm/vmx/vmx.c | 10 ---------- 1 file changed, 10 deletions(-)
arch/x86/kvm/vmx/vmx.c +0 -10
@@ -3072,14 +3072,6 @@ static int vmx_get_tdp_level(struct kvm_vcpu *vcpu)return 4 ; } -static int get_ept_level (struct kvm_vcpu *vcpu) -{ -if (is_guest_mode (vcpu) &&nested_cpu_has_ept (get_vmcs12 (vcpu))) -return vmx_eptp_page_walk_level (nested_ept_get_eptp (vcpu)); - -return vmx_get_tdp_level (vcpu); -} -u64 construct_eptp (struct kvm_vcpu *vcpu,unsigned long root_hpa,int root_level) {
@@ -3104,8 +3096,6 @@ static void vmx_load_mmu_pgd(struct kvm_vcpu *vcpu, unsigned long pgd,u64 eptp;if (enable_ept) { -WARN_ON (pgd_level !=get_ept_level (vcpu)); - eptp =construct_eptp (vcpu, pgd, pgd_level);vmcs_write64 (EPT_POINTER , eptp);
Signature · 1 line
2.26.0
PATCH 7/9 KVM: x86: Dynamically calculate TDP level from max level and MAXPHYADDR
In reply to Sean ChristophersonCalculate the desired TDP level on the fly using the max TDP level and MAXPHYADDR instead of doing the same when CPUID is updated. This avoids the hidden dependency on cpuid_maxphyaddr() in vmx_get_tdp_level() and also standardizes the "use 5-level paging iff MAXPHYADDR > 48" behavior across x86.
--- arch/x86/include/asm/kvm_host.h | 4 ++-- arch/x86/kvm/cpuid.c | 2 -- arch/x86/kvm/mmu/mmu.c | 17 +++++++++++++---- arch/x86/kvm/svm/svm.c | 4 ++-- arch/x86/kvm/vmx/vmx.c | 6 +++--- arch/x86/kvm/x86.c | 2 +- 6 files changed, 21 insertions(+), 14 deletions(-)
arch/x86/include/asm/kvm_host.h +2 -2
@@ -639,7 +639,7 @@ struct kvm_vcpu_arch {struct kvm_cpuid_entry2 cpuid_entries[KVM_MAX_CPUID_ENTRIES ];int maxphyaddr; -int tdp_level; +int max_tdp_level;/* emulate context */
@@ -1133,7 +1133,7 @@ struct kvm_x86_ops {int (*sync_pir_to_irr)(struct kvm_vcpu *vcpu);int (*set_tss_addr)(struct kvm *kvm,unsigned int addr);int (*set_identity_map_addr)(struct kvm *kvm,u64 ident_addr); -int (*get_tdp_level)(struct kvm_vcpu *vcpu); +int (*get_max_tdp_level)(void );u64 (*get_mt_mask)(struct kvm_vcpu *vcpu,gfn_t gfn,bool is_mmio); void (*load_mmu_pgd)(struct kvm_vcpu *vcpu, unsigned long pgd,
arch/x86/kvm/cpuid.c +0 -2
@@ -140,9 +140,7 @@ static void kvm_vcpu_after_set_cpuid(struct kvm_vcpu *vcpu) vcpu->arch.guest_supported_xcr0 = (best->eax | ((u64 )best->edx <<32 )) & supported_xcr0; -/* Note, maxphyaddr must be updated before tdp_level. */ vcpu->arch.maxphyaddr =cpuid_query_maxphyaddr (vcpu); - vcpu->arch.tdp_level = kvm_x86_ops.get_tdp_level (vcpu);kvm_mmu_reset_context (vcpu);kvm_pmu_refresh (vcpu);
arch/x86/kvm/mmu/mmu.c +13 -4
@@ -4846,13 +4846,22 @@ static union kvm_mmu_role kvm_calc_mmu_role_common(struct kvm_vcpu *vcpu,return role; } +static inline int kvm_mmu_get_tdp_level (struct kvm_vcpu *vcpu) +{ +/* Use 5-level TDP if and only if it's useful/necessary. */ +if (vcpu->arch.max_tdp_level ==5 &&cpuid_maxphyaddr (vcpu) <=48 ) +return 4 ; + +return vcpu->arch.max_tdp_level; +} +static union kvm_mmu_role kvm_calc_tdp_mmu_root_page_role (struct kvm_vcpu *vcpu,bool base_only) {union kvm_mmu_role role =kvm_calc_mmu_role_common (vcpu, base_only); role.base.ad_disabled = (shadow_accessed_mask ==0 ); - role.base.level = vcpu->arch.tdp_level; + role.base.level =kvm_mmu_get_tdp_level (vcpu); role.base.direct = true; role.base.gpte_is_8_bytes = true;
@@ -4873,7 +4882,7 @@ static void init_kvm_tdp_mmu(struct kvm_vcpu *vcpu) context->sync_page = nonpaging_sync_page; context->invlpg =NULL ; context->update_pte = nonpaging_update_pte; - context->shadow_root_level = vcpu->arch.tdp_level; + context->shadow_root_level =kvm_mmu_get_tdp_level (vcpu); context->direct_map = true; context->get_guest_pgd = get_cr3; context->get_pdptr = kvm_pdptr_read;
@@ -4973,7 +4982,7 @@ kvm_calc_shadow_npt_root_page_role(struct kvm_vcpu *vcpu)kvm_calc_shadow_root_page_role_common (vcpu, false); role.base.direct = false; - role.base.level = vcpu->arch.tdp_level; + role.base.level =kvm_mmu_get_tdp_level (vcpu);return role; }
@@ -5683,7 +5692,7 @@ static int alloc_mmu_pages(struct kvm_vcpu *vcpu, struct kvm_mmu *mmu)* SVM's 32-bit NPT support, TDP paging doesn't use PAE paging and can * skip allocating the PDP table. */ -if (tdp_enabled && vcpu->arch.tdp_level >PT32E_ROOT_LEVEL ) +if (tdp_enabled &&kvm_mmu_get_tdp_level (vcpu) >PT32E_ROOT_LEVEL )return 0 ; page =alloc_page (GFP_KERNEL_ACCOUNT | __GFP_DMA32);
arch/x86/kvm/svm/svm.c +2 -2
@@ -254,7 +254,7 @@ static inline void invlpga(unsigned long addr, u32 asid) asm volatile (__ex("invlpga %1, %0") : : "c"(asid), "a"(addr)); } -static int get_npt_level (struct kvm_vcpu *vcpu) +static int get_max_npt_level (void ) {#ifdef CONFIG_X86_64 return PT64_ROOT_4LEVEL ;
@@ -4109,7 +4109,7 @@ static struct kvm_x86_ops svm_x86_ops __initdata = { .set_tss_addr = svm_set_tss_addr, .set_identity_map_addr = svm_set_identity_map_addr, - .get_tdp_level = get_npt_level, + .get_max_tdp_level = get_max_npt_level, .get_mt_mask = svm_get_mt_mask, .get_exit_info = svm_get_exit_info,
arch/x86/kvm/vmx/vmx.c +3 -3
@@ -3065,9 +3065,9 @@ void vmx_set_cr0(struct kvm_vcpu *vcpu, unsigned long cr0) vmx->emulation_required =emulation_required (vcpu); } -static int vmx_get_tdp_level (struct kvm_vcpu *vcpu) +static int vmx_get_max_tdp_level (void ) { -if (cpu_has_vmx_ept_5levels () && (cpuid_maxphyaddr (vcpu) >48 )) +if (cpu_has_vmx_ept_5levels ())return 5 ;return 4 ; }
@@ -7959,7 +7959,7 @@ static struct kvm_x86_ops vmx_x86_ops __initdata = { .set_tss_addr = vmx_set_tss_addr, .set_identity_map_addr = vmx_set_identity_map_addr, - .get_tdp_level = vmx_get_tdp_level, + .get_max_tdp_level = vmx_get_max_tdp_level, .get_mt_mask = vmx_get_mt_mask, .get_exit_info = vmx_get_exit_info,
arch/x86/kvm/x86.c +1 -1
@@ -9520,7 +9520,7 @@ int kvm_arch_vcpu_create(struct kvm_vcpu *vcpu)fx_init (vcpu); vcpu->arch.maxphyaddr =cpuid_query_maxphyaddr (vcpu); - vcpu->arch.tdp_level = kvm_x86_ops.get_tdp_level (vcpu); + vcpu->arch.max_tdp_level = kvm_x86_ops.get_max_tdp_level (); vcpu->arch.pat =MSR_IA32_CR_PAT_DEFAULT ;
Signature · 1 line
2.26.0
PATCH 8/9 KVM: x86/mmu: Rename max_page_level to max_huge_page_level
In reply to Sean ChristophersonRename max_page_level to explicitly call out that it tracks the max huge page level so as to avoid confusion when a future patch moves the max TDP level, i.e. max root level, into the MMU and kvm_configure_mmu().
--- arch/x86/kvm/mmu/mmu.c | 14 +++++++------- 1 file changed, 7 insertions(+), 7 deletions(-)
arch/x86/kvm/mmu/mmu.c +7 -7
@@ -92,7 +92,7 @@ module_param_named(flush_on_reuse, force_flush_and_sync_on_reuse, bool, 0644);*/ bool tdp_enabled = false; -static int max_page_level__read_mostly ; +static int max_huge_page_level__read_mostly ;enum {AUDIT_PRE_PAGE_FAULT ,
@@ -3256,7 +3256,7 @@ static int kvm_mmu_hugepage_adjust(struct kvm_vcpu *vcpu, gfn_t gfn,if (!slot)return PG_LEVEL_4K ; - max_level =min (max_level, max_page_level); + max_level =min (max_level, max_huge_page_level);for ( ; max_level >PG_LEVEL_4K ; max_level--) { linfo =lpage_info_slot (gfn, slot, max_level);if (!linfo->disallow_lpage)
@@ -5580,23 +5580,23 @@ void kvm_mmu_invpcid_gva(struct kvm_vcpu *vcpu, gva_t gva, unsigned long pcid) }EXPORT_SYMBOL_GPL (kvm_mmu_invpcid_gva); -void kvm_configure_mmu (bool enable_tdp,int tdp_page_level) +void kvm_configure_mmu (bool enable_tdp,int tdp_huge_page_level) { tdp_enabled = enable_tdp;/* -* max_page_level reflects the capabilities of KVM's MMU irrespective +* max_huge_page_level reflects KVM's MMU capabilities irrespective * of kernel support, e.g. KVM may be capable of using 1GB pages when * the kernel is not. But, KVM never creates a page size greater than * what is used by the kernel for any given HVA, i.e. the kernel's * capabilities are ultimately consulted by kvm_mmu_hugepage_adjust(). */ if (tdp_enabled) - max_page_level = tdp_page_level; + max_huge_page_level = tdp_huge_page_level;else if (boot_cpu_has (X86_FEATURE_GBPAGES )) - max_page_level =PG_LEVEL_1G ; + max_huge_page_level =PG_LEVEL_1G ;else - max_page_level =PG_LEVEL_2M ; + max_huge_page_level =PG_LEVEL_2M ; }EXPORT_SYMBOL_GPL (kvm_configure_mmu);
Signature · 1 line
2.26.0
PATCH 9/9 KVM: x86: Specify max TDP level via kvm_configure_mmu()
In reply to Sean ChristophersonCapture the max TDP level during kvm_configure_mmu() instead of using a kvm_x86_ops hook to do it at every vCPU creation.
--- arch/x86/include/asm/kvm_host.h | 4 ++-- arch/x86/kvm/mmu/mmu.c | 9 ++++++--- arch/x86/kvm/svm/svm.c | 3 +-- arch/x86/kvm/vmx/vmx.c | 3 +-- arch/x86/kvm/x86.c | 1 - 5 files changed, 10 insertions(+), 10 deletions(-)
arch/x86/include/asm/kvm_host.h +2 -2
@@ -1133,7 +1133,6 @@ struct kvm_x86_ops {int (*sync_pir_to_irr)(struct kvm_vcpu *vcpu);int (*set_tss_addr)(struct kvm *kvm,unsigned int addr);int (*set_identity_map_addr)(struct kvm *kvm,u64 ident_addr); -int (*get_max_tdp_level)(void );u64 (*get_mt_mask)(struct kvm_vcpu *vcpu,gfn_t gfn,bool is_mmio); void (*load_mmu_pgd)(struct kvm_vcpu *vcpu, unsigned long pgd,
@@ -1509,7 +1508,8 @@ void kvm_mmu_invpcid_gva(struct kvm_vcpu *vcpu, gva_t gva, unsigned long pcid);void kvm_mmu_new_pgd (struct kvm_vcpu *vcpu,gpa_t new_pgd,bool skip_tlb_flush,bool skip_mmu_sync); -void kvm_configure_mmu (bool enable_tdp,int tdp_page_level); +void kvm_configure_mmu (bool enable_tdp,int tdp_max_root_level, +int tdp_huge_page_level);static inline u16 kvm_read_ldt (void ) {
arch/x86/kvm/mmu/mmu.c +6 -3
@@ -93,6 +93,7 @@ module_param_named(flush_on_reuse, force_flush_and_sync_on_reuse, bool, 0644);bool tdp_enabled = false;static int max_huge_page_level__read_mostly ; +static int max_tdp_level__read_mostly ;enum {AUDIT_PRE_PAGE_FAULT ,
@@ -4849,10 +4850,10 @@ static union kvm_mmu_role kvm_calc_mmu_role_common(struct kvm_vcpu *vcpu,static inline int kvm_mmu_get_tdp_level (struct kvm_vcpu *vcpu) {/* Use 5-level TDP if and only if it's useful/necessary. */ -if (vcpu->arch.max_tdp_level ==5 &&cpuid_maxphyaddr (vcpu) <=48 ) +if (max_tdp_level ==5 &&cpuid_maxphyaddr (vcpu) <=48 )return 4 ; -return vcpu->arch.max_tdp_level; +return max_tdp_level; } static union kvm_mmu_role
@@ -5580,9 +5581,11 @@ void kvm_mmu_invpcid_gva(struct kvm_vcpu *vcpu, gva_t gva, unsigned long pcid) }EXPORT_SYMBOL_GPL (kvm_mmu_invpcid_gva); -void kvm_configure_mmu (bool enable_tdp,int tdp_huge_page_level) +void kvm_configure_mmu (bool enable_tdp,int tdp_max_root_level, +int tdp_huge_page_level) { tdp_enabled = enable_tdp; + max_tdp_level = tdp_max_root_level;/* * max_huge_page_level reflects KVM's MMU capabilities irrespective
arch/x86/kvm/svm/svm.c +1 -2
@@ -885,7 +885,7 @@ static __init int svm_hardware_setup(void)if (npt_enabled && !npt) npt_enabled = false; -kvm_configure_mmu (npt_enabled,PG_LEVEL_1G ); +kvm_configure_mmu (npt_enabled,get_max_npt_level (),PG_LEVEL_1G );pr_info ("kvm: Nested Paging %sabled\n" , npt_enabled ?"en" :"dis" );if (nrips) {
@@ -4109,7 +4109,6 @@ static struct kvm_x86_ops svm_x86_ops __initdata = { .set_tss_addr = svm_set_tss_addr, .set_identity_map_addr = svm_set_identity_map_addr, - .get_max_tdp_level = get_max_npt_level, .get_mt_mask = svm_get_mt_mask, .get_exit_info = svm_get_exit_info,
arch/x86/kvm/vmx/vmx.c +1 -2
@@ -7959,7 +7959,6 @@ static struct kvm_x86_ops vmx_x86_ops __initdata = { .set_tss_addr = vmx_set_tss_addr, .set_identity_map_addr = vmx_set_identity_map_addr, - .get_max_tdp_level = vmx_get_max_tdp_level, .get_mt_mask = vmx_get_mt_mask, .get_exit_info = vmx_get_exit_info,
@@ -8110,7 +8109,7 @@ static __init int hardware_setup(void) ept_lpage_level =PG_LEVEL_2M ; else ept_lpage_level =PG_LEVEL_4K ; -kvm_configure_mmu (enable_ept, ept_lpage_level); +kvm_configure_mmu (enable_ept,vmx_get_max_tdp_level (), ept_lpage_level);/* * Only enable PML when hardware supports PML feature, and both EPT
arch/x86/kvm/x86.c +0 -1
@@ -9520,7 +9520,6 @@ int kvm_arch_vcpu_create(struct kvm_vcpu *vcpu)fx_init (vcpu); vcpu->arch.maxphyaddr =cpuid_query_maxphyaddr (vcpu); - vcpu->arch.max_tdp_level = kvm_x86_ops.get_max_tdp_level (); vcpu->arch.pat =MSR_IA32_CR_PAT_DEFAULT ;
Signature · 1 line
2.26.0
Quoted 29 lines · Sean Christopherson
The primary purpose of this series is to implement a suggestion from Paolo to have the MMU make the decision between 4 and 5 level EPT/TDP (when 5-level page tables are supported). Having the MMU "own" the decision of whether or not to use 5-level paging leads to a variety of nice cleanups, and ultimately gets rid of another
kvm_x86_ops.Patch 1 is a fix for SVM's shadow NPT that is compile tested only. I don't know enough about the shadow NPT details to know if it's a "real" bug or just a supericial oddity that can't actually cause problems.
"Remove temporary WARN on expected vs. actual EPTP level mismatch" could easily be squashed with "Pull the PGD's level from the MMU instead of recalculating it", I threw it in as a separate patch to provide a bisection helper in case things go sideways.
Sean Christopherson (9):
KVM: nSVM: Correctly set the shadow NPT root level in its MMU role
KVM: x86/mmu: Add separate helper for shadow NPT root page role calc
KVM: VMX: Drop a duplicate declaration ofconstruct_eptp()
KVM: VMX: Makevmx_load_mmu_pgd()static
KVM: x86: Pull the PGD's level from the MMU instead of recalculating
it
KVM: VXM: Remove temporary WARN on expected vs. actual EPTP level
mismatch
KVM: x86: Dynamically calculate TDP level from max level and
MAXPHYADDR
KVM: x86/mmu: Renamemax_page_leveltomax_huge_page_level
KVM: x86: Specify max TDP level viakvm_configure_mmu()
Quoted 12 lines
arch/x86/include/asm/kvm_host.h | 9 ++--- arch/x86/kvm/cpuid.c | 2 -- arch/x86/kvm/mmu.h | 10 ++++-- arch/x86/kvm/mmu/mmu.c | 63 +++++++++++++++++++++++++-------- arch/x86/kvm/svm/nested.c | 1 - arch/x86/kvm/svm/svm.c | 8 ++--- arch/x86/kvm/vmx/nested.c | 2 +- arch/x86/kvm/vmx/vmx.c | 31 +++++++--------- arch/x86/kvm/vmx/vmx.h | 6 ++-- arch/x86/kvm/x86.c | 1 - 10 files changed, 81 insertions(+), 52 deletions(-)
Queued, thanks.
Paolo