KVM: selftests: Add simple SEV test
v7 cover KVM: selftests: Add simple SEV test
This patch series continues the work Michael Roth has done in supporting SEV guests in selftests. It continues on top of the work Sean Christopherson has sent to support ucalls from SEV guests. Along with a very simple version of the SEV selftests Michael originally proposed.
V7
* Thanks to Sean for the branch:
https://github.com/sean-jc/linux/tree/x86/sev_selftests_for_peter. This series is now based on that.
* I kept is_pt_protected because without it the page tables are never readable. Its used for the elf loading in kvm_vm_elf_load().
V6
* Updated SEV VM create function based on Seanjc's feedback and new changes to VM creation functions.
* Removed pte_me_mask based on feedback.
* Fixed s_bit usage based on TDX
* Fixed bugs and took Ackerly's code for enc_region setup code.
V5
* Rebase onto seanjc@'s latest ucall pool series.
* More review changes based on seanjc:
** use protected instead of encrypted outside of SEV specific files ** Swap memcrypt struct for kvm_vm_arch arch specific struct
** Make protected page table data agnostic of address bit stealing specifics
of SEV
** Further clean up for SEV library to just vm_sev_create_one_vcpu()
* Due to large changes moved more authorships from mroth@ to pgonda@. Gave originally-by tags to mroth@ as suggested by Seanjc for this.
V4
* Rebase ontop of seanjc@'s latest Ucall Pool series:
https://lore.kernel.org/linux-arm-kernel/[email protected]/
* Fix up review comments from seanjc
* Switch authorship on 2 patches because of significant changes, added
* Michael as suggested-by or originally-by.
V3
* Addressed more of andrew.jones@ in ucall patches.
* Fix build in non-x86 archs.
V2
* Dropped RFC tag
* Correctly separated Sean's ucall patches into 2 as originally intended.
* Addressed andrew.jones@ in ucall patches.
* Fixed ucall pool usage to work for other archs
V1
* https://lore.kernel.org/all/[email protected]/
Michael Roth (2):
KVM: selftests: Make sparsebit structs const where appropriate
KVM: selftests: add support for protected vm_vaddr_* allocations
Peter Gonda (6):
KVM: selftests: Extend VM creation's @mode to allow control of VM
subtype
KVM: selftests: add hooks for managing protected guest memory
KVM: selftests: Allow tagging protected memory in guest page tables
KVM: selftests: add library for creating/interacting with SEV guests
KVM: selftests: Update ucall pool to allocate from shared memory
KVM: selftests: Add simple sev vm testing
include/uapi/linux/kvm.h | 2 +- tools/arch/arm64/include/asm/kvm_host.h | 7 + tools/arch/riscv/include/asm/kvm_host.h | 7 + tools/arch/s390/include/asm/kvm_host.h | 7 + tools/arch/x86/include/asm/kvm_host.h | 15 ++ tools/testing/selftests/kvm/Makefile | 2 + .../selftests/kvm/include/kvm_util_base.h | 113 +++++++--- .../testing/selftests/kvm/include/sparsebit.h | 58 +++-- .../selftests/kvm/include/x86_64/processor.h | 2 + .../selftests/kvm/include/x86_64/sev.h | 27 +++ tools/testing/selftests/kvm/lib/guest_modes.c | 2 +- tools/testing/selftests/kvm/lib/kvm_util.c | 103 ++++++--- tools/testing/selftests/kvm/lib/sparsebit.c | 48 ++--- .../testing/selftests/kvm/lib/ucall_common.c | 3 +- .../selftests/kvm/lib/x86_64/processor.c | 31 ++- tools/testing/selftests/kvm/lib/x86_64/sev.c | 202 ++++++++++++++++++ .../selftests/kvm/x86_64/sev_all_boot_test.c | 59 +++++ 17 files changed, 585 insertions(+), 103 deletions(-) create mode 100644 tools/arch/arm64/include/asm/kvm_host.h create mode 100644 tools/arch/riscv/include/asm/kvm_host.h create mode 100644 tools/arch/s390/include/asm/kvm_host.h create mode 100644 tools/arch/x86/include/asm/kvm_host.h create mode 100644 tools/testing/selftests/kvm/include/x86_64/sev.h create mode 100644 tools/testing/selftests/kvm/lib/x86_64/sev.c create mode 100644 tools/testing/selftests/kvm/x86_64/sev_all_boot_test.c
Signature · 1 line
2.43.0.472.g3155946c3a-goog
PATCH v7 1/8 KVM: selftests: Extend VM creation's @mode to allow control of VM subtype
Carve out space in the @mode passed to the various VM creation helpers to allow using the mode to control the subtype of VM, e.g. to identify x86's SEV VMs (which are "regular" VMs as far as KVM is concerned).
--- .../selftests/kvm/include/kvm_util_base.h | 82 ++++++++++++------- tools/testing/selftests/kvm/lib/guest_modes.c | 2 +- tools/testing/selftests/kvm/lib/kvm_util.c | 34 ++++---- 3 files changed, 73 insertions(+), 45 deletions(-)
tools/testing/selftests/kvm/include/kvm_util_base.h +53 -29
@@ -43,6 +43,48 @@typedef uint64_t vm_paddr_t ;/* Virtual Machine (Guest) physical address */ typedef uint64_t vm_vaddr_t ;/* Virtual Machine (Guest) virtual address */ +enum vm_guest_mode { +VM_MODE_P52V48_4K , +VM_MODE_P52V48_64K , +VM_MODE_P48V48_4K , +VM_MODE_P48V48_16K , +VM_MODE_P48V48_64K , +VM_MODE_P40V48_4K , +VM_MODE_P40V48_16K , +VM_MODE_P40V48_64K , +VM_MODE_PXXV48_4K ,/* For 48bits VA but ANY bits PA */ +VM_MODE_P47V64_4K , +VM_MODE_P44V64_4K , +VM_MODE_P36V48_4K , +VM_MODE_P36V48_16K , +VM_MODE_P36V48_64K , +VM_MODE_P36V47_16K , +NUM_VM_MODES , +}; + +enum vm_subtype { +VM_SUBTYPE_DEFAULT , +VM_SUBTYPE_SEV , +NUM_VM_SUBTYPES , +}; + +/* +* There are currently two flavors of "modes" that tests can control. The +* primary mode defines the physical and virtual address widths, and page sizes +* configured in hardware. The VM type allows creating alternative types of +* VMs, e.g. architecture specific flavors of protected VMs. +* +* Valid values for the primary mask are "enum vm_guest_mode", and valid values +* for the type mask are "enum vm_subtype". +*/ +#define VM_MODE_PRIMARY_MASK GENMASK(7, 0) +#define VM_MODE_SUBTYPE_SHIFT 8 +#define VM_MODE_SUBTYPE_MASK GENMASK(15, 8) + +/* 8 bits in each mask above, i.e. 255 possible values */ +_Static_assert (NUM_VM_MODES <256 ); +_Static_assert (NUM_VM_SUBTYPES <256 ); +struct userspace_mem_region {struct kvm_userspace_memory_region region;struct sparsebit *unused_phy_pages;
@@ -88,7 +130,8 @@ enum kvm_mem_region_type { };struct kvm_vm { -int mode; +enum vm_guest_mode mode; +enum vm_subtype subtype;unsigned long type;int kvm_fd;int fd;
@@ -169,28 +212,9 @@ static inline struct userspace_mem_region *vm_get_mem_region(struct kvm_vm *vm,#define DEFAULT_GUEST_STACK_VADDR_MIN 0xab6000#define DEFAULT_STACK_PGS 5 -enum vm_guest_mode { -VM_MODE_P52V48_4K , -VM_MODE_P52V48_64K , -VM_MODE_P48V48_4K , -VM_MODE_P48V48_16K , -VM_MODE_P48V48_64K , -VM_MODE_P40V48_4K , -VM_MODE_P40V48_16K , -VM_MODE_P40V48_64K , -VM_MODE_PXXV48_4K ,/* For 48bits VA but ANY bits PA */ -VM_MODE_P47V64_4K , -VM_MODE_P44V64_4K , -VM_MODE_P36V48_4K , -VM_MODE_P36V48_16K , -VM_MODE_P36V48_64K , -VM_MODE_P36V47_16K , -NUM_VM_MODES , -}; -#if defined(__aarch64__) -extern enum vm_guest_mode vm_mode_default; +extern uint32_t vm_mode_default;#define VM_MODE_DEFAULT vm_mode_default#define MIN_PAGE_SHIFT 12U
@@ -713,8 +737,8 @@ vm_paddr_t vm_alloc_page_table(struct kvm_vm *vm);* __vm_create() does NOT create vCPUs, @nr_runnable_vcpus is used purely to * calculate the amount of memory needed for per-vCPU data, e.g. stacks. */ -struct kvm_vm *____vm_create (enum vm_guest_mode mode); -struct kvm_vm *__vm_create (enum vm_guest_mode mode,uint32_t nr_runnable_vcpus, +struct kvm_vm *____vm_create (uint32_t mode); +struct kvm_vm *__vm_create (uint32_t mode,uint32_t nr_runnable_vcpus,uint64_t nr_extra_pages);static inline struct kvm_vm *vm_create_barebones (void )
@@ -727,7 +751,7 @@ static inline struct kvm_vm *vm_create(uint32_t nr_runnable_vcpus)return __vm_create (VM_MODE_DEFAULT , nr_runnable_vcpus,0 ); } -struct kvm_vm *__vm_create_with_vcpus (enum vm_guest_mode mode,uint32_t nr_vcpus, +struct kvm_vm *__vm_create_with_vcpus (uint32_t mode,uint32_t nr_vcpus,uint64_t extra_mem_pages,void *guest_code,struct kvm_vcpu *vcpus[]);
@@ -761,11 +785,11 @@ void kvm_parse_vcpu_pinning(const char *pcpus_string, uint32_t vcpu_to_pcpu[], int nr_vcpus);unsigned long vm_compute_max_gfn (struct kvm_vm *vm); -unsigned int vm_calc_num_guest_pages (enum vm_guest_mode mode,size_t size); -unsigned int vm_num_host_pages (enum vm_guest_mode mode,unsigned int num_guest_pages); -unsigned int vm_num_guest_pages (enum vm_guest_mode mode,unsigned int num_host_pages); -static inline unsigned int -vm_adjust_num_guest_pages (enum vm_guest_mode mode,unsigned int num_guest_pages) +unsigned int vm_calc_num_guest_pages (uint32_t mode,size_t size); +unsigned int vm_num_host_pages (uint32_t mode,unsigned int num_guest_pages); +unsigned int vm_num_guest_pages (uint32_t mode,unsigned int num_host_pages); +static inline unsigned int vm_adjust_num_guest_pages (uint32_t mode, +unsigned int num_guest_pages) {unsigned int n; n =vm_num_guest_pages (mode,vm_num_host_pages (mode, num_guest_pages));
tools/testing/selftests/kvm/lib/guest_modes.c +1 -1
@@ -6,7 +6,7 @@#ifdef __aarch64__#include "processor.h" -enum vm_guest_mode vm_mode_default; +uint32_t vm_mode_default;#endif struct guest_mode guest_modes[NUM_VM_MODES ];
tools/testing/selftests/kvm/lib/kvm_util.c +19 -15
@@ -209,7 +209,7 @@ __weak void vm_vaddr_populate_bitmap(struct kvm_vm *vm) (1ULL << (vm->va_bits - 1)) >> vm->page_shift); } -struct kvm_vm *____vm_create (enum vm_guest_mode mode) +struct kvm_vm *____vm_create (uint32_t mode) {struct kvm_vm *vm;
@@ -221,13 +221,16 @@ struct kvm_vm *____vm_create(enum vm_guest_mode mode) vm->regions.hva_tree =RB_ROOT ;hash_init (vm->regions.slot_hash); - vm->mode = mode; vm->type =0 ; + vm->subtype = (mode &VM_MODE_SUBTYPE_MASK ) >>VM_MODE_SUBTYPE_SHIFT ; + vm->mode = mode &VM_MODE_PRIMARY_MASK ; +pr_debug ("%s: mode='%s'\n" , __func__,vm_guest_mode_string (vm->mode)); - vm->pa_bits = vm_guest_mode_params[mode].pa_bits; - vm->va_bits = vm_guest_mode_params[mode].va_bits; - vm->page_size = vm_guest_mode_params[mode].page_size; - vm->page_shift = vm_guest_mode_params[mode].page_shift; + + vm->pa_bits = vm_guest_mode_params[vm->mode].pa_bits; + vm->va_bits = vm_guest_mode_params[vm->mode].va_bits; + vm->page_size = vm_guest_mode_params[vm->mode].page_size; + vm->page_shift = vm_guest_mode_params[vm->mode].page_shift;/* Setup mode specific traits. */ switch (vm->mode) {
@@ -285,7 +288,7 @@ struct kvm_vm *____vm_create(enum vm_guest_mode mode) vm->pgtable_levels =5 ;break ;default : -TEST_FAIL ("Unknown guest mode, mode: 0x%x" , mode); +TEST_FAIL ("Unknown guest mode, mode: 0x%x" , vm->mode); }#ifdef __aarch64__
@@ -308,7 +311,7 @@ struct kvm_vm *____vm_create(enum vm_guest_mode mode)return vm; } -static uint64_t vm_nr_pages_required (enum vm_guest_mode mode, +static uint64_t vm_nr_pages_required (uint32_t mode,uint32_t nr_runnable_vcpus,uint64_t extra_mem_pages) {
@@ -347,17 +350,18 @@ static uint64_t vm_nr_pages_required(enum vm_guest_mode mode,return vm_adjust_num_guest_pages (mode, nr_pages); } -struct kvm_vm *__vm_create (enum vm_guest_mode mode,uint32_t nr_runnable_vcpus, +struct kvm_vm *__vm_create (uint32_t mode,uint32_t nr_runnable_vcpus,uint64_t nr_extra_pages) { -uint64_t nr_pages =vm_nr_pages_required (mode, nr_runnable_vcpus, +uint32_t primary_mode = mode &VM_MODE_PRIMARY_MASK ; +uint64_t nr_pages =vm_nr_pages_required (primary_mode, nr_runnable_vcpus, nr_extra_pages);struct userspace_mem_region *slot0;struct kvm_vm *vm;int i;pr_debug ("%s: mode='%s' pages='%ld'\n" , __func__, -vm_guest_mode_string (mode), nr_pages); +vm_guest_mode_string (primary_mode), nr_pages); vm =____vm_create (mode);
@@ -400,7 +404,7 @@ struct kvm_vm *__vm_create(enum vm_guest_mode mode, uint32_t nr_runnable_vcpus,* extra_mem_pages is only used to calculate the maximum page table size, * no real memory allocation for non-slot0 memory in this function. */ -struct kvm_vm *__vm_create_with_vcpus (enum vm_guest_mode mode,uint32_t nr_vcpus, +struct kvm_vm *__vm_create_with_vcpus (uint32_t mode,uint32_t nr_vcpus,uint64_t extra_mem_pages,void *guest_code,struct kvm_vcpu *vcpus[]) {
@@ -2030,7 +2034,7 @@ static inline int getpageshift(void) }unsigned int -vm_num_host_pages (enum vm_guest_mode mode,unsigned int num_guest_pages) +vm_num_host_pages (uint32_t mode,unsigned int num_guest_pages) { return vm_calc_num_pages(num_guest_pages, vm_guest_mode_params[mode].page_shift,
@@ -2038,13 +2042,13 @@ vm_num_host_pages(enum vm_guest_mode mode, unsigned int num_guest_pages) }unsigned int -vm_num_guest_pages (enum vm_guest_mode mode,unsigned int num_host_pages) +vm_num_guest_pages (uint32_t mode,unsigned int num_host_pages) {return vm_calc_num_pages (num_host_pages,getpageshift (), vm_guest_mode_params[mode].page_shift, false); } -unsigned int vm_calc_num_guest_pages (enum vm_guest_mode mode,size_t size) +unsigned int vm_calc_num_guest_pages (uint32_t mode,size_t size) {unsigned int n; n =DIV_ROUND_UP (size, vm_guest_mode_params[mode].page_size);
Signature · 1 line
2.43.0.472.g3155946c3a-goog
Sean Christopherson
reviewerRe: [PATCH V7 1/8] KVM: selftests: Extend VM creation's @mode to allow control of VM subtype
Quoted 4 lines · Peter Gonda
Carve out space in the @mode passed to the various VM creation helpers to allow using the mode to control the subtype of VM, e.g. to identify x86's SEV VMs (which are "regular" VMs as far as KVM is concerned).
Quoted 9 lines
Cc Paolo Bonzini <[email protected]>Cc Sean Christopherson <[email protected]>Cc Vishal Annapurve <[email protected]>Cc Ackerley Tng <[email protected]>Cc Andrew Jones <[email protected]>Cc Tom Lendacky <[email protected]>Cc Michael Roth <[email protected]>Signed-off-by Peter Gonda <[email protected]>Signed-off-by Sean Christopherson <[email protected]>
SoB order is messed up.
Quoted 28 lines
--- .../selftests/kvm/include/kvm_util_base.h | 82 ++++++++++++------- tools/testing/selftests/kvm/lib/guest_modes.c | 2 +- tools/testing/selftests/kvm/lib/kvm_util.c | 34 ++++---- 3 files changed, 73 insertions(+), 45 deletions(-)tools/testing/selftests/kvm/include/kvm_util_base.h +14
-0@@ -43,6 +43,48 @@typedef uint64_t vm_paddr_t ;/* Virtual Machine (Guest) physical address */ typedef uint64_t vm_vaddr_t ;/* Virtual Machine (Guest) virtual address */ +enum vm_guest_mode { +VM_MODE_P52V48_4K , +VM_MODE_P52V48_64K , +VM_MODE_P48V48_4K , +VM_MODE_P48V48_16K , +VM_MODE_P48V48_64K , +VM_MODE_P40V48_4K , +VM_MODE_P40V48_16K , +VM_MODE_P40V48_64K , +VM_MODE_PXXV48_4K ,/* For 48bits VA but ANY bits PA */ +VM_MODE_P47V64_4K , +VM_MODE_P44V64_4K , +VM_MODE_P36V48_4K , +VM_MODE_P36V48_16K ,
tools/testing/selftests/kvm/include/kvm_util_base.h line 69
Quoted 10 lines
tools/testing/selftests/kvm/include/kvm_util_base.h +10
-0+VM_MODE_P36V48_64K , +VM_MODE_P36V47_16K , + NUM_VM_MODES, +}; + +enum vm_subtype { +VM_SUBTYPE_DEFAULT , +VM_SUBTYPE_SEV , +NUM_VM_SUBTYPES , +};
Now that "struct vm_shape" exists, this can be much more simply:
tools/testing/selftests/kvm/include/kvm_util_base.h +7 -2
@@ -90,6 +90,7 @@ enum kvm_mem_region_type {struct kvm_vm {int mode;unsigned long type; +uint8_t subtype;int kvm_fd;int fd;unsigned int pgtable_levels;
@@ -191,10 +192,14 @@ enum vm_guest_mode { };struct vm_shape { -enum vm_guest_mode mode; -unsigned int type; +uint32_t type; +uint8_t mode; +uint8_t subtype; +uint16_t padding; }; +kvm_static_assert (sizeof (struct vm_shape ) ==sizeof (uint64_t )); +#define VM_TYPE_DEFAULT 0#define VM_SHAPE (__mode) \
tools/testing/selftests/kvm/lib/kvm_util.c +1 -0
@@ -226,6 +226,7 @@ struct kvm_vm *____vm_create(struct vm_shape shape) vm->mode = shape.mode; vm->type = shape.type; + vm->subtype = shape.subtype; vm->pa_bits = vm_guest_mode_params[vm->mode].pa_bits; vm->va_bits = vm_guest_mode_params[vm->mode].va_bits;
PATCH v7 2/8 KVM: selftests: Make sparsebit structs const where appropriate
In reply to Peter GondaFrom: Michael Roth <[email protected]>
Subsequent patches will introduce an encryption bitmap in kvm_util that would be useful to allow tests to access in read-only fashion. This will be done via a const sparsebit*. To avoid warnings or the need to add casts everywhere, add const to the various sparsebit functions that are applicable for read-only usage of sparsebit.
--- .../testing/selftests/kvm/include/sparsebit.h | 36 +++++++------- tools/testing/selftests/kvm/lib/sparsebit.c | 48 +++++++++---------- 2 files changed, 42 insertions(+), 42 deletions(-)
tools/testing/selftests/kvm/include/sparsebit.h +18 -18
@@ -30,26 +30,26 @@ typedef uint64_t sparsebit_num_t;struct sparsebit *sparsebit_alloc (void );void sparsebit_free (struct sparsebit **sbitp); -void sparsebit_copy (struct sparsebit *dstp,struct sparsebit *src); +void sparsebit_copy (struct sparsebit *dstp,const struct sparsebit *src); -bool sparsebit_is_set (struct sparsebit *sbit,sparsebit_idx_t idx); -bool sparsebit_is_set_num (struct sparsebit *sbit, +bool sparsebit_is_set (const struct sparsebit *sbit,sparsebit_idx_t idx); +bool sparsebit_is_set_num (const struct sparsebit *sbit,sparsebit_idx_t idx,sparsebit_num_t num); -bool sparsebit_is_clear (struct sparsebit *sbit,sparsebit_idx_t idx); -bool sparsebit_is_clear_num (struct sparsebit *sbit, +bool sparsebit_is_clear (const struct sparsebit *sbit,sparsebit_idx_t idx); +bool sparsebit_is_clear_num (const struct sparsebit *sbit,sparsebit_idx_t idx,sparsebit_num_t num); -sparsebit_num_t sparsebit_num_set (struct sparsebit *sbit); -bool sparsebit_any_set (struct sparsebit *sbit); -bool sparsebit_any_clear (struct sparsebit *sbit); -bool sparsebit_all_set (struct sparsebit *sbit); -bool sparsebit_all_clear (struct sparsebit *sbit); -sparsebit_idx_t sparsebit_first_set (struct sparsebit *sbit); -sparsebit_idx_t sparsebit_first_clear (struct sparsebit *sbit); -sparsebit_idx_t sparsebit_next_set (struct sparsebit *sbit,sparsebit_idx_t prev); -sparsebit_idx_t sparsebit_next_clear (struct sparsebit *sbit,sparsebit_idx_t prev); -sparsebit_idx_t sparsebit_next_set_num (struct sparsebit *sbit, +sparsebit_num_t sparsebit_num_set (const struct sparsebit *sbit); +bool sparsebit_any_set (const struct sparsebit *sbit); +bool sparsebit_any_clear (const struct sparsebit *sbit); +bool sparsebit_all_set (const struct sparsebit *sbit); +bool sparsebit_all_clear (const struct sparsebit *sbit); +sparsebit_idx_t sparsebit_first_set (const struct sparsebit *sbit); +sparsebit_idx_t sparsebit_first_clear (const struct sparsebit *sbit); +sparsebit_idx_t sparsebit_next_set (const struct sparsebit *sbit,sparsebit_idx_t prev); +sparsebit_idx_t sparsebit_next_clear (const struct sparsebit *sbit,sparsebit_idx_t prev); +sparsebit_idx_t sparsebit_next_set_num (const struct sparsebit *sbit,sparsebit_idx_t start,sparsebit_num_t num); -sparsebit_idx_t sparsebit_next_clear_num (struct sparsebit *sbit, +sparsebit_idx_t sparsebit_next_clear_num (const struct sparsebit *sbit,sparsebit_idx_t start,sparsebit_num_t num);void sparsebit_set (struct sparsebit *sbitp,sparsebit_idx_t idx);
@@ -62,9 +62,9 @@ void sparsebit_clear_num(struct sparsebit *sbitp, sparsebit_idx_t start, sparsebit_num_t num);void sparsebit_clear_all (struct sparsebit *sbitp); -void sparsebit_dump (FILE *stream,struct sparsebit *sbit, +void sparsebit_dump (FILE *stream,const struct sparsebit *sbit,unsigned int indent); -void sparsebit_validate_internal (struct sparsebit *sbit); +void sparsebit_validate_internal (const struct sparsebit *sbit); #ifdef __cplusplus }
tools/testing/selftests/kvm/lib/sparsebit.c +24 -24
190 lines not on this page · raw message
Signature · 1 line
2.43.0.472.g3155946c3a-goog
PATCH v7 3/8 KVM: selftests: add hooks for managing protected guest memory
In reply to Peter GondaAdd kvm_vm.protected metadata. Protected VMs memory, potentially register and other state may not be accessible to KVM. This combined with a new protected_phy_pages bitmap will allow the selftests to check if a given pages is accessible.
--- .../selftests/kvm/include/kvm_util_base.h | 15 +++++++++++++-- tools/testing/selftests/kvm/lib/kvm_util.c | 16 +++++++++++++--- 2 files changed, 26 insertions(+), 5 deletions(-)
tools/testing/selftests/kvm/include/kvm_util_base.h +13 -2
@@ -88,6 +88,7 @@ _Static_assert(NUM_VM_SUBTYPES < 256);struct userspace_mem_region {struct kvm_userspace_memory_region region;struct sparsebit *unused_phy_pages; +struct sparsebit *protected_phy_pages;int fd;off_t offset;enum vm_mem_backing_src_type backing_src_type;
@@ -155,6 +156,9 @@ struct kvm_vm {vm_vaddr_t handlers;uint32_t dirty_ring_size; +/* VM protection enabled: SEV, etc*/ +bool protected; +/* Cache of information for binary stats interface */ int stats_fd;struct kvm_stats_header stats_header;
@@ -727,10 +731,17 @@ const char *exit_reason_str(unsigned int exit_reason);vm_paddr_t vm_phy_page_alloc (struct kvm_vm *vm,vm_paddr_t paddr_min,uint32_t memslot); -vm_paddr_t vm_phy_pages_alloc (struct kvm_vm *vm,size_t num, -vm_paddr_t paddr_min,uint32_t memslot); +vm_paddr_t __vm_phy_pages_alloc (struct kvm_vm *vm,size_t num, +vm_paddr_t paddr_min,uint32_t memslot, +bool protected);vm_paddr_t vm_alloc_page_table (struct kvm_vm *vm); +static inline vm_paddr_t vm_phy_pages_alloc (struct kvm_vm *vm,size_t num, +vm_paddr_t paddr_min,uint32_t memslot) +{ +return __vm_phy_pages_alloc (vm, num, paddr_min, memslot, vm->protected); +} +/* * ____vm_create() does KVM_CREATE_VM and little else. __vm_create() also * loads the test binary into guest memory and creates an IRQ chip (x86 only).
tools/testing/selftests/kvm/lib/kvm_util.c +13 -3
@@ -693,6 +693,7 @@ static void __vm_mem_region_delete(struct kvm_vm *vm,vm_ioctl (vm,KVM_SET_USER_MEMORY_REGION , ®ion->region);sparsebit_free (®ion->unused_phy_pages); +sparsebit_free (®ion->protected_phy_pages); ret =munmap (region->mmap_start, region->mmap_size);TEST_ASSERT (!ret,__KVM_SYSCALL_ERROR ("munmap()" , ret));if (region->fd >=0 ) {
@@ -1040,6 +1041,7 @@ void vm_userspace_mem_region_add(struct kvm_vm *vm, region->backing_src_type = src_type; region->unused_phy_pages =sparsebit_alloc (); + region->protected_phy_pages =sparsebit_alloc ();sparsebit_set_num (region->unused_phy_pages, guest_paddr >> vm->page_shift, npages); region->region.slot = slot;
@@ -1829,6 +1831,10 @@ void vm_dump(FILE *stream, struct kvm_vm *vm, uint8_t indent) region->host_mem);fprintf (stream,"%*sunused_phy_pages: " , indent +2 ,"" );sparsebit_dump (stream, region->unused_phy_pages,0 ); +if (vm->protected) { +fprintf (stream,"%*sprotected_phy_pages: " , indent +2 ,"" ); +sparsebit_dump (stream, region->protected_phy_pages,0 ); + } }fprintf (stream,"%*sMapped Virtual Pages:\n" , indent,"" );sparsebit_dump (stream, vm->vpages_mapped, indent +2 );
@@ -1941,8 +1947,9 @@ const char *exit_reason_str(unsigned int exit_reason)* and their base address is returned. A TEST_ASSERT failure occurs if * not enough pages are available at or above paddr_min. */ -vm_paddr_t vm_phy_pages_alloc (struct kvm_vm *vm,size_t num, -vm_paddr_t paddr_min,uint32_t memslot) +vm_paddr_t __vm_phy_pages_alloc (struct kvm_vm *vm,size_t num, +vm_paddr_t paddr_min,uint32_t memslot, +bool protected) {struct userspace_mem_region *region;sparsebit_idx_t pg, base;
@@ -1975,8 +1982,11 @@ vm_paddr_t vm_phy_pages_alloc(struct kvm_vm *vm, size_t num,abort (); } -for (pg = base; pg < base + num; ++pg) +for (pg = base; pg < base + num; ++pg) {sparsebit_clear (region->unused_phy_pages, pg); +if (protected) +sparsebit_set (region->protected_phy_pages, pg); + }return base * vm->page_size; }
Signature · 1 line
2.43.0.472.g3155946c3a-goog
Sean Christopherson
reviewerRe: [PATCH V7 3/8] KVM: selftests: add hooks for managing protected guest memory
Quoted 32 lines · Peter Gonda
Add kvm_vm.protected metadata. Protected VMs memory, potentially register and other state may not be accessible to KVM. This combined with a new
protected_phy_pagesbitmap will allow the selftests to check if a given pages is accessible.Cc Paolo Bonzini <[email protected]>Cc Sean Christopherson <[email protected]>Cc Vishal Annapurve <[email protected]>Cc Ackerley Tng <[email protected]>cc Andrew Jones <[email protected]>Cc Tom Lendacky <[email protected]>Cc Michael Roth <[email protected]>Originally-by Michael Roth <[email protected]>Signed-off-by Peter Gonda <[email protected]>--- .../selftests/kvm/include/kvm_util_base.h | 15 +++++++++++++-- tools/testing/selftests/kvm/lib/kvm_util.c | 16 +++++++++++++--- 2 files changed, 26 insertions(+), 5 deletions(-)tools/testing/selftests/kvm/include/kvm_util_base.h +1
-0@@ -88,6 +88,7 @@ _Static_assert(NUM_VM_SUBTYPES < 256);struct userspace_mem_region {struct kvm_userspace_memory_region region;struct sparsebit *unused_phy_pages; +struct sparsebit *protected_phy_pages;int fd;off_t offset;enum vm_mem_backing_src_type backing_src_type;
tools/testing/selftests/kvm/include/kvm_util_base.h struct kvm_vm { · line 160
Quoted 5 lines
tools/testing/selftests/kvm/include/kvm_util_base.h +2
-0@@ -155,6 +156,9 @@ struct kvm_vm {vm_vaddr_t handlers;uint32_t dirty_ring_size; +/* VM protection enabled: SEV, etc*/ +bool protected;
Yet another bool is unnecessary, just add an arch hook. That way it's impossible to have a discrepancy where vm->arch says a VM is protected, but vm->protected says it's not.
tools/testing/selftests/kvm/include/kvm_util_base.h void vm_userspace_mem_region_add(struct kvm_vm *vm, · line 1044
Quoted 5 lines
tools/testing/selftests/kvm/include/kvm_util_base.h +1
-0@@ -1040,6 +1041,7 @@ void vm_userspace_mem_region_add(struct kvm_vm *vm, region->backing_src_type = src_type; region->unused_phy_pages =sparsebit_alloc (); + region->protected_phy_pages =sparsebit_alloc ();
There's zero region to allocate protected_phy_pages if the VM doesn't support protected memory.
tools/testing/selftests/kvm/include/kvm_util_base.h void vm_dump(FILE *stream, struct kvm_vm *vm, uint8_t indent) · line 1834
Quoted 8 lines
tools/testing/selftests/kvm/include/kvm_util_base.h +1
-0sparsebit_set_num (region->unused_phy_pages, guest_paddr >> vm->page_shift, npages); region->region.slot = slot;@@ -1829,6 +1831,10 @@ void vm_dump(FILE *stream, struct kvm_vm *vm, uint8_t indent) region->host_mem);fprintf (stream,"%*sunused_phy_pages: " , indent +2 ,"" );sparsebit_dump (stream, region->unused_phy_pages,0 ); +if (vm->protected) {
And this should check region->protected_phy_pages, not vm->protected.
Quoted 19 lines
tools/testing/selftests/kvm/include/kvm_util_base.h +6
-2+fprintf (stream,"%*sprotected_phy_pages: " , indent +2 ,"" ); +sparsebit_dump (stream, region->protected_phy_pages,0 ); + } }fprintf (stream,"%*sMapped Virtual Pages:\n" , indent,"" );sparsebit_dump (stream, vm->vpages_mapped, indent +2 );@@ -1941,8 +1947,9 @@ const char *exit_reason_str(unsigned int exit_reason)* and their base address is returned. A TEST_ASSERT failure occurs if * not enough pages are available at or above paddr_min. */ -vm_paddr_t vm_phy_pages_alloc (struct kvm_vm *vm,size_t num, -vm_paddr_t paddr_min,uint32_t memslot) +vm_paddr_t __vm_phy_pages_alloc (struct kvm_vm *vm,size_t num, +vm_paddr_t paddr_min,uint32_t memslot, +bool protected) {struct userspace_mem_region *region;sparsebit_idx_t pg, base;
tools/testing/selftests/kvm/include/kvm_util_base.h vm_paddr_t vm_phy_pages_alloc(struct kvm_vm *vm, size_t num, · line 1983
Quoted 2 lines
tools/testing/selftests/kvm/include/kvm_util_base.h +0
-0@@ -1975,8 +1982,11 @@ vm_paddr_t vm_phy_pages_alloc(struct kvm_vm *vm, size_t num,abort (); }
And here, assert that:
TEST_ASSERT(!protected || region->protected_phy_pages, "Region doesn't support protected memory");
Quoted 12 lines
tools/testing/selftests/kvm/include/kvm_util_base.h +4
-1-for (pg = base; pg < base + num; ++pg) +for (pg = base; pg < base + num; ++pg) {sparsebit_clear (region->unused_phy_pages, pg); +if (protected) +sparsebit_set (region->protected_phy_pages, pg); + }return base * vm->page_size; }Signature · 1 line
2.43.0.472.g3155946c3a-goog
PATCH v7 4/8 KVM: selftests: Allow tagging protected memory in guest page tables
In reply to Peter GondaSEV guests rely on an encyption bit (C-bit) which resides within the physical address range, i.e. is stolen from the guest's GPA space. Guest code in selftests will expect the C-Bit to be set appropriately in the guest's page tables, whereas the rest of the kvm_util functions will generally expect these bits to not be present. Introduce pte_me_mask and struct kvm_vm_arch to allow for arch specific address tagging.
Currently just adding x86 c_bit and s_bit support for SEV and TDX.
--- tools/arch/arm64/include/asm/kvm_host.h | 7 +++++ tools/arch/riscv/include/asm/kvm_host.h | 7 +++++ tools/arch/s390/include/asm/kvm_host.h | 7 +++++ tools/arch/x86/include/asm/kvm_host.h | 13 +++++++++ .../selftests/kvm/include/kvm_util_base.h | 13 +++++++++ tools/testing/selftests/kvm/lib/kvm_util.c | 27 ++++++++++++++++--- .../selftests/kvm/lib/x86_64/processor.c | 15 ++++++++++- 7 files changed, 85 insertions(+), 4 deletions(-) create mode 100644 tools/arch/arm64/include/asm/kvm_host.h create mode 100644 tools/arch/riscv/include/asm/kvm_host.h create mode 100644 tools/arch/s390/include/asm/kvm_host.h create mode 100644 tools/arch/x86/include/asm/kvm_host.h
tools/arch/arm64/include/asm/kvm_host.h new file +7 -0
@@ -0,0 +1,7 @@ +/* SPDX-License-Identifier: GPL-2.0-only */ +#ifndef _TOOLS_LINUX_ASM_ARM64_KVM_HOST_H +#define _TOOLS_LINUX_ASM_ARM64_KVM_HOST_H + +struct kvm_vm_arch {}; + +#endif // _TOOLS_LINUX_ASM_ARM64_KVM_HOST_H
tools/arch/riscv/include/asm/kvm_host.h new file +7 -0
@@ -0,0 +1,7 @@ +/* SPDX-License-Identifier: GPL-2.0-only */ +#ifndef _TOOLS_LINUX_ASM_RISCV_KVM_HOST_H +#define _TOOLS_LINUX_ASM_RISCV_KVM_HOST_H + +struct kvm_vm_arch {}; + +#endif // _TOOLS_LINUX_ASM_RISCV_KVM_HOST_H
tools/arch/s390/include/asm/kvm_host.h new file +7 -0
@@ -0,0 +1,7 @@ +/* SPDX-License-Identifier: GPL-2.0-only */ +#ifndef _TOOLS_LINUX_ASM_S390_KVM_HOST_H +#define _TOOLS_LINUX_ASM_S390_KVM_HOST_H + +struct kvm_vm_arch {}; + +#endif // _TOOLS_LINUX_ASM_S390_KVM_HOST_H
tools/arch/x86/include/asm/kvm_host.h new file +13 -0
@@ -0,0 +1,13 @@ +/* SPDX-License-Identifier: GPL-2.0-only */ +#ifndef _TOOLS_LINUX_ASM_X86_KVM_HOST_H +#define _TOOLS_LINUX_ASM_X86_KVM_HOST_H + +#include <stdbool.h> +#include <stdint.h> + +struct kvm_vm_arch { +uint64_t c_bit; +uint64_t s_bit; +}; + +#endif // _TOOLS_LINUX_ASM_X86_KVM_HOST_H
tools/testing/selftests/kvm/include/kvm_util_base.h +13 -0
@@ -18,6 +18,8 @@#include <linux/types.h> #include <asm/atomic.h> +#include <asm/kvm.h> +#include <asm/kvm_host.h> #include <sys/ioctl.h>
@@ -155,6 +157,9 @@ struct kvm_vm {vm_vaddr_t idt;vm_vaddr_t handlers;uint32_t dirty_ring_size; +uint64_t gpa_tag_mask; + +struct kvm_vm_arch arch;/* VM protection enabled: SEV, etc*/ bool protected;
@@ -489,6 +494,12 @@ void *addr_gva2hva(struct kvm_vm *vm, vm_vaddr_t gva);vm_paddr_t addr_hva2gpa (struct kvm_vm *vm,void *hva);void *addr_gpa2alias (struct kvm_vm *vm,vm_paddr_t gpa); + +static inline vm_paddr_t vm_untag_gpa (struct kvm_vm *vm,vm_paddr_t gpa) +{ +return gpa & ~vm->gpa_tag_mask; +} +void vcpu_run (struct kvm_vcpu *vcpu);int _vcpu_run (struct kvm_vcpu *vcpu);
@@ -967,4 +978,6 @@ void kvm_selftest_arch_init(void);void kvm_arch_vm_post_create (struct kvm_vm *vm); +bool vm_is_gpa_protected (struct kvm_vm *vm,vm_paddr_t paddr); +#endif /* SELFTEST_KVM_UTIL_BASE_H */
tools/testing/selftests/kvm/lib/kvm_util.c +24 -3
@@ -165,10 +165,11 @@ const char *vm_guest_mode_string(uint32_t i) };_Static_assert (sizeof (strings)/sizeof (char *) ==NUM_VM_MODES ,"Missing new mode strings?" ); +const uint32_t mode = i &VM_MODE_PRIMARY_MASK ; -TEST_ASSERT (i <NUM_VM_MODES ,"Guest mode ID %d too big" , i); +TEST_ASSERT (mode <NUM_VM_MODES ,"Guest mode ID %d too big" , mode); -return strings[i]; +return strings[mode]; }const struct vm_guest_mode_params vm_guest_mode_params[] = {
@@ -315,7 +316,7 @@ static uint64_t vm_nr_pages_required(uint32_t mode,uint32_t nr_runnable_vcpus, uint64_t extra_mem_pages) { - uint64_t page_size = vm_guest_mode_params[mode].page_size; + uint64_t page_size = vm_guest_mode_params[mode & VM_MODE_PRIMARY_MASK].page_size;uint64_t nr_pages; TEST_ASSERT(nr_runnable_vcpus,
@@ -1485,6 +1486,8 @@ void *addr_gpa2hva(struct kvm_vm *vm, vm_paddr_t gpa) {struct userspace_mem_region *region; + gpa =vm_untag_gpa (vm, gpa); + region =userspace_mem_region_find (vm, gpa, gpa);if (!region) {TEST_FAIL ("No vm physical memory at 0x%lx" , gpa);
@@ -2190,3 +2193,21 @@ void __attribute((constructor)) kvm_selftest_init(void)kvm_selftest_arch_init (); } + +bool vm_is_gpa_protected (struct kvm_vm *vm,vm_paddr_t paddr) +{ +sparsebit_idx_t pg =0 ; +struct userspace_mem_region *region; + +if (!vm->protected) +return false; + + region =userspace_mem_region_find (vm, paddr, paddr); +if (!region) { +TEST_FAIL ("No vm physical memory at 0x%lx" , paddr); +return false; + } + + pg = paddr >> vm->page_shift; +return sparsebit_is_set (region->protected_phy_pages, pg); +}
tools/testing/selftests/kvm/lib/x86_64/processor.c +14 -1
@@ -157,6 +157,8 @@ static uint64_t *virt_create_upper_pte(struct kvm_vm *vm, {uint64_t *pte =virt_get_pte (vm, parent_pte, vaddr, current_level); + paddr =vm_untag_gpa (vm, paddr); +if (!(*pte &PTE_PRESENT_MASK )) { *pte =PTE_PRESENT_MASK |PTE_WRITABLE_MASK ;if (current_level == target_level)
@@ -200,6 +202,8 @@ void __virt_pg_map(struct kvm_vm *vm, uint64_t vaddr, uint64_t paddr, int level)"Physical address beyond maximum supported,\n" " paddr: 0x%lx vm->max_gfn: 0x%lx vm->page_size: 0x%x" , paddr, vm->max_gfn, vm->page_size); +TEST_ASSERT (vm_untag_gpa (vm, paddr) == paddr, +"Unexpected bits in paddr: %lx" , paddr);/* * Allocate upper level page tables, if not already present. Return
@@ -222,6 +226,15 @@ void __virt_pg_map(struct kvm_vm *vm, uint64_t vaddr, uint64_t paddr, int level)TEST_ASSERT (!(*pte &PTE_PRESENT_MASK ),"PTE already present for 4k page at vaddr: 0x%lx\n" , vaddr); *pte =PTE_PRESENT_MASK |PTE_WRITABLE_MASK | (paddr &PHYSICAL_PAGE_MASK ); + +/* +* Neither SEV nor TDX supports shared page tables, so only the final +* leaf PTE needs manually set the C/S-bit. +*/ +if (vm_is_gpa_protected (vm, paddr)) + *pte |= vm->arch.c_bit; +else + *pte |= vm->arch.s_bit; }void virt_arch_pg_map (struct kvm_vm *vm,uint64_t vaddr,uint64_t paddr)
@@ -496,7 +509,7 @@ vm_paddr_t addr_arch_gva2gpa(struct kvm_vm *vm, vm_vaddr_t gva)* No need for a hugepage mask on the PTE, x86-64 requires the "unused" * address bits to be zero. */ -return PTE_GET_PA (*pte) | (gva & ~HUGEPAGE_MASK (level)); +return vm_untag_gpa (vm,PTE_GET_PA (*pte)) | (gva & ~HUGEPAGE_MASK (level)); }static void kvm_setup_gdt (struct kvm_vm *vm,struct kvm_dtable *dt)
Signature · 1 line
2.43.0.472.g3155946c3a-goog
Sean Christopherson
reviewerRe: [PATCH V7 4/8] KVM: selftests: Allow tagging protected memory in guest page tables
Quoted 19 lines · Peter Gonda
SEV guests rely on an encyption bit (C-bit) which resides within the physical address range, i.e. is stolen from the guest's GPA space. Guest code in selftests will expect the C-Bit to be set appropriately in the guest's page tables, whereas the rest of the
kvm_utilfunctions will generally expect these bits to not be present. Introducepte_me_maskand structkvm_vm_archto allow for arch specific address tagging.Currently just adding x86
c_bitands_bitsupport for SEV and TDX.Cc Paolo Bonzini <[email protected]>Cc Sean Christopherson <[email protected]>Cc Vishal Annapurve <[email protected]>Cc Ackerly Tng <[email protected]>cc Andrew Jones <[email protected]>Cc Tom Lendacky <[email protected]>Cc Michael Roth <[email protected]>Originally-by Michael Roth <[email protected]>Signed-off-by Peter Gonda <[email protected]>
Quoted 13 lines
--- tools/arch/arm64/include/asm/kvm_host.h | 7 +++++ tools/arch/riscv/include/asm/kvm_host.h | 7 +++++ tools/arch/s390/include/asm/kvm_host.h | 7 +++++ tools/arch/x86/include/asm/kvm_host.h | 13 +++++++++ .../selftests/kvm/include/kvm_util_base.h | 13 +++++++++ tools/testing/selftests/kvm/lib/kvm_util.c | 27 ++++++++++++++++--- .../selftests/kvm/lib/x86_64/processor.c | 15 ++++++++++- 7 files changed, 85 insertions(+), 4 deletions(-) create mode 100644 tools/arch/arm64/include/asm/kvm_host.h create mode 100644 tools/arch/riscv/include/asm/kvm_host.h create mode 100644 tools/arch/s390/include/asm/kvm_host.h create mode 100644 tools/arch/x86/include/asm/kvm_host.h
As I said in the previous version, kvm_host.h is a bad name. There's also zero reason to put this in tools/arch/<arch>/include, the header is specific to KVM selftests *and* we already have per-arch directories.
PATCH v7 5/8 KVM: selftests: add support for protected vm_vaddr_* allocations
In reply to Peter GondaFrom: Michael Roth <[email protected]>
Test programs may wish to allocate shared vaddrs for things like sharing memory with the guest. Since protected vms will have their memory encrypted by default an interface is needed to explicitly request shared pages.
Implement this by splitting the common code out from vm_vaddr_alloc() and introducing a new vm_vaddr_alloc_shared().
--- .../selftests/kvm/include/kvm_util_base.h | 3 +++ tools/testing/selftests/kvm/lib/kvm_util.c | 25 +++++++++++++++---- 2 files changed, 23 insertions(+), 5 deletions(-)
tools/testing/selftests/kvm/include/kvm_util_base.h +3 -0
@@ -482,6 +482,9 @@ vm_vaddr_t vm_vaddr_unused_gap(struct kvm_vm *vm, size_t sz, vm_vaddr_t vaddr_mivm_vaddr_t vm_vaddr_alloc (struct kvm_vm *vm,size_t sz,vm_vaddr_t vaddr_min);vm_vaddr_t __vm_vaddr_alloc (struct kvm_vm *vm,size_t sz,vm_vaddr_t vaddr_min,enum kvm_mem_region_type type); +vm_vaddr_t vm_vaddr_alloc_shared (struct kvm_vm *vm,size_t sz, +vm_vaddr_t vaddr_min, +enum kvm_mem_region_type type);vm_vaddr_t vm_vaddr_alloc_pages (struct kvm_vm *vm,int nr_pages);vm_vaddr_t __vm_vaddr_alloc_page (struct kvm_vm *vm,enum kvm_mem_region_type type);
tools/testing/selftests/kvm/lib/kvm_util.c +20 -5
@@ -1336,15 +1336,17 @@ vm_vaddr_t vm_vaddr_unused_gap(struct kvm_vm *vm, size_t sz,return pgidx_start * vm->page_size; } -vm_vaddr_t __vm_vaddr_alloc (struct kvm_vm *vm,size_t sz,vm_vaddr_t vaddr_min, -enum kvm_mem_region_type type) +static vm_vaddr_t ____vm_vaddr_alloc (struct kvm_vm *vm,size_t sz, +vm_vaddr_t vaddr_min, +enum kvm_mem_region_type type, +bool protected) {uint64_t pages = (sz >> vm->page_shift) + ((sz % vm->page_size) !=0 );virt_pgd_alloc (vm); -vm_paddr_t paddr =vm_phy_pages_alloc (vm, pages, -KVM_UTIL_MIN_PFN * vm->page_size, - vm->memslots[type]); +vm_paddr_t paddr =__vm_phy_pages_alloc (vm, pages, +KVM_UTIL_MIN_PFN * vm->page_size, + vm->memslots[type], protected);/* * Find an unused range of virtual page addresses of at least
@@ -1364,6 +1366,19 @@ vm_vaddr_t __vm_vaddr_alloc(struct kvm_vm *vm, size_t sz, vm_vaddr_t vaddr_min,return vaddr_start; } +vm_vaddr_t __vm_vaddr_alloc (struct kvm_vm *vm,size_t sz,vm_vaddr_t vaddr_min, +enum kvm_mem_region_type type) +{ +return ____vm_vaddr_alloc (vm, sz, vaddr_min, type, vm->protected); +} + +vm_vaddr_t vm_vaddr_alloc_shared (struct kvm_vm *vm,size_t sz, +vm_vaddr_t vaddr_min, +enum kvm_mem_region_type type) +{ +return ____vm_vaddr_alloc (vm, sz, vaddr_min, type, false); +} +/* * VM Virtual Address Allocate *
Signature · 1 line
2.43.0.472.g3155946c3a-goog
PATCH v7 6/8 KVM: selftests: add library for creating/interacting with SEV guests
In reply to Peter GondaAdd interfaces to allow tests to create SEV guests. The additional requirements for SEV guests PTs and other state is encapsulated by the new vm_sev_create_with_one_vcpu() function. This can future be generalized for more vCPUs but the first set of SEV selftests in this series only uses a single vCPU.
--- include/uapi/linux/kvm.h | 2 +- tools/arch/x86/include/asm/kvm_host.h | 2 + tools/testing/selftests/kvm/Makefile | 1 + .../testing/selftests/kvm/include/sparsebit.h | 22 ++ .../selftests/kvm/include/x86_64/processor.h | 2 + .../selftests/kvm/include/x86_64/sev.h | 27 +++ tools/testing/selftests/kvm/lib/kvm_util.c | 1 + .../selftests/kvm/lib/x86_64/processor.c | 16 ++ tools/testing/selftests/kvm/lib/x86_64/sev.c | 202 ++++++++++++++++++ 9 files changed, 274 insertions(+), 1 deletion(-) create mode 100644 tools/testing/selftests/kvm/include/x86_64/sev.h create mode 100644 tools/testing/selftests/kvm/lib/x86_64/sev.c
include/uapi/linux/kvm.h +1 -1
@@ -1660,7 +1660,7 @@ struct kvm_s390_ucas_mapping {#define KVM_S390_GET_CMMA_BITS _IOWR(KVMIO, 0xb8, struct kvm_s390_cmma_log)#define KVM_S390_SET_CMMA_BITS _IOW(KVMIO, 0xb9, struct kvm_s390_cmma_log)/* Memory Encryption Commands */ -#define KVM_MEMORY_ENCRYPT_OP _IOWR(KVMIO, 0xba, unsigned long) +#define KVM_MEMORY_ENCRYPT_OP _IOWR(KVMIO, 0xba, struct kvm_sev_cmd)struct kvm_enc_region {__u64 addr;
tools/arch/x86/include/asm/kvm_host.h +2 -0
@@ -8,6 +8,8 @@struct kvm_vm_arch {uint64_t c_bit;uint64_t s_bit; +int sev_fd; +bool is_pt_protected; };#endif // _TOOLS_LINUX_ASM_X86_KVM_HOST_H
tools/testing/selftests/kvm/Makefile +1 -0
@@ -37,6 +37,7 @@ LIBKVM_x86_64 += lib/x86_64/handlers.S LIBKVM_x86_64 += lib/x86_64/hyperv.c LIBKVM_x86_64 += lib/x86_64/memstress.c LIBKVM_x86_64 += lib/x86_64/processor.c +LIBKVM_x86_64 += lib/x86_64/sev.c LIBKVM_x86_64 += lib/x86_64/svm.c LIBKVM_x86_64 += lib/x86_64/ucall.c LIBKVM_x86_64 += lib/x86_64/vmx.c
tools/testing/selftests/kvm/include/sparsebit.h +22 -0
@@ -66,6 +66,28 @@ void sparsebit_dump(FILE *stream, const struct sparsebit *sbit, unsigned int indent);void sparsebit_validate_internal (const struct sparsebit *sbit); +/* +* Iterate over set ranges within sparsebit @s. In each iteration, +* @range_begin and @range_end will take the beginning and end of the set +* range, which are of type sparsebit_idx_t. +* +* For example, if the range [3, 7] (inclusive) is set, within the +* iteration,@range_begin will take the value 3 and @range_end will take +* the value 7. +* +* Ensure that there is at least one bit set before using this macro with +* sparsebit_any_set(), because sparsebit_first_set() will abort if none +* are set. +*/ +#define sparsebit_for_each_set_range (s, range_begin, range_end) \ + for (range_begin = sparsebit_first_set(s), \ + range_end = \ + sparsebit_next_clear(s, range_begin) - 1; \ + range_begin && range_end; \ + range_begin = sparsebit_next_set(s, range_end), \ + range_end = \ + sparsebit_next_clear(s, range_begin) - 1) + #ifdef __cplusplus }#endif
tools/testing/selftests/kvm/include/x86_64/processor.h +2 -0
@@ -266,6 +266,7 @@ struct kvm_x86_cpu_property {#define X86_PROPERTY_MAX_PHY_ADDR KVM_X86_CPU_PROPERTY(0x80000008, 0, EAX, 0, 7)#define X86_PROPERTY_MAX_VIRT_ADDR KVM_X86_CPU_PROPERTY(0x80000008, 0, EAX, 8, 15)#define X86_PROPERTY_PHYS_ADDR_REDUCTION KVM_X86_CPU_PROPERTY(0x8000001F, 0, EBX, 6, 11) +#define X86_PROPERTY_SEV_C_BIT KVM_X86_CPU_PROPERTY(0x8000001F, 0, EBX, 0, 5)#define X86_PROPERTY_MAX_CENTAUR_LEAF KVM_X86_CPU_PROPERTY(0xC0000000, 0, EAX, 0, 31)
@@ -1035,6 +1036,7 @@ do { \ }while (0 ) void kvm_get_cpu_address_width(unsigned int *pa_bits, unsigned int *va_bits); +void kvm_init_vm_address_properties (struct kvm_vm *vm);bool vm_is_unrestricted_guest (struct kvm_vm *vm);struct ex_regs {
tools/testing/selftests/kvm/include/x86_64/sev.h new file +27 -0
@@ -0,0 +1,27 @@ +/* SPDX-License-Identifier: GPL-2.0-only */ +/* +* Helpers used for SEV guests +* +*/ +#ifndef SELFTEST_KVM_SEV_H +#define SELFTEST_KVM_SEV_H + +#include <stdint.h> +#include <stdbool.h> + +#include "kvm_util.h" + +#define CPUID_MEM_ENC_LEAF 0x8000001f +#define CPUID_EBX_CBIT_MASK 0x3f + +#define SEV_POLICY_NO_DBG (1UL << 0) +#define SEV_POLICY_ES (1UL << 2) + +bool is_kvm_sev_supported (void ); + +void sev_vm_init (struct kvm_vm *vm); + +struct kvm_vm *vm_sev_create_with_one_vcpu (uint32_t policy,void *guest_code, +struct kvm_vcpu **cpu); + +#endif /* SELFTEST_KVM_SEV_H */
tools/testing/selftests/kvm/lib/kvm_util.c +1 -0
@@ -266,6 +266,7 @@ struct kvm_vm *____vm_create(uint32_t mode)case VM_MODE_PXXV48_4K :#ifdef __x86_64__kvm_get_cpu_address_width (&vm->pa_bits, &vm->va_bits); +kvm_init_vm_address_properties (vm);/* * Ignore KVM support for 5-level paging (vm->va_bits == 57), * it doesn't take effect unless a CR4.LA57 is set, which it
tools/testing/selftests/kvm/lib/x86_64/processor.c +16 -0
@@ -9,6 +9,7 @@#include "test_util.h" #include "kvm_util.h" #include "processor.h" +#include "sev.h" #ifndef NUM_INTERRUPTS #define NUM_INTERRUPTS 256
@@ -278,6 +279,9 @@ uint64_t *__vm_get_page_table_entry(struct kvm_vm *vm, uint64_t vaddr, {uint64_t *pml4e, *pdpe, *pde; +TEST_ASSERT (!vm->arch.is_pt_protected, +"Walking page tables of protected guests is impossible" ); +TEST_ASSERT (*level >=PG_LEVEL_NONE && *level <PG_LEVEL_NUM ,"Invalid PG_LEVEL_* '%d'" , *level);
@@ -573,6 +577,9 @@ void kvm_arch_vm_post_create(struct kvm_vm *vm)vm_create_irqchip (vm);sync_global_to_guest (vm, host_cpu_is_intel);sync_global_to_guest (vm, host_cpu_is_amd); + +if (vm->subtype ==VM_SUBTYPE_SEV ) +sev_vm_init (vm); } struct kvm_vcpu *vm_arch_vcpu_add(struct kvm_vm *vm, uint32_t vcpu_id,
@@ -1054,6 +1061,15 @@ void kvm_get_cpu_address_width(unsigned int *pa_bits, unsigned int *va_bits) } } +void kvm_init_vm_address_properties (struct kvm_vm *vm) +{ +if (vm->subtype ==VM_SUBTYPE_SEV ) { + vm->protected = true; + vm->arch.c_bit =1ULL <<this_cpu_property (X86_PROPERTY_SEV_C_BIT ); + vm->gpa_tag_mask = vm->arch.c_bit; + } +} +static void set_idt_entry (struct kvm_vm *vm,int vector,unsigned long addr,int dpl,unsigned short selector) {
tools/testing/selftests/kvm/lib/x86_64/sev.c new file +202 -0
202 lines not on this page · raw message
Signature · 1 line
2.43.0.472.g3155946c3a-goog
Sean Christopherson
reviewerRe: [PATCH V7 6/8] KVM: selftests: add library for creating/interacting with SEV guests
+TDX folks
Quoted 6 lines · Peter Gonda
Add interfaces to allow tests to create SEV guests. The additional requirements for SEV guests PTs and other state is encapsulated by the new
vm_sev_create_with_one_vcpu()function. This can future be generalized for more vCPUs but the first set of SEV selftests in this series only uses a single vCPU.
Quoted 9 lines
Cc Paolo Bonzini <[email protected]>Cc Sean Christopherson <[email protected]>Cc Vishal Annapurve <[email protected]>Cc Ackerly Tng <[email protected]>cc Andrew Jones <[email protected]>Cc Tom Lendacky <[email protected]>Cc Michael Roth <[email protected]>Originally-by Michael Roth <[email protected]>Co-developed-by Ackerly Tng <[email protected]>
Needs Ackerly's SoB.
Quoted 20 lines
Signed-off-by Peter Gonda <[email protected]>--- include/uapi/linux/kvm.h | 2 +- tools/arch/x86/include/asm/kvm_host.h | 2 + tools/testing/selftests/kvm/Makefile | 1 + .../testing/selftests/kvm/include/sparsebit.h | 22 ++ .../selftests/kvm/include/x86_64/processor.h | 2 + .../selftests/kvm/include/x86_64/sev.h | 27 +++ tools/testing/selftests/kvm/lib/kvm_util.c | 1 + .../selftests/kvm/lib/x86_64/processor.c | 16 ++ tools/testing/selftests/kvm/lib/x86_64/sev.c | 202 ++++++++++++++++++ 9 files changed, 274 insertions(+), 1 deletion(-) create mode 100644 tools/testing/selftests/kvm/include/x86_64/sev.h create mode 100644 tools/testing/selftests/kvm/lib/x86_64/sev.cinclude/uapi/linux/kvm.h +0
-0
include/uapi/linux/kvm.h struct kvm_s390_ucas_mapping { · line 1663
Quoted 5 lines
include/uapi/linux/kvm.h +1
-1@@ -1660,7 +1660,7 @@ struct kvm_s390_ucas_mapping {#define KVM_S390_GET_CMMA_BITS _IOWR(KVMIO, 0xb8, struct kvm_s390_cmma_log)#define KVM_S390_SET_CMMA_BITS _IOW(KVMIO, 0xb9, struct kvm_s390_cmma_log)/* Memory Encryption Commands */ -#define KVM_MEMORY_ENCRYPT_OP _IOWR(KVMIO, 0xba, unsigned long) +#define KVM_MEMORY_ENCRYPT_OP _IOWR(KVMIO, 0xba, struct kvm_sev_cmd)
*sigh*
This cost me an hour of debug, partly because I was looking at tools/'s "good" version, but mostly because I didn't expect a selftests patch to clobber KVM's uapi.
<rant>
This is an incredibly frustrating violating of basic patch principles. Don't include unrelated/unnecessary changes without good cause, especially not for uapi headers. If you do include unrelated changes, _document_ it in the changelog. And if you don't understand _why_ something is weird, ask!
Even worse is that this series has sat on the lists for over a month, and NO ONE tested it. I can kinda sorta see how Peter missed this, e.g. if the host kernel was build from the same source as the selftests. But I have a very, very hard time believing that every other person that peeked at a _selftests_ series rebuilt and rebooted their hosts using that series.
If this were some obscure series that was touching an area of KVM that few devs care about, I wouldn't react so strongly. But there are how many developers working on SNP and TDX? 10? 15? 20?
I have made it _abundantly_ clear, over, and over, that tests are a hard requirement for new features. Yet I see *zero* review/testing activity on this series or Sagi's TDX selftests series. Some of the flaws in this series are design-ish problems, i.e. not things I would expect everyone to be able to independently identify and/or address, but there are also a number of glaring flaws that anyone giving this more than a cursory glance would pick out. E.g. this patch adds an SEV library, but then the series doesn't bother to use it to dedup the existing code in sev_migrate_test.c.
If y'all want SNP or TDX support to go anywhere but the backburner, cycles need to be redirected to getting selftests written, healthy, and *maintainable*. I have *very* limited cycles for SNP/TDX for the foreseeable future, and I care a hell of a lot more about having healthy, robust selftests than I do about getting SNP or TDX merged by some arbitrary deadline.
</rant>
Quoted 10 lines
include/uapi/linux/kvm.h +6
-0@@ -66,6 +66,28 @@ void sparsebit_dump(FILE *stream, const struct sparsebit *sbit, unsigned int indent);void sparsebit_validate_internal (const struct sparsebit *sbit); +/* +* Iterate over set ranges within sparsebit @s. In each iteration, +* @range_begin and @range_end will take the beginning and end of the set +* range, which are of type sparsebit_idx_t. +* +* For example, if the range [3, 7] (inclusive) is set, within the
include/uapi/linux/kvm.h void sparsebit_dump(FILE *stream, const struct sparsebit *sbit, · line 84
Quoted 10 lines
include/uapi/linux/kvm.h +10
-0+* iteration,@range_begin will take the value 3 and @range_end will take +* the value 7. +* +* Ensure that there is at least one bit set before using this macro with +* sparsebit_any_set(), because sparsebit_first_set() will abort if none +* are set. +*/ +#define sparsebit_for_each_set_range (s, range_begin, range_end) \ + for (range_begin = sparsebit_first_set(s), \ + range_end = \
Unnecessary newline.
include/uapi/linux/kvm.h void sparsebit_dump(FILE *stream, const struct sparsebit *sbit, · line 90
Quoted 6 lines
include/uapi/linux/kvm.h +6
-0+sparsebit_next_clear (s, range_begin) -1 ; \ + range_begin && range_end; \ + range_begin =sparsebit_next_set (s, range_end), \ + range_end = \ + sparsebit_next_clear(s, range_begin) - 1) +
It probably makes sense to split this to a separate patch. Adding APIs without users is generally frowned upon, but I think in this case it's worth isolating the SEV changes.
tools/testing/selftests/kvm/include/x86_64/processor.h struct kvm_x86_cpu_property { · line 269
Quoted 12 lines
include/uapi/linux/kvm.h +0
-0#ifdef __cplusplus }#endif tools/testing/selftests/kvm/include/x86_64/processor.h +1
-0@@ -266,6 +266,7 @@ struct kvm_x86_cpu_property {#define X86_PROPERTY_MAX_PHY_ADDR KVM_X86_CPU_PROPERTY(0x80000008, 0, EAX, 0, 7)#define X86_PROPERTY_MAX_VIRT_ADDR KVM_X86_CPU_PROPERTY(0x80000008, 0, EAX, 8, 15)#define X86_PROPERTY_PHYS_ADDR_REDUCTION KVM_X86_CPU_PROPERTY(0x8000001F, 0, EBX, 6, 11) +#define X86_PROPERTY_SEV_C_BIT KVM_X86_CPU_PROPERTY(0x8000001F, 0, EBX, 0, 5)
Put this above X86_PROPERTY_PHYS_ADDR_REDUCTION so that they are sorted in ascending order.
Quoted 15 lines
tools/testing/selftests/kvm/lib/x86_64/sev.c new file +9
-0@@ -0,0 +1,202 @@ +// SPDX-License-Identifier: GPL-2.0-only +#define _GNU_SOURCE/* for program_invocation_short_name */ +#include <stdint.h> +#include <stdbool.h> + +#include "kvm_util.h" +#include "svm_util.h" +#include "linux/psp-sev.h" +#include "processor.h"
tools/testing/selftests/kvm/lib/x86_64/sev.c line 19
Quoted 10 lines
tools/testing/selftests/kvm/lib/x86_64/sev.c new file +10
-0+#include "sev.h" + +#define SEV_FW_REQ_VER_MAJOR 0 +#define SEV_FW_REQ_VER_MINOR 17 + +enum sev_guest_state { +SEV_GSTATE_UNINIT =0 , +SEV_GSTATE_LUPDATE , +SEV_GSTATE_LSECRET , +SEV_GSTATE_RUNNING ,
Spell these out, saving a few keystrokes is not worth inscrutable names. These enums/define also belong in sev.h
Quoted 37 lines
tools/testing/selftests/kvm/lib/x86_64/sev.c new file +37
-0+}; + +static void sev_ioctl (int cmd,void *data) +{ +int sev_fd =open_sev_dev_path_or_exit (); +struct sev_issue_cmd arg = { + .cmd = cmd, + .data = (unsigned long )data, + }; + +kvm_ioctl (sev_fd,SEV_ISSUE_CMD , &arg); +close (sev_fd); +} + +static void kvm_sev_ioctl (struct kvm_vm *vm,int cmd,void *data) +{ +struct kvm_sev_cmd sev_cmd = { + .id = cmd, + .sev_fd = vm->arch.sev_fd, + .data = (unsigned long )data, + }; + +vm_ioctl (vm,KVM_MEMORY_ENCRYPT_OP , &sev_cmd); +} + +static void sev_register_encrypted_memory (struct kvm_vm *vm, +struct userspace_mem_region *region) +{ +struct kvm_enc_region range = { + .addr = region->region.userspace_addr, + .size = region->region.memory_size, + }; + +vm_ioctl (vm,KVM_MEMORY_ENCRYPT_REG_REGION , &range); +} + +static void sev_launch_update_data(struct kvm_vm *vm, vm_paddr_t gpa,
tools/testing/selftests/kvm/lib/x86_64/sev.c line 66
Quoted 10 lines
tools/testing/selftests/kvm/lib/x86_64/sev.c new file +10
-0+ uint64_t size) +{ +struct kvm_sev_launch_update_data update_data = { + .uaddr = (unsigned long )addr_gpa2hva (vm, gpa), + .len = size, + }; + +kvm_sev_ioctl (vm,KVM_SEV_LAUNCH_UPDATE_DATA , &update_data); +} +
The APIs that are effectively wrappers to KVM ioctls() should be globally visible, e.g. to allow mixing in match them in negative tests that want to do "dumb" things on a half-baked VM.
Quoted 4 lines
tools/testing/selftests/kvm/lib/x86_64/sev.c new file +4
-0+static void sev_vm_launch (struct kvm_vm *vm,uint32_t policy) +{ +struct kvm_sev_launch_start launch_start = { + .policy = policy,
tools/testing/selftests/kvm/lib/x86_64/sev.c line 121
Quoted 10 lines
tools/testing/selftests/kvm/lib/x86_64/sev.c new file +10
-0+ }; +struct userspace_mem_region *region; +struct kvm_sev_guest_status status; +int ctr; + +kvm_sev_ioctl (vm,KVM_SEV_LAUNCH_START , &launch_start); +kvm_sev_ioctl (vm,KVM_SEV_GUEST_STATUS , &status); + +TEST_ASSERT (status.policy == policy,"Expected policy %d, got %d" , + policy, status.policy);
TEST_ASSERT_EQ() will do the heavy lifting for you.
tools/testing/selftests/kvm/lib/x86_64/sev.c line 174
Quoted 13 lines
tools/testing/selftests/kvm/lib/x86_64/sev.c new file +13
-0+static void sev_vm_measure (struct kvm_vm *vm) +{ +uint8_t measurement[512 ]; +int i; + +sev_vm_launch_measure (vm, measurement); + +/* TODO: Validate the measurement is as expected. */ +pr_debug ("guest measurement: " ); +for (i =0 ; i <32 ; ++i) +pr_debug ("%02x" , measurement[i]); +pr_debug ("\n" ); +}
Meh, this isn't helpful for a test, e.g. the average user isn't never going to do anything useful with the measurement info.
Re: [PATCH V7 6/8] KVM: selftests: add library for creating/interacting with SEV guests
Quoted 19 lines · Sean Christopherson
+TDX folks
Quoted 6 lines · Peter Gonda
Add interfaces to allow tests to create SEV guests. The additional requirements for SEV guests PTs and other state is encapsulated by the new
vm_sev_create_with_one_vcpu()function. This can future be generalized for more vCPUs but the first set of SEV selftests in this series only uses a single vCPU.Quoted 9 lines
Cc Paolo Bonzini <[email protected]>Cc Sean Christopherson <[email protected]>Cc Vishal Annapurve <[email protected]>Cc Ackerly Tng <[email protected]>cc Andrew Jones <[email protected]>Cc Tom Lendacky <[email protected]>Cc Michael Roth <[email protected]>Originally-by Michael Roth <[email protected]>Co-developed-by Ackerly Tng <[email protected]>
Quoted 2 lines
Needs Ackerly's SoB.
Quoted 1 line
<snip>
PATCH v7 7/8 KVM: selftests: Update ucall pool to allocate from shared memory
In reply to Peter GondaUpdate the per VM ucall_header allocation from vm_vaddr_alloc() to vm_vaddr_alloc_shared(). This allows encrypted guests to use ucall pools by placing their shared ucall structures in unencrypted (shared) memory. No behavior change for non encrypted guests.
--- tools/testing/selftests/kvm/lib/ucall_common.c | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-)
tools/testing/selftests/kvm/lib/ucall_common.c +2 -1
@@ -29,7 +29,8 @@ void ucall_init(struct kvm_vm *vm, vm_paddr_t mmio_gpa)vm_vaddr_t vaddr;int i; - vaddr =__vm_vaddr_alloc (vm,sizeof (*hdr),KVM_UTIL_MIN_VADDR ,MEM_REGION_DATA ); + vaddr =vm_vaddr_alloc_shared (vm,sizeof (*hdr),KVM_UTIL_MIN_VADDR , +MEM_REGION_DATA ); hdr = (struct ucall_header *)addr_gva2hva (vm, vaddr);memset (hdr,0 ,sizeof (*hdr));
Signature · 1 line
2.43.0.472.g3155946c3a-goog
PATCH v7 8/8 KVM: selftests: Add simple sev vm testing
In reply to Peter GondaA very simple of booting SEV guests that checks SEV related CPUID bits and the SEV MSR.
--- tools/testing/selftests/kvm/Makefile | 1 + .../selftests/kvm/x86_64/sev_all_boot_test.c | 59 +++++++++++++++++++ 2 files changed, 60 insertions(+) create mode 100644 tools/testing/selftests/kvm/x86_64/sev_all_boot_test.c
tools/testing/selftests/kvm/Makefile +1 -0
@@ -115,6 +115,7 @@ TEST_GEN_PROGS_x86_64 += x86_64/tsc_msrs_test TEST_GEN_PROGS_x86_64 += x86_64/vmx_pmu_caps_test TEST_GEN_PROGS_x86_64 += x86_64/xen_shinfo_test TEST_GEN_PROGS_x86_64 += x86_64/xen_vmcall_test +TEST_GEN_PROGS_x86_64 += x86_64/sev_all_boot_test TEST_GEN_PROGS_x86_64 += x86_64/sev_migrate_tests TEST_GEN_PROGS_x86_64 += x86_64/amx_test TEST_GEN_PROGS_x86_64 += x86_64/max_vcpuid_cap_test
tools/testing/selftests/kvm/x86_64/sev_all_boot_test.c new file +59 -0
59 lines not on this page · raw message
Signature · 1 line
2.43.0.472.g3155946c3a-goog
Sean Christopherson
reviewerRe: [PATCH V7 8/8] KVM: selftests: Add simple sev vm testing
Quoted 2 lines · Peter Gonda
A very simple of booting SEV guests that checks SEV related CPUID bits and the SEV MSR.
Phrase changelogs as commands.
Quoted 9 lines
Cc Paolo Bonzini <[email protected]>Cc Sean Christopherson <[email protected]>Cc Vishal Annapurve <[email protected]>Cc Ackerly Tng <[email protected]>cc Andrew Jones <[email protected]>Cc Tom Lendacky <[email protected]>Cc Michael Roth <[email protected]>Suggested-by Michael Roth <[email protected]>Signed-off-by Peter Gonda <[email protected]>
Quoted 5 lines
--- tools/testing/selftests/kvm/Makefile | 1 + .../selftests/kvm/x86_64/sev_all_boot_test.c | 59 +++++++++++++++++++ 2 files changed, 60 insertions(+) create mode 100644 tools/testing/selftests/kvm/x86_64/sev_all_boot_test.c
I think sev_smoke_test is more appropriate. This isn't "booting" in the traditional sense, e.g. it's not going through BIOS/firmware, transfering to a proper kernel, etc.
Sean Christopherson
reviewerQuoted 4 lines · Peter Gonda
This patch series continues the work Michael Roth has done in supporting SEV guests in selftests. It continues on top of the work Sean Christopherson has sent to support ucalls from SEV guests. Along with a very simple version of the SEV selftests Michael originally proposed.
I'll post a v8 this week, I've already done (almost) all of the changes needed to get this into shape.