RISC-V KVM ONE_REG interface for SBI
Subsystems (3)
v2 cover RISC-V KVM ONE_REG interface for SBI
This series does first does few cleanups/fixes (PATCH1 to PATCH5) and adds ONE-REG interface for customizing the SBI interface visible to the Guest/VM.
The testing of this series has been done with KVMTOOL changes in riscv_sbi_imp_v1 branch at:
https://github.com/avpatel/kvmtool.git
These patches can also be found in the riscv_kvm_sbi_imp_v2 branch at:
https://github.com/avpatel/linux.git
Changes since v1:
- Dropped patches 1 to 8 since these are already merged.
- Rebased on Linux-6.3-rc4
Anup Patel (1):
RISC-V: KVM: Add ONE_REG interface to enable/disable SBI extensions
arch/riscv/include/asm/kvm_vcpu_sbi.h | 8 +- arch/riscv/include/uapi/asm/kvm.h | 20 ++++ arch/riscv/kvm/vcpu.c | 2 + arch/riscv/kvm/vcpu_sbi.c | 150 +++++++++++++++++++++++--- arch/riscv/kvm/vcpu_sbi_base.c | 2 +- 5 files changed, 163 insertions(+), 19 deletions(-)
Signature · 1 line
2.34.1
PATCH v2 1/1 RISC-V: KVM: Add ONE_REG interface to enable/disable SBI extensions
We add ONE_REG interface to enable/disable SBI extensions (just like the ONE_REG interface for ISA extensions). This allows KVM user-space to decide the set of SBI extension enabled for a Guest and by default all SBI extensions are enabled.
--- arch/riscv/include/asm/kvm_vcpu_sbi.h | 8 +- arch/riscv/include/uapi/asm/kvm.h | 20 ++++ arch/riscv/kvm/vcpu.c | 2 + arch/riscv/kvm/vcpu_sbi.c | 150 +++++++++++++++++++++++--- arch/riscv/kvm/vcpu_sbi_base.c | 2 +- 5 files changed, 163 insertions(+), 19 deletions(-)
arch/riscv/include/asm/kvm_vcpu_sbi.h +7 -1
@@ -16,6 +16,7 @@struct kvm_vcpu_sbi_context {int return_handled; +bool extension_disabled[KVM_RISCV_SBI_EXT_MAX ]; };struct kvm_vcpu_sbi_return {
@@ -45,7 +46,12 @@ void kvm_riscv_vcpu_sbi_system_reset(struct kvm_vcpu *vcpu,struct kvm_run *run, u32 type, u64 flags);int kvm_riscv_vcpu_sbi_return (struct kvm_vcpu *vcpu,struct kvm_run *run); -const struct kvm_vcpu_sbi_extension *kvm_vcpu_sbi_find_ext (unsigned long extid); +int kvm_riscv_vcpu_set_reg_sbi_ext (struct kvm_vcpu *vcpu, +const struct kvm_one_reg *reg); +int kvm_riscv_vcpu_get_reg_sbi_ext (struct kvm_vcpu *vcpu, +const struct kvm_one_reg *reg); +const struct kvm_vcpu_sbi_extension *kvm_vcpu_sbi_find_ext ( +struct kvm_vcpu *vcpu,unsigned long extid);int kvm_riscv_vcpu_sbi_ecall (struct kvm_vcpu *vcpu,struct kvm_run *run);#ifdef CONFIG_RISCV_SBI_V01
arch/riscv/include/uapi/asm/kvm.h +20 -0
@@ -108,6 +108,23 @@ enum KVM_RISCV_ISA_EXT_ID { KVM_RISCV_ISA_EXT_MAX, }; +/* +* SBI extension IDs specific to KVM. This is not the same as the SBI +* extension IDs defined by the RISC-V SBI specification. +*/ +enum KVM_RISCV_SBI_EXT_ID { +KVM_RISCV_SBI_EXT_V01 =0 , +KVM_RISCV_SBI_EXT_TIME , +KVM_RISCV_SBI_EXT_IPI , +KVM_RISCV_SBI_EXT_RFENCE , +KVM_RISCV_SBI_EXT_SRST , +KVM_RISCV_SBI_EXT_HSM , +KVM_RISCV_SBI_EXT_PMU , +KVM_RISCV_SBI_EXT_EXPERIMENTAL , +KVM_RISCV_SBI_EXT_VENDOR , +KVM_RISCV_SBI_EXT_MAX , +}; +/* Possible states for kvm_riscv_timer */ #define KVM_RISCV_TIMER_STATE_OFF 0#define KVM_RISCV_TIMER_STATE_ON 1
@@ -152,6 +169,9 @@ enum KVM_RISCV_ISA_EXT_ID {/* ISA Extension registers are mapped as type 7 */ #define KVM_REG_RISCV_ISA_EXT (0x07 << KVM_REG_RISCV_TYPE_SHIFT) +/* SBI extension registers are mapped as type 8 */ +#define KVM_REG_RISCV_SBI_EXT (0x08 << KVM_REG_RISCV_TYPE_SHIFT) +#endif #endif /* __LINUX_KVM_RISCV_H */
arch/riscv/kvm/vcpu.c +2 -0
@@ -601,6 +601,8 @@ static int kvm_riscv_vcpu_set_reg(struct kvm_vcpu *vcpu, KVM_REG_RISCV_FP_D);case KVM_REG_RISCV_ISA_EXT :return kvm_riscv_vcpu_set_reg_isa_ext (vcpu, reg); +case KVM_REG_RISCV_SBI_EXT : +return kvm_riscv_vcpu_set_reg_sbi_ext (vcpu, reg);default :break ; }
arch/riscv/kvm/vcpu_sbi.c +133 -17
171 lines not on this page · raw message
arch/riscv/kvm/vcpu_sbi_base.c +1 -1
@@ -44,7 +44,7 @@ static int kvm_sbi_ext_base_handler(struct kvm_vcpu *vcpu, struct kvm_run *run,kvm_riscv_vcpu_sbi_forward (vcpu, run); retdata->uexit = true; }else { - sbi_ext =kvm_vcpu_sbi_find_ext (cp->a0); + sbi_ext =kvm_vcpu_sbi_find_ext (vcpu, cp->a0); *out_val = sbi_ext && sbi_ext->probe ? sbi_ext->probe (vcpu) : !!sbi_ext; }
Signature · 1 line
2.34.1
Re: [PATCH v2 1/1] RISC-V: KVM: Add ONE_REG interface to enable/disable SBI extensions
Quoted 285 lines · Anup Patel
We add
ONE_REGinterface to enable/disable SBI extensions (just like theONE_REGinterface for ISA extensions). This allows KVM user-space to decide the set of SBI extension enabled for a Guest and by default all SBI extensions are enabled.Signed-off-by Anup Patel <[email protected]>--- arch/riscv/include/asm/kvm_vcpu_sbi.h | 8 +- arch/riscv/include/uapi/asm/kvm.h | 20 ++++ arch/riscv/kvm/vcpu.c | 2 + arch/riscv/kvm/vcpu_sbi.c | 150 +++++++++++++++++++++++--- arch/riscv/kvm/vcpu_sbi_base.c | 2 +- 5 files changed, 163 insertions(+), 19 deletions(-)arch/riscv/include/asm/kvm_vcpu_sbi.h +7
-1@@ -16,6 +16,7 @@struct kvm_vcpu_sbi_context {int return_handled; +bool extension_disabled[KVM_RISCV_SBI_EXT_MAX ]; };struct kvm_vcpu_sbi_return {@@ -45,7 +46,12 @@ void kvm_riscv_vcpu_sbi_system_reset(struct kvm_vcpu *vcpu,struct kvm_run *run, u32 type, u64 flags);int kvm_riscv_vcpu_sbi_return (struct kvm_vcpu *vcpu,struct kvm_run *run); -const struct kvm_vcpu_sbi_extension *kvm_vcpu_sbi_find_ext (unsigned long extid); +int kvm_riscv_vcpu_set_reg_sbi_ext (struct kvm_vcpu *vcpu, +const struct kvm_one_reg *reg); +int kvm_riscv_vcpu_get_reg_sbi_ext (struct kvm_vcpu *vcpu, +const struct kvm_one_reg *reg); +const struct kvm_vcpu_sbi_extension *kvm_vcpu_sbi_find_ext ( +struct kvm_vcpu *vcpu,unsigned long extid);int kvm_riscv_vcpu_sbi_ecall (struct kvm_vcpu *vcpu,struct kvm_run *run);#ifdef CONFIG_RISCV_SBI_V01 arch/riscv/include/uapi/asm/kvm.h +20
-0@@ -108,6 +108,23 @@ enum KVM_RISCV_ISA_EXT_ID { KVM_RISCV_ISA_EXT_MAX, }; +/* +* SBI extension IDs specific to KVM. This is not the same as the SBI +* extension IDs defined by the RISC-V SBI specification. +*/ +enum KVM_RISCV_SBI_EXT_ID { +KVM_RISCV_SBI_EXT_V01 =0 , +KVM_RISCV_SBI_EXT_TIME , +KVM_RISCV_SBI_EXT_IPI , +KVM_RISCV_SBI_EXT_RFENCE , +KVM_RISCV_SBI_EXT_SRST , +KVM_RISCV_SBI_EXT_HSM , +KVM_RISCV_SBI_EXT_PMU , +KVM_RISCV_SBI_EXT_EXPERIMENTAL , +KVM_RISCV_SBI_EXT_VENDOR , +KVM_RISCV_SBI_EXT_MAX , +}; +/* Possible states for kvm_riscv_timer */ #define KVM_RISCV_TIMER_STATE_OFF 0#define KVM_RISCV_TIMER_STATE_ON 1@@ -152,6 +169,9 @@ enum KVM_RISCV_ISA_EXT_ID {/* ISA Extension registers are mapped as type 7 */ #define KVM_REG_RISCV_ISA_EXT (0x07 << KVM_REG_RISCV_TYPE_SHIFT) +/* SBI extension registers are mapped as type 8 */ +#define KVM_REG_RISCV_SBI_EXT (0x08 << KVM_REG_RISCV_TYPE_SHIFT) +#endif #endif /* __LINUX_KVM_RISCV_H */ arch/riscv/kvm/vcpu.c +2
-0@@ -601,6 +601,8 @@ static int kvm_riscv_vcpu_set_reg(struct kvm_vcpu *vcpu, KVM_REG_RISCV_FP_D);case KVM_REG_RISCV_ISA_EXT :return kvm_riscv_vcpu_set_reg_isa_ext (vcpu, reg); +case KVM_REG_RISCV_SBI_EXT : +return kvm_riscv_vcpu_set_reg_sbi_ext (vcpu, reg);default :break ; }arch/riscv/kvm/vcpu_sbi.c +133
-17@@ -30,17 +30,52 @@ static const struct kvm_vcpu_sbi_extension vcpu_sbi_ext_pmu = { };#endif -static const struct kvm_vcpu_sbi_extension *sbi_ext[] = { - &vcpu_sbi_ext_v01, - &vcpu_sbi_ext_base, - &vcpu_sbi_ext_time, - &vcpu_sbi_ext_ipi, - &vcpu_sbi_ext_rfence, - &vcpu_sbi_ext_srst, - &vcpu_sbi_ext_hsm, - &vcpu_sbi_ext_pmu, - &vcpu_sbi_ext_experimental, - &vcpu_sbi_ext_vendor, +struct kvm_riscv_sbi_extension_entry { +enum KVM_RISCV_SBI_EXT_ID dis_idx; +const struct kvm_vcpu_sbi_extension *ext_ptr; +}; + +static const struct kvm_riscv_sbi_extension_entry sbi_ext[] = { + { + .dis_idx =KVM_RISCV_SBI_EXT_V01 , + .ext_ptr = &vcpu_sbi_ext_v01, + }, + { + .dis_idx =KVM_RISCV_SBI_EXT_MAX ,/* Can't be disabled */ + .ext_ptr = &vcpu_sbi_ext_base, + }, + { + .dis_idx =KVM_RISCV_SBI_EXT_TIME , + .ext_ptr = &vcpu_sbi_ext_time, + }, + { + .dis_idx =KVM_RISCV_SBI_EXT_IPI , + .ext_ptr = &vcpu_sbi_ext_ipi, + }, + { + .dis_idx =KVM_RISCV_SBI_EXT_RFENCE , + .ext_ptr = &vcpu_sbi_ext_rfence, + }, + { + .dis_idx =KVM_RISCV_SBI_EXT_SRST , + .ext_ptr = &vcpu_sbi_ext_srst, + }, + { + .dis_idx =KVM_RISCV_SBI_EXT_HSM , + .ext_ptr = &vcpu_sbi_ext_hsm, + }, + { + .dis_idx =KVM_RISCV_SBI_EXT_PMU , + .ext_ptr = &vcpu_sbi_ext_pmu, + }, + { + .dis_idx =KVM_RISCV_SBI_EXT_EXPERIMENTAL , + .ext_ptr = &vcpu_sbi_ext_experimental, + }, + { + .dis_idx =KVM_RISCV_SBI_EXT_VENDOR , + .ext_ptr = &vcpu_sbi_ext_vendor, + }, };void kvm_riscv_vcpu_sbi_forward (struct kvm_vcpu *vcpu,struct kvm_run *run)@@ -99,14 +134,95 @@ int kvm_riscv_vcpu_sbi_return(struct kvm_vcpu *vcpu, struct kvm_run *run)return 0 ; } -const struct kvm_vcpu_sbi_extension *kvm_vcpu_sbi_find_ext (unsigned long extid) +int kvm_riscv_vcpu_set_reg_sbi_ext (struct kvm_vcpu *vcpu, +const struct kvm_one_reg *reg) +{ +unsigned long __user *uaddr = + (unsigned long __user *)(unsigned long )reg->addr; +unsigned long reg_num = reg->id & ~(KVM_REG_ARCH_MASK | +KVM_REG_SIZE_MASK | +KVM_REG_RISCV_SBI_EXT ); +unsigned long i, reg_val; +const struct kvm_riscv_sbi_extension_entry *sext =NULL ; +struct kvm_vcpu_sbi_context *scontext = &vcpu->arch.sbi_context; + +if (KVM_REG_SIZE (reg->id) !=sizeof (unsigned long )) +return -EINVAL ; + +if (copy_from_user (®_val, uaddr,KVM_REG_SIZE (reg->id))) +return -EFAULT ; + +if (reg_num >=KVM_RISCV_SBI_EXT_MAX || + (reg_val !=1 && reg_val !=0 )) +return -EINVAL ; + +if (vcpu->arch.ran_atleast_once) +return -EBUSY ; + +for (i =0 ; i <ARRAY_SIZE (sbi_ext); i++) { +if (sbi_ext[i].dis_idx == reg_num) { + sext = &sbi_ext[i]; +break ; + } + } +if (!sext) +return -ENOENT ; + + scontext->extension_disabled[sext->dis_idx] = !reg_val; + +return 0 ; +} + +int kvm_riscv_vcpu_get_reg_sbi_ext (struct kvm_vcpu *vcpu, +const struct kvm_one_reg *reg) +{ +unsigned long __user *uaddr = + (unsigned long __user *)(unsigned long )reg->addr; +unsigned long reg_num = reg->id & ~(KVM_REG_ARCH_MASK | +KVM_REG_SIZE_MASK | +KVM_REG_RISCV_SBI_EXT ); +unsigned long i, reg_val; +const struct kvm_riscv_sbi_extension_entry *sext =NULL ; +struct kvm_vcpu_sbi_context *scontext = &vcpu->arch.sbi_context; + +if (KVM_REG_SIZE (reg->id) !=sizeof (unsigned long )) +return -EINVAL ; + +if (reg_num >=KVM_RISCV_SBI_EXT_MAX ) +return -EINVAL ; + +for (i =0 ; i <ARRAY_SIZE (sbi_ext); i++) { +if (sbi_ext[i].dis_idx == reg_num) { + sext = &sbi_ext[i]; +break ; + } + } +if (!sext) +return -ENOENT ; + + reg_val = !scontext->extension_disabled[sext->dis_idx]; +if (copy_to_user (uaddr, ®_val,KVM_REG_SIZE (reg->id))) +return -EFAULT ; + +return 0 ; +} + +const struct kvm_vcpu_sbi_extension *kvm_vcpu_sbi_find_ext ( +struct kvm_vcpu *vcpu,unsigned long extid) { -int i =0 ; +int i; +const struct kvm_riscv_sbi_extension_entry *sext; +struct kvm_vcpu_sbi_context *scontext = &vcpu->arch.sbi_context;for (i =0 ; i <ARRAY_SIZE (sbi_ext); i++) { -if (sbi_ext[i]->extid_start <= extid && - sbi_ext[i]->extid_end >= extid) -return sbi_ext[i]; + sext = &sbi_ext[i]; +if (sext->ext_ptr->extid_start <= extid && + sext->ext_ptr->extid_end >= extid) { +if (sext->dis_idx <KVM_RISCV_SBI_EXT_MAX && + scontext->extension_disabled[sext->dis_idx]) +return NULL ; +return sbi_ext[i].ext_ptr; + } }return NULL ;@@ -126,7 +242,7 @@ int kvm_riscv_vcpu_sbi_ecall(struct kvm_vcpu *vcpu, struct kvm_run *run) };bool ext_is_v01 = false; - sbi_ext =kvm_vcpu_sbi_find_ext (cp->a7); + sbi_ext =kvm_vcpu_sbi_find_ext (vcpu, cp->a7);if (sbi_ext && sbi_ext->handler) {#ifdef CONFIG_RISCV_SBI_V01 if (cp->a7 >= SBI_EXT_0_1_SET_TIMER &&arch/riscv/kvm/vcpu_sbi_base.c +1
-1@@ -44,7 +44,7 @@ static int kvm_sbi_ext_base_handler(struct kvm_vcpu *vcpu, struct kvm_run *run,kvm_riscv_vcpu_sbi_forward (vcpu, run); retdata->uexit = true; }else { - sbi_ext =kvm_vcpu_sbi_find_ext (cp->a0); + sbi_ext =kvm_vcpu_sbi_find_ext (vcpu, cp->a0); *out_val = sbi_ext && sbi_ext->probe ? sbi_ext->probe (vcpu) : !!sbi_ext; }Signature · 1 line
2.34.1
This looks good, but I wonder if we shouldn't instead get/set a bitmap of all SBI extension enables at once for scalability.
Thanks,
drew
Re: [PATCH v2 1/1] RISC-V: KVM: Add ONE_REG interface to enable/disable SBI extensions
Quoted 282 lines · On Thu, Mar 30, 2023 at 12:34?PM Andrew Jones <[email protected]> wrote:
Quoted 280 lines · Anup Patel
We add
ONE_REGinterface to enable/disable SBI extensions (just like theONE_REGinterface for ISA extensions). This allows KVM user-space to decide the set of SBI extension enabled for a Guest and by default all SBI extensions are enabled.Signed-off-by Anup Patel <[email protected]>--- arch/riscv/include/asm/kvm_vcpu_sbi.h | 8 +- arch/riscv/include/uapi/asm/kvm.h | 20 ++++ arch/riscv/kvm/vcpu.c | 2 + arch/riscv/kvm/vcpu_sbi.c | 150 +++++++++++++++++++++++--- arch/riscv/kvm/vcpu_sbi_base.c | 2 +- 5 files changed, 163 insertions(+), 19 deletions(-)arch/riscv/include/asm/kvm_vcpu_sbi.h +7
-1@@ -16,6 +16,7 @@struct kvm_vcpu_sbi_context {int return_handled; +bool extension_disabled[KVM_RISCV_SBI_EXT_MAX ]; };struct kvm_vcpu_sbi_return {@@ -45,7 +46,12 @@ void kvm_riscv_vcpu_sbi_system_reset(struct kvm_vcpu *vcpu,struct kvm_run *run, u32 type, u64 flags);int kvm_riscv_vcpu_sbi_return (struct kvm_vcpu *vcpu,struct kvm_run *run); -const struct kvm_vcpu_sbi_extension *kvm_vcpu_sbi_find_ext (unsigned long extid); +int kvm_riscv_vcpu_set_reg_sbi_ext (struct kvm_vcpu *vcpu, +const struct kvm_one_reg *reg); +int kvm_riscv_vcpu_get_reg_sbi_ext (struct kvm_vcpu *vcpu, +const struct kvm_one_reg *reg); +const struct kvm_vcpu_sbi_extension *kvm_vcpu_sbi_find_ext ( +struct kvm_vcpu *vcpu,unsigned long extid);int kvm_riscv_vcpu_sbi_ecall (struct kvm_vcpu *vcpu,struct kvm_run *run);#ifdef CONFIG_RISCV_SBI_V01 arch/riscv/include/uapi/asm/kvm.h +20
-0@@ -108,6 +108,23 @@ enum KVM_RISCV_ISA_EXT_ID { KVM_RISCV_ISA_EXT_MAX, }; +/* +* SBI extension IDs specific to KVM. This is not the same as the SBI +* extension IDs defined by the RISC-V SBI specification. +*/ +enum KVM_RISCV_SBI_EXT_ID { +KVM_RISCV_SBI_EXT_V01 =0 , +KVM_RISCV_SBI_EXT_TIME , +KVM_RISCV_SBI_EXT_IPI , +KVM_RISCV_SBI_EXT_RFENCE , +KVM_RISCV_SBI_EXT_SRST , +KVM_RISCV_SBI_EXT_HSM , +KVM_RISCV_SBI_EXT_PMU , +KVM_RISCV_SBI_EXT_EXPERIMENTAL , +KVM_RISCV_SBI_EXT_VENDOR , +KVM_RISCV_SBI_EXT_MAX , +}; +/* Possible states for kvm_riscv_timer */ #define KVM_RISCV_TIMER_STATE_OFF 0#define KVM_RISCV_TIMER_STATE_ON 1@@ -152,6 +169,9 @@ enum KVM_RISCV_ISA_EXT_ID {/* ISA Extension registers are mapped as type 7 */ #define KVM_REG_RISCV_ISA_EXT (0x07 << KVM_REG_RISCV_TYPE_SHIFT) +/* SBI extension registers are mapped as type 8 */ +#define KVM_REG_RISCV_SBI_EXT (0x08 << KVM_REG_RISCV_TYPE_SHIFT) +#endif #endif /* __LINUX_KVM_RISCV_H */ arch/riscv/kvm/vcpu.c +2
-0@@ -601,6 +601,8 @@ static int kvm_riscv_vcpu_set_reg(struct kvm_vcpu *vcpu, KVM_REG_RISCV_FP_D);case KVM_REG_RISCV_ISA_EXT :return kvm_riscv_vcpu_set_reg_isa_ext (vcpu, reg); +case KVM_REG_RISCV_SBI_EXT : +return kvm_riscv_vcpu_set_reg_sbi_ext (vcpu, reg);default :break ; }arch/riscv/kvm/vcpu_sbi.c +133
-17@@ -30,17 +30,52 @@ static const struct kvm_vcpu_sbi_extension vcpu_sbi_ext_pmu = { };#endif -static const struct kvm_vcpu_sbi_extension *sbi_ext[] = { - &vcpu_sbi_ext_v01, - &vcpu_sbi_ext_base, - &vcpu_sbi_ext_time, - &vcpu_sbi_ext_ipi, - &vcpu_sbi_ext_rfence, - &vcpu_sbi_ext_srst, - &vcpu_sbi_ext_hsm, - &vcpu_sbi_ext_pmu, - &vcpu_sbi_ext_experimental, - &vcpu_sbi_ext_vendor, +struct kvm_riscv_sbi_extension_entry { +enum KVM_RISCV_SBI_EXT_ID dis_idx; +const struct kvm_vcpu_sbi_extension *ext_ptr; +}; + +static const struct kvm_riscv_sbi_extension_entry sbi_ext[] = { + { + .dis_idx =KVM_RISCV_SBI_EXT_V01 , + .ext_ptr = &vcpu_sbi_ext_v01, + }, + { + .dis_idx =KVM_RISCV_SBI_EXT_MAX ,/* Can't be disabled */ + .ext_ptr = &vcpu_sbi_ext_base, + }, + { + .dis_idx =KVM_RISCV_SBI_EXT_TIME , + .ext_ptr = &vcpu_sbi_ext_time, + }, + { + .dis_idx =KVM_RISCV_SBI_EXT_IPI , + .ext_ptr = &vcpu_sbi_ext_ipi, + }, + { + .dis_idx =KVM_RISCV_SBI_EXT_RFENCE , + .ext_ptr = &vcpu_sbi_ext_rfence, + }, + { + .dis_idx =KVM_RISCV_SBI_EXT_SRST , + .ext_ptr = &vcpu_sbi_ext_srst, + }, + { + .dis_idx =KVM_RISCV_SBI_EXT_HSM , + .ext_ptr = &vcpu_sbi_ext_hsm, + }, + { + .dis_idx =KVM_RISCV_SBI_EXT_PMU , + .ext_ptr = &vcpu_sbi_ext_pmu, + }, + { + .dis_idx =KVM_RISCV_SBI_EXT_EXPERIMENTAL , + .ext_ptr = &vcpu_sbi_ext_experimental, + }, + { + .dis_idx =KVM_RISCV_SBI_EXT_VENDOR , + .ext_ptr = &vcpu_sbi_ext_vendor, + }, };void kvm_riscv_vcpu_sbi_forward (struct kvm_vcpu *vcpu,struct kvm_run *run)@@ -99,14 +134,95 @@ int kvm_riscv_vcpu_sbi_return(struct kvm_vcpu *vcpu, struct kvm_run *run)return 0 ; } -const struct kvm_vcpu_sbi_extension *kvm_vcpu_sbi_find_ext (unsigned long extid) +int kvm_riscv_vcpu_set_reg_sbi_ext (struct kvm_vcpu *vcpu, +const struct kvm_one_reg *reg) +{ +unsigned long __user *uaddr = + (unsigned long __user *)(unsigned long )reg->addr; +unsigned long reg_num = reg->id & ~(KVM_REG_ARCH_MASK | +KVM_REG_SIZE_MASK | +KVM_REG_RISCV_SBI_EXT ); +unsigned long i, reg_val; +const struct kvm_riscv_sbi_extension_entry *sext =NULL ; +struct kvm_vcpu_sbi_context *scontext = &vcpu->arch.sbi_context; + +if (KVM_REG_SIZE (reg->id) !=sizeof (unsigned long )) +return -EINVAL ; + +if (copy_from_user (®_val, uaddr,KVM_REG_SIZE (reg->id))) +return -EFAULT ; + +if (reg_num >=KVM_RISCV_SBI_EXT_MAX || + (reg_val !=1 && reg_val !=0 )) +return -EINVAL ; + +if (vcpu->arch.ran_atleast_once) +return -EBUSY ; + +for (i =0 ; i <ARRAY_SIZE (sbi_ext); i++) { +if (sbi_ext[i].dis_idx == reg_num) { + sext = &sbi_ext[i]; +break ; + } + } +if (!sext) +return -ENOENT ; + + scontext->extension_disabled[sext->dis_idx] = !reg_val; + +return 0 ; +} + +int kvm_riscv_vcpu_get_reg_sbi_ext (struct kvm_vcpu *vcpu, +const struct kvm_one_reg *reg) +{ +unsigned long __user *uaddr = + (unsigned long __user *)(unsigned long )reg->addr; +unsigned long reg_num = reg->id & ~(KVM_REG_ARCH_MASK | +KVM_REG_SIZE_MASK | +KVM_REG_RISCV_SBI_EXT ); +unsigned long i, reg_val; +const struct kvm_riscv_sbi_extension_entry *sext =NULL ; +struct kvm_vcpu_sbi_context *scontext = &vcpu->arch.sbi_context; + +if (KVM_REG_SIZE (reg->id) !=sizeof (unsigned long )) +return -EINVAL ; + +if (reg_num >=KVM_RISCV_SBI_EXT_MAX ) +return -EINVAL ; + +for (i =0 ; i <ARRAY_SIZE (sbi_ext); i++) { +if (sbi_ext[i].dis_idx == reg_num) { + sext = &sbi_ext[i]; +break ; + } + } +if (!sext) +return -ENOENT ; + + reg_val = !scontext->extension_disabled[sext->dis_idx]; +if (copy_to_user (uaddr, ®_val,KVM_REG_SIZE (reg->id))) +return -EFAULT ; + +return 0 ; +} + +const struct kvm_vcpu_sbi_extension *kvm_vcpu_sbi_find_ext ( +struct kvm_vcpu *vcpu,unsigned long extid) { -int i =0 ; +int i; +const struct kvm_riscv_sbi_extension_entry *sext; +struct kvm_vcpu_sbi_context *scontext = &vcpu->arch.sbi_context;for (i =0 ; i <ARRAY_SIZE (sbi_ext); i++) { -if (sbi_ext[i]->extid_start <= extid && - sbi_ext[i]->extid_end >= extid) -return sbi_ext[i]; + sext = &sbi_ext[i]; +if (sext->ext_ptr->extid_start <= extid && + sext->ext_ptr->extid_end >= extid) { +if (sext->dis_idx <KVM_RISCV_SBI_EXT_MAX && + scontext->extension_disabled[sext->dis_idx]) +return NULL ; +return sbi_ext[i].ext_ptr; + } }return NULL ;@@ -126,7 +242,7 @@ int kvm_riscv_vcpu_sbi_ecall(struct kvm_vcpu *vcpu, struct kvm_run *run) };bool ext_is_v01 = false; - sbi_ext =kvm_vcpu_sbi_find_ext (cp->a7); + sbi_ext =kvm_vcpu_sbi_find_ext (vcpu, cp->a7);if (sbi_ext && sbi_ext->handler) {#ifdef CONFIG_RISCV_SBI_V01 if (cp->a7 >= SBI_EXT_0_1_SET_TIMER &&arch/riscv/kvm/vcpu_sbi_base.c +1
-1@@ -44,7 +44,7 @@ static int kvm_sbi_ext_base_handler(struct kvm_vcpu *vcpu, struct kvm_run *run,kvm_riscv_vcpu_sbi_forward (vcpu, run); retdata->uexit = true; }else { - sbi_ext =kvm_vcpu_sbi_find_ext (cp->a0); + sbi_ext =kvm_vcpu_sbi_find_ext (vcpu, cp->a0); *out_val = sbi_ext && sbi_ext->probe ?
Quoted 8 lines
Quoted 5 lines
arch/riscv/kvm/vcpu_sbi_base.c +0
-1sbi_ext->probe(vcpu) : !!sbi_ext; } --2.34.1
This looks good, but I wonder if we shouldn't instead get/set a bitmap of all SBI extension enables at once for scalability.
The SBI extensions (just like ISA extensions) are enabled by default so user-space only needs to disable selected ones which it does not want.
Also, the problem with bitmap is that we can't fix the size of bitmap and we will have to define each XLEN bitmap word (along with the bits) separately.
Instead (like you had suggested previously), we should rather add a generic IOCTL which allows user-space to create a VCPU based on some other VCPU as reference.
Regards,
Anup
Re: [PATCH v2 1/1] RISC-V: KVM: Add ONE_REG interface to enable/disable SBI extensions
Quoted 292 lines · Anup Patel
Quoted 282 lines · On Thu, Mar 30, 2023 at 12:34?PM Andrew Jones <[email protected]> wrote:
Quoted 280 lines · Anup Patel
We add
ONE_REGinterface to enable/disable SBI extensions (just like theONE_REGinterface for ISA extensions). This allows KVM user-space to decide the set of SBI extension enabled for a Guest and by default all SBI extensions are enabled.Signed-off-by Anup Patel <[email protected]>--- arch/riscv/include/asm/kvm_vcpu_sbi.h | 8 +- arch/riscv/include/uapi/asm/kvm.h | 20 ++++ arch/riscv/kvm/vcpu.c | 2 + arch/riscv/kvm/vcpu_sbi.c | 150 +++++++++++++++++++++++--- arch/riscv/kvm/vcpu_sbi_base.c | 2 +- 5 files changed, 163 insertions(+), 19 deletions(-)arch/riscv/include/asm/kvm_vcpu_sbi.h +7
-1@@ -16,6 +16,7 @@struct kvm_vcpu_sbi_context {int return_handled; +bool extension_disabled[KVM_RISCV_SBI_EXT_MAX ]; };struct kvm_vcpu_sbi_return {@@ -45,7 +46,12 @@ void kvm_riscv_vcpu_sbi_system_reset(struct kvm_vcpu *vcpu,struct kvm_run *run, u32 type, u64 flags);int kvm_riscv_vcpu_sbi_return (struct kvm_vcpu *vcpu,struct kvm_run *run); -const struct kvm_vcpu_sbi_extension *kvm_vcpu_sbi_find_ext (unsigned long extid); +int kvm_riscv_vcpu_set_reg_sbi_ext (struct kvm_vcpu *vcpu, +const struct kvm_one_reg *reg); +int kvm_riscv_vcpu_get_reg_sbi_ext (struct kvm_vcpu *vcpu, +const struct kvm_one_reg *reg); +const struct kvm_vcpu_sbi_extension *kvm_vcpu_sbi_find_ext ( +struct kvm_vcpu *vcpu,unsigned long extid);int kvm_riscv_vcpu_sbi_ecall (struct kvm_vcpu *vcpu,struct kvm_run *run);#ifdef CONFIG_RISCV_SBI_V01 arch/riscv/include/uapi/asm/kvm.h +20
-0@@ -108,6 +108,23 @@ enum KVM_RISCV_ISA_EXT_ID { KVM_RISCV_ISA_EXT_MAX, }; +/* +* SBI extension IDs specific to KVM. This is not the same as the SBI +* extension IDs defined by the RISC-V SBI specification. +*/ +enum KVM_RISCV_SBI_EXT_ID { +KVM_RISCV_SBI_EXT_V01 =0 , +KVM_RISCV_SBI_EXT_TIME , +KVM_RISCV_SBI_EXT_IPI , +KVM_RISCV_SBI_EXT_RFENCE , +KVM_RISCV_SBI_EXT_SRST , +KVM_RISCV_SBI_EXT_HSM , +KVM_RISCV_SBI_EXT_PMU , +KVM_RISCV_SBI_EXT_EXPERIMENTAL , +KVM_RISCV_SBI_EXT_VENDOR , +KVM_RISCV_SBI_EXT_MAX , +}; +/* Possible states for kvm_riscv_timer */ #define KVM_RISCV_TIMER_STATE_OFF 0#define KVM_RISCV_TIMER_STATE_ON 1@@ -152,6 +169,9 @@ enum KVM_RISCV_ISA_EXT_ID {/* ISA Extension registers are mapped as type 7 */ #define KVM_REG_RISCV_ISA_EXT (0x07 << KVM_REG_RISCV_TYPE_SHIFT) +/* SBI extension registers are mapped as type 8 */ +#define KVM_REG_RISCV_SBI_EXT (0x08 << KVM_REG_RISCV_TYPE_SHIFT) +#endif #endif /* __LINUX_KVM_RISCV_H */ arch/riscv/kvm/vcpu.c +2
-0@@ -601,6 +601,8 @@ static int kvm_riscv_vcpu_set_reg(struct kvm_vcpu *vcpu, KVM_REG_RISCV_FP_D);case KVM_REG_RISCV_ISA_EXT :return kvm_riscv_vcpu_set_reg_isa_ext (vcpu, reg); +case KVM_REG_RISCV_SBI_EXT : +return kvm_riscv_vcpu_set_reg_sbi_ext (vcpu, reg);default :break ; }arch/riscv/kvm/vcpu_sbi.c +133
-17@@ -30,17 +30,52 @@ static const struct kvm_vcpu_sbi_extension vcpu_sbi_ext_pmu = { };#endif -static const struct kvm_vcpu_sbi_extension *sbi_ext[] = { - &vcpu_sbi_ext_v01, - &vcpu_sbi_ext_base, - &vcpu_sbi_ext_time, - &vcpu_sbi_ext_ipi, - &vcpu_sbi_ext_rfence, - &vcpu_sbi_ext_srst, - &vcpu_sbi_ext_hsm, - &vcpu_sbi_ext_pmu, - &vcpu_sbi_ext_experimental, - &vcpu_sbi_ext_vendor, +struct kvm_riscv_sbi_extension_entry { +enum KVM_RISCV_SBI_EXT_ID dis_idx; +const struct kvm_vcpu_sbi_extension *ext_ptr; +}; + +static const struct kvm_riscv_sbi_extension_entry sbi_ext[] = { + { + .dis_idx =KVM_RISCV_SBI_EXT_V01 , + .ext_ptr = &vcpu_sbi_ext_v01, + }, + { + .dis_idx =KVM_RISCV_SBI_EXT_MAX ,/* Can't be disabled */ + .ext_ptr = &vcpu_sbi_ext_base, + }, + { + .dis_idx =KVM_RISCV_SBI_EXT_TIME , + .ext_ptr = &vcpu_sbi_ext_time, + }, + { + .dis_idx =KVM_RISCV_SBI_EXT_IPI , + .ext_ptr = &vcpu_sbi_ext_ipi, + }, + { + .dis_idx =KVM_RISCV_SBI_EXT_RFENCE , + .ext_ptr = &vcpu_sbi_ext_rfence, + }, + { + .dis_idx =KVM_RISCV_SBI_EXT_SRST , + .ext_ptr = &vcpu_sbi_ext_srst, + }, + { + .dis_idx =KVM_RISCV_SBI_EXT_HSM , + .ext_ptr = &vcpu_sbi_ext_hsm, + }, + { + .dis_idx =KVM_RISCV_SBI_EXT_PMU , + .ext_ptr = &vcpu_sbi_ext_pmu, + }, + { + .dis_idx =KVM_RISCV_SBI_EXT_EXPERIMENTAL , + .ext_ptr = &vcpu_sbi_ext_experimental, + }, + { + .dis_idx =KVM_RISCV_SBI_EXT_VENDOR , + .ext_ptr = &vcpu_sbi_ext_vendor, + }, };void kvm_riscv_vcpu_sbi_forward (struct kvm_vcpu *vcpu,struct kvm_run *run)@@ -99,14 +134,95 @@ int kvm_riscv_vcpu_sbi_return(struct kvm_vcpu *vcpu, struct kvm_run *run)return 0 ; } -const struct kvm_vcpu_sbi_extension *kvm_vcpu_sbi_find_ext (unsigned long extid) +int kvm_riscv_vcpu_set_reg_sbi_ext (struct kvm_vcpu *vcpu, +const struct kvm_one_reg *reg) +{ +unsigned long __user *uaddr = + (unsigned long __user *)(unsigned long )reg->addr; +unsigned long reg_num = reg->id & ~(KVM_REG_ARCH_MASK | +KVM_REG_SIZE_MASK | +KVM_REG_RISCV_SBI_EXT ); +unsigned long i, reg_val; +const struct kvm_riscv_sbi_extension_entry *sext =NULL ; +struct kvm_vcpu_sbi_context *scontext = &vcpu->arch.sbi_context; + +if (KVM_REG_SIZE (reg->id) !=sizeof (unsigned long )) +return -EINVAL ; + +if (copy_from_user (®_val, uaddr,KVM_REG_SIZE (reg->id))) +return -EFAULT ; + +if (reg_num >=KVM_RISCV_SBI_EXT_MAX || + (reg_val !=1 && reg_val !=0 )) +return -EINVAL ; + +if (vcpu->arch.ran_atleast_once) +return -EBUSY ; + +for (i =0 ; i <ARRAY_SIZE (sbi_ext); i++) { +if (sbi_ext[i].dis_idx == reg_num) { + sext = &sbi_ext[i]; +break ; + } + } +if (!sext) +return -ENOENT ; + + scontext->extension_disabled[sext->dis_idx] = !reg_val; + +return 0 ; +} + +int kvm_riscv_vcpu_get_reg_sbi_ext (struct kvm_vcpu *vcpu, +const struct kvm_one_reg *reg) +{ +unsigned long __user *uaddr = + (unsigned long __user *)(unsigned long )reg->addr; +unsigned long reg_num = reg->id & ~(KVM_REG_ARCH_MASK | +KVM_REG_SIZE_MASK | +KVM_REG_RISCV_SBI_EXT ); +unsigned long i, reg_val; +const struct kvm_riscv_sbi_extension_entry *sext =NULL ; +struct kvm_vcpu_sbi_context *scontext = &vcpu->arch.sbi_context; + +if (KVM_REG_SIZE (reg->id) !=sizeof (unsigned long )) +return -EINVAL ; + +if (reg_num >=KVM_RISCV_SBI_EXT_MAX ) +return -EINVAL ; + +for (i =0 ; i <ARRAY_SIZE (sbi_ext); i++) { +if (sbi_ext[i].dis_idx == reg_num) { + sext = &sbi_ext[i]; +break ; + } + } +if (!sext) +return -ENOENT ; + + reg_val = !scontext->extension_disabled[sext->dis_idx]; +if (copy_to_user (uaddr, ®_val,KVM_REG_SIZE (reg->id))) +return -EFAULT ; + +return 0 ; +} + +const struct kvm_vcpu_sbi_extension *kvm_vcpu_sbi_find_ext ( +struct kvm_vcpu *vcpu,unsigned long extid) { -int i =0 ; +int i; +const struct kvm_riscv_sbi_extension_entry *sext; +struct kvm_vcpu_sbi_context *scontext = &vcpu->arch.sbi_context;for (i =0 ; i <ARRAY_SIZE (sbi_ext); i++) { -if (sbi_ext[i]->extid_start <= extid && - sbi_ext[i]->extid_end >= extid) -return sbi_ext[i]; + sext = &sbi_ext[i]; +if (sext->ext_ptr->extid_start <= extid && + sext->ext_ptr->extid_end >= extid) { +if (sext->dis_idx <KVM_RISCV_SBI_EXT_MAX && + scontext->extension_disabled[sext->dis_idx]) +return NULL ; +return sbi_ext[i].ext_ptr; + } }return NULL ;@@ -126,7 +242,7 @@ int kvm_riscv_vcpu_sbi_ecall(struct kvm_vcpu *vcpu, struct kvm_run *run) };bool ext_is_v01 = false; - sbi_ext =kvm_vcpu_sbi_find_ext (cp->a7); + sbi_ext =kvm_vcpu_sbi_find_ext (vcpu, cp->a7);if (sbi_ext && sbi_ext->handler) {#ifdef CONFIG_RISCV_SBI_V01 if (cp->a7 >= SBI_EXT_0_1_SET_TIMER &&arch/riscv/kvm/vcpu_sbi_base.c +1
-1@@ -44,7 +44,7 @@ static int kvm_sbi_ext_base_handler(struct kvm_vcpu *vcpu, struct kvm_run *run,kvm_riscv_vcpu_sbi_forward (vcpu, run); retdata->uexit = true; }else { - sbi_ext =kvm_vcpu_sbi_find_ext (cp->a0); + sbi_ext =kvm_vcpu_sbi_find_ext (vcpu, cp->a0); *out_val = sbi_ext && sbi_ext->probe ?Quoted 8 lines
Quoted 5 lines
arch/riscv/kvm/vcpu_sbi_base.c +0
-1sbi_ext->probe(vcpu) : !!sbi_ext; } --2.34.1
This looks good, but I wonder if we shouldn't instead get/set a bitmap of all SBI extension enables at once for scalability.
Quoted 3 lines
The SBI extensions (just like ISA extensions) are enabled by default so user-space only needs to disable selected ones which it does not want.
I guess it depends on the anticipated KVM version gap a guest may need to migrate. For example, if a guest is running on an enterprise host with a long major version release cadence, then it may need to jump several years of KVM changes when its host is upgraded to the next major version. All SBI extensions added since the old KVM version would need to be disabled one by one each time its VCPUs are created on the new host. Nothing would change if a bitmap was used.
Quoted 2 lines
Also, the problem with bitmap is that we can't fix the size of bitmap
That's true. While the set/get-reg interface is a good interface for almost all VCPU configuration, arbitrary length arrays need their own IOCTLs. Or, if the anticipated growth rate of the SBI-ext bitmap is low, then selecting a register width of 128 may be sufficient. If a day comes when we need 129, then another 128-bit virtual register can be added.
Quoted 2 lines
and we will have to define each XLEN bitmap word (along with the bits) separately.
I don't think we need to worry about that. Each SBI-ext gets a UAPI number, and the per-XLEN word and bit numbers can be derived from those numbers with a couple macros exported in UAPI along with them.
Quoted 4 lines
Instead (like you had suggested previously), we should rather add a generic IOCTL which allows user-space to create a VCPU based on some other VCPU as reference.
I need to prototype that idea, but I think choosing each feature's interface can be independent of it, as even if we only need to configure a single VCPU, we might as well make that as efficient as possible too.
Thanks,
drew