Enumerate and expose AVX512_FP16 feature
cover Enumerate and expose AVX512_FP16 feature
Introduce AVX512_FP16 feature and expose it to KVM CPUID for processors that support it. KVM reports this information and guests can make use of it.
Detailed information on the instruction and CPUID feature flag can be found in the latest "extensions" manual [1].
Reference:
[1]. https://software.intel.com/content/www/us/en/develop/download/intel-architecture-instruction-set-extensions-programming-reference.html
Cathy Zhang (1):
x86: Expose AVX512_FP16 for supported CPUID
Kyung Min Park (1):
Enumerate AVX512 FP16 CPUID feature flag
arch/x86/include/asm/cpufeatures.h | 1 + arch/x86/kernel/cpu/cpuid-deps.c | 1 + arch/x86/kvm/cpuid.c | 2 +- 3 files changed, 3 insertions(+), 1 deletion(-)
Signature · 1 line
2.17.1
PATCH 1/2 Enumerate AVX512 FP16 CPUID feature flag
Enumerate AVX512 Half-precision floating point (FP16) CPUID feature flag. Compared with using FP32, using FP16 cut the number of bits required for storage in half, reducing the exponent from 8 bits to 5, and the mantissa from 23 bits to 10. Using FP16 also enables developers to train and run inference on deep learning models fast when all precision or magnitude (FP32) is not needed.
A processor supports AVX512 FP16 if CPUID.(EAX=7,ECX=0):EDX[bit 23] is present. The AVX512 FP16 requires AVX512BW feature be implemented since the instructions for manipulating 32bit masks are associated with AVX512BW.
The only in-kernel usage of this is kvm passthrough. The CPU feature flag is shown as "avx512_fp16" in /proc/cpuinfo.
--- arch/x86/include/asm/cpufeatures.h | 1 + arch/x86/kernel/cpu/cpuid-deps.c | 1 + 2 files changed, 2 insertions(+)
arch/x86/include/asm/cpufeatures.h +1 -0
@@ -375,6 +375,7 @@#define X86_FEATURE_TSXLDTRK (18*32+16)/* TSX Suspend Load Address Tracking */ #define X86_FEATURE_PCONFIG (18*32+18)/* Intel PCONFIG */ #define X86_FEATURE_ARCH_LBR (18*32+19)/* Intel ARCH LBR */ +#define X86_FEATURE_AVX512_FP16 (18*32+23)/* AVX512 FP16 */ #define X86_FEATURE_SPEC_CTRL (18*32+26)/* "" Speculation Control (IBRS + IBPB) */ #define X86_FEATURE_INTEL_STIBP (18*32+27)/* "" Single Thread Indirect Branch Predictors */ #define X86_FEATURE_FLUSH_L1D (18*32+28)/* Flush L1D cache */
arch/x86/kernel/cpu/cpuid-deps.c +1 -0
@@ -69,6 +69,7 @@ static const struct cpuid_dep cpuid_deps[] = { { X86_FEATURE_CQM_MBM_TOTAL, X86_FEATURE_CQM_LLC }, { X86_FEATURE_CQM_MBM_LOCAL, X86_FEATURE_CQM_LLC }, { X86_FEATURE_AVX512_BF16, X86_FEATURE_AVX512VL }, + { X86_FEATURE_AVX512_FP16, X86_FEATURE_AVX512BW }, { X86_FEATURE_ENQCMD, X86_FEATURE_XSAVES }, { X86_FEATURE_PER_THREAD_MBA, X86_FEATURE_MBA }, {}
Signature · 1 line
2.17.1
Re: [PATCH 1/2] Enumerate AVX512 FP16 CPUID feature flag
Quoted 41 lines · Kyung Min Park
Enumerate AVX512 Half-precision floating point (FP16) CPUID feature flag. Compared with using FP32, using FP16 cut the number of bits required for storage in half, reducing the exponent from 8 bits to 5, and the mantissa from 23 bits to 10. Using FP16 also enables developers to train and run inference on deep learning models fast when all precision or magnitude (FP32) is not needed.
A processor supports AVX512 FP16 if CPUID.(EAX=7,ECX=0):EDX[bit 23] is present. The AVX512 FP16 requires AVX512BW feature be implemented since the instructions for manipulating 32bit masks are associated with AVX512BW.
The only in-kernel usage of this is kvm passthrough. The CPU feature flag is shown as "
avx512_fp16" in/proc/cpuinfo.Signed-off-by Kyung Min Park <[email protected]>Acked-by Dave Hansen <[email protected]>Reviewed-by Tony Luck <[email protected]>--- arch/x86/include/asm/cpufeatures.h | 1 + arch/x86/kernel/cpu/cpuid-deps.c | 1 + 2 files changed, 2 insertions(+)arch/x86/include/asm/cpufeatures.h +1
-0@@ -375,6 +375,7 @@#define X86_FEATURE_TSXLDTRK (18*32+16)/* TSX Suspend Load Address Tracking */ #define X86_FEATURE_PCONFIG (18*32+18)/* Intel PCONFIG */ #define X86_FEATURE_ARCH_LBR (18*32+19)/* Intel ARCH LBR */ +#define X86_FEATURE_AVX512_FP16 (18*32+23)/* AVX512 FP16 */ #define X86_FEATURE_SPEC_CTRL (18*32+26)/* "" Speculation Control (IBRS + IBPB) */ #define X86_FEATURE_INTEL_STIBP (18*32+27)/* "" Single Thread Indirect Branch Predictors */ #define X86_FEATURE_FLUSH_L1D (18*32+28)/* Flush L1D cache */ arch/x86/kernel/cpu/cpuid-deps.c +0
-0
arch/x86/kernel/cpu/cpuid-deps.c static const struct cpuid_dep cpuid_deps[] = { · line 75
Quoted 7 lines
arch/x86/kernel/cpu/cpuid-deps.c +1
-0@@ -69,6 +69,7 @@ static const struct cpuid_dep cpuid_deps[] = { { X86_FEATURE_CQM_MBM_TOTAL, X86_FEATURE_CQM_LLC }, { X86_FEATURE_CQM_MBM_LOCAL, X86_FEATURE_CQM_LLC }, { X86_FEATURE_AVX512_BF16, X86_FEATURE_AVX512VL }, + { X86_FEATURE_AVX512_FP16, X86_FEATURE_AVX512BW }, { X86_FEATURE_ENQCMD, X86_FEATURE_XSAVES }, { X86_FEATURE_PER_THREAD_MBA, X86_FEATURE_MBA }, {}
Paolo, you can pick those up if you prefer.
Thx.
Signature · 4 lines
Regards/Gruss,
Boris.
https://people.kernel.org/tglx/notes-about-netiquettePATCH 2/2 x86: Expose AVX512_FP16 for supported CPUID
In reply to Kyung Min ParkFrom: Cathy Zhang <[email protected]>
AVX512_FP16 is supported by Intel processors, like Sapphire Rapids. It could gain better performance for it's faster compared to FP32 while meets the precision or magnitude requirement. It's availability is indicated by CPUID.(EAX=7,ECX=0):EDX[bit 23].
Expose it in KVM supported CPUID, then guest could make use of it.
--- arch/x86/kvm/cpuid.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
arch/x86/kvm/cpuid.c +1 -1
@@ -416,7 +416,7 @@ void kvm_set_cpu_caps(void)F (AVX512_4VNNIW ) |F (AVX512_4FMAPS ) |F (SPEC_CTRL ) |F (SPEC_CTRL_SSBD ) |F (ARCH_CAPABILITIES ) |F (INTEL_STIBP ) |F (MD_CLEAR ) |F (AVX512_VP2INTERSECT ) |F (FSRM ) | -F (SERIALIZE ) |F (TSXLDTRK ) +F (SERIALIZE ) |F (TSXLDTRK ) |F (AVX512_FP16 ) );/* TSC_ADJUST and ARCH_CAPABILITIES are emulated in software. */
Signature · 1 line
2.17.1
Sean Christopherson
maintainerRe: [PATCH 2/2] x86: Expose AVX512_FP16 for supported CPUID
Shortlog should use "KVM: x86: ...", and probably s/for/in. It currently reads like the kernel is exposing the flag to KVM for KVM's supported CPUID, e.g.:
KVM: x86: Expose AVX512_FP16 in supported CPUID
Quoted 8 lines · Kyung Min Park
From: Cathy Zhang <[email protected]>
AVX512_FP16is supported by Intel processors, like Sapphire Rapids. It could gain better performance for it's faster compared to FP32 while meets the precision or magnitude requirement. It's availability is indicated by CPUID.(EAX=7,ECX=0):EDX[bit 23].Expose it in KVM supported CPUID, then guest could make use of it.
For new features like this that don't require additional KVM enabling, it would be nice to explicitly state as much in the changelog, along with a brief explanation of why additional KVM enabling is not necessary. It doesn't have to be much, just something to help people that aren't already familiar with FP16 understand what this patch actually exposes to the guest. E.g. I assume there are new instructions that are available with FP16?
Quoted 24 lines
Signed-off-by Cathy Zhang <[email protected]>Signed-off-by Kyung Min Park <[email protected]>Acked-by Dave Hansen <[email protected]>Reviewed-by Tony Luck <[email protected]>--- arch/x86/kvm/cpuid.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)arch/x86/kvm/cpuid.c +1
-1@@ -416,7 +416,7 @@ void kvm_set_cpu_caps(void)F (AVX512_4VNNIW ) |F (AVX512_4FMAPS ) |F (SPEC_CTRL ) |F (SPEC_CTRL_SSBD ) |F (ARCH_CAPABILITIES ) |F (INTEL_STIBP ) |F (MD_CLEAR ) |F (AVX512_VP2INTERSECT ) |F (FSRM ) | -F (SERIALIZE ) |F (TSXLDTRK ) +F (SERIALIZE ) |F (TSXLDTRK ) |F (AVX512_FP16 ) );/* TSC_ADJUST and ARCH_CAPABILITIES are emulated in software. */ Signature · 1 line
2.17.1
Quoted 13 lines · Kyung Min Park
Introduce
AVX512_FP16feature and expose it to KVM CPUID for processors that support it. KVM reports this information and guests can make use of it.Detailed information on the instruction and CPUID feature flag can be found in the latest "extensions" manual [1].
Reference:
[1]. https://software.intel.com/content/www/us/en/develop/download/intel-architecture-instruction-set-extensions-programming-reference.htmlCathy Zhang (1):
x86: ExposeAVX512_FP16for supported CPUID
Quoted 8 lines
Kyung Min Park (1):
Enumerate AVX512 FP16 CPUID feature flagarch/x86/include/asm/cpufeatures.h | 1 + arch/x86/kernel/cpu/cpuid-deps.c | 1 + arch/x86/kvm/cpuid.c | 2 +- 3 files changed, 3 insertions(+), 1 deletion(-)
Queued, with adjusted commit message according to Sean's review.
Paolo
Thanks Paolo and Sean! Sorry for the delay response, I'm back from vacation and just see Sean's comment, and I see Paolo has made changes, thanks a bunch!
Quoted 27 lines · Paolo Bonzini
Quoted 13 lines · Kyung Min Park
Introduce
AVX512_FP16feature and expose it to KVM CPUID for processors that support it. KVM reports this information and guests can make use of it.Detailed information on the instruction and CPUID feature flag can be found in the latest "extensions" manual [1].
Reference:
[1]. https://software.intel.com/content/www/us/en/develop/download/intel-architecture-instruction-set-extensions-programming-reference.htmlCathy Zhang (1):
x86: ExposeAVX512_FP16for supported CPUIDQuoted 8 lines
Kyung Min Park (1):
Enumerate AVX512 FP16 CPUID feature flag
arch/x86/include/asm/cpufeatures.h| 1 +
arch/x86/kernel/cpu/cpuid-deps.c | 1 +
arch/x86/kvm/cpuid.c | 2 +-3 files changed, 3 insertions(+), 1 deletion(-)Queued, with adjusted commit message according to Sean's review.
Paolo