Skip to contentSkip to conversation

VFP fixes

PATCH In review Stephen Boyd 4 participants 10 messages Oct 14, 2014 – Oct 28, 2014

Subsystems (3)
lore
Share & tools
lore
#0 lore raw

v2 cover VFP fixes

These changes allow us to detect VFP correctly on Krait processors. They also fix short vector emulation for Cortex-A15 and Krait.

Changes since v1:
* Move to use CPUID and MVFR0 in patch 2
* Patches 1 and 3 unchanged

Stepan Moskovchenko (1):
arm: vfp: Bounce undefined instructions in vectored mode

Stephen Boyd (2):
ARM: vfp: Workaround bad MVFR1 register on some Kraits
ARM: vfp: Fix VFPv3 hwcap detection on CPUID based cpus

 arch/arm/include/asm/vfp.h |  5 +++
 arch/arm/mm/proc-v7.S      |  5 ++-
 arch/arm/vfp/vfphw.S       |  6 +++
 arch/arm/vfp/vfpmodule.c   | 93 ++++++++++++++++++++++++++--------------------
 4 files changed, 66 insertions(+), 43 deletions(-)
Signature · 2 lines
The Qualcomm Innovation Center, Inc. is a member of the Code Aurora Forum,
a Linux Foundation Collaborative Project
#1 lore raw

PATCH v2 1/3 ARM: vfp: Workaround bad MVFR1 register on some Kraits

Certain versions of the Krait processor don't report that they support the fused multiply accumulate instruction via the MVFR1 register despite the fact that they actually do. Unfortunately we use this register to identify support for VFPv4. Override the hwcap on all Krait processors to indicate support for VFPv4 to workaround this.

---
 arch/arm/mm/proc-v7.S | 5 +++--
 1 file changed, 3 insertions(+), 2 deletions(-)
arch/arm/mm/proc-v7.S +3 -2
index b5d67db20897..2e78b4b2538f 100644
@@ -593,9 +593,10 @@ __krait_proc_info:
 	/*
 	 * Some Krait processors don't indicate support for SDIV and UDIV
 	 * instructions in the ARM instruction set, even though they actually
-	 * do support them.
+	 * do support them. They also don't indicate support for fused multiply
+	 * instructions even though they actually do support them.
 	 */
-	__v7_proc __v7_setup, hwcaps = HWCAP_IDIV
+	__v7_proc __v7_setup, hwcaps = HWCAP_IDIV | HWCAP_VFPv4
 	.size	__krait_proc_info, . - __krait_proc_info
 
 	/*
Signature · 2 lines
The Qualcomm Innovation Center, Inc. is a member of the Code Aurora Forum,
a Linux Foundation Collaborative Project
#2 lore raw

PATCH v2 2/3 ARM: vfp: Fix VFPv3 hwcap detection on CPUID based cpus

In reply to Stephen Boyd

The subarchitecture field in the fpsid register is 7 bits wide on ARM CPUs using the CPUID identification scheme, spanning bits 22 to 16. The topmost bit is used to designate that the subarchitecture designer is not ARM when it is set to 1. On non-CPUID scheme CPUs the subarchitecture field is only 4 bits wide and the higher bits are used to indicate no double precision support (bit 20) and the FTSMX/FLDMX format (bits 21-22).

The VFP support code only looks at bits 19-16 to determine the VFP version. On Qualcomm's processors (Krait and Scorpion) we should see that we have HWCAP_VFPv3 but we don't because bit 22 is set to 1 to indicate that the subarchitecture is not implemented by ARM and the rest of the bits are left as 0 because this is the first subarchitecture that Qualcomm has designed. Unfortunately we can't just widen the FPSID subarchitecture bitmask to consider all the bits on a CPUID scheme because there may be CPUs without the CPUID scheme that have VFP without double precision support and then the version would be a very wrong and large number. Instead, update the version detection logic to consider if the CPU is using the CPUID scheme.

If the CPU is using CPUID scheme, use the MVFR registers to determine what version of VFP is supported. We already do this for VFPv4, so do something similar for VFPv3 and look for single or double precision support in MVFR0. Otherwise fall back to using FPSID to detect VFP suppport on non-CPUID scheme CPUs. We know that VFPv3 is only present in CPUs that have support for the CPUID scheme so this should be equivalent.

---
 arch/arm/include/asm/vfp.h |  5 +++
 arch/arm/vfp/vfpmodule.c   | 93 ++++++++++++++++++++++++++--------------------
 2 files changed, 57 insertions(+), 41 deletions(-)
arch/arm/include/asm/vfp.h +5 -0
index f4ab34fd4f72..ee5f3084243c 100644
@@ -22,6 +22,7 @@
 #define FPSID_NODOUBLE		(1<<20)
 #define FPSID_ARCH_BIT		(16)
 #define FPSID_ARCH_MASK		(0xF  << FPSID_ARCH_BIT)
+#define FPSID_CPUID_ARCH_MASK	(0x7F  << FPSID_ARCH_BIT)
 #define FPSID_PART_BIT		(8)
 #define FPSID_PART_MASK		(0xFF << FPSID_PART_BIT)
 #define FPSID_VARIANT_BIT	(4)
@@ -75,6 +76,10 @@
 /* MVFR0 bits */
 #define MVFR0_A_SIMD_BIT	(0)
 #define MVFR0_A_SIMD_MASK	(0xf << MVFR0_A_SIMD_BIT)
+#define MVFR0_SP_BIT		(4)
+#define MVFR0_SP_MASK		(0xf << MVFR0_SP_BIT)
+#define MVFR0_DP_BIT		(8)
+#define MVFR0_DP_MASK		(0xf << MVFR0_DP_BIT)
 
 /* Bit patterns for decoding the packaged operation descriptors */
 #define VFPOPDESC_LENGTH_BIT	(9)
arch/arm/vfp/vfpmodule.c +52 -41

121 lines not on this page · raw message

Signature · 2 lines
The Qualcomm Innovation Center, Inc. is a member of the Code Aurora Forum,
a Linux Foundation Collaborative Project
#3 lore raw

Re: [PATCH v2 2/3] ARM: vfp: Fix VFPv3 hwcap detection on CPUID based cpus

Hi Stephen,

Quoted 21 lines · Stephen Boyd

The subarchitecture field in the fpsid register is 7 bits wide on ARM CPUs using the CPUID identification scheme, spanning bits 22 to 16. The topmost bit is used to designate that the subarchitecture designer is not ARM when it is set to 1. On non-CPUID scheme CPUs the subarchitecture field is only 4 bits wide and the higher bits are used to indicate no double precision support (bit 20) and the FTSMX/FLDMX format (bits 21-22).

The VFP support code only looks at bits 19-16 to determine the VFP version. On Qualcomm's processors (Krait and Scorpion) we should see that we have HWCAP_VFPv3 but we don't because bit 22 is set to 1 to indicate that the subarchitecture is not implemented by ARM and the rest of the bits are left as 0 because this is the first subarchitecture that Qualcomm has designed. Unfortunately we can't just widen the FPSID subarchitecture bitmask to consider all the bits on a CPUID scheme because there may be CPUs without the CPUID scheme that have VFP without double precision support and then the version would be a very wrong and large number. Instead, update the version detection logic to consider if the CPU is using the CPUID scheme.

Quoted 7 lines

If the CPU is using CPUID scheme, use the MVFR registers to determine what version of VFP is supported. We already do this for VFPv4, so do something similar for VFPv3 and look for single or double precision support in MVFR0. Otherwise fall back to using FPSID to detect VFP suppport on non-CPUID scheme CPUs. We know that VFPv3 is only present in CPUs that have support for the CPUID scheme so this should be equivalent.

This looks correct to me, but it raises a bigger question about the suitability of hwcaps for describing features of the instruction set.

With the extended CPUID scheme, there are a whole bunch of different instruction set features that are reported and bundling arbitrary subsets of them into hwcaps such as `VFPv4' doesn't feel like the right thing to do in the long run. It also doesn't seem to match where the architecture is going.

Perhaps it would be better to consider exposing the ID registers to userspace in some manner? This could be done either via an undef handler, or using the vdso. We would add a (final) hwcap advertising this cpuid support. For big/little systems, the kernel would need to expose a suitable subset of the features (we already have the sanity checking code from Rutland).

I'd certainly like to explore that route for arm64, before we start adding a bunch of fine-grained capabilities.

Will

#4 lore raw

Re: [PATCH v2 2/3] ARM: vfp: Fix VFPv3 hwcap detection on CPUID based cpus

Quoted 5 lines · Will Deacon

Perhaps it would be better to consider exposing the ID registers to userspace in some manner? This could be done either via an undef handler, or using the vdso. We would add a (final) hwcap advertising this cpuid support. For big/little systems, the kernel would need to expose a suitable subset of the features (we already have the sanity checking code from Rutland).

This was discussed a few years ago, and some people raised various objections. Off the top of my head:

- Some features (e.g. VFP/NEON) need kernel support, and if this is not enabled, the actual system capabilities will not match the raw register value. Fudging the values exposed to userspace would be fragile.
(This argument has some merit.)

- Only v7 and newer CPUs have the CPUID registers. Ridiculously old CPUs don't even have a CP15. Providing synthetic values might be tricky. Software thus needs to support alternate feature detection methods for such hardware.
(This is true enough.)

- It would only be available on new kernels, so software would still need a fallback to another method for the foreseeable future. (This is a rather lazy argument.)

- It would be specific to Linux, so software can't rely on it anyway. (This is an even lazier argument.)

Signature · 2 lines
M?ns Rullg?rd
mans at mansr.com
#5 lore raw

Re: [PATCH v2 2/3] ARM: vfp: Fix VFPv3 hwcap detection on CPUID based cpus

In reply to Will Deacon
Quoted 31 lines · Will Deacon

Hi Stephen,

Quoted 21 lines · Stephen Boyd

The subarchitecture field in the fpsid register is 7 bits wide on ARM CPUs using the CPUID identification scheme, spanning bits 22 to 16. The topmost bit is used to designate that the subarchitecture designer is not ARM when it is set to 1. On non-CPUID scheme CPUs the subarchitecture field is only 4 bits wide and the higher bits are used to indicate no double precision support (bit 20) and the FTSMX/FLDMX format (bits 21-22).

The VFP support code only looks at bits 19-16 to determine the VFP version. On Qualcomm's processors (Krait and Scorpion) we should see that we have HWCAP_VFPv3 but we don't because bit 22 is set to 1 to indicate that the subarchitecture is not implemented by ARM and the rest of the bits are left as 0 because this is the first subarchitecture that Qualcomm has designed. Unfortunately we can't just widen the FPSID subarchitecture bitmask to consider all the bits on a CPUID scheme because there may be CPUs without the CPUID scheme that have VFP without double precision support and then the version would be a very wrong and large number. Instead, update the version detection logic to consider if the CPU is using the CPUID scheme.

Quoted 7 lines

If the CPU is using CPUID scheme, use the MVFR registers to determine what version of VFP is supported. We already do this for VFPv4, so do something similar for VFPv3 and look for single or double precision support in MVFR0. Otherwise fall back to using FPSID to detect VFP suppport on non-CPUID scheme CPUs. We know that VFPv3 is only present in CPUs that have support for the CPUID scheme so this should be equivalent.

Quoted 2 lines

This looks correct to me, but it raises a bigger question about the suitability of hwcaps for describing features of the instruction set.

Great. Can I get your reviewed-by on this patch please?

Quoted 6 lines

With the extended CPUID scheme, there are a whole bunch of different instruction set features that are reported and bundling arbitrary subsets of them into hwcaps such as `VFPv4' doesn't feel like the right thing to do in the long run. It also doesn't seem to match where the architecture is going.

Quoted 8 lines

Perhaps it would be better to consider exposing the ID registers to userspace in some manner? This could be done either via an undef handler, or using the vdso. We would add a (final) hwcap advertising this cpuid support. For big/little systems, the kernel would need to expose a suitable subset of the features (we already have the sanity checking code from Rutland).

I'd certainly like to explore that route for arm64, before we start adding a bunch of fine-grained capabilities.

I have an RFC for the undef handler written up, except for the big/little thing. Let me post it. Is there anyone from the userspace side that can be on Cc?

Signature · 2 lines
Qualcomm Innovation Center, Inc. is a member of Code Aurora Forum,
a Linux Foundation Collaborative Project
#6 lore raw

Re: [PATCH v2 2/3] ARM: vfp: Fix VFPv3 hwcap detection on CPUID based cpus

Quoted 9 lines · Stephen Boyd
Quoted 8 lines · Will Deacon
Quoted 7 lines · Stephen Boyd

If the CPU is using CPUID scheme, use the MVFR registers to determine what version of VFP is supported. We already do this for VFPv4, so do something similar for VFPv3 and look for single or double precision support in MVFR0. Otherwise fall back to using FPSID to detect VFP suppport on non-CPUID scheme CPUs. We know that VFPv3 is only present in CPUs that have support for the CPUID scheme so this should be equivalent.

Quoted 4 lines
Quoted 2 lines

This looks correct to me, but it raises a bigger question about the suitability of hwcaps for describing features of the instruction set.

Great. Can I get your reviewed-by on this patch please?

Sure. There's a spelling mistake ("arhitecture") which you should fix, but the code looks ok.

Quoted 11 lines
Quoted 11 lines

With the extended CPUID scheme, there are a whole bunch of different instruction set features that are reported and bundling arbitrary subsets of them into hwcaps such as `VFPv4' doesn't feel like the right thing to do in the long run. It also doesn't seem to match where the architecture is going.

Perhaps it would be better to consider exposing the ID registers to userspace in some manner? This could be done either via an undef handler, or using the vdso. We would add a (final) hwcap advertising this cpuid support. For big/little systems, the kernel would need to expose a suitable subset of the features (we already have the sanity checking code from Rutland).

Quoted 6 lines
Quoted 2 lines

I'd certainly like to explore that route for arm64, before we start adding a bunch of fine-grained capabilities.

I have an RFC for the undef handler written up, except for the big/little thing. Let me post it. Is there anyone from the userspace side that can be on Cc?

Off the top of my head:

Mans Rullgard (already replied to this thread)
Peter Maydell <[email protected]> [QEMU]
Jacob Bramley <[email protected]> [JITs]
Kyrylo Tkachov <[email protected]> [GCC]

(CC Rutland for the big/little bits too)

Will

#7 lore raw

Re: [PATCH v2 2/3] ARM: vfp: Fix VFPv3 hwcap detection on CPUID based cpus

Quoted 3 lines · Will Deacon

Sure. There's a spelling mistake ("arhitecture") which you should fix, but the code looks ok.

Ok I'll fix it up and send it off to the patch tracker if I don't hear anything else.

Quoted 5 lines
Quoted 4 lines

I have an RFC for the undef handler written up, except for the big/little thing. Let me post it. Is there anyone from the userspace side that can be on Cc?

Quoted 7 lines

Off the top of my head:

Mans Rullgard (already replied to this thread)
Peter Maydell <[email protected]> [QEMU]
Jacob Bramley <[email protected]> [JITs]
Kyrylo Tkachov <[email protected]> [GCC]

Thanks. I'll add them to the patch for next round and add them on Cc for the current patch on the list.

Signature · 2 lines
Qualcomm Innovation Center, Inc. is a member of Code Aurora Forum,
a Linux Foundation Collaborative Project
#8 lore raw

PATCH v2 3/3 arm: vfp: Bounce undefined instructions in vectored mode

In reply to Stephen Boyd

From: Stepan Moskovchenko <[email protected]>

Certain ARM CPU implementations (e.g. Cortex-A15) may not raise a floating- point exception whenever deprecated short-vector VFP instructions are executed. Instead these instructions are treated as UNALLOCATED. Change the VFP exception handling code to emulate short-vector instructions even if FPEXC exception bits are not set.

---
 arch/arm/vfp/vfphw.S | 6 ++++++
 1 file changed, 6 insertions(+)
arch/arm/vfp/vfphw.S +6 -0
index cda654cbf2c2..f74a8f7e5f84 100644
@@ -197,6 +197,12 @@ look_for_VFP_exceptions:
 	tst	r5, #FPSCR_IXE
 	bne	process_exception
 
+	tst	r5, #FPSCR_LENGTH_MASK
+	beq	skip
+	orr	r1, r1, #FPEXC_DEX
+	b	process_exception
+skip:
+
 	@ Fall into hand on to next handler - appropriate coproc instr
 	@ not recognised by VFP
 
Signature · 2 lines
The Qualcomm Innovation Center, Inc. is a member of the Code Aurora Forum,
a Linux Foundation Collaborative Project
Tested-by on the v2 series
#9 lore raw
In reply to Stephen Boyd
Quoted 7 lines · Stephen Boyd

These changes allow us to detect VFP correctly on Krait processors. They also fix short vector emulation for Cortex-A15 and Krait.

Changes since v1:
* Move to use CPUID and MVFR0 in patch 2
* Patches 1 and 3 unchanged

Quoted 7 lines

Stepan Moskovchenko (1):
arm: vfp: Bounce undefined instructions in vectored mode

Stephen Boyd (2):
ARM: vfp: Workaround bad MVFR1 register on some Kraits
ARM: vfp: Fix VFPv3 hwcap detection on CPUID based cpus

for the series,

Quoted 10 lines
 arch/arm/include/asm/vfp.h |  5 +++
 arch/arm/mm/proc-v7.S      |  5 ++-
 arch/arm/vfp/vfphw.S       |  6 +++
 arch/arm/vfp/vfpmodule.c   | 93 ++++++++++++++++++++++++++--------------------
 4 files changed, 66 insertions(+), 43 deletions(-)

--
The Qualcomm Innovation Center, Inc. is a member of the Code Aurora Forum, a Linux Foundation Collaborative Project