ARMv8.5-RNG support
Subsystems (2)
v9 cover ARMv8.5-RNG support
This series is based on Richard Henderson's previous v7, it addresses review comments from that version by splitting the boot and runtime interaction with the core random code so that they are completely separate and adds a new change that uses the v8.5-RNG extension to seed KASLR when ARCH_RANDOM is enabled.
v9:
- Make another static inline helper for early feature checks.
- Add init annotations.
- Use xor to add RNDR output to seed for KASLR.
Mark Brown (2):
arm64: random: Add data to pool from setup_arch()
arm64: Use v8.5-RNG entropy for KASLR seed
Richard Henderson (1):
arm64: Implement archrandom.h for ARMv8.5-RNG
Documentation/arm64/cpu-feature-registers.rst | 2 + arch/arm64/Kconfig | 12 +++ arch/arm64/include/asm/archrandom.h | 97 +++++++++++++++++++ arch/arm64/include/asm/cpucaps.h | 3 +- arch/arm64/include/asm/sysreg.h | 4 + arch/arm64/kernel/cpufeature.c | 13 +++ arch/arm64/kernel/kaslr.c | 11 +++ arch/arm64/kernel/setup.c | 2 + 8 files changed, 143 insertions(+), 1 deletion(-) create mode 100644 arch/arm64/include/asm/archrandom.h
Signature · 7 lines
2.20.1 _______________________________________________ linux-arm-kernel mailing list [email protected] http://lists.infradead.org/mailman/listinfo/linux-arm-kernel
PATCH v9 1/3 arm64: Implement archrandom.h for ARMv8.5-RNG
From: Richard Henderson <[email protected]>
Expose the ID_AA64ISAR0.RNDR field to userspace, as the RNG system registers are always available at EL0.
Implement arch_get_random_seed_long using RNDR. Given that the TRNG is likely to be a shared resource between cores, and VMs, do not explicitly force re-seeding with RNDRRS. In order to avoid code complexity and potential issues with hetrogenous systems only provide values after cpufeature has finalized the system capabilities.
[Modified to only function after cpufeature has finalized the system capabilities and move all the code into the header -- broonie]
--- Documentation/arm64/cpu-feature-registers.rst | 2 + arch/arm64/Kconfig | 12 ++++ arch/arm64/include/asm/archrandom.h | 67 +++++++++++++++++++ arch/arm64/include/asm/cpucaps.h | 3 +- arch/arm64/include/asm/sysreg.h | 4 ++ arch/arm64/kernel/cpufeature.c | 13 ++++ 6 files changed, 100 insertions(+), 1 deletion(-) create mode 100644 arch/arm64/include/asm/archrandom.h
Documentation/arm64/cpu-feature-registers.rst +2 -0
@@ -117,6 +117,8 @@ infrastructure: +------------------------------+---------+---------+ | Name | bits | visible | +------------------------------+---------+---------+ + | RNDR | [63-60] | y | + +------------------------------+---------+---------+ | TS | [55-52] | y | +------------------------------+---------+---------+ | FHM | [51-48] | y |
arch/arm64/Kconfig +12 -0
@@ -1484,6 +1484,18 @@ config ARM64_PTR_AUTH endmenu +menu "ARMv8.5 architectural features" + +config ARCH_RANDOM + bool "Enable support for random number generation" + default y + help + Random number generation (part of the ARMv8.5 Extensions) + provides a high bandwidth, cryptographically secure + hardware random number generator. + +endmenu + config ARM64_SVE bool "ARM Scalable Vector Extension support" default y
arch/arm64/include/asm/archrandom.h new file +67 -0
67 lines not on this page · raw message
arch/arm64/include/asm/cpucaps.h +2 -1
@@ -56,7 +56,8 @@#define ARM64_WORKAROUND_CAVIUM_TX2_219_PRFM 46#define ARM64_WORKAROUND_1542419 47#define ARM64_WORKAROUND_1319367 48 +#define ARM64_HAS_RNG 49 -#define ARM64_NCAPS 49 +#define ARM64_NCAPS 50#endif /* __ASM_CPUCAPS_H */
arch/arm64/include/asm/sysreg.h +4 -0
@@ -365,6 +365,9 @@#define SYS_CTR_EL0 sys_reg(3, 3, 0, 0, 1)#define SYS_DCZID_EL0 sys_reg(3, 3, 0, 0, 7) +#define SYS_RNDR_EL0 sys_reg(3, 3, 2, 4, 0) +#define SYS_RNDRRS_EL0 sys_reg(3, 3, 2, 4, 1) +#define SYS_PMCR_EL0 sys_reg(3, 3, 9, 12, 0)#define SYS_PMCNTENSET_EL0 sys_reg(3, 3, 9, 12, 1)#define SYS_PMCNTENCLR_EL0 sys_reg(3, 3, 9, 12, 2)
@@ -539,6 +542,7 @@ ENDIAN_SET_EL1 | SCTLR_EL1_UCI | SCTLR_EL1_RES1)/* id_aa64isar0 */ +#define ID_AA64ISAR0_RNDR_SHIFT 60#define ID_AA64ISAR0_TS_SHIFT 52#define ID_AA64ISAR0_FHM_SHIFT 48#define ID_AA64ISAR0_DP_SHIFT 44
arch/arm64/kernel/cpufeature.c +13 -0
@@ -119,6 +119,7 @@ static void cpu_enable_cnp(struct arm64_cpu_capabilities const *cap);* sync with the documentation of the CPU feature register ABI. */ static const struct arm64_ftr_bits ftr_id_aa64isar0[] = { +ARM64_FTR_BITS (FTR_VISIBLE ,FTR_STRICT ,FTR_LOWER_SAFE ,ID_AA64ISAR0_RNDR_SHIFT ,4 ,0 ),ARM64_FTR_BITS (FTR_VISIBLE ,FTR_STRICT ,FTR_LOWER_SAFE ,ID_AA64ISAR0_TS_SHIFT ,4 ,0 ),ARM64_FTR_BITS (FTR_VISIBLE ,FTR_STRICT ,FTR_LOWER_SAFE ,ID_AA64ISAR0_FHM_SHIFT ,4 ,0 ),ARM64_FTR_BITS (FTR_VISIBLE ,FTR_STRICT ,FTR_LOWER_SAFE ,ID_AA64ISAR0_DP_SHIFT ,4 ,0 ),
@@ -1566,6 +1567,18 @@ static const struct arm64_cpu_capabilities arm64_features[] = { .sign = FTR_UNSIGNED, .min_field_value = 1, }, +#endif +#ifdef CONFIG_ARCH_RANDOM + { + .desc = "Random Number Generator", + .capability = ARM64_HAS_RNG, + .type = ARM64_CPUCAP_SYSTEM_FEATURE, + .matches = has_cpuid_feature, + .sys_reg = SYS_ID_AA64ISAR0_EL1, + .field_pos = ID_AA64ISAR0_RNDR_SHIFT, + .sign = FTR_UNSIGNED, + .min_field_value = 1, + }, #endif {}, };
Signature · 7 lines
2.20.1 _______________________________________________ linux-arm-kernel mailing list [email protected] http://lists.infradead.org/mailman/listinfo/linux-arm-kernel
PATCH v9 2/3 arm64: random: Add data to pool from setup_arch()
In reply to Mark BrownSince the arm64 ARCH_RANDOM implementation is not available until cpufeature has determined the system capabilities it can't be used by the generic random code to initialize the entropy pool for early use. Instead explicitly add some data to the pool from setup_arch() if the boot CPU supports v8.5-RNG, this is the point recommended by the generic code.
--- arch/arm64/include/asm/archrandom.h | 30 +++++++++++++++++++++++++++++ arch/arm64/kernel/setup.c | 2 ++ 2 files changed, 32 insertions(+)
arch/arm64/include/asm/archrandom.h +30 -0
@@ -59,9 +59,39 @@ static inline bool __must_check arch_get_random_seed_int(unsigned int *v)return ok; } +static inline bool __init __early_cpu_has_rndr (void ) +{ +/* Open code as we run prior to the first call to cpufeature. */ +unsigned long ftr =read_sysreg_s (SYS_ID_AA64ISAR0_EL1 ); +return (ftr >>ID_AA64ISAR0_RNDR_SHIFT ) &0xf ; +} + +/* +* Our ARCH_RANDOM implementation does not function until relatively +* late in the boot when cpufeature has detertmined system +* capabilities so the core code can't use arch_get_random*() to +* initialize, instead we call this function to inject data from +* setup_arch() if the boot CPU supports v8.5-RNG. +*/ +static inline void __init arm64_add_early_rndr_entropy (void ) +{ +unsigned long val; +int i; + +if (!__early_cpu_has_rndr ()) +return ; + +/* Add multiple values to mirror the generic code. */ +for (i =0 ; i <16 ; i++) +if (__arm64_rndr (&val)) +add_device_randomness (&val,sizeof (val)); +} +#else static inline bool __arm64_rndr (unsigned long *v) {return false; } +static inline bool __init __early_cpu_has_rndr (void ) {return false; } +static inline void __init arm64_add_early_rndr_entropy (void ) { }#endif /* CONFIG_ARCH_RANDOM */ #endif /* _ASM_ARCHRANDOM_H */
arch/arm64/kernel/setup.c +2 -0
@@ -344,6 +344,8 @@ void __init setup_arch(char **cmdline_p)/* Init percpu seeds for random tags after cpus are set up. */ kasan_init_tags (); +arm64_add_early_rndr_entropy (); +#ifdef CONFIG_ARM64_SW_TTBR0_PAN /* * Make sure init_thread_info.ttbr0 always generates translation
Signature · 7 lines
2.20.1 _______________________________________________ linux-arm-kernel mailing list [email protected] http://lists.infradead.org/mailman/listinfo/linux-arm-kernel
Re: [PATCH v9 2/3] arm64: random: Add data to pool from setup_arch()
Quoted 10 lines · Mark Brown
arch/arm64/include/asm/archrandom.h +10
-0+/* +* Our ARCH_RANDOM implementation does not function until relatively +* late in the boot when cpufeature has detertmined system +* capabilities so the core code can't use arch_get_random*() to +* initialize, instead we call this function to inject data from +* setup_arch() if the boot CPU supports v8.5-RNG. +*/ +static inline void __init arm64_add_early_rndr_entropy (void ) +{ +unsigned long val;
arch/arm64/include/asm/archrandom.h static inline bool __must_check arch_get_random_seed_int(unsigned int *v) · line 88
Quoted 10 lines
arch/arm64/include/asm/archrandom.h +10
-0+int i; + +if (!__early_cpu_has_rndr ()) +return ; + +/* Add multiple values to mirror the generic code. */ +for (i =0 ; i <16 ; i++) +if (__arm64_rndr (&val)) +add_device_randomness (&val,sizeof (val)); +}
This is not nearly the same thing as what crng_initialize does. In particular, it's not going to advance crng_init at all.
You could use add_hwgenerator_randomness, but you have no way to honor the random.trust_cpu command-line parameter that way.
The only thing I can imagine that would satisfy MarkR's constraints is to have a new archrandom.h interface, arch_get_random_boot_long().
r~
_______________________________________________
linux-arm-kernel mailing list
[email protected]
http://lists.infradead.org/mailman/listinfo/linux-arm-kernel
Re: [PATCH v9 2/3] arm64: random: Add data to pool from setup_arch()
Quoted 9 lines · Richard Henderson
arch/arm64/include/asm/archrandom.h static inline bool __must_check arch_get_random_seed_int(unsigned int *v) · line 88
Quoted 4 lines · Mark Brown
arch/arm64/include/asm/archrandom.h +4
-0+for (i =0 ; i <16 ; i++) +if (__arm64_rndr (&val)) +add_device_randomness (&val,sizeof (val)); +}This is not nearly the same thing as what
crng_initializedoes. In particular, it's not going to advancecrng_initat all.
That's right, but I think that's good enough to get us going here. It will add data into the pool so we're mitigating against a lack of per device entropy which seems clearly better than doing nothing at all and has no issues with integration with the decision about trusting the RNG to provide entropy so it's safe. The commit message does say we add data rather than entropy, though I agree that on reflection the callback isn't clearly named there and people not familiar with the random subsystem will likely not notice the difference.
We could definitely improve the commit message a bit here or even drop the patch but I think we're better off with this than without it, and exposing the feature to userspace, allowing in kernel usage after init and using it for KASAN are clear wins regardless of what we do with the pool. If we can do something that credits the entropy at boot that'd be even better of course but I don't think that needs to block everything else.
Quoted 2 lines
You could use
add_hwgenerator_randomness, but you have no way to honor the random.trust_cpu command-line parameter that way.
Right, that'd definitely be the wrong thing to do here.
Quoted 1 line
The only thing I can imagine that would satisfy MarkR's constraints is to have
The main issue he had was as far as I can tell with adding complexity to the main runtime path which we now avoid, we now don't have anything that needs to disable preemption or anything like that.
Quoted 1 line
a new
archrandom.hinterface,arch_get_random_boot_long().
An equivalent of device_add_randomness() that credits entropy would also do the trick for adding entropy, it'd definitely be more hassle to implement and quite possibly more trouble than it's worth compared to a simple call like you suggest but it does have the advantage that you know the core can't try to call it once we've got multiple CPUs up.
_______________________________________________
linux-arm-kernel mailing list
[email protected]
http://lists.infradead.org/mailman/listinfo/linux-arm-kernel
PATCH v9 3/3 arm64: Use v8.5-RNG entropy for KASLR seed
In reply to Mark BrownWhen seeding KALSR on a system where we have architecture level random number generation make use of that entropy, mixing it in with the seed passed by the bootloader. Since this is run very early in init before feature detection is complete we open code rather than use archrandom.h.
--- arch/arm64/kernel/kaslr.c | 11 +++++++++++ 1 file changed, 11 insertions(+)
arch/arm64/kernel/kaslr.c +11 -0
@@ -120,6 +120,17 @@ u64 __init kaslr_early_init(u64 dt_phys)return 0 ; } +/* +* Mix in any entropy obtainable architecturally, open coded +* since this runs extremely early. +*/ +if (__early_cpu_has_rndr ()) { +unsigned long raw; + +if (__arm64_rndr (&raw)) + seed ^= raw; + } +if (!seed) { kaslr_status =KASLR_DISABLED_NO_SEED ;return 0 ;
Signature · 7 lines
2.20.1 _______________________________________________ linux-arm-kernel mailing list [email protected] http://lists.infradead.org/mailman/listinfo/linux-arm-kernel