riscv: support for Svpbmt and D1 memory types
Subsystems (2)
v9 cover riscv: support for Svpbmt and D1 memory types
Svpbmt is an extension defining "Supervisor-mode: page-based memory types" for things like non-cacheable pages or I/O memory pages.
So this is my 2nd try at implementing Svpbmt (and the diverging D1 memory types) using the alternatives framework.
This includes a number of changes to the alternatives mechanism itself. The biggest one being the move to a more central location, as I expect in the future, nearly every chip needing some sort of patching, be it either for erratas or for optional features (svpbmt or others).
Detection of the svpbmt functionality is done via Atish's isa extension handling series [0] and thus does not need any dt-parsing of its own anymore.
The series also introduces support for the memory types of the D1 which are implemented differently to svpbmt. But when patching anyway it's pretty clean to add the D1 variant via ALTERNATIVE_2 to the same location.
The only slightly bigger difference is that the "normal" type is not 0 as with svpbmt, so kernel patches for this PMA type need to be applied even before the MMU is brought up, so the series introduces a separate stage for that.
In theory this series is 2 parts:
- alternatives improvements
- svpbmt+d1
I picked the recipient list from the previous versions, hopefully I didn't forget anybody.
I tested the series on:
- qemu-rv32 + buildroot rootfs
- qemu-rv64 + debian roots
- Allwinner D1-Nezha
- BeagleV - it at least reached the same point as without the series
changes in v9:
- rebase onto 5.18-rc1
- drop the sbi null-ptr patch
While I still think this to be non-ideal as is, it isn't really necessary for svpbmt support anymore
- merge cpufeature + svpbmt patch, as otherwise some empty shells cause build warnings when a bisection stops between these two patches
- address review comments from Christoph Hellwig:
- keep alternatives optional, they now get selected by its users (erratas and also the newly introduced svpbmt kconfig)
- wrap long lines and keep things below 80 characters
- restyle svpbmt + thead errata assembly
- introduce a helper for the repeated calls to
(val & _PAGE_PFN_MASK) >> _PAGE_PFN_SHIFT
changes in v8:
- rebase onto 5.17-final + isa extension series We're halfway through the merge-window, so this series should be merge after that
- adapt to fix limiting alternatives to non-xip-kernels
- add .norelax option for alternatives
- fix unused cpu_apply_errata in thead errata
- don't use static globals to store cpu-manufacturer data as it makes machines hang if done too early
changes in v7:
- fix typo in patch1 (Atish)
- moved to Atish's isa-extension framework
- and therefore move regular boot-alternatives directly behind fill_hwcaps
- change T-Head errata Kconfig text (Atish)
changes in v6:
- rebase onto 5.17-rc1
- handle sbi null-ptr differently
- improve commit messages
- use riscv,mmu as property name
changes in v5:
- move to use alternatives for runtime-patching
- add D1 variant
[0] https://lore.kernel.org/r/[email protected]
Heiko Stuebner (12):
riscv: integrate alternatives better into the main architecture
riscv: allow different stages with alternatives
riscv: implement module alternatives
riscv: implement ALTERNATIVE_2 macro
riscv: extend concatenated alternatives-lines to the same length
riscv: prevent compressed instructions in alternatives
riscv: move boot alternatives to after fill_hwcap
riscv: Fix accessing pfn bits in PTEs for non-32bit variants
riscv: add RISC-V Svpbmt extension support
riscv: remove FIXMAP_PAGE_IO and fall back to its default value
riscv: don't use global static vars to store alternative data
riscv: add memory-type errata for T-Head
arch/riscv/Kconfig | 22 ++++ arch/riscv/Kconfig.erratas | 33 +++-- arch/riscv/Kconfig.socs | 1 - arch/riscv/Makefile | 2 +- arch/riscv/errata/Makefile | 2 +- arch/riscv/errata/alternative.c | 75 ------------ arch/riscv/errata/sifive/errata.c | 20 ++- arch/riscv/errata/thead/Makefile | 1 + arch/riscv/errata/thead/errata.c | 82 +++++++++++++ arch/riscv/include/asm/alternative-macros.h | 129 +++++++++++++++----- arch/riscv/include/asm/alternative.h | 25 +++- arch/riscv/include/asm/errata_list.h | 59 +++++++++ arch/riscv/include/asm/fixmap.h | 2 - arch/riscv/include/asm/hwcap.h | 1 + arch/riscv/include/asm/pgtable-32.h | 17 +++ arch/riscv/include/asm/pgtable-64.h | 79 +++++++++++- arch/riscv/include/asm/pgtable-bits.h | 10 -- arch/riscv/include/asm/pgtable.h | 55 +++++++-- arch/riscv/include/asm/vendorid_list.h | 1 + arch/riscv/kernel/Makefile | 1 + arch/riscv/kernel/alternative.c | 104 ++++++++++++++++ arch/riscv/kernel/cpu.c | 1 + arch/riscv/kernel/cpufeature.c | 80 +++++++++++- arch/riscv/kernel/module.c | 29 +++++ arch/riscv/kernel/setup.c | 2 + arch/riscv/kernel/smpboot.c | 4 - arch/riscv/kernel/traps.c | 2 +- arch/riscv/mm/init.c | 1 + 28 files changed, 679 insertions(+), 161 deletions(-) delete mode 100644 arch/riscv/errata/alternative.c create mode 100644 arch/riscv/errata/thead/Makefile create mode 100644 arch/riscv/errata/thead/errata.c create mode 100644 arch/riscv/kernel/alternative.c
Signature · 7 lines
2.35.1 _______________________________________________ linux-riscv mailing list [email protected] http://lists.infradead.org/mailman/listinfo/linux-riscv
PATCH v9 1/12 riscv: integrate alternatives better into the main architecture
Right now the alternatives need to be explicitly enabled and erratas are limited to SiFive ones.
We want to use alternatives not only for patching soc erratas, but in the future also for handling different behaviour depending on the existence of future extensions.
So move the core alternatives over to the kernel subdirectory and move the CONFIG_RISCV_ALTERNATIVE to be a hidden symbol which we expect relevant erratas and extensions to just select if needed.
---
arch/riscv/Kconfig | 9 +++++++++
arch/riscv/Kconfig.erratas | 13 ++-----------
arch/riscv/Kconfig.socs | 1 -
arch/riscv/Makefile | 2 +-
arch/riscv/errata/Makefile | 1 -
arch/riscv/include/asm/alternative-macros.h | 7 ++++---
arch/riscv/include/asm/alternative.h | 8 ++++++++
arch/riscv/kernel/Makefile | 1 +
arch/riscv/{errata => kernel}/alternative.c | 0
arch/riscv/kernel/smpboot.c | 2 --
arch/riscv/kernel/traps.c | 2 +-
11 files changed, 26 insertions(+), 20 deletions(-)
rename arch/riscv/{errata => kernel}/alternative.c (100%)arch/riscv/Kconfig +9 -0
@@ -324,6 +324,15 @@ config NODES_SHIFT Specify the maximum number of NUMA Nodes available on the target system. Increases memory reserved to accommodate various tables. +config RISCV_ALTERNATIVE + bool + depends on !XIP_KERNEL + help + This Kconfig allows the kernel to automatically patch the + errata required by the execution platform at run time. The + code patching is performed once in the boot stages. It means + that the overhead from this mechanism is just taken once. + config RISCV_ISA_C bool "Emit compressed instructions when building Linux" default y
arch/riscv/Kconfig.erratas +2 -11
@@ -1,18 +1,9 @@ menu "CPU errata selection" -config RISCV_ERRATA_ALTERNATIVE - bool "RISC-V alternative scheme" - depends on !XIP_KERNEL - default y - help - This Kconfig allows the kernel to automatically patch the - errata required by the execution platform at run time. The - code patching is performed once in the boot stages. It means - that the overhead from this mechanism is just taken once. - config ERRATA_SIFIVE bool "SiFive errata" - depends on RISCV_ERRATA_ALTERNATIVE + depends on !XIP_KERNEL + select RISCV_ALTERNATIVE help All SiFive errata Kconfig depend on this Kconfig. Disabling this Kconfig will disable all SiFive errata. Please say "Y"
arch/riscv/Kconfig.socs +0 -1
@@ -14,7 +14,6 @@ config SOC_SIFIVE select CLK_SIFIVE select CLK_SIFIVE_PRCI select SIFIVE_PLIC - select RISCV_ERRATA_ALTERNATIVE if !XIP_KERNEL select ERRATA_SIFIVE if !XIP_KERNEL help This enables support for SiFive SoC platform hardware.
arch/riscv/Makefile +1 -1
@@ -103,7 +103,7 @@ endif head-y := arch/riscv/kernel/head.o -core-$(CONFIG_RISCV_ERRATA_ALTERNATIVE) += arch/riscv/errata/ +core-y += arch/riscv/errata/ core-$(CONFIG_KVM) += arch/riscv/kvm/ libs-y += arch/riscv/lib/
arch/riscv/errata/Makefile +0 -1
@@ -1,2 +1 @@ -obj-y += alternative.o obj-$(CONFIG_ERRATA_SIFIVE) += sifive/
arch/riscv/include/asm/alternative-macros.h +4 -3
@@ -2,7 +2,7 @@#ifndef __ASM_ALTERNATIVE_MACROS_H#define __ASM_ALTERNATIVE_MACROS_H -#ifdef CONFIG_RISCV_ERRATA_ALTERNATIVE +#ifdef CONFIG_RISCV_ALTERNATIVE #ifdef __ASSEMBLY__
@@ -76,7 +76,7 @@#endif /* __ASSEMBLY__ */ -#else /* !CONFIG_RISCV_ERRATA_ALTERNATIVE*/ +#else /* CONFIG_RISCV_ALTERNATIVE */ #ifdef __ASSEMBLY__ .macro __ALTERNATIVE_CFG old_c
@@ -95,7 +95,8 @@ __ALTERNATIVE_CFG(old_c)#endif /* __ASSEMBLY__ */ -#endif /* CONFIG_RISCV_ERRATA_ALTERNATIVE */ +#endif /* CONFIG_RISCV_ALTERNATIVE */ +/* * Usage: * ALTERNATIVE(old_content, new_content, vendor_id, errata_id, CONFIG_k)
arch/riscv/include/asm/alternative.h +8 -0
@@ -12,6 +12,8 @@#ifndef __ASSEMBLY__ +#ifdef CONFIG_RISCV_ALTERNATIVE +#include <linux/init.h> #include <linux/types.h> #include <linux/stddef.h>
@@ -35,5 +37,11 @@ struct errata_checkfunc_id {void sifive_errata_patch_func (struct alt_entry *begin,struct alt_entry *end,unsigned long archid,unsigned long impid); +#else /* CONFIG_RISCV_ALTERNATIVE */ + +static inline void apply_boot_alternatives (void ) { } + +#endif /* CONFIG_RISCV_ALTERNATIVE */ +#endif #endif
arch/riscv/kernel/Makefile +1 -0
@@ -18,6 +18,7 @@ extra-y += head.o extra-y += vmlinux.lds obj-y += soc.o +obj-$(CONFIG_RISCV_ALTERNATIVE) += alternative.o obj-y += cpu.o obj-y += cpufeature.o obj-y += entry.o
arch/riscv/kernel/alternative.c renamed from arch/riscv/errata/alternative.c +0 -0
arch/riscv/kernel/smpboot.c +0 -2
@@ -41,9 +41,7 @@ static DECLARE_COMPLETION(cpu_running);void __init smp_prepare_boot_cpu (void ) {init_cpu_topology (); -#ifdef CONFIG_RISCV_ERRATA_ALTERNATIVE apply_boot_alternatives (); -#endif }void __init smp_prepare_cpus (unsigned int max_cpus)
arch/riscv/kernel/traps.c +1 -1
@@ -86,7 +86,7 @@ static void do_trap_error(struct pt_regs *regs, int signo, int code, } } -#if defined (CONFIG_XIP_KERNEL ) && defined (CONFIG_RISCV_ERRATA_ALTERNATIVE ) +#if defined (CONFIG_XIP_KERNEL ) && defined (CONFIG_RISCV_ALTERNATIVE )#define __trap_section __section(".xip.traps")#else #define __trap_section
Signature · 7 lines
2.35.1 _______________________________________________ linux-riscv mailing list [email protected] http://lists.infradead.org/mailman/listinfo/linux-riscv
Re: [PATCH v9 01/12] riscv: integrate alternatives better into the main architecture
Quoted 8 lines · Heiko Stuebner
Right now the alternatives need to be explicitly enabled and erratas are limited to SiFive ones.
We want to use alternatives not only for patching soc erratas, but in the future also for handling different behaviour depending on the existence of future extensions.
Quoted 6 lines
So move the core alternatives over to the kernel subdirectory and move the
CONFIG_RISCV_ALTERNATIVEto be a hidden symbol which we expect relevant erratas and extensions to just select if needed.Signed-off-by Heiko Stuebner <[email protected]>
PATCH v9 2/12 riscv: allow different stages with alternatives
In reply to Heiko StuebnerFuture features may need to be applied at a different time during boot, so allow defining stages for alternatives and handling them differently depending on the stage.
Also make the alternatives-location more flexible so that future stages may provide their own location.
--- arch/riscv/errata/sifive/errata.c | 3 ++- arch/riscv/include/asm/alternative.h | 5 ++++- arch/riscv/kernel/alternative.c | 26 +++++++++++++++++--------- 3 files changed, 23 insertions(+), 11 deletions(-)
arch/riscv/errata/sifive/errata.c +2 -1
@@ -80,7 +80,8 @@ static void __init warn_miss_errata(u32 miss_errata) }void __init sifive_errata_patch_func (struct alt_entry *begin,struct alt_entry *end, -unsigned long archid,unsigned long impid) +unsigned long archid,unsigned long impid, +unsigned int stage) {struct alt_entry *alt;u32 cpu_req_errata =sifive_errata_probe (archid, impid);
arch/riscv/include/asm/alternative.h +4 -1
@@ -19,6 +19,8 @@#include <linux/stddef.h> #include <asm/hwcap.h> +#define RISCV_ALTERNATIVES_BOOT 0/* alternatives applied during regular boot */ +void __init apply_boot_alternatives (void );struct alt_entry {
@@ -35,7 +37,8 @@ struct errata_checkfunc_id { };void sifive_errata_patch_func (struct alt_entry *begin,struct alt_entry *end, -unsigned long archid,unsigned long impid); +unsigned long archid,unsigned long impid, +unsigned int stage);#else /* CONFIG_RISCV_ALTERNATIVE */
arch/riscv/kernel/alternative.c +17 -9
@@ -22,8 +22,8 @@ static struct cpu_manufacturer_info_t { } cpu_mfr_info;static void (*vendor_patch_func)(struct alt_entry *begin,struct alt_entry *end, -unsigned long archid, -unsigned long impid)__initdata ; +unsigned long archid,unsigned long impid, +unsigned int stage)__initdata ;static inline void __init riscv_fill_cpu_mfr_info (void ) {
@@ -58,6 +58,18 @@ static void __init init_alternative(void)* a feature detect on the boot CPU). No need to worry about other CPUs * here. */ +static void __init _apply_alternatives (struct alt_entry *begin, +struct alt_entry *end, +unsigned int stage) +{ +if (!vendor_patch_func) +return ; + +vendor_patch_func (begin, end, + cpu_mfr_info.arch_id, cpu_mfr_info.imp_id, + stage); +} +void __init apply_boot_alternatives (void ) {/* If called on non-boot cpu things could go wrong */
@@ -65,11 +77,7 @@ void __init apply_boot_alternatives(void)init_alternative (); -if (!vendor_patch_func) -return ; - -vendor_patch_func ((struct alt_entry *)__alt_start, - (struct alt_entry *)__alt_end, - cpu_mfr_info.arch_id, cpu_mfr_info.imp_id); +_apply_alternatives ((struct alt_entry *)__alt_start, + (struct alt_entry *)__alt_end, +RISCV_ALTERNATIVES_BOOT ); } -
Signature · 7 lines
2.35.1 _______________________________________________ linux-riscv mailing list [email protected] http://lists.infradead.org/mailman/listinfo/linux-riscv
Re: [PATCH v9 02/12] riscv: allow different stages with alternatives
Quoted 9 lines · Heiko Stuebner
Future features may need to be applied at a different time during boot, so allow defining stages for alternatives and handling them differently depending on the stage.
Also make the alternatives-location more flexible so that future stages may provide their own location.
Signed-off-by Heiko Stuebner <[email protected]>
PATCH v9 3/12 riscv: implement module alternatives
In reply to Heiko StuebnerThis allows alternatives to also be applied when loading modules and follows the implementation of other architectures (e.g. arm64).
--- arch/riscv/errata/sifive/errata.c | 14 +++++++++----- arch/riscv/include/asm/alternative.h | 3 +++ arch/riscv/kernel/alternative.c | 18 +++++++++++++---- arch/riscv/kernel/module.c | 29 ++++++++++++++++++++++++++++ 4 files changed, 55 insertions(+), 9 deletions(-)
arch/riscv/errata/sifive/errata.c +9 -5
@@ -4,6 +4,7 @@*/ #include <linux/kernel.h> +#include <linux/module.h> #include <linux/string.h> #include <linux/bug.h> #include <asm/patch.h>
@@ -54,7 +55,8 @@ static struct errata_info_t errata_list[ERRATA_SIFIVE_NUMBER] = { }, }; -static u32 __init sifive_errata_probe (unsigned long archid,unsigned long impid) +static u32 __init_or_module sifive_errata_probe(unsigned long archid, +unsigned long impid) {int idx;u32 cpu_req_errata =0 ;
@@ -66,7 +68,7 @@ static u32 __init sifive_errata_probe(unsigned long archid, unsigned long impid)return cpu_req_errata; } -static void __init warn_miss_errata (u32 miss_errata) +static void __init_or_module warn_miss_errata(u32 miss_errata) {int i;
@@ -79,9 +81,11 @@ static void __init warn_miss_errata(u32 miss_errata)pr_warn ("----------------------------------------------------------------\n" ); } -void __init sifive_errata_patch_func (struct alt_entry *begin,struct alt_entry *end, -unsigned long archid,unsigned long impid, -unsigned int stage) +void __init_or_module sifive_errata_patch_func(struct alt_entry *begin, +struct alt_entry *end, +unsigned long archid, +unsigned long impid, +unsigned int stage) {struct alt_entry *alt;u32 cpu_req_errata =sifive_errata_probe (archid, impid);
arch/riscv/include/asm/alternative.h +3 -0
@@ -20,8 +20,10 @@#include <asm/hwcap.h> #define RISCV_ALTERNATIVES_BOOT 0/* alternatives applied during regular boot */ +#define RISCV_ALTERNATIVES_MODULE 1/* alternatives applied during module-init */ void __init apply_boot_alternatives (void ); +void apply_module_alternatives (void *start,size_t length);struct alt_entry {void *old_ptr;/* address of original instruciton or data */
@@ -43,6 +45,7 @@ void sifive_errata_patch_func(struct alt_entry *begin, struct alt_entry *end,#else /* CONFIG_RISCV_ALTERNATIVE */ static inline void apply_boot_alternatives (void ) { } +static inline void apply_module_alternatives (void *start,size_t length) { }#endif /* CONFIG_RISCV_ALTERNATIVE */
arch/riscv/kernel/alternative.c +14 -4
@@ -7,6 +7,7 @@*/ #include <linux/init.h> +#include <linux/module.h> #include <linux/cpu.h> #include <linux/uaccess.h> #include <asm/alternative.h>
@@ -23,7 +24,7 @@ static struct cpu_manufacturer_info_t { static void (*vendor_patch_func)(struct alt_entry *begin, struct alt_entry *end, unsigned long archid, unsigned long impid, -unsigned int stage)__initdata ; + unsigned int stage) __initdata_or_module;static inline void __init riscv_fill_cpu_mfr_info (void ) {
@@ -58,9 +59,9 @@ static void __init init_alternative(void)* a feature detect on the boot CPU). No need to worry about other CPUs * here. */ -static void __init _apply_alternatives (struct alt_entry *begin, -struct alt_entry *end, -unsigned int stage) +static void __init_or_module _apply_alternatives(struct alt_entry *begin, +struct alt_entry *end, +unsigned int stage) {if (!vendor_patch_func)return ;
@@ -81,3 +82,12 @@ void __init apply_boot_alternatives(void) (struct alt_entry *)__alt_end, RISCV_ALTERNATIVES_BOOT); } + +#ifdef CONFIG_MODULES +void apply_module_alternatives (void *start,size_t length) +{ +_apply_alternatives ((struct alt_entry *)start, + (struct alt_entry *)(start + length), +RISCV_ALTERNATIVES_MODULE ); +} +#endif
arch/riscv/kernel/module.c +29 -0
@@ -11,6 +11,7 @@#include <linux/vmalloc.h> #include <linux/sizes.h> #include <linux/pgtable.h> +#include <asm/alternative.h> #include <asm/sections.h> /*
@@ -427,3 +428,31 @@ void *module_alloc(unsigned long size) __builtin_return_address(0)); }#endif + +static const Elf_Shdr *find_section (const Elf_Ehdr *hdr, +const Elf_Shdr *sechdrs, +const char *name) +{ +const Elf_Shdr *s, *se; +const char *secstrs = (void *)hdr + sechdrs[hdr->e_shstrndx].sh_offset; + +for (s = sechdrs, se = sechdrs + hdr->e_shnum; s < se; s++) { +if (strcmp (name, secstrs + s->sh_name) ==0 ) +return s; + } + +return NULL ; +} + +int module_finalize (const Elf_Ehdr *hdr, +const Elf_Shdr *sechdrs, +struct module *me) +{ +const Elf_Shdr *s; + + s =find_section (hdr, sechdrs,".alternative" ); +if (s) +apply_module_alternatives ((void *)s->sh_addr, s->sh_size); + +return 0 ; +}
Signature · 7 lines
2.35.1 _______________________________________________ linux-riscv mailing list [email protected] http://lists.infradead.org/mailman/listinfo/linux-riscv
Re: [PATCH v9 03/12] riscv: implement module alternatives
Quoted 5 lines · Heiko Stuebner
This allows alternatives to also be applied when loading modules and follows the implementation of other architectures (e.g. arm64).
Signed-off-by Heiko Stuebner <[email protected]>
PATCH v9 4/12 riscv: implement ALTERNATIVE_2 macro
In reply to Heiko StuebnerWhen the alternatives were added the commit already provided a template on how to implement 2 different alternatives for one piece of code.
Make this usable.
--- arch/riscv/include/asm/alternative-macros.h | 78 +++++++++++++++------ 1 file changed, 58 insertions(+), 20 deletions(-)
arch/riscv/include/asm/alternative-macros.h +58 -20
@@ -39,6 +39,24 @@#define _ALTERNATIVE_CFG (old_c, new_c, vendor_id, errata_id, CONFIG_k) \ __ALTERNATIVE_CFG old_c, new_c, vendor_id, errata_id, IS_ENABLED(CONFIG_k) +.macro __ALTERNATIVE_CFG_2 old_c, new_c_1, vendor_id_1, errata_id_1, enable_1, \ + new_c_2, vendor_id_2, errata_id_2, enable_2 +886 : + \old_c +887 : + ALT_NEW_CONTENT \vendor_id_1, \errata_id_1, \enable_1, \new_c_1 + ALT_NEW_CONTENT \vendor_id_2, \errata_id_2, \enable_2, \new_c_2 +.endm + +#define _ALTERNATIVE_CFG_2(old_c, new_c_1, vendor_id_1, errata_id_1, \ + CONFIG_k_1, \ + new_c_2, vendor_id_2, errata_id_2, \ + CONFIG_k_2) \ + __ALTERNATIVE_CFG_2 old_c, new_c_1, vendor_id_1, errata_id_1, \ +IS_ENABLED (CONFIG_k_1 ), \ + new_c_2, vendor_id_2, errata_id_2, \ + IS_ENABLED(CONFIG_k_2) +#else /* !__ASSEMBLY__ */ #include <asm/asm.h>
@@ -74,6 +92,25 @@#define _ALTERNATIVE_CFG (old_c, new_c, vendor_id, errata_id, CONFIG_k) \ __ALTERNATIVE_CFG(old_c, new_c, vendor_id, errata_id, IS_ENABLED(CONFIG_k)) +#define __ALTERNATIVE_CFG_2 (old_c, new_c_1, vendor_id_1, errata_id_1, \ + enable_1, \ + new_c_2, vendor_id_2, errata_id_2, \ + enable_2) \ + "886 :\n" \ + old_c "\n" \ + "887 :\n" \ + ALT_NEW_CONTENT(vendor_id_1, errata_id_1, enable_1, new_c_1) \ + ALT_NEW_CONTENT(vendor_id_2, errata_id_2, enable_2, new_c_2) + +#define _ALTERNATIVE_CFG_2 (old_c, new_c_1, vendor_id_1, errata_id_1, \ + CONFIG_k_1, \ + new_c_2, vendor_id_2, errata_id_2, \ + CONFIG_k_2) \ + __ALTERNATIVE_CFG_2(old_c, new_c_1, vendor_id_1, errata_id_1, \ + IS_ENABLED(CONFIG_k_1), \ + new_c_2, vendor_id_2, errata_id_2, \ + IS_ENABLED(CONFIG_k_2)) +#endif /* __ASSEMBLY__ */ #else /* CONFIG_RISCV_ALTERNATIVE */
@@ -86,6 +123,12 @@#define _ALTERNATIVE_CFG (old_c, new_c, vendor_id, errata_id, CONFIG_k) \ __ALTERNATIVE_CFG old_c +#define _ALTERNATIVE_CFG_2 (old_c, new_c_1, vendor_id_1, errata_id_1, \ + CONFIG_k_1, \ + new_c_2, vendor_id_2, errata_id_2, \ + CONFIG_k_2) \ + __ALTERNATIVE_CFG old_c +#else /* !__ASSEMBLY__ */ #define __ALTERNATIVE_CFG (old_c) \
@@ -94,6 +137,12 @@#define _ALTERNATIVE_CFG (old_c, new_c, vendor_id, errata_id, CONFIG_k) \ __ALTERNATIVE_CFG(old_c) +#define _ALTERNATIVE_CFG_2 (old_c, new_c_1, vendor_id_1, errata_id_1, \ + CONFIG_k_1, \ + new_c_2, vendor_id_2, errata_id_2, \ + CONFIG_k_2) \ + __ALTERNATIVE_CFG(old_c) +#endif /* __ASSEMBLY__ */ #endif /* CONFIG_RISCV_ALTERNATIVE */
@@ -119,25 +168,14 @@* this case, this vendor can create a new macro ALTERNATIVE_2() based * on the following sample code and then replace ALTERNATIVE() with * ALTERNATIVE_2() to append its customized content. -* -* .macro __ALTERNATIVE_CFG_2 old_c, new_c_1, vendor_id_1, errata_id_1, enable_1, \ -* new_c_2, vendor_id_2, errata_id_2, enable_2 -* 886 : -* \old_c -* 887 : -* ALT_NEW_CONTENT \vendor_id_1, \errata_id_1, \enable_1, \new_c_1 -* ALT_NEW_CONTENT \vendor_id_2, \errata_id_2, \enable_2, \new_c_2 -* .endm -* -* #define _ALTERNATIVE_CFG_2(old_c, new_c_1, vendor_id_1, errata_id_1, CONFIG_k_1, \ -* new_c_2, vendor_id_2, errata_id_2, CONFIG_k_2) \ -* __ALTERNATIVE_CFG_2 old_c, new_c_1, vendor_id_1, errata_id_1, IS_ENABLED(CONFIG_k_1), \ -* new_c_2, vendor_id_2, errata_id_2, IS_ENABLED(CONFIG_k_2) \ -* -* #define ALTERNATIVE_2(old_content, new_content_1, vendor_id_1, errata_id_1, CONFIG_k_1, \ -* new_content_2, vendor_id_2, errata_id_2, CONFIG_k_2) \ -* _ALTERNATIVE_CFG_2(old_content, new_content_1, vendor_id_1, errata_id_1, CONFIG_k_1, \ -* new_content_2, vendor_id_2, errata_id_2, CONFIG_k_2) -* */ +#define ALTERNATIVE_2 (old_content, new_content_1, vendor_id_1, \ + errata_id_1, CONFIG_k_1, \ + new_content_2, vendor_id_2, \ + errata_id_2, CONFIG_k_2) \ + _ALTERNATIVE_CFG_2(old_content, new_content_1, vendor_id_1, \ + errata_id_1, CONFIG_k_1, \ + new_content_2, vendor_id_2, \ + errata_id_2, CONFIG_k_2) +#endif
Signature · 1 line
2.35.1
Re: [PATCH v9 04/12] riscv: implement ALTERNATIVE_2 macro
Quoted 7 lines · Heiko Stuebner
When the alternatives were added the commit already provided a template on how to implement 2 different alternatives for one piece of code.
Make this usable.
Signed-off-by Heiko Stuebner <[email protected]>
PATCH v9 5/12 riscv: extend concatenated alternatives-lines to the same length
In reply to Heiko StuebnerALT_NEW_CONTENT already uses same-length assembler lines, so extend this to the other elements as well.
This makes it more readable when these elements need to be extended in the future.
--- arch/riscv/include/asm/alternative-macros.h | 20 ++++++++++---------- 1 file changed, 10 insertions(+), 10 deletions(-)
arch/riscv/include/asm/alternative-macros.h +10 -10
@@ -62,14 +62,14 @@#include <asm/asm.h> #include <linux/stringify.h> -#define ALT_ENTRY (oldptr, newptr, vendor_id, errata_id, newlen) \ - RISCV_PTR " " oldptr "\n" \ - RISCV_PTR " " newptr "\n" \ - REG_ASM " " vendor_id "\n" \ - REG_ASM " " newlen "\n" \ +#define ALT_ENTRY (oldptr, newptr, vendor_id, errata_id, newlen) \ + RISCV_PTR " " oldptr "\n" \ + RISCV_PTR " " newptr "\n" \ + REG_ASM " " vendor_id "\n" \ + REG_ASM " " newlen "\n" \ ".word " errata_id "\n" -#define ALT_NEW_CONTENT (vendor_id, errata_id, enable, new_c) \ +#define ALT_NEW_CONTENT (vendor_id, errata_id, enable, new_c) \ ".if " __stringify(enable) " == 1\n" \ ".pushsection .alternative, \"a\"\n" \ ALT_ENTRY("886b", "888f", __stringify(vendor_id), __stringify(errata_id), "889f - 888f") \
@@ -83,10 +83,10 @@".org . - (889b - 888b) + (887b - 886b)\n" \ ".endif\n" -#define __ALTERNATIVE_CFG (old_c, new_c, vendor_id, errata_id, enable) \ - "886 :\n" \ - old_c "\n" \ - "887 :\n" \ +#define __ALTERNATIVE_CFG (old_c, new_c, vendor_id, errata_id, enable) \ + "886 :\n" \ + old_c "\n" \ + "887 :\n" \ ALT_NEW_CONTENT(vendor_id, errata_id, enable, new_c)#define _ALTERNATIVE_CFG (old_c, new_c, vendor_id, errata_id, CONFIG_k) \
Signature · 7 lines
2.35.1 _______________________________________________ linux-riscv mailing list [email protected] http://lists.infradead.org/mailman/listinfo/linux-riscv
Re: [PATCH v9 05/12] riscv: extend concatenated alternatives-lines to the same length
Quoted 8 lines · Heiko Stuebner
ALT_NEW_CONTENTalready uses same-length assembler lines, so extend this to the other elements as well.This makes it more readable when these elements need to be extended in the future.
Signed-off-by Heiko Stuebner <[email protected]>
_______________________________________________
linux-riscv mailing list
[email protected]
http://lists.infradead.org/mailman/listinfo/linux-riscv
PATCH v9 6/12 riscv: prevent compressed instructions in alternatives
In reply to Heiko StuebnerInstructions are opportunistically compressed by the RISC-V assembler when possible, but in alternatives-blocks both the old and new content need to be the same size, so having the toolchain do somewhat random optimizations will cause strange side-effects like
"attempt to move .org backwards" compile-time errors.
Already a simple "and" used in alternatives assembly will cause these mismatched code sizes.
So prevent compressed instructions to be generated in alternatives- code and use option-push and -pop to only limit this to the relevant code blocks
--- arch/riscv/include/asm/alternative-macros.h | 24 +++++++++++++++++++++ 1 file changed, 24 insertions(+)
arch/riscv/include/asm/alternative-macros.h +24 -0
@@ -21,7 +21,11 @@ .popsection .subsection 1 888 : + .option push + .option norvc + .option norelax \new_c + .option pop 889 : .previous .org . - (889b - 888b) + (887b - 886b)
@@ -31,7 +35,11 @@ .macro __ALTERNATIVE_CFG old_c, new_c, vendor_id, errata_id, enable 886 : + .option push + .option norvc + .option norelax \old_c + .option pop 887 : ALT_NEW_CONTENT \vendor_id, \errata_id, \enable, \new_c .endm
@@ -42,7 +50,11 @@ .macro __ALTERNATIVE_CFG_2 old_c, new_c_1, vendor_id_1, errata_id_1, enable_1, \ new_c_2, vendor_id_2, errata_id_2, enable_2 886 : + .option push + .option norvc + .option norelax \old_c + .option pop 887 : ALT_NEW_CONTENT \vendor_id_1, \errata_id_1, \enable_1, \new_c_1 ALT_NEW_CONTENT \vendor_id_2, \errata_id_2, \enable_2, \new_c_2
@@ -76,7 +88,11 @@".popsection\n" \".subsection 1\n" \"888 :\n" \ +".option push\n" \ +".option norvc\n" \ +".option norelax\n" \ new_c"\n" \ +".option pop\n" \"889 :\n" \".previous\n" \".org . - (887b - 886b) + (889b - 888b)\n" \
@@ -85,7 +101,11 @@#define __ALTERNATIVE_CFG (old_c, new_c, vendor_id, errata_id, enable) \ "886 :\n" \ + ".option push\n" \ + ".option norvc\n" \ + ".option norelax\n" \ old_c "\n" \ + ".option pop\n" \ "887 :\n" \ ALT_NEW_CONTENT(vendor_id, errata_id, enable, new_c)
@@ -97,7 +117,11 @@ new_c_2, vendor_id_2, errata_id_2, \ enable_2) \ "886 :\n" \ + ".option push\n" \ + ".option norvc\n" \ + ".option norelax\n" \ old_c "\n" \ + ".option pop\n" \ "887 :\n" \ ALT_NEW_CONTENT(vendor_id_1, errata_id_1, enable_1, new_c_1) \ALT_NEW_CONTENT (vendor_id_2, errata_id_2, enable_2, new_c_2)
Signature · 7 lines
2.35.1 _______________________________________________ linux-riscv mailing list [email protected] http://lists.infradead.org/mailman/listinfo/linux-riscv
Re: [PATCH v9 06/12] riscv: prevent compressed instructions in alternatives
Quoted 10 lines · Heiko Stuebner
Instructions are opportunistically compressed by the RISC-V assembler when possible, but in alternatives-blocks both the old and new content need to be the same size, so having the toolchain do somewhat random optimizations will cause strange side-effects like
"attempt to move .org backwards" compile-time errors.Already a simple "and" used in alternatives assembly will cause these mismatched code sizes.
Quoted 6 lines
So prevent compressed instructions to be generated in alternatives- code and use option-push and -pop to only limit this to the relevant code blocks
Signed-off-by Heiko Stuebner <[email protected]>Reviewed-by Christoph Hellwig <[email protected]>
kernel test robot
build botRe: [PATCH v9 06/12] riscv: prevent compressed instructions in alternatives
In reply to Heiko StuebnerI love your patch! Yet something to improve:
Hi Heiko,
I love your patch! Yet something to improve:
[auto build test ERROR on linus/master]
[also build test ERROR on v5.18-rc2 next-20220414]
[If your patch is applied to the wrong git tree, kindly drop us a note. And when submitting patch, we suggest to use '--base' as documented in
https://git-scm.com/docs/git-format-patch]
url: https://github.com/intel-lab-lkp/linux/commits/Heiko-Stuebner/riscv-support-for-Svpbmt-and-D1-memory-types/20220413-110832 base: https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git a19944809fe9942e6a96292490717904d0690c21 config: riscv-rv32_defconfig (https://download.01.org/0day-ci/archive/20220416/[email protected]/config) compiler: clang version 15.0.0 (https://github.com/llvm/llvm-project 8e43cbab33765c476337571e5ed11b005199dd0d)
reproduce (this is a W=1 build):
wget https://raw.githubusercontent.com/intel/lkp-tests/master/sbin/make.cross -O ~/bin/make.cross chmod +x ~/bin/make.cross
# install riscv cross compiling tool for clang build
# apt-get install binutils-riscv64-linux-gnu
# https://github.com/intel-lab-lkp/linux/commit/723a94fab035c904455590ec18572bf49a45b671
git remote add linux-review https://github.com/intel-lab-lkp/linux
git fetch --no-tags linux-review Heiko-Stuebner/riscv-support-for-Svpbmt-and-D1-memory-types/20220413-110832 git checkout 723a94fab035c904455590ec18572bf49a45b671
# save the config file to linux build tree
mkdir build_dir
COMPILER_INSTALL_PATH=$HOME/0day COMPILER=clang make.cross W=1 O=build_dir ARCH=riscv SHELL=/bin/bash
If you fix the issue, kindly add following tag as appropriate
All errors (new ones prefixed by >>):
arch/riscv/mm/init.c:834:13: warning: no previous prototype for function 'pt_ops_set_early' [-Wmissing-prototypes] void __init pt_ops_set_early(void)
^
arch/riscv/mm/init.c:834:1: note: declare 'static' if the function is not intended to be used outside of this translation unit
void __init pt_ops_set_early(void)
^
static
arch/riscv/mm/init.c:856:13: warning: no previous prototype for function 'pt_ops_set_fixmap' [-Wmissing-prototypes]
void __init pt_ops_set_fixmap(void)
^
arch/riscv/mm/init.c:856:1: note: declare 'static' if the function is not intended to be used outside of this translation unit
void __init pt_ops_set_fixmap(void)
^
static
arch/riscv/mm/init.c:874:13: warning: no previous prototype for function 'pt_ops_set_late' [-Wmissing-prototypes]
void __init pt_ops_set_late(void)
^
arch/riscv/mm/init.c:874:1: note: declare 'static' if the function is not intended to be used outside of this translation unit
void __init pt_ops_set_late(void)
^
static
In file included from arch/riscv/mm/init.c:10:
In file included from include/linux/mm.h:29:
In file included from include/linux/pgtable.h:6:
In file included from arch/riscv/include/asm/pgtable.h:108:
>> arch/riscv/include/asm/tlbflush.h:23:2: error: expected assembly-time absolute expression
ALT_FLUSH_TLB_PAGE(__asm__ __volatile__ ("sfence.vma %0" : : "r" (addr) : "memory"));
^
arch/riscv/include/asm/errata_list.h:33:5: note: expanded from macro 'ALT_FLUSH_TLB_PAGE'
asm(ALTERNATIVE("sfence.vma %0", "sfence.vma", SIFIVE_VENDOR_ID, \
^
arch/riscv/include/asm/alternative-macros.h:187:2: note: expanded from macro 'ALTERNATIVE'
_ALTERNATIVE_CFG(old_content, new_content, vendor_id, errata_id, CONFIG_k)
^
arch/riscv/include/asm/alternative-macros.h:113:2: note: expanded from macro '_ALTERNATIVE_CFG'
__ALTERNATIVE_CFG(old_c, new_c, vendor_id, errata_id, IS_ENABLED(CONFIG_k))
^
arch/riscv/include/asm/alternative-macros.h:110:2: note: expanded from macro '__ALTERNATIVE_CFG'
ALT_NEW_CONTENT(vendor_id, errata_id, enable, new_c)
^
arch/riscv/include/asm/alternative-macros.h:98:3: note: expanded from macro 'ALT_NEW_CONTENT'
".org . - (887b - 886b) + (889b - 888b)\n" \
^
<inline asm>:25:6: note: instantiated into assembly here
.org . - (887b - 886b) + (889b - 888b)
^
In file included from arch/riscv/mm/init.c:10:
In file included from include/linux/mm.h:29:
In file included from include/linux/pgtable.h:6:
In file included from arch/riscv/include/asm/pgtable.h:108:
>> arch/riscv/include/asm/tlbflush.h:23:2: error: expected assembly-time absolute expression
ALT_FLUSH_TLB_PAGE(__asm__ __volatile__ ("sfence.vma %0" : : "r" (addr) : "memory"));
^
arch/riscv/include/asm/errata_list.h:33:5: note: expanded from macro 'ALT_FLUSH_TLB_PAGE'
asm(ALTERNATIVE("sfence.vma %0", "sfence.vma", SIFIVE_VENDOR_ID, \
^
arch/riscv/include/asm/alternative-macros.h:187:2: note: expanded from macro 'ALTERNATIVE'
_ALTERNATIVE_CFG(old_content, new_content, vendor_id, errata_id, CONFIG_k)
^
arch/riscv/include/asm/alternative-macros.h:113:2: note: expanded from macro '_ALTERNATIVE_CFG'
__ALTERNATIVE_CFG(old_c, new_c, vendor_id, errata_id, IS_ENABLED(CONFIG_k))
^
arch/riscv/include/asm/alternative-macros.h:110:2: note: expanded from macro '__ALTERNATIVE_CFG'
ALT_NEW_CONTENT(vendor_id, errata_id, enable, new_c)
^
arch/riscv/include/asm/alternative-macros.h:99:3: note: expanded from macro 'ALT_NEW_CONTENT'
".org . - (889b - 888b) + (887b - 886b)\n" \
^
<inline asm>:26:6: note: instantiated into assembly here
.org . - (889b - 888b) + (887b - 886b)
^
In file included from arch/riscv/mm/init.c:10:
In file included from include/linux/mm.h:29:
In file included from include/linux/pgtable.h:6:
In file included from arch/riscv/include/asm/pgtable.h:108:
>> arch/riscv/include/asm/tlbflush.h:23:2: error: expected assembly-time absolute expression
ALT_FLUSH_TLB_PAGE(__asm__ __volatile__ ("sfence.vma %0" : : "r" (addr) : "memory"));
^
arch/riscv/include/asm/errata_list.h:33:5: note: expanded from macro 'ALT_FLUSH_TLB_PAGE'
asm(ALTERNATIVE("sfence.vma %0", "sfence.vma", SIFIVE_VENDOR_ID, \
^
arch/riscv/include/asm/alternative-macros.h:187:2: note: expanded from macro 'ALTERNATIVE'
_ALTERNATIVE_CFG(old_content, new_content, vendor_id, errata_id, CONFIG_k)
^
arch/riscv/include/asm/alternative-macros.h:113:2: note: expanded from macro '_ALTERNATIVE_CFG'
__ALTERNATIVE_CFG(old_c, new_c, vendor_id, errata_id, IS_ENABLED(CONFIG_k))
^
arch/riscv/include/asm/alternative-macros.h:110:2: note: expanded from macro '__ALTERNATIVE_CFG'
ALT_NEW_CONTENT(vendor_id, errata_id, enable, new_c)
^
arch/riscv/include/asm/alternative-macros.h:98:3: note: expanded from macro 'ALT_NEW_CONTENT'
".org . - (887b - 886b) + (889b - 888b)\n" \
^
<inline asm>:25:6: note: instantiated into assembly here
.org . - (887b - 886b) + (889b - 888b)
^
In file included from arch/riscv/mm/init.c:10:
In file included from include/linux/mm.h:29:
In file included from include/linux/pgtable.h:6:
In file included from arch/riscv/include/asm/pgtable.h:108:
>> arch/riscv/include/asm/tlbflush.h:23:2: error: expected assembly-time absolute expression
ALT_FLUSH_TLB_PAGE(__asm__ __volatile__ ("sfence.vma %0" : : "r" (addr) : "memory"));
^
arch/riscv/include/asm/errata_list.h:33:5: note: expanded from macro 'ALT_FLUSH_TLB_PAGE'
asm(ALTERNATIVE("sfence.vma %0", "sfence.vma", SIFIVE_VENDOR_ID, \
^
arch/riscv/include/asm/alternative-macros.h:187:2: note: expanded from macro 'ALTERNATIVE'
_ALTERNATIVE_CFG(old_content, new_content, vendor_id, errata_id, CONFIG_k)
^
arch/riscv/include/asm/alternative-macros.h:113:2: note: expanded from macro '_ALTERNATIVE_CFG'
__ALTERNATIVE_CFG(old_c, new_c, vendor_id, errata_id, IS_ENABLED(CONFIG_k))
^
arch/riscv/include/asm/alternative-macros.h:110:2: note: expanded from macro '__ALTERNATIVE_CFG'
ALT_NEW_CONTENT(vendor_id, errata_id, enable, new_c)
^
arch/riscv/include/asm/alternative-macros.h:99:3: note: expanded from macro 'ALT_NEW_CONTENT'
".org . - (889b - 888b) + (887b - 886b)\n" \
^
<inline asm>:26:6: note: instantiated into assembly here
.org . - (889b - 888b) + (887b - 886b)
^
In file included from arch/riscv/mm/init.c:10:
In file included from include/linux/mm.h:29:
In file included from include/linux/pgtable.h:6:
In file included from arch/riscv/include/asm/pgtable.h:108:
>> arch/riscv/include/asm/tlbflush.h:23:2: error: expected assembly-time absolute expression
ALT_FLUSH_TLB_PAGE(__asm__ __volatile__ ("sfence.vma %0" : : "r" (addr) : "memory"));
^
arch/riscv/include/asm/errata_list.h:33:5: note: expanded from macro 'ALT_FLUSH_TLB_PAGE'
asm(ALTERNATIVE("sfence.vma %0", "sfence.vma", SIFIVE_VENDOR_ID, \
^
arch/riscv/include/asm/alternative-macros.h:187:2: note: expanded from macro 'ALTERNATIVE'
_ALTERNATIVE_CFG(old_content, new_content, vendor_id, errata_id, CONFIG_k)
^
arch/riscv/include/asm/alternative-macros.h:113:2: note: expanded from macro '_ALTERNATIVE_CFG'
__ALTERNATIVE_CFG(old_c, new_c, vendor_id, errata_id, IS_ENABLED(CONFIG_k))
^
arch/riscv/include/asm/alternative-macros.h:110:2: note: expanded from macro '__ALTERNATIVE_CFG'
ALT_NEW_CONTENT(vendor_id, errata_id, enable, new_c)
^
arch/riscv/include/asm/alternative-macros.h:98:3: note: expanded from macro 'ALT_NEW_CONTENT'
".org . - (887b - 886b) + (889b - 888b)\n" \
^
<inline asm>:25:6: note: instantiated into assembly here
.org . - (887b - 886b) + (889b - 888b)
^
In file included from arch/riscv/mm/init.c:10:
In file included from include/linux/mm.h:29:
In file included from include/linux/pgtable.h:6:
In file included from arch/riscv/include/asm/pgtable.h:108:
>> arch/riscv/include/asm/tlbflush.h:23:2: error: expected assembly-time absolute expression
ALT_FLUSH_TLB_PAGE(__asm__ __volatile__ ("sfence.vma %0" : : "r" (addr) : "memory"));
^
arch/riscv/include/asm/errata_list.h:33:5: note: expanded from macro 'ALT_FLUSH_TLB_PAGE'
asm(ALTERNATIVE("sfence.vma %0", "sfence.vma", SIFIVE_VENDOR_ID, \
^
arch/riscv/include/asm/alternative-macros.h:187:2: note: expanded from macro 'ALTERNATIVE'
_ALTERNATIVE_CFG(old_content, new_content, vendor_id, errata_id, CONFIG_k)
^
arch/riscv/include/asm/alternative-macros.h:113:2: note: expanded from macro '_ALTERNATIVE_CFG'
__ALTERNATIVE_CFG(old_c, new_c, vendor_id, errata_id, IS_ENABLED(CONFIG_k))
^
arch/riscv/include/asm/alternative-macros.h:110:2: note: expanded from macro '__ALTERNATIVE_CFG'
ALT_NEW_CONTENT(vendor_id, errata_id, enable, new_c)
^
arch/riscv/include/asm/alternative-macros.h:99:3: note: expanded from macro 'ALT_NEW_CONTENT'
".org . - (889b - 888b) + (887b - 886b)\n" \
^
<inline asm>:26:6: note: instantiated into assembly here
.org . - (889b - 888b) + (887b - 886b)
^
In file included from arch/riscv/mm/init.c:10:
In file included from include/linux/mm.h:29:
In file included from include/linux/pgtable.h:6:
In file included from arch/riscv/include/asm/pgtable.h:108:
>> arch/riscv/include/asm/tlbflush.h:23:2: error: expected assembly-time absolute expression
ALT_FLUSH_TLB_PAGE(__asm__ __volatile__ ("sfence.vma %0" : : "r" (addr) : "memory"));
^
arch/riscv/include/asm/errata_list.h:33:5: note: expanded from macro 'ALT_FLUSH_TLB_PAGE'
asm(ALTERNATIVE("sfence.vma %0", "sfence.vma", SIFIVE_VENDOR_ID, \
^
arch/riscv/include/asm/alternative-macros.h:187:2: note: expanded from macro 'ALTERNATIVE'
_ALTERNATIVE_CFG(old_content, new_content, vendor_id, errata_id, CONFIG_k)
^
arch/riscv/include/asm/alternative-macros.h:113:2: note: expanded from macro '_ALTERNATIVE_CFG'
__ALTERNATIVE_CFG(old_c, new_c, vendor_id, errata_id, IS_ENABLED(CONFIG_k))
^
arch/riscv/include/asm/alternative-macros.h:110:2: note: expanded from macro '__ALTERNATIVE_CFG'
ALT_NEW_CONTENT(vendor_id, errata_id, enable, new_c)
^
arch/riscv/include/asm/alternative-macros.h:98:3: note: expanded from macro 'ALT_NEW_CONTENT'
".org . - (887b - 886b) + (889b - 888b)\n" \
^
<inline asm>:25:6: note: instantiated into assembly here
.org . - (887b - 886b) + (889b - 888b)
^
In file included from arch/riscv/mm/init.c:10:
In file included from include/linux/mm.h:29:
In file included from include/linux/pgtable.h:6:
In file included from arch/riscv/include/asm/pgtable.h:108:
>> arch/riscv/include/asm/tlbflush.h:23:2: error: expected assembly-time absolute expression
ALT_FLUSH_TLB_PAGE(__asm__ __volatile__ ("sfence.vma %0" : : "r" (addr) : "memory"));
^
arch/riscv/include/asm/errata_list.h:33:5: note: expanded from macro 'ALT_FLUSH_TLB_PAGE'
asm(ALTERNATIVE("sfence.vma %0", "sfence.vma", SIFIVE_VENDOR_ID, \
^
arch/riscv/include/asm/alternative-macros.h:187:2: note: expanded from macro 'ALTERNATIVE'
_ALTERNATIVE_CFG(old_content, new_content, vendor_id, errata_id, CONFIG_k)
^
arch/riscv/include/asm/alternative-macros.h:113:2: note: expanded from macro '_ALTERNATIVE_CFG'
__ALTERNATIVE_CFG(old_c, new_c, vendor_id, errata_id, IS_ENABLED(CONFIG_k))
^
arch/riscv/include/asm/alternative-macros.h:110:2: note: expanded from macro '__ALTERNATIVE_CFG'
ALT_NEW_CONTENT(vendor_id, errata_id, enable, new_c)
^
arch/riscv/include/asm/alternative-macros.h:99:3: note: expanded from macro 'ALT_NEW_CONTENT'
".org . - (889b - 888b) + (887b - 886b)\n" \
^
<inline asm>:26:6: note: instantiated into assembly here
.org . - (889b - 888b) + (887b - 886b)
^
In file included from arch/riscv/mm/init.c:10:
In file included from include/linux/mm.h:29:
In file included from include/linux/pgtable.h:6:
In file included from arch/riscv/include/asm/pgtable.h:108:
>> arch/riscv/include/asm/tlbflush.h:23:2: error: expected assembly-time absolute expression
ALT_FLUSH_TLB_PAGE(__asm__ __volatile__ ("sfence.vma %0" : : "r" (addr) : "memory"));
^
arch/riscv/include/asm/errata_list.h:33:5: note: expanded from macro 'ALT_FLUSH_TLB_PAGE'
asm(ALTERNATIVE("sfence.vma %0", "sfence.vma", SIFIVE_VENDOR_ID, \
^
arch/riscv/include/asm/alternative-macros.h:187:2: note: expanded from macro 'ALTERNATIVE'
_ALTERNATIVE_CFG(old_content, new_content, vendor_id, errata_id, CONFIG_k)
^
arch/riscv/include/asm/alternative-macros.h:113:2: note: expanded from macro '_ALTERNATIVE_CFG'
__ALTERNATIVE_CFG(old_c, new_c, vendor_id, errata_id, IS_ENABLED(CONFIG_k))
^
arch/riscv/include/asm/alternative-macros.h:110:2: note: expanded from macro '__ALTERNATIVE_CFG'
ALT_NEW_CONTENT(vendor_id, errata_id, enable, new_c)
^
arch/riscv/include/asm/alternative-macros.h:98:3: note: expanded from macro 'ALT_NEW_CONTENT'
".org . - (887b - 886b) + (889b - 888b)\n" \
^
<inline asm>:25:6: note: instantiated into assembly here
.org . - (887b - 886b) + (889b - 888b)
^
In file included from arch/riscv/mm/init.c:10:
In file included from include/linux/mm.h:29:
In file included from include/linux/pgtable.h:6:
In file included from arch/riscv/include/asm/pgtable.h:108:
>> arch/riscv/include/asm/tlbflush.h:23:2: error: expected assembly-time absolute expression
ALT_FLUSH_TLB_PAGE(__asm__ __volatile__ ("sfence.vma %0" : : "r" (addr) : "memory"));
^
arch/riscv/include/asm/errata_list.h:33:5: note: expanded from macro 'ALT_FLUSH_TLB_PAGE'
asm(ALTERNATIVE("sfence.vma %0", "sfence.vma", SIFIVE_VENDOR_ID, \
^
arch/riscv/include/asm/alternative-macros.h:187:2: note: expanded from macro 'ALTERNATIVE'
_ALTERNATIVE_CFG(old_content, new_content, vendor_id, errata_id, CONFIG_k)
^
arch/riscv/include/asm/alternative-macros.h:113:2: note: expanded from macro '_ALTERNATIVE_CFG'
__ALTERNATIVE_CFG(old_c, new_c, vendor_id, errata_id, IS_ENABLED(CONFIG_k))
^
arch/riscv/include/asm/alternative-macros.h:110:2: note: expanded from macro '__ALTERNATIVE_CFG'
ALT_NEW_CONTENT(vendor_id, errata_id, enable, new_c)
^
arch/riscv/include/asm/alternative-macros.h:99:3: note: expanded from macro 'ALT_NEW_CONTENT'
".org . - (889b - 888b) + (887b - 886b)\n" \
^
<inline asm>:26:6: note: instantiated into assembly here
.org . - (889b - 888b) + (887b - 886b)
^
In file included from arch/riscv/mm/init.c:10:
In file included from include/linux/mm.h:29:
In file included from include/linux/pgtable.h:6:
In file included from arch/riscv/include/asm/pgtable.h:108:
>> arch/riscv/include/asm/tlbflush.h:23:2: error: expected assembly-time absolute expression
ALT_FLUSH_TLB_PAGE(__asm__ __volatile__ ("sfence.vma %0" : : "r" (addr) : "memory"));
^
arch/riscv/include/asm/errata_list.h:33:5: note: expanded from macro 'ALT_FLUSH_TLB_PAGE'
asm(ALTERNATIVE("sfence.vma %0", "sfence.vma", SIFIVE_VENDOR_ID, \
^
arch/riscv/include/asm/alternative-macros.h:187:2: note: expanded from macro 'ALTERNATIVE'
_ALTERNATIVE_CFG(old_content, new_content, vendor_id, errata_id, CONFIG_k)
^
arch/riscv/include/asm/alternative-macros.h:113:2: note: expanded from macro '_ALTERNATIVE_CFG'
__ALTERNATIVE_CFG(old_c, new_c, vendor_id, errata_id, IS_ENABLED(CONFIG_k))
^
arch/riscv/include/asm/alternative-macros.h:110:2: note: expanded from macro '__ALTERNATIVE_CFG'
ALT_NEW_CONTENT(vendor_id, errata_id, enable, new_c)
^
arch/riscv/include/asm/alternative-macros.h:98:3: note: expanded from macro 'ALT_NEW_CONTENT'
".org . - (887b - 886b) + (889b - 888b)\n" \
^
<inline asm>:25:6: note: instantiated into assembly here
.org . - (887b - 886b) + (889b - 888b)
^
In file included from arch/riscv/mm/init.c:10:
In file included from include/linux/mm.h:29:
In file included from include/linux/pgtable.h:6:
In file included from arch/riscv/include/asm/pgtable.h:108:
>> arch/riscv/include/asm/tlbflush.h:23:2: error: expected assembly-time absolute expression
ALT_FLUSH_TLB_PAGE(__asm__ __volatile__ ("sfence.vma %0" : : "r" (addr) : "memory"));
^
arch/riscv/include/asm/errata_list.h:33:5: note: expanded from macro 'ALT_FLUSH_TLB_PAGE'
asm(ALTERNATIVE("sfence.vma %0", "sfence.vma", SIFIVE_VENDOR_ID, \
^
arch/riscv/include/asm/alternative-macros.h:187:2: note: expanded from macro 'ALTERNATIVE'
_ALTERNATIVE_CFG(old_content, new_content, vendor_id, errata_id, CONFIG_k)
^
arch/riscv/include/asm/alternative-macros.h:113:2: note: expanded from macro '_ALTERNATIVE_CFG'
__ALTERNATIVE_CFG(old_c, new_c, vendor_id, errata_id, IS_ENABLED(CONFIG_k))
^
arch/riscv/include/asm/alternative-macros.h:110:2: note: expanded from macro '__ALTERNATIVE_CFG'
ALT_NEW_CONTENT(vendor_id, errata_id, enable, new_c)
^
arch/riscv/include/asm/alternative-macros.h:99:3: note: expanded from macro 'ALT_NEW_CONTENT'
".org . - (889b - 888b) + (887b - 886b)\n" \
^
<inline asm>:26:6: note: instantiated into assembly here
.org . - (889b - 888b) + (887b - 886b)
^
In file included from arch/riscv/mm/init.c:10:
In file included from include/linux/mm.h:29:
In file included from include/linux/pgtable.h:6:
In file included from arch/riscv/include/asm/pgtable.h:108:
>> arch/riscv/include/asm/tlbflush.h:23:2: error: expected assembly-time absolute expression
ALT_FLUSH_TLB_PAGE(__asm__ __volatile__ ("sfence.vma %0" : : "r" (addr) : "memory"));
^
arch/riscv/include/asm/errata_list.h:33:5: note: expanded from macro 'ALT_FLUSH_TLB_PAGE'
asm(ALTERNATIVE("sfence.vma %0", "sfence.vma", SIFIVE_VENDOR_ID, \
^
arch/riscv/include/asm/alternative-macros.h:187:2: note: expanded from macro 'ALTERNATIVE'
_ALTERNATIVE_CFG(old_content, new_content, vendor_id, errata_id, CONFIG_k)
^
arch/riscv/include/asm/alternative-macros.h:113:2: note: expanded from macro '_ALTERNATIVE_CFG'
__ALTERNATIVE_CFG(old_c, new_c, vendor_id, errata_id, IS_ENABLED(CONFIG_k))
^
arch/riscv/include/asm/alternative-macros.h:110:2: note: expanded from macro '__ALTERNATIVE_CFG'
ALT_NEW_CONTENT(vendor_id, errata_id, enable, new_c)
^
arch/riscv/include/asm/alternative-macros.h:98:3: note: expanded from macro 'ALT_NEW_CONTENT'
".org . - (887b - 886b) + (889b - 888b)\n" \
^
<inline asm>:25:6: note: instantiated into assembly here
.org . - (887b - 886b) + (889b - 888b)
^
In file included from arch/riscv/mm/init.c:10:
In file included from include/linux/mm.h:29:
In file included from include/linux/pgtable.h:6:
In file included from arch/riscv/include/asm/pgtable.h:108:
>> arch/riscv/include/asm/tlbflush.h:23:2: error: expected assembly-time absolute expression
ALT_FLUSH_TLB_PAGE(__asm__ __volatile__ ("sfence.vma %0" : : "r" (addr) : "memory"));
^
arch/riscv/include/asm/errata_list.h:33:5: note: expanded from macro 'ALT_FLUSH_TLB_PAGE'
asm(ALTERNATIVE("sfence.vma %0", "sfence.vma", SIFIVE_VENDOR_ID, \
^
arch/riscv/include/asm/alternative-macros.h:187:2: note: expanded from macro 'ALTERNATIVE'
_ALTERNATIVE_CFG(old_content, new_content, vendor_id, errata_id, CONFIG_k)
^
arch/riscv/include/asm/alternative-macros.h:113:2: note: expanded from macro '_ALTERNATIVE_CFG'
__ALTERNATIVE_CFG(old_c, new_c, vendor_id, errata_id, IS_ENABLED(CONFIG_k))
^
arch/riscv/include/asm/alternative-macros.h:110:2: note: expanded from macro '__ALTERNATIVE_CFG'
ALT_NEW_CONTENT(vendor_id, errata_id, enable, new_c)
^
arch/riscv/include/asm/alternative-macros.h:99:3: note: expanded from macro 'ALT_NEW_CONTENT'
".org . - (889b - 888b) + (887b - 886b)\n" \
^
<inline asm>:26:6: note: instantiated into assembly here
.org . - (889b - 888b) + (887b - 886b)
^
In file included from arch/riscv/mm/init.c:10:
In file included from include/linux/mm.h:29:
In file included from include/linux/pgtable.h:6:
In file included from arch/riscv/include/asm/pgtable.h:108:
>> arch/riscv/include/asm/tlbflush.h:23:2: error: expected assembly-time absolute expression
ALT_FLUSH_TLB_PAGE(__asm__ __volatile__ ("sfence.vma %0" : : "r" (addr) : "memory"));
^
arch/riscv/include/asm/errata_list.h:33:5: note: expanded from macro 'ALT_FLUSH_TLB_PAGE'
asm(ALTERNATIVE("sfence.vma %0", "sfence.vma", SIFIVE_VENDOR_ID, \
^
arch/riscv/include/asm/alternative-macros.h:187:2: note: expanded from macro 'ALTERNATIVE'
_ALTERNATIVE_CFG(old_content, new_content, vendor_id, errata_id, CONFIG_k)
^
arch/riscv/include/asm/alternative-macros.h:113:2: note: expanded from macro '_ALTERNATIVE_CFG'
__ALTERNATIVE_CFG(old_c, new_c, vendor_id, errata_id, IS_ENABLED(CONFIG_k))
^
arch/riscv/include/asm/alternative-macros.h:110:2: note: expanded from macro '__ALTERNATIVE_CFG'
ALT_NEW_CONTENT(vendor_id, errata_id, enable, new_c)
^
arch/riscv/include/asm/alternative-macros.h:98:3: note: expanded from macro 'ALT_NEW_CONTENT'
".org . - (887b - 886b) + (889b - 888b)\n" \
^
<inline asm>:25:6: note: instantiated into assembly here
.org . - (887b - 886b) + (889b - 888b)
^
In file included from arch/riscv/mm/init.c:10:
In file included from include/linux/mm.h:29:
In file included from include/linux/pgtable.h:6:
In file included from arch/riscv/include/asm/pgtable.h:108:
>> arch/riscv/include/asm/tlbflush.h:23:2: error: expected assembly-time absolute expression
ALT_FLUSH_TLB_PAGE(__asm__ __volatile__ ("sfence.vma %0" : : "r" (addr) : "memory"));
^
arch/riscv/include/asm/errata_list.h:33:5: note: expanded from macro 'ALT_FLUSH_TLB_PAGE'
asm(ALTERNATIVE("sfence.vma %0", "sfence.vma", SIFIVE_VENDOR_ID, \
^
arch/riscv/include/asm/alternative-macros.h:187:2: note: expanded from macro 'ALTERNATIVE'
_ALTERNATIVE_CFG(old_content, new_content, vendor_id, errata_id, CONFIG_k)
^
arch/riscv/include/asm/alternative-macros.h:113:2: note: expanded from macro '_ALTERNATIVE_CFG'
__ALTERNATIVE_CFG(old_c, new_c, vendor_id, errata_id, IS_ENABLED(CONFIG_k))
^
arch/riscv/include/asm/alternative-macros.h:110:2: note: expanded from macro '__ALTERNATIVE_CFG'
ALT_NEW_CONTENT(vendor_id, errata_id, enable, new_c)
^
arch/riscv/include/asm/alternative-macros.h:99:3: note: expanded from macro 'ALT_NEW_CONTENT'
".org . - (889b - 888b) + (887b - 886b)\n" \
^
<inline asm>:26:6: note: instantiated into assembly here
.org . - (889b - 888b) + (887b - 886b)
^
In file included from arch/riscv/mm/init.c:10:
In file included from include/linux/mm.h:29:
In file included from include/linux/pgtable.h:6:
In file included from arch/riscv/include/asm/pgtable.h:108:
>> arch/riscv/include/asm/tlbflush.h:23:2: error: expected assembly-time absolute expression
ALT_FLUSH_TLB_PAGE(__asm__ __volatile__ ("sfence.vma %0" : : "r" (addr) : "memory"));
^
arch/riscv/include/asm/errata_list.h:33:5: note: expanded from macro 'ALT_FLUSH_TLB_PAGE'
asm(ALTERNATIVE("sfence.vma %0", "sfence.vma", SIFIVE_VENDOR_ID, \
^
arch/riscv/include/asm/alternative-macros.h:187:2: note: expanded from macro 'ALTERNATIVE'
_ALTERNATIVE_CFG(old_content, new_content, vendor_id, errata_id, CONFIG_k)
^
arch/riscv/include/asm/alternative-macros.h:113:2: note: expanded from macro '_ALTERNATIVE_CFG'
__ALTERNATIVE_CFG(old_c, new_c, vendor_id, errata_id, IS_ENABLED(CONFIG_k))
^
arch/riscv/include/asm/alternative-macros.h:110:2: note: expanded from macro '__ALTERNATIVE_CFG'
ALT_NEW_CONTENT(vendor_id, errata_id, enable, new_c)
^
arch/riscv/include/asm/alternative-macros.h:98:3: note: expanded from macro 'ALT_NEW_CONTENT'
".org . - (887b - 886b) + (889b - 888b)\n" \
^
<inline asm>:25:6: note: instantiated into assembly here
.org . - (887b - 886b) + (889b - 888b)
^
In file included from arch/riscv/mm/init.c:10:
In file included from include/linux/mm.h:29:
In file included from include/linux/pgtable.h:6:
In file included from arch/riscv/include/asm/pgtable.h:108:
>> arch/riscv/include/asm/tlbflush.h:23:2: error: expected assembly-time absolute expression
ALT_FLUSH_TLB_PAGE(__asm__ __volatile__ ("sfence.vma %0" : : "r" (addr) : "memory"));
^
arch/riscv/include/asm/errata_list.h:33:5: note: expanded from macro 'ALT_FLUSH_TLB_PAGE'
asm(ALTERNATIVE("sfence.vma %0", "sfence.vma", SIFIVE_VENDOR_ID, \
^
arch/riscv/include/asm/alternative-macros.h:187:2: note: expanded from macro 'ALTERNATIVE'
_ALTERNATIVE_CFG(old_content, new_content, vendor_id, errata_id, CONFIG_k)
^
arch/riscv/include/asm/alternative-macros.h:113:2: note: expanded from macro '_ALTERNATIVE_CFG'
__ALTERNATIVE_CFG(old_c, new_c, vendor_id, errata_id, IS_ENABLED(CONFIG_k))
^
arch/riscv/include/asm/alternative-macros.h:110:2: note: expanded from macro '__ALTERNATIVE_CFG'
ALT_NEW_CONTENT(vendor_id, errata_id, enable, new_c)
^
arch/riscv/include/asm/alternative-macros.h:99:3: note: expanded from macro 'ALT_NEW_CONTENT'
".org . - (889b - 888b) + (887b - 886b)\n" \
^
<inline asm>:26:6: note: instantiated into assembly here
.org . - (889b - 888b) + (887b - 886b)
^
In file included from arch/riscv/mm/init.c:10:
In file included from include/linux/mm.h:29:
In file included from include/linux/pgtable.h:6:
In file included from arch/riscv/include/asm/pgtable.h:108:
>> arch/riscv/include/asm/tlbflush.h:23:2: error: expected assembly-time absolute expression
ALT_FLUSH_TLB_PAGE(__asm__ __volatile__ ("sfence.vma %0" : : "r" (addr) : "memory"));
^
arch/riscv/include/asm/errata_list.h:33:5: note: expanded from macro 'ALT_FLUSH_TLB_PAGE'
asm(ALTERNATIVE("sfence.vma %0", "sfence.vma", SIFIVE_VENDOR_ID, \
^
arch/riscv/include/asm/alternative-macros.h:187:2: note: expanded from macro 'ALTERNATIVE'
_ALTERNATIVE_CFG(old_content, new_content, vendor_id, errata_id, CONFIG_k)
^
arch/riscv/include/asm/alternative-macros.h:113:2: note: expanded from macro '_ALTERNATIVE_CFG'
__ALTERNATIVE_CFG(old_c, new_c, vendor_id, errata_id, IS_ENABLED(CONFIG_k))
^
arch/riscv/include/asm/alternative-macros.h:110:2: note: expanded from macro '__ALTERNATIVE_CFG'
ALT_NEW_CONTENT(vendor_id, errata_id, enable, new_c)
^
arch/riscv/include/asm/alternative-macros.h:98:3: note: expanded from macro 'ALT_NEW_CONTENT'
".org . - (887b - 886b) + (889b - 888b)\n" \
^
<inline asm>:25:6: note: instantiated into assembly here
.org . - (887b - 886b) + (889b - 888b)
^ fatal error: too many errors emitted, stopping now [-ferror-limit=] 3 warnings and 20 errors generated.
..
vim +23 arch/riscv/include/asm/tlbflush.h
fab957c11efe2f Palmer Dabbelt 2017-07-10 19
fab957c11efe2f Palmer Dabbelt 2017-07-10 20 /* Flush one page from local TLB */
fab957c11efe2f Palmer Dabbelt 2017-07-10 21 static inline void local_flush_tlb_page(unsigned long addr)
fab957c11efe2f Palmer Dabbelt 2017-07-10 22 {
bff3ff525460b4 Vincent Chen 2021-03-22 @23 ALT_FLUSH_TLB_PAGE(__asm__ __volatile__ ("sfence.vma %0" : : "r" (addr) : "memory"));
fab957c11efe2f Palmer Dabbelt 2017-07-10 24 }
6bd33e1ece528f Christoph Hellwig 2019-10-28 25 #else /* CONFIG_MMU */
6bd33e1ece528f Christoph Hellwig 2019-10-28 26 #define local_flush_tlb_all() do { } while (0)
6bd33e1ece528f Christoph Hellwig 2019-10-28 27 #define local_flush_tlb_page(addr) do { } while (0)
6bd33e1ece528f Christoph Hellwig 2019-10-28 28 #endif /* CONFIG_MMU */
fab957c11efe2f Palmer Dabbelt 2017-07-10 29 Signature · 2 lines
0-DAY CI Kernel Test Service https://01.org/lkp
PATCH v9 7/12 riscv: move boot alternatives to after fill_hwcap
In reply to Heiko StuebnerMove the application of boot alternatives to after the hw-capabilities are populated. This allows to check for available extensions when determining which alternatives to apply and also makes it actually work if CONFIG_SMP is disabled for whatever reason.
--- arch/riscv/kernel/setup.c | 2 ++ arch/riscv/kernel/smpboot.c | 2 -- 2 files changed, 2 insertions(+), 2 deletions(-)
arch/riscv/kernel/setup.c +2 -0
@@ -21,6 +21,7 @@#include <linux/efi.h> #include <linux/crash_dump.h> +#include <asm/alternative.h> #include <asm/cpu_ops.h> #include <asm/early_ioremap.h> #include <asm/pgtable.h>
@@ -295,6 +296,7 @@ void __init setup_arch(char **cmdline_p)#endif riscv_fill_hwcap (); +apply_boot_alternatives (); }static int __init topology_init (void )
arch/riscv/kernel/smpboot.c +0 -2
@@ -32,7 +32,6 @@#include <asm/sections.h> #include <asm/sbi.h> #include <asm/smp.h> -#include <asm/alternative.h> #include "head.h"
@@ -41,7 +40,6 @@ static DECLARE_COMPLETION(cpu_running);void __init smp_prepare_boot_cpu (void ) {init_cpu_topology (); -apply_boot_alternatives (); }void __init smp_prepare_cpus (unsigned int max_cpus)
Signature · 1 line
2.35.1
Re: [PATCH v9 07/12] riscv: move boot alternatives to after fill_hwcap
Quoted 56 lines · Heiko Stuebner
Move the application of boot alternatives to after the hw-capabilities are populated. This allows to check for available extensions when determining which alternatives to apply and also makes it actually work if
CONFIG_SMPis disabled for whatever reason.Signed-off-by Heiko Stuebner <[email protected]>Reviewed-by Christoph Hellwig <[email protected]>--- arch/riscv/kernel/setup.c | 2 ++ arch/riscv/kernel/smpboot.c | 2 -- 2 files changed, 2 insertions(+), 2 deletions(-)arch/riscv/kernel/setup.c +2
-0@@ -21,6 +21,7 @@#include <linux/efi.h> #include <linux/crash_dump.h> +#include <asm/alternative.h> #include <asm/cpu_ops.h> #include <asm/early_ioremap.h> #include <asm/pgtable.h> @@ -295,6 +296,7 @@ void __init setup_arch(char **cmdline_p)#endif riscv_fill_hwcap (); +apply_boot_alternatives (); }static int __init topology_init (void )arch/riscv/kernel/smpboot.c +0
-3@@ -32,7 +32,6 @@#include <asm/sections.h> #include <asm/sbi.h> #include <asm/smp.h> -#include <asm/alternative.h> #include "head.h" @@ -41,7 +40,6 @@ static DECLARE_COMPLETION(cpu_running);void __init smp_prepare_boot_cpu (void ) {init_cpu_topology (); -apply_boot_alternatives (); }void __init smp_prepare_cpus (unsigned int max_cpus) --2.35.1
Signature · 4 lines
Best Regards Guo Ren ML: https://lore.kernel.org/linux-csky/
Re: [PATCH v9 07/12] riscv: move boot alternatives to after fill_hwcap
In reply to Heiko StuebnerQuoted 8 lines · Heiko Stuebner
Move the application of boot alternatives to after the hw-capabilities are populated. This allows to check for available extensions when determining which alternatives to apply and also makes it actually work if
CONFIG_SMPis disabled for whatever reason.Signed-off-by Heiko Stuebner <[email protected]>Reviewed-by Christoph Hellwig <[email protected]>
_______________________________________________
linux-riscv mailing list
[email protected]
http://lists.infradead.org/mailman/listinfo/linux-riscv
PATCH v9 8/12 riscv: Fix accessing pfn bits in PTEs for non-32bit variants
In reply to Heiko StuebnerOn rv32 the PFN part of PTEs is defined to use bits [xlen-1:10] while on rv64 it is defined to use bits [53:10], leaving [63:54] as reserved.
With upcoming optional extensions like svpbmt these previously reserved bits will get used so simply right-shifting the PTE to get the PFN won't be enough.
So introduce a _PAGE_PFN_MASK constant to mask the correct bits for both rv32 and rv64 before shifting.
--- arch/riscv/include/asm/pgtable-32.h | 8 ++++++++ arch/riscv/include/asm/pgtable-64.h | 14 +++++++++++--- arch/riscv/include/asm/pgtable-bits.h | 6 ------ arch/riscv/include/asm/pgtable.h | 8 +++++--- 4 files changed, 24 insertions(+), 12 deletions(-)
arch/riscv/include/asm/pgtable-32.h +8 -0
@@ -7,6 +7,7 @@#define _ASM_RISCV_PGTABLE_32_H#include <asm-generic/pgtable-nopmd.h> +#include <linux/bits.h> #include <linux/const.h> /* Size of region mapped by a page global directory */
@@ -16,4 +17,11 @@#define MAX_POSSIBLE_PHYSMEM_BITS 34 +/* +* rv32 PTE format: +* | XLEN-1 10 | 9 8 | 7 | 6 | 5 | 4 | 3 | 2 | 1 | 0 +* PFN reserved for SW D A G U X W R V +*/ +#define _PAGE_PFN_MASK GENMASK(31, 10) +#endif /* _ASM_RISCV_PGTABLE_32_H */
arch/riscv/include/asm/pgtable-64.h +11 -3
@@ -6,6 +6,7 @@#ifndef _ASM_RISCV_PGTABLE_64_H#define _ASM_RISCV_PGTABLE_64_H +#include <linux/bits.h> #include <linux/const.h> extern bool pgtable_l4_enabled;
@@ -65,6 +66,13 @@ typedef struct {#define PTRS_PER_PMD (PAGE_SIZE / sizeof(pmd_t)) +/* +* rv64 PTE format: +* | 63 | 62 61 | 60 54 | 53 10 | 9 8 | 7 | 6 | 5 | 4 | 3 | 2 | 1 | 0 +* N MT RSV PFN reserved for SW D A G U X W R V +*/ +#define _PAGE_PFN_MASK GENMASK(53, 10) +static inline int pud_present (pud_t pud) {return (pud_val (pud) & _PAGE_PRESENT);
@@ -108,12 +116,12 @@ static inline unsigned long _pud_pfn(pud_t pud)static inline pmd_t *pud_pgtable (pud_t pud) { -return (pmd_t *)pfn_to_virt (pud_val (pud) >> _PAGE_PFN_SHIFT); +return (pmd_t *)pfn_to_virt (__page_val_to_pfn (pud_val (pud))); }static inline struct page *pud_page (pud_t pud) { -return pfn_to_page (pud_val (pud) >> _PAGE_PFN_SHIFT); +return pfn_to_page (__page_val_to_pfn (pud_val (pud))); }#define mm_p4d_folded mm_p4d_folded
@@ -143,7 +151,7 @@ static inline pmd_t pfn_pmd(unsigned long pfn, pgprot_t prot)static inline unsigned long _pmd_pfn (pmd_t pmd) { -return pmd_val (pmd) >> _PAGE_PFN_SHIFT; +return __page_val_to_pfn (pmd_val (pmd)); }#define mk_pmd (page, prot) pfn_pmd(page_to_pfn(page), prot)
arch/riscv/include/asm/pgtable-bits.h +0 -6
@@ -6,12 +6,6 @@#ifndef _ASM_RISCV_PGTABLE_BITS_H#define _ASM_RISCV_PGTABLE_BITS_H -/* -* PTE format: -* | XLEN-1 10 | 9 8 | 7 | 6 | 5 | 4 | 3 | 2 | 1 | 0 -* PFN reserved for SW D A G U X W R V -*/ -#define _PAGE_ACCESSED_OFFSET 6#define _PAGE_PRESENT (1 << 0)
arch/riscv/include/asm/pgtable.h +5 -3
@@ -108,6 +108,8 @@#include <asm/tlbflush.h> #include <linux/mm_types.h> +#define __page_val_to_pfn (_val) (((_val) & _PAGE_PFN_MASK) >> _PAGE_PFN_SHIFT) +#ifdef CONFIG_64BIT #include <asm/pgtable-64.h> #else
@@ -261,12 +263,12 @@ static inline unsigned long _pgd_pfn(pgd_t pgd)static inline struct page *pmd_page (pmd_t pmd) { -return pfn_to_page (pmd_val (pmd) >> _PAGE_PFN_SHIFT); +return pfn_to_page (__page_val_to_pfn (pmd_val (pmd))); }static inline unsigned long pmd_page_vaddr (pmd_t pmd) { -return (unsigned long )pfn_to_virt (pmd_val (pmd) >> _PAGE_PFN_SHIFT); +return (unsigned long )pfn_to_virt (__page_val_to_pfn (pmd_val (pmd))); }static inline pte_t pmd_pte (pmd_t pmd)
@@ -282,7 +284,7 @@ static inline pte_t pud_pte(pud_t pud)/* Yields the page frame number (PFN) of a page table entry */ static inline unsigned long pte_pfn (pte_t pte) { -return (pte_val (pte) >> _PAGE_PFN_SHIFT); +return __page_val_to_pfn (pte_val (pte)); }#define pte_page (x) pfn_to_page(pte_pfn(x))
Signature · 7 lines
2.35.1 _______________________________________________ linux-riscv mailing list [email protected] http://lists.infradead.org/mailman/listinfo/linux-riscv
Re: [PATCH v9 08/12] riscv: Fix accessing pfn bits in PTEs for non-32bit variants
Quoted 5 lines · Heiko Stuebner
On rv32 the PFN part of PTEs is defined to use bits [xlen-1:10] while on rv64 it is defined to use bits [53:10], leaving [63:54] as reserved.
Quoted 8 lines
With upcoming optional extensions like svpbmt these previously reserved bits will get used so simply right-shifting the PTE to get the PFN won't be enough.
So introduce a
_PAGE_PFN_MASKconstant to mask the correct bits for both rv32 and rv64 before shifting.Signed-off-by Heiko Stuebner <[email protected]>
_______________________________________________
linux-riscv mailing list
[email protected]
http://lists.infradead.org/mailman/listinfo/linux-riscv
PATCH v9 9/12 riscv: add RISC-V Svpbmt extension support
In reply to Heiko StuebnerSvpbmt (the S should be capitalized) is the "Supervisor-mode: page-based memory types" extension that specifies attributes for cacheability, idempotency and ordering.
The relevant settings are done in special bits in PTEs:
Here is the svpbmt PTE format:
| 63 | 62-61 | 60-8 | 7 | 6 | 5 | 4 | 3 | 2 | 1 | 0
N MT RSW D A G U X W R V
^Of the Reserved bits [63:54] in a leaf PTE, the high bit is already allocated (as the N bit), so bits [62:61] are used as the MT (aka MemType) field. This field specifies one of three memory types that are close equivalents (or equivalent in effect) to the three main x86 and ARMv8 memory types - as shown in the following table.
RISC-V
Encoding &
MemType RISC-V Description ---------- ------------------------------------------------ 00 - PMA Normal Cacheable, No change to implied PMA memory type 01 - NC Non-cacheable, idempotent, weakly-ordered Main Memory 10 - IO Non-cacheable, non-idempotent, strongly-ordered I/O memory 11 - Rsvd Reserved for future standard use
As the extension will not be present on all implementations, implement a method to handle cpufeatures via alternatives to not incur runtime penalties on cpu variants not supporting specific extensions and patch relevant code parts at runtime.
--- arch/riscv/Kconfig | 13 +++++ arch/riscv/include/asm/alternative.h | 3 ++ arch/riscv/include/asm/errata_list.h | 15 ++++++ arch/riscv/include/asm/hwcap.h | 1 + arch/riscv/include/asm/pgtable-32.h | 9 ++++ arch/riscv/include/asm/pgtable-64.h | 47 +++++++++++++++++ arch/riscv/include/asm/pgtable-bits.h | 4 -- arch/riscv/include/asm/pgtable.h | 29 +++++++++-- arch/riscv/kernel/alternative.c | 2 + arch/riscv/kernel/cpu.c | 1 + arch/riscv/kernel/cpufeature.c | 75 ++++++++++++++++++++++++++- 11 files changed, 189 insertions(+), 10 deletions(-)
arch/riscv/Kconfig +13 -0
@@ -343,6 +343,19 @@ config RISCV_ISA_C If you don't know what to do here, say Y. +config RISCV_ISA_SVPBMT + bool "SVPBMT extension support" + depends on 64BIT && MMU + select RISCV_ALTERNATIVE + default y + help + Adds support to dynamically detect the presence of the SVPBMT extension + (Supervisor-mode: page-based memory types) and enable its usage. + + The SVPBMT extension is only available on 64Bit cpus. + + If you don't know what to do here, say Y. + config FPU bool "FPU support" default y
arch/riscv/include/asm/alternative.h +3 -0
@@ -42,6 +42,9 @@ void sifive_errata_patch_func(struct alt_entry *begin, struct alt_entry *end, unsigned long archid, unsigned long impid, unsigned int stage); +void riscv_cpufeature_patch_func (struct alt_entry *begin,struct alt_entry *end, +unsigned int stage); +#else /* CONFIG_RISCV_ALTERNATIVE */ static inline void apply_boot_alternatives (void ) { }
arch/riscv/include/asm/errata_list.h +15 -0
@@ -14,6 +14,9 @@#define ERRATA_SIFIVE_NUMBER 2#endif +#define CPUFEATURE_SVPBMT 0 +#define CPUFEATURE_NUMBER 1 +#ifdef __ASSEMBLY__#define ALT_INSN_FAULT (x) \
@@ -34,6 +37,18 @@ asm(ALTERNATIVE("sfence.vma %0", "sfence.vma", SIFIVE_VENDOR_ID, \ ERRATA_SIFIVE_CIP_1200, CONFIG_ERRATA_SIFIVE_CIP_1200) \ : : "r" (addr) : "memory") +/* +* _val is marked as "will be overwritten", so need to set it to 0 +* in the default case. +*/ +#define ALT_SVPBMT_SHIFT 61 +#define ALT_SVPBMT (_val, prot) \ +asm(ALTERNATIVE("li %0, 0\t\nnop", "li %0, %1\t\nslli %0,%0,%2", 0, \ + CPUFEATURE_SVPBMT, CONFIG_RISCV_ISA_SVPBMT) \ + : "=r"(_val) \ + : "I"(prot##_SVPBMT >> ALT_SVPBMT_SHIFT), \ + "I"(ALT_SVPBMT_SHIFT)) +#endif /* __ASSEMBLY__ */ #endif
arch/riscv/include/asm/hwcap.h +1 -0
@@ -52,6 +52,7 @@ extern unsigned long elf_hwcap;*/ enum riscv_isa_ext_id {RISCV_ISA_EXT_SSCOFPMF =RISCV_ISA_EXT_BASE , +RISCV_ISA_EXT_SVPBMT ,RISCV_ISA_EXT_ID_MAX =RISCV_ISA_EXT_MAX , };
arch/riscv/include/asm/pgtable-32.h +9 -0
@@ -24,4 +24,13 @@*/ #define _PAGE_PFN_MASK GENMASK(31, 10) +#define _PAGE_NOCACHE 0 +#define _PAGE_IO 0 +#define _PAGE_MTMASK 0 + +/* Set of bits to preserve across pte_modify() */ +#define _PAGE_CHG_MASK (~(unsigned long)(_PAGE_PRESENT | _PAGE_READ | \ + _PAGE_WRITE | _PAGE_EXEC | \ + _PAGE_USER | _PAGE_GLOBAL)) +#endif /* _ASM_RISCV_PGTABLE_32_H */
arch/riscv/include/asm/pgtable-64.h +47 -0
59 lines not on this page · raw message
arch/riscv/include/asm/pgtable-bits.h +0 -4
@@ -29,10 +29,6 @@#define _PAGE_PFN_SHIFT 10 -/* Set of bits to preserve across pte_modify() */ -#define _PAGE_CHG_MASK (~(unsigned long)(_PAGE_PRESENT | _PAGE_READ | \ - _PAGE_WRITE | _PAGE_EXEC | \ - _PAGE_USER | _PAGE_GLOBAL))/* * when all of R/W/X are zero, the PTE is a pointer to the next level * of the page table; otherwise, it is a leaf PTE.
arch/riscv/include/asm/pgtable.h +24 -5
@@ -179,11 +179,8 @@ extern struct pt_alloc_ops pt_ops __initdata;#define PAGE_TABLE __pgprot(_PAGE_TABLE) -/* -* The RISC-V ISA doesn't yet specify how to query or modify PMAs, so we can't -* change the properties of memory regions. -*/ -#define _PAGE_IOREMAP _PAGE_KERNEL +#define _PAGE_IOREMAP ((_PAGE_KERNEL & ~_PAGE_MTMASK) | _PAGE_IO) +#define PAGE_KERNEL_IO __pgprot(_PAGE_IOREMAP)extern pgd_t swapper_pg_dir[];
@@ -523,6 +520,28 @@ static inline int ptep_clear_flush_young(struct vm_area_struct *vma,return ptep_test_and_clear_young (vma, address, ptep); } +#define pgprot_noncached pgprot_noncached +static inline pgprot_t pgprot_noncached (pgprot_t _prot) +{ +unsigned long prot =pgprot_val (_prot); + + prot &= ~_PAGE_MTMASK; + prot |= _PAGE_IO; + +return __pgprot (prot); +} + +#define pgprot_writecombine pgprot_writecombine +static inline pgprot_t pgprot_writecombine (pgprot_t _prot) +{ +unsigned long prot =pgprot_val (_prot); + + prot &= ~_PAGE_MTMASK; + prot |= _PAGE_NOCACHE; + +return __pgprot (prot); +} +/* * THP functions */
arch/riscv/kernel/alternative.c +2 -0
@@ -63,6 +63,8 @@ static void __init_or_module _apply_alternatives(struct alt_entry *begin,struct alt_entry *end, unsigned int stage) { +riscv_cpufeature_patch_func (begin ,end ,stage ); +if (!vendor_patch_func)return ;
arch/riscv/kernel/cpu.c +1 -0
@@ -88,6 +88,7 @@ int riscv_of_parent_hartid(struct device_node *node)*/ static struct riscv_isa_ext_data isa_ext_arr[] = {__RISCV_ISA_EXT_DATA (sscofpmf,RISCV_ISA_EXT_SSCOFPMF ), +__RISCV_ISA_EXT_DATA (svpbmt,RISCV_ISA_EXT_SVPBMT ),__RISCV_ISA_EXT_DATA ("" ,RISCV_ISA_EXT_MAX ), };
arch/riscv/kernel/cpufeature.c +74 -1
92 lines not on this page · raw message
Signature · 7 lines
2.35.1 _______________________________________________ linux-riscv mailing list [email protected] http://lists.infradead.org/mailman/listinfo/linux-riscv
Re: [PATCH v9 09/12] riscv: add RISC-V Svpbmt extension support
Quoted 50 lines · Heiko Stuebner
Svpbmt (the S should be capitalized) is the "Supervisor-mode: page-based memory types" extension that specifies attributes for cacheability, idempotency and ordering.
The relevant settings are done in special bits in PTEs:
Here is the svpbmt PTE format:
| 63 | 62-61 | 60-8 | 7 | 6 | 5 | 4 | 3 | 2 | 1 | 0 N MT RSW D A G U X W R V ^Of the Reserved bits [63:54] in a leaf PTE, the high bit is already allocated (as the N bit), so bits [62:61] are used as the MT (aka MemType) field. This field specifies one of three memory types that are close equivalents (or equivalent in effect) to the three main x86 and ARMv8 memory types - as shown in the following table.
RISC-V
Encoding &MemType RISC-V Description ---------- ------------------------------------------------ 00 - PMA Normal Cacheable, No change to implied PMA memory type 01 - NC Non-cacheable, idempotent, weakly-ordered Main Memory 10 - IO Non-cacheable, non-idempotent, strongly-ordered I/O memory 11 - Rsvd Reserved for future standard useAs the extension will not be present on all implementations, implement a method to handle cpufeatures via alternatives to not incur runtime penalties on cpu variants not supporting specific extensions and patch relevant code parts at runtime.
Co-developed-by Wei Fu <[email protected]>Signed-off-by Wei Fu <[email protected]>Co-developed-by Liu Shaohua <[email protected]>Signed-off-by Liu Shaohua <[email protected]>Co-developed-by Guo Ren <[email protected]>Signed-off-by Guo Ren <[email protected]>[moved to use the alternatives mechanism]Signed-off-by Heiko Stuebner <[email protected]>Cc Christoph Hellwig <[email protected]>Cc Arnd Bergmann <[email protected]>Cc Drew Fustini <[email protected]>Cc Wei Fu <[email protected]>Cc Wei Wu <[email protected]>Cc Chen-Yu Tsai <[email protected]>Cc Maxime Ripard <[email protected]>Cc Daniel Lustig <[email protected]>Cc Greg Favor <[email protected]>
Quoted 8 lines
Cc Andrea Mondelli <[email protected]>Cc Jonathan Behrens <[email protected]>Cc Xinhaoqu (Freddie) <[email protected]>Cc Bill Huffman <[email protected]>Cc Nick Kossifidis <[email protected]>Cc Allen Baum <[email protected]>Cc Josh Scheid <[email protected]>Cc Richard Trauben <[email protected]>
_______________________________________________
linux-riscv mailing list
[email protected]
http://lists.infradead.org/mailman/listinfo/linux-riscv
PATCH v9 10/12 riscv: remove FIXMAP_PAGE_IO and fall back to its default value
In reply to Heiko StuebnerIf not defined in the arch, FIXMAP_PAGE_IO defaults to PAGE_KERNEL_IO, which we defined when adding the svpbmt implementation.
So drop the FIXMAP_PAGE_IO riscv define.
--- arch/riscv/include/asm/fixmap.h | 2 -- 1 file changed, 2 deletions(-)
arch/riscv/include/asm/fixmap.h +0 -2
@@ -45,8 +45,6 @@ enum fixed_addresses { __end_of_fixed_addresses }; -#define FIXMAP_PAGE_IO PAGE_KERNEL -#define __early_set_fixmap __set_fixmap#define __late_set_fixmap __set_fixmap
Signature · 7 lines
2.35.1 _______________________________________________ linux-riscv mailing list [email protected] http://lists.infradead.org/mailman/listinfo/linux-riscv
Re: [PATCH v9 10/12] riscv: remove FIXMAP_PAGE_IO and fall back to its default value
Quoted 28 lines · Heiko Stuebner
If not defined in the arch,
FIXMAP_PAGE_IOdefaults toPAGE_KERNEL_IO, which we defined when adding the svpbmt implementation.So drop the
FIXMAP_PAGE_IOriscv define.Signed-off-by Heiko Stuebner <[email protected]>Reviewed-by Christoph Hellwig <[email protected]>--- arch/riscv/include/asm/fixmap.h | 2 -- 1 file changed, 2 deletions(-)arch/riscv/include/asm/fixmap.h +0
-3@@ -45,8 +45,6 @@ enum fixed_addresses { __end_of_fixed_addresses }; -#define FIXMAP_PAGE_IO PAGE_KERNEL -#define __early_set_fixmap __set_fixmap#define __late_set_fixmap __set_fixmap --2.35.1
Signature · 4 lines
Best Regards Guo Ren ML: https://lore.kernel.org/linux-csky/
Re: [PATCH v9 10/12] riscv: remove FIXMAP_PAGE_IO and fall back to its default value
In reply to Heiko StuebnerQuoted 8 lines · Heiko Stuebner
If not defined in the arch,
FIXMAP_PAGE_IOdefaults toPAGE_KERNEL_IO, which we defined when adding the svpbmt implementation.So drop the
FIXMAP_PAGE_IOriscv define.Signed-off-by Heiko Stuebner <[email protected]>Reviewed-by Christoph Hellwig <[email protected]>
PATCH v9 11/12 riscv: don't use global static vars to store alternative data
In reply to Heiko StuebnerRight now the code uses a global struct to store vendor-ids and another global variable to store the vendor-patch-function.
There exist specific cases where we'll need to patch the kernel at an even earlier stage, where trying to write to a static variable might actually result in hangs.
Also collecting the vendor-information consists of 3 sbi-ecalls (or csr-reads) which is pretty negligible in the context of booting a kernel.
So rework the code to not rely on static variables and instead collect the vendor-information when a round of alternatives is to be applied.
--- arch/riscv/kernel/alternative.c | 51 ++++++++++++++++----------------- 1 file changed, 24 insertions(+), 27 deletions(-)
arch/riscv/kernel/alternative.c +24 -27
@@ -16,41 +16,35 @@#include <asm/sbi.h> #include <asm/csr.h> -static struct cpu_manufacturer_info_t { +struct cpu_manufacturer_info_t {unsigned long vendor_id;unsigned long arch_id;unsigned long imp_id; -} cpu_mfr_info; +void (*vendor_patch_func)(struct alt_entry *begin,struct alt_entry *end, +unsigned long archid,unsigned long impid, +unsigned int stage); +}; -static void (*vendor_patch_func)(struct alt_entry *begin, struct alt_entry *end, - unsigned long archid, unsigned long impid, - unsigned int stage) __initdata_or_module; - -static inline void __init riscv_fill_cpu_mfr_info (void ) +static void __init_or_module riscv_fill_cpu_mfr_info(struct cpu_manufacturer_info_t *cpu_mfr_info) {#ifdef CONFIG_RISCV_M_MODE - cpu_mfr_info.vendor_id =csr_read (CSR_MVENDORID ); - cpu_mfr_info.arch_id =csr_read (CSR_MARCHID ); - cpu_mfr_info.imp_id =csr_read (CSR_MIMPID ); + cpu_mfr_info->vendor_id =csr_read (CSR_MVENDORID ); + cpu_mfr_info->arch_id =csr_read (CSR_MARCHID ); + cpu_mfr_info->imp_id =csr_read (CSR_MIMPID );#else - cpu_mfr_info.vendor_id =sbi_get_mvendorid (); - cpu_mfr_info.arch_id =sbi_get_marchid (); - cpu_mfr_info.imp_id =sbi_get_mimpid (); + cpu_mfr_info->vendor_id =sbi_get_mvendorid (); + cpu_mfr_info->arch_id =sbi_get_marchid (); + cpu_mfr_info->imp_id =sbi_get_mimpid ();#endif -} - -static void __init init_alternative (void ) -{ -riscv_fill_cpu_mfr_info (); -switch (cpu_mfr_info.vendor_id) { +switch (cpu_mfr_info->vendor_id) {#ifdef CONFIG_ERRATA_SIFIVE case SIFIVE_VENDOR_ID : - vendor_patch_func = sifive_errata_patch_func; + cpu_mfr_info->vendor_patch_func = sifive_errata_patch_func;break ;#endif default : - vendor_patch_func =NULL ; + cpu_mfr_info->vendor_patch_func =NULL ; } }
@@ -63,14 +57,19 @@ static void __init_or_module _apply_alternatives(struct alt_entry *begin, struct alt_entry *end, unsigned int stage) { +struct cpu_manufacturer_info_t cpu_mfr_info; + +riscv_fill_cpu_mfr_info (&cpu_mfr_info); +riscv_cpufeature_patch_func (begin, end, stage); -if (!vendor_patch_func) +if (!cpu_mfr_info.vendor_patch_func)return ; -vendor_patch_func (begin, end, - cpu_mfr_info.arch_id, cpu_mfr_info.imp_id, - stage); + cpu_mfr_info.vendor_patch_func (begin, end, + cpu_mfr_info.arch_id, + cpu_mfr_info.imp_id, + stage); }void __init apply_boot_alternatives (void )
@@ -78,8 +77,6 @@ void __init apply_boot_alternatives(void)/* If called on non-boot cpu things could go wrong */ WARN_ON (smp_processor_id () !=0 ); -init_alternative (); -_apply_alternatives ((struct alt_entry *)__alt_start, (struct alt_entry *)__alt_end,RISCV_ALTERNATIVES_BOOT );
Signature · 1 line
2.35.1
Re: [PATCH v9 11/12] riscv: don't use global static vars to store alternative data
Quoted 118 lines · Heiko Stuebner
Right now the code uses a global struct to store vendor-ids and another global variable to store the vendor-patch-function.
There exist specific cases where we'll need to patch the kernel at an even earlier stage, where trying to write to a static variable might actually result in hangs.
Also collecting the vendor-information consists of 3 sbi-ecalls (or csr-reads) which is pretty negligible in the context of booting a kernel.
So rework the code to not rely on static variables and instead collect the vendor-information when a round of alternatives is to be applied.
Signed-off-by Heiko Stuebner <[email protected]>--- arch/riscv/kernel/alternative.c | 51 ++++++++++++++++----------------- 1 file changed, 24 insertions(+), 27 deletions(-)arch/riscv/kernel/alternative.c +24
-28@@ -16,41 +16,35 @@#include <asm/sbi.h> #include <asm/csr.h> -static struct cpu_manufacturer_info_t { +struct cpu_manufacturer_info_t {unsigned long vendor_id;unsigned long arch_id;unsigned long imp_id; -} cpu_mfr_info; +void (*vendor_patch_func)(struct alt_entry *begin,struct alt_entry *end, +unsigned long archid,unsigned long impid, +unsigned int stage); +}; -static void (*vendor_patch_func)(struct alt_entry *begin, struct alt_entry *end, - unsigned long archid, unsigned long impid, - unsigned int stage) __initdata_or_module; - -static inline void __init riscv_fill_cpu_mfr_info (void ) +static void __init_or_module riscv_fill_cpu_mfr_info(struct cpu_manufacturer_info_t *cpu_mfr_info) {#ifdef CONFIG_RISCV_M_MODE - cpu_mfr_info.vendor_id =csr_read (CSR_MVENDORID ); - cpu_mfr_info.arch_id =csr_read (CSR_MARCHID ); - cpu_mfr_info.imp_id =csr_read (CSR_MIMPID ); + cpu_mfr_info->vendor_id =csr_read (CSR_MVENDORID ); + cpu_mfr_info->arch_id =csr_read (CSR_MARCHID ); + cpu_mfr_info->imp_id =csr_read (CSR_MIMPID );#else - cpu_mfr_info.vendor_id =sbi_get_mvendorid (); - cpu_mfr_info.arch_id =sbi_get_marchid (); - cpu_mfr_info.imp_id =sbi_get_mimpid (); + cpu_mfr_info->vendor_id =sbi_get_mvendorid (); + cpu_mfr_info->arch_id =sbi_get_marchid (); + cpu_mfr_info->imp_id =sbi_get_mimpid ();#endif -} - -static void __init init_alternative (void ) -{ -riscv_fill_cpu_mfr_info (); -switch (cpu_mfr_info.vendor_id) { +switch (cpu_mfr_info->vendor_id) {#ifdef CONFIG_ERRATA_SIFIVE case SIFIVE_VENDOR_ID : - vendor_patch_func = sifive_errata_patch_func; + cpu_mfr_info->vendor_patch_func = sifive_errata_patch_func;break ;#endif default : - vendor_patch_func =NULL ; + cpu_mfr_info->vendor_patch_func =NULL ; } }@@ -63,14 +57,19 @@ static void __init_or_module _apply_alternatives(struct alt_entry *begin, struct alt_entry *end, unsigned int stage) { +struct cpu_manufacturer_info_t cpu_mfr_info; + +riscv_fill_cpu_mfr_info (&cpu_mfr_info); +riscv_cpufeature_patch_func (begin, end, stage); -if (!vendor_patch_func) +if (!cpu_mfr_info.vendor_patch_func)return ; -vendor_patch_func (begin, end, - cpu_mfr_info.arch_id, cpu_mfr_info.imp_id, - stage); + cpu_mfr_info.vendor_patch_func (begin, end, + cpu_mfr_info.arch_id, + cpu_mfr_info.imp_id, + stage); }void __init apply_boot_alternatives (void )@@ -78,8 +77,6 @@ void __init apply_boot_alternatives(void)/* If called on non-boot cpu things could go wrong */ WARN_ON (smp_processor_id () !=0 ); -init_alternative (); -_apply_alternatives ((struct alt_entry *)__alt_start, (struct alt_entry *)__alt_end,RISCV_ALTERNATIVES_BOOT ); --2.35.1
Signature · 4 lines
Best Regards Guo Ren ML: https://lore.kernel.org/linux-csky/
Re: [PATCH v9 11/12] riscv: don't use global static vars to store alternative data
In reply to Heiko StuebnerQuoted 12 lines · Heiko Stuebner
Right now the code uses a global struct to store vendor-ids and another global variable to store the vendor-patch-function.
There exist specific cases where we'll need to patch the kernel at an even earlier stage, where trying to write to a static variable might actually result in hangs.
Also collecting the vendor-information consists of 3 sbi-ecalls (or csr-reads) which is pretty negligible in the context of booting a kernel.
Quoted 5 lines
So rework the code to not rely on static variables and instead collect the vendor-information when a round of alternatives is to be applied.
Signed-off-by Heiko Stuebner <[email protected]>
PATCH v9 12/12 riscv: add memory-type errata for T-Head
In reply to Heiko StuebnerSome current cpus based on T-Head cores implement memory-types way different than described in the svpbmt spec even going so far as using PTE bits marked as reserved.
Add the T-Head vendor-id and necessary errata code to replace the affected instructions.
--- arch/riscv/Kconfig.erratas | 20 +++++++ arch/riscv/errata/Makefile | 1 + arch/riscv/errata/sifive/errata.c | 7 ++- arch/riscv/errata/thead/Makefile | 1 + arch/riscv/errata/thead/errata.c | 82 ++++++++++++++++++++++++++ arch/riscv/include/asm/alternative.h | 6 ++ arch/riscv/include/asm/errata_list.h | 50 +++++++++++++++- arch/riscv/include/asm/pgtable-64.h | 18 +++++- arch/riscv/include/asm/pgtable.h | 18 +++++- arch/riscv/include/asm/vendorid_list.h | 1 + arch/riscv/kernel/alternative.c | 12 ++++ arch/riscv/kernel/cpufeature.c | 7 ++- arch/riscv/mm/init.c | 1 + 13 files changed, 215 insertions(+), 9 deletions(-) create mode 100644 arch/riscv/errata/thead/Makefile create mode 100644 arch/riscv/errata/thead/errata.c
arch/riscv/Kconfig.erratas +20 -0
@@ -33,4 +33,24 @@ config ERRATA_SIFIVE_CIP_1200 If you don't know what to do here, say "Y". +config ERRATA_THEAD + bool "T-HEAD errata" + select RISCV_ALTERNATIVE + help + All T-HEAD errata Kconfig depend on this Kconfig. Disabling + this Kconfig will disable all T-HEAD errata. Please say "Y" + here if your platform uses T-HEAD CPU cores. + + Otherwise, please say "N" here to avoid unnecessary overhead. + +config ERRATA_THEAD_PBMT + bool "Apply T-Head memory type errata" + depends on ERRATA_THEAD && 64BIT + default y + help + This will apply the memory type errata to handle the non-standard + memory type bits in page-table-entries on T-Head SoCs. + + If you don't know what to do here, say "Y". + endmenu
arch/riscv/errata/Makefile +1 -0
@@ -1 +1,2 @@ obj-$(CONFIG_ERRATA_SIFIVE) += sifive/ +obj-$(CONFIG_ERRATA_THEAD) += thead/
arch/riscv/errata/sifive/errata.c +6 -1
@@ -88,10 +88,15 @@ void __init_or_module sifive_errata_patch_func(struct alt_entry *begin, unsigned int stage) {struct alt_entry *alt; -u32 cpu_req_errata =sifive_errata_probe (archid, impid); +u32 cpu_req_errata;u32 cpu_apply_errata =0 ;u32 tmp; +if (stage ==RISCV_ALTERNATIVES_EARLY_BOOT ) +return ; + + cpu_req_errata =sifive_errata_probe (archid, impid); +for (alt = begin; alt < end; alt++) {if (alt->vendor_id !=SIFIVE_VENDOR_ID )continue ;
arch/riscv/errata/thead/Makefile new file +1 -0
@@ -0,0 +1 @@ +obj-y += errata.o
arch/riscv/errata/thead/errata.c new file +82 -0
82 lines not on this page · raw message
arch/riscv/include/asm/alternative.h +6 -0
@@ -21,8 +21,10 @@#define RISCV_ALTERNATIVES_BOOT 0/* alternatives applied during regular boot */ #define RISCV_ALTERNATIVES_MODULE 1/* alternatives applied during module-init */ +#define RISCV_ALTERNATIVES_EARLY_BOOT 2/* alternatives applied before mmu start */ void __init apply_boot_alternatives (void ); +void __init apply_early_boot_alternatives (void );void apply_module_alternatives (void *start,size_t length);struct alt_entry {
@@ -41,6 +43,9 @@ struct errata_checkfunc_id {void sifive_errata_patch_func (struct alt_entry *begin,struct alt_entry *end,unsigned long archid,unsigned long impid,unsigned int stage); +void thead_errata_patch_func (struct alt_entry *begin,struct alt_entry *end, +unsigned long archid,unsigned long impid, +unsigned int stage);void riscv_cpufeature_patch_func (struct alt_entry *begin,struct alt_entry *end,unsigned int stage);
@@ -48,6 +53,7 @@ void riscv_cpufeature_patch_func(struct alt_entry *begin, struct alt_entry *end,#else /* CONFIG_RISCV_ALTERNATIVE */ static inline void apply_boot_alternatives (void ) { } +static inline void apply_early_boot_alternatives (void ) { }static inline void apply_module_alternatives (void *start,size_t length) { }#endif /* CONFIG_RISCV_ALTERNATIVE */
arch/riscv/include/asm/errata_list.h +47 -3
65 lines not on this page · raw message
arch/riscv/include/asm/pgtable-64.h +17 -1
@@ -86,6 +86,18 @@ typedef struct {#define _PAGE_IO_SVPBMT (1UL << 62)#define _PAGE_MTMASK_SVPBMT (_PAGE_NOCACHE_SVPBMT | _PAGE_IO_SVPBMT) +/* +* [63:59] T-Head Memory Type definitions: +* +* 00000 - NC Weakly-ordered, Non-cacheable, Non-bufferable, Non-shareable, Non-trustable +* 01110 - PMA Weakly-ordered, Cacheable, Bufferable, Shareable, Non-trustable +* 10000 - IO Strongly-ordered, Non-cacheable, Non-bufferable, Non-shareable, Non-trustable +*/ +#define _PAGE_PMA_THEAD ((1UL << 62) | (1UL << 61) | (1UL << 60)) +#define _PAGE_NOCACHE_THEAD 0UL +#define _PAGE_IO_THEAD (1UL << 63) +#define _PAGE_MTMASK_THEAD (_PAGE_PMA_THEAD | _PAGE_IO_THEAD | (1UL << 59)) +static inline u64 riscv_page_mtmask (void ) {u64 val;
@@ -193,7 +205,11 @@ static inline bool mm_pud_folded(struct mm_struct *mm)static inline pmd_t pfn_pmd (unsigned long pfn,pgprot_t prot) { -return __pmd ((pfn << _PAGE_PFN_SHIFT) |pgprot_val (prot)); +unsigned long prot_val =pgprot_val (prot); + +ALT_THEAD_PMA (prot_val); + +return __pmd ((pfn << _PAGE_PFN_SHIFT) | prot_val); }static inline unsigned long _pmd_pfn (pmd_t pmd)
arch/riscv/include/asm/pgtable.h +15 -3
@@ -250,7 +250,11 @@ static inline void pmd_clear(pmd_t *pmdp)static inline pgd_t pfn_pgd (unsigned long pfn,pgprot_t prot) { -return __pgd ((pfn << _PAGE_PFN_SHIFT) |pgprot_val (prot)); +unsigned long prot_val =pgprot_val (prot); + +ALT_THEAD_PMA (prot_val); + +return __pgd ((pfn << _PAGE_PFN_SHIFT) | prot_val); }static inline unsigned long _pgd_pfn (pgd_t pgd)
@@ -289,7 +293,11 @@ static inline unsigned long pte_pfn(pte_t pte)/* Constructs a page table entry */ static inline pte_t pfn_pte (unsigned long pfn,pgprot_t prot) { -return __pte ((pfn << _PAGE_PFN_SHIFT) |pgprot_val (prot)); +unsigned long prot_val =pgprot_val (prot); + +ALT_THEAD_PMA (prot_val); + +return __pte ((pfn << _PAGE_PFN_SHIFT) | prot_val); }#define mk_pte (page, prot) pfn_pte(page_to_pfn(page), prot)
@@ -398,7 +406,11 @@ static inline int pmd_protnone(pmd_t pmd)/* Modify page protection bits */ static inline pte_t pte_modify (pte_t pte,pgprot_t newprot) { -return __pte ((pte_val (pte) & _PAGE_CHG_MASK) |pgprot_val (newprot)); +unsigned long newprot_val =pgprot_val (newprot); + +ALT_THEAD_PMA (newprot_val); + +return __pte ((pte_val (pte) & _PAGE_CHG_MASK) | newprot_val); }#define pgd_ERROR (e) \
arch/riscv/include/asm/vendorid_list.h +1 -0
@@ -6,5 +6,6 @@#define ASM_VENDOR_LIST_H #define SIFIVE_VENDOR_ID 0x489 +#define THEAD_VENDOR_ID 0x5b7#endif
arch/riscv/kernel/alternative.c +12 -0
@@ -42,6 +42,11 @@ static void __init_or_module riscv_fill_cpu_mfr_info(struct cpu_manufacturer_infcase SIFIVE_VENDOR_ID : cpu_mfr_info->vendor_patch_func = sifive_errata_patch_func;break ; +#endif +#ifdef CONFIG_ERRATA_THEAD +case THEAD_VENDOR_ID : + cpu_mfr_info->vendor_patch_func = thead_errata_patch_func; +break ;#endif default : cpu_mfr_info->vendor_patch_func =NULL ;
@@ -82,6 +87,13 @@ void __init apply_boot_alternatives(void) RISCV_ALTERNATIVES_BOOT); } +void __init apply_early_boot_alternatives (void ) +{ +_apply_alternatives ((struct alt_entry *)__alt_start, + (struct alt_entry *)__alt_end, +RISCV_ALTERNATIVES_EARLY_BOOT ); +} +#ifdef CONFIG_MODULES void apply_module_alternatives (void *start,size_t length) {
arch/riscv/kernel/cpufeature.c +6 -1
@@ -254,7 +254,12 @@ struct cpufeature_info { static bool __init_or_module cpufeature_svpbmt_check_func(unsigned int stage) {#ifdef CONFIG_RISCV_ISA_SVPBMT -return riscv_isa_extension_available (NULL ,SVPBMT ); +switch (stage) { +case RISCV_ALTERNATIVES_EARLY_BOOT : +return false; +default : +return riscv_isa_extension_available (NULL ,SVPBMT ); + }#endif return false;
arch/riscv/mm/init.c +1 -0
@@ -935,6 +935,7 @@ asmlinkage void __init setup_vm(uintptr_t dtb_pa)BUG_ON ((kernel_map.virt_addr + kernel_map.size) >ADDRESS_SPACE_END -SZ_4K );#endif +apply_early_boot_alternatives ();pt_ops_set_early ();/* Setup early PGD for fixmap */
Signature · 1 line
2.35.1
Re: [PATCH v9 12/12] riscv: add memory-type errata for T-Head
Quoted 437 lines · Heiko Stuebner
Some current cpus based on T-Head cores implement memory-types way different than described in the svpbmt spec even going so far as using PTE bits marked as reserved.
Add the T-Head vendor-id and necessary errata code to replace the affected instructions.
Signed-off-by Heiko Stuebner <[email protected]>Tested-by Samuel Holland <[email protected]>--- arch/riscv/Kconfig.erratas | 20 +++++++ arch/riscv/errata/Makefile | 1 + arch/riscv/errata/sifive/errata.c | 7 ++- arch/riscv/errata/thead/Makefile | 1 + arch/riscv/errata/thead/errata.c | 82 ++++++++++++++++++++++++++ arch/riscv/include/asm/alternative.h | 6 ++ arch/riscv/include/asm/errata_list.h | 50 +++++++++++++++- arch/riscv/include/asm/pgtable-64.h | 18 +++++- arch/riscv/include/asm/pgtable.h | 18 +++++- arch/riscv/include/asm/vendorid_list.h | 1 + arch/riscv/kernel/alternative.c | 12 ++++ arch/riscv/kernel/cpufeature.c | 7 ++- arch/riscv/mm/init.c | 1 + 13 files changed, 215 insertions(+), 9 deletions(-) create mode 100644 arch/riscv/errata/thead/Makefile create mode 100644 arch/riscv/errata/thead/errata.carch/riscv/Kconfig.erratas +20
-0@@ -33,4 +33,24 @@ config ERRATA_SIFIVE_CIP_1200 If you don't know what to do here, say "Y". +config ERRATA_THEAD + bool "T-HEAD errata" + select RISCV_ALTERNATIVE + help + All T-HEAD errata Kconfig depend on this Kconfig. Disabling + this Kconfig will disable all T-HEAD errata. Please say "Y" + here if your platform uses T-HEAD CPU cores. + + Otherwise, please say "N" here to avoid unnecessary overhead. + +config ERRATA_THEAD_PBMT + bool "Apply T-Head memory type errata" + depends on ERRATA_THEAD && 64BIT + default y + help + This will apply the memory type errata to handle the non-standard + memory type bits in page-table-entries on T-Head SoCs. + + If you don't know what to do here, say "Y". + endmenuarch/riscv/errata/Makefile +1
-0@@ -1 +1,2 @@ obj-$(CONFIG_ERRATA_SIFIVE) += sifive/ +obj-$(CONFIG_ERRATA_THEAD) += thead/arch/riscv/errata/sifive/errata.c +6
-1@@ -88,10 +88,15 @@ void __init_or_module sifive_errata_patch_func(struct alt_entry *begin, unsigned int stage) {struct alt_entry *alt; -u32 cpu_req_errata =sifive_errata_probe (archid, impid); +u32 cpu_req_errata;u32 cpu_apply_errata =0 ;u32 tmp; +if (stage ==RISCV_ALTERNATIVES_EARLY_BOOT ) +return ; + + cpu_req_errata =sifive_errata_probe (archid, impid); +for (alt = begin; alt < end; alt++) {if (alt->vendor_id !=SIFIVE_VENDOR_ID )continue ;arch/riscv/errata/thead/Makefile new file +1
-0@@ -0,0 +1 @@ +obj-y += errata.oarch/riscv/errata/thead/errata.c new file +82
-0@@ -0,0 +1,82 @@ +// SPDX-License-Identifier: GPL-2.0-only +/* +* Copyright (C) 2021 Heiko Stuebner <[email protected]> +*/ + +#include <linux/bug.h> +#include <linux/kernel.h> +#include <linux/module.h> +#include <linux/string.h> +#include <linux/uaccess.h> +#include <asm/alternative.h> +#include <asm/cacheflush.h> +#include <asm/errata_list.h> +#include <asm/patch.h> +#include <asm/vendorid_list.h> + +struct errata_info { +char name[ERRATA_STRING_LENGTH_MAX ]; +bool (*check_func)(unsigned long arch_id,unsigned long impid); +unsigned int stage; +}; + +static bool errata_mt_check_func (unsigned long arch_id,unsigned long impid) +{ +if (arch_id !=0 || impid !=0 ) +return false; +return true; +} + +static const struct errata_info errata_list[ERRATA_THEAD_NUMBER ] = { + { + .name ="memory-types" , + .stage =RISCV_ALTERNATIVES_EARLY_BOOT , + .check_func = errata_mt_check_func + }, +}; + +static u32 thead_errata_probe (unsigned int stage,unsigned long archid,unsigned long impid) +{ +const struct errata_info *info; +u32 cpu_req_errata =0 ; +int idx; + +for (idx =0 ; idx <ERRATA_THEAD_NUMBER ; idx++) { + info = &errata_list[idx]; + +if ((stage ==RISCV_ALTERNATIVES_MODULE || + info->stage == stage) && info->check_func (archid, impid)) + cpu_req_errata |= (1U << idx); + } + +return cpu_req_errata; +} + +void __init_or_module thead_errata_patch_func(struct alt_entry *begin, struct alt_entry *end, +unsigned long archid,unsigned long impid, +unsigned int stage) +{ +struct alt_entry *alt; +u32 cpu_req_errata =thead_errata_probe (stage, archid, impid); +u32 tmp; + +for (alt = begin; alt < end; alt++) { +if (alt->vendor_id !=THEAD_VENDOR_ID ) +continue ; +if (alt->errata_id >=ERRATA_THEAD_NUMBER ) +continue ; + + tmp = (1U << alt->errata_id); +if (cpu_req_errata & tmp) { +/* On vm-alternatives, the mmu isn't running yet */ +if (stage ==RISCV_ALTERNATIVES_EARLY_BOOT ) +memcpy ((void *)__pa_symbol (alt->old_ptr), + (void *)__pa_symbol (alt->alt_ptr), alt->alt_len); +else +patch_text_nosync (alt->old_ptr, alt->alt_ptr, alt->alt_len); + } + } + +if (stage ==RISCV_ALTERNATIVES_EARLY_BOOT ) +local_flush_icache_all (); +}arch/riscv/include/asm/alternative.h +6
-0@@ -21,8 +21,10 @@#define RISCV_ALTERNATIVES_BOOT 0/* alternatives applied during regular boot */ #define RISCV_ALTERNATIVES_MODULE 1/* alternatives applied during module-init */ +#define RISCV_ALTERNATIVES_EARLY_BOOT 2/* alternatives applied before mmu start */ void __init apply_boot_alternatives (void ); +void __init apply_early_boot_alternatives (void );void apply_module_alternatives (void *start,size_t length);struct alt_entry {@@ -41,6 +43,9 @@ struct errata_checkfunc_id {void sifive_errata_patch_func (struct alt_entry *begin,struct alt_entry *end,unsigned long archid,unsigned long impid,unsigned int stage); +void thead_errata_patch_func (struct alt_entry *begin,struct alt_entry *end, +unsigned long archid,unsigned long impid, +unsigned int stage);void riscv_cpufeature_patch_func (struct alt_entry *begin,struct alt_entry *end,unsigned int stage);@@ -48,6 +53,7 @@ void riscv_cpufeature_patch_func(struct alt_entry *begin, struct alt_entry *end,#else /* CONFIG_RISCV_ALTERNATIVE */ static inline void apply_boot_alternatives (void ) { } +static inline void apply_early_boot_alternatives (void ) { }static inline void apply_module_alternatives (void *start,size_t length) { }#endif /* CONFIG_RISCV_ALTERNATIVE */ arch/riscv/include/asm/errata_list.h +47
-3@@ -14,6 +14,11 @@#define ERRATA_SIFIVE_NUMBER 2#endif +#ifdef CONFIG_ERRATA_THEAD +#define ERRATA_THEAD_PBMT 0 +#define ERRATA_THEAD_NUMBER 1 +#endif +#define CPUFEATURE_SVPBMT 0#define CPUFEATURE_NUMBER 1@@ -42,12 +47,51 @@ asm(ALTERNATIVE("sfence.vma %0", "sfence.vma", SIFIVE_VENDOR_ID, \* in the default case. */ #define ALT_SVPBMT_SHIFT 61 +#define ALT_THEAD_PBMT_SHIFT 59#define ALT_SVPBMT (_val, prot) \ -asm(ALTERNATIVE("li %0, 0\t\nnop", "li %0, %1\t\nslli %0,%0,%2", 0, \ - CPUFEATURE_SVPBMT, CONFIG_RISCV_ISA_SVPBMT) \ +asm(ALTERNATIVE_2("li %0, 0\t\nnop", \ + "li %0, %1\t\nslli %0,%0,%3", 0, \ + CPUFEATURE_SVPBMT, CONFIG_RISCV_ISA_SVPBMT, \ + "li %0, %2\t\nslli %0,%0,%4", THEAD_VENDOR_ID, \ + ERRATA_THEAD_PBMT, CONFIG_ERRATA_THEAD_PBMT) \ : "=r"(_val) \ : "I"(prot##_SVPBMT >> ALT_SVPBMT_SHIFT), \ - "I"(ALT_SVPBMT_SHIFT)) + "I"(prot##_THEAD >> ALT_THEAD_PBMT_SHIFT), \ + "I"(ALT_SVPBMT_SHIFT), \ + "I"(ALT_THEAD_PBMT_SHIFT)) + +#ifdef CONFIG_ERRATA_THEAD_PBMT +/* +* IO/NOCACHE memory types are handled together with svpbmt, +* so on T-Head chips, check if no other memory type is set, +* and set the non-0 PMA type if applicable. +*/ +#define ALT_THEAD_PMA (_val) \ +asm volatile(ALTERNATIVE( \ + "nop\n\t" \ + "nop\n\t" \ + "nop\n\t" \ + "nop\n\t" \ + "nop\n\t" \ + "nop\n\t" \ + "nop", \ + "li t3, %2\n\t" \ + "slli t3, t3, %4\n\t" \ + "and t3, %0, t3\n\t" \ + "bne t3, zero, 2f\n\t" \ + "li t3, %3\n\t" \ + "slli t3, t3, %4\n\t" \ + "or %0, %0, t3\n\t" \ + "2:", THEAD_VENDOR_ID, \ + ERRATA_THEAD_PBMT, CONFIG_ERRATA_THEAD_PBMT) \ + : "+r"(_val) \ + : "0"(_val), \ + "I"(_PAGE_MTMASK_THEAD >> ALT_THEAD_PBMT_SHIFT), \ + "I"(_PAGE_PMA_THEAD >> ALT_THEAD_PBMT_SHIFT), \ + "I"(ALT_THEAD_PBMT_SHIFT)) +#else +#define ALT_THEAD_PMA (_val) +#endif #endif /* __ASSEMBLY__ */ arch/riscv/include/asm/pgtable-64.h +17
-1@@ -86,6 +86,18 @@ typedef struct {#define _PAGE_IO_SVPBMT (1UL << 62)#define _PAGE_MTMASK_SVPBMT (_PAGE_NOCACHE_SVPBMT | _PAGE_IO_SVPBMT) +/* +* [63:59] T-Head Memory Type definitions: +* +* 00000 - NC Weakly-ordered, Non-cacheable, Non-bufferable, Non-shareable, Non-trustable +* 01110 - PMA Weakly-ordered, Cacheable, Bufferable, Shareable, Non-trustable +* 10000 - IO Strongly-ordered, Non-cacheable, Non-bufferable, Non-shareable, Non-trustable +*/ +#define _PAGE_PMA_THEAD ((1UL << 62) | (1UL << 61) | (1UL << 60)) +#define _PAGE_NOCACHE_THEAD 0UL +#define _PAGE_IO_THEAD (1UL << 63) +#define _PAGE_MTMASK_THEAD (_PAGE_PMA_THEAD | _PAGE_IO_THEAD | (1UL << 59)) +static inline u64 riscv_page_mtmask (void ) {u64 val;@@ -193,7 +205,11 @@ static inline bool mm_pud_folded(struct mm_struct *mm)static inline pmd_t pfn_pmd (unsigned long pfn,pgprot_t prot) { -return __pmd ((pfn << _PAGE_PFN_SHIFT) |pgprot_val (prot)); +unsigned long prot_val =pgprot_val (prot); + +ALT_THEAD_PMA (prot_val); + +return __pmd ((pfn << _PAGE_PFN_SHIFT) | prot_val); }static inline unsigned long _pmd_pfn (pmd_t pmd)arch/riscv/include/asm/pgtable.h +15
-3@@ -250,7 +250,11 @@ static inline void pmd_clear(pmd_t *pmdp)static inline pgd_t pfn_pgd (unsigned long pfn,pgprot_t prot) { -return __pgd ((pfn << _PAGE_PFN_SHIFT) |pgprot_val (prot)); +unsigned long prot_val =pgprot_val (prot); + +ALT_THEAD_PMA (prot_val); + +return __pgd ((pfn << _PAGE_PFN_SHIFT) | prot_val); }static inline unsigned long _pgd_pfn (pgd_t pgd)@@ -289,7 +293,11 @@ static inline unsigned long pte_pfn(pte_t pte)/* Constructs a page table entry */ static inline pte_t pfn_pte (unsigned long pfn,pgprot_t prot) { -return __pte ((pfn << _PAGE_PFN_SHIFT) |pgprot_val (prot)); +unsigned long prot_val =pgprot_val (prot); + +ALT_THEAD_PMA (prot_val); + +return __pte ((pfn << _PAGE_PFN_SHIFT) | prot_val); }#define mk_pte (page, prot) pfn_pte(page_to_pfn(page), prot)@@ -398,7 +406,11 @@ static inline int pmd_protnone(pmd_t pmd)/* Modify page protection bits */ static inline pte_t pte_modify (pte_t pte,pgprot_t newprot) { -return __pte ((pte_val (pte) & _PAGE_CHG_MASK) |pgprot_val (newprot)); +unsigned long newprot_val =pgprot_val (newprot); + +ALT_THEAD_PMA (newprot_val); + +return __pte ((pte_val (pte) & _PAGE_CHG_MASK) | newprot_val); }#define pgd_ERROR (e) \arch/riscv/include/asm/vendorid_list.h +1
-0@@ -6,5 +6,6 @@#define ASM_VENDOR_LIST_H #define SIFIVE_VENDOR_ID 0x489 +#define THEAD_VENDOR_ID 0x5b7#endif arch/riscv/kernel/alternative.c +12
-0@@ -42,6 +42,11 @@ static void __init_or_module riscv_fill_cpu_mfr_info(struct cpu_manufacturer_infcase SIFIVE_VENDOR_ID : cpu_mfr_info->vendor_patch_func = sifive_errata_patch_func;break ; +#endif +#ifdef CONFIG_ERRATA_THEAD +case THEAD_VENDOR_ID : + cpu_mfr_info->vendor_patch_func = thead_errata_patch_func; +break ;#endif default : cpu_mfr_info->vendor_patch_func =NULL ;@@ -82,6 +87,13 @@ void __init apply_boot_alternatives(void) RISCV_ALTERNATIVES_BOOT); } +void __init apply_early_boot_alternatives (void ) +{ +_apply_alternatives ((struct alt_entry *)__alt_start, + (struct alt_entry *)__alt_end, +RISCV_ALTERNATIVES_EARLY_BOOT ); +} +#ifdef CONFIG_MODULES void apply_module_alternatives (void *start,size_t length) {arch/riscv/kernel/cpufeature.c +6
-1@@ -254,7 +254,12 @@ struct cpufeature_info { static bool __init_or_module cpufeature_svpbmt_check_func(unsigned int stage) {#ifdef CONFIG_RISCV_ISA_SVPBMT -return riscv_isa_extension_available (NULL ,SVPBMT ); +switch (stage) { +case RISCV_ALTERNATIVES_EARLY_BOOT : +return false; +default : +return riscv_isa_extension_available (NULL ,SVPBMT ); + }#endif return false;arch/riscv/mm/init.c +1
-1@@ -935,6 +935,7 @@ asmlinkage void __init setup_vm(uintptr_t dtb_pa)BUG_ON ((kernel_map.virt_addr + kernel_map.size) >ADDRESS_SPACE_END -SZ_4K );#endif +apply_early_boot_alternatives ();pt_ops_set_early ();/* Setup early PGD for fixmap */ --2.35.1
Signature · 4 lines
Best Regards Guo Ren ML: https://lore.kernel.org/linux-csky/
Re: [PATCH v9 12/12] riscv: add memory-type errata for T-Head
In reply to Heiko StuebnerQuoted 10 lines · Heiko Stuebner
Some current cpus based on T-Head cores implement memory-types way different than described in the svpbmt spec even going so far as using PTE bits marked as reserved.
Add the T-Head vendor-id and necessary errata code to replace the affected instructions.
Signed-off-by Heiko Stuebner <[email protected]>Tested-by Samuel Holland <[email protected]>
_______________________________________________
linux-riscv mailing list
[email protected]
http://lists.infradead.org/mailman/listinfo/linux-riscv