Introduce RISC-V
Subsystems (7)
v2 cover Introduce RISC-V
v2:
- While basing [1] on this series I found two bugs (one in exception return and another in isa string parsing). I also decided to expose a get_pte() function to unit tests and also an isa-extension-by-name function to check for arbitrary extensions. Finally, I picked up Thomas' gitlab-ci suggestion and his tags.
(Having [1] and the selftests running makes me pretty happy with the series, so, unless somebody shouts, I'll merge this sometime next week.)
[1] https://gitlab.com/jones-drew/kvm-unit-tests/-/commit/e9c6c58b1c799de77fd39970b358a7592ecd048f
Thanks,
drew
Original cover letter follows:
This series adds another architecture to kvm-unit-tests (RISC-V, both 32-bit and 64-bit). Much of the code is borrowed from arm/arm64 by mimicking its patterns or by first making the arm code more generic and moving it to the common lib.
This series brings UART, SMP, MMU, and exception handling support. One should be able to start writing CPU validation tests in a mix of C and asm as well as write SBI tests, as is the plan for the SBI verification framework. kvm-unit-tests provides backtraces on asserts and input can be given to the tests through command line arguments, environment variables, and the DT (there's already an ISA string parser for extension detection).
This series only targets QEMU TCG and KVM, but OpenSBI may be replaced with other SBI implementations, such as RustSBI. It's a goal to target bare-metal as soon as possible, so EFI support is already in progress and will be posted soon. More follow on series will come as well, bringing interrupt controller support for timer and PMU testing, support to run tests in usermode, and whatever else people need for their tests.
Andrew Jones (24):
configure: Add ARCH_LIBDIR
riscv: Initial port, hello world
arm/arm64: Move cpumask.h to common lib arm/arm64: Share cpu online, present and idle masks
riscv: Add DT parsing
riscv: Add initial SBI support
riscv: Add run script and unittests.cfg
riscv: Add riscv32 support
riscv: Add exception handling
riscv: Add backtrace support
arm/arm64: Generalize wfe/sev names in smp.c arm/arm64: Remove spinlocks from on_cpu_async arm/arm64: Share on_cpus
riscv: Compile with march
riscv: Add SMP support
arm/arm64: Share memregions
riscv: Populate memregions and switch to page allocator
riscv: Add MMU support
riscv: Enable the MMU in secondaries
riscv: Enable vmalloc
lib: Add strcasecmp and strncasecmp
riscv: Add isa string parsing
gitlab-ci: Add riscv64 tests
MAINTAINERS: Add riscv
.gitlab-ci.yml | 17 +++
MAINTAINERS | 8 ++
Makefile | 2 +-
arm/Makefile.common | 2 +
arm/selftest.c | 3 +-
configure | 16 +++
lib/arm/asm/gic-v2.h | 2 +-
lib/arm/asm/gic-v3.h | 2 +-
lib/arm/asm/gic.h | 2 +-
lib/arm/asm/setup.h | 14 --
lib/arm/asm/smp.h | 45 +-----
lib/arm/mmu.c | 3 +-
lib/arm/setup.c | 93 +++----------
lib/arm/smp.c | 135 +-----------------
lib/arm64/asm/cpumask.h | 1 -
lib/{arm/asm => }/cpumask.h | 42 +++++-
lib/ctype.h | 10 ++
lib/elf.h | 11 ++
lib/ldiv32.c | 16 +++
lib/linux/const.h | 2 +
lib/memregions.c | 82 +++++++++++
lib/memregions.h | 29 ++++
lib/on-cpus.c | 154 +++++++++++++++++++++
lib/on-cpus.h | 14 ++
lib/riscv/.gitignore | 1 +
lib/riscv/asm-offsets.c | 62 +++++++++
lib/riscv/asm/asm-offsets.h | 1 +
lib/riscv/asm/barrier.h | 20 +++
lib/riscv/asm/bitops.h | 21 +++
lib/riscv/asm/bug.h | 20 +++
lib/riscv/asm/csr.h | 100 ++++++++++++++
lib/riscv/asm/io.h | 87 ++++++++++++
lib/riscv/asm/isa.h | 33 +++++
lib/riscv/asm/memory_areas.h | 1 +
lib/riscv/asm/mmu.h | 32 +++++
lib/riscv/asm/page.h | 21 +++
lib/riscv/asm/pgtable.h | 42 ++++++
lib/riscv/asm/processor.h | 29 ++++
lib/riscv/asm/ptrace.h | 46 +++++++
lib/riscv/asm/sbi.h | 54 ++++++++
lib/riscv/asm/setup.h | 15 ++
lib/riscv/asm/smp.h | 29 ++++
lib/riscv/asm/spinlock.h | 7 +
lib/riscv/asm/stack.h | 12 ++
lib/riscv/bitops.c | 47 +++++++
lib/riscv/io.c | 97 +++++++++++++
lib/riscv/isa.c | 126 +++++++++++++++++
lib/riscv/mmu.c | 205 +++++++++++++++++++++++++++
lib/riscv/processor.c | 64 +++++++++
lib/riscv/sbi.c | 40 ++++++
lib/riscv/setup.c | 188 +++++++++++++++++++++++++
lib/riscv/smp.c | 70 ++++++++++
lib/riscv/stack.c | 32 +++++
lib/string.c | 14 ++
lib/string.h | 2 +
riscv/Makefile | 106 ++++++++++++++
riscv/cstart.S | 259 +++++++++++++++++++++++++++++++++++
riscv/flat.lds | 75 ++++++++++
riscv/run | 41 ++++++
riscv/sbi.c | 41 ++++++
riscv/selftest.c | 100 ++++++++++++++
riscv/sieve.c | 1 +
riscv/unittests.cfg | 37 +++++
63 files changed, 2616 insertions(+), 267 deletions(-)
delete mode 100644 lib/arm64/asm/cpumask.h
rename lib/{arm/asm => }/cpumask.h (72%)
create mode 100644 lib/memregions.c
create mode 100644 lib/memregions.h
create mode 100644 lib/on-cpus.c
create mode 100644 lib/on-cpus.h
create mode 100644 lib/riscv/.gitignore
create mode 100644 lib/riscv/asm-offsets.c
create mode 100644 lib/riscv/asm/asm-offsets.h
create mode 100644 lib/riscv/asm/barrier.h
create mode 100644 lib/riscv/asm/bitops.h
create mode 100644 lib/riscv/asm/bug.h
create mode 100644 lib/riscv/asm/csr.h
create mode 100644 lib/riscv/asm/io.h
create mode 100644 lib/riscv/asm/isa.h
create mode 100644 lib/riscv/asm/memory_areas.h
create mode 100644 lib/riscv/asm/mmu.h
create mode 100644 lib/riscv/asm/page.h
create mode 100644 lib/riscv/asm/pgtable.h
create mode 100644 lib/riscv/asm/processor.h
create mode 100644 lib/riscv/asm/ptrace.h
create mode 100644 lib/riscv/asm/sbi.h
create mode 100644 lib/riscv/asm/setup.h
create mode 100644 lib/riscv/asm/smp.h
create mode 100644 lib/riscv/asm/spinlock.h
create mode 100644 lib/riscv/asm/stack.h
create mode 100644 lib/riscv/bitops.c
create mode 100644 lib/riscv/io.c
create mode 100644 lib/riscv/isa.c
create mode 100644 lib/riscv/mmu.c
create mode 100644 lib/riscv/processor.c
create mode 100644 lib/riscv/sbi.c
create mode 100644 lib/riscv/setup.c
create mode 100644 lib/riscv/smp.c
create mode 100644 lib/riscv/stack.c
create mode 100644 riscv/Makefile
create mode 100644 riscv/cstart.S
create mode 100644 riscv/flat.lds
create mode 100755 riscv/run
create mode 100644 riscv/sbi.c
create mode 100644 riscv/selftest.c
create mode 120000 riscv/sieve.c
create mode 100644 riscv/unittests.cfgSignature · 1 line
2.43.0
PATCH v2 1/24 configure: Add ARCH_LIBDIR
Prepare for an architecture which will share the same lib/$ARCH directory, but be configured with different arch names for different bit widths, i.e. riscv32 -> lib/riscv and riscv64 -> lib/riscv.
--- Makefile | 2 +- configure | 2 ++ 2 files changed, 3 insertions(+), 1 deletion(-)
Makefile +1 -1
@@ -10,7 +10,7 @@ include config.mak VPATH = $(SRCDIR) libdirs-get = $(shell [ -d "lib/$(1)" ] && echo "lib/$(1) lib/$(1)/asm") -ARCH_LIBDIRS := $(call libdirs-get,$(ARCH)) $(call libdirs-get,$(TEST_DIR)) +ARCH_LIBDIRS := $(call libdirs-get,$(ARCH_LIBDIR)) $(call libdirs-get,$(TEST_DIR)) OBJDIRS := $(ARCH_LIBDIRS) DESTDIR := $(PREFIX)/share/kvm-unit-tests/
configure +2 -0
@@ -198,6 +198,7 @@ fi arch_name=$arch [ "$arch" = "aarch64" ] && arch="arm64" [ "$arch_name" = "arm64" ] && arch_name="aarch64" +arch_libdir=$arch if [ -z "$target" ]; then target="qemu"
@@ -391,6 +392,7 @@ PREFIX=$prefix HOST=$host ARCH=$arch ARCH_NAME=$arch_name +ARCH_LIBDIR=$arch_libdir PROCESSOR=$processor CC=$cross_prefix$cc CFLAGS=$cflags
Signature · 1 line
2.43.0
Re: [kvm-unit-tests PATCH v2 01/24] configure: Add ARCH_LIBDIR
Hi Drew,
Quoted 7 lines · Andrew Jones
Prepare for an architecture which will share the same lib/$ARCH directory, but be configured with different arch names for different bit widths, i.e. riscv32 -> lib/riscv and riscv64 -> lib/riscv.
Signed-off-by Andrew Jones <[email protected]>Reviewed-by Thomas Huth <[email protected]>Acked-by Thomas Huth <[email protected]>
Eric
Quoted 38 lines
--- Makefile | 2 +- configure | 2 ++ 2 files changed, 3 insertions(+), 1 deletion(-)Makefile +1
-1@@ -10,7 +10,7 @@ include config.mak VPATH = $(SRCDIR) libdirs-get = $(shell [ -d "lib/$(1)" ] && echo "lib/$(1) lib/$(1)/asm") -ARCH_LIBDIRS := $(call libdirs-get,$(ARCH)) $(call libdirs-get,$(TEST_DIR)) +ARCH_LIBDIRS := $(call libdirs-get,$(ARCH_LIBDIR)) $(call libdirs-get,$(TEST_DIR)) OBJDIRS := $(ARCH_LIBDIRS) DESTDIR := $(PREFIX)/share/kvm-unit-tests/configure +2
-0@@ -198,6 +198,7 @@ fi arch_name=$arch [ "$arch" = "aarch64" ] && arch="arm64" [ "$arch_name" = "arm64" ] && arch_name="aarch64" +arch_libdir=$arch if [ -z "$target" ]; then target="qemu"@@ -391,6 +392,7 @@ PREFIX=$prefix HOST=$host ARCH=$arch ARCH_NAME=$arch_name +ARCH_LIBDIR=$arch_libdir PROCESSOR=$processor CC=$cross_prefix$cc CFLAGS=$cflags
PATCH v2 2/24 riscv: Initial port, hello world
In reply to Andrew JonesAdd the minimal amount of code possible in order to launch a first test, which just prints "Hello, world" using the expected UART address of the QEMU virt machine. Add files, stubs, and some support, such as barriers and MMIO read/write along the way in order to satisfy the compiler. Basically everything is either copied from the arm64 port of kvm-unit-tests, or at least inspired by it, and, in that case, the RISC-V Linux kernel code was copied.
Run with
qemu-system-riscv64 -nographic -M virt -kernel riscv/selftest.flat
and then go to the monitor (ctrl-a c) and use 'q' to quit, since the unit test will just hang after printing hello world and the exit code.
--- configure | 14 ++++++ lib/riscv/.gitignore | 1 + lib/riscv/asm-offsets.c | 6 +++ lib/riscv/asm/asm-offsets.h | 1 + lib/riscv/asm/barrier.h | 13 ++++++ lib/riscv/asm/csr.h | 7 +++ lib/riscv/asm/io.h | 78 +++++++++++++++++++++++++++++++ lib/riscv/asm/page.h | 7 +++ lib/riscv/asm/setup.h | 7 +++ lib/riscv/asm/spinlock.h | 7 +++ lib/riscv/asm/stack.h | 9 ++++ lib/riscv/io.c | 44 ++++++++++++++++++ lib/riscv/setup.c | 12 +++++ riscv/Makefile | 83 +++++++++++++++++++++++++++++++++ riscv/cstart.S | 92 +++++++++++++++++++++++++++++++++++++ riscv/flat.lds | 75 ++++++++++++++++++++++++++++++ riscv/selftest.c | 13 ++++++ 17 files changed, 469 insertions(+) create mode 100644 lib/riscv/.gitignore create mode 100644 lib/riscv/asm-offsets.c create mode 100644 lib/riscv/asm/asm-offsets.h create mode 100644 lib/riscv/asm/barrier.h create mode 100644 lib/riscv/asm/csr.h create mode 100644 lib/riscv/asm/io.h create mode 100644 lib/riscv/asm/page.h create mode 100644 lib/riscv/asm/setup.h create mode 100644 lib/riscv/asm/spinlock.h create mode 100644 lib/riscv/asm/stack.h create mode 100644 lib/riscv/io.c create mode 100644 lib/riscv/setup.c create mode 100644 riscv/Makefile create mode 100644 riscv/cstart.S create mode 100644 riscv/flat.lds create mode 100644 riscv/selftest.c
configure +14 -0
@@ -200,6 +200,11 @@ arch_name=$arch [ "$arch_name" = "arm64" ] && arch_name="aarch64" arch_libdir=$arch +if [ "$arch" = "riscv" ]; then + echo "riscv32 or riscv64 must be specified" + exit 1 +fi + if [ -z "$target" ]; then target="qemu" else
@@ -307,6 +312,9 @@ elif [ "$arch" = "ppc64" ]; then echo "You must provide endianness (big or little)!" usage fi +elif [ "$arch" = "riscv32" ] || [ "$arch" = "riscv64" ]; then + testdir=riscv + arch_libdir=riscv else testdir=$arch fi
@@ -438,6 +446,12 @@ cat <<EOF >> lib/config.h #define CONFIG_ERRATA_FORCE ${errata_force} #define CONFIG_PAGE_SIZE _AC(${page_size}, UL) +EOF +elif [ "$arch" = "riscv32" ] || [ "$arch" = "riscv64" ]; then +cat <<EOF >> lib/config.h + +#define CONFIG_UART_EARLY_BASE 0x10000000 + EOF fi echo "#endif" >> lib/config.h
lib/riscv/.gitignore new file +1 -0
@@ -0,0 +1 @@ +/asm-offsets.[hs]
lib/riscv/asm-offsets.c new file +6 -0
@@ -0,0 +1,6 @@ +// SPDX-License-Identifier: GPL-2.0-only + +int main (void ) +{ +return 0 ; +}
lib/riscv/asm/asm-offsets.h new file +1 -0
@@ -0,0 +1 @@ +#include <generated/asm-offsets.h>
lib/riscv/asm/barrier.h new file +13 -0
@@ -0,0 +1,13 @@ +/* SPDX-License-Identifier: GPL-2.0-only */ +#ifndef _ASMRISCV_BARRIER_H_ +#define _ASMRISCV_BARRIER_H_ + +#define RISCV_FENCE (p, s) \ + __asm__ __volatile__ ("fence " #p "," #s : : : "memory") + +/* These barriers need to enforce ordering on both devices or memory. */ +#define mb () RISCV_FENCE(iorw,iorw) +#define rmb () RISCV_FENCE(ir,ir) +#define wmb () RISCV_FENCE(ow,ow) + +#endif /* _ASMRISCV_BARRIER_H_ */
lib/riscv/asm/csr.h new file +7 -0
@@ -0,0 +1,7 @@ +/* SPDX-License-Identifier: GPL-2.0-only */ +#ifndef _ASMRISCV_CSR_H_ +#define _ASMRISCV_CSR_H_ + +#define CSR_SSCRATCH 0x140 + +#endif /* _ASMRISCV_CSR_H_ */
lib/riscv/asm/io.h new file +78 -0
78 lines not on this page · raw message
lib/riscv/asm/page.h new file +7 -0
@@ -0,0 +1,7 @@ +/* SPDX-License-Identifier: GPL-2.0-only */ +#ifndef _ASMRISCV_PAGE_H_ +#define _ASMRISCV_PAGE_H_ + +#include <asm-generic/page.h> + +#endif /* _ASMRISCV_PAGE_H_ */
lib/riscv/asm/setup.h new file +7 -0
@@ -0,0 +1,7 @@ +/* SPDX-License-Identifier: GPL-2.0-only */ +#ifndef _ASMRISCV_SETUP_H_ +#define _ASMRISCV_SETUP_H_ + +void setup (const void *fdt,phys_addr_t freemem_start); + +#endif /* _ASMRISCV_SETUP_H_ */
lib/riscv/asm/spinlock.h new file +7 -0
@@ -0,0 +1,7 @@ +/* SPDX-License-Identifier: GPL-2.0-only */ +#ifndef _ASMRISCV_SPINLOCK_H_ +#define _ASMRISCV_SPINLOCK_H_ + +#include <asm-generic/spinlock.h> + +#endif /* _ASMRISCV_SPINLOCK_H_ */
lib/riscv/asm/stack.h new file +9 -0
@@ -0,0 +1,9 @@ +/* SPDX-License-Identifier: GPL-2.0-only */ +#ifndef _ASMRISCV_STACK_H_ +#define _ASMRISCV_STACK_H_ + +#ifndef _STACK_H_ +#error Do not directly include <asm/stack.h>. Just use <stack.h>. +#endif + +#endif
lib/riscv/io.c new file +44 -0
44 lines not on this page · raw message
lib/riscv/setup.c new file +12 -0
@@ -0,0 +1,12 @@ +// SPDX-License-Identifier: GPL-2.0-only +/* +* Initialize machine setup information and I/O. +* +* Copyright (C) 2023, Ventana Micro Systems Inc., Andrew Jones <[email protected]> +*/ +#include <libcflat.h> +#include <asm/setup.h> + +void setup (const void *fdt,phys_addr_t freemem_start) +{ +}
riscv/Makefile new file +83 -0
83 lines not on this page · raw message
riscv/cstart.S new file +92 -0
92 lines not on this page · raw message
riscv/flat.lds new file +75 -0
75 lines not on this page · raw message
riscv/selftest.c new file +13 -0
@@ -0,0 +1,13 @@ +// SPDX-License-Identifier: GPL-2.0-only +/* +* Test the framework itself. These tests confirm that setup works. +* +* Copyright (C) 2023, Ventana Micro Systems Inc., Andrew Jones <[email protected]> +*/ +#include <libcflat.h> + +int main (void ) +{ +puts ("Hello, world\n" ); +return 0 ; +}
Signature · 1 line
2.43.0
Re: [kvm-unit-tests PATCH v2 02/24] riscv: Initial port, hello world
Quoted 451 lines · Andrew Jones
Add the minimal amount of code possible in order to launch a first test, which just prints "Hello, world" using the expected UART address of the QEMU virt machine. Add files, stubs, and some support, such as barriers and MMIO read/write along the way in order to satisfy the compiler. Basically everything is either copied from the arm64 port of kvm-unit-tests, or at least inspired by it, and, in that case, the RISC-V Linux kernel code was copied.
Run with
qemu-system-riscv64 -nographic -M virt -kernel riscv/selftest.flatand then go to the monitor (ctrl-a c) and use 'q' to quit, since the unit test will just hang after printing hello world and the exit code.
Signed-off-by Andrew Jones <[email protected]>Acked-by Thomas Huth <[email protected]>--- configure | 14 ++++++ lib/riscv/.gitignore | 1 + lib/riscv/asm-offsets.c | 6 +++ lib/riscv/asm/asm-offsets.h | 1 + lib/riscv/asm/barrier.h | 13 ++++++ lib/riscv/asm/csr.h | 7 +++ lib/riscv/asm/io.h | 78 +++++++++++++++++++++++++++++++ lib/riscv/asm/page.h | 7 +++ lib/riscv/asm/setup.h | 7 +++ lib/riscv/asm/spinlock.h | 7 +++ lib/riscv/asm/stack.h | 9 ++++ lib/riscv/io.c | 44 ++++++++++++++++++ lib/riscv/setup.c | 12 +++++ riscv/Makefile | 83 +++++++++++++++++++++++++++++++++ riscv/cstart.S | 92 +++++++++++++++++++++++++++++++++++++ riscv/flat.lds | 75 ++++++++++++++++++++++++++++++ riscv/selftest.c | 13 ++++++ 17 files changed, 469 insertions(+) create mode 100644 lib/riscv/.gitignore create mode 100644 lib/riscv/asm-offsets.c create mode 100644 lib/riscv/asm/asm-offsets.h create mode 100644 lib/riscv/asm/barrier.h create mode 100644 lib/riscv/asm/csr.h create mode 100644 lib/riscv/asm/io.h create mode 100644 lib/riscv/asm/page.h create mode 100644 lib/riscv/asm/setup.h create mode 100644 lib/riscv/asm/spinlock.h create mode 100644 lib/riscv/asm/stack.h create mode 100644 lib/riscv/io.c create mode 100644 lib/riscv/setup.c create mode 100644 riscv/Makefile create mode 100644 riscv/cstart.S create mode 100644 riscv/flat.lds create mode 100644 riscv/selftest.cconfigure +14
-0@@ -200,6 +200,11 @@ arch_name=$arch [ "$arch_name" = "arm64" ] && arch_name="aarch64" arch_libdir=$arch +if [ "$arch" = "riscv" ]; then + echo "riscv32 or riscv64 must be specified" + exit 1 +fi + if [ -z "$target" ]; then target="qemu" else@@ -307,6 +312,9 @@ elif [ "$arch" = "ppc64" ]; then echo "You must provide endianness (big or little)!" usage fi +elif [ "$arch" = "riscv32" ] || [ "$arch" = "riscv64" ]; then + testdir=riscv + arch_libdir=riscv else testdir=$arch fi@@ -438,6 +446,12 @@ cat <<EOF >> lib/config.h #define CONFIG_ERRATA_FORCE ${errata_force} #define CONFIG_PAGE_SIZE _AC(${page_size}, UL) +EOF +elif [ "$arch" = "riscv32" ] || [ "$arch" = "riscv64" ]; then +cat <<EOF >> lib/config.h + +#define CONFIG_UART_EARLY_BASE 0x10000000 + EOF fi echo "#endif" >> lib/config.hlib/riscv/.gitignore new file +1
-0@@ -0,0 +1 @@ +/asm-offsets.[hs]lib/riscv/asm-offsets.c new file +6
-0@@ -0,0 +1,6 @@ +// SPDX-License-Identifier: GPL-2.0-only + +int main (void ) +{ +return 0 ; +}lib/riscv/asm/asm-offsets.h new file +1
-0@@ -0,0 +1 @@ +#include <generated/asm-offsets.h> lib/riscv/asm/barrier.h new file +13
-0@@ -0,0 +1,13 @@ +/* SPDX-License-Identifier: GPL-2.0-only */ +#ifndef _ASMRISCV_BARRIER_H_ +#define _ASMRISCV_BARRIER_H_ + +#define RISCV_FENCE (p, s) \ + __asm__ __volatile__ ("fence " #p "," #s : : : "memory") + +/* These barriers need to enforce ordering on both devices or memory. */ +#define mb () RISCV_FENCE(iorw,iorw) +#define rmb () RISCV_FENCE(ir,ir) +#define wmb () RISCV_FENCE(ow,ow) + +#endif /* _ASMRISCV_BARRIER_H_ */ lib/riscv/asm/csr.h new file +7
-0@@ -0,0 +1,7 @@ +/* SPDX-License-Identifier: GPL-2.0-only */ +#ifndef _ASMRISCV_CSR_H_ +#define _ASMRISCV_CSR_H_ + +#define CSR_SSCRATCH 0x140 + +#endif /* _ASMRISCV_CSR_H_ */ lib/riscv/asm/io.h new file +78
-0@@ -0,0 +1,78 @@ +/* SPDX-License-Identifier: GPL-2.0-only */ +/* +* From Linux arch/riscv/include/asm/mmio.h +*/ +#ifndef _ASMRISCV_IO_H_ +#define _ASMRISCV_IO_H_ +#include <libcflat.h> + +#define __iomem + +/* Generic IO read/write. These perform native-endian accesses. */ +#define __raw_writeb __raw_writeb +static inline void __raw_writeb (u8 val,volatile void __iomem *addr) +{ + asmvolatile ("sb %0, 0(%1)" : :"r" (val),"r" (addr)); +} + +#define __raw_writew __raw_writew +static inline void __raw_writew (u16 val,volatile void __iomem *addr) +{ + asmvolatile ("sh %0, 0(%1)" : :"r" (val),"r" (addr)); +} + +#define __raw_writel __raw_writel +static inline void __raw_writel (u32 val,volatile void __iomem *addr) +{ + asmvolatile ("sw %0, 0(%1)" : :"r" (val),"r" (addr)); +} + +#ifdef CONFIG_64BIT +#define __raw_writeq __raw_writeq +static inline void __raw_writeq (u64 val,volatile void __iomem *addr) +{ + asmvolatile ("sd %0, 0(%1)" : :"r" (val),"r" (addr)); +} +#endif + +#define __raw_readb __raw_readb +static inline u8 __raw_readb (const volatile void __iomem *addr) +{ +u8 val; + + asmvolatile ("lb %0, 0(%1)" :"=r" (val) :"r" (addr)); +return val; +} + +#define __raw_readw __raw_readw +static inline u16 __raw_readw (const volatile void __iomem *addr) +{ +u16 val; + + asmvolatile ("lh %0, 0(%1)" :"=r" (val) :"r" (addr)); +return val; +} + +#define __raw_readl __raw_readl +static inline u32 __raw_readl (const volatile void __iomem *addr) +{ +u32 val; + + asmvolatile ("lw %0, 0(%1)" :"=r" (val) :"r" (addr)); +return val; +} + +#ifdef CONFIG_64BIT +#define __raw_readq __raw_readq +static inline u64 __raw_readq (const volatile void __iomem *addr) +{ +u64 val; + + asmvolatile ("ld %0, 0(%1)" :"=r" (val) :"r" (addr)); +return val; +} +#endif + +#include <asm-generic/io.h> + +#endif /* _ASMRISCV_IO_H_ */ lib/riscv/asm/page.h new file +7
-0@@ -0,0 +1,7 @@ +/* SPDX-License-Identifier: GPL-2.0-only */ +#ifndef _ASMRISCV_PAGE_H_ +#define _ASMRISCV_PAGE_H_ + +#include <asm-generic/page.h> + +#endif /* _ASMRISCV_PAGE_H_ */ lib/riscv/asm/setup.h new file +7
-0@@ -0,0 +1,7 @@ +/* SPDX-License-Identifier: GPL-2.0-only */ +#ifndef _ASMRISCV_SETUP_H_ +#define _ASMRISCV_SETUP_H_ + +void setup (const void *fdt,phys_addr_t freemem_start); + +#endif /* _ASMRISCV_SETUP_H_ */ lib/riscv/asm/spinlock.h new file +7
-0@@ -0,0 +1,7 @@ +/* SPDX-License-Identifier: GPL-2.0-only */ +#ifndef _ASMRISCV_SPINLOCK_H_ +#define _ASMRISCV_SPINLOCK_H_ + +#include <asm-generic/spinlock.h> + +#endif /* _ASMRISCV_SPINLOCK_H_ */ lib/riscv/asm/stack.h new file +9
-0@@ -0,0 +1,9 @@ +/* SPDX-License-Identifier: GPL-2.0-only */ +#ifndef _ASMRISCV_STACK_H_ +#define _ASMRISCV_STACK_H_ + +#ifndef _STACK_H_ +#error Do not directly include <asm/stack.h>. Just use <stack.h>. +#endif + +#endif lib/riscv/io.c new file +44
-0@@ -0,0 +1,44 @@ +// SPDX-License-Identifier: GPL-2.0-only +/* +* Each architecture must implement puts() and exit() with the I/O +* devices exposed from QEMU, e.g. ns16550a. +* +* Copyright (C) 2023, Ventana Micro Systems Inc., Andrew Jones <[email protected]> +*/ +#include <libcflat.h> +#include <config.h> +#include <asm/io.h> +#include <asm/spinlock.h> + +/* +* Use this guess for the uart base in order to make an attempt at +* having earlier printf support. We'll overwrite it with the real +* base address that we read from the device tree later. This is +* the address we expect the virtual machine manager to put in +* its generated device tree. +*/ +#define UART_EARLY_BASE ((u8 *)(unsigned long)CONFIG_UART_EARLY_BASE) +static volatile u8 *uart0_base =UART_EARLY_BASE ; +static struct spinlock uart_lock; + +void puts (const char *s) +{ +spin_lock (&uart_lock); +while (*s) +writeb (*s++, uart0_base); +spin_unlock (&uart_lock); +} + +/* +* Defining halt to take 'code' as an argument guarantees that it will +* be in a0 when we halt. That gives us a final chance to see the exit +* status while inspecting the halted unit test state. +*/ +void halt (int code); + +void exit (int code) +{ +printf ("\nEXIT: STATUS=%d\n" , ((code) <<1 ) |1 ); +halt (code); +__builtin_unreachable (); +}lib/riscv/setup.c new file +12
-0@@ -0,0 +1,12 @@ +// SPDX-License-Identifier: GPL-2.0-only +/* +* Initialize machine setup information and I/O. +* +* Copyright (C) 2023, Ventana Micro Systems Inc., Andrew Jones <[email protected]> +*/ +#include <libcflat.h> +#include <asm/setup.h> + +void setup (const void *fdt,phys_addr_t freemem_start) +{ +}riscv/Makefile new file +83
-0@@ -0,0 +1,83 @@ +# +# riscv makefile +# +# Authors: Andrew Jones <[email protected]> +# + +ifeq ($(CONFIG_EFI),y) +exe = efi +else +exe = flat +endif + +tests = +tests += $(TEST_DIR)/selftest.$(exe) +#tests += $(TEST_DIR)/sieve.$(exe) + +all: $(tests) + +$(TEST_DIR)/sieve.elf: AUXFLAGS = 0x1 + +cstart.o = $(TEST_DIR)/cstart.o + +cflatobjs += lib/riscv/io.o +cflatobjs += lib/riscv/setup.o + +######################################## + +OBJDIRS += lib/riscv +FLATLIBS = $(libcflat) $(LIBFDT_archive) + +AUXFLAGS ?= 0x0 + +# stack.o relies on frame pointers. +KEEP_FRAME_POINTER := y + +# We want to keep intermediate files +.PRECIOUS: %.elf %.o + +define arch_elf_check = + $(if $(shell ! $(READELF) -rW $(1) >&/dev/null && echo "nok"), + $(error $(shell $(READELF) -rW $(1) 2>&1))) + $(if $(shell $(READELF) -rW $(1) | grep R_ | grep -v R_RISCV_RELATIVE), + $(error $(1) has unsupported reloc types)) +endef + +ifeq ($(ARCH),riscv64) +CFLAGS += -DCONFIG_64BIT +endif +CFLAGS += -DCONFIG_RELOC +CFLAGS += -mcmodel=medany +CFLAGS += -mstrict-align +CFLAGS += -std=gnu99 +CFLAGS += -ffreestanding +CFLAGS += -O2 +CFLAGS += -I $(SRCDIR)/lib -I $(SRCDIR)/lib/libfdt + +asm-offsets = lib/riscv/asm-offsets.h +include $(SRCDIR)/scripts/asm-offsets.mak + +ifeq ($(CONFIG_EFI),y) + # TODO +else +%.elf: LDFLAGS += -pie -n -z notext +%.elf: %.o $(FLATLIBS) $(SRCDIR)/riscv/flat.lds $(cstart.o) + $(CC) $(CFLAGS) -c -o $(@:.elf=.aux.o) $(SRCDIR)/lib/auxinfo.c \ + -DPROGNAME=\"$(notdir $(@:.elf=.flat))\" -DAUXFLAGS=$(AUXFLAGS) + $(LD) $(LDFLAGS) -o $@ -T $(SRCDIR)/riscv/flat.lds \ + $(filter %.o, $^) $(FLATLIBS) $(@:.elf=.aux.o) + $(RM) $(@:.elf=.aux.o) + @chmod a-x $@ + +%.flat: %.elf + $(call arch_elf_check, $^) + $(OBJCOPY) -O binary $^ $@ + @chmod a-x $@ +endif + +generated-files = $(asm-offsets) +$(tests:.$(exe)=.o) $(cstart.o) $(cflatobjs): $(generated-files) + +arch_clean: asm_offsets_clean + $(RM) $(TEST_DIR)/*.{o,flat,elf,so,efi,debug} \ + $(TEST_DIR)/.*.d $(TEST_DIR)/efi/.*.d lib/riscv/.*.driscv/cstart.S new file +0
-0
riscv/cstart.S line 9
Quoted 9 lines
riscv/cstart.S new file +9
-0@@ -0,0 +1,92 @@ +/* SPDX-License-Identifier: GPL-2.0 */ +/* + * Boot entry point and assembler functions for riscv. + * + * Copyright (C) 2023, Ventana Micro Systems Inc., Andrew Jones <[email protected]> + */ +#include <asm/csr.h> + +.macro zero_range, tmp1, tmp2
For my education what were the tmp3/4 args used for on arm?
Quoted 173 lines
riscv/cstart.S new file +83
-0+9998: beq \tmp1, \tmp2, 9997f + sd zero, 0(\tmp1) + addi \tmp1, \tmp1, 8 + j 9998b +9997: +.endm + + .section .init + +/* + * The hartid of the current core is in a0 + * The address of the devicetree is in a1 + * + * See Linux kernel doc Documentation/riscv/boot.rst + */ +.global start +start: + /* + * Stash the hartid in scratch and shift the dtb + * address into a0 + */ + csrw CSR_SSCRATCH, a0 + mv a0, a1 + + /* + * Update all R_RISCV_RELATIVE relocations using the table + * of Elf64_Rela entries between reloc_start/end. The build + * will not emit other relocation types. + * + * struct Elf64_Rela { + * uint64_t r_offset; + * uint64_t r_info; + * int64_t r_addend; + * } + */ + la a1, reloc_start + la a2, reloc_end + la a3, start // base +1: + bge a1, a2, 1f + ld a4, 0(a1) // r_offset + ld a5, 16(a1) // r_addend + add a4, a3, a4 // addr = base + r_offset + add a5, a3, a5 // val = base + r_addend + sd a5, 0(a4) // *addr = val + addi a1, a1, 24 + j 1b + +1: + /* zero BSS */ + la a1, bss + la a2, ebss + zero_range a1, a2 + + /* zero and set up stack */ + la sp, stacktop + li a1, -8192 + add a1, sp, a1 + zero_range a1, sp + + /* set up exception handling */ + //TODO + + /* complete setup */ + la a1, stacktop // a1 is the base of free memory + call setup // a0 is the addr of the dtb + + /* run the test */ + la a0, __argc + ld a0, 0(a0) + la a1, __argv + la a2, __environ + call main + call exit + j halt + + .text + +.balign 4 +.global halt +halt: +1: wfi + j 1briscv/flat.lds new file +75
-0@@ -0,0 +1,75 @@ +/* + * init::start will pass stacktop to setup() as the base of free memory. + * setup() will then move the FDT and initrd to that base before calling + * mem_init(). With those movements and this linker script, we'll end up + * having the following memory layout: + * + * +----------------------+ <-- top of physical memory + * | | + * ~ ~ + * | | + * +----------------------+ <-- top of initrd + * | | + * +----------------------+ <-- top of FDT + * | | + * +----------------------+ <-- top of cpu0's stack + * | | + * +----------------------+ <-- top of text/data/bss sections + * | | + * | | + * +----------------------+ <-- load address + * | | + * +----------------------+ <-- physical address 0x0 + */ + +PHDRS +{ + text PT_LOAD FLAGS(5); + data PT_LOAD FLAGS(6); +} + +SECTIONS +{ + PROVIDE(_text = .); + .text : { *(.init) *(.text) *(.text.*) } :text + . = ALIGN(4K); + PROVIDE(_etext = .); + + PROVIDE(reloc_start = .); + .rela.dyn : { *(.rela.dyn) } + PROVIDE(reloc_end = .); + .dynsym : { *(.dynsym) } + .dynstr : { *(.dynstr) } + .hash : { *(.hash) } + .gnu.hash : { *(.gnu.hash) } + .got : { *(.got) *(.got.plt) } + .eh_frame : { *(.eh_frame) } + + .rodata : { *(.rodata*) } :data + .data : { *(.data) } :data + . = ALIGN(16); + PROVIDE(bss = .); + .bss : { *(.bss) } + . = ALIGN(16); + PROVIDE(ebss = .); + . = ALIGN(4K); + PROVIDE(edata = .); + + /* + * stack depth is 8K and sp must be 16 byte aligned + * sp must always be strictly less than the true stacktop + */ + . += 12K; + . = ALIGN(4K); + PROVIDE(stackptr = . - 16); + PROVIDE(stacktop = .); + + /DISCARD/ : { + *(.note*) + *(.interp) + *(.comment) + *(.dynamic) + } +} + +ENTRY(start)riscv/selftest.c new file +3
-0@@ -0,0 +1,13 @@ +// SPDX-License-Identifier: GPL-2.0-only +/* +* Test the framework itself. These tests confirm that setup works.
riscv/selftest.c line 13
Quoted 10 lines
riscv/selftest.c new file +10
-0+* +* Copyright (C) 2023, Ventana Micro Systems Inc., Andrew Jones <[email protected]> +*/ +#include <libcflat.h> + +int main (void ) +{ +puts ("Hello, world\n" ); +return 0 ; +}
Thanks
Eric
Re: Re: [kvm-unit-tests PATCH v2 02/24] riscv: Initial port, hello world
On Thu, Feb 01, 2024 at 09:29:36AM +0100, Eric Auger wrote:
...
Quoted 13 lines
riscv/cstart.S line 9
Quoted 12 lines
riscv/cstart.S new file +9
-0@@ -0,0 +1,92 @@ +/* SPDX-License-Identifier: GPL-2.0 */ +/* + * Boot entry point and assembler functions for riscv. + * + * Copyright (C) 2023, Ventana Micro Systems Inc., Andrew Jones <[email protected]> + */ +#include <asm/csr.h> + +.macro zero_range, tmp1, tmp2For my education what were the tmp3/4 args used for on arm?
Quoted 7 lines
riscv/cstart.S line 16
Quoted 7 lines
riscv/cstart.S new file +7
-0+9998: beq \tmp1, \tmp2, 9997f + sd zero, 0(\tmp1) + addi \tmp1, \tmp1, 8 + j 9998b +9997: +.endm +
arm doesn't have a zero register like arm64 and riscv32/64 have, so at least one extra tmp register is needed to hold the zero stored to the memory. We use two tmp registers because arm has a 'strd' instruction allowing us to write two at once, as long as the first register is an even-numbered register and the second is the immediately following odd-numbered register. (We should probably write a comment about the purpose and even/odd constraints of tmp3/4 above the zero_range macro in arm/cstart.S)
Thanks,
drew
PATCH v2 3/24 arm/arm64: Move cpumask.h to common lib
In reply to Andrew JonesRISC-V will also make use of cpumask.h, so move it to the arch-common directory.
---
lib/arm/asm/gic-v2.h | 2 +-
lib/arm/asm/gic-v3.h | 2 +-
lib/arm/asm/gic.h | 2 +-
lib/arm/asm/smp.h | 2 +-
lib/arm/mmu.c | 2 +-
lib/arm/smp.c | 2 +-
lib/arm64/asm/cpumask.h | 1 -
lib/{arm/asm => }/cpumask.h | 9 ++++-----
8 files changed, 10 insertions(+), 12 deletions(-)
delete mode 100644 lib/arm64/asm/cpumask.h
rename lib/{arm/asm => }/cpumask.h (94%)lib/arm/asm/gic-v2.h +1 -1
@@ -18,7 +18,7 @@#define GICC_IAR_INT_ID_MASK 0x3ff #ifndef __ASSEMBLY__ -#include <asm/cpumask.h> +#include <cpumask.h> struct gicv2_data { void *dist_base;
lib/arm/asm/gic-v3.h +1 -1
@@ -67,10 +67,10 @@#include <asm/arch_gicv3.h> #ifndef __ASSEMBLY__ +#include <cpumask.h> #include <asm/setup.h> #include <asm/processor.h> #include <asm/delay.h> -#include <asm/cpumask.h> #include <asm/smp.h> #include <asm/io.h>
lib/arm/asm/gic.h +1 -1
@@ -47,7 +47,7 @@#define SPI (irq) ((irq) + GIC_FIRST_SPI)#ifndef __ASSEMBLY__ -#include <asm/cpumask.h> +#include <cpumask.h> enum gic_irq_state { GIC_IRQ_STATE_INACTIVE,
lib/arm/asm/smp.h +1 -1
@@ -5,8 +5,8 @@* * This work is licensed under the terms of the GNU LGPL, version 2. */ +#include <cpumask.h> #include <asm/thread_info.h> -#include <asm/cpumask.h> #define smp_processor_id () (current_thread_info()->cpu)
lib/arm/mmu.c +1 -1
@@ -5,9 +5,9 @@* * This work is licensed under the terms of the GNU LGPL, version 2. */ +#include <cpumask.h> #include <asm/setup.h> #include <asm/thread_info.h> -#include <asm/cpumask.h> #include <asm/mmu.h> #include <asm/setup.h> #include <asm/page.h>
lib/arm/smp.c +1 -1
@@ -7,9 +7,9 @@*/ #include <libcflat.h> #include <auxinfo.h> +#include <cpumask.h> #include <asm/thread_info.h> #include <asm/spinlock.h> -#include <asm/cpumask.h> #include <asm/barrier.h> #include <asm/mmu.h> #include <asm/psci.h>
lib/arm64/asm/cpumask.h deleted +0 -1
@@ -1 +0,0 @@ -#include "../../arm/asm/cpumask.h"
lib/cpumask.h renamed from lib/arm/asm/cpumask.h +4 -5
@@ -1,12 +1,11 @@ -#ifndef _ASMARM_CPUMASK_H_ -#define _ASMARM_CPUMASK_H_ +/* SPDX-License-Identifier: GPL-2.0-only */ /* * Simple cpumask implementation * * Copyright (C) 2015, Red Hat Inc, Andrew Jones <[email protected]> -* -* This work is licensed under the terms of the GNU LGPL, version 2. */ +#ifndef _CPUMASK_H_ +#define _CPUMASK_H_#include <asm/setup.h> #include <bitops.h>
@@ -120,4 +119,4 @@ static inline int cpumask_next(int cpu, const cpumask_t *mask) (cpu) < nr_cpus; \ (cpu) = cpumask_next(cpu, mask)) -#endif /* _ASMARM_CPUMASK_H_ */ +#endif /* _CPUMASK_H_ */
Signature · 1 line
2.43.0
Re: [kvm-unit-tests PATCH v2 03/24] arm/arm64: Move cpumask.h to common lib
Quoted 6 lines · Andrew Jones
RISC-V will also make use of
cpumask.h, so move it to the arch-common directory.Signed-off-by Andrew Jones <[email protected]>Reviewed-by Thomas Huth <[email protected]>Acked-by Thomas Huth <[email protected]>
Eric
Quoted 135 lines
--- lib/arm/asm/gic-v2.h | 2 +- lib/arm/asm/gic-v3.h | 2 +- lib/arm/asm/gic.h | 2 +- lib/arm/asm/smp.h | 2 +- lib/arm/mmu.c | 2 +- lib/arm/smp.c | 2 +- lib/arm64/asm/cpumask.h | 1 - lib/{arm/asm => }/cpumask.h | 9 ++++----- 8 files changed, 10 insertions(+), 12 deletions(-) delete mode 100644 lib/arm64/asm/cpumask.h rename lib/{arm/asm => }/cpumask.h (94%)lib/arm/asm/gic-v2.h +1
-1@@ -18,7 +18,7 @@#define GICC_IAR_INT_ID_MASK 0x3ff #ifndef __ASSEMBLY__ -#include <asm/cpumask.h> +#include <cpumask.h> struct gicv2_data { void *dist_base;lib/arm/asm/gic-v3.h +1
-1@@ -67,10 +67,10 @@#include <asm/arch_gicv3.h> #ifndef __ASSEMBLY__ +#include <cpumask.h> #include <asm/setup.h> #include <asm/processor.h> #include <asm/delay.h> -#include <asm/cpumask.h> #include <asm/smp.h> #include <asm/io.h> lib/arm/asm/gic.h +1
-1@@ -47,7 +47,7 @@#define SPI (irq) ((irq) + GIC_FIRST_SPI)#ifndef __ASSEMBLY__ -#include <asm/cpumask.h> +#include <cpumask.h> enum gic_irq_state { GIC_IRQ_STATE_INACTIVE,lib/arm/asm/smp.h +1
-1@@ -5,8 +5,8 @@* * This work is licensed under the terms of the GNU LGPL, version 2. */ +#include <cpumask.h> #include <asm/thread_info.h> -#include <asm/cpumask.h> #define smp_processor_id () (current_thread_info()->cpu)lib/arm/mmu.c +1
-1@@ -5,9 +5,9 @@* * This work is licensed under the terms of the GNU LGPL, version 2. */ +#include <cpumask.h> #include <asm/setup.h> #include <asm/thread_info.h> -#include <asm/cpumask.h> #include <asm/mmu.h> #include <asm/setup.h> #include <asm/page.h> lib/arm/smp.c +1
-1@@ -7,9 +7,9 @@*/ #include <libcflat.h> #include <auxinfo.h> +#include <cpumask.h> #include <asm/thread_info.h> #include <asm/spinlock.h> -#include <asm/cpumask.h> #include <asm/barrier.h> #include <asm/mmu.h> #include <asm/psci.h> lib/arm64/asm/cpumask.h deleted +0
-1@@ -1 +0,0 @@ -#include "../../arm/asm/cpumask.h" lib/cpumask.h renamed from lib/arm/asm/cpumask.h +4
-5@@ -1,12 +1,11 @@ -#ifndef _ASMARM_CPUMASK_H_ -#define _ASMARM_CPUMASK_H_ +/* SPDX-License-Identifier: GPL-2.0-only */ /* * Simple cpumask implementation * * Copyright (C) 2015, Red Hat Inc, Andrew Jones <[email protected]> -* -* This work is licensed under the terms of the GNU LGPL, version 2. */ +#ifndef _CPUMASK_H_ +#define _CPUMASK_H_#include <asm/setup.h> #include <bitops.h> @@ -120,4 +119,4 @@ static inline int cpumask_next(int cpu, const cpumask_t *mask) (cpu) < nr_cpus; \ (cpu) = cpumask_next(cpu, mask)) -#endif /* _ASMARM_CPUMASK_H_ */ +#endif /* _CPUMASK_H_ */
PATCH v2 4/24 arm/arm64: Share cpu online, present and idle masks
In reply to Andrew JonesRISC-V will also use Arm's three cpumasks. These were in smp.h, but they can be in cpumask.h instead, so move them there, which is now shared.
--- lib/arm/asm/smp.h | 33 --------------------------------- lib/cpumask.h | 33 +++++++++++++++++++++++++++++++++ 2 files changed, 33 insertions(+), 33 deletions(-)
lib/arm/asm/smp.h +0 -33
@@ -23,39 +23,6 @@ extern bool cpu0_calls_idle;extern void halt (void );extern void do_idle (void ); -extern cpumask_t cpu_present_mask; -extern cpumask_t cpu_online_mask; -extern cpumask_t cpu_idle_mask; -#define cpu_present (cpu) cpumask_test_cpu(cpu, &cpu_present_mask) -#define cpu_online (cpu) cpumask_test_cpu(cpu, &cpu_online_mask) -#define cpu_idle (cpu) cpumask_test_cpu(cpu, &cpu_idle_mask) -#define for_each_present_cpu (cpu) for_each_cpu(cpu, &cpu_present_mask) -#define for_each_online_cpu (cpu) for_each_cpu(cpu, &cpu_online_mask) - -static inline void set_cpu_present (int cpu,bool present) -{ -if (present) -cpumask_set_cpu (cpu, &cpu_present_mask); -else -cpumask_clear_cpu (cpu, &cpu_present_mask); -} - -static inline void set_cpu_online (int cpu,bool online) -{ -if (online) -cpumask_set_cpu (cpu, &cpu_online_mask); -else -cpumask_clear_cpu (cpu, &cpu_online_mask); -} - -static inline void set_cpu_idle (int cpu,bool idle) -{ -if (idle) -cpumask_set_cpu (cpu, &cpu_idle_mask); -else -cpumask_clear_cpu (cpu, &cpu_idle_mask); -} -extern void smp_boot_secondary (int cpu,secondary_entry_fn entry);extern void on_cpu_async (int cpu,void (*func)(void *data),void *data);extern void on_cpu (int cpu,void (*func)(void *data),void *data);
lib/cpumask.h +33 -0
@@ -119,4 +119,37 @@ static inline int cpumask_next(int cpu, const cpumask_t *mask) (cpu) < nr_cpus; \ (cpu) = cpumask_next(cpu, mask)) +extern cpumask_t cpu_present_mask; +extern cpumask_t cpu_online_mask; +extern cpumask_t cpu_idle_mask; +#define cpu_present (cpu) cpumask_test_cpu(cpu, &cpu_present_mask) +#define cpu_online (cpu) cpumask_test_cpu(cpu, &cpu_online_mask) +#define cpu_idle (cpu) cpumask_test_cpu(cpu, &cpu_idle_mask) +#define for_each_present_cpu (cpu) for_each_cpu(cpu, &cpu_present_mask) +#define for_each_online_cpu (cpu) for_each_cpu(cpu, &cpu_online_mask) + +static inline void set_cpu_present (int cpu,bool present) +{ +if (present) +cpumask_set_cpu (cpu, &cpu_present_mask); +else +cpumask_clear_cpu (cpu, &cpu_present_mask); +} + +static inline void set_cpu_online (int cpu,bool online) +{ +if (online) +cpumask_set_cpu (cpu, &cpu_online_mask); +else +cpumask_clear_cpu (cpu, &cpu_online_mask); +} + +static inline void set_cpu_idle (int cpu,bool idle) +{ +if (idle) +cpumask_set_cpu (cpu, &cpu_idle_mask); +else +cpumask_clear_cpu (cpu, &cpu_idle_mask); +} +#endif /* _CPUMASK_H_ */
Signature · 1 line
2.43.0
Re: [kvm-unit-tests PATCH v2 04/24] arm/arm64: Share cpu online, present and idle masks
Hi Drew,
Quoted 7 lines · Andrew Jones
RISC-V will also use Arm's three cpumasks. These were in
smp.h, but they can be incpumask.hinstead, so move them there, which is now shared.Signed-off-by Andrew Jones <[email protected]>Reviewed-by Thomas Huth <[email protected]>Acked-by Thomas Huth <[email protected]>
Eric
Quoted 91 lines
--- lib/arm/asm/smp.h | 33 --------------------------------- lib/cpumask.h | 33 +++++++++++++++++++++++++++++++++ 2 files changed, 33 insertions(+), 33 deletions(-)lib/arm/asm/smp.h +0
-33@@ -23,39 +23,6 @@ extern bool cpu0_calls_idle;extern void halt (void );extern void do_idle (void ); -extern cpumask_t cpu_present_mask; -extern cpumask_t cpu_online_mask; -extern cpumask_t cpu_idle_mask; -#define cpu_present (cpu) cpumask_test_cpu(cpu, &cpu_present_mask) -#define cpu_online (cpu) cpumask_test_cpu(cpu, &cpu_online_mask) -#define cpu_idle (cpu) cpumask_test_cpu(cpu, &cpu_idle_mask) -#define for_each_present_cpu (cpu) for_each_cpu(cpu, &cpu_present_mask) -#define for_each_online_cpu (cpu) for_each_cpu(cpu, &cpu_online_mask) - -static inline void set_cpu_present (int cpu,bool present) -{ -if (present) -cpumask_set_cpu (cpu, &cpu_present_mask); -else -cpumask_clear_cpu (cpu, &cpu_present_mask); -} - -static inline void set_cpu_online (int cpu,bool online) -{ -if (online) -cpumask_set_cpu (cpu, &cpu_online_mask); -else -cpumask_clear_cpu (cpu, &cpu_online_mask); -} - -static inline void set_cpu_idle (int cpu,bool idle) -{ -if (idle) -cpumask_set_cpu (cpu, &cpu_idle_mask); -else -cpumask_clear_cpu (cpu, &cpu_idle_mask); -} -extern void smp_boot_secondary (int cpu,secondary_entry_fn entry);extern void on_cpu_async (int cpu,void (*func)(void *data),void *data);extern void on_cpu (int cpu,void (*func)(void *data),void *data);lib/cpumask.h +33
-0@@ -119,4 +119,37 @@ static inline int cpumask_next(int cpu, const cpumask_t *mask) (cpu) < nr_cpus; \ (cpu) = cpumask_next(cpu, mask)) +extern cpumask_t cpu_present_mask; +extern cpumask_t cpu_online_mask; +extern cpumask_t cpu_idle_mask; +#define cpu_present (cpu) cpumask_test_cpu(cpu, &cpu_present_mask) +#define cpu_online (cpu) cpumask_test_cpu(cpu, &cpu_online_mask) +#define cpu_idle (cpu) cpumask_test_cpu(cpu, &cpu_idle_mask) +#define for_each_present_cpu (cpu) for_each_cpu(cpu, &cpu_present_mask) +#define for_each_online_cpu (cpu) for_each_cpu(cpu, &cpu_online_mask) + +static inline void set_cpu_present (int cpu,bool present) +{ +if (present) +cpumask_set_cpu (cpu, &cpu_present_mask); +else +cpumask_clear_cpu (cpu, &cpu_present_mask); +} + +static inline void set_cpu_online (int cpu,bool online) +{ +if (online) +cpumask_set_cpu (cpu, &cpu_online_mask); +else +cpumask_clear_cpu (cpu, &cpu_online_mask); +} + +static inline void set_cpu_idle (int cpu,bool idle) +{ +if (idle) +cpumask_set_cpu (cpu, &cpu_idle_mask); +else +cpumask_clear_cpu (cpu, &cpu_idle_mask); +} +#endif /* _CPUMASK_H_ */
PATCH v2 5/24 riscv: Add DT parsing
In reply to Andrew JonesStart building setup() by copying code from Arm and adding dependencies along the way like bitops and a few more barriers. We now parse the DT for the UART base address to be sure we find what we expect with the early base. We also parse the CPU nodes to get the hartids, even though we don't yet support booting secondaries. Finally, add parsing of bootargs to get the command line and parsing of the environ to set the environment variables, and then extend the selftest to ensure it all works.
We don't do proper memory setup yet, only just enough to allocate memory for the environment variables and any another small mallocs that may be necessary.
Note, we've added a banner, which Arm doesn't have, because we need to separate the test output from OpenSBI output.
Run with
qemu-system-riscv64 -nographic -M virt \
-kernel riscv/selftest.flat \
-append 'foo bar baz' \
-initrd test-env \
-smp 16where test-env is a text file with the environment, i.e.
$ cat test-env FOO=foo BAR=bar BAZ=baz
--- lib/linux/const.h | 2 + lib/riscv/asm/barrier.h | 5 ++ lib/riscv/asm/bitops.h | 21 ++++++++ lib/riscv/asm/csr.h | 64 +++++++++++++++++++++++ lib/riscv/asm/setup.h | 7 +++ lib/riscv/bitops.c | 47 +++++++++++++++++ lib/riscv/io.c | 51 +++++++++++++++++++ lib/riscv/setup.c | 109 ++++++++++++++++++++++++++++++++++++++++ lib/riscv/smp.c | 6 +++ riscv/Makefile | 5 ++ riscv/selftest.c | 44 ++++++++++++++-- 11 files changed, 358 insertions(+), 3 deletions(-) create mode 100644 lib/riscv/asm/bitops.h create mode 100644 lib/riscv/bitops.c create mode 100644 lib/riscv/smp.c
lib/linux/const.h +2 -0
@@ -15,10 +15,12 @@#if defined(__ASSEMBLY__) || defined(__ASSEMBLER__)#define _AC (X ,Y ) X#define _AT (T ,X ) X +#define __ASM_STR (X ) X#else #define __AC (X ,Y ) (X##Y)#define _AC (X ,Y ) __AC(X,Y)#define _AT (T ,X ) ((T)(X)) +#define __ASM_STR (X ) #X#endif #define _BITUL (x) (_AC(1,UL) << (x))
lib/riscv/asm/barrier.h +5 -0
@@ -10,4 +10,9 @@#define rmb () RISCV_FENCE(ir,ir)#define wmb () RISCV_FENCE(ow,ow) +/* These barriers do not need to enforce ordering on devices, just memory. */ +#define smp_mb () RISCV_FENCE(rw,rw) +#define smp_rmb () RISCV_FENCE(r,r) +#define smp_wmb () RISCV_FENCE(w,w) +#endif /* _ASMRISCV_BARRIER_H_ */
lib/riscv/asm/bitops.h new file +21 -0
@@ -0,0 +1,21 @@ +/* SPDX-License-Identifier: GPL-2.0-only */ +#ifndef _ASMRISCV_BITOPS_H_ +#define _ASMRISCV_BITOPS_H_ + +#ifndef _BITOPS_H_ +#error only <bitops.h> can be included directly +#endif + +#ifdef CONFIG_64BIT +#define BITS_PER_LONG 64 +#else +#define BITS_PER_LONG 32 +#endif + +void set_bit (int nr,volatile unsigned long *addr); +void clear_bit (int nr,volatile unsigned long *addr); +int test_bit (int nr,const volatile unsigned long *addr); +int test_and_set_bit (int nr,volatile unsigned long *addr); +int test_and_clear_bit (int nr,volatile unsigned long *addr); + +#endif /* _ASMRISCV_BITOPS_H_ */
lib/riscv/asm/csr.h +64 -0
71 lines not on this page · raw message
lib/riscv/asm/setup.h +7 -0
@@ -1,7 +1,14 @@/* SPDX-License-Identifier: GPL-2.0-only */ #ifndef _ASMRISCV_SETUP_H_#define _ASMRISCV_SETUP_H_ +#include <libcflat.h> +#define NR_CPUS 16 +extern unsigned long cpus[NR_CPUS ];/* per-cpu IDs (hartids) */ +extern int nr_cpus; +int hartid_to_cpu (unsigned long hartid); + +void io_init (void );void setup (const void *fdt,phys_addr_t freemem_start);#endif /* _ASMRISCV_SETUP_H_ */
lib/riscv/bitops.c new file +47 -0
47 lines not on this page · raw message
lib/riscv/io.c +51 -0
64 lines not on this page · raw message
lib/riscv/setup.c +109 -0
117 lines not on this page · raw message
lib/riscv/smp.c new file +6 -0
@@ -0,0 +1,6 @@ +// SPDX-License-Identifier: GPL-2.0-only +#include <cpumask.h> + +cpumask_t cpu_present_mask; +cpumask_t cpu_online_mask; +cpumask_t cpu_idle_mask;
riscv/Makefile +5 -0
@@ -20,8 +20,13 @@ $(TEST_DIR)/sieve.elf: AUXFLAGS = 0x1 cstart.o = $(TEST_DIR)/cstart.o +cflatobjs += lib/alloc.o +cflatobjs += lib/alloc_phys.o +cflatobjs += lib/devicetree.o +cflatobjs += lib/riscv/bitops.o cflatobjs += lib/riscv/io.o cflatobjs += lib/riscv/setup.o +cflatobjs += lib/riscv/smp.o ########################################
riscv/selftest.c +41 -3
50 lines not on this page · raw message
Signature · 1 line
2.43.0
PATCH v2 6/24 riscv: Add initial SBI support
In reply to Andrew JonesAdd an SBI call function and immediately apply it to properly exiting the test (instead of hanging) by invoking SBI shutdown from exit(). Also seed an SBI test file with a simple SBI test that checks mvendorid is correctly extracted.
Run with e.g.
qemu-system-riscv64 -nographic -M virt \
-kernel riscv/sbi.flat \
-cpu rv64,mvendorid=45 \
-initrd sbi-envand be happy that ctrl-a c q is no longer necessary to return to the shell prompt. sbi-env has MVENDORID=45 in it.
--- lib/riscv/asm/sbi.h | 32 ++++++++++++++++++++++++++++++++ lib/riscv/io.c | 2 ++ lib/riscv/sbi.c | 35 +++++++++++++++++++++++++++++++++++ riscv/Makefile | 2 ++ riscv/sbi.c | 41 +++++++++++++++++++++++++++++++++++++++++ 5 files changed, 112 insertions(+) create mode 100644 lib/riscv/asm/sbi.h create mode 100644 lib/riscv/sbi.c create mode 100644 riscv/sbi.c
lib/riscv/asm/sbi.h new file +32 -0
@@ -0,0 +1,32 @@ +/* SPDX-License-Identifier: GPL-2.0-only */ +#ifndef _ASMRISCV_SBI_H_ +#define _ASMRISCV_SBI_H_ + +enum sbi_ext_id { +SBI_EXT_BASE =0x10 , +SBI_EXT_SRST =0x53525354 , +}; + +enum sbi_ext_base_fid { +SBI_EXT_BASE_GET_SPEC_VERSION =0 , +SBI_EXT_BASE_GET_IMP_ID , +SBI_EXT_BASE_GET_IMP_VERSION , +SBI_EXT_BASE_PROBE_EXT , +SBI_EXT_BASE_GET_MVENDORID , +SBI_EXT_BASE_GET_MARCHID , +SBI_EXT_BASE_GET_MIMPID , +}; + +struct sbiret { +long error; +long value; +}; + +struct sbiret sbi_ecall (int ext,int fid,unsigned long arg0, +unsigned long arg1,unsigned long arg2, +unsigned long arg3,unsigned long arg4, +unsigned long arg5); + +void sbi_shutdown (void ); + +#endif /* _ASMRISCV_SBI_H_ */
lib/riscv/io.c +2 -0
@@ -9,6 +9,7 @@#include <config.h> #include <devicetree.h> #include <asm/io.h> +#include <asm/sbi.h> #include <asm/setup.h> #include <asm/spinlock.h>
@@ -90,6 +91,7 @@ void halt(int code);void exit (int code) {printf ("\nEXIT: STATUS=%d\n" , ((code) <<1 ) |1 ); +sbi_shutdown ();halt (code);__builtin_unreachable (); }
lib/riscv/sbi.c new file +35 -0
@@ -0,0 +1,35 @@ +// SPDX-License-Identifier: GPL-2.0-only +#include <libcflat.h> +#include <asm/sbi.h> + +struct sbiret sbi_ecall (int ext,int fid,unsigned long arg0, +unsigned long arg1,unsigned long arg2, +unsigned long arg3,unsigned long arg4, +unsigned long arg5) +{ + register uintptr_t a0 asm ("a0") = (uintptr_t)(arg0); + register uintptr_t a1 asm ("a1") = (uintptr_t)(arg1); + register uintptr_t a2 asm ("a2") = (uintptr_t)(arg2); + register uintptr_t a3 asm ("a3") = (uintptr_t)(arg3); + register uintptr_t a4 asm ("a4") = (uintptr_t)(arg4); + register uintptr_t a5 asm ("a5") = (uintptr_t)(arg5); + register uintptr_t a6 asm ("a6") = (uintptr_t)(fid); + register uintptr_t a7 asm ("a7") = (uintptr_t)(ext); +struct sbiret ret; + + asmvolatile ( +"ecall" + :"+r" (a0),"+r" (a1) + :"r" (a2),"r" (a3),"r" (a4),"r" (a5),"r" (a6),"r" (a7) + :"memory" ); + ret.error = a0; + ret.value = a1; + +return ret; +} + +void sbi_shutdown (void ) +{ +sbi_ecall (SBI_EXT_SRST ,0 ,0 ,0 ,0 ,0 ,0 ,0 ); +puts ("SBI shutdown failed!\n" ); +}
riscv/Makefile +2 -0
@@ -11,6 +11,7 @@ exe = flat endif tests = +tests += $(TEST_DIR)/sbi.$(exe) tests += $(TEST_DIR)/selftest.$(exe) #tests += $(TEST_DIR)/sieve.$(exe)
@@ -25,6 +26,7 @@ cflatobjs += lib/alloc_phys.o cflatobjs += lib/devicetree.o cflatobjs += lib/riscv/bitops.o cflatobjs += lib/riscv/io.o +cflatobjs += lib/riscv/sbi.o cflatobjs += lib/riscv/setup.o cflatobjs += lib/riscv/smp.o
riscv/sbi.c new file +41 -0
41 lines not on this page · raw message
Signature · 1 line
2.43.0
PATCH v2 7/24 riscv: Add run script and unittests.cfg
In reply to Andrew JonesWith a run script and a unittests.cfg file we can now run
$ KVM_UNIT_TESTS_ENV=test-env ./run_tests.sh
where test-env has the environment variables needed for both tests.
Note, to change the SBI implementation under test, for example to RustSBI, QEMU needs the -bios parameter. The full command line would be
qemu-system-riscv64 -nographic -M virt -cpu rv64 \
-kernel riscv/sbi.flat \
-bios $PATH_TO_RUSTSBIand with the run script, it's
SBI_IMPL="-bios $PATH_TO_RUSTSBI" ./run_tests.sh -g sbi
(note the '-g sbi' to only run the SBI test group)
Finally, with the addition of the run script, 'make standalone' now also works.
--- riscv/run | 41 +++++++++++++++++++++++++++++++++++++++++ riscv/unittests.cfg | 37 +++++++++++++++++++++++++++++++++++++ 2 files changed, 78 insertions(+) create mode 100755 riscv/run create mode 100644 riscv/unittests.cfg
riscv/run new file +41 -0
@@ -0,0 +1,41 @@ +#!/usr/bin/env bash + +if [ -z "$KUT_STANDALONE" ]; then + if [ ! -f config.mak ]; then + echo "run ./configure && make first. See ./configure -h" + exit 2 + fi + source config.mak + source scripts/arch-run.bash +fi + +# Allow user overrides of some config.mak variables +processor=$PROCESSOR_OVERRIDE +firmware=$FIRMWARE_OVERRIDE + +[ "$PROCESSOR" = "$ARCH" ] && PROCESSOR="max" +: "${processor:=$PROCESSOR}" +: "${firmware:=$FIRMWARE}" +[ "$firmware" ] && firmware="-bios $firmware" + +set_qemu_accelerator || exit $? +[ "$ACCEL" = "kvm" ] && QEMU_ARCH=$HOST +acc="-accel $ACCEL$ACCEL_PROPS" + +qemu=$(search_qemu_binary) || exit $? +if ! $qemu -machine '?' | grep -q 'RISC-V VirtIO board'; then + echo "$qemu doesn't support mach-virt ('-machine virt'). Exiting." + exit 2 +fi +mach='-machine virt' + +command="$qemu -nodefaults -nographic -serial mon:stdio" +command+=" $mach $acc $firmware -cpu $processor " +command="$(migration_cmd) $(timeout_cmd) $command" + +if [ "$EFI_RUN" = "y" ]; then + ENVIRON_DEFAULT=n run_qemu_status $command "$@" +else + # We return the exit code via stdout, not via the QEMU return code + run_qemu_status $command -kernel "$@" +fi
riscv/unittests.cfg new file +37 -0
@@ -0,0 +1,37 @@ +############################################################################## +# unittest configuration +# +# [unittest_name] +# file = <name>.flat # Name of the flat file to be used. +# smp = <num> # Number of processors the VM will use +# # during this test. Use $MAX_SMP to use +# # the maximum the host supports. Defaults +# # to one. +# extra_params = -append <params...> # Additional parameters used. +# arch = riscv32|riscv64 # Select one if the test case is +# # specific to only one. +# groups = <group_name1> <group_name2> ... # Used to identify test cases +# # with run_tests -g ... +# # Specify group_name=nodefault +# # to have test not run by +# # default +# accel = kvm|tcg # Optionally specify if test must run with +# # kvm or tcg. If not specified, then kvm will +# # be used when available. +# timeout = <duration> # Optionally specify a timeout. +# check = <path>=<value> # check a file for a particular value before running +# # a test. The check line can contain multiple files +# # to check separated by a space but each check +# # parameter needs to be of the form <path>=<value> +############################################################################## + +[selftest] +file = selftest.flat +smp = 16 +extra_params = -append 'foo bar baz' +groups = selftest + +# Set $FIRMWARE_OVERRIDE to /path/to/firmware to select the SBI implementation. +[sbi] +file = sbi.flat +groups = sbi
Signature · 1 line
2.43.0
PATCH v2 8/24 riscv: Add riscv32 support
In reply to Andrew JonesMake a few tweaks to allow also building and running riscv32.
--- lib/elf.h | 11 +++++++++++ lib/ldiv32.c | 16 ++++++++++++++++ lib/riscv/asm-offsets.c | 11 +++++++++++ riscv/Makefile | 3 +++ riscv/cstart.S | 35 +++++++++++++++++++++-------------- 5 files changed, 62 insertions(+), 14 deletions(-)
lib/elf.h +11 -0
@@ -8,6 +8,11 @@#include <libcflat.h> +/* 32-bit ELF base types. */ +typedef u32 Elf32_Addr ; +typedef u32 Elf32_Xword ; +typedef s32 Elf32_Sxword ; +/* 64-bit ELF base types. */ typedef u64 Elf64_Addr ;typedef u64 Elf64_Xword ;
@@ -26,6 +31,12 @@ typedef struct elf64_rel {Elf64_Xword r_info;/* index and type of relocation */ } Elf64_Rel; +typedef struct elf32_rela { +Elf32_Addr r_offset;/* Location at which to apply the action */ +Elf32_Xword r_info;/* index and type of relocation */ +Elf32_Sxword r_addend;/* Constant addend used to compute value */ +}Elf32_Rela ; + typedef struct elf64_rela { Elf64_Addr r_offset; /* Location at which to apply the action */ Elf64_Xword r_info; /* index and type of relocation */
lib/ldiv32.c +16 -0
@@ -1,5 +1,21 @@#include <stdint.h> +#if __riscv_xlen ==32 +int __clzdi2 (unsigned long ); + +int __clzdi2 (unsigned long a) +{ +int n =0 ; + +while (a) { + ++n; + a >>=1 ; + } + +return 32 - n; +} +#endif +extern uint64_t __udivmoddi4 (uint64_t num,uint64_t den,uint64_t *p_rem);extern int64_t __divmoddi4 (int64_t num,int64_t den,int64_t *p_rem);extern int64_t __moddi3 (int64_t num,int64_t den);
lib/riscv/asm-offsets.c +11 -0
@@ -1,6 +1,17 @@// SPDX-License-Identifier: GPL-2.0-only +#include <kbuild.h> +#include <elf.h> int main (void ) { +#if __riscv_xlen ==32 +OFFSET (ELF_RELA_OFFSET , elf32_rela, r_offset); +OFFSET (ELF_RELA_ADDEND , elf32_rela, r_addend); +DEFINE (ELF_RELA_SIZE ,sizeof (struct elf32_rela )); +#elif __riscv_xlen ==64 +OFFSET (ELF_RELA_OFFSET , elf64_rela, r_offset); +OFFSET (ELF_RELA_ADDEND , elf64_rela, r_addend); +DEFINE (ELF_RELA_SIZE ,sizeof (struct elf64_rela )); +#endif return 0 ; }
riscv/Makefile +3 -0
@@ -29,6 +29,9 @@ cflatobjs += lib/riscv/io.o cflatobjs += lib/riscv/sbi.o cflatobjs += lib/riscv/setup.o cflatobjs += lib/riscv/smp.o +ifeq ($(ARCH),riscv32) +cflatobjs += lib/ldiv32.o +endif ########################################
riscv/cstart.S +21 -14
@@ -4,11 +4,23 @@ * * Copyright (C) 2023, Ventana Micro Systems Inc., Andrew Jones <[email protected]> */ +#include <asm/asm-offsets.h> #include <asm/csr.h> +#if __riscv_xlen == 64 +#define __REG_SEL(a, b) a +#elif __riscv_xlen == 32 +#define __REG_SEL(a, b) b +#else +#error "Unexpected __riscv_xlen" +#endif + +#define REG_L __REG_SEL(ld, lw) +#define REG_S __REG_SEL(sd, sw) + .macro zero_range, tmp1, tmp2 9998: beq \tmp1, \tmp2, 9997f - sd zero, 0(\tmp1) + REG_S zero, 0(\tmp1) addi \tmp1, \tmp1, 8 j 9998b 9997:
@@ -33,26 +45,20 @@ start: /* * Update all R_RISCV_RELATIVE relocations using the table - * of Elf64_Rela entries between reloc_start/end. The build - * will not emit other relocation types. - * - * struct Elf64_Rela { - * uint64_t r_offset; - * uint64_t r_info; - * int64_t r_addend; - * } + * of Elf32_Rela/Elf64_Rela entries between reloc_start/end. + * The build will not emit other relocation types. */ la a1, reloc_start la a2, reloc_end la a3, start // base 1: bge a1, a2, 1f - ld a4, 0(a1) // r_offset - ld a5, 16(a1) // r_addend + REG_L a4, ELF_RELA_OFFSET(a1) // r_offset + REG_L a5, ELF_RELA_ADDEND(a1) // r_addend add a4, a3, a4 // addr = base + r_offset add a5, a3, a5 // val = base + r_addend - sd a5, 0(a4) // *addr = val - addi a1, a1, 24 + REG_S a5, 0(a4) // *addr = val + addi a1, a1, ELF_RELA_SIZE j 1b 1:
@@ -72,11 +78,12 @@ start: /* complete setup */ la a1, stacktop // a1 is the base of free memory + mv a2, zero // clear a2 for xlen=32 call setup // a0 is the addr of the dtb /* run the test */ la a0, __argc - ld a0, 0(a0) + REG_L a0, 0(a0) la a1, __argv la a2, __environ call main
Signature · 1 line
2.43.0
Re: [kvm-unit-tests PATCH v2 08/24] riscv: Add riscv32 support
On Fri, Jan 26, 2024 at 03:23:33PM +0100, Andrew Jones wrote:
...
Quoted 13 lines
lib/ldiv32.c +6
-0@@ -1,5 +1,21 @@#include <stdint.h> +#if __riscv_xlen ==32 +int __clzdi2 (unsigned long ); + +int __clzdi2 (unsigned long a) +{ +int n =0 ;
lib/ldiv32.c line 18
Quoted 10 lines
lib/ldiv32.c +10
-0+ +while (a) { + ++n; + a >>=1 ; + } + + return 32 - n; +} +#endif +
On riscv32, when attempting to do printf("%llx\n", x), where x is a 64-bit type, I found a bug with the above. It turns out that despite [1] stating that __clzdi2() takes an unsigned long, libgcc code which generates calls to it expect it to take an unsigned long long. I've fixed this for v3 by renaming the above function to __clzsi2() and adding
int __clzdi2(uint64_t num)
{
return num >> 32 ? __clzsi2(num >> 32) : __clzsi2(num) + 32;}
[1] https://gcc.gnu.org/onlinedocs/gccint/Integer-library-routines.html
Thanks,
drew
PATCH v2 9/24 riscv: Add exception handling
In reply to Andrew JonesSteal more code from Linux to implement exception handling, but with the same kvm-unit-tests API that Arm has. Also introduce struct thread_info like Arm has in order to hold the handler pointers. Finally, as usual, extend the selftest to make sure it all works.
--- lib/riscv/asm-offsets.c | 38 +++++++++++++ lib/riscv/asm/bug.h | 20 +++++++ lib/riscv/asm/csr.h | 28 +++++++++ lib/riscv/asm/processor.h | 28 +++++++++ lib/riscv/asm/ptrace.h | 46 +++++++++++++++ lib/riscv/asm/setup.h | 3 +- lib/riscv/processor.c | 60 +++++++++++++++++++ lib/riscv/setup.c | 9 ++- riscv/Makefile | 1 + riscv/cstart.S | 117 +++++++++++++++++++++++++++++++++++++- riscv/selftest.c | 20 ++++++- 11 files changed, 362 insertions(+), 8 deletions(-) create mode 100644 lib/riscv/asm/bug.h create mode 100644 lib/riscv/asm/processor.h create mode 100644 lib/riscv/asm/ptrace.h create mode 100644 lib/riscv/processor.c
lib/riscv/asm-offsets.c +38 -0
@@ -1,6 +1,7 @@// SPDX-License-Identifier: GPL-2.0-only #include <kbuild.h> #include <elf.h> +#include <asm/ptrace.h> int main (void ) {
@@ -13,5 +14,42 @@ int main(void)OFFSET (ELF_RELA_ADDEND , elf64_rela, r_addend);DEFINE (ELF_RELA_SIZE ,sizeof (struct elf64_rela ));#endif +OFFSET (PT_EPC , pt_regs, epc); +OFFSET (PT_RA , pt_regs, ra); +OFFSET (PT_SP , pt_regs, sp); +OFFSET (PT_GP , pt_regs, gp); +OFFSET (PT_TP , pt_regs, tp); +OFFSET (PT_T0 , pt_regs, t0); +OFFSET (PT_T1 , pt_regs, t1); +OFFSET (PT_T2 , pt_regs, t2); +OFFSET (PT_S0 , pt_regs, s0); +OFFSET (PT_S1 , pt_regs, s1); +OFFSET (PT_A0 , pt_regs, a0); +OFFSET (PT_A1 , pt_regs, a1); +OFFSET (PT_A2 , pt_regs, a2); +OFFSET (PT_A3 , pt_regs, a3); +OFFSET (PT_A4 , pt_regs, a4); +OFFSET (PT_A5 , pt_regs, a5); +OFFSET (PT_A6 , pt_regs, a6); +OFFSET (PT_A7 , pt_regs, a7); +OFFSET (PT_S2 , pt_regs, s2); +OFFSET (PT_S3 , pt_regs, s3); +OFFSET (PT_S4 , pt_regs, s4); +OFFSET (PT_S5 , pt_regs, s5); +OFFSET (PT_S6 , pt_regs, s6); +OFFSET (PT_S7 , pt_regs, s7); +OFFSET (PT_S8 , pt_regs, s8); +OFFSET (PT_S9 , pt_regs, s9); +OFFSET (PT_S10 , pt_regs, s10); +OFFSET (PT_S11 , pt_regs, s11); +OFFSET (PT_T3 , pt_regs, t3); +OFFSET (PT_T4 , pt_regs, t4); +OFFSET (PT_T5 , pt_regs, t5); +OFFSET (PT_T6 , pt_regs, t6); +OFFSET (PT_STATUS , pt_regs, status); +OFFSET (PT_BADADDR , pt_regs, badaddr); +OFFSET (PT_CAUSE , pt_regs, cause); +OFFSET (PT_ORIG_A0 , pt_regs, orig_a0); +DEFINE (PT_SIZE ,sizeof (struct pt_regs ));return 0 ; }
lib/riscv/asm/bug.h new file +20 -0
@@ -0,0 +1,20 @@ +/* SPDX-License-Identifier: GPL-2.0-only */ +#ifndef _ASMRISCV_BUG_H_ +#define _ASMRISCV_BUG_H_ + +#ifndef __ASSEMBLY__ + +static inline void bug (void ) +{ + asmvolatile ("ebreak" ); +} + +#else + +.macro bug + ebreak +.endm + +#endif + +#endif /* _ASMRISCV_BUG_H_ */
lib/riscv/asm/csr.h +28 -0
@@ -3,7 +3,35 @@#define _ASMRISCV_CSR_H_#include <linux/const.h> +#define CSR_SSTATUS 0x100 +#define CSR_STVEC 0x105#define CSR_SSCRATCH 0x140 +#define CSR_SEPC 0x141 +#define CSR_SCAUSE 0x142 +#define CSR_STVAL 0x143 + +/* Exception cause high bit - is an interrupt if set */ +#define CAUSE_IRQ_FLAG (_AC(1, UL) << (__riscv_xlen - 1)) + +/* Exception causes */ +#define EXC_INST_MISALIGNED 0 +#define EXC_INST_ACCESS 1 +#define EXC_INST_ILLEGAL 2 +#define EXC_BREAKPOINT 3 +#define EXC_LOAD_MISALIGNED 4 +#define EXC_LOAD_ACCESS 5 +#define EXC_STORE_MISALIGNED 6 +#define EXC_STORE_ACCESS 7 +#define EXC_SYSCALL 8 +#define EXC_HYPERVISOR_SYSCALL 9 +#define EXC_SUPERVISOR_SYSCALL 10 +#define EXC_INST_PAGE_FAULT 12 +#define EXC_LOAD_PAGE_FAULT 13 +#define EXC_STORE_PAGE_FAULT 15 +#define EXC_INST_GUEST_PAGE_FAULT 20 +#define EXC_LOAD_GUEST_PAGE_FAULT 21 +#define EXC_VIRTUAL_INST_FAULT 22 +#define EXC_STORE_GUEST_PAGE_FAULT 23#ifndef __ASSEMBLY__
lib/riscv/asm/processor.h new file +28 -0
@@ -0,0 +1,28 @@ +/* SPDX-License-Identifier: GPL-2.0-only */ +#ifndef _ASMRISCV_PROCESSOR_H_ +#define _ASMRISCV_PROCESSOR_H_ +#include <asm/csr.h> +#include <asm/ptrace.h> + +#define EXCEPTION_CAUSE_MAX 16 + +typedef void (*exception_fn )(struct pt_regs *); + +struct thread_info { +int cpu; +unsigned long hartid; +exception_fn exception_handlers[EXCEPTION_CAUSE_MAX ]; +}; + +static inline struct thread_info *current_thread_info (void ) +{ +return (struct thread_info *)csr_read (CSR_SSCRATCH ); +} + +void install_exception_handler (unsigned long cause,void (*handler)(struct pt_regs *)); +void do_handle_exception (struct pt_regs *regs); +void thread_info_init (void ); + +void show_regs (struct pt_regs *regs); + +#endif /* _ASMRISCV_PROCESSOR_H_ */
lib/riscv/asm/ptrace.h new file +46 -0
46 lines not on this page · raw message
lib/riscv/asm/setup.h +2 -1
@@ -2,9 +2,10 @@#ifndef _ASMRISCV_SETUP_H_#define _ASMRISCV_SETUP_H_#include <libcflat.h> +#include <asm/processor.h> #define NR_CPUS 16 -extern unsigned long cpus[NR_CPUS ];/* per-cpu IDs (hartids) */ +extern struct thread_info cpus[NR_CPUS ];extern int nr_cpus;int hartid_to_cpu (unsigned long hartid);
lib/riscv/processor.c new file +60 -0
60 lines not on this page · raw message
lib/riscv/setup.c +6 -3
@@ -12,12 +12,13 @@#include <devicetree.h> #include <asm/csr.h> #include <asm/page.h> +#include <asm/processor.h> #include <asm/setup.h> char *initrd;u32 initrd_size; -unsigned long cpus[NR_CPUS ] = { [0 ...NR_CPUS -1 ] = ~0UL }; +struct thread_info cpus[NR_CPUS ];int nr_cpus;int hartid_to_cpu (unsigned long hartid)
@@ -25,7 +26,7 @@ int hartid_to_cpu(unsigned long hartid)int cpu;for_each_present_cpu (cpu) -if (cpus[cpu] == hartid) +if (cpus[cpu].hartid == hartid)return cpu;return -1 ; }
@@ -36,7 +37,8 @@ static void cpu_set_fdt(int fdtnode __unused, u64 regval, void *info __unused)assert_msg (cpu <NR_CPUS ,"Number cpus exceeds maximum supported (%d)." ,NR_CPUS ); - cpus[cpu] = regval; + cpus[cpu].cpu = cpu; + cpus[cpu].hartid = regval;set_cpu_present (cpu, true); }
@@ -104,6 +106,7 @@ void setup(const void *fdt, phys_addr_t freemem_start)mem_init (PAGE_ALIGN ((unsigned long )freemem));cpu_init (); +thread_info_init ();io_init (); ret =dt_get_bootargs (&bootargs);
riscv/Makefile +1 -0
@@ -26,6 +26,7 @@ cflatobjs += lib/alloc_phys.o cflatobjs += lib/devicetree.o cflatobjs += lib/riscv/bitops.o cflatobjs += lib/riscv/io.o +cflatobjs += lib/riscv/processor.o cflatobjs += lib/riscv/sbi.o cflatobjs += lib/riscv/setup.o cflatobjs += lib/riscv/smp.o
riscv/cstart.S +114 -3
132 lines not on this page · raw message
riscv/selftest.c +19 -1
@@ -6,6 +6,7 @@*/ #include <libcflat.h> #include <cpumask.h> +#include <asm/processor.h> #include <asm/setup.h> static void check_cpus (void )
@@ -13,7 +14,23 @@ static void check_cpus(void)int cpu;for_each_present_cpu (cpu) -report_info ("CPU%3d: hartid=%08lx" , cpu, cpus[cpu]); +report_info ("CPU%3d: hartid=%08lx" , cpu, cpus[cpu].hartid); +} + +static bool exceptions_work; + +static void handler (struct pt_regs *regs) +{ + exceptions_work = true; + regs->epc +=2 ; +} + +static void check_exceptions (void ) +{ +install_exception_handler (EXC_INST_ILLEGAL , handler); + asmvolatile (".4byte 0" ); +install_exception_handler (EXC_INST_ILLEGAL ,NULL ); +report (exceptions_work,"exceptions" ); }int main (int argc,char **argv)
@@ -45,6 +62,7 @@ int main(int argc, char **argv)report_skip ("environ parsing" ); } +check_exceptions ();check_cpus ();return report_summary ();
Signature · 1 line
2.43.0
PATCH v2 10/24 riscv: Add backtrace support
In reply to Andrew JonesEnable stack unwinding, even when going through an exception, by implementing backtrace() and pushing a frame pointer on the stack in exception_vectors.
--- lib/riscv/asm/stack.h | 3 +++ lib/riscv/stack.c | 32 ++++++++++++++++++++++++++++++++ riscv/Makefile | 1 + riscv/cstart.S | 28 ++++++++++++++++++++++++++-- 4 files changed, 62 insertions(+), 2 deletions(-) create mode 100644 lib/riscv/stack.c
lib/riscv/asm/stack.h +3 -0
@@ -6,4 +6,7 @@#error Do not directly include <asm/stack.h>. Just use <stack.h>.#endif +#define HAVE_ARCH_BACKTRACE_FRAME +#define HAVE_ARCH_BACKTRACE +#endif
lib/riscv/stack.c new file +32 -0
@@ -0,0 +1,32 @@ +// SPDX-License-Identifier: GPL-2.0-only +#include <libcflat.h> +#include <stack.h> + +int backtrace_frame (const void *frame,const void **return_addrs,int max_depth) +{ +static bool walking; +const unsigned long *fp = (unsigned long *)frame; +int depth; + +if (walking) { +printf ("RECURSIVE STACK WALK!!!\n" ); +return 0 ; + } + walking = true; + +for (depth =0 ; fp && depth < max_depth; ++depth) { + return_addrs[depth] = (void *)fp[-1 ]; +if (return_addrs[depth] ==0 ) +break ; + fp = (unsigned long *)fp[-2 ]; + } + + walking = false; +return depth; +} + +int backtrace (const void **return_addrs,int max_depth) +{ +return backtrace_frame (__builtin_frame_address (0 ), + return_addrs, max_depth); +}
riscv/Makefile +1 -0
@@ -30,6 +30,7 @@ cflatobjs += lib/riscv/processor.o cflatobjs += lib/riscv/sbi.o cflatobjs += lib/riscv/setup.o cflatobjs += lib/riscv/smp.o +cflatobjs += lib/riscv/stack.o ifeq ($(ARCH),riscv32) cflatobjs += lib/ldiv32.o endif
riscv/cstart.S +26 -2
@@ -17,6 +17,22 @@ #define REG_L __REG_SEL(ld, lw) #define REG_S __REG_SEL(sd, sw) +#define SZREG __REG_SEL(8, 4) + +#define FP_SIZE 16 + +.macro push_fp, ra=ra + addi sp, sp, -FP_SIZE + REG_S \ra, (FP_SIZE - SZREG)(sp) + REG_S fp, (FP_SIZE - 2*SZREG)(sp) + addi fp, sp, FP_SIZE +.endm + +.macro pop_fp + REG_L ra, (FP_SIZE - SZREG)(sp) + REG_L fp, (FP_SIZE - 2*SZREG)(sp) + addi sp, sp, FP_SIZE +.endm .macro zero_range, tmp1, tmp2 9998: beq \tmp1, \tmp2, 9997f
@@ -73,6 +89,7 @@ start: li a1, -8192 add a1, sp, a1 zero_range a1, sp + mv fp, zero // Ensure fp starts out as zero /* set up exception handling */ la a1, exception_vectors
@@ -200,9 +217,16 @@ halt: .balign 4 .global exception_vectors exception_vectors: - REG_S a0, (-PT_SIZE + PT_ORIG_A0)(sp) - addi a0, sp, -PT_SIZE + REG_S a0, (-PT_SIZE - FP_SIZE + PT_ORIG_A0)(sp) + addi a0, sp, -PT_SIZE - FP_SIZE save_context + /* + * Set a frame pointer "ra" which points to the last instruction. + * Add 1 to it, because pretty_print_stacks.py subtracts 1. + */ + REG_L a1, PT_EPC(a0) + addi a1, a1, 1 + push_fp a1 mv sp, a0 call do_handle_exception mv a0, sp
Signature · 1 line
2.43.0
PATCH v2 11/24 arm/arm64: Generalize wfe/sev names in smp.c
In reply to Andrew JonesMost of Arm's on_cpus() implementation can be shared by any architecture which has the possible, present, and idle cpumasks, like riscv does. Rename the exceptions (wfe/sve) to something more generic in order to prepare to share the functions.
--- lib/arm/asm/smp.h | 4 ++++ lib/arm/smp.c | 16 ++++++++-------- 2 files changed, 12 insertions(+), 8 deletions(-)
lib/arm/asm/smp.h +4 -0
@@ -6,6 +6,7 @@* This work is licensed under the terms of the GNU LGPL, version 2. */ #include <cpumask.h> +#include <asm/barrier.h> #include <asm/thread_info.h> #define smp_processor_id () (current_thread_info()->cpu)
@@ -18,6 +19,9 @@ struct secondary_data { };extern struct secondary_data secondary_data; +#define smp_wait_for_event () wfe() +#define smp_send_event () sev() +extern bool cpu0_calls_idle;extern void halt (void );
lib/arm/smp.c +8 -8
@@ -45,7 +45,7 @@ secondary_entry_fn secondary_cinit(void)*/ entry = secondary_data.entry;set_cpu_online (ti->cpu, true); -sev (); +smp_send_event ();/* * Return to the assembly stub, allowing entry to be called
@@ -65,7 +65,7 @@ static void __smp_boot_secondary(int cpu, secondary_entry_fn entry)assert (ret ==0 );while (!cpu_online (cpu)) -wfe (); +smp_wait_for_event (); }void smp_boot_secondary (int cpu,secondary_entry_fn entry)
@@ -122,7 +122,7 @@ static void cpu_wait(int cpu)cpumask_set_cpu (me, &on_cpu_info[cpu].waiters);deadlock_check (me, cpu);while (!cpu_idle (cpu)) -wfe (); +smp_wait_for_event ();cpumask_clear_cpu (me, &on_cpu_info[cpu].waiters); }
@@ -134,17 +134,17 @@ void do_idle(void) cpu0_calls_idle = true;set_cpu_idle (cpu, true); -sev (); +smp_send_event ();for (;;) {while (cpu_idle (cpu)) -wfe (); +smp_wait_for_event ();smp_rmb (); on_cpu_info[cpu].func (on_cpu_info[cpu].data); on_cpu_info[cpu].func =NULL ;smp_wmb ();set_cpu_idle (cpu, true); -sev (); +smp_send_event (); } }
@@ -174,7 +174,7 @@ void on_cpu_async(int cpu, void (*func)(void *data), void *data) on_cpu_info[cpu].data = data;spin_unlock (&lock);set_cpu_idle (cpu, false); -sev (); +smp_send_event (); }void on_cpu (int cpu,void (*func)(void *data),void *data)
@@ -201,7 +201,7 @@ void on_cpus(void (*func)(void *data), void *data)deadlock_check (me, cpu); }while (cpumask_weight (&cpu_idle_mask) < nr_cpus -1 ) -wfe (); +smp_wait_for_event ();for_each_present_cpu (cpu)cpumask_clear_cpu (me, &on_cpu_info[cpu].waiters); }
Signature · 1 line
2.43.0
Re: [kvm-unit-tests PATCH v2 11/24] arm/arm64: Generalize wfe/sev names in smp.c
Quoted 7 lines · Andrew Jones
Most of Arm's
on_cpus()implementation can be shared by any architecture which has the possible, present, and idle cpumasks, like riscv does. Rename the exceptions (wfe/sve) to something more generic in order to prepare to share the functions.Signed-off-by Andrew Jones <[email protected]>Acked-by Thomas Huth <[email protected]>
Eric
Quoted 97 lines
--- lib/arm/asm/smp.h | 4 ++++ lib/arm/smp.c | 16 ++++++++-------- 2 files changed, 12 insertions(+), 8 deletions(-)lib/arm/asm/smp.h +4
-0@@ -6,6 +6,7 @@* This work is licensed under the terms of the GNU LGPL, version 2. */ #include <cpumask.h> +#include <asm/barrier.h> #include <asm/thread_info.h> #define smp_processor_id () (current_thread_info()->cpu)@@ -18,6 +19,9 @@ struct secondary_data { };extern struct secondary_data secondary_data; +#define smp_wait_for_event () wfe() +#define smp_send_event () sev() +extern bool cpu0_calls_idle;extern void halt (void );lib/arm/smp.c +8
-8@@ -45,7 +45,7 @@ secondary_entry_fn secondary_cinit(void)*/ entry = secondary_data.entry;set_cpu_online (ti->cpu, true); -sev (); +smp_send_event ();/* * Return to the assembly stub, allowing entry to be called @@ -65,7 +65,7 @@ static void __smp_boot_secondary(int cpu, secondary_entry_fn entry)assert (ret ==0 );while (!cpu_online (cpu)) -wfe (); +smp_wait_for_event (); }void smp_boot_secondary (int cpu,secondary_entry_fn entry)@@ -122,7 +122,7 @@ static void cpu_wait(int cpu)cpumask_set_cpu (me, &on_cpu_info[cpu].waiters);deadlock_check (me, cpu);while (!cpu_idle (cpu)) -wfe (); +smp_wait_for_event ();cpumask_clear_cpu (me, &on_cpu_info[cpu].waiters); }@@ -134,17 +134,17 @@ void do_idle(void) cpu0_calls_idle = true;set_cpu_idle (cpu, true); -sev (); +smp_send_event ();for (;;) {while (cpu_idle (cpu)) -wfe (); +smp_wait_for_event ();smp_rmb (); on_cpu_info[cpu].func (on_cpu_info[cpu].data); on_cpu_info[cpu].func =NULL ;smp_wmb ();set_cpu_idle (cpu, true); -sev (); +smp_send_event (); } }@@ -174,7 +174,7 @@ void on_cpu_async(int cpu, void (*func)(void *data), void *data) on_cpu_info[cpu].data = data;spin_unlock (&lock);set_cpu_idle (cpu, false); -sev (); +smp_send_event (); }void on_cpu (int cpu,void (*func)(void *data),void *data)@@ -201,7 +201,7 @@ void on_cpus(void (*func)(void *data), void *data)deadlock_check (me, cpu); }while (cpumask_weight (&cpu_idle_mask) < nr_cpus -1 ) -wfe (); +smp_wait_for_event ();for_each_present_cpu (cpu)cpumask_clear_cpu (me, &on_cpu_info[cpu].waiters); }
PATCH v2 12/24 arm/arm64: Remove spinlocks from on_cpu_async
In reply to Andrew JonesRemove spinlocks from on_cpu_async() by pulling some of their use into a new function and also by narrowing the locking to a single on_cpu_info structure by introducing yet another cpumask.
--- lib/arm/asm/smp.h | 4 +++- lib/arm/smp.c | 37 ++++++++++++++++++++++++++++--------- 2 files changed, 31 insertions(+), 10 deletions(-)
lib/arm/asm/smp.h +3 -1
@@ -27,9 +27,11 @@ extern bool cpu0_calls_idle;extern void halt (void );extern void do_idle (void ); -extern void smp_boot_secondary (int cpu,secondary_entry_fn entry);extern void on_cpu_async (int cpu,void (*func)(void *data),void *data);extern void on_cpu (int cpu,void (*func)(void *data),void *data);extern void on_cpus (void (*func)(void *data),void *data); +extern void smp_boot_secondary (int cpu,secondary_entry_fn entry); +extern void smp_boot_secondary_nofail (int cpu,secondary_entry_fn entry); +#endif /* _ASMARM_SMP_H_ */
lib/arm/smp.c +28 -9
@@ -76,12 +76,32 @@ void smp_boot_secondary(int cpu, secondary_entry_fn entry)spin_unlock (&lock); } +void smp_boot_secondary_nofail (int cpu,secondary_entry_fn entry) +{ +spin_lock (&lock); +if (!cpu_online (cpu)) +__smp_boot_secondary (cpu, entry); +spin_unlock (&lock); +} +struct on_cpu_info {void (*func)(void *data);void *data;cpumask_t waiters; };static struct on_cpu_info on_cpu_info[NR_CPUS ]; +static cpumask_t on_cpu_info_lock; + +static bool get_on_cpu_info (int cpu) +{ +return !cpumask_test_and_set_cpu (cpu, &on_cpu_info_lock); +} + +static void put_on_cpu_info (int cpu) +{ +int ret =cpumask_test_and_clear_cpu (cpu, &on_cpu_info_lock); +assert (ret); +}static void __deadlock_check (int cpu,const cpumask_t *waiters,bool *found) {
@@ -158,22 +178,21 @@ void on_cpu_async(int cpu, void (*func)(void *data), void *data)assert_msg (cpu !=0 || cpu0_calls_idle,"Waiting on CPU0, which is unlikely to idle. " "If this is intended set cpu0_calls_idle=1" ); -spin_lock (&lock); -if (!cpu_online (cpu)) -__smp_boot_secondary (cpu, do_idle); -spin_unlock (&lock); +smp_boot_secondary_nofail (cpu, do_idle);for (;;) {cpu_wait (cpu); -spin_lock (&lock); -if ((volatile void *)on_cpu_info[cpu].func ==NULL ) -break ; -spin_unlock (&lock); +if (get_on_cpu_info (cpu)) { +if ((volatile void *)on_cpu_info[cpu].func ==NULL ) +break ; +put_on_cpu_info (cpu); + } } + on_cpu_info[cpu].func = func; on_cpu_info[cpu].data = data; -spin_unlock (&lock);set_cpu_idle (cpu, false); +put_on_cpu_info (cpu);smp_send_event (); }
Signature · 1 line
2.43.0
Re: [kvm-unit-tests PATCH v2 12/24] arm/arm64: Remove spinlocks from on_cpu_async
Quoted 6 lines · Andrew Jones
Remove spinlocks from
on_cpu_async()by pulling some of their use into a new function and also by narrowing the locking to a singleon_cpu_infostructure by introducing yet another cpumask.Signed-off-by Andrew Jones <[email protected]>Acked-by Thomas Huth <[email protected]>
Eric
Quoted 90 lines
--- lib/arm/asm/smp.h | 4 +++- lib/arm/smp.c | 37 ++++++++++++++++++++++++++++--------- 2 files changed, 31 insertions(+), 10 deletions(-)lib/arm/asm/smp.h +3
-1@@ -27,9 +27,11 @@ extern bool cpu0_calls_idle;extern void halt (void );extern void do_idle (void ); -extern void smp_boot_secondary (int cpu,secondary_entry_fn entry);extern void on_cpu_async (int cpu,void (*func)(void *data),void *data);extern void on_cpu (int cpu,void (*func)(void *data),void *data);extern void on_cpus (void (*func)(void *data),void *data); +extern void smp_boot_secondary (int cpu,secondary_entry_fn entry); +extern void smp_boot_secondary_nofail (int cpu,secondary_entry_fn entry); +#endif /* _ASMARM_SMP_H_ */ lib/arm/smp.c +28
-9@@ -76,12 +76,32 @@ void smp_boot_secondary(int cpu, secondary_entry_fn entry)spin_unlock (&lock); } +void smp_boot_secondary_nofail (int cpu,secondary_entry_fn entry) +{ +spin_lock (&lock); +if (!cpu_online (cpu)) +__smp_boot_secondary (cpu, entry); +spin_unlock (&lock); +} +struct on_cpu_info {void (*func)(void *data);void *data;cpumask_t waiters; };static struct on_cpu_info on_cpu_info[NR_CPUS ]; +static cpumask_t on_cpu_info_lock; + +static bool get_on_cpu_info (int cpu) +{ +return !cpumask_test_and_set_cpu (cpu, &on_cpu_info_lock); +} + +static void put_on_cpu_info (int cpu) +{ +int ret =cpumask_test_and_clear_cpu (cpu, &on_cpu_info_lock); +assert (ret); +}static void __deadlock_check (int cpu,const cpumask_t *waiters,bool *found) {@@ -158,22 +178,21 @@ void on_cpu_async(int cpu, void (*func)(void *data), void *data)assert_msg (cpu !=0 || cpu0_calls_idle,"Waiting on CPU0, which is unlikely to idle. " "If this is intended set cpu0_calls_idle=1" ); -spin_lock (&lock); -if (!cpu_online (cpu)) -__smp_boot_secondary (cpu, do_idle); -spin_unlock (&lock); +smp_boot_secondary_nofail (cpu, do_idle);for (;;) {cpu_wait (cpu); -spin_lock (&lock); -if ((volatile void *)on_cpu_info[cpu].func ==NULL ) -break ; -spin_unlock (&lock); +if (get_on_cpu_info (cpu)) { +if ((volatile void *)on_cpu_info[cpu].func ==NULL ) +break ; +put_on_cpu_info (cpu); + } } + on_cpu_info[cpu].func = func; on_cpu_info[cpu].data = data; -spin_unlock (&lock);set_cpu_idle (cpu, false); +put_on_cpu_info (cpu);smp_send_event (); }
PATCH v2 13/24 arm/arm64: Share on_cpus
In reply to Andrew JonesNow that the previous patches have cleaned up Arm's on_cpus implementation we can move it to the common lib where riscv will share it.
--- arm/Makefile.common | 1 + lib/arm/asm/smp.h | 8 +-- lib/arm/smp.c | 144 ----------------------------------------- lib/on-cpus.c | 154 ++++++++++++++++++++++++++++++++++++++++++++ lib/on-cpus.h | 14 ++++ 5 files changed, 170 insertions(+), 151 deletions(-) create mode 100644 lib/on-cpus.c create mode 100644 lib/on-cpus.h
arm/Makefile.common +1 -0
@@ -43,6 +43,7 @@ cflatobjs += lib/vmalloc.o cflatobjs += lib/alloc.o cflatobjs += lib/devicetree.o cflatobjs += lib/migrate.o +cflatobjs += lib/on-cpus.o cflatobjs += lib/pci.o cflatobjs += lib/pci-host-generic.o cflatobjs += lib/pci-testdev.o
lib/arm/asm/smp.h +1 -7
@@ -6,6 +6,7 @@* This work is licensed under the terms of the GNU LGPL, version 2. */ #include <cpumask.h> +#include <on-cpus.h> #include <asm/barrier.h> #include <asm/thread_info.h>
@@ -22,14 +23,7 @@ extern struct secondary_data secondary_data;#define smp_wait_for_event () wfe()#define smp_send_event () sev() -extern bool cpu0_calls_idle; -extern void halt (void ); -extern void do_idle (void ); - -extern void on_cpu_async (int cpu,void (*func)(void *data),void *data); -extern void on_cpu (int cpu,void (*func)(void *data),void *data); -extern void on_cpus (void (*func)(void *data),void *data);extern void smp_boot_secondary (int cpu,secondary_entry_fn entry);extern void smp_boot_secondary_nofail (int cpu,secondary_entry_fn entry);
lib/arm/smp.c +0 -144
157 lines not on this page · raw message
lib/on-cpus.c new file +154 -0
154 lines not on this page · raw message
lib/on-cpus.h new file +14 -0
@@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: GPL-2.0-only */ +#ifndef _ON_CPUS_H_ +#define _ON_CPUS_H_ +#include <stdbool.h> + +extern bool cpu0_calls_idle; + +void do_idle (void ); + +void on_cpu_async (int cpu,void (*func)(void *data),void *data); +void on_cpu (int cpu,void (*func)(void *data),void *data); +void on_cpus (void (*func)(void *data),void *data); + +#endif /* _ON_CPUS_H_ */
Signature · 1 line
2.43.0
Re: [kvm-unit-tests PATCH v2 13/24] arm/arm64: Share on_cpus
Quoted 6 lines · Andrew Jones
Now that the previous patches have cleaned up Arm's
on_cpusimplementation we can move it to the common lib where riscv will share it.Signed-off-by Andrew Jones <[email protected]>Acked-by Thomas Huth <[email protected]>
Eric
Quoted 392 lines
--- arm/Makefile.common | 1 + lib/arm/asm/smp.h | 8 +-- lib/arm/smp.c | 144 ----------------------------------------- lib/on-cpus.c | 154 ++++++++++++++++++++++++++++++++++++++++++++ lib/on-cpus.h | 14 ++++ 5 files changed, 170 insertions(+), 151 deletions(-) create mode 100644 lib/on-cpus.c create mode 100644 lib/on-cpus.harm/Makefile.common +1
-0@@ -43,6 +43,7 @@ cflatobjs += lib/vmalloc.o cflatobjs += lib/alloc.o cflatobjs += lib/devicetree.o cflatobjs += lib/migrate.o +cflatobjs += lib/on-cpus.o cflatobjs += lib/pci.o cflatobjs += lib/pci-host-generic.o cflatobjs += lib/pci-testdev.olib/arm/asm/smp.h +1
-7@@ -6,6 +6,7 @@* This work is licensed under the terms of the GNU LGPL, version 2. */ #include <cpumask.h> +#include <on-cpus.h> #include <asm/barrier.h> #include <asm/thread_info.h> @@ -22,14 +23,7 @@ extern struct secondary_data secondary_data;#define smp_wait_for_event () wfe()#define smp_send_event () sev() -extern bool cpu0_calls_idle; -extern void halt (void ); -extern void do_idle (void ); - -extern void on_cpu_async (int cpu,void (*func)(void *data),void *data); -extern void on_cpu (int cpu,void (*func)(void *data),void *data); -extern void on_cpus (void (*func)(void *data),void *data);extern void smp_boot_secondary (int cpu,secondary_entry_fn entry);extern void smp_boot_secondary_nofail (int cpu,secondary_entry_fn entry);lib/arm/smp.c +0
-144@@ -10,13 +10,10 @@#include <cpumask.h> #include <asm/thread_info.h> #include <asm/spinlock.h> -#include <asm/barrier.h> #include <asm/mmu.h> #include <asm/psci.h> #include <asm/smp.h> -bool cpu0_calls_idle; -cpumask_t cpu_present_mask;cpumask_t cpu_online_mask;cpumask_t cpu_idle_mask;@@ -83,144 +80,3 @@ void smp_boot_secondary_nofail(int cpu, secondary_entry_fn entry)__smp_boot_secondary (cpu, entry);spin_unlock (&lock); } - -struct on_cpu_info { -void (*func)(void *data); -void *data; -cpumask_t waiters; -}; -static struct on_cpu_info on_cpu_info[NR_CPUS ]; -static cpumask_t on_cpu_info_lock; - -static bool get_on_cpu_info (int cpu) -{ -return !cpumask_test_and_set_cpu (cpu, &on_cpu_info_lock); -} - -static void put_on_cpu_info (int cpu) -{ -int ret =cpumask_test_and_clear_cpu (cpu, &on_cpu_info_lock); -assert (ret); -} - -static void __deadlock_check (int cpu,const cpumask_t *waiters,bool *found) -{ -int i; - -for_each_cpu (i, waiters) { -if (i == cpu) { -printf ("CPU%d" , cpu); - *found = true; -return ; - } -__deadlock_check (cpu, &on_cpu_info[i].waiters, found); -if (*found) { -printf (" <=> CPU%d" , i); -return ; - } - } -} - -static void deadlock_check (int me,int cpu) -{ -bool found = false; - -__deadlock_check (cpu, &on_cpu_info[me].waiters, &found); -if (found) { -printf (" <=> CPU%d deadlock detectd\n" , me); -assert (0 ); - } -} - -static void cpu_wait (int cpu) -{ -int me =smp_processor_id (); - -if (cpu == me) -return ; - -cpumask_set_cpu (me, &on_cpu_info[cpu].waiters); -deadlock_check (me, cpu); -while (!cpu_idle (cpu)) -smp_wait_for_event (); -cpumask_clear_cpu (me, &on_cpu_info[cpu].waiters); -} - -void do_idle (void ) -{ -int cpu =smp_processor_id (); - -if (cpu ==0 ) - cpu0_calls_idle = true; - -set_cpu_idle (cpu, true); -smp_send_event (); - -for (;;) { -while (cpu_idle (cpu)) -smp_wait_for_event (); -smp_rmb (); - on_cpu_info[cpu].func (on_cpu_info[cpu].data); - on_cpu_info[cpu].func =NULL ; -smp_wmb (); -set_cpu_idle (cpu, true); -smp_send_event (); - } -} - -void on_cpu_async (int cpu,void (*func)(void *data),void *data) -{ -if (cpu ==smp_processor_id ()) { -func (data); -return ; - } - -assert_msg (cpu !=0 || cpu0_calls_idle,"Waiting on CPU0, which is unlikely to idle. " -"If this is intended set cpu0_calls_idle=1" ); - -smp_boot_secondary_nofail (cpu, do_idle); - -for (;;) { -cpu_wait (cpu); -if (get_on_cpu_info (cpu)) { -if ((volatile void *)on_cpu_info[cpu].func ==NULL ) -break ; -put_on_cpu_info (cpu); - } - } - - on_cpu_info[cpu].func = func; - on_cpu_info[cpu].data = data; -set_cpu_idle (cpu, false); -put_on_cpu_info (cpu); -smp_send_event (); -} - -void on_cpu (int cpu,void (*func)(void *data),void *data) -{ -on_cpu_async (cpu, func, data); -cpu_wait (cpu); -} - -void on_cpus (void (*func)(void *data),void *data) -{ -int cpu, me =smp_processor_id (); - -for_each_present_cpu (cpu) { -if (cpu == me) -continue ; -on_cpu_async (cpu, func, data); - } -func (data); - -for_each_present_cpu (cpu) { -if (cpu == me) -continue ; -cpumask_set_cpu (me, &on_cpu_info[cpu].waiters); -deadlock_check (me, cpu); - } -while (cpumask_weight (&cpu_idle_mask) < nr_cpus -1 ) -smp_wait_for_event (); -for_each_present_cpu (cpu) -cpumask_clear_cpu (me, &on_cpu_info[cpu].waiters); -}lib/on-cpus.c new file +154
-0@@ -0,0 +1,154 @@ +// SPDX-License-Identifier: GPL-2.0-only +/* +* on_cpus() support based on cpumasks. +* +* Copyright (C) 2015, Red Hat Inc, Andrew Jones <[email protected]> +*/ +#include <libcflat.h> +#include <cpumask.h> +#include <on-cpus.h> +#include <asm/barrier.h> +#include <asm/smp.h> + +bool cpu0_calls_idle; + +struct on_cpu_info { +void (*func)(void *data); +void *data; +cpumask_t waiters; +}; +static struct on_cpu_info on_cpu_info[NR_CPUS ]; +static cpumask_t on_cpu_info_lock; + +static bool get_on_cpu_info (int cpu) +{ +return !cpumask_test_and_set_cpu (cpu, &on_cpu_info_lock); +} + +static void put_on_cpu_info (int cpu) +{ +int ret =cpumask_test_and_clear_cpu (cpu, &on_cpu_info_lock); +assert (ret); +} + +static void __deadlock_check (int cpu,const cpumask_t *waiters,bool *found) +{ +int i; + +for_each_cpu (i, waiters) { +if (i == cpu) { +printf ("CPU%d" , cpu); + *found = true; +return ; + } +__deadlock_check (cpu, &on_cpu_info[i].waiters, found); +if (*found) { +printf (" <=> CPU%d" , i); +return ; + } + } +} + +static void deadlock_check (int me,int cpu) +{ +bool found = false; + +__deadlock_check (cpu, &on_cpu_info[me].waiters, &found); +if (found) { +printf (" <=> CPU%d deadlock detectd\n" , me); +assert (0 ); + } +} + +static void cpu_wait (int cpu) +{ +int me =smp_processor_id (); + +if (cpu == me) +return ; + +cpumask_set_cpu (me, &on_cpu_info[cpu].waiters); +deadlock_check (me, cpu); +while (!cpu_idle (cpu)) +smp_wait_for_event (); +cpumask_clear_cpu (me, &on_cpu_info[cpu].waiters); +} + +void do_idle (void ) +{ +int cpu =smp_processor_id (); + +if (cpu ==0 ) + cpu0_calls_idle = true; + +set_cpu_idle (cpu, true); +smp_send_event (); + +for (;;) { +while (cpu_idle (cpu)) +smp_wait_for_event (); +smp_rmb (); + on_cpu_info[cpu].func (on_cpu_info[cpu].data); + on_cpu_info[cpu].func =NULL ; +smp_wmb (); +set_cpu_idle (cpu, true); +smp_send_event (); + } +} + +void on_cpu_async (int cpu,void (*func)(void *data),void *data) +{ +if (cpu ==smp_processor_id ()) { +func (data); +return ; + } + +assert_msg (cpu !=0 || cpu0_calls_idle,"Waiting on CPU0, which is unlikely to idle. " +"If this is intended set cpu0_calls_idle=1" ); + +smp_boot_secondary_nofail (cpu, do_idle); + +for (;;) { +cpu_wait (cpu); +if (get_on_cpu_info (cpu)) { +if ((volatile void *)on_cpu_info[cpu].func ==NULL ) +break ; +put_on_cpu_info (cpu); + } + } + + on_cpu_info[cpu].func = func; + on_cpu_info[cpu].data = data; +set_cpu_idle (cpu, false); +put_on_cpu_info (cpu); +smp_send_event (); +} + +void on_cpu (int cpu,void (*func)(void *data),void *data) +{ +on_cpu_async (cpu, func, data); +cpu_wait (cpu); +} + +void on_cpus (void (*func)(void *data),void *data) +{ +int cpu, me =smp_processor_id (); + +for_each_present_cpu (cpu) { +if (cpu == me) +continue ; +on_cpu_async (cpu, func, data); + } +func (data); + +for_each_present_cpu (cpu) { +if (cpu == me) +continue ; +cpumask_set_cpu (me, &on_cpu_info[cpu].waiters); +deadlock_check (me, cpu); + } +while (cpumask_weight (&cpu_idle_mask) < nr_cpus -1 ) +smp_wait_for_event (); +for_each_present_cpu (cpu) +cpumask_clear_cpu (me, &on_cpu_info[cpu].waiters); +}lib/on-cpus.h new file +14
-0@@ -0,0 +1,14 @@ +/* SPDX-License-Identifier: GPL-2.0-only */ +#ifndef _ON_CPUS_H_ +#define _ON_CPUS_H_ +#include <stdbool.h> + +extern bool cpu0_calls_idle; + +void do_idle (void ); + +void on_cpu_async (int cpu,void (*func)(void *data),void *data); +void on_cpu (int cpu,void (*func)(void *data),void *data); +void on_cpus (void (*func)(void *data),void *data); + +#endif /* _ON_CPUS_H_ */
PATCH v2 14/24 riscv: Compile with march
In reply to Andrew JonesTell the compiler to provide mnemonics for instructions we depend on, such as 'pause'. Specifying march also allows extensions which affect compilation to be individually [un]selected. For example, building without compressed (2 byte) instructions may be desirable, so 'c' may be removed from the march isa string.
--- riscv/Makefile | 5 +++++ 1 file changed, 5 insertions(+)
riscv/Makefile +5 -0
@@ -55,8 +55,13 @@ define arch_elf_check = $(error $(1) has unsupported reloc types)) endef +ISA_COMMON = mafdc_zicsr_zifencei_zihintpause + ifeq ($(ARCH),riscv64) +CFLAGS += -march=rv64i$(ISA_COMMON) CFLAGS += -DCONFIG_64BIT +else ifeq ($(ARCH),riscv32) +CFLAGS += -march=rv32i$(ISA_COMMON) endif CFLAGS += -DCONFIG_RELOC CFLAGS += -mcmodel=medany
Signature · 1 line
2.43.0
PATCH v2 15/24 riscv: Add SMP support
In reply to Andrew JonesImplement the same SMP API that Arm has but using an SBI HSM call instead of PSCI. Unlike Arm, riscv needs to always set cpu0_calls_idle, because the boot hart doesn't have to be the first hart described in the DT, which means cpu0 may well be a secondary. As usual, add a couple tests to selftest.c to make sure everything works.
(The secondary boot process is also improved over Arm's a bit by keeping boot data percpu, dropping the need for a lock. We could create percpu data for Arm too, but that's left as future work.)
--- lib/riscv/asm-offsets.c | 6 ++++ lib/riscv/asm/barrier.h | 2 ++ lib/riscv/asm/sbi.h | 22 +++++++++++++++ lib/riscv/asm/smp.h | 28 +++++++++++++++++++ lib/riscv/processor.c | 2 ++ lib/riscv/sbi.c | 5 ++++ lib/riscv/setup.c | 2 ++ lib/riscv/smp.c | 61 +++++++++++++++++++++++++++++++++++++++++ riscv/Makefile | 1 + riscv/cstart.S | 25 +++++++++++++++++ riscv/selftest.c | 31 +++++++++++++++++++++ 11 files changed, 185 insertions(+) create mode 100644 lib/riscv/asm/smp.h
lib/riscv/asm-offsets.c +6 -0
@@ -2,6 +2,7 @@#include <kbuild.h> #include <elf.h> #include <asm/ptrace.h> +#include <asm/smp.h> int main (void ) {
@@ -51,5 +52,10 @@ int main(void)OFFSET (PT_CAUSE , pt_regs, cause);OFFSET (PT_ORIG_A0 , pt_regs, orig_a0);DEFINE (PT_SIZE ,sizeof (struct pt_regs )); + +OFFSET (SECONDARY_STVEC , secondary_data, stvec); +OFFSET (SECONDARY_FUNC , secondary_data, func); +DEFINE (SECONDARY_DATA_SIZE ,sizeof (struct secondary_data )); +return 0 ; }
lib/riscv/asm/barrier.h +2 -0
@@ -15,4 +15,6 @@#define smp_rmb () RISCV_FENCE(r,r)#define smp_wmb () RISCV_FENCE(w,w) +#define cpu_relax () __asm__ __volatile__ ("pause") +#endif /* _ASMRISCV_BARRIER_H_ */
lib/riscv/asm/sbi.h +22 -0
@@ -2,8 +2,21 @@#ifndef _ASMRISCV_SBI_H_#define _ASMRISCV_SBI_H_ +#define SBI_SUCCESS 0 +#define SBI_ERR_FAILURE -1 +#define SBI_ERR_NOT_SUPPORTED -2 +#define SBI_ERR_INVALID_PARAM -3 +#define SBI_ERR_DENIED -4 +#define SBI_ERR_INVALID_ADDRESS -5 +#define SBI_ERR_ALREADY_AVAILABLE -6 +#define SBI_ERR_ALREADY_STARTED -7 +#define SBI_ERR_ALREADY_STOPPED -8 + +#ifndef __ASSEMBLY__ +enum sbi_ext_id {SBI_EXT_BASE =0x10 , +SBI_EXT_HSM =0x48534d ,SBI_EXT_SRST =0x53525354 , };
@@ -17,6 +30,13 @@ enum sbi_ext_base_fid { SBI_EXT_BASE_GET_MIMPID, }; +enum sbi_ext_hsm_fid { +SBI_EXT_HSM_HART_START =0 , +SBI_EXT_HSM_HART_STOP , +SBI_EXT_HSM_HART_STATUS , +SBI_EXT_HSM_HART_SUSPEND , +}; +struct sbiret {long error;long value;
@@ -28,5 +48,7 @@ struct sbiret sbi_ecall(int ext, int fid, unsigned long arg0, unsigned long arg5);void sbi_shutdown (void ); +struct sbiret sbi_hart_start (unsigned long hartid,unsigned long entry,unsigned long sp); +#endif /* !__ASSEMBLY__ */ #endif /* _ASMRISCV_SBI_H_ */
lib/riscv/asm/smp.h new file +28 -0
@@ -0,0 +1,28 @@ +/* SPDX-License-Identifier: GPL-2.0-only */ +#ifndef _ASMRISCV_SMP_H_ +#define _ASMRISCV_SMP_H_ +#include <asm/barrier.h> +#include <asm/processor.h> + +#define smp_wait_for_event () cpu_relax() +#define smp_send_event () cpu_relax() + +static inline int smp_processor_id (void ) +{ +return current_thread_info ()->cpu; +} + +typedef void (*secondary_func_t )(void ); + +struct secondary_data { +unsigned long stvec; +secondary_func_t func; +} __attribute__((aligned (16 ))); + +void secondary_entry (unsigned long hartid,unsigned long sp_phys); +secondary_func_t secondary_cinit (struct secondary_data *data); + +void smp_boot_secondary (int cpu,void (*func)(void )); +void smp_boot_secondary_nofail (int cpu,void (*func)(void )); + +#endif /* _ASMRISCV_SMP_H_ */
lib/riscv/processor.c +2 -0
@@ -11,10 +11,12 @@ extern unsigned long _text;void show_regs (struct pt_regs *regs) { +struct thread_info *info =current_thread_info ();uintptr_t text = (uintptr_t )&_text;unsigned int w = __riscv_xlen /4 ;printf ("Load address: %" PRIxPTR"\n" , text); +printf ("CPU%3d : hartid=%lx\n" , info->cpu, info->hartid);printf ("status : %.*lx\n" , w, regs->status);printf ("cause : %.*lx\n" , w, regs->cause);printf ("badaddr: %.*lx\n" , w, regs->badaddr);
lib/riscv/sbi.c +5 -0
@@ -33,3 +33,8 @@ void sbi_shutdown(void)sbi_ecall (SBI_EXT_SRST ,0 ,0 ,0 ,0 ,0 ,0 ,0 );puts ("SBI shutdown failed!\n" ); } + +struct sbiret sbi_hart_start (unsigned long hartid,unsigned long entry,unsigned long sp) +{ +return sbi_ecall (SBI_EXT_HSM ,SBI_EXT_HSM_HART_START , hartid, entry, sp,0 ,0 ,0 ); +}
lib/riscv/setup.c +2 -0
@@ -10,6 +10,7 @@#include <argv.h> #include <cpumask.h> #include <devicetree.h> +#include <on-cpus.h> #include <asm/csr.h> #include <asm/page.h> #include <asm/processor.h>
@@ -60,6 +61,7 @@ static void cpu_init(void) }set_cpu_online (hartid_to_cpu (csr_read (CSR_SSCRATCH )), true); + cpu0_calls_idle = true; }static void mem_init (phys_addr_t freemem_start)
lib/riscv/smp.c +61 -0
67 lines not on this page · raw message
riscv/Makefile +1 -0
@@ -24,6 +24,7 @@ cstart.o = $(TEST_DIR)/cstart.o cflatobjs += lib/alloc.o cflatobjs += lib/alloc_phys.o cflatobjs += lib/devicetree.o +cflatobjs += lib/on-cpus.o cflatobjs += lib/riscv/bitops.o cflatobjs += lib/riscv/io.o cflatobjs += lib/riscv/processor.o
riscv/cstart.S +25 -0
@@ -117,6 +117,31 @@ halt: 1: wfi j 1b +.balign 4 +.global secondary_entry +secondary_entry: + /* + * From the "HSM Hart Start Register State" table of the SBI spec: + * satp 0 + * sstatus.SIE 0 + * a0 hartid + * a1 opaque parameter + * + * __smp_boot_secondary() sets the opaque parameter (a1) to the physical + * address of the stack and the stack contains the secondary data. + */ + csrw CSR_SSCRATCH, a0 + mv sp, a1 + mv fp, zero + REG_L a0, SECONDARY_STVEC(sp) + csrw CSR_STVEC, a0 + mv a0, sp + call secondary_cinit + addi sp, sp, SECONDARY_DATA_SIZE + jr a0 + la a0, do_idle + jr a0 + /* * Save context to address in a0. * For a0, sets PT_A0(a0) to the contents of PT_ORIG_A0(a0).
riscv/selftest.c +31 -0
@@ -6,8 +6,10 @@*/ #include <libcflat.h> #include <cpumask.h> +#include <on-cpus.h> #include <asm/processor.h> #include <asm/setup.h> +#include <asm/smp.h> static void check_cpus (void ) {
@@ -33,6 +35,34 @@ static void check_exceptions(void)report (exceptions_work,"exceptions" ); } +static cpumask_t cpus_alive; + +static void check_secondary (void *data) +{ +cpumask_set_cpu (smp_processor_id (), &cpus_alive); +} + +static void check_smp (void ) +{ +int cpu, me =smp_processor_id (); +bool fail = false; + +on_cpus (check_secondary,NULL ); + +report (cpumask_full (&cpu_online_mask),"Brought up all cpus" ); +report (cpumask_full (&cpus_alive),"check_secondary" ); + +for_each_present_cpu (cpu) { +if (cpu == me) +continue ; +if (!cpu_idle (cpu)) { + fail = true; +break ; + } + } +report (!fail,"All secondaries are idle" ); +} +int main (int argc,char **argv) {bool r;
@@ -64,6 +94,7 @@ int main(int argc, char **argv)check_exceptions ();check_cpus (); +check_smp ();return report_summary (); }
Signature · 1 line
2.43.0
PATCH v2 16/24 arm/arm64: Share memregions
In reply to Andrew Jonesarm/arm64 (and to a small extent powerpc) have memory regions which get built from hardware descriptions (DT/ACPI/EFI) and then used to build page tables. Move memregions to common code, tweaking the API a bit at the same time, e.g. change 'mem_region' to 'memregions'. The biggest change is there is now a default number of memory regions which, if too small, should be overridden at setup time with a new init function, memregions_init().
--- arm/Makefile.common | 1 + arm/selftest.c | 3 +- lib/arm/asm/setup.h | 14 ------- lib/arm/mmu.c | 1 + lib/arm/setup.c | 93 ++++++++++----------------------------------- lib/memregions.c | 82 +++++++++++++++++++++++++++++++++++++++ lib/memregions.h | 29 ++++++++++++++ 7 files changed, 136 insertions(+), 87 deletions(-) create mode 100644 lib/memregions.c create mode 100644 lib/memregions.h
arm/Makefile.common +1 -0
@@ -42,6 +42,7 @@ cflatobjs += lib/alloc_page.o cflatobjs += lib/vmalloc.o cflatobjs += lib/alloc.o cflatobjs += lib/devicetree.o +cflatobjs += lib/memregions.o cflatobjs += lib/migrate.o cflatobjs += lib/on-cpus.o cflatobjs += lib/pci.o
arm/selftest.c +2 -1
@@ -8,6 +8,7 @@#include <libcflat.h> #include <util.h> #include <devicetree.h> +#include <memregions.h> #include <vmalloc.h> #include <asm/setup.h> #include <asm/ptrace.h>
@@ -90,7 +91,7 @@ static bool check_pabt_init(void) highest_end =PAGE_ALIGN (r->end); } -if (mem_region_get_flags (highest_end) !=MR_F_UNKNOWN ) +if (memregions_get_flags (highest_end) !=MR_F_UNKNOWN )return false; vaddr = (unsigned long )vmap (highest_end,PAGE_SIZE );
lib/arm/asm/setup.h +0 -14
@@ -13,22 +13,8 @@extern u64 cpus[NR_CPUS ];/* per-cpu IDs (MPIDRs) */ extern int nr_cpus; -#define MR_F_IO (1U << 0) -#define MR_F_CODE (1U << 1) -#define MR_F_RESERVED (1U << 2) -#define MR_F_UNKNOWN (1U << 31) - -struct mem_region { -phys_addr_t start; -phys_addr_t end; -unsigned int flags; -}; -extern struct mem_region *mem_regions;extern phys_addr_t __phys_offset, __phys_end; -extern struct mem_region *mem_region_find (phys_addr_t paddr); -extern unsigned int mem_region_get_flags (phys_addr_t paddr); -#define PHYS_OFFSET (__phys_offset)#define PHYS_END (__phys_end)
lib/arm/mmu.c +1 -0
@@ -6,6 +6,7 @@* This work is licensed under the terms of the GNU LGPL, version 2. */ #include <cpumask.h> +#include <memregions.h> #include <asm/setup.h> #include <asm/thread_info.h> #include <asm/mmu.h>
lib/arm/setup.c +21 -72
164 lines not on this page · raw message
lib/memregions.c new file +82 -0
82 lines not on this page · raw message
lib/memregions.h new file +29 -0
@@ -0,0 +1,29 @@ +/* SPDX-License-Identifier: GPL-2.0-only */ +#ifndef _MEMREGIONS_H_ +#define _MEMREGIONS_H_ +#include <libcflat.h> +#include <bitops.h> + +#define NR_INITIAL_MEM_REGIONS 8 + +#define MR_F_IO BIT(0) +#define MR_F_CODE BIT(1) +#define MR_F_RESERVED BIT(2) +#define MR_F_UNKNOWN BIT(31) + +struct mem_region { +phys_addr_t start; +phys_addr_t end; +uint32_t flags; +}; + +extern struct mem_region *mem_regions; + +void memregions_init (struct mem_region regions[],size_t nr); +struct mem_region *memregions_add (struct mem_region *r); +struct mem_region *memregions_find (phys_addr_t paddr); +uint32_t memregions_get_flags (phys_addr_t paddr); +void memregions_split (phys_addr_t addr,struct mem_region **r1,struct mem_region **r2); +void memregions_add_dt_regions (size_t max_nr); + +#endif /* _MEMREGIONS_H_ */
Signature · 1 line
2.43.0
Re: [kvm-unit-tests PATCH v2 16/24] arm/arm64: Share memregions
Hi Drew,
Quoted 186 lines · Andrew Jones
arm/arm64 (and to a small extent powerpc) have memory regions which get built from hardware descriptions (DT/ACPI/EFI) and then used to build page tables. Move memregions to common code, tweaking the API a bit at the same time, e.g. change '
mem_region' to 'memregions'. The biggest change is there is now a default number of memory regions which, if too small, should be overridden at setup time with a new init function,memregions_init().Signed-off-by Andrew Jones <[email protected]>Acked-by Thomas Huth <[email protected]>--- arm/Makefile.common | 1 + arm/selftest.c | 3 +- lib/arm/asm/setup.h | 14 ------- lib/arm/mmu.c | 1 + lib/arm/setup.c | 93 ++++++++++----------------------------------- lib/memregions.c | 82 +++++++++++++++++++++++++++++++++++++++ lib/memregions.h | 29 ++++++++++++++ 7 files changed, 136 insertions(+), 87 deletions(-) create mode 100644 lib/memregions.c create mode 100644 lib/memregions.harm/Makefile.common +1
-0@@ -42,6 +42,7 @@ cflatobjs += lib/alloc_page.o cflatobjs += lib/vmalloc.o cflatobjs += lib/alloc.o cflatobjs += lib/devicetree.o +cflatobjs += lib/memregions.o cflatobjs += lib/migrate.o cflatobjs += lib/on-cpus.o cflatobjs += lib/pci.oarm/selftest.c +2
-1@@ -8,6 +8,7 @@#include <libcflat.h> #include <util.h> #include <devicetree.h> +#include <memregions.h> #include <vmalloc.h> #include <asm/setup.h> #include <asm/ptrace.h> @@ -90,7 +91,7 @@ static bool check_pabt_init(void) highest_end =PAGE_ALIGN (r->end); } -if (mem_region_get_flags (highest_end) !=MR_F_UNKNOWN ) +if (memregions_get_flags (highest_end) !=MR_F_UNKNOWN )return false; vaddr = (unsigned long )vmap (highest_end,PAGE_SIZE );lib/arm/asm/setup.h +0
-14@@ -13,22 +13,8 @@extern u64 cpus[NR_CPUS ];/* per-cpu IDs (MPIDRs) */ extern int nr_cpus; -#define MR_F_IO (1U << 0) -#define MR_F_CODE (1U << 1) -#define MR_F_RESERVED (1U << 2) -#define MR_F_UNKNOWN (1U << 31) - -struct mem_region { -phys_addr_t start; -phys_addr_t end; -unsigned int flags; -}; -extern struct mem_region *mem_regions;extern phys_addr_t __phys_offset, __phys_end; -extern struct mem_region *mem_region_find (phys_addr_t paddr); -extern unsigned int mem_region_get_flags (phys_addr_t paddr); -#define PHYS_OFFSET (__phys_offset)#define PHYS_END (__phys_end)lib/arm/mmu.c +1
-0@@ -6,6 +6,7 @@* This work is licensed under the terms of the GNU LGPL, version 2. */ #include <cpumask.h> +#include <memregions.h> #include <asm/setup.h> #include <asm/thread_info.h> #include <asm/mmu.h> lib/arm/setup.c +5
-55@@ -13,6 +13,7 @@#include <libcflat.h> #include <libfdt/libfdt.h> #include <devicetree.h> +#include <memregions.h> #include <alloc.h> #include <alloc_phys.h> #include <alloc_page.h> @@ -31,7 +32,7 @@#define MAX_DT_MEM_REGIONS 16#define NR_EXTRA_MEM_REGIONS 64 -#define NR_INITIAL_MEM_REGIONS (MAX_DT_MEM_REGIONS + NR_EXTRA_MEM_REGIONS) +#define NR_MEM_REGIONS (MAX_DT_MEM_REGIONS + NR_EXTRA_MEM_REGIONS)extern unsigned long _text, _etext, _data, _edata;@@ -41,8 +42,7 @@ u32 initrd_size;u64 cpus[NR_CPUS ] = { [0 ...NR_CPUS -1 ] = (u64 )~0 };int nr_cpus; -static struct mem_region __initial_mem_regions[NR_INITIAL_MEM_REGIONS +1 ]; -struct mem_region *mem_regions = __initial_mem_regions; +static struct mem_region arm_mem_regions[NR_MEM_REGIONS +1 ];phys_addr_t __phys_offset = (phys_addr_t)-1 , __phys_end =0 ;extern void exceptions_init (void );@@ -114,68 +114,14 @@ static void cpu_init(void)set_cpu_online (0 , true); } -static void mem_region_add (struct mem_region *r) +static void arm_memregions_add_assumed (void ) { -struct mem_region *r_next = mem_regions; -int i =0 ; - -for (; r_next->end; ++r_next, ++i) - ; -assert (i <NR_INITIAL_MEM_REGIONS ); - - *r_next = *r; -} - -static void mem_regions_add_dt_regions (void ) -{ -struct dt_pbus_reg regs[MAX_DT_MEM_REGIONS ]; -int nr_regs, i; - - nr_regs =dt_get_memory_params (regs,MAX_DT_MEM_REGIONS ); -assert (nr_regs >0 ); - -for (i =0 ; i < nr_regs; ++i) { -mem_region_add (&(struct mem_region ){ - .start = regs[i].addr, - .end = regs[i].addr + regs[i].size, - }); - } -} - -struct mem_region *mem_region_find (phys_addr_t paddr) -{ -struct mem_region *r; - -for (r = mem_regions; r->end; ++r) -if (paddr >= r->start && paddr < r->end) -return r; -return NULL ; -} - -unsigned int mem_region_get_flags (phys_addr_t paddr) -{ -struct mem_region *r =mem_region_find (paddr); -return r ? r->flags :MR_F_UNKNOWN ; -} - -static void mem_regions_add_assumed (void ) -{ -phys_addr_t code_end = (phys_addr_t )(unsigned long )&_etext; -struct mem_region *r; - - r =mem_region_find (code_end -1 ); -assert (r); +struct mem_region *code, *data;/* Split the region with the code into two regions; code and data */ - mem_region_add(&(struct mem_region){ - .start = code_end,
lib/arm/setup.c static void cpu_init(void) · line 124
Quoted 10 lines
lib/arm/setup.c +3
-7- .end = r->end, - }); - *r = (struct mem_region ){ - .start = r->start, - .end = code_end, - .flags =MR_F_CODE , - }; +memregions_split ((unsigned long )&_etext, &code, &data); +assert (code); + code->flags |=MR_F_CODE ;
I think this would deserve to be split into several patches, esp. this change in the implementation of
mem_regions_add_assumed and the init changes. At the moment this is pretty difficult to review
Eric
Quoted 200 lines
lib/arm/setup.c +13
-10/* * mach-virt I/O regions: @@ -183,10 +129,10 @@ static void mem_regions_add_assumed(void)* - 512M at 256G (arm64, arm uses highmem=off) * - 512G at 512G (arm64, arm uses highmem=off) */ -mem_region_add (&(struct mem_region ){0 , (1ul <<30 ),MR_F_IO }); +memregions_add (&(struct mem_region ){0 , (1ul <<30 ),MR_F_IO });#ifdef __aarch64__ -mem_region_add (&(struct mem_region ){ (1ul <<38 ), (1ul <<38 ) | (1ul <<29 ),MR_F_IO }); -mem_region_add (&(struct mem_region ){ (1ul <<39 ), (1ul <<40 ),MR_F_IO }); +memregions_add (&(struct mem_region ){ (1ul <<38 ), (1ul <<38 ) | (1ul <<29 ),MR_F_IO }); +memregions_add (&(struct mem_region ){ (1ul <<39 ), (1ul <<40 ),MR_F_IO });#endif }@@ -197,7 +143,7 @@ static void mem_init(phys_addr_t freemem_start) .start = (phys_addr_t)-1, }; - freemem =mem_region_find (freemem_start); + freemem =memregions_find (freemem_start);assert (freemem && !(freemem->flags & (MR_F_IO |MR_F_CODE )));for (r = mem_regions; r->end; ++r) {@@ -212,9 +158,9 @@ static void mem_init(phys_addr_t freemem_start) mem.end &=PHYS_MASK ;/* Check for holes */ - r =mem_region_find (mem.start); + r =memregions_find (mem.start);while (r && r->end != mem.end) - r =mem_region_find (r->end); + r =memregions_find (r->end);assert (r);/* Ensure our selected freemem range is somewhere in our full range */ @@ -263,8 +209,9 @@ void setup(const void *fdt, phys_addr_t freemem_start) freemem += initrd_size; } -mem_regions_add_dt_regions (); -mem_regions_add_assumed (); +memregions_init (arm_mem_regions,NR_MEM_REGIONS ); +memregions_add_dt_regions (MAX_DT_MEM_REGIONS ); +arm_memregions_add_assumed ();mem_init (PAGE_ALIGN ((unsigned long )freemem));psci_set_conduit ();@@ -371,7 +318,7 @@ static efi_status_t efi_mem_init(efi_bootinfo_t *efi_bootinfo)assert (edata <= r.end); r.flags =MR_F_CODE ; r.end = data; -mem_region_add (&r); +memregions_add (&r); r.start = data; r.end = tmp; r.flags =0 ;@@ -393,7 +340,7 @@ static efi_status_t efi_mem_init(efi_bootinfo_t *efi_bootinfo)if (r.end > __phys_end) __phys_end = r.end; } -mem_region_add (&r); +memregions_add (&r); }if (fdt) {/* Move the FDT to the base of free memory */ @@ -439,6 +386,8 @@ efi_status_t setup_efi(efi_bootinfo_t *efi_bootinfo)exceptions_init (); +memregions_init (arm_mem_regions,NR_MEM_REGIONS ); + status =efi_mem_init (efi_bootinfo);if (status !=EFI_SUCCESS ) {printf ("Failed to initialize memory: " );lib/memregions.c new file +82
-0@@ -0,0 +1,82 @@ +// SPDX-License-Identifier: GPL-2.0-only +#include <libcflat.h> +#include <devicetree.h> +#include <memregions.h> + +static struct mem_region __initial_mem_regions[NR_INITIAL_MEM_REGIONS +1 ]; +static size_t nr_regions =NR_INITIAL_MEM_REGIONS ; + +struct mem_region *mem_regions = __initial_mem_regions; + +void memregions_init (struct mem_region regions[],size_t nr) +{ + mem_regions = regions; + nr_regions = nr; +} + +struct mem_region *memregions_add (struct mem_region *r) +{ +struct mem_region *r_next = mem_regions; +int i =0 ; + +for (; r_next->end; ++r_next, ++i) + ; +assert (i < nr_regions); + + *r_next = *r; + +return r_next; +} + +struct mem_region *memregions_find (phys_addr_t paddr) +{ +struct mem_region *r; + +for (r = mem_regions; r->end; ++r) +if (paddr >= r->start && paddr < r->end) +return r; +return NULL ; +} + +uint32_t memregions_get_flags (phys_addr_t paddr) +{ +struct mem_region *r =memregions_find (paddr); + +return r ? r->flags :MR_F_UNKNOWN ; +} + +void memregions_split (phys_addr_t addr,struct mem_region **r1,struct mem_region **r2) +{ + *r1 =memregions_find (addr); +assert (*r1); + +if ((*r1)->start == addr) { + *r2 = *r1; + *r1 =NULL ; +return ; + } + + *r2 =memregions_add (&(struct mem_region ){ + .start = addr, + .end = (*r1)->end, + .flags = (*r1)->flags, + }); + + (*r1)->end = addr; +} + +void memregions_add_dt_regions (size_t max_nr) +{ +struct dt_pbus_reg regs[max_nr]; +int nr_regs, i; + + nr_regs =dt_get_memory_params (regs, max_nr); +assert (nr_regs >0 ); + +for (i =0 ; i < nr_regs; ++i) { +memregions_add (&(struct mem_region ){ + .start = regs[i].addr, + .end = regs[i].addr + regs[i].size, + }); + } +}lib/memregions.h new file +29
-0@@ -0,0 +1,29 @@ +/* SPDX-License-Identifier: GPL-2.0-only */ +#ifndef _MEMREGIONS_H_ +#define _MEMREGIONS_H_ +#include <libcflat.h> +#include <bitops.h> + +#define NR_INITIAL_MEM_REGIONS 8 + +#define MR_F_IO BIT(0) +#define MR_F_CODE BIT(1) +#define MR_F_RESERVED BIT(2) +#define MR_F_UNKNOWN BIT(31) + +struct mem_region { +phys_addr_t start; +phys_addr_t end; +uint32_t flags; +}; + +extern struct mem_region *mem_regions; + +void memregions_init (struct mem_region regions[],size_t nr); +struct mem_region *memregions_add (struct mem_region *r); +struct mem_region *memregions_find (phys_addr_t paddr); +uint32_t memregions_get_flags (phys_addr_t paddr); +void memregions_split (phys_addr_t addr,struct mem_region **r1,struct mem_region **r2); +void memregions_add_dt_regions (size_t max_nr); + +#endif /* _MEMREGIONS_H_ */
Re: Re: [kvm-unit-tests PATCH v2 16/24] arm/arm64: Share memregions
Quoted 3 lines · Eric Auger
Hi Drew,
On 1/26/24 15:23, Andrew Jones wrote:
...
Quoted 25 lines
Quoted 12 lines
lib/arm/setup.c +1
-9-static void mem_regions_add_assumed (void ) -{ -phys_addr_t code_end = (phys_addr_t )(unsigned long )&_etext; -struct mem_region *r; - - r =mem_region_find (code_end -1 ); -assert (r); +struct mem_region *code, *data;/* Split the region with the code into two regions; code and data */ - mem_region_add(&(struct mem_region){ - .start = code_end,lib/arm/setup.c static void cpu_init(void) · line 124
Quoted 10 lines
lib/arm/setup.c +3
-7- .end = r->end, - }); - *r = (struct mem_region ){ - .start = r->start, - .end = code_end, - .flags =MR_F_CODE , - }; +memregions_split ((unsigned long )&_etext, &code, &data); +assert (code); + code->flags |=MR_F_CODE ;I think this would deserve to be split into several patches, esp. this change in the implementation of
Quoted 2 lines
mem_regions_add_assumedand the init changes. At the moment this is pretty difficult to review
Darn, you called me out on this one :-) I had a feeling I should split out the introduction of memregions_split(), since it was sneaking a bit more into the patch than just code motion as advertised, but then I hoped I get away with putting a bit more burden on the reviewer instead. If you haven't already convinced yourself that the new function is equivalent to the old code, then I'll respin with the splitting and also create a new patch for the 'mem_region' to 'memregions' rename while at it (so there will be three patches instead of one). But, if you're already good with it, then I'll leave it as is, since patch splitting is a pain...
Thanks,
drew
Re: [kvm-unit-tests PATCH v2 16/24] arm/arm64: Share memregions
Quoted 32 lines · Andrew Jones
Quoted 3 lines · Eric Auger
Hi Drew,
On 1/26/24 15:23, Andrew Jones wrote:
...
Quoted 25 lines
Quoted 12 lines
lib/arm/setup.c +1
-9-static void mem_regions_add_assumed (void ) -{ -phys_addr_t code_end = (phys_addr_t )(unsigned long )&_etext; -struct mem_region *r; - - r =mem_region_find (code_end -1 ); -assert (r); +struct mem_region *code, *data;/* Split the region with the code into two regions; code and data */ - mem_region_add(&(struct mem_region){ - .start = code_end,lib/arm/setup.c static void cpu_init(void) · line 124
Quoted 10 lines
lib/arm/setup.c +3
-7- .end = r->end, - }); - *r = (struct mem_region ){ - .start = r->start, - .end = code_end, - .flags =MR_F_CODE , - }; +memregions_split ((unsigned long )&_etext, &code, &data); +assert (code); + code->flags |=MR_F_CODE ;I think this would deserve to be split into several patches, esp. this change in the implementation of
Quoted 2 lines
mem_regions_add_assumedand the init changes. At the moment this is pretty difficult to review
Quoted 9 lines
Darn, you called me out on this one :-) I had a feeling I should split out the introduction of
memregions_split(), since it was sneaking a bit more into the patch than just code motion as advertised, but then I hoped I get away with putting a bit more burden on the reviewer instead. If you haven't already convinced yourself that the new function is equivalent to the old code, then I'll respin with the splitting and also create a new patch for the 'mem_region' to 'memregions' rename while at it (so there will be three patches instead of one). But, if you're already good with it, then I'll leave it as is, since patch splitting is a pain...
frankly I would prefer you split. But maybe somebody smarter than me will be able to review as is, maybe just wait a little bit until you respin ;-)
Eric
Quoted 4 lines
Thanks,
drew
PATCH v2 17/24 riscv: Populate memregions and switch to page allocator
In reply to Andrew JonesGet the memory regions from the DT rather than just assuming we have enough. Getting memory regions and setting their flags is also a first step to enabling the MMU. Also switch to the page allocator, which is a second step to enabling the MMU.
--- lib/riscv/asm/memory_areas.h | 1 + lib/riscv/setup.c | 55 ++++++++++++++++++++++++++++++++++-- riscv/Makefile | 2 ++ 3 files changed, 55 insertions(+), 3 deletions(-) create mode 100644 lib/riscv/asm/memory_areas.h
lib/riscv/asm/memory_areas.h new file +1 -0
@@ -0,0 +1 @@ +#include <asm-generic/memory_areas.h>
lib/riscv/setup.c +52 -3
91 lines not on this page · raw message
riscv/Makefile +2 -0
@@ -22,8 +22,10 @@ $(TEST_DIR)/sieve.elf: AUXFLAGS = 0x1 cstart.o = $(TEST_DIR)/cstart.o cflatobjs += lib/alloc.o +cflatobjs += lib/alloc_page.o cflatobjs += lib/alloc_phys.o cflatobjs += lib/devicetree.o +cflatobjs += lib/memregions.o cflatobjs += lib/on-cpus.o cflatobjs += lib/riscv/bitops.o cflatobjs += lib/riscv/io.o
Signature · 1 line
2.43.0
PATCH v2 18/24 riscv: Add MMU support
In reply to Andrew JonesAdd minimal page table defines and functions in order to build page tables and enable the MMU.
--- lib/riscv/asm/csr.h | 1 + lib/riscv/asm/io.h | 3 + lib/riscv/asm/mmu.h | 34 +++++++++ lib/riscv/asm/page.h | 14 ++++ lib/riscv/asm/pgtable.h | 42 +++++++++++ lib/riscv/mmu.c | 150 ++++++++++++++++++++++++++++++++++++++++ lib/riscv/setup.c | 3 + riscv/Makefile | 1 + 8 files changed, 248 insertions(+) create mode 100644 lib/riscv/asm/mmu.h create mode 100644 lib/riscv/asm/pgtable.h create mode 100644 lib/riscv/mmu.c
lib/riscv/asm/csr.h +1 -0
@@ -9,6 +9,7 @@#define CSR_SEPC 0x141#define CSR_SCAUSE 0x142#define CSR_STVAL 0x143 +#define CSR_SATP 0x180/* Exception cause high bit - is an interrupt if set */ #define CAUSE_IRQ_FLAG (_AC(1, UL) << (__riscv_xlen - 1))
lib/riscv/asm/io.h +3 -0
@@ -73,6 +73,9 @@ static inline u64 __raw_readq(const volatile void __iomem *addr) }#endif +#define ioremap ioremap +void __iomem *ioremap (phys_addr_t phys_addr,size_t size); +#include <asm-generic/io.h> #endif /* _ASMRISCV_IO_H_ */
lib/riscv/asm/mmu.h new file +34 -0
@@ -0,0 +1,34 @@ +/* SPDX-License-Identifier: GPL-2.0-only */ +#ifndef _ASMRISCV_MMU_H_ +#define _ASMRISCV_MMU_H_ +#include <libcflat.h> +#include <asm/csr.h> +#include <asm/page.h> +#include <asm/pgtable.h> + +static inline pgd_t *current_pgtable (void ) +{ +return (pgd_t *)((csr_read (CSR_SATP ) &SATP_PPN ) <<PAGE_SHIFT ); +} + +void mmu_set_range_ptes (pgd_t *pgtable,uintptr_t virt_offset, +phys_addr_t phys_start,phys_addr_t phys_end, +pgprot_t prot,bool flush); +void __mmu_enable (unsigned long satp); +void mmu_enable (unsigned long mode,pgd_t *pgtable); +void mmu_disable (void ); + +void setup_mmu (void ); + +static inline void local_flush_tlb_page (unsigned long addr) +{ + asmvolatile ("sfence.vma %0" : :"r" (addr) :"memory" ); +} + +/* +* Get the pte pointer for a virtual address, even if it's not mapped. +* Constructs upper levels of the table as necessary. +*/ +pte_t *get_pte (pgd_t *pgtable,uintptr_t vaddr); + +#endif /* _ASMRISCV_MMU_H_ */
lib/riscv/asm/page.h +14 -0
@@ -2,6 +2,20 @@#ifndef _ASMRISCV_PAGE_H_#define _ASMRISCV_PAGE_H_ +#ifndef __ASSEMBLY__ + +typedef unsigned long pgd_t ; +typedef unsigned long pte_t ; +typedef unsigned long pgprot_t ; +typedef unsigned long pteval_t ; + +#define pte_val (x) ((pteval_t)(x)) +#define pgprot_val (x) ((pteval_t)(x)) +#define __pte (x) ((pte_t)(x)) +#define __pgprot (x) ((pgprot_t)(x)) + +#endif /* !__ASSEMBLY__ */ +#include <asm-generic/page.h> #endif /* _ASMRISCV_PAGE_H_ */
lib/riscv/asm/pgtable.h new file +42 -0
42 lines not on this page · raw message
lib/riscv/mmu.c new file +150 -0
150 lines not on this page · raw message
lib/riscv/setup.c +3 -0
@@ -14,6 +14,7 @@#include <memregions.h> #include <on-cpus.h> #include <asm/csr.h> +#include <asm/mmu.h> #include <asm/page.h> #include <asm/processor.h> #include <asm/setup.h>
@@ -171,5 +172,7 @@ void setup(const void *fdt, phys_addr_t freemem_start)setup_env (env, initrd_size); } +setup_mmu (); +banner (); }
riscv/Makefile +1 -0
@@ -29,6 +29,7 @@ cflatobjs += lib/memregions.o cflatobjs += lib/on-cpus.o cflatobjs += lib/riscv/bitops.o cflatobjs += lib/riscv/io.o +cflatobjs += lib/riscv/mmu.o cflatobjs += lib/riscv/processor.o cflatobjs += lib/riscv/sbi.o cflatobjs += lib/riscv/setup.o
Signature · 1 line
2.43.0
PATCH v2 19/24 riscv: Enable the MMU in secondaries
In reply to Andrew JonesSet each secondary satp to the same as the primary's and enable the MMU when starting. We also change the memalign() to alloc_pages() to prepare for enabling vmalloc_ops. We always want an address for the stack where its virtual address is the same as its physical address, but vmalloc_ops.memalign wouldn't provide that.
--- lib/riscv/asm-offsets.c | 1 + lib/riscv/asm/smp.h | 1 + lib/riscv/smp.c | 7 +++++-- 3 files changed, 7 insertions(+), 2 deletions(-)
lib/riscv/asm-offsets.c +1 -0
@@ -53,6 +53,7 @@ int main(void)OFFSET (PT_ORIG_A0 , pt_regs, orig_a0);DEFINE (PT_SIZE ,sizeof (struct pt_regs )); +OFFSET (SECONDARY_SATP , secondary_data, satp);OFFSET (SECONDARY_STVEC , secondary_data, stvec);OFFSET (SECONDARY_FUNC , secondary_data, func);DEFINE (SECONDARY_DATA_SIZE ,sizeof (struct secondary_data ));
lib/riscv/asm/smp.h +1 -0
@@ -15,6 +15,7 @@ static inline int smp_processor_id(void)typedef void (*secondary_func_t )(void );struct secondary_data { +unsigned long satp;unsigned long stvec;secondary_func_t func; } __attribute__((aligned (16 )));
lib/riscv/smp.c +5 -2
@@ -5,9 +5,10 @@* Copyright (C) 2023, Ventana Micro Systems Inc., Andrew Jones <[email protected]> */ #include <libcflat.h> -#include <alloc.h> +#include <alloc_page.h> #include <cpumask.h> #include <asm/csr.h> +#include <asm/mmu.h> #include <asm/page.h> #include <asm/processor.h> #include <asm/sbi.h>
@@ -23,6 +24,7 @@ secondary_func_t secondary_cinit(struct secondary_data *data) {struct thread_info *info; +__mmu_enable (data->satp);thread_info_init (); info =current_thread_info ();set_cpu_online (info->cpu, true);
@@ -33,10 +35,11 @@ secondary_func_t secondary_cinit(struct secondary_data *data)static void __smp_boot_secondary (int cpu,secondary_func_t func) { -struct secondary_data *sp =memalign (16 ,SZ_8K ) +SZ_8K -16 ; +struct secondary_data *sp =alloc_pages (1 ) +SZ_8K -16 ;struct sbiret ret; sp -=sizeof (struct secondary_data ); + sp->satp =csr_read (CSR_SATP ); sp->stvec =csr_read (CSR_STVEC ); sp->func = func;
Signature · 1 line
2.43.0
PATCH v2 20/24 riscv: Enable vmalloc
In reply to Andrew JonesImplement the functions that vmalloc depends on and let it enable the MMU through setup_vm(). We can now also run the sieve test, so we add it as well.
--- lib/riscv/asm/io.h | 6 +++++ lib/riscv/asm/mmu.h | 2 -- lib/riscv/mmu.c | 57 ++++++++++++++++++++++++++++++++++++++++++++- lib/riscv/setup.c | 16 ++++++++++--- riscv/Makefile | 3 ++- riscv/sieve.c | 1 + 6 files changed, 78 insertions(+), 7 deletions(-) create mode 120000 riscv/sieve.c
lib/riscv/asm/io.h +6 -0
@@ -76,6 +76,12 @@ static inline u64 __raw_readq(const volatile void __iomem *addr)#define ioremap ioremapvoid __iomem *ioremap (phys_addr_t phys_addr,size_t size); +#define virt_to_phys virt_to_phys +unsigned long virt_to_phys (volatile void *address); + +#define phys_to_virt phys_to_virt +void *phys_to_virt (unsigned long address); +#include <asm-generic/io.h> #endif /* _ASMRISCV_IO_H_ */
lib/riscv/asm/mmu.h +0 -2
@@ -18,8 +18,6 @@ void __mmu_enable(unsigned long satp);void mmu_enable (unsigned long mode,pgd_t *pgtable);void mmu_disable (void ); -void setup_mmu (void ); -static inline void local_flush_tlb_page (unsigned long addr) { asmvolatile ("sfence.vma %0" : :"r" (addr) :"memory" );
lib/riscv/mmu.c +56 -1
84 lines not on this page · raw message
lib/riscv/setup.c +13 -3
@@ -9,10 +9,12 @@#include <alloc_page.h> #include <alloc_phys.h> #include <argv.h> +#include <auxinfo.h> #include <cpumask.h> #include <devicetree.h> #include <memregions.h> #include <on-cpus.h> +#include <vmalloc.h> #include <asm/csr.h> #include <asm/mmu.h> #include <asm/page.h>
@@ -20,6 +22,11 @@#include <asm/setup.h> #define VA_BASE ((phys_addr_t)3 * SZ_1G) +#if __riscv_xlen ==64 +#define VA_TOP ((phys_addr_t)4 * SZ_1G) +#else +#define VA_TOP ((phys_addr_t)0) +#endif #define MAX_DT_MEM_REGIONS 16#define NR_MEM_REGIONS (MAX_DT_MEM_REGIONS + 16)
@@ -106,6 +113,8 @@ static void mem_init(phys_addr_t freemem_start) freemem_end =VA_BASE ;assert (freemem_end - freemem_start >=SZ_1M *16 ); +init_alloc_vpage (__va (VA_TOP )); +/* * TODO: Remove the need for this phys allocator dance, since, as we * can see with the assert, we could have gone straight to the page
@@ -137,7 +146,7 @@ void setup(const void *fdt, phys_addr_t freemem_start)int ret;assert (sizeof (long ) ==8 || freemem_start <VA_BASE ); - freemem = (void *)(unsigned long )freemem_start; + freemem =__va (freemem_start);/* Move the FDT to the base of free memory */ fdt_size =fdt_totalsize (fdt);
@@ -156,7 +165,7 @@ void setup(const void *fdt, phys_addr_t freemem_start) freemem += initrd_size; } -mem_init (PAGE_ALIGN ((unsigned long )freemem)); +mem_init (PAGE_ALIGN (__pa (freemem)));cpu_init ();thread_info_init ();io_init ();
@@ -172,7 +181,8 @@ void setup(const void *fdt, phys_addr_t freemem_start)setup_env (env, initrd_size); } -setup_mmu (); +if (!(auxinfo.flags &AUXINFO_MMU_OFF )) +setup_vm ();banner (); }
riscv/Makefile +2 -1
@@ -13,7 +13,7 @@ endif tests = tests += $(TEST_DIR)/sbi.$(exe) tests += $(TEST_DIR)/selftest.$(exe) -#tests += $(TEST_DIR)/sieve.$(exe) +tests += $(TEST_DIR)/sieve.$(exe) all: $(tests)
@@ -27,6 +27,7 @@ cflatobjs += lib/alloc_phys.o cflatobjs += lib/devicetree.o cflatobjs += lib/memregions.o cflatobjs += lib/on-cpus.o +cflatobjs += lib/vmalloc.o cflatobjs += lib/riscv/bitops.o cflatobjs += lib/riscv/io.o cflatobjs += lib/riscv/mmu.o
riscv/sieve.c new file +1 -0
@@ -0,0 +1 @@ +../x86/sieve.c
Signature · 1 line
2.43.0
PATCH v2 21/24 lib: Add strcasecmp and strncasecmp
In reply to Andrew JonesWe'll soon want a case insensitive string comparison. Add toupper() and tolower() too (the latter gets used by the new string functions).
--- lib/ctype.h | 10 ++++++++++ lib/string.c | 14 ++++++++++++++ lib/string.h | 2 ++ 3 files changed, 26 insertions(+)
lib/ctype.h +10 -0
@@ -37,4 +37,14 @@ static inline int isspace(int c) return c == ' ' || c == '\t' || c == '\r' || c == '\n' || c == '\v' || c == '\f'; } +static inline int toupper (int c) +{ +return islower (c) ? c -'a' +'A' : c; +} + +static inline int tolower (int c) +{ +return isupper (c) ? c -'A' +'a' : c; +} +#endif /* _CTYPE_H_ */
lib/string.c +14 -0
@@ -54,11 +54,25 @@ int strncmp(const char *a, const char *b, size_t n)return 0 ; } +int strncasecmp (const char *a,const char *b,size_t n) +{ +for (; n--; ++a, ++b) +if (tolower (*a) !=tolower (*b) || *a =='\0' ) +return tolower (*a) -tolower (*b); + +return 0 ; +} +int strcmp (const char *a,const char *b) {return strncmp (a, b,SIZE_MAX ); } +int strcasecmp (const char *a,const char *b) +{ +return strncasecmp (a, b,SIZE_MAX ); +} +char *strchr (const char *s,int c) {while (*s != (char )c)
lib/string.h +2 -0
@@ -15,6 +15,8 @@ extern char *strcat(char *dest, const char *src);extern char *strcpy (char *dest,const char *src);extern int strcmp (const char *a,const char *b);extern int strncmp (const char *a,const char *b,size_t n); +int strcasecmp (const char *a,const char *b); +int strncasecmp (const char *a,const char *b,size_t n);extern char *strchr (const char *s,int c);extern char *strrchr (const char *s,int c);extern char *strchrnul (const char *s,int c);
Signature · 1 line
2.43.0
Re: [kvm-unit-tests PATCH v2 21/24] lib: Add strcasecmp and strncasecmp
Quoted 6 lines · Andrew Jones
We'll soon want a case insensitive string comparison. Add
toupper()andtolower()too (the latter gets used by the new string functions).Signed-off-by Andrew Jones <[email protected]>Reviewed-by Thomas Huth <[email protected]>Acked-by Thomas Huth <[email protected]>
Eric
Quoted 68 lines
--- lib/ctype.h | 10 ++++++++++ lib/string.c | 14 ++++++++++++++ lib/string.h | 2 ++ 3 files changed, 26 insertions(+)lib/ctype.h +10
-0@@ -37,4 +37,14 @@ static inline int isspace(int c) return c == ' ' || c == '\t' || c == '\r' || c == '\n' || c == '\v' || c == '\f'; } +static inline int toupper (int c) +{ +return islower (c) ? c -'a' +'A' : c; +} + +static inline int tolower (int c) +{ +return isupper (c) ? c -'A' +'a' : c; +} +#endif /* _CTYPE_H_ */ lib/string.c +14
-0@@ -54,11 +54,25 @@ int strncmp(const char *a, const char *b, size_t n)return 0 ; } +int strncasecmp (const char *a,const char *b,size_t n) +{ +for (; n--; ++a, ++b) +if (tolower (*a) !=tolower (*b) || *a =='\0' ) +return tolower (*a) -tolower (*b); + +return 0 ; +} +int strcmp (const char *a,const char *b) {return strncmp (a, b,SIZE_MAX ); } +int strcasecmp (const char *a,const char *b) +{ +return strncasecmp (a, b,SIZE_MAX ); +} +char *strchr (const char *s,int c) {while (*s != (char )c)lib/string.h +2
-0@@ -15,6 +15,8 @@ extern char *strcat(char *dest, const char *src);extern char *strcpy (char *dest,const char *src);extern int strcmp (const char *a,const char *b);extern int strncmp (const char *a,const char *b,size_t n); +int strcasecmp (const char *a,const char *b); +int strncasecmp (const char *a,const char *b,size_t n);extern char *strchr (const char *s,int c);extern char *strrchr (const char *s,int c);extern char *strchrnul (const char *s,int c);
PATCH v2 22/24 riscv: Add isa string parsing
In reply to Andrew JonesWe can probably get away with just assuming several important and popular extensions (at least everything covered by G), but we'll also want to use some extensions which we should ensure are present by parsing the isa string. Add a parser and already apply it to Sstc.
--- lib/riscv/asm/isa.h | 33 ++++++++++ lib/riscv/asm/processor.h | 1 + lib/riscv/isa.c | 126 ++++++++++++++++++++++++++++++++++++++ lib/riscv/processor.c | 2 + riscv/Makefile | 1 + 5 files changed, 163 insertions(+) create mode 100644 lib/riscv/asm/isa.h create mode 100644 lib/riscv/isa.c
lib/riscv/asm/isa.h new file +33 -0
@@ -0,0 +1,33 @@ +/* SPDX-License-Identifier: GPL-2.0-only */ +#ifndef _ASMRISCV_ISA_H_ +#define _ASMRISCV_ISA_H_ +#include <bitops.h> +#include <asm/setup.h> + +/* +* We assume and use several extensions, such as Zicsr and Zifencei. +* Here we only track extensions which we don't assume and the +* framework may want to use. Unit tests may check for extensions +* by name not tracked here with cpu_has_extension_name() +*/ +enum { +ISA_SSTC , +ISA_MAX , +}; +_Static_assert (ISA_MAX <= __riscv_xlen,"Need to increase thread_info.isa" ); + +static inline bool cpu_has_extension (int cpu,int ext) +{ +return test_bit (ext, cpus[cpu].isa); +} + +bool cpu_has_extension_name (int cpu,const char *ext); + +static inline bool has_ext (const char *ext) +{ +return cpu_has_extension_name (current_thread_info ()->cpu, ext); +} + +void isa_init (struct thread_info *info); + +#endif /* _ASMRISCV_ISA_H_ */
lib/riscv/asm/processor.h +1 -0
@@ -11,6 +11,7 @@ typedef void (*exception_fn)(struct pt_regs *);struct thread_info {int cpu;unsigned long hartid; +unsigned long isa[1 ];exception_fn exception_handlers[EXCEPTION_CAUSE_MAX ]; };
lib/riscv/isa.c new file +126 -0
126 lines not on this page · raw message
lib/riscv/processor.c +2 -0
@@ -4,6 +4,7 @@*/ #include <libcflat.h> #include <asm/csr.h> +#include <asm/isa.h> #include <asm/processor.h> #include <asm/setup.h>
@@ -58,5 +59,6 @@ void thread_info_init(void)unsigned long hartid =csr_read (CSR_SSCRATCH );int cpu =hartid_to_cpu (hartid); +isa_init (&cpus[cpu]);csr_write (CSR_SSCRATCH , &cpus[cpu]); }
riscv/Makefile +1 -0
@@ -30,6 +30,7 @@ cflatobjs += lib/on-cpus.o cflatobjs += lib/vmalloc.o cflatobjs += lib/riscv/bitops.o cflatobjs += lib/riscv/io.o +cflatobjs += lib/riscv/isa.o cflatobjs += lib/riscv/mmu.o cflatobjs += lib/riscv/processor.o cflatobjs += lib/riscv/sbi.o
Signature · 1 line
2.43.0
PATCH v2 23/24 gitlab-ci: Add riscv64 tests
In reply to Andrew JonesAdd build/run tests for riscv64. We would also add riscv32, but Fedora doesn't package what we need for that.
--- .gitlab-ci.yml | 17 +++++++++++++++++ 1 file changed, 17 insertions(+)
.gitlab-ci.yml +17 -0
@@ -87,6 +87,23 @@ build-ppc64le: | tee results.txt - if grep -q FAIL results.txt ; then exit 1 ; fi +# build-riscv32: +# Fedora doesn't package a riscv32 compiler for QEMU. Oh, well. + +# Select 'rv64' with PROCESSOR_OVERRIDE in case QEMU is too old to have 'max' +build-riscv64: + extends: .intree_template + script: + - dnf install -y qemu-system-riscv gcc-riscv64-linux-gnu + - ./configure --arch=riscv64 --cross-prefix=riscv64-linux-gnu- + - make -j2 + - printf "FOO=foo\nBAR=bar\nBAZ=baz\nMVENDORID=0\n" >test-env + - PROCESSOR_OVERRIDE=rv64 ACCEL=tcg KVM_UNIT_TESTS_ENV=test-env ./run_tests.sh + selftest + sbi + | tee results.txt + - grep -q PASS results.txt && ! grep -q FAIL results.txt + build-s390x: extends: .outoftree_template script:
Signature · 1 line
2.43.0
PATCH v2 24/24 MAINTAINERS: Add riscv
In reply to Andrew JonesMost of the support for riscv is now in place. Let's make it official and start adding tests!
--- MAINTAINERS | 8 ++++++++ 1 file changed, 8 insertions(+)
MAINTAINERS +8 -0
@@ -94,6 +94,14 @@ F: powerpc/ F: lib/powerpc/ F: lib/ppc64/ +RISCV +M: Andrew Jones <[email protected]> +S: Supported +L: kvm-riscv at lists.infradead.org +F: riscv/ +F: lib/riscv/ +T: https://gitlab.com/jones-drew/kvm-unit-tests.git + S390X M: Janosch Frank <[email protected]> M: Claudio Imbrenda <[email protected]>
Signature · 1 line
2.43.0
Quoted 11 lines · Andrew Jones
v2:
- While basing [1] on this series I found two bugs (one in exception return and another in isa string parsing). I also decided to expose aget_pte()function to unit tests and also an isa-extension-by-name function to check for arbitrary extensions. Finally, I picked up Thomas' gitlab-ci suggestion and his tags.(Having [1] and the selftests running makes me pretty happy with the series, so, unless somebody shouts, I'll merge this sometime next week.)
[1] https://gitlab.com/jones-drew/kvm-unit-tests/-/commit/e9c6c58b1c799de77fd39970b358a7592ecd048f
With the fix for __clzdi2(), the makefile refactoring to add the %.aux.o target, and Eric's tags, I'm pleased to announce that I've created a v3 branch and merged it. Bring on the riscv tests!
Thanks,
drew
Quoted 165 lines
Thanks,
drewOriginal cover letter follows:
This series adds another architecture to kvm-unit-tests (RISC-V, both 32-bit and 64-bit). Much of the code is borrowed from arm/arm64 by mimicking its patterns or by first making the arm code more generic and moving it to the common lib.
This series brings UART, SMP, MMU, and exception handling support. One should be able to start writing CPU validation tests in a mix of C and asm as well as write SBI tests, as is the plan for the SBI verification framework. kvm-unit-tests provides backtraces on asserts and input can be given to the tests through command line arguments, environment variables, and the DT (there's already an ISA string parser for extension detection).
This series only targets QEMU TCG and KVM, but OpenSBI may be replaced with other SBI implementations, such as RustSBI. It's a goal to target bare-metal as soon as possible, so EFI support is already in progress and will be posted soon. More follow on series will come as well, bringing interrupt controller support for timer and PMU testing, support to run tests in usermode, and whatever else people need for their tests.
Andrew Jones (24):
configure: AddARCH_LIBDIR
riscv: Initial port, hello world
arm/arm64: Movecpumask.hto common lib arm/arm64: Share cpu online, present and idle masks
riscv: Add DT parsing
riscv: Add initial SBI support
riscv: Add run script and unittests.cfg
riscv: Add riscv32 support
riscv: Add exception handling
riscv: Add backtrace support
arm/arm64: Generalize wfe/sev names insmp.carm/arm64: Remove spinlocks fromon_cpu_asyncarm/arm64: Shareon_cpus
riscv: Compile with march
riscv: Add SMP support
arm/arm64: Share memregions
riscv: Populate memregions and switch to page allocator
riscv: Add MMU support
riscv: Enable the MMU in secondaries
riscv: Enable vmalloc
lib: Add strcasecmp and strncasecmp
riscv: Add isa string parsing
gitlab-ci: Add riscv64 tests
MAINTAINERS: Add riscv.gitlab-ci.yml | 17 +++ MAINTAINERS | 8 ++ Makefile | 2 +- arm/Makefile.common | 2 + arm/selftest.c | 3 +- configure | 16 +++ lib/arm/asm/gic-v2.h | 2 +- lib/arm/asm/gic-v3.h | 2 +- lib/arm/asm/gic.h | 2 +- lib/arm/asm/setup.h | 14 -- lib/arm/asm/smp.h | 45 +----- lib/arm/mmu.c | 3 +- lib/arm/setup.c | 93 +++---------- lib/arm/smp.c | 135 +----------------- lib/arm64/asm/cpumask.h | 1 - lib/{arm/asm => }/cpumask.h | 42 +++++- lib/ctype.h | 10 ++ lib/elf.h | 11 ++ lib/ldiv32.c | 16 +++ lib/linux/const.h | 2 + lib/memregions.c | 82 +++++++++++ lib/memregions.h | 29 ++++ lib/on-cpus.c | 154 +++++++++++++++++++++ lib/on-cpus.h | 14 ++ lib/riscv/.gitignore | 1 + lib/riscv/asm-offsets.c | 62 +++++++++ lib/riscv/asm/asm-offsets.h | 1 + lib/riscv/asm/barrier.h | 20 +++ lib/riscv/asm/bitops.h | 21 +++ lib/riscv/asm/bug.h | 20 +++ lib/riscv/asm/csr.h | 100 ++++++++++++++ lib/riscv/asm/io.h | 87 ++++++++++++ lib/riscv/asm/isa.h | 33 +++++ lib/riscv/asm/memory_areas.h | 1 + lib/riscv/asm/mmu.h | 32 +++++ lib/riscv/asm/page.h | 21 +++ lib/riscv/asm/pgtable.h | 42 ++++++ lib/riscv/asm/processor.h | 29 ++++ lib/riscv/asm/ptrace.h | 46 +++++++ lib/riscv/asm/sbi.h | 54 ++++++++ lib/riscv/asm/setup.h | 15 ++ lib/riscv/asm/smp.h | 29 ++++ lib/riscv/asm/spinlock.h | 7 + lib/riscv/asm/stack.h | 12 ++ lib/riscv/bitops.c | 47 +++++++ lib/riscv/io.c | 97 +++++++++++++ lib/riscv/isa.c | 126 +++++++++++++++++ lib/riscv/mmu.c | 205 +++++++++++++++++++++++++++ lib/riscv/processor.c | 64 +++++++++ lib/riscv/sbi.c | 40 ++++++ lib/riscv/setup.c | 188 +++++++++++++++++++++++++ lib/riscv/smp.c | 70 ++++++++++ lib/riscv/stack.c | 32 +++++ lib/string.c | 14 ++ lib/string.h | 2 + riscv/Makefile | 106 ++++++++++++++ riscv/cstart.S | 259 +++++++++++++++++++++++++++++++++++ riscv/flat.lds | 75 ++++++++++ riscv/run | 41 ++++++ riscv/sbi.c | 41 ++++++ riscv/selftest.c | 100 ++++++++++++++ riscv/sieve.c | 1 + riscv/unittests.cfg | 37 +++++ 63 files changed, 2616 insertions(+), 267 deletions(-) delete mode 100644 lib/arm64/asm/cpumask.h rename lib/{arm/asm => }/cpumask.h (72%) create mode 100644 lib/memregions.c create mode 100644 lib/memregions.h create mode 100644 lib/on-cpus.c create mode 100644 lib/on-cpus.h create mode 100644 lib/riscv/.gitignore create mode 100644 lib/riscv/asm-offsets.c create mode 100644 lib/riscv/asm/asm-offsets.h create mode 100644 lib/riscv/asm/barrier.h create mode 100644 lib/riscv/asm/bitops.h create mode 100644 lib/riscv/asm/bug.h create mode 100644 lib/riscv/asm/csr.h create mode 100644 lib/riscv/asm/io.h create mode 100644 lib/riscv/asm/isa.h create mode 100644 lib/riscv/asm/memory_areas.h create mode 100644 lib/riscv/asm/mmu.h create mode 100644 lib/riscv/asm/page.h create mode 100644 lib/riscv/asm/pgtable.h create mode 100644 lib/riscv/asm/processor.h create mode 100644 lib/riscv/asm/ptrace.h create mode 100644 lib/riscv/asm/sbi.h create mode 100644 lib/riscv/asm/setup.h create mode 100644 lib/riscv/asm/smp.h create mode 100644 lib/riscv/asm/spinlock.h create mode 100644 lib/riscv/asm/stack.h create mode 100644 lib/riscv/bitops.c create mode 100644 lib/riscv/io.c create mode 100644 lib/riscv/isa.c create mode 100644 lib/riscv/mmu.c create mode 100644 lib/riscv/processor.c create mode 100644 lib/riscv/sbi.c create mode 100644 lib/riscv/setup.c create mode 100644 lib/riscv/smp.c create mode 100644 lib/riscv/stack.c create mode 100644 riscv/Makefile create mode 100644 riscv/cstart.S create mode 100644 riscv/flat.lds create mode 100755 riscv/run create mode 100644 riscv/sbi.c create mode 100644 riscv/selftest.c create mode 120000 riscv/sieve.c create mode 100644 riscv/unittests.cfgSignature · 1 line
2.43.0