ARM: vmlinux.lds.S: do not hardcode cacheline size as 32 bytes
RFC PATCH 1/1 ARM: vmlinux.lds.S: do not hardcode cacheline size as 32 bytes
The linker script assumes a cacheline size of 32 bytes when aligning the .data..cacheline_aligned and .data..percpu sections.
This patch updates the script to use L1_CACHE_BYTES, which should be set to 64 on platforms that require it.
---
I'm posting this as an RFC because, whilst this fixes a bug, it looks like many platforms don't select ARM_L1_CACHE_SHIFT_6 when they should (all Cortex-A8 platforms should select this, for example).
I'd be happy to select ARM_L1_CACHE_SHIFT_6 if CPU_V7, but this doesn't help us for combined v6/v7 kernels...
Answers on a postcard (although email is preferable),
Will
arch/arm/kernel/vmlinux.lds.S | 5 +++-- 1 files changed, 3 insertions(+), 2 deletions(-)
arch/arm/kernel/vmlinux.lds.S +3 -2
@@ -4,6 +4,7 @@ */ #include <asm-generic/vmlinux.lds.h> +#include <asm/cache.h> #include <asm/thread_info.h> #include <asm/memory.h> #include <asm/page.h>
@@ -174,7 +175,7 @@ SECTIONS } #endif - PERCPU_SECTION(32) + PERCPU_SECTION(L1_CACHE_BYTES) #ifdef CONFIG_XIP_KERNEL __data_loc = ALIGN(4); /* location in binary */
@@ -205,7 +206,7 @@ SECTIONS #endif NOSAVE_DATA - CACHELINE_ALIGNED_DATA(32) + CACHELINE_ALIGNED_DATA(L1_CACHE_BYTES) READ_MOSTLY_DATA(32) /*
Signature · 1 line
1.7.4.1
RFC PATCH 1/1 ARM: vmlinux.lds.S: do not hardcode cacheline size as 32 bytes
Quoted 6 lines · Will Deacon
The linker script assumes a cacheline size of 32 bytes when aligning the .data..cacheline_aligned and .data..percpu sections.
This patch updates the script to use
L1_CACHE_BYTES, which should be set to 64 on platforms that require it.
Quoted 6 lines
Signed-off-by Will Deacon <[email protected]>---
I'm posting this as an RFC because, whilst this fixes a bug, it looks like many platforms don't select
ARM_L1_CACHE_SHIFT_6when they should (all Cortex-A8 platforms should select this, for example).
What are the implications of not having cache aligned data? Is it a performance impact or something more?
arch/arm/kernel/vmlinux.lds.S SECTIONS · line 210
Quoted 7 lines
arch/arm/kernel/vmlinux.lds.S +1
-1@@ -205,7 +206,7 @@ SECTIONS #endif NOSAVE_DATA - CACHELINE_ALIGNED_DATA(32) + CACHELINE_ALIGNED_DATA(L1_CACHE_BYTES) READ_MOSTLY_DATA(32)
Does READ_MOSTLY_DATA also need to be cache aligned? At least powerpc is doing that.
Signature · 2 lines
Sent by an employee of the Qualcomm Innovation Center, Inc. The Qualcomm Innovation Center, Inc. is a member of the Code Aurora Forum.
RFC PATCH 1/1 ARM: vmlinux.lds.S: do not hardcode cacheline size as 32 bytes
Hi Stephen,
Quoted 10 lines · Stephen Boyd
Quoted 9 lines · Will Deacon
The linker script assumes a cacheline size of 32 bytes when aligning the .data..cacheline_aligned and .data..percpu sections.
This patch updates the script to use
L1_CACHE_BYTES, which should be set to 64 on platforms that require it.Signed-off-by Will Deacon <[email protected]>---
Quoted 6 lines
Quoted 3 lines
I'm posting this as an RFC because, whilst this fixes a bug, it looks like many platforms don't select
ARM_L1_CACHE_SHIFT_6when they should (all Cortex-A8 platforms should select this, for example).What are the implications of not having cache aligned data? Is it a performance impact or something more?
It's used both for performance reasons but also for correctness. For example, I think that having the line size too small could cause possible misalignment of streaming DMA buffers (see ARCH_DMA_MINALIGN), which could lead to data corruption when we invalidate adjacent data on speculating CPUs.
Quoted 10 lines
arch/arm/kernel/vmlinux.lds.S SECTIONS · line 210
Quoted 7 lines
arch/arm/kernel/vmlinux.lds.S +1
-1@@ -205,7 +206,7 @@ SECTIONS #endif NOSAVE_DATA - CACHELINE_ALIGNED_DATA(32) + CACHELINE_ALIGNED_DATA(L1_CACHE_BYTES) READ_MOSTLY_DATA(32)Does
READ_MOSTLY_DATAalso need to be cache aligned? At least powerpc is doing that.
This is in the optimistion camp but it's probably a good idea since it will help to keep read-mostly data cachelines in the shared state on SMP systems.
The main issue I have with all of this is the lack of platforms selecting the correct shift. Defaulting to 6 would be my preference, but it's hard to tell what to predicate this on (CPU_V6 || CPU_V7 ?).
Will