Add a percpu subsection for cache hot data
Subsystems (9)
v3 cover Add a percpu subsection for cache hot data
Add a new percpu subsection for data that is frequently accessed and exclusive to each processor. This replaces the pcpu_hot struct on x86, and is available to all architectures and the core kernel.
ffffffff834f5000 D __per_cpu_hot_startffffffff834f5000 D hardirq_stack_ptrffffffff834f5008 D __ref_stack_chk_guardffffffff834f5008 D __stack_chk_guardffffffff834f5010 D const_cpu_current_top_of_stackffffffff834f5010 D cpu_current_top_of_stackffffffff834f5018 D const_current_taskffffffff834f5018 D current_taskffffffff834f5020 D __x86_call_depthffffffff834f5028 D this_cpu_offffffffff834f5030 D __preempt_countffffffff834f5034 D cpu_numberffffffff834f5038 D __softirq_pendingffffffff834f503a D hardirq_stack_inuseffffffff834f503b D __per_cpu_hot_padffffffff834f5040 D __per_cpu_hot_end
This applies to the tip/x86/asm branch.
Changes in v3:
- Fix typo of CACHE_HOT_DATA()
- Move hardirq_stack_inuse to irq_64.c
- Add __per_cpu_hot_pad to show the end of the actual data
Brian Gerst (11):
percpu: Introduce percpu hot section
x86/percpu: Move pcpu_hot to percpu hot section x86/preempt: Move preempt count to percpu hot section x86/smp: Move cpu number to percpu hot section x86/retbleed: Move call depth to percpu hot section x86/softirq: Move softirq_pending to percpu hot section x86/irq: Move irq stacks to percpu hot section x86/percpu: Move top_of_stack to percpu hot section x86/percpu: Move current_task to percpu hot section x86/stackprotector: Move __stack_chk_guard to percpu hot section x86/smp: Move this_cpu_off to percpu hot section
arch/x86/entry/entry_32.S | 4 +-- arch/x86/entry/entry_64.S | 6 ++--- arch/x86/entry/entry_64_compat.S | 4 +-- arch/x86/include/asm/current.h | 36 +++++---------------------- arch/x86/include/asm/hardirq.h | 4 +-- arch/x86/include/asm/irq_stack.h | 12 ++++----- arch/x86/include/asm/nospec-branch.h | 11 ++++---- arch/x86/include/asm/percpu.h | 4 +-- arch/x86/include/asm/preempt.h | 25 ++++++++++--------- arch/x86/include/asm/processor.h | 16 ++++++++++-- arch/x86/include/asm/smp.h | 7 +++--- arch/x86/include/asm/stackprotector.h | 2 +- arch/x86/kernel/asm-offsets.c | 5 ---- arch/x86/kernel/cpu/common.c | 25 +++++++++++++------ arch/x86/kernel/dumpstack_32.c | 4 +-- arch/x86/kernel/dumpstack_64.c | 2 +- arch/x86/kernel/head_64.S | 4 +-- arch/x86/kernel/irq.c | 5 ++++ arch/x86/kernel/irq_32.c | 12 +++++---- arch/x86/kernel/irq_64.c | 7 +++--- arch/x86/kernel/process_32.c | 6 ++--- arch/x86/kernel/process_64.c | 6 ++--- arch/x86/kernel/setup_percpu.c | 7 ++++-- arch/x86/kernel/smpboot.c | 4 +-- arch/x86/kernel/vmlinux.lds.S | 6 ++++- arch/x86/lib/retpoline.S | 2 +- include/asm-generic/vmlinux.lds.h | 11 ++++++++ include/linux/percpu-defs.h | 13 ++++++++++ include/linux/preempt.h | 1 + kernel/bpf/verifier.c | 4 +-- scripts/gdb/linux/cpus.py | 2 +- 31 files changed, 146 insertions(+), 111 deletions(-)
base-commit: 693c8502970a533363e9ece482c80bb6db0c12a5
Signature · 1 line
2.48.1
PATCH v3 1/11 percpu: Introduce percpu hot section
Add a subsection to the percpu data for frequently accessed variables that should remain cached on each processor. These varables should not be accessed from other processors to avoid cacheline bouncing.
This will replace the pcpu_hot struct on x86, and open up similar functionality to other architectures and the kernel core.
--- include/asm-generic/vmlinux.lds.h | 11 +++++++++++ include/linux/percpu-defs.h | 13 +++++++++++++ 2 files changed, 24 insertions(+)
include/asm-generic/vmlinux.lds.h +11 -0
@@ -385,6 +385,11 @@ defined(CONFIG_AUTOFDO_CLANG) || defined(CONFIG_PROPELLER_CLANG) . = ALIGN(PAGE_SIZE); \ __nosave_end = .; +#define CACHE_HOT_DATA (align) \ + . = ALIGN(align); \ + *(SORT_BY_ALIGNMENT(.data..hot.*)) \ + . = ALIGN(align); +#define PAGE_ALIGNED_DATA (page_align) \ . = ALIGN(page_align); \ *(.data..page_aligned) \
@@ -1064,6 +1069,11 @@ defined(CONFIG_AUTOFDO_CLANG) || defined(CONFIG_PROPELLER_CLANG) . = ALIGN(PAGE_SIZE); \ *(.data..percpu..page_aligned) \ . = ALIGN(cacheline); \ + __per_cpu_hot_start = .; \ + *(SORT_BY_ALIGNMENT(.data..percpu..hot.*)) \ + __per_cpu_hot_pad = .; \ + . = ALIGN(cacheline); \ + __per_cpu_hot_end = .; \ *(.data..percpu..read_mostly) \ . = ALIGN(cacheline); \ *(.data..percpu) \
@@ -1111,6 +1121,7 @@ defined(CONFIG_AUTOFDO_CLANG) || defined(CONFIG_PROPELLER_CLANG)INIT_TASK_DATA (inittask) \ NOSAVE_DATA \ PAGE_ALIGNED_DATA(pagealigned) \ + CACHE_HOT_DATA(cacheline) \ CACHELINE_ALIGNED_DATA(cacheline) \ READ_MOSTLY_DATA(cacheline) \ DATA_DATA \
include/linux/percpu-defs.h +13 -0
@@ -112,6 +112,19 @@#define DEFINE_PER_CPU (type, name) \ DEFINE_PER_CPU_SECTION(type, name, "") +/* +* Declaration/definition used for per-CPU variables that are frequently +* accessed and should be in a single cacheline. +* +* For use only by architecture and core code. Only use scalar or pointer +* types to maximize density. +*/ +#define DECLARE_PER_CPU_CACHE_HOT (type, name) \ + DECLARE_PER_CPU_SECTION(type, name, "..hot.." #name) + +#define DEFINE_PER_CPU_CACHE_HOT (type, name) \ + DEFINE_PER_CPU_SECTION(type, name, "..hot.." #name) +/* * Declaration/definition used for per-CPU variables that must be cacheline * aligned under SMP conditions so that, whilst a particular instance of the
Signature · 1 line
2.48.1
[tip: x86/core] percpu: Introduce percpu hot section
The following commit has been merged into the x86/core branch of tip:
The following commit has been merged into the x86/core branch of tip:
Commit-ID: 56f91085a914d807477fc90b414998dcd7a0d0c3 Gitweb: https://git.kernel.org/tip/56f91085a914d807477fc90b414998dcd7a0d0c3 Author: Brian Gerst <[email protected]> AuthorDate: Mon, 03 Mar 2025 11:52:36 -05:00 Committer: Ingo Molnar <[email protected]> CommitterDate: Mon, 03 Mar 2025 21:07:16 +01:00
percpu: Introduce percpu hot section
Add a subsection to the percpu data for frequently accessed variables that should remain cached on each processor. These varables should not be accessed from other processors to avoid cacheline bouncing.
This will replace the pcpu_hot struct on x86, and open up similar functionality to other architectures and the kernel core.
--- include/asm-generic/vmlinux.lds.h | 11 +++++++++++ include/linux/percpu-defs.h | 13 +++++++++++++ 2 files changed, 24 insertions(+)
include/asm-generic/vmlinux.lds.h +11 -0
@@ -385,6 +385,11 @@ defined(CONFIG_AUTOFDO_CLANG) || defined(CONFIG_PROPELLER_CLANG) . = ALIGN(PAGE_SIZE); \ __nosave_end = .; +#define CACHE_HOT_DATA (align) \ + . = ALIGN(align); \ + *(SORT_BY_ALIGNMENT(.data..hot.*)) \ + . = ALIGN(align); +#define PAGE_ALIGNED_DATA (page_align) \ . = ALIGN(page_align); \ *(.data..page_aligned) \
@@ -1065,6 +1070,11 @@ defined(CONFIG_AUTOFDO_CLANG) || defined(CONFIG_PROPELLER_CLANG) . = ALIGN(PAGE_SIZE); \ *(.data..percpu..page_aligned) \ . = ALIGN(cacheline); \ + __per_cpu_hot_start = .; \ + *(SORT_BY_ALIGNMENT(.data..percpu..hot.*)) \ + __per_cpu_hot_pad = .; \ + . = ALIGN(cacheline); \ + __per_cpu_hot_end = .; \ *(.data..percpu..read_mostly) \ . = ALIGN(cacheline); \ *(.data..percpu) \
@@ -1112,6 +1122,7 @@ defined(CONFIG_AUTOFDO_CLANG) || defined(CONFIG_PROPELLER_CLANG)INIT_TASK_DATA (inittask) \ NOSAVE_DATA \ PAGE_ALIGNED_DATA(pagealigned) \ + CACHE_HOT_DATA(cacheline) \ CACHELINE_ALIGNED_DATA(cacheline) \ READ_MOSTLY_DATA(cacheline) \ DATA_DATA \
include/linux/percpu-defs.h +13 -0
@@ -113,6 +113,19 @@DEFINE_PER_CPU_SECTION (type, name,"" )/* +* Declaration/definition used for per-CPU variables that are frequently +* accessed and should be in a single cacheline. +* +* For use only by architecture and core code. Only use scalar or pointer +* types to maximize density. + */ +#define DECLARE_PER_CPU_CACHE_HOT (type, name) \ + DECLARE_PER_CPU_SECTION(type, name, "..hot.." #name) + +#define DEFINE_PER_CPU_CACHE_HOT (type, name) \ + DEFINE_PER_CPU_SECTION(type, name, "..hot.." #name) + +/* * Declaration/definition used for per-CPU variables that must be cacheline * aligned under SMP conditions so that, whilst a particular instance of the * data corresponds to a particular CPU, inefficiencies due to direct access by
[tip: x86/core] percpu: Introduce percpu hot section
In reply to Brian GerstThe following commit has been merged into the x86/core branch of tip:
The following commit has been merged into the x86/core branch of tip:
Commit-ID: 120df9cb53f01237fdc4bfc8798d51442fe82311 Gitweb: https://git.kernel.org/tip/120df9cb53f01237fdc4bfc8798d51442fe82311 Author: Brian Gerst <[email protected]> AuthorDate: Mon, 03 Mar 2025 11:52:36 -05:00 Committer: Ingo Molnar <[email protected]> CommitterDate: Tue, 04 Mar 2025 11:24:28 +01:00
percpu: Introduce percpu hot section
Add a subsection to the percpu data for frequently accessed variables that should remain cached on each processor. These varables should not be accessed from other processors to avoid cacheline bouncing.
This will replace the pcpu_hot struct on x86, and open up similar functionality to other architectures and the kernel core.
--- include/asm-generic/vmlinux.lds.h | 11 +++++++++++ include/linux/percpu-defs.h | 13 +++++++++++++ 2 files changed, 24 insertions(+)
include/asm-generic/vmlinux.lds.h +11 -0
@@ -385,6 +385,11 @@ defined(CONFIG_AUTOFDO_CLANG) || defined(CONFIG_PROPELLER_CLANG) . = ALIGN(PAGE_SIZE); \ __nosave_end = .; +#define CACHE_HOT_DATA (align) \ + . = ALIGN(align); \ + *(SORT_BY_ALIGNMENT(.data..hot.*)) \ + . = ALIGN(align); +#define PAGE_ALIGNED_DATA (page_align) \ . = ALIGN(page_align); \ *(.data..page_aligned) \
@@ -1065,6 +1070,11 @@ defined(CONFIG_AUTOFDO_CLANG) || defined(CONFIG_PROPELLER_CLANG) . = ALIGN(PAGE_SIZE); \ *(.data..percpu..page_aligned) \ . = ALIGN(cacheline); \ + __per_cpu_hot_start = .; \ + *(SORT_BY_ALIGNMENT(.data..percpu..hot.*)) \ + __per_cpu_hot_pad = .; \ + . = ALIGN(cacheline); \ + __per_cpu_hot_end = .; \ *(.data..percpu..read_mostly) \ . = ALIGN(cacheline); \ *(.data..percpu) \
@@ -1112,6 +1122,7 @@ defined(CONFIG_AUTOFDO_CLANG) || defined(CONFIG_PROPELLER_CLANG)INIT_TASK_DATA (inittask) \ NOSAVE_DATA \ PAGE_ALIGNED_DATA(pagealigned) \ + CACHE_HOT_DATA(cacheline) \ CACHELINE_ALIGNED_DATA(cacheline) \ READ_MOSTLY_DATA(cacheline) \ DATA_DATA \
include/linux/percpu-defs.h +13 -0
@@ -113,6 +113,19 @@DEFINE_PER_CPU_SECTION (type, name,"" )/* +* Declaration/definition used for per-CPU variables that are frequently +* accessed and should be in a single cacheline. +* +* For use only by architecture and core code. Only use scalar or pointer +* types to maximize density. + */ +#define DECLARE_PER_CPU_CACHE_HOT (type, name) \ + DECLARE_PER_CPU_SECTION(type, name, "..hot.." #name) + +#define DEFINE_PER_CPU_CACHE_HOT (type, name) \ + DEFINE_PER_CPU_SECTION(type, name, "..hot.." #name) + +/* * Declaration/definition used for per-CPU variables that must be cacheline * aligned under SMP conditions so that, whilst a particular instance of the * data corresponds to a particular CPU, inefficiencies due to direct access by
[tip: x86/core] percpu: Introduce percpu hot section
In reply to Brian GerstThe following commit has been merged into the x86/core branch of tip:
The following commit has been merged into the x86/core branch of tip:
Commit-ID: 4c5dee3944eb239e6680167069af594878a91200 Gitweb: https://git.kernel.org/tip/4c5dee3944eb239e6680167069af594878a91200 Author: Brian Gerst <[email protected]> AuthorDate: Mon, 03 Mar 2025 11:52:36 -05:00 Committer: Ingo Molnar <[email protected]> CommitterDate: Tue, 04 Mar 2025 20:18:02 +01:00
percpu: Introduce percpu hot section
Add a subsection to the percpu data for frequently accessed variables that should remain cached on each processor. These varables should not be accessed from other processors to avoid cacheline bouncing.
This will replace the pcpu_hot struct on x86, and open up similar functionality to other architectures and the kernel core.
--- include/asm-generic/vmlinux.lds.h | 11 +++++++++++ include/linux/percpu-defs.h | 13 +++++++++++++ 2 files changed, 24 insertions(+)
include/asm-generic/vmlinux.lds.h +11 -0
@@ -385,6 +385,11 @@ defined(CONFIG_AUTOFDO_CLANG) || defined(CONFIG_PROPELLER_CLANG) . = ALIGN(PAGE_SIZE); \ __nosave_end = .; +#define CACHE_HOT_DATA (align) \ + . = ALIGN(align); \ + *(SORT_BY_ALIGNMENT(.data..hot.*)) \ + . = ALIGN(align); +#define PAGE_ALIGNED_DATA (page_align) \ . = ALIGN(page_align); \ *(.data..page_aligned) \
@@ -1065,6 +1070,11 @@ defined(CONFIG_AUTOFDO_CLANG) || defined(CONFIG_PROPELLER_CLANG) . = ALIGN(PAGE_SIZE); \ *(.data..percpu..page_aligned) \ . = ALIGN(cacheline); \ + __per_cpu_hot_start = .; \ + *(SORT_BY_ALIGNMENT(.data..percpu..hot.*)) \ + __per_cpu_hot_pad = .; \ + . = ALIGN(cacheline); \ + __per_cpu_hot_end = .; \ *(.data..percpu..read_mostly) \ . = ALIGN(cacheline); \ *(.data..percpu) \
@@ -1112,6 +1122,7 @@ defined(CONFIG_AUTOFDO_CLANG) || defined(CONFIG_PROPELLER_CLANG)INIT_TASK_DATA (inittask) \ NOSAVE_DATA \ PAGE_ALIGNED_DATA(pagealigned) \ + CACHE_HOT_DATA(cacheline) \ CACHELINE_ALIGNED_DATA(cacheline) \ READ_MOSTLY_DATA(cacheline) \ DATA_DATA \
include/linux/percpu-defs.h +13 -0
@@ -113,6 +113,19 @@DEFINE_PER_CPU_SECTION (type, name,"" )/* +* Declaration/definition used for per-CPU variables that are frequently +* accessed and should be in a single cacheline. +* +* For use only by architecture and core code. Only use scalar or pointer +* types to maximize density. + */ +#define DECLARE_PER_CPU_CACHE_HOT (type, name) \ + DECLARE_PER_CPU_SECTION(type, name, "..hot.." #name) + +#define DEFINE_PER_CPU_CACHE_HOT (type, name) \ + DEFINE_PER_CPU_SECTION(type, name, "..hot.." #name) + +/* * Declaration/definition used for per-CPU variables that must be cacheline * aligned under SMP conditions so that, whilst a particular instance of the * data corresponds to a particular CPU, inefficiencies due to direct access by
[tip: x86/core] percpu: Introduce percpu hot section
In reply to Brian GerstThe following commit has been merged into the x86/core branch of tip:
The following commit has been merged into the x86/core branch of tip:
Commit-ID: ab2bb9c084f7e3b641ceba91efc33b3adcd1846e Gitweb: https://git.kernel.org/tip/ab2bb9c084f7e3b641ceba91efc33b3adcd1846e Author: Brian Gerst <[email protected]> AuthorDate: Mon, 03 Mar 2025 11:52:36 -05:00 Committer: Ingo Molnar <[email protected]> CommitterDate: Tue, 04 Mar 2025 20:30:33 +01:00
percpu: Introduce percpu hot section
Add a subsection to the percpu data for frequently accessed variables that should remain cached on each processor. These varables should not be accessed from other processors to avoid cacheline bouncing.
This will replace the pcpu_hot struct on x86, and open up similar functionality to other architectures and the kernel core.
--- include/asm-generic/vmlinux.lds.h | 11 +++++++++++ include/linux/percpu-defs.h | 13 +++++++++++++ 2 files changed, 24 insertions(+)
include/asm-generic/vmlinux.lds.h +11 -0
@@ -385,6 +385,11 @@ defined(CONFIG_AUTOFDO_CLANG) || defined(CONFIG_PROPELLER_CLANG) . = ALIGN(PAGE_SIZE); \ __nosave_end = .; +#define CACHE_HOT_DATA (align) \ + . = ALIGN(align); \ + *(SORT_BY_ALIGNMENT(.data..hot.*)) \ + . = ALIGN(align); +#define PAGE_ALIGNED_DATA (page_align) \ . = ALIGN(page_align); \ *(.data..page_aligned) \
@@ -1065,6 +1070,11 @@ defined(CONFIG_AUTOFDO_CLANG) || defined(CONFIG_PROPELLER_CLANG) . = ALIGN(PAGE_SIZE); \ *(.data..percpu..page_aligned) \ . = ALIGN(cacheline); \ + __per_cpu_hot_start = .; \ + *(SORT_BY_ALIGNMENT(.data..percpu..hot.*)) \ + __per_cpu_hot_pad = .; \ + . = ALIGN(cacheline); \ + __per_cpu_hot_end = .; \ *(.data..percpu..read_mostly) \ . = ALIGN(cacheline); \ *(.data..percpu) \
@@ -1112,6 +1122,7 @@ defined(CONFIG_AUTOFDO_CLANG) || defined(CONFIG_PROPELLER_CLANG)INIT_TASK_DATA (inittask) \ NOSAVE_DATA \ PAGE_ALIGNED_DATA(pagealigned) \ + CACHE_HOT_DATA(cacheline) \ CACHELINE_ALIGNED_DATA(cacheline) \ READ_MOSTLY_DATA(cacheline) \ DATA_DATA \
include/linux/percpu-defs.h +13 -0
@@ -113,6 +113,19 @@DEFINE_PER_CPU_SECTION (type, name,"" )/* +* Declaration/definition used for per-CPU variables that are frequently +* accessed and should be in a single cacheline. +* +* For use only by architecture and core code. Only use scalar or pointer +* types to maximize density. + */ +#define DECLARE_PER_CPU_CACHE_HOT (type, name) \ + DECLARE_PER_CPU_SECTION(type, name, "..hot.." #name) + +#define DEFINE_PER_CPU_CACHE_HOT (type, name) \ + DEFINE_PER_CPU_SECTION(type, name, "..hot.." #name) + +/* * Declaration/definition used for per-CPU variables that must be cacheline * aligned under SMP conditions so that, whilst a particular instance of the * data corresponds to a particular CPU, inefficiencies due to direct access by
PATCH v3 2/11 x86/percpu: Move pcpu_hot to percpu hot section
In reply to Brian GerstNo functional change.
--- arch/x86/include/asm/current.h | 28 +++++++++++----------------- arch/x86/kernel/cpu/common.c | 2 +- arch/x86/kernel/vmlinux.lds.S | 3 +++ 3 files changed, 15 insertions(+), 18 deletions(-)
arch/x86/include/asm/current.h +11 -17
@@ -13,32 +13,26 @@struct task_struct ;struct pcpu_hot { -union { -struct { -struct task_struct *current_task; -int preempt_count; -int cpu_number; +struct task_struct *current_task; +int preempt_count; +int cpu_number;#ifdef CONFIG_MITIGATION_CALL_DEPTH_TRACKING -u64 call_depth; +u64 call_depth;#endif -unsigned long top_of_stack; -void *hardirq_stack_ptr; -u16 softirq_pending; +unsigned long top_of_stack; +void *hardirq_stack_ptr; +u16 softirq_pending;#ifdef CONFIG_X86_64 -bool hardirq_stack_inuse; +bool hardirq_stack_inuse;#else -void *softirq_stack_ptr; +void *softirq_stack_ptr;#endif - }; -u8 pad[64 ]; - }; }; -static_assert (sizeof (struct pcpu_hot ) ==64 ); -DECLARE_PER_CPU_ALIGNED(struct pcpu_hot, pcpu_hot); +DECLARE_PER_CPU_CACHE_HOT(struct pcpu_hot, pcpu_hot);/* const-qualified alias to pcpu_hot, aliased by linker. */ -DECLARE_PER_CPU_ALIGNED(const struct pcpu_hot __percpu_seg_override, +DECLARE_PER_CPU_CACHE_HOT(const struct pcpu_hot __percpu_seg_override, const_pcpu_hot); static __always_inline struct task_struct *get_current(void)
arch/x86/kernel/cpu/common.c +1 -1
@@ -2049,7 +2049,7 @@ static __init int setup_setcpuid(char *arg) }__setup ("setcpuid=" , setup_setcpuid); -DEFINE_PER_CPU_ALIGNED(struct pcpu_hot, pcpu_hot) = { +DEFINE_PER_CPU_CACHE_HOT(struct pcpu_hot, pcpu_hot) = { .current_task = &init_task, .preempt_count =INIT_PREEMPT_COUNT , .top_of_stack =TOP_OF_INIT_STACK ,
arch/x86/kernel/vmlinux.lds.S +3 -0
@@ -187,6 +187,8 @@ SECTIONS PAGE_ALIGNED_DATA(PAGE_SIZE) + CACHE_HOT_DATA(L1_CACHE_BYTES) + CACHELINE_ALIGNED_DATA(L1_CACHE_BYTES) DATA_DATA
@@ -328,6 +330,7 @@ SECTIONS } PERCPU_SECTION(INTERNODE_CACHE_BYTES) + ASSERT(__per_cpu_hot_end - __per_cpu_hot_start <= 64, "percpu cache hot section too large") RUNTIME_CONST_VARIABLES RUNTIME_CONST(ptr, USER_PTR_MAX)
Signature · 1 line
2.48.1
[tip: x86/core] x86/percpu: Move pcpu_hot to percpu hot section
The following commit has been merged into the x86/core branch of tip:
The following commit has been merged into the x86/core branch of tip:
Commit-ID: e765b2480bebb2539b5408e3ed3afe6f1a6f23a2 Gitweb: https://git.kernel.org/tip/e765b2480bebb2539b5408e3ed3afe6f1a6f23a2 Author: Brian Gerst <[email protected]> AuthorDate: Mon, 03 Mar 2025 11:52:37 -05:00 Committer: Ingo Molnar <[email protected]> CommitterDate: Mon, 03 Mar 2025 21:37:28 +01:00
x86/percpu: Move pcpu_hot to percpu hot section
Also change the alignment of the percpu hot section:
- PERCPU_SECTION(INTERNODE_CACHE_BYTES)
+ PERCPU_SECTION(L1_CACHE_BYTES)
As vSMP will muck with INTERNODE_CACHE_BYTES that invalidates the too-large-section assert we do:
ASSERT(__per_cpu_hot_end - __per_cpu_hot_start <= 64, "percpu cache hot section too large")
[ mingo: Added INTERNODE_CACHE_BYTES fix & explanation. ]
--- arch/x86/include/asm/current.h | 28 +++++++++++----------------- arch/x86/kernel/cpu/common.c | 2 +- arch/x86/kernel/vmlinux.lds.S | 5 ++++- 3 files changed, 16 insertions(+), 19 deletions(-)
arch/x86/include/asm/current.h +11 -17
@@ -13,32 +13,26 @@struct task_struct ;struct pcpu_hot { -union { -struct { -struct task_struct *current_task; -int preempt_count; -int cpu_number; +struct task_struct *current_task; +int preempt_count; +int cpu_number;#ifdef CONFIG_MITIGATION_CALL_DEPTH_TRACKING -u64 call_depth; +u64 call_depth;#endif -unsigned long top_of_stack; -void *hardirq_stack_ptr; -u16 softirq_pending; +unsigned long top_of_stack; +void *hardirq_stack_ptr; +u16 softirq_pending;#ifdef CONFIG_X86_64 -bool hardirq_stack_inuse; +bool hardirq_stack_inuse;#else -void *softirq_stack_ptr; +void *softirq_stack_ptr;#endif - }; -u8 pad[64 ]; - }; }; -static_assert (sizeof (struct pcpu_hot ) ==64 ); -DECLARE_PER_CPU_ALIGNED(struct pcpu_hot, pcpu_hot); +DECLARE_PER_CPU_CACHE_HOT(struct pcpu_hot, pcpu_hot);/* const-qualified alias to pcpu_hot, aliased by linker. */ -DECLARE_PER_CPU_ALIGNED(const struct pcpu_hot __percpu_seg_override, +DECLARE_PER_CPU_CACHE_HOT(const struct pcpu_hot __percpu_seg_override, const_pcpu_hot); static __always_inline struct task_struct *get_current(void)
arch/x86/kernel/cpu/common.c +1 -1
@@ -2047,7 +2047,7 @@ static __init int setup_setcpuid(char *arg) }__setup ("setcpuid=" , setup_setcpuid); -DEFINE_PER_CPU_ALIGNED(struct pcpu_hot, pcpu_hot) = { +DEFINE_PER_CPU_CACHE_HOT(struct pcpu_hot, pcpu_hot) = { .current_task = &init_task, .preempt_count =INIT_PREEMPT_COUNT , .top_of_stack =TOP_OF_INIT_STACK ,
arch/x86/kernel/vmlinux.lds.S +4 -1
@@ -187,6 +187,8 @@ SECTIONS PAGE_ALIGNED_DATA(PAGE_SIZE) + CACHE_HOT_DATA(L1_CACHE_BYTES) + CACHELINE_ALIGNED_DATA(L1_CACHE_BYTES) DATA_DATA
@@ -327,7 +329,8 @@ SECTIONS EXIT_DATA } - PERCPU_SECTION(INTERNODE_CACHE_BYTES) + PERCPU_SECTION(L1_CACHE_BYTES) + ASSERT(__per_cpu_hot_end - __per_cpu_hot_start <= 64, "percpu cache hot section too large") RUNTIME_CONST_VARIABLES RUNTIME_CONST(ptr, USER_PTR_MAX)
[tip: x86/core] x86/percpu: Move pcpu_hot to percpu hot section
In reply to Brian GerstThe following commit has been merged into the x86/core branch of tip:
The following commit has been merged into the x86/core branch of tip:
Commit-ID: da682fa70c336042f3fff564c2795b2767556ec3 Gitweb: https://git.kernel.org/tip/da682fa70c336042f3fff564c2795b2767556ec3 Author: Brian Gerst <[email protected]> AuthorDate: Mon, 03 Mar 2025 11:52:37 -05:00 Committer: Ingo Molnar <[email protected]> CommitterDate: Tue, 04 Mar 2025 11:24:28 +01:00
x86/percpu: Move pcpu_hot to percpu hot section
Also change the alignment of the percpu hot section:
- PERCPU_SECTION(INTERNODE_CACHE_BYTES)
+ PERCPU_SECTION(L1_CACHE_BYTES)
As vSMP will muck with INTERNODE_CACHE_BYTES that invalidates the too-large-section assert we do:
ASSERT(__per_cpu_hot_end - __per_cpu_hot_start <= 64, "percpu cache hot section too large")
[ mingo: Added INTERNODE_CACHE_BYTES fix & explanation. ]
--- arch/x86/include/asm/current.h | 28 +++++++++++----------------- arch/x86/kernel/cpu/common.c | 2 +- arch/x86/kernel/vmlinux.lds.S | 5 ++++- 3 files changed, 16 insertions(+), 19 deletions(-)
arch/x86/include/asm/current.h +11 -17
@@ -13,32 +13,26 @@struct task_struct ;struct pcpu_hot { -union { -struct { -struct task_struct *current_task; -int preempt_count; -int cpu_number; +struct task_struct *current_task; +int preempt_count; +int cpu_number;#ifdef CONFIG_MITIGATION_CALL_DEPTH_TRACKING -u64 call_depth; +u64 call_depth;#endif -unsigned long top_of_stack; -void *hardirq_stack_ptr; -u16 softirq_pending; +unsigned long top_of_stack; +void *hardirq_stack_ptr; +u16 softirq_pending;#ifdef CONFIG_X86_64 -bool hardirq_stack_inuse; +bool hardirq_stack_inuse;#else -void *softirq_stack_ptr; +void *softirq_stack_ptr;#endif - }; -u8 pad[64 ]; - }; }; -static_assert (sizeof (struct pcpu_hot ) ==64 ); -DECLARE_PER_CPU_ALIGNED(struct pcpu_hot, pcpu_hot); +DECLARE_PER_CPU_CACHE_HOT(struct pcpu_hot, pcpu_hot);/* const-qualified alias to pcpu_hot, aliased by linker. */ -DECLARE_PER_CPU_ALIGNED(const struct pcpu_hot __percpu_seg_override, +DECLARE_PER_CPU_CACHE_HOT(const struct pcpu_hot __percpu_seg_override, const_pcpu_hot); static __always_inline struct task_struct *get_current(void)
arch/x86/kernel/cpu/common.c +1 -1
@@ -2064,7 +2064,7 @@ static __init int setup_setcpuid(char *arg) }__setup ("setcpuid=" , setup_setcpuid); -DEFINE_PER_CPU_ALIGNED(struct pcpu_hot, pcpu_hot) = { +DEFINE_PER_CPU_CACHE_HOT(struct pcpu_hot, pcpu_hot) = { .current_task = &init_task, .preempt_count =INIT_PREEMPT_COUNT , .top_of_stack =TOP_OF_INIT_STACK ,
arch/x86/kernel/vmlinux.lds.S +4 -1
@@ -187,6 +187,8 @@ SECTIONS PAGE_ALIGNED_DATA(PAGE_SIZE) + CACHE_HOT_DATA(L1_CACHE_BYTES) + CACHELINE_ALIGNED_DATA(L1_CACHE_BYTES) DATA_DATA
@@ -327,7 +329,8 @@ SECTIONS EXIT_DATA } - PERCPU_SECTION(INTERNODE_CACHE_BYTES) + PERCPU_SECTION(L1_CACHE_BYTES) + ASSERT(__per_cpu_hot_end - __per_cpu_hot_start <= 64, "percpu cache hot section too large") RUNTIME_CONST_VARIABLES RUNTIME_CONST(ptr, USER_PTR_MAX)
[tip: x86/core] x86/percpu: Move pcpu_hot to percpu hot section
In reply to Brian GerstThe following commit has been merged into the x86/core branch of tip:
The following commit has been merged into the x86/core branch of tip:
Commit-ID: cb6550fd7d3e4e71cb9e6978cc9cea91dcaebd08 Gitweb: https://git.kernel.org/tip/cb6550fd7d3e4e71cb9e6978cc9cea91dcaebd08 Author: Brian Gerst <[email protected]> AuthorDate: Mon, 03 Mar 2025 11:52:37 -05:00 Committer: Ingo Molnar <[email protected]> CommitterDate: Tue, 04 Mar 2025 20:18:02 +01:00
x86/percpu: Move pcpu_hot to percpu hot section
Also change the alignment of the percpu hot section:
- PERCPU_SECTION(INTERNODE_CACHE_BYTES)
+ PERCPU_SECTION(L1_CACHE_BYTES)
As vSMP will muck with INTERNODE_CACHE_BYTES that invalidates the too-large-section assert we do:
ASSERT(__per_cpu_hot_end - __per_cpu_hot_start <= 64, "percpu cache hot section too large")
[ mingo: Added INTERNODE_CACHE_BYTES fix & explanation. ]
--- arch/x86/include/asm/current.h | 28 +++++++++++----------------- arch/x86/kernel/cpu/common.c | 2 +- arch/x86/kernel/vmlinux.lds.S | 5 ++++- 3 files changed, 16 insertions(+), 19 deletions(-)
arch/x86/include/asm/current.h +11 -17
@@ -13,32 +13,26 @@struct task_struct ;struct pcpu_hot { -union { -struct { -struct task_struct *current_task; -int preempt_count; -int cpu_number; +struct task_struct *current_task; +int preempt_count; +int cpu_number;#ifdef CONFIG_MITIGATION_CALL_DEPTH_TRACKING -u64 call_depth; +u64 call_depth;#endif -unsigned long top_of_stack; -void *hardirq_stack_ptr; -u16 softirq_pending; +unsigned long top_of_stack; +void *hardirq_stack_ptr; +u16 softirq_pending;#ifdef CONFIG_X86_64 -bool hardirq_stack_inuse; +bool hardirq_stack_inuse;#else -void *softirq_stack_ptr; +void *softirq_stack_ptr;#endif - }; -u8 pad[64 ]; - }; }; -static_assert (sizeof (struct pcpu_hot ) ==64 ); -DECLARE_PER_CPU_ALIGNED(struct pcpu_hot, pcpu_hot); +DECLARE_PER_CPU_CACHE_HOT(struct pcpu_hot, pcpu_hot);/* const-qualified alias to pcpu_hot, aliased by linker. */ -DECLARE_PER_CPU_ALIGNED(const struct pcpu_hot __percpu_seg_override, +DECLARE_PER_CPU_CACHE_HOT(const struct pcpu_hot __percpu_seg_override, const_pcpu_hot); static __always_inline struct task_struct *get_current(void)
arch/x86/kernel/cpu/common.c +1 -1
@@ -2064,7 +2064,7 @@ static __init int setup_setcpuid(char *arg) }__setup ("setcpuid=" , setup_setcpuid); -DEFINE_PER_CPU_ALIGNED(struct pcpu_hot, pcpu_hot) = { +DEFINE_PER_CPU_CACHE_HOT(struct pcpu_hot, pcpu_hot) = { .current_task = &init_task, .preempt_count =INIT_PREEMPT_COUNT , .top_of_stack =TOP_OF_INIT_STACK ,
arch/x86/kernel/vmlinux.lds.S +4 -1
@@ -187,6 +187,8 @@ SECTIONS PAGE_ALIGNED_DATA(PAGE_SIZE) + CACHE_HOT_DATA(L1_CACHE_BYTES) + CACHELINE_ALIGNED_DATA(L1_CACHE_BYTES) DATA_DATA
@@ -327,7 +329,8 @@ SECTIONS EXIT_DATA } - PERCPU_SECTION(INTERNODE_CACHE_BYTES) + PERCPU_SECTION(L1_CACHE_BYTES) + ASSERT(__per_cpu_hot_end - __per_cpu_hot_start <= 64, "percpu cache hot section too large") RUNTIME_CONST_VARIABLES RUNTIME_CONST(ptr, USER_PTR_MAX)
[tip: x86/core] x86/percpu: Move pcpu_hot to percpu hot section
In reply to Brian GerstThe following commit has been merged into the x86/core branch of tip:
The following commit has been merged into the x86/core branch of tip:
Commit-ID: 972f9cdff924ca53715019b63b4d4aed69d23b1e Gitweb: https://git.kernel.org/tip/972f9cdff924ca53715019b63b4d4aed69d23b1e Author: Brian Gerst <[email protected]> AuthorDate: Mon, 03 Mar 2025 11:52:37 -05:00 Committer: Ingo Molnar <[email protected]> CommitterDate: Tue, 04 Mar 2025 20:30:33 +01:00
x86/percpu: Move pcpu_hot to percpu hot section
Also change the alignment of the percpu hot section:
- PERCPU_SECTION(INTERNODE_CACHE_BYTES)
+ PERCPU_SECTION(L1_CACHE_BYTES)
As vSMP will muck with INTERNODE_CACHE_BYTES that invalidates the too-large-section assert we do:
ASSERT(__per_cpu_hot_end - __per_cpu_hot_start <= 64, "percpu cache hot section too large")
[ mingo: Added INTERNODE_CACHE_BYTES fix & explanation. ]
--- arch/x86/include/asm/current.h | 28 +++++++++++----------------- arch/x86/kernel/cpu/common.c | 2 +- arch/x86/kernel/vmlinux.lds.S | 5 ++++- 3 files changed, 16 insertions(+), 19 deletions(-)
arch/x86/include/asm/current.h +11 -17
@@ -13,32 +13,26 @@struct task_struct ;struct pcpu_hot { -union { -struct { -struct task_struct *current_task; -int preempt_count; -int cpu_number; +struct task_struct *current_task; +int preempt_count; +int cpu_number;#ifdef CONFIG_MITIGATION_CALL_DEPTH_TRACKING -u64 call_depth; +u64 call_depth;#endif -unsigned long top_of_stack; -void *hardirq_stack_ptr; -u16 softirq_pending; +unsigned long top_of_stack; +void *hardirq_stack_ptr; +u16 softirq_pending;#ifdef CONFIG_X86_64 -bool hardirq_stack_inuse; +bool hardirq_stack_inuse;#else -void *softirq_stack_ptr; +void *softirq_stack_ptr;#endif - }; -u8 pad[64 ]; - }; }; -static_assert (sizeof (struct pcpu_hot ) ==64 ); -DECLARE_PER_CPU_ALIGNED(struct pcpu_hot, pcpu_hot); +DECLARE_PER_CPU_CACHE_HOT(struct pcpu_hot, pcpu_hot);/* const-qualified alias to pcpu_hot, aliased by linker. */ -DECLARE_PER_CPU_ALIGNED(const struct pcpu_hot __percpu_seg_override, +DECLARE_PER_CPU_CACHE_HOT(const struct pcpu_hot __percpu_seg_override, const_pcpu_hot); static __always_inline struct task_struct *get_current(void)
arch/x86/kernel/cpu/common.c +1 -1
@@ -2064,7 +2064,7 @@ static __init int setup_setcpuid(char *arg) }__setup ("setcpuid=" , setup_setcpuid); -DEFINE_PER_CPU_ALIGNED(struct pcpu_hot, pcpu_hot) = { +DEFINE_PER_CPU_CACHE_HOT(struct pcpu_hot, pcpu_hot) = { .current_task = &init_task, .preempt_count =INIT_PREEMPT_COUNT , .top_of_stack =TOP_OF_INIT_STACK ,
arch/x86/kernel/vmlinux.lds.S +4 -1
@@ -187,6 +187,8 @@ SECTIONS PAGE_ALIGNED_DATA(PAGE_SIZE) + CACHE_HOT_DATA(L1_CACHE_BYTES) + CACHELINE_ALIGNED_DATA(L1_CACHE_BYTES) DATA_DATA
@@ -327,7 +329,8 @@ SECTIONS EXIT_DATA } - PERCPU_SECTION(INTERNODE_CACHE_BYTES) + PERCPU_SECTION(L1_CACHE_BYTES) + ASSERT(__per_cpu_hot_end - __per_cpu_hot_start <= 64, "percpu cache hot section too large") RUNTIME_CONST_VARIABLES RUNTIME_CONST(ptr, USER_PTR_MAX)
PATCH v3 3/11 x86/preempt: Move preempt count to percpu hot section
In reply to Brian GerstNo functional change.
--- arch/x86/include/asm/current.h | 1 - arch/x86/include/asm/preempt.h | 25 +++++++++++++------------ arch/x86/kernel/cpu/common.c | 4 +++- include/linux/preempt.h | 1 + 4 files changed, 17 insertions(+), 14 deletions(-)
arch/x86/include/asm/current.h +0 -1
@@ -14,7 +14,6 @@ struct task_struct;struct pcpu_hot {struct task_struct *current_task; -int preempt_count;int cpu_number;#ifdef CONFIG_MITIGATION_CALL_DEPTH_TRACKING u64 call_depth;
arch/x86/include/asm/preempt.h +13 -12
@@ -4,10 +4,11 @@#include <asm/rmwcc.h> #include <asm/percpu.h> -#include <asm/current.h> #include <linux/static_call_types.h> +DECLARE_PER_CPU_CACHE_HOT (int, __preempt_count); +/* We use the MSB mostly because its available */ #define PREEMPT_NEED_RESCHED 0x80000000
@@ -23,18 +24,18 @@*/ static __always_inline int preempt_count(void) { -return raw_cpu_read_4 (pcpu_hot.preempt_count) & ~PREEMPT_NEED_RESCHED ; +return raw_cpu_read_4 (__preempt_count) & ~PREEMPT_NEED_RESCHED ; } static __always_inline void preempt_count_set(int pc) {int old, new; - old =raw_cpu_read_4 (pcpu_hot.preempt_count); + old =raw_cpu_read_4 (__preempt_count);do { new = (old &PREEMPT_NEED_RESCHED ) | (pc & ~PREEMPT_NEED_RESCHED ); - }while (!raw_cpu_try_cmpxchg_4 (pcpu_hot.preempt_count, &old, new)); + }while (!raw_cpu_try_cmpxchg_4 (__preempt_count, &old, new)); }/*
@@ -43,7 +44,7 @@ static __always_inline void preempt_count_set(int pc)#define init_task_preempt_count (p) do { } while (0)#define init_idle_preempt_count (p, cpu) do { \ - per_cpu(pcpu_hot.preempt_count, (cpu)) = PREEMPT_DISABLED; \ + per_cpu(__preempt_count, (cpu)) = PREEMPT_DISABLED; \ } while (0)/*
@@ -57,17 +58,17 @@ static __always_inline void preempt_count_set(int pc) static __always_inline void set_preempt_need_resched(void) { -raw_cpu_and_4 (pcpu_hot.preempt_count, ~PREEMPT_NEED_RESCHED ); +raw_cpu_and_4 (__preempt_count, ~PREEMPT_NEED_RESCHED ); } static __always_inline void clear_preempt_need_resched(void) { -raw_cpu_or_4 (pcpu_hot.preempt_count,PREEMPT_NEED_RESCHED ); +raw_cpu_or_4 (__preempt_count,PREEMPT_NEED_RESCHED ); } static __always_inline bool test_preempt_need_resched(void) { -return !(raw_cpu_read_4 (pcpu_hot.preempt_count) &PREEMPT_NEED_RESCHED ); +return !(raw_cpu_read_4 (__preempt_count) &PREEMPT_NEED_RESCHED ); }/*
@@ -76,12 +77,12 @@ static __always_inline bool test_preempt_need_resched(void) static __always_inline void __preempt_count_add(int val) { -raw_cpu_add_4 (pcpu_hot.preempt_count, val); +raw_cpu_add_4 (__preempt_count, val); } static __always_inline void __preempt_count_sub(int val) { -raw_cpu_add_4 (pcpu_hot.preempt_count, -val); +raw_cpu_add_4 (__preempt_count, -val); }/*
@@ -91,7 +92,7 @@ static __always_inline void __preempt_count_sub(int val)*/ static __always_inline bool __preempt_count_dec_and_test(void) { -return GEN_UNARY_RMWcc ("decl" ,__my_cpu_var (pcpu_hot.preempt_count), e, +return GEN_UNARY_RMWcc ("decl" ,__my_cpu_var (__preempt_count), e, __percpu_arg([var])); }
@@ -100,7 +101,7 @@ static __always_inline bool __preempt_count_dec_and_test(void)*/ static __always_inline bool should_resched(int preempt_offset) { -return unlikely (raw_cpu_read_4 (pcpu_hot.preempt_count) == preempt_offset); +return unlikely (raw_cpu_read_4 (__preempt_count) == preempt_offset); }#ifdef CONFIG_PREEMPTION
arch/x86/kernel/cpu/common.c +3 -1
@@ -2051,12 +2051,14 @@ __setup("setcpuid=", setup_setcpuid); DEFINE_PER_CPU_CACHE_HOT(struct pcpu_hot, pcpu_hot) = { .current_task = &init_task, - .preempt_count =INIT_PREEMPT_COUNT , .top_of_stack =TOP_OF_INIT_STACK , };EXPORT_PER_CPU_SYMBOL (pcpu_hot);EXPORT_PER_CPU_SYMBOL (const_pcpu_hot); +DEFINE_PER_CPU_CACHE_HOT (int, __preempt_count) =INIT_PREEMPT_COUNT ; +EXPORT_PER_CPU_SYMBOL (__preempt_count); +#ifdef CONFIG_X86_64 static void wrmsrl_cstar (unsigned long val) {
include/linux/preempt.h +1 -0
@@ -319,6 +319,7 @@ do { \#ifdef CONFIG_PREEMPT_NOTIFIERS struct preempt_notifier ; +struct task_struct ;/** * preempt_ops - notifiers called when a task is preempted and rescheduled
Signature · 1 line
2.48.1
[tip: x86/core] x86/preempt: Move preempt count to percpu hot section
The following commit has been merged into the x86/core branch of tip:
The following commit has been merged into the x86/core branch of tip:
Commit-ID: 4f2b419dd00eddd34952966a38c78892cd7c5715 Gitweb: https://git.kernel.org/tip/4f2b419dd00eddd34952966a38c78892cd7c5715 Author: Brian Gerst <[email protected]> AuthorDate: Mon, 03 Mar 2025 11:52:38 -05:00 Committer: Ingo Molnar <[email protected]> CommitterDate: Mon, 03 Mar 2025 21:37:41 +01:00
x86/preempt: Move preempt count to percpu hot section
No functional change.
--- arch/x86/include/asm/current.h | 1 - arch/x86/include/asm/preempt.h | 25 +++++++++++++------------ arch/x86/kernel/cpu/common.c | 4 +++- include/linux/preempt.h | 1 + 4 files changed, 17 insertions(+), 14 deletions(-)
arch/x86/include/asm/current.h +0 -1
@@ -14,7 +14,6 @@ struct task_struct;struct pcpu_hot {struct task_struct *current_task; -int preempt_count;int cpu_number;#ifdef CONFIG_MITIGATION_CALL_DEPTH_TRACKING u64 call_depth;
arch/x86/include/asm/preempt.h +13 -12
@@ -4,10 +4,11 @@#include <asm/rmwcc.h> #include <asm/percpu.h> -#include <asm/current.h> #include <linux/static_call_types.h> +DECLARE_PER_CPU_CACHE_HOT (int, __preempt_count); +/* We use the MSB mostly because its available */ #define PREEMPT_NEED_RESCHED 0x80000000
@@ -23,18 +24,18 @@*/ static __always_inline int preempt_count(void) { -return raw_cpu_read_4 (pcpu_hot.preempt_count) & ~PREEMPT_NEED_RESCHED ; +return raw_cpu_read_4 (__preempt_count) & ~PREEMPT_NEED_RESCHED ; } static __always_inline void preempt_count_set(int pc) {int old, new; - old =raw_cpu_read_4 (pcpu_hot.preempt_count); + old =raw_cpu_read_4 (__preempt_count);do { new = (old &PREEMPT_NEED_RESCHED ) | (pc & ~PREEMPT_NEED_RESCHED ); - }while (!raw_cpu_try_cmpxchg_4 (pcpu_hot.preempt_count, &old, new)); + }while (!raw_cpu_try_cmpxchg_4 (__preempt_count, &old, new)); }/*
@@ -43,7 +44,7 @@ static __always_inline void preempt_count_set(int pc)#define init_task_preempt_count (p) do { } while (0)#define init_idle_preempt_count (p, cpu) do { \ - per_cpu(pcpu_hot.preempt_count, (cpu)) = PREEMPT_DISABLED; \ + per_cpu(__preempt_count, (cpu)) = PREEMPT_DISABLED; \ } while (0)/*
@@ -57,17 +58,17 @@ static __always_inline void preempt_count_set(int pc) static __always_inline void set_preempt_need_resched(void) { -raw_cpu_and_4 (pcpu_hot.preempt_count, ~PREEMPT_NEED_RESCHED ); +raw_cpu_and_4 (__preempt_count, ~PREEMPT_NEED_RESCHED ); } static __always_inline void clear_preempt_need_resched(void) { -raw_cpu_or_4 (pcpu_hot.preempt_count,PREEMPT_NEED_RESCHED ); +raw_cpu_or_4 (__preempt_count,PREEMPT_NEED_RESCHED ); } static __always_inline bool test_preempt_need_resched(void) { -return !(raw_cpu_read_4 (pcpu_hot.preempt_count) &PREEMPT_NEED_RESCHED ); +return !(raw_cpu_read_4 (__preempt_count) &PREEMPT_NEED_RESCHED ); }/*
@@ -76,12 +77,12 @@ static __always_inline bool test_preempt_need_resched(void) static __always_inline void __preempt_count_add(int val) { -raw_cpu_add_4 (pcpu_hot.preempt_count, val); +raw_cpu_add_4 (__preempt_count, val); } static __always_inline void __preempt_count_sub(int val) { -raw_cpu_add_4 (pcpu_hot.preempt_count, -val); +raw_cpu_add_4 (__preempt_count, -val); }/*
@@ -91,7 +92,7 @@ static __always_inline void __preempt_count_sub(int val)*/ static __always_inline bool __preempt_count_dec_and_test(void) { -return GEN_UNARY_RMWcc ("decl" ,__my_cpu_var (pcpu_hot.preempt_count), e, +return GEN_UNARY_RMWcc ("decl" ,__my_cpu_var (__preempt_count), e, __percpu_arg([var])); }
@@ -100,7 +101,7 @@ static __always_inline bool __preempt_count_dec_and_test(void)*/ static __always_inline bool should_resched(int preempt_offset) { -return unlikely (raw_cpu_read_4 (pcpu_hot.preempt_count) == preempt_offset); +return unlikely (raw_cpu_read_4 (__preempt_count) == preempt_offset); }#ifdef CONFIG_PREEMPTION
arch/x86/kernel/cpu/common.c +3 -1
@@ -2049,12 +2049,14 @@ __setup("setcpuid=", setup_setcpuid); DEFINE_PER_CPU_CACHE_HOT(struct pcpu_hot, pcpu_hot) = { .current_task = &init_task, - .preempt_count =INIT_PREEMPT_COUNT , .top_of_stack =TOP_OF_INIT_STACK , };EXPORT_PER_CPU_SYMBOL (pcpu_hot);EXPORT_PER_CPU_SYMBOL (const_pcpu_hot); +DEFINE_PER_CPU_CACHE_HOT (int, __preempt_count) =INIT_PREEMPT_COUNT ; +EXPORT_PER_CPU_SYMBOL (__preempt_count); +#ifdef CONFIG_X86_64 static void wrmsrl_cstar (unsigned long val) {
include/linux/preempt.h +1 -0
@@ -319,6 +319,7 @@ do { \#ifdef CONFIG_PREEMPT_NOTIFIERS struct preempt_notifier ; +struct task_struct ;/** * preempt_ops - notifiers called when a task is preempted and rescheduled
[tip: x86/core] x86/preempt: Move preempt count to percpu hot section
In reply to Brian GerstThe following commit has been merged into the x86/core branch of tip:
The following commit has been merged into the x86/core branch of tip:
Commit-ID: 8887199b22241c5bbc7d79e502155b35546405ce Gitweb: https://git.kernel.org/tip/8887199b22241c5bbc7d79e502155b35546405ce Author: Brian Gerst <[email protected]> AuthorDate: Mon, 03 Mar 2025 11:52:38 -05:00 Committer: Ingo Molnar <[email protected]> CommitterDate: Tue, 04 Mar 2025 11:24:28 +01:00
x86/preempt: Move preempt count to percpu hot section
No functional change.
--- arch/x86/include/asm/current.h | 1 - arch/x86/include/asm/preempt.h | 25 +++++++++++++------------ arch/x86/kernel/cpu/common.c | 4 +++- include/linux/preempt.h | 1 + 4 files changed, 17 insertions(+), 14 deletions(-)
arch/x86/include/asm/current.h +0 -1
@@ -14,7 +14,6 @@ struct task_struct;struct pcpu_hot {struct task_struct *current_task; -int preempt_count;int cpu_number;#ifdef CONFIG_MITIGATION_CALL_DEPTH_TRACKING u64 call_depth;
arch/x86/include/asm/preempt.h +13 -12
@@ -4,10 +4,11 @@#include <asm/rmwcc.h> #include <asm/percpu.h> -#include <asm/current.h> #include <linux/static_call_types.h> +DECLARE_PER_CPU_CACHE_HOT (int, __preempt_count); +/* We use the MSB mostly because its available */ #define PREEMPT_NEED_RESCHED 0x80000000
@@ -23,18 +24,18 @@*/ static __always_inline int preempt_count(void) { -return raw_cpu_read_4 (pcpu_hot.preempt_count) & ~PREEMPT_NEED_RESCHED ; +return raw_cpu_read_4 (__preempt_count) & ~PREEMPT_NEED_RESCHED ; } static __always_inline void preempt_count_set(int pc) {int old, new; - old =raw_cpu_read_4 (pcpu_hot.preempt_count); + old =raw_cpu_read_4 (__preempt_count);do { new = (old &PREEMPT_NEED_RESCHED ) | (pc & ~PREEMPT_NEED_RESCHED ); - }while (!raw_cpu_try_cmpxchg_4 (pcpu_hot.preempt_count, &old, new)); + }while (!raw_cpu_try_cmpxchg_4 (__preempt_count, &old, new)); }/*
@@ -43,7 +44,7 @@ static __always_inline void preempt_count_set(int pc)#define init_task_preempt_count (p) do { } while (0)#define init_idle_preempt_count (p, cpu) do { \ - per_cpu(pcpu_hot.preempt_count, (cpu)) = PREEMPT_DISABLED; \ + per_cpu(__preempt_count, (cpu)) = PREEMPT_DISABLED; \ } while (0)/*
@@ -57,17 +58,17 @@ static __always_inline void preempt_count_set(int pc) static __always_inline void set_preempt_need_resched(void) { -raw_cpu_and_4 (pcpu_hot.preempt_count, ~PREEMPT_NEED_RESCHED ); +raw_cpu_and_4 (__preempt_count, ~PREEMPT_NEED_RESCHED ); } static __always_inline void clear_preempt_need_resched(void) { -raw_cpu_or_4 (pcpu_hot.preempt_count,PREEMPT_NEED_RESCHED ); +raw_cpu_or_4 (__preempt_count,PREEMPT_NEED_RESCHED ); } static __always_inline bool test_preempt_need_resched(void) { -return !(raw_cpu_read_4 (pcpu_hot.preempt_count) &PREEMPT_NEED_RESCHED ); +return !(raw_cpu_read_4 (__preempt_count) &PREEMPT_NEED_RESCHED ); }/*
@@ -76,12 +77,12 @@ static __always_inline bool test_preempt_need_resched(void) static __always_inline void __preempt_count_add(int val) { -raw_cpu_add_4 (pcpu_hot.preempt_count, val); +raw_cpu_add_4 (__preempt_count, val); } static __always_inline void __preempt_count_sub(int val) { -raw_cpu_add_4 (pcpu_hot.preempt_count, -val); +raw_cpu_add_4 (__preempt_count, -val); }/*
@@ -91,7 +92,7 @@ static __always_inline void __preempt_count_sub(int val)*/ static __always_inline bool __preempt_count_dec_and_test(void) { -return GEN_UNARY_RMWcc ("decl" ,__my_cpu_var (pcpu_hot.preempt_count), e, +return GEN_UNARY_RMWcc ("decl" ,__my_cpu_var (__preempt_count), e, __percpu_arg([var])); }
@@ -100,7 +101,7 @@ static __always_inline bool __preempt_count_dec_and_test(void)*/ static __always_inline bool should_resched(int preempt_offset) { -return unlikely (raw_cpu_read_4 (pcpu_hot.preempt_count) == preempt_offset); +return unlikely (raw_cpu_read_4 (__preempt_count) == preempt_offset); }#ifdef CONFIG_PREEMPTION
arch/x86/kernel/cpu/common.c +3 -1
@@ -2066,12 +2066,14 @@ __setup("setcpuid=", setup_setcpuid); DEFINE_PER_CPU_CACHE_HOT(struct pcpu_hot, pcpu_hot) = { .current_task = &init_task, - .preempt_count =INIT_PREEMPT_COUNT , .top_of_stack =TOP_OF_INIT_STACK , };EXPORT_PER_CPU_SYMBOL (pcpu_hot);EXPORT_PER_CPU_SYMBOL (const_pcpu_hot); +DEFINE_PER_CPU_CACHE_HOT (int, __preempt_count) =INIT_PREEMPT_COUNT ; +EXPORT_PER_CPU_SYMBOL (__preempt_count); +#ifdef CONFIG_X86_64 static void wrmsrl_cstar (unsigned long val) {
include/linux/preempt.h +1 -0
@@ -319,6 +319,7 @@ do { \#ifdef CONFIG_PREEMPT_NOTIFIERS struct preempt_notifier ; +struct task_struct ;/** * preempt_ops - notifiers called when a task is preempted and rescheduled
[tip: x86/core] x86/preempt: Move preempt count to percpu hot section
In reply to Brian GerstThe following commit has been merged into the x86/core branch of tip:
The following commit has been merged into the x86/core branch of tip:
Commit-ID: d6bb8b60e0c2be9fb311d6f6ce2530e3dd177450 Gitweb: https://git.kernel.org/tip/d6bb8b60e0c2be9fb311d6f6ce2530e3dd177450 Author: Brian Gerst <[email protected]> AuthorDate: Mon, 03 Mar 2025 11:52:38 -05:00 Committer: Ingo Molnar <[email protected]> CommitterDate: Tue, 04 Mar 2025 20:18:02 +01:00
x86/preempt: Move preempt count to percpu hot section
No functional change.
--- arch/x86/include/asm/current.h | 1 - arch/x86/include/asm/preempt.h | 25 +++++++++++++------------ arch/x86/kernel/cpu/common.c | 4 +++- include/linux/preempt.h | 1 + 4 files changed, 17 insertions(+), 14 deletions(-)
arch/x86/include/asm/current.h +0 -1
@@ -14,7 +14,6 @@ struct task_struct;struct pcpu_hot {struct task_struct *current_task; -int preempt_count;int cpu_number;#ifdef CONFIG_MITIGATION_CALL_DEPTH_TRACKING u64 call_depth;
arch/x86/include/asm/preempt.h +13 -12
@@ -4,10 +4,11 @@#include <asm/rmwcc.h> #include <asm/percpu.h> -#include <asm/current.h> #include <linux/static_call_types.h> +DECLARE_PER_CPU_CACHE_HOT (int, __preempt_count); +/* We use the MSB mostly because its available */ #define PREEMPT_NEED_RESCHED 0x80000000
@@ -23,18 +24,18 @@*/ static __always_inline int preempt_count(void) { -return raw_cpu_read_4 (pcpu_hot.preempt_count) & ~PREEMPT_NEED_RESCHED ; +return raw_cpu_read_4 (__preempt_count) & ~PREEMPT_NEED_RESCHED ; } static __always_inline void preempt_count_set(int pc) {int old, new; - old =raw_cpu_read_4 (pcpu_hot.preempt_count); + old =raw_cpu_read_4 (__preempt_count);do { new = (old &PREEMPT_NEED_RESCHED ) | (pc & ~PREEMPT_NEED_RESCHED ); - }while (!raw_cpu_try_cmpxchg_4 (pcpu_hot.preempt_count, &old, new)); + }while (!raw_cpu_try_cmpxchg_4 (__preempt_count, &old, new)); }/*
@@ -43,7 +44,7 @@ static __always_inline void preempt_count_set(int pc)#define init_task_preempt_count (p) do { } while (0)#define init_idle_preempt_count (p, cpu) do { \ - per_cpu(pcpu_hot.preempt_count, (cpu)) = PREEMPT_DISABLED; \ + per_cpu(__preempt_count, (cpu)) = PREEMPT_DISABLED; \ } while (0)/*
@@ -57,17 +58,17 @@ static __always_inline void preempt_count_set(int pc) static __always_inline void set_preempt_need_resched(void) { -raw_cpu_and_4 (pcpu_hot.preempt_count, ~PREEMPT_NEED_RESCHED ); +raw_cpu_and_4 (__preempt_count, ~PREEMPT_NEED_RESCHED ); } static __always_inline void clear_preempt_need_resched(void) { -raw_cpu_or_4 (pcpu_hot.preempt_count,PREEMPT_NEED_RESCHED ); +raw_cpu_or_4 (__preempt_count,PREEMPT_NEED_RESCHED ); } static __always_inline bool test_preempt_need_resched(void) { -return !(raw_cpu_read_4 (pcpu_hot.preempt_count) &PREEMPT_NEED_RESCHED ); +return !(raw_cpu_read_4 (__preempt_count) &PREEMPT_NEED_RESCHED ); }/*
@@ -76,12 +77,12 @@ static __always_inline bool test_preempt_need_resched(void) static __always_inline void __preempt_count_add(int val) { -raw_cpu_add_4 (pcpu_hot.preempt_count, val); +raw_cpu_add_4 (__preempt_count, val); } static __always_inline void __preempt_count_sub(int val) { -raw_cpu_add_4 (pcpu_hot.preempt_count, -val); +raw_cpu_add_4 (__preempt_count, -val); }/*
@@ -91,7 +92,7 @@ static __always_inline void __preempt_count_sub(int val)*/ static __always_inline bool __preempt_count_dec_and_test(void) { -return GEN_UNARY_RMWcc ("decl" ,__my_cpu_var (pcpu_hot.preempt_count), e, +return GEN_UNARY_RMWcc ("decl" ,__my_cpu_var (__preempt_count), e, __percpu_arg([var])); }
@@ -100,7 +101,7 @@ static __always_inline bool __preempt_count_dec_and_test(void)*/ static __always_inline bool should_resched(int preempt_offset) { -return unlikely (raw_cpu_read_4 (pcpu_hot.preempt_count) == preempt_offset); +return unlikely (raw_cpu_read_4 (__preempt_count) == preempt_offset); }#ifdef CONFIG_PREEMPTION
arch/x86/kernel/cpu/common.c +3 -1
@@ -2066,12 +2066,14 @@ __setup("setcpuid=", setup_setcpuid); DEFINE_PER_CPU_CACHE_HOT(struct pcpu_hot, pcpu_hot) = { .current_task = &init_task, - .preempt_count =INIT_PREEMPT_COUNT , .top_of_stack =TOP_OF_INIT_STACK , };EXPORT_PER_CPU_SYMBOL (pcpu_hot);EXPORT_PER_CPU_SYMBOL (const_pcpu_hot); +DEFINE_PER_CPU_CACHE_HOT (int, __preempt_count) =INIT_PREEMPT_COUNT ; +EXPORT_PER_CPU_SYMBOL (__preempt_count); +#ifdef CONFIG_X86_64 static void wrmsrl_cstar (unsigned long val) {
include/linux/preempt.h +1 -0
@@ -319,6 +319,7 @@ do { \#ifdef CONFIG_PREEMPT_NOTIFIERS struct preempt_notifier ; +struct task_struct ;/** * preempt_ops - notifiers called when a task is preempted and rescheduled
[tip: x86/core] x86/preempt: Move preempt count to percpu hot section
In reply to Brian GerstThe following commit has been merged into the x86/core branch of tip:
The following commit has been merged into the x86/core branch of tip:
Commit-ID: 46e8fff6d45fe44cb0939c9339b6d5936551b1e4 Gitweb: https://git.kernel.org/tip/46e8fff6d45fe44cb0939c9339b6d5936551b1e4 Author: Brian Gerst <[email protected]> AuthorDate: Mon, 03 Mar 2025 11:52:38 -05:00 Committer: Ingo Molnar <[email protected]> CommitterDate: Tue, 04 Mar 2025 20:30:33 +01:00
x86/preempt: Move preempt count to percpu hot section
No functional change.
--- arch/x86/include/asm/current.h | 1 - arch/x86/include/asm/preempt.h | 25 +++++++++++++------------ arch/x86/kernel/cpu/common.c | 4 +++- include/linux/preempt.h | 1 + 4 files changed, 17 insertions(+), 14 deletions(-)
arch/x86/include/asm/current.h +0 -1
@@ -14,7 +14,6 @@ struct task_struct;struct pcpu_hot {struct task_struct *current_task; -int preempt_count;int cpu_number;#ifdef CONFIG_MITIGATION_CALL_DEPTH_TRACKING u64 call_depth;
arch/x86/include/asm/preempt.h +13 -12
@@ -4,10 +4,11 @@#include <asm/rmwcc.h> #include <asm/percpu.h> -#include <asm/current.h> #include <linux/static_call_types.h> +DECLARE_PER_CPU_CACHE_HOT (int, __preempt_count); +/* We use the MSB mostly because its available */ #define PREEMPT_NEED_RESCHED 0x80000000
@@ -23,18 +24,18 @@*/ static __always_inline int preempt_count(void) { -return raw_cpu_read_4 (pcpu_hot.preempt_count) & ~PREEMPT_NEED_RESCHED ; +return raw_cpu_read_4 (__preempt_count) & ~PREEMPT_NEED_RESCHED ; } static __always_inline void preempt_count_set(int pc) {int old, new; - old =raw_cpu_read_4 (pcpu_hot.preempt_count); + old =raw_cpu_read_4 (__preempt_count);do { new = (old &PREEMPT_NEED_RESCHED ) | (pc & ~PREEMPT_NEED_RESCHED ); - }while (!raw_cpu_try_cmpxchg_4 (pcpu_hot.preempt_count, &old, new)); + }while (!raw_cpu_try_cmpxchg_4 (__preempt_count, &old, new)); }/*
@@ -43,7 +44,7 @@ static __always_inline void preempt_count_set(int pc)#define init_task_preempt_count (p) do { } while (0)#define init_idle_preempt_count (p, cpu) do { \ - per_cpu(pcpu_hot.preempt_count, (cpu)) = PREEMPT_DISABLED; \ + per_cpu(__preempt_count, (cpu)) = PREEMPT_DISABLED; \ } while (0)/*
@@ -57,17 +58,17 @@ static __always_inline void preempt_count_set(int pc) static __always_inline void set_preempt_need_resched(void) { -raw_cpu_and_4 (pcpu_hot.preempt_count, ~PREEMPT_NEED_RESCHED ); +raw_cpu_and_4 (__preempt_count, ~PREEMPT_NEED_RESCHED ); } static __always_inline void clear_preempt_need_resched(void) { -raw_cpu_or_4 (pcpu_hot.preempt_count,PREEMPT_NEED_RESCHED ); +raw_cpu_or_4 (__preempt_count,PREEMPT_NEED_RESCHED ); } static __always_inline bool test_preempt_need_resched(void) { -return !(raw_cpu_read_4 (pcpu_hot.preempt_count) &PREEMPT_NEED_RESCHED ); +return !(raw_cpu_read_4 (__preempt_count) &PREEMPT_NEED_RESCHED ); }/*
@@ -76,12 +77,12 @@ static __always_inline bool test_preempt_need_resched(void) static __always_inline void __preempt_count_add(int val) { -raw_cpu_add_4 (pcpu_hot.preempt_count, val); +raw_cpu_add_4 (__preempt_count, val); } static __always_inline void __preempt_count_sub(int val) { -raw_cpu_add_4 (pcpu_hot.preempt_count, -val); +raw_cpu_add_4 (__preempt_count, -val); }/*
@@ -91,7 +92,7 @@ static __always_inline void __preempt_count_sub(int val)*/ static __always_inline bool __preempt_count_dec_and_test(void) { -return GEN_UNARY_RMWcc ("decl" ,__my_cpu_var (pcpu_hot.preempt_count), e, +return GEN_UNARY_RMWcc ("decl" ,__my_cpu_var (__preempt_count), e, __percpu_arg([var])); }
@@ -100,7 +101,7 @@ static __always_inline bool __preempt_count_dec_and_test(void)*/ static __always_inline bool should_resched(int preempt_offset) { -return unlikely (raw_cpu_read_4 (pcpu_hot.preempt_count) == preempt_offset); +return unlikely (raw_cpu_read_4 (__preempt_count) == preempt_offset); }#ifdef CONFIG_PREEMPTION
arch/x86/kernel/cpu/common.c +3 -1
@@ -2066,12 +2066,14 @@ __setup("setcpuid=", setup_setcpuid); DEFINE_PER_CPU_CACHE_HOT(struct pcpu_hot, pcpu_hot) = { .current_task = &init_task, - .preempt_count =INIT_PREEMPT_COUNT , .top_of_stack =TOP_OF_INIT_STACK , };EXPORT_PER_CPU_SYMBOL (pcpu_hot);EXPORT_PER_CPU_SYMBOL (const_pcpu_hot); +DEFINE_PER_CPU_CACHE_HOT (int, __preempt_count) =INIT_PREEMPT_COUNT ; +EXPORT_PER_CPU_SYMBOL (__preempt_count); +#ifdef CONFIG_X86_64 static void wrmsrl_cstar (unsigned long val) {
include/linux/preempt.h +1 -0
@@ -319,6 +319,7 @@ do { \#ifdef CONFIG_PREEMPT_NOTIFIERS struct preempt_notifier ; +struct task_struct ;/** * preempt_ops - notifiers called when a task is preempted and rescheduled
PATCH v3 4/11 x86/smp: Move cpu number to percpu hot section
In reply to Brian GerstNo functional change.
--- arch/x86/include/asm/current.h | 1 - arch/x86/include/asm/smp.h | 7 ++++--- arch/x86/kernel/setup_percpu.c | 5 ++++- kernel/bpf/verifier.c | 4 ++-- 4 files changed, 10 insertions(+), 7 deletions(-)
arch/x86/include/asm/current.h +0 -1
@@ -14,7 +14,6 @@ struct task_struct;struct pcpu_hot {struct task_struct *current_task; -int cpu_number;#ifdef CONFIG_MITIGATION_CALL_DEPTH_TRACKING u64 call_depth;#endif
arch/x86/include/asm/smp.h +4 -3
@@ -6,7 +6,8 @@#include <linux/thread_info.h> #include <asm/cpumask.h> -#include <asm/current.h> + +DECLARE_PER_CPU_CACHE_HOT (int, cpu_number);DECLARE_PER_CPU_READ_MOSTLY (cpumask_var_t, cpu_sibling_map);DECLARE_PER_CPU_READ_MOSTLY (cpumask_var_t, cpu_core_map);
@@ -134,8 +135,8 @@ __visible void smp_call_function_single_interrupt(struct pt_regs *r);* This function is needed by all SMP systems. It must _always_ be valid * from the initial startup. */ -#define raw_smp_processor_id () this_cpu_read(pcpu_hot.cpu_number) -#define __smp_processor_id () __this_cpu_read(pcpu_hot.cpu_number) +#define raw_smp_processor_id () this_cpu_read(cpu_number) +#define __smp_processor_id () __this_cpu_read(cpu_number)#ifdef CONFIG_X86_32 extern int safe_smp_processor_id (void );
arch/x86/kernel/setup_percpu.c +4 -1
@@ -23,6 +23,9 @@#include <asm/cpumask.h> #include <asm/cpu.h> +DEFINE_PER_CPU_CACHE_HOT (int, cpu_number); +EXPORT_PER_CPU_SYMBOL (cpu_number); + DEFINE_PER_CPU_READ_MOSTLY(unsigned long, this_cpu_off);EXPORT_PER_CPU_SYMBOL (this_cpu_off);
@@ -161,7 +164,7 @@ void __init setup_per_cpu_areas(void)for_each_possible_cpu (cpu) {per_cpu_offset (cpu) = delta + pcpu_unit_offsets[cpu];per_cpu (this_cpu_off, cpu) =per_cpu_offset (cpu); -per_cpu (pcpu_hot.cpu_number, cpu) = cpu; +per_cpu (cpu_number, cpu) = cpu;setup_percpu_segment (cpu);/* * Copy data used in early init routines from the
kernel/bpf/verifier.c +2 -2
@@ -21702,12 +21702,12 @@ static int do_misc_fixups(struct bpf_verifier_env *env)if (insn->imm == BPF_FUNC_get_smp_processor_id &&verifier_inlines_helper_call (env, insn->imm)) {/* BPF_FUNC_get_smp_processor_id inlining is an -* optimization, so if pcpu_hot.cpu_number is ever +* optimization, so if cpu_number is ever * changed in some incompatible and hard to support * way, it's fine to back out this inlining logic */ #ifdef CONFIG_SMP - insn_buf[0 ] =BPF_MOV64_IMM (BPF_REG_0 , (u32 )(unsigned long )&pcpu_hot.cpu_number); + insn_buf[0 ] =BPF_MOV64_IMM (BPF_REG_0 , (u32 )(unsigned long )&cpu_number); insn_buf[1 ] =BPF_MOV64_PERCPU_REG (BPF_REG_0 ,BPF_REG_0 ); insn_buf[2 ] =BPF_LDX_MEM (BPF_W ,BPF_REG_0 ,BPF_REG_0 ,0 ); cnt =3 ;
Signature · 1 line
2.48.1
[tip: x86/core] x86/smp: Move cpu number to percpu hot section
The following commit has been merged into the x86/core branch of tip:
The following commit has been merged into the x86/core branch of tip:
Commit-ID: d9d755ec42d0aca4796cdcbc2177ca6844867e99 Gitweb: https://git.kernel.org/tip/d9d755ec42d0aca4796cdcbc2177ca6844867e99 Author: Brian Gerst <[email protected]> AuthorDate: Mon, 03 Mar 2025 11:52:39 -05:00 Committer: Ingo Molnar <[email protected]> CommitterDate: Mon, 03 Mar 2025 21:37:41 +01:00
x86/smp: Move cpu number to percpu hot section
No functional change.
--- arch/x86/include/asm/current.h | 1 - arch/x86/include/asm/smp.h | 7 ++++--- arch/x86/kernel/setup_percpu.c | 5 ++++- kernel/bpf/verifier.c | 4 ++-- 4 files changed, 10 insertions(+), 7 deletions(-)
arch/x86/include/asm/current.h +0 -1
@@ -14,7 +14,6 @@ struct task_struct;struct pcpu_hot {struct task_struct *current_task; -int cpu_number;#ifdef CONFIG_MITIGATION_CALL_DEPTH_TRACKING u64 call_depth;#endif
arch/x86/include/asm/smp.h +4 -3
@@ -6,7 +6,8 @@#include <linux/thread_info.h> #include <asm/cpumask.h> -#include <asm/current.h> + +DECLARE_PER_CPU_CACHE_HOT (int, cpu_number);DECLARE_PER_CPU_READ_MOSTLY (cpumask_var_t, cpu_sibling_map);DECLARE_PER_CPU_READ_MOSTLY (cpumask_var_t, cpu_core_map);
@@ -134,8 +135,8 @@ __visible void smp_call_function_single_interrupt(struct pt_regs *r);* This function is needed by all SMP systems. It must _always_ be valid * from the initial startup. */ -#define raw_smp_processor_id () this_cpu_read(pcpu_hot.cpu_number) -#define __smp_processor_id () __this_cpu_read(pcpu_hot.cpu_number) +#define raw_smp_processor_id () this_cpu_read(cpu_number) +#define __smp_processor_id () __this_cpu_read(cpu_number)static inline struct cpumask *cpu_llc_shared_mask (int cpu) {
arch/x86/kernel/setup_percpu.c +4 -1
@@ -23,6 +23,9 @@#include <asm/cpumask.h> #include <asm/cpu.h> +DEFINE_PER_CPU_CACHE_HOT (int, cpu_number); +EXPORT_PER_CPU_SYMBOL (cpu_number); + DEFINE_PER_CPU_READ_MOSTLY(unsigned long, this_cpu_off);EXPORT_PER_CPU_SYMBOL (this_cpu_off);
@@ -161,7 +164,7 @@ void __init setup_per_cpu_areas(void)for_each_possible_cpu (cpu) {per_cpu_offset (cpu) = delta + pcpu_unit_offsets[cpu];per_cpu (this_cpu_off, cpu) =per_cpu_offset (cpu); -per_cpu (pcpu_hot.cpu_number, cpu) = cpu; +per_cpu (cpu_number, cpu) = cpu;setup_percpu_segment (cpu);/* * Copy data used in early init routines from the
kernel/bpf/verifier.c +2 -2
@@ -21702,12 +21702,12 @@ patch_map_ops_generic:if (insn->imm == BPF_FUNC_get_smp_processor_id &&verifier_inlines_helper_call (env, insn->imm)) {/* BPF_FUNC_get_smp_processor_id inlining is an -* optimization, so if pcpu_hot.cpu_number is ever +* optimization, so if cpu_number is ever * changed in some incompatible and hard to support * way, it's fine to back out this inlining logic */ #ifdef CONFIG_SMP - insn_buf[0 ] =BPF_MOV64_IMM (BPF_REG_0 , (u32 )(unsigned long )&pcpu_hot.cpu_number); + insn_buf[0 ] =BPF_MOV64_IMM (BPF_REG_0 , (u32 )(unsigned long )&cpu_number); insn_buf[1 ] =BPF_MOV64_PERCPU_REG (BPF_REG_0 ,BPF_REG_0 ); insn_buf[2 ] =BPF_LDX_MEM (BPF_W ,BPF_REG_0 ,BPF_REG_0 ,0 ); cnt =3 ;
[tip: x86/core] x86/smp: Move cpu number to percpu hot section
In reply to Brian GerstThe following commit has been merged into the x86/core branch of tip:
The following commit has been merged into the x86/core branch of tip:
Commit-ID: 816a6123b28ce5be9af27666e4a45b09fde3865b Gitweb: https://git.kernel.org/tip/816a6123b28ce5be9af27666e4a45b09fde3865b Author: Brian Gerst <[email protected]> AuthorDate: Mon, 03 Mar 2025 11:52:39 -05:00 Committer: Ingo Molnar <[email protected]> CommitterDate: Tue, 04 Mar 2025 11:24:28 +01:00
x86/smp: Move cpu number to percpu hot section
No functional change.
--- arch/x86/include/asm/current.h | 1 - arch/x86/include/asm/smp.h | 7 ++++--- arch/x86/kernel/setup_percpu.c | 5 ++++- kernel/bpf/verifier.c | 4 ++-- 4 files changed, 10 insertions(+), 7 deletions(-)
arch/x86/include/asm/current.h +0 -1
@@ -14,7 +14,6 @@ struct task_struct;struct pcpu_hot {struct task_struct *current_task; -int cpu_number;#ifdef CONFIG_MITIGATION_CALL_DEPTH_TRACKING u64 call_depth;#endif
arch/x86/include/asm/smp.h +4 -3
@@ -6,7 +6,8 @@#include <linux/thread_info.h> #include <asm/cpumask.h> -#include <asm/current.h> + +DECLARE_PER_CPU_CACHE_HOT (int, cpu_number);DECLARE_PER_CPU_READ_MOSTLY (cpumask_var_t, cpu_sibling_map);DECLARE_PER_CPU_READ_MOSTLY (cpumask_var_t, cpu_core_map);
@@ -132,8 +133,8 @@ __visible void smp_call_function_single_interrupt(struct pt_regs *r);* This function is needed by all SMP systems. It must _always_ be valid * from the initial startup. */ -#define raw_smp_processor_id () this_cpu_read(pcpu_hot.cpu_number) -#define __smp_processor_id () __this_cpu_read(pcpu_hot.cpu_number) +#define raw_smp_processor_id () this_cpu_read(cpu_number) +#define __smp_processor_id () __this_cpu_read(cpu_number)static inline struct cpumask *cpu_llc_shared_mask (int cpu) {
arch/x86/kernel/setup_percpu.c +4 -1
@@ -23,6 +23,9 @@#include <asm/cpumask.h> #include <asm/cpu.h> +DEFINE_PER_CPU_CACHE_HOT (int, cpu_number); +EXPORT_PER_CPU_SYMBOL (cpu_number); + DEFINE_PER_CPU_READ_MOSTLY(unsigned long, this_cpu_off);EXPORT_PER_CPU_SYMBOL (this_cpu_off);
@@ -161,7 +164,7 @@ void __init setup_per_cpu_areas(void)for_each_possible_cpu (cpu) {per_cpu_offset (cpu) = delta + pcpu_unit_offsets[cpu];per_cpu (this_cpu_off, cpu) =per_cpu_offset (cpu); -per_cpu (pcpu_hot.cpu_number, cpu) = cpu; +per_cpu (cpu_number, cpu) = cpu;setup_percpu_segment (cpu);/* * Copy data used in early init routines from the
kernel/bpf/verifier.c +2 -2
@@ -21702,12 +21702,12 @@ patch_map_ops_generic:if (insn->imm == BPF_FUNC_get_smp_processor_id &&verifier_inlines_helper_call (env, insn->imm)) {/* BPF_FUNC_get_smp_processor_id inlining is an -* optimization, so if pcpu_hot.cpu_number is ever +* optimization, so if cpu_number is ever * changed in some incompatible and hard to support * way, it's fine to back out this inlining logic */ #ifdef CONFIG_SMP - insn_buf[0 ] =BPF_MOV64_IMM (BPF_REG_0 , (u32 )(unsigned long )&pcpu_hot.cpu_number); + insn_buf[0 ] =BPF_MOV64_IMM (BPF_REG_0 , (u32 )(unsigned long )&cpu_number); insn_buf[1 ] =BPF_MOV64_PERCPU_REG (BPF_REG_0 ,BPF_REG_0 ); insn_buf[2 ] =BPF_LDX_MEM (BPF_W ,BPF_REG_0 ,BPF_REG_0 ,0 ); cnt =3 ;
[tip: x86/core] x86/smp: Move cpu number to percpu hot section
In reply to Brian GerstThe following commit has been merged into the x86/core branch of tip:
The following commit has been merged into the x86/core branch of tip:
Commit-ID: 5cb5f5acb01749db1b878ea054a00aac13e59fdb Gitweb: https://git.kernel.org/tip/5cb5f5acb01749db1b878ea054a00aac13e59fdb Author: Brian Gerst <[email protected]> AuthorDate: Mon, 03 Mar 2025 11:52:39 -05:00 Committer: Ingo Molnar <[email protected]> CommitterDate: Tue, 04 Mar 2025 20:18:02 +01:00
x86/smp: Move cpu number to percpu hot section
No functional change.
--- arch/x86/include/asm/current.h | 1 - arch/x86/include/asm/smp.h | 7 ++++--- arch/x86/kernel/setup_percpu.c | 5 ++++- kernel/bpf/verifier.c | 4 ++-- 4 files changed, 10 insertions(+), 7 deletions(-)
arch/x86/include/asm/current.h +0 -1
@@ -14,7 +14,6 @@ struct task_struct;struct pcpu_hot {struct task_struct *current_task; -int cpu_number;#ifdef CONFIG_MITIGATION_CALL_DEPTH_TRACKING u64 call_depth;#endif
arch/x86/include/asm/smp.h +4 -3
@@ -6,7 +6,8 @@#include <linux/thread_info.h> #include <asm/cpumask.h> -#include <asm/current.h> + +DECLARE_PER_CPU_CACHE_HOT (int, cpu_number);DECLARE_PER_CPU_READ_MOSTLY (cpumask_var_t, cpu_sibling_map);DECLARE_PER_CPU_READ_MOSTLY (cpumask_var_t, cpu_core_map);
@@ -132,8 +133,8 @@ __visible void smp_call_function_single_interrupt(struct pt_regs *r);* This function is needed by all SMP systems. It must _always_ be valid * from the initial startup. */ -#define raw_smp_processor_id () this_cpu_read(pcpu_hot.cpu_number) -#define __smp_processor_id () __this_cpu_read(pcpu_hot.cpu_number) +#define raw_smp_processor_id () this_cpu_read(cpu_number) +#define __smp_processor_id () __this_cpu_read(cpu_number)static inline struct cpumask *cpu_llc_shared_mask (int cpu) {
arch/x86/kernel/setup_percpu.c +4 -1
@@ -23,6 +23,9 @@#include <asm/cpumask.h> #include <asm/cpu.h> +DEFINE_PER_CPU_CACHE_HOT (int, cpu_number); +EXPORT_PER_CPU_SYMBOL (cpu_number); + DEFINE_PER_CPU_READ_MOSTLY(unsigned long, this_cpu_off);EXPORT_PER_CPU_SYMBOL (this_cpu_off);
@@ -161,7 +164,7 @@ void __init setup_per_cpu_areas(void)for_each_possible_cpu (cpu) {per_cpu_offset (cpu) = delta + pcpu_unit_offsets[cpu];per_cpu (this_cpu_off, cpu) =per_cpu_offset (cpu); -per_cpu (pcpu_hot.cpu_number, cpu) = cpu; +per_cpu (cpu_number, cpu) = cpu;setup_percpu_segment (cpu);/* * Copy data used in early init routines from the
kernel/bpf/verifier.c +2 -2
@@ -21702,12 +21702,12 @@ patch_map_ops_generic:if (insn->imm == BPF_FUNC_get_smp_processor_id &&verifier_inlines_helper_call (env, insn->imm)) {/* BPF_FUNC_get_smp_processor_id inlining is an -* optimization, so if pcpu_hot.cpu_number is ever +* optimization, so if cpu_number is ever * changed in some incompatible and hard to support * way, it's fine to back out this inlining logic */ #ifdef CONFIG_SMP - insn_buf[0 ] =BPF_MOV64_IMM (BPF_REG_0 , (u32 )(unsigned long )&pcpu_hot.cpu_number); + insn_buf[0 ] =BPF_MOV64_IMM (BPF_REG_0 , (u32 )(unsigned long )&cpu_number); insn_buf[1 ] =BPF_MOV64_PERCPU_REG (BPF_REG_0 ,BPF_REG_0 ); insn_buf[2 ] =BPF_LDX_MEM (BPF_W ,BPF_REG_0 ,BPF_REG_0 ,0 ); cnt =3 ;
[tip: x86/core] x86/smp: Move cpu number to percpu hot section
In reply to Brian GerstThe following commit has been merged into the x86/core branch of tip:
The following commit has been merged into the x86/core branch of tip:
Commit-ID: 01c7bc5198e9ef5628fad0346c5cdba2633a79da Gitweb: https://git.kernel.org/tip/01c7bc5198e9ef5628fad0346c5cdba2633a79da Author: Brian Gerst <[email protected]> AuthorDate: Mon, 03 Mar 2025 11:52:39 -05:00 Committer: Ingo Molnar <[email protected]> CommitterDate: Tue, 04 Mar 2025 20:30:33 +01:00
x86/smp: Move cpu number to percpu hot section
No functional change.
--- arch/x86/include/asm/current.h | 1 - arch/x86/include/asm/smp.h | 7 ++++--- arch/x86/kernel/setup_percpu.c | 5 ++++- kernel/bpf/verifier.c | 4 ++-- 4 files changed, 10 insertions(+), 7 deletions(-)
arch/x86/include/asm/current.h +0 -1
@@ -14,7 +14,6 @@ struct task_struct;struct pcpu_hot {struct task_struct *current_task; -int cpu_number;#ifdef CONFIG_MITIGATION_CALL_DEPTH_TRACKING u64 call_depth;#endif
arch/x86/include/asm/smp.h +4 -3
@@ -6,7 +6,8 @@#include <linux/thread_info.h> #include <asm/cpumask.h> -#include <asm/current.h> + +DECLARE_PER_CPU_CACHE_HOT (int, cpu_number);DECLARE_PER_CPU_READ_MOSTLY (cpumask_var_t, cpu_sibling_map);DECLARE_PER_CPU_READ_MOSTLY (cpumask_var_t, cpu_core_map);
@@ -132,8 +133,8 @@ __visible void smp_call_function_single_interrupt(struct pt_regs *r);* This function is needed by all SMP systems. It must _always_ be valid * from the initial startup. */ -#define raw_smp_processor_id () this_cpu_read(pcpu_hot.cpu_number) -#define __smp_processor_id () __this_cpu_read(pcpu_hot.cpu_number) +#define raw_smp_processor_id () this_cpu_read(cpu_number) +#define __smp_processor_id () __this_cpu_read(cpu_number)static inline struct cpumask *cpu_llc_shared_mask (int cpu) {
arch/x86/kernel/setup_percpu.c +4 -1
@@ -23,6 +23,9 @@#include <asm/cpumask.h> #include <asm/cpu.h> +DEFINE_PER_CPU_CACHE_HOT (int, cpu_number); +EXPORT_PER_CPU_SYMBOL (cpu_number); + DEFINE_PER_CPU_READ_MOSTLY(unsigned long, this_cpu_off);EXPORT_PER_CPU_SYMBOL (this_cpu_off);
@@ -161,7 +164,7 @@ void __init setup_per_cpu_areas(void)for_each_possible_cpu (cpu) {per_cpu_offset (cpu) = delta + pcpu_unit_offsets[cpu];per_cpu (this_cpu_off, cpu) =per_cpu_offset (cpu); -per_cpu (pcpu_hot.cpu_number, cpu) = cpu; +per_cpu (cpu_number, cpu) = cpu;setup_percpu_segment (cpu);/* * Copy data used in early init routines from the
kernel/bpf/verifier.c +2 -2
@@ -21702,12 +21702,12 @@ patch_map_ops_generic:if (insn->imm == BPF_FUNC_get_smp_processor_id &&verifier_inlines_helper_call (env, insn->imm)) {/* BPF_FUNC_get_smp_processor_id inlining is an -* optimization, so if pcpu_hot.cpu_number is ever +* optimization, so if cpu_number is ever * changed in some incompatible and hard to support * way, it's fine to back out this inlining logic */ #ifdef CONFIG_SMP - insn_buf[0 ] =BPF_MOV64_IMM (BPF_REG_0 , (u32 )(unsigned long )&pcpu_hot.cpu_number); + insn_buf[0 ] =BPF_MOV64_IMM (BPF_REG_0 , (u32 )(unsigned long )&cpu_number); insn_buf[1 ] =BPF_MOV64_PERCPU_REG (BPF_REG_0 ,BPF_REG_0 ); insn_buf[2 ] =BPF_LDX_MEM (BPF_W ,BPF_REG_0 ,BPF_REG_0 ,0 ); cnt =3 ;
PATCH v3 5/11 x86/retbleed: Move call depth to percpu hot section
In reply to Brian GerstNo functional change.
--- arch/x86/include/asm/current.h | 3 --- arch/x86/include/asm/nospec-branch.h | 11 ++++++----- arch/x86/kernel/asm-offsets.c | 3 --- arch/x86/kernel/cpu/common.c | 8 ++++++++ arch/x86/lib/retpoline.S | 2 +- 5 files changed, 15 insertions(+), 12 deletions(-)
arch/x86/include/asm/current.h +0 -3
@@ -14,9 +14,6 @@ struct task_struct;struct pcpu_hot {struct task_struct *current_task; -#ifdef CONFIG_MITIGATION_CALL_DEPTH_TRACKING -u64 call_depth; -#endif unsigned long top_of_stack;void *hardirq_stack_ptr;u16 softirq_pending;
arch/x86/include/asm/nospec-branch.h +6 -5
@@ -12,7 +12,6 @@#include <asm/msr-index.h> #include <asm/unwind_hints.h> #include <asm/percpu.h> -#include <asm/current.h> /* * Call depth tracking for Intel SKL CPUs to address the RSB underflow
@@ -78,21 +77,21 @@#include <asm/asm-offsets.h> #define CREDIT_CALL_DEPTH \ - movq $-1, PER_CPU_VAR(pcpu_hot + X86_call_depth); + movq $-1, PER_CPU_VAR(__x86_call_depth);#define RESET_CALL_DEPTH \ xor %eax, %eax; \ bts $63, %rax; \ - movq %rax, PER_CPU_VAR(pcpu_hot + X86_call_depth); + movq %rax, PER_CPU_VAR(__x86_call_depth);#define RESET_CALL_DEPTH_FROM_CALL \ movb $0xfc, %al; \ shl $56, %rax; \ - movq %rax, PER_CPU_VAR(pcpu_hot + X86_call_depth); \ + movq %rax, PER_CPU_VAR(__x86_call_depth); \ CALL_THUNKS_DEBUG_INC_CALLS#define INCREMENT_CALL_DEPTH \ - sarq $5, PER_CPU_VAR(pcpu_hot + X86_call_depth); \ + sarq $5, PER_CPU_VAR(__x86_call_depth); \ CALL_THUNKS_DEBUG_INC_CALLS#else
@@ -387,6 +386,8 @@ extern void call_depth_return_thunk(void);__stringify (INCREMENT_CALL_DEPTH ), \ X86_FEATURE_CALL_DEPTH) +DECLARE_PER_CPU_CACHE_HOT (u64 ,__x86_call_depth ); +#ifdef CONFIG_CALL_THUNKS_DEBUG DECLARE_PER_CPU (u64, __x86_call_count);DECLARE_PER_CPU (u64, __x86_ret_count);
arch/x86/kernel/asm-offsets.c +0 -3
@@ -109,9 +109,6 @@ static void __used common(void)OFFSET (TSS_sp2, tss_struct, x86_tss.sp2);OFFSET (X86_top_of_stack, pcpu_hot, top_of_stack);OFFSET (X86_current_task, pcpu_hot, current_task); -#ifdef CONFIG_MITIGATION_CALL_DEPTH_TRACKING -OFFSET (X86_call_depth, pcpu_hot, call_depth); -#endif #if IS_ENABLED (CONFIG_CRYPTO_ARIA_AESNI_AVX_X86_64 )/* Offset for fields in aria_ctx */ BLANK ();
arch/x86/kernel/cpu/common.c +8 -0
@@ -2060,6 +2060,14 @@ DEFINE_PER_CPU_CACHE_HOT(int, __preempt_count) = INIT_PREEMPT_COUNT;EXPORT_PER_CPU_SYMBOL (__preempt_count);#ifdef CONFIG_X86_64 +/* +* Note: Do not make this dependant on CONFIG_MITIGATION_CALL_DEPTH_TRACKING +* so that this space is reserved in the hot cache section even when the +* mitigation is disabled. +*/ +DEFINE_PER_CPU_CACHE_HOT (u64, __x86_call_depth); +EXPORT_PER_CPU_SYMBOL (__x86_call_depth); +static void wrmsrl_cstar (unsigned long val) {/*
arch/x86/lib/retpoline.S +1 -1
@@ -343,7 +343,7 @@ SYM_FUNC_START(call_depth_return_thunk) * case. */ CALL_THUNKS_DEBUG_INC_RETS - shlq $5, PER_CPU_VAR(pcpu_hot + X86_call_depth) + shlq $5, PER_CPU_VAR(__x86_call_depth) jz 1f ANNOTATE_UNRET_SAFE ret
Signature · 1 line
2.48.1
[tip: x86/core] x86/retbleed: Move call depth to percpu hot section
The following commit has been merged into the x86/core branch of tip:
The following commit has been merged into the x86/core branch of tip:
Commit-ID: e836c9cd89d097603e80a1a0d1c90d887f573129 Gitweb: https://git.kernel.org/tip/e836c9cd89d097603e80a1a0d1c90d887f573129 Author: Brian Gerst <[email protected]> AuthorDate: Mon, 03 Mar 2025 11:52:40 -05:00 Committer: Ingo Molnar <[email protected]> CommitterDate: Mon, 03 Mar 2025 21:37:41 +01:00
x86/retbleed: Move call depth to percpu hot section
No functional change.
--- arch/x86/include/asm/current.h | 3 --- arch/x86/include/asm/nospec-branch.h | 11 ++++++----- arch/x86/kernel/asm-offsets.c | 3 --- arch/x86/kernel/cpu/common.c | 8 ++++++++ arch/x86/lib/retpoline.S | 2 +- 5 files changed, 15 insertions(+), 12 deletions(-)
arch/x86/include/asm/current.h +0 -3
@@ -14,9 +14,6 @@ struct task_struct;struct pcpu_hot {struct task_struct *current_task; -#ifdef CONFIG_MITIGATION_CALL_DEPTH_TRACKING -u64 call_depth; -#endif unsigned long top_of_stack;void *hardirq_stack_ptr;u16 softirq_pending;
arch/x86/include/asm/nospec-branch.h +6 -5
@@ -12,7 +12,6 @@#include <asm/msr-index.h> #include <asm/unwind_hints.h> #include <asm/percpu.h> -#include <asm/current.h> /* * Call depth tracking for Intel SKL CPUs to address the RSB underflow
@@ -78,21 +77,21 @@#include <asm/asm-offsets.h> #define CREDIT_CALL_DEPTH \ - movq $-1, PER_CPU_VAR(pcpu_hot + X86_call_depth); + movq $-1, PER_CPU_VAR(__x86_call_depth);#define RESET_CALL_DEPTH \ xor %eax, %eax; \ bts $63, %rax; \ - movq %rax, PER_CPU_VAR(pcpu_hot + X86_call_depth); + movq %rax, PER_CPU_VAR(__x86_call_depth);#define RESET_CALL_DEPTH_FROM_CALL \ movb $0xfc, %al; \ shl $56, %rax; \ - movq %rax, PER_CPU_VAR(pcpu_hot + X86_call_depth); \ + movq %rax, PER_CPU_VAR(__x86_call_depth); \ CALL_THUNKS_DEBUG_INC_CALLS#define INCREMENT_CALL_DEPTH \ - sarq $5, PER_CPU_VAR(pcpu_hot + X86_call_depth); \ + sarq $5, PER_CPU_VAR(__x86_call_depth); \ CALL_THUNKS_DEBUG_INC_CALLS#else
@@ -388,6 +387,8 @@ extern void call_depth_return_thunk(void);__stringify (INCREMENT_CALL_DEPTH ), \ X86_FEATURE_CALL_DEPTH) +DECLARE_PER_CPU_CACHE_HOT (u64 ,__x86_call_depth ); +#ifdef CONFIG_CALL_THUNKS_DEBUG DECLARE_PER_CPU (u64, __x86_call_count);DECLARE_PER_CPU (u64, __x86_ret_count);
arch/x86/kernel/asm-offsets.c +0 -3
@@ -109,9 +109,6 @@ static void __used common(void)OFFSET (TSS_sp2, tss_struct, x86_tss.sp2);OFFSET (X86_top_of_stack, pcpu_hot, top_of_stack);OFFSET (X86_current_task, pcpu_hot, current_task); -#ifdef CONFIG_MITIGATION_CALL_DEPTH_TRACKING -OFFSET (X86_call_depth, pcpu_hot, call_depth); -#endif #if IS_ENABLED (CONFIG_CRYPTO_ARIA_AESNI_AVX_X86_64 )/* Offset for fields in aria_ctx */ BLANK ();
arch/x86/kernel/cpu/common.c +8 -0
@@ -2058,6 +2058,14 @@ DEFINE_PER_CPU_CACHE_HOT(int, __preempt_count) = INIT_PREEMPT_COUNT;EXPORT_PER_CPU_SYMBOL (__preempt_count);#ifdef CONFIG_X86_64 +/* +* Note: Do not make this dependant on CONFIG_MITIGATION_CALL_DEPTH_TRACKING +* so that this space is reserved in the hot cache section even when the +* mitigation is disabled. +*/ +DEFINE_PER_CPU_CACHE_HOT (u64, __x86_call_depth); +EXPORT_PER_CPU_SYMBOL (__x86_call_depth); +static void wrmsrl_cstar (unsigned long val) {/*
arch/x86/lib/retpoline.S +1 -1
@@ -343,7 +343,7 @@ SYM_FUNC_START(call_depth_return_thunk) * case. */ CALL_THUNKS_DEBUG_INC_RETS - shlq $5, PER_CPU_VAR(pcpu_hot + X86_call_depth) + shlq $5, PER_CPU_VAR(__x86_call_depth) jz 1f ANNOTATE_UNRET_SAFE ret
[tip: x86/core] x86/retbleed: Move call depth to percpu hot section
In reply to Brian GerstThe following commit has been merged into the x86/core branch of tip:
The following commit has been merged into the x86/core branch of tip:
Commit-ID: bacde25dbbad6180b434332ad829b9e2f8064a56 Gitweb: https://git.kernel.org/tip/bacde25dbbad6180b434332ad829b9e2f8064a56 Author: Brian Gerst <[email protected]> AuthorDate: Mon, 03 Mar 2025 11:52:40 -05:00 Committer: Ingo Molnar <[email protected]> CommitterDate: Tue, 04 Mar 2025 11:24:28 +01:00
x86/retbleed: Move call depth to percpu hot section
No functional change.
--- arch/x86/include/asm/current.h | 3 --- arch/x86/include/asm/nospec-branch.h | 11 ++++++----- arch/x86/kernel/asm-offsets.c | 3 --- arch/x86/kernel/cpu/common.c | 8 ++++++++ arch/x86/lib/retpoline.S | 2 +- 5 files changed, 15 insertions(+), 12 deletions(-)
arch/x86/include/asm/current.h +0 -3
@@ -14,9 +14,6 @@ struct task_struct;struct pcpu_hot {struct task_struct *current_task; -#ifdef CONFIG_MITIGATION_CALL_DEPTH_TRACKING -u64 call_depth; -#endif unsigned long top_of_stack;void *hardirq_stack_ptr;u16 softirq_pending;
arch/x86/include/asm/nospec-branch.h +6 -5
@@ -12,7 +12,6 @@#include <asm/msr-index.h> #include <asm/unwind_hints.h> #include <asm/percpu.h> -#include <asm/current.h> /* * Call depth tracking for Intel SKL CPUs to address the RSB underflow
@@ -78,21 +77,21 @@#include <asm/asm-offsets.h> #define CREDIT_CALL_DEPTH \ - movq $-1, PER_CPU_VAR(pcpu_hot + X86_call_depth); + movq $-1, PER_CPU_VAR(__x86_call_depth);#define RESET_CALL_DEPTH \ xor %eax, %eax; \ bts $63, %rax; \ - movq %rax, PER_CPU_VAR(pcpu_hot + X86_call_depth); + movq %rax, PER_CPU_VAR(__x86_call_depth);#define RESET_CALL_DEPTH_FROM_CALL \ movb $0xfc, %al; \ shl $56, %rax; \ - movq %rax, PER_CPU_VAR(pcpu_hot + X86_call_depth); \ + movq %rax, PER_CPU_VAR(__x86_call_depth); \ CALL_THUNKS_DEBUG_INC_CALLS#define INCREMENT_CALL_DEPTH \ - sarq $5, PER_CPU_VAR(pcpu_hot + X86_call_depth); \ + sarq $5, PER_CPU_VAR(__x86_call_depth); \ CALL_THUNKS_DEBUG_INC_CALLS#else
@@ -387,6 +386,8 @@ extern void call_depth_return_thunk(void);__stringify (INCREMENT_CALL_DEPTH ), \ X86_FEATURE_CALL_DEPTH) +DECLARE_PER_CPU_CACHE_HOT (u64 ,__x86_call_depth ); +#ifdef CONFIG_CALL_THUNKS_DEBUG DECLARE_PER_CPU (u64, __x86_call_count);DECLARE_PER_CPU (u64, __x86_ret_count);
arch/x86/kernel/asm-offsets.c +0 -3
@@ -109,9 +109,6 @@ static void __used common(void)OFFSET (TSS_sp2, tss_struct, x86_tss.sp2);OFFSET (X86_top_of_stack, pcpu_hot, top_of_stack);OFFSET (X86_current_task, pcpu_hot, current_task); -#ifdef CONFIG_MITIGATION_CALL_DEPTH_TRACKING -OFFSET (X86_call_depth, pcpu_hot, call_depth); -#endif #if IS_ENABLED (CONFIG_CRYPTO_ARIA_AESNI_AVX_X86_64 )/* Offset for fields in aria_ctx */ BLANK ();
arch/x86/kernel/cpu/common.c +8 -0
@@ -2075,6 +2075,14 @@ DEFINE_PER_CPU_CACHE_HOT(int, __preempt_count) = INIT_PREEMPT_COUNT;EXPORT_PER_CPU_SYMBOL (__preempt_count);#ifdef CONFIG_X86_64 +/* +* Note: Do not make this dependant on CONFIG_MITIGATION_CALL_DEPTH_TRACKING +* so that this space is reserved in the hot cache section even when the +* mitigation is disabled. +*/ +DEFINE_PER_CPU_CACHE_HOT (u64, __x86_call_depth); +EXPORT_PER_CPU_SYMBOL (__x86_call_depth); +static void wrmsrl_cstar (unsigned long val) {/*
arch/x86/lib/retpoline.S +1 -1
@@ -343,7 +343,7 @@ SYM_FUNC_START(call_depth_return_thunk) * case. */ CALL_THUNKS_DEBUG_INC_RETS - shlq $5, PER_CPU_VAR(pcpu_hot + X86_call_depth) + shlq $5, PER_CPU_VAR(__x86_call_depth) jz 1f ANNOTATE_UNRET_SAFE ret
[tip: x86/core] x86/retbleed: Move call depth to percpu hot section
In reply to Brian GerstThe following commit has been merged into the x86/core branch of tip:
The following commit has been merged into the x86/core branch of tip:
Commit-ID: 7ca6fc13aed7d7524d8a6e301a13f153a5976024 Gitweb: https://git.kernel.org/tip/7ca6fc13aed7d7524d8a6e301a13f153a5976024 Author: Brian Gerst <[email protected]> AuthorDate: Mon, 03 Mar 2025 11:52:40 -05:00 Committer: Ingo Molnar <[email protected]> CommitterDate: Tue, 04 Mar 2025 20:18:02 +01:00
x86/retbleed: Move call depth to percpu hot section
No functional change.
--- arch/x86/include/asm/current.h | 3 --- arch/x86/include/asm/nospec-branch.h | 11 ++++++----- arch/x86/kernel/asm-offsets.c | 3 --- arch/x86/kernel/cpu/common.c | 8 ++++++++ arch/x86/lib/retpoline.S | 2 +- 5 files changed, 15 insertions(+), 12 deletions(-)
arch/x86/include/asm/current.h +0 -3
@@ -14,9 +14,6 @@ struct task_struct;struct pcpu_hot {struct task_struct *current_task; -#ifdef CONFIG_MITIGATION_CALL_DEPTH_TRACKING -u64 call_depth; -#endif unsigned long top_of_stack;void *hardirq_stack_ptr;u16 softirq_pending;
arch/x86/include/asm/nospec-branch.h +6 -5
@@ -12,7 +12,6 @@#include <asm/msr-index.h> #include <asm/unwind_hints.h> #include <asm/percpu.h> -#include <asm/current.h> /* * Call depth tracking for Intel SKL CPUs to address the RSB underflow
@@ -78,21 +77,21 @@#include <asm/asm-offsets.h> #define CREDIT_CALL_DEPTH \ - movq $-1, PER_CPU_VAR(pcpu_hot + X86_call_depth); + movq $-1, PER_CPU_VAR(__x86_call_depth);#define RESET_CALL_DEPTH \ xor %eax, %eax; \ bts $63, %rax; \ - movq %rax, PER_CPU_VAR(pcpu_hot + X86_call_depth); + movq %rax, PER_CPU_VAR(__x86_call_depth);#define RESET_CALL_DEPTH_FROM_CALL \ movb $0xfc, %al; \ shl $56, %rax; \ - movq %rax, PER_CPU_VAR(pcpu_hot + X86_call_depth); \ + movq %rax, PER_CPU_VAR(__x86_call_depth); \ CALL_THUNKS_DEBUG_INC_CALLS#define INCREMENT_CALL_DEPTH \ - sarq $5, PER_CPU_VAR(pcpu_hot + X86_call_depth); \ + sarq $5, PER_CPU_VAR(__x86_call_depth); \ CALL_THUNKS_DEBUG_INC_CALLS#else
@@ -387,6 +386,8 @@ extern void call_depth_return_thunk(void);__stringify (INCREMENT_CALL_DEPTH ), \ X86_FEATURE_CALL_DEPTH) +DECLARE_PER_CPU_CACHE_HOT (u64 ,__x86_call_depth ); +#ifdef CONFIG_CALL_THUNKS_DEBUG DECLARE_PER_CPU (u64, __x86_call_count);DECLARE_PER_CPU (u64, __x86_ret_count);
arch/x86/kernel/asm-offsets.c +0 -3
@@ -109,9 +109,6 @@ static void __used common(void)OFFSET (TSS_sp2, tss_struct, x86_tss.sp2);OFFSET (X86_top_of_stack, pcpu_hot, top_of_stack);OFFSET (X86_current_task, pcpu_hot, current_task); -#ifdef CONFIG_MITIGATION_CALL_DEPTH_TRACKING -OFFSET (X86_call_depth, pcpu_hot, call_depth); -#endif #if IS_ENABLED (CONFIG_CRYPTO_ARIA_AESNI_AVX_X86_64 )/* Offset for fields in aria_ctx */ BLANK ();
arch/x86/kernel/cpu/common.c +8 -0
@@ -2075,6 +2075,14 @@ DEFINE_PER_CPU_CACHE_HOT(int, __preempt_count) = INIT_PREEMPT_COUNT;EXPORT_PER_CPU_SYMBOL (__preempt_count);#ifdef CONFIG_X86_64 +/* +* Note: Do not make this dependant on CONFIG_MITIGATION_CALL_DEPTH_TRACKING +* so that this space is reserved in the hot cache section even when the +* mitigation is disabled. +*/ +DEFINE_PER_CPU_CACHE_HOT (u64, __x86_call_depth); +EXPORT_PER_CPU_SYMBOL (__x86_call_depth); +static void wrmsrl_cstar (unsigned long val) {/*
arch/x86/lib/retpoline.S +1 -1
@@ -343,7 +343,7 @@ SYM_FUNC_START(call_depth_return_thunk) * case. */ CALL_THUNKS_DEBUG_INC_RETS - shlq $5, PER_CPU_VAR(pcpu_hot + X86_call_depth) + shlq $5, PER_CPU_VAR(__x86_call_depth) jz 1f ANNOTATE_UNRET_SAFE ret
[tip: x86/core] x86/retbleed: Move call depth to percpu hot section
In reply to Brian GerstThe following commit has been merged into the x86/core branch of tip:
The following commit has been merged into the x86/core branch of tip:
Commit-ID: 839be1619fb897364b782997bc2c5d072d7a79f2 Gitweb: https://git.kernel.org/tip/839be1619fb897364b782997bc2c5d072d7a79f2 Author: Brian Gerst <[email protected]> AuthorDate: Mon, 03 Mar 2025 11:52:40 -05:00 Committer: Ingo Molnar <[email protected]> CommitterDate: Tue, 04 Mar 2025 20:30:33 +01:00
x86/retbleed: Move call depth to percpu hot section
No functional change.
--- arch/x86/include/asm/current.h | 3 --- arch/x86/include/asm/nospec-branch.h | 11 ++++++----- arch/x86/kernel/asm-offsets.c | 3 --- arch/x86/kernel/cpu/common.c | 8 ++++++++ arch/x86/lib/retpoline.S | 2 +- 5 files changed, 15 insertions(+), 12 deletions(-)
arch/x86/include/asm/current.h +0 -3
@@ -14,9 +14,6 @@ struct task_struct;struct pcpu_hot {struct task_struct *current_task; -#ifdef CONFIG_MITIGATION_CALL_DEPTH_TRACKING -u64 call_depth; -#endif unsigned long top_of_stack;void *hardirq_stack_ptr;u16 softirq_pending;
arch/x86/include/asm/nospec-branch.h +6 -5
@@ -12,7 +12,6 @@#include <asm/msr-index.h> #include <asm/unwind_hints.h> #include <asm/percpu.h> -#include <asm/current.h> /* * Call depth tracking for Intel SKL CPUs to address the RSB underflow
@@ -78,21 +77,21 @@#include <asm/asm-offsets.h> #define CREDIT_CALL_DEPTH \ - movq $-1, PER_CPU_VAR(pcpu_hot + X86_call_depth); + movq $-1, PER_CPU_VAR(__x86_call_depth);#define RESET_CALL_DEPTH \ xor %eax, %eax; \ bts $63, %rax; \ - movq %rax, PER_CPU_VAR(pcpu_hot + X86_call_depth); + movq %rax, PER_CPU_VAR(__x86_call_depth);#define RESET_CALL_DEPTH_FROM_CALL \ movb $0xfc, %al; \ shl $56, %rax; \ - movq %rax, PER_CPU_VAR(pcpu_hot + X86_call_depth); \ + movq %rax, PER_CPU_VAR(__x86_call_depth); \ CALL_THUNKS_DEBUG_INC_CALLS#define INCREMENT_CALL_DEPTH \ - sarq $5, PER_CPU_VAR(pcpu_hot + X86_call_depth); \ + sarq $5, PER_CPU_VAR(__x86_call_depth); \ CALL_THUNKS_DEBUG_INC_CALLS#else
@@ -387,6 +386,8 @@ extern void call_depth_return_thunk(void);__stringify (INCREMENT_CALL_DEPTH ), \ X86_FEATURE_CALL_DEPTH) +DECLARE_PER_CPU_CACHE_HOT (u64 ,__x86_call_depth ); +#ifdef CONFIG_CALL_THUNKS_DEBUG DECLARE_PER_CPU (u64, __x86_call_count);DECLARE_PER_CPU (u64, __x86_ret_count);
arch/x86/kernel/asm-offsets.c +0 -3
@@ -109,9 +109,6 @@ static void __used common(void)OFFSET (TSS_sp2, tss_struct, x86_tss.sp2);OFFSET (X86_top_of_stack, pcpu_hot, top_of_stack);OFFSET (X86_current_task, pcpu_hot, current_task); -#ifdef CONFIG_MITIGATION_CALL_DEPTH_TRACKING -OFFSET (X86_call_depth, pcpu_hot, call_depth); -#endif #if IS_ENABLED (CONFIG_CRYPTO_ARIA_AESNI_AVX_X86_64 )/* Offset for fields in aria_ctx */ BLANK ();
arch/x86/kernel/cpu/common.c +8 -0
@@ -2075,6 +2075,14 @@ DEFINE_PER_CPU_CACHE_HOT(int, __preempt_count) = INIT_PREEMPT_COUNT;EXPORT_PER_CPU_SYMBOL (__preempt_count);#ifdef CONFIG_X86_64 +/* +* Note: Do not make this dependant on CONFIG_MITIGATION_CALL_DEPTH_TRACKING +* so that this space is reserved in the hot cache section even when the +* mitigation is disabled. +*/ +DEFINE_PER_CPU_CACHE_HOT (u64, __x86_call_depth); +EXPORT_PER_CPU_SYMBOL (__x86_call_depth); +static void wrmsrl_cstar (unsigned long val) {/*
arch/x86/lib/retpoline.S +1 -1
@@ -343,7 +343,7 @@ SYM_FUNC_START(call_depth_return_thunk) * case. */ CALL_THUNKS_DEBUG_INC_RETS - shlq $5, PER_CPU_VAR(pcpu_hot + X86_call_depth) + shlq $5, PER_CPU_VAR(__x86_call_depth) jz 1f ANNOTATE_UNRET_SAFE ret
PATCH v3 6/11 x86/softirq: Move softirq_pending to percpu hot section
In reply to Brian GerstNo functional change.
--- arch/x86/include/asm/current.h | 1 - arch/x86/include/asm/hardirq.h | 4 ++-- arch/x86/kernel/irq.c | 3 +++ 3 files changed, 5 insertions(+), 3 deletions(-)
arch/x86/include/asm/current.h +0 -1
@@ -16,7 +16,6 @@ struct pcpu_hot {struct task_struct *current_task;unsigned long top_of_stack;void *hardirq_stack_ptr; -u16 softirq_pending;#ifdef CONFIG_X86_64 bool hardirq_stack_inuse;#else
arch/x86/include/asm/hardirq.h +2 -2
@@ -3,7 +3,6 @@#define _ASM_X86_HARDIRQ_H#include <linux/threads.h> -#include <asm/current.h> typedef struct { #if IS_ENABLED(CONFIG_KVM_INTEL)
@@ -66,7 +65,8 @@ extern u64 arch_irq_stat_cpu(unsigned int cpu);extern u64 arch_irq_stat (void );#define arch_irq_stat arch_irq_stat -#define local_softirq_pending_ref pcpu_hot.softirq_pending +DECLARE_PER_CPU_CACHE_HOT (u16, __softirq_pending); +#define local_softirq_pending_ref __softirq_pending#if IS_ENABLED (CONFIG_KVM_INTEL )/*
arch/x86/kernel/irq.c +3 -0
@@ -33,6 +33,9 @@DEFINE_PER_CPU_SHARED_ALIGNED (irq_cpustat_t, irq_stat);EXPORT_PER_CPU_SYMBOL (irq_stat); +DEFINE_PER_CPU_CACHE_HOT (u16, __softirq_pending); +EXPORT_PER_CPU_SYMBOL (__softirq_pending); +atomic_t irq_err_count;/*
Signature · 1 line
2.48.1
[tip: x86/core] x86/softirq: Move softirq_pending to percpu hot section
The following commit has been merged into the x86/core branch of tip:
The following commit has been merged into the x86/core branch of tip:
Commit-ID: d24ec21858c6cd17c7a46222d92b06644f69b12e Gitweb: https://git.kernel.org/tip/d24ec21858c6cd17c7a46222d92b06644f69b12e Author: Brian Gerst <[email protected]> AuthorDate: Mon, 03 Mar 2025 11:52:41 -05:00 Committer: Ingo Molnar <[email protected]> CommitterDate: Mon, 03 Mar 2025 21:37:41 +01:00
x86/softirq: Move softirq_pending to percpu hot section
No functional change.
--- arch/x86/include/asm/current.h | 1 - arch/x86/include/asm/hardirq.h | 4 ++-- arch/x86/kernel/irq.c | 3 +++ 3 files changed, 5 insertions(+), 3 deletions(-)
arch/x86/include/asm/current.h +0 -1
@@ -16,7 +16,6 @@ struct pcpu_hot {struct task_struct *current_task;unsigned long top_of_stack;void *hardirq_stack_ptr; -u16 softirq_pending;#ifdef CONFIG_X86_64 bool hardirq_stack_inuse;#else
arch/x86/include/asm/hardirq.h +2 -2
@@ -3,7 +3,6 @@#define _ASM_X86_HARDIRQ_H#include <linux/threads.h> -#include <asm/current.h> typedef struct { #if IS_ENABLED(CONFIG_KVM_INTEL)
@@ -66,7 +65,8 @@ extern u64 arch_irq_stat_cpu(unsigned int cpu);extern u64 arch_irq_stat (void );#define arch_irq_stat arch_irq_stat -#define local_softirq_pending_ref pcpu_hot.softirq_pending +DECLARE_PER_CPU_CACHE_HOT (u16, __softirq_pending); +#define local_softirq_pending_ref __softirq_pending#if IS_ENABLED (CONFIG_KVM_INTEL )/*
arch/x86/kernel/irq.c +3 -0
@@ -33,6 +33,9 @@DEFINE_PER_CPU_SHARED_ALIGNED (irq_cpustat_t, irq_stat);EXPORT_PER_CPU_SYMBOL (irq_stat); +DEFINE_PER_CPU_CACHE_HOT (u16, __softirq_pending); +EXPORT_PER_CPU_SYMBOL (__softirq_pending); +atomic_t irq_err_count;/*
[tip: x86/core] x86/softirq: Move softirq_pending to percpu hot section
In reply to Brian GerstThe following commit has been merged into the x86/core branch of tip:
The following commit has been merged into the x86/core branch of tip:
Commit-ID: db04c0b33c68b99616cea4acc78a54b6d684244e Gitweb: https://git.kernel.org/tip/db04c0b33c68b99616cea4acc78a54b6d684244e Author: Brian Gerst <[email protected]> AuthorDate: Mon, 03 Mar 2025 11:52:41 -05:00 Committer: Ingo Molnar <[email protected]> CommitterDate: Tue, 04 Mar 2025 11:24:28 +01:00
x86/softirq: Move softirq_pending to percpu hot section
No functional change.
--- arch/x86/include/asm/current.h | 1 - arch/x86/include/asm/hardirq.h | 4 ++-- arch/x86/kernel/irq.c | 3 +++ 3 files changed, 5 insertions(+), 3 deletions(-)
arch/x86/include/asm/current.h +0 -1
@@ -16,7 +16,6 @@ struct pcpu_hot {struct task_struct *current_task;unsigned long top_of_stack;void *hardirq_stack_ptr; -u16 softirq_pending;#ifdef CONFIG_X86_64 bool hardirq_stack_inuse;#else
arch/x86/include/asm/hardirq.h +2 -2
@@ -3,7 +3,6 @@#define _ASM_X86_HARDIRQ_H#include <linux/threads.h> -#include <asm/current.h> typedef struct { #if IS_ENABLED(CONFIG_KVM_INTEL)
@@ -66,7 +65,8 @@ extern u64 arch_irq_stat_cpu(unsigned int cpu);extern u64 arch_irq_stat (void );#define arch_irq_stat arch_irq_stat -#define local_softirq_pending_ref pcpu_hot.softirq_pending +DECLARE_PER_CPU_CACHE_HOT (u16, __softirq_pending); +#define local_softirq_pending_ref __softirq_pending#if IS_ENABLED (CONFIG_KVM_INTEL )/*
arch/x86/kernel/irq.c +3 -0
@@ -33,6 +33,9 @@DEFINE_PER_CPU_SHARED_ALIGNED (irq_cpustat_t, irq_stat);EXPORT_PER_CPU_SYMBOL (irq_stat); +DEFINE_PER_CPU_CACHE_HOT (u16, __softirq_pending); +EXPORT_PER_CPU_SYMBOL (__softirq_pending); +atomic_t irq_err_count;/*
[tip: x86/core] x86/softirq: Move softirq_pending to percpu hot section
In reply to Brian GerstThe following commit has been merged into the x86/core branch of tip:
The following commit has been merged into the x86/core branch of tip:
Commit-ID: de3e8123a856af6257b6f5089baa2dc9de882705 Gitweb: https://git.kernel.org/tip/de3e8123a856af6257b6f5089baa2dc9de882705 Author: Brian Gerst <[email protected]> AuthorDate: Mon, 03 Mar 2025 11:52:41 -05:00 Committer: Ingo Molnar <[email protected]> CommitterDate: Tue, 04 Mar 2025 20:18:02 +01:00
x86/softirq: Move softirq_pending to percpu hot section
No functional change.
--- arch/x86/include/asm/current.h | 1 - arch/x86/include/asm/hardirq.h | 4 ++-- arch/x86/kernel/irq.c | 3 +++ 3 files changed, 5 insertions(+), 3 deletions(-)
arch/x86/include/asm/current.h +0 -1
@@ -16,7 +16,6 @@ struct pcpu_hot {struct task_struct *current_task;unsigned long top_of_stack;void *hardirq_stack_ptr; -u16 softirq_pending;#ifdef CONFIG_X86_64 bool hardirq_stack_inuse;#else
arch/x86/include/asm/hardirq.h +2 -2
@@ -3,7 +3,6 @@#define _ASM_X86_HARDIRQ_H#include <linux/threads.h> -#include <asm/current.h> typedef struct { #if IS_ENABLED(CONFIG_KVM_INTEL)
@@ -66,7 +65,8 @@ extern u64 arch_irq_stat_cpu(unsigned int cpu);extern u64 arch_irq_stat (void );#define arch_irq_stat arch_irq_stat -#define local_softirq_pending_ref pcpu_hot.softirq_pending +DECLARE_PER_CPU_CACHE_HOT (u16, __softirq_pending); +#define local_softirq_pending_ref __softirq_pending#if IS_ENABLED (CONFIG_KVM_INTEL )/*
arch/x86/kernel/irq.c +3 -0
@@ -33,6 +33,9 @@DEFINE_PER_CPU_SHARED_ALIGNED (irq_cpustat_t, irq_stat);EXPORT_PER_CPU_SYMBOL (irq_stat); +DEFINE_PER_CPU_CACHE_HOT (u16, __softirq_pending); +EXPORT_PER_CPU_SYMBOL (__softirq_pending); +atomic_t irq_err_count;/*
[tip: x86/core] x86/softirq: Move softirq_pending to percpu hot section
In reply to Brian GerstThe following commit has been merged into the x86/core branch of tip:
The following commit has been merged into the x86/core branch of tip:
Commit-ID: c8f1ac2bd7771a3bc536f897c142ca219cac13e1 Gitweb: https://git.kernel.org/tip/c8f1ac2bd7771a3bc536f897c142ca219cac13e1 Author: Brian Gerst <[email protected]> AuthorDate: Mon, 03 Mar 2025 11:52:41 -05:00 Committer: Ingo Molnar <[email protected]> CommitterDate: Tue, 04 Mar 2025 20:30:33 +01:00
x86/softirq: Move softirq_pending to percpu hot section
No functional change.
--- arch/x86/include/asm/current.h | 1 - arch/x86/include/asm/hardirq.h | 4 ++-- arch/x86/kernel/irq.c | 3 +++ 3 files changed, 5 insertions(+), 3 deletions(-)
arch/x86/include/asm/current.h +0 -1
@@ -16,7 +16,6 @@ struct pcpu_hot {struct task_struct *current_task;unsigned long top_of_stack;void *hardirq_stack_ptr; -u16 softirq_pending;#ifdef CONFIG_X86_64 bool hardirq_stack_inuse;#else
arch/x86/include/asm/hardirq.h +2 -2
@@ -3,7 +3,6 @@#define _ASM_X86_HARDIRQ_H#include <linux/threads.h> -#include <asm/current.h> typedef struct { #if IS_ENABLED(CONFIG_KVM_INTEL)
@@ -66,7 +65,8 @@ extern u64 arch_irq_stat_cpu(unsigned int cpu);extern u64 arch_irq_stat (void );#define arch_irq_stat arch_irq_stat -#define local_softirq_pending_ref pcpu_hot.softirq_pending +DECLARE_PER_CPU_CACHE_HOT (u16, __softirq_pending); +#define local_softirq_pending_ref __softirq_pending#if IS_ENABLED (CONFIG_KVM_INTEL )/*
arch/x86/kernel/irq.c +3 -0
@@ -33,6 +33,9 @@DEFINE_PER_CPU_SHARED_ALIGNED (irq_cpustat_t, irq_stat);EXPORT_PER_CPU_SYMBOL (irq_stat); +DEFINE_PER_CPU_CACHE_HOT (u16, __softirq_pending); +EXPORT_PER_CPU_SYMBOL (__softirq_pending); +atomic_t irq_err_count;/*
PATCH v3 7/11 x86/irq: Move irq stacks to percpu hot section
In reply to Brian GerstNo functional change.
--- arch/x86/include/asm/current.h | 6 ------ arch/x86/include/asm/irq_stack.h | 12 ++++++------ arch/x86/include/asm/processor.h | 7 +++++++ arch/x86/kernel/dumpstack_32.c | 4 ++-- arch/x86/kernel/dumpstack_64.c | 2 +- arch/x86/kernel/irq.c | 2 ++ arch/x86/kernel/irq_32.c | 12 +++++++----- arch/x86/kernel/irq_64.c | 7 ++++--- arch/x86/kernel/process_64.c | 2 +- 9 files changed, 30 insertions(+), 24 deletions(-)
arch/x86/include/asm/current.h +0 -6
@@ -15,12 +15,6 @@ struct task_struct;struct pcpu_hot {struct task_struct *current_task;unsigned long top_of_stack; -void *hardirq_stack_ptr; -#ifdef CONFIG_X86_64 -bool hardirq_stack_inuse; -#else -void *softirq_stack_ptr; -#endif }; DECLARE_PER_CPU_CACHE_HOT(struct pcpu_hot, pcpu_hot);
arch/x86/include/asm/irq_stack.h +6 -6
@@ -117,7 +117,7 @@ ASM_CALL_ARG2 #define call_on_irqstack(func, asm_call, argconstr...) \ - call_on_stack(__this_cpu_read(pcpu_hot.hardirq_stack_ptr), \ + call_on_stack(__this_cpu_read(hardirq_stack_ptr), \ func, asm_call, argconstr) /* Macros to assert type correctness for run_*_on_irqstack macros */
@@ -136,7 +136,7 @@* User mode entry and interrupt on the irq stack do not \ * switch stacks. If from user mode the task stack is empty. \ */ \ -if (user_mode (regs) ||__this_cpu_read (pcpu_hot.hardirq_stack_inuse)) { \ +if (user_mode (regs) ||__this_cpu_read (hardirq_stack_inuse)) { \irq_enter_rcu (); \func (c_args); \irq_exit_rcu (); \
@@ -147,9 +147,9 @@* places. Invoke the stack switch macro with the call \ * sequence which matches the above direct invocation. \ */ \ -__this_cpu_write (pcpu_hot.hardirq_stack_inuse, true); \ +__this_cpu_write (hardirq_stack_inuse, true); \call_on_irqstack (func, asm_call, constr); \ -__this_cpu_write (pcpu_hot.hardirq_stack_inuse, false); \ +__this_cpu_write (hardirq_stack_inuse, false); \ } \ }
@@ -213,9 +213,9 @@*/ #define do_softirq_own_stack () \ { \ - __this_cpu_write(pcpu_hot.hardirq_stack_inuse, true); \ + __this_cpu_write(hardirq_stack_inuse, true); \ call_on_irqstack(__do_softirq, ASM_CALL_ARG0); \ - __this_cpu_write(pcpu_hot.hardirq_stack_inuse, false); \ + __this_cpu_write(hardirq_stack_inuse, false); \ }#endif
arch/x86/include/asm/processor.h +7 -0
@@ -420,6 +420,13 @@ struct irq_stack {char stack[IRQ_STACK_SIZE ]; }__aligned(IRQ_STACK_SIZE) ; +DECLARE_PER_CPU_CACHE_HOT(struct irq_stack *, hardirq_stack_ptr); +#ifdef CONFIG_X86_64 +DECLARE_PER_CPU_CACHE_HOT (bool, hardirq_stack_inuse); +#else +DECLARE_PER_CPU_CACHE_HOT(struct irq_stack *, softirq_stack_ptr); +#endif +#ifdef CONFIG_X86_64 static inline unsigned long cpu_kernelmode_gs_base (int cpu) {
arch/x86/kernel/dumpstack_32.c +2 -2
@@ -37,7 +37,7 @@ const char *stack_type_name(enum stack_type type)static bool in_hardirq_stack (unsigned long *stack,struct stack_info *info) { -unsigned long *begin = (unsigned long *)this_cpu_read (pcpu_hot.hardirq_stack_ptr); +unsigned long *begin = (unsigned long *)this_cpu_read (hardirq_stack_ptr);unsigned long *end = begin + (THREAD_SIZE /sizeof (long ));/*
@@ -62,7 +62,7 @@ static bool in_hardirq_stack(unsigned long *stack, struct stack_info *info)static bool in_softirq_stack (unsigned long *stack,struct stack_info *info) { -unsigned long *begin = (unsigned long *)this_cpu_read (pcpu_hot.softirq_stack_ptr); +unsigned long *begin = (unsigned long *)this_cpu_read (softirq_stack_ptr);unsigned long *end = begin + (THREAD_SIZE /sizeof (long ));/*
arch/x86/kernel/dumpstack_64.c +1 -1
@@ -134,7 +134,7 @@ static __always_inline bool in_exception_stack(unsigned long *stack, struct stac static __always_inline bool in_irq_stack(unsigned long *stack, struct stack_info *info) { -unsigned long *end = (unsigned long *)this_cpu_read (pcpu_hot.hardirq_stack_ptr); +unsigned long *end = (unsigned long *)this_cpu_read (hardirq_stack_ptr);unsigned long *begin;/*
arch/x86/kernel/irq.c +2 -0
@@ -36,6 +36,8 @@ EXPORT_PER_CPU_SYMBOL(irq_stat);DEFINE_PER_CPU_CACHE_HOT (u16, __softirq_pending);EXPORT_PER_CPU_SYMBOL (__softirq_pending); +DEFINE_PER_CPU_CACHE_HOT(struct irq_stack *, hardirq_stack_ptr); +atomic_t irq_err_count;/*
arch/x86/kernel/irq_32.c +7 -5
@@ -52,6 +52,8 @@ static inline int check_stack_overflow(void) { return 0; }static inline void print_stack_overflow (void ) { }#endif +DEFINE_PER_CPU_CACHE_HOT(struct irq_stack *, softirq_stack_ptr); +static void call_on_stack (void *func,void *stack) { asm volatile("xchgl %%ebx,%%esp \n"
@@ -74,7 +76,7 @@ static inline int execute_on_irq_stack(int overflow, struct irq_desc *desc)u32 *isp, *prev_esp, arg1; curstk = (struct irq_stack *)current_stack (); - irqstk =__this_cpu_read (pcpu_hot.hardirq_stack_ptr); + irqstk =__this_cpu_read (hardirq_stack_ptr);/* * this is where we switch to the IRQ stack. However, if we are
@@ -112,7 +114,7 @@ int irq_init_percpu_irqstack(unsigned int cpu)int node =cpu_to_node (cpu);struct page *ph, *ps; -if (per_cpu (pcpu_hot.hardirq_stack_ptr, cpu)) +if (per_cpu (hardirq_stack_ptr, cpu))return 0 ; ph =alloc_pages_node (node,THREADINFO_GFP ,THREAD_SIZE_ORDER );
@@ -124,8 +126,8 @@ int irq_init_percpu_irqstack(unsigned int cpu)return -ENOMEM ; } -per_cpu (pcpu_hot.hardirq_stack_ptr, cpu) =page_address (ph); -per_cpu (pcpu_hot.softirq_stack_ptr, cpu) =page_address (ps); +per_cpu (hardirq_stack_ptr, cpu) =page_address (ph); +per_cpu (softirq_stack_ptr, cpu) =page_address (ps);return 0 ; }
@@ -135,7 +137,7 @@ void do_softirq_own_stack(void)struct irq_stack *irqstk;u32 *isp, *prev_esp; - irqstk =__this_cpu_read (pcpu_hot.softirq_stack_ptr); + irqstk =__this_cpu_read (softirq_stack_ptr);/* build the stack frame on the softirq stack */ isp = (u32 *) ((char *)irqstk +sizeof (*irqstk));
arch/x86/kernel/irq_64.c +4 -3
@@ -26,6 +26,7 @@#include <asm/io_apic.h> #include <asm/apic.h> +DEFINE_PER_CPU_CACHE_HOT (bool, hardirq_stack_inuse); DEFINE_PER_CPU_PAGE_ALIGNED(struct irq_stack, irq_stack_backing_store) __visible;#ifdef CONFIG_VMAP_STACK
@@ -50,7 +51,7 @@ static int map_irq_stack(unsigned int cpu)return -ENOMEM ;/* Store actual TOS to avoid adjustment in the hotpath */ -per_cpu (pcpu_hot.hardirq_stack_ptr, cpu) = va +IRQ_STACK_SIZE -8 ; +per_cpu (hardirq_stack_ptr, cpu) = va +IRQ_STACK_SIZE -8 ; return 0; }#else
@@ -63,14 +64,14 @@ static int map_irq_stack(unsigned int cpu)void *va =per_cpu_ptr (&irq_stack_backing_store, cpu);/* Store actual TOS to avoid adjustment in the hotpath */ -per_cpu (pcpu_hot.hardirq_stack_ptr, cpu) = va +IRQ_STACK_SIZE -8 ; +per_cpu (hardirq_stack_ptr, cpu) = va +IRQ_STACK_SIZE -8 ; return 0; }#endif int irq_init_percpu_irqstack (unsigned int cpu) { -if (per_cpu (pcpu_hot.hardirq_stack_ptr, cpu)) +if (per_cpu (hardirq_stack_ptr, cpu))return 0 ;return map_irq_stack (cpu); }
arch/x86/kernel/process_64.c +1 -1
@@ -614,7 +614,7 @@ __switch_to(struct task_struct *prev_p, struct task_struct *next_p)int cpu =smp_processor_id ();WARN_ON_ONCE (IS_ENABLED (CONFIG_DEBUG_ENTRY ) && -this_cpu_read (pcpu_hot.hardirq_stack_inuse)); +this_cpu_read (hardirq_stack_inuse));if (!test_tsk_thread_flag (prev_p,TIF_NEED_FPU_LOAD ))switch_fpu_prepare (prev_p, cpu);
Signature · 1 line
2.48.1
[tip: x86/core] x86/irq: Move irq stacks to percpu hot section
The following commit has been merged into the x86/core branch of tip:
The following commit has been merged into the x86/core branch of tip:
Commit-ID: e4ac257c96fa96eae93d24a9d296c8cbc9c72db1 Gitweb: https://git.kernel.org/tip/e4ac257c96fa96eae93d24a9d296c8cbc9c72db1 Author: Brian Gerst <[email protected]> AuthorDate: Mon, 03 Mar 2025 11:52:42 -05:00 Committer: Ingo Molnar <[email protected]> CommitterDate: Mon, 03 Mar 2025 21:37:41 +01:00
x86/irq: Move irq stacks to percpu hot section
No functional change.
--- arch/x86/include/asm/current.h | 6 ------ arch/x86/include/asm/irq_stack.h | 12 ++++++------ arch/x86/include/asm/processor.h | 7 +++++++ arch/x86/kernel/dumpstack_32.c | 4 ++-- arch/x86/kernel/dumpstack_64.c | 2 +- arch/x86/kernel/irq.c | 2 ++ arch/x86/kernel/irq_32.c | 12 +++++++----- arch/x86/kernel/irq_64.c | 7 ++++--- arch/x86/kernel/process_64.c | 2 +- 9 files changed, 30 insertions(+), 24 deletions(-)
arch/x86/include/asm/current.h +0 -6
@@ -15,12 +15,6 @@ struct task_struct;struct pcpu_hot {struct task_struct *current_task;unsigned long top_of_stack; -void *hardirq_stack_ptr; -#ifdef CONFIG_X86_64 -bool hardirq_stack_inuse; -#else -void *softirq_stack_ptr; -#endif }; DECLARE_PER_CPU_CACHE_HOT(struct pcpu_hot, pcpu_hot);
arch/x86/include/asm/irq_stack.h +6 -6
@@ -117,7 +117,7 @@ ASM_CALL_ARG2 #define call_on_irqstack(func, asm_call, argconstr...) \ - call_on_stack(__this_cpu_read(pcpu_hot.hardirq_stack_ptr), \ + call_on_stack(__this_cpu_read(hardirq_stack_ptr), \ func, asm_call, argconstr) /* Macros to assert type correctness for run_*_on_irqstack macros */
@@ -136,7 +136,7 @@* User mode entry and interrupt on the irq stack do not \ * switch stacks. If from user mode the task stack is empty. \ */ \ -if (user_mode (regs) ||__this_cpu_read (pcpu_hot.hardirq_stack_inuse)) { \ +if (user_mode (regs) ||__this_cpu_read (hardirq_stack_inuse)) { \irq_enter_rcu (); \func (c_args); \irq_exit_rcu (); \
@@ -147,9 +147,9 @@* places. Invoke the stack switch macro with the call \ * sequence which matches the above direct invocation. \ */ \ -__this_cpu_write (pcpu_hot.hardirq_stack_inuse, true); \ +__this_cpu_write (hardirq_stack_inuse, true); \call_on_irqstack (func, asm_call, constr); \ -__this_cpu_write (pcpu_hot.hardirq_stack_inuse, false); \ +__this_cpu_write (hardirq_stack_inuse, false); \ } \ }
@@ -213,9 +213,9 @@*/ #define do_softirq_own_stack () \ { \ - __this_cpu_write(pcpu_hot.hardirq_stack_inuse, true); \ + __this_cpu_write(hardirq_stack_inuse, true); \ call_on_irqstack(__do_softirq, ASM_CALL_ARG0); \ - __this_cpu_write(pcpu_hot.hardirq_stack_inuse, false); \ + __this_cpu_write(hardirq_stack_inuse, false); \ }#endif
arch/x86/include/asm/processor.h +7 -0
@@ -420,6 +420,13 @@ struct irq_stack {char stack[IRQ_STACK_SIZE ]; }__aligned(IRQ_STACK_SIZE) ; +DECLARE_PER_CPU_CACHE_HOT(struct irq_stack *, hardirq_stack_ptr); +#ifdef CONFIG_X86_64 +DECLARE_PER_CPU_CACHE_HOT (bool, hardirq_stack_inuse); +#else +DECLARE_PER_CPU_CACHE_HOT(struct irq_stack *, softirq_stack_ptr); +#endif +#ifdef CONFIG_X86_64 static inline unsigned long cpu_kernelmode_gs_base (int cpu) {
arch/x86/kernel/dumpstack_32.c +2 -2
@@ -37,7 +37,7 @@ const char *stack_type_name(enum stack_type type)static bool in_hardirq_stack (unsigned long *stack,struct stack_info *info) { -unsigned long *begin = (unsigned long *)this_cpu_read (pcpu_hot.hardirq_stack_ptr); +unsigned long *begin = (unsigned long *)this_cpu_read (hardirq_stack_ptr);unsigned long *end = begin + (THREAD_SIZE /sizeof (long ));/*
@@ -62,7 +62,7 @@ static bool in_hardirq_stack(unsigned long *stack, struct stack_info *info)static bool in_softirq_stack (unsigned long *stack,struct stack_info *info) { -unsigned long *begin = (unsigned long *)this_cpu_read (pcpu_hot.softirq_stack_ptr); +unsigned long *begin = (unsigned long *)this_cpu_read (softirq_stack_ptr);unsigned long *end = begin + (THREAD_SIZE /sizeof (long ));/*
arch/x86/kernel/dumpstack_64.c +1 -1
@@ -134,7 +134,7 @@ static __always_inline bool in_exception_stack(unsigned long *stack, struct stac static __always_inline bool in_irq_stack(unsigned long *stack, struct stack_info *info) { -unsigned long *end = (unsigned long *)this_cpu_read (pcpu_hot.hardirq_stack_ptr); +unsigned long *end = (unsigned long *)this_cpu_read (hardirq_stack_ptr);unsigned long *begin;/*
arch/x86/kernel/irq.c +2 -0
@@ -36,6 +36,8 @@ EXPORT_PER_CPU_SYMBOL(irq_stat);DEFINE_PER_CPU_CACHE_HOT (u16, __softirq_pending);EXPORT_PER_CPU_SYMBOL (__softirq_pending); +DEFINE_PER_CPU_CACHE_HOT(struct irq_stack *, hardirq_stack_ptr); +atomic_t irq_err_count;/*
arch/x86/kernel/irq_32.c +7 -5
@@ -52,6 +52,8 @@ static inline int check_stack_overflow(void) { return 0; }static inline void print_stack_overflow (void ) { }#endif +DEFINE_PER_CPU_CACHE_HOT(struct irq_stack *, softirq_stack_ptr); +static void call_on_stack (void *func,void *stack) { asm volatile("xchgl %%ebx,%%esp \n"
@@ -74,7 +76,7 @@ static inline int execute_on_irq_stack(int overflow, struct irq_desc *desc)u32 *isp, *prev_esp, arg1; curstk = (struct irq_stack *)current_stack (); - irqstk =__this_cpu_read (pcpu_hot.hardirq_stack_ptr); + irqstk =__this_cpu_read (hardirq_stack_ptr);/* * this is where we switch to the IRQ stack. However, if we are
@@ -112,7 +114,7 @@ int irq_init_percpu_irqstack(unsigned int cpu)int node =cpu_to_node (cpu);struct page *ph, *ps; -if (per_cpu (pcpu_hot.hardirq_stack_ptr, cpu)) +if (per_cpu (hardirq_stack_ptr, cpu))return 0 ; ph =alloc_pages_node (node,THREADINFO_GFP ,THREAD_SIZE_ORDER );
@@ -124,8 +126,8 @@ int irq_init_percpu_irqstack(unsigned int cpu)return -ENOMEM ; } -per_cpu (pcpu_hot.hardirq_stack_ptr, cpu) =page_address (ph); -per_cpu (pcpu_hot.softirq_stack_ptr, cpu) =page_address (ps); +per_cpu (hardirq_stack_ptr, cpu) =page_address (ph); +per_cpu (softirq_stack_ptr, cpu) =page_address (ps);return 0 ; }
@@ -135,7 +137,7 @@ void do_softirq_own_stack(void)struct irq_stack *irqstk;u32 *isp, *prev_esp; - irqstk =__this_cpu_read (pcpu_hot.softirq_stack_ptr); + irqstk =__this_cpu_read (softirq_stack_ptr);/* build the stack frame on the softirq stack */ isp = (u32 *) ((char *)irqstk +sizeof (*irqstk));
arch/x86/kernel/irq_64.c +4 -3
@@ -26,6 +26,7 @@#include <asm/io_apic.h> #include <asm/apic.h> +DEFINE_PER_CPU_CACHE_HOT (bool, hardirq_stack_inuse); DEFINE_PER_CPU_PAGE_ALIGNED(struct irq_stack, irq_stack_backing_store) __visible;#ifdef CONFIG_VMAP_STACK
@@ -50,7 +51,7 @@ static int map_irq_stack(unsigned int cpu)return -ENOMEM ;/* Store actual TOS to avoid adjustment in the hotpath */ -per_cpu (pcpu_hot.hardirq_stack_ptr, cpu) = va +IRQ_STACK_SIZE -8 ; +per_cpu (hardirq_stack_ptr, cpu) = va +IRQ_STACK_SIZE -8 ; return 0; }#else
@@ -63,14 +64,14 @@ static int map_irq_stack(unsigned int cpu)void *va =per_cpu_ptr (&irq_stack_backing_store, cpu);/* Store actual TOS to avoid adjustment in the hotpath */ -per_cpu (pcpu_hot.hardirq_stack_ptr, cpu) = va +IRQ_STACK_SIZE -8 ; +per_cpu (hardirq_stack_ptr, cpu) = va +IRQ_STACK_SIZE -8 ; return 0; }#endif int irq_init_percpu_irqstack (unsigned int cpu) { -if (per_cpu (pcpu_hot.hardirq_stack_ptr, cpu)) +if (per_cpu (hardirq_stack_ptr, cpu))return 0 ;return map_irq_stack (cpu); }
arch/x86/kernel/process_64.c +1 -1
@@ -614,7 +614,7 @@ __switch_to(struct task_struct *prev_p, struct task_struct *next_p)int cpu =smp_processor_id ();WARN_ON_ONCE (IS_ENABLED (CONFIG_DEBUG_ENTRY ) && -this_cpu_read (pcpu_hot.hardirq_stack_inuse)); +this_cpu_read (hardirq_stack_inuse));if (!test_tsk_thread_flag (prev_p,TIF_NEED_FPU_LOAD ))switch_fpu_prepare (prev_p, cpu);
[tip: x86/core] x86/irq: Move irq stacks to percpu hot section
In reply to Brian GerstThe following commit has been merged into the x86/core branch of tip:
The following commit has been merged into the x86/core branch of tip:
Commit-ID: 7ef636dcf031898ea6775c89d27e914979071cf9 Gitweb: https://git.kernel.org/tip/7ef636dcf031898ea6775c89d27e914979071cf9 Author: Brian Gerst <[email protected]> AuthorDate: Mon, 03 Mar 2025 11:52:42 -05:00 Committer: Ingo Molnar <[email protected]> CommitterDate: Tue, 04 Mar 2025 11:24:28 +01:00
x86/irq: Move irq stacks to percpu hot section
No functional change.
--- arch/x86/include/asm/current.h | 6 ------ arch/x86/include/asm/irq_stack.h | 12 ++++++------ arch/x86/include/asm/processor.h | 7 +++++++ arch/x86/kernel/dumpstack_32.c | 4 ++-- arch/x86/kernel/dumpstack_64.c | 2 +- arch/x86/kernel/irq.c | 2 ++ arch/x86/kernel/irq_32.c | 12 +++++++----- arch/x86/kernel/irq_64.c | 7 ++++--- arch/x86/kernel/process_64.c | 2 +- 9 files changed, 30 insertions(+), 24 deletions(-)
arch/x86/include/asm/current.h +0 -6
@@ -15,12 +15,6 @@ struct task_struct;struct pcpu_hot {struct task_struct *current_task;unsigned long top_of_stack; -void *hardirq_stack_ptr; -#ifdef CONFIG_X86_64 -bool hardirq_stack_inuse; -#else -void *softirq_stack_ptr; -#endif }; DECLARE_PER_CPU_CACHE_HOT(struct pcpu_hot, pcpu_hot);
arch/x86/include/asm/irq_stack.h +6 -6
@@ -117,7 +117,7 @@ ASM_CALL_ARG2 #define call_on_irqstack(func, asm_call, argconstr...) \ - call_on_stack(__this_cpu_read(pcpu_hot.hardirq_stack_ptr), \ + call_on_stack(__this_cpu_read(hardirq_stack_ptr), \ func, asm_call, argconstr) /* Macros to assert type correctness for run_*_on_irqstack macros */
@@ -136,7 +136,7 @@* User mode entry and interrupt on the irq stack do not \ * switch stacks. If from user mode the task stack is empty. \ */ \ -if (user_mode (regs) ||__this_cpu_read (pcpu_hot.hardirq_stack_inuse)) { \ +if (user_mode (regs) ||__this_cpu_read (hardirq_stack_inuse)) { \irq_enter_rcu (); \func (c_args); \irq_exit_rcu (); \
@@ -147,9 +147,9 @@* places. Invoke the stack switch macro with the call \ * sequence which matches the above direct invocation. \ */ \ -__this_cpu_write (pcpu_hot.hardirq_stack_inuse, true); \ +__this_cpu_write (hardirq_stack_inuse, true); \call_on_irqstack (func, asm_call, constr); \ -__this_cpu_write (pcpu_hot.hardirq_stack_inuse, false); \ +__this_cpu_write (hardirq_stack_inuse, false); \ } \ }
@@ -213,9 +213,9 @@*/ #define do_softirq_own_stack () \ { \ - __this_cpu_write(pcpu_hot.hardirq_stack_inuse, true); \ + __this_cpu_write(hardirq_stack_inuse, true); \ call_on_irqstack(__do_softirq, ASM_CALL_ARG0); \ - __this_cpu_write(pcpu_hot.hardirq_stack_inuse, false); \ + __this_cpu_write(hardirq_stack_inuse, false); \ }#endif
arch/x86/include/asm/processor.h +7 -0
@@ -415,6 +415,13 @@ struct irq_stack {char stack[IRQ_STACK_SIZE ]; }__aligned(IRQ_STACK_SIZE) ; +DECLARE_PER_CPU_CACHE_HOT(struct irq_stack *, hardirq_stack_ptr); +#ifdef CONFIG_X86_64 +DECLARE_PER_CPU_CACHE_HOT (bool, hardirq_stack_inuse); +#else +DECLARE_PER_CPU_CACHE_HOT(struct irq_stack *, softirq_stack_ptr); +#endif +#ifdef CONFIG_X86_64 static inline unsigned long cpu_kernelmode_gs_base (int cpu) {
arch/x86/kernel/dumpstack_32.c +2 -2
@@ -37,7 +37,7 @@ const char *stack_type_name(enum stack_type type)static bool in_hardirq_stack (unsigned long *stack,struct stack_info *info) { -unsigned long *begin = (unsigned long *)this_cpu_read (pcpu_hot.hardirq_stack_ptr); +unsigned long *begin = (unsigned long *)this_cpu_read (hardirq_stack_ptr);unsigned long *end = begin + (THREAD_SIZE /sizeof (long ));/*
@@ -62,7 +62,7 @@ static bool in_hardirq_stack(unsigned long *stack, struct stack_info *info)static bool in_softirq_stack (unsigned long *stack,struct stack_info *info) { -unsigned long *begin = (unsigned long *)this_cpu_read (pcpu_hot.softirq_stack_ptr); +unsigned long *begin = (unsigned long *)this_cpu_read (softirq_stack_ptr);unsigned long *end = begin + (THREAD_SIZE /sizeof (long ));/*
arch/x86/kernel/dumpstack_64.c +1 -1
@@ -134,7 +134,7 @@ static __always_inline bool in_exception_stack(unsigned long *stack, struct stac static __always_inline bool in_irq_stack(unsigned long *stack, struct stack_info *info) { -unsigned long *end = (unsigned long *)this_cpu_read (pcpu_hot.hardirq_stack_ptr); +unsigned long *end = (unsigned long *)this_cpu_read (hardirq_stack_ptr);unsigned long *begin;/*
arch/x86/kernel/irq.c +2 -0
@@ -36,6 +36,8 @@ EXPORT_PER_CPU_SYMBOL(irq_stat);DEFINE_PER_CPU_CACHE_HOT (u16, __softirq_pending);EXPORT_PER_CPU_SYMBOL (__softirq_pending); +DEFINE_PER_CPU_CACHE_HOT(struct irq_stack *, hardirq_stack_ptr); +atomic_t irq_err_count;/*
arch/x86/kernel/irq_32.c +7 -5
@@ -49,6 +49,8 @@ static inline bool check_stack_overflow(void) { return false; }static inline void print_stack_overflow (void ) { }#endif +DEFINE_PER_CPU_CACHE_HOT(struct irq_stack *, softirq_stack_ptr); +static void call_on_stack (void *func,void *stack) { asm volatile("xchgl %[sp], %%esp\n"
@@ -71,7 +73,7 @@ static inline bool execute_on_irq_stack(bool overflow, struct irq_desc *desc)u32 *isp, *prev_esp; curstk = (struct irq_stack *)current_stack (); - irqstk =__this_cpu_read (pcpu_hot.hardirq_stack_ptr); + irqstk =__this_cpu_read (hardirq_stack_ptr);/* * this is where we switch to the IRQ stack. However, if we are
@@ -109,7 +111,7 @@ int irq_init_percpu_irqstack(unsigned int cpu)int node =cpu_to_node (cpu);struct page *ph, *ps; -if (per_cpu (pcpu_hot.hardirq_stack_ptr, cpu)) +if (per_cpu (hardirq_stack_ptr, cpu))return 0 ; ph =alloc_pages_node (node,THREADINFO_GFP ,THREAD_SIZE_ORDER );
@@ -121,8 +123,8 @@ int irq_init_percpu_irqstack(unsigned int cpu)return -ENOMEM ; } -per_cpu (pcpu_hot.hardirq_stack_ptr, cpu) =page_address (ph); -per_cpu (pcpu_hot.softirq_stack_ptr, cpu) =page_address (ps); +per_cpu (hardirq_stack_ptr, cpu) =page_address (ph); +per_cpu (softirq_stack_ptr, cpu) =page_address (ps);return 0 ; }
@@ -132,7 +134,7 @@ void do_softirq_own_stack(void)struct irq_stack *irqstk;u32 *isp, *prev_esp; - irqstk =__this_cpu_read (pcpu_hot.softirq_stack_ptr); + irqstk =__this_cpu_read (softirq_stack_ptr);/* build the stack frame on the softirq stack */ isp = (u32 *) ((char *)irqstk +sizeof (*irqstk));
arch/x86/kernel/irq_64.c +4 -3
@@ -26,6 +26,7 @@#include <asm/io_apic.h> #include <asm/apic.h> +DEFINE_PER_CPU_CACHE_HOT (bool, hardirq_stack_inuse); DEFINE_PER_CPU_PAGE_ALIGNED(struct irq_stack, irq_stack_backing_store) __visible;#ifdef CONFIG_VMAP_STACK
@@ -50,7 +51,7 @@ static int map_irq_stack(unsigned int cpu)return -ENOMEM ;/* Store actual TOS to avoid adjustment in the hotpath */ -per_cpu (pcpu_hot.hardirq_stack_ptr, cpu) = va +IRQ_STACK_SIZE -8 ; +per_cpu (hardirq_stack_ptr, cpu) = va +IRQ_STACK_SIZE -8 ; return 0; }#else
@@ -63,14 +64,14 @@ static int map_irq_stack(unsigned int cpu)void *va =per_cpu_ptr (&irq_stack_backing_store, cpu);/* Store actual TOS to avoid adjustment in the hotpath */ -per_cpu (pcpu_hot.hardirq_stack_ptr, cpu) = va +IRQ_STACK_SIZE -8 ; +per_cpu (hardirq_stack_ptr, cpu) = va +IRQ_STACK_SIZE -8 ; return 0; }#endif int irq_init_percpu_irqstack (unsigned int cpu) { -if (per_cpu (pcpu_hot.hardirq_stack_ptr, cpu)) +if (per_cpu (hardirq_stack_ptr, cpu))return 0 ;return map_irq_stack (cpu); }
arch/x86/kernel/process_64.c +1 -1
@@ -614,7 +614,7 @@ __switch_to(struct task_struct *prev_p, struct task_struct *next_p)int cpu =smp_processor_id ();WARN_ON_ONCE (IS_ENABLED (CONFIG_DEBUG_ENTRY ) && -this_cpu_read (pcpu_hot.hardirq_stack_inuse)); +this_cpu_read (hardirq_stack_inuse));if (!test_tsk_thread_flag (prev_p,TIF_NEED_FPU_LOAD ))switch_fpu_prepare (prev_p, cpu);
[tip: x86/core] x86/irq: Move irq stacks to percpu hot section
In reply to Brian GerstThe following commit has been merged into the x86/core branch of tip:
The following commit has been merged into the x86/core branch of tip:
Commit-ID: 7b1619bd7564c15a1fc25129f28c9361efdea83e Gitweb: https://git.kernel.org/tip/7b1619bd7564c15a1fc25129f28c9361efdea83e Author: Brian Gerst <[email protected]> AuthorDate: Mon, 03 Mar 2025 11:52:42 -05:00 Committer: Ingo Molnar <[email protected]> CommitterDate: Tue, 04 Mar 2025 20:18:02 +01:00
x86/irq: Move irq stacks to percpu hot section
No functional change.
--- arch/x86/include/asm/current.h | 6 ------ arch/x86/include/asm/irq_stack.h | 12 ++++++------ arch/x86/include/asm/processor.h | 7 +++++++ arch/x86/kernel/dumpstack_32.c | 4 ++-- arch/x86/kernel/dumpstack_64.c | 2 +- arch/x86/kernel/irq.c | 2 ++ arch/x86/kernel/irq_32.c | 12 +++++++----- arch/x86/kernel/irq_64.c | 7 ++++--- arch/x86/kernel/process_64.c | 2 +- 9 files changed, 30 insertions(+), 24 deletions(-)
arch/x86/include/asm/current.h +0 -6
@@ -15,12 +15,6 @@ struct task_struct;struct pcpu_hot {struct task_struct *current_task;unsigned long top_of_stack; -void *hardirq_stack_ptr; -#ifdef CONFIG_X86_64 -bool hardirq_stack_inuse; -#else -void *softirq_stack_ptr; -#endif }; DECLARE_PER_CPU_CACHE_HOT(struct pcpu_hot, pcpu_hot);
arch/x86/include/asm/irq_stack.h +6 -6
@@ -116,7 +116,7 @@ ASM_CALL_ARG2 #define call_on_irqstack(func, asm_call, argconstr...) \ - call_on_stack(__this_cpu_read(pcpu_hot.hardirq_stack_ptr), \ + call_on_stack(__this_cpu_read(hardirq_stack_ptr), \ func, asm_call, argconstr) /* Macros to assert type correctness for run_*_on_irqstack macros */
@@ -135,7 +135,7 @@* User mode entry and interrupt on the irq stack do not \ * switch stacks. If from user mode the task stack is empty. \ */ \ -if (user_mode (regs) ||__this_cpu_read (pcpu_hot.hardirq_stack_inuse)) { \ +if (user_mode (regs) ||__this_cpu_read (hardirq_stack_inuse)) { \irq_enter_rcu (); \func (c_args); \irq_exit_rcu (); \
@@ -146,9 +146,9 @@* places. Invoke the stack switch macro with the call \ * sequence which matches the above direct invocation. \ */ \ -__this_cpu_write (pcpu_hot.hardirq_stack_inuse, true); \ +__this_cpu_write (hardirq_stack_inuse, true); \call_on_irqstack (func, asm_call, constr); \ -__this_cpu_write (pcpu_hot.hardirq_stack_inuse, false); \ +__this_cpu_write (hardirq_stack_inuse, false); \ } \ }
@@ -212,9 +212,9 @@*/ #define do_softirq_own_stack () \ { \ - __this_cpu_write(pcpu_hot.hardirq_stack_inuse, true); \ + __this_cpu_write(hardirq_stack_inuse, true); \ call_on_irqstack(__do_softirq, ASM_CALL_ARG0); \ - __this_cpu_write(pcpu_hot.hardirq_stack_inuse, false); \ + __this_cpu_write(hardirq_stack_inuse, false); \ }#endif
arch/x86/include/asm/processor.h +7 -0
@@ -415,6 +415,13 @@ struct irq_stack {char stack[IRQ_STACK_SIZE ]; }__aligned(IRQ_STACK_SIZE) ; +DECLARE_PER_CPU_CACHE_HOT(struct irq_stack *, hardirq_stack_ptr); +#ifdef CONFIG_X86_64 +DECLARE_PER_CPU_CACHE_HOT (bool, hardirq_stack_inuse); +#else +DECLARE_PER_CPU_CACHE_HOT(struct irq_stack *, softirq_stack_ptr); +#endif +#ifdef CONFIG_X86_64 static inline unsigned long cpu_kernelmode_gs_base (int cpu) {
arch/x86/kernel/dumpstack_32.c +2 -2
@@ -37,7 +37,7 @@ const char *stack_type_name(enum stack_type type)static bool in_hardirq_stack (unsigned long *stack,struct stack_info *info) { -unsigned long *begin = (unsigned long *)this_cpu_read (pcpu_hot.hardirq_stack_ptr); +unsigned long *begin = (unsigned long *)this_cpu_read (hardirq_stack_ptr);unsigned long *end = begin + (THREAD_SIZE /sizeof (long ));/*
@@ -62,7 +62,7 @@ static bool in_hardirq_stack(unsigned long *stack, struct stack_info *info)static bool in_softirq_stack (unsigned long *stack,struct stack_info *info) { -unsigned long *begin = (unsigned long *)this_cpu_read (pcpu_hot.softirq_stack_ptr); +unsigned long *begin = (unsigned long *)this_cpu_read (softirq_stack_ptr);unsigned long *end = begin + (THREAD_SIZE /sizeof (long ));/*
arch/x86/kernel/dumpstack_64.c +1 -1
@@ -134,7 +134,7 @@ static __always_inline bool in_exception_stack(unsigned long *stack, struct stac static __always_inline bool in_irq_stack(unsigned long *stack, struct stack_info *info) { -unsigned long *end = (unsigned long *)this_cpu_read (pcpu_hot.hardirq_stack_ptr); +unsigned long *end = (unsigned long *)this_cpu_read (hardirq_stack_ptr);unsigned long *begin;/*
arch/x86/kernel/irq.c +2 -0
@@ -36,6 +36,8 @@ EXPORT_PER_CPU_SYMBOL(irq_stat);DEFINE_PER_CPU_CACHE_HOT (u16, __softirq_pending);EXPORT_PER_CPU_SYMBOL (__softirq_pending); +DEFINE_PER_CPU_CACHE_HOT(struct irq_stack *, hardirq_stack_ptr); +atomic_t irq_err_count;/*
arch/x86/kernel/irq_32.c +7 -5
@@ -49,6 +49,8 @@ static inline bool check_stack_overflow(void) { return false; }static inline void print_stack_overflow (void ) { }#endif +DEFINE_PER_CPU_CACHE_HOT(struct irq_stack *, softirq_stack_ptr); +static void call_on_stack (void *func,void *stack) { asm volatile("xchgl %[sp], %%esp\n"
@@ -71,7 +73,7 @@ static inline bool execute_on_irq_stack(bool overflow, struct irq_desc *desc)u32 *isp, *prev_esp; curstk = (struct irq_stack *)current_stack (); - irqstk =__this_cpu_read (pcpu_hot.hardirq_stack_ptr); + irqstk =__this_cpu_read (hardirq_stack_ptr);/* * this is where we switch to the IRQ stack. However, if we are
@@ -109,7 +111,7 @@ int irq_init_percpu_irqstack(unsigned int cpu)int node =cpu_to_node (cpu);struct page *ph, *ps; -if (per_cpu (pcpu_hot.hardirq_stack_ptr, cpu)) +if (per_cpu (hardirq_stack_ptr, cpu))return 0 ; ph =alloc_pages_node (node,THREADINFO_GFP ,THREAD_SIZE_ORDER );
@@ -121,8 +123,8 @@ int irq_init_percpu_irqstack(unsigned int cpu)return -ENOMEM ; } -per_cpu (pcpu_hot.hardirq_stack_ptr, cpu) =page_address (ph); -per_cpu (pcpu_hot.softirq_stack_ptr, cpu) =page_address (ps); +per_cpu (hardirq_stack_ptr, cpu) =page_address (ph); +per_cpu (softirq_stack_ptr, cpu) =page_address (ps);return 0 ; }
@@ -132,7 +134,7 @@ void do_softirq_own_stack(void)struct irq_stack *irqstk;u32 *isp, *prev_esp; - irqstk =__this_cpu_read (pcpu_hot.softirq_stack_ptr); + irqstk =__this_cpu_read (softirq_stack_ptr);/* build the stack frame on the softirq stack */ isp = (u32 *) ((char *)irqstk +sizeof (*irqstk));
arch/x86/kernel/irq_64.c +4 -3
@@ -26,6 +26,7 @@#include <asm/io_apic.h> #include <asm/apic.h> +DEFINE_PER_CPU_CACHE_HOT (bool, hardirq_stack_inuse); DEFINE_PER_CPU_PAGE_ALIGNED(struct irq_stack, irq_stack_backing_store) __visible;#ifdef CONFIG_VMAP_STACK
@@ -50,7 +51,7 @@ static int map_irq_stack(unsigned int cpu)return -ENOMEM ;/* Store actual TOS to avoid adjustment in the hotpath */ -per_cpu (pcpu_hot.hardirq_stack_ptr, cpu) = va +IRQ_STACK_SIZE -8 ; +per_cpu (hardirq_stack_ptr, cpu) = va +IRQ_STACK_SIZE -8 ; return 0; }#else
@@ -63,14 +64,14 @@ static int map_irq_stack(unsigned int cpu)void *va =per_cpu_ptr (&irq_stack_backing_store, cpu);/* Store actual TOS to avoid adjustment in the hotpath */ -per_cpu (pcpu_hot.hardirq_stack_ptr, cpu) = va +IRQ_STACK_SIZE -8 ; +per_cpu (hardirq_stack_ptr, cpu) = va +IRQ_STACK_SIZE -8 ; return 0; }#endif int irq_init_percpu_irqstack (unsigned int cpu) { -if (per_cpu (pcpu_hot.hardirq_stack_ptr, cpu)) +if (per_cpu (hardirq_stack_ptr, cpu))return 0 ;return map_irq_stack (cpu); }
arch/x86/kernel/process_64.c +1 -1
@@ -614,7 +614,7 @@ __switch_to(struct task_struct *prev_p, struct task_struct *next_p)int cpu =smp_processor_id ();WARN_ON_ONCE (IS_ENABLED (CONFIG_DEBUG_ENTRY ) && -this_cpu_read (pcpu_hot.hardirq_stack_inuse)); +this_cpu_read (hardirq_stack_inuse));if (!test_tsk_thread_flag (prev_p,TIF_NEED_FPU_LOAD ))switch_fpu_prepare (prev_p, cpu);
[tip: x86/core] x86/irq: Move irq stacks to percpu hot section
In reply to Brian GerstThe following commit has been merged into the x86/core branch of tip:
The following commit has been merged into the x86/core branch of tip:
Commit-ID: c6a0918072eaa97df268c00c05822ea982a321b6 Gitweb: https://git.kernel.org/tip/c6a0918072eaa97df268c00c05822ea982a321b6 Author: Brian Gerst <[email protected]> AuthorDate: Mon, 03 Mar 2025 11:52:42 -05:00 Committer: Ingo Molnar <[email protected]> CommitterDate: Tue, 04 Mar 2025 20:30:33 +01:00
x86/irq: Move irq stacks to percpu hot section
No functional change.
--- arch/x86/include/asm/current.h | 6 ------ arch/x86/include/asm/irq_stack.h | 12 ++++++------ arch/x86/include/asm/processor.h | 7 +++++++ arch/x86/kernel/dumpstack_32.c | 4 ++-- arch/x86/kernel/dumpstack_64.c | 2 +- arch/x86/kernel/irq.c | 2 ++ arch/x86/kernel/irq_32.c | 12 +++++++----- arch/x86/kernel/irq_64.c | 7 ++++--- arch/x86/kernel/process_64.c | 2 +- 9 files changed, 30 insertions(+), 24 deletions(-)
arch/x86/include/asm/current.h +0 -6
@@ -15,12 +15,6 @@ struct task_struct;struct pcpu_hot {struct task_struct *current_task;unsigned long top_of_stack; -void *hardirq_stack_ptr; -#ifdef CONFIG_X86_64 -bool hardirq_stack_inuse; -#else -void *softirq_stack_ptr; -#endif }; DECLARE_PER_CPU_CACHE_HOT(struct pcpu_hot, pcpu_hot);
arch/x86/include/asm/irq_stack.h +6 -6
@@ -116,7 +116,7 @@ ASM_CALL_ARG2 #define call_on_irqstack(func, asm_call, argconstr...) \ - call_on_stack(__this_cpu_read(pcpu_hot.hardirq_stack_ptr), \ + call_on_stack(__this_cpu_read(hardirq_stack_ptr), \ func, asm_call, argconstr) /* Macros to assert type correctness for run_*_on_irqstack macros */
@@ -135,7 +135,7 @@* User mode entry and interrupt on the irq stack do not \ * switch stacks. If from user mode the task stack is empty. \ */ \ -if (user_mode (regs) ||__this_cpu_read (pcpu_hot.hardirq_stack_inuse)) { \ +if (user_mode (regs) ||__this_cpu_read (hardirq_stack_inuse)) { \irq_enter_rcu (); \func (c_args); \irq_exit_rcu (); \
@@ -146,9 +146,9 @@* places. Invoke the stack switch macro with the call \ * sequence which matches the above direct invocation. \ */ \ -__this_cpu_write (pcpu_hot.hardirq_stack_inuse, true); \ +__this_cpu_write (hardirq_stack_inuse, true); \call_on_irqstack (func, asm_call, constr); \ -__this_cpu_write (pcpu_hot.hardirq_stack_inuse, false); \ +__this_cpu_write (hardirq_stack_inuse, false); \ } \ }
@@ -212,9 +212,9 @@*/ #define do_softirq_own_stack () \ { \ - __this_cpu_write(pcpu_hot.hardirq_stack_inuse, true); \ + __this_cpu_write(hardirq_stack_inuse, true); \ call_on_irqstack(__do_softirq, ASM_CALL_ARG0); \ - __this_cpu_write(pcpu_hot.hardirq_stack_inuse, false); \ + __this_cpu_write(hardirq_stack_inuse, false); \ }#endif
arch/x86/include/asm/processor.h +7 -0
@@ -415,6 +415,13 @@ struct irq_stack {char stack[IRQ_STACK_SIZE ]; }__aligned(IRQ_STACK_SIZE) ; +DECLARE_PER_CPU_CACHE_HOT(struct irq_stack *, hardirq_stack_ptr); +#ifdef CONFIG_X86_64 +DECLARE_PER_CPU_CACHE_HOT (bool, hardirq_stack_inuse); +#else +DECLARE_PER_CPU_CACHE_HOT(struct irq_stack *, softirq_stack_ptr); +#endif +#ifdef CONFIG_X86_64 static inline unsigned long cpu_kernelmode_gs_base (int cpu) {
arch/x86/kernel/dumpstack_32.c +2 -2
@@ -37,7 +37,7 @@ const char *stack_type_name(enum stack_type type)static bool in_hardirq_stack (unsigned long *stack,struct stack_info *info) { -unsigned long *begin = (unsigned long *)this_cpu_read (pcpu_hot.hardirq_stack_ptr); +unsigned long *begin = (unsigned long *)this_cpu_read (hardirq_stack_ptr);unsigned long *end = begin + (THREAD_SIZE /sizeof (long ));/*
@@ -62,7 +62,7 @@ static bool in_hardirq_stack(unsigned long *stack, struct stack_info *info)static bool in_softirq_stack (unsigned long *stack,struct stack_info *info) { -unsigned long *begin = (unsigned long *)this_cpu_read (pcpu_hot.softirq_stack_ptr); +unsigned long *begin = (unsigned long *)this_cpu_read (softirq_stack_ptr);unsigned long *end = begin + (THREAD_SIZE /sizeof (long ));/*
arch/x86/kernel/dumpstack_64.c +1 -1
@@ -134,7 +134,7 @@ static __always_inline bool in_exception_stack(unsigned long *stack, struct stac static __always_inline bool in_irq_stack(unsigned long *stack, struct stack_info *info) { -unsigned long *end = (unsigned long *)this_cpu_read (pcpu_hot.hardirq_stack_ptr); +unsigned long *end = (unsigned long *)this_cpu_read (hardirq_stack_ptr);unsigned long *begin;/*
arch/x86/kernel/irq.c +2 -0
@@ -36,6 +36,8 @@ EXPORT_PER_CPU_SYMBOL(irq_stat);DEFINE_PER_CPU_CACHE_HOT (u16, __softirq_pending);EXPORT_PER_CPU_SYMBOL (__softirq_pending); +DEFINE_PER_CPU_CACHE_HOT(struct irq_stack *, hardirq_stack_ptr); +atomic_t irq_err_count;/*
arch/x86/kernel/irq_32.c +7 -5
@@ -49,6 +49,8 @@ static inline bool check_stack_overflow(void) { return false; }static inline void print_stack_overflow (void ) { }#endif +DEFINE_PER_CPU_CACHE_HOT(struct irq_stack *, softirq_stack_ptr); +static void call_on_stack (void *func,void *stack) { asm volatile("xchgl %[sp], %%esp\n"
@@ -70,7 +72,7 @@ static inline bool execute_on_irq_stack(bool overflow, struct irq_desc *desc)u32 *isp, *prev_esp; curstk = (struct irq_stack *)current_stack (); - irqstk =__this_cpu_read (pcpu_hot.hardirq_stack_ptr); + irqstk =__this_cpu_read (hardirq_stack_ptr);/* * this is where we switch to the IRQ stack. However, if we are
@@ -107,7 +109,7 @@ int irq_init_percpu_irqstack(unsigned int cpu)int node =cpu_to_node (cpu);struct page *ph, *ps; -if (per_cpu (pcpu_hot.hardirq_stack_ptr, cpu)) +if (per_cpu (hardirq_stack_ptr, cpu))return 0 ; ph =alloc_pages_node (node,THREADINFO_GFP ,THREAD_SIZE_ORDER );
@@ -119,8 +121,8 @@ int irq_init_percpu_irqstack(unsigned int cpu)return -ENOMEM ; } -per_cpu (pcpu_hot.hardirq_stack_ptr, cpu) =page_address (ph); -per_cpu (pcpu_hot.softirq_stack_ptr, cpu) =page_address (ps); +per_cpu (hardirq_stack_ptr, cpu) =page_address (ph); +per_cpu (softirq_stack_ptr, cpu) =page_address (ps);return 0 ; }
@@ -130,7 +132,7 @@ void do_softirq_own_stack(void)struct irq_stack *irqstk;u32 *isp, *prev_esp; - irqstk =__this_cpu_read (pcpu_hot.softirq_stack_ptr); + irqstk =__this_cpu_read (softirq_stack_ptr);/* build the stack frame on the softirq stack */ isp = (u32 *) ((char *)irqstk +sizeof (*irqstk));
arch/x86/kernel/irq_64.c +4 -3
@@ -26,6 +26,7 @@#include <asm/io_apic.h> #include <asm/apic.h> +DEFINE_PER_CPU_CACHE_HOT (bool, hardirq_stack_inuse); DEFINE_PER_CPU_PAGE_ALIGNED(struct irq_stack, irq_stack_backing_store) __visible;#ifdef CONFIG_VMAP_STACK
@@ -50,7 +51,7 @@ static int map_irq_stack(unsigned int cpu)return -ENOMEM ;/* Store actual TOS to avoid adjustment in the hotpath */ -per_cpu (pcpu_hot.hardirq_stack_ptr, cpu) = va +IRQ_STACK_SIZE -8 ; +per_cpu (hardirq_stack_ptr, cpu) = va +IRQ_STACK_SIZE -8 ; return 0; }#else
@@ -63,14 +64,14 @@ static int map_irq_stack(unsigned int cpu)void *va =per_cpu_ptr (&irq_stack_backing_store, cpu);/* Store actual TOS to avoid adjustment in the hotpath */ -per_cpu (pcpu_hot.hardirq_stack_ptr, cpu) = va +IRQ_STACK_SIZE -8 ; +per_cpu (hardirq_stack_ptr, cpu) = va +IRQ_STACK_SIZE -8 ; return 0; }#endif int irq_init_percpu_irqstack (unsigned int cpu) { -if (per_cpu (pcpu_hot.hardirq_stack_ptr, cpu)) +if (per_cpu (hardirq_stack_ptr, cpu))return 0 ;return map_irq_stack (cpu); }
arch/x86/kernel/process_64.c +1 -1
@@ -614,7 +614,7 @@ __switch_to(struct task_struct *prev_p, struct task_struct *next_p)int cpu =smp_processor_id ();WARN_ON_ONCE (IS_ENABLED (CONFIG_DEBUG_ENTRY ) && -this_cpu_read (pcpu_hot.hardirq_stack_inuse)); +this_cpu_read (hardirq_stack_inuse));if (!test_tsk_thread_flag (prev_p,TIF_NEED_FPU_LOAD ))switch_fpu_prepare (prev_p, cpu);
PATCH v3 8/11 x86/percpu: Move top_of_stack to percpu hot section
In reply to Brian GerstNo functional change.
--- arch/x86/entry/entry_32.S | 4 ++-- arch/x86/entry/entry_64.S | 6 +++--- arch/x86/entry/entry_64_compat.S | 4 ++-- arch/x86/include/asm/current.h | 1 - arch/x86/include/asm/percpu.h | 2 +- arch/x86/include/asm/processor.h | 9 +++++++-- arch/x86/kernel/asm-offsets.c | 1 - arch/x86/kernel/cpu/common.c | 3 ++- arch/x86/kernel/process_32.c | 4 ++-- arch/x86/kernel/process_64.c | 2 +- arch/x86/kernel/smpboot.c | 2 +- arch/x86/kernel/vmlinux.lds.S | 1 + 12 files changed, 22 insertions(+), 17 deletions(-)
arch/x86/entry/entry_32.S +2 -2
@@ -1153,7 +1153,7 @@ SYM_CODE_START(asm_exc_nmi) * is using the thread stack right now, so it's safe for us to use it. */ movl %esp, %ebx - movl PER_CPU_VAR(pcpu_hot + X86_top_of_stack), %esp + movl PER_CPU_VAR(cpu_current_top_of_stack), %esp call exc_nmi movl %ebx, %esp
@@ -1217,7 +1217,7 @@ SYM_CODE_START(rewind_stack_and_make_dead) /* Prevent any naive code from trying to unwind to our caller. */ xorl %ebp, %ebp - movl PER_CPU_VAR(pcpu_hot + X86_top_of_stack), %esi + movl PER_CPU_VAR(cpu_current_top_of_stack), %esi leal -TOP_OF_KERNEL_STACK_PADDING-PTREGS_SIZE(%esi), %esp call make_task_dead
arch/x86/entry/entry_64.S +3 -3
@@ -92,7 +92,7 @@ SYM_CODE_START(entry_SYSCALL_64) /* tss.sp2 is scratch space. */ movq %rsp, PER_CPU_VAR(cpu_tss_rw + TSS_sp2) SWITCH_TO_KERNEL_CR3 scratch_reg=%rsp - movq PER_CPU_VAR(pcpu_hot + X86_top_of_stack), %rsp + movq PER_CPU_VAR(cpu_current_top_of_stack), %rsp SYM_INNER_LABEL(entry_SYSCALL_64_safe_stack, SYM_L_GLOBAL) ANNOTATE_NOENDBR
@@ -1168,7 +1168,7 @@ SYM_CODE_START(asm_exc_nmi) FENCE_SWAPGS_USER_ENTRY SWITCH_TO_KERNEL_CR3 scratch_reg=%rdx movq %rsp, %rdx - movq PER_CPU_VAR(pcpu_hot + X86_top_of_stack), %rsp + movq PER_CPU_VAR(cpu_current_top_of_stack), %rsp UNWIND_HINT_IRET_REGS base=%rdx offset=8 pushq 5*8(%rdx) /* pt_regs->ss */ pushq 4*8(%rdx) /* pt_regs->rsp */
@@ -1486,7 +1486,7 @@ SYM_CODE_START_NOALIGN(rewind_stack_and_make_dead) /* Prevent any naive code from trying to unwind to our caller. */ xorl %ebp, %ebp - movq PER_CPU_VAR(pcpu_hot + X86_top_of_stack), %rax + movq PER_CPU_VAR(cpu_current_top_of_stack), %rax leaq -PTREGS_SIZE(%rax), %rsp UNWIND_HINT_REGS
arch/x86/entry/entry_64_compat.S +2 -2
@@ -57,7 +57,7 @@ SYM_CODE_START(entry_SYSENTER_compat) SWITCH_TO_KERNEL_CR3 scratch_reg=%rax popq %rax - movq PER_CPU_VAR(pcpu_hot + X86_top_of_stack), %rsp + movq PER_CPU_VAR(cpu_current_top_of_stack), %rsp /* Construct struct pt_regs on stack */ pushq $__USER_DS /* pt_regs->ss */
@@ -193,7 +193,7 @@ SYM_CODE_START(entry_SYSCALL_compat) SWITCH_TO_KERNEL_CR3 scratch_reg=%rsp /* Switch to the kernel stack */ - movq PER_CPU_VAR(pcpu_hot + X86_top_of_stack), %rsp + movq PER_CPU_VAR(cpu_current_top_of_stack), %rsp SYM_INNER_LABEL(entry_SYSCALL_compat_safe_stack, SYM_L_GLOBAL) ANNOTATE_NOENDBR
arch/x86/include/asm/current.h +0 -1
@@ -14,7 +14,6 @@ struct task_struct;struct pcpu_hot {struct task_struct *current_task; -unsigned long top_of_stack; }; DECLARE_PER_CPU_CACHE_HOT(struct pcpu_hot, pcpu_hot);
arch/x86/include/asm/percpu.h +1 -1
@@ -549,7 +549,7 @@ do { \* it is accessed while this_cpu_read_stable() allows the value to be cached. * this_cpu_read_stable() is more efficient and can be used if its value * is guaranteed to be valid across CPUs. The current users include -* pcpu_hot.current_task and pcpu_hot.top_of_stack, both of which are +* pcpu_hot.current_task and cpu_current_top_of_stack, both of which are * actually per-thread variables implemented as per-CPU variables and * thus stable for the duration of the respective task. */
arch/x86/include/asm/processor.h +7 -2
@@ -427,6 +427,11 @@ DECLARE_PER_CPU_CACHE_HOT(bool, hardirq_stack_inuse); DECLARE_PER_CPU_CACHE_HOT(struct irq_stack *, softirq_stack_ptr);#endif +DECLARE_PER_CPU_CACHE_HOT(unsigned long, cpu_current_top_of_stack); +/* const-qualified alias provided by the linker. */ +DECLARE_PER_CPU_CACHE_HOT(const unsigned long __percpu_seg_override, + const_cpu_current_top_of_stack); +#ifdef CONFIG_X86_64 static inline unsigned long cpu_kernelmode_gs_base (int cpu) {
@@ -552,9 +557,9 @@ static __always_inline unsigned long current_top_of_stack(void)* entry trampoline. */ if (IS_ENABLED (CONFIG_USE_X86_SEG_SUPPORT )) -return this_cpu_read_const (const_pcpu_hot.top_of_stack); +return this_cpu_read_const (const_cpu_current_top_of_stack); -return this_cpu_read_stable (pcpu_hot.top_of_stack); +return this_cpu_read_stable (cpu_current_top_of_stack); } static __always_inline bool on_thread_stack(void)
arch/x86/kernel/asm-offsets.c +0 -1
@@ -107,7 +107,6 @@ static void __used common(void)OFFSET (TSS_sp0, tss_struct, x86_tss.sp0);OFFSET (TSS_sp1, tss_struct, x86_tss.sp1);OFFSET (TSS_sp2, tss_struct, x86_tss.sp2); -OFFSET (X86_top_of_stack, pcpu_hot, top_of_stack);OFFSET (X86_current_task, pcpu_hot, current_task);#if IS_ENABLED (CONFIG_CRYPTO_ARIA_AESNI_AVX_X86_64 )/* Offset for fields in aria_ctx */
arch/x86/kernel/cpu/common.c +2 -1
@@ -2051,7 +2051,6 @@ __setup("setcpuid=", setup_setcpuid); DEFINE_PER_CPU_CACHE_HOT(struct pcpu_hot, pcpu_hot) = { .current_task = &init_task, - .top_of_stack =TOP_OF_INIT_STACK , };EXPORT_PER_CPU_SYMBOL (pcpu_hot);EXPORT_PER_CPU_SYMBOL (const_pcpu_hot);
@@ -2059,6 +2058,8 @@ EXPORT_PER_CPU_SYMBOL(const_pcpu_hot);DEFINE_PER_CPU_CACHE_HOT (int, __preempt_count) =INIT_PREEMPT_COUNT ;EXPORT_PER_CPU_SYMBOL (__preempt_count); +DEFINE_PER_CPU_CACHE_HOT(unsigned long, cpu_current_top_of_stack) = TOP_OF_INIT_STACK; +#ifdef CONFIG_X86_64 /* * Note: Do not make this dependant on CONFIG_MITIGATION_CALL_DEPTH_TRACKING
arch/x86/kernel/process_32.c +2 -2
@@ -190,13 +190,13 @@ __switch_to(struct task_struct *prev_p, struct task_struct *next_p)arch_end_context_switch (next_p);/* -* Reload esp0 and pcpu_hot.top_of_stack. This changes +* Reload esp0 and cpu_current_top_of_stack. This changes * current_thread_info(). Refresh the SYSENTER configuration in * case prev or next is vm86. */ update_task_stack (next_p);refresh_sysenter_cs (next); -this_cpu_write (pcpu_hot.top_of_stack, +this_cpu_write (cpu_current_top_of_stack, (unsigned long )task_stack_page (next_p) +THREAD_SIZE );
arch/x86/kernel/process_64.c +1 -1
@@ -669,7 +669,7 @@ __switch_to(struct task_struct *prev_p, struct task_struct *next_p)* Switch the PDA and FPU contexts. */ raw_cpu_write (pcpu_hot.current_task, next_p); -raw_cpu_write (pcpu_hot.top_of_stack,task_top_of_stack (next_p)); +raw_cpu_write (cpu_current_top_of_stack,task_top_of_stack (next_p));switch_fpu_finish (next_p);
arch/x86/kernel/smpboot.c +1 -1
@@ -852,7 +852,7 @@ int common_cpu_up(unsigned int cpu, struct task_struct *idle)#ifdef CONFIG_X86_32 /* Stack for startup_32 can be just as for start_secondary onwards */ -per_cpu (pcpu_hot.top_of_stack, cpu) =task_top_of_stack (idle); +per_cpu (cpu_current_top_of_stack, cpu) =task_top_of_stack (idle);#endif return 0 ; }
arch/x86/kernel/vmlinux.lds.S +1 -0
@@ -44,6 +44,7 @@ ENTRY(phys_startup_64) jiffies = jiffies_64; const_pcpu_hot = pcpu_hot; +const_cpu_current_top_of_stack = cpu_current_top_of_stack; #if defined(CONFIG_X86_64) /*
Signature · 1 line
2.48.1
[tip: x86/core] x86/percpu: Move top_of_stack to percpu hot section
The following commit has been merged into the x86/core branch of tip:
The following commit has been merged into the x86/core branch of tip:
Commit-ID: 1105a9997f71a8d71a4a5c9306edfbcacd20e21e Gitweb: https://git.kernel.org/tip/1105a9997f71a8d71a4a5c9306edfbcacd20e21e Author: Brian Gerst <[email protected]> AuthorDate: Mon, 03 Mar 2025 11:52:43 -05:00 Committer: Ingo Molnar <[email protected]> CommitterDate: Mon, 03 Mar 2025 21:37:41 +01:00
x86/percpu: Move top_of_stack to percpu hot section
No functional change.
--- arch/x86/entry/entry_32.S | 4 ++-- arch/x86/entry/entry_64.S | 6 +++--- arch/x86/entry/entry_64_compat.S | 4 ++-- arch/x86/include/asm/current.h | 1 - arch/x86/include/asm/percpu.h | 2 +- arch/x86/include/asm/processor.h | 9 +++++++-- arch/x86/kernel/asm-offsets.c | 1 - arch/x86/kernel/cpu/common.c | 3 ++- arch/x86/kernel/process_32.c | 4 ++-- arch/x86/kernel/process_64.c | 2 +- arch/x86/kernel/smpboot.c | 2 +- arch/x86/kernel/vmlinux.lds.S | 1 + 12 files changed, 22 insertions(+), 17 deletions(-)
arch/x86/entry/entry_32.S +2 -2
@@ -1153,7 +1153,7 @@ SYM_CODE_START(asm_exc_nmi) * is using the thread stack right now, so it's safe for us to use it. */ movl %esp, %ebx - movl PER_CPU_VAR(pcpu_hot + X86_top_of_stack), %esp + movl PER_CPU_VAR(cpu_current_top_of_stack), %esp call exc_nmi movl %ebx, %esp
@@ -1217,7 +1217,7 @@ SYM_CODE_START(rewind_stack_and_make_dead) /* Prevent any naive code from trying to unwind to our caller. */ xorl %ebp, %ebp - movl PER_CPU_VAR(pcpu_hot + X86_top_of_stack), %esi + movl PER_CPU_VAR(cpu_current_top_of_stack), %esi leal -TOP_OF_KERNEL_STACK_PADDING-PTREGS_SIZE(%esi), %esp call make_task_dead
arch/x86/entry/entry_64.S +3 -3
@@ -92,7 +92,7 @@ SYM_CODE_START(entry_SYSCALL_64) /* tss.sp2 is scratch space. */ movq %rsp, PER_CPU_VAR(cpu_tss_rw + TSS_sp2) SWITCH_TO_KERNEL_CR3 scratch_reg=%rsp - movq PER_CPU_VAR(pcpu_hot + X86_top_of_stack), %rsp + movq PER_CPU_VAR(cpu_current_top_of_stack), %rsp SYM_INNER_LABEL(entry_SYSCALL_64_safe_stack, SYM_L_GLOBAL) ANNOTATE_NOENDBR
@@ -1168,7 +1168,7 @@ SYM_CODE_START(asm_exc_nmi) FENCE_SWAPGS_USER_ENTRY SWITCH_TO_KERNEL_CR3 scratch_reg=%rdx movq %rsp, %rdx - movq PER_CPU_VAR(pcpu_hot + X86_top_of_stack), %rsp + movq PER_CPU_VAR(cpu_current_top_of_stack), %rsp UNWIND_HINT_IRET_REGS base=%rdx offset=8 pushq 5*8(%rdx) /* pt_regs->ss */ pushq 4*8(%rdx) /* pt_regs->rsp */
@@ -1486,7 +1486,7 @@ SYM_CODE_START_NOALIGN(rewind_stack_and_make_dead) /* Prevent any naive code from trying to unwind to our caller. */ xorl %ebp, %ebp - movq PER_CPU_VAR(pcpu_hot + X86_top_of_stack), %rax + movq PER_CPU_VAR(cpu_current_top_of_stack), %rax leaq -PTREGS_SIZE(%rax), %rsp UNWIND_HINT_REGS
arch/x86/entry/entry_64_compat.S +2 -2
@@ -57,7 +57,7 @@ SYM_CODE_START(entry_SYSENTER_compat) SWITCH_TO_KERNEL_CR3 scratch_reg=%rax popq %rax - movq PER_CPU_VAR(pcpu_hot + X86_top_of_stack), %rsp + movq PER_CPU_VAR(cpu_current_top_of_stack), %rsp /* Construct struct pt_regs on stack */ pushq $__USER_DS /* pt_regs->ss */
@@ -193,7 +193,7 @@ SYM_CODE_START(entry_SYSCALL_compat) SWITCH_TO_KERNEL_CR3 scratch_reg=%rsp /* Switch to the kernel stack */ - movq PER_CPU_VAR(pcpu_hot + X86_top_of_stack), %rsp + movq PER_CPU_VAR(cpu_current_top_of_stack), %rsp SYM_INNER_LABEL(entry_SYSCALL_compat_safe_stack, SYM_L_GLOBAL) ANNOTATE_NOENDBR
arch/x86/include/asm/current.h +0 -1
@@ -14,7 +14,6 @@ struct task_struct;struct pcpu_hot {struct task_struct *current_task; -unsigned long top_of_stack; }; DECLARE_PER_CPU_CACHE_HOT(struct pcpu_hot, pcpu_hot);
arch/x86/include/asm/percpu.h +1 -1
@@ -549,7 +549,7 @@ do { \* it is accessed while this_cpu_read_stable() allows the value to be cached. * this_cpu_read_stable() is more efficient and can be used if its value * is guaranteed to be valid across CPUs. The current users include -* pcpu_hot.current_task and pcpu_hot.top_of_stack, both of which are +* pcpu_hot.current_task and cpu_current_top_of_stack, both of which are * actually per-thread variables implemented as per-CPU variables and * thus stable for the duration of the respective task. */
arch/x86/include/asm/processor.h +7 -2
@@ -427,6 +427,11 @@ DECLARE_PER_CPU_CACHE_HOT(bool, hardirq_stack_inuse); DECLARE_PER_CPU_CACHE_HOT(struct irq_stack *, softirq_stack_ptr);#endif +DECLARE_PER_CPU_CACHE_HOT(unsigned long, cpu_current_top_of_stack); +/* const-qualified alias provided by the linker. */ +DECLARE_PER_CPU_CACHE_HOT(const unsigned long __percpu_seg_override, + const_cpu_current_top_of_stack); +#ifdef CONFIG_X86_64 static inline unsigned long cpu_kernelmode_gs_base (int cpu) {
@@ -552,9 +557,9 @@ static __always_inline unsigned long current_top_of_stack(void)* entry trampoline. */ if (IS_ENABLED (CONFIG_USE_X86_SEG_SUPPORT )) -return this_cpu_read_const (const_pcpu_hot.top_of_stack); +return this_cpu_read_const (const_cpu_current_top_of_stack); -return this_cpu_read_stable (pcpu_hot.top_of_stack); +return this_cpu_read_stable (cpu_current_top_of_stack); } static __always_inline bool on_thread_stack(void)
arch/x86/kernel/asm-offsets.c +0 -1
@@ -107,7 +107,6 @@ static void __used common(void)OFFSET (TSS_sp0, tss_struct, x86_tss.sp0);OFFSET (TSS_sp1, tss_struct, x86_tss.sp1);OFFSET (TSS_sp2, tss_struct, x86_tss.sp2); -OFFSET (X86_top_of_stack, pcpu_hot, top_of_stack);OFFSET (X86_current_task, pcpu_hot, current_task);#if IS_ENABLED (CONFIG_CRYPTO_ARIA_AESNI_AVX_X86_64 )/* Offset for fields in aria_ctx */
arch/x86/kernel/cpu/common.c +2 -1
@@ -2049,7 +2049,6 @@ __setup("setcpuid=", setup_setcpuid); DEFINE_PER_CPU_CACHE_HOT(struct pcpu_hot, pcpu_hot) = { .current_task = &init_task, - .top_of_stack =TOP_OF_INIT_STACK , };EXPORT_PER_CPU_SYMBOL (pcpu_hot);EXPORT_PER_CPU_SYMBOL (const_pcpu_hot);
@@ -2057,6 +2056,8 @@ EXPORT_PER_CPU_SYMBOL(const_pcpu_hot);DEFINE_PER_CPU_CACHE_HOT (int, __preempt_count) =INIT_PREEMPT_COUNT ;EXPORT_PER_CPU_SYMBOL (__preempt_count); +DEFINE_PER_CPU_CACHE_HOT(unsigned long, cpu_current_top_of_stack) = TOP_OF_INIT_STACK; +#ifdef CONFIG_X86_64 /* * Note: Do not make this dependant on CONFIG_MITIGATION_CALL_DEPTH_TRACKING
arch/x86/kernel/process_32.c +2 -2
@@ -190,13 +190,13 @@ __switch_to(struct task_struct *prev_p, struct task_struct *next_p)arch_end_context_switch (next_p);/* -* Reload esp0 and pcpu_hot.top_of_stack. This changes +* Reload esp0 and cpu_current_top_of_stack. This changes * current_thread_info(). Refresh the SYSENTER configuration in * case prev or next is vm86. */ update_task_stack (next_p);refresh_sysenter_cs (next); -this_cpu_write (pcpu_hot.top_of_stack, +this_cpu_write (cpu_current_top_of_stack, (unsigned long )task_stack_page (next_p) +THREAD_SIZE );
arch/x86/kernel/process_64.c +1 -1
@@ -669,7 +669,7 @@ __switch_to(struct task_struct *prev_p, struct task_struct *next_p)* Switch the PDA and FPU contexts. */ raw_cpu_write (pcpu_hot.current_task, next_p); -raw_cpu_write (pcpu_hot.top_of_stack,task_top_of_stack (next_p)); +raw_cpu_write (cpu_current_top_of_stack,task_top_of_stack (next_p));switch_fpu_finish (next_p);
arch/x86/kernel/smpboot.c +1 -1
@@ -852,7 +852,7 @@ int common_cpu_up(unsigned int cpu, struct task_struct *idle)#ifdef CONFIG_X86_32 /* Stack for startup_32 can be just as for start_secondary onwards */ -per_cpu (pcpu_hot.top_of_stack, cpu) =task_top_of_stack (idle); +per_cpu (cpu_current_top_of_stack, cpu) =task_top_of_stack (idle);#endif return 0 ; }
arch/x86/kernel/vmlinux.lds.S +1 -0
@@ -44,6 +44,7 @@ ENTRY(phys_startup_64) jiffies = jiffies_64; const_pcpu_hot = pcpu_hot; +const_cpu_current_top_of_stack = cpu_current_top_of_stack; #if defined(CONFIG_X86_64) /*
[tip: x86/core] x86/percpu: Move top_of_stack to percpu hot section
In reply to Brian GerstThe following commit has been merged into the x86/core branch of tip:
The following commit has been merged into the x86/core branch of tip:
Commit-ID: 648e4e21fa7ec7fbe34e1fb2ec12b86c3f616b88 Gitweb: https://git.kernel.org/tip/648e4e21fa7ec7fbe34e1fb2ec12b86c3f616b88 Author: Brian Gerst <[email protected]> AuthorDate: Mon, 03 Mar 2025 11:52:43 -05:00 Committer: Ingo Molnar <[email protected]> CommitterDate: Tue, 04 Mar 2025 11:24:28 +01:00
x86/percpu: Move top_of_stack to percpu hot section
No functional change.
--- arch/x86/entry/entry_32.S | 4 ++-- arch/x86/entry/entry_64.S | 6 +++--- arch/x86/entry/entry_64_compat.S | 4 ++-- arch/x86/include/asm/current.h | 1 - arch/x86/include/asm/percpu.h | 2 +- arch/x86/include/asm/processor.h | 9 +++++++-- arch/x86/kernel/asm-offsets.c | 1 - arch/x86/kernel/cpu/common.c | 3 ++- arch/x86/kernel/process_32.c | 4 ++-- arch/x86/kernel/process_64.c | 2 +- arch/x86/kernel/smpboot.c | 2 +- arch/x86/kernel/vmlinux.lds.S | 1 + 12 files changed, 22 insertions(+), 17 deletions(-)
arch/x86/entry/entry_32.S +2 -2
@@ -1153,7 +1153,7 @@ SYM_CODE_START(asm_exc_nmi) * is using the thread stack right now, so it's safe for us to use it. */ movl %esp, %ebx - movl PER_CPU_VAR(pcpu_hot + X86_top_of_stack), %esp + movl PER_CPU_VAR(cpu_current_top_of_stack), %esp call exc_nmi movl %ebx, %esp
@@ -1217,7 +1217,7 @@ SYM_CODE_START(rewind_stack_and_make_dead) /* Prevent any naive code from trying to unwind to our caller. */ xorl %ebp, %ebp - movl PER_CPU_VAR(pcpu_hot + X86_top_of_stack), %esi + movl PER_CPU_VAR(cpu_current_top_of_stack), %esi leal -TOP_OF_KERNEL_STACK_PADDING-PTREGS_SIZE(%esi), %esp call make_task_dead
arch/x86/entry/entry_64.S +3 -3
@@ -92,7 +92,7 @@ SYM_CODE_START(entry_SYSCALL_64) /* tss.sp2 is scratch space. */ movq %rsp, PER_CPU_VAR(cpu_tss_rw + TSS_sp2) SWITCH_TO_KERNEL_CR3 scratch_reg=%rsp - movq PER_CPU_VAR(pcpu_hot + X86_top_of_stack), %rsp + movq PER_CPU_VAR(cpu_current_top_of_stack), %rsp SYM_INNER_LABEL(entry_SYSCALL_64_safe_stack, SYM_L_GLOBAL) ANNOTATE_NOENDBR
@@ -1168,7 +1168,7 @@ SYM_CODE_START(asm_exc_nmi) FENCE_SWAPGS_USER_ENTRY SWITCH_TO_KERNEL_CR3 scratch_reg=%rdx movq %rsp, %rdx - movq PER_CPU_VAR(pcpu_hot + X86_top_of_stack), %rsp + movq PER_CPU_VAR(cpu_current_top_of_stack), %rsp UNWIND_HINT_IRET_REGS base=%rdx offset=8 pushq 5*8(%rdx) /* pt_regs->ss */ pushq 4*8(%rdx) /* pt_regs->rsp */
@@ -1486,7 +1486,7 @@ SYM_CODE_START_NOALIGN(rewind_stack_and_make_dead) /* Prevent any naive code from trying to unwind to our caller. */ xorl %ebp, %ebp - movq PER_CPU_VAR(pcpu_hot + X86_top_of_stack), %rax + movq PER_CPU_VAR(cpu_current_top_of_stack), %rax leaq -PTREGS_SIZE(%rax), %rsp UNWIND_HINT_REGS
arch/x86/entry/entry_64_compat.S +2 -2
@@ -57,7 +57,7 @@ SYM_CODE_START(entry_SYSENTER_compat) SWITCH_TO_KERNEL_CR3 scratch_reg=%rax popq %rax - movq PER_CPU_VAR(pcpu_hot + X86_top_of_stack), %rsp + movq PER_CPU_VAR(cpu_current_top_of_stack), %rsp /* Construct struct pt_regs on stack */ pushq $__USER_DS /* pt_regs->ss */
@@ -193,7 +193,7 @@ SYM_CODE_START(entry_SYSCALL_compat) SWITCH_TO_KERNEL_CR3 scratch_reg=%rsp /* Switch to the kernel stack */ - movq PER_CPU_VAR(pcpu_hot + X86_top_of_stack), %rsp + movq PER_CPU_VAR(cpu_current_top_of_stack), %rsp SYM_INNER_LABEL(entry_SYSCALL_compat_safe_stack, SYM_L_GLOBAL) ANNOTATE_NOENDBR
arch/x86/include/asm/current.h +0 -1
@@ -14,7 +14,6 @@ struct task_struct;struct pcpu_hot {struct task_struct *current_task; -unsigned long top_of_stack; }; DECLARE_PER_CPU_CACHE_HOT(struct pcpu_hot, pcpu_hot);
arch/x86/include/asm/percpu.h +1 -1
@@ -549,7 +549,7 @@ do { \* it is accessed while this_cpu_read_stable() allows the value to be cached. * this_cpu_read_stable() is more efficient and can be used if its value * is guaranteed to be valid across CPUs. The current users include -* pcpu_hot.current_task and pcpu_hot.top_of_stack, both of which are +* pcpu_hot.current_task and cpu_current_top_of_stack, both of which are * actually per-thread variables implemented as per-CPU variables and * thus stable for the duration of the respective task. */
arch/x86/include/asm/processor.h +7 -2
@@ -422,6 +422,11 @@ DECLARE_PER_CPU_CACHE_HOT(bool, hardirq_stack_inuse); DECLARE_PER_CPU_CACHE_HOT(struct irq_stack *, softirq_stack_ptr);#endif +DECLARE_PER_CPU_CACHE_HOT(unsigned long, cpu_current_top_of_stack); +/* const-qualified alias provided by the linker. */ +DECLARE_PER_CPU_CACHE_HOT(const unsigned long __percpu_seg_override, + const_cpu_current_top_of_stack); +#ifdef CONFIG_X86_64 static inline unsigned long cpu_kernelmode_gs_base (int cpu) {
@@ -547,9 +552,9 @@ static __always_inline unsigned long current_top_of_stack(void)* entry trampoline. */ if (IS_ENABLED (CONFIG_USE_X86_SEG_SUPPORT )) -return this_cpu_read_const (const_pcpu_hot.top_of_stack); +return this_cpu_read_const (const_cpu_current_top_of_stack); -return this_cpu_read_stable (pcpu_hot.top_of_stack); +return this_cpu_read_stable (cpu_current_top_of_stack); } static __always_inline bool on_thread_stack(void)
arch/x86/kernel/asm-offsets.c +0 -1
@@ -107,7 +107,6 @@ static void __used common(void)OFFSET (TSS_sp0, tss_struct, x86_tss.sp0);OFFSET (TSS_sp1, tss_struct, x86_tss.sp1);OFFSET (TSS_sp2, tss_struct, x86_tss.sp2); -OFFSET (X86_top_of_stack, pcpu_hot, top_of_stack);OFFSET (X86_current_task, pcpu_hot, current_task);#if IS_ENABLED (CONFIG_CRYPTO_ARIA_AESNI_AVX_X86_64 )/* Offset for fields in aria_ctx */
arch/x86/kernel/cpu/common.c +2 -1
@@ -2066,7 +2066,6 @@ __setup("setcpuid=", setup_setcpuid); DEFINE_PER_CPU_CACHE_HOT(struct pcpu_hot, pcpu_hot) = { .current_task = &init_task, - .top_of_stack =TOP_OF_INIT_STACK , };EXPORT_PER_CPU_SYMBOL (pcpu_hot);EXPORT_PER_CPU_SYMBOL (const_pcpu_hot);
@@ -2074,6 +2073,8 @@ EXPORT_PER_CPU_SYMBOL(const_pcpu_hot);DEFINE_PER_CPU_CACHE_HOT (int, __preempt_count) =INIT_PREEMPT_COUNT ;EXPORT_PER_CPU_SYMBOL (__preempt_count); +DEFINE_PER_CPU_CACHE_HOT(unsigned long, cpu_current_top_of_stack) = TOP_OF_INIT_STACK; +#ifdef CONFIG_X86_64 /* * Note: Do not make this dependant on CONFIG_MITIGATION_CALL_DEPTH_TRACKING
arch/x86/kernel/process_32.c +2 -2
@@ -190,13 +190,13 @@ __switch_to(struct task_struct *prev_p, struct task_struct *next_p)arch_end_context_switch (next_p);/* -* Reload esp0 and pcpu_hot.top_of_stack. This changes +* Reload esp0 and cpu_current_top_of_stack. This changes * current_thread_info(). Refresh the SYSENTER configuration in * case prev or next is vm86. */ update_task_stack (next_p);refresh_sysenter_cs (next); -this_cpu_write (pcpu_hot.top_of_stack, +this_cpu_write (cpu_current_top_of_stack, (unsigned long )task_stack_page (next_p) +THREAD_SIZE );
arch/x86/kernel/process_64.c +1 -1
@@ -669,7 +669,7 @@ __switch_to(struct task_struct *prev_p, struct task_struct *next_p)* Switch the PDA and FPU contexts. */ raw_cpu_write (pcpu_hot.current_task, next_p); -raw_cpu_write (pcpu_hot.top_of_stack,task_top_of_stack (next_p)); +raw_cpu_write (cpu_current_top_of_stack,task_top_of_stack (next_p));switch_fpu_finish (next_p);
arch/x86/kernel/smpboot.c +1 -1
@@ -832,7 +832,7 @@ int common_cpu_up(unsigned int cpu, struct task_struct *idle)#ifdef CONFIG_X86_32 /* Stack for startup_32 can be just as for start_secondary onwards */ -per_cpu (pcpu_hot.top_of_stack, cpu) =task_top_of_stack (idle); +per_cpu (cpu_current_top_of_stack, cpu) =task_top_of_stack (idle);#endif return 0 ; }
arch/x86/kernel/vmlinux.lds.S +1 -0
@@ -44,6 +44,7 @@ ENTRY(phys_startup_64) jiffies = jiffies_64; const_pcpu_hot = pcpu_hot; +const_cpu_current_top_of_stack = cpu_current_top_of_stack; #if defined(CONFIG_X86_64) /*
[tip: x86/core] x86/percpu: Move top_of_stack to percpu hot section
In reply to Brian GerstThe following commit has been merged into the x86/core branch of tip:
The following commit has been merged into the x86/core branch of tip:
Commit-ID: 79e2e9f216f4cc9f20135fb14a6cb3087ff2e80d Gitweb: https://git.kernel.org/tip/79e2e9f216f4cc9f20135fb14a6cb3087ff2e80d Author: Brian Gerst <[email protected]> AuthorDate: Mon, 03 Mar 2025 11:52:43 -05:00 Committer: Ingo Molnar <[email protected]> CommitterDate: Tue, 04 Mar 2025 20:18:02 +01:00
x86/percpu: Move top_of_stack to percpu hot section
No functional change.
--- arch/x86/entry/entry_32.S | 4 ++-- arch/x86/entry/entry_64.S | 6 +++--- arch/x86/entry/entry_64_compat.S | 4 ++-- arch/x86/include/asm/current.h | 1 - arch/x86/include/asm/percpu.h | 2 +- arch/x86/include/asm/processor.h | 9 +++++++-- arch/x86/kernel/asm-offsets.c | 1 - arch/x86/kernel/cpu/common.c | 3 ++- arch/x86/kernel/process_32.c | 4 ++-- arch/x86/kernel/process_64.c | 2 +- arch/x86/kernel/smpboot.c | 2 +- arch/x86/kernel/vmlinux.lds.S | 1 + 12 files changed, 22 insertions(+), 17 deletions(-)
arch/x86/entry/entry_32.S +2 -2
@@ -1153,7 +1153,7 @@ SYM_CODE_START(asm_exc_nmi) * is using the thread stack right now, so it's safe for us to use it. */ movl %esp, %ebx - movl PER_CPU_VAR(pcpu_hot + X86_top_of_stack), %esp + movl PER_CPU_VAR(cpu_current_top_of_stack), %esp call exc_nmi movl %ebx, %esp
@@ -1217,7 +1217,7 @@ SYM_CODE_START(rewind_stack_and_make_dead) /* Prevent any naive code from trying to unwind to our caller. */ xorl %ebp, %ebp - movl PER_CPU_VAR(pcpu_hot + X86_top_of_stack), %esi + movl PER_CPU_VAR(cpu_current_top_of_stack), %esi leal -TOP_OF_KERNEL_STACK_PADDING-PTREGS_SIZE(%esi), %esp call make_task_dead
arch/x86/entry/entry_64.S +3 -3
@@ -92,7 +92,7 @@ SYM_CODE_START(entry_SYSCALL_64) /* tss.sp2 is scratch space. */ movq %rsp, PER_CPU_VAR(cpu_tss_rw + TSS_sp2) SWITCH_TO_KERNEL_CR3 scratch_reg=%rsp - movq PER_CPU_VAR(pcpu_hot + X86_top_of_stack), %rsp + movq PER_CPU_VAR(cpu_current_top_of_stack), %rsp SYM_INNER_LABEL(entry_SYSCALL_64_safe_stack, SYM_L_GLOBAL) ANNOTATE_NOENDBR
@@ -1168,7 +1168,7 @@ SYM_CODE_START(asm_exc_nmi) FENCE_SWAPGS_USER_ENTRY SWITCH_TO_KERNEL_CR3 scratch_reg=%rdx movq %rsp, %rdx - movq PER_CPU_VAR(pcpu_hot + X86_top_of_stack), %rsp + movq PER_CPU_VAR(cpu_current_top_of_stack), %rsp UNWIND_HINT_IRET_REGS base=%rdx offset=8 pushq 5*8(%rdx) /* pt_regs->ss */ pushq 4*8(%rdx) /* pt_regs->rsp */
@@ -1486,7 +1486,7 @@ SYM_CODE_START_NOALIGN(rewind_stack_and_make_dead) /* Prevent any naive code from trying to unwind to our caller. */ xorl %ebp, %ebp - movq PER_CPU_VAR(pcpu_hot + X86_top_of_stack), %rax + movq PER_CPU_VAR(cpu_current_top_of_stack), %rax leaq -PTREGS_SIZE(%rax), %rsp UNWIND_HINT_REGS
arch/x86/entry/entry_64_compat.S +2 -2
@@ -57,7 +57,7 @@ SYM_CODE_START(entry_SYSENTER_compat) SWITCH_TO_KERNEL_CR3 scratch_reg=%rax popq %rax - movq PER_CPU_VAR(pcpu_hot + X86_top_of_stack), %rsp + movq PER_CPU_VAR(cpu_current_top_of_stack), %rsp /* Construct struct pt_regs on stack */ pushq $__USER_DS /* pt_regs->ss */
@@ -193,7 +193,7 @@ SYM_CODE_START(entry_SYSCALL_compat) SWITCH_TO_KERNEL_CR3 scratch_reg=%rsp /* Switch to the kernel stack */ - movq PER_CPU_VAR(pcpu_hot + X86_top_of_stack), %rsp + movq PER_CPU_VAR(cpu_current_top_of_stack), %rsp SYM_INNER_LABEL(entry_SYSCALL_compat_safe_stack, SYM_L_GLOBAL) ANNOTATE_NOENDBR
arch/x86/include/asm/current.h +0 -1
@@ -14,7 +14,6 @@ struct task_struct;struct pcpu_hot {struct task_struct *current_task; -unsigned long top_of_stack; }; DECLARE_PER_CPU_CACHE_HOT(struct pcpu_hot, pcpu_hot);
arch/x86/include/asm/percpu.h +1 -1
@@ -551,7 +551,7 @@ do { \* it is accessed while this_cpu_read_stable() allows the value to be cached. * this_cpu_read_stable() is more efficient and can be used if its value * is guaranteed to be valid across CPUs. The current users include -* pcpu_hot.current_task and pcpu_hot.top_of_stack, both of which are +* pcpu_hot.current_task and cpu_current_top_of_stack, both of which are * actually per-thread variables implemented as per-CPU variables and * thus stable for the duration of the respective task. */
arch/x86/include/asm/processor.h +7 -2
@@ -422,6 +422,11 @@ DECLARE_PER_CPU_CACHE_HOT(bool, hardirq_stack_inuse); DECLARE_PER_CPU_CACHE_HOT(struct irq_stack *, softirq_stack_ptr);#endif +DECLARE_PER_CPU_CACHE_HOT(unsigned long, cpu_current_top_of_stack); +/* const-qualified alias provided by the linker. */ +DECLARE_PER_CPU_CACHE_HOT(const unsigned long __percpu_seg_override, + const_cpu_current_top_of_stack); +#ifdef CONFIG_X86_64 static inline unsigned long cpu_kernelmode_gs_base (int cpu) {
@@ -547,9 +552,9 @@ static __always_inline unsigned long current_top_of_stack(void)* entry trampoline. */ if (IS_ENABLED (CONFIG_USE_X86_SEG_SUPPORT )) -return this_cpu_read_const (const_pcpu_hot.top_of_stack); +return this_cpu_read_const (const_cpu_current_top_of_stack); -return this_cpu_read_stable (pcpu_hot.top_of_stack); +return this_cpu_read_stable (cpu_current_top_of_stack); } static __always_inline bool on_thread_stack(void)
arch/x86/kernel/asm-offsets.c +0 -1
@@ -107,7 +107,6 @@ static void __used common(void)OFFSET (TSS_sp0, tss_struct, x86_tss.sp0);OFFSET (TSS_sp1, tss_struct, x86_tss.sp1);OFFSET (TSS_sp2, tss_struct, x86_tss.sp2); -OFFSET (X86_top_of_stack, pcpu_hot, top_of_stack);OFFSET (X86_current_task, pcpu_hot, current_task);#if IS_ENABLED (CONFIG_CRYPTO_ARIA_AESNI_AVX_X86_64 )/* Offset for fields in aria_ctx */
arch/x86/kernel/cpu/common.c +2 -1
@@ -2066,7 +2066,6 @@ __setup("setcpuid=", setup_setcpuid); DEFINE_PER_CPU_CACHE_HOT(struct pcpu_hot, pcpu_hot) = { .current_task = &init_task, - .top_of_stack =TOP_OF_INIT_STACK , };EXPORT_PER_CPU_SYMBOL (pcpu_hot);EXPORT_PER_CPU_SYMBOL (const_pcpu_hot);
@@ -2074,6 +2073,8 @@ EXPORT_PER_CPU_SYMBOL(const_pcpu_hot);DEFINE_PER_CPU_CACHE_HOT (int, __preempt_count) =INIT_PREEMPT_COUNT ;EXPORT_PER_CPU_SYMBOL (__preempt_count); +DEFINE_PER_CPU_CACHE_HOT(unsigned long, cpu_current_top_of_stack) = TOP_OF_INIT_STACK; +#ifdef CONFIG_X86_64 /* * Note: Do not make this dependant on CONFIG_MITIGATION_CALL_DEPTH_TRACKING
arch/x86/kernel/process_32.c +2 -2
@@ -190,13 +190,13 @@ __switch_to(struct task_struct *prev_p, struct task_struct *next_p)arch_end_context_switch (next_p);/* -* Reload esp0 and pcpu_hot.top_of_stack. This changes +* Reload esp0 and cpu_current_top_of_stack. This changes * current_thread_info(). Refresh the SYSENTER configuration in * case prev or next is vm86. */ update_task_stack (next_p);refresh_sysenter_cs (next); -this_cpu_write (pcpu_hot.top_of_stack, +this_cpu_write (cpu_current_top_of_stack, (unsigned long )task_stack_page (next_p) +THREAD_SIZE );
arch/x86/kernel/process_64.c +1 -1
@@ -669,7 +669,7 @@ __switch_to(struct task_struct *prev_p, struct task_struct *next_p)* Switch the PDA and FPU contexts. */ raw_cpu_write (pcpu_hot.current_task, next_p); -raw_cpu_write (pcpu_hot.top_of_stack,task_top_of_stack (next_p)); +raw_cpu_write (cpu_current_top_of_stack,task_top_of_stack (next_p));switch_fpu_finish (next_p);
arch/x86/kernel/smpboot.c +1 -1
@@ -832,7 +832,7 @@ int common_cpu_up(unsigned int cpu, struct task_struct *idle)#ifdef CONFIG_X86_32 /* Stack for startup_32 can be just as for start_secondary onwards */ -per_cpu (pcpu_hot.top_of_stack, cpu) =task_top_of_stack (idle); +per_cpu (cpu_current_top_of_stack, cpu) =task_top_of_stack (idle);#endif return 0 ; }
arch/x86/kernel/vmlinux.lds.S +1 -0
@@ -44,6 +44,7 @@ ENTRY(phys_startup_64) jiffies = jiffies_64; const_pcpu_hot = pcpu_hot; +const_cpu_current_top_of_stack = cpu_current_top_of_stack; #if defined(CONFIG_X86_64) /*
[tip: x86/core] x86/percpu: Move top_of_stack to percpu hot section
In reply to Brian GerstThe following commit has been merged into the x86/core branch of tip:
The following commit has been merged into the x86/core branch of tip:
Commit-ID: 385f72c83eb609652f02dc9ee415520c23bda629 Gitweb: https://git.kernel.org/tip/385f72c83eb609652f02dc9ee415520c23bda629 Author: Brian Gerst <[email protected]> AuthorDate: Mon, 03 Mar 2025 11:52:43 -05:00 Committer: Ingo Molnar <[email protected]> CommitterDate: Tue, 04 Mar 2025 20:30:33 +01:00
x86/percpu: Move top_of_stack to percpu hot section
No functional change.
--- arch/x86/entry/entry_32.S | 4 ++-- arch/x86/entry/entry_64.S | 6 +++--- arch/x86/entry/entry_64_compat.S | 4 ++-- arch/x86/include/asm/current.h | 1 - arch/x86/include/asm/percpu.h | 2 +- arch/x86/include/asm/processor.h | 9 +++++++-- arch/x86/kernel/asm-offsets.c | 1 - arch/x86/kernel/cpu/common.c | 3 ++- arch/x86/kernel/process_32.c | 4 ++-- arch/x86/kernel/process_64.c | 2 +- arch/x86/kernel/smpboot.c | 2 +- arch/x86/kernel/vmlinux.lds.S | 1 + 12 files changed, 22 insertions(+), 17 deletions(-)
arch/x86/entry/entry_32.S +2 -2
@@ -1153,7 +1153,7 @@ SYM_CODE_START(asm_exc_nmi) * is using the thread stack right now, so it's safe for us to use it. */ movl %esp, %ebx - movl PER_CPU_VAR(pcpu_hot + X86_top_of_stack), %esp + movl PER_CPU_VAR(cpu_current_top_of_stack), %esp call exc_nmi movl %ebx, %esp
@@ -1217,7 +1217,7 @@ SYM_CODE_START(rewind_stack_and_make_dead) /* Prevent any naive code from trying to unwind to our caller. */ xorl %ebp, %ebp - movl PER_CPU_VAR(pcpu_hot + X86_top_of_stack), %esi + movl PER_CPU_VAR(cpu_current_top_of_stack), %esi leal -TOP_OF_KERNEL_STACK_PADDING-PTREGS_SIZE(%esi), %esp call make_task_dead
arch/x86/entry/entry_64.S +3 -3
@@ -92,7 +92,7 @@ SYM_CODE_START(entry_SYSCALL_64) /* tss.sp2 is scratch space. */ movq %rsp, PER_CPU_VAR(cpu_tss_rw + TSS_sp2) SWITCH_TO_KERNEL_CR3 scratch_reg=%rsp - movq PER_CPU_VAR(pcpu_hot + X86_top_of_stack), %rsp + movq PER_CPU_VAR(cpu_current_top_of_stack), %rsp SYM_INNER_LABEL(entry_SYSCALL_64_safe_stack, SYM_L_GLOBAL) ANNOTATE_NOENDBR
@@ -1168,7 +1168,7 @@ SYM_CODE_START(asm_exc_nmi) FENCE_SWAPGS_USER_ENTRY SWITCH_TO_KERNEL_CR3 scratch_reg=%rdx movq %rsp, %rdx - movq PER_CPU_VAR(pcpu_hot + X86_top_of_stack), %rsp + movq PER_CPU_VAR(cpu_current_top_of_stack), %rsp UNWIND_HINT_IRET_REGS base=%rdx offset=8 pushq 5*8(%rdx) /* pt_regs->ss */ pushq 4*8(%rdx) /* pt_regs->rsp */
@@ -1486,7 +1486,7 @@ SYM_CODE_START_NOALIGN(rewind_stack_and_make_dead) /* Prevent any naive code from trying to unwind to our caller. */ xorl %ebp, %ebp - movq PER_CPU_VAR(pcpu_hot + X86_top_of_stack), %rax + movq PER_CPU_VAR(cpu_current_top_of_stack), %rax leaq -PTREGS_SIZE(%rax), %rsp UNWIND_HINT_REGS
arch/x86/entry/entry_64_compat.S +2 -2
@@ -57,7 +57,7 @@ SYM_CODE_START(entry_SYSENTER_compat) SWITCH_TO_KERNEL_CR3 scratch_reg=%rax popq %rax - movq PER_CPU_VAR(pcpu_hot + X86_top_of_stack), %rsp + movq PER_CPU_VAR(cpu_current_top_of_stack), %rsp /* Construct struct pt_regs on stack */ pushq $__USER_DS /* pt_regs->ss */
@@ -193,7 +193,7 @@ SYM_CODE_START(entry_SYSCALL_compat) SWITCH_TO_KERNEL_CR3 scratch_reg=%rsp /* Switch to the kernel stack */ - movq PER_CPU_VAR(pcpu_hot + X86_top_of_stack), %rsp + movq PER_CPU_VAR(cpu_current_top_of_stack), %rsp SYM_INNER_LABEL(entry_SYSCALL_compat_safe_stack, SYM_L_GLOBAL) ANNOTATE_NOENDBR
arch/x86/include/asm/current.h +0 -1
@@ -14,7 +14,6 @@ struct task_struct;struct pcpu_hot {struct task_struct *current_task; -unsigned long top_of_stack; }; DECLARE_PER_CPU_CACHE_HOT(struct pcpu_hot, pcpu_hot);
arch/x86/include/asm/percpu.h +1 -1
@@ -551,7 +551,7 @@ do { \* it is accessed while this_cpu_read_stable() allows the value to be cached. * this_cpu_read_stable() is more efficient and can be used if its value * is guaranteed to be valid across CPUs. The current users include -* pcpu_hot.current_task and pcpu_hot.top_of_stack, both of which are +* pcpu_hot.current_task and cpu_current_top_of_stack, both of which are * actually per-thread variables implemented as per-CPU variables and * thus stable for the duration of the respective task. */
arch/x86/include/asm/processor.h +7 -2
@@ -422,6 +422,11 @@ DECLARE_PER_CPU_CACHE_HOT(bool, hardirq_stack_inuse); DECLARE_PER_CPU_CACHE_HOT(struct irq_stack *, softirq_stack_ptr);#endif +DECLARE_PER_CPU_CACHE_HOT(unsigned long, cpu_current_top_of_stack); +/* const-qualified alias provided by the linker. */ +DECLARE_PER_CPU_CACHE_HOT(const unsigned long __percpu_seg_override, + const_cpu_current_top_of_stack); +#ifdef CONFIG_X86_64 static inline unsigned long cpu_kernelmode_gs_base (int cpu) {
@@ -547,9 +552,9 @@ static __always_inline unsigned long current_top_of_stack(void)* entry trampoline. */ if (IS_ENABLED (CONFIG_USE_X86_SEG_SUPPORT )) -return this_cpu_read_const (const_pcpu_hot.top_of_stack); +return this_cpu_read_const (const_cpu_current_top_of_stack); -return this_cpu_read_stable (pcpu_hot.top_of_stack); +return this_cpu_read_stable (cpu_current_top_of_stack); } static __always_inline bool on_thread_stack(void)
arch/x86/kernel/asm-offsets.c +0 -1
@@ -107,7 +107,6 @@ static void __used common(void)OFFSET (TSS_sp0, tss_struct, x86_tss.sp0);OFFSET (TSS_sp1, tss_struct, x86_tss.sp1);OFFSET (TSS_sp2, tss_struct, x86_tss.sp2); -OFFSET (X86_top_of_stack, pcpu_hot, top_of_stack);OFFSET (X86_current_task, pcpu_hot, current_task);#if IS_ENABLED (CONFIG_CRYPTO_ARIA_AESNI_AVX_X86_64 )/* Offset for fields in aria_ctx */
arch/x86/kernel/cpu/common.c +2 -1
@@ -2066,7 +2066,6 @@ __setup("setcpuid=", setup_setcpuid); DEFINE_PER_CPU_CACHE_HOT(struct pcpu_hot, pcpu_hot) = { .current_task = &init_task, - .top_of_stack =TOP_OF_INIT_STACK , };EXPORT_PER_CPU_SYMBOL (pcpu_hot);EXPORT_PER_CPU_SYMBOL (const_pcpu_hot);
@@ -2074,6 +2073,8 @@ EXPORT_PER_CPU_SYMBOL(const_pcpu_hot);DEFINE_PER_CPU_CACHE_HOT (int, __preempt_count) =INIT_PREEMPT_COUNT ;EXPORT_PER_CPU_SYMBOL (__preempt_count); +DEFINE_PER_CPU_CACHE_HOT(unsigned long, cpu_current_top_of_stack) = TOP_OF_INIT_STACK; +#ifdef CONFIG_X86_64 /* * Note: Do not make this dependant on CONFIG_MITIGATION_CALL_DEPTH_TRACKING
arch/x86/kernel/process_32.c +2 -2
@@ -190,13 +190,13 @@ __switch_to(struct task_struct *prev_p, struct task_struct *next_p)arch_end_context_switch (next_p);/* -* Reload esp0 and pcpu_hot.top_of_stack. This changes +* Reload esp0 and cpu_current_top_of_stack. This changes * current_thread_info(). Refresh the SYSENTER configuration in * case prev or next is vm86. */ update_task_stack (next_p);refresh_sysenter_cs (next); -this_cpu_write (pcpu_hot.top_of_stack, +this_cpu_write (cpu_current_top_of_stack, (unsigned long )task_stack_page (next_p) +THREAD_SIZE );
arch/x86/kernel/process_64.c +1 -1
@@ -669,7 +669,7 @@ __switch_to(struct task_struct *prev_p, struct task_struct *next_p)* Switch the PDA and FPU contexts. */ raw_cpu_write (pcpu_hot.current_task, next_p); -raw_cpu_write (pcpu_hot.top_of_stack,task_top_of_stack (next_p)); +raw_cpu_write (cpu_current_top_of_stack,task_top_of_stack (next_p));switch_fpu_finish (next_p);
arch/x86/kernel/smpboot.c +1 -1
@@ -832,7 +832,7 @@ int common_cpu_up(unsigned int cpu, struct task_struct *idle)#ifdef CONFIG_X86_32 /* Stack for startup_32 can be just as for start_secondary onwards */ -per_cpu (pcpu_hot.top_of_stack, cpu) =task_top_of_stack (idle); +per_cpu (cpu_current_top_of_stack, cpu) =task_top_of_stack (idle);#endif return 0 ; }
arch/x86/kernel/vmlinux.lds.S +1 -0
@@ -44,6 +44,7 @@ ENTRY(phys_startup_64) jiffies = jiffies_64; const_pcpu_hot = pcpu_hot; +const_cpu_current_top_of_stack = cpu_current_top_of_stack; #if defined(CONFIG_X86_64) /*
PATCH v3 9/11 x86/percpu: Move current_task to percpu hot section
In reply to Brian GerstNo functional change.
--- arch/x86/include/asm/current.h | 17 ++++++----------- arch/x86/include/asm/percpu.h | 2 +- arch/x86/kernel/asm-offsets.c | 1 - arch/x86/kernel/cpu/common.c | 8 +++----- arch/x86/kernel/head_64.S | 4 ++-- arch/x86/kernel/process_32.c | 2 +- arch/x86/kernel/process_64.c | 2 +- arch/x86/kernel/smpboot.c | 2 +- arch/x86/kernel/vmlinux.lds.S | 2 +- scripts/gdb/linux/cpus.py | 2 +- 10 files changed, 17 insertions(+), 25 deletions(-)
arch/x86/include/asm/current.h +6 -11
@@ -12,22 +12,17 @@struct task_struct ; -struct pcpu_hot { -struct task_struct *current_task; -}; - -DECLARE_PER_CPU_CACHE_HOT(struct pcpu_hot, pcpu_hot); - -/* const-qualified alias to pcpu_hot, aliased by linker. */ -DECLARE_PER_CPU_CACHE_HOT(const struct pcpu_hot __percpu_seg_override, - const_pcpu_hot); +DECLARE_PER_CPU_CACHE_HOT(struct task_struct *, current_task); +/* const-qualified alias provided by the linker. */ +DECLARE_PER_CPU_CACHE_HOT(struct task_struct * const __percpu_seg_override, + const_current_task); static __always_inline struct task_struct *get_current(void) {if (IS_ENABLED (CONFIG_USE_X86_SEG_SUPPORT )) -return this_cpu_read_const (const_pcpu_hot.current_task); +return this_cpu_read_const (const_current_task); -return this_cpu_read_stable (pcpu_hot.current_task); +return this_cpu_read_stable (current_task); }#define current get_current()
arch/x86/include/asm/percpu.h +1 -1
@@ -549,7 +549,7 @@ do { \* it is accessed while this_cpu_read_stable() allows the value to be cached. * this_cpu_read_stable() is more efficient and can be used if its value * is guaranteed to be valid across CPUs. The current users include -* pcpu_hot.current_task and cpu_current_top_of_stack, both of which are +* current_task and cpu_current_top_of_stack, both of which are * actually per-thread variables implemented as per-CPU variables and * thus stable for the duration of the respective task. */
arch/x86/kernel/asm-offsets.c +0 -1
@@ -107,7 +107,6 @@ static void __used common(void)OFFSET (TSS_sp0, tss_struct, x86_tss.sp0);OFFSET (TSS_sp1, tss_struct, x86_tss.sp1);OFFSET (TSS_sp2, tss_struct, x86_tss.sp2); -OFFSET (X86_current_task, pcpu_hot, current_task);#if IS_ENABLED (CONFIG_CRYPTO_ARIA_AESNI_AVX_X86_64 )/* Offset for fields in aria_ctx */ BLANK ();
arch/x86/kernel/cpu/common.c +3 -5
@@ -2049,11 +2049,9 @@ static __init int setup_setcpuid(char *arg) }__setup ("setcpuid=" , setup_setcpuid); -DEFINE_PER_CPU_CACHE_HOT(struct pcpu_hot, pcpu_hot) = { - .current_task = &init_task, -}; -EXPORT_PER_CPU_SYMBOL (pcpu_hot); -EXPORT_PER_CPU_SYMBOL (const_pcpu_hot); +DEFINE_PER_CPU_CACHE_HOT(struct task_struct *, current_task) = &init_task; +EXPORT_PER_CPU_SYMBOL (current_task); +EXPORT_PER_CPU_SYMBOL (const_current_task);DEFINE_PER_CPU_CACHE_HOT (int, __preempt_count) =INIT_PREEMPT_COUNT ;EXPORT_PER_CPU_SYMBOL (__preempt_count);
arch/x86/kernel/head_64.S +2 -2
@@ -322,7 +322,7 @@ SYM_INNER_LABEL(common_startup_64, SYM_L_LOCAL) * * RDX contains the per-cpu offset */ - movq pcpu_hot + X86_current_task(%rdx), %rax + movq current_task(%rdx), %rax movq TASK_threadsp(%rax), %rsp /*
@@ -433,7 +433,7 @@ SYM_CODE_START(soft_restart_cpu) UNWIND_HINT_END_OF_STACK /* Find the idle task stack */ - movq PER_CPU_VAR(pcpu_hot + X86_current_task), %rcx + movq PER_CPU_VAR(current_task), %rcx movq TASK_threadsp(%rcx), %rsp jmp .Ljump_to_C_code
arch/x86/kernel/process_32.c +1 -1
@@ -206,7 +206,7 @@ __switch_to(struct task_struct *prev_p, struct task_struct *next_p)if (prev->gs | next->gs)loadsegment (gs, next->gs); -raw_cpu_write (pcpu_hot.current_task, next_p); +raw_cpu_write (current_task, next_p);switch_fpu_finish (next_p);
arch/x86/kernel/process_64.c +1 -1
@@ -668,7 +668,7 @@ __switch_to(struct task_struct *prev_p, struct task_struct *next_p)/* * Switch the PDA and FPU contexts. */ -raw_cpu_write (pcpu_hot.current_task, next_p); +raw_cpu_write (current_task, next_p);raw_cpu_write (cpu_current_top_of_stack,task_top_of_stack (next_p));switch_fpu_finish (next_p);
arch/x86/kernel/smpboot.c +1 -1
@@ -842,7 +842,7 @@ int common_cpu_up(unsigned int cpu, struct task_struct *idle)/* Just in case we booted with a single CPU. */ alternatives_enable_smp (); -per_cpu (pcpu_hot.current_task, cpu) = idle; +per_cpu (current_task, cpu) = idle;cpu_init_stack_canary (cpu, idle);/* Initialize the interrupt stack(s) */
arch/x86/kernel/vmlinux.lds.S +1 -1
@@ -43,7 +43,7 @@ ENTRY(phys_startup_64) #endif jiffies = jiffies_64; -const_pcpu_hot = pcpu_hot; +const_current_task = current_task; const_cpu_current_top_of_stack = cpu_current_top_of_stack; #if defined(CONFIG_X86_64)
scripts/gdb/linux/cpus.py +1 -1
@@ -164,7 +164,7 @@ def get_current_task(cpu): var_ptr = gdb.parse_and_eval("(struct task_struct *)cpu_tasks[0].task") return var_ptr.dereference() else: - var_ptr = gdb.parse_and_eval("&pcpu_hot.current_task") + var_ptr = gdb.parse_and_eval("¤t_task") return per_cpu(var_ptr, cpu).dereference() elif utils.is_target_arch("aarch64"): current_task_addr = gdb.parse_and_eval("(unsigned long)$SP_EL0")
Signature · 1 line
2.48.1
[tip: x86/core] x86/percpu: Move current_task to percpu hot section
The following commit has been merged into the x86/core branch of tip:
The following commit has been merged into the x86/core branch of tip:
Commit-ID: bc91ad515dffab286194872e4bacfdb6faa18688 Gitweb: https://git.kernel.org/tip/bc91ad515dffab286194872e4bacfdb6faa18688 Author: Brian Gerst <[email protected]> AuthorDate: Mon, 03 Mar 2025 11:52:44 -05:00 Committer: Ingo Molnar <[email protected]> CommitterDate: Mon, 03 Mar 2025 21:37:41 +01:00
x86/percpu: Move current_task to percpu hot section
No functional change.
--- arch/x86/include/asm/current.h | 17 ++++++----------- arch/x86/include/asm/percpu.h | 2 +- arch/x86/kernel/asm-offsets.c | 1 - arch/x86/kernel/cpu/common.c | 8 +++----- arch/x86/kernel/head_64.S | 4 ++-- arch/x86/kernel/process_32.c | 2 +- arch/x86/kernel/process_64.c | 2 +- arch/x86/kernel/smpboot.c | 2 +- arch/x86/kernel/vmlinux.lds.S | 2 +- scripts/gdb/linux/cpus.py | 2 +- 10 files changed, 17 insertions(+), 25 deletions(-)
arch/x86/include/asm/current.h +6 -11
@@ -12,22 +12,17 @@struct task_struct ; -struct pcpu_hot { -struct task_struct *current_task; -}; - -DECLARE_PER_CPU_CACHE_HOT(struct pcpu_hot, pcpu_hot); - -/* const-qualified alias to pcpu_hot, aliased by linker. */ -DECLARE_PER_CPU_CACHE_HOT(const struct pcpu_hot __percpu_seg_override, - const_pcpu_hot); +DECLARE_PER_CPU_CACHE_HOT(struct task_struct *, current_task); +/* const-qualified alias provided by the linker. */ +DECLARE_PER_CPU_CACHE_HOT(struct task_struct * const __percpu_seg_override, + const_current_task); static __always_inline struct task_struct *get_current(void) {if (IS_ENABLED (CONFIG_USE_X86_SEG_SUPPORT )) -return this_cpu_read_const (const_pcpu_hot.current_task); +return this_cpu_read_const (const_current_task); -return this_cpu_read_stable (pcpu_hot.current_task); +return this_cpu_read_stable (current_task); }#define current get_current()
arch/x86/include/asm/percpu.h +1 -1
@@ -549,7 +549,7 @@ do { \* it is accessed while this_cpu_read_stable() allows the value to be cached. * this_cpu_read_stable() is more efficient and can be used if its value * is guaranteed to be valid across CPUs. The current users include -* pcpu_hot.current_task and cpu_current_top_of_stack, both of which are +* current_task and cpu_current_top_of_stack, both of which are * actually per-thread variables implemented as per-CPU variables and * thus stable for the duration of the respective task. */
arch/x86/kernel/asm-offsets.c +0 -1
@@ -107,7 +107,6 @@ static void __used common(void)OFFSET (TSS_sp0, tss_struct, x86_tss.sp0);OFFSET (TSS_sp1, tss_struct, x86_tss.sp1);OFFSET (TSS_sp2, tss_struct, x86_tss.sp2); -OFFSET (X86_current_task, pcpu_hot, current_task);#if IS_ENABLED (CONFIG_CRYPTO_ARIA_AESNI_AVX_X86_64 )/* Offset for fields in aria_ctx */ BLANK ();
arch/x86/kernel/cpu/common.c +3 -5
@@ -2047,11 +2047,9 @@ static __init int setup_setcpuid(char *arg) }__setup ("setcpuid=" , setup_setcpuid); -DEFINE_PER_CPU_CACHE_HOT(struct pcpu_hot, pcpu_hot) = { - .current_task = &init_task, -}; -EXPORT_PER_CPU_SYMBOL (pcpu_hot); -EXPORT_PER_CPU_SYMBOL (const_pcpu_hot); +DEFINE_PER_CPU_CACHE_HOT(struct task_struct *, current_task) = &init_task; +EXPORT_PER_CPU_SYMBOL (current_task); +EXPORT_PER_CPU_SYMBOL (const_current_task);DEFINE_PER_CPU_CACHE_HOT (int, __preempt_count) =INIT_PREEMPT_COUNT ;EXPORT_PER_CPU_SYMBOL (__preempt_count);
arch/x86/kernel/head_64.S +2 -2
@@ -322,7 +322,7 @@ SYM_INNER_LABEL(common_startup_64, SYM_L_LOCAL) * * RDX contains the per-cpu offset */ - movq pcpu_hot + X86_current_task(%rdx), %rax + movq current_task(%rdx), %rax movq TASK_threadsp(%rax), %rsp /*
@@ -433,7 +433,7 @@ SYM_CODE_START(soft_restart_cpu) UNWIND_HINT_END_OF_STACK /* Find the idle task stack */ - movq PER_CPU_VAR(pcpu_hot + X86_current_task), %rcx + movq PER_CPU_VAR(current_task), %rcx movq TASK_threadsp(%rcx), %rsp jmp .Ljump_to_C_code
arch/x86/kernel/process_32.c +1 -1
@@ -206,7 +206,7 @@ __switch_to(struct task_struct *prev_p, struct task_struct *next_p)if (prev->gs | next->gs)loadsegment (gs, next->gs); -raw_cpu_write (pcpu_hot.current_task, next_p); +raw_cpu_write (current_task, next_p);switch_fpu_finish (next_p);
arch/x86/kernel/process_64.c +1 -1
@@ -668,7 +668,7 @@ __switch_to(struct task_struct *prev_p, struct task_struct *next_p)/* * Switch the PDA and FPU contexts. */ -raw_cpu_write (pcpu_hot.current_task, next_p); +raw_cpu_write (current_task, next_p);raw_cpu_write (cpu_current_top_of_stack,task_top_of_stack (next_p));switch_fpu_finish (next_p);
arch/x86/kernel/smpboot.c +1 -1
@@ -842,7 +842,7 @@ int common_cpu_up(unsigned int cpu, struct task_struct *idle)/* Just in case we booted with a single CPU. */ alternatives_enable_smp (); -per_cpu (pcpu_hot.current_task, cpu) = idle; +per_cpu (current_task, cpu) = idle;cpu_init_stack_canary (cpu, idle);/* Initialize the interrupt stack(s) */
arch/x86/kernel/vmlinux.lds.S +1 -1
@@ -43,7 +43,7 @@ ENTRY(phys_startup_64) #endif jiffies = jiffies_64; -const_pcpu_hot = pcpu_hot; +const_current_task = current_task; const_cpu_current_top_of_stack = cpu_current_top_of_stack; #if defined(CONFIG_X86_64)
scripts/gdb/linux/cpus.py +1 -1
@@ -164,7 +164,7 @@ def get_current_task(cpu): var_ptr = gdb.parse_and_eval("(struct task_struct *)cpu_tasks[0].task") return var_ptr.dereference() else: - var_ptr = gdb.parse_and_eval("&pcpu_hot.current_task") + var_ptr = gdb.parse_and_eval("¤t_task") return per_cpu(var_ptr, cpu).dereference() elif utils.is_target_arch("aarch64"): current_task_addr = gdb.parse_and_eval("(unsigned long)$SP_EL0")
[tip: x86/core] x86/percpu: Move current_task to percpu hot section
In reply to Brian GerstThe following commit has been merged into the x86/core branch of tip:
The following commit has been merged into the x86/core branch of tip:
Commit-ID: f19a605f4334e0dab51c839202a089f79c46579d Gitweb: https://git.kernel.org/tip/f19a605f4334e0dab51c839202a089f79c46579d Author: Brian Gerst <[email protected]> AuthorDate: Mon, 03 Mar 2025 11:52:44 -05:00 Committer: Ingo Molnar <[email protected]> CommitterDate: Tue, 04 Mar 2025 11:24:29 +01:00
x86/percpu: Move current_task to percpu hot section
No functional change.
--- arch/x86/include/asm/current.h | 17 ++++++----------- arch/x86/include/asm/percpu.h | 2 +- arch/x86/kernel/asm-offsets.c | 1 - arch/x86/kernel/cpu/common.c | 8 +++----- arch/x86/kernel/head_64.S | 4 ++-- arch/x86/kernel/process_32.c | 2 +- arch/x86/kernel/process_64.c | 2 +- arch/x86/kernel/smpboot.c | 2 +- arch/x86/kernel/vmlinux.lds.S | 2 +- scripts/gdb/linux/cpus.py | 2 +- 10 files changed, 17 insertions(+), 25 deletions(-)
arch/x86/include/asm/current.h +6 -11
@@ -12,22 +12,17 @@struct task_struct ; -struct pcpu_hot { -struct task_struct *current_task; -}; - -DECLARE_PER_CPU_CACHE_HOT(struct pcpu_hot, pcpu_hot); - -/* const-qualified alias to pcpu_hot, aliased by linker. */ -DECLARE_PER_CPU_CACHE_HOT(const struct pcpu_hot __percpu_seg_override, - const_pcpu_hot); +DECLARE_PER_CPU_CACHE_HOT(struct task_struct *, current_task); +/* const-qualified alias provided by the linker. */ +DECLARE_PER_CPU_CACHE_HOT(struct task_struct * const __percpu_seg_override, + const_current_task); static __always_inline struct task_struct *get_current(void) {if (IS_ENABLED (CONFIG_USE_X86_SEG_SUPPORT )) -return this_cpu_read_const (const_pcpu_hot.current_task); +return this_cpu_read_const (const_current_task); -return this_cpu_read_stable (pcpu_hot.current_task); +return this_cpu_read_stable (current_task); }#define current get_current()
arch/x86/include/asm/percpu.h +1 -1
@@ -549,7 +549,7 @@ do { \* it is accessed while this_cpu_read_stable() allows the value to be cached. * this_cpu_read_stable() is more efficient and can be used if its value * is guaranteed to be valid across CPUs. The current users include -* pcpu_hot.current_task and cpu_current_top_of_stack, both of which are +* current_task and cpu_current_top_of_stack, both of which are * actually per-thread variables implemented as per-CPU variables and * thus stable for the duration of the respective task. */
arch/x86/kernel/asm-offsets.c +0 -1
@@ -107,7 +107,6 @@ static void __used common(void)OFFSET (TSS_sp0, tss_struct, x86_tss.sp0);OFFSET (TSS_sp1, tss_struct, x86_tss.sp1);OFFSET (TSS_sp2, tss_struct, x86_tss.sp2); -OFFSET (X86_current_task, pcpu_hot, current_task);#if IS_ENABLED (CONFIG_CRYPTO_ARIA_AESNI_AVX_X86_64 )/* Offset for fields in aria_ctx */ BLANK ();
arch/x86/kernel/cpu/common.c +3 -5
@@ -2064,11 +2064,9 @@ static __init int setup_setcpuid(char *arg) }__setup ("setcpuid=" , setup_setcpuid); -DEFINE_PER_CPU_CACHE_HOT(struct pcpu_hot, pcpu_hot) = { - .current_task = &init_task, -}; -EXPORT_PER_CPU_SYMBOL (pcpu_hot); -EXPORT_PER_CPU_SYMBOL (const_pcpu_hot); +DEFINE_PER_CPU_CACHE_HOT(struct task_struct *, current_task) = &init_task; +EXPORT_PER_CPU_SYMBOL (current_task); +EXPORT_PER_CPU_SYMBOL (const_current_task);DEFINE_PER_CPU_CACHE_HOT (int, __preempt_count) =INIT_PREEMPT_COUNT ;EXPORT_PER_CPU_SYMBOL (__preempt_count);
arch/x86/kernel/head_64.S +2 -2
@@ -322,7 +322,7 @@ SYM_INNER_LABEL(common_startup_64, SYM_L_LOCAL) * * RDX contains the per-cpu offset */ - movq pcpu_hot + X86_current_task(%rdx), %rax + movq current_task(%rdx), %rax movq TASK_threadsp(%rax), %rsp /*
@@ -433,7 +433,7 @@ SYM_CODE_START(soft_restart_cpu) UNWIND_HINT_END_OF_STACK /* Find the idle task stack */ - movq PER_CPU_VAR(pcpu_hot + X86_current_task), %rcx + movq PER_CPU_VAR(current_task), %rcx movq TASK_threadsp(%rcx), %rsp jmp .Ljump_to_C_code
arch/x86/kernel/process_32.c +1 -1
@@ -206,7 +206,7 @@ __switch_to(struct task_struct *prev_p, struct task_struct *next_p)if (prev->gs | next->gs)loadsegment (gs, next->gs); -raw_cpu_write (pcpu_hot.current_task, next_p); +raw_cpu_write (current_task, next_p);switch_fpu_finish (next_p);
arch/x86/kernel/process_64.c +1 -1
@@ -668,7 +668,7 @@ __switch_to(struct task_struct *prev_p, struct task_struct *next_p)/* * Switch the PDA and FPU contexts. */ -raw_cpu_write (pcpu_hot.current_task, next_p); +raw_cpu_write (current_task, next_p);raw_cpu_write (cpu_current_top_of_stack,task_top_of_stack (next_p));switch_fpu_finish (next_p);
arch/x86/kernel/smpboot.c +1 -1
@@ -822,7 +822,7 @@ int common_cpu_up(unsigned int cpu, struct task_struct *idle)/* Just in case we booted with a single CPU. */ alternatives_enable_smp (); -per_cpu (pcpu_hot.current_task, cpu) = idle; +per_cpu (current_task, cpu) = idle;cpu_init_stack_canary (cpu, idle);/* Initialize the interrupt stack(s) */
arch/x86/kernel/vmlinux.lds.S +1 -1
@@ -43,7 +43,7 @@ ENTRY(phys_startup_64) #endif jiffies = jiffies_64; -const_pcpu_hot = pcpu_hot; +const_current_task = current_task; const_cpu_current_top_of_stack = cpu_current_top_of_stack; #if defined(CONFIG_X86_64)
scripts/gdb/linux/cpus.py +1 -1
@@ -164,7 +164,7 @@ def get_current_task(cpu): var_ptr = gdb.parse_and_eval("(struct task_struct *)cpu_tasks[0].task") return var_ptr.dereference() else: - var_ptr = gdb.parse_and_eval("&pcpu_hot.current_task") + var_ptr = gdb.parse_and_eval("¤t_task") return per_cpu(var_ptr, cpu).dereference() elif utils.is_target_arch("aarch64"): current_task_addr = gdb.parse_and_eval("(unsigned long)$SP_EL0")
[tip: x86/core] x86/percpu: Move current_task to percpu hot section
In reply to Brian GerstThe following commit has been merged into the x86/core branch of tip:
The following commit has been merged into the x86/core branch of tip:
Commit-ID: f7d482a833ca1c72859c90a05a1eca04f0b3954d Gitweb: https://git.kernel.org/tip/f7d482a833ca1c72859c90a05a1eca04f0b3954d Author: Brian Gerst <[email protected]> AuthorDate: Mon, 03 Mar 2025 11:52:44 -05:00 Committer: Ingo Molnar <[email protected]> CommitterDate: Tue, 04 Mar 2025 20:18:02 +01:00
x86/percpu: Move current_task to percpu hot section
No functional change.
--- arch/x86/include/asm/current.h | 17 ++++++----------- arch/x86/include/asm/percpu.h | 2 +- arch/x86/kernel/asm-offsets.c | 1 - arch/x86/kernel/cpu/common.c | 8 +++----- arch/x86/kernel/head_64.S | 4 ++-- arch/x86/kernel/process_32.c | 2 +- arch/x86/kernel/process_64.c | 2 +- arch/x86/kernel/smpboot.c | 2 +- arch/x86/kernel/vmlinux.lds.S | 2 +- scripts/gdb/linux/cpus.py | 2 +- 10 files changed, 17 insertions(+), 25 deletions(-)
arch/x86/include/asm/current.h +6 -11
@@ -12,22 +12,17 @@struct task_struct ; -struct pcpu_hot { -struct task_struct *current_task; -}; - -DECLARE_PER_CPU_CACHE_HOT(struct pcpu_hot, pcpu_hot); - -/* const-qualified alias to pcpu_hot, aliased by linker. */ -DECLARE_PER_CPU_CACHE_HOT(const struct pcpu_hot __percpu_seg_override, - const_pcpu_hot); +DECLARE_PER_CPU_CACHE_HOT(struct task_struct *, current_task); +/* const-qualified alias provided by the linker. */ +DECLARE_PER_CPU_CACHE_HOT(struct task_struct * const __percpu_seg_override, + const_current_task); static __always_inline struct task_struct *get_current(void) {if (IS_ENABLED (CONFIG_USE_X86_SEG_SUPPORT )) -return this_cpu_read_const (const_pcpu_hot.current_task); +return this_cpu_read_const (const_current_task); -return this_cpu_read_stable (pcpu_hot.current_task); +return this_cpu_read_stable (current_task); }#define current get_current()
arch/x86/include/asm/percpu.h +1 -1
@@ -551,7 +551,7 @@ do { \* it is accessed while this_cpu_read_stable() allows the value to be cached. * this_cpu_read_stable() is more efficient and can be used if its value * is guaranteed to be valid across CPUs. The current users include -* pcpu_hot.current_task and cpu_current_top_of_stack, both of which are +* current_task and cpu_current_top_of_stack, both of which are * actually per-thread variables implemented as per-CPU variables and * thus stable for the duration of the respective task. */
arch/x86/kernel/asm-offsets.c +0 -1
@@ -107,7 +107,6 @@ static void __used common(void)OFFSET (TSS_sp0, tss_struct, x86_tss.sp0);OFFSET (TSS_sp1, tss_struct, x86_tss.sp1);OFFSET (TSS_sp2, tss_struct, x86_tss.sp2); -OFFSET (X86_current_task, pcpu_hot, current_task);#if IS_ENABLED (CONFIG_CRYPTO_ARIA_AESNI_AVX_X86_64 )/* Offset for fields in aria_ctx */ BLANK ();
arch/x86/kernel/cpu/common.c +3 -5
@@ -2064,11 +2064,9 @@ static __init int setup_setcpuid(char *arg) }__setup ("setcpuid=" , setup_setcpuid); -DEFINE_PER_CPU_CACHE_HOT(struct pcpu_hot, pcpu_hot) = { - .current_task = &init_task, -}; -EXPORT_PER_CPU_SYMBOL (pcpu_hot); -EXPORT_PER_CPU_SYMBOL (const_pcpu_hot); +DEFINE_PER_CPU_CACHE_HOT(struct task_struct *, current_task) = &init_task; +EXPORT_PER_CPU_SYMBOL (current_task); +EXPORT_PER_CPU_SYMBOL (const_current_task);DEFINE_PER_CPU_CACHE_HOT (int, __preempt_count) =INIT_PREEMPT_COUNT ;EXPORT_PER_CPU_SYMBOL (__preempt_count);
arch/x86/kernel/head_64.S +2 -2
@@ -322,7 +322,7 @@ SYM_INNER_LABEL(common_startup_64, SYM_L_LOCAL) * * RDX contains the per-cpu offset */ - movq pcpu_hot + X86_current_task(%rdx), %rax + movq current_task(%rdx), %rax movq TASK_threadsp(%rax), %rsp /*
@@ -433,7 +433,7 @@ SYM_CODE_START(soft_restart_cpu) UNWIND_HINT_END_OF_STACK /* Find the idle task stack */ - movq PER_CPU_VAR(pcpu_hot + X86_current_task), %rcx + movq PER_CPU_VAR(current_task), %rcx movq TASK_threadsp(%rcx), %rsp jmp .Ljump_to_C_code
arch/x86/kernel/process_32.c +1 -1
@@ -206,7 +206,7 @@ __switch_to(struct task_struct *prev_p, struct task_struct *next_p)if (prev->gs | next->gs)loadsegment (gs, next->gs); -raw_cpu_write (pcpu_hot.current_task, next_p); +raw_cpu_write (current_task, next_p);switch_fpu_finish (next_p);
arch/x86/kernel/process_64.c +1 -1
@@ -668,7 +668,7 @@ __switch_to(struct task_struct *prev_p, struct task_struct *next_p)/* * Switch the PDA and FPU contexts. */ -raw_cpu_write (pcpu_hot.current_task, next_p); +raw_cpu_write (current_task, next_p);raw_cpu_write (cpu_current_top_of_stack,task_top_of_stack (next_p));switch_fpu_finish (next_p);
arch/x86/kernel/smpboot.c +1 -1
@@ -822,7 +822,7 @@ int common_cpu_up(unsigned int cpu, struct task_struct *idle)/* Just in case we booted with a single CPU. */ alternatives_enable_smp (); -per_cpu (pcpu_hot.current_task, cpu) = idle; +per_cpu (current_task, cpu) = idle;cpu_init_stack_canary (cpu, idle);/* Initialize the interrupt stack(s) */
arch/x86/kernel/vmlinux.lds.S +1 -1
@@ -43,7 +43,7 @@ ENTRY(phys_startup_64) #endif jiffies = jiffies_64; -const_pcpu_hot = pcpu_hot; +const_current_task = current_task; const_cpu_current_top_of_stack = cpu_current_top_of_stack; #if defined(CONFIG_X86_64)
scripts/gdb/linux/cpus.py +1 -1
@@ -164,7 +164,7 @@ def get_current_task(cpu): var_ptr = gdb.parse_and_eval("(struct task_struct *)cpu_tasks[0].task") return var_ptr.dereference() else: - var_ptr = gdb.parse_and_eval("&pcpu_hot.current_task") + var_ptr = gdb.parse_and_eval("¤t_task") return per_cpu(var_ptr, cpu).dereference() elif utils.is_target_arch("aarch64"): current_task_addr = gdb.parse_and_eval("(unsigned long)$SP_EL0")
[tip: x86/core] x86/percpu: Move current_task to percpu hot section
In reply to Brian GerstThe following commit has been merged into the x86/core branch of tip:
The following commit has been merged into the x86/core branch of tip:
Commit-ID: a1e4cc0155ad577adc3a2c563fc5eec625945ce7 Gitweb: https://git.kernel.org/tip/a1e4cc0155ad577adc3a2c563fc5eec625945ce7 Author: Brian Gerst <[email protected]> AuthorDate: Mon, 03 Mar 2025 11:52:44 -05:00 Committer: Ingo Molnar <[email protected]> CommitterDate: Tue, 04 Mar 2025 20:30:33 +01:00
x86/percpu: Move current_task to percpu hot section
No functional change.
--- arch/x86/include/asm/current.h | 17 ++++++----------- arch/x86/include/asm/percpu.h | 2 +- arch/x86/kernel/asm-offsets.c | 1 - arch/x86/kernel/cpu/common.c | 8 +++----- arch/x86/kernel/head_64.S | 4 ++-- arch/x86/kernel/process_32.c | 2 +- arch/x86/kernel/process_64.c | 2 +- arch/x86/kernel/smpboot.c | 2 +- arch/x86/kernel/vmlinux.lds.S | 2 +- scripts/gdb/linux/cpus.py | 2 +- 10 files changed, 17 insertions(+), 25 deletions(-)
arch/x86/include/asm/current.h +6 -11
@@ -12,22 +12,17 @@struct task_struct ; -struct pcpu_hot { -struct task_struct *current_task; -}; - -DECLARE_PER_CPU_CACHE_HOT(struct pcpu_hot, pcpu_hot); - -/* const-qualified alias to pcpu_hot, aliased by linker. */ -DECLARE_PER_CPU_CACHE_HOT(const struct pcpu_hot __percpu_seg_override, - const_pcpu_hot); +DECLARE_PER_CPU_CACHE_HOT(struct task_struct *, current_task); +/* const-qualified alias provided by the linker. */ +DECLARE_PER_CPU_CACHE_HOT(struct task_struct * const __percpu_seg_override, + const_current_task); static __always_inline struct task_struct *get_current(void) {if (IS_ENABLED (CONFIG_USE_X86_SEG_SUPPORT )) -return this_cpu_read_const (const_pcpu_hot.current_task); +return this_cpu_read_const (const_current_task); -return this_cpu_read_stable (pcpu_hot.current_task); +return this_cpu_read_stable (current_task); }#define current get_current()
arch/x86/include/asm/percpu.h +1 -1
@@ -551,7 +551,7 @@ do { \* it is accessed while this_cpu_read_stable() allows the value to be cached. * this_cpu_read_stable() is more efficient and can be used if its value * is guaranteed to be valid across CPUs. The current users include -* pcpu_hot.current_task and cpu_current_top_of_stack, both of which are +* current_task and cpu_current_top_of_stack, both of which are * actually per-thread variables implemented as per-CPU variables and * thus stable for the duration of the respective task. */
arch/x86/kernel/asm-offsets.c +0 -1
@@ -107,7 +107,6 @@ static void __used common(void)OFFSET (TSS_sp0, tss_struct, x86_tss.sp0);OFFSET (TSS_sp1, tss_struct, x86_tss.sp1);OFFSET (TSS_sp2, tss_struct, x86_tss.sp2); -OFFSET (X86_current_task, pcpu_hot, current_task);#if IS_ENABLED (CONFIG_CRYPTO_ARIA_AESNI_AVX_X86_64 )/* Offset for fields in aria_ctx */ BLANK ();
arch/x86/kernel/cpu/common.c +3 -5
@@ -2064,11 +2064,9 @@ static __init int setup_setcpuid(char *arg) }__setup ("setcpuid=" , setup_setcpuid); -DEFINE_PER_CPU_CACHE_HOT(struct pcpu_hot, pcpu_hot) = { - .current_task = &init_task, -}; -EXPORT_PER_CPU_SYMBOL (pcpu_hot); -EXPORT_PER_CPU_SYMBOL (const_pcpu_hot); +DEFINE_PER_CPU_CACHE_HOT(struct task_struct *, current_task) = &init_task; +EXPORT_PER_CPU_SYMBOL (current_task); +EXPORT_PER_CPU_SYMBOL (const_current_task);DEFINE_PER_CPU_CACHE_HOT (int, __preempt_count) =INIT_PREEMPT_COUNT ;EXPORT_PER_CPU_SYMBOL (__preempt_count);
arch/x86/kernel/head_64.S +2 -2
@@ -322,7 +322,7 @@ SYM_INNER_LABEL(common_startup_64, SYM_L_LOCAL) * * RDX contains the per-cpu offset */ - movq pcpu_hot + X86_current_task(%rdx), %rax + movq current_task(%rdx), %rax movq TASK_threadsp(%rax), %rsp /*
@@ -433,7 +433,7 @@ SYM_CODE_START(soft_restart_cpu) UNWIND_HINT_END_OF_STACK /* Find the idle task stack */ - movq PER_CPU_VAR(pcpu_hot + X86_current_task), %rcx + movq PER_CPU_VAR(current_task), %rcx movq TASK_threadsp(%rcx), %rsp jmp .Ljump_to_C_code
arch/x86/kernel/process_32.c +1 -1
@@ -206,7 +206,7 @@ __switch_to(struct task_struct *prev_p, struct task_struct *next_p)if (prev->gs | next->gs)loadsegment (gs, next->gs); -raw_cpu_write (pcpu_hot.current_task, next_p); +raw_cpu_write (current_task, next_p);switch_fpu_finish (next_p);
arch/x86/kernel/process_64.c +1 -1
@@ -668,7 +668,7 @@ __switch_to(struct task_struct *prev_p, struct task_struct *next_p)/* * Switch the PDA and FPU contexts. */ -raw_cpu_write (pcpu_hot.current_task, next_p); +raw_cpu_write (current_task, next_p);raw_cpu_write (cpu_current_top_of_stack,task_top_of_stack (next_p));switch_fpu_finish (next_p);
arch/x86/kernel/smpboot.c +1 -1
@@ -822,7 +822,7 @@ int common_cpu_up(unsigned int cpu, struct task_struct *idle)/* Just in case we booted with a single CPU. */ alternatives_enable_smp (); -per_cpu (pcpu_hot.current_task, cpu) = idle; +per_cpu (current_task, cpu) = idle;cpu_init_stack_canary (cpu, idle);/* Initialize the interrupt stack(s) */
arch/x86/kernel/vmlinux.lds.S +1 -1
@@ -43,7 +43,7 @@ ENTRY(phys_startup_64) #endif jiffies = jiffies_64; -const_pcpu_hot = pcpu_hot; +const_current_task = current_task; const_cpu_current_top_of_stack = cpu_current_top_of_stack; #if defined(CONFIG_X86_64)
scripts/gdb/linux/cpus.py +1 -1
@@ -164,7 +164,7 @@ def get_current_task(cpu): var_ptr = gdb.parse_and_eval("(struct task_struct *)cpu_tasks[0].task") return var_ptr.dereference() else: - var_ptr = gdb.parse_and_eval("&pcpu_hot.current_task") + var_ptr = gdb.parse_and_eval("¤t_task") return per_cpu(var_ptr, cpu).dereference() elif utils.is_target_arch("aarch64"): current_task_addr = gdb.parse_and_eval("(unsigned long)$SP_EL0")
PATCH v3 10/11 x86/stackprotector: Move __stack_chk_guard to percpu hot section
In reply to Brian GerstNo functional change.
--- arch/x86/include/asm/stackprotector.h | 2 +- arch/x86/kernel/cpu/common.c | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-)
arch/x86/include/asm/stackprotector.h +1 -1
@@ -20,7 +20,7 @@#include <linux/sched.h> -DECLARE_PER_CPU(unsigned long, __stack_chk_guard); +DECLARE_PER_CPU_CACHE_HOT(unsigned long, __stack_chk_guard);/* * Initialize the stackprotector canary value.
arch/x86/kernel/cpu/common.c +1 -1
@@ -2132,7 +2132,7 @@ void syscall_init(void)#endif /* CONFIG_X86_64 */ #ifdef CONFIG_STACKPROTECTOR -DEFINE_PER_CPU(unsigned long, __stack_chk_guard); +DEFINE_PER_CPU_CACHE_HOT(unsigned long, __stack_chk_guard);#ifndef CONFIG_SMP EXPORT_PER_CPU_SYMBOL (__stack_chk_guard);#endif
Signature · 1 line
2.48.1
[tip: x86/core] x86/stackprotector: Move __stack_chk_guard to percpu hot section
The following commit has been merged into the x86/core branch of tip:
The following commit has been merged into the x86/core branch of tip:
Commit-ID: 0d3cd124b77ab546ba4284587fb6a72322a89daf Gitweb: https://git.kernel.org/tip/0d3cd124b77ab546ba4284587fb6a72322a89daf Author: Brian Gerst <[email protected]> AuthorDate: Mon, 03 Mar 2025 11:52:45 -05:00 Committer: Ingo Molnar <[email protected]> CommitterDate: Mon, 03 Mar 2025 21:37:41 +01:00
x86/stackprotector: Move __stack_chk_guard to percpu hot section
No functional change.
--- arch/x86/include/asm/stackprotector.h | 2 +- arch/x86/kernel/cpu/common.c | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-)
arch/x86/include/asm/stackprotector.h +1 -1
@@ -20,7 +20,7 @@#include <linux/sched.h> -DECLARE_PER_CPU(unsigned long, __stack_chk_guard); +DECLARE_PER_CPU_CACHE_HOT(unsigned long, __stack_chk_guard);/* * Initialize the stackprotector canary value.
arch/x86/kernel/cpu/common.c +1 -1
@@ -2130,7 +2130,7 @@ void syscall_init(void)#endif /* CONFIG_X86_64 */ #ifdef CONFIG_STACKPROTECTOR -DEFINE_PER_CPU(unsigned long, __stack_chk_guard); +DEFINE_PER_CPU_CACHE_HOT(unsigned long, __stack_chk_guard);#ifndef CONFIG_SMP EXPORT_PER_CPU_SYMBOL (__stack_chk_guard);#endif
[tip: x86/core] x86/stackprotector: Move __stack_chk_guard to percpu hot section
In reply to Brian GerstThe following commit has been merged into the x86/core branch of tip:
The following commit has been merged into the x86/core branch of tip:
Commit-ID: f9bf822a1642aedb986b1a7dbdfa658de999b7c6 Gitweb: https://git.kernel.org/tip/f9bf822a1642aedb986b1a7dbdfa658de999b7c6 Author: Brian Gerst <[email protected]> AuthorDate: Mon, 03 Mar 2025 11:52:45 -05:00 Committer: Ingo Molnar <[email protected]> CommitterDate: Tue, 04 Mar 2025 11:24:29 +01:00
x86/stackprotector: Move __stack_chk_guard to percpu hot section
No functional change.
--- arch/x86/include/asm/stackprotector.h | 2 +- arch/x86/kernel/cpu/common.c | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-)
arch/x86/include/asm/stackprotector.h +1 -1
@@ -20,7 +20,7 @@#include <linux/sched.h> -DECLARE_PER_CPU(unsigned long, __stack_chk_guard); +DECLARE_PER_CPU_CACHE_HOT(unsigned long, __stack_chk_guard);/* * Initialize the stackprotector canary value.
arch/x86/kernel/cpu/common.c +1 -1
@@ -2147,7 +2147,7 @@ void syscall_init(void)#endif /* CONFIG_X86_64 */ #ifdef CONFIG_STACKPROTECTOR -DEFINE_PER_CPU(unsigned long, __stack_chk_guard); +DEFINE_PER_CPU_CACHE_HOT(unsigned long, __stack_chk_guard);#ifndef CONFIG_SMP EXPORT_PER_CPU_SYMBOL (__stack_chk_guard);#endif
[tip: x86/core] x86/stackprotector: Move __stack_chk_guard to percpu hot section
In reply to Brian GerstThe following commit has been merged into the x86/core branch of tip:
The following commit has been merged into the x86/core branch of tip:
Commit-ID: db421cdec99d0f18282f3c9fafc57a0a8a0ffdf9 Gitweb: https://git.kernel.org/tip/db421cdec99d0f18282f3c9fafc57a0a8a0ffdf9 Author: Brian Gerst <[email protected]> AuthorDate: Mon, 03 Mar 2025 11:52:45 -05:00 Committer: Ingo Molnar <[email protected]> CommitterDate: Tue, 04 Mar 2025 20:18:02 +01:00
x86/stackprotector: Move __stack_chk_guard to percpu hot section
No functional change.
--- arch/x86/include/asm/stackprotector.h | 2 +- arch/x86/kernel/cpu/common.c | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-)
arch/x86/include/asm/stackprotector.h +1 -1
@@ -20,7 +20,7 @@#include <linux/sched.h> -DECLARE_PER_CPU(unsigned long, __stack_chk_guard); +DECLARE_PER_CPU_CACHE_HOT(unsigned long, __stack_chk_guard);/* * Initialize the stackprotector canary value.
arch/x86/kernel/cpu/common.c +1 -1
@@ -2147,7 +2147,7 @@ void syscall_init(void)#endif /* CONFIG_X86_64 */ #ifdef CONFIG_STACKPROTECTOR -DEFINE_PER_CPU(unsigned long, __stack_chk_guard); +DEFINE_PER_CPU_CACHE_HOT(unsigned long, __stack_chk_guard);#ifndef CONFIG_SMP EXPORT_PER_CPU_SYMBOL (__stack_chk_guard);#endif
[tip: x86/core] x86/stackprotector: Move __stack_chk_guard to percpu hot section
In reply to Brian GerstThe following commit has been merged into the x86/core branch of tip:
The following commit has been merged into the x86/core branch of tip:
Commit-ID: f3856cd343b6371530c9af3c97354cdc003f3203 Gitweb: https://git.kernel.org/tip/f3856cd343b6371530c9af3c97354cdc003f3203 Author: Brian Gerst <[email protected]> AuthorDate: Mon, 03 Mar 2025 11:52:45 -05:00 Committer: Ingo Molnar <[email protected]> CommitterDate: Tue, 04 Mar 2025 20:30:33 +01:00
x86/stackprotector: Move __stack_chk_guard to percpu hot section
No functional change.
--- arch/x86/include/asm/stackprotector.h | 2 +- arch/x86/kernel/cpu/common.c | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-)
arch/x86/include/asm/stackprotector.h +1 -1
@@ -20,7 +20,7 @@#include <linux/sched.h> -DECLARE_PER_CPU(unsigned long, __stack_chk_guard); +DECLARE_PER_CPU_CACHE_HOT(unsigned long, __stack_chk_guard);/* * Initialize the stackprotector canary value.
arch/x86/kernel/cpu/common.c +1 -1
@@ -2147,7 +2147,7 @@ void syscall_init(void)#endif /* CONFIG_X86_64 */ #ifdef CONFIG_STACKPROTECTOR -DEFINE_PER_CPU(unsigned long, __stack_chk_guard); +DEFINE_PER_CPU_CACHE_HOT(unsigned long, __stack_chk_guard);#ifndef CONFIG_SMP EXPORT_PER_CPU_SYMBOL (__stack_chk_guard);#endif
PATCH v3 11/11 x86/smp: Move this_cpu_off to percpu hot section
In reply to Brian GerstNo functional change.
--- arch/x86/include/asm/percpu.h | 2 +- arch/x86/kernel/setup_percpu.c | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-)
arch/x86/include/asm/percpu.h +1 -1
@@ -584,7 +584,7 @@ do { \#include <asm-generic/percpu.h> /* We can use this directly for local CPU (faster). */ -DECLARE_PER_CPU_READ_MOSTLY(unsigned long, this_cpu_off); +DECLARE_PER_CPU_CACHE_HOT(unsigned long, this_cpu_off);#endif /* !__ASSEMBLY__ */
arch/x86/kernel/setup_percpu.c +1 -1
@@ -26,7 +26,7 @@DEFINE_PER_CPU_CACHE_HOT (int, cpu_number);EXPORT_PER_CPU_SYMBOL (cpu_number); -DEFINE_PER_CPU_READ_MOSTLY(unsigned long, this_cpu_off); +DEFINE_PER_CPU_CACHE_HOT(unsigned long, this_cpu_off);EXPORT_PER_CPU_SYMBOL (this_cpu_off);unsigned long __per_cpu_offset[NR_CPUS ]__ro_after_init ;
Signature · 1 line
2.48.1
[tip: x86/core] x86/smp: Move this_cpu_off to percpu hot section
The following commit has been merged into the x86/core branch of tip:
The following commit has been merged into the x86/core branch of tip:
Commit-ID: cfe31c859a8123a282e0ecee76bf77fdc3bccf74 Gitweb: https://git.kernel.org/tip/cfe31c859a8123a282e0ecee76bf77fdc3bccf74 Author: Brian Gerst <[email protected]> AuthorDate: Mon, 03 Mar 2025 11:52:46 -05:00 Committer: Ingo Molnar <[email protected]> CommitterDate: Mon, 03 Mar 2025 21:37:41 +01:00
x86/smp: Move this_cpu_off to percpu hot section
No functional change.
--- arch/x86/include/asm/percpu.h | 2 +- arch/x86/kernel/setup_percpu.c | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-)
arch/x86/include/asm/percpu.h +1 -1
@@ -584,7 +584,7 @@ do { \#include <asm-generic/percpu.h> /* We can use this directly for local CPU (faster). */ -DECLARE_PER_CPU_READ_MOSTLY(unsigned long, this_cpu_off); +DECLARE_PER_CPU_CACHE_HOT(unsigned long, this_cpu_off);#endif /* !__ASSEMBLY__ */
arch/x86/kernel/setup_percpu.c +1 -1
@@ -26,7 +26,7 @@DEFINE_PER_CPU_CACHE_HOT (int, cpu_number);EXPORT_PER_CPU_SYMBOL (cpu_number); -DEFINE_PER_CPU_READ_MOSTLY(unsigned long, this_cpu_off); +DEFINE_PER_CPU_CACHE_HOT(unsigned long, this_cpu_off);EXPORT_PER_CPU_SYMBOL (this_cpu_off);unsigned long __per_cpu_offset[NR_CPUS ]__ro_after_init ;
[tip: x86/core] x86/smp: Move this_cpu_off to percpu hot section
In reply to Brian GerstThe following commit has been merged into the x86/core branch of tip:
The following commit has been merged into the x86/core branch of tip:
Commit-ID: 04ce0ca5d5b6d79376913b272e14118be09c6367 Gitweb: https://git.kernel.org/tip/04ce0ca5d5b6d79376913b272e14118be09c6367 Author: Brian Gerst <[email protected]> AuthorDate: Mon, 03 Mar 2025 11:52:46 -05:00 Committer: Ingo Molnar <[email protected]> CommitterDate: Tue, 04 Mar 2025 11:24:29 +01:00
x86/smp: Move this_cpu_off to percpu hot section
No functional change.
--- arch/x86/include/asm/percpu.h | 2 +- arch/x86/kernel/setup_percpu.c | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-)
arch/x86/include/asm/percpu.h +1 -1
@@ -584,7 +584,7 @@ do { \#include <asm-generic/percpu.h> /* We can use this directly for local CPU (faster). */ -DECLARE_PER_CPU_READ_MOSTLY(unsigned long, this_cpu_off); +DECLARE_PER_CPU_CACHE_HOT(unsigned long, this_cpu_off);#endif /* !__ASSEMBLY__ */
arch/x86/kernel/setup_percpu.c +1 -1
@@ -26,7 +26,7 @@DEFINE_PER_CPU_CACHE_HOT (int, cpu_number);EXPORT_PER_CPU_SYMBOL (cpu_number); -DEFINE_PER_CPU_READ_MOSTLY(unsigned long, this_cpu_off); +DEFINE_PER_CPU_CACHE_HOT(unsigned long, this_cpu_off);EXPORT_PER_CPU_SYMBOL (this_cpu_off);unsigned long __per_cpu_offset[NR_CPUS ]__ro_after_init ;
[tip: x86/core] x86/smp: Move this_cpu_off to percpu hot section
In reply to Brian GerstThe following commit has been merged into the x86/core branch of tip:
The following commit has been merged into the x86/core branch of tip:
Commit-ID: 6a75fb34742d94d2de49b755ed5c6dbe77be0857 Gitweb: https://git.kernel.org/tip/6a75fb34742d94d2de49b755ed5c6dbe77be0857 Author: Brian Gerst <[email protected]> AuthorDate: Mon, 03 Mar 2025 11:52:46 -05:00 Committer: Ingo Molnar <[email protected]> CommitterDate: Tue, 04 Mar 2025 20:18:02 +01:00
x86/smp: Move this_cpu_off to percpu hot section
No functional change.
--- arch/x86/include/asm/percpu.h | 2 +- arch/x86/kernel/setup_percpu.c | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-)
arch/x86/include/asm/percpu.h +1 -1
@@ -586,7 +586,7 @@ do { \#include <asm-generic/percpu.h> /* We can use this directly for local CPU (faster). */ -DECLARE_PER_CPU_READ_MOSTLY(unsigned long, this_cpu_off); +DECLARE_PER_CPU_CACHE_HOT(unsigned long, this_cpu_off);#endif /* !__ASSEMBLY__ */
arch/x86/kernel/setup_percpu.c +1 -1
@@ -26,7 +26,7 @@DEFINE_PER_CPU_CACHE_HOT (int, cpu_number);EXPORT_PER_CPU_SYMBOL (cpu_number); -DEFINE_PER_CPU_READ_MOSTLY(unsigned long, this_cpu_off); +DEFINE_PER_CPU_CACHE_HOT(unsigned long, this_cpu_off);EXPORT_PER_CPU_SYMBOL (this_cpu_off);unsigned long __per_cpu_offset[NR_CPUS ]__ro_after_init ;
[tip: x86/core] x86/smp: Move this_cpu_off to percpu hot section
In reply to Brian GerstThe following commit has been merged into the x86/core branch of tip:
The following commit has been merged into the x86/core branch of tip:
Commit-ID: 06aa03056f90a67ce6e6b78c748801319904215c Gitweb: https://git.kernel.org/tip/06aa03056f90a67ce6e6b78c748801319904215c Author: Brian Gerst <[email protected]> AuthorDate: Mon, 03 Mar 2025 11:52:46 -05:00 Committer: Ingo Molnar <[email protected]> CommitterDate: Tue, 04 Mar 2025 20:30:33 +01:00
x86/smp: Move this_cpu_off to percpu hot section
No functional change.
--- arch/x86/include/asm/percpu.h | 2 +- arch/x86/kernel/setup_percpu.c | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-)
arch/x86/include/asm/percpu.h +1 -1
@@ -586,7 +586,7 @@ do { \#include <asm-generic/percpu.h> /* We can use this directly for local CPU (faster). */ -DECLARE_PER_CPU_READ_MOSTLY(unsigned long, this_cpu_off); +DECLARE_PER_CPU_CACHE_HOT(unsigned long, this_cpu_off);#endif /* !__ASSEMBLY__ */
arch/x86/kernel/setup_percpu.c +1 -1
@@ -26,7 +26,7 @@DEFINE_PER_CPU_CACHE_HOT (int, cpu_number);EXPORT_PER_CPU_SYMBOL (cpu_number); -DEFINE_PER_CPU_READ_MOSTLY(unsigned long, this_cpu_off); +DEFINE_PER_CPU_CACHE_HOT(unsigned long, this_cpu_off);EXPORT_PER_CPU_SYMBOL (this_cpu_off);unsigned long __per_cpu_offset[NR_CPUS ]__ro_after_init ;
Quoted 29 lines · Brian Gerst
Add a new percpu subsection for data that is frequently accessed and exclusive to each processor. This replaces the
pcpu_hotstruct on x86, and is available to all architectures and the core kernel.
ffffffff834f5000D__per_cpu_hot_startffffffff834f5000Dhardirq_stack_ptrffffffff834f5008D__ref_stack_chk_guardffffffff834f5008D__stack_chk_guardffffffff834f5010Dconst_cpu_current_top_of_stackffffffff834f5010Dcpu_current_top_of_stackffffffff834f5018Dconst_current_taskffffffff834f5018Dcurrent_taskffffffff834f5020D__x86_call_depthffffffff834f5028Dthis_cpu_offffffffff834f5030D__preempt_countffffffff834f5034Dcpu_numberffffffff834f5038D__softirq_pendingffffffff834f503aDhardirq_stack_inuseffffffff834f503bD__per_cpu_hot_padffffffff834f5040D__per_cpu_hot_endThis applies to the tip/x86/asm branch.
Changes in v3:
- Fix typo ofCACHE_HOT_DATA()
- Movehardirq_stack_inusetoirq_64.c
- Add__per_cpu_hot_padto show the end of the actual data
Quoted 12 lines
Brian Gerst (11):
percpu: Introduce percpu hot section
x86/percpu: Movepcpu_hotto percpu hot section x86/preempt: Move preempt count to percpu hot section x86/smp: Move cpu number to percpu hot section x86/retbleed: Move call depth to percpu hot section x86/softirq: Movesoftirq_pendingto percpu hot section x86/irq: Move irq stacks to percpu hot section x86/percpu: Movetop_of_stackto percpu hot section x86/percpu: Movecurrent_taskto percpu hot section x86/stackprotector: Move__stack_chk_guardto percpu hot section x86/smp: Movethis_cpu_offto percpu hot section
For the series:
Uros.
Quoted 41 lines · Brian Gerst
Add a new percpu subsection for data that is frequently accessed and exclusive to each processor. This replaces the
pcpu_hotstruct on x86, and is available to all architectures and the core kernel.
ffffffff834f5000D__per_cpu_hot_startffffffff834f5000Dhardirq_stack_ptrffffffff834f5008D__ref_stack_chk_guardffffffff834f5008D__stack_chk_guardffffffff834f5010Dconst_cpu_current_top_of_stackffffffff834f5010Dcpu_current_top_of_stackffffffff834f5018Dconst_current_taskffffffff834f5018Dcurrent_taskffffffff834f5020D__x86_call_depthffffffff834f5028Dthis_cpu_offffffffff834f5030D__preempt_countffffffff834f5034Dcpu_numberffffffff834f5038D__softirq_pendingffffffff834f503aDhardirq_stack_inuseffffffff834f503bD__per_cpu_hot_padffffffff834f5040D__per_cpu_hot_endThis applies to the tip/x86/asm branch.
Changes in v3:
- Fix typo ofCACHE_HOT_DATA()
- Movehardirq_stack_inusetoirq_64.c
- Add__per_cpu_hot_padto show the end of the actual dataBrian Gerst (11):
percpu: Introduce percpu hot section
x86/percpu: Movepcpu_hotto percpu hot section x86/preempt: Move preempt count to percpu hot section x86/smp: Move cpu number to percpu hot section x86/retbleed: Move call depth to percpu hot section x86/softirq: Movesoftirq_pendingto percpu hot section x86/irq: Move irq stacks to percpu hot section x86/percpu: Movetop_of_stackto percpu hot section x86/percpu: Movecurrent_taskto percpu hot section x86/stackprotector: Move__stack_chk_guardto percpu hot section x86/smp: Movethis_cpu_offto percpu hot section
Quoted 1 line
31 files changed, 146 insertions(+), 111 deletions(-)
Yeah, so the result is that on x86-64 allmodconfig we now get:
ld: percpu cache hot section too large
See the relevant .tmp_vmlinux1.map below.
Which is due to:
CONFIG_X86_INTERNODE_CACHE_SHIFT=12
Increasing 'cache alignment' to 4096 bytes:
PERCPU_SECTION(INTERNODE_CACHE_BYTES)
... because of the vSMP muck:
config X86_INTERNODE_CACHE_SHIFT
int
default "12" if X86_VSMP
default X86_L1_CACHE_SHIFTThe workaround would be to use L1_CACHE_BYTES in, but I really dislike what vSMP is doing here.
Anyway, I applied the short-term fix to patch 02/11, but I'm not sure it's the right fix.
Thanks,
Ingo
=====================>
0xffffffff8664f000 . = ALIGN (0x1000)
0xffffffff8664f000 __per_cpu_hot_start = .
*(SORT_BY_ALIGNMENT(.data..percpu..hot.*))
.data..percpu..hot..hardirq_stack_ptr
0xffffffff8664f000 0x8 vmlinux.o
0xffffffff8664f000 hardirq_stack_ptr
.data..percpu..hot..__stack_chk_guard
0xffffffff8664f008 0x8 vmlinux.o
0xffffffff8664f008 __stack_chk_guard
.data..percpu..hot..cpu_current_top_of_stack
0xffffffff8664f010 0x8 vmlinux.o
0xffffffff8664f010 cpu_current_top_of_stack
.data..percpu..hot..current_task
0xffffffff8664f018 0x8 vmlinux.o
0xffffffff8664f018 current_task
.data..percpu..hot..__x86_call_depth
0xffffffff8664f020 0x8 vmlinux.o
0xffffffff8664f020 __x86_call_depth
.data..percpu..hot..this_cpu_off
0xffffffff8664f028 0x8 vmlinux.o
0xffffffff8664f028 this_cpu_off
.data..percpu..hot..__preempt_count
0xffffffff8664f030 0x4 vmlinux.o
0xffffffff8664f030 __preempt_count
.data..percpu..hot..cpu_number
0xffffffff8664f034 0x4 vmlinux.o
0xffffffff8664f034 cpu_number
.data..percpu..hot..__softirq_pending
0xffffffff8664f038 0x2 vmlinux.o
0xffffffff8664f038 __softirq_pending
.data..percpu..hot..hardirq_stack_inuse
0xffffffff8664f03a 0x1 vmlinux.o
0xffffffff8664f03a hardirq_stack_inuse
0xffffffff8664f03b __per_cpu_hot_pad = .
0xffffffff86650000 . = ALIGN (0x1000)
*fill* 0xffffffff8664f03b 0xfc5
0xffffffff86650000 __per_cpu_hot_end = .
*(.data..percpu..read_mostly)
.data..percpu..read_mostly
0xffffffff86650000 0xa30 vmlinux.o=================>
arch/x86/kernel/vmlinux.lds.S | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
arch/x86/kernel/vmlinux.lds.S +1 -1
@@ -330,7 +330,7 @@ SECTIONS EXIT_DATA } - PERCPU_SECTION(INTERNODE_CACHE_BYTES) + PERCPU_SECTION(L1_CACHE_BYTES) ASSERT(__per_cpu_hot_end - __per_cpu_hot_start <= 64, "percpu cache hot section too large") RUNTIME_CONST_VARIABLES
Quoted 131 lines · Ingo Molnar
Quoted 41 lines · Brian Gerst
Add a new percpu subsection for data that is frequently accessed and exclusive to each processor. This replaces the
pcpu_hotstruct on x86, and is available to all architectures and the core kernel.
ffffffff834f5000D__per_cpu_hot_startffffffff834f5000Dhardirq_stack_ptrffffffff834f5008D__ref_stack_chk_guardffffffff834f5008D__stack_chk_guardffffffff834f5010Dconst_cpu_current_top_of_stackffffffff834f5010Dcpu_current_top_of_stackffffffff834f5018Dconst_current_taskffffffff834f5018Dcurrent_taskffffffff834f5020D__x86_call_depthffffffff834f5028Dthis_cpu_offffffffff834f5030D__preempt_countffffffff834f5034Dcpu_numberffffffff834f5038D__softirq_pendingffffffff834f503aDhardirq_stack_inuseffffffff834f503bD__per_cpu_hot_padffffffff834f5040D__per_cpu_hot_endThis applies to the tip/x86/asm branch.
Changes in v3:
- Fix typo ofCACHE_HOT_DATA()
- Movehardirq_stack_inusetoirq_64.c
- Add__per_cpu_hot_padto show the end of the actual dataBrian Gerst (11):
percpu: Introduce percpu hot section
x86/percpu: Movepcpu_hotto percpu hot section x86/preempt: Move preempt count to percpu hot section x86/smp: Move cpu number to percpu hot section x86/retbleed: Move call depth to percpu hot section x86/softirq: Movesoftirq_pendingto percpu hot section x86/irq: Move irq stacks to percpu hot section x86/percpu: Movetop_of_stackto percpu hot section x86/percpu: Movecurrent_taskto percpu hot section x86/stackprotector: Move__stack_chk_guardto percpu hot section x86/smp: Movethis_cpu_offto percpu hot sectionQuoted 1 line
31 files changed, 146 insertions(+), 111 deletions(-)Yeah, so the result is that on x86-64 allmodconfig we now get:
ld: percpu cache hot section too large
See the relevant .tmp_vmlinux1.map below.
Which is due to:
CONFIG_X86_INTERNODE_CACHE_SHIFT=12Increasing 'cache alignment' to 4096 bytes:
PERCPU_SECTION(INTERNODE_CACHE_BYTES)... because of the vSMP muck:
config
X86_INTERNODE_CACHE_SHIFTint default "12" if X86_VSMP default X86_L1_CACHE_SHIFTThe workaround would be to use
L1_CACHE_BYTESin, but I really dislike what vSMP is doing here.Anyway, I applied the short-term fix to patch 02/11, but I'm not sure it's the right fix.
Thanks,
Ingo
=====================>
0xffffffff8664f000 . = ALIGN (0x1000) 0xffffffff8664f000 __per_cpu_hot_start = . *(SORT_BY_ALIGNMENT(.data..percpu..hot.*)) .data..percpu..hot..hardirq_stack_ptr 0xffffffff8664f000 0x8 vmlinux.o 0xffffffff8664f000 hardirq_stack_ptr .data..percpu..hot..__stack_chk_guard 0xffffffff8664f008 0x8 vmlinux.o 0xffffffff8664f008 __stack_chk_guard .data..percpu..hot..cpu_current_top_of_stack 0xffffffff8664f010 0x8 vmlinux.o 0xffffffff8664f010 cpu_current_top_of_stack .data..percpu..hot..current_task 0xffffffff8664f018 0x8 vmlinux.o 0xffffffff8664f018 current_task .data..percpu..hot..__x86_call_depth 0xffffffff8664f020 0x8 vmlinux.o 0xffffffff8664f020 __x86_call_depth .data..percpu..hot..this_cpu_off 0xffffffff8664f028 0x8 vmlinux.o 0xffffffff8664f028 this_cpu_off .data..percpu..hot..__preempt_count 0xffffffff8664f030 0x4 vmlinux.o 0xffffffff8664f030 __preempt_count .data..percpu..hot..cpu_number 0xffffffff8664f034 0x4 vmlinux.o 0xffffffff8664f034 cpu_number .data..percpu..hot..__softirq_pending 0xffffffff8664f038 0x2 vmlinux.o 0xffffffff8664f038 __softirq_pending .data..percpu..hot..hardirq_stack_inuse 0xffffffff8664f03a 0x1 vmlinux.o 0xffffffff8664f03a hardirq_stack_inuse 0xffffffff8664f03b __per_cpu_hot_pad = . 0xffffffff86650000 . = ALIGN (0x1000) *fill* 0xffffffff8664f03b 0xfc5 0xffffffff86650000 __per_cpu_hot_end = . *(.data..percpu..read_mostly) .data..percpu..read_mostly 0xffffffff86650000 0xa30 vmlinux.o=================>
arch/x86/kernel/vmlinux.lds.S | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)arch/x86/kernel/vmlinux.lds.S +0
-0
arch/x86/kernel/vmlinux.lds.S SECTIONS · line 336
Quoted 8 lines
arch/x86/kernel/vmlinux.lds.S +1
-1@@ -330,7 +330,7 @@ SECTIONS EXIT_DATA } - PERCPU_SECTION(INTERNODE_CACHE_BYTES) + PERCPU_SECTION(L1_CACHE_BYTES) ASSERT(__per_cpu_hot_end - __per_cpu_hot_start <= 64, "percpu cache hot section too large") RUNTIME_CONST_VARIABLES
That is probably the right call. The initial percpu section is just used by the boot cpu early and as a template for the dynamically allocated percpu memory, which should account for the proper alignment for NUMA.
Brian Gerst
Quoted 5 lines · Brian Gerst
Quoted 5 lines
arch/x86/kernel/vmlinux.lds.S +1
-1- PERCPU_SECTION(INTERNODE_CACHE_BYTES) + PERCPU_SECTION(L1_CACHE_BYTES) ASSERT(__per_cpu_hot_end - __per_cpu_hot_start <= 64, "percpu cache hot section too large")
Quoted 7 lines
Quoted 2 lines
RUNTIME_CONST_VARIABLESThat is probably the right call. The initial percpu section is just used by the boot cpu early and as a template for the dynamically allocated percpu memory, which should account for the proper alignment for NUMA.
Okay.
Randconfig testing found another corner case with the attached config:
KSYMS .tmp_vmlinux0.kallsyms.S
AS .tmp_vmlinux0.kallsyms.o
LD .tmp_vmlinux1 ld: percpu cache hot section too large
make[2]: *** [scripts/Makefile.vmlinux:77: vmlinux] Error 1
(I haven't figured out the root cause yet.)
Thanks,
Ingo
#
# Automatically generated file; DO NOT EDIT.
# Linux/i386 6.14.0-rc5 Kernel Configuration
#CONFIG_CC_VERSION_TEXT="gcc (Ubuntu 14.2.0-4ubuntu2) 14.2.0" CONFIG_CC_IS_GCC=yCONFIG_GCC_VERSION=140200CONFIG_CLANG_VERSION=0CONFIG_AS_IS_GNU=yCONFIG_AS_VERSION=24301CONFIG_LD_IS_BFD=yCONFIG_LD_VERSION=24301CONFIG_LLD_VERSION=0CONFIG_RUSTC_VERSION=0CONFIG_RUSTC_LLVM_VERSION=0CONFIG_CC_CAN_LINK=yCONFIG_CC_CAN_LINK_STATIC=y CONFIG_CC_HAS_ASM_GOTO_OUTPUT=y CONFIG_CC_HAS_ASM_GOTO_TIED_OUTPUT=y CONFIG_TOOLS_SUPPORT_RELR=y CONFIG_CC_HAS_ASM_INLINE=y CONFIG_CC_HAS_NO_PROFILE_FN_ATTR=y CONFIG_PAHOLE_VERSION=127CONFIG_IRQ_WORK=yCONFIG_BUILDTIME_TABLE_SORT=y CONFIG_THREAD_INFO_IN_TASK=y
#
# General setup
#CONFIG_INIT_ENV_ARG_LIMIT=32
# CONFIG_COMPILE_TEST is not set
# CONFIG_WERROR is not setCONFIG_LOCALVERSION=""
# CONFIG_LOCALVERSION_AUTO is not setCONFIG_BUILD_SALT=""CONFIG_HAVE_KERNEL_GZIP=yCONFIG_HAVE_KERNEL_BZIP2=yCONFIG_HAVE_KERNEL_LZMA=yCONFIG_HAVE_KERNEL_XZ=yCONFIG_HAVE_KERNEL_LZO=yCONFIG_HAVE_KERNEL_LZ4=yCONFIG_HAVE_KERNEL_ZSTD=yCONFIG_KERNEL_GZIP=y
# CONFIG_KERNEL_BZIP2 is not set
# CONFIG_KERNEL_LZMA is not set
# CONFIG_KERNEL_XZ is not set
# CONFIG_KERNEL_LZO is not set
# CONFIG_KERNEL_LZ4 is not set
# CONFIG_KERNEL_ZSTD is not setCONFIG_DEFAULT_INIT=""CONFIG_DEFAULT_HOSTNAME="(none)"CONFIG_SYSVIPC=yCONFIG_SYSVIPC_SYSCTL=y
# CONFIG_WATCH_QUEUE is not set
# CONFIG_CROSS_MEMORY_ATTACH is not setCONFIG_USELIB=yCONFIG_HAVE_ARCH_AUDITSYSCALL=y
#
# IRQ subsystem
#CONFIG_GENERIC_IRQ_PROBE=yCONFIG_GENERIC_IRQ_SHOW=yCONFIG_GENERIC_IRQ_EFFECTIVE_AFF_MASK=yCONFIG_GENERIC_PENDING_IRQ=yCONFIG_GENERIC_IRQ_MIGRATION=yCONFIG_HARDIRQS_SW_RESEND=yCONFIG_IRQ_DOMAIN=yCONFIG_IRQ_SIM=yCONFIG_IRQ_DOMAIN_HIERARCHY=yCONFIG_IRQ_MSI_IOMMU=yCONFIG_GENERIC_IRQ_MATRIX_ALLOCATOR=yCONFIG_GENERIC_IRQ_RESERVATION_MODE=yCONFIG_IRQ_FORCED_THREADING=yCONFIG_SPARSE_IRQ=y
# CONFIG_GENERIC_IRQ_DEBUGFS is not set
# end of IRQ subsystem
CONFIG_CLOCKSOURCE_WATCHDOG=yCONFIG_ARCH_CLOCKSOURCE_INIT=yCONFIG_GENERIC_TIME_VSYSCALL=yCONFIG_GENERIC_CLOCKEVENTS=yCONFIG_GENERIC_CLOCKEVENTS_BROADCAST=yCONFIG_GENERIC_CLOCKEVENTS_BROADCAST_IDLE=yCONFIG_GENERIC_CLOCKEVENTS_MIN_ADJUST=yCONFIG_GENERIC_CMOS_UPDATE=yCONFIG_HAVE_POSIX_CPU_TIMERS_TASK_WORK=yCONFIG_POSIX_CPU_TIMERS_TASK_WORK=y
# CONFIG_TIME_KUNIT_TEST is not setCONFIG_CONTEXT_TRACKING=yCONFIG_CONTEXT_TRACKING_IDLE=y
#
# Timers subsystem
#CONFIG_TICK_ONESHOT=yCONFIG_HZ_PERIODIC=y
# CONFIG_NO_HZ_IDLE is not set
# CONFIG_NO_HZ is not setCONFIG_HIGH_RES_TIMERS=yCONFIG_CLOCKSOURCE_WATCHDOG_MAX_SKEW_US=125
# end of Timers subsystem
CONFIG_BPF=yCONFIG_HAVE_EBPF_JIT=y
#
# BPF subsystem
#CONFIG_BPF_SYSCALL=y
# CONFIG_BPF_JIT is not set
# CONFIG_BPF_UNPRIV_DEFAULT_OFF is not set
# CONFIG_BPF_PRELOAD is not set
# end of BPF subsystem
CONFIG_PREEMPT_BUILD=yCONFIG_ARCH_HAS_PREEMPT_LAZY=yCONFIG_PREEMPT_NONE=y
# CONFIG_PREEMPT_VOLUNTARY is not set
# CONFIG_PREEMPT is not set
# CONFIG_PREEMPT_LAZY is not setCONFIG_PREEMPT_COUNT=yCONFIG_PREEMPTION=yCONFIG_PREEMPT_DYNAMIC=yCONFIG_SCHED_CORE=y
#
# CPU/Task time and stats accounting
#CONFIG_TICK_CPU_ACCOUNTING=y
# CONFIG_IRQ_TIME_ACCOUNTING is not setCONFIG_BSD_PROCESS_ACCT=yCONFIG_BSD_PROCESS_ACCT_V3=y
# CONFIG_PSI is not set
# end of CPU/Task time and stats accounting
CONFIG_CPU_ISOLATION=y
#
# RCU Subsystem
#CONFIG_TREE_RCU=yCONFIG_PREEMPT_RCU=yCONFIG_RCU_EXPERT=yCONFIG_TREE_SRCU=yCONFIG_TASKS_RCU_GENERIC=y
# CONFIG_FORCE_TASKS_RCU is not setCONFIG_NEED_TASKS_RCU=yCONFIG_TASKS_RCU=yCONFIG_FORCE_TASKS_RUDE_RCU=yCONFIG_TASKS_RUDE_RCU=yCONFIG_FORCE_TASKS_TRACE_RCU=yCONFIG_TASKS_TRACE_RCU=yCONFIG_RCU_STALL_COMMON=yCONFIG_RCU_NEED_SEGCBLIST=yCONFIG_RCU_FANOUT=32CONFIG_RCU_FANOUT_LEAF=16CONFIG_RCU_BOOST=yCONFIG_RCU_BOOST_DELAY=500CONFIG_RCU_EXP_KTHREAD=y
# CONFIG_RCU_NOCB_CPU is not setCONFIG_TASKS_TRACE_RCU_READ_MB=yCONFIG_RCU_DOUBLE_CHECK_CB_TIME=y
# end of RCU Subsystem
CONFIG_IKCONFIG=m
# CONFIG_IKCONFIG_PROC is not setCONFIG_IKHEADERS=mCONFIG_LOG_BUF_SHIFT=17CONFIG_LOG_CPU_MAX_BUF_SHIFT=12CONFIG_PRINTK_INDEX=yCONFIG_HAVE_UNSTABLE_SCHED_CLOCK=y
#
# Scheduler features
#
# end of Scheduler features
CONFIG_ARCH_WANT_BATCHED_UNMAP_TLB_FLUSH=y CONFIG_CC_IMPLICIT_FALLTHROUGH="-Wimplicit-fallthrough=5" CONFIG_GCC10_NO_ARRAY_BOUNDS=y CONFIG_CC_NO_ARRAY_BOUNDS=y CONFIG_GCC_NO_STRINGOP_OVERFLOW=y CONFIG_CC_NO_STRINGOP_OVERFLOW=y CONFIG_SLAB_OBJ_EXT=y
# CONFIG_CGROUPS is not setCONFIG_NAMESPACES=yCONFIG_UTS_NS=y
# CONFIG_TIME_NS is not set
# CONFIG_IPC_NS is not setCONFIG_USER_NS=y
# CONFIG_PID_NS is not set
# CONFIG_CHECKPOINT_RESTORE is not set
# CONFIG_SCHED_AUTOGROUP is not set
# CONFIG_RELAY is not set CONFIG_BLK_DEV_INITRD=y CONFIG_INITRAMFS_SOURCE=""
# CONFIG_RD_GZIP is not setCONFIG_RD_BZIP2=y
# CONFIG_RD_LZMA is not setCONFIG_RD_XZ=y
# CONFIG_RD_LZO is not set
# CONFIG_RD_LZ4 is not set
# CONFIG_RD_ZSTD is not setCONFIG_BOOT_CONFIG=y
# CONFIG_BOOT_CONFIG_FORCE is not set CONFIG_BOOT_CONFIG_EMBED=y CONFIG_BOOT_CONFIG_EMBED_FILE=""
# CONFIG_INITRAMFS_PRESERVE_MTIME is not set CONFIG_CC_OPTIMIZE_FOR_PERFORMANCE=y
# CONFIG_CC_OPTIMIZE_FOR_SIZE is not set CONFIG_LD_ORPHAN_WARN=y CONFIG_LD_ORPHAN_WARN_LEVEL="warn" CONFIG_SYSCTL=yCONFIG_HAVE_UID16=y CONFIG_SYSCTL_EXCEPTION_TRACE=y CONFIG_HAVE_PCSPKR_PLATFORM=y
# CONFIG_EXPERT is not setCONFIG_UID16=yCONFIG_MULTIUSER=yCONFIG_SGETMASK_SYSCALL=yCONFIG_SYSFS_SYSCALL=yCONFIG_FHANDLE=yCONFIG_POSIX_TIMERS=yCONFIG_PRINTK=yCONFIG_BUG=yCONFIG_ELF_CORE=yCONFIG_PCSPKR_PLATFORM=yCONFIG_FUTEX=yCONFIG_FUTEX_PI=yCONFIG_EPOLL=yCONFIG_SIGNALFD=yCONFIG_TIMERFD=yCONFIG_EVENTFD=yCONFIG_SHMEM=yCONFIG_AIO=yCONFIG_IO_URING=yCONFIG_ADVISE_SYSCALLS=yCONFIG_MEMBARRIER=yCONFIG_KCMP=yCONFIG_RSEQ=yCONFIG_CACHESTAT_SYSCALL=yCONFIG_KALLSYMS=y
# CONFIG_KALLSYMS_SELFTEST is not set CONFIG_KALLSYMS_ALL=y CONFIG_ARCH_HAS_MEMBARRIER_SYNC_CORE=y CONFIG_HAVE_PERF_EVENTS=y CONFIG_PERF_USE_VMALLOC=y
#
# Kernel Performance Events And Counters
#CONFIG_PERF_EVENTS=yCONFIG_DEBUG_PERF_USE_VMALLOC=y
# end of Kernel Performance Events And Counters
CONFIG_SYSTEM_DATA_VERIFICATION=yCONFIG_PROFILING=yCONFIG_TRACEPOINTS=y
#
# Kexec and crash features
#CONFIG_KEXEC_CORE=yCONFIG_KEXEC=yCONFIG_KEXEC_JUMP=y
# CONFIG_CRASH_DUMP is not set
# end of Kexec and crash features # end of General setup
CONFIG_X86_32=yCONFIG_X86=yCONFIG_INSTRUCTION_DECODER=yCONFIG_OUTPUT_FORMAT="elf32-i386"CONFIG_LOCKDEP_SUPPORT=yCONFIG_STACKTRACE_SUPPORT=yCONFIG_MMU=yCONFIG_ARCH_MMAP_RND_BITS_MIN=8CONFIG_ARCH_MMAP_RND_BITS_MAX=16CONFIG_ARCH_MMAP_RND_COMPAT_BITS_MIN=8CONFIG_ARCH_MMAP_RND_COMPAT_BITS_MAX=16CONFIG_GENERIC_ISA_DMA=yCONFIG_GENERIC_BUG=yCONFIG_ARCH_MAY_HAVE_PC_FDC=yCONFIG_GENERIC_CALIBRATE_DELAY=yCONFIG_ARCH_HAS_CPU_RELAX=yCONFIG_ARCH_HIBERNATION_POSSIBLE=yCONFIG_ARCH_SUSPEND_POSSIBLE=yCONFIG_ARCH_SUPPORTS_UPROBES=yCONFIG_FIX_EARLYCON_MEM=yCONFIG_PGTABLE_LEVELS=3
#
# Processor type and features
#CONFIG_SMP=yCONFIG_X86_MPPARSE=y
# CONFIG_X86_CPU_RESCTRL is not setCONFIG_X86_EXTENDED_PLATFORM=y
# CONFIG_X86_GOLDFISH is not set
# CONFIG_X86_RDC321X is not setCONFIG_X86_SUPPORTS_MEMORY_FAILURE=yCONFIG_X86_32_IRIS=m
# CONFIG_SCHED_OMIT_FRAME_POINTER is not set
# CONFIG_HYPERVISOR_GUEST is not set
# CONFIG_M486SX is not set
# CONFIG_M486 is not set
# CONFIG_M586 is not set
# CONFIG_M586TSC is not set
# CONFIG_M586MMX is not set
# CONFIG_M686 is not set
# CONFIG_MPENTIUMII is not set
# CONFIG_MPENTIUMIII is not set
# CONFIG_MPENTIUMM is not setCONFIG_MPENTIUM4=y
# CONFIG_MK6 is not set
# CONFIG_MK7 is not set
# CONFIG_MCRUSOE is not set
# CONFIG_MEFFICEON is not set
# CONFIG_MWINCHIPC6 is not set
# CONFIG_MWINCHIP3D is not set
# CONFIG_MELAN is not set
# CONFIG_MGEODEGX1 is not set
# CONFIG_MGEODE_LX is not set
# CONFIG_MCYRIXIII is not set
# CONFIG_MVIAC3_2 is not set
# CONFIG_MVIAC7 is not set
# CONFIG_MATOM is not set
# CONFIG_X86_GENERIC is not setCONFIG_X86_INTERNODE_CACHE_SHIFT=7CONFIG_X86_L1_CACHE_SHIFT=7CONFIG_X86_INTEL_USERCOPY=yCONFIG_X86_USE_PPRO_CHECKSUM=yCONFIG_X86_TSC=yCONFIG_X86_HAVE_PAE=yCONFIG_X86_CX8=yCONFIG_X86_CMOV=yCONFIG_X86_MINIMUM_CPU_FAMILY=6CONFIG_X86_DEBUGCTLMSR=yCONFIG_IA32_FEAT_CTL=yCONFIG_X86_VMX_FEATURE_NAMES=yCONFIG_CPU_SUP_INTEL=yCONFIG_CPU_SUP_AMD=yCONFIG_CPU_SUP_HYGON=yCONFIG_CPU_SUP_CENTAUR=yCONFIG_CPU_SUP_TRANSMETA_32=yCONFIG_CPU_SUP_ZHAOXIN=yCONFIG_CPU_SUP_VORTEX_32=yCONFIG_HPET_TIMER=yCONFIG_HPET_EMULATE_RTC=yCONFIG_DMI=yCONFIG_BOOT_VESA_SUPPORT=yCONFIG_NR_CPUS_RANGE_BEGIN=2CONFIG_NR_CPUS_RANGE_END=8CONFIG_NR_CPUS_DEFAULT=8CONFIG_NR_CPUS=8CONFIG_SCHED_CLUSTER=yCONFIG_SCHED_SMT=y
# CONFIG_SCHED_MC is not setCONFIG_X86_LOCAL_APIC=yCONFIG_X86_IO_APIC=yCONFIG_X86_REROUTE_FOR_BROKEN_BOOT_IRQS=yCONFIG_X86_MCE=yCONFIG_X86_MCELOG_LEGACY=yCONFIG_X86_MCE_INTEL=y
# CONFIG_X86_MCE_AMD is not setCONFIG_X86_ANCIENT_MCE=yCONFIG_X86_MCE_THRESHOLD=y
# CONFIG_X86_MCE_INJECT is not set
#
# Performance monitoring
#
# CONFIG_PERF_EVENTS_AMD_POWER is not setCONFIG_PERF_EVENTS_AMD_UNCORE=yCONFIG_PERF_EVENTS_AMD_BRS=y
# end of Performance monitoring
CONFIG_X86_LEGACY_VM86=yCONFIG_VM86=yCONFIG_X86_16BIT=yCONFIG_X86_ESPFIX32=yCONFIG_X86_IOPL_IOPERM=yCONFIG_TOSHIBA=y
# CONFIG_X86_REBOOTFIXUPS is not setCONFIG_MICROCODE=yCONFIG_MICROCODE_INITRD32=y
# CONFIG_MICROCODE_LATE_LOADING is not set
# CONFIG_X86_MSR is not setCONFIG_X86_CPUID=mCONFIG_HIGHMEM4G=y
# CONFIG_VMSPLIT_3G is not set
# CONFIG_VMSPLIT_2G is not setCONFIG_VMSPLIT_1G=yCONFIG_PAGE_OFFSET=0x40000000CONFIG_HIGHMEM=yCONFIG_X86_PAE=y
# CONFIG_X86_CPA_STATISTICS is not setCONFIG_ARCH_FLATMEM_ENABLE=yCONFIG_ARCH_SPARSEMEM_ENABLE=yCONFIG_ARCH_SELECT_MEMORY_MODEL=yCONFIG_ILLEGAL_POINTER_VALUE=0
# CONFIG_X86_CHECK_BIOS_CORRUPTION is not setCONFIG_MTRR=y
# CONFIG_MTRR_SANITIZER is not setCONFIG_X86_PAT=yCONFIG_X86_UMIP=yCONFIG_CC_HAS_IBT=yCONFIG_ARCH_PKEY_BITS=4
# CONFIG_X86_INTEL_TSX_MODE_OFF is not set
# CONFIG_X86_INTEL_TSX_MODE_ON is not setCONFIG_X86_INTEL_TSX_MODE_AUTO=y
# CONFIG_HZ_100 is not setCONFIG_HZ_250=y
# CONFIG_HZ_300 is not set
# CONFIG_HZ_1000 is not setCONFIG_HZ=250CONFIG_SCHED_HRTICK=yCONFIG_ARCH_SUPPORTS_KEXEC=yCONFIG_ARCH_SUPPORTS_KEXEC_PURGATORY=yCONFIG_ARCH_SUPPORTS_KEXEC_SIG=yCONFIG_ARCH_SUPPORTS_KEXEC_SIG_FORCE=yCONFIG_ARCH_SUPPORTS_KEXEC_BZIMAGE_VERIFY_SIG=yCONFIG_ARCH_SUPPORTS_KEXEC_JUMP=yCONFIG_ARCH_SUPPORTS_CRASH_DUMP=yCONFIG_ARCH_DEFAULT_CRASH_DUMP=yCONFIG_ARCH_SUPPORTS_CRASH_HOTPLUG=yCONFIG_PHYSICAL_START=0x1000000CONFIG_RELOCATABLE=y
# CONFIG_RANDOMIZE_BASE is not setCONFIG_X86_NEED_RELOCS=yCONFIG_PHYSICAL_ALIGN=0x200000CONFIG_HOTPLUG_CPU=y
# CONFIG_COMPAT_VDSO is not set
# CONFIG_CMDLINE_BOOL is not setCONFIG_MODIFY_LDT_SYSCALL=y
# CONFIG_STRICT_SIGALTSTACK_SIZE is not setCONFIG_X86_BUS_LOCK_DETECT=y
# end of Processor type and features
CONFIG_CC_HAS_NAMED_AS=y CONFIG_CC_HAS_NAMED_AS_FIXED_SANITIZERS=y CONFIG_USE_X86_SEG_SUPPORT=y CONFIG_CC_HAS_SLS=y CONFIG_CC_HAS_RETURN_THUNK=y CONFIG_CC_HAS_ENTRY_PADDING=y CONFIG_FUNCTION_PADDING_CFI=0 CONFIG_FUNCTION_PADDING_BYTES=4 CONFIG_CPU_MITIGATIONS=y
# CONFIG_MITIGATION_PAGE_TABLE_ISOLATION is not set # CONFIG_MITIGATION_RETPOLINE is not set
# CONFIG_MITIGATION_GDS is not set CONFIG_MITIGATION_RFDS=y CONFIG_MITIGATION_SPECTRE_BHI=y
# CONFIG_MITIGATION_MDS is not set CONFIG_MITIGATION_TAA=y
# CONFIG_MITIGATION_MMIO_STALE_DATA is not set CONFIG_MITIGATION_L1TF=y CONFIG_MITIGATION_RETBLEED=y CONFIG_MITIGATION_SPECTRE_V1=y CONFIG_MITIGATION_SPECTRE_V2=y CONFIG_MITIGATION_SRBDS=y
# CONFIG_MITIGATION_SSB is not set
#
# Power management and ACPI options
#CONFIG_ARCH_HIBERNATION_HEADER=yCONFIG_SUSPEND=yCONFIG_SUSPEND_FREEZER=yCONFIG_HIBERNATE_CALLBACKS=yCONFIG_HIBERNATION=y
# CONFIG_HIBERNATION_SNAPSHOT_DEV is not setCONFIG_HIBERNATION_COMP_LZO=y
# CONFIG_HIBERNATION_COMP_LZ4 is not setCONFIG_HIBERNATION_DEF_COMP="lzo"CONFIG_PM_STD_PARTITION=""CONFIG_PM_SLEEP=yCONFIG_PM_SLEEP_SMP=y
# CONFIG_PM_AUTOSLEEP is not setCONFIG_PM_USERSPACE_AUTOSLEEP=y
# CONFIG_PM_WAKELOCKS is not setCONFIG_PM=yCONFIG_PM_DEBUG=yCONFIG_PM_ADVANCED_DEBUG=yCONFIG_PM_TEST_SUSPEND=yCONFIG_PM_SLEEP_DEBUG=y
# CONFIG_PM_TRACE_RTC is not setCONFIG_WQ_POWER_EFFICIENT_DEFAULT=yCONFIG_ARCH_SUPPORTS_ACPI=y
# CONFIG_ACPI is not setCONFIG_X86_APM_BOOT=yCONFIG_APM=y
# CONFIG_APM_IGNORE_USER_SUSPEND is not setCONFIG_APM_DO_ENABLE=y
# CONFIG_APM_DISPLAY_BLANK is not setCONFIG_APM_ALLOW_INTS=y
#
# CPU Frequency scaling
#
# CONFIG_CPU_FREQ is not set
# end of CPU Frequency scaling
#
# CPU Idle
#
# CONFIG_CPU_IDLE is not set
# end of CPU Idle # end of Power management and ACPI options
#
# Bus options (PCI etc.)
#CONFIG_ISA_DMA_API=yCONFIG_ISA=y
CONFIG_SCx200=m
CONFIG_SCx200HR_TIMER=m
# CONFIG_ALIX is not set
# CONFIG_NET5501 is not set
# CONFIG_GEOS is not set
# end of Bus options (PCI etc.)
#
# Binary Emulations
#CONFIG_COMPAT_32=y
# end of Binary Emulations
CONFIG_HAVE_ATOMIC_IOMAP=y
# CONFIG_VIRTUALIZATION is not setCONFIG_X86_REQUIRED_FEATURE_ALWAYS=yCONFIG_X86_REQUIRED_FEATURE_CX8=yCONFIG_X86_REQUIRED_FEATURE_CMOV=yCONFIG_X86_REQUIRED_FEATURE_FPU=yCONFIG_X86_REQUIRED_FEATURE_PAE=yCONFIG_X86_DISABLED_FEATURE_PCID=yCONFIG_X86_DISABLED_FEATURE_PKU=yCONFIG_X86_DISABLED_FEATURE_OSPKE=yCONFIG_X86_DISABLED_FEATURE_LA57=yCONFIG_X86_DISABLED_FEATURE_PTI=yCONFIG_X86_DISABLED_FEATURE_RETPOLINE=yCONFIG_X86_DISABLED_FEATURE_RETPOLINE_LFENCE=yCONFIG_X86_DISABLED_FEATURE_RETHUNK=yCONFIG_X86_DISABLED_FEATURE_UNRET=yCONFIG_X86_DISABLED_FEATURE_CALL_DEPTH=yCONFIG_X86_DISABLED_FEATURE_LAM=yCONFIG_X86_DISABLED_FEATURE_ENQCMD=yCONFIG_X86_DISABLED_FEATURE_SGX=yCONFIG_X86_DISABLED_FEATURE_XENPV=yCONFIG_X86_DISABLED_FEATURE_TDX_GUEST=yCONFIG_X86_DISABLED_FEATURE_USER_SHSTK=yCONFIG_X86_DISABLED_FEATURE_IBT=yCONFIG_X86_DISABLED_FEATURE_FRED=yCONFIG_X86_DISABLED_FEATURE_SEV_SNP=yCONFIG_AS_AVX512=yCONFIG_AS_SHA1_NI=yCONFIG_AS_SHA256_NI=yCONFIG_AS_TPAUSE=yCONFIG_AS_GFNI=yCONFIG_AS_VAES=yCONFIG_AS_VPCLMULQDQ=yCONFIG_AS_WRUSS=yCONFIG_ARCH_CONFIGURES_CPU_MITIGATIONS=y
#
# General architecture-dependent options
#CONFIG_HOTPLUG_SMT=yCONFIG_HOTPLUG_CORE_SYNC=yCONFIG_HOTPLUG_CORE_SYNC_DEAD=yCONFIG_HOTPLUG_CORE_SYNC_FULL=yCONFIG_HOTPLUG_SPLIT_STARTUP=yCONFIG_GENERIC_ENTRY=y
# CONFIG_KPROBES is not setCONFIG_JUMP_LABEL=y
# CONFIG_STATIC_KEYS_SELFTEST is not setCONFIG_STATIC_CALL_SELFTEST=yCONFIG_HAVE_EFFICIENT_UNALIGNED_ACCESS=yCONFIG_ARCH_USE_BUILTIN_BSWAP=yCONFIG_HAVE_IOREMAP_PROT=yCONFIG_HAVE_KPROBES=yCONFIG_HAVE_KRETPROBES=yCONFIG_HAVE_OPTPROBES=yCONFIG_HAVE_KPROBES_ON_FTRACE=yCONFIG_ARCH_CORRECT_STACKTRACE_ON_KRETPROBE=yCONFIG_HAVE_FUNCTION_ERROR_INJECTION=yCONFIG_HAVE_NMI=yCONFIG_TRACE_IRQFLAGS_SUPPORT=yCONFIG_TRACE_IRQFLAGS_NMI_SUPPORT=yCONFIG_HAVE_ARCH_TRACEHOOK=yCONFIG_HAVE_DMA_CONTIGUOUS=yCONFIG_GENERIC_SMP_IDLE_THREAD=yCONFIG_ARCH_HAS_FORTIFY_SOURCE=yCONFIG_ARCH_HAS_SET_MEMORY=yCONFIG_ARCH_HAS_SET_DIRECT_MAP=yCONFIG_ARCH_HAS_CPU_FINALIZE_INIT=yCONFIG_HAVE_ARCH_THREAD_STRUCT_WHITELIST=yCONFIG_ARCH_WANTS_DYNAMIC_TASK_STRUCT=yCONFIG_ARCH_WANTS_NO_INSTR=yCONFIG_ARCH_32BIT_OFF_T=yCONFIG_HAVE_ASM_MODVERSIONS=yCONFIG_HAVE_REGS_AND_STACK_ACCESS_API=yCONFIG_HAVE_RSEQ=yCONFIG_HAVE_FUNCTION_ARG_ACCESS_API=yCONFIG_HAVE_HW_BREAKPOINT=yCONFIG_HAVE_MIXED_BREAKPOINTS_REGS=yCONFIG_HAVE_USER_RETURN_NOTIFIER=yCONFIG_HAVE_PERF_EVENTS_NMI=yCONFIG_HAVE_HARDLOCKUP_DETECTOR_PERF=yCONFIG_HAVE_PERF_REGS=yCONFIG_HAVE_PERF_USER_STACK_DUMP=yCONFIG_HAVE_ARCH_JUMP_LABEL=yCONFIG_HAVE_ARCH_JUMP_LABEL_RELATIVE=yCONFIG_MMU_GATHER_TABLE_FREE=yCONFIG_MMU_GATHER_RCU_TABLE_FREE=yCONFIG_MMU_GATHER_MERGE_VMAS=yCONFIG_MMU_LAZY_TLB_REFCOUNT=yCONFIG_ARCH_HAVE_NMI_SAFE_CMPXCHG=yCONFIG_ARCH_HAVE_EXTRA_ELF_NOTES=yCONFIG_ARCH_HAS_NMI_SAFE_THIS_CPU_OPS=yCONFIG_HAVE_ALIGNED_STRUCT_PAGE=yCONFIG_HAVE_CMPXCHG_LOCAL=yCONFIG_HAVE_CMPXCHG_DOUBLE=yCONFIG_ARCH_WANT_IPC_PARSE_VERSION=yCONFIG_HAVE_ARCH_SECCOMP=yCONFIG_HAVE_ARCH_SECCOMP_FILTER=y
# CONFIG_SECCOMP is not setCONFIG_HAVE_ARCH_STACKLEAK=yCONFIG_HAVE_STACKPROTECTOR=y
# CONFIG_STACKPROTECTOR is not setCONFIG_ARCH_SUPPORTS_LTO_CLANG=yCONFIG_ARCH_SUPPORTS_LTO_CLANG_THIN=yCONFIG_LTO_NONE=yCONFIG_ARCH_SUPPORTS_AUTOFDO_CLANG=yCONFIG_HAVE_ARCH_WITHIN_STACK_FRAMES=yCONFIG_HAVE_IRQ_TIME_ACCOUNTING=yCONFIG_HAVE_MOVE_PUD=yCONFIG_HAVE_MOVE_PMD=yCONFIG_HAVE_ARCH_TRANSPARENT_HUGEPAGE=yCONFIG_HAVE_ARCH_HUGE_VMAP=yCONFIG_ARCH_WANT_HUGE_PMD_SHARE=yCONFIG_HAVE_MOD_ARCH_SPECIFIC=yCONFIG_MODULES_USE_ELF_REL=yCONFIG_HAVE_SOFTIRQ_ON_OWN_STACK=yCONFIG_SOFTIRQ_ON_OWN_STACK=yCONFIG_ARCH_HAS_ELF_RANDOMIZE=yCONFIG_HAVE_ARCH_MMAP_RND_BITS=yCONFIG_HAVE_EXIT_THREAD=yCONFIG_ARCH_MMAP_RND_BITS=8CONFIG_HAVE_PAGE_SIZE_4KB=yCONFIG_PAGE_SIZE_4KB=yCONFIG_PAGE_SIZE_LESS_THAN_64KB=yCONFIG_PAGE_SIZE_LESS_THAN_256KB=yCONFIG_PAGE_SHIFT=12CONFIG_ISA_BUS_API=yCONFIG_CLONE_BACKWARDS=yCONFIG_OLD_SIGSUSPEND3=yCONFIG_OLD_SIGACTION=y
# CONFIG_COMPAT_32BIT_TIME is not setCONFIG_ARCH_SUPPORTS_RT=yCONFIG_HAVE_ARCH_RANDOMIZE_KSTACK_OFFSET=yCONFIG_RANDOMIZE_KSTACK_OFFSET=yCONFIG_RANDOMIZE_KSTACK_OFFSET_DEFAULT=yCONFIG_ARCH_HAS_STRICT_KERNEL_RWX=yCONFIG_STRICT_KERNEL_RWX=yCONFIG_ARCH_HAS_STRICT_MODULE_RWX=yCONFIG_STRICT_MODULE_RWX=yCONFIG_HAVE_ARCH_PREL32_RELOCATIONS=y
# CONFIG_LOCK_EVENT_COUNTS is not setCONFIG_ARCH_HAS_MEM_ENCRYPT=yCONFIG_HAVE_STATIC_CALL=yCONFIG_HAVE_PREEMPT_DYNAMIC=yCONFIG_HAVE_PREEMPT_DYNAMIC_CALL=yCONFIG_ARCH_WANT_LD_ORPHAN_WARN=yCONFIG_ARCH_SUPPORTS_DEBUG_PAGEALLOC=yCONFIG_ARCH_SPLIT_ARG64=yCONFIG_ARCH_HAS_PARANOID_L1D_FLUSH=yCONFIG_DYNAMIC_SIGFRAME=yCONFIG_ARCH_HAS_HW_PTE_YOUNG=yCONFIG_ARCH_HAS_NONLEAF_PMD_YOUNG=yCONFIG_ARCH_HAS_KERNEL_FPU_SUPPORT=y
#
# GCOV-based kernel profiling
#
# CONFIG_GCOV_KERNEL is not setCONFIG_ARCH_HAS_GCOV_PROFILE_ALL=y
# end of GCOV-based kernel profiling
CONFIG_HAVE_GCC_PLUGINS=yCONFIG_FUNCTION_ALIGNMENT_4B=yCONFIG_FUNCTION_ALIGNMENT=4CONFIG_CC_HAS_MIN_FUNCTION_ALIGNMENT=yCONFIG_CC_HAS_SANE_FUNCTION_ALIGNMENT=y
# end of General architecture-dependent options
CONFIG_RT_MUTEXES=yCONFIG_MODULES=y
# CONFIG_MODULE_DEBUG is not set
# CONFIG_MODULE_FORCE_LOAD is not set
# CONFIG_MODULE_UNLOAD is not set
# CONFIG_MODVERSIONS is not set CONFIG_MODULE_SRCVERSION_ALL=y
# CONFIG_MODULE_SIG is not set
# CONFIG_MODULE_COMPRESS is not set
# CONFIG_MODULE_ALLOW_MISSING_NAMESPACE_IMPORTS is not set CONFIG_MODPROBE_PATH="/sbin/modprobe"
# CONFIG_TRIM_UNUSED_KSYMS is not set CONFIG_MODULES_TREE_LOOKUP=yCONFIG_BLOCK=y
# CONFIG_BLOCK_LEGACY_AUTOLOAD is not set CONFIG_BLK_CGROUP_PUNT_BIO=y
# CONFIG_BLK_DEV_BSGLIB is not set
# CONFIG_BLK_DEV_INTEGRITY is not set CONFIG_BLK_DEV_WRITE_MOUNTED=y
# CONFIG_BLK_DEV_ZONED is not set CONFIG_BLK_WBT=yCONFIG_BLK_WBT_MQ=y
# CONFIG_BLK_DEBUG_FS is not set
# CONFIG_BLK_SED_OPAL is not set CONFIG_BLK_INLINE_ENCRYPTION=y CONFIG_BLK_INLINE_ENCRYPTION_FALLBACK=y
#
# Partition Types
#CONFIG_PARTITION_ADVANCED=y
# CONFIG_ACORN_PARTITION is not setCONFIG_AIX_PARTITION=y
# CONFIG_OSF_PARTITION is not set
# CONFIG_AMIGA_PARTITION is not set
# CONFIG_ATARI_PARTITION is not set
# CONFIG_MAC_PARTITION is not setCONFIG_MSDOS_PARTITION=y
# CONFIG_BSD_DISKLABEL is not setCONFIG_MINIX_SUBPARTITION=yCONFIG_SOLARIS_X86_PARTITION=y
# CONFIG_UNIXWARE_DISKLABEL is not set
# CONFIG_LDM_PARTITION is not set
# CONFIG_SGI_PARTITION is not set
# CONFIG_ULTRIX_PARTITION is not setCONFIG_SUN_PARTITION=y
# CONFIG_KARMA_PARTITION is not setCONFIG_EFI_PARTITION=yCONFIG_SYSV68_PARTITION=y
# CONFIG_CMDLINE_PARTITION is not set
# end of Partition Types
CONFIG_BLK_MQ_VIRTIO=yCONFIG_BLK_PM=y
#
# IO Schedulers
#
# CONFIG_MQ_IOSCHED_DEADLINE is not setCONFIG_MQ_IOSCHED_KYBER=m
# CONFIG_IOSCHED_BFQ is not set
# end of IO Schedulers
CONFIG_ASN1=yCONFIG_UNINLINE_SPIN_UNLOCK=yCONFIG_ARCH_SUPPORTS_ATOMIC_RMW=yCONFIG_MUTEX_SPIN_ON_OWNER=yCONFIG_RWSEM_SPIN_ON_OWNER=yCONFIG_LOCK_SPIN_ON_OWNER=yCONFIG_ARCH_USE_QUEUED_SPINLOCKS=yCONFIG_QUEUED_SPINLOCKS=yCONFIG_ARCH_USE_QUEUED_RWLOCKS=yCONFIG_QUEUED_RWLOCKS=yCONFIG_ARCH_HAS_NON_OVERLAPPING_ADDRESS_SPACE=yCONFIG_ARCH_HAS_SYNC_CORE_BEFORE_USERMODE=yCONFIG_ARCH_HAS_SYSCALL_WRAPPER=yCONFIG_FREEZER=y
#
# Executable file formats
#CONFIG_BINFMT_ELF=yCONFIG_ELFCORE=yCONFIG_CORE_DUMP_DEFAULT_ELF_HEADERS=yCONFIG_BINFMT_SCRIPT=mCONFIG_BINFMT_MISC=yCONFIG_COREDUMP=y
# end of Executable file formats
#
# Memory Management options
#CONFIG_ZPOOL=yCONFIG_SWAP=yCONFIG_ZSWAP=y
# CONFIG_ZSWAP_DEFAULT_ON is not set CONFIG_ZSWAP_SHRINKER_DEFAULT_ON=y
# CONFIG_ZSWAP_COMPRESSOR_DEFAULT_DEFLATE is not set # CONFIG_ZSWAP_COMPRESSOR_DEFAULT_LZO is not set # CONFIG_ZSWAP_COMPRESSOR_DEFAULT_842 is not set CONFIG_ZSWAP_COMPRESSOR_DEFAULT_LZ4=y
# CONFIG_ZSWAP_COMPRESSOR_DEFAULT_LZ4HC is not set # CONFIG_ZSWAP_COMPRESSOR_DEFAULT_ZSTD is not set CONFIG_ZSWAP_COMPRESSOR_DEFAULT="lz4"
# CONFIG_ZSWAP_ZPOOL_DEFAULT_ZBUD is not set
# CONFIG_ZSWAP_ZPOOL_DEFAULT_Z3FOLD_DEPRECATED is not set CONFIG_ZSWAP_ZPOOL_DEFAULT_ZSMALLOC=y CONFIG_ZSWAP_ZPOOL_DEFAULT="zsmalloc" CONFIG_ZBUD=m
# CONFIG_Z3FOLD_DEPRECATED is not set CONFIG_ZSMALLOC=y
# CONFIG_ZSMALLOC_STAT is not set CONFIG_ZSMALLOC_CHAIN_SIZE=8
#
# Slab allocator options
#CONFIG_SLUB=y
# CONFIG_SLAB_MERGE_DEFAULT is not set
# CONFIG_SLAB_FREELIST_RANDOM is not set
# CONFIG_SLAB_FREELIST_HARDENED is not set
# CONFIG_SLAB_BUCKETS is not setCONFIG_SLUB_STATS=yCONFIG_SLUB_CPU_PARTIAL=y
# CONFIG_RANDOM_KMALLOC_CACHES is not set
# end of Slab allocator options
# CONFIG_SHUFFLE_PAGE_ALLOCATOR is not set
# CONFIG_COMPAT_BRK is not setCONFIG_SELECT_MEMORY_MODEL=yCONFIG_FLATMEM_MANUAL=y
# CONFIG_SPARSEMEM_MANUAL is not setCONFIG_FLATMEM=yCONFIG_SPARSEMEM_STATIC=yCONFIG_HAVE_GUP_FAST=yCONFIG_MEMORY_ISOLATION=yCONFIG_EXCLUSIVE_SYSTEM_RAM=yCONFIG_ARCH_MHP_MEMMAP_ON_MEMORY_ENABLE=yCONFIG_SPLIT_PTE_PTLOCKS=yCONFIG_ARCH_ENABLE_SPLIT_PMD_PTLOCK=yCONFIG_SPLIT_PMD_PTLOCKS=yCONFIG_MEMORY_BALLOON=y
# CONFIG_COMPACTION is not setCONFIG_PAGE_REPORTING=yCONFIG_MIGRATION=yCONFIG_CONTIG_ALLOC=yCONFIG_PCP_BATCH_SCALE_MAX=5CONFIG_PHYS_ADDR_T_64BIT=y
# CONFIG_BOUNCE is not setCONFIG_KSM=yCONFIG_DEFAULT_MMAP_MIN_ADDR=4096CONFIG_ARCH_SUPPORTS_MEMORY_FAILURE=yCONFIG_MEMORY_FAILURE=y
# CONFIG_HWPOISON_INJECT is not setCONFIG_ARCH_WANT_GENERAL_HUGETLB=y
# CONFIG_TRANSPARENT_HUGEPAGE is not setCONFIG_NEED_PER_CPU_EMBED_FIRST_CHUNK=yCONFIG_NEED_PER_CPU_PAGE_FIRST_CHUNK=yCONFIG_HAVE_SETUP_PER_CPU_AREA=yCONFIG_CMA=yCONFIG_CMA_DEBUGFS=y
# CONFIG_CMA_SYSFS is not setCONFIG_CMA_AREAS=8CONFIG_GENERIC_EARLY_IOREMAP=y
# CONFIG_IDLE_PAGE_TRACKING is not setCONFIG_ARCH_HAS_CACHE_LINE_SIZE=yCONFIG_ARCH_HAS_CURRENT_STACK_POINTER=yCONFIG_ZONE_DMA=yCONFIG_GET_FREE_REGION=yCONFIG_ARCH_USES_PG_ARCH_2=yCONFIG_VM_EVENT_COUNTERS=yCONFIG_PERCPU_STATS=yCONFIG_GUP_TEST=yCONFIG_GUP_GET_PXX_LOW_HIGH=y
# CONFIG_DMAPOOL_TEST is not setCONFIG_ARCH_HAS_PTE_SPECIAL=yCONFIG_KMAP_LOCAL=yCONFIG_MEMFD_CREATE=yCONFIG_SECRETMEM=yCONFIG_ANON_VMA_NAME=yCONFIG_USERFAULTFD=yCONFIG_LRU_GEN=y
# CONFIG_LRU_GEN_ENABLED is not set
# CONFIG_LRU_GEN_STATS is not setCONFIG_LRU_GEN_WALKS_MMU=yCONFIG_LOCK_MM_AND_FIND_VMA=yCONFIG_EXECMEM=y
#
# Data Access Monitoring
#
# CONFIG_DAMON is not set
# end of Data Access Monitoring # end of Memory Management options
# CONFIG_NET is not set
#
# Device Drivers
#CONFIG_HAVE_EISA=yCONFIG_EISA=y
# CONFIG_EISA_VLB_PRIMING is not set
# CONFIG_EISA_VIRTUAL_ROOT is not setCONFIG_EISA_NAMES=yCONFIG_HAVE_PCI=yCONFIG_GENERIC_PCI_IOMAP=y
# CONFIG_PCI is not setCONFIG_PCCARD=yCONFIG_PCMCIA=y
# CONFIG_PCMCIA_LOAD_CIS is not set
#
# PC-card bridges
#CONFIG_I82365=y
# CONFIG_TCIC is not setCONFIG_PCMCIA_PROBE=yCONFIG_PCCARD_NONSTATIC=y
#
# Generic Driver Options
#CONFIG_AUXILIARY_BUS=y
# CONFIG_UEVENT_HELPER is not setCONFIG_DEVTMPFS=y
# CONFIG_DEVTMPFS_MOUNT is not set
# CONFIG_DEVTMPFS_SAFE is not set
# CONFIG_STANDALONE is not setCONFIG_PREVENT_FIRMWARE_BUILD=y
#
# Firmware loader
#CONFIG_FW_LOADER=y
# CONFIG_FW_LOADER_DEBUG is not setCONFIG_FW_LOADER_PAGED_BUF=yCONFIG_FW_LOADER_SYSFS=yCONFIG_EXTRA_FIRMWARE=""CONFIG_FW_LOADER_USER_HELPER=yCONFIG_FW_LOADER_USER_HELPER_FALLBACK=y
# CONFIG_FW_LOADER_COMPRESS is not set
# CONFIG_FW_CACHE is not setCONFIG_FW_UPLOAD=y
# end of Firmware loader
CONFIG_WANT_DEV_COREDUMP=yCONFIG_ALLOW_DEV_COREDUMP=yCONFIG_DEV_COREDUMP=yCONFIG_DEBUG_DRIVER=y
# CONFIG_DEBUG_DEVRES is not setCONFIG_DEBUG_TEST_DRIVER_REMOVE=y
# CONFIG_TEST_ASYNC_DRIVER_PROBE is not set
# CONFIG_DM_KUNIT_TEST is not setCONFIG_DRIVER_PE_KUNIT_TEST=mCONFIG_GENERIC_CPU_DEVICES=yCONFIG_GENERIC_CPU_AUTOPROBE=yCONFIG_GENERIC_CPU_VULNERABILITIES=yCONFIG_REGMAP=yCONFIG_REGMAP_KUNIT=mCONFIG_REGMAP_BUILD=yCONFIG_REGMAP_I2C=yCONFIG_REGMAP_W1=yCONFIG_REGMAP_MMIO=yCONFIG_REGMAP_IRQ=yCONFIG_REGMAP_RAM=mCONFIG_REGMAP_SCCB=mCONFIG_DMA_SHARED_BUFFER=yCONFIG_DMA_FENCE_TRACE=yCONFIG_FW_DEVLINK_SYNC_STATE_TIMEOUT=y
# end of Generic Driver Options
#
# Bus devices
#
# CONFIG_MHI_BUS is not setCONFIG_MHI_BUS_EP=m
# end of Bus devices
#
# Cache Drivers
#
# end of Cache Drivers
#
# Firmware Drivers
#
#
# ARM System Control and Management Interface Protocol #
# end of ARM System Control and Management Interface Protocol
CONFIG_EDD=m
# CONFIG_EDD_OFF is not setCONFIG_FIRMWARE_MEMMAP=y
# CONFIG_DMIID is not setCONFIG_DMI_SYSFS=yCONFIG_DMI_SCAN_MACHINE_NON_EFI_FALLBACK=yCONFIG_FW_CFG_SYSFS=y
# CONFIG_FW_CFG_SYSFS_CMDLINE is not setCONFIG_SYSFB=yCONFIG_SYSFB_SIMPLEFB=yCONFIG_FW_CS_DSP=m
# CONFIG_FW_CS_DSP_KUNIT_TEST is not set
# CONFIG_GOOGLE_FIRMWARE is not set
#
# Qualcomm firmware drivers
#
# end of Qualcomm firmware drivers
#
# Tegra firmware driver
#
# end of Tegra firmware driver # end of Firmware Drivers
# CONFIG_GNSS is not setCONFIG_MTD=yCONFIG_MTD_TESTS=m
#
# Partition parsers
#
# CONFIG_MTD_CMDLINE_PARTS is not set
# CONFIG_MTD_REDBOOT_PARTS is not set
# end of Partition parsers
#
# User Modules And Translation Layers
#CONFIG_MTD_BLKDEVS=yCONFIG_MTD_BLOCK=mCONFIG_MTD_BLOCK_RO=y
#
# Note that in some cases UBI block is preferred. See MTD_UBI_BLOCK. #CONFIG_FTL=yCONFIG_NFTL=y
# CONFIG_NFTL_RW is not set
# CONFIG_INFTL is not setCONFIG_RFD_FTL=yCONFIG_SSFDC=m
# CONFIG_SM_FTL is not set
# CONFIG_MTD_OOPS is not setCONFIG_MTD_SWAP=mCONFIG_MTD_PARTITIONED_MASTER=y
#
# RAM/ROM/Flash chip drivers
#CONFIG_MTD_CFI=yCONFIG_MTD_JEDECPROBE=mCONFIG_MTD_GEN_PROBE=yCONFIG_MTD_CFI_ADV_OPTIONS=y
# CONFIG_MTD_CFI_NOSWAP is not setCONFIG_MTD_CFI_BE_BYTE_SWAP=y
# CONFIG_MTD_CFI_LE_BYTE_SWAP is not setCONFIG_MTD_CFI_GEOMETRY=yCONFIG_MTD_MAP_BANK_WIDTH_1=yCONFIG_MTD_MAP_BANK_WIDTH_2=yCONFIG_MTD_MAP_BANK_WIDTH_4=y
# CONFIG_MTD_MAP_BANK_WIDTH_8 is not set
# CONFIG_MTD_MAP_BANK_WIDTH_16 is not set
# CONFIG_MTD_MAP_BANK_WIDTH_32 is not set
# CONFIG_MTD_CFI_I1 is not set
# CONFIG_MTD_CFI_I2 is not setCONFIG_MTD_CFI_I4=y
# CONFIG_MTD_CFI_I8 is not set
# CONFIG_MTD_OTP is not setCONFIG_MTD_CFI_INTELEXT=yCONFIG_MTD_CFI_AMDSTD=yCONFIG_MTD_CFI_STAA=mCONFIG_MTD_CFI_UTIL=yCONFIG_MTD_RAM=yCONFIG_MTD_ROM=yCONFIG_MTD_ABSENT=y
# end of RAM/ROM/Flash chip drivers
#
# Mapping drivers for chip access
#CONFIG_MTD_COMPLEX_MAPPINGS=yCONFIG_MTD_PHYSMAP=yCONFIG_MTD_PHYSMAP_COMPAT=yCONFIG_MTD_PHYSMAP_START=0x8000000CONFIG_MTD_PHYSMAP_LEN=0CONFIG_MTD_PHYSMAP_BANKWIDTH=2
# CONFIG_MTD_PHYSMAP_GPIO_ADDR is not setCONFIG_MTD_SBC_GXX=y
# CONFIG_MTD_SCx200_DOCFLASH is not setCONFIG_MTD_AMD76XROM=mCONFIG_MTD_ICHXROM=m
# CONFIG_MTD_NETtel is not setCONFIG_MTD_L440GX=mCONFIG_MTD_PCMCIA=y
# CONFIG_MTD_PCMCIA_ANONYMOUS is not set
# CONFIG_MTD_PLATRAM is not set
# end of Mapping drivers for chip access
#
# Self-contained MTD device drivers
#
# CONFIG_MTD_SLRAM is not setCONFIG_MTD_PHRAM=mCONFIG_MTD_MTDRAM=yCONFIG_MTDRAM_TOTAL_SIZE=4096CONFIG_MTDRAM_ERASE_SIZE=128CONFIG_MTD_BLOCK2MTD=y
#
# Disk-On-Chip Device Drivers
#CONFIG_MTD_DOCG3=yCONFIG_BCH_CONST_M=14CONFIG_BCH_CONST_T=4
# end of Self-contained MTD device drivers
#
# NAND
#CONFIG_MTD_NAND_CORE=yCONFIG_MTD_ONENAND=m
# CONFIG_MTD_ONENAND_VERIFY_WRITE is not set
# CONFIG_MTD_ONENAND_GENERIC is not setCONFIG_MTD_ONENAND_OTP=y
# CONFIG_MTD_ONENAND_2X_PROGRAM is not setCONFIG_MTD_RAW_NAND=y
#
# Raw/parallel NAND flash controllers
#CONFIG_MTD_NAND_CS553X=yCONFIG_MTD_NAND_MXIC=mCONFIG_MTD_NAND_GPIO=mCONFIG_MTD_NAND_PLATFORM=yCONFIG_MTD_NAND_ARASAN=y
#
# Misc
#CONFIG_MTD_NAND_NANDSIM=m
# CONFIG_MTD_NAND_DISKONCHIP is not set
#
# ECC engine support
#CONFIG_MTD_NAND_ECC=yCONFIG_MTD_NAND_ECC_SW_HAMMING=y
# CONFIG_MTD_NAND_ECC_SW_HAMMING_SMC is not setCONFIG_MTD_NAND_ECC_SW_BCH=yCONFIG_MTD_NAND_ECC_MXIC=y
# end of ECC engine support # end of NAND
#
# LPDDR & LPDDR2 PCM memory drivers
#CONFIG_MTD_LPDDR=yCONFIG_MTD_QINFO_PROBE=y
# end of LPDDR & LPDDR2 PCM memory drivers
# CONFIG_MTD_UBI is not setCONFIG_MTD_HYPERBUS=y
# CONFIG_OF is not setCONFIG_ARCH_MIGHT_HAVE_PC_PARPORT=yCONFIG_PARPORT=y
# CONFIG_PARPORT_PC is not setCONFIG_PARPORT_1284=yCONFIG_PARPORT_NOT_PC=yCONFIG_PNP=yCONFIG_PNP_DEBUG_MESSAGES=y
#
# Protocols
#CONFIG_ISAPNP=y
# CONFIG_PNPBIOS is not set
# CONFIG_BLK_DEV is not set
#
# NVME Support
#CONFIG_NVME_AUTH=mCONFIG_NVME_CORE=mCONFIG_NVME_MULTIPATH=yCONFIG_NVME_VERBOSE_ERRORS=yCONFIG_NVME_FABRICS=m
# CONFIG_NVME_FC is not setCONFIG_NVME_HOST_AUTH=yCONFIG_NVME_TARGET=m
# CONFIG_NVME_TARGET_DEBUGFS is not setCONFIG_NVME_TARGET_PASSTHRU=yCONFIG_NVME_TARGET_LOOP=mCONFIG_NVME_TARGET_FC=m
# CONFIG_NVME_TARGET_AUTH is not set
# end of NVME Support
#
# Misc devices
#CONFIG_AD525X_DPOT=m
# CONFIG_AD525X_DPOT_I2C is not setCONFIG_DUMMY_IRQ=yCONFIG_RPMB=mCONFIG_ICS932S401=y
# CONFIG_ENCLOSURE_SERVICES is not set
# CONFIG_SMPRO_ERRMON is not setCONFIG_SMPRO_MISC=m
# CONFIG_APDS9802ALS is not setCONFIG_ISL29003=y
# CONFIG_ISL29020 is not setCONFIG_SENSORS_TSL2550=mCONFIG_SENSORS_BH1770=yCONFIG_SENSORS_APDS990X=y
# CONFIG_HMC6352 is not setCONFIG_DS1682=yCONFIG_SRAM=y
# CONFIG_XILINX_SDFEC is not setCONFIG_MISC_RTSX=yCONFIG_NTSYNC=yCONFIG_TPS6594_ESM=mCONFIG_TPS6594_PFSM=mCONFIG_NSM=m
# CONFIG_C2PORT is not set
#
# EEPROM support
#CONFIG_EEPROM_AT24=yCONFIG_EEPROM_MAX6875=mCONFIG_EEPROM_93CX6=m
# CONFIG_EEPROM_IDT_89HPESX is not setCONFIG_EEPROM_EE1004=y
# end of EEPROM support
# CONFIG_SENSORS_LIS3_I2C is not setCONFIG_ALTERA_STAPL=mCONFIG_ECHO=yCONFIG_MISC_RTSX_USB=yCONFIG_UACCE=yCONFIG_PVPANIC=y
# end of Misc devices
#
# SCSI device support
#CONFIG_SCSI_MOD=yCONFIG_RAID_ATTRS=y
# CONFIG_SCSI is not setCONFIG_SCSI_LIB_KUNIT_TEST=m
# end of SCSI device support
# CONFIG_ATA is not set
# CONFIG_MD is not set
# CONFIG_TARGET_CORE is not setCONFIG_MACINTOSH_DRIVERS=yCONFIG_MAC_EMUMOUSEBTN=m
#
# Input device support
#CONFIG_INPUT=y
# CONFIG_INPUT_LEDS is not setCONFIG_INPUT_FF_MEMLESS=yCONFIG_INPUT_SPARSEKMAP=y
# CONFIG_INPUT_MATRIXKMAP is not set
#
# Userland interfaces
#CONFIG_INPUT_MOUSEDEV=mCONFIG_INPUT_MOUSEDEV_PSAUX=yCONFIG_INPUT_MOUSEDEV_SCREEN_X=1024CONFIG_INPUT_MOUSEDEV_SCREEN_Y=768CONFIG_INPUT_JOYDEV=m
# CONFIG_INPUT_EVDEV is not setCONFIG_INPUT_KUNIT_TEST=m
#
# Input Device Drivers
#
# CONFIG_INPUT_KEYBOARD is not setCONFIG_INPUT_MOUSE=yCONFIG_MOUSE_PS2=mCONFIG_MOUSE_PS2_ALPS=yCONFIG_MOUSE_PS2_BYD=yCONFIG_MOUSE_PS2_LOGIPS2PP=yCONFIG_MOUSE_PS2_SYNAPTICS=yCONFIG_MOUSE_PS2_SYNAPTICS_SMBUS=yCONFIG_MOUSE_PS2_CYPRESS=yCONFIG_MOUSE_PS2_LIFEBOOK=yCONFIG_MOUSE_PS2_TRACKPOINT=yCONFIG_MOUSE_PS2_ELANTECH=yCONFIG_MOUSE_PS2_ELANTECH_SMBUS=yCONFIG_MOUSE_PS2_SENTELIC=y
# CONFIG_MOUSE_PS2_TOUCHKIT is not setCONFIG_MOUSE_PS2_FOCALTECH=yCONFIG_MOUSE_PS2_SMBUS=yCONFIG_MOUSE_SERIAL=mCONFIG_MOUSE_APPLETOUCH=mCONFIG_MOUSE_BCM5974=mCONFIG_MOUSE_CYAPA=mCONFIG_MOUSE_ELAN_I2C=m
# CONFIG_MOUSE_ELAN_I2C_I2C is not setCONFIG_MOUSE_ELAN_I2C_SMBUS=yCONFIG_MOUSE_INPORT=m
# CONFIG_MOUSE_ATIXL is not setCONFIG_MOUSE_LOGIBM=yCONFIG_MOUSE_PC110PAD=yCONFIG_MOUSE_VSXXXAA=yCONFIG_MOUSE_GPIO=yCONFIG_MOUSE_SYNAPTICS_I2C=yCONFIG_MOUSE_SYNAPTICS_USB=m
# CONFIG_INPUT_JOYSTICK is not setCONFIG_INPUT_TABLET=yCONFIG_TABLET_USB_ACECAD=m
# CONFIG_TABLET_USB_AIPTEK is not setCONFIG_TABLET_USB_HANWANG=y
# CONFIG_TABLET_USB_KBTAB is not setCONFIG_TABLET_USB_PEGASUS=m
# CONFIG_TABLET_SERIAL_WACOM4 is not set
# CONFIG_INPUT_TOUCHSCREEN is not set
# CONFIG_INPUT_MISC is not setCONFIG_RMI4_CORE=mCONFIG_RMI4_I2C=mCONFIG_RMI4_SMB=m
# CONFIG_RMI4_F03 is not setCONFIG_RMI4_2D_SENSOR=yCONFIG_RMI4_F11=y
# CONFIG_RMI4_F12 is not setCONFIG_RMI4_F30=yCONFIG_RMI4_F34=yCONFIG_RMI4_F3A=yCONFIG_RMI4_F54=yCONFIG_RMI4_F55=y
#
# Hardware I/O ports
#CONFIG_SERIO=yCONFIG_ARCH_MIGHT_HAVE_PC_SERIO=yCONFIG_SERIO_I8042=mCONFIG_SERIO_SERPORT=m
# CONFIG_SERIO_CT82C710 is not setCONFIG_SERIO_PARKBD=mCONFIG_SERIO_LIBPS2=mCONFIG_SERIO_RAW=mCONFIG_SERIO_ALTERA_PS2=mCONFIG_SERIO_PS2MULT=y
# CONFIG_SERIO_ARC_PS2 is not set
# CONFIG_SERIO_GPIO_PS2 is not setCONFIG_USERIO=mCONFIG_GAMEPORT=y
# CONFIG_GAMEPORT_NS558 is not setCONFIG_GAMEPORT_L4=y
# end of Hardware I/O ports # end of Input device support
#
# Character devices
#CONFIG_TTY=yCONFIG_VT=yCONFIG_CONSOLE_TRANSLATIONS=yCONFIG_VT_CONSOLE=yCONFIG_VT_CONSOLE_SLEEP=yCONFIG_VT_HW_CONSOLE_BINDING=yCONFIG_UNIX98_PTYS=yCONFIG_LEGACY_PTYS=yCONFIG_LEGACY_PTY_COUNT=256
# CONFIG_LEGACY_TIOCSTI is not setCONFIG_LDISC_AUTOLOAD=y
#
# Serial drivers
#CONFIG_SERIAL_EARLYCON=yCONFIG_SERIAL_8250=mCONFIG_SERIAL_8250_DEPRECATED_OPTIONS=yCONFIG_SERIAL_8250_PNP=yCONFIG_SERIAL_8250_16550A_VARIANTS=y
# CONFIG_SERIAL_8250_FINTEK is not setCONFIG_SERIAL_8250_DMA=y
# CONFIG_SERIAL_8250_CS is not setCONFIG_SERIAL_8250_MEN_MCB=mCONFIG_SERIAL_8250_NR_UARTS=4CONFIG_SERIAL_8250_RUNTIME_UARTS=4
# CONFIG_SERIAL_8250_EXTENDED is not setCONFIG_SERIAL_8250_DWLIB=yCONFIG_SERIAL_8250_DW=m
# CONFIG_SERIAL_8250_RT288X is not set
#
# Non-8250 serial port support
#
# CONFIG_SERIAL_UARTLITE is not setCONFIG_SERIAL_CORE=yCONFIG_SERIAL_CORE_CONSOLE=yCONFIG_SERIAL_LANTIQ=yCONFIG_SERIAL_LANTIQ_CONSOLE=yCONFIG_SERIAL_SCCNXP=mCONFIG_SERIAL_SC16IS7XX=mCONFIG_SERIAL_SC16IS7XX_I2C=mCONFIG_SERIAL_TIMBERDALE=mCONFIG_SERIAL_ALTERA_JTAGUART=m
# CONFIG_SERIAL_ALTERA_UART is not setCONFIG_SERIAL_ARC=mCONFIG_SERIAL_ARC_NR_PORTS=1
# CONFIG_SERIAL_FSL_LPUART is not set
# CONFIG_SERIAL_FSL_LINFLEXUART is not setCONFIG_SERIAL_MEN_Z135=m
# end of Serial drivers
CONFIG_SERIAL_MCTRL_GPIO=m
# CONFIG_SERIAL_NONSTANDARD is not set
# CONFIG_NULL_TTY is not setCONFIG_HVC_DRIVER=yCONFIG_RPMSG_TTY=mCONFIG_SERIAL_DEV_BUS=y
# CONFIG_SERIAL_DEV_CTRL_TTYPORT is not set
# CONFIG_PRINTER is not set
# CONFIG_PPDEV is not setCONFIG_VIRTIO_CONSOLE=yCONFIG_IPMI_HANDLER=yCONFIG_IPMI_DMI_DECODE=yCONFIG_IPMI_PLAT_DATA=yCONFIG_IPMI_PANIC_EVENT=yCONFIG_IPMI_PANIC_STRING=y
# CONFIG_IPMI_DEVICE_INTERFACE is not set
# CONFIG_IPMI_SI is not setCONFIG_IPMI_SSIF=mCONFIG_IPMI_IPMB=y
# CONFIG_IPMI_WATCHDOG is not setCONFIG_IPMI_POWEROFF=y
# CONFIG_SSIF_IPMI_BMC is not set
# CONFIG_IPMB_DEVICE_INTERFACE is not setCONFIG_HW_RANDOM=mCONFIG_HW_RANDOM_TIMERIOMEM=m
# CONFIG_HW_RANDOM_BA431 is not setCONFIG_HW_RANDOM_VIA=m
# CONFIG_HW_RANDOM_VIRTIO is not setCONFIG_HW_RANDOM_XIPHERA=mCONFIG_DTLK=mCONFIG_MWAVE=m
CONFIG_SCx200_GPIO=m
# CONFIG_PC8736x_GPIO is not setCONFIG_NSC_GPIO=m
# CONFIG_DEVMEM is not setCONFIG_NVRAM=yCONFIG_DEVPORT=y
# CONFIG_HANGCHECK_TIMER is not setCONFIG_TCG_TPM=m
# CONFIG_TCG_TPM2_HMAC is not set
# CONFIG_HW_RANDOM_TPM is not setCONFIG_TCG_TIS_CORE=m
# CONFIG_TCG_TIS is not setCONFIG_TCG_TIS_I2C=mCONFIG_TCG_TIS_I2C_CR50=mCONFIG_TCG_TIS_I2C_ATMEL=m
# CONFIG_TCG_TIS_I2C_INFINEON is not set
# CONFIG_TCG_TIS_I2C_NUVOTON is not set
# CONFIG_TCG_NSC is not setCONFIG_TCG_ATMEL=mCONFIG_TCG_INFINEON=m
# CONFIG_TCG_VTPM_PROXY is not setCONFIG_TCG_TIS_ST33ZP24=mCONFIG_TCG_TIS_ST33ZP24_I2C=mCONFIG_TELCLOCK=y
# CONFIG_XILLYUSB is not set
# end of Character devices
#
# I2C support
#CONFIG_I2C=yCONFIG_I2C_BOARDINFO=yCONFIG_I2C_CHARDEV=y
# CONFIG_I2C_MUX is not set
# CONFIG_I2C_HELPER_AUTO is not setCONFIG_I2C_SMBUS=m
#
# I2C Algorithms
#CONFIG_I2C_ALGOBIT=m
# CONFIG_I2C_ALGOPCF is not setCONFIG_I2C_ALGOPCA=m
# end of I2C Algorithms
#
# I2C Hardware Bus support
#
#
# I2C system bus drivers (mostly embedded / system-on-chip) #CONFIG_I2C_CBUS_GPIO=yCONFIG_I2C_CGBC=m
# CONFIG_I2C_DESIGNWARE_CORE is not set
# CONFIG_I2C_GPIO is not setCONFIG_I2C_OCORES=y
# CONFIG_I2C_PCA_PLATFORM is not set CONFIG_I2C_SIMTEC=mCONFIG_I2C_XILINX=y
#
# External I2C/SMBus adapter drivers
#CONFIG_I2C_DIOLAN_U2C=m
# CONFIG_I2C_CP2615 is not setCONFIG_I2C_PARPORT=mCONFIG_I2C_ROBOTFUZZ_OSIF=yCONFIG_I2C_TAOS_EVM=m
# CONFIG_I2C_TINY_USB is not set
#
# Other I2C/SMBus bus drivers
#CONFIG_I2C_PCA_ISA=mCONFIG_I2C_CROS_EC_TUNNEL=mCONFIG_I2C_VIRTIO=y
# end of I2C Hardware Bus support
CONFIG_I2C_STUB=mCONFIG_I2C_SLAVE=yCONFIG_I2C_SLAVE_EEPROM=yCONFIG_I2C_SLAVE_TESTUNIT=yCONFIG_I2C_DEBUG_CORE=y
# CONFIG_I2C_DEBUG_ALGO is not set
# CONFIG_I2C_DEBUG_BUS is not set
# end of I2C support
CONFIG_I3C=y
# CONFIG_CDNS_I3C_MASTER is not setCONFIG_DW_I3C_MASTER=mCONFIG_SVC_I3C_MASTER=m
# CONFIG_MIPI_I3C_HCI is not set
# CONFIG_SPI is not set
# CONFIG_SPMI is not setCONFIG_HSI=mCONFIG_HSI_BOARDINFO=y
#
# HSI controllers
#
#
# HSI clients
#
# CONFIG_HSI_CHAR is not setCONFIG_PPS=yCONFIG_PPS_DEBUG=y
# CONFIG_NTP_PPS is not set
#
# PPS clients support
#
# CONFIG_PPS_CLIENT_KTIMER is not setCONFIG_PPS_CLIENT_LDISC=mCONFIG_PPS_CLIENT_PARPORT=m
# CONFIG_PPS_CLIENT_GPIO is not set
# CONFIG_PPS_GENERATOR is not set
#
# PTP clock support
#CONFIG_PTP_1588_CLOCK_OPTIONAL=y
#
# Enable PHYLIB and NETWORK_PHY_TIMESTAMPING to see the additional clocks. #
# end of PTP clock support
CONFIG_PINCTRL=yCONFIG_PINMUX=yCONFIG_PINCONF=yCONFIG_GENERIC_PINCONF=y
# CONFIG_DEBUG_PINCTRL is not setCONFIG_PINCTRL_CY8C95X0=yCONFIG_PINCTRL_DA9062=m
# CONFIG_PINCTRL_MCP23S08 is not set
# CONFIG_PINCTRL_SX150X is not setCONFIG_PINCTRL_CS42L43=m
#
# Renesas pinctrl drivers
#
# end of Renesas pinctrl drivers
CONFIG_GPIOLIB=yCONFIG_GPIOLIB_FASTPATH_LIMIT=512CONFIG_GPIOLIB_IRQCHIP=yCONFIG_DEBUG_GPIO=yCONFIG_GPIO_CDEV=y
# CONFIG_GPIO_CDEV_V1 is not setCONFIG_GPIO_GENERIC=yCONFIG_GPIO_REGMAP=mCONFIG_GPIO_MAX730X=y
#
# Memory mapped GPIO drivers
#
# CONFIG_GPIO_ALTERA is not set
# CONFIG_GPIO_DWAPB is not setCONFIG_GPIO_GENERIC_PLATFORM=mCONFIG_GPIO_GRANITERAPIDS=yCONFIG_GPIO_MB86S7X=yCONFIG_GPIO_MENZ127=y
# CONFIG_GPIO_POLARFIRE_SOC is not setCONFIG_GPIO_SIOX=m
# CONFIG_GPIO_XILINX is not setCONFIG_GPIO_AMD_FCH=y
# end of Memory mapped GPIO drivers
#
# Port-mapped I/O GPIO drivers
#
# CONFIG_GPIO_F7188X is not setCONFIG_GPIO_IT87=mCONFIG_GPIO_SCH311X=mCONFIG_GPIO_WINBOND=mCONFIG_GPIO_WS16C48=m
# end of Port-mapped I/O GPIO drivers
#
# I2C GPIO expanders
#
# CONFIG_GPIO_FXL6408 is not setCONFIG_GPIO_DS4520=mCONFIG_GPIO_MAX7300=yCONFIG_GPIO_MAX732X=mCONFIG_GPIO_PCA953X=mCONFIG_GPIO_PCA953X_IRQ=yCONFIG_GPIO_PCA9570=mCONFIG_GPIO_PCF857X=mCONFIG_GPIO_TPIC2810=m
# end of I2C GPIO expanders
#
# MFD GPIO expanders
#CONFIG_GPIO_BD9571MWV=y
# CONFIG_GPIO_CGBC is not setCONFIG_GPIO_CROS_EC=m
# CONFIG_GPIO_ELKHARTLAKE is not setCONFIG_GPIO_LP873X=mCONFIG_GPIO_PALMAS=y
# CONFIG_GPIO_RC5T583 is not set
# CONFIG_GPIO_TPS65086 is not setCONFIG_GPIO_TPS65910=yCONFIG_GPIO_TPS65912=yCONFIG_GPIO_TQMX86=y
# CONFIG_GPIO_TWL4030 is not setCONFIG_GPIO_WM831X=mCONFIG_GPIO_WM8350=yCONFIG_GPIO_WM8994=m
# end of MFD GPIO expanders
#
# USB GPIO expanders
#CONFIG_GPIO_MPSSE=m
# end of USB GPIO expanders
#
# Virtual GPIO drivers
#CONFIG_GPIO_AGGREGATOR=mCONFIG_GPIO_LATCH=mCONFIG_GPIO_MOCKUP=m
# CONFIG_GPIO_VIRTIO is not set
# CONFIG_GPIO_SIM is not set
# end of Virtual GPIO drivers
#
# GPIO Debugging utilities
#CONFIG_GPIO_VIRTUSER=m
# end of GPIO Debugging utilities
CONFIG_W1=y
#
# 1-wire Bus Masters
#CONFIG_W1_MASTER_AMD_AXI=y
# CONFIG_W1_MASTER_DS2490 is not setCONFIG_W1_MASTER_DS2482=yCONFIG_W1_MASTER_GPIO=mCONFIG_W1_MASTER_SGI=yCONFIG_W1_MASTER_UART=m
# end of 1-wire Bus Masters
#
# 1-wire Slaves
#CONFIG_W1_SLAVE_THERM=y
# CONFIG_W1_SLAVE_SMEM is not setCONFIG_W1_SLAVE_DS2405=yCONFIG_W1_SLAVE_DS2408=yCONFIG_W1_SLAVE_DS2408_READBACK=y
# CONFIG_W1_SLAVE_DS2413 is not setCONFIG_W1_SLAVE_DS2406=mCONFIG_W1_SLAVE_DS2423=mCONFIG_W1_SLAVE_DS2805=yCONFIG_W1_SLAVE_DS2430=y
# CONFIG_W1_SLAVE_DS2431 is not setCONFIG_W1_SLAVE_DS2433=mCONFIG_W1_SLAVE_DS2433_CRC=yCONFIG_W1_SLAVE_DS2438=mCONFIG_W1_SLAVE_DS250X=mCONFIG_W1_SLAVE_DS2780=yCONFIG_W1_SLAVE_DS2781=yCONFIG_W1_SLAVE_DS28E04=yCONFIG_W1_SLAVE_DS28E17=y
# end of 1-wire Slaves
CONFIG_POWER_RESET=y CONFIG_POWER_RESET_MT6323=y
# CONFIG_POWER_RESET_RESTART is not set
# CONFIG_POWER_RESET_TPS65086 is not set
# CONFIG_POWER_SEQUENCING is not set CONFIG_POWER_SUPPLY=y CONFIG_POWER_SUPPLY_DEBUG=y CONFIG_IP5XXX_POWER=y CONFIG_WM831X_BACKUP=y
# CONFIG_WM831X_POWER is not set
# CONFIG_WM8350_POWER is not set CONFIG_TEST_POWER=y
# CONFIG_BATTERY_88PM860X is not set CONFIG_CHARGER_ADP5061=y CONFIG_BATTERY_CW2015=y CONFIG_BATTERY_DS2760=y CONFIG_BATTERY_DS2780=y CONFIG_BATTERY_DS2781=y CONFIG_BATTERY_DS2782=m
# CONFIG_BATTERY_SAMSUNG_SDI is not set CONFIG_BATTERY_SBS=mCONFIG_CHARGER_SBS=y CONFIG_BATTERY_BQ27XXX=y
# CONFIG_BATTERY_BQ27XXX_I2C is not set CONFIG_BATTERY_BQ27XXX_HDQ=m CONFIG_BATTERY_DA9030=m CONFIG_BATTERY_DA9150=m CONFIG_BATTERY_MAX17042=y CONFIG_BATTERY_MAX1720X=m CONFIG_BATTERY_MAX1721X=y CONFIG_CHARGER_ISP1704=y CONFIG_CHARGER_MAX8903=y CONFIG_CHARGER_LP8727=y CONFIG_CHARGER_GPIO=m CONFIG_CHARGER_MANAGER=m CONFIG_CHARGER_LT3651=m CONFIG_CHARGER_LTC4162L=y CONFIG_CHARGER_MAX77693=m CONFIG_CHARGER_MAX77976=y
# CONFIG_CHARGER_MT6360 is not set CONFIG_CHARGER_BQ2415X=m CONFIG_CHARGER_BQ24190=y CONFIG_CHARGER_BQ24257=y CONFIG_CHARGER_BQ24735=m CONFIG_CHARGER_BQ2515X=m
# CONFIG_CHARGER_BQ25890 is not set
# CONFIG_CHARGER_BQ25980 is not set CONFIG_CHARGER_BQ256XX=y CONFIG_CHARGER_SMB347=m
# CONFIG_CHARGER_TPS65090 is not set CONFIG_BATTERY_GAUGE_LTC2941=m CONFIG_BATTERY_GOLDFISH=m
# CONFIG_BATTERY_RT5033 is not set CONFIG_CHARGER_RT9455=m CONFIG_CHARGER_RT9467=m CONFIG_CHARGER_RT9471=m CONFIG_CHARGER_CROS_PCHG=m CONFIG_FUEL_GAUGE_STC3117=m CONFIG_CHARGER_BD99954=m CONFIG_BATTERY_UG3105=m CONFIG_FUEL_GAUGE_MM8013=y
# CONFIG_HWMON is not setCONFIG_THERMAL=y CONFIG_THERMAL_STATISTICS=y
# CONFIG_THERMAL_DEBUGFS is not set CONFIG_THERMAL_CORE_TESTING=m CONFIG_THERMAL_EMERGENCY_POWEROFF_DELAY_MS=0 # CONFIG_THERMAL_DEFAULT_GOV_STEP_WISE is not set CONFIG_THERMAL_DEFAULT_GOV_FAIR_SHARE=y
# CONFIG_THERMAL_DEFAULT_GOV_USER_SPACE is not set CONFIG_THERMAL_GOV_FAIR_SHARE=y CONFIG_THERMAL_GOV_STEP_WISE=y
# CONFIG_THERMAL_GOV_BANG_BANG is not set CONFIG_THERMAL_GOV_USER_SPACE=y CONFIG_THERMAL_EMULATION=y
#
# Intel thermal drivers
#CONFIG_X86_THERMAL_VECTOR=yCONFIG_INTEL_TCC=y
#
# ACPI INT340X thermal drivers
#
# end of ACPI INT340X thermal drivers
CONFIG_INTEL_TCC_COOLING=m
# end of Intel thermal drivers
# CONFIG_WATCHDOG is not setCONFIG_SSB_POSSIBLE=yCONFIG_SSB=yCONFIG_SSB_PCMCIAHOST_POSSIBLE=y
# CONFIG_SSB_PCMCIAHOST is not set
# CONFIG_SSB_DRIVER_GPIO is not setCONFIG_BCMA_POSSIBLE=yCONFIG_BCMA=yCONFIG_BCMA_HOST_SOC=y
# CONFIG_BCMA_SFLASH is not setCONFIG_BCMA_DRIVER_GMAC_CMN=y
# CONFIG_BCMA_DRIVER_GPIO is not set
# CONFIG_BCMA_DEBUG is not set
#
# Multifunction device drivers
#CONFIG_MFD_CORE=yCONFIG_MFD_AS3711=yCONFIG_MFD_SMPRO=m
# CONFIG_PMIC_ADP5520 is not setCONFIG_MFD_AAT2870_CORE=y
# CONFIG_MFD_BCM590XX is not setCONFIG_MFD_BD9571MWV=yCONFIG_MFD_AXP20X=yCONFIG_MFD_AXP20X_I2C=yCONFIG_MFD_CGBC=mCONFIG_MFD_CROS_EC_DEV=mCONFIG_MFD_CS42L43=yCONFIG_MFD_CS42L43_I2C=y
# CONFIG_MFD_MADERA is not setCONFIG_PMIC_DA903X=y
# CONFIG_MFD_DA9052_I2C is not set
# CONFIG_MFD_DA9055 is not setCONFIG_MFD_DA9062=mCONFIG_MFD_DA9063=mCONFIG_MFD_DA9150=m
# CONFIG_MFD_DLN2 is not setCONFIG_MFD_MC13XXX=mCONFIG_MFD_MC13XXX_I2C=m
# CONFIG_MFD_MP2629 is not set
# CONFIG_MFD_IQS62X is not set
# CONFIG_MFD_KEMPLD is not setCONFIG_MFD_88PM800=mCONFIG_MFD_88PM805=yCONFIG_MFD_88PM860X=y
# CONFIG_MFD_MAX14577 is not set
# CONFIG_MFD_MAX77541 is not setCONFIG_MFD_MAX77693=m
# CONFIG_MFD_MAX77843 is not setCONFIG_MFD_MAX8907=m
# CONFIG_MFD_MAX8925 is not set
# CONFIG_MFD_MAX8997 is not set
# CONFIG_MFD_MAX8998 is not setCONFIG_MFD_MT6360=m
# CONFIG_MFD_MT6370 is not setCONFIG_MFD_MT6397=y
# CONFIG_MFD_MENF21BMC is not set
# CONFIG_MFD_VIPERBOARD is not set
# CONFIG_MFD_RETU is not set
# CONFIG_MFD_PCF50633 is not setCONFIG_MFD_SY7636A=mCONFIG_MFD_RT4831=y
# CONFIG_MFD_RT5033 is not setCONFIG_MFD_RT5120=yCONFIG_MFD_RC5T583=y
# CONFIG_MFD_SI476X_CORE is not setCONFIG_MFD_SIMPLE_MFD_I2C=mCONFIG_MFD_SM501=mCONFIG_MFD_SM501_GPIO=y
# CONFIG_MFD_SKY81452 is not setCONFIG_MFD_SYSCON=y
# CONFIG_MFD_LP3943 is not setCONFIG_MFD_LP8788=yCONFIG_MFD_TI_LMU=mCONFIG_MFD_PALMAS=mCONFIG_TPS6105X=y
# CONFIG_TPS65010 is not set
# CONFIG_TPS6507X is not setCONFIG_MFD_TPS65086=yCONFIG_MFD_TPS65090=yCONFIG_MFD_TI_LP873X=m
# CONFIG_MFD_TPS6586X is not setCONFIG_MFD_TPS65910=yCONFIG_MFD_TPS65912=yCONFIG_MFD_TPS65912_I2C=yCONFIG_MFD_TPS6594=yCONFIG_MFD_TPS6594_I2C=yCONFIG_TWL4030_CORE=y
# CONFIG_MFD_TWL4030_AUDIO is not set
# CONFIG_TWL6040_CORE is not setCONFIG_MFD_WL1273_CORE=mCONFIG_MFD_LM3533=yCONFIG_MFD_TQMX86=y
# CONFIG_MFD_ARIZONA_I2C is not set
# CONFIG_MFD_WM8400 is not setCONFIG_MFD_WM831X=yCONFIG_MFD_WM831X_I2C=yCONFIG_MFD_WM8350=yCONFIG_MFD_WM8350_I2C=yCONFIG_MFD_WM8994=m
# CONFIG_MFD_ATC260X_I2C is not setCONFIG_MFD_CS40L50_CORE=mCONFIG_MFD_CS40L50_I2C=mCONFIG_RAVE_SP_CORE=m
# CONFIG_MFD_QNAP_MCU is not set
# end of Multifunction device drivers
CONFIG_REGULATOR=y
# CONFIG_REGULATOR_DEBUG is not setCONFIG_REGULATOR_FIXED_VOLTAGE=yCONFIG_REGULATOR_VIRTUAL_CONSUMER=m
# CONFIG_REGULATOR_USERSPACE_CONSUMER is not set
# CONFIG_REGULATOR_88PG86X is not set
# CONFIG_REGULATOR_88PM800 is not setCONFIG_REGULATOR_88PM8607=yCONFIG_REGULATOR_ACT8865=mCONFIG_REGULATOR_AD5398=yCONFIG_REGULATOR_AAT2870=yCONFIG_REGULATOR_AS3711=mCONFIG_REGULATOR_AW37503=y
# CONFIG_REGULATOR_AXP20X is not setCONFIG_REGULATOR_BD9571MWV=mCONFIG_REGULATOR_DA903X=mCONFIG_REGULATOR_DA9062=mCONFIG_REGULATOR_DA9210=mCONFIG_REGULATOR_DA9211=mCONFIG_REGULATOR_FAN53555=m
# CONFIG_REGULATOR_GPIO is not set
# CONFIG_REGULATOR_ISL9305 is not setCONFIG_REGULATOR_ISL6271A=y
# CONFIG_REGULATOR_LM363X is not setCONFIG_REGULATOR_LP3971=yCONFIG_REGULATOR_LP3972=m
# CONFIG_REGULATOR_LP872X is not set
# CONFIG_REGULATOR_LP8755 is not setCONFIG_REGULATOR_LP8788=yCONFIG_REGULATOR_LTC3589=m
# CONFIG_REGULATOR_LTC3676 is not set
# CONFIG_REGULATOR_MAX1586 is not setCONFIG_REGULATOR_MAX77503=yCONFIG_REGULATOR_MAX77857=yCONFIG_REGULATOR_MAX8649=mCONFIG_REGULATOR_MAX8660=m
# CONFIG_REGULATOR_MAX8893 is not setCONFIG_REGULATOR_MAX8907=m
# CONFIG_REGULATOR_MAX8952 is not setCONFIG_REGULATOR_MAX20086=mCONFIG_REGULATOR_MAX20411=mCONFIG_REGULATOR_MAX77693=mCONFIG_REGULATOR_MAX77826=y
# CONFIG_REGULATOR_MC13783 is not set
# CONFIG_REGULATOR_MC13892 is not set
# CONFIG_REGULATOR_MP8859 is not setCONFIG_REGULATOR_MT6311=mCONFIG_REGULATOR_MT6323=y
# CONFIG_REGULATOR_MT6331 is not setCONFIG_REGULATOR_MT6332=m
# CONFIG_REGULATOR_MT6357 is not set
# CONFIG_REGULATOR_MT6358 is not setCONFIG_REGULATOR_MT6359=yCONFIG_REGULATOR_MT6360=m
# CONFIG_REGULATOR_MT6397 is not setCONFIG_REGULATOR_PALMAS=m
# CONFIG_REGULATOR_PCA9450 is not set
# CONFIG_REGULATOR_PV88060 is not set
# CONFIG_REGULATOR_PV88080 is not setCONFIG_REGULATOR_PV88090=yCONFIG_REGULATOR_PWM=yCONFIG_REGULATOR_RC5T583=y
# CONFIG_REGULATOR_RT4801 is not setCONFIG_REGULATOR_RT4803=mCONFIG_REGULATOR_RT4831=mCONFIG_REGULATOR_RT5120=y
# CONFIG_REGULATOR_RT5190A is not setCONFIG_REGULATOR_RT5739=mCONFIG_REGULATOR_RT5759=y
# CONFIG_REGULATOR_RT6160 is not setCONFIG_REGULATOR_RT6190=m
# CONFIG_REGULATOR_RT6245 is not set
# CONFIG_REGULATOR_RTQ2134 is not set
# CONFIG_REGULATOR_RTMV20 is not setCONFIG_REGULATOR_RTQ6752=y
# CONFIG_REGULATOR_RTQ2208 is not set
# CONFIG_REGULATOR_SLG51000 is not setCONFIG_REGULATOR_SY7636A=m
# CONFIG_REGULATOR_TPS51632 is not setCONFIG_REGULATOR_TPS6105X=yCONFIG_REGULATOR_TPS62360=mCONFIG_REGULATOR_TPS65023=yCONFIG_REGULATOR_TPS6507X=mCONFIG_REGULATOR_TPS65086=mCONFIG_REGULATOR_TPS65090=yCONFIG_REGULATOR_TPS65132=y
# CONFIG_REGULATOR_TPS65910 is not setCONFIG_REGULATOR_TPS65912=yCONFIG_REGULATOR_TWL4030=yCONFIG_REGULATOR_WM831X=yCONFIG_REGULATOR_WM8350=yCONFIG_REGULATOR_WM8994=mCONFIG_RC_CORE=y
# CONFIG_LIRC is not setCONFIG_RC_MAP=m
# CONFIG_RC_DECODERS is not set
# CONFIG_RC_DEVICES is not setCONFIG_CEC_CORE=yCONFIG_CEC_NOTIFIER=y
#
# CEC support
#
# CONFIG_MEDIA_CEC_RC is not set
# CONFIG_MEDIA_CEC_SUPPORT is not set
# end of CEC support
CONFIG_MEDIA_SUPPORT=y
# CONFIG_MEDIA_SUPPORT_FILTER is not set
# CONFIG_MEDIA_SUBDRV_AUTOSELECT is not set
#
# Media device types
#CONFIG_MEDIA_CAMERA_SUPPORT=yCONFIG_MEDIA_ANALOG_TV_SUPPORT=yCONFIG_MEDIA_DIGITAL_TV_SUPPORT=yCONFIG_MEDIA_RADIO_SUPPORT=yCONFIG_MEDIA_SDR_SUPPORT=yCONFIG_MEDIA_PLATFORM_SUPPORT=yCONFIG_MEDIA_TEST_SUPPORT=y
# end of Media device types
#
# Media core support
#CONFIG_VIDEO_DEV=yCONFIG_MEDIA_CONTROLLER=yCONFIG_DVB_CORE=m
# end of Media core support
#
# Video4Linux options
#CONFIG_VIDEO_V4L2_I2C=yCONFIG_VIDEO_V4L2_SUBDEV_API=y
# CONFIG_VIDEO_ADV_DEBUG is not set
# CONFIG_VIDEO_FIXED_MINOR_RANGES is not setCONFIG_V4L2_FWNODE=yCONFIG_V4L2_ASYNC=yCONFIG_V4L2_CCI=yCONFIG_V4L2_CCI_I2C=y
# end of Video4Linux options
#
# Media controller options
#CONFIG_MEDIA_CONTROLLER_DVB=y
# end of Media controller options
#
# Digital TV options
#
# CONFIG_DVB_MMAP is not setCONFIG_DVB_MAX_ADAPTERS=16
# CONFIG_DVB_DYNAMIC_MINORS is not set
# CONFIG_DVB_DEMUX_SECTION_LOSS_LOG is not setCONFIG_DVB_ULE_DEBUG=y
# end of Digital TV options
#
# Media drivers
#
#
# Media drivers
#
# CONFIG_MEDIA_USB_SUPPORT is not set
# CONFIG_RADIO_ADAPTERS is not set
# CONFIG_MEDIA_PLATFORM_DRIVERS is not set
#
# MMC/SDIO DVB adapters
#CONFIG_SMS_SDIO_DRV=m
# CONFIG_V4L_TEST_DRIVERS is not setCONFIG_DVB_TEST_DRIVERS=yCONFIG_DVB_VIDTV=mCONFIG_MEDIA_COMMON_OPTIONS=y
#
# common driver options # CONFIG_SMS_SIANO_MDTV=m # CONFIG_SMS_SIANO_RC is not set CONFIG_VIDEOBUF2_CORE=y CONFIG_VIDEOBUF2_V4L2=y CONFIG_VIDEOBUF2_MEMOPS=y CONFIG_VIDEOBUF2_VMALLOC=y # end of Media drivers
#
# Media ancillary drivers
#CONFIG_MEDIA_ATTACH=yCONFIG_VIDEO_IR_I2C=mCONFIG_VIDEO_CAMERA_SENSOR=yCONFIG_VIDEO_APTINA_PLL=mCONFIG_VIDEO_ALVIUM_CSI2=y
# CONFIG_VIDEO_AR0521 is not setCONFIG_VIDEO_GC0308=yCONFIG_VIDEO_GC05A2=mCONFIG_VIDEO_GC08A3=m
# CONFIG_VIDEO_GC2145 is not setCONFIG_VIDEO_HI556=mCONFIG_VIDEO_HI846=mCONFIG_VIDEO_HI847=yCONFIG_VIDEO_IMX208=m
# CONFIG_VIDEO_IMX214 is not set
# CONFIG_VIDEO_IMX219 is not set
# CONFIG_VIDEO_IMX258 is not set
# CONFIG_VIDEO_IMX274 is not set
# CONFIG_VIDEO_IMX283 is not setCONFIG_VIDEO_IMX290=y
# CONFIG_VIDEO_IMX296 is not setCONFIG_VIDEO_IMX319=yCONFIG_VIDEO_IMX355=mCONFIG_VIDEO_MAX9271_LIB=mCONFIG_VIDEO_MT9M001=y
# CONFIG_VIDEO_MT9M111 is not set
# CONFIG_VIDEO_MT9M114 is not setCONFIG_VIDEO_MT9P031=mCONFIG_VIDEO_MT9T112=yCONFIG_VIDEO_MT9V011=yCONFIG_VIDEO_MT9V032=yCONFIG_VIDEO_MT9V111=m
# CONFIG_VIDEO_OG01A1B is not set
# CONFIG_VIDEO_OV01A10 is not setCONFIG_VIDEO_OV02A10=m
# CONFIG_VIDEO_OV08D10 is not setCONFIG_VIDEO_OV08X40=m
# CONFIG_VIDEO_OV13858 is not set
# CONFIG_VIDEO_OV13B10 is not setCONFIG_VIDEO_OV2640=yCONFIG_VIDEO_OV2659=yCONFIG_VIDEO_OV2680=y
# CONFIG_VIDEO_OV2685 is not set
# CONFIG_VIDEO_OV4689 is not setCONFIG_VIDEO_OV5647=m
# CONFIG_VIDEO_OV5648 is not setCONFIG_VIDEO_OV5670=yCONFIG_VIDEO_OV5675=m
# CONFIG_VIDEO_OV5693 is not setCONFIG_VIDEO_OV5695=mCONFIG_VIDEO_OV64A40=mCONFIG_VIDEO_OV6650=yCONFIG_VIDEO_OV7251=m
# CONFIG_VIDEO_OV7640 is not set
# CONFIG_VIDEO_OV7670 is not set
# CONFIG_VIDEO_OV772X is not set
# CONFIG_VIDEO_OV7740 is not setCONFIG_VIDEO_OV8856=m
# CONFIG_VIDEO_OV8858 is not set
# CONFIG_VIDEO_OV8865 is not setCONFIG_VIDEO_OV9640=yCONFIG_VIDEO_OV9650=mCONFIG_VIDEO_RDACM20=mCONFIG_VIDEO_RDACM21=m
# CONFIG_VIDEO_RJ54N1 is not set
# CONFIG_VIDEO_S5K5BAF is not set
# CONFIG_VIDEO_S5K6A3 is not set
# CONFIG_VIDEO_ET8EK8 is not set
#
# Camera ISPs
#CONFIG_VIDEO_THP7312=m
# end of Camera ISPs
#
# Lens drivers
#
# CONFIG_VIDEO_AD5820 is not set
# CONFIG_VIDEO_AK7375 is not setCONFIG_VIDEO_DW9714=mCONFIG_VIDEO_DW9719=m
# CONFIG_VIDEO_DW9768 is not setCONFIG_VIDEO_DW9807_VCM=y
# end of Lens drivers
#
# Flash devices
#CONFIG_VIDEO_ADP1653=mCONFIG_VIDEO_LM3560=mCONFIG_VIDEO_LM3646=y
# end of Flash devices
#
# Audio decoders, processors and mixers
#
# CONFIG_VIDEO_CS3308 is not setCONFIG_VIDEO_CS5345=m
# CONFIG_VIDEO_CS53L32A is not setCONFIG_VIDEO_MSP3400=m
# CONFIG_VIDEO_SONY_BTF_MPX is not set
# CONFIG_VIDEO_TDA1997X is not set
# CONFIG_VIDEO_TDA7432 is not set
# CONFIG_VIDEO_TDA9840 is not setCONFIG_VIDEO_TEA6415C=yCONFIG_VIDEO_TEA6420=y
# CONFIG_VIDEO_TLV320AIC23B is not setCONFIG_VIDEO_TVAUDIO=mCONFIG_VIDEO_UDA1342=yCONFIG_VIDEO_VP27SMPX=mCONFIG_VIDEO_WM8739=y
# CONFIG_VIDEO_WM8775 is not set
# end of Audio decoders, processors and mixers
#
# RDS decoders
#CONFIG_VIDEO_SAA6588=y
# end of RDS decoders
#
# Video decoders
#CONFIG_VIDEO_ADV7180=yCONFIG_VIDEO_ADV7183=yCONFIG_VIDEO_ADV7604=yCONFIG_VIDEO_ADV7604_CEC=yCONFIG_VIDEO_ADV7842=mCONFIG_VIDEO_ADV7842_CEC=yCONFIG_VIDEO_BT819=mCONFIG_VIDEO_BT856=yCONFIG_VIDEO_BT866=m
# CONFIG_VIDEO_KS0127 is not set
# CONFIG_VIDEO_ML86V7667 is not setCONFIG_VIDEO_SAA7110=mCONFIG_VIDEO_SAA711X=yCONFIG_VIDEO_TC358743=y
# CONFIG_VIDEO_TC358743_CEC is not setCONFIG_VIDEO_TC358746=yCONFIG_VIDEO_TVP514X=m
# CONFIG_VIDEO_TVP5150 is not setCONFIG_VIDEO_TVP7002=m
# CONFIG_VIDEO_TW2804 is not setCONFIG_VIDEO_TW9900=mCONFIG_VIDEO_TW9903=yCONFIG_VIDEO_TW9906=yCONFIG_VIDEO_TW9910=yCONFIG_VIDEO_VPX3220=y
#
# Video and audio decoders
#CONFIG_VIDEO_SAA717X=yCONFIG_VIDEO_CX25840=y
# end of Video decoders
#
# Video encoders
#CONFIG_VIDEO_ADV7170=mCONFIG_VIDEO_ADV7175=y
# CONFIG_VIDEO_ADV7343 is not setCONFIG_VIDEO_ADV7393=yCONFIG_VIDEO_ADV7511=yCONFIG_VIDEO_ADV7511_CEC=yCONFIG_VIDEO_AK881X=mCONFIG_VIDEO_SAA7127=mCONFIG_VIDEO_SAA7185=m
# CONFIG_VIDEO_THS8200 is not set
# end of Video encoders
#
# Video improvement chips
#
# CONFIG_VIDEO_UPD64031A is not setCONFIG_VIDEO_UPD64083=y
# end of Video improvement chips
#
# Audio/Video compression chips
#
# CONFIG_VIDEO_SAA6752HS is not set
# end of Audio/Video compression chips
#
# SDR tuner chips
#CONFIG_SDR_MAX2175=m
# end of SDR tuner chips
#
# Miscellaneous helper chips
#CONFIG_VIDEO_I2C=yCONFIG_VIDEO_M52790=yCONFIG_VIDEO_ST_MIPID02=m
# CONFIG_VIDEO_THS7303 is not set
# end of Miscellaneous helper chips
#
# Video serializers and deserializers
#
# end of Video serializers and deserializers
CONFIG_MEDIA_TUNER=y
#
# Customize TV tuners
#CONFIG_MEDIA_TUNER_E4000=y
# CONFIG_MEDIA_TUNER_FC0011 is not setCONFIG_MEDIA_TUNER_FC0012=yCONFIG_MEDIA_TUNER_FC0013=mCONFIG_MEDIA_TUNER_FC2580=m
# CONFIG_MEDIA_TUNER_IT913X is not setCONFIG_MEDIA_TUNER_M88RS6000T=mCONFIG_MEDIA_TUNER_MAX2165=yCONFIG_MEDIA_TUNER_MC44S803=mCONFIG_MEDIA_TUNER_MT2060=mCONFIG_MEDIA_TUNER_MT2063=yCONFIG_MEDIA_TUNER_MT20XX=m
# CONFIG_MEDIA_TUNER_MT2131 is not setCONFIG_MEDIA_TUNER_MT2266=m
# CONFIG_MEDIA_TUNER_MXL301RF is not set
# CONFIG_MEDIA_TUNER_MXL5005S is not setCONFIG_MEDIA_TUNER_MXL5007T=m
# CONFIG_MEDIA_TUNER_QM1D1B0004 is not set
# CONFIG_MEDIA_TUNER_QM1D1C0042 is not setCONFIG_MEDIA_TUNER_QT1010=y
# CONFIG_MEDIA_TUNER_R820T is not set
# CONFIG_MEDIA_TUNER_SI2157 is not setCONFIG_MEDIA_TUNER_SIMPLE=m
# CONFIG_MEDIA_TUNER_TDA18212 is not setCONFIG_MEDIA_TUNER_TDA18218=m
# CONFIG_MEDIA_TUNER_TDA18250 is not setCONFIG_MEDIA_TUNER_TDA18271=mCONFIG_MEDIA_TUNER_TDA827X=yCONFIG_MEDIA_TUNER_TDA8290=mCONFIG_MEDIA_TUNER_TDA9887=yCONFIG_MEDIA_TUNER_TEA5761=yCONFIG_MEDIA_TUNER_TEA5767=mCONFIG_MEDIA_TUNER_TUA9001=mCONFIG_MEDIA_TUNER_XC2028=mCONFIG_MEDIA_TUNER_XC4000=yCONFIG_MEDIA_TUNER_XC5000=m
# end of Customize TV tuners
#
# Customise DVB Frontends
#
#
# Multistandard (satellite) frontends
#CONFIG_DVB_MXL5XX=mCONFIG_DVB_STB0899=mCONFIG_DVB_STB6100=m
# CONFIG_DVB_STV090x is not setCONFIG_DVB_STV0910=m
# CONFIG_DVB_STV6110x is not setCONFIG_DVB_STV6111=m
#
# Multistandard (cable + terrestrial) frontends
#CONFIG_DVB_DRXK=mCONFIG_DVB_MN88472=mCONFIG_DVB_MN88473=mCONFIG_DVB_SI2165=mCONFIG_DVB_TDA18271C2DD=m
#
# DVB-S (satellite) frontends
#CONFIG_DVB_CX24110=mCONFIG_DVB_CX24116=mCONFIG_DVB_CX24117=m
# CONFIG_DVB_CX24120 is not set
# CONFIG_DVB_CX24123 is not setCONFIG_DVB_DS3000=mCONFIG_DVB_MB86A16=m
# CONFIG_DVB_MT312 is not setCONFIG_DVB_S5H1420=mCONFIG_DVB_SI21XX=mCONFIG_DVB_STB6000=m
# CONFIG_DVB_STV0288 is not setCONFIG_DVB_STV0299=m
# CONFIG_DVB_STV0900 is not setCONFIG_DVB_STV6110=mCONFIG_DVB_TDA10071=mCONFIG_DVB_TDA10086=mCONFIG_DVB_TDA8083=mCONFIG_DVB_TDA8261=m
# CONFIG_DVB_TDA826X is not set
# CONFIG_DVB_TS2020 is not setCONFIG_DVB_TUA6100=mCONFIG_DVB_TUNER_CX24113=mCONFIG_DVB_TUNER_ITD1000=mCONFIG_DVB_VES1X93=mCONFIG_DVB_ZL10036=mCONFIG_DVB_ZL10039=m
#
# DVB-T (terrestrial) frontends
#CONFIG_DVB_CX22700=m
# CONFIG_DVB_CX22702 is not setCONFIG_DVB_CXD2820R=m
# CONFIG_DVB_CXD2841ER is not setCONFIG_DVB_DIB3000MB=m
# CONFIG_DVB_DIB3000MC is not set
# CONFIG_DVB_DIB7000M is not setCONFIG_DVB_DIB7000P=m
# CONFIG_DVB_DIB9000 is not setCONFIG_DVB_DRXD=mCONFIG_DVB_EC100=mCONFIG_DVB_L64781=mCONFIG_DVB_MT352=mCONFIG_DVB_NXT6000=mCONFIG_DVB_S5H1432=mCONFIG_DVB_SP887X=mCONFIG_DVB_STV0367=mCONFIG_DVB_TDA10048=m
# CONFIG_DVB_TDA1004X is not set
# CONFIG_DVB_ZD1301_DEMOD is not setCONFIG_DVB_ZL10353=m
#
# DVB-C (cable) frontends
#
# CONFIG_DVB_STV0297 is not setCONFIG_DVB_TDA10021=m
# CONFIG_DVB_TDA10023 is not set
# CONFIG_DVB_VES1820 is not set
#
# ATSC (North American/Korean Terrestrial/Cable DTV) frontends #CONFIG_DVB_AU8522=mCONFIG_DVB_AU8522_DTV=m
# CONFIG_DVB_AU8522_V4L is not set CONFIG_DVB_BCM3510=mCONFIG_DVB_LG2160=m
# CONFIG_DVB_LGDT3305 is not set CONFIG_DVB_LGDT330X=mCONFIG_DVB_MXL692=mCONFIG_DVB_NXT200X=m
# CONFIG_DVB_OR51132 is not setCONFIG_DVB_OR51211=mCONFIG_DVB_S5H1409=mCONFIG_DVB_S5H1411=m
#
# ISDB-T (terrestrial) frontends
#CONFIG_DVB_DIB8000=mCONFIG_DVB_MB86A20S=m
# CONFIG_DVB_S921 is not set
#
# ISDB-S (satellite) & ISDB-T (terrestrial) frontends #CONFIG_DVB_MN88443X=mCONFIG_DVB_TC90522=m
#
# Digital terrestrial only tuners/PLL
#CONFIG_DVB_PLL=mCONFIG_DVB_TUNER_DIB0070=mCONFIG_DVB_TUNER_DIB0090=m
#
# SEC control devices for DVB-S
#CONFIG_DVB_A8293=mCONFIG_DVB_AF9033=m
# CONFIG_DVB_ASCOT2E is not setCONFIG_DVB_ATBM8830=mCONFIG_DVB_HELENE=mCONFIG_DVB_HORUS3A=m
# CONFIG_DVB_ISL6405 is not setCONFIG_DVB_ISL6421=mCONFIG_DVB_ISL6423=mCONFIG_DVB_IX2505V=m
# CONFIG_DVB_LGS8GL5 is not setCONFIG_DVB_LGS8GXX=mCONFIG_DVB_LNBH25=mCONFIG_DVB_LNBH29=m
# CONFIG_DVB_LNBP21 is not setCONFIG_DVB_LNBP22=m
# CONFIG_DVB_M88RS2000 is not set
CONFIG_DVB_TDA665x=mCONFIG_DVB_DRX39XYJ=m
#
# Common Interface (EN50221) controller drivers
#CONFIG_DVB_CXD2099=m
# CONFIG_DVB_SP2 is not set
# end of Customise DVB Frontends
#
# Tools to develop new frontends
#
# CONFIG_DVB_DUMMY_FE is not set
# end of Media ancillary drivers
#
# Graphics support
#CONFIG_APERTURE_HELPERS=yCONFIG_SCREEN_INFO=yCONFIG_VIDEO=yCONFIG_AUXDISPLAY=yCONFIG_CHARLCD=yCONFIG_HD44780_COMMON=yCONFIG_HD44780=m
# CONFIG_LCD2S is not setCONFIG_PARPORT_PANEL=yCONFIG_PANEL_PARPORT=0CONFIG_PANEL_PROFILE=5CONFIG_PANEL_CHANGE_MESSAGE=yCONFIG_PANEL_BOOT_MESSAGE=""CONFIG_CHARLCD_BL_OFF=y
# CONFIG_CHARLCD_BL_ON is not set
# CONFIG_CHARLCD_BL_FLASH is not setCONFIG_LINEDISP=yCONFIG_IMG_ASCII_LCD=yCONFIG_MAX6959=y
# CONFIG_SEG_LED_GPIO is not set
# CONFIG_PANEL is not setCONFIG_DRM=y
# CONFIG_DRM_DEBUG_MM is not setCONFIG_DRM_KUNIT_TEST_HELPERS=mCONFIG_DRM_KUNIT_TEST=mCONFIG_DRM_KMS_HELPER=yCONFIG_DRM_DRAW=y
# CONFIG_DRM_PANIC is not setCONFIG_DRM_CLIENT=yCONFIG_DRM_CLIENT_LIB=yCONFIG_DRM_CLIENT_SELECTION=yCONFIG_DRM_CLIENT_SETUP=y
#
# Supported DRM clients
#
# CONFIG_DRM_FBDEV_EMULATION is not setCONFIG_DRM_CLIENT_LOG=yCONFIG_DRM_CLIENT_DEFAULT_LOG=yCONFIG_DRM_CLIENT_DEFAULT="log"
# end of Supported DRM clients
CONFIG_DRM_LOAD_EDID_FIRMWARE=yCONFIG_DRM_DISPLAY_HELPER=yCONFIG_DRM_DISPLAY_DP_AUX_CEC=y
# CONFIG_DRM_DISPLAY_DP_AUX_CHARDEV is not setCONFIG_DRM_DISPLAY_DP_HELPER=yCONFIG_DRM_DISPLAY_HDMI_AUDIO_HELPER=yCONFIG_DRM_DISPLAY_HDMI_HELPER=yCONFIG_DRM_DISPLAY_HDMI_STATE_HELPER=yCONFIG_DRM_EXEC=mCONFIG_DRM_BUDDY=mCONFIG_DRM_GEM_SHMEM_HELPER=yCONFIG_DRM_SCHED=m
#
# I2C encoder or helper chips
#
# CONFIG_DRM_I2C_CH7006 is not setCONFIG_DRM_I2C_SIL164=mCONFIG_DRM_I2C_NXP_TDA998X=mCONFIG_DRM_I2C_NXP_TDA9950=m
# end of I2C encoder or helper chips
#
# ARM devices
#
# end of ARM devices
CONFIG_DRM_VGEM=yCONFIG_DRM_VKMS=yCONFIG_DRM_UDL=mCONFIG_DRM_VIRTIO_GPU=y
# CONFIG_DRM_VIRTIO_GPU_KMS is not setCONFIG_DRM_PANEL=y
#
# Display Panels
#
# end of Display Panels
CONFIG_DRM_BRIDGE=yCONFIG_DRM_PANEL_BRIDGE=y
#
# Display Interface Bridges
#CONFIG_DRM_ANALOGIX_ANX78XX=yCONFIG_DRM_ANALOGIX_DP=y
# end of Display Interface Bridges
CONFIG_DRM_ETNAVIV=mCONFIG_DRM_ETNAVIV_THERMAL=yCONFIG_DRM_GM12U320=mCONFIG_DRM_SIMPLEDRM=yCONFIG_DRM_GUD=mCONFIG_DRM_SSD130X=m
# CONFIG_DRM_SSD130X_I2C is not setCONFIG_DRM_EXPORT_FOR_TESTS=yCONFIG_DRM_LIB_RANDOM=yCONFIG_DRM_PANEL_ORIENTATION_QUIRKS=y
#
# Frame buffer Devices
#
# CONFIG_FB is not set
# end of Frame buffer Devices
#
# Backlight & LCD device support
#CONFIG_LCD_CLASS_DEVICE=yCONFIG_LCD_PLATFORM=yCONFIG_BACKLIGHT_CLASS_DEVICE=m
# CONFIG_BACKLIGHT_KTD253 is not setCONFIG_BACKLIGHT_KTD2801=mCONFIG_BACKLIGHT_KTZ8866=m
# CONFIG_BACKLIGHT_LM3533 is not setCONFIG_BACKLIGHT_PWM=mCONFIG_BACKLIGHT_DA903X=m
# CONFIG_BACKLIGHT_QCOM_WLED is not setCONFIG_BACKLIGHT_RT4831=mCONFIG_BACKLIGHT_SAHARA=mCONFIG_BACKLIGHT_WM831X=mCONFIG_BACKLIGHT_ADP8860=mCONFIG_BACKLIGHT_ADP8870=m
# CONFIG_BACKLIGHT_88PM860X is not setCONFIG_BACKLIGHT_AAT2870=mCONFIG_BACKLIGHT_LM3509=mCONFIG_BACKLIGHT_LM3630A=mCONFIG_BACKLIGHT_LM3639=mCONFIG_BACKLIGHT_LP855X=m
# CONFIG_BACKLIGHT_LP8788 is not setCONFIG_BACKLIGHT_MP3309C=mCONFIG_BACKLIGHT_PANDORA=mCONFIG_BACKLIGHT_AS3711=m
# CONFIG_BACKLIGHT_GPIO is not set
# CONFIG_BACKLIGHT_LV5207LP is not setCONFIG_BACKLIGHT_BD6107=mCONFIG_BACKLIGHT_ARCXCNN=mCONFIG_BACKLIGHT_RAVE_SP=m
# end of Backlight & LCD device support
CONFIG_HDMI=y
#
# Console display driver support
#CONFIG_VGA_CONSOLE=yCONFIG_MDA_CONSOLE=yCONFIG_DUMMY_CONSOLE=yCONFIG_DUMMY_CONSOLE_COLUMNS=80CONFIG_DUMMY_CONSOLE_ROWS=25
# end of Console display driver support # end of Graphics support
# CONFIG_DRM_ACCEL is not setCONFIG_SOUND=yCONFIG_SND=mCONFIG_SND_TIMER=mCONFIG_SND_PCM=mCONFIG_SND_PCM_ELD=yCONFIG_SND_PCM_IEC958=yCONFIG_SND_DMAENGINE_PCM=mCONFIG_SND_HWDEP=mCONFIG_SND_SEQ_DEVICE=mCONFIG_SND_RAWMIDI=mCONFIG_SND_CORE_TEST=mCONFIG_SND_COMPRESS_OFFLOAD=mCONFIG_SND_COMPRESS_ACCEL=yCONFIG_SND_JACK=yCONFIG_SND_JACK_INPUT_DEV=y
# CONFIG_SND_OSSEMUL is not setCONFIG_SND_PCM_TIMER=yCONFIG_SND_HRTIMER=mCONFIG_SND_DYNAMIC_MINORS=yCONFIG_SND_MAX_CARDS=32CONFIG_SND_SUPPORT_OLD_API=yCONFIG_SND_PROC_FS=y
# CONFIG_SND_VERBOSE_PROCFS is not setCONFIG_SND_CTL_FAST_LOOKUP=yCONFIG_SND_DEBUG=y
# CONFIG_SND_DEBUG_VERBOSE is not set
# CONFIG_SND_CTL_INPUT_VALIDATION is not setCONFIG_SND_CTL_DEBUG=yCONFIG_SND_JACK_INJECTION_DEBUG=yCONFIG_SND_UTIMER=yCONFIG_SND_VMASTER=yCONFIG_SND_DMA_SGBUF=yCONFIG_SND_CTL_LED=mCONFIG_SND_SEQUENCER=m
# CONFIG_SND_SEQ_DUMMY is not setCONFIG_SND_SEQ_HRTIMER_DEFAULT=yCONFIG_SND_SEQ_MIDI_EVENT=mCONFIG_SND_SEQ_MIDI=mCONFIG_SND_SEQ_VIRMIDI=mCONFIG_SND_SEQ_UMP=yCONFIG_SND_AC97_CODEC=mCONFIG_SND_DRIVERS=yCONFIG_SND_PCSP=mCONFIG_SND_DUMMY=m
# CONFIG_SND_ALOOP is not setCONFIG_SND_PCMTEST=mCONFIG_SND_VIRMIDI=mCONFIG_SND_MTPAV=m
# CONFIG_SND_MTS64 is not setCONFIG_SND_SERIAL_U16550=m
# CONFIG_SND_MPU401 is not setCONFIG_SND_PORTMAN2X4=m
# CONFIG_SND_AC97_POWER_SAVE is not set
# CONFIG_SND_ISA is not set
#
# HD-Audio
#CONFIG_SND_HDA=mCONFIG_SND_HDA_GENERIC_LEDS=y
# CONFIG_SND_HDA_HWDEP is not setCONFIG_SND_HDA_RECONFIG=yCONFIG_SND_HDA_INPUT_BEEP=yCONFIG_SND_HDA_INPUT_BEEP_MODE=1CONFIG_SND_HDA_PATCH_LOADER=yCONFIG_SND_HDA_CIRRUS_SCODEC=mCONFIG_SND_HDA_CIRRUS_SCODEC_KUNIT_TEST=m
# CONFIG_SND_HDA_CODEC_REALTEK is not setCONFIG_SND_HDA_CODEC_ANALOG=mCONFIG_SND_HDA_CODEC_SIGMATEL=mCONFIG_SND_HDA_CODEC_VIA=mCONFIG_SND_HDA_CODEC_HDMI=mCONFIG_SND_HDA_CODEC_CIRRUS=m
# CONFIG_SND_HDA_CODEC_CS8409 is not set
# CONFIG_SND_HDA_CODEC_CONEXANT is not set
# CONFIG_SND_HDA_CODEC_SENARYTECH is not setCONFIG_SND_HDA_CODEC_CA0110=mCONFIG_SND_HDA_CODEC_CA0132=mCONFIG_SND_HDA_CODEC_CA0132_DSP=yCONFIG_SND_HDA_CODEC_CMEDIA=m
# CONFIG_SND_HDA_CODEC_SI3054 is not setCONFIG_SND_HDA_GENERIC=mCONFIG_SND_HDA_POWER_SAVE_DEFAULT=0
# end of HD-Audio
CONFIG_SND_HDA_CORE=mCONFIG_SND_HDA_DSP_LOADER=yCONFIG_SND_HDA_EXT_CORE=mCONFIG_SND_HDA_PREALLOC_SIZE=0CONFIG_SND_USB=y
# CONFIG_SND_USB_AUDIO is not setCONFIG_SND_USB_UA101=mCONFIG_SND_USB_USX2Y=mCONFIG_SND_USB_CAIAQ=mCONFIG_SND_USB_CAIAQ_INPUT=yCONFIG_SND_USB_US122L=m
# CONFIG_SND_USB_6FIRE is not set
# CONFIG_SND_USB_HIFACE is not setCONFIG_SND_BCD2000=mCONFIG_SND_USB_LINE6=m
# CONFIG_SND_USB_POD is not setCONFIG_SND_USB_PODHD=mCONFIG_SND_USB_TONEPORT=mCONFIG_SND_USB_VARIAX=mCONFIG_SND_PCMCIA=y
# CONFIG_SND_VXPOCKET is not setCONFIG_SND_PDAUDIOCF=mCONFIG_SND_SOC=mCONFIG_SND_SOC_AC97_BUS=yCONFIG_SND_SOC_GENERIC_DMAENGINE_PCM=yCONFIG_SND_SOC_COMPRESS=y
# CONFIG_SND_SOC_TOPOLOGY_BUILD is not setCONFIG_SND_SOC_CARD_KUNIT_TEST=mCONFIG_SND_SOC_UTILS_KUNIT_TEST=mCONFIG_SND_SOC_ADI=mCONFIG_SND_SOC_ADI_AXI_I2S=m
# CONFIG_SND_SOC_ADI_AXI_SPDIF is not setCONFIG_SND_SOC_AMD_ACP=m
# CONFIG_SND_SOC_AMD_CZ_RT5645_MACH is not setCONFIG_SND_AMD_ACP_CONFIG=mCONFIG_SND_SOC_AMD_ACP63_TOPLEVEL=mCONFIG_SND_ATMEL_SOC=m
# CONFIG_SND_BCM63XX_I2S_WHISTLER is not set
#
# SoC Audio for Freescale CPUs
#
#
# Common SoC Audio options for Freescale CPUs:
#CONFIG_SND_SOC_FSL_ASRC=m
# CONFIG_SND_SOC_FSL_SAI is not setCONFIG_SND_SOC_FSL_AUDMIX=m
# CONFIG_SND_SOC_FSL_SSI is not set
# CONFIG_SND_SOC_FSL_SPDIF is not setCONFIG_SND_SOC_FSL_ESAI=mCONFIG_SND_SOC_FSL_MICFIL=mCONFIG_SND_SOC_FSL_EASRC=m
# CONFIG_SND_SOC_FSL_XCVR is not setCONFIG_SND_SOC_FSL_UTILS=mCONFIG_SND_SOC_IMX_AUDMUX=m
# end of SoC Audio for Freescale CPUs
CONFIG_SND_SOC_CHV3_I2S=mCONFIG_SND_I2S_HI6210_I2S=m
#
# SoC Audio for Loongson CPUs
#
# end of SoC Audio for Loongson CPUs
CONFIG_SND_SOC_IMG=yCONFIG_SND_SOC_IMG_I2S_IN=m
# CONFIG_SND_SOC_IMG_I2S_OUT is not set
# CONFIG_SND_SOC_IMG_PARALLEL_OUT is not setCONFIG_SND_SOC_IMG_SPDIF_IN=mCONFIG_SND_SOC_IMG_SPDIF_OUT=mCONFIG_SND_SOC_IMG_PISTACHIO_INTERNAL_DAC=mCONFIG_SND_SOC_INTEL_SST_TOPLEVEL=yCONFIG_SND_SOC_INTEL_MACH=yCONFIG_SND_SOC_INTEL_USER_FRIENDLY_LONG_NAMES=yCONFIG_SND_SOC_MTK_BTCVSD=mCONFIG_SND_SOC_SDCA_OPTIONAL=mCONFIG_SND_SOC_SOF_TOPLEVEL=yCONFIG_SND_SOC_SOF_AMD_TOPLEVEL=m
# CONFIG_SND_SOC_SOF_INTEL_TOPLEVEL is not set
#
# STMicroelectronics STM32 SOC audio support
#
# end of STMicroelectronics STM32 SOC audio support
# CONFIG_SND_SOC_XILINX_I2S is not setCONFIG_SND_SOC_XILINX_AUDIO_FORMATTER=mCONFIG_SND_SOC_XILINX_SPDIF=mCONFIG_SND_SOC_XTFPGA_I2S=mCONFIG_SND_SOC_I2C_AND_SPI=m
#
# CODEC drivers
#CONFIG_SND_SOC_WM_ADSP=mCONFIG_SND_SOC_AC97_CODEC=mCONFIG_SND_SOC_ADAU_UTILS=mCONFIG_SND_SOC_ADAU1372=mCONFIG_SND_SOC_ADAU1372_I2C=mCONFIG_SND_SOC_ADAU1373=mCONFIG_SND_SOC_ADAU1701=m
# CONFIG_SND_SOC_ADAU1761_I2C is not setCONFIG_SND_SOC_ADAU7002=mCONFIG_SND_SOC_ADAU7118=m
# CONFIG_SND_SOC_ADAU7118_HW is not setCONFIG_SND_SOC_ADAU7118_I2C=m
# CONFIG_SND_SOC_AK4118 is not setCONFIG_SND_SOC_AK4375=mCONFIG_SND_SOC_AK4458=m
# CONFIG_SND_SOC_AK4554 is not setCONFIG_SND_SOC_AK4613=mCONFIG_SND_SOC_AK4619=mCONFIG_SND_SOC_AK4642=mCONFIG_SND_SOC_AK5386=mCONFIG_SND_SOC_AK5558=mCONFIG_SND_SOC_ALC5623=mCONFIG_SND_SOC_AW8738=mCONFIG_SND_SOC_AW88395_LIB=m
# CONFIG_SND_SOC_AW88395 is not setCONFIG_SND_SOC_AW88261=mCONFIG_SND_SOC_AW88081=mCONFIG_SND_SOC_AW87390=mCONFIG_SND_SOC_AW88399=m
# CONFIG_SND_SOC_BD28623 is not set
# CONFIG_SND_SOC_BT_SCO is not setCONFIG_SND_SOC_CHV3_CODEC=mCONFIG_SND_SOC_CROS_EC_CODEC=mCONFIG_SND_SOC_CS_AMP_LIB=m
# CONFIG_SND_SOC_CS_AMP_LIB_TEST is not setCONFIG_SND_SOC_CS35L32=m
# CONFIG_SND_SOC_CS35L33 is not set
# CONFIG_SND_SOC_CS35L34 is not setCONFIG_SND_SOC_CS35L35=m
# CONFIG_SND_SOC_CS35L36 is not setCONFIG_SND_SOC_CS35L41_LIB=mCONFIG_SND_SOC_CS35L41=mCONFIG_SND_SOC_CS35L41_I2C=mCONFIG_SND_SOC_CS35L45=mCONFIG_SND_SOC_CS35L45_I2C=mCONFIG_SND_SOC_CS35L56=mCONFIG_SND_SOC_CS35L56_SHARED=mCONFIG_SND_SOC_CS35L56_I2C=mCONFIG_SND_SOC_CS40L50=mCONFIG_SND_SOC_CS42L42_CORE=mCONFIG_SND_SOC_CS42L42=m
# CONFIG_SND_SOC_CS42L43 is not set
# CONFIG_SND_SOC_CS42L51_I2C is not setCONFIG_SND_SOC_CS42L52=mCONFIG_SND_SOC_CS42L56=m
# CONFIG_SND_SOC_CS42L73 is not set
# CONFIG_SND_SOC_CS42L83 is not setCONFIG_SND_SOC_CS42L84=mCONFIG_SND_SOC_CS4234=m
# CONFIG_SND_SOC_CS4265 is not setCONFIG_SND_SOC_CS4270=mCONFIG_SND_SOC_CS4271=mCONFIG_SND_SOC_CS4271_I2C=mCONFIG_SND_SOC_CS42XX8=mCONFIG_SND_SOC_CS42XX8_I2C=mCONFIG_SND_SOC_CS43130=m
# CONFIG_SND_SOC_CS4341 is not setCONFIG_SND_SOC_CS4349=m
# CONFIG_SND_SOC_CS53L30 is not set
# CONFIG_SND_SOC_CS530X_I2C is not set
# CONFIG_SND_SOC_CX2072X is not setCONFIG_SND_SOC_DA7213=m
# CONFIG_SND_SOC_DMIC is not setCONFIG_SND_SOC_HDMI_CODEC=mCONFIG_SND_SOC_ES7134=m
# CONFIG_SND_SOC_ES7241 is not set
# CONFIG_SND_SOC_ES8311 is not setCONFIG_SND_SOC_ES8316=mCONFIG_SND_SOC_ES8323=mCONFIG_SND_SOC_ES8326=m
# CONFIG_SND_SOC_ES8328_I2C is not setCONFIG_SND_SOC_GTM601=mCONFIG_SND_SOC_HDA=mCONFIG_SND_SOC_ICS43432=mCONFIG_SND_SOC_MAX98088=mCONFIG_SND_SOC_MAX98090=mCONFIG_SND_SOC_MAX98357A=mCONFIG_SND_SOC_MAX98504=m
# CONFIG_SND_SOC_MAX9867 is not set
# CONFIG_SND_SOC_MAX98927 is not setCONFIG_SND_SOC_MAX98520=mCONFIG_SND_SOC_MAX98373=mCONFIG_SND_SOC_MAX98373_I2C=mCONFIG_SND_SOC_MAX98388=mCONFIG_SND_SOC_MAX98390=mCONFIG_SND_SOC_MAX98396=m
# CONFIG_SND_SOC_MAX9860 is not set
# CONFIG_SND_SOC_MSM8916_WCD_DIGITAL is not set
# CONFIG_SND_SOC_PCM1681 is not set
# CONFIG_SND_SOC_PCM1789_I2C is not set
# CONFIG_SND_SOC_PCM179X_I2C is not setCONFIG_SND_SOC_PCM186X=mCONFIG_SND_SOC_PCM186X_I2C=mCONFIG_SND_SOC_PCM3060=mCONFIG_SND_SOC_PCM3060_I2C=mCONFIG_SND_SOC_PCM3168A=mCONFIG_SND_SOC_PCM3168A_I2C=mCONFIG_SND_SOC_PCM5102A=m
CONFIG_SND_SOC_PCM512x=m
CONFIG_SND_SOC_PCM512x_I2C=m
# CONFIG_SND_SOC_PCM6240 is not setCONFIG_SND_SOC_RL6231=mCONFIG_SND_SOC_RT5616=m
# CONFIG_SND_SOC_RT5631 is not setCONFIG_SND_SOC_RT5640=mCONFIG_SND_SOC_RT5659=m
# CONFIG_SND_SOC_RT9120 is not set
# CONFIG_SND_SOC_RTQ9128 is not setCONFIG_SND_SOC_SGTL5000=mCONFIG_SND_SOC_SIGMADSP=mCONFIG_SND_SOC_SIGMADSP_I2C=m
# CONFIG_SND_SOC_SIMPLE_AMPLIFIER is not setCONFIG_SND_SOC_SIMPLE_MUX=m
# CONFIG_SND_SOC_SMA1303 is not setCONFIG_SND_SOC_SMA1307=mCONFIG_SND_SOC_SPDIF=mCONFIG_SND_SOC_SRC4XXX_I2C=mCONFIG_SND_SOC_SRC4XXX=mCONFIG_SND_SOC_SSM2305=m
# CONFIG_SND_SOC_SSM2518 is not set
# CONFIG_SND_SOC_SSM2602_I2C is not set
# CONFIG_SND_SOC_SSM4567 is not setCONFIG_SND_SOC_STA32X=mCONFIG_SND_SOC_STA350=mCONFIG_SND_SOC_STI_SAS=m
# CONFIG_SND_SOC_TAS2552 is not setCONFIG_SND_SOC_TAS2562=mCONFIG_SND_SOC_TAS2764=m
# CONFIG_SND_SOC_TAS2770 is not set
# CONFIG_SND_SOC_TAS2780 is not set
# CONFIG_SND_SOC_TAS2781_I2C is not setCONFIG_SND_SOC_TAS5086=mCONFIG_SND_SOC_TAS571X=mCONFIG_SND_SOC_TAS5720=mCONFIG_SND_SOC_TAS5805M=mCONFIG_SND_SOC_TAS6424=m
# CONFIG_SND_SOC_TDA7419 is not setCONFIG_SND_SOC_TFA9879=mCONFIG_SND_SOC_TFA989X=m
# CONFIG_SND_SOC_TLV320ADC3XXX is not setCONFIG_SND_SOC_TLV320AIC23=mCONFIG_SND_SOC_TLV320AIC23_I2C=mCONFIG_SND_SOC_TLV320AIC31XX=mCONFIG_SND_SOC_TLV320AIC3X=mCONFIG_SND_SOC_TLV320AIC3X_I2C=m
# CONFIG_SND_SOC_TLV320ADCX140 is not setCONFIG_SND_SOC_TS3A227E=mCONFIG_SND_SOC_TSCS42XX=mCONFIG_SND_SOC_TSCS454=mCONFIG_SND_SOC_UDA1334=mCONFIG_SND_SOC_UDA1342=mCONFIG_SND_SOC_WM8510=mCONFIG_SND_SOC_WM8523=mCONFIG_SND_SOC_WM8524=m
# CONFIG_SND_SOC_WM8580 is not setCONFIG_SND_SOC_WM8711=mCONFIG_SND_SOC_WM8728=m
# CONFIG_SND_SOC_WM8731_I2C is not setCONFIG_SND_SOC_WM8737=mCONFIG_SND_SOC_WM8741=m
# CONFIG_SND_SOC_WM8750 is not setCONFIG_SND_SOC_WM8753=mCONFIG_SND_SOC_WM8776=mCONFIG_SND_SOC_WM8782=mCONFIG_SND_SOC_WM8804=mCONFIG_SND_SOC_WM8804_I2C=m
# CONFIG_SND_SOC_WM8903 is not setCONFIG_SND_SOC_WM8904=m
# CONFIG_SND_SOC_WM8940 is not setCONFIG_SND_SOC_WM8960=mCONFIG_SND_SOC_WM8961=mCONFIG_SND_SOC_WM8962=mCONFIG_SND_SOC_WM8974=m
# CONFIG_SND_SOC_WM8978 is not setCONFIG_SND_SOC_WM8985=mCONFIG_SND_SOC_MAX9759=mCONFIG_SND_SOC_MT6351=mCONFIG_SND_SOC_MT6357=mCONFIG_SND_SOC_MT6358=mCONFIG_SND_SOC_MT6660=mCONFIG_SND_SOC_NAU8315=mCONFIG_SND_SOC_NAU8540=m
# CONFIG_SND_SOC_NAU8810 is not set
# CONFIG_SND_SOC_NAU8821 is not setCONFIG_SND_SOC_NAU8822=m
# CONFIG_SND_SOC_NAU8824 is not setCONFIG_SND_SOC_NTPFW=mCONFIG_SND_SOC_NTP8918=mCONFIG_SND_SOC_NTP8835=mCONFIG_SND_SOC_TPA6130A2=m
# end of CODEC drivers
CONFIG_SND_SIMPLE_CARD_UTILS=mCONFIG_SND_SIMPLE_CARD=m
# CONFIG_SND_X86 is not setCONFIG_SND_VIRTIO=mCONFIG_AC97_BUS=m
# CONFIG_HID_SUPPORT is not setCONFIG_USB_OHCI_LITTLE_ENDIAN=yCONFIG_USB_SUPPORT=yCONFIG_USB_COMMON=y
# CONFIG_USB_LED_TRIG is not setCONFIG_USB_ULPI_BUS=yCONFIG_USB_CONN_GPIO=yCONFIG_USB_ARCH_HAS_HCD=yCONFIG_USB=y
# CONFIG_USB_ANNOUNCE_NEW_DEVICES is not set
#
# Miscellaneous USB options
#
# CONFIG_USB_DEFAULT_PERSIST is not setCONFIG_USB_FEW_INIT_RETRIES=y
# CONFIG_USB_DYNAMIC_MINORS is not setCONFIG_USB_OTG=yCONFIG_USB_OTG_PRODUCTLIST=yCONFIG_USB_OTG_DISABLE_EXTERNAL_HUB=yCONFIG_USB_OTG_FSM=mCONFIG_USB_LEDS_TRIGGER_USBPORT=yCONFIG_USB_AUTOSUSPEND_DELAY=2CONFIG_USB_DEFAULT_AUTHORIZATION_MODE=1CONFIG_USB_MON=m
#
# USB Host Controller Drivers
#
# CONFIG_USB_C67X00_HCD is not setCONFIG_USB_XHCI_HCD=yCONFIG_USB_XHCI_DBGCAP=yCONFIG_USB_XHCI_PLATFORM=mCONFIG_USB_EHCI_HCD=m
# CONFIG_USB_EHCI_ROOT_HUB_TT is not set
# CONFIG_USB_EHCI_TT_NEWSCHED is not set
# CONFIG_USB_EHCI_FSL is not setCONFIG_USB_EHCI_HCD_PLATFORM=mCONFIG_USB_OXU210HP_HCD=mCONFIG_USB_ISP116X_HCD=yCONFIG_USB_OHCI_HCD=yCONFIG_USB_OHCI_HCD_SSB=yCONFIG_USB_OHCI_HCD_PLATFORM=yCONFIG_USB_SL811_HCD=yCONFIG_USB_SL811_HCD_ISO=yCONFIG_USB_SL811_CS=mCONFIG_USB_R8A66597_HCD=m
# CONFIG_USB_HCD_BCMA is not setCONFIG_USB_HCD_SSB=yCONFIG_USB_HCD_TEST_MODE=y
#
# USB Device Class drivers
#
# CONFIG_USB_ACM is not set
# CONFIG_USB_PRINTER is not set
# CONFIG_USB_WDM is not set
# CONFIG_USB_TMC is not set
#
# NOTE: USB_STORAGE depends on SCSI but BLK_DEV_SD may also be needed; see USB_STORAGE Help for more info #
#
# USB Imaging devices
#CONFIG_USB_MDC800=y
#
# USB dual-mode controller drivers
#CONFIG_USB_CDNS_SUPPORT=mCONFIG_USB_CDNS_HOST=yCONFIG_USB_CDNS3=mCONFIG_USB_CDNS3_HOST=y
# CONFIG_USB_MUSB_HDRC is not setCONFIG_USB_DWC3=m
# CONFIG_USB_DWC3_ULPI is not setCONFIG_USB_DWC3_HOST=y
#
# Platform Glue Driver Support
#CONFIG_USB_DWC2=mCONFIG_USB_DWC2_HOST=y
#
# Gadget/Dual-role mode requires USB Gadget support to be enabled #CONFIG_USB_DWC2_DEBUG=y
# CONFIG_USB_DWC2_VERBOSE is not set
# CONFIG_USB_DWC2_TRACK_MISSED_SOFS is not set
# CONFIG_USB_DWC2_DEBUG_PERIODIC is not set CONFIG_USB_CHIPIDEA=m
# CONFIG_USB_CHIPIDEA_HOST is not set CONFIG_USB_CHIPIDEA_MSM=mCONFIG_USB_CHIPIDEA_NPCM=m CONFIG_USB_CHIPIDEA_GENERIC=mCONFIG_USB_ISP1760=yCONFIG_USB_ISP1760_HCD=yCONFIG_USB_ISP1760_HOST_ROLE=y
#
# USB port drivers
#CONFIG_USB_SERIAL=yCONFIG_USB_SERIAL_CONSOLE=yCONFIG_USB_SERIAL_GENERIC=y
# CONFIG_USB_SERIAL_SIMPLE is not setCONFIG_USB_SERIAL_AIRCABLE=mCONFIG_USB_SERIAL_ARK3116=mCONFIG_USB_SERIAL_BELKIN=m
# CONFIG_USB_SERIAL_CH341 is not setCONFIG_USB_SERIAL_WHITEHEAT=yCONFIG_USB_SERIAL_DIGI_ACCELEPORT=y
# CONFIG_USB_SERIAL_CP210X is not setCONFIG_USB_SERIAL_CYPRESS_M8=y
# CONFIG_USB_SERIAL_EMPEG is not set
# CONFIG_USB_SERIAL_FTDI_SIO is not set
# CONFIG_USB_SERIAL_VISOR is not setCONFIG_USB_SERIAL_IPAQ=yCONFIG_USB_SERIAL_IR=m
# CONFIG_USB_SERIAL_EDGEPORT is not setCONFIG_USB_SERIAL_EDGEPORT_TI=yCONFIG_USB_SERIAL_F81232=mCONFIG_USB_SERIAL_F8153X=m
# CONFIG_USB_SERIAL_GARMIN is not set
# CONFIG_USB_SERIAL_IPW is not setCONFIG_USB_SERIAL_IUU=m
# CONFIG_USB_SERIAL_KEYSPAN_PDA is not setCONFIG_USB_SERIAL_KEYSPAN=m
# CONFIG_USB_SERIAL_KLSI is not set
# CONFIG_USB_SERIAL_KOBIL_SCT is not setCONFIG_USB_SERIAL_MCT_U232=m
# CONFIG_USB_SERIAL_METRO is not setCONFIG_USB_SERIAL_MOS7720=mCONFIG_USB_SERIAL_MOS7715_PARPORT=y
# CONFIG_USB_SERIAL_MOS7840 is not setCONFIG_USB_SERIAL_MXUPORT=mCONFIG_USB_SERIAL_NAVMAN=mCONFIG_USB_SERIAL_PL2303=yCONFIG_USB_SERIAL_OTI6858=mCONFIG_USB_SERIAL_QCAUX=yCONFIG_USB_SERIAL_QUALCOMM=y
# CONFIG_USB_SERIAL_SPCP8X5 is not setCONFIG_USB_SERIAL_SAFE=mCONFIG_USB_SERIAL_SAFE_PADDED=yCONFIG_USB_SERIAL_SIERRAWIRELESS=m
# CONFIG_USB_SERIAL_SYMBOL is not setCONFIG_USB_SERIAL_TI=yCONFIG_USB_SERIAL_CYBERJACK=mCONFIG_USB_SERIAL_WWAN=yCONFIG_USB_SERIAL_OPTION=yCONFIG_USB_SERIAL_OMNINET=yCONFIG_USB_SERIAL_OPTICON=mCONFIG_USB_SERIAL_XSENS_MT=y
# CONFIG_USB_SERIAL_WISHBONE is not setCONFIG_USB_SERIAL_SSU100=yCONFIG_USB_SERIAL_QT2=mCONFIG_USB_SERIAL_UPD78F0730=yCONFIG_USB_SERIAL_XR=yCONFIG_USB_SERIAL_DEBUG=y
#
# USB Miscellaneous drivers
#CONFIG_USB_USS720=y
# CONFIG_USB_EMI62 is not setCONFIG_USB_EMI26=yCONFIG_USB_ADUTUX=yCONFIG_USB_SEVSEG=yCONFIG_USB_LEGOTOWER=m
# CONFIG_USB_LCD is not set
# CONFIG_USB_CYPRESS_CY7C63 is not set
# CONFIG_USB_CYTHERM is not setCONFIG_USB_IDMOUSE=yCONFIG_USB_APPLEDISPLAY=mCONFIG_APPLE_MFI_FASTCHARGE=m
# CONFIG_USB_SISUSBVGA is not setCONFIG_USB_LD=mCONFIG_USB_TRANCEVIBRATOR=mCONFIG_USB_IOWARRIOR=mCONFIG_USB_TEST=mCONFIG_USB_EHSET_TEST_FIXTURE=mCONFIG_USB_ISIGHTFW=mCONFIG_USB_YUREX=yCONFIG_USB_EZUSB_FX2=yCONFIG_USB_HUB_USB251XB=yCONFIG_USB_HSIC_USB3503=yCONFIG_USB_HSIC_USB4604=yCONFIG_USB_LINK_LAYER_TEST=yCONFIG_USB_CHAOSKEY=m
#
# USB Physical Layer drivers
#CONFIG_USB_PHY=yCONFIG_NOP_USB_XCEIV=mCONFIG_USB_ISP1301=m
# end of USB Physical Layer drivers
# CONFIG_USB_GADGET is not set
# CONFIG_TYPEC is not setCONFIG_USB_ROLE_SWITCH=yCONFIG_MMC=mCONFIG_MMC_BLOCK=mCONFIG_MMC_BLOCK_MINORS=8
# CONFIG_SDIO_UART is not setCONFIG_MMC_TEST=mCONFIG_MMC_CRYPTO=y
#
# MMC/SD/SDIO Host Controller Drivers
#
# CONFIG_MMC_DEBUG is not setCONFIG_MMC_SDHCI=mCONFIG_MMC_SDHCI_PLTFM=m
# CONFIG_MMC_WBSD is not set
# CONFIG_MMC_VUB300 is not setCONFIG_MMC_USHC=m
# CONFIG_MMC_USDHI6ROL0 is not set
# CONFIG_MMC_REALTEK_USB is not set
# CONFIG_MMC_CQHCI is not set
# CONFIG_MMC_HSQ is not set
# CONFIG_MMC_SDHCI_XENON is not set
# CONFIG_MEMSTICK is not setCONFIG_LEDS_EXPRESSWIRE=yCONFIG_NEW_LEDS=yCONFIG_LEDS_CLASS=m
# CONFIG_LEDS_CLASS_FLASH is not setCONFIG_LEDS_CLASS_MULTICOLOR=mCONFIG_LEDS_BRIGHTNESS_HW_CHANGED=y
#
# LED drivers
#CONFIG_LEDS_88PM860X=mCONFIG_LEDS_APU=mCONFIG_LEDS_AW200XX=mCONFIG_LEDS_CROS_EC=mCONFIG_LEDS_LM3530=mCONFIG_LEDS_LM3532=m
# CONFIG_LEDS_LM3533 is not setCONFIG_LEDS_LM3642=mCONFIG_LEDS_MT6323=mCONFIG_LEDS_NET48XX=mCONFIG_LEDS_WRAP=mCONFIG_LEDS_PCA9532=m
# CONFIG_LEDS_PCA9532_GPIO is not setCONFIG_LEDS_GPIO=mCONFIG_LEDS_LP3944=mCONFIG_LEDS_LP3952=m
# CONFIG_LEDS_LP50XX is not set
# CONFIG_LEDS_LP8788 is not setCONFIG_LEDS_PCA955X=mCONFIG_LEDS_PCA955X_GPIO=yCONFIG_LEDS_PCA963X=mCONFIG_LEDS_PCA995X=m
# CONFIG_LEDS_WM831X_STATUS is not set
# CONFIG_LEDS_WM8350 is not setCONFIG_LEDS_DA903X=mCONFIG_LEDS_PWM=m
# CONFIG_LEDS_REGULATOR is not set
# CONFIG_LEDS_BD2606MVV is not setCONFIG_LEDS_BD2802=mCONFIG_LEDS_LT3593=mCONFIG_LEDS_MC13783=mCONFIG_LEDS_TCA6507=m
# CONFIG_LEDS_TLC591XX is not set
CONFIG_LEDS_LM355x=m
# CONFIG_LEDS_OT200 is not set
# CONFIG_LEDS_IS31FL319X is not set
#
# LED driver for blink(1) USB RGB LED is under Special HID drivers (HID_THINGM) #CONFIG_LEDS_BLINKM=mCONFIG_LEDS_BLINKM_MULTICOLOR=y
# CONFIG_LEDS_MLXCPLD is not setCONFIG_LEDS_MLXREG=m
# CONFIG_LEDS_USER is not setCONFIG_LEDS_TI_LMU_COMMON=mCONFIG_LEDS_LM36274=mCONFIG_LEDS_TPS6105X=m
#
# Flash and Torch LED drivers
#
#
# RGB LED drivers
#CONFIG_LEDS_KTD202X=m
# CONFIG_LEDS_PWM_MULTICOLOR is not set
#
# LED Triggers
#CONFIG_LEDS_TRIGGERS=y
# CONFIG_LEDS_TRIGGER_TIMER is not setCONFIG_LEDS_TRIGGER_ONESHOT=m
# CONFIG_LEDS_TRIGGER_MTD is not set
# CONFIG_LEDS_TRIGGER_HEARTBEAT is not set
# CONFIG_LEDS_TRIGGER_BACKLIGHT is not setCONFIG_LEDS_TRIGGER_CPU=y
# CONFIG_LEDS_TRIGGER_ACTIVITY is not setCONFIG_LEDS_TRIGGER_GPIO=yCONFIG_LEDS_TRIGGER_DEFAULT_ON=y
#
# iptables trigger is under Netfilter config (LED target) # CONFIG_LEDS_TRIGGER_TRANSIENT=y CONFIG_LEDS_TRIGGER_CAMERA=m CONFIG_LEDS_TRIGGER_PANIC=y # CONFIG_LEDS_TRIGGER_PATTERN is not set CONFIG_LEDS_TRIGGER_TTY=y CONFIG_LEDS_TRIGGER_INPUT_EVENTS=m
#
# Simple LED drivers
#CONFIG_LEDS_SIEMENS_SIMATIC_IPC=mCONFIG_ACCESSIBILITY=yCONFIG_A11Y_BRAILLE_CONSOLE=y
#
# Speakup console speech
#CONFIG_SPEAKUP=yCONFIG_SPEAKUP_SERIALIO=y
# CONFIG_SPEAKUP_SYNTH_ACNTSA is not set
# CONFIG_SPEAKUP_SYNTH_ACNTPC is not setCONFIG_SPEAKUP_SYNTH_APOLLO=mCONFIG_SPEAKUP_SYNTH_AUDPTR=yCONFIG_SPEAKUP_SYNTH_BNS=mCONFIG_SPEAKUP_SYNTH_DECTLK=mCONFIG_SPEAKUP_SYNTH_DECEXT=mCONFIG_SPEAKUP_SYNTH_DECPC=mCONFIG_SPEAKUP_SYNTH_DTLK=yCONFIG_SPEAKUP_SYNTH_KEYPC=y
# CONFIG_SPEAKUP_SYNTH_LTLK is not setCONFIG_SPEAKUP_SYNTH_SOFT=mCONFIG_SPEAKUP_SYNTH_SPKOUT=m
# CONFIG_SPEAKUP_SYNTH_TXPRT is not set
# CONFIG_SPEAKUP_SYNTH_DUMMY is not set
# end of Speakup console speech
CONFIG_EDAC_ATOMIC_SCRUB=yCONFIG_EDAC_SUPPORT=yCONFIG_EDAC=mCONFIG_EDAC_LEGACY_SYSFS=yCONFIG_EDAC_DEBUG=yCONFIG_RTC_LIB=yCONFIG_RTC_MC146818_LIB=yCONFIG_RTC_CLASS=y
# CONFIG_RTC_HCTOSYS is not set
# CONFIG_RTC_SYSTOHC is not setCONFIG_RTC_DEBUG=yCONFIG_RTC_LIB_KUNIT_TEST=mCONFIG_RTC_NVMEM=y
#
# RTC interfaces
#CONFIG_RTC_INTF_SYSFS=y
# CONFIG_RTC_INTF_PROC is not setCONFIG_RTC_INTF_DEV=y
# CONFIG_RTC_INTF_DEV_UIE_EMUL is not setCONFIG_RTC_DRV_TEST=m
#
# I2C RTC drivers
#
# CONFIG_RTC_DRV_88PM860X is not setCONFIG_RTC_DRV_88PM80X=mCONFIG_RTC_DRV_ABB5ZES3=mCONFIG_RTC_DRV_ABEOZ9=yCONFIG_RTC_DRV_ABX80X=m
# CONFIG_RTC_DRV_DS1307 is not setCONFIG_RTC_DRV_DS1374=m
# CONFIG_RTC_DRV_DS1672 is not set
# CONFIG_RTC_DRV_LP8788 is not setCONFIG_RTC_DRV_MAX6900=y
# CONFIG_RTC_DRV_MAX8907 is not setCONFIG_RTC_DRV_RS5C372=mCONFIG_RTC_DRV_ISL1208=mCONFIG_RTC_DRV_ISL12022=yCONFIG_RTC_DRV_X1205=yCONFIG_RTC_DRV_PCF8523=m
# CONFIG_RTC_DRV_PCF85063 is not set
# CONFIG_RTC_DRV_PCF85363 is not set
# CONFIG_RTC_DRV_PCF8563 is not set
# CONFIG_RTC_DRV_PCF8583 is not setCONFIG_RTC_DRV_M41T80=m
# CONFIG_RTC_DRV_M41T80_WDT is not setCONFIG_RTC_DRV_BQ32K=yCONFIG_RTC_DRV_PALMAS=mCONFIG_RTC_DRV_TPS6594=mCONFIG_RTC_DRV_TPS65910=yCONFIG_RTC_DRV_RC5T583=yCONFIG_RTC_DRV_S35390A=yCONFIG_RTC_DRV_FM3130=mCONFIG_RTC_DRV_RX8010=yCONFIG_RTC_DRV_RX8111=m
# CONFIG_RTC_DRV_RX8581 is not set
# CONFIG_RTC_DRV_RX8025 is not setCONFIG_RTC_DRV_EM3027=y
# CONFIG_RTC_DRV_RV3028 is not setCONFIG_RTC_DRV_RV3032=mCONFIG_RTC_DRV_RV8803=yCONFIG_RTC_DRV_SD2405AL=yCONFIG_RTC_DRV_SD3078=y
#
# SPI RTC drivers
#CONFIG_RTC_I2C_AND_SPI=y
#
# SPI and I2C RTC drivers
#CONFIG_RTC_DRV_DS3232=mCONFIG_RTC_DRV_PCF2127=m
# CONFIG_RTC_DRV_RV3029C2 is not setCONFIG_RTC_DRV_RX6110=y
#
# Platform RTC drivers
#CONFIG_RTC_DRV_CMOS=mCONFIG_RTC_DRV_DS1286=mCONFIG_RTC_DRV_DS1511=m
# CONFIG_RTC_DRV_DS1553 is not setCONFIG_RTC_DRV_DS1685_FAMILY=m
# CONFIG_RTC_DRV_DS1685 is not set
# CONFIG_RTC_DRV_DS1689 is not set
# CONFIG_RTC_DRV_DS17285 is not setCONFIG_RTC_DRV_DS17485=y
# CONFIG_RTC_DRV_DS17885 is not set
# CONFIG_RTC_DRV_DS1742 is not set
# CONFIG_RTC_DRV_DS2404 is not setCONFIG_RTC_DRV_DA9063=mCONFIG_RTC_DRV_STK17TA8=yCONFIG_RTC_DRV_M48T86=y
# CONFIG_RTC_DRV_M48T35 is not setCONFIG_RTC_DRV_M48T59=yCONFIG_RTC_DRV_MSM6242=yCONFIG_RTC_DRV_RP5C01=y
# CONFIG_RTC_DRV_WM831X is not set
# CONFIG_RTC_DRV_WM8350 is not setCONFIG_RTC_DRV_CROS_EC=m
#
# on-CPU RTC drivers
#CONFIG_RTC_DRV_FTRTC010=y
# CONFIG_RTC_DRV_MC13XXX is not setCONFIG_RTC_DRV_MT6397=m
#
# HID Sensor RTC drivers
#
# CONFIG_RTC_DRV_GOLDFISH is not setCONFIG_DMADEVICES=y
# CONFIG_DMADEVICES_DEBUG is not set
#
# DMA Devices
#CONFIG_DMA_ENGINE=yCONFIG_ALTERA_MSGDMA=y
# CONFIG_INTEL_IDMA64 is not set
# CONFIG_XILINX_DMA is not set
# CONFIG_XILINX_XDMA is not set
# CONFIG_AMD_QDMA is not set
# CONFIG_QCOM_HIDMA_MGMT is not set
# CONFIG_QCOM_HIDMA is not set
# CONFIG_DW_DMAC is not set
# CONFIG_SF_PDMA is not set
# CONFIG_INTEL_LDMA is not set
#
# DMA Clients
#CONFIG_ASYNC_TX_DMA=yCONFIG_DMATEST=yCONFIG_DMA_ENGINE_RAID=y
#
# DMABUF options
#CONFIG_SYNC_FILE=yCONFIG_SW_SYNC=y
# CONFIG_UDMABUF is not set
# CONFIG_DMABUF_MOVE_NOTIFY is not setCONFIG_DMABUF_DEBUG=yCONFIG_DMABUF_SELFTESTS=yCONFIG_DMABUF_HEAPS=yCONFIG_DMABUF_SYSFS_STATS=y
# CONFIG_DMABUF_HEAPS_SYSTEM is not set
# CONFIG_DMABUF_HEAPS_CMA is not set
# end of DMABUF options
# CONFIG_UIO is not setCONFIG_VFIO=y
# CONFIG_VFIO_DEVICE_CDEV is not setCONFIG_VFIO_GROUP=yCONFIG_VFIO_CONTAINER=yCONFIG_VFIO_IOMMU_TYPE1=y
# CONFIG_VFIO_NOIOMMU is not setCONFIG_VFIO_DEBUGFS=y
# CONFIG_VIRT_DRIVERS is not setCONFIG_VIRTIO_ANCHOR=yCONFIG_VIRTIO=yCONFIG_VIRTIO_MENU=yCONFIG_VIRTIO_BALLOON=m
# CONFIG_VIRTIO_INPUT is not setCONFIG_VIRTIO_MMIO=mCONFIG_VIRTIO_MMIO_CMDLINE_DEVICES=yCONFIG_VIRTIO_DMA_SHARED_BUFFER=yCONFIG_VIRTIO_DEBUG=y
# CONFIG_VHOST_MENU is not set
#
# Microsoft Hyper-V guest support
#
# end of Microsoft Hyper-V guest support
# CONFIG_GREYBUS is not setCONFIG_COMEDI=mCONFIG_COMEDI_DEBUG=yCONFIG_COMEDI_DEFAULT_BUF_SIZE_KB=2048CONFIG_COMEDI_DEFAULT_BUF_MAXSIZE_KB=20480
# CONFIG_COMEDI_MISC_DRIVERS is not set
# CONFIG_COMEDI_ISA_DRIVERS is not setCONFIG_COMEDI_PCMCIA_DRIVERS=mCONFIG_COMEDI_CB_DAS16_CS=mCONFIG_COMEDI_DAS08_CS=mCONFIG_COMEDI_NI_DAQ_700_CS=mCONFIG_COMEDI_NI_DAQ_DIO24_CS=mCONFIG_COMEDI_NI_LABPC_CS=mCONFIG_COMEDI_NI_MIO_CS=mCONFIG_COMEDI_QUATECH_DAQP_CS=mCONFIG_COMEDI_USB_DRIVERS=m
# CONFIG_COMEDI_DT9812 is not set
# CONFIG_COMEDI_NI_USB6501 is not setCONFIG_COMEDI_USBDUX=mCONFIG_COMEDI_USBDUXFAST=m
# CONFIG_COMEDI_USBDUXSIGMA is not setCONFIG_COMEDI_VMK80XX=mCONFIG_COMEDI_8254=mCONFIG_COMEDI_8255=mCONFIG_COMEDI_8255_SA=m
# CONFIG_COMEDI_KCOMEDILIB is not setCONFIG_COMEDI_DAS08=mCONFIG_COMEDI_NI_LABPC=mCONFIG_COMEDI_NI_TIO=mCONFIG_COMEDI_NI_ROUTING=mCONFIG_COMEDI_TESTS=m
# CONFIG_COMEDI_TESTS_EXAMPLE is not setCONFIG_COMEDI_TESTS_NI_ROUTES=m
# CONFIG_STAGING is not set
# CONFIG_GOLDFISH is not setCONFIG_CHROME_PLATFORMS=yCONFIG_CHROMEOS_LAPTOP=yCONFIG_CHROMEOS_PSTORE=mCONFIG_CROS_EC=mCONFIG_CROS_EC_I2C=mCONFIG_CROS_EC_PROTO=y
# CONFIG_CROS_KBD_LED_BACKLIGHT is not setCONFIG_CROS_EC_CHARDEV=mCONFIG_CROS_EC_LIGHTBAR=m
# CONFIG_CROS_EC_DEBUGFS is not set
# CONFIG_CROS_EC_SENSORHUB is not setCONFIG_CROS_EC_SYSFS=m
# CONFIG_CROS_USBPD_NOTIFY is not set
# CONFIG_CROS_KUNIT_EC_PROTO_TEST is not set
# CONFIG_MELLANOX_PLATFORM is not setCONFIG_SURFACE_PLATFORMS=yCONFIG_X86_PLATFORM_DEVICES=yCONFIG_X86_PLATFORM_DRIVERS_DELL=y
# CONFIG_DCDBAS is not setCONFIG_DELL_RBU=yCONFIG_DELL_SMBIOS=m
# CONFIG_X86_PLATFORM_DRIVERS_HP is not set
# CONFIG_SENSORS_HDAPS is not setCONFIG_INTEL_ATOMISP2_PDX86=yCONFIG_INTEL_ATOMISP2_LED=mCONFIG_INTEL_PUNIT_IPC=y
# CONFIG_BARCO_P50_GPIO is not set
# CONFIG_SAMSUNG_LAPTOP is not setCONFIG_SIEMENS_SIMATIC_IPC=m
# CONFIG_WINMATE_FM07_KEYS is not set
# CONFIG_COMMON_CLK is not setCONFIG_HWSPINLOCK=y
#
# Clock Source drivers
#CONFIG_CLKSRC_I8253=yCONFIG_CLKEVT_I8253=yCONFIG_I8253_LOCK=yCONFIG_CLKBLD_I8253=y
# end of Clock Source drivers
CONFIG_MAILBOX=y
# CONFIG_ALTERA_MBOX is not setCONFIG_IOMMU_IOVA=yCONFIG_IOMMU_API=yCONFIG_IOMMUFD_DRIVER=yCONFIG_IOMMU_SUPPORT=y
#
# Generic IOMMU Pagetable Support
#
# end of Generic IOMMU Pagetable Support
# CONFIG_IOMMU_DEBUGFS is not set
# CONFIG_IOMMU_DEFAULT_DMA_STRICT is not set
# CONFIG_IOMMU_DEFAULT_DMA_LAZY is not setCONFIG_IOMMU_DEFAULT_PASSTHROUGH=yCONFIG_IOMMU_DMA=yCONFIG_IOMMUFD_DRIVER_CORE=yCONFIG_IOMMUFD=yCONFIG_IOMMUFD_TEST=y
# CONFIG_VIRTIO_IOMMU is not set
#
# Remoteproc drivers
#CONFIG_REMOTEPROC=y
# CONFIG_REMOTEPROC_CDEV is not set
# end of Remoteproc drivers
#
# Rpmsg drivers
#CONFIG_RPMSG=y
# CONFIG_RPMSG_CTRL is not setCONFIG_RPMSG_NS=yCONFIG_RPMSG_QCOM_GLINK=yCONFIG_RPMSG_QCOM_GLINK_RPM=y
# CONFIG_RPMSG_VIRTIO is not set
# end of Rpmsg drivers
#
# SOC (System On Chip) specific Drivers
#
#
# Amlogic SoC drivers
#
# end of Amlogic SoC drivers
#
# Broadcom SoC drivers
#
# end of Broadcom SoC drivers
#
# NXP/Freescale QorIQ SoC drivers
#
# end of NXP/Freescale QorIQ SoC drivers
#
# fujitsu SoC drivers # # end of fujitsu SoC drivers
#
# i.MX SoC drivers
#
# end of i.MX SoC drivers
#
# Enable LiteX SoC Builder specific drivers
#
# end of Enable LiteX SoC Builder specific drivers
# CONFIG_WPCM450_SOC is not set
#
# Qualcomm SoC drivers
#CONFIG_QCOM_PMIC_PDCHARGER_ULOG=m
# end of Qualcomm SoC drivers
CONFIG_SOC_TI=y
#
# Xilinx SoC drivers
#
# end of Xilinx SoC drivers # end of SOC (System On Chip) specific Drivers
#
# PM Domains
#
#
# Amlogic PM Domains
#
# end of Amlogic PM Domains
#
# Broadcom PM Domains
#
# end of Broadcom PM Domains
#
# i.MX PM Domains
#
# end of i.MX PM Domains
#
# Qualcomm PM Domains
#
# end of Qualcomm PM Domains # end of PM Domains
# CONFIG_PM_DEVFREQ is not setCONFIG_EXTCON=y
#
# Extcon Device Drivers
#
# CONFIG_EXTCON_FSA9480 is not setCONFIG_EXTCON_GPIO=yCONFIG_EXTCON_LC824206XA=yCONFIG_EXTCON_MAX3355=yCONFIG_EXTCON_MAX77693=mCONFIG_EXTCON_PALMAS=m
# CONFIG_EXTCON_PTN5150 is not setCONFIG_EXTCON_RT8973A=m
# CONFIG_EXTCON_SM5502 is not setCONFIG_EXTCON_USB_GPIO=mCONFIG_EXTCON_USBC_CROS_EC=mCONFIG_MEMORY=y
# CONFIG_IIO is not setCONFIG_PWM=yCONFIG_PWM_DEBUG=yCONFIG_PWM_CROS_EC=mCONFIG_PWM_GPIO=yCONFIG_PWM_PCA9685=yCONFIG_PWM_TWL=mCONFIG_PWM_TWL_LED=m
#
# IRQ chip support
#
# end of IRQ chip support
CONFIG_IPACK_BUS=yCONFIG_SERIAL_IPOCTAL=mCONFIG_RESET_CONTROLLER=y
# CONFIG_RESET_GPIO is not set
# CONFIG_RESET_TI_SYSCON is not set
# CONFIG_RESET_TI_TPS380X is not set
#
# PHY Subsystem
#CONFIG_GENERIC_PHY=yCONFIG_GENERIC_PHY_MIPI_DPHY=yCONFIG_USB_LGM_PHY=m
# CONFIG_PHY_CAN_TRANSCEIVER is not set
#
# PHY drivers for Broadcom platforms
#CONFIG_BCM_KONA_USB2_PHY=m
# end of PHY drivers for Broadcom platforms
# CONFIG_PHY_PXA_28NM_HSIC is not setCONFIG_PHY_PXA_28NM_USB2=mCONFIG_PHY_QCOM_USB_HS=m
# CONFIG_PHY_QCOM_USB_HSIC is not set
# CONFIG_PHY_SAMSUNG_USB2 is not set
# CONFIG_PHY_TUSB1210 is not setCONFIG_PHY_INTEL_LGM_EMMC=m
# end of PHY Subsystem
# CONFIG_POWERCAP is not setCONFIG_MCB=yCONFIG_MCB_LPC=m
#
# Performance monitor support
#
# end of Performance monitor support
CONFIG_RAS=yCONFIG_RAS_CEC=yCONFIG_RAS_CEC_DEBUG=y
#
# Android
#
# CONFIG_ANDROID_BINDER_IPC is not set
# end of Android
CONFIG_DAX=mCONFIG_NVMEM=yCONFIG_NVMEM_SYSFS=y
# CONFIG_NVMEM_LAYOUTS is not set
# CONFIG_NVMEM_RAVE_SP_EEPROM is not setCONFIG_NVMEM_RMEM=m
#
# HW tracing support
#
# CONFIG_STM is not setCONFIG_INTEL_TH=yCONFIG_INTEL_TH_GTH=mCONFIG_INTEL_TH_MSU=yCONFIG_INTEL_TH_PTI=yCONFIG_INTEL_TH_DEBUG=y
# end of HW tracing support
CONFIG_FPGA=y
# CONFIG_ALTERA_PR_IP_CORE is not set
# CONFIG_FPGA_MGR_XILINX_SELECTMAP is not set
# CONFIG_FPGA_BRIDGE is not set
# CONFIG_FPGA_DFL is not setCONFIG_TEE=yCONFIG_SIOX=m
# CONFIG_SIOX_BUS_GPIO is not set
# CONFIG_SLIMBUS is not setCONFIG_INTERCONNECT=yCONFIG_COUNTER=yCONFIG_INTERRUPT_CNT=mCONFIG_MOST=mCONFIG_MOST_USB_HDM=mCONFIG_MOST_CDEV=mCONFIG_MOST_SND=mCONFIG_PECI=mCONFIG_PECI_CPU=mCONFIG_HTE=y
# end of Device Drivers
#
# File systems
#CONFIG_DCACHE_WORD_ACCESS=y
# CONFIG_VALIDATE_FS_PARSER is not setCONFIG_FS_IOMAP=yCONFIG_BUFFER_HEAD=yCONFIG_LEGACY_DIRECT_IO=yCONFIG_EXT2_FS=yCONFIG_EXT2_FS_XATTR=yCONFIG_EXT2_FS_POSIX_ACL=yCONFIG_EXT2_FS_SECURITY=y
# CONFIG_EXT3_FS is not setCONFIG_EXT4_FS=m
# CONFIG_EXT4_FS_POSIX_ACL is not setCONFIG_EXT4_FS_SECURITY=yCONFIG_EXT4_DEBUG=yCONFIG_EXT4_KUNIT_TESTS=mCONFIG_JBD2=m
# CONFIG_JBD2_DEBUG is not setCONFIG_FS_MBCACHE=yCONFIG_JFS_FS=y
# CONFIG_JFS_POSIX_ACL is not setCONFIG_JFS_SECURITY=yCONFIG_JFS_DEBUG=y
# CONFIG_JFS_STATISTICS is not setCONFIG_XFS_FS=yCONFIG_XFS_SUPPORT_V4=yCONFIG_XFS_SUPPORT_ASCII_CI=y
# CONFIG_XFS_QUOTA is not setCONFIG_XFS_POSIX_ACL=y
# CONFIG_XFS_RT is not set
# CONFIG_XFS_ONLINE_SCRUB is not setCONFIG_XFS_DEBUG=yCONFIG_XFS_DEBUG_EXPENSIVE=y
# CONFIG_XFS_ASSERT_FATAL is not setCONFIG_GFS2_FS=yCONFIG_BTRFS_FS=y
# CONFIG_BTRFS_FS_POSIX_ACL is not set
# CONFIG_BTRFS_FS_RUN_SANITY_TESTS is not set
# CONFIG_BTRFS_DEBUG is not setCONFIG_BTRFS_ASSERT=y
# CONFIG_BTRFS_EXPERIMENTAL is not set
# CONFIG_BTRFS_FS_REF_VERIFY is not setCONFIG_NILFS2_FS=yCONFIG_F2FS_FS=m
# CONFIG_F2FS_STAT_FS is not set
# CONFIG_F2FS_FS_XATTR is not setCONFIG_F2FS_CHECK_FS=y
# CONFIG_F2FS_FAULT_INJECTION is not setCONFIG_F2FS_FS_COMPRESSION=y
# CONFIG_F2FS_FS_LZO is not set
# CONFIG_F2FS_FS_LZ4 is not set
# CONFIG_F2FS_FS_ZSTD is not set
# CONFIG_F2FS_IOSTAT is not set
# CONFIG_BCACHEFS_FS is not setCONFIG_FS_POSIX_ACL=yCONFIG_EXPORTFS=yCONFIG_EXPORTFS_BLOCK_OPS=yCONFIG_FILE_LOCKING=y
# CONFIG_FS_ENCRYPTION is not setCONFIG_FS_VERITY=yCONFIG_FS_VERITY_BUILTIN_SIGNATURES=yCONFIG_FSNOTIFY=yCONFIG_DNOTIFY=y
# CONFIG_INOTIFY_USER is not set
# CONFIG_FANOTIFY is not setCONFIG_QUOTA=yCONFIG_QUOTA_DEBUG=yCONFIG_QUOTA_TREE=mCONFIG_QFMT_V1=mCONFIG_QFMT_V2=mCONFIG_QUOTACTL=y
# CONFIG_AUTOFS_FS is not set
# CONFIG_FUSE_FS is not set
# CONFIG_OVERLAY_FS is not set
#
# Caches
#
# end of Caches
#
# CD-ROM/DVD Filesystems
#CONFIG_ISO9660_FS=m
# CONFIG_JOLIET is not set
# CONFIG_ZISOFS is not set
# CONFIG_UDF_FS is not set
# end of CD-ROM/DVD Filesystems
#
# DOS/FAT/EXFAT/NT Filesystems
#CONFIG_FAT_FS=mCONFIG_MSDOS_FS=mCONFIG_VFAT_FS=mCONFIG_FAT_DEFAULT_CODEPAGE=437CONFIG_FAT_DEFAULT_IOCHARSET="iso8859-1"
# CONFIG_FAT_DEFAULT_UTF8 is not setCONFIG_FAT_KUNIT_TEST=mCONFIG_EXFAT_FS=yCONFIG_EXFAT_DEFAULT_IOCHARSET="utf8"CONFIG_NTFS3_FS=yCONFIG_NTFS3_LZX_XPRESS=y
# CONFIG_NTFS3_FS_POSIX_ACL is not setCONFIG_NTFS_FS=y
# end of DOS/FAT/EXFAT/NT Filesystems
#
# Pseudo filesystems
#CONFIG_PROC_FS=y
# CONFIG_PROC_KCORE is not setCONFIG_PROC_SYSCTL=yCONFIG_PROC_PAGE_MONITOR=y
# CONFIG_PROC_CHILDREN is not setCONFIG_PROC_PID_ARCH_STATUS=yCONFIG_KERNFS=yCONFIG_SYSFS=yCONFIG_TMPFS=yCONFIG_TMPFS_POSIX_ACL=yCONFIG_TMPFS_XATTR=y
# CONFIG_TMPFS_QUOTA is not set
# CONFIG_HUGETLBFS is not setCONFIG_CONFIGFS_FS=m
# end of Pseudo filesystems
CONFIG_MISC_FILESYSTEMS=y CONFIG_ORANGEFS_FS=yCONFIG_ADFS_FS=m
# CONFIG_ADFS_FS_RW is not set CONFIG_AFFS_FS=y
# CONFIG_ECRYPT_FS is not set
# CONFIG_HFS_FS is not set
# CONFIG_HFSPLUS_FS is not set CONFIG_BEFS_FS=m
# CONFIG_BEFS_DEBUG is not set CONFIG_BFS_FS=yCONFIG_EFS_FS=mCONFIG_JFFS2_FS=mCONFIG_JFFS2_FS_DEBUG=0 CONFIG_JFFS2_FS_WRITEBUFFER=y CONFIG_JFFS2_FS_WBUF_VERIFY=y
# CONFIG_JFFS2_SUMMARY is not set
# CONFIG_JFFS2_FS_XATTR is not set CONFIG_JFFS2_COMPRESSION_OPTIONS=y CONFIG_JFFS2_ZLIB=yCONFIG_JFFS2_LZO=yCONFIG_JFFS2_RTIME=y
# CONFIG_JFFS2_RUBIN is not set CONFIG_JFFS2_CMODE_NONE=y
# CONFIG_JFFS2_CMODE_PRIORITY is not set
# CONFIG_JFFS2_CMODE_SIZE is not set
# CONFIG_JFFS2_CMODE_FAVOURLZO is not set # CONFIG_CRAMFS is not set
# CONFIG_SQUASHFS is not set CONFIG_VXFS_FS=mCONFIG_MINIX_FS=mCONFIG_OMFS_FS=y
# CONFIG_HPFS_FS is not set
# CONFIG_QNX4FS_FS is not set CONFIG_QNX6FS_FS=m
# CONFIG_QNX6FS_DEBUG is not set CONFIG_ROMFS_FS=y CONFIG_ROMFS_BACKED_BY_BLOCK=y
# CONFIG_ROMFS_BACKED_BY_MTD is not set
# CONFIG_ROMFS_BACKED_BY_BOTH is not set CONFIG_ROMFS_ON_BLOCK=y
# CONFIG_PSTORE is not set CONFIG_SYSV_FS=y
# CONFIG_UFS_FS is not set
# CONFIG_EROFS_FS is not setCONFIG_NLS=y CONFIG_NLS_DEFAULT="iso8859-1"
# CONFIG_NLS_CODEPAGE_437 is not set
# CONFIG_NLS_CODEPAGE_737 is not set CONFIG_NLS_CODEPAGE_775=y
# CONFIG_NLS_CODEPAGE_850 is not set CONFIG_NLS_CODEPAGE_852=y CONFIG_NLS_CODEPAGE_855=y CONFIG_NLS_CODEPAGE_857=m CONFIG_NLS_CODEPAGE_860=m
# CONFIG_NLS_CODEPAGE_861 is not set CONFIG_NLS_CODEPAGE_862=y CONFIG_NLS_CODEPAGE_863=y CONFIG_NLS_CODEPAGE_864=y CONFIG_NLS_CODEPAGE_865=y CONFIG_NLS_CODEPAGE_866=y CONFIG_NLS_CODEPAGE_869=m CONFIG_NLS_CODEPAGE_936=y CONFIG_NLS_CODEPAGE_950=y CONFIG_NLS_CODEPAGE_932=m CONFIG_NLS_CODEPAGE_949=m
# CONFIG_NLS_CODEPAGE_874 is not set CONFIG_NLS_ISO8859_8=m CONFIG_NLS_CODEPAGE_1250=y CONFIG_NLS_CODEPAGE_1251=y CONFIG_NLS_ASCII=mCONFIG_NLS_ISO8859_1=m CONFIG_NLS_ISO8859_2=y CONFIG_NLS_ISO8859_3=y CONFIG_NLS_ISO8859_4=m
# CONFIG_NLS_ISO8859_5 is not set
# CONFIG_NLS_ISO8859_6 is not set
# CONFIG_NLS_ISO8859_7 is not set CONFIG_NLS_ISO8859_9=m CONFIG_NLS_ISO8859_13=y CONFIG_NLS_ISO8859_14=m
# CONFIG_NLS_ISO8859_15 is not set
# CONFIG_NLS_KOI8_R is not set
# CONFIG_NLS_KOI8_U is not set CONFIG_NLS_MAC_ROMAN=y CONFIG_NLS_MAC_CELTIC=m CONFIG_NLS_MAC_CENTEURO=y CONFIG_NLS_MAC_CROATIAN=y CONFIG_NLS_MAC_CYRILLIC=y CONFIG_NLS_MAC_GAELIC=y CONFIG_NLS_MAC_GREEK=m
# CONFIG_NLS_MAC_ICELAND is not set CONFIG_NLS_MAC_INUIT=y CONFIG_NLS_MAC_ROMANIAN=m
# CONFIG_NLS_MAC_TURKISH is not set
# CONFIG_NLS_UTF8 is not set CONFIG_NLS_UCS2_UTILS=yCONFIG_UNICODE=y
# CONFIG_UNICODE_NORMALIZATION_SELFTEST is not set CONFIG_IO_WQ=y
# end of File systems
#
# Security options
#CONFIG_KEYS=y
# CONFIG_KEYS_REQUEST_CACHE is not set CONFIG_PERSISTENT_KEYRINGS=yCONFIG_TRUSTED_KEYS=mCONFIG_HAVE_TRUSTED_KEYS=y
# CONFIG_TRUSTED_KEYS_TPM is not set CONFIG_TRUSTED_KEYS_TEE=y
# CONFIG_ENCRYPTED_KEYS is not set
# CONFIG_KEY_DH_OPERATIONS is not set CONFIG_SECURITY_DMESG_RESTRICT=y
# CONFIG_PROC_MEM_ALWAYS_FORCE is not set CONFIG_PROC_MEM_FORCE_PTRACE=y
# CONFIG_PROC_MEM_NO_FORCE is not set
# CONFIG_SECURITY is not setCONFIG_SECURITYFS=y
# CONFIG_HARDENED_USERCOPY is not set CONFIG_FORTIFY_SOURCE=y
# CONFIG_STATIC_USERMODEHELPER is not set CONFIG_DEFAULT_SECURITY_DAC=y CONFIG_LSM="landlock,lockdown,yama,loadpin,safesetid,ipe,bpf"
#
# Kernel hardening options
#
#
# Memory initialization
#CONFIG_CC_HAS_AUTO_VAR_INIT_PATTERN=yCONFIG_CC_HAS_AUTO_VAR_INIT_ZERO_BARE=yCONFIG_CC_HAS_AUTO_VAR_INIT_ZERO=y
# CONFIG_INIT_STACK_NONE is not set
# CONFIG_INIT_STACK_ALL_PATTERN is not setCONFIG_INIT_STACK_ALL_ZERO=yCONFIG_INIT_ON_ALLOC_DEFAULT_ON=yCONFIG_INIT_ON_FREE_DEFAULT_ON=yCONFIG_CC_HAS_ZERO_CALL_USED_REGS=yCONFIG_ZERO_CALL_USED_REGS=y
# end of Memory initialization
#
# Hardening of kernel data structures
#CONFIG_LIST_HARDENED=y
# CONFIG_BUG_ON_DATA_CORRUPTION is not set
# end of Hardening of kernel data structures
CONFIG_RANDSTRUCT_NONE=y
# end of Kernel hardening options # end of Security options
CONFIG_XOR_BLOCKS=yCONFIG_CRYPTO=y
#
# Crypto core or helper
#CONFIG_CRYPTO_ALGAPI=yCONFIG_CRYPTO_ALGAPI2=yCONFIG_CRYPTO_AEAD=yCONFIG_CRYPTO_AEAD2=yCONFIG_CRYPTO_SIG=yCONFIG_CRYPTO_SIG2=yCONFIG_CRYPTO_SKCIPHER=yCONFIG_CRYPTO_SKCIPHER2=yCONFIG_CRYPTO_HASH=yCONFIG_CRYPTO_HASH2=yCONFIG_CRYPTO_RNG=yCONFIG_CRYPTO_RNG2=yCONFIG_CRYPTO_RNG_DEFAULT=yCONFIG_CRYPTO_AKCIPHER2=yCONFIG_CRYPTO_AKCIPHER=yCONFIG_CRYPTO_KPP2=yCONFIG_CRYPTO_KPP=yCONFIG_CRYPTO_ACOMP2=yCONFIG_CRYPTO_MANAGER=yCONFIG_CRYPTO_MANAGER2=yCONFIG_CRYPTO_MANAGER_DISABLE_TESTS=yCONFIG_CRYPTO_NULL=yCONFIG_CRYPTO_NULL2=y
# CONFIG_CRYPTO_PCRYPT is not setCONFIG_CRYPTO_CRYPTD=mCONFIG_CRYPTO_AUTHENC=mCONFIG_CRYPTO_TEST=mCONFIG_CRYPTO_SIMD=mCONFIG_CRYPTO_ENGINE=m
# end of Crypto core or helper
#
# Public-key cryptography
#CONFIG_CRYPTO_RSA=yCONFIG_CRYPTO_DH=mCONFIG_CRYPTO_DH_RFC7919_GROUPS=yCONFIG_CRYPTO_ECC=yCONFIG_CRYPTO_ECDH=yCONFIG_CRYPTO_ECDSA=yCONFIG_CRYPTO_ECRDSA=yCONFIG_CRYPTO_CURVE25519=y
# end of Public-key cryptography
#
# Block ciphers
#CONFIG_CRYPTO_AES=y
# CONFIG_CRYPTO_AES_TI is not setCONFIG_CRYPTO_ARIA=y
# CONFIG_CRYPTO_BLOWFISH is not setCONFIG_CRYPTO_CAMELLIA=yCONFIG_CRYPTO_CAST_COMMON=yCONFIG_CRYPTO_CAST5=y
# CONFIG_CRYPTO_CAST6 is not setCONFIG_CRYPTO_DES=y
# CONFIG_CRYPTO_FCRYPT is not setCONFIG_CRYPTO_SERPENT=mCONFIG_CRYPTO_SM4=yCONFIG_CRYPTO_SM4_GENERIC=y
# CONFIG_CRYPTO_TWOFISH is not setCONFIG_CRYPTO_TWOFISH_COMMON=m
# end of Block ciphers
#
# Length-preserving ciphers and modes
#
# CONFIG_CRYPTO_ADIANTUM is not setCONFIG_CRYPTO_CHACHA20=yCONFIG_CRYPTO_CBC=mCONFIG_CRYPTO_CTR=yCONFIG_CRYPTO_CTS=yCONFIG_CRYPTO_ECB=yCONFIG_CRYPTO_HCTR2=mCONFIG_CRYPTO_LRW=yCONFIG_CRYPTO_PCBC=mCONFIG_CRYPTO_XCTR=mCONFIG_CRYPTO_XTS=m
# end of Length-preserving ciphers and modes
#
# AEAD (authenticated encryption with associated data) ciphers #
# CONFIG_CRYPTO_AEGIS128 is not set CONFIG_CRYPTO_CHACHA20POLY1305=m
# CONFIG_CRYPTO_CCM is not setCONFIG_CRYPTO_GCM=y
# CONFIG_CRYPTO_SEQIV is not set
# CONFIG_CRYPTO_ECHAINIV is not set
# CONFIG_CRYPTO_ESSIV is not set
# end of AEAD (authenticated encryption with associated data) ciphers
#
# Hashes, digests, and MACs
#CONFIG_CRYPTO_BLAKE2B=yCONFIG_CRYPTO_CMAC=yCONFIG_CRYPTO_GHASH=yCONFIG_CRYPTO_HMAC=y
# CONFIG_CRYPTO_MD4 is not setCONFIG_CRYPTO_MD5=mCONFIG_CRYPTO_MICHAEL_MIC=yCONFIG_CRYPTO_POLYVAL=mCONFIG_CRYPTO_POLY1305=y
# CONFIG_CRYPTO_RMD160 is not setCONFIG_CRYPTO_SHA1=yCONFIG_CRYPTO_SHA256=yCONFIG_CRYPTO_SHA512=yCONFIG_CRYPTO_SHA3=y
# CONFIG_CRYPTO_SM3_GENERIC is not setCONFIG_CRYPTO_STREEBOG=yCONFIG_CRYPTO_WP512=yCONFIG_CRYPTO_XCBC=yCONFIG_CRYPTO_XXHASH=y
# end of Hashes, digests, and MACs
#
# CRCs (cyclic redundancy checks)
#CONFIG_CRYPTO_CRC32C=yCONFIG_CRYPTO_CRC32=yCONFIG_CRYPTO_CRCT10DIF=m
# CONFIG_CRYPTO_CRC64_ROCKSOFT is not set
# end of CRCs (cyclic redundancy checks)
#
# Compression
#CONFIG_CRYPTO_DEFLATE=yCONFIG_CRYPTO_LZO=yCONFIG_CRYPTO_842=yCONFIG_CRYPTO_LZ4=yCONFIG_CRYPTO_LZ4HC=y
# CONFIG_CRYPTO_ZSTD is not set
# end of Compression
#
# Random number generation
#CONFIG_CRYPTO_ANSI_CPRNG=yCONFIG_CRYPTO_DRBG_MENU=yCONFIG_CRYPTO_DRBG_HMAC=y
# CONFIG_CRYPTO_DRBG_HASH is not set
# CONFIG_CRYPTO_DRBG_CTR is not setCONFIG_CRYPTO_DRBG=yCONFIG_CRYPTO_JITTERENTROPY=yCONFIG_CRYPTO_JITTERENTROPY_MEMORY_BLOCKS=64CONFIG_CRYPTO_JITTERENTROPY_MEMORY_BLOCKSIZE=32CONFIG_CRYPTO_JITTERENTROPY_OSR=1
# end of Random number generation
#
# Userspace interface
#
# end of Userspace interface
CONFIG_CRYPTO_HASH_INFO=y
#
# Accelerated Cryptographic Algorithms for CPU (x86) #
# CONFIG_CRYPTO_AES_NI_INTEL is not set CONFIG_CRYPTO_SERPENT_SSE2_586=m CONFIG_CRYPTO_TWOFISH_586=m
# end of Accelerated Cryptographic Algorithms for CPU (x86)
CONFIG_CRYPTO_HW=yCONFIG_CRYPTO_DEV_PADLOCK=yCONFIG_CRYPTO_DEV_PADLOCK_AES=yCONFIG_CRYPTO_DEV_PADLOCK_SHA=yCONFIG_CRYPTO_DEV_ATMEL_I2C=yCONFIG_CRYPTO_DEV_ATMEL_ECC=yCONFIG_CRYPTO_DEV_ATMEL_SHA204A=mCONFIG_CRYPTO_DEV_VIRTIO=m
# CONFIG_CRYPTO_DEV_AMLOGIC_GXL is not setCONFIG_ASYMMETRIC_KEY_TYPE=yCONFIG_ASYMMETRIC_PUBLIC_KEY_SUBTYPE=yCONFIG_X509_CERTIFICATE_PARSER=yCONFIG_PKCS8_PRIVATE_KEY_PARSER=mCONFIG_PKCS7_MESSAGE_PARSER=yCONFIG_PKCS7_TEST_KEY=mCONFIG_SIGNED_PE_FILE_VERIFICATION=yCONFIG_FIPS_SIGNATURE_SELFTEST=mCONFIG_FIPS_SIGNATURE_SELFTEST_RSA=yCONFIG_FIPS_SIGNATURE_SELFTEST_ECDSA=y
#
# Certificates for signature checking
#CONFIG_SYSTEM_TRUSTED_KEYRING=yCONFIG_SYSTEM_TRUSTED_KEYS=""
# CONFIG_SYSTEM_EXTRA_CERTIFICATE is not set
# CONFIG_SECONDARY_TRUSTED_KEYRING is not setCONFIG_SYSTEM_BLACKLIST_KEYRING=yCONFIG_SYSTEM_BLACKLIST_HASH_LIST=""
# CONFIG_SYSTEM_REVOCATION_LIST is not setCONFIG_SYSTEM_BLACKLIST_AUTH_UPDATE=y
# end of Certificates for signature checking
CONFIG_BINARY_PRINTF=y
#
# Library routines
#CONFIG_RAID6_PQ=yCONFIG_RAID6_PQ_BENCHMARK=yCONFIG_LINEAR_RANGES=y
# CONFIG_PACKING is not setCONFIG_BITREVERSE=yCONFIG_GENERIC_STRNCPY_FROM_USER=yCONFIG_GENERIC_STRNLEN_USER=yCONFIG_CORDIC=yCONFIG_PRIME_NUMBERS=mCONFIG_RATIONAL=yCONFIG_GENERIC_IOMAP=yCONFIG_ARCH_USE_CMPXCHG_LOCKREF=yCONFIG_ARCH_HAS_FAST_MULTIPLIER=yCONFIG_ARCH_USE_SYM_ANNOTATIONS=y
#
# Crypto library routines
#CONFIG_CRYPTO_LIB_UTILS=yCONFIG_CRYPTO_LIB_AES=yCONFIG_CRYPTO_LIB_GF128MUL=yCONFIG_CRYPTO_LIB_BLAKE2S_GENERIC=yCONFIG_CRYPTO_LIB_CHACHA_GENERIC=y
# CONFIG_CRYPTO_LIB_CHACHA is not setCONFIG_CRYPTO_LIB_CURVE25519_GENERIC=yCONFIG_CRYPTO_LIB_CURVE25519=mCONFIG_CRYPTO_LIB_DES=yCONFIG_CRYPTO_LIB_POLY1305_RSIZE=1CONFIG_CRYPTO_LIB_POLY1305_GENERIC=yCONFIG_CRYPTO_LIB_POLY1305=y
# CONFIG_CRYPTO_LIB_CHACHA20POLY1305 is not setCONFIG_CRYPTO_LIB_SHA1=yCONFIG_CRYPTO_LIB_SHA256=y
# end of Crypto library routines
CONFIG_CRC_CCITT=mCONFIG_CRC16=yCONFIG_CRC_T10DIF=m
# CONFIG_CRC64_ROCKSOFT is not setCONFIG_CRC_ITU_T=yCONFIG_CRC32=yCONFIG_ARCH_HAS_CRC32=yCONFIG_CRC32_ARCH=yCONFIG_CRC64=mCONFIG_CRC4=m
# CONFIG_CRC7 is not setCONFIG_LIBCRC32C=yCONFIG_CRC8=yCONFIG_CRC_OPTIMIZATIONS=yCONFIG_XXHASH=yCONFIG_RANDOM32_SELFTEST=yCONFIG_842_COMPRESS=yCONFIG_842_DECOMPRESS=yCONFIG_ZLIB_INFLATE=yCONFIG_ZLIB_DEFLATE=yCONFIG_LZO_COMPRESS=yCONFIG_LZO_DECOMPRESS=yCONFIG_LZ4_COMPRESS=yCONFIG_LZ4HC_COMPRESS=yCONFIG_LZ4_DECOMPRESS=yCONFIG_ZSTD_COMMON=yCONFIG_ZSTD_COMPRESS=yCONFIG_ZSTD_DECOMPRESS=yCONFIG_XZ_DEC=yCONFIG_XZ_DEC_X86=yCONFIG_XZ_DEC_POWERPC=yCONFIG_XZ_DEC_ARM=yCONFIG_XZ_DEC_ARMTHUMB=yCONFIG_XZ_DEC_ARM64=yCONFIG_XZ_DEC_SPARC=yCONFIG_XZ_DEC_RISCV=y
# CONFIG_XZ_DEC_MICROLZMA is not setCONFIG_XZ_DEC_BCJ=yCONFIG_XZ_DEC_TEST=yCONFIG_DECOMPRESS_BZIP2=yCONFIG_DECOMPRESS_XZ=yCONFIG_GENERIC_ALLOCATOR=yCONFIG_BCH=yCONFIG_INTERVAL_TREE=yCONFIG_INTERVAL_TREE_SPAN_ITER=yCONFIG_XARRAY_MULTI=yCONFIG_ASSOCIATIVE_ARRAY=yCONFIG_HAS_IOMEM=yCONFIG_HAS_IOPORT=yCONFIG_HAS_IOPORT_MAP=yCONFIG_HAS_DMA=yCONFIG_DMA_OPS_HELPERS=yCONFIG_NEED_SG_DMA_LENGTH=yCONFIG_NEED_DMA_MAP_STATE=yCONFIG_ARCH_DMA_ADDR_T_64BIT=yCONFIG_DMA_NEED_SYNC=yCONFIG_DMA_CMA=y
#
# Default contiguous memory area size:
#CONFIG_CMA_SIZE_PERCENTAGE=0
# CONFIG_CMA_SIZE_SEL_MBYTES is not setCONFIG_CMA_SIZE_SEL_PERCENTAGE=y
# CONFIG_CMA_SIZE_SEL_MIN is not set
# CONFIG_CMA_SIZE_SEL_MAX is not setCONFIG_CMA_ALIGNMENT=8CONFIG_DMA_API_DEBUG=yCONFIG_DMA_MAP_BENCHMARK=yCONFIG_SGL_ALLOC=yCONFIG_GLOB=yCONFIG_GLOB_SELFTEST=mCONFIG_CLZ_TAB=y
# CONFIG_IRQ_POLL is not setCONFIG_MPILIB=yCONFIG_OID_REGISTRY=yCONFIG_HAVE_GENERIC_VDSO=yCONFIG_GENERIC_GETTIMEOFDAY=yCONFIG_GENERIC_VDSO_32=yCONFIG_GENERIC_VDSO_TIME_NS=yCONFIG_GENERIC_VDSO_OVERFLOW_PROTECT=yCONFIG_GENERIC_VDSO_DATA_STORE=yCONFIG_FONT_SUPPORT=yCONFIG_FONTS=y
CONFIG_FONT_8x16=y
# CONFIG_FONT_MINI_4x6 is not set
# CONFIG_FONT_6x10 is not setCONFIG_FONT_AUTOSELECT=yCONFIG_SG_POOL=yCONFIG_ARCH_HAS_CPU_CACHE_INVALIDATE_MEMREGION=yCONFIG_ARCH_STACKWALK=yCONFIG_STACKDEPOT=yCONFIG_STACKDEPOT_MAX_FRAMES=64CONFIG_SBITMAP=y
# CONFIG_LWQ_TEST is not set
# end of Library routines
#
# Kernel hacking
#
#
# printk and dmesg options # CONFIG_PRINTK_TIME=y CONFIG_PRINTK_CALLER=y # CONFIG_STACKTRACE_BUILD_ID is not set CONFIG_CONSOLE_LOGLEVEL_DEFAULT=7 CONFIG_CONSOLE_LOGLEVEL_QUIET=4 CONFIG_MESSAGE_LOGLEVEL_DEFAULT=4 CONFIG_BOOT_PRINTK_DELAY=y CONFIG_DYNAMIC_DEBUG=y CONFIG_DYNAMIC_DEBUG_CORE=y CONFIG_SYMBOLIC_ERRNAME=y CONFIG_DEBUG_BUGVERBOSE=y # end of printk and dmesg options
CONFIG_DEBUG_KERNEL=y
# CONFIG_DEBUG_MISC is not set
#
# Compile-time checks and compiler options
#CONFIG_AS_HAS_NON_CONST_ULEB128=y CONFIG_DEBUG_INFO_NONE=y
# CONFIG_DEBUG_INFO_DWARF_TOOLCHAIN_DEFAULT is not set # CONFIG_DEBUG_INFO_DWARF4 is not set
# CONFIG_DEBUG_INFO_DWARF5 is not set CONFIG_FRAME_WARN=1024 CONFIG_STRIP_ASM_SYMS=y
# CONFIG_READABLE_ASM is not set
# CONFIG_HEADERS_INSTALL is not set CONFIG_DEBUG_SECTION_MISMATCH=y CONFIG_SECTION_MISMATCH_WARN_ONLY=y CONFIG_ARCH_WANT_FRAME_POINTERS=y CONFIG_FRAME_POINTER=y
# CONFIG_DEBUG_FORCE_WEAK_PER_CPU is not set
# end of Compile-time checks and compiler options
#
# Generic Kernel Debugging Instruments
#CONFIG_MAGIC_SYSRQ=yCONFIG_MAGIC_SYSRQ_DEFAULT_ENABLE=0x1CONFIG_MAGIC_SYSRQ_SERIAL=yCONFIG_MAGIC_SYSRQ_SERIAL_SEQUENCE=""CONFIG_DEBUG_FS=y
# CONFIG_DEBUG_FS_ALLOW_ALL is not setCONFIG_DEBUG_FS_DISALLOW_MOUNT=y
# CONFIG_DEBUG_FS_ALLOW_NONE is not setCONFIG_HAVE_ARCH_KGDB=y
# CONFIG_KGDB is not setCONFIG_ARCH_HAS_UBSAN=y
# CONFIG_UBSAN is not setCONFIG_HAVE_KCSAN_COMPILER=y
# end of Generic Kernel Debugging Instruments
#
# Networking Debugging
#
# end of Networking Debugging
#
# Memory Debugging
#CONFIG_PAGE_EXTENSION=yCONFIG_DEBUG_PAGEALLOC=yCONFIG_DEBUG_PAGEALLOC_ENABLE_DEFAULT=yCONFIG_SLUB_DEBUG=y
# CONFIG_SLUB_DEBUG_ON is not setCONFIG_PAGE_OWNER=yCONFIG_PAGE_POISONING=yCONFIG_DEBUG_PAGE_REF=yCONFIG_DEBUG_RODATA_TEST=yCONFIG_ARCH_HAS_DEBUG_WX=y
# CONFIG_DEBUG_WX is not setCONFIG_GENERIC_PTDUMP=y
# CONFIG_PTDUMP_DEBUGFS is not setCONFIG_HAVE_DEBUG_KMEMLEAK=y
# CONFIG_DEBUG_KMEMLEAK is not set
# CONFIG_DEBUG_OBJECTS is not setCONFIG_SHRINKER_DEBUG=yCONFIG_DEBUG_STACK_USAGE=y
# CONFIG_SCHED_STACK_END_CHECK is not set
# CONFIG_DEBUG_VM is not setCONFIG_ARCH_HAS_DEBUG_VIRTUAL=yCONFIG_DEBUG_VIRTUAL=yCONFIG_DEBUG_MEMORY_INIT=y
# CONFIG_DEBUG_PER_CPU_MAPS is not setCONFIG_DEBUG_KMAP_LOCAL=yCONFIG_ARCH_SUPPORTS_KMAP_LOCAL_FORCE_MAP=yCONFIG_DEBUG_KMAP_LOCAL_FORCE_MAP=y
# CONFIG_DEBUG_HIGHMEM is not setCONFIG_HAVE_DEBUG_STACKOVERFLOW=yCONFIG_DEBUG_STACKOVERFLOW=yCONFIG_CODE_TAGGING=yCONFIG_MEM_ALLOC_PROFILING=yCONFIG_MEM_ALLOC_PROFILING_ENABLED_BY_DEFAULT=yCONFIG_MEM_ALLOC_PROFILING_DEBUG=yCONFIG_CC_HAS_KASAN_GENERIC=yCONFIG_CC_HAS_KASAN_SW_TAGS=yCONFIG_CC_HAS_WORKING_NOSANITIZE_ADDRESS=yCONFIG_HAVE_ARCH_KFENCE=yCONFIG_KFENCE=yCONFIG_KFENCE_SAMPLE_INTERVAL=100CONFIG_KFENCE_NUM_OBJECTS=255CONFIG_KFENCE_DEFERRABLE=yCONFIG_KFENCE_STRESS_TEST_FAULTS=0CONFIG_KFENCE_KUNIT_TEST=m
# end of Memory Debugging
CONFIG_DEBUG_SHIRQ=y
#
# Debug Oops, Lockups and Hangs
#
# CONFIG_PANIC_ON_OOPS is not setCONFIG_PANIC_ON_OOPS_VALUE=0CONFIG_PANIC_TIMEOUT=0CONFIG_LOCKUP_DETECTOR=yCONFIG_SOFTLOCKUP_DETECTOR=y
# CONFIG_BOOTPARAM_SOFTLOCKUP_PANIC is not setCONFIG_HAVE_HARDLOCKUP_DETECTOR_BUDDY=y
# CONFIG_HARDLOCKUP_DETECTOR is not setCONFIG_DETECT_HUNG_TASK=yCONFIG_DEFAULT_HUNG_TASK_TIMEOUT=120
# CONFIG_BOOTPARAM_HUNG_TASK_PANIC is not setCONFIG_WQ_WATCHDOG=y
# CONFIG_WQ_CPU_INTENSIVE_REPORT is not set
# CONFIG_TEST_LOCKUP is not set
# end of Debug Oops, Lockups and Hangs
#
# Scheduler Debugging
#CONFIG_SCHED_DEBUG=yCONFIG_SCHED_INFO=yCONFIG_SCHEDSTATS=y
# end of Scheduler Debugging
# CONFIG_DEBUG_PREEMPT is not set
#
# Lock Debugging (spinlocks, mutexes, etc...)
#CONFIG_LOCK_DEBUGGING_SUPPORT=y
# CONFIG_PROVE_LOCKING is not setCONFIG_LOCK_STAT=yCONFIG_DEBUG_RT_MUTEXES=yCONFIG_DEBUG_SPINLOCK=yCONFIG_DEBUG_MUTEXES=y
# CONFIG_DEBUG_WW_MUTEX_SLOWPATH is not set
# CONFIG_DEBUG_RWSEMS is not setCONFIG_DEBUG_LOCK_ALLOC=yCONFIG_LOCKDEP=yCONFIG_LOCKDEP_BITS=15CONFIG_LOCKDEP_CHAINS_BITS=16CONFIG_LOCKDEP_STACK_TRACE_BITS=19CONFIG_LOCKDEP_STACK_TRACE_HASH_BITS=14CONFIG_LOCKDEP_CIRCULAR_QUEUE_BITS=12
# CONFIG_DEBUG_LOCKDEP is not setCONFIG_DEBUG_ATOMIC_SLEEP=yCONFIG_DEBUG_LOCKING_API_SELFTESTS=yCONFIG_LOCK_TORTURE_TEST=mCONFIG_WW_MUTEX_SELFTEST=mCONFIG_SCF_TORTURE_TEST=m
# end of Lock Debugging (spinlocks, mutexes, etc...)
CONFIG_TRACE_IRQFLAGS=yCONFIG_TRACE_IRQFLAGS_NMI=y
# CONFIG_NMI_CHECK_CPU is not setCONFIG_DEBUG_IRQFLAGS=yCONFIG_STACKTRACE=y
# CONFIG_WARN_ALL_UNSEEDED_RANDOM is not set
# CONFIG_DEBUG_KOBJECT is not set
#
# Debug kernel data structures
#CONFIG_DEBUG_LIST=y
# CONFIG_DEBUG_PLIST is not setCONFIG_DEBUG_SG=yCONFIG_DEBUG_NOTIFIERS=yCONFIG_DEBUG_MAPLE_TREE=y
# end of Debug kernel data structures
#
# RCU Debugging
#CONFIG_TORTURE_TEST=m
# CONFIG_RCU_SCALE_TEST is not set
# CONFIG_RCU_TORTURE_TEST is not setCONFIG_RCU_REF_SCALE_TEST=mCONFIG_RCU_CPU_STALL_TIMEOUT=21CONFIG_RCU_EXP_CPU_STALL_TIMEOUT=0CONFIG_RCU_CPU_STALL_CPUTIME=yCONFIG_RCU_CPU_STALL_NOTIFIER=yCONFIG_RCU_TRACE=y
# CONFIG_RCU_EQS_DEBUG is not set
# end of RCU Debugging
# CONFIG_DEBUG_WQ_FORCE_RR_CPU is not set
# CONFIG_CPU_HOTPLUG_STATE_CONTROL is not set CONFIG_LATENCYTOP=y CONFIG_USER_STACKTRACE_SUPPORT=y CONFIG_NOP_TRACER=yCONFIG_HAVE_RETHOOK=y CONFIG_HAVE_FUNCTION_TRACER=y CONFIG_HAVE_FUNCTION_GRAPH_TRACER=y CONFIG_HAVE_FUNCTION_GRAPH_FREGS=y CONFIG_HAVE_FTRACE_GRAPH_FUNC=y CONFIG_HAVE_DYNAMIC_FTRACE=y CONFIG_HAVE_DYNAMIC_FTRACE_WITH_REGS=y CONFIG_HAVE_DYNAMIC_FTRACE_WITH_DIRECT_CALLS=y CONFIG_HAVE_DYNAMIC_FTRACE_NO_PATCHABLE=y CONFIG_HAVE_FTRACE_MCOUNT_RECORD=y CONFIG_HAVE_SYSCALL_TRACEPOINTS=y CONFIG_HAVE_C_RECORDMCOUNT=y CONFIG_HAVE_BUILDTIME_MCOUNT_SORT=y CONFIG_TRACER_MAX_TRACE=y CONFIG_TRACE_CLOCK=yCONFIG_RING_BUFFER=yCONFIG_EVENT_TRACING=y CONFIG_CONTEXT_SWITCH_TRACER=y CONFIG_RING_BUFFER_ALLOW_SWAP=y CONFIG_PREEMPTIRQ_TRACEPOINTS=y CONFIG_TRACING=yCONFIG_GENERIC_TRACER=y CONFIG_TRACING_SUPPORT=yCONFIG_FTRACE=yCONFIG_BOOTTIME_TRACING=y
# CONFIG_FUNCTION_TRACER is not set
# CONFIG_STACK_TRACER is not set CONFIG_IRQSOFF_TRACER=y
# CONFIG_PREEMPT_TRACER is not set
# CONFIG_SCHED_TRACER is not set CONFIG_HWLAT_TRACER=y
# CONFIG_OSNOISE_TRACER is not set
# CONFIG_TIMERLAT_TRACER is not set
# CONFIG_FTRACE_SYSCALLS is not set CONFIG_TRACER_SNAPSHOT=y CONFIG_TRACER_SNAPSHOT_PER_CPU_SWAP=y CONFIG_BRANCH_PROFILE_NONE=y
# CONFIG_PROFILE_ANNOTATED_BRANCHES is not set # CONFIG_BLK_DEV_IO_TRACE is not set
# CONFIG_UPROBE_EVENTS is not set CONFIG_DYNAMIC_EVENTS=yCONFIG_TRACING_MAP=yCONFIG_SYNTH_EVENTS=yCONFIG_USER_EVENTS=yCONFIG_HIST_TRIGGERS=y CONFIG_TRACE_EVENT_INJECT=y CONFIG_TRACEPOINT_BENCHMARK=y
# CONFIG_RING_BUFFER_BENCHMARK is not set CONFIG_TRACE_EVAL_MAP_FILE=y CONFIG_FTRACE_SELFTEST=y CONFIG_FTRACE_STARTUP_TEST=y CONFIG_EVENT_TRACE_STARTUP_TEST=y
# CONFIG_EVENT_TRACE_TEST_SYSCALLS is not set # CONFIG_RING_BUFFER_STARTUP_TEST is not set # CONFIG_RING_BUFFER_VALIDATE_TIME_DELTAS is not set CONFIG_PREEMPTIRQ_DELAY_TEST=m CONFIG_SYNTH_EVENT_GEN_TEST=m
# CONFIG_HIST_TRIGGERS_DEBUG is not set
# CONFIG_RV is not set
# CONFIG_SAMPLES is not set CONFIG_ARCH_HAS_DEVMEM_IS_ALLOWED=y
#
# x86 Debugging # CONFIG_X86_VERBOSE_BOOTUP=y CONFIG_EARLY_PRINTK=y CONFIG_DEBUG_TLBFLUSH=y CONFIG_HAVE_MMIOTRACE_SUPPORT=y # CONFIG_X86_DECODER_SELFTEST is not set # CONFIG_IO_DELAY_0X80 is not set # CONFIG_IO_DELAY_0XED is not set # CONFIG_IO_DELAY_UDELAY is not set CONFIG_IO_DELAY_NONE=y # CONFIG_DEBUG_BOOT_PARAMS is not set # CONFIG_CPA_DEBUG is not set # CONFIG_DEBUG_ENTRY is not set # CONFIG_DEBUG_NMI_SELFTEST is not set CONFIG_X86_DEBUG_FPU=y CONFIG_UNWINDER_FRAME_POINTER=y # end of x86 Debugging
#
# Kernel Testing and Coverage
#CONFIG_KUNIT=m
# CONFIG_KUNIT_DEBUGFS is not set
# CONFIG_KUNIT_FAULT_TEST is not set CONFIG_KUNIT_TEST=m CONFIG_KUNIT_EXAMPLE_TEST=m CONFIG_KUNIT_ALL_TESTS=m CONFIG_KUNIT_DEFAULT_ENABLED=y
# CONFIG_KUNIT_AUTORUN_ENABLED is not set CONFIG_NOTIFIER_ERROR_INJECTION=y CONFIG_PM_NOTIFIER_ERROR_INJECT=y CONFIG_FAULT_INJECTION=yCONFIG_FAILSLAB=y
# CONFIG_FAIL_PAGE_ALLOC is not set
# CONFIG_FAULT_INJECTION_USERCOPY is not set # CONFIG_FAIL_MAKE_REQUEST is not set CONFIG_FAIL_IO_TIMEOUT=yCONFIG_FAIL_FUTEX=y CONFIG_FAULT_INJECTION_DEBUG_FS=y CONFIG_FAIL_MMC_REQUEST=y
# CONFIG_FAIL_SKB_REALLOC is not set
# CONFIG_FAULT_INJECTION_CONFIGFS is not set # CONFIG_FAULT_INJECTION_STACKTRACE_FILTER is not set CONFIG_CC_HAS_SANCOV_TRACE_PC=y CONFIG_RUNTIME_TESTING_MENU=y CONFIG_TEST_DHRY=yCONFIG_LKDTM=mCONFIG_CPUMASK_KUNIT_TEST=m CONFIG_TEST_LIST_SORT=m CONFIG_TEST_MIN_HEAP=mCONFIG_TEST_SORT=mCONFIG_TEST_DIV64=y
# CONFIG_TEST_MULDIV64 is not set
# CONFIG_TEST_IOV_ITER is not set CONFIG_BACKTRACE_SELF_TEST=m
# CONFIG_TEST_REF_TRACKER is not set CONFIG_RBTREE_TEST=m
# CONFIG_REED_SOLOMON_TEST is not set CONFIG_INTERVAL_TREE_TEST=m
# CONFIG_PERCPU_TEST is not set CONFIG_ATOMIC64_SELFTEST=y
# CONFIG_TEST_HEXDUMP is not set
# CONFIG_STRING_KUNIT_TEST is not set CONFIG_STRING_HELPERS_KUNIT_TEST=m CONFIG_TEST_KSTRTOX=m
# CONFIG_TEST_PRINTF is not set
# CONFIG_TEST_SCANF is not set CONFIG_TEST_BITMAP=yCONFIG_TEST_UUID=yCONFIG_TEST_XARRAY=mCONFIG_TEST_MAPLE_TREE=m CONFIG_TEST_RHASHTABLE=yCONFIG_TEST_IDA=y
# CONFIG_TEST_MISC_MINOR is not set CONFIG_TEST_LKM=mCONFIG_TEST_BITOPS=yCONFIG_TEST_VMALLOC=m CONFIG_FIND_BIT_BENCHMARK=m CONFIG_TEST_FIRMWARE=y
# CONFIG_TEST_SYSCTL is not set
# CONFIG_BITFIELD_KUNIT is not set CONFIG_CHECKSUM_KUNIT=m CONFIG_UTIL_MACROS_KUNIT=m
# CONFIG_HASH_KUNIT_TEST is not set CONFIG_RESOURCE_KUNIT_TEST=m
# CONFIG_SYSCTL_KUNIT_TEST is not set CONFIG_LIST_KUNIT_TEST=m
# CONFIG_HASHTABLE_KUNIT_TEST is not set CONFIG_LINEAR_RANGES_TEST=m CONFIG_CMDLINE_KUNIT_TEST=m CONFIG_BITS_TEST=m
# CONFIG_SLUB_KUNIT_TEST is not set CONFIG_RATIONAL_KUNIT_TEST=m CONFIG_MEMCPY_KUNIT_TEST=m CONFIG_IS_SIGNED_TYPE_KUNIT_TEST=m CONFIG_OVERFLOW_KUNIT_TEST=m
# CONFIG_STACKINIT_KUNIT_TEST is not set
# CONFIG_FORTIFY_KUNIT_TEST is not set CONFIG_CRC_KUNIT_TEST=m CONFIG_CRC_BENCHMARK=y CONFIG_SIPHASH_KUNIT_TEST=m CONFIG_USERCOPY_KUNIT_TEST=m
# CONFIG_TEST_UDELAY is not set
# CONFIG_TEST_STATIC_KEYS is not set CONFIG_TEST_DYNAMIC_DEBUG=y
# CONFIG_TEST_KALLSYMS is not set CONFIG_TEST_DEBUG_VIRTUAL=y CONFIG_TEST_MEMCAT_P=mCONFIG_TEST_MEMINIT=m CONFIG_TEST_FREE_PAGES=y
# CONFIG_TEST_FPU is not set CONFIG_TEST_CLOCKSOURCE_WATCHDOG=m CONFIG_TEST_OBJPOOL=mCONFIG_INT_POW_TEST=m CONFIG_INT_SQRT_KUNIT_TEST=m CONFIG_ARCH_USE_MEMTEST=yCONFIG_MEMTEST=y
# end of Kernel Testing and Coverage
#
# Rust hacking
#
# end of Rust hacking # end of Kernel hacking
Quoted 21 lines · Ingo Molnar
Quoted 5 lines · Brian Gerst
Quoted 5 lines
arch/x86/kernel/vmlinux.lds.S +1
-1- PERCPU_SECTION(INTERNODE_CACHE_BYTES) + PERCPU_SECTION(L1_CACHE_BYTES) ASSERT(__per_cpu_hot_end - __per_cpu_hot_start <= 64, "percpu cache hot section too large")Quoted 7 lines
Quoted 2 lines
RUNTIME_CONST_VARIABLESThat is probably the right call. The initial percpu section is just used by the boot cpu early and as a template for the dynamically allocated percpu memory, which should account for the proper alignment for NUMA.
Okay.
Randconfig testing found another corner case with the attached config:
Quoted 7 lines
KSYMS .tmp_vmlinux0.kallsyms.S AS .tmp_vmlinux0.kallsyms.o LD .tmp_vmlinux1ld: percpu cache hot section too large
make[2]: *** [scripts/Makefile.vmlinux:77: vmlinux] Error 1(I haven't figured out the root cause yet.)
CONFIG_MPENTIUM4 sets X86_L1_CACHE_SHIFT to 7 (128 bytes).
Brian Gerst
Quoted 28 lines · Brian Gerst
Quoted 27 lines · Ingo Molnar
Quoted 5 lines · Brian Gerst
Quoted 5 lines
arch/x86/kernel/vmlinux.lds.S +1
-1- PERCPU_SECTION(INTERNODE_CACHE_BYTES) + PERCPU_SECTION(L1_CACHE_BYTES) ASSERT(__per_cpu_hot_end - __per_cpu_hot_start <= 64, "percpu cache hot section too large")Quoted 7 lines
Quoted 2 lines
RUNTIME_CONST_VARIABLESThat is probably the right call. The initial percpu section is just used by the boot cpu early and as a template for the dynamically allocated percpu memory, which should account for the proper alignment for NUMA.
Okay.
Randconfig testing found another corner case with the attached config:
KSYMS .tmp_vmlinux0.kallsyms.S AS .tmp_vmlinux0.kallsyms.o LD .tmp_vmlinux1ld: percpu cache hot section too large
make[2]: *** [scripts/Makefile.vmlinux:77: vmlinux] Error 1
Quoted 3 lines
Quoted 1 line
(I haven't figured out the root cause yet.)
CONFIG_MPENTIUM4setsX86_L1_CACHE_SHIFTto 7 (128 bytes).
Hm, to resolve this I'd go for the easy out of explicitly using '64' as the size limit - like we did it in the C space.
Thanks,
Ingo
Quoted 32 lines · Ingo Molnar
Quoted 28 lines · Brian Gerst
Quoted 27 lines · Ingo Molnar
Quoted 5 lines · Brian Gerst
Quoted 5 lines
arch/x86/kernel/vmlinux.lds.S +1
-1- PERCPU_SECTION(INTERNODE_CACHE_BYTES) + PERCPU_SECTION(L1_CACHE_BYTES) ASSERT(__per_cpu_hot_end - __per_cpu_hot_start <= 64, "percpu cache hot section too large")Quoted 7 lines
Quoted 2 lines
RUNTIME_CONST_VARIABLESThat is probably the right call. The initial percpu section is just used by the boot cpu early and as a template for the dynamically allocated percpu memory, which should account for the proper alignment for NUMA.
Okay.
Randconfig testing found another corner case with the attached config:
KSYMS .tmp_vmlinux0.kallsyms.S AS .tmp_vmlinux0.kallsyms.o LD .tmp_vmlinux1ld: percpu cache hot section too large
make[2]: *** [scripts/Makefile.vmlinux:77: vmlinux] Error 1
Quoted 6 lines
Quoted 3 lines
Quoted 1 line
(I haven't figured out the root cause yet.)
CONFIG_MPENTIUM4setsX86_L1_CACHE_SHIFTto 7 (128 bytes).Hm, to resolve this I'd go for the easy out of explicitly using '64' as the size limit - like we did it in the C space.
Why not simply:
ASSERT(__per_cpu_hot_end - __per_cpu_hot_start <= L1_CACHE_BYTES, "...")
?
Uros.
Quoted 37 lines · Uros Bizjak
Quoted 36 lines · Ingo Molnar
Quoted 31 lines · Brian Gerst
Quoted 21 lines · Ingo Molnar
Quoted 5 lines · Brian Gerst
Quoted 5 lines
arch/x86/kernel/vmlinux.lds.S +1
-1- PERCPU_SECTION(INTERNODE_CACHE_BYTES) + PERCPU_SECTION(L1_CACHE_BYTES) ASSERT(__per_cpu_hot_end - __per_cpu_hot_start <= 64, "percpu cache hot section too large")Quoted 7 lines
Quoted 2 lines
RUNTIME_CONST_VARIABLESThat is probably the right call. The initial percpu section is just used by the boot cpu early and as a template for the dynamically allocated percpu memory, which should account for the proper alignment for NUMA.
Okay.
Randconfig testing found another corner case with the attached config:
Quoted 7 lines
KSYMS .tmp_vmlinux0.kallsyms.S AS .tmp_vmlinux0.kallsyms.o LD .tmp_vmlinux1ld: percpu cache hot section too large
make[2]: *** [scripts/Makefile.vmlinux:77: vmlinux] Error 1(I haven't figured out the root cause yet.)
CONFIG_MPENTIUM4setsX86_L1_CACHE_SHIFTto 7 (128 bytes).
Quoted 8 lines
Quoted 2 lines
Hm, to resolve this I'd go for the easy out of explicitly using '64' as the size limit - like we did it in the C space.
Why not simply:
ASSERT(__per_cpu_hot_end - __per_cpu_hot_start <= L1_CACHE_BYTES, "...")?
I don't think it's a great idea to randomly allow a larger section depending on the .config ... The *actual* intended limit is 64, not 128 and not 4096, so I'd suggest we write it out as before.
Thanks,
Ingo
Quoted 46 lines · Ingo Molnar
Quoted 42 lines · Uros Bizjak
Quoted 32 lines · Ingo Molnar
Quoted 28 lines · Brian Gerst
Quoted 27 lines · Ingo Molnar
Quoted 5 lines · Brian Gerst
Quoted 5 lines
(quoted diff) +1
-1- PERCPU_SECTION(INTERNODE_CACHE_BYTES) + PERCPU_SECTION(L1_CACHE_BYTES) ASSERT(__per_cpu_hot_end - __per_cpu_hot_start <= 64, "percpu cache hot section too large")Quoted 7 lines
Quoted 2 lines
RUNTIME_CONST_VARIABLESThat is probably the right call. The initial percpu section is just used by the boot cpu early and as a template for the dynamically allocated percpu memory, which should account for the proper alignment for NUMA.
Okay.
Randconfig testing found another corner case with the attached config:
KSYMS .tmp_vmlinux0.kallsyms.S AS .tmp_vmlinux0.kallsyms.o LD .tmp_vmlinux1ld: percpu cache hot section too large
make[2]: *** [scripts/Makefile.vmlinux:77: vmlinux] Error 1Quoted 6 lines
Quoted 3 lines
Quoted 1 line
(I haven't figured out the root cause yet.)
CONFIG_MPENTIUM4setsX86_L1_CACHE_SHIFTto 7 (128 bytes).Hm, to resolve this I'd go for the easy out of explicitly using '64' as the size limit - like we did it in the C space.
Why not simply:
Quoted 7 lines
Quoted 3 lines
ASSERT(__per_cpu_hot_end - __per_cpu_hot_start <= L1_CACHE_BYTES, "...")?
I don't think it's a great idea to randomly allow a larger section depending on the .config ... The *actual* intended limit is 64, not 128 and not 4096, so I'd suggest we write it out as before.
Change the assert to:
ASSERT(__per_cpu_hot_pad - __per_cpu_hot_start <= 64, "percpu
cache hot section too large")
We only care about the used portion, not the padded end.
Brian Gerst
Quoted 56 lines · Brian Gerst
Quoted 46 lines · Ingo Molnar
Quoted 42 lines · Uros Bizjak
Quoted 32 lines · Ingo Molnar
Quoted 28 lines · Brian Gerst
Quoted 27 lines · Ingo Molnar
Quoted 5 lines · Brian Gerst
Quoted 5 lines
(quoted diff) +1
-1- PERCPU_SECTION(INTERNODE_CACHE_BYTES) + PERCPU_SECTION(L1_CACHE_BYTES) ASSERT(__per_cpu_hot_end - __per_cpu_hot_start <= 64, "percpu cache hot section too large")Quoted 7 lines
Quoted 2 lines
RUNTIME_CONST_VARIABLESThat is probably the right call. The initial percpu section is just used by the boot cpu early and as a template for the dynamically allocated percpu memory, which should account for the proper alignment for NUMA.
Okay.
Randconfig testing found another corner case with the attached config:
KSYMS .tmp_vmlinux0.kallsyms.S AS .tmp_vmlinux0.kallsyms.o LD .tmp_vmlinux1ld: percpu cache hot section too large
make[2]: *** [scripts/Makefile.vmlinux:77: vmlinux] Error 1Quoted 6 lines
Quoted 3 lines
Quoted 1 line
(I haven't figured out the root cause yet.)
CONFIG_MPENTIUM4setsX86_L1_CACHE_SHIFTto 7 (128 bytes).Hm, to resolve this I'd go for the easy out of explicitly using '64' as the size limit - like we did it in the C space.
Why not simply:
Quoted 7 lines
Quoted 3 lines
ASSERT(__per_cpu_hot_end - __per_cpu_hot_start <= L1_CACHE_BYTES, "...")?
I don't think it's a great idea to randomly allow a larger section depending on the .config ... The *actual* intended limit is 64, not 128 and not 4096, so I'd suggest we write it out as before.
Quoted 5 lines
Change the assert to:
ASSERT(__per_cpu_hot_pad - __per_cpu_hot_start <= 64, "percpucache hot section too large")
We only care about the used portion, not the padded end.
If this is the case, perhaps it is better to use __per_cpu_hot_end to mark the end of the real data, as in the attached patch.
Uros.
include/asm-generic/vmlinux.lds.h +1 -2
@@ -1071,9 +1071,8 @@ defined(CONFIG_AUTOFDO_CLANG) || defined(CONFIG_PROPELLER_CLANG) . = ALIGN(cacheline); \ __per_cpu_hot_start = .; \ *(SORT_BY_ALIGNMENT(.data..percpu..hot.*)) \ - __per_cpu_hot_pad = .; \ - . = ALIGN(cacheline); \ __per_cpu_hot_end = .; \ + . = ALIGN(cacheline); \ *(.data..percpu..read_mostly) \ . = ALIGN(cacheline); \ *(.data..percpu) \
Quoted 58 lines · Uros Bizjak
Quoted 56 lines · Brian Gerst
Quoted 53 lines · Ingo Molnar
Quoted 37 lines · Uros Bizjak
Quoted 36 lines · Ingo Molnar
Quoted 31 lines · Brian Gerst
Quoted 21 lines · Ingo Molnar
Quoted 5 lines · Brian Gerst
Quoted 5 lines
(quoted diff) +1
-1- PERCPU_SECTION(INTERNODE_CACHE_BYTES) + PERCPU_SECTION(L1_CACHE_BYTES) ASSERT(__per_cpu_hot_end - __per_cpu_hot_start <= 64, "percpu cache hot section too large")Quoted 7 lines
Quoted 2 lines
RUNTIME_CONST_VARIABLESThat is probably the right call. The initial percpu section is just used by the boot cpu early and as a template for the dynamically allocated percpu memory, which should account for the proper alignment for NUMA.
Okay.
Randconfig testing found another corner case with the attached config:
Quoted 7 lines
KSYMS .tmp_vmlinux0.kallsyms.S AS .tmp_vmlinux0.kallsyms.o LD .tmp_vmlinux1ld: percpu cache hot section too large
make[2]: *** [scripts/Makefile.vmlinux:77: vmlinux] Error 1(I haven't figured out the root cause yet.)
CONFIG_MPENTIUM4setsX86_L1_CACHE_SHIFTto 7 (128 bytes).Quoted 8 lines
Quoted 2 lines
Hm, to resolve this I'd go for the easy out of explicitly using '64' as the size limit - like we did it in the C space.
Why not simply:
ASSERT(__per_cpu_hot_end - __per_cpu_hot_start <= L1_CACHE_BYTES, "...")?
I don't think it's a great idea to randomly allow a larger section depending on the .config ... The *actual* intended limit is 64, not 128 and not 4096, so I'd suggest we write it out as before.
Quoted 8 lines
Quoted 5 lines
Change the assert to:
ASSERT(__per_cpu_hot_pad - __per_cpu_hot_start <= 64, "percpucache hot section too large")
We only care about the used portion, not the padded end.
If this is the case, perhaps it is better to use
__per_cpu_hot_endto mark the end of the real data, as in the attached patch.
That's a better approach. There's not much value in the current _end symbol if it's not always _start+64.
Brian Gerst
Quoted 64 lines · Brian Gerst
Quoted 62 lines · Uros Bizjak
Quoted 60 lines · Brian Gerst
Quoted 46 lines · Ingo Molnar
Quoted 42 lines · Uros Bizjak
Quoted 32 lines · Ingo Molnar
Quoted 28 lines · Brian Gerst
Quoted 27 lines · Ingo Molnar
Quoted 5 lines · Brian Gerst
Quoted 5 lines
(quoted diff) +1
-1- PERCPU_SECTION(INTERNODE_CACHE_BYTES) + PERCPU_SECTION(L1_CACHE_BYTES) ASSERT(__per_cpu_hot_end - __per_cpu_hot_start <= 64, "percpu cache hot section too large")Quoted 7 lines
Quoted 2 lines
RUNTIME_CONST_VARIABLESThat is probably the right call. The initial percpu section is just used by the boot cpu early and as a template for the dynamically allocated percpu memory, which should account for the proper alignment for NUMA.
Okay.
Randconfig testing found another corner case with the attached config:
KSYMS .tmp_vmlinux0.kallsyms.S AS .tmp_vmlinux0.kallsyms.o LD .tmp_vmlinux1ld: percpu cache hot section too large
make[2]: *** [scripts/Makefile.vmlinux:77: vmlinux] Error 1Quoted 6 lines
Quoted 3 lines
Quoted 1 line
(I haven't figured out the root cause yet.)
CONFIG_MPENTIUM4setsX86_L1_CACHE_SHIFTto 7 (128 bytes).Hm, to resolve this I'd go for the easy out of explicitly using '64' as the size limit - like we did it in the C space.
Why not simply:
Quoted 7 lines
Quoted 3 lines
ASSERT(__per_cpu_hot_end - __per_cpu_hot_start <= L1_CACHE_BYTES, "...")?
I don't think it's a great idea to randomly allow a larger section depending on the .config ... The *actual* intended limit is 64, not 128 and not 4096, so I'd suggest we write it out as before.
Change the assert to:
ASSERT(__per_cpu_hot_pad - __per_cpu_hot_start <= 64, "percpucache hot section too large")
Quoted 7 lines
Quoted 4 lines
Quoted 1 line
We only care about the used portion, not the padded end.
If this is the case, perhaps it is better to use
__per_cpu_hot_endto mark the end of the real data, as in the attached patch.That's a better approach. There's not much value in the current
_endsymbol if it's not always _start+64.
Thanks, I'll submit a formal patch submission.
Uros.