stackdepot: Make max number of pools build-time configurable
Subsystems (2)
PATCH v2 1/1 stackdepot: Make max number of pools build-time configurable
From: Matt Fleming <[email protected]>
We're hitting the WARN in depot_init_pool() about reaching the stack depot limit because we have long stacks that don't dedup very well.
Introduce a new config to allow users to set the number of maximum stack depot pools at build time. Also, turn the silent capping into a build-time assert to provide more obvious feedback when users set this value too high.
---
Changes in v2:
- Replace BUILD_BUG_ON with static_assert()
- Hide STACKDEPOT_MAX_POOLS behind EXPERT
lib/Kconfig | 6 ++++++ lib/stackdepot.c | 8 ++++---- 2 files changed, 10 insertions(+), 4 deletions(-)
lib/Kconfig +6 -0
@@ -720,6 +720,12 @@ config STACKDEPOT_MAX_FRAMES default 64 depends on STACKDEPOT +config STACKDEPOT_MAX_POOLS + int "Maximum number of stack depot pools to store stack traces" if EXPERT + range 1024 131071 + default 8192 + depends on STACKDEPOT + config REF_TRACKER bool depends on STACKTRACE_SUPPORT
lib/stackdepot.c +4 -4
@@ -36,11 +36,11 @@#include <linux/memblock.h> #include <linux/kasan-enabled.h> -#define DEPOT_POOLS_CAP 8192 +#define DEPOT_MAX_POOLS CONFIG_STACKDEPOT_MAX_POOLS +/* The pool_index is offset by 1 so the first record does not have a 0 handle. */ -#define DEPOT_MAX_POOLS \ - (((1LL << (DEPOT_POOL_INDEX_BITS)) - 1 < DEPOT_POOLS_CAP) ? \ - (1LL << (DEPOT_POOL_INDEX_BITS)) - 1 : DEPOT_POOLS_CAP) +static_assert (DEPOT_MAX_POOLS <= (1LL << (DEPOT_POOL_INDEX_BITS )) -1 ); +static bool stack_depot_disabled;static bool __stack_depot_early_init_requested__initdata =IS_ENABLED (CONFIG_STACKDEPOT_ALWAYS_INIT );
Signature · 1 line
2.34.1
Andrew Morton
maintainerQuoted 15 lines · On Fri, 4 Jul 2025 13:06:04 +0100 Matt Fleming <[email protected]> wrote:
From: Matt Fleming <[email protected]>
We're hitting the WARN in
depot_init_pool()about reaching the stack depot limit because we have long stacks that don't dedup very well.Introduce a new config to allow users to set the number of maximum stack depot pools at build time. Also, turn the silent capping into a build-time assert to provide more obvious feedback when users set this value too high.
...
lib/Kconfig config STACKDEPOT_MAX_FRAMES · line 727
Quoted 8 lines
lib/Kconfig +5
-0@@ -720,6 +720,12 @@ config STACKDEPOT_MAX_FRAMES default 64 depends on STACKDEPOT +config STACKDEPOT_MAX_POOLS + int "Maximum number of stack depot pools to store stack traces" if EXPERT + range 1024 131071 + default 8192 + depends on STACKDEPOT
Do we need a range? If someone wants values outside the range they'll just edit the Kconfig, shrug.
lib/stackdepot.c line 39
Quoted 13 lines
lib/Kconfig +0
-0config REF_TRACKER bool depends on STACKTRACE_SUPPORTlib/stackdepot.c +1
-1@@ -36,11 +36,11 @@#include <linux/memblock.h> #include <linux/kasan-enabled.h> -#define DEPOT_POOLS_CAP 8192 +#define DEPOT_MAX_POOLS CONFIG_STACKDEPOT_MAX_POOLS
A boot-time option would be much friendlier. Can we dynamically allocate stack_pools[]?
Or possibly even runtime, although perhaps not a good effort-to-utility ratio.
kernel test robot
build botkernel test robot noticed the following build errors:
Hi Matt,
kernel test robot noticed the following build errors:
[auto build test ERROR on akpm-mm/mm-nonmm-unstable]
[also build test ERROR on linus/master v6.16-rc4 next-20250704] [cannot apply to akpm-mm/mm-everything]
[If your patch is applied to the wrong git tree, kindly drop us a note. And when submitting patch, we suggest to use '--base' as documented in
https://git-scm.com/docs/git-format-patch#_base_tree_information]
url: https://github.com/intel-lab-lkp/linux/commits/Matt-Fleming/stackdepot-Make-max-number-of-pools-build-time-configurable/20250704-200804 base: https://git.kernel.org/pub/scm/linux/kernel/git/akpm/mm.git mm-nonmm-unstable patch link: https://lore.kernel.org/r/20250704120604.2688934-1-matt%40readmodwrite.com patch subject: [PATCH v2] stackdepot: Make max number of pools build-time configurable config: arm64-randconfig-001-20250705 (https://download.01.org/0day-ci/archive/20250705/[email protected]/config) compiler: aarch64-linux-gcc (GCC) 10.5.0 reproduce (this is a W=1 build): (https://download.01.org/0day-ci/archive/20250705/[email protected]/reproduce)
If you fix the issue in a separate patch/commit (i.e. not just a new version of the same patch/commit), kindly add following tags
| Reported-by: kernel test robot <[email protected]>
| Closes: https://lore.kernel.org/oe-kbuild-all/[email protected]/
All errors (new ones prefixed by >>):
In file included from include/linux/init.h:5,
from include/linux/printk.h:6,
from include/asm-generic/bug.h:22,
from arch/arm64/include/asm/bug.h:26,
from include/linux/bug.h:5,
from include/linux/vfsdebug.h:5,
from include/linux/fs.h:5,
from include/linux/debugfs.h:15,
from lib/stackdepot.c:17:
>> include/linux/build_bug.h:78:41: error: static assertion failed: "DEPOT_MAX_POOLS <= (1LL << (DEPOT_POOL_INDEX_BITS)) - 1"
78 | #define __static_assert(expr, msg, ...) _Static_assert(expr, msg)
| ^~~~~~~~~~~~~~
include/linux/build_bug.h:77:34: note: in expansion of macro '__static_assert'
77 | #define static_assert(expr, ...) __static_assert(expr, ##__VA_ARGS__, #expr)
| ^~~~~~~~~~~~~~~
lib/stackdepot.c:42:1: note: in expansion of macro 'static_assert'
42 | static_assert(DEPOT_MAX_POOLS <= (1LL << (DEPOT_POOL_INDEX_BITS)) - 1);
| ^~~~~~~~~~~~~vim +78 include/linux/build_bug.h
bc6245e5efd70c Ian Abbott 2017-07-10 60 6bab69c65013be Rasmus Villemoes 2019-03-07 61 /** 6bab69c65013be Rasmus Villemoes 2019-03-07 62 * static_assert - check integer constant expression at build time 6bab69c65013be Rasmus Villemoes 2019-03-07 63 * 6bab69c65013be Rasmus Villemoes 2019-03-07 64 * static_assert() is a wrapper for the C11 _Static_assert, with a 6bab69c65013be Rasmus Villemoes 2019-03-07 65 * little macro magic to make the message optional (defaulting to the 6bab69c65013be Rasmus Villemoes 2019-03-07 66 * stringification of the tested expression). 6bab69c65013be Rasmus Villemoes 2019-03-07 67 * 6bab69c65013be Rasmus Villemoes 2019-03-07 68 * Contrary to BUILD_BUG_ON(), static_assert() can be used at global 6bab69c65013be Rasmus Villemoes 2019-03-07 69 * scope, but requires the expression to be an integer constant 6bab69c65013be Rasmus Villemoes 2019-03-07 70 * expression (i.e., it is not enough that __builtin_constant_p() is 6bab69c65013be Rasmus Villemoes 2019-03-07 71 * true for expr). 6bab69c65013be Rasmus Villemoes 2019-03-07 72 * 6bab69c65013be Rasmus Villemoes 2019-03-07 73 * Also note that BUILD_BUG_ON() fails the build if the condition is 6bab69c65013be Rasmus Villemoes 2019-03-07 74 * true, while static_assert() fails the build if the expression is 6bab69c65013be Rasmus Villemoes 2019-03-07 75 * false. 6bab69c65013be Rasmus Villemoes 2019-03-07 76 */ 6bab69c65013be Rasmus Villemoes 2019-03-07 77 #define static_assert(expr, ...) __static_assert(expr, ##__VA_ARGS__, #expr)
6bab69c65013be Rasmus Villemoes 2019-03-07 @78 #define __static_assert(expr, msg, ...) _Static_assert(expr, msg) 6bab69c65013be Rasmus Villemoes 2019-03-07 7907a368b3f55a79 Maxim Levitsky 2022-10-25 80
Signature · 2 lines
0-DAY CI Kernel Test Service https://github.com/intel/lkp-tests/wiki
Quoted 37 lines · kernel test robot
Hi Matt,
kernel test robot noticed the following build errors:
[auto build test ERROR on akpm-mm/mm-nonmm-unstable]
[also build test ERROR on linus/master v6.16-rc4 next-20250704] [cannot apply to akpm-mm/mm-everything]
[If your patch is applied to the wrong git tree, kindly drop us a note. And when submitting patch, we suggest to use '--base' as documented in
https://git-scm.com/docs/git-format-patch#_base_tree_information]url: https://github.com/intel-lab-lkp/linux/commits/Matt-Fleming/stackdepot-Make-max-number-of-pools-build-time-configurable/20250704-200804 base: https://git.kernel.org/pub/scm/linux/kernel/git/akpm/mm.git mm-nonmm-unstable patch link: https://lore.kernel.org/r/20250704120604.2688934-1-matt%40readmodwrite.com patch subject: [PATCH v2] stackdepot: Make max number of pools build-time configurable config: arm64-randconfig-001-20250705 (https://download.01.org/0day-ci/archive/20250705/[email protected]/config) compiler: aarch64-linux-gcc (GCC) 10.5.0 reproduce (this is a W=1 build): (https://download.01.org/0day-ci/archive/20250705/[email protected]/reproduce)If you fix the issue in a separate patch/commit (i.e. not just a new version of the same patch/commit), kindly add following tags
| Reported-by: kernel test robot <[email protected]>
| Closes: https://lore.kernel.org/oe-kbuild-all/[email protected]/All errors (new ones prefixed by >>):
In file included from
include/linux/init.h:5,from include/linux/printk.h:6, from include/asm-generic/bug.h:22, from arch/arm64/include/asm/bug.h:26, from include/linux/bug.h:5, from include/linux/vfsdebug.h:5, from include/linux/fs.h:5, from include/linux/debugfs.h:15, from lib/stackdepot.c:17:Quoted 1 line
Quoted 1 line
include/linux/build_bug.h:78:41: error: static assertion failed: "DEPOT_MAX_POOLS<= (1LL << (DEPOT_POOL_INDEX_BITS)) - 1"
Quoted 8 lines
78 | #define __static_assert(expr, msg, ...) _Static_assert(expr, msg)
| ^~~~~~~~~~~~~~
include/linux/build_bug.h:77:34: note: in expansion of macro '__static_assert'
77 | #define static_assert(expr, ...) __static_assert(expr, ##__VA_ARGS__, #expr)
| ^~~~~~~~~~~~~~~
lib/stackdepot.c:42:1: note: in expansion of macro 'static_assert'
42 | static_assert(DEPOT_MAX_POOLS <= (1LL << (DEPOT_POOL_INDEX_BITS)) - 1);
| ^~~~~~~~~~~~~This is odd. The randconfig here uses the default:
Quoted 1 line
CONFIG_STACKDEPOT_MAX_POOLS=8192
Quoted 41 lines · Andrew Morton
Quoted 15 lines · On Fri, 4 Jul 2025 13:06:04 +0100 Matt Fleming <[email protected]> wrote:
From: Matt Fleming <[email protected]>
We're hitting the WARN in
depot_init_pool()about reaching the stack depot limit because we have long stacks that don't dedup very well.Introduce a new config to allow users to set the number of maximum stack depot pools at build time. Also, turn the silent capping into a build-time assert to provide more obvious feedback when users set this value too high.
...
lib/Kconfig config STACKDEPOT_MAX_FRAMES · line 727
Quoted 8 lines
lib/Kconfig +5
-0@@ -720,6 +720,12 @@ config STACKDEPOT_MAX_FRAMES default 64 depends on STACKDEPOT +config STACKDEPOT_MAX_POOLS + int "Maximum number of stack depot pools to store stack traces" if EXPERT + range 1024 131071 + default 8192 + depends on STACKDEPOTDo we need a range? If someone wants values outside the range they'll just edit the
Kconfig, shrug.Quoted 11 lines
lib/Kconfig +0
-0config REF_TRACKER bool depends on STACKTRACE_SUPPORTlib/stackdepot.c +0
-0@@ -36,11 +36,11 @@#include <linux/memblock.h> #include <linux/kasan-enabled.h>
Quoted 5 lines
lib/stackdepot.c line 39
Quoted 2 lines
lib/stackdepot.c +1
-1-#define DEPOT_POOLS_CAP 8192 +#define DEPOT_MAX_POOLS CONFIG_STACKDEPOT_MAX_POOLSA boot-time option would be much friendlier. Can we dynamically allocate stack_pools[]?
We could allocate this in stack_depot_init(). I think it wasn't done so far as requiring a very large number of pools is typically indicative of stackdepot misuse.
In any case, I agree it's better if this were configurable at boot time. However, need to be careful to sanitize user inputs (reject too small, reject too large).
Matt, do you think this would work better for your usecase rather than rebuilding the kernel?
Quoted 2 lines
Or possibly even runtime, although perhaps not a good effort-to-utility ratio.
Could make stack_pools an RCU-protected array and resize on demand. But given stackdepot can be used from constrained contexts, the dance around RCU might be brittle (see existing RCU usage in stackdepot). Along with the fact that arbitrary resizing likely indicates a usage bug, it might be safer to just allocate on boot.
Quoted 48 lines · Marco Elver
Quoted 37 lines · kernel test robot
Hi Matt,
kernel test robot noticed the following build errors:
[auto build test ERROR on akpm-mm/mm-nonmm-unstable]
[also build test ERROR on linus/master v6.16-rc4 next-20250704] [cannot apply to akpm-mm/mm-everything]
[If your patch is applied to the wrong git tree, kindly drop us a note. And when submitting patch, we suggest to use '--base' as documented in
https://git-scm.com/docs/git-format-patch#_base_tree_information]url: https://github.com/intel-lab-lkp/linux/commits/Matt-Fleming/stackdepot-Make-max-number-of-pools-build-time-configurable/20250704-200804 base: https://git.kernel.org/pub/scm/linux/kernel/git/akpm/mm.git mm-nonmm-unstable patch link: https://lore.kernel.org/r/20250704120604.2688934-1-matt%40readmodwrite.com patch subject: [PATCH v2] stackdepot: Make max number of pools build-time configurable config: arm64-randconfig-001-20250705 (https://download.01.org/0day-ci/archive/20250705/[email protected]/config) compiler: aarch64-linux-gcc (GCC) 10.5.0 reproduce (this is a W=1 build): (https://download.01.org/0day-ci/archive/20250705/[email protected]/reproduce)If you fix the issue in a separate patch/commit (i.e. not just a new version of the same patch/commit), kindly add following tags
| Reported-by: kernel test robot <[email protected]>
| Closes: https://lore.kernel.org/oe-kbuild-all/[email protected]/All errors (new ones prefixed by >>):
In file included from
include/linux/init.h:5,from include/linux/printk.h:6, from include/asm-generic/bug.h:22, from arch/arm64/include/asm/bug.h:26, from include/linux/bug.h:5, from include/linux/vfsdebug.h:5, from include/linux/fs.h:5, from include/linux/debugfs.h:15, from lib/stackdepot.c:17:Quoted 1 line
Quoted 1 line
include/linux/build_bug.h:78:41: error: static assertion failed: "DEPOT_MAX_POOLS<= (1LL << (DEPOT_POOL_INDEX_BITS)) - 1"Quoted 8 lines
78 | #define __static_assert(expr, msg, ...) _Static_assert(expr, msg) | ^~~~~~~~~~~~~~ include/linux/build_bug.h:77:34: note: in expansion of macro '__static_assert' 77 | #define static_assert(expr, ...) __static_assert(expr, ##__VA_ARGS__, #expr) | ^~~~~~~~~~~~~~~ lib/stackdepot.c:42:1: note: in expansion of macro 'static_assert' 42 | static_assert(DEPOT_MAX_POOLS <= (1LL << (DEPOT_POOL_INDEX_BITS)) - 1); | ^~~~~~~~~~~~~
Quoted 3 lines
This is odd. The randconfig here uses the default:
Quoted 1 line
CONFIG_STACKDEPOT_MAX_POOLS=8192
Ugh, I see what's happened here. For this config, the expression evaluates to
static_assert(8192 <= 8191);
So the default needs to be 8191.
Quoted 11 lines · Marco Elver
We could allocate this in
stack_depot_init(). I think it wasn't done so far as requiring a very large number of pools is typically indicative of stackdepot misuse.In any case, I agree it's better if this were configurable at boot time. However, need to be careful to sanitize user inputs (reject too small, reject too large).
Matt, do you think this would work better for your usecase rather than rebuilding the kernel?
Yep, that's a better option. I'll send a new version.