tracing: fprobe: function_graph: Multi-function graph and fprobe on fgraph
Subsystems (15)
Masami Hiramatsu (Google)
maintainerv13 cover tracing: fprobe: function_graph: Multi-function graph and fprobe on fgraph
Hi,
Here is the 13th version of the series to re-implement the fprobe on function-graph tracer. The previous version is;
https://lore.kernel.org/all/172000134410.63468.13742222887213469474.stgit@devnote2/
This version is based on v6.11-rc3.
In this version, I added a bugfix as [1/20], which should go to urgent branch, and dropped the performance improvement patch which was introduced in v12 because I found that does not work with new kernel.
Overview
--------
This series rewrites the fprobe on this function-graph. The purposes of this change are;
1) Remove dependency of the rethook from fprobe so that we can reduce the return hook code and shadow stack.
2) Make 'ftrace_regs' the common trace interface for the function boundary.
1) Currently we have 2(or 3) different function return hook codes, the function-graph tracer and rethook (and legacy kretprobe). But since this is redundant and needs double maintenance cost, I would like to unify those. From the user's viewpoint, function- graph tracer is very useful to grasp the execution path. For this purpose, it is hard to use the rethook in the function-graph tracer, but the opposite is possible. (Strictly speaking, kretprobe can not use it because it requires 'pt_regs' for historical reasons.)
2) Now the fprobe provides the 'pt_regs' for its handler, but that is wrong for the function entry and exit. Moreover, depending on the architecture, there is no way to accurately reproduce 'pt_regs' outside of interrupt or exception handlers. This means fprobe should not use 'pt_regs' because it does not use such exceptions. (Conversely, kprobe should use 'pt_regs' because it is an abstract interface of the software breakpoint exception.)
This series changes fprobe to use function-graph tracer for tracing function entry and exit, instead of mixture of ftrace and rethook. Unlike the rethook which is a per-task list of system-wide allocated nodes, the function graph's ret_stack is a per-task shadow stack. Thus it does not need to set 'nr_maxactive' (which is the number of pre-allocated nodes).
Also the handlers will get the 'ftrace_regs' instead of 'pt_regs'. Since eBPF mulit_kprobe/multi_kretprobe events still use 'pt_regs' as their register interface, this changes it to convert 'ftrace_regs' to 'pt_regs'. Of course this conversion makes an incomplete 'pt_regs', so users must access only registers for function parameters or return value.
Design
------
Instead of using ftrace's function entry hook directly, the new fprobe is built on top of the function-graph's entry and return callbacks with 'ftrace_regs'.
Since the fprobe requires access to 'ftrace_regs', the architecture must support CONFIG_HAVE_DYNAMIC_FTRACE_WITH_ARGS and CONFIG_HAVE_FTRACE_GRAPH_FUNC, which enables to call function-graph entry callback with 'ftrace_regs', and also CONFIG_HAVE_FUNCTION_GRAPH_FREGS, which passes the ftrace_regs to return_to_handler.
All fprobes share a single function-graph ops (means shares a common ftrace filter) similar to the kprobe-on-ftrace. This needs another layer to find corresponding fprobe in the common function-graph callbacks, but has much better scalability, since the number of registered function-graph ops is limited.
In the entry callback, the fprobe runs its entry_handler and saves the address of 'fprobe' on the function-graph's shadow stack as data. The return callback decodes the data to get the 'fprobe' address, and runs the exit_handler.
The fprobe introduces two hash-tables, one is for entry callback which searches fprobes related to the given function address passed by entry callback. The other is for a return callback which checks if the given 'fprobe' data structure pointer is still valid. Note that it is possible to unregister fprobe before the return callback runs. Thus the address validation must be done before using it in the return callback.
Download
--------
This series can be applied against the ftrace/for-next branch in linux-trace tree.
This series can also be found below branch.
https://git.kernel.org/pub/scm/linux/kernel/git/mhiramat/linux.git/log/?h=topic/fprobe-on-fgraph
Thank you,
---
Masami Hiramatsu (Google) (20):
tracing: fgraph: Fix to add new fgraph_ops to array after ftrace_startup_subops()
tracing: Add a comment about ftrace_regs definition
tracing: Rename ftrace_regs_return_value to ftrace_regs_get_return_value
function_graph: Pass ftrace_regs to entryfunc
function_graph: Replace fgraph_ret_regs with ftrace_regs
function_graph: Pass ftrace_regs to retfunc
fprobe: Use ftrace_regs in fprobe entry handler
fprobe: Use ftrace_regs in fprobe exit handler
tracing: Add ftrace_partial_regs() for converting ftrace_regs to pt_regs
tracing: Add ftrace_fill_perf_regs() for perf event
tracing/fprobe: Enable fprobe events with CONFIG_DYNAMIC_FTRACE_WITH_ARGS
bpf: Enable kprobe_multi feature if CONFIG_FPROBE is enabled
ftrace: Add CONFIG_HAVE_FTRACE_GRAPH_FUNC
fprobe: Rewrite fprobe on function-graph tracer
tracing: Fix function timing profiler to initialize hashtable tracing/fprobe: Remove nr_maxactive from fprobe
selftests: ftrace: Remove obsolate maxactive syntax check selftests/ftrace: Add a test case for repeating register/unregister fprobe
Documentation: probes: Update fprobe on function-graph tracer
fgraph: Skip recording calltime/rettime if it is not nneeded
Documentation/trace/fprobe.rst | 42 + arch/arm64/Kconfig | 2 arch/arm64/include/asm/ftrace.h | 47 + arch/arm64/kernel/asm-offsets.c | 12 arch/arm64/kernel/entry-ftrace.S | 32 + arch/arm64/kernel/ftrace.c | 20 + arch/loongarch/Kconfig | 4 arch/loongarch/include/asm/ftrace.h | 32 - arch/loongarch/kernel/asm-offsets.c | 12 arch/loongarch/kernel/ftrace_dyn.c | 10 arch/loongarch/kernel/mcount.S | 17 - arch/loongarch/kernel/mcount_dyn.S | 14 arch/powerpc/Kconfig | 1 arch/powerpc/include/asm/ftrace.h | 15 arch/powerpc/kernel/trace/ftrace.c | 2 arch/powerpc/kernel/trace/ftrace_64_pg.c | 10 arch/riscv/Kconfig | 3 arch/riscv/include/asm/ftrace.h | 26 - arch/riscv/kernel/ftrace.c | 17 + arch/riscv/kernel/mcount.S | 24 - arch/s390/Kconfig | 3 arch/s390/include/asm/ftrace.h | 39 + arch/s390/kernel/asm-offsets.c | 6 arch/s390/kernel/mcount.S | 9 arch/x86/Kconfig | 4 arch/x86/include/asm/ftrace.h | 37 + arch/x86/kernel/ftrace.c | 50 +- arch/x86/kernel/ftrace_32.S | 15 arch/x86/kernel/ftrace_64.S | 17 - include/linux/fprobe.h | 57 +- include/linux/ftrace.h | 136 ++++ kernel/trace/Kconfig | 23 + kernel/trace/bpf_trace.c | 19 - kernel/trace/fgraph.c | 127 +++- kernel/trace/fprobe.c | 638 ++++++++++++++------ kernel/trace/ftrace.c | 10 kernel/trace/trace.h | 6 kernel/trace/trace_fprobe.c | 147 ++--- kernel/trace/trace_functions_graph.c | 10 kernel/trace/trace_irqsoff.c | 6 kernel/trace/trace_probe_tmpl.h | 2 kernel/trace/trace_sched_wakeup.c | 6 kernel/trace/trace_selftest.c | 11 lib/test_fprobe.c | 51 -- samples/fprobe/fprobe_example.c | 4 .../test.d/dynevent/add_remove_fprobe_repeat.tc | 19 + .../ftrace/test.d/dynevent/fprobe_syntax_errors.tc | 4 47 files changed, 1168 insertions(+), 630 deletions(-) create mode 100644 tools/testing/selftests/ftrace/test.d/dynevent/add_remove_fprobe_repeat.tc
--
Masami Hiramatsu (Google) <[email protected]>
Masami Hiramatsu (Google)
maintainerPATCH v13 1/20 tracing: fgraph: Fix to add new fgraph_ops to array after ftrace_startup_subops()
From: Masami Hiramatsu (Google) <[email protected]>
Since the register_ftrace_graph() assigns a new fgraph_ops to fgraph_array before registring it by ftrace_startup_subops(), the new fgraph_ops can be used in function_graph_enter().
In most cases, it is still OK because those fgraph_ops's hashtable is already initialized by ftrace_set_filter*() etc.
But if a user registers a new fgraph_ops which does not initialize the hash list, ftrace_ops_test() in function_graph_enter() causes a NULL pointer dereference BUG because fgraph_ops->ops.func_hash is NULL.
This can be reproduced by the below commands because function profiler's fgraph_ops does not initialize the hash list;
# cd /sys/kernel/tracing # echo function_graph > current_tracer # echo 1 > function_profile_enabled
To fix this problem, add a new fgraph_ops to fgraph_array after ftrace_startup_subops(). Thus, until the new fgraph_ops is initialized, we will see fgraph_stub on the corresponding fgraph_array entry.
--- kernel/trace/fgraph.c | 31 ++++++++++++++++++------------- 1 file changed, 18 insertions(+), 13 deletions(-)
kernel/trace/fgraph.c +18 -13
@@ -1206,18 +1206,24 @@ static void init_task_vars(int idx)read_unlock (&tasklist_lock); } -static void ftrace_graph_enable_direct (bool enable_branch) +static void ftrace_graph_enable_direct (bool enable_branch,struct fgraph_ops *gops) {trace_func_graph_ent_t func =NULL ;trace_func_graph_ret_t retfunc =NULL ;int i; -for_each_set_bit (i, &fgraph_array_bitmask, -sizeof (fgraph_array_bitmask) *BITS_PER_BYTE ) { - func = fgraph_array[i]->entryfunc; - retfunc = fgraph_array[i]->retfunc; - fgraph_direct_gops = fgraph_array[i]; - } +if (gops) { + func = gops->entryfunc; + retfunc = gops->retfunc; + fgraph_direct_gops = gops; + }else { +for_each_set_bit (i, &fgraph_array_bitmask, +sizeof (fgraph_array_bitmask) *BITS_PER_BYTE ) { + func = fgraph_array[i]->entryfunc; + retfunc = fgraph_array[i]->retfunc; + fgraph_direct_gops = fgraph_array[i]; + } + }if (WARN_ON_ONCE (!func))return ;
@@ -1256,8 +1262,6 @@ int register_ftrace_graph(struct fgraph_ops *gops) ret = -ENOSPC ; goto out; } - - fgraph_array[i] = gops; gops->idx = i; ftrace_graph_active++;
@@ -1266,7 +1270,7 @@ int register_ftrace_graph(struct fgraph_ops *gops)ftrace_graph_disable_direct (true);if (ftrace_graph_active ==1 ) { -ftrace_graph_enable_direct (false); +ftrace_graph_enable_direct (false, gops);register_pm_notifier (&ftrace_suspend_notifier); ret =start_graph_tracing ();if (ret)
@@ -1281,14 +1285,15 @@ int register_ftrace_graph(struct fgraph_ops *gops) }else {init_task_vars (gops->idx); } -/* Always save the function, and reset at unregistering */ gops->saved_func = gops->entryfunc; ret =ftrace_startup_subops (&graph_ops, &gops->ops, command); +if (!ret) + fgraph_array[i] = gops; + error:if (ret) { - fgraph_array[i] = &fgraph_stub; ftrace_graph_active--; gops->saved_func =NULL ;fgraph_lru_release_index (i);
@@ -1324,7 +1329,7 @@ void unregister_ftrace_graph(struct fgraph_ops *gops)ftrace_shutdown_subops (&graph_ops, &gops->ops, command);if (ftrace_graph_active ==1 ) -ftrace_graph_enable_direct (true); +ftrace_graph_enable_direct (true,NULL );else if (!ftrace_graph_active)ftrace_graph_disable_direct (false);
Masami Hiramatsu (Google)
maintainerPATCH v13 2/20 tracing: Add a comment about ftrace_regs definition
In reply to Masami Hiramatsu (Google)From: Masami Hiramatsu (Google) <[email protected]>
To clarify what will be expected on ftrace_regs, add a comment to the architecture independent definition of the ftrace_regs.
---
Changes in v8:
- Update that the saved registers depends on the context.
Changes in v3:
- Add instruction pointer
Changes in v2:
- newly added.
--- include/linux/ftrace.h | 26 ++++++++++++++++++++++++++ 1 file changed, 26 insertions(+)
include/linux/ftrace.h +26 -0
@@ -117,6 +117,32 @@ extern int ftrace_enabled;#ifndef CONFIG_HAVE_DYNAMIC_FTRACE_WITH_ARGS +/** +* ftrace_regs - ftrace partial/optimal register set +* +* ftrace_regs represents a group of registers which is used at the +* function entry and exit. There are three types of registers. +* +* - Registers for passing the parameters to callee, including the stack +* pointer. (e.g. rcx, rdx, rdi, rsi, r8, r9 and rsp on x86_64) +* - Registers for passing the return values to caller. +* (e.g. rax and rdx on x86_64) +* - Registers for hooking the function call and return including the +* frame pointer (the frame pointer is architecture/config dependent) +* (e.g. rip, rbp and rsp for x86_64) +* +* Also, architecture dependent fields can be used for internal process. +* (e.g. orig_ax on x86_64) +* +* On the function entry, those registers will be restored except for +* the stack pointer, so that user can change the function parameters +* and instruction pointer (e.g. live patching.) +* On the function exit, only registers which is used for return values +* are restored. +* +* NOTE: user *must not* access regs directly, only do it via APIs, because +* the member can be changed according to the architecture. +*/ struct ftrace_regs {struct pt_regs regs; };
Masami Hiramatsu (Google)
maintainerPATCH v13 3/20 tracing: Rename ftrace_regs_return_value to ftrace_regs_get_return_value
In reply to Masami Hiramatsu (Google)From: Masami Hiramatsu (Google) <[email protected]>
Rename ftrace_regs_return_value to ftrace_regs_get_return_value as same as other ftrace_regs_get/set_* APIs.
---
Changes in v6:
- Moved to top of the series.
Changes in v3:
- Newly added.
--- arch/loongarch/include/asm/ftrace.h | 2 +- arch/powerpc/include/asm/ftrace.h | 2 +- arch/s390/include/asm/ftrace.h | 2 +- arch/x86/include/asm/ftrace.h | 2 +- include/linux/ftrace.h | 2 +- 5 files changed, 5 insertions(+), 5 deletions(-)
arch/loongarch/include/asm/ftrace.h +1 -1
@@ -69,7 +69,7 @@ ftrace_regs_set_instruction_pointer(struct ftrace_regs *fregs, unsigned long ip) regs_get_kernel_argument(&(fregs)->regs, n)#define ftrace_regs_get_stack_pointer (fregs) \ kernel_stack_pointer(&(fregs)->regs) -#define ftrace_regs_return_value (fregs) \ +#define ftrace_regs_get_return_value (fregs) \ regs_return_value(&(fregs)->regs)#define ftrace_regs_set_return_value (fregs, ret) \ regs_set_return_value(&(fregs)->regs, ret)
arch/powerpc/include/asm/ftrace.h +1 -1
@@ -59,7 +59,7 @@ ftrace_regs_get_instruction_pointer(struct ftrace_regs *fregs) regs_get_kernel_argument(&(fregs)->regs, n)#define ftrace_regs_get_stack_pointer (fregs) \ kernel_stack_pointer(&(fregs)->regs) -#define ftrace_regs_return_value (fregs) \ +#define ftrace_regs_get_return_value (fregs) \ regs_return_value(&(fregs)->regs)#define ftrace_regs_set_return_value (fregs, ret) \ regs_set_return_value(&(fregs)->regs, ret)
arch/s390/include/asm/ftrace.h +1 -1
@@ -83,7 +83,7 @@ ftrace_regs_set_instruction_pointer(struct ftrace_regs *fregs, regs_get_kernel_argument(&(fregs)->regs, n)#define ftrace_regs_get_stack_pointer (fregs) \ kernel_stack_pointer(&(fregs)->regs) -#define ftrace_regs_return_value (fregs) \ +#define ftrace_regs_get_return_value (fregs) \ regs_return_value(&(fregs)->regs)#define ftrace_regs_set_return_value (fregs, ret) \ regs_set_return_value(&(fregs)->regs, ret)
arch/x86/include/asm/ftrace.h +1 -1
@@ -56,7 +56,7 @@ arch_ftrace_get_regs(struct ftrace_regs *fregs) regs_get_kernel_argument(&(fregs)->regs, n)#define ftrace_regs_get_stack_pointer (fregs) \ kernel_stack_pointer(&(fregs)->regs) -#define ftrace_regs_return_value (fregs) \ +#define ftrace_regs_get_return_value (fregs) \ regs_return_value(&(fregs)->regs)#define ftrace_regs_set_return_value (fregs, ret) \ regs_set_return_value(&(fregs)->regs, ret)
include/linux/ftrace.h +1 -1
@@ -183,7 +183,7 @@ static __always_inline bool ftrace_regs_has_args(struct ftrace_regs *fregs) regs_get_kernel_argument(ftrace_get_regs(fregs), n)#define ftrace_regs_get_stack_pointer (fregs) \ kernel_stack_pointer(ftrace_get_regs(fregs)) -#define ftrace_regs_return_value (fregs) \ +#define ftrace_regs_get_return_value (fregs) \ regs_return_value(ftrace_get_regs(fregs))#define ftrace_regs_set_return_value (fregs, ret) \ regs_set_return_value(ftrace_get_regs(fregs), ret)
Masami Hiramatsu (Google)
maintainerPATCH v13 4/20 function_graph: Pass ftrace_regs to entryfunc
In reply to Masami Hiramatsu (Google)From: Masami Hiramatsu (Google) <[email protected]>
Pass ftrace_regs to the fgraph_ops::entryfunc(). If ftrace_regs is not available, it passes a NULL instead. User callback function can access some registers (including return address) via this ftrace_regs.
---
Changes in v11:
- Update for the latest for-next branch.
Changes in v8:
- Just pass ftrace_regs to the handler instead of adding a new entryregfunc.
- Update riscv ftrace_graph_func().
Changes in v3:
- Update for new multiple fgraph.
--- arch/arm64/kernel/ftrace.c | 20 +++++++++++- arch/loongarch/kernel/ftrace_dyn.c | 10 +++++- arch/powerpc/kernel/trace/ftrace.c | 2 + arch/powerpc/kernel/trace/ftrace_64_pg.c | 10 ++++-- arch/riscv/kernel/ftrace.c | 17 ++++++++++ arch/x86/kernel/ftrace.c | 50 +++++++++++++++++++++--------- include/linux/ftrace.h | 18 ++++++++--- kernel/trace/fgraph.c | 23 ++++++++------ kernel/trace/ftrace.c | 3 +- kernel/trace/trace.h | 3 +- kernel/trace/trace_functions_graph.c | 3 +- kernel/trace/trace_irqsoff.c | 3 +- kernel/trace/trace_sched_wakeup.c | 3 +- kernel/trace/trace_selftest.c | 8 +++-- 14 files changed, 128 insertions(+), 45 deletions(-)
arch/arm64/kernel/ftrace.c +19 -1
@@ -481,7 +481,25 @@ void prepare_ftrace_return(unsigned long self_addr, unsigned long *parent,void ftrace_graph_func (unsigned long ip,unsigned long parent_ip,struct ftrace_ops *op,struct ftrace_regs *fregs) { -prepare_ftrace_return (ip, &fregs->lr, fregs->fp); +unsigned long return_hooker = (unsigned long )&return_to_handler; +unsigned long frame_pointer = fregs->fp; +unsigned long *parent = &fregs->lr; +unsigned long old; + +if (unlikely (atomic_read (¤t->tracing_graph_pause))) +return ; + +/* +* Note: +* No protection against faulting at *parent, which may be seen +* on other archs. It's unlikely on AArch64. +*/ + old = *parent; + +if (!function_graph_enter_regs (old, ip, frame_pointer, + (void *)frame_pointer, fregs)) { + *parent = return_hooker; + } }#else /*
arch/loongarch/kernel/ftrace_dyn.c +9 -1
@@ -243,8 +243,16 @@ void ftrace_graph_func(unsigned long ip, unsigned long parent_ip, {struct pt_regs *regs = &fregs->regs;unsigned long *parent = (unsigned long *)®s->regs[1 ]; +unsigned long return_hooker = (unsigned long )&return_to_handler; +unsigned long old; + +if (unlikely (atomic_read (¤t->tracing_graph_pause))) +return ; + + old = *parent; -prepare_ftrace_return (ip, (unsigned long *)parent); +if (!function_graph_enter_regs (old, ip,0 , parent, fregs)) + *parent = return_hooker; }#else static int ftrace_modify_graph_caller (bool enable)
arch/powerpc/kernel/trace/ftrace.c +1 -1
@@ -434,7 +434,7 @@ void ftrace_graph_func(unsigned long ip, unsigned long parent_ip,if (bit <0 ) goto out; -if (!function_graph_enter (parent_ip, ip,0 , (unsigned long *)sp)) +if (!function_graph_enter_regs (parent_ip, ip,0 , (unsigned long *)sp, fregs)) parent_ip =ppc_function_entry (return_to_handler);ftrace_test_recursion_unlock (bit);
arch/powerpc/kernel/trace/ftrace_64_pg.c +6 -4
@@ -800,7 +800,8 @@ int ftrace_disable_ftrace_graph_caller(void)* in current thread info. Return the address we want to divert to. */ static unsigned long -__prepare_ftrace_return (unsigned long parent,unsigned long ip,unsigned long sp) +__prepare_ftrace_return (unsigned long parent,unsigned long ip,unsigned long sp, +struct ftrace_regs *fregs) {unsigned long return_hooker;int bit;
@@ -817,7 +818,7 @@ __prepare_ftrace_return(unsigned long parent, unsigned long ip, unsigned long sp return_hooker =ppc_function_entry (return_to_handler); -if (!function_graph_enter (parent, ip,0 , (unsigned long *)sp)) +if (!function_graph_enter_regs (parent, ip,0 , (unsigned long *)sp, fregs)) parent = return_hooker;ftrace_test_recursion_unlock (bit);
@@ -829,13 +830,14 @@ __prepare_ftrace_return(unsigned long parent, unsigned long ip, unsigned long spvoid ftrace_graph_func (unsigned long ip,unsigned long parent_ip,struct ftrace_ops *op,struct ftrace_regs *fregs) { - fregs->regs.link =__prepare_ftrace_return (parent_ip, ip, fregs->regs.gpr[1 ]); + fregs->regs.link =__prepare_ftrace_return (parent_ip, ip, + fregs->regs.gpr[1 ], fregs); }#else unsigned long prepare_ftrace_return (unsigned long parent,unsigned long ip,unsigned long sp) { -return __prepare_ftrace_return (parent, ip, sp); +return __prepare_ftrace_return (parent, ip, sp,NULL ); }#endif #endif /* CONFIG_FUNCTION_GRAPH_TRACER */
arch/riscv/kernel/ftrace.c +16 -1
@@ -214,7 +214,22 @@ void prepare_ftrace_return(unsigned long *parent, unsigned long self_addr,void ftrace_graph_func (unsigned long ip,unsigned long parent_ip,struct ftrace_ops *op,struct ftrace_regs *fregs) { -prepare_ftrace_return (&fregs->ra, ip, fregs->s0); +unsigned long return_hooker = (unsigned long )&return_to_handler; +unsigned long frame_pointer = fregs->s0; +unsigned long *parent = &fregs->ra; +unsigned long old; + +if (unlikely (atomic_read (¤t->tracing_graph_pause))) +return ; + +/* +* We don't suffer access faults, so no extra fault-recovery assembly +* is needed here. +*/ + old = *parent; + +if (!function_graph_enter_regs (old, ip, frame_pointer, parent, fregs)) + *parent = return_hooker; }#else /* CONFIG_DYNAMIC_FTRACE_WITH_ARGS */ extern void ftrace_graph_call (void );
arch/x86/kernel/ftrace.c +35 -15
72 lines not on this page · raw message
include/linux/ftrace.h +14 -4
@@ -1063,9 +1063,12 @@ struct fgraph_ops;typedef void (*trace_func_graph_ret_t )(struct ftrace_graph_ret *,struct fgraph_ops *);/* return */ typedef int (*trace_func_graph_ent_t )(struct ftrace_graph_ent *, -struct fgraph_ops *);/* entry */ +struct fgraph_ops *, +struct ftrace_regs *);/* entry */ -extern int ftrace_graph_entry_stub (struct ftrace_graph_ent *trace,struct fgraph_ops *gops); +extern int ftrace_graph_entry_stub (struct ftrace_graph_ent *trace, +struct fgraph_ops *gops, +struct ftrace_regs *fregs);bool ftrace_pids_enabled (struct ftrace_ops *ops);#ifdef CONFIG_FUNCTION_GRAPH_TRACER
@@ -1108,8 +1111,15 @@ struct ftrace_ret_stack {extern void return_to_handler (void );extern int -function_graph_enter (unsigned long ret,unsigned long func, -unsigned long frame_pointer,unsigned long *retp); +function_graph_enter_regs (unsigned long ret,unsigned long func, +unsigned long frame_pointer,unsigned long *retp, +struct ftrace_regs *fregs); + +static inline int function_graph_enter (unsigned long ret,unsigned long func, +unsigned long fp,unsigned long *retp) +{ +return function_graph_enter_regs (ret, func, fp, retp,NULL ); +}struct ftrace_ret_stack *ftrace_graph_get_ret_stack (struct task_struct *task,int skip);
kernel/trace/fgraph.c +13 -10
@@ -290,7 +290,8 @@ static inline unsigned long make_data_type_val(int idx, int size, int offset) }/* ftrace_graph_entry set to this to tell some archs to run function graph */ -static int entry_run (struct ftrace_graph_ent *trace,struct fgraph_ops *ops) +static int entry_run (struct ftrace_graph_ent *trace,struct fgraph_ops *ops, +struct ftrace_regs *fregs) {return 0 ; }
@@ -484,7 +485,7 @@ int __weak ftrace_disable_ftrace_graph_caller(void)#endif int ftrace_graph_entry_stub (struct ftrace_graph_ent *trace, -struct fgraph_ops *gops) +struct fgraph_ops *gops,struct ftrace_regs *fregs) {return 0 ; }
@@ -612,8 +613,9 @@ ftrace_push_return_trace(unsigned long ret, unsigned long func,#endif /* If the caller does not use ftrace, call this function. */ -int function_graph_enter (unsigned long ret,unsigned long func, -unsigned long frame_pointer,unsigned long *retp) +int function_graph_enter_regs (unsigned long ret,unsigned long func, +unsigned long frame_pointer,unsigned long *retp, +struct ftrace_regs *fregs) {struct ftrace_graph_ent trace;unsigned long bitmap =0 ;
@@ -631,7 +633,7 @@ int function_graph_enter(unsigned long ret, unsigned long func,if (static_branch_likely (&fgraph_do_direct)) {int save_curr_ret_stack = current->curr_ret_stack; -if (static_call (fgraph_func)(&trace, fgraph_direct_gops)) +if (static_call (fgraph_func)(&trace, fgraph_direct_gops, fregs)) bitmap |=BIT (fgraph_direct_gops->idx);else /* Clear out any saved storage */
@@ -649,7 +651,7 @@ int function_graph_enter(unsigned long ret, unsigned long func, save_curr_ret_stack = current->curr_ret_stack;if (ftrace_ops_test (&gops->ops, func,NULL ) && - gops->entryfunc (&trace, gops)) + gops->entryfunc (&trace, gops, fregs)) bitmap |=BIT (i);else /* Clear out any saved storage */
@@ -925,7 +927,7 @@ unsigned long ftrace_graph_ret_addr(struct task_struct *task, int *idx,static struct ftrace_ops graph_ops = { .func = ftrace_graph_func, - .flags =FTRACE_OPS_GRAPH_STUB , + .flags =FTRACE_OPS_GRAPH_STUB |FTRACE_OPS_FL_SAVE_ARGS , #ifdef FTRACE_GRAPH_TRAMP_ADDR .trampoline =FTRACE_GRAPH_TRAMP_ADDR , /* trampoline_size is only needed for dynamically allocated tramps */
@@ -935,7 +937,8 @@ static struct ftrace_ops graph_ops = {void fgraph_init_ops (struct ftrace_ops *dst_ops,struct ftrace_ops *src_ops) { - dst_ops->flags =FTRACE_OPS_FL_PID |FTRACE_OPS_GRAPH_STUB ; + dst_ops->flags =FTRACE_OPS_FL_PID |FTRACE_OPS_GRAPH_STUB | +FTRACE_OPS_FL_SAVE_ARGS ;#ifdef CONFIG_DYNAMIC_FTRACE if (src_ops) {
@@ -1119,7 +1122,7 @@ void ftrace_graph_exit_task(struct task_struct *t)#ifdef CONFIG_DYNAMIC_FTRACE static int fgraph_pid_func (struct ftrace_graph_ent *trace, -struct fgraph_ops *gops) +struct fgraph_ops *gops,struct ftrace_regs *fregs) {struct trace_array *tr = gops->ops.private;int pid;
@@ -1133,7 +1136,7 @@ static int fgraph_pid_func(struct ftrace_graph_ent *trace,return 0 ; } -return gops->saved_func (trace, gops); +return gops->saved_func (trace, gops, fregs); }void fgraph_update_pid_func (void )
kernel/trace/ftrace.c +2 -1
@@ -821,7 +821,8 @@ void ftrace_graph_graph_time_control(bool enable) }static int profile_graph_entry (struct ftrace_graph_ent *trace, -struct fgraph_ops *gops) +struct fgraph_ops *gops, +struct ftrace_regs *fregs) {struct ftrace_ret_stack *ret_stack;
kernel/trace/trace.h +2 -1
@@ -683,7 +683,8 @@ void trace_default_header(struct seq_file *m);void print_trace_header (struct seq_file *m,struct trace_iterator *iter);void trace_graph_return (struct ftrace_graph_ret *trace,struct fgraph_ops *gops); -int trace_graph_entry (struct ftrace_graph_ent *trace,struct fgraph_ops *gops); +int trace_graph_entry (struct ftrace_graph_ent *trace,struct fgraph_ops *gops, +struct ftrace_regs *fregs);void tracing_start_cmdline_record (void );void tracing_stop_cmdline_record (void );
kernel/trace/trace_functions_graph.c +2 -1
@@ -128,7 +128,8 @@ static inline int ftrace_graph_ignore_irqs(void) }int trace_graph_entry (struct ftrace_graph_ent *trace, -struct fgraph_ops *gops) +struct fgraph_ops *gops, +struct ftrace_regs *fregs) {unsigned long *task_var =fgraph_get_task_var (gops);struct trace_array *tr = gops->private;
kernel/trace/trace_irqsoff.c +2 -1
@@ -176,7 +176,8 @@ static int irqsoff_display_graph(struct trace_array *tr, int set) }static int irqsoff_graph_entry (struct ftrace_graph_ent *trace, -struct fgraph_ops *gops) +struct fgraph_ops *gops, +struct ftrace_regs *fregs) {struct trace_array *tr = irqsoff_trace;struct trace_array_cpu *data;
kernel/trace/trace_sched_wakeup.c +2 -1
@@ -113,7 +113,8 @@ static int wakeup_display_graph(struct trace_array *tr, int set) }static int wakeup_graph_entry (struct ftrace_graph_ent *trace, -struct fgraph_ops *gops) +struct fgraph_ops *gops, +struct ftrace_regs *fregs) {struct trace_array *tr = wakeup_trace;struct trace_array_cpu *data;
kernel/trace/trace_selftest.c +5 -3
@@ -773,7 +773,8 @@ struct fgraph_fixture { };static __init int store_entry (struct ftrace_graph_ent *trace, -struct fgraph_ops *gops) +struct fgraph_ops *gops, +struct ftrace_regs *fregs) { struct fgraph_fixture *fixture = container_of(gops, struct fgraph_fixture, gops);const char *type = fixture->store_type_name;
@@ -1011,7 +1012,8 @@ static unsigned int graph_hang_thresh;/* Wrap the real function entry probe to avoid possible hanging */ static int trace_graph_entry_watchdog (struct ftrace_graph_ent *trace, -struct fgraph_ops *gops) +struct fgraph_ops *gops, +struct ftrace_regs *fregs) {/* This is harmlessly racy, we want to approximately detect a hang */ if (unlikely (++graph_hang_thresh >GRAPH_MAX_FUNC_TEST )) {
@@ -1025,7 +1027,7 @@ static int trace_graph_entry_watchdog(struct ftrace_graph_ent *trace,return 0 ; } -return trace_graph_entry (trace, gops); +return trace_graph_entry (trace, gops, fregs); }static struct fgraph_ops fgraph_ops__initdata = {
Masami Hiramatsu (Google)
maintainerPATCH v13 5/20 function_graph: Replace fgraph_ret_regs with ftrace_regs
In reply to Masami Hiramatsu (Google)From: Masami Hiramatsu (Google) <[email protected]>
Use ftrace_regs instead of fgraph_ret_regs for tracing return value on function_graph tracer because of simplifying the callback interface.
The CONFIG_HAVE_FUNCTION_GRAPH_RETVAL is also replaced by CONFIG_HAVE_FUNCTION_GRAPH_FREGS.
---
Changes in v8:
- Newly added.
--- arch/arm64/Kconfig | 1 + arch/arm64/include/asm/ftrace.h | 23 ++++++----------------- arch/arm64/kernel/asm-offsets.c | 12 ------------ arch/arm64/kernel/entry-ftrace.S | 32 ++++++++++++++++++-------------- arch/loongarch/Kconfig | 2 +- arch/loongarch/include/asm/ftrace.h | 24 ++---------------------- arch/loongarch/kernel/asm-offsets.c | 12 ------------ arch/loongarch/kernel/mcount.S | 17 ++++++++++------- arch/loongarch/kernel/mcount_dyn.S | 14 +++++++------- arch/riscv/Kconfig | 2 +- arch/riscv/include/asm/ftrace.h | 26 +++++--------------------- arch/riscv/kernel/mcount.S | 24 +++++++++++++----------- arch/s390/Kconfig | 2 +- arch/s390/include/asm/ftrace.h | 26 +++++++++----------------- arch/s390/kernel/asm-offsets.c | 6 ------ arch/s390/kernel/mcount.S | 9 +++++---- arch/x86/Kconfig | 2 +- arch/x86/include/asm/ftrace.h | 22 ++-------------------- arch/x86/kernel/ftrace_32.S | 15 +++++++++------ arch/x86/kernel/ftrace_64.S | 17 +++++++++-------- include/linux/ftrace.h | 14 +++++++++++--- kernel/trace/Kconfig | 4 ++-- kernel/trace/fgraph.c | 21 +++++++++------------ 23 files changed, 122 insertions(+), 205 deletions(-)
arch/arm64/Kconfig +1 -0
@@ -211,6 +211,7 @@ config ARM64 select HAVE_FTRACE_MCOUNT_RECORD select HAVE_FUNCTION_TRACER select HAVE_FUNCTION_ERROR_INJECTION + select HAVE_FUNCTION_GRAPH_FREGS select HAVE_FUNCTION_GRAPH_TRACER select HAVE_FUNCTION_GRAPH_RETVAL select HAVE_GCC_PLUGINS
arch/arm64/include/asm/ftrace.h +6 -17
@@ -126,6 +126,12 @@ ftrace_override_function_with_return(struct ftrace_regs *fregs) fregs->pc = fregs->lr; } +static __always_inline unsigned long +ftrace_regs_get_frame_pointer (const struct ftrace_regs *fregs) +{ +return fregs->fp; +} +int ftrace_regs_query_register_offset (const char *name);int ftrace_init_nop (struct module *mod,struct dyn_ftrace *rec);
@@ -183,23 +189,6 @@ static inline bool arch_syscall_match_sym_name(const char *sym,#ifndef __ASSEMBLY__#ifdef CONFIG_FUNCTION_GRAPH_TRACER -struct fgraph_ret_regs { -/* x0 - x7 */ -unsigned long regs[8 ]; - -unsigned long fp; -unsigned long __unused; -}; - -static inline unsigned long fgraph_ret_regs_return_value (struct fgraph_ret_regs *ret_regs) -{ -return ret_regs->regs[0 ]; -} - -static inline unsigned long fgraph_ret_regs_frame_pointer (struct fgraph_ret_regs *ret_regs) -{ -return ret_regs->fp; -}void prepare_ftrace_return (unsigned long self_addr,unsigned long *parent,unsigned long frame_pointer);
arch/arm64/kernel/asm-offsets.c +0 -12
@@ -201,18 +201,6 @@ int main(void)DEFINE (FTRACE_OPS_FUNC , offsetof(struct ftrace_ops , func));#endif BLANK (); -#ifdef CONFIG_FUNCTION_GRAPH_TRACER - DEFINE(FGRET_REGS_X0, offsetof(struct fgraph_ret_regs, regs[0])); - DEFINE(FGRET_REGS_X1, offsetof(struct fgraph_ret_regs, regs[1])); - DEFINE(FGRET_REGS_X2, offsetof(struct fgraph_ret_regs, regs[2])); - DEFINE(FGRET_REGS_X3, offsetof(struct fgraph_ret_regs, regs[3])); - DEFINE(FGRET_REGS_X4, offsetof(struct fgraph_ret_regs, regs[4])); - DEFINE(FGRET_REGS_X5, offsetof(struct fgraph_ret_regs, regs[5])); - DEFINE(FGRET_REGS_X6, offsetof(struct fgraph_ret_regs, regs[6])); - DEFINE(FGRET_REGS_X7, offsetof(struct fgraph_ret_regs, regs[7])); -DEFINE (FGRET_REGS_FP , offsetof(struct fgraph_ret_regs , fp)); -DEFINE (FGRET_REGS_SIZE ,sizeof (struct fgraph_ret_regs )); -#endif #ifdef CONFIG_DYNAMIC_FTRACE_WITH_DIRECT_CALLS DEFINE (FTRACE_OPS_DIRECT_CALL , offsetof(struct ftrace_ops , direct_call));#endif
arch/arm64/kernel/entry-ftrace.S +18 -14
@@ -329,24 +329,28 @@ SYM_FUNC_END(ftrace_stub_graph) * @fp is checked against the value passed by ftrace_graph_caller(). */ SYM_CODE_START(return_to_handler) - /* save return value regs */ - sub sp, sp, #FGRET_REGS_SIZE - stp x0, x1, [sp, #FGRET_REGS_X0] - stp x2, x3, [sp, #FGRET_REGS_X2] - stp x4, x5, [sp, #FGRET_REGS_X4] - stp x6, x7, [sp, #FGRET_REGS_X6] - str x29, [sp, #FGRET_REGS_FP] // parent's fp + /* Make room for ftrace_regs */ + sub sp, sp, #FREGS_SIZE + + /* Save return value regs */ + stp x0, x1, [sp, #FREGS_X0] + stp x2, x3, [sp, #FREGS_X2] + stp x4, x5, [sp, #FREGS_X4] + stp x6, x7, [sp, #FREGS_X6] + + /* Save the callsite's FP */ + str x29, [sp, #FREGS_FP] mov x0, sp - bl ftrace_return_to_handler // addr = ftrace_return_to_hander(regs); + bl ftrace_return_to_handler // addr = ftrace_return_to_hander(fregs); mov x30, x0 // restore the original return address - /* restore return value regs */ - ldp x0, x1, [sp, #FGRET_REGS_X0] - ldp x2, x3, [sp, #FGRET_REGS_X2] - ldp x4, x5, [sp, #FGRET_REGS_X4] - ldp x6, x7, [sp, #FGRET_REGS_X6] - add sp, sp, #FGRET_REGS_SIZE + /* Restore return value regs */ + ldp x0, x1, [sp, #FREGS_X0] + ldp x2, x3, [sp, #FREGS_X2] + ldp x4, x5, [sp, #FREGS_X4] + ldp x6, x7, [sp, #FREGS_X6] + add sp, sp, #FREGS_SIZE ret SYM_CODE_END(return_to_handler)
arch/loongarch/Kconfig +1 -1
@@ -131,7 +131,7 @@ config LOONGARCH select HAVE_FTRACE_MCOUNT_RECORD select HAVE_FUNCTION_ARG_ACCESS_API select HAVE_FUNCTION_ERROR_INJECTION - select HAVE_FUNCTION_GRAPH_RETVAL if HAVE_FUNCTION_GRAPH_TRACER + select HAVE_FUNCTION_GRAPH_FREGS select HAVE_FUNCTION_GRAPH_TRACER select HAVE_FUNCTION_TRACER select HAVE_GCC_PLUGINS
arch/loongarch/include/asm/ftrace.h +2 -22
@@ -77,6 +77,8 @@ ftrace_regs_set_instruction_pointer(struct ftrace_regs *fregs, unsigned long ip) override_function_with_return(&(fregs)->regs)#define ftrace_regs_query_register_offset (name) \ regs_query_register_offset(name) +#define ftrace_regs_get_frame_pointer (fregs) \ + ((fregs)->regs.regs[22])#define ftrace_graph_func ftrace_graph_func void ftrace_graph_func(unsigned long ip, unsigned long parent_ip,
@@ -99,26 +101,4 @@ __arch_ftrace_set_direct_caller(struct pt_regs *regs, unsigned long addr)#endif /* CONFIG_FUNCTION_TRACER */ -#ifndef __ASSEMBLY__ -#ifdef CONFIG_FUNCTION_GRAPH_TRACER -struct fgraph_ret_regs { -/* a0 - a1 */ -unsigned long regs[2 ]; - -unsigned long fp; -unsigned long __unused; -}; - -static inline unsigned long fgraph_ret_regs_return_value (struct fgraph_ret_regs *ret_regs) -{ -return ret_regs->regs[0 ]; -} - -static inline unsigned long fgraph_ret_regs_frame_pointer (struct fgraph_ret_regs *ret_regs) -{ -return ret_regs->fp; -} -#endif /* ifdef CONFIG_FUNCTION_GRAPH_TRACER */ -#endif -#endif /* _ASM_LOONGARCH_FTRACE_H */
arch/loongarch/kernel/asm-offsets.c +0 -12
@@ -279,18 +279,6 @@ static void __used output_pbe_defines(void) }#endif -#ifdef CONFIG_FUNCTION_GRAPH_TRACER -static void __used output_fgraph_ret_regs_defines (void ) -{ -COMMENT ("LoongArch fgraph_ret_regs offsets." ); -OFFSET (FGRET_REGS_A0 , fgraph_ret_regs, regs[0 ]); -OFFSET (FGRET_REGS_A1 , fgraph_ret_regs, regs[1 ]); -OFFSET (FGRET_REGS_FP , fgraph_ret_regs, fp); -DEFINE (FGRET_REGS_SIZE ,sizeof (struct fgraph_ret_regs )); -BLANK (); -} -#endif -static void __used output_kvm_defines (void ) {COMMENT ("KVM/LoongArch Specific offsets." );
arch/loongarch/kernel/mcount.S +10 -7
@@ -79,10 +79,11 @@ SYM_FUNC_START(ftrace_graph_caller) SYM_FUNC_END(ftrace_graph_caller) SYM_FUNC_START(return_to_handler) - PTR_ADDI sp, sp, -FGRET_REGS_SIZE - PTR_S a0, sp, FGRET_REGS_A0 - PTR_S a1, sp, FGRET_REGS_A1 - PTR_S zero, sp, FGRET_REGS_FP + /* Save return value regs */ + PTR_ADDI sp, sp, -PT_SIZE + PTR_S a0, sp, PT_R4 + PTR_S a1, sp, PT_R5 + PTR_S zero, sp, PT_R22 move a0, sp bl ftrace_return_to_handler
@@ -90,9 +91,11 @@ SYM_FUNC_START(return_to_handler) /* Restore the real parent address: a0 -> ra */ move ra, a0 - PTR_L a0, sp, FGRET_REGS_A0 - PTR_L a1, sp, FGRET_REGS_A1 - PTR_ADDI sp, sp, FGRET_REGS_SIZE + /* Restore return value regs */ + PTR_L a0, sp, PT_R4 + PTR_L a1, sp, PT_R5 + PTR_ADDI sp, sp, PT_SIZE + jr ra SYM_FUNC_END(return_to_handler) #endif /* CONFIG_FUNCTION_GRAPH_TRACER */
arch/loongarch/kernel/mcount_dyn.S +7 -7
@@ -140,19 +140,19 @@ SYM_CODE_END(ftrace_graph_caller) SYM_CODE_START(return_to_handler) UNWIND_HINT_UNDEFINED /* Save return value regs */ - PTR_ADDI sp, sp, -FGRET_REGS_SIZE - PTR_S a0, sp, FGRET_REGS_A0 - PTR_S a1, sp, FGRET_REGS_A1 - PTR_S zero, sp, FGRET_REGS_FP + PTR_ADDI sp, sp, -PT_SIZE + PTR_S a0, sp, PT_R4 + PTR_S a1, sp, PT_R5 + PTR_S zero, sp, PT_R22 move a0, sp bl ftrace_return_to_handler move ra, a0 /* Restore return value regs */ - PTR_L a0, sp, FGRET_REGS_A0 - PTR_L a1, sp, FGRET_REGS_A1 - PTR_ADDI sp, sp, FGRET_REGS_SIZE + PTR_L a0, sp, PT_R4 + PTR_L a1, sp, PT_R5 + PTR_ADDI sp, sp, PT_SIZE jr ra SYM_CODE_END(return_to_handler)
arch/riscv/Kconfig +1 -1
@@ -140,7 +140,7 @@ config RISCV select HAVE_DYNAMIC_FTRACE_WITH_ARGS if HAVE_DYNAMIC_FTRACE select HAVE_FTRACE_MCOUNT_RECORD if !XIP_KERNEL select HAVE_FUNCTION_GRAPH_TRACER - select HAVE_FUNCTION_GRAPH_RETVAL if HAVE_FUNCTION_GRAPH_TRACER + select HAVE_FUNCTION_GRAPH_FREGS select HAVE_FUNCTION_TRACER if !XIP_KERNEL && !PREEMPTION select HAVE_EBPF_JIT if MMU select HAVE_GUP_FAST if MMU
arch/riscv/include/asm/ftrace.h +5 -21
@@ -164,6 +164,11 @@ static __always_inline unsigned long ftrace_regs_get_stack_pointer(const structreturn fregs->sp; } +static __always_inline unsigned long ftrace_regs_get_frame_pointer (const struct ftrace_regs *fregs) +{ +return fregs->s0; +} +static __always_inline unsigned long ftrace_regs_get_argument (struct ftrace_regs *fregs,unsigned int n) {
@@ -204,25 +209,4 @@ static inline void arch_ftrace_set_direct_caller(struct ftrace_regs *fregs, unsi#endif /* CONFIG_DYNAMIC_FTRACE */ -#ifndef __ASSEMBLY__ -#ifdef CONFIG_FUNCTION_GRAPH_TRACER -struct fgraph_ret_regs { -unsigned long a1; -unsigned long a0; -unsigned long s0; -unsigned long ra; -}; - -static inline unsigned long fgraph_ret_regs_return_value (struct fgraph_ret_regs *ret_regs) -{ -return ret_regs->a0; -} - -static inline unsigned long fgraph_ret_regs_frame_pointer (struct fgraph_ret_regs *ret_regs) -{ -return ret_regs->s0; -} -#endif /* ifdef CONFIG_FUNCTION_GRAPH_TRACER */ -#endif -#endif /* _ASM_RISCV_FTRACE_H */
arch/riscv/kernel/mcount.S +13 -11
@@ -12,6 +12,8 @@ #include <asm/asm-offsets.h> #include <asm/ftrace.h> +#define ABI_SIZE_ON_STACK 80 + .text .macro SAVE_ABI_STATE
@@ -26,12 +28,12 @@ * register if a0 was not saved. */ .macro SAVE_RET_ABI_STATE - addi sp, sp, -4*SZREG - REG_S s0, 2*SZREG(sp) - REG_S ra, 3*SZREG(sp) - REG_S a0, 1*SZREG(sp) - REG_S a1, 0*SZREG(sp) - addi s0, sp, 4*SZREG + addi sp, sp, -ABI_SIZE_ON_STACK + REG_S ra, 1*SZREG(sp) + REG_S s0, 8*SZREG(sp) + REG_S a0, 10*SZREG(sp) + REG_S a1, 11*SZREG(sp) + addi s0, sp, ABI_SIZE_ON_STACK .endm .macro RESTORE_ABI_STATE
@@ -41,11 +43,11 @@ .endm .macro RESTORE_RET_ABI_STATE - REG_L ra, 3*SZREG(sp) - REG_L s0, 2*SZREG(sp) - REG_L a0, 1*SZREG(sp) - REG_L a1, 0*SZREG(sp) - addi sp, sp, 4*SZREG + REG_L ra, 1*SZREG(sp) + REG_L s0, 8*SZREG(sp) + REG_L a0, 10*SZREG(sp) + REG_L a1, 11*SZREG(sp) + addi sp, sp, ABI_SIZE_ON_STACK .endm SYM_TYPED_FUNC_START(ftrace_stub)
arch/s390/Kconfig +1 -1
@@ -184,7 +184,7 @@ config S390 select HAVE_FTRACE_MCOUNT_RECORD select HAVE_FUNCTION_ARG_ACCESS_API select HAVE_FUNCTION_ERROR_INJECTION - select HAVE_FUNCTION_GRAPH_RETVAL + select HAVE_FUNCTION_GRAPH_FREGS select HAVE_FUNCTION_GRAPH_TRACER select HAVE_FUNCTION_TRACER select HAVE_GCC_PLUGINS
arch/s390/include/asm/ftrace.h +9 -17
@@ -49,23 +49,6 @@ static __always_inline struct pt_regs *arch_ftrace_get_regs(struct ftrace_regs *return NULL ; } -#ifdef CONFIG_FUNCTION_GRAPH_TRACER -struct fgraph_ret_regs { -unsigned long gpr2; -unsigned long fp; -}; - -static __always_inline unsigned long fgraph_ret_regs_return_value (struct fgraph_ret_regs *ret_regs) -{ -return ret_regs->gpr2; -} - -static __always_inline unsigned long fgraph_ret_regs_frame_pointer (struct fgraph_ret_regs *ret_regs) -{ -return ret_regs->fp; -} -#endif /* CONFIG_FUNCTION_GRAPH_TRACER */ -static __always_inline unsigned long ftrace_regs_get_instruction_pointer (const struct ftrace_regs *fregs) {
@@ -92,6 +75,15 @@ ftrace_regs_set_instruction_pointer(struct ftrace_regs *fregs,#define ftrace_regs_query_register_offset (name) \ regs_query_register_offset(name) +static __always_inline unsigned long +ftrace_regs_get_frame_pointer (struct ftrace_regs *fregs) +{ +unsigned long *sp; + + sp = (void *)ftrace_regs_get_stack_pointer (fregs); +return sp[0 ];/* return backchain */ +} +#ifdef CONFIG_DYNAMIC_FTRACE_WITH_DIRECT_CALLS /* * When an ftrace registered caller is tracing a function that is
arch/s390/kernel/asm-offsets.c +0 -6
@@ -179,12 +179,6 @@ int main(void)DEFINE (OLDMEM_SIZE ,PARMAREA + offsetof(struct parmarea , oldmem_size));DEFINE (COMMAND_LINE ,PARMAREA + offsetof(struct parmarea , command_line));DEFINE (MAX_COMMAND_LINE_SIZE ,PARMAREA + offsetof(struct parmarea , max_command_line_size)); -#ifdef CONFIG_FUNCTION_GRAPH_TRACER -/* function graph return value tracing */ -OFFSET (__FGRAPH_RET_GPR2, fgraph_ret_regs, gpr2); -OFFSET (__FGRAPH_RET_FP, fgraph_ret_regs, fp); -DEFINE (__FGRAPH_RET_SIZE,sizeof (struct fgraph_ret_regs )); -#endif OFFSET (__FTRACE_REGS_PT_REGS, ftrace_regs, regs);DEFINE (__FTRACE_REGS_SIZE,sizeof (struct ftrace_regs ));
arch/s390/kernel/mcount.S +5 -4
@@ -133,14 +133,15 @@ SYM_CODE_END(ftrace_common) SYM_FUNC_START(return_to_handler) stmg %r2,%r5,32(%r15) lgr %r1,%r15 - aghi %r15,-(STACK_FRAME_OVERHEAD+__FGRAPH_RET_SIZE) +# Allocate ftrace_regs + backchain on the stack + aghi %r15,-STACK_FRAME_SIZE_FREGS stg %r1,__SF_BACKCHAIN(%r15) la %r3,STACK_FRAME_OVERHEAD(%r15) - stg %r1,__FGRAPH_RET_FP(%r3) - stg %r2,__FGRAPH_RET_GPR2(%r3) + stg %r2,(__SF_GPRS+2*8)(%r15) + stg %r15,(__SF_GPRS+15*8)(%r15) lgr %r2,%r3 brasl %r14,ftrace_return_to_handler - aghi %r15,STACK_FRAME_OVERHEAD+__FGRAPH_RET_SIZE + aghi %r15,STACK_FRAME_SIZE_FREGS lgr %r14,%r2 lmg %r2,%r5,32(%r15) BR_EX %r14
arch/x86/Kconfig +1 -1
@@ -228,7 +228,7 @@ config X86 select HAVE_GUP_FAST select HAVE_FENTRY if X86_64 || DYNAMIC_FTRACE select HAVE_FTRACE_MCOUNT_RECORD - select HAVE_FUNCTION_GRAPH_RETVAL if HAVE_FUNCTION_GRAPH_TRACER + select HAVE_FUNCTION_GRAPH_FREGS if HAVE_FUNCTION_GRAPH_TRACER select HAVE_FUNCTION_GRAPH_TRACER if X86_32 || (X86_64 && DYNAMIC_FTRACE) select HAVE_FUNCTION_TRACER select HAVE_GCC_PLUGINS
arch/x86/include/asm/ftrace.h +2 -20
@@ -64,6 +64,8 @@ arch_ftrace_get_regs(struct ftrace_regs *fregs) override_function_with_return(&(fregs)->regs)#define ftrace_regs_query_register_offset (name) \ regs_query_register_offset(name) +#define ftrace_regs_get_frame_pointer (fregs) \ + frame_pointer(&(fregs)->regs)struct ftrace_ops ;#define ftrace_graph_func ftrace_graph_func
@@ -148,24 +150,4 @@ static inline bool arch_trace_is_compat_syscall(struct pt_regs *regs)#endif /* !COMPILE_OFFSETS */ #endif /* !__ASSEMBLY__ */ -#ifndef __ASSEMBLY__ -#ifdef CONFIG_FUNCTION_GRAPH_TRACER -struct fgraph_ret_regs { -unsigned long ax; -unsigned long dx; -unsigned long bp; -}; - -static inline unsigned long fgraph_ret_regs_return_value (struct fgraph_ret_regs *ret_regs) -{ -return ret_regs->ax; -} - -static inline unsigned long fgraph_ret_regs_frame_pointer (struct fgraph_ret_regs *ret_regs) -{ -return ret_regs->bp; -} -#endif /* ifdef CONFIG_FUNCTION_GRAPH_TRACER */ -#endif -#endif /* _ASM_X86_FTRACE_H */
arch/x86/kernel/ftrace_32.S +9 -6
@@ -23,6 +23,8 @@ SYM_FUNC_START(__fentry__) SYM_FUNC_END(__fentry__) EXPORT_SYMBOL(__fentry__) +#define FRAME_SIZE PT_OLDSS+4 + SYM_CODE_START(ftrace_caller) #ifdef CONFIG_FRAME_POINTER
@@ -187,14 +189,15 @@ SYM_CODE_END(ftrace_graph_caller) .globl return_to_handler return_to_handler: - pushl $0 - pushl %edx - pushl %eax + subl $(FRAME_SIZE), %esp + movl $0, PT_EBP(%esp) + movl %edx, PT_EDX(%esp) + movl %eax, PT_EAX(%esp) movl %esp, %eax call ftrace_return_to_handler movl %eax, %ecx - popl %eax - popl %edx - addl $4, %esp # skip ebp + movl %eax, PT_EAX(%esp) + movl %edx, PT_EDX(%esp) + addl $(FRAME_SIZE), %esp JMP_NOSPEC ecx #endif
arch/x86/kernel/ftrace_64.S +9 -8
@@ -348,21 +348,22 @@ STACK_FRAME_NON_STANDARD_FP(__fentry__) SYM_CODE_START(return_to_handler) UNWIND_HINT_UNDEFINED ANNOTATE_NOENDBR - subq $24, %rsp - /* Save the return values */ - movq %rax, (%rsp) - movq %rdx, 8(%rsp) - movq %rbp, 16(%rsp) + /* Save ftrace_regs for function exit context */ + subq $(FRAME_SIZE), %rsp + + movq %rax, RAX(%rsp) + movq %rdx, RDX(%rsp) + movq %rbp, RBP(%rsp) movq %rsp, %rdi call ftrace_return_to_handler movq %rax, %rdi - movq 8(%rsp), %rdx - movq (%rsp), %rax + movq RDX(%rsp), %rdx + movq RAX(%rsp), %rax - addq $24, %rsp + addq $(FRAME_SIZE), %rsp /* * Jump back to the old return address. This cannot be JMP_NOSPEC rdi * since IBT would demand that contain ENDBR, which simply isn't so for
include/linux/ftrace.h +11 -3
@@ -43,9 +43,8 @@ struct dyn_ftrace;char *arch_ftrace_match_adjust (char *str,const char *search); -#ifdef CONFIG_HAVE_FUNCTION_GRAPH_RETVAL -struct fgraph_ret_regs ; -unsigned long ftrace_return_to_handler (struct fgraph_ret_regs *ret_regs); +#ifdef CONFIG_HAVE_FUNCTION_GRAPH_FREGS +unsigned long ftrace_return_to_handler (struct ftrace_regs *fregs);#else unsigned long ftrace_return_to_handler (unsigned long frame_pointer);#endif
@@ -134,6 +133,13 @@ extern int ftrace_enabled;* Also, architecture dependent fields can be used for internal process. * (e.g. orig_ax on x86_64) * +* Basically, ftrace_regs stores the registers related to the context. +* On function entry, registers for function parameters and hooking the +* function call are stored, and on function exit, registers for function +* return value and frame pointers are stored. +* +* And also, it dpends on the context that which registers are restored +* from the ftrace_regs. * On the function entry, those registers will be restored except for * the stack pointer, so that user can change the function parameters * and instruction pointer (e.g. live patching.)
@@ -191,6 +197,8 @@ static __always_inline bool ftrace_regs_has_args(struct ftrace_regs *fregs) override_function_with_return(ftrace_get_regs(fregs))#define ftrace_regs_query_register_offset (name) \ regs_query_register_offset(name) +#define ftrace_regs_get_frame_pointer (fregs) \ + frame_pointer(&(fregs)->regs)#endif typedef void (*ftrace_func_t)(unsigned long ip, unsigned long parent_ip,
kernel/trace/Kconfig +2 -2
@@ -31,7 +31,7 @@ config HAVE_FUNCTION_GRAPH_TRACER help See Documentation/trace/ftrace-design.rst -config HAVE_FUNCTION_GRAPH_RETVAL +config HAVE_FUNCTION_GRAPH_FREGS bool config HAVE_DYNAMIC_FTRACE
@@ -232,7 +232,7 @@ config FUNCTION_GRAPH_TRACER config FUNCTION_GRAPH_RETVAL bool "Kernel Function Graph Return Value" - depends on HAVE_FUNCTION_GRAPH_RETVAL + depends on HAVE_FUNCTION_GRAPH_FREGS depends on FUNCTION_GRAPH_TRACER default n help
kernel/trace/fgraph.c +9 -12
@@ -763,15 +763,12 @@ static struct notifier_block ftrace_suspend_notifier = { .notifier_call = ftrace_suspend_notifier_call, }; -/* fgraph_ret_regs is not defined without CONFIG_FUNCTION_GRAPH_RETVAL */ -struct fgraph_ret_regs ; -/* * Send the trace to the ring-buffer. * @return the original return address. */ -static unsigned long __ftrace_return_to_handler (struct fgraph_ret_regs *ret_regs, -unsigned long frame_pointer) +static inline unsigned long +__ftrace_return_to_handler (struct ftrace_regs *fregs,unsigned long frame_pointer) {struct ftrace_ret_stack *ret_stack;struct ftrace_graph_ret trace;
@@ -791,7 +788,7 @@ static unsigned long __ftrace_return_to_handler(struct fgraph_ret_regs *ret_regs trace.rettime =trace_clock_local ();#ifdef CONFIG_FUNCTION_GRAPH_RETVAL - trace.retval =fgraph_ret_regs_return_value (ret_regs); + trace.retval =ftrace_regs_get_return_value (fregs);#endif bitmap =get_bitmap_bits (current, offset);
@@ -826,14 +823,14 @@ static unsigned long __ftrace_return_to_handler(struct fgraph_ret_regs *ret_regs }/* -* After all architecures have selected HAVE_FUNCTION_GRAPH_RETVAL, we can -* leave only ftrace_return_to_handler(ret_regs). +* After all architecures have selected HAVE_FUNCTION_GRAPH_FREGS, we can +* leave only ftrace_return_to_handler(fregs). */ -#ifdef CONFIG_HAVE_FUNCTION_GRAPH_RETVAL -unsigned long ftrace_return_to_handler (struct fgraph_ret_regs *ret_regs) +#ifdef CONFIG_HAVE_FUNCTION_GRAPH_FREGS +unsigned long ftrace_return_to_handler (struct ftrace_regs *fregs) { -return __ftrace_return_to_handler (ret_regs, -fgraph_ret_regs_frame_pointer (ret_regs)); +return __ftrace_return_to_handler (fregs, +ftrace_regs_get_frame_pointer (fregs)); }#else unsigned long ftrace_return_to_handler (unsigned long frame_pointer)
Masami Hiramatsu (Google)
maintainerPATCH v13 6/20 function_graph: Pass ftrace_regs to retfunc
In reply to Masami Hiramatsu (Google)From: Masami Hiramatsu (Google) <[email protected]>
Pass ftrace_regs to the fgraph_ops::retfunc(). If ftrace_regs is not available, it passes a NULL instead. User callback function can access some registers (including return address) via this ftrace_regs.
---
Changes in v8:
- Pass ftrace_regs to retfunc, instead of adding retregfunc.
Changes in v6:
- update to use ftrace_regs_get_return_value() because of reordering patches.
Changes in v3:
- Update for new multiple fgraph.
- Save the return address to instruction pointer in ftrace_regs.
--- include/linux/ftrace.h | 3 ++- kernel/trace/fgraph.c | 16 +++++++++++----- kernel/trace/ftrace.c | 3 ++- kernel/trace/trace.h | 3 ++- kernel/trace/trace_functions_graph.c | 7 ++++--- kernel/trace/trace_irqsoff.c | 3 ++- kernel/trace/trace_sched_wakeup.c | 3 ++- kernel/trace/trace_selftest.c | 3 ++- 8 files changed, 27 insertions(+), 14 deletions(-)
include/linux/ftrace.h +2 -1
@@ -1069,7 +1069,8 @@ struct fgraph_ops;/* Type of the callback handlers for tracing function graph*/ typedef void (*trace_func_graph_ret_t )(struct ftrace_graph_ret *, -struct fgraph_ops *);/* return */ +struct fgraph_ops *, +struct ftrace_regs *);/* return */ typedef int (*trace_func_graph_ent_t )(struct ftrace_graph_ent *,struct fgraph_ops *,struct ftrace_regs *);/* entry */
kernel/trace/fgraph.c +11 -5
@@ -297,7 +297,8 @@ static int entry_run(struct ftrace_graph_ent *trace, struct fgraph_ops *ops, }/* ftrace_graph_return set to this to tell some archs to run function graph */ -static void return_run (struct ftrace_graph_ret *trace,struct fgraph_ops *ops) +static void return_run (struct ftrace_graph_ret *trace,struct fgraph_ops *ops, +struct ftrace_regs *fregs) { }
@@ -491,7 +492,8 @@ int ftrace_graph_entry_stub(struct ftrace_graph_ent *trace, }static void ftrace_graph_ret_stub (struct ftrace_graph_ret *trace, -struct fgraph_ops *gops) +struct fgraph_ops *gops, +struct ftrace_regs *fregs) { }
@@ -787,6 +789,9 @@ __ftrace_return_to_handler(struct ftrace_regs *fregs, unsigned long frame_pointe } trace.rettime =trace_clock_local (); +if (fregs) +ftrace_regs_set_instruction_pointer (fregs, ret); +#ifdef CONFIG_FUNCTION_GRAPH_RETVAL trace.retval =ftrace_regs_get_return_value (fregs);#endif
@@ -796,7 +801,7 @@ __ftrace_return_to_handler(struct ftrace_regs *fregs, unsigned long frame_pointe#ifdef CONFIG_HAVE_STATIC_CALL if (static_branch_likely (&fgraph_do_direct)) {if (test_bit (fgraph_direct_gops->idx, &bitmap)) -static_call (fgraph_retfunc)(&trace, fgraph_direct_gops); +static_call (fgraph_retfunc)(&trace, fgraph_direct_gops, fregs); } else#endif {
@@ -806,7 +811,7 @@ __ftrace_return_to_handler(struct ftrace_regs *fregs, unsigned long frame_pointeif (gops == &fgraph_stub)continue ; - gops->retfunc (&trace, gops); + gops->retfunc (&trace, gops, fregs); } }
@@ -956,7 +961,8 @@ void ftrace_graph_sleep_time_control(bool enable)* Simply points to ftrace_stub, but with the proper protocol. * Defined by the linker script in linux/vmlinux.lds.h */ -void ftrace_stub_graph (struct ftrace_graph_ret *trace,struct fgraph_ops *gops); +void ftrace_stub_graph (struct ftrace_graph_ret *trace,struct fgraph_ops *gops, +struct ftrace_regs *fregs);/* The callbacks that hook a function */ trace_func_graph_ret_t ftrace_graph_return = ftrace_stub_graph;
kernel/trace/ftrace.c +2 -1
@@ -840,7 +840,8 @@ static int profile_graph_entry(struct ftrace_graph_ent *trace, }static void profile_graph_return (struct ftrace_graph_ret *trace, -struct fgraph_ops *gops) +struct fgraph_ops *gops, +struct ftrace_regs *fregs) {struct ftrace_ret_stack *ret_stack;struct ftrace_profile_stat *stat;
kernel/trace/trace.h +2 -1
@@ -682,7 +682,8 @@ void trace_latency_header(struct seq_file *m);void trace_default_header (struct seq_file *m);void print_trace_header (struct seq_file *m,struct trace_iterator *iter); -void trace_graph_return (struct ftrace_graph_ret *trace,struct fgraph_ops *gops); +void trace_graph_return (struct ftrace_graph_ret *trace,struct fgraph_ops *gops, +struct ftrace_regs *fregs);int trace_graph_entry (struct ftrace_graph_ent *trace,struct fgraph_ops *gops,struct ftrace_regs *fregs);
kernel/trace/trace_functions_graph.c +4 -3
@@ -240,7 +240,7 @@ void __trace_graph_return(struct trace_array *tr, }void trace_graph_return (struct ftrace_graph_ret *trace, -struct fgraph_ops *gops) +struct fgraph_ops *gops,struct ftrace_regs *fregs) {unsigned long *task_var =fgraph_get_task_var (gops);struct trace_array *tr = gops->private;
@@ -270,7 +270,8 @@ void trace_graph_return(struct ftrace_graph_ret *trace, }static void trace_graph_thresh_return (struct ftrace_graph_ret *trace, -struct fgraph_ops *gops) +struct fgraph_ops *gops, +struct ftrace_regs *fregs) {ftrace_graph_addr_finish (gops, trace);
@@ -283,7 +284,7 @@ static void trace_graph_thresh_return(struct ftrace_graph_ret *trace, (trace->rettime - trace->calltime < tracing_thresh)) return; else -trace_graph_return (trace ,gops ); +trace_graph_return (trace ,gops ,fregs ); }static struct fgraph_ops funcgraph_ops = {
kernel/trace/trace_irqsoff.c +2 -1
@@ -208,7 +208,8 @@ static int irqsoff_graph_entry(struct ftrace_graph_ent *trace, }static void irqsoff_graph_return (struct ftrace_graph_ret *trace, -struct fgraph_ops *gops) +struct fgraph_ops *gops, +struct ftrace_regs *fregs) {struct trace_array *tr = irqsoff_trace;struct trace_array_cpu *data;
kernel/trace/trace_sched_wakeup.c +2 -1
@@ -144,7 +144,8 @@ static int wakeup_graph_entry(struct ftrace_graph_ent *trace, }static void wakeup_graph_return (struct ftrace_graph_ret *trace, -struct fgraph_ops *gops) +struct fgraph_ops *gops, +struct ftrace_regs *fregs) {struct trace_array *tr = wakeup_trace;struct trace_array_cpu *data;
kernel/trace/trace_selftest.c +2 -1
@@ -807,7 +807,8 @@ static __init int store_entry(struct ftrace_graph_ent *trace, }static __init void store_return (struct ftrace_graph_ret *trace, -struct fgraph_ops *gops) +struct fgraph_ops *gops, +struct ftrace_regs *fregs) { struct fgraph_fixture *fixture = container_of(gops, struct fgraph_fixture, gops);const char *type = fixture->store_type_name;
Masami Hiramatsu (Google)
maintainerPATCH v13 7/20 fprobe: Use ftrace_regs in fprobe entry handler
In reply to Masami Hiramatsu (Google)From: Masami Hiramatsu (Google) <[email protected]>
This allows fprobes to be available with CONFIG_DYNAMIC_FTRACE_WITH_ARGS instead of CONFIG_DYNAMIC_FTRACE_WITH_REGS, then we can enable fprobe on arm64.
---
Changes in v6:
- Keep using SAVE_REGS flag to avoid breaking bpf kprobe-multi test.
--- include/linux/fprobe.h | 2 +- kernel/trace/Kconfig | 3 ++- kernel/trace/bpf_trace.c | 10 +++++++--- kernel/trace/fprobe.c | 3 ++- kernel/trace/trace_fprobe.c | 6 +++++- lib/test_fprobe.c | 4 ++-- samples/fprobe/fprobe_example.c | 2 +- 7 files changed, 20 insertions(+), 10 deletions(-)
include/linux/fprobe.h +1 -1
@@ -10,7 +10,7 @@struct fprobe ;typedef int (*fprobe_entry_cb )(struct fprobe *fp,unsigned long entry_ip, -unsigned long ret_ip,struct pt_regs *regs, +unsigned long ret_ip,struct ftrace_regs *regs,void *entry_data); typedef void (*fprobe_exit_cb)(struct fprobe *fp, unsigned long entry_ip,
kernel/trace/Kconfig +2 -1
@@ -287,7 +287,7 @@ config DYNAMIC_FTRACE_WITH_ARGS config FPROBE bool "Kernel Function Probe (fprobe)" depends on FUNCTION_TRACER - depends on DYNAMIC_FTRACE_WITH_REGS + depends on DYNAMIC_FTRACE_WITH_REGS || DYNAMIC_FTRACE_WITH_ARGS depends on HAVE_RETHOOK select RETHOOK default n
@@ -672,6 +672,7 @@ config FPROBE_EVENTS select TRACING select PROBE_EVENTS select DYNAMIC_EVENTS + depends on DYNAMIC_FTRACE_WITH_REGS default y help This allows user to add tracing events on the function entry and
kernel/trace/bpf_trace.c +7 -3
@@ -2605,7 +2605,7 @@ struct bpf_session_run_ctx {void *data; }; -#ifdef CONFIG_FPROBE +#if defined(CONFIG_FPROBE) && defined(CONFIG_DYNAMIC_FTRACE_WITH_REGS) struct bpf_kprobe_multi_link { struct bpf_link link; struct fprobe fp;
@@ -2857,12 +2857,16 @@ kprobe_multi_link_prog_run(struct bpf_kprobe_multi_link *link,static int kprobe_multi_link_handler (struct fprobe *fp,unsigned long fentry_ip, -unsigned long ret_ip,struct pt_regs *regs, +unsigned long ret_ip,struct ftrace_regs *fregs,void *data) { +struct pt_regs *regs =ftrace_get_regs (fregs);struct bpf_kprobe_multi_link *link;int err; +if (!regs) +return 0 ; + link = container_of(fp, struct bpf_kprobe_multi_link, fp); err =kprobe_multi_link_prog_run (link,get_entry_ip (fentry_ip), regs, false, data);return is_kprobe_session (link->link.prog) ? err :0 ;
@@ -3137,7 +3141,7 @@ int bpf_kprobe_multi_link_attach(const union bpf_attr *attr, struct bpf_prog *prkvfree (cookies); return err; } -#else /* !CONFIG_FPROBE */ +#else /* !CONFIG_FPROBE || !CONFIG_DYNAMIC_FTRACE_WITH_REGS */ int bpf_kprobe_multi_link_attach (const union bpf_attr *attr,struct bpf_prog *prog) {return -EOPNOTSUPP ;
kernel/trace/fprobe.c +2 -1
@@ -46,7 +46,7 @@ static inline void __fprobe_handler(unsigned long ip, unsigned long parent_ip, }if (fp->entry_handler) - ret = fp->entry_handler (fp, ip, parent_ip,ftrace_get_regs (fregs), entry_data); + ret = fp->entry_handler (fp, ip, parent_ip, fregs, entry_data);/* If entry_handler returns !0, nmissed is not counted. */ if (rh) {
@@ -182,6 +182,7 @@ static void fprobe_init(struct fprobe *fp) fp->ops.func = fprobe_kprobe_handler; else fp->ops.func = fprobe_handler; + fp->ops.flags |=FTRACE_OPS_FL_SAVE_REGS ; }
kernel/trace/trace_fprobe.c +5 -1
@@ -338,12 +338,16 @@ NOKPROBE_SYMBOL(fexit_perf_func);#endif /* CONFIG_PERF_EVENTS */ static int fentry_dispatcher (struct fprobe *fp,unsigned long entry_ip, -unsigned long ret_ip,struct pt_regs *regs, +unsigned long ret_ip,struct ftrace_regs *fregs,void *entry_data) { struct trace_fprobe *tf = container_of(fp, struct trace_fprobe, fp); +struct pt_regs *regs =ftrace_get_regs (fregs);int ret =0 ; +if (!regs) +return 0 ; +if (trace_probe_test_flag (&tf->tp,TP_FLAG_TRACE ))fentry_trace_func (tf, entry_ip, regs);#ifdef CONFIG_PERF_EVENTS
lib/test_fprobe.c +2 -2
@@ -40,7 +40,7 @@ static noinline u32 fprobe_selftest_nest_target(u32 value, u32 (*nest)(u32)) static notrace int fp_entry_handler(struct fprobe *fp, unsigned long ip,unsigned long ret_ip, -struct pt_regs *regs,void *data) +struct ftrace_regs *fregs,void *data) {KUNIT_EXPECT_FALSE (current_test,preemptible ());/* This can be called on the fprobe_selftest_target and the fprobe_selftest_target2 */
@@ -81,7 +81,7 @@ static notrace void fp_exit_handler(struct fprobe *fp, unsigned long ip, static notrace int nest_entry_handler(struct fprobe *fp, unsigned long ip,unsigned long ret_ip, -struct pt_regs *regs,void *data) +struct ftrace_regs *fregs,void *data) {KUNIT_EXPECT_FALSE (current_test,preemptible ());return 0 ;
samples/fprobe/fprobe_example.c +1 -1
@@ -50,7 +50,7 @@ static void show_backtrace(void)static int sample_entry_handler (struct fprobe *fp,unsigned long ip,unsigned long ret_ip, -struct pt_regs *regs,void *data) +struct ftrace_regs *fregs,void *data) {if (use_trace)/*
Masami Hiramatsu (Google)
maintainerPATCH v13 8/20 fprobe: Use ftrace_regs in fprobe exit handler
In reply to Masami Hiramatsu (Google)From: Masami Hiramatsu (Google) <[email protected]>
Change the fprobe exit handler to use ftrace_regs structure instead of pt_regs. This also introduce HAVE_PT_REGS_TO_FTRACE_REGS_CAST which means the ftrace_regs's memory layout is equal to the pt_regs so that those are able to cast. Fprobe introduces a new dependency with that.
---
Changes in v3:
- Use ftrace_regs_get_return_value()
Changes from previous series: NOTHING, just forward ported.
--- arch/loongarch/Kconfig | 1 + arch/s390/Kconfig | 1 + arch/x86/Kconfig | 1 + include/linux/fprobe.h | 2 +- include/linux/ftrace.h | 6 ++++++ kernel/trace/Kconfig | 8 ++++++++ kernel/trace/bpf_trace.c | 6 +++++- kernel/trace/fprobe.c | 3 ++- kernel/trace/trace_fprobe.c | 6 +++++- lib/test_fprobe.c | 6 +++--- samples/fprobe/fprobe_example.c | 2 +- 11 files changed, 34 insertions(+), 8 deletions(-)
arch/loongarch/Kconfig +1 -0
@@ -122,6 +122,7 @@ config LOONGARCH select HAVE_DMA_CONTIGUOUS select HAVE_DYNAMIC_FTRACE select HAVE_DYNAMIC_FTRACE_WITH_ARGS + select HAVE_PT_REGS_TO_FTRACE_REGS_CAST select HAVE_DYNAMIC_FTRACE_WITH_DIRECT_CALLS select HAVE_DYNAMIC_FTRACE_WITH_REGS select HAVE_EBPF_JIT
arch/s390/Kconfig +1 -0
@@ -175,6 +175,7 @@ config S390 select HAVE_DMA_CONTIGUOUS select HAVE_DYNAMIC_FTRACE select HAVE_DYNAMIC_FTRACE_WITH_ARGS + select HAVE_PT_REGS_TO_FTRACE_REGS_CAST select HAVE_DYNAMIC_FTRACE_WITH_DIRECT_CALLS select HAVE_DYNAMIC_FTRACE_WITH_REGS select HAVE_EBPF_JIT if HAVE_MARCH_Z196_FEATURES
arch/x86/Kconfig +1 -0
@@ -218,6 +218,7 @@ config X86 select HAVE_DYNAMIC_FTRACE select HAVE_DYNAMIC_FTRACE_WITH_REGS select HAVE_DYNAMIC_FTRACE_WITH_ARGS if X86_64 + select HAVE_PT_REGS_TO_FTRACE_REGS_CAST if X86_64 select HAVE_DYNAMIC_FTRACE_WITH_DIRECT_CALLS select HAVE_SAMPLE_FTRACE_DIRECT if X86_64 select HAVE_SAMPLE_FTRACE_DIRECT_MULTI if X86_64
include/linux/fprobe.h +1 -1
@@ -14,7 +14,7 @@ typedef int (*fprobe_entry_cb)(struct fprobe *fp, unsigned long entry_ip, void *entry_data);typedef void (*fprobe_exit_cb )(struct fprobe *fp,unsigned long entry_ip, -unsigned long ret_ip,struct pt_regs *regs, +unsigned long ret_ip,struct ftrace_regs *regs,void *entry_data);/**
include/linux/ftrace.h +6 -0
@@ -162,6 +162,12 @@ struct ftrace_regs {#define ftrace_regs_set_instruction_pointer (fregs, ip) do { } while (0)#endif /* CONFIG_HAVE_DYNAMIC_FTRACE_WITH_ARGS */ +#ifdef CONFIG_HAVE_PT_REGS_TO_FTRACE_REGS_CAST + +static_assert (sizeof (struct pt_regs ) ==sizeof (struct ftrace_regs )); + +#endif /* CONFIG_HAVE_PT_REGS_TO_FTRACE_REGS_CAST */ + static __always_inline struct pt_regs *ftrace_get_regs(struct ftrace_regs *fregs) {if (!fregs)
kernel/trace/Kconfig +8 -0
@@ -57,6 +57,13 @@ config HAVE_DYNAMIC_FTRACE_WITH_ARGS This allows for use of ftrace_regs_get_argument() and ftrace_regs_get_stack_pointer(). +config HAVE_PT_REGS_TO_FTRACE_REGS_CAST + bool + help + If this is set, the memory layout of the ftrace_regs data structure + is the same as the pt_regs. So the pt_regs is possible to be casted + to ftrace_regs. + config HAVE_DYNAMIC_FTRACE_NO_PATCHABLE bool help
@@ -288,6 +295,7 @@ config FPROBE bool "Kernel Function Probe (fprobe)" depends on FUNCTION_TRACER depends on DYNAMIC_FTRACE_WITH_REGS || DYNAMIC_FTRACE_WITH_ARGS + depends on HAVE_PT_REGS_TO_FTRACE_REGS_CAST || !HAVE_DYNAMIC_FTRACE_WITH_ARGS depends on HAVE_RETHOOK select RETHOOK default n
kernel/trace/bpf_trace.c +5 -1
@@ -2874,10 +2874,14 @@ kprobe_multi_link_handler(struct fprobe *fp, unsigned long fentry_ip,static void kprobe_multi_link_exit_handler (struct fprobe *fp,unsigned long fentry_ip, -unsigned long ret_ip,struct pt_regs *regs, +unsigned long ret_ip,struct ftrace_regs *fregs,void *data) {struct bpf_kprobe_multi_link *link; +struct pt_regs *regs =ftrace_get_regs (fregs); + +if (!regs) +return ; link = container_of(fp, struct bpf_kprobe_multi_link, fp);kprobe_multi_link_prog_run (link,get_entry_ip (fentry_ip), regs, true, data);
kernel/trace/fprobe.c +2 -1
@@ -124,6 +124,7 @@ static void fprobe_exit_handler(struct rethook_node *rh, void *data, {struct fprobe *fp = (struct fprobe *)data;struct fprobe_rethook_node *fpr; +struct ftrace_regs *fregs = (struct ftrace_regs *)regs;int bit;if (!fp ||fprobe_disabled (fp))
@@ -141,7 +142,7 @@ static void fprobe_exit_handler(struct rethook_node *rh, void *data,return ; } - fp->exit_handler (fp, fpr->entry_ip, ret_ip, regs, + fp->exit_handler (fp, fpr->entry_ip, ret_ip, fregs, fp->entry_data_size ? (void *)fpr->data :NULL );ftrace_test_recursion_unlock (bit); }
kernel/trace/trace_fprobe.c +5 -1
@@ -359,10 +359,14 @@ static int fentry_dispatcher(struct fprobe *fp, unsigned long entry_ip,NOKPROBE_SYMBOL (fentry_dispatcher);static void fexit_dispatcher (struct fprobe *fp,unsigned long entry_ip, -unsigned long ret_ip,struct pt_regs *regs, +unsigned long ret_ip,struct ftrace_regs *fregs,void *entry_data) { struct trace_fprobe *tf = container_of(fp, struct trace_fprobe, fp); +struct pt_regs *regs =ftrace_get_regs (fregs); + +if (!regs) +return ;if (trace_probe_test_flag (&tf->tp,TP_FLAG_TRACE ))fexit_trace_func (tf, entry_ip, ret_ip, regs, entry_data);
lib/test_fprobe.c +3 -3
@@ -59,9 +59,9 @@ static notrace int fp_entry_handler(struct fprobe *fp, unsigned long ip, static notrace void fp_exit_handler(struct fprobe *fp, unsigned long ip,unsigned long ret_ip, -struct pt_regs *regs,void *data) +struct ftrace_regs *fregs,void *data) { -unsigned long ret =regs_return_value (regs); +unsigned long ret =ftrace_regs_get_return_value (fregs);KUNIT_EXPECT_FALSE (current_test,preemptible ());if (ip != target_ip) {
@@ -89,7 +89,7 @@ static notrace int nest_entry_handler(struct fprobe *fp, unsigned long ip, static notrace void nest_exit_handler(struct fprobe *fp, unsigned long ip,unsigned long ret_ip, -struct pt_regs *regs,void *data) +struct ftrace_regs *fregs,void *data) {KUNIT_EXPECT_FALSE (current_test,preemptible ());KUNIT_EXPECT_EQ (current_test, ip, target_nest_ip);
samples/fprobe/fprobe_example.c +1 -1
@@ -67,7 +67,7 @@ static int sample_entry_handler(struct fprobe *fp, unsigned long ip, }static void sample_exit_handler (struct fprobe *fp,unsigned long ip, -unsigned long ret_ip,struct pt_regs *regs, +unsigned long ret_ip,struct ftrace_regs *regs,void *data) {unsigned long rip = ret_ip;
Masami Hiramatsu (Google)
maintainerPATCH v13 9/20 tracing: Add ftrace_partial_regs() for converting ftrace_regs to pt_regs
In reply to Masami Hiramatsu (Google)From: Masami Hiramatsu (Google) <[email protected]>
Add ftrace_partial_regs() which converts the ftrace_regs to pt_regs. This is for the eBPF which needs this to keep the same pt_regs interface to access registers.
Thus when replacing the pt_regs with ftrace_regs in fprobes (which is used by kprobe_multi eBPF event), this will be used.
If the architecture defines its own ftrace_regs, this copies partial registers to pt_regs and returns it. If not, ftrace_regs is the same as pt_regs and ftrace_partial_regs() will return ftrace_regs::regs.
---
Changes in v8:
- Add the reason why this required in changelog.
Changes from previous series: NOTHING, just forward ported.
--- arch/arm64/include/asm/ftrace.h | 11 +++++++++++ include/linux/ftrace.h | 17 +++++++++++++++++ 2 files changed, 28 insertions(+)
arch/arm64/include/asm/ftrace.h +11 -0
@@ -132,6 +132,17 @@ ftrace_regs_get_frame_pointer(const struct ftrace_regs *fregs)return fregs->fp; } +static __always_inline struct pt_regs * +ftrace_partial_regs (const struct ftrace_regs *fregs,struct pt_regs *regs) +{ +memcpy (regs->regs, fregs->regs,sizeof (u64) *9 ); + regs->sp = fregs->sp; + regs->pc = fregs->pc; + regs->regs[29 ] = fregs->fp; + regs->regs[30 ] = fregs->lr; +return regs; +} +int ftrace_regs_query_register_offset (const char *name);int ftrace_init_nop (struct module *mod,struct dyn_ftrace *rec);
include/linux/ftrace.h +17 -0
@@ -176,6 +176,23 @@ static __always_inline struct pt_regs *ftrace_get_regs(struct ftrace_regs *fregsreturn arch_ftrace_get_regs (fregs); } +#if !defined(CONFIG_HAVE_DYNAMIC_FTRACE_WITH_ARGS ) || \ + defined(CONFIG_HAVE_PT_REGS_TO_FTRACE_REGS_CAST ) + +static __always_inline struct pt_regs * +ftrace_partial_regs (struct ftrace_regs *fregs,struct pt_regs *regs) +{ +/* +* If CONFIG_HAVE_PT_REGS_TO_FTRACE_REGS_CAST=y, ftrace_regs memory +* layout is the same as pt_regs. So always returns that address. +* Since arch_ftrace_get_regs() will check some members and may return +* NULL, we can not use it. +*/ +return &fregs->regs; +} + +#endif /* !CONFIG_HAVE_DYNAMIC_FTRACE_WITH_ARGS || CONFIG_HAVE_PT_REGS_TO_FTRACE_REGS_CAST */ +/* * When true, the ftrace_regs_{get,set}_*() functions may be used on fregs. * Note: this can be true even when ftrace_get_regs() cannot provide a pt_regs.
Masami Hiramatsu (Google)
maintainerPATCH v13 10/20 tracing: Add ftrace_fill_perf_regs() for perf event
In reply to Masami Hiramatsu (Google)From: Masami Hiramatsu (Google) <[email protected]>
Add ftrace_fill_perf_regs() which should be compatible with the perf_fetch_caller_regs(). In other words, the pt_regs returned from the ftrace_fill_perf_regs() must satisfy 'user_mode(regs) == false' and can be used for stack tracing.
---
Changes from previous series: NOTHING, just forward ported.
--- arch/arm64/include/asm/ftrace.h | 7 +++++++ arch/powerpc/include/asm/ftrace.h | 7 +++++++ arch/s390/include/asm/ftrace.h | 5 +++++ arch/x86/include/asm/ftrace.h | 7 +++++++ include/linux/ftrace.h | 31 +++++++++++++++++++++++++++++++ 5 files changed, 57 insertions(+)
arch/arm64/include/asm/ftrace.h +7 -0
@@ -143,6 +143,13 @@ ftrace_partial_regs(const struct ftrace_regs *fregs, struct pt_regs *regs)return regs; } +#define arch_ftrace_fill_perf_regs (fregs, _regs) do { \ + (_regs)->pc = (fregs)->pc; \ + (_regs)->regs[29] = (fregs)->fp; \ + (_regs)->sp = (fregs)->sp; \ + (_regs)->pstate = PSR_MODE_EL1h; \ + } while (0) +int ftrace_regs_query_register_offset (const char *name);int ftrace_init_nop (struct module *mod,struct dyn_ftrace *rec);
arch/powerpc/include/asm/ftrace.h +7 -0
@@ -42,6 +42,13 @@ static __always_inline struct pt_regs *arch_ftrace_get_regs(struct ftrace_regs *return fregs->regs.msr ? &fregs->regs :NULL ; } +#define arch_ftrace_fill_perf_regs (fregs, _regs) do { \ + (_regs)->result = 0; \ + (_regs)->nip = (fregs)->regs.nip; \ + (_regs)->gpr[1] = (fregs)->regs.gpr[1]; \ + asm volatile("mfmsr %0" : "=r" ((_regs)->msr)); \ + } while (0) + static __always_inline voidftrace_regs_set_instruction_pointer (struct ftrace_regs *fregs,unsigned long ip)
arch/s390/include/asm/ftrace.h +5 -0
@@ -84,6 +84,11 @@ ftrace_regs_get_frame_pointer(struct ftrace_regs *fregs)return sp[0 ];/* return backchain */ } +#define arch_ftrace_fill_perf_regs (fregs, _regs) do { \ + (_regs)->psw.addr = (fregs)->regs.psw.addr; \ + (_regs)->gprs[15] = (fregs)->regs.gprs[15]; \ + } while (0) +#ifdef CONFIG_DYNAMIC_FTRACE_WITH_DIRECT_CALLS /* * When an ftrace registered caller is tracing a function that is
arch/x86/include/asm/ftrace.h +7 -0
@@ -46,6 +46,13 @@ arch_ftrace_get_regs(struct ftrace_regs *fregs)return &fregs->regs; } +#define arch_ftrace_fill_perf_regs (fregs, _regs) do { \ + (_regs)->ip = (fregs)->regs.ip; \ + (_regs)->sp = (fregs)->regs.sp; \ + (_regs)->cs = __KERNEL_CS; \ + (_regs)->flags = 0; \ + } while (0) +#define ftrace_regs_set_instruction_pointer (fregs, _ip) \ do { (fregs)->regs.ip = (_ip); } while (0)
include/linux/ftrace.h +31 -0
@@ -193,6 +193,37 @@ ftrace_partial_regs(struct ftrace_regs *fregs, struct pt_regs *regs)#endif /* !CONFIG_HAVE_DYNAMIC_FTRACE_WITH_ARGS || CONFIG_HAVE_PT_REGS_TO_FTRACE_REGS_CAST */ +#ifdef CONFIG_HAVE_DYNAMIC_FTRACE_WITH_ARGS + +/* +* Please define arch dependent pt_regs which compatible to the +* perf_arch_fetch_caller_regs() but based on ftrace_regs. +* This requires +* - user_mode(_regs) returns false (always kernel mode). +* - able to use the _regs for stack trace. +*/ +#ifndef arch_ftrace_fill_perf_regs +/* As same as perf_arch_fetch_caller_regs(), do nothing by default */ +#define arch_ftrace_fill_perf_regs (fregs, _regs) do {} while (0) +#endif + +static __always_inline struct pt_regs * +ftrace_fill_perf_regs (struct ftrace_regs *fregs,struct pt_regs *regs) +{ +arch_ftrace_fill_perf_regs (fregs, regs); +return regs; +} + +#else /* !CONFIG_HAVE_DYNAMIC_FTRACE_WITH_ARGS */ + +static __always_inline struct pt_regs * +ftrace_fill_perf_regs (struct ftrace_regs *fregs,struct pt_regs *regs) +{ +return &fregs->regs; +} + +#endif +/* * When true, the ftrace_regs_{get,set}_*() functions may be used on fregs. * Note: this can be true even when ftrace_get_regs() cannot provide a pt_regs.
Masami Hiramatsu (Google)
maintainerPATCH v13 11/20 tracing/fprobe: Enable fprobe events with CONFIG_DYNAMIC_FTRACE_WITH_ARGS
In reply to Masami Hiramatsu (Google)From: Masami Hiramatsu (Google) <[email protected]>
Allow fprobe events to be enabled with CONFIG_DYNAMIC_FTRACE_WITH_ARGS. With this change, fprobe events mostly use ftrace_regs instead of pt_regs. Note that if the arch doesn't enable HAVE_PT_REGS_COMPAT_FTRACE_REGS, fprobe events will not be able to be used from perf.
---
Changes in v9:
- Copy store_trace_entry_data() as store_fprobe_entry_data() for fprobe.
Chagnes in v3:
- Use ftrace_regs_get_return_value().
Changes in v2:
- Define ftrace_regs_get_kernel_stack_nth() for !CONFIG_HAVE_REGS_AND_STACK_ACCESS_API.
Changes from previous series: Update against the new series.
--- include/linux/ftrace.h | 17 ++++++ kernel/trace/Kconfig | 1 kernel/trace/trace_fprobe.c | 107 +++++++++++++++++++++++++-------------- kernel/trace/trace_probe_tmpl.h | 2 - 4 files changed, 86 insertions(+), 41 deletions(-)
include/linux/ftrace.h +17 -0
@@ -255,6 +255,23 @@ static __always_inline bool ftrace_regs_has_args(struct ftrace_regs *fregs) frame_pointer(&(fregs)->regs)#endif +#ifdef CONFIG_HAVE_REGS_AND_STACK_ACCESS_API +static __always_inline unsigned long +ftrace_regs_get_kernel_stack_nth (struct ftrace_regs *fregs,unsigned int nth) +{ +unsigned long *stackp; + + stackp = (unsigned long *)ftrace_regs_get_stack_pointer (fregs); +if (((unsigned long )(stackp + nth) & ~(THREAD_SIZE -1 )) == + ((unsigned long )stackp & ~(THREAD_SIZE -1 ))) +return *(stackp + nth); + +return 0 ; +} +#else /* !CONFIG_HAVE_REGS_AND_STACK_ACCESS_API */ +#define ftrace_regs_get_kernel_stack_nth (fregs, nth) (0L) +#endif /* CONFIG_HAVE_REGS_AND_STACK_ACCESS_API */ +typedef void (*ftrace_func_t )(unsigned long ip,unsigned long parent_ip,struct ftrace_ops *op,struct ftrace_regs *fregs);
kernel/trace/Kconfig +0 -1
@@ -680,7 +680,6 @@ config FPROBE_EVENTS select TRACING select PROBE_EVENTS select DYNAMIC_EVENTS - depends on DYNAMIC_FTRACE_WITH_REGS default y help This allows user to add tracing events on the function entry and
kernel/trace/trace_fprobe.c +68 -39
271 lines not on this page · raw message
kernel/trace/trace_probe_tmpl.h +1 -1
@@ -232,7 +232,7 @@ process_fetch_insn_bottom(struct fetch_insn *code, unsigned long val,/* Sum up total data length for dynamic arrays (strings) */ static nokprobe_inline int -__get_data_size (struct trace_probe *tp,struct pt_regs *regs,void *edata) +__get_data_size (struct trace_probe *tp,void *regs,void *edata) {struct probe_arg *arg;int i, len, ret =0 ;
Masami Hiramatsu (Google)
maintainerPATCH v13 12/20 bpf: Enable kprobe_multi feature if CONFIG_FPROBE is enabled
In reply to Masami Hiramatsu (Google)From: Masami Hiramatsu (Google) <[email protected]>
Enable kprobe_multi feature if CONFIG_FPROBE is enabled. The pt_regs is converted from ftrace_regs by ftrace_partial_regs(), thus some registers may always returns 0. But it should be enough for function entry (access arguments) and exit (access return value).
---
Changes in v9:
- Avoid wasting memory for bpf_kprobe_multi_pt_regs when CONFIG_HAVE_PT_REGS_TO_FTRACE_REGS_CAST=y
--- kernel/trace/bpf_trace.c | 27 ++++++++++++++------------- 1 file changed, 14 insertions(+), 13 deletions(-)
kernel/trace/bpf_trace.c +14 -13
@@ -2605,7 +2605,7 @@ struct bpf_session_run_ctx {void *data; }; -#if defined(CONFIG_FPROBE) && defined(CONFIG_DYNAMIC_FTRACE_WITH_REGS) +#ifdef CONFIG_FPROBE struct bpf_kprobe_multi_link { struct bpf_link link; struct fprobe fp;
@@ -2628,6 +2628,13 @@ struct user_syms {char *buf; }; +#ifndef CONFIG_HAVE_PT_REGS_TO_FTRACE_REGS_CAST +static DEFINE_PER_CPU(struct pt_regs, bpf_kprobe_multi_pt_regs); +#define bpf_kprobe_multi_pt_regs_ptr () this_cpu_ptr(&bpf_kprobe_multi_pt_regs) +#else +#define bpf_kprobe_multi_pt_regs_ptr () (NULL) +#endif +static int copy_user_syms (struct user_syms *us,unsigned long __user *usyms,u32 cnt) {unsigned long __user usymbol;
@@ -2822,7 +2829,7 @@ static u64 bpf_kprobe_multi_entry_ip(struct bpf_run_ctx *ctx)static int kprobe_multi_link_prog_run (struct bpf_kprobe_multi_link *link, -unsigned long entry_ip,struct pt_regs *regs, +unsigned long entry_ip,struct ftrace_regs *fregs,bool is_return,void *data) {struct bpf_kprobe_multi_run_ctx run_ctx = {
@@ -2834,6 +2841,7 @@ kprobe_multi_link_prog_run(struct bpf_kprobe_multi_link *link, .entry_ip = entry_ip, };struct bpf_run_ctx *old_run_ctx; +struct pt_regs *regs;int err;if (unlikely (__this_cpu_inc_return (bpf_prog_active) !=1 )) {
@@ -2844,6 +2852,7 @@ kprobe_multi_link_prog_run(struct bpf_kprobe_multi_link *link,migrate_disable ();rcu_read_lock (); + regs =ftrace_partial_regs (fregs,bpf_kprobe_multi_pt_regs_ptr ()); old_run_ctx =bpf_set_run_ctx (&run_ctx.session_ctx.run_ctx); err =bpf_prog_run (link->link.prog, regs);bpf_reset_run_ctx (old_run_ctx);
@@ -2860,15 +2869,11 @@ kprobe_multi_link_handler(struct fprobe *fp, unsigned long fentry_ip, unsigned long ret_ip, struct ftrace_regs *fregs, void *data) { - struct pt_regs *regs = ftrace_get_regs(fregs); struct bpf_kprobe_multi_link *link;int err; -if (!regs) -return 0 ; - link = container_of(fp, struct bpf_kprobe_multi_link, fp); - err =kprobe_multi_link_prog_run (link,get_entry_ip (fentry_ip), regs, false, data); + err =kprobe_multi_link_prog_run (link,get_entry_ip (fentry_ip), fregs, false, data);return is_kprobe_session (link->link.prog) ? err :0 ; }
@@ -2878,13 +2883,9 @@ kprobe_multi_link_exit_handler(struct fprobe *fp, unsigned long fentry_ip, void *data) {struct bpf_kprobe_multi_link *link; -struct pt_regs *regs =ftrace_get_regs (fregs); - -if (!regs) -return ; link = container_of(fp, struct bpf_kprobe_multi_link, fp); -kprobe_multi_link_prog_run (link,get_entry_ip (fentry_ip), regs, true, data); +kprobe_multi_link_prog_run (link,get_entry_ip (fentry_ip), fregs, true, data); }static int symbols_cmp_r (const void *a,const void *b,const void *priv)
@@ -3145,7 +3146,7 @@ int bpf_kprobe_multi_link_attach(const union bpf_attr *attr, struct bpf_prog *prkvfree (cookies); return err; } -#else /* !CONFIG_FPROBE || !CONFIG_DYNAMIC_FTRACE_WITH_REGS */ +#else /* !CONFIG_FPROBE */ int bpf_kprobe_multi_link_attach (const union bpf_attr *attr,struct bpf_prog *prog) {return -EOPNOTSUPP ;
Masami Hiramatsu (Google)
maintainerPATCH v13 13/20 ftrace: Add CONFIG_HAVE_FTRACE_GRAPH_FUNC
In reply to Masami Hiramatsu (Google)From: Masami Hiramatsu (Google) <[email protected]>
Add CONFIG_HAVE_FTRACE_GRAPH_FUNC kconfig in addition to ftrace_graph_func macro check. This is for the other feature (e.g. FPROBE) which requires to access ftrace_regs from fgraph_ops::entryfunc() can avoid compiling if the fgraph can not pass the valid ftrace_regs.
---
Changes in v8:
- Newly added.
--- arch/arm64/Kconfig | 1 + arch/loongarch/Kconfig | 1 + arch/powerpc/Kconfig | 1 + arch/riscv/Kconfig | 1 + arch/x86/Kconfig | 1 + kernel/trace/Kconfig | 5 +++++ 6 files changed, 10 insertions(+)
arch/arm64/Kconfig +1 -0
@@ -208,6 +208,7 @@ config ARM64 select HAVE_SAMPLE_FTRACE_DIRECT_MULTI select HAVE_EFFICIENT_UNALIGNED_ACCESS select HAVE_GUP_FAST + select HAVE_FTRACE_GRAPH_FUNC select HAVE_FTRACE_MCOUNT_RECORD select HAVE_FUNCTION_TRACER select HAVE_FUNCTION_ERROR_INJECTION
arch/loongarch/Kconfig +1 -0
@@ -129,6 +129,7 @@ config LOONGARCH select HAVE_EFFICIENT_UNALIGNED_ACCESS if !ARCH_STRICT_ALIGN select HAVE_EXIT_THREAD select HAVE_GUP_FAST + select HAVE_FTRACE_GRAPH_FUNC select HAVE_FTRACE_MCOUNT_RECORD select HAVE_FUNCTION_ARG_ACCESS_API select HAVE_FUNCTION_ERROR_INJECTION
arch/powerpc/Kconfig +1 -0
@@ -238,6 +238,7 @@ config PPC select HAVE_EBPF_JIT select HAVE_EFFICIENT_UNALIGNED_ACCESS select HAVE_GUP_FAST + select HAVE_FTRACE_GRAPH_FUNC select HAVE_FTRACE_MCOUNT_RECORD select HAVE_FUNCTION_ARG_ACCESS_API select HAVE_FUNCTION_DESCRIPTORS if PPC64_ELF_ABI_V1
arch/riscv/Kconfig +1 -0
@@ -138,6 +138,7 @@ config RISCV select HAVE_DYNAMIC_FTRACE if !XIP_KERNEL && MMU && (CLANG_SUPPORTS_DYNAMIC_FTRACE || GCC_SUPPORTS_DYNAMIC_FTRACE) select HAVE_DYNAMIC_FTRACE_WITH_DIRECT_CALLS select HAVE_DYNAMIC_FTRACE_WITH_ARGS if HAVE_DYNAMIC_FTRACE + select HAVE_FTRACE_GRAPH_FUNC select HAVE_FTRACE_MCOUNT_RECORD if !XIP_KERNEL select HAVE_FUNCTION_GRAPH_TRACER select HAVE_FUNCTION_GRAPH_FREGS
arch/x86/Kconfig +1 -0
@@ -228,6 +228,7 @@ config X86 select HAVE_EXIT_THREAD select HAVE_GUP_FAST select HAVE_FENTRY if X86_64 || DYNAMIC_FTRACE + select HAVE_FTRACE_GRAPH_FUNC if HAVE_FUNCTION_GRAPH_TRACER select HAVE_FTRACE_MCOUNT_RECORD select HAVE_FUNCTION_GRAPH_FREGS if HAVE_FUNCTION_GRAPH_TRACER select HAVE_FUNCTION_GRAPH_TRACER if X86_32 || (X86_64 && DYNAMIC_FTRACE)
kernel/trace/Kconfig +5 -0
@@ -34,6 +34,11 @@ config HAVE_FUNCTION_GRAPH_TRACER config HAVE_FUNCTION_GRAPH_FREGS bool +config HAVE_FTRACE_GRAPH_FUNC + bool + help + True if ftrace_graph_func() is defined. + config HAVE_DYNAMIC_FTRACE bool help
Masami Hiramatsu (Google)
maintainerPATCH v13 14/20 fprobe: Rewrite fprobe on function-graph tracer
In reply to Masami Hiramatsu (Google)From: Masami Hiramatsu (Google) <[email protected]>
Rewrite fprobe implementation on function-graph tracer. Major API changes are:
- 'nr_maxactive' field is deprecated.
- This depends on CONFIG_DYNAMIC_FTRACE_WITH_ARGS or !CONFIG_HAVE_DYNAMIC_FTRACE_WITH_ARGS, and CONFIG_HAVE_FUNCTION_GRAPH_FREGS. So currently works only on x86_64.
- Currently the entry size is limited in 15 * sizeof(long).
- If there is too many fprobe exit handler set on the same function, it will fail to probe.
---
Changes in v12:
- Skip updating ftrace hash if not required.
Changes in v9:
- Remove unneeded prototype of ftrace_regs_get_return_address().
- Fix entry data address calculation.
- Remove DIV_ROUND_UP() from hotpath.
Changes in v8:
- Use trace_func_graph_ret/ent_t for fgraph_ops.
- Update CONFIG_FPROBE dependencies.
- Add ftrace_regs_get_return_address() for each arch.
Changes in v3:
- Update for new reserve_data/retrieve_data API.
- Fix internal push/pop on fgraph data logic so that it can correctly save/restore the returning fprobes.
Changes in v2:
- Add more lockdep_assert_held(fprobe_mutex)
- Use READ_ONCE() and WRITE_ONCE() for fprobe_hlist_node::fp.
- Add NOKPROBE_SYMBOL() for the functions which is called from entry/exit callback.
--- arch/arm64/include/asm/ftrace.h | 6 arch/loongarch/include/asm/ftrace.h | 6 arch/powerpc/include/asm/ftrace.h | 6 arch/s390/include/asm/ftrace.h | 6 arch/x86/include/asm/ftrace.h | 6 include/linux/fprobe.h | 53 ++- kernel/trace/Kconfig | 8 kernel/trace/fprobe.c | 639 +++++++++++++++++++++++++---------- lib/test_fprobe.c | 45 -- 9 files changed, 530 insertions(+), 245 deletions(-)
arch/arm64/include/asm/ftrace.h +6 -0
@@ -132,6 +132,12 @@ ftrace_regs_get_frame_pointer(const struct ftrace_regs *fregs)return fregs->fp; } +static __always_inline unsigned long +ftrace_regs_get_return_address (const struct ftrace_regs *fregs) +{ +return fregs->lr; +} + static __always_inline struct pt_regs *ftrace_partial_regs (const struct ftrace_regs *fregs,struct pt_regs *regs) {
arch/loongarch/include/asm/ftrace.h +6 -0
@@ -80,6 +80,12 @@ ftrace_regs_set_instruction_pointer(struct ftrace_regs *fregs, unsigned long ip)#define ftrace_regs_get_frame_pointer (fregs) \ ((fregs)->regs.regs[22]) +static __always_inline unsigned long +ftrace_regs_get_return_address (struct ftrace_regs *fregs) +{ +return *(unsigned long *)(fregs->regs.regs[1 ]); +} +#define ftrace_graph_func ftrace_graph_funcvoid ftrace_graph_func (unsigned long ip,unsigned long parent_ip,struct ftrace_ops *op,struct ftrace_regs *fregs);
arch/powerpc/include/asm/ftrace.h +6 -0
@@ -75,6 +75,12 @@ ftrace_regs_get_instruction_pointer(struct ftrace_regs *fregs)#define ftrace_regs_query_register_offset (name) \ regs_query_register_offset(name) +static __always_inline unsigned long +ftrace_regs_get_return_address (struct ftrace_regs *fregs) +{ +return fregs->regs.link; +} +struct ftrace_ops ;#define ftrace_graph_func ftrace_graph_func
arch/s390/include/asm/ftrace.h +6 -0
@@ -84,6 +84,12 @@ ftrace_regs_get_frame_pointer(struct ftrace_regs *fregs)return sp[0 ];/* return backchain */ } +static __always_inline unsigned long +ftrace_regs_get_return_address (const struct ftrace_regs *fregs) +{ +return fregs->regs.gprs[14 ]; +} +#define arch_ftrace_fill_perf_regs (fregs, _regs) do { \ (_regs)->psw.addr = (fregs)->regs.psw.addr; \ (_regs)->gprs[15] = (fregs)->regs.gprs[15]; \
arch/x86/include/asm/ftrace.h +6 -0
@@ -74,6 +74,12 @@ arch_ftrace_get_regs(struct ftrace_regs *fregs)#define ftrace_regs_get_frame_pointer (fregs) \ frame_pointer(&(fregs)->regs) +static __always_inline unsigned long +ftrace_regs_get_return_address (struct ftrace_regs *fregs) +{ +return *(unsigned long *)ftrace_regs_get_stack_pointer (fregs); +} +struct ftrace_ops ;#define ftrace_graph_func ftrace_graph_func void ftrace_graph_func(unsigned long ip, unsigned long parent_ip,
include/linux/fprobe.h +38 -15
83 lines not on this page · raw message
kernel/trace/Kconfig +3 -5
@@ -298,11 +298,9 @@ config DYNAMIC_FTRACE_WITH_ARGS config FPROBE bool "Kernel Function Probe (fprobe)" - depends on FUNCTION_TRACER - depends on DYNAMIC_FTRACE_WITH_REGS || DYNAMIC_FTRACE_WITH_ARGS - depends on HAVE_PT_REGS_TO_FTRACE_REGS_CAST || !HAVE_DYNAMIC_FTRACE_WITH_ARGS - depends on HAVE_RETHOOK - select RETHOOK + depends on FUNCTION_GRAPH_TRACER + depends on HAVE_FUNCTION_GRAPH_FREGS && HAVE_FTRACE_GRAPH_FUNC + depends on DYNAMIC_FTRACE_WITH_ARGS default n help This option enables kernel function probe (fprobe) based on ftrace.
kernel/trace/fprobe.c +459 -180
769 lines not on this page · raw message
lib/test_fprobe.c +0 -45
85 lines not on this page · raw message
Masami Hiramatsu (Google)
maintainerPATCH v13 15/20 tracing: Fix function timing profiler to initialize hashtable
In reply to Masami Hiramatsu (Google)From: Masami Hiramatsu (Google) <[email protected]>
Since the new fgraph requires to initialize fgraph_ops.ops.func_hash before calling register_ftrace_graph(), initialize it with default (tracing all functions) parameter.
--- kernel/trace/ftrace.c | 4 ++++ 1 file changed, 4 insertions(+)
kernel/trace/ftrace.c +4 -0
@@ -885,6 +885,10 @@ static void profile_graph_return(struct ftrace_graph_ret *trace, }static struct fgraph_ops fprofiler_ops = { + .ops = { + .flags =FTRACE_OPS_FL_INITIALIZED , +INIT_OPS_HASH (fprofiler_ops.ops) + }, .entryfunc = &profile_graph_entry, .retfunc = &profile_graph_return, };
Masami Hiramatsu (Google)
maintainerPATCH v13 16/20 tracing/fprobe: Remove nr_maxactive from fprobe
In reply to Masami Hiramatsu (Google)From: Masami Hiramatsu (Google) <[email protected]>
Remove depercated fprobe::nr_maxactive. This involves fprobe events to rejects the maxactive number.
---
Changes in v2:
- Newly added.
--- include/linux/fprobe.h | 2 -- kernel/trace/trace_fprobe.c | 44 ++++++------------------------------------- 2 files changed, 6 insertions(+), 40 deletions(-)
include/linux/fprobe.h +0 -2
@@ -54,7 +54,6 @@ struct fprobe_hlist {* @nmissed: The counter for missing events. * @flags: The status flag. * @entry_data_size: The private data storage size. -* @nr_maxactive: The max number of active functions. (*deprecated) * @entry_handler: The callback function for function entry. * @exit_handler: The callback function for function exit. * @hlist_array: The fprobe_hlist for fprobe search from IP hash table.
@@ -63,7 +62,6 @@ struct fprobe {unsigned long nmissed;unsigned int flags;size_t entry_data_size; -int nr_maxactive;fprobe_entry_cb entry_handler;fprobe_exit_cb exit_handler;
kernel/trace/trace_fprobe.c +6 -38
93 lines not on this page · raw message
Masami Hiramatsu (Google)
maintainerPATCH v13 17/20 selftests: ftrace: Remove obsolate maxactive syntax check
In reply to Masami Hiramatsu (Google)From: Masami Hiramatsu (Google) <[email protected]>
Since the fprobe event does not support maxactive anymore, stop testing the maxactive syntax error checking.
--- .../ftrace/test.d/dynevent/fprobe_syntax_errors.tc | 4 +--- 1 file changed, 1 insertion(+), 3 deletions(-)
tools/testing/selftests/ftrace/test.d/dynevent/fprobe_syntax_errors.tc +1 -3
@@ -16,9 +16,7 @@ aarch64) REG=%r0 ;; esac -check_error 'f^100 vfs_read' # MAXACT_NO_KPROBE -check_error 'f^1a111 vfs_read' # BAD_MAXACT -check_error 'f^100000 vfs_read' # MAXACT_TOO_BIG +check_error 'f^100 vfs_read' # BAD_MAXACT check_error 'f ^non_exist_func' # BAD_PROBE_ADDR (enoent) check_error 'f ^vfs_read+10' # BAD_PROBE_ADDR
Masami Hiramatsu (Google)
maintainerPATCH v13 18/20 selftests/ftrace: Add a test case for repeating register/unregister fprobe
In reply to Masami Hiramatsu (Google)From: Masami Hiramatsu (Google) <[email protected]>
This test case repeats define and undefine the fprobe dynamic event to ensure that the fprobe does not cause any issue with such operations.
--- .../test.d/dynevent/add_remove_fprobe_repeat.tc | 19 +++++++++++++++++++ 1 file changed, 19 insertions(+) create mode 100644 tools/testing/selftests/ftrace/test.d/dynevent/add_remove_fprobe_repeat.tc
tools/testing/selftests/ftrace/test.d/dynevent/add_remove_fprobe_repeat.tc new file +19 -0
@@ -0,0 +1,19 @@ +#!/bin/sh +# SPDX-License-Identifier: GPL-2.0 +# description: Generic dynamic event - Repeating add/remove fprobe events +# requires: dynamic_events "f[:[<group>/][<event>]] <func-name>[%return] [<args>]":README + +echo 0 > events/enable +echo > dynamic_events + +PLACE=$FUNCTION_FORK +REPEAT_TIMES=64 + +for i in `seq 1 $REPEAT_TIMES`; do + echo "f:myevent $PLACE" >> dynamic_events + grep -q myevent dynamic_events + test -d events/fprobes/myevent + echo > dynamic_events +done + +clear_trace
Masami Hiramatsu (Google)
maintainerPATCH v13 19/20 Documentation: probes: Update fprobe on function-graph tracer
In reply to Masami Hiramatsu (Google)From: Masami Hiramatsu (Google) <[email protected]>
Update fprobe documentation for the new fprobe on function-graph tracer. This includes some bahvior changes and pt_regs to ftrace_regs interface change.
---
Changes in v2:
- Update @fregs parameter explanation.
--- Documentation/trace/fprobe.rst | 42 ++++++++++++++++++++++++++-------------- 1 file changed, 27 insertions(+), 15 deletions(-)
Documentation/trace/fprobe.rst +27 -15
@@ -9,9 +9,10 @@ Fprobe - Function entry/exit probe Introduction ============ -Fprobe is a function entry/exit probe mechanism based on ftrace. -Instead of using ftrace full feature, if you only want to attach callbacks -on function entry and exit, similar to the kprobes and kretprobes, you can +Fprobe is a function entry/exit probe mechanism based on the function-graph +tracer. +Instead of tracing all functions, if you want to attach callbacks on specific +function entry and exit, similar to the kprobes and kretprobes, you can use fprobe. Compared with kprobes and kretprobes, fprobe gives faster instrumentation for multiple functions with single handler. This document describes how to use fprobe.
@@ -91,12 +92,14 @@ The prototype of the entry/exit callback function are as follows: .. code-block:: c - int entry_callback(struct fprobe *fp, unsigned long entry_ip, unsigned long ret_ip, struct pt_regs *regs, void *entry_data); + int entry_callback(struct fprobe *fp, unsigned long entry_ip, unsigned long ret_ip, struct ftrace_regs *fregs, void *entry_data); - void exit_callback(struct fprobe *fp, unsigned long entry_ip, unsigned long ret_ip, struct pt_regs *regs, void *entry_data); + void exit_callback(struct fprobe *fp, unsigned long entry_ip, unsigned long ret_ip, struct ftrace_regs *fregs, void *entry_data); -Note that the @entry_ip is saved at function entry and passed to exit handler. -If the entry callback function returns !0, the corresponding exit callback will be cancelled. +Note that the @entry_ip is saved at function entry and passed to exit +handler. +If the entry callback function returns !0, the corresponding exit callback +will be cancelled. @fp This is the address of `fprobe` data structure related to this handler.
@@ -112,12 +115,10 @@ If the entry callback function returns !0, the corresponding exit callback will This is the return address that the traced function will return to, somewhere in the caller. This can be used at both entry and exit. -@regs - This is the `pt_regs` data structure at the entry and exit. Note that - the instruction pointer of @regs may be different from the @entry_ip - in the entry_handler. If you need traced instruction pointer, you need - to use @entry_ip. On the other hand, in the exit_handler, the instruction - pointer of @regs is set to the current return address. +@fregs + This is the `ftrace_regs` data structure at the entry and exit. This + includes the function parameters, or the return values. So user can + access thos values via appropriate `ftrace_regs_*` APIs. @entry_data This is a local storage to share the data between entry and exit handlers.
@@ -125,6 +126,17 @@ If the entry callback function returns !0, the corresponding exit callback will and `entry_data_size` field when registering the fprobe, the storage is allocated and passed to both `entry_handler` and `exit_handler`. +Entry data size and exit handlers on the same function +====================================================== + +Since the entry data is passed via per-task stack and it is has limited size, +the entry data size per probe is limited to `15 * sizeof(long)`. You also need +to take care that the different fprobes are probing on the same function, this +limit becomes smaller. The entry data size is aligned to `sizeof(long)` and +each fprobe which has exit handler uses a `sizeof(long)` space on the stack, +you should keep the number of fprobes on the same function as small as +possible. + Share the callbacks with kprobes ================================
@@ -165,8 +177,8 @@ This counter counts up when; - fprobe fails to take ftrace_recursion lock. This usually means that a function which is traced by other ftrace users is called from the entry_handler. - - fprobe fails to setup the function exit because of the shortage of rethook - (the shadow stack for hooking the function return.) + - fprobe fails to setup the function exit because of failing to allocate the + data buffer from the per-task shadow stack. The `fprobe::nmissed` field counts up in both cases. Therefore, the former skips both of entry and exit callback and the latter skips the exit
Masami Hiramatsu (Google)
maintainerPATCH v13 20/20 fgraph: Skip recording calltime/rettime if it is not nneeded
In reply to Masami Hiramatsu (Google)From: Masami Hiramatsu (Google) <[email protected]>
Skip recording calltime and rettime if the fgraph_ops does not need it. This is a kind of performance optimization for fprobe. Since the fprobe user does not use these entries, recording timestamp in fgraph is just a overhead (e.g. eBPF, ftrace). So introduce the skip_timestamp flag, and all fgraph_ops sets this flag, skip recording calltime and rettime.
Here is the performance results measured by
tools/testing/selftests/bpf/benchs/run_bench_trigger.sh
Without this:
kprobe-multi : 5.700 ± 0.065M/s kretprobe-multi: 4.239 ± 0.006M/s
With skip-timestamp:
kprobe-multi : 6.265 ± 0.033M/s +9.91% kretprobe-multi: 4.758 ± 0.009M/s +12.24%
---
Changes in v11:
- Simplify it to be symmetric on push and pop. (Thus the timestamp getting place is a bit shifted.)
Changes in v10:
- Add likely() to skipping timestamp.
Changes in v9:
- Newly added.
--- include/linux/ftrace.h | 2 ++ kernel/trace/fgraph.c | 36 +++++++++++++++++++++++++++++++++--- kernel/trace/fprobe.c | 1 + 3 files changed, 36 insertions(+), 3 deletions(-)
include/linux/ftrace.h +2 -0
@@ -1160,6 +1160,8 @@ struct fgraph_ops {void *private;trace_func_graph_ent_t saved_func;int idx; +/* If skip_timestamp is true, this does not record timestamps. */ +bool skip_timestamp; };void *fgraph_reserve_data (int idx,int size_bytes);
kernel/trace/fgraph.c +33 -3
@@ -174,6 +174,7 @@ int ftrace_graph_active;static struct fgraph_ops *fgraph_array[FGRAPH_ARRAY_SIZE ];static unsigned long fgraph_array_bitmask; +static bool fgraph_skip_timestamp;/* LRU index table for fgraph_array */ static int fgraph_lru_table[FGRAPH_ARRAY_SIZE ];
@@ -557,7 +558,11 @@ ftrace_push_return_trace(unsigned long ret, unsigned long func,return -EBUSY ; } - calltime =trace_clock_local (); +/* This is not really 'likely' but for keeping the least path to be faster. */ +if (likely (fgraph_skip_timestamp)) + calltime =0LL ; +else + calltime =trace_clock_local (); offset =READ_ONCE (current->curr_ret_stack); ret_stack =RET_STACK (current, offset);
@@ -728,6 +733,12 @@ ftrace_pop_return_trace(struct ftrace_graph_ret *trace, unsigned long *ret, *ret = ret_stack->ret; trace->func = ret_stack->func; trace->calltime = ret_stack->calltime; +/* This is not really 'likely' but for keeping the least path to be faster. */ +if (likely (!trace->calltime)) + trace->rettime =0LL ; +else + trace->rettime =trace_clock_local (); + trace->overrun =atomic_read (¤t->trace_overrun); trace->depth = current->curr_ret_depth;/*
@@ -788,7 +799,6 @@ __ftrace_return_to_handler(struct ftrace_regs *fregs, unsigned long frame_pointereturn (unsigned long )panic; } - trace.rettime =trace_clock_local ();if (fregs)ftrace_regs_set_instruction_pointer (fregs, ret);
@@ -1248,6 +1258,24 @@ static void ftrace_graph_disable_direct(bool disable_branch) fgraph_direct_gops = &fgraph_stub; } +static void update_fgraph_skip_timestamp (void ) +{ +int i; + +for (i =0 ; i <FGRAPH_ARRAY_SIZE ; i++) { +struct fgraph_ops *gops = fgraph_array[i]; + +if (gops == &fgraph_stub) +continue ; + +if (!gops->skip_timestamp) { + fgraph_skip_timestamp = false; +return ; + } + } + fgraph_skip_timestamp = true; +} +int register_ftrace_graph (struct fgraph_ops *gops) {int command =0 ;
@@ -1271,6 +1299,7 @@ int register_ftrace_graph(struct fgraph_ops *gops) gops->idx = i; ftrace_graph_active++; +update_fgraph_skip_timestamp ();if (ftrace_graph_active ==2 )ftrace_graph_disable_direct (true);
@@ -1303,6 +1332,7 @@ int register_ftrace_graph(struct fgraph_ops *gops) ftrace_graph_active--; gops->saved_func =NULL ;fgraph_lru_release_index (i); +update_fgraph_skip_timestamp (); } out:mutex_unlock (&ftrace_lock);
@@ -1326,8 +1356,8 @@ void unregister_ftrace_graph(struct fgraph_ops *gops) goto out; fgraph_array[gops->idx] = &fgraph_stub; - ftrace_graph_active--; +update_fgraph_skip_timestamp ();if (!ftrace_graph_active) command =FTRACE_STOP_FUNC_RET ;
kernel/trace/fprobe.c +1 -0
@@ -345,6 +345,7 @@ NOKPROBE_SYMBOL(fprobe_return);static struct fgraph_ops fprobe_graph_ops = { .entryfunc = fprobe_entry, .retfunc = fprobe_return, + .skip_timestamp = true, };static int fprobe_graph_active;
A message that is not in the archive (sent off-list or not yet received): 2b4d25f8fa99ae5a329f5164b6c79b81f1a4cc78688dcf5470d601f3612264ea@mail.kernel.org
A message that is not in the archive (sent off-list or not yet received): [email protected]
Quoted 6 lines · Masami Hiramatsu
Hi,
Where can I get the test programs? I would like to check what the programs actually expected.
Hi Masami,
This is part of BPF selftests (so it's under tools/testing/selftests/bpf). Specifically, this test is defined in
- progs/kprobe_multi.c for BPF parts
- prog_tests/kprobe_multi_testmod_test.c for user-space parts.
It seems to be failing on arm64 (but not on x86-64, so something architecture-specific).
Quoted 53 lines
Quoted 43 lines · On Sun, 18 Aug 2024 13:51:30 +0000 (UTC) [email protected] wrote:
Dear patch submitter,
CI has tested the following submission:
Status: FAILURE Name: [v13,00/20] tracing: fprobe: function_graph: Multi-function graph and fprobe on fgraph Patchwork: https://patchwork.kernel.org/project/netdevbpf/list/?series=880630&state=* Matrix: https://github.com/kernel-patches/bpf/actions/runs/10440799833Failed jobs:
test_progs-aarch64-gcc: https://github.com/kernel-patches/bpf/actions/runs/10440799833/job/28911439106
test_progs_no_alu32-aarch64-gcc: https://github.com/kernel-patches/bpf/actions/runs/10440799833/job/28911439234
test_progs-s390x-gcc: https://github.com/kernel-patches/bpf/actions/runs/10440799833/job/28911405063
test_progs_no_alu32-s390x-gcc: https://github.com/kernel-patches/bpf/actions/runs/10440799833/job/28911404959
veristat-x86_64-gcc: https://github.com/kernel-patches/bpf/actions/runs/10440799833/job/28911401263First
test_progsfailure (test_progs-aarch64-gcc):
#126kprobe_multi_testmod_test
serial_test_kprobe_multi_testmod_test:PASS:load_kallsyms_local 0 nsec
#126/1 kprobe_multi_testmod_test/testmod_attach_api_syms test_testmod_attach_api:PASS:fentry_raw_skel_load 0 nsec trigger_module_test_read:PASS:testmod_file_open 0 nsec test_testmod_attach_api:PASS:trigger_read 0 nsec kprobe_multi_testmod_check:FAIL:kprobe_test1_result unexpectedkprobe_test1_result: actual 0 != expected 1 kprobe_multi_testmod_check:FAIL:kprobe_test2_result unexpectedkprobe_test2_result: actual 0 != expected 1 kprobe_multi_testmod_check:FAIL:kprobe_test3_result unexpectedkprobe_test3_result: actual 0 != expected 1 kprobe_multi_testmod_check:FAIL:kretprobe_test1_result unexpectedkretprobe_test1_result: actual 0 != expected 1 kprobe_multi_testmod_check:FAIL:kretprobe_test2_result unexpectedkretprobe_test2_result: actual 0 != expected 1 kprobe_multi_testmod_check:FAIL:kretprobe_test3_result unexpectedkretprobe_test3_result: actual 0 != expected 1 #126/2 kprobe_multi_testmod_test/testmod_attach_api_addrs test_testmod_attach_api_addrs:PASS:ksym_get_addr_local 0 nsec test_testmod_attach_api_addrs:PASS:ksym_get_addr_local 0 nsec test_testmod_attach_api_addrs:PASS:ksym_get_addr_local 0 nsec test_testmod_attach_api:PASS:fentry_raw_skel_load 0 nsec trigger_module_test_read:PASS:testmod_file_open 0 nsec test_testmod_attach_api:PASS:trigger_read 0 nsec kprobe_multi_testmod_check:FAIL:kprobe_test1_result unexpectedkprobe_test1_result: actual 0 != expected 1 kprobe_multi_testmod_check:FAIL:kprobe_test2_result unexpectedkprobe_test2_result: actual 0 != expected 1 kprobe_multi_testmod_check:FAIL:kprobe_test3_result unexpectedkprobe_test3_result: actual 0 != expected 1 kprobe_multi_testmod_check:FAIL:kretprobe_test1_result unexpectedkretprobe_test1_result: actual 0 != expected 1 kprobe_multi_testmod_check:FAIL:kretprobe_test2_result unexpectedkretprobe_test2_result: actual 0 != expected 1 kprobe_multi_testmod_check:FAIL:kretprobe_test3_result unexpectedkretprobe_test3_result: actual 0 != expected 1Quoted 3 lines
Please note: this email is coming from an unmonitored mailbox. If you have questions or feedback, please reach out to the Meta Kernel CI team at [email protected].
--
Masami Hiramatsu (Google) <[email protected]>
A message that is not in the archive (sent off-list or not yet received): MN2PR15MB34883ABBB55D78B4E15758EDAD8C2@MN2PR15MB3488.namprd15.prod.outlook.com
A message that is not in the archive (sent off-list or not yet received): [email protected]
+bpf
Quoted 16 lines · Masami Hiramatsu
Quoted 12 lines · On Mon, 19 Aug 2024 15:56:39 +0000 Daniel Xu <[email protected]> wrote:
[sorry for outlook top post]
Hi Masami,
test_progsis checked into kernel tree. There should be source files in selftests for the test names. For example, for fill_link_info/kprobe_multi_invalid_ubuff failure:$ find . -name "*fill_link_info*" ./tools/testing/selftests/bpf/prog_tests/fill_link_info.c ./tools/testing/selftests/bpf/progs/test_fill_link_info.c
Quoted 7 lines
Quoted 4 lines
veristat I'm less famiiar with. My understanding is that it checks for verifier regressions. Skimming your patchset, it's not obvious to me why verifier would regress. If you have issues debugging that, we can poke Andrii for help.
Thanks for the information! Hmm, maybe
kprobe_multi_testmod_checkmight check the register which is not supported on theftrace_regs. But I also don't have any idea
This test is getting IP of the function using bpf_get_func_ip() helper. If that somehow started returning wrong value on arm64/s390x, then the test will basically not find expected addresses
Quoted 1 line
about veristat. Is that also checks all
pt_regs? Andrii, do you have any idea?
I wouldn't worry about veristat, your changes shouldn't regress BPF verifier logic, so it's probably just an artifact of our BPF CI setup. The above test regression seems much more worrying.
Quoted 77 lines
Thank you,
Quoted 63 lines
Thanks,
Daniel________________________________
From: Masami Hiramatsu <[email protected]>
Sent: Sunday, August 18, 2024 5:58 PM
To: [email protected] <[email protected]>
Cc: kernel-ci <[email protected]>; [email protected] <[email protected]>; [email protected] <[email protected]>; [email protected] <[email protected]>
Subject: Re: [PATCH v13 00/20] tracing: fprobe:function_graph: Multi-function graph and fprobe on fgraphHi,
Where can I get the test programs? I would like to check what the programs actually expected.
Quoted 43 lines · On Sun, 18 Aug 2024 13:51:30 +0000 (UTC) [email protected] wrote:
Dear patch submitter,
CI has tested the following submission:
Status: FAILURE Name: [v13,00/20] tracing: fprobe: function_graph: Multi-function graph and fprobe on fgraph Patchwork: https://patchwork.kernel.org/project/netdevbpf/list/?series=880630&state=* Matrix: https://github.com/kernel-patches/bpf/actions/runs/10440799833Failed jobs:
test_progs-aarch64-gcc: https://github.com/kernel-patches/bpf/actions/runs/10440799833/job/28911439106
test_progs_no_alu32-aarch64-gcc: https://github.com/kernel-patches/bpf/actions/runs/10440799833/job/28911439234
test_progs-s390x-gcc: https://github.com/kernel-patches/bpf/actions/runs/10440799833/job/28911405063
test_progs_no_alu32-s390x-gcc: https://github.com/kernel-patches/bpf/actions/runs/10440799833/job/28911404959
veristat-x86_64-gcc: https://github.com/kernel-patches/bpf/actions/runs/10440799833/job/28911401263First
test_progsfailure (test_progs-aarch64-gcc):
#126kprobe_multi_testmod_test
serial_test_kprobe_multi_testmod_test:PASS:load_kallsyms_local 0 nsec
#126/1 kprobe_multi_testmod_test/testmod_attach_api_syms test_testmod_attach_api:PASS:fentry_raw_skel_load 0 nsec trigger_module_test_read:PASS:testmod_file_open 0 nsec test_testmod_attach_api:PASS:trigger_read 0 nsec kprobe_multi_testmod_check:FAIL:kprobe_test1_result unexpectedkprobe_test1_result: actual 0 != expected 1 kprobe_multi_testmod_check:FAIL:kprobe_test2_result unexpectedkprobe_test2_result: actual 0 != expected 1 kprobe_multi_testmod_check:FAIL:kprobe_test3_result unexpectedkprobe_test3_result: actual 0 != expected 1 kprobe_multi_testmod_check:FAIL:kretprobe_test1_result unexpectedkretprobe_test1_result: actual 0 != expected 1 kprobe_multi_testmod_check:FAIL:kretprobe_test2_result unexpectedkretprobe_test2_result: actual 0 != expected 1 kprobe_multi_testmod_check:FAIL:kretprobe_test3_result unexpectedkretprobe_test3_result: actual 0 != expected 1 #126/2 kprobe_multi_testmod_test/testmod_attach_api_addrs test_testmod_attach_api_addrs:PASS:ksym_get_addr_local 0 nsec test_testmod_attach_api_addrs:PASS:ksym_get_addr_local 0 nsec test_testmod_attach_api_addrs:PASS:ksym_get_addr_local 0 nsec test_testmod_attach_api:PASS:fentry_raw_skel_load 0 nsec trigger_module_test_read:PASS:testmod_file_open 0 nsec test_testmod_attach_api:PASS:trigger_read 0 nsec kprobe_multi_testmod_check:FAIL:kprobe_test1_result unexpectedkprobe_test1_result: actual 0 != expected 1 kprobe_multi_testmod_check:FAIL:kprobe_test2_result unexpectedkprobe_test2_result: actual 0 != expected 1 kprobe_multi_testmod_check:FAIL:kprobe_test3_result unexpectedkprobe_test3_result: actual 0 != expected 1 kprobe_multi_testmod_check:FAIL:kretprobe_test1_result unexpectedkretprobe_test1_result: actual 0 != expected 1 kprobe_multi_testmod_check:FAIL:kretprobe_test2_result unexpectedkretprobe_test2_result: actual 0 != expected 1 kprobe_multi_testmod_check:FAIL:kretprobe_test3_result unexpectedkretprobe_test3_result: actual 0 != expected 1Quoted 7 lines
Quoted 3 lines
Please note: this email is coming from an unmonitored mailbox. If you have questions or feedback, please reach out to the Meta Kernel CI team at [email protected].
--
Masami Hiramatsu (Google) <[email protected]>--
Masami Hiramatsu (Google) <[email protected]>
Masami Hiramatsu (Google)
maintainerQuoted 24 lines · On Mon, 19 Aug 2024 19:48:23 -0700 Andrii Nakryiko <[email protected]>…
+bpf
Quoted 21 lines · Masami Hiramatsu
Quoted 16 lines · On Mon, 19 Aug 2024 15:56:39 +0000 Daniel Xu <[email protected]> wrote:
[sorry for outlook top post]
Hi Masami,
test_progsis checked into kernel tree. There should be source files in selftests for the test names. For example, for fill_link_info/kprobe_multi_invalid_ubuff failure:$ find . -name "*fill_link_info*" ./tools/testing/selftests/bpf/prog_tests/fill_link_info.c ./tools/testing/selftests/bpf/progs/test_fill_link_info.cveristat I'm less famiiar with. My understanding is that it checks for verifier regressions. Skimming your patchset, it's not obvious to me why verifier would regress. If you have issues debugging that, we can poke Andrii for help.
Quoted 6 lines
Quoted 2 lines
Thanks for the information! Hmm, maybe
kprobe_multi_testmod_checkmight check the register which is not supported on theftrace_regs. But I also don't have any ideaThis test is getting IP of the function using
bpf_get_func_ip()helper. If that somehow started returning wrong value on arm64/s390x, then the test will basically not find expected addresses
Ah, bpf_get_func_ip() may get PC register in pt_regs. ftrace_regs doesn't have it. Hmm, but that information should be injected by bpf side because ftrace_regs -> pt_regs converted in trace_bpf, and the handler should know the IP.
Quoted 6 lines
Quoted 2 lines
about veristat. Is that also checks all
pt_regs? Andrii, do you have any idea?I wouldn't worry about veristat, your changes shouldn't regress BPF verifier logic, so it's probably just an artifact of our BPF CI setup. The above test regression seems much more worrying.
OK, trying to fix that. Maybe [07/20] caused this issue.
Thank you,
Quoted 79 lines
Quoted 79 lines
Thank you,
Quoted 63 lines
Thanks,
Daniel________________________________
From: Masami Hiramatsu <[email protected]>
Sent: Sunday, August 18, 2024 5:58 PM
To: [email protected] <[email protected]>
Cc: kernel-ci <[email protected]>; [email protected] <[email protected]>; [email protected] <[email protected]>; [email protected] <[email protected]>
Subject: Re: [PATCH v13 00/20] tracing: fprobe:function_graph: Multi-function graph and fprobe on fgraphHi,
Where can I get the test programs? I would like to check what the programs actually expected.
Quoted 43 lines · On Sun, 18 Aug 2024 13:51:30 +0000 (UTC) [email protected] wrote:
Dear patch submitter,
CI has tested the following submission:
Status: FAILURE Name: [v13,00/20] tracing: fprobe: function_graph: Multi-function graph and fprobe on fgraph Patchwork: https://patchwork.kernel.org/project/netdevbpf/list/?series=880630&state=* Matrix: https://github.com/kernel-patches/bpf/actions/runs/10440799833Failed jobs:
test_progs-aarch64-gcc: https://github.com/kernel-patches/bpf/actions/runs/10440799833/job/28911439106
test_progs_no_alu32-aarch64-gcc: https://github.com/kernel-patches/bpf/actions/runs/10440799833/job/28911439234
test_progs-s390x-gcc: https://github.com/kernel-patches/bpf/actions/runs/10440799833/job/28911405063
test_progs_no_alu32-s390x-gcc: https://github.com/kernel-patches/bpf/actions/runs/10440799833/job/28911404959
veristat-x86_64-gcc: https://github.com/kernel-patches/bpf/actions/runs/10440799833/job/28911401263First
test_progsfailure (test_progs-aarch64-gcc):
#126kprobe_multi_testmod_test
serial_test_kprobe_multi_testmod_test:PASS:load_kallsyms_local 0 nsec
#126/1 kprobe_multi_testmod_test/testmod_attach_api_syms test_testmod_attach_api:PASS:fentry_raw_skel_load 0 nsec trigger_module_test_read:PASS:testmod_file_open 0 nsec test_testmod_attach_api:PASS:trigger_read 0 nsec kprobe_multi_testmod_check:FAIL:kprobe_test1_result unexpectedkprobe_test1_result: actual 0 != expected 1 kprobe_multi_testmod_check:FAIL:kprobe_test2_result unexpectedkprobe_test2_result: actual 0 != expected 1 kprobe_multi_testmod_check:FAIL:kprobe_test3_result unexpectedkprobe_test3_result: actual 0 != expected 1 kprobe_multi_testmod_check:FAIL:kretprobe_test1_result unexpectedkretprobe_test1_result: actual 0 != expected 1 kprobe_multi_testmod_check:FAIL:kretprobe_test2_result unexpectedkretprobe_test2_result: actual 0 != expected 1 kprobe_multi_testmod_check:FAIL:kretprobe_test3_result unexpectedkretprobe_test3_result: actual 0 != expected 1 #126/2 kprobe_multi_testmod_test/testmod_attach_api_addrs test_testmod_attach_api_addrs:PASS:ksym_get_addr_local 0 nsec test_testmod_attach_api_addrs:PASS:ksym_get_addr_local 0 nsec test_testmod_attach_api_addrs:PASS:ksym_get_addr_local 0 nsec test_testmod_attach_api:PASS:fentry_raw_skel_load 0 nsec trigger_module_test_read:PASS:testmod_file_open 0 nsec test_testmod_attach_api:PASS:trigger_read 0 nsec kprobe_multi_testmod_check:FAIL:kprobe_test1_result unexpectedkprobe_test1_result: actual 0 != expected 1 kprobe_multi_testmod_check:FAIL:kprobe_test2_result unexpectedkprobe_test2_result: actual 0 != expected 1 kprobe_multi_testmod_check:FAIL:kprobe_test3_result unexpectedkprobe_test3_result: actual 0 != expected 1 kprobe_multi_testmod_check:FAIL:kretprobe_test1_result unexpectedkretprobe_test1_result: actual 0 != expected 1 kprobe_multi_testmod_check:FAIL:kretprobe_test2_result unexpectedkretprobe_test2_result: actual 0 != expected 1 kprobe_multi_testmod_check:FAIL:kretprobe_test3_result unexpectedkretprobe_test3_result: actual 0 != expected 1Quoted 7 lines
Quoted 3 lines
Please note: this email is coming from an unmonitored mailbox. If you have questions or feedback, please reach out to the Meta Kernel CI team at [email protected].
--
Masami Hiramatsu (Google) <[email protected]>--
Masami Hiramatsu (Google) <[email protected]>
Signature · 1 line
Masami Hiramatsu (Google) <[email protected]>
Masami Hiramatsu (Google)
maintainerQuoted 24 lines · On Mon, 19 Aug 2024 19:48:23 -0700 Andrii Nakryiko <[email protected]>…
+bpf
Quoted 21 lines · Masami Hiramatsu
Quoted 16 lines · On Mon, 19 Aug 2024 15:56:39 +0000 Daniel Xu <[email protected]> wrote:
[sorry for outlook top post]
Hi Masami,
test_progsis checked into kernel tree. There should be source files in selftests for the test names. For example, for fill_link_info/kprobe_multi_invalid_ubuff failure:$ find . -name "*fill_link_info*" ./tools/testing/selftests/bpf/prog_tests/fill_link_info.c ./tools/testing/selftests/bpf/progs/test_fill_link_info.cveristat I'm less famiiar with. My understanding is that it checks for verifier regressions. Skimming your patchset, it's not obvious to me why verifier would regress. If you have issues debugging that, we can poke Andrii for help.
Quoted 6 lines
Quoted 2 lines
Thanks for the information! Hmm, maybe
kprobe_multi_testmod_checkmight check the register which is not supported on theftrace_regs. But I also don't have any ideaThis test is getting IP of the function using
bpf_get_func_ip()helper. If that somehow started returning wrong value on arm64/s390x, then the test will basically not find expected addresses
Ah, I got a clue. For the kprobe_multi (fprobe) uses bpf_kprobe_multi_cookie() to get func_ip, it is implemented as below;
static u64 bpf_kprobe_multi_cookie(struct bpf_run_ctx *ctx)
{
struct bpf_kprobe_multi_run_ctx *run_ctx;
struct bpf_kprobe_multi_link *link;
u64 *cookie, entry_ip;
unsigned long *addr;
if (WARN_ON_ONCE(!ctx))
return 0;
run_ctx = container_of(current->bpf_ctx, struct bpf_kprobe_multi_run_ctx,
session_ctx.run_ctx);
link = run_ctx->link;
if (!link->cookies)
return 0;
entry_ip = run_ctx->entry_ip;
addr = bsearch(&entry_ip, link->addrs, link->cnt, sizeof(entry_ip),
bpf_kprobe_multi_addrs_cmp);
if (!addr)
return 0;
cookie = link->cookies + (addr - link->addrs);
return *cookie;
}The problem is that the run_ctx->entry_ip may not be a real function entry but the ftrace entry address, which is not the same address of the function entry on MANY architectures. X86 uses -fentry and it is able to call another function from the first instruction, but Even on x86, IBT can change it, so it is fixed by get_entry_ip().
On other architectures, usually they need to prepare ftrace stub call by
- saving return address to the frame pointer or stack
- set ftrace stub address to a register (optional?)
- call ftrace stub.
Thus the ftrace's entry_ip is a bit shift by some instruction size. To solve this issue,
To solve this problem, I think we can fix it by modifying bpf_kprobe_multi_addrs_cmp().
static int bpf_kprobe_multi_addrs_cmp(const void *a, const void *b)
{
const unsigned long *addr_a = a, *addr_b = b;
if (*addr_a >= *addr_b && *addr_a < *addr_b + SOME_OFFSET)
return 0;
return *addr_a < *addr_b ? -1 : 1;
}SOME_OFFSET depends on architecture implmentation. E.g. arm64 is 4 or 8 (if BTI is enabled).
Thank you,
Quoted 85 lines
Quoted 2 lines
about veristat. Is that also checks all
pt_regs? Andrii, do you have any idea?I wouldn't worry about veristat, your changes shouldn't regress BPF verifier logic, so it's probably just an artifact of our BPF CI setup. The above test regression seems much more worrying.
Quoted 77 lines
Thank you,
Quoted 63 lines
Thanks,
Daniel________________________________
From: Masami Hiramatsu <[email protected]>
Sent: Sunday, August 18, 2024 5:58 PM
To: [email protected] <[email protected]>
Cc: kernel-ci <[email protected]>; [email protected] <[email protected]>; [email protected] <[email protected]>; [email protected] <[email protected]>
Subject: Re: [PATCH v13 00/20] tracing: fprobe:function_graph: Multi-function graph and fprobe on fgraphHi,
Where can I get the test programs? I would like to check what the programs actually expected.
Quoted 43 lines · On Sun, 18 Aug 2024 13:51:30 +0000 (UTC) [email protected] wrote:
Dear patch submitter,
CI has tested the following submission:
Status: FAILURE Name: [v13,00/20] tracing: fprobe: function_graph: Multi-function graph and fprobe on fgraph Patchwork: https://patchwork.kernel.org/project/netdevbpf/list/?series=880630&state=* Matrix: https://github.com/kernel-patches/bpf/actions/runs/10440799833Failed jobs:
test_progs-aarch64-gcc: https://github.com/kernel-patches/bpf/actions/runs/10440799833/job/28911439106
test_progs_no_alu32-aarch64-gcc: https://github.com/kernel-patches/bpf/actions/runs/10440799833/job/28911439234
test_progs-s390x-gcc: https://github.com/kernel-patches/bpf/actions/runs/10440799833/job/28911405063
test_progs_no_alu32-s390x-gcc: https://github.com/kernel-patches/bpf/actions/runs/10440799833/job/28911404959
veristat-x86_64-gcc: https://github.com/kernel-patches/bpf/actions/runs/10440799833/job/28911401263First
test_progsfailure (test_progs-aarch64-gcc):
#126kprobe_multi_testmod_test
serial_test_kprobe_multi_testmod_test:PASS:load_kallsyms_local 0 nsec
#126/1 kprobe_multi_testmod_test/testmod_attach_api_syms test_testmod_attach_api:PASS:fentry_raw_skel_load 0 nsec trigger_module_test_read:PASS:testmod_file_open 0 nsec test_testmod_attach_api:PASS:trigger_read 0 nsec kprobe_multi_testmod_check:FAIL:kprobe_test1_result unexpectedkprobe_test1_result: actual 0 != expected 1 kprobe_multi_testmod_check:FAIL:kprobe_test2_result unexpectedkprobe_test2_result: actual 0 != expected 1 kprobe_multi_testmod_check:FAIL:kprobe_test3_result unexpectedkprobe_test3_result: actual 0 != expected 1 kprobe_multi_testmod_check:FAIL:kretprobe_test1_result unexpectedkretprobe_test1_result: actual 0 != expected 1 kprobe_multi_testmod_check:FAIL:kretprobe_test2_result unexpectedkretprobe_test2_result: actual 0 != expected 1 kprobe_multi_testmod_check:FAIL:kretprobe_test3_result unexpectedkretprobe_test3_result: actual 0 != expected 1 #126/2 kprobe_multi_testmod_test/testmod_attach_api_addrs test_testmod_attach_api_addrs:PASS:ksym_get_addr_local 0 nsec test_testmod_attach_api_addrs:PASS:ksym_get_addr_local 0 nsec test_testmod_attach_api_addrs:PASS:ksym_get_addr_local 0 nsec test_testmod_attach_api:PASS:fentry_raw_skel_load 0 nsec trigger_module_test_read:PASS:testmod_file_open 0 nsec test_testmod_attach_api:PASS:trigger_read 0 nsec kprobe_multi_testmod_check:FAIL:kprobe_test1_result unexpectedkprobe_test1_result: actual 0 != expected 1 kprobe_multi_testmod_check:FAIL:kprobe_test2_result unexpectedkprobe_test2_result: actual 0 != expected 1 kprobe_multi_testmod_check:FAIL:kprobe_test3_result unexpectedkprobe_test3_result: actual 0 != expected 1 kprobe_multi_testmod_check:FAIL:kretprobe_test1_result unexpectedkretprobe_test1_result: actual 0 != expected 1 kprobe_multi_testmod_check:FAIL:kretprobe_test2_result unexpectedkretprobe_test2_result: actual 0 != expected 1 kprobe_multi_testmod_check:FAIL:kretprobe_test3_result unexpectedkretprobe_test3_result: actual 0 != expected 1Quoted 7 lines
Quoted 3 lines
Please note: this email is coming from an unmonitored mailbox. If you have questions or feedback, please reach out to the Meta Kernel CI team at [email protected].
--
Masami Hiramatsu (Google) <[email protected]>--
Masami Hiramatsu (Google) <[email protected]>
Signature · 1 line
Masami Hiramatsu (Google) <[email protected]>
Masami Hiramatsu (Google)
maintainerLet me gently ping :)
Let me check it should be rebased on tracing/for-next again. But basically this should be the same...
Quoted 174 lines · On Sun, 18 Aug 2024 21:47:53 +0900 "Masami Hiramatsu (Google)"…
Hi,
Here is the 13th version of the series to re-implement the fprobe on function-graph tracer. The previous version is;
https://lore.kernel.org/all/172000134410.63468.13742222887213469474.stgit@devnote2/
This version is based on v6.11-rc3.
In this version, I added a bugfix as [1/20], which should go to urgent branch, and dropped the performance improvement patch which was introduced in v12 because I found that does not work with new kernel.Overview
--------
This series rewrites the fprobe on this function-graph. The purposes of this change are;1) Remove dependency of the rethook from fprobe so that we can reduce the return hook code and shadow stack.
2) Make '
ftrace_regs' the common trace interface for the function boundary.1) Currently we have 2(or 3) different function return hook codes, the function-graph tracer and rethook (and legacy kretprobe). But since this is redundant and needs double maintenance cost, I would like to unify those. From the user's viewpoint, function- graph tracer is very useful to grasp the execution path. For this purpose, it is hard to use the rethook in the function-graph tracer, but the opposite is possible. (Strictly speaking, kretprobe can not use it because it requires '
pt_regs' for historical reasons.)2) Now the fprobe provides the '
pt_regs' for its handler, but that is wrong for the function entry and exit. Moreover, depending on the architecture, there is no way to accurately reproduce 'pt_regs' outside of interrupt or exception handlers. This means fprobe should not use 'pt_regs' because it does not use such exceptions. (Conversely, kprobe should use 'pt_regs' because it is an abstract interface of the software breakpoint exception.)This series changes fprobe to use function-graph tracer for tracing function entry and exit, instead of mixture of ftrace and rethook. Unlike the rethook which is a per-task list of system-wide allocated nodes, the function graph's
ret_stackis a per-task shadow stack. Thus it does not need to set 'nr_maxactive' (which is the number of pre-allocated nodes).
Also the handlers will get the 'ftrace_regs' instead of 'pt_regs'. Since eBPF mulit_kprobe/multi_kretprobe events still use 'pt_regs' as their register interface, this changes it to convert 'ftrace_regs' to 'pt_regs'. Of course this conversion makes an incomplete 'pt_regs', so users must access only registers for function parameters or return value.Design
------
Instead of using ftrace's function entry hook directly, the new fprobe is built on top of the function-graph's entry and return callbacks with 'ftrace_regs'.Since the fprobe requires access to '
ftrace_regs', the architecture must supportCONFIG_HAVE_DYNAMIC_FTRACE_WITH_ARGSandCONFIG_HAVE_FTRACE_GRAPH_FUNC, which enables to call function-graph entry callback with 'ftrace_regs', and alsoCONFIG_HAVE_FUNCTION_GRAPH_FREGS, which passes theftrace_regstoreturn_to_handler.All fprobes share a single function-graph ops (means shares a common ftrace filter) similar to the kprobe-on-ftrace. This needs another layer to find corresponding fprobe in the common function-graph callbacks, but has much better scalability, since the number of registered function-graph ops is limited.
In the entry callback, the fprobe runs its
entry_handlerand saves the address of 'fprobe' on the function-graph's shadow stack as data. The return callback decodes the data to get the 'fprobe' address, and runs theexit_handler.The fprobe introduces two hash-tables, one is for entry callback which searches fprobes related to the given function address passed by entry callback. The other is for a return callback which checks if the given 'fprobe' data structure pointer is still valid. Note that it is possible to unregister fprobe before the return callback runs. Thus the address validation must be done before using it in the return callback.
Download
--------
This series can be applied against the ftrace/for-next branch in linux-trace tree.This series can also be found below branch.
https://git.kernel.org/pub/scm/linux/kernel/git/mhiramat/linux.git/log/?h=topic/fprobe-on-fgraph
Thank you,
---
Masami Hiramatsu (Google) (20):
tracing: fgraph: Fix to add newfgraph_opsto array afterftrace_startup_subops()
tracing: Add a comment aboutftrace_regsdefinition
tracing: Renameftrace_regs_return_valuetoftrace_regs_get_return_value
function_graph: Passftrace_regsto entryfunc
function_graph: Replacefgraph_ret_regswithftrace_regs
function_graph: Passftrace_regsto retfunc
fprobe: Useftrace_regsin fprobe entry handler
fprobe: Useftrace_regsin fprobe exit handler
tracing: Addftrace_partial_regs()for convertingftrace_regstopt_regs
tracing: Addftrace_fill_perf_regs()for perf event
tracing/fprobe: Enable fprobe events withCONFIG_DYNAMIC_FTRACE_WITH_ARGS
bpf: Enablekprobe_multifeature ifCONFIG_FPROBEis enabled
ftrace: AddCONFIG_HAVE_FTRACE_GRAPH_FUNC
fprobe: Rewrite fprobe on function-graph tracer
tracing: Fix function timing profiler to initialize hashtable tracing/fprobe: Removenr_maxactivefrom fprobe
selftests: ftrace: Remove obsolate maxactive syntax check selftests/ftrace: Add a test case for repeating register/unregister fprobe
Documentation: probes: Update fprobe on function-graph tracer
fgraph: Skip recording calltime/rettime if it is not nneededDocumentation/trace/fprobe.rst | 42 + arch/arm64/Kconfig | 2 arch/arm64/include/asm/ftrace.h | 47 + arch/arm64/kernel/asm-offsets.c | 12 arch/arm64/kernel/entry-ftrace.S | 32 + arch/arm64/kernel/ftrace.c | 20 + arch/loongarch/Kconfig | 4 arch/loongarch/include/asm/ftrace.h | 32 - arch/loongarch/kernel/asm-offsets.c | 12 arch/loongarch/kernel/ftrace_dyn.c | 10 arch/loongarch/kernel/mcount.S | 17 - arch/loongarch/kernel/mcount_dyn.S | 14 arch/powerpc/Kconfig | 1 arch/powerpc/include/asm/ftrace.h | 15 arch/powerpc/kernel/trace/ftrace.c | 2 arch/powerpc/kernel/trace/ftrace_64_pg.c | 10 arch/riscv/Kconfig | 3 arch/riscv/include/asm/ftrace.h | 26 - arch/riscv/kernel/ftrace.c | 17 + arch/riscv/kernel/mcount.S | 24 - arch/s390/Kconfig | 3 arch/s390/include/asm/ftrace.h | 39 + arch/s390/kernel/asm-offsets.c | 6 arch/s390/kernel/mcount.S | 9 arch/x86/Kconfig | 4 arch/x86/include/asm/ftrace.h | 37 + arch/x86/kernel/ftrace.c | 50 +- arch/x86/kernel/ftrace_32.S | 15 arch/x86/kernel/ftrace_64.S | 17 - include/linux/fprobe.h | 57 +- include/linux/ftrace.h | 136 ++++ kernel/trace/Kconfig | 23 + kernel/trace/bpf_trace.c | 19 - kernel/trace/fgraph.c | 127 +++- kernel/trace/fprobe.c | 638 ++++++++++++++------ kernel/trace/ftrace.c | 10 kernel/trace/trace.h | 6 kernel/trace/trace_fprobe.c | 147 ++--- kernel/trace/trace_functions_graph.c | 10 kernel/trace/trace_irqsoff.c | 6 kernel/trace/trace_probe_tmpl.h | 2 kernel/trace/trace_sched_wakeup.c | 6 kernel/trace/trace_selftest.c | 11 lib/test_fprobe.c | 51 -- samples/fprobe/fprobe_example.c | 4 .../test.d/dynevent/add_remove_fprobe_repeat.tc | 19 + .../ftrace/test.d/dynevent/fprobe_syntax_errors.tc | 4 47 files changed, 1168 insertions(+), 630 deletions(-) create mode 100644 tools/testing/selftests/ftrace/test.d/dynevent/add_remove_fprobe_repeat.tc--
Masami Hiramatsu (Google) <[email protected]>
Signature · 1 line
Masami Hiramatsu (Google) <[email protected]>
Masami Hiramatsu (Google)
maintainerQuoted 4 lines · On Wed, 11 Sep 2024 09:24:34 +0900 Masami Hiramatsu (Google)…
Let me gently ping :)
Let me check it should be rebased on tracing/for-next again. But basically this should be the same...
I found a build error on riscv. Let me fix that.
Thanks,
Quoted 182 lines
Quoted 174 lines · On Sun, 18 Aug 2024 21:47:53 +0900 "Masami Hiramatsu (Google)"…
Hi,
Here is the 13th version of the series to re-implement the fprobe on function-graph tracer. The previous version is;
https://lore.kernel.org/all/172000134410.63468.13742222887213469474.stgit@devnote2/
This version is based on v6.11-rc3.
In this version, I added a bugfix as [1/20], which should go to urgent branch, and dropped the performance improvement patch which was introduced in v12 because I found that does not work with new kernel.Overview
--------
This series rewrites the fprobe on this function-graph. The purposes of this change are;1) Remove dependency of the rethook from fprobe so that we can reduce the return hook code and shadow stack.
2) Make '
ftrace_regs' the common trace interface for the function boundary.1) Currently we have 2(or 3) different function return hook codes, the function-graph tracer and rethook (and legacy kretprobe). But since this is redundant and needs double maintenance cost, I would like to unify those. From the user's viewpoint, function- graph tracer is very useful to grasp the execution path. For this purpose, it is hard to use the rethook in the function-graph tracer, but the opposite is possible. (Strictly speaking, kretprobe can not use it because it requires '
pt_regs' for historical reasons.)2) Now the fprobe provides the '
pt_regs' for its handler, but that is wrong for the function entry and exit. Moreover, depending on the architecture, there is no way to accurately reproduce 'pt_regs' outside of interrupt or exception handlers. This means fprobe should not use 'pt_regs' because it does not use such exceptions. (Conversely, kprobe should use 'pt_regs' because it is an abstract interface of the software breakpoint exception.)This series changes fprobe to use function-graph tracer for tracing function entry and exit, instead of mixture of ftrace and rethook. Unlike the rethook which is a per-task list of system-wide allocated nodes, the function graph's
ret_stackis a per-task shadow stack. Thus it does not need to set 'nr_maxactive' (which is the number of pre-allocated nodes).
Also the handlers will get the 'ftrace_regs' instead of 'pt_regs'. Since eBPF mulit_kprobe/multi_kretprobe events still use 'pt_regs' as their register interface, this changes it to convert 'ftrace_regs' to 'pt_regs'. Of course this conversion makes an incomplete 'pt_regs', so users must access only registers for function parameters or return value.Design
------
Instead of using ftrace's function entry hook directly, the new fprobe is built on top of the function-graph's entry and return callbacks with 'ftrace_regs'.Since the fprobe requires access to '
ftrace_regs', the architecture must supportCONFIG_HAVE_DYNAMIC_FTRACE_WITH_ARGSandCONFIG_HAVE_FTRACE_GRAPH_FUNC, which enables to call function-graph entry callback with 'ftrace_regs', and alsoCONFIG_HAVE_FUNCTION_GRAPH_FREGS, which passes theftrace_regstoreturn_to_handler.All fprobes share a single function-graph ops (means shares a common ftrace filter) similar to the kprobe-on-ftrace. This needs another layer to find corresponding fprobe in the common function-graph callbacks, but has much better scalability, since the number of registered function-graph ops is limited.
In the entry callback, the fprobe runs its
entry_handlerand saves the address of 'fprobe' on the function-graph's shadow stack as data. The return callback decodes the data to get the 'fprobe' address, and runs theexit_handler.The fprobe introduces two hash-tables, one is for entry callback which searches fprobes related to the given function address passed by entry callback. The other is for a return callback which checks if the given 'fprobe' data structure pointer is still valid. Note that it is possible to unregister fprobe before the return callback runs. Thus the address validation must be done before using it in the return callback.
Download
--------
This series can be applied against the ftrace/for-next branch in linux-trace tree.This series can also be found below branch.
https://git.kernel.org/pub/scm/linux/kernel/git/mhiramat/linux.git/log/?h=topic/fprobe-on-fgraph
Thank you,
---
Masami Hiramatsu (Google) (20):
tracing: fgraph: Fix to add newfgraph_opsto array afterftrace_startup_subops()
tracing: Add a comment aboutftrace_regsdefinition
tracing: Renameftrace_regs_return_valuetoftrace_regs_get_return_value
function_graph: Passftrace_regsto entryfunc
function_graph: Replacefgraph_ret_regswithftrace_regs
function_graph: Passftrace_regsto retfunc
fprobe: Useftrace_regsin fprobe entry handler
fprobe: Useftrace_regsin fprobe exit handler
tracing: Addftrace_partial_regs()for convertingftrace_regstopt_regs
tracing: Addftrace_fill_perf_regs()for perf event
tracing/fprobe: Enable fprobe events withCONFIG_DYNAMIC_FTRACE_WITH_ARGS
bpf: Enablekprobe_multifeature ifCONFIG_FPROBEis enabled
ftrace: AddCONFIG_HAVE_FTRACE_GRAPH_FUNC
fprobe: Rewrite fprobe on function-graph tracer
tracing: Fix function timing profiler to initialize hashtable tracing/fprobe: Removenr_maxactivefrom fprobe
selftests: ftrace: Remove obsolate maxactive syntax check selftests/ftrace: Add a test case for repeating register/unregister fprobe
Documentation: probes: Update fprobe on function-graph tracer
fgraph: Skip recording calltime/rettime if it is not nneededDocumentation/trace/fprobe.rst | 42 + arch/arm64/Kconfig | 2 arch/arm64/include/asm/ftrace.h | 47 + arch/arm64/kernel/asm-offsets.c | 12 arch/arm64/kernel/entry-ftrace.S | 32 + arch/arm64/kernel/ftrace.c | 20 + arch/loongarch/Kconfig | 4 arch/loongarch/include/asm/ftrace.h | 32 - arch/loongarch/kernel/asm-offsets.c | 12 arch/loongarch/kernel/ftrace_dyn.c | 10 arch/loongarch/kernel/mcount.S | 17 - arch/loongarch/kernel/mcount_dyn.S | 14 arch/powerpc/Kconfig | 1 arch/powerpc/include/asm/ftrace.h | 15 arch/powerpc/kernel/trace/ftrace.c | 2 arch/powerpc/kernel/trace/ftrace_64_pg.c | 10 arch/riscv/Kconfig | 3 arch/riscv/include/asm/ftrace.h | 26 - arch/riscv/kernel/ftrace.c | 17 + arch/riscv/kernel/mcount.S | 24 - arch/s390/Kconfig | 3 arch/s390/include/asm/ftrace.h | 39 + arch/s390/kernel/asm-offsets.c | 6 arch/s390/kernel/mcount.S | 9 arch/x86/Kconfig | 4 arch/x86/include/asm/ftrace.h | 37 + arch/x86/kernel/ftrace.c | 50 +- arch/x86/kernel/ftrace_32.S | 15 arch/x86/kernel/ftrace_64.S | 17 - include/linux/fprobe.h | 57 +- include/linux/ftrace.h | 136 ++++ kernel/trace/Kconfig | 23 + kernel/trace/bpf_trace.c | 19 - kernel/trace/fgraph.c | 127 +++- kernel/trace/fprobe.c | 638 ++++++++++++++------ kernel/trace/ftrace.c | 10 kernel/trace/trace.h | 6 kernel/trace/trace_fprobe.c | 147 ++--- kernel/trace/trace_functions_graph.c | 10 kernel/trace/trace_irqsoff.c | 6 kernel/trace/trace_probe_tmpl.h | 2 kernel/trace/trace_sched_wakeup.c | 6 kernel/trace/trace_selftest.c | 11 lib/test_fprobe.c | 51 -- samples/fprobe/fprobe_example.c | 4 .../test.d/dynevent/add_remove_fprobe_repeat.tc | 19 + .../ftrace/test.d/dynevent/fprobe_syntax_errors.tc | 4 47 files changed, 1168 insertions(+), 630 deletions(-) create mode 100644 tools/testing/selftests/ftrace/test.d/dynevent/add_remove_fprobe_repeat.tc--
Masami Hiramatsu (Google) <[email protected]>Signature · 1 line
Masami Hiramatsu (Google) <[email protected]>
Signature · 1 line
Masami Hiramatsu (Google) <[email protected]>
Quoted 90 lines · Masami Hiramatsu (Google)
Hi,
Here is the 13th version of the series to re-implement the fprobe on function-graph tracer. The previous version is;
https://lore.kernel.org/all/172000134410.63468.13742222887213469474.stgit@devnote2/
This version is based on v6.11-rc3.
In this version, I added a bugfix as [1/20], which should go to urgent branch, and dropped the performance improvement patch which was introduced in v12 because I found that does not work with new kernel.Overview
--------
This series rewrites the fprobe on this function-graph. The purposes of this change are;1) Remove dependency of the rethook from fprobe so that we can reduce the return hook code and shadow stack.
2) Make '
ftrace_regs' the common trace interface for the function boundary.1) Currently we have 2(or 3) different function return hook codes, the function-graph tracer and rethook (and legacy kretprobe). But since this is redundant and needs double maintenance cost, I would like to unify those. From the user's viewpoint, function- graph tracer is very useful to grasp the execution path. For this purpose, it is hard to use the rethook in the function-graph tracer, but the opposite is possible. (Strictly speaking, kretprobe can not use it because it requires '
pt_regs' for historical reasons.)2) Now the fprobe provides the '
pt_regs' for its handler, but that is wrong for the function entry and exit. Moreover, depending on the architecture, there is no way to accurately reproduce 'pt_regs' outside of interrupt or exception handlers. This means fprobe should not use 'pt_regs' because it does not use such exceptions. (Conversely, kprobe should use 'pt_regs' because it is an abstract interface of the software breakpoint exception.)This series changes fprobe to use function-graph tracer for tracing function entry and exit, instead of mixture of ftrace and rethook. Unlike the rethook which is a per-task list of system-wide allocated nodes, the function graph's
ret_stackis a per-task shadow stack. Thus it does not need to set 'nr_maxactive' (which is the number of pre-allocated nodes).
Also the handlers will get the 'ftrace_regs' instead of 'pt_regs'. Since eBPF mulit_kprobe/multi_kretprobe events still use 'pt_regs' as their register interface, this changes it to convert 'ftrace_regs' to 'pt_regs'. Of course this conversion makes an incomplete 'pt_regs', so users must access only registers for function parameters or return value.Design
------
Instead of using ftrace's function entry hook directly, the new fprobe is built on top of the function-graph's entry and return callbacks with 'ftrace_regs'.Since the fprobe requires access to '
ftrace_regs', the architecture must supportCONFIG_HAVE_DYNAMIC_FTRACE_WITH_ARGSandCONFIG_HAVE_FTRACE_GRAPH_FUNC, which enables to call function-graph entry callback with 'ftrace_regs', and alsoCONFIG_HAVE_FUNCTION_GRAPH_FREGS, which passes theftrace_regstoreturn_to_handler.All fprobes share a single function-graph ops (means shares a common ftrace filter) similar to the kprobe-on-ftrace. This needs another layer to find corresponding fprobe in the common function-graph callbacks, but has much better scalability, since the number of registered function-graph ops is limited.
In the entry callback, the fprobe runs its
entry_handlerand saves the address of 'fprobe' on the function-graph's shadow stack as data. The return callback decodes the data to get the 'fprobe' address, and runs theexit_handler.The fprobe introduces two hash-tables, one is for entry callback which searches fprobes related to the given function address passed by entry callback. The other is for a return callback which checks if the given 'fprobe' data structure pointer is still valid. Note that it is possible to unregister fprobe before the return callback runs. Thus the address validation must be done before using it in the return callback.
Download
--------
This series can be applied against the ftrace/for-next branch in linux-trace tree.
Quoted 7 lines
This series can also be found below branch.
https://git.kernel.org/pub/scm/linux/kernel/git/mhiramat/linux.git/log/?h=topic/fprobe-on-fgraph
Thank you,
---
hi,
I ran the kprobe_multi bench and I'm seeing lower throughput numbers with new fprobe implementation
base (bpf-next/master)
root@amd:/home/jolsa/bpf-next/tools/testing/selftests/bpf# ./bench -w2 -d5 -a trig-kprobe-multi
Setting up benchmark 'trig-kprobe-multi'...
Benchmark 'trig-kprobe-multi' started.
Iter 0 ( 70.969us): hits 8.530M/s ( 8.530M/prod), drops 0.000M/s, total operations 8.530M/s
Iter 1 (-24.985us): hits 8.541M/s ( 8.541M/prod), drops 0.000M/s, total operations 8.541M/s
Iter 2 ( -2.976us): hits 8.537M/s ( 8.537M/prod), drops 0.000M/s, total operations 8.537M/s
Iter 3 ( -1.502us): hits 8.540M/s ( 8.540M/prod), drops 0.000M/s, total operations 8.540M/s
Iter 4 ( 0.392us): hits 8.540M/s ( 8.540M/prod), drops 0.000M/s, total operations 8.540M/s
Iter 5 ( 1.308us): hits 8.545M/s ( 8.545M/prod), drops 0.000M/s, total operations 8.545M/s
Iter 6 ( 2.783us): hits 8.530M/s ( 8.530M/prod), drops 0.000M/s, total operations 8.530M/s
Iter 7 ( -3.775us): hits 8.535M/s ( 8.535M/prod), drops 0.000M/s, total operations 8.535M/s
Summary: hits 8.538 ± 0.005M/s ( 8.538M/prod), drops 0.000 ± 0.000M/s, total operations 8.538 ± 0.005M/syour patchset on top of bpf-next/master
root@amd:/home/jolsa/bpf-next/tools/testing/selftests/bpf# ./bench -w2 -d5 -a trig-kprobe-multi
Setting up benchmark 'trig-kprobe-multi'...
Benchmark 'trig-kprobe-multi' started.
Iter 0 ( 55.712us): hits 7.224M/s ( 7.224M/prod), drops 0.000M/s, total operations 7.224M/s
Iter 1 ( 15.226us): hits 7.222M/s ( 7.222M/prod), drops 0.000M/s, total operations 7.222M/s
Iter 2 ( -1.353us): hits 7.221M/s ( 7.221M/prod), drops 0.000M/s, total operations 7.221M/s
Iter 3 (-13.029us): hits 7.223M/s ( 7.223M/prod), drops 0.000M/s, total operations 7.223M/s
Iter 4 ( 9.111us): hits 7.222M/s ( 7.222M/prod), drops 0.000M/s, total operations 7.222M/s
Iter 5 ( -0.106us): hits 7.222M/s ( 7.222M/prod), drops 0.000M/s, total operations 7.222M/s
Iter 6 ( 0.734us): hits 7.221M/s ( 7.221M/prod), drops 0.000M/s, total operations 7.221M/s
Iter 7 (-10.233us): hits 7.220M/s ( 7.220M/prod), drops 0.000M/s, total operations 7.220M/s
Summary: hits 7.221 ± 0.001M/s ( 7.221M/prod), drops 0.000 ± 0.000M/s, total operations 7.221 ± 0.001M/sI did perf profile (attached), but nothing stands out on the first look, I'll try to check on that later this week
jirka
---
# To display the perf.data header info, please use --header/--header-only options. #
#
# Total Lost Samples: 0
#
# Samples: 42K of event 'cycles:k'
# Event count (approx.): 44580427937
#
# Overhead Command Shared Object Symbol # ........ ............... .................................................... ........................................................
#
17.47% bench [kernel.vmlinux] [k] find_kallsyms_symbol
|
---find_kallsyms_symbol
module_address_lookup
kallsyms_lookup_buildid
kallsyms_lookup
print_rec
t_show
seq_read_iter
seq_read
vfs_read
ksys_read
__x64_sys_read
x64_sys_call
do_syscall_64
entry_SYSCALL_64
read
0
11.71% bench [kernel.vmlinux] [k] kprobe_multi_link_prog_run
|
---kprobe_multi_link_prog_run
|
--11.56%--kprobe_multi_link_handler
fprobe_entry function_graph_enter_regs ftrace_graph_func 0xffffffffc29850ab bpf_get_numa_node_id bpf_prog_d9703036495d54b0_trigger_driver __bpf_prog_test_run_raw_tp bpf_prog_test_run_raw_tp __sys_bpf
__x64_sys_bpf
x64_sys_call
do_syscall_64 entry_SYSCALL_64
syscall bpf_prog_test_run_opts trigger_producer_batch 0x7a2a73a94ac3
7.65% bench [kernel.vmlinux] [k] function_graph_enter_regs
|
---function_graph_enter_regs
|
--7.65%--ftrace_graph_func
0xffffffffc29850ab bpf_get_numa_node_id bpf_prog_d9703036495d54b0_trigger_driver __bpf_prog_test_run_raw_tp bpf_prog_test_run_raw_tp __sys_bpf
__x64_sys_bpf
x64_sys_call
do_syscall_64 entry_SYSCALL_64
syscall bpf_prog_test_run_opts trigger_producer_batch 0x7a2a73a94ac3
7.55% bench [kernel.vmlinux] [k] kprobe_multi_link_handler
|
---kprobe_multi_link_handler
|
|--4.35%--function_graph_enter_regs
| ftrace_graph_func
| 0xffffffffc29850ab
| bpf_get_numa_node_id
| bpf_prog_d9703036495d54b0_trigger_driver
| __bpf_prog_test_run_raw_tp
| bpf_prog_test_run_raw_tp
| __sys_bpf
| __x64_sys_bpf
| x64_sys_call
| do_syscall_64
| entry_SYSCALL_64
| syscall
| bpf_prog_test_run_opts
| trigger_producer_batch
| 0x7a2a73a94ac3
|
--3.20%--fprobe_entry
function_graph_enter_regs ftrace_graph_func 0xffffffffc29850ab bpf_get_numa_node_id bpf_prog_d9703036495d54b0_trigger_driver __bpf_prog_test_run_raw_tp bpf_prog_test_run_raw_tp __sys_bpf
__x64_sys_bpf
x64_sys_call
do_syscall_64 entry_SYSCALL_64
syscall bpf_prog_test_run_opts trigger_producer_batch 0x7a2a73a94ac3
7.50% bench [kernel.vmlinux] [k] fprobe_entry
|
---fprobe_entry
|
--7.50%--function_graph_enter_regs
ftrace_graph_func 0xffffffffc29850ab bpf_get_numa_node_id bpf_prog_d9703036495d54b0_trigger_driver __bpf_prog_test_run_raw_tp bpf_prog_test_run_raw_tp __sys_bpf
__x64_sys_bpf
x64_sys_call
do_syscall_64 entry_SYSCALL_64
syscall bpf_prog_test_run_opts trigger_producer_batch 0x7a2a73a94ac3
7.08% bench bpf_prog_7790468e40a289ea_bench_trigger_kprobe_multi [k] bpf_prog_7790468e40a289ea_bench_trigger_kprobe_multi
| ---bpf_prog_7790468e40a289ea_bench_trigger_kprobe_multi
|
|--4.10%--kprobe_multi_link_handler
| fprobe_entry
| function_graph_enter_regs
| ftrace_graph_func
| 0xffffffffc29850ab
| bpf_get_numa_node_id
| bpf_prog_d9703036495d54b0_trigger_driver
| __bpf_prog_test_run_raw_tp
| bpf_prog_test_run_raw_tp
| __sys_bpf
| __x64_sys_bpf
| x64_sys_call
| do_syscall_64
| entry_SYSCALL_64
| syscall
| bpf_prog_test_run_opts
| trigger_producer_batch
| 0x7a2a73a94ac3
|
--2.97%--kprobe_multi_link_prog_run
kprobe_multi_link_handler fprobe_entry function_graph_enter_regs ftrace_graph_func 0xffffffffc29850ab bpf_get_numa_node_id bpf_prog_d9703036495d54b0_trigger_driver __bpf_prog_test_run_raw_tp bpf_prog_test_run_raw_tp __sys_bpf
__x64_sys_bpf
x64_sys_call
do_syscall_64
entry_SYSCALL_64
syscall
bpf_prog_test_run_opts trigger_producer_batch 0x7a2a73a94ac3
6.11% bench [kernel.vmlinux] [k] migrate_enable
|
---migrate_enable
|
|--3.37%--kprobe_multi_link_handler
| fprobe_entry
| function_graph_enter_regs
| ftrace_graph_func
| 0xffffffffc29850ab
| bpf_get_numa_node_id
| bpf_prog_d9703036495d54b0_trigger_driver
| __bpf_prog_test_run_raw_tp
| bpf_prog_test_run_raw_tp
| __sys_bpf
| __x64_sys_bpf
| x64_sys_call
| do_syscall_64
| entry_SYSCALL_64
| syscall
| bpf_prog_test_run_opts
| trigger_producer_batch
| 0x7a2a73a94ac3
|
--2.73%--kprobe_multi_link_prog_run
kprobe_multi_link_handler fprobe_entry function_graph_enter_regs ftrace_graph_func 0xffffffffc29850ab bpf_get_numa_node_id bpf_prog_d9703036495d54b0_trigger_driver __bpf_prog_test_run_raw_tp bpf_prog_test_run_raw_tp __sys_bpf
__x64_sys_bpf
x64_sys_call
do_syscall_64 entry_SYSCALL_64
syscall bpf_prog_test_run_opts trigger_producer_batch 0x7a2a73a94ac3
5.90% bench [kernel.vmlinux] [k] ftrace_graph_func
|
---ftrace_graph_func
|
--5.75%--0xffffffffc29850ab
bpf_get_numa_node_id bpf_prog_d9703036495d54b0_trigger_driver __bpf_prog_test_run_raw_tp bpf_prog_test_run_raw_tp __sys_bpf
__x64_sys_bpf
x64_sys_call
do_syscall_64 entry_SYSCALL_64
syscall bpf_prog_test_run_opts trigger_producer_batch 0x7a2a73a94ac3
4.03% bench [kernel.vmlinux] [k] __rcu_read_lock
|
---__rcu_read_lock
|
--4.00%--kprobe_multi_link_handler
fprobe_entry function_graph_enter_regs ftrace_graph_func 0xffffffffc29850ab bpf_get_numa_node_id bpf_prog_d9703036495d54b0_trigger_driver __bpf_prog_test_run_raw_tp bpf_prog_test_run_raw_tp __sys_bpf
__x64_sys_bpf
x64_sys_call
do_syscall_64 entry_SYSCALL_64
syscall bpf_prog_test_run_opts trigger_producer_batch 0x7a2a73a94ac3
3.61% bench [kernel.vmlinux] [k] bpf_get_numa_node_id
|
---bpf_get_numa_node_id
__bpf_prog_test_run_raw_tp
bpf_prog_test_run_raw_tp
__sys_bpf
__x64_sys_bpf
x64_sys_call
do_syscall_64
entry_SYSCALL_64
syscall
bpf_prog_test_run_opts
trigger_producer_batch
0x7a2a73a94ac3
2.99% bench [nf_conntrack] [k] 0x000000000002c0b3
|
---0xffffffffc29850b3
bpf_get_numa_node_id bpf_prog_d9703036495d54b0_trigger_driver __bpf_prog_test_run_raw_tp bpf_prog_test_run_raw_tp __sys_bpf
__x64_sys_bpf
x64_sys_call
do_syscall_64
entry_SYSCALL_64
syscall
bpf_prog_test_run_opts trigger_producer_batch 0x7a2a73a94ac3
2.69% bench bpf_prog_d9703036495d54b0_trigger_driver [k] bpf_prog_d9703036495d54b0_trigger_driver
| ---bpf_prog_d9703036495d54b0_trigger_driver
|
--2.68%--__bpf_prog_test_run_raw_tp
bpf_prog_test_run_raw_tp __sys_bpf __x64_sys_bpf x64_sys_call do_syscall_64 entry_SYSCALL_64 syscall bpf_prog_test_run_opts trigger_producer_batch 0x7a2a73a94ac3
2.04% bench [kernel.vmlinux] [k] t_start
|
---t_start
seq_read_iter
seq_read
vfs_read
ksys_read
__x64_sys_read
x64_sys_call
do_syscall_64
entry_SYSCALL_64
read
0
1.90% bench [kernel.vmlinux] [k] srso_untrain_ret
|
---srso_untrain_ret
|
|--0.68%--fprobe_entry
| function_graph_enter_regs
| ftrace_graph_func
| 0xffffffffc29850ab
| bpf_get_numa_node_id
| bpf_prog_d9703036495d54b0_trigger_driver
| __bpf_prog_test_run_raw_tp
| bpf_prog_test_run_raw_tp
| __sys_bpf
| __x64_sys_bpf
| x64_sys_call
| do_syscall_64
| entry_SYSCALL_64
| syscall
| bpf_prog_test_run_opts
| trigger_producer_batch
| 0x7a2a73a94ac3
|
--0.54%--seq_read_iter
seq_read
vfs_read
ksys_read
__x64_sys_read
x64_sys_call
do_syscall_64
entry_SYSCALL_64
read
0
1.14% bench [kernel.vmlinux] [k] __rcu_read_unlock
|
---__rcu_read_unlock
|
--1.12%--kprobe_multi_link_handler
fprobe_entry function_graph_enter_regs ftrace_graph_func 0xffffffffc29850ab bpf_get_numa_node_id bpf_prog_d9703036495d54b0_trigger_driver __bpf_prog_test_run_raw_tp bpf_prog_test_run_raw_tp __sys_bpf
__x64_sys_bpf
x64_sys_call
do_syscall_64 entry_SYSCALL_64
syscall bpf_prog_test_run_opts trigger_producer_batch 0x7a2a73a94ac3
1.02% bench [kernel.vmlinux] [k] migrate_disable
|
---migrate_disable
kprobe_multi_link_handler fprobe_entry function_graph_enter_regs ftrace_graph_func 0xffffffffc29850ab bpf_get_numa_node_id bpf_prog_d9703036495d54b0_trigger_driver __bpf_prog_test_run_raw_tp bpf_prog_test_run_raw_tp __sys_bpf
__x64_sys_bpf
x64_sys_call
do_syscall_64
entry_SYSCALL_64
syscall
bpf_prog_test_run_opts trigger_producer_batch 0x7a2a73a94ac3
0.99% bench [kernel.vmlinux] [k] t_func_next.isra.0
|
---t_func_next.isra.0
|
--0.83%--t_start
seq_read_iter
seq_read
vfs_read
ksys_read
__x64_sys_read
x64_sys_call
do_syscall_64
entry_SYSCALL_64
read
0
0.78% bench [nf_conntrack] [k] 0x000000000002c0d4
|
---0xffffffffc29850d4
__bpf_prog_test_run_raw_tp
bpf_prog_test_run_raw_tp
__sys_bpf
__x64_sys_bpf
x64_sys_call
do_syscall_64
entry_SYSCALL_64
syscall
bpf_prog_test_run_opts
trigger_producer_batch
0x7a2a73a94ac3
0.75% bench [nf_conntrack] [k] 0x000000000002c0ab
|
---0xffffffffc29850ab
bpf_get_numa_node_id bpf_prog_d9703036495d54b0_trigger_driver __bpf_prog_test_run_raw_tp bpf_prog_test_run_raw_tp __sys_bpf
__x64_sys_bpf
x64_sys_call
do_syscall_64
entry_SYSCALL_64
syscall
bpf_prog_test_run_opts trigger_producer_batch 0x7a2a73a94ac3
0.68% bench [nf_conntrack] [k] 0x000000000002c00d
|
---0xffffffffc298500d
bpf_prog_d9703036495d54b0_trigger_driver __bpf_prog_test_run_raw_tp bpf_prog_test_run_raw_tp __sys_bpf
__x64_sys_bpf
x64_sys_call
do_syscall_64
entry_SYSCALL_64
syscall
bpf_prog_test_run_opts trigger_producer_batch 0x7a2a73a94ac3
0.52% bench [kernel.vmlinux] [k] __x86_indirect_thunk_array
|
---__x86_indirect_thunk_array
0.42% bench [nf_conntrack] [k] 0x000000000002c005
0.38% bench [kernel.vmlinux] [k] __sys_bpf
0.37% bench [kernel.vmlinux] [k] srso_return_thunk
0.24% bench [nf_conntrack] [k] 0x000000000002c001
0.23% bench [kernel.vmlinux] [k] read_hpet
0.21% bench [kernel.vmlinux] [k] entry_SYSCALL_64
0.19% bench [kernel.vmlinux] [k] bpf_prog_test_run_raw_tp
0.17% bench [nf_conntrack] [k] 0x000000000002c000
0.15% bench [kernel.vmlinux] [k] _copy_from_user
0.15% bench [kernel.vmlinux] [k] syscall_exit_to_user_mode
0.14% bench [nf_conntrack] [k] 0x000000000002c027
0.14% bench [nf_conntrack] [k] 0x000000000002c0ca
0.13% swapper [kernel.vmlinux] [k] read_hpet
0.12% bench [kernel.vmlinux] [k] _copy_to_user
0.12% bench [nf_conntrack] [k] 0x000000000002c086
0.11% bench [nf_conntrack] [k] 0x000000000002c0c0
0.11% bench [kernel.vmlinux] [k] __fdget
0.11% bench bench [.] bpf_prog_test_run_opts
0.11% bench [kernel.vmlinux] [k] __bpf_prog_test_run_raw_tp
0.10% bench [nf_conntrack] [k] 0x000000000002c059
0.09% bench [kernel.vmlinux] [k] get_symbol_offset
0.09% bench [kernel.vmlinux] [k] do_syscall_64
0.08% bench [kernel.vmlinux] [k] __bpf_prog_get
0.08% bench [kernel.vmlinux] [k] memchr_inv
0.07% bench [kernel.vmlinux] [k] syscall_return_via_sysret
0.06% bench [kernel.vmlinux] [k] x64_sys_call
0.06% bench [kernel.vmlinux] [k] rep_movs_alternative
0.06% bench [kernel.vmlinux] [k] ftrace_replace_code
0.04% bench [kernel.vmlinux] [k] __x64_sys_bpf
0.04% bench [kernel.vmlinux] [k] get_symbol_pos
0.04% bench bench [.] sys_bpf
0.04% bench [kernel.vmlinux] [k] vsnprintf
0.04% bench [kernel.vmlinux] [k] number
0.04% bench bench [.] ptr_to_u64
0.04% bench [kernel.vmlinux] [k] kfree
0.03% bench [kernel.vmlinux] [k] seq_read_iter
0.03% bench [kernel.vmlinux] [k] security_bpf
0.03% bench libc.so.6 [.] syscall
0.03% bench [kernel.vmlinux] [k] kallsyms_expand_symbol.constprop.0
0.03% kworker/2:2-eve [kernel.vmlinux] [k] memcpy_orig
0.03% swapper [amdgpu] [k] 0x0000000000002f75
0.03% bench bench [.] trigger_producer_batch
0.03% bench [kernel.vmlinux] [k] __bpf_prog_put
0.02% bench [kernel.vmlinux] [k] seq_printf
0.02% bench [kernel.vmlinux] [k] smp_call_function_many_cond
0.02% kworker/2:2-eve [amdgpu] [k] 0x0000000000002f75
0.02% bench [kernel.vmlinux] [k] __check_object_size
0.02% bench [kernel.vmlinux] [k] ftrace_test_record
0.02% bench [kernel.vmlinux] [k] seq_write
0.02% bench [kernel.vmlinux] [k] ftrace_lookup_ip
0.02% bench [kernel.vmlinux] [k] t_show
0.02% bench [kernel.vmlinux] [k] print_rec
0.02% swapper [kernel.vmlinux] [k] io_idle
0.01% bench [amdgpu] [k] 0x0000000000002f75
0.01% kworker/2:2-eve [kernel.vmlinux] [k] memcmp
0.01% bench [kernel.vmlinux] [k] format_decode
0.01% bench [kernel.vmlinux] [k] memcpy_orig
0.01% bench [kernel.vmlinux] [k] __ftrace_hash_rec_update.part.0
0.01% bench [kernel.vmlinux] [k] mod_find
0.01% swapper [kernel.vmlinux] [k] srso_untrain_ret
0.01% bench [kernel.vmlinux] [k] kallsyms_lookup_buildid
0.01% bench [kernel.vmlinux] [k] __seq_puts
0.01% bench [kernel.vmlinux] [k] native_read_msr
0.01% bench [kernel.vmlinux] [k] check_stack_object
0.01% bench [kernel.vmlinux] [k] fput
0.01% bench bench [.] libbpf_err_errno
0.01% bench [kernel.vmlinux] [k] fpregs_assert_state_consistent
0.01% bench [kernel.vmlinux] [k] ftrace_check_record
0.01% bench [kernel.vmlinux] [k] t_next
0.01% bench [kernel.vmlinux] [k] strlen
0.01% swapper [kernel.vmlinux] [k] native_sched_clock
0.01% bench [kernel.vmlinux] [k] __sysvec_apic_timer_interrupt
0.01% bench libc.so.6 [.] 0x00000000001a0f10
0.01% bench [kernel.vmlinux] [k] native_write_msr
0.01% bench [kernel.vmlinux] [k] __update_load_avg_se
0.01% bench [kernel.vmlinux] [k] amd_pmu_addr_offset
0.01% bench [kernel.vmlinux] [k] module_address_lookup
0.01% bench [kernel.vmlinux] [k] ftrace_rec_iter_next
0.01% bench [kernel.vmlinux] [k] string
0.01% bench [kernel.vmlinux] [k] asm_exc_page_fault
0.01% swapper [kernel.vmlinux] [k] __get_next_timer_interrupt
0.01% bench [kernel.vmlinux] [k] clear_page_rep
0.01% kworker/2:2-eve [kernel.vmlinux] [k] delay_halt_mwaitx
0.01% bench [kernel.vmlinux] [k] __handle_mm_fault
0.01% swapper [kernel.vmlinux] [k] ktime_get
0.01% kworker/2:2-eve [kernel.vmlinux] [k] clear_page_rep
0.01% swapper [kernel.vmlinux] [k] menu_select
0.00% perf [kernel.vmlinux] [k] clear_page_rep
0.00% bench [kernel.vmlinux] [k] ftrace_rec_iter_record
0.00% bench [kernel.vmlinux] [k] account_process_tick
0.00% bench [kernel.vmlinux] [k] __update_load_avg_cfs_rq
0.00% bench [kernel.vmlinux] [k] update_curr
0.00% bench [kernel.vmlinux] [k] do_sync_core
0.00% bench [kernel.vmlinux] [k] kallsyms_lookup
0.00% bench [kernel.vmlinux] [k] memset_orig
0.00% kworker/6:1-eve [kernel.vmlinux] [k] memcpy_orig
0.00% perf [kernel.vmlinux] [k] rep_movs_alternative
0.00% sshd [kernel.vmlinux] [k] p4d_offset
0.00% kworker/6:1-eve [amdgpu] [k] 0x0000000000002f75
0.00% bench [kernel.vmlinux] [k] __mod_memcg_lruvec_state
0.00% swapper [kernel.vmlinux] [k] _raw_spin_unlock
0.00% swapper [kernel.vmlinux] [k] cpuidle_enter_state
0.00% swapper [kernel.vmlinux] [k] rb_erase
0.00% containerd [kernel.vmlinux] [k] read_hpet
0.00% kworker/6:1-eve [kernel.vmlinux] [k] memcmp
0.00% swapper [kernel.vmlinux] [k] irq_entries_start
0.00% swapper [kernel.vmlinux] [k] do_idle
0.00% kworker/2:2-eve [kernel.vmlinux] [k] read_hpet
0.00% swapper [kernel.vmlinux] [k] update_rq_clock
0.00% swapper [kernel.vmlinux] [k] psi_group_change
0.00% swapper [kernel.vmlinux] [k] sched_clock_cpu
0.00% swapper [kernel.vmlinux] [k] do_sync_core
0.00% kworker/2:2-eve [amdgpu] [k] 0x000000000064ec11
0.00% swapper [kernel.vmlinux] [k] _raw_spin_lock_irqsave
0.00% swapper [kernel.vmlinux] [k] asm_sysvec_call_function_single
0.00% swapper [kernel.vmlinux] [k] update_sd_lb_stats.constprop.0
0.00% perf [kernel.vmlinux] [k] __filemap_get_folio
0.00% swapper [kernel.vmlinux] [k] irqentry_enter
0.00% bench [kernel.vmlinux] [k] amd_pmu_test_overflow_topbit
0.00% bench [amdgpu] [k] 0x0000000000124f4c
0.00% bench [kernel.vmlinux] [k] update_rq_clock
0.00% bench [kernel.vmlinux] [k] perf_event_task_tick
0.00% bench [amdgpu] [k] 0x0000000000126f3a
0.00% bench [kernel.vmlinux] [k] sched_balance_update_blocked_averages
0.00% bench [kernel.vmlinux] [k] hrtimer_active
0.00% bench [kernel.vmlinux] [k] _copy_to_iter
0.00% bench [kernel.vmlinux] [k] _raw_spin_lock_irqsave
0.00% bench [kernel.vmlinux] [k] calc_global_load_tick
0.00% bench [kernel.vmlinux] [k] ftrace_shutdown.part.0
0.00% bench libc.so.6 [.] 0x00000000001a0fb5
0.00% bench [kernel.vmlinux] [k] task_tick_mm_cid
0.00% bench libc.so.6 [.] 0x00000000001a0fba
0.00% bench [kernel.vmlinux] [k] sched_clock_cpu
0.00% bench [kernel.vmlinux] [k] update_cfs_group
0.00% bench [kernel.vmlinux] [k] irq_exit_rcu
0.00% bench [kernel.vmlinux] [k] native_sched_clock
0.00% bench [kernel.vmlinux] [k] sched_tick
0.00% bench [kernel.vmlinux] [k] sized_strscpy
0.00% bench [kernel.vmlinux] [k] task_tick_fair
0.00% bench [nf_conntrack] [k] 0x000000000002c036
0.00% bench [kernel.vmlinux] [k] perf_adjust_freq_unthr_context
0.00% bench [kernel.vmlinux] [k] idle_cpu
0.00% bench [kernel.vmlinux] [k] bpf_check_uarg_tail_zero
0.00% swapper [kernel.vmlinux] [k] __hrtimer_next_event_base
0.00% swapper [kernel.vmlinux] [k] native_write_msr
0.00% bench [kernel.vmlinux] [k] __module_address.part.0
0.00% bench [kernel.vmlinux] [k] lru_gen_add_folio
0.00% bench [kernel.vmlinux] [k] set_pte_range
0.00% bench [kernel.vmlinux] [k] pfn_pte
0.00% swapper [kernel.vmlinux] [k] error_entry
0.00% swapper [kernel.vmlinux] [k] idle_cpu
0.00% bench [kernel.vmlinux] [k] unmap_page_range
0.00% bench [kernel.vmlinux] [k] __count_memcg_events
0.00% bench [kernel.vmlinux] [k] __irq_exit_rcu
0.00% perf [kernel.vmlinux] [k] __perf_event_enable
0.00% bench [kernel.vmlinux] [k] seq_putc
0.00% perf [kernel.vmlinux] [k] srso_untrain_ret
0.00% swapper [kernel.vmlinux] [k] __irq_exit_rcu
0.00% kworker/2:2-eve [kernel.vmlinux] [k] __kmalloc_cache_noprof
0.00% bench libc.so.6 [.] 0x00000000001a0bd7
0.00% perf [kernel.vmlinux] [k] _raw_spin_lock
0.00% kworker/u65:2-e [kernel.vmlinux] [k] __bio_split_to_limits
0.00% bench [kernel.vmlinux] [k] do_anonymous_page
0.00% perf [kernel.vmlinux] [k] __es_insert_extent
0.00% bench [kernel.vmlinux] [k] __mem_cgroup_charge
0.00% kworker/2:2-eve [kernel.vmlinux] [k] __wait_for_common
0.00% bench [kernel.vmlinux] [k] __folio_throttle_swaprate
0.00% swapper [kernel.vmlinux] [k] __switch_to_asm
0.00% swapper [kernel.vmlinux] [k] add_interrupt_randomness
0.00% kworker/2:2-eve [kernel.vmlinux] [k] srso_untrain_ret
0.00% kworker/2:2-eve [kernel.vmlinux] [k] memset_orig
0.00% kworker/u65:2-e [kernel.vmlinux] [k] percpu_counter_add_batch
0.00% swapper [kernel.vmlinux] [k] tick_irq_enter
0.00% swapper [kernel.vmlinux] [k] tick_check_broadcast_expired
0.00% kworker/2:2-eve [amdgpu] [k] 0x000000000045d28e
0.00% perf [kernel.vmlinux] [k] __lruvec_stat_mod_folio
0.00% bench [kernel.vmlinux] [k] kernfs_fop_read_iter
0.00% bench [kernel.vmlinux] [k] __mod_zone_page_state
0.00% kworker/2:2-eve [kernel.vmlinux] [k] delay_halt
0.00% perf [kernel.vmlinux] [k] __mod_memcg_lruvec_state
0.00% perf [kernel.vmlinux] [k] xas_load
0.00% perf [kernel.vmlinux] [k] workingset_update_node
0.00% perf [kernel.vmlinux] [k] _raw_spin_unlock
0.00% swapper [kernel.vmlinux] [k] __handle_irq_event_percpu
0.00% kworker/2:2-eve [kernel.vmlinux] [k] post_alloc_hook
0.00% bench [kernel.vmlinux] [k] refill_obj_stock
0.00% perf [kernel.vmlinux] [k] __alloc_pages_noprof
0.00% swapper [kernel.vmlinux] [k] cpuidle_enter
0.00% swapper [kernel.vmlinux] [k] sched_balance_domains
0.00% perf [kernel.vmlinux] [k] __handle_mm_fault
0.00% swapper [kernel.vmlinux] [k] ct_kernel_enter.constprop.0
0.00% bench [kernel.vmlinux] [k] mab_mas_cp
0.00% swapper [amdgpu] [k] 0x00000000004619a7
0.00% swapper [kernel.vmlinux] [k] tick_nohz_irq_exit
0.00% perf [kernel.vmlinux] [k] __memcg_slab_post_alloc_hook
0.00% bench [kernel.vmlinux] [k] __alloc_pages_noprof
0.00% swapper [kernel.vmlinux] [k] irq_exit_rcu
0.00% bench [kernel.vmlinux] [k] memcmp
0.00% swapper [kernel.vmlinux] [k] asm_sysvec_call_function
0.00% perf [kernel.vmlinux] [k] perf_poll
0.00% swapper [kernel.vmlinux] [k] enqueue_task_fair
0.00% bench [kernel.vmlinux] [k] __rmqueue_pcplist
0.00% kworker/u65:4-e [kernel.vmlinux] [k] __iommu_map
0.00% kworker/6:1-eve [amdgpu] [k] 0x0000000000992cd2
0.00% kworker/6:1-eve [amdgpu] [k] 0x00000000004b2ade
0.00% swapper [kernel.vmlinux] [k] wakeup_preempt
0.00% migration/11 [kernel.vmlinux] [k] enqueue_task
0.00% swapper [kernel.vmlinux] [k] hrtimer_update_next_event
0.00% swapper [kernel.vmlinux] [k] native_apic_mem_eoi
0.00% bench [kernel.vmlinux] [k] is_sync_callback_calling_insn
0.00% kworker/6:1-eve [amdgpu] [k] 0x0000000000992cb3
0.00% systemd-network libc.so.6 [.] clock_gettime
0.00% kworker/u65:4-e [kernel.vmlinux] [k] filemap_get_folios_tag
0.00% kworker/u65:4-e [kernel.vmlinux] [k] fscrypt_mergeable_bio_bh
0.00% swapper [kernel.vmlinux] [k] hrtimer_start_range_ns
0.00% multipathd [kernel.vmlinux] [k] cpuacct_charge
0.00% swapper [kernel.vmlinux] [k] hrtimer_get_next_event
0.00% kworker/12:1-ev [amdgpu] [k] 0x00000000004b09fc
0.00% kworker/12:1-ev [kernel.vmlinux] [k] memcpy_orig
0.00% kworker/u65:4-e [kernel.vmlinux] [k] wbt_track
0.00% kworker/u65:4-e [kernel.vmlinux] [k] __lruvec_stat_mod_folio
0.00% kworker/12:1-ev [amdgpu] [k] 0x0000000000002f75
0.00% bench [kernel.vmlinux] [k] do_jit
0.00% kworker/u65:4-e [kernel.vmlinux] [k] __folio_start_writeback
0.00% bench [kernel.vmlinux] [k] uncharge_folio
0.00% perf [kernel.vmlinux] [k] do_fault
0.00% perf [kernel.vmlinux] [k] __kmalloc_noprof
0.00% containerd [kernel.vmlinux] [k] blkcg_maybe_throttle_current
0.00% kworker/12:1-ev [amdgpu] [k] 0x0000000000523901
0.00% kworker/12:1-ev [amdgpu] [k] 0x0000000000538414
0.00% kworker/2:2-eve [amdgpu] [k] 0x0000000000465f98
0.00% irqbalance [kernel.vmlinux] [k] format_decode
0.00% swapper [kernel.vmlinux] [k] handle_edge_irq
0.00% kworker/12:1-ev [kernel.vmlinux] [k] srso_untrain_ret
0.00% kworker/u65:4-e [kernel.vmlinux] [k] __find_get_block
0.00% systemd-journal [kernel.vmlinux] [k] __put_user_nocheck_4
0.00% systemd-journal libsystemd-shared-249.so [.] 0x00000000001c9c3e
0.00% swapper [kernel.vmlinux] [k] local_touch_nmi
0.00% bench [kernel.vmlinux] [k] __mem_cgroup_uncharge_folios
0.00% swapper [kernel.vmlinux] [k] _raw_spin_lock
0.00% swapper [kernel.vmlinux] [k] select_task_rq_fair
0.00% swapper [kernel.vmlinux] [k] need_update
0.00% bench [kernel.vmlinux] [k] rcu_segcblist_enqueue
0.00% swapper [kernel.vmlinux] [k] tick_nohz_get_sleep_length
0.00% containerd [kernel.vmlinux] [k] _raw_spin_unlock
0.00% containerd [kernel.vmlinux] [k] ep_autoremove_wake_function
0.00% kworker/u66:1-e [kernel.vmlinux] [k] __percpu_counter_sum
0.00% swapper [kernel.vmlinux] [k] ktime_get_mono_fast_ns
0.00% swapper [kernel.vmlinux] [k] sysvec_apic_timer_interrupt
0.00% swapper [kernel.vmlinux] [k] _raw_spin_unlock_irqrestore
0.00% migration/10 [kernel.vmlinux] [k] dequeue_entity
0.00% swapper [kernel.vmlinux] [k] handle_irq_event
0.00% perf [kernel.vmlinux] [k] srso_return_thunk
0.00% perf [kernel.vmlinux] [k] xas_find_conflict
0.00% perf-exec [kernel.vmlinux] [k] mas_next_slot
0.00% swapper [kernel.vmlinux] [k] fetch_next_timer_interrupt.constprop.0
0.00% bench [kernel.vmlinux] [k] get_page_from_freelist
0.00% swapper [amdgpu] [k] 0x0000000000125079
0.00% kworker/u65:4-e [kernel.vmlinux] [k] sched_balance_newidle
0.00% migration/6 [kernel.vmlinux] [k] raw_spin_rq_unlock
0.00% kworker/2:2-eve [amdgpu] [k] 0x0000000000444a05
0.00% swapper [kernel.vmlinux] [k] fetch_pte
0.00% perf [kernel.vmlinux] [k] __pte_offset_map
0.00% kworker/2:2-eve [amdgpu] [k] 0x0000000000534985
0.00% kworker/2:2-eve [amdgpu] [k] 0x0000000000003ac5
0.00% bench [kernel.vmlinux] [k] perf_iterate_sb
0.00% swapper [kernel.vmlinux] [k] get_cpu_device
0.00% perf [kernel.vmlinux] [k] xas_start
0.00% kworker/2:2-eve [amdgpu] [k] 0x000000000098fea5
0.00% perf [kernel.vmlinux] [k] mark_buffer_dirty
0.00% containerd containerd [.] runtime.cleantimers
0.00% bench [kernel.vmlinux] [k] __cond_resched
0.00% kworker/2:2-eve [drm_kms_helper] [k] 0x00000000000008eb
0.00% kworker/2:2-eve [raid6_pq] [k] 0x000000000000c24b
0.00% kworker/2:2-eve [amdgpu] [k] 0x000000000064ea79
0.00% perf [kernel.vmlinux] [k] cpu_util
0.00% swapper [kernel.vmlinux] [k] asm_common_interrupt
0.00% perf [kernel.vmlinux] [k] __filemap_add_folio
0.00% kworker/2:2-eve [amdgpu] [k] 0x00000000007d1eab
0.00% kworker/2:2-eve [amdgpu] [k] 0x000000000051a45f
0.00% perf [kernel.vmlinux] [k] ext4_es_lookup_extent
0.00% swapper [kernel.vmlinux] [k] __flush_smp_call_function_queue
0.00% kworker/2:2-eve [amdgpu] [k] 0x0000000000519af6
0.00% swapper [kernel.vmlinux] [k] refresh_cpu_vm_stats
0.00% kworker/2:2-eve [amdgpu] [k] 0x0000000000477759
0.00% perf-exec [kernel.vmlinux] [k] kmem_cache_free
0.00% kworker/2:2-eve [amdgpu] [k] 0x0000000000539303
0.00% kworker/2:2-eve [drm] [k] 0x0000000000020c1c
0.00% swapper [kernel.vmlinux] [k] asm_sysvec_apic_timer_interrupt
0.00% bench [kernel.vmlinux] [k] alloc_pages_mpol_noprof
0.00% bench [kernel.vmlinux] [k] filemap_map_pages
0.00% kworker/2:2-eve [amdgpu] [k] 0x0000000000477767
0.00% swapper [kernel.vmlinux] [k] update_load_avg
0.00% kworker/2:2-eve [amdgpu] [k] 0x000000000045d3d6
0.00% kworker/2:2-eve [amdgpu] [k] 0x000000000051d905
0.00% kworker/2:2-eve [drm_kms_helper] [k] 0x0000000000004ae8
0.00% kworker/u65:2-e [kernel.vmlinux] [k] __mod_memcg_lruvec_state
0.00% kworker/u65:2-e [kernel.vmlinux] [k] bio_associate_blkg
0.00% kworker/2:2-eve [amdgpu] [k] 0x00000000004916dd
0.00% kworker/2:2-eve [amdgpu] [k] 0x0000000000465ecb
0.00% kworker/2:2-eve [amdgpu] [k] 0x00000000004b780a
0.00% swapper [kernel.vmlinux] [k] sysvec_call_function
0.00% kworker/2:2-eve [amdgpu] [k] 0x000000000051e764
0.00% kworker/2:2-eve [amdgpu] [k] 0x000000000064ed72
0.00% kworker/2:2-eve [amdgpu] [k] 0x000000000051c7bf
0.00% kworker/2:2-eve [amdgpu] [k] 0x000000000064ebe0
0.00% kworker/2:2-eve [amdgpu] [k] 0x0000000000523fba
0.00% kworker/2:2-eve [amdgpu] [k] 0x0000000000832660
0.00% swapper [kernel.vmlinux] [k] acpi_idle_do_entry
0.00% kworker/2:2-eve [amdgpu] [k] 0x000000000097ddfc
0.00% kworker/2:2-eve [amdgpu] [k] 0x000000000045d334
0.00% kworker/u65:2-e [kernel.vmlinux] [k] soft_cursor
0.00% perf [kernel.vmlinux] [k] sched_balance_rq
0.00% kworker/u65:2-e [kernel.vmlinux] [k] __fprop_add_percpu
0.00% swapper [kernel.vmlinux] [k] rb_next
0.00% kworker/2:2-eve [amdgpu] [k] 0x0000000000977ece
0.00% perf [kernel.vmlinux] [k] __folio_mark_dirty
0.00% perf [kernel.vmlinux] [k] filemap_alloc_folio_noprof
0.00% perf [kernel.vmlinux] [k] get_mem_cgroup_from_mm
0.00% perf [kernel.vmlinux] [k] ext4_da_reserve_space
0.00% perf [kernel.vmlinux] [k] read_hpet
0.00% kworker/2:2-eve [amdgpu] [k] 0x000000000051cd3e
0.00% kworker/2:2-eve [amdgpu] [k] 0x0000000000532f0f
0.00% kworker/2:2-eve [kernel.vmlinux] [k] __mod_node_page_state
0.00% systemd-journal [kernel.vmlinux] [k] mod_objcg_state
0.00% jbd2/dm-0-8 [kernel.vmlinux] [k] dm_submit_bio
0.00% kworker/2:2-eve [amdgpu] [k] 0x0000000000517b6d
0.00% kcompactd0 [kernel.vmlinux] [k] idle_cpu
0.00% kworker/2:2-eve [kernel.vmlinux] [k] free_tail_page_prepare
0.00% swapper [amdgpu] [k] 0x00000000002f7f65
0.00% swapper [kernel.vmlinux] [k] tick_program_event
0.00% containerd [kernel.vmlinux] [k] psi_group_change
0.00% kworker/2:2-eve [amdgpu] [k] 0x000000000053776f
0.00% swapper [kernel.vmlinux] [k] srso_return_thunk
0.00% perf [kernel.vmlinux] [k] ext4_claim_free_clusters
0.00% perf [kernel.vmlinux] [k] generic_perform_write
0.00% perf [kernel.vmlinux] [k] mem_cgroup_commit_charge
0.00% perf [kernel.vmlinux] [k] file_modified
0.00% kworker/2:2-eve [amdgpu] [k] 0x000000000051e779
0.00% kworker/2:2-eve [amdgpu] [k] 0x000000000053974c
0.00% perf [kernel.vmlinux] [k] ext4_da_write_begin
0.00% perf [kernel.vmlinux] [k] filemap_add_folio
0.00% perf libc.so.6 [.] write
0.00% perf [kernel.vmlinux] [k] __es_remove_extent
0.00% kworker/2:2-eve [amdgpu] [k] 0x000000000052244a
0.00% swapper [kernel.vmlinux] [k] ct_nmi_exit
0.00% kworker/2:2-eve [amdgpu] [k] 0x000000000034bee5
0.00% kworker/2:2-eve [kernel.vmlinux] [k] __rcu_read_lock
0.00% perf [kernel.vmlinux] [k] __dquot_alloc_space
0.00% swapper [kernel.vmlinux] [k] native_read_msr
0.00% perf [kernel.vmlinux] [k] folio_unlock
0.00% perf [kernel.vmlinux] [k] radix_tree_node_ctor
0.00% kworker/2:2-eve [amdgpu] [k] 0x00000000006c5b82
0.00% kworker/2:2-eve [amdgpu] [k] 0x0000000000527259
0.00% perf [kernel.vmlinux] [k] __mod_node_page_state
0.00% perf [kernel.vmlinux] [k] __radix_tree_lookup
0.00% kworker/u65:2-e [kernel.vmlinux] [k] __rcu_read_unlock
0.00% perf [kernel.vmlinux] [k] ext4_get_reserved_space
0.00% swapper [kernel.vmlinux] [k] hrtimer_cancel
0.00% kworker/2:2-eve [amdgpu] [k] 0x00000000004ba8ce
0.00% swapper [amdgpu] [k] 0x0000000000126f3a
0.00% perf perf [.] perf_cpu_map__idx
0.00% swapper [kernel.vmlinux] [k] sched_balance_update_blocked_averages
0.00% systemd-journal [kernel.vmlinux] [k] do_timerfd_settime
0.00% kworker/2:2-eve [amdgpu] [k] 0x000000000097ddc5
0.00% kworker/2:2-eve [amdgpu] [k] 0x000000000097e5a4
0.00% perf [kernel.vmlinux] [k] folio_batch_move_lru
0.00% swapper [amdgpu] [k] 0x000000000046f8a5
0.00% perf [kernel.vmlinux] [k] xas_nomem
0.00% kworker/2:2-eve [amdgpu] [k] 0x000000000051d24c
0.00% kworker/2:2-eve [amdgpu] [k] 0x000000000097df7c
0.00% tuned [kernel.vmlinux] [k] psi_task_switch
0.00% swapper [kernel.vmlinux] [k] __dequeue_entity
0.00% swapper [amdgpu] [k] 0x00000000006e7c5d
0.00% swapper [kernel.vmlinux] [k] rcu_preempt_deferred_qs
0.00% kworker/7:1-eve [kernel.vmlinux] [k] __free_one_page
0.00% swapper [kernel.vmlinux] [k] memchr_inv
0.00% perf [kernel.vmlinux] [k] psi_task_switch
0.00% swapper [kernel.vmlinux] [k] _nohz_idle_balance.isra.0
0.00% kworker/2:2-eve [amdgpu] [k] 0x00000000009a6fbd
0.00% swapper [kernel.vmlinux] [k] acpi_idle_enter
0.00% kworker/2:2-eve [amdgpu] [k] 0x0000000000456a9f
0.00% kworker/2:2-eve [amdgpu] [k] 0x00000000004ac642
0.00% kworker/2:2-eve [amdgpu] [k] 0x0000000000477888
0.00% kworker/2:2-eve [amdgpu] [k] 0x0000000000529a52
0.00% kworker/2:2-eve [amdgpu] [k] 0x00000000004b36d2
0.00% kworker/2:2-eve [amdgpu] [k] 0x0000000000525b33
0.00% swapper [kernel.vmlinux] [k] tmigr_active_up
0.00% kworker/2:2-eve [amdgpu] [k] 0x0000000000452444
0.00% swapper [amdgpu] [k] 0x000000000046f865
0.00% swapper [kernel.vmlinux] [k] next_timer_interrupt
0.00% kworker/6:1-eve [kernel.vmlinux] [k] __free_pages_ok
0.00% perf [kernel.vmlinux] [k] exc_page_fault
0.00% swapper [kernel.vmlinux] [k] __schedule
0.00% irqbalance [kernel.vmlinux] [k] __kmalloc_cache_noprof
0.00% swapper [kernel.vmlinux] [k] cpuidle_not_available
0.00% containerd [kernel.vmlinux] [k] pick_next_task_fair
0.00% kworker/6:1-eve [amdgpu] [k] 0x00000000009a70b7
0.00% swapper [kernel.vmlinux] [k] tick_nohz_next_event
0.00% swapper [kernel.vmlinux] [k] tick_check_oneshot_broadcast_this_cpu
0.00% swapper [kernel.vmlinux] [k] irq_chip_ack_parent
0.00% irqbalance [kernel.vmlinux] [k] show_stat
0.00% kworker/2:2-eve [amdgpu] [k] 0x00000000004b8295
0.00% swapper [amdgpu] [k] 0x000000000045d385
0.00% swapper [kernel.vmlinux] [k] tick_nohz_idle_stop_tick
0.00% containerd [kernel.vmlinux] [k] __schedule
0.00% swapper [kernel.vmlinux] [k] switch_mm_irqs_off
0.00% swapper [amdgpu] [k] 0x0000000000461a21
0.00% kworker/6:1-eve [amdgpu] [k] 0x000000000051d7c2
0.00% swapper [kernel.vmlinux] [k] try_to_wake_up
0.00% kworker/2:2-eve [amdgpu] [k] 0x000000000051e7cf
0.00% kworker/2:2-eve [amdgpu] [k] 0x000000000064ed4e
0.00% perf [kernel.vmlinux] [k] perf_mmap_to_page
0.00% migration/7 [kernel.vmlinux] [k] update_sd_lb_stats.constprop.0
0.00% irqbalance [kernel.vmlinux] [k] __rcu_read_lock
0.00% migration/3 [kernel.vmlinux] [k] __update_load_avg_cfs_rq
0.00% swapper [br_netfilter] [k] 0x0000000000000775
0.00% bench [kernel.vmlinux] [k] remove_vma
0.00% swapper [kernel.vmlinux] [k] sched_clock_noinstr
0.00% kworker/6:1-eve [amdgpu] [k] 0x0000000000529169
0.00% swapper [amdgpu] [k] 0x000000000000df07
0.00% swapper [kernel.vmlinux] [k] __switch_to
0.00% swapper [kernel.vmlinux] [k] place_entity
0.00% kworker/6:1-eve [amdgpu] [k] 0x000000000097dd9a
0.00% swapper [amdgpu] [k] 0x00000000006e7c5a
0.00% irqbalance [kernel.vmlinux] [k] __rcu_read_unlock
0.00% migration/6 [kernel.vmlinux] [k] enqueue_entity
0.00% swapper [kernel.vmlinux] [k] __update_load_avg_cfs_rq
0.00% perf [kernel.vmlinux] [k] event_function
0.00% perf [kernel.vmlinux] [k] do_user_addr_fault
0.00% kworker/2:2-eve [amdgpu] [k] 0x000000000064eaee
0.00% migration/4 [kernel.vmlinux] [k] __update_load_avg_cfs_rq
0.00% swapper [amdgpu] [k] 0x00000000006e79ff
0.00% containerd [kernel.vmlinux] [k] schedule_hrtimeout_range_clock
0.00% irqbalance [kernel.vmlinux] [k] security_file_open
0.00% perf [kernel.vmlinux] [k] _find_next_and_bit
0.00% multipathd [kernel.vmlinux] [k] __rseq_handle_notify_resume
0.00% swapper [kernel.vmlinux] [k] __x86_indirect_thunk_r12
0.00% swapper [kernel.vmlinux] [k] rcu_note_context_switch
0.00% bench [kernel.vmlinux] [k] free_unref_folios
0.00% migration/0 [kernel.vmlinux] [k] migration_cpu_stop
0.00% migration/1 [kernel.vmlinux] [k] rcu_note_context_switch
0.00% kworker/u66:1-e [kernel.vmlinux] [k] n_tty_receive_buf2
0.00% swapper [kernel.vmlinux] [k] __common_interrupt
0.00% swapper [drm] [k] 0x000000000003d658
0.00% migration/5 [kernel.vmlinux] [k] psi_group_change
0.00% swapper [kernel.vmlinux] [k] clockevents_program_event
0.00% swapper [kernel.vmlinux] [k] __x86_indirect_thunk_array
0.00% perf [kernel.vmlinux] [k] set_pte_range
0.00% perf [kernel.vmlinux] [k] __schedule
0.00% swapper [kernel.vmlinux] [k] __update_load_avg_se
0.00% swapper [kernel.vmlinux] [k] asm_sysvec_reschedule_ipi
0.00% swapper [kernel.vmlinux] [k] local_clock_noinstr
0.00% swapper [kernel.vmlinux] [k] tick_nohz_stop_idle
0.00% swapper [amdgpu] [k] 0x000000000044a039
0.00% kworker/4:1-mm_ [kernel.vmlinux] [k] native_queued_spin_lock_slowpath
0.00% rcu_preempt [kernel.vmlinux] [k] __update_idle_core
0.00% rcu_preempt [kernel.vmlinux] [k] pick_next_task_fair
0.00% rcu_preempt [kernel.vmlinux] [k] prepare_to_swait_event
0.00% rcu_preempt [kernel.vmlinux] [k] sched_balance_rq
0.00% rcu_preempt [kernel.vmlinux] [k] update_rq_clock
0.00% rs:main Q:Reg [kernel.vmlinux] [k] ext4_inode_csum
0.00% swapper [kernel.vmlinux] [k] tmigr_inactive_up
0.00% swapper [kernel.vmlinux] [k] hrtimer_forward
0.00% swapper [kernel.vmlinux] [k] cpuidle_reflect
0.00% perf [kernel.vmlinux] [k] percpu_counter_add_batch
0.00% swapper [amdgpu] [k] 0x000000000031e745
0.00% swapper [kernel.vmlinux] [k] sched_idle_set_state
0.00% kworker/6:1-eve [amdgpu] [k] 0x000000000045675c
0.00% kworker/6:1-eve [amdgpu] [k] 0x000000000051cbb1
0.00% swapper [amdgpu] [k] 0x000000000002dce5
0.00% systemd-journal [kernel.vmlinux] [k] __ext4_ext_check
0.00% swapper [kernel.vmlinux] [k] sched_core_idle_cpu
0.00% swapper [drm] [k] 0x000000000003de52
0.00% swapper [kernel.vmlinux] [k] __msecs_to_jiffies
0.00% swapper [amdgpu] [k] 0x000000000046f9c4
0.00% swapper [kernel.vmlinux] [k] call_cpuidle
0.00% swapper [kernel.vmlinux] [k] cpuidle_governor_latency_req
0.00% kworker/7:1-eve [kernel.vmlinux] [k] __switch_to_asm
0.00% dockerd [kernel.vmlinux] [k] apparmor_file_permission
0.00% swapper [amdgpu] [k] 0x0000000000126f37
0.00% swapper [amdgpu] [k] 0x00000000003218b6
0.00% swapper [amdgpu] [k] 0x00000000006e8d65
0.00% swapper [amdgpu] [k] 0x000000000096f62d
0.00% systemd-journal [kernel.vmlinux] [k] __es_tree_search.isra.0
0.00% swapper [kernel.vmlinux] [k] update_group_capacity
0.00% kworker/2:2-eve [amdgpu] [k] 0x00000000005225c3
0.00% kworker/2:2-eve [amdgpu] [k] 0x0000000000990c4f
0.00% swapper [kernel.vmlinux] [k] timer_base_try_to_set_idle
0.00% swapper [kernel.vmlinux] [k] ct_idle_exit
0.00% swapper [kernel.vmlinux] [k] __x86_indirect_thunk_rbx
0.00% swapper [kernel.vmlinux] [k] fast_mix
0.00% swapper [kernel.vmlinux] [k] sched_clock_idle_sleep_event
0.00% swapper [kernel.vmlinux] [k] touch_softlockup_watchdog_sched
0.00% containerd [kernel.vmlinux] [k] psi_task_switch
0.00% swapper [amdgpu] [k] 0x0000000000123820
0.00% swapper [kernel.vmlinux] [k] sched_clock
0.00% swapper [amdgpu] [k] 0x00000000002f46a5
0.00% swapper [amdgpu] [k] 0x0000000000449ff5
0.00% containerd [kernel.vmlinux] [k] _copy_to_user
0.00% swapper [kernel.vmlinux] [k] enqueue_task
0.00% swapper [amdgpu] [k] 0x000000000096f625
0.00% swapper [amdgpu] [k] 0x00000000006e7c66
0.00% swapper [kernel.vmlinux] [k] hrtimer_interrupt
0.00% swapper [kernel.vmlinux] [k] irq_enter_rcu
0.00% perf [kernel.vmlinux] [k] _raw_spin_lock_irqsave
0.00% perf [kernel.vmlinux] [k] poll_freewait
0.00% rcu_preempt [kernel.vmlinux] [k] __rcu_read_lock
0.00% swapper [kernel.vmlinux] [k] wake_q_add
0.00% kworker/7:1H-kb [kernel.vmlinux] [k] __switch_to_asm
0.00% swapper [amdgpu] [k] 0x00000000002f8058
0.00% swapper [kernel.vmlinux] [k] sched_clock_tick
0.00% swapper [kernel.vmlinux] [k] slab_update_freelist.constprop.0.isra.0
0.00% swapper [kernel.vmlinux] [k] tick_nohz_get_next_hrtimer
0.00% swapper [kernel.vmlinux] [k] ct_kernel_enter_state
0.00% swapper [kernel.vmlinux] [k] hrtimer_next_event_without
0.00% swapper [kernel.vmlinux] [k] resched_curr
0.00% swapper [amdgpu] [k] 0x0000000000003a55
0.00% swapper [amdgpu] [k] 0x000000000045d3df
0.00% swapper [amdgpu] [k] 0x000000000098aeb9
0.00% containerd [kernel.vmlinux] [k] __switch_to
0.00% swapper [kernel.vmlinux] [k] rcu_sched_clock_irq
0.00% kworker/9:1-eve [kernel.vmlinux] [k] sched_clock_cpu
0.00% swapper [amdgpu] [k] 0x0000000000124ef5
0.00% containerd [kernel.vmlinux] [k] update_curr
0.00% swapper [drm] [k] 0x0000000000035f4e
0.00% swapper [kernel.vmlinux] [k] tmigr_update_events
0.00% swapper [kernel.vmlinux] [k] profile_pc
0.00% swapper [nvme] [k] 0x0000000000004315
0.00% swapper [kernel.vmlinux] [k] raw_spin_rq_unlock
0.00% containerd [kernel.vmlinux] [k] posix_get_monotonic_timespec
0.00% swapper [amdgpu] [k] 0x0000000000002f4b
0.00% swapper [amdgpu] [k] 0x000000000034bf25
0.00% perf [kernel.vmlinux] [k] get_page_from_freelist
0.00% rcu_preempt [kernel.vmlinux] [k] __mod_timer
0.00% perf [kernel.vmlinux] [k] mutex_unlock
0.00% swapper [amdgpu] [k] 0x0000000000460f85
0.00% swapper [amdgpu] [k] 0x0000000000977ec5
0.00% swapper [amdgpu] [k] 0x0000000000977ed6
0.00% swapper [kernel.vmlinux] [k] sched_clock_idle_wakeup_event
0.00% swapper [amdgpu] [k] 0x0000000000124016
0.00% swapper [kernel.vmlinux] [k] pick_next_task_fair
0.00% swapper [raid6_pq] [k] 0x000000000001acf5
0.00% swapper [amdgpu] [k] 0x0000000000977ec6
0.00% systemd-journal [kernel.vmlinux] [k] security_inode_setattr
0.00% swapper [kernel.vmlinux] [k] __sysvec_apic_timer_interrupt
0.00% swapper [amdgpu] [k] 0x0000000000461985
0.00% swapper [amdgpu] [k] 0x0000000000123825
0.00% swapper [amdgpu] [k] 0x0000000000126ee9
0.00% swapper [amdgpu] [k] 0x000000000096f6cd
0.00% perf [kernel.vmlinux] [k] do_syscall_64
0.00% systemd-journal [kernel.vmlinux] [k] unmap_mapping_range
0.00% systemd-journal libc.so.6 [.] 0x0000000000090a64
0.00% containerd [kernel.vmlinux] [k] dequeue_entity
0.00% systemd-journal [kernel.vmlinux] [k] dax_layout_busy_page
0.00% swapper [kernel.vmlinux] [k] apic_ack_irq
0.00% swapper [drm] [k] 0x000000000003d83b
0.00% containerd [kernel.vmlinux] [k] __futex_queue
0.00% swapper [kernel.vmlinux] [k] complete_all
0.00% swapper [amdgpu] [k] 0x000000000098b0d6
0.00% swapper [kernel.vmlinux] [k] can_stop_idle_tick
0.00% swapper [amdgpu] [k] 0x000000000000dee5
0.00% swapper [amdgpu] [k] 0x000000000044ecef
0.00% swapper [amdgpu] [k] 0x000000000000dee6
0.00% migration/14 [kernel.vmlinux] [k] update_curr_common
0.00% rs:main Q:Reg [kernel.vmlinux] [k] ext4_get_group_desc
0.00% swapper [kernel.vmlinux] [k] tick_do_update_jiffies64
0.00% swapper [kernel.vmlinux] [k] tmigr_cpu_new_timer
0.00% kworker/7:1-eve [kernel.vmlinux] [k] free_pcppages_bulk
0.00% dockerd [kernel.vmlinux] [k] srso_untrain_ret
0.00% dockerd [kernel.vmlinux] [k] update_curr
0.00% swapper [amdgpu] [k] 0x0000000000124f0c
0.00% swapper [drm] [k] 0x000000000003f455
0.00% swapper [amdgpu] [k] 0x00000000003218b5
0.00% swapper [kernel.vmlinux] [k] ct_irq_enter
0.00% swapper [kernel.vmlinux] [k] ct_irq_exit
0.00% swapper [kernel.vmlinux] [k] blk_stat_add
0.00% swapper [amdgpu] [k] 0x00000000006e8dd0
0.00% swapper [amdgpu] [k] 0x0000000000124f4c
0.00% swapper [amdgpu] [k] 0x000000000098aef6
0.00% swapper [drm] [k] 0x000000000003f468
0.00% swapper [kernel.vmlinux] [k] nohz_balance_enter_idle
0.00% swapper [kernel.vmlinux] [k] __wake_up_common
0.00% swapper [amdgpu] [k] 0x00000000001240ea
0.00% swapper [kernel.vmlinux] [k] __wake_up
0.00% swapper [amdgpu] [k] 0x00000000002f7f81
0.00% swapper [amdgpu] [k] 0x000000000046f97f
0.00% swapper [drm] [k] 0x000000000003f45c
0.00% swapper [kernel.vmlinux] [k] __mod_memcg_lruvec_state
0.00% swapper [kernel.vmlinux] [k] mempool_free_slab
0.00% swapper [amdgpu] [k] 0x0000000000977ef0
0.00% swapper [kernel.vmlinux] [k] x86_pmu_disable_all
0.00% swapper [amdgpu] [k] 0x00000000002f7f71
0.00% kworker/3:1H-kb [kernel.vmlinux] [k] read_hpet
0.00% swapper [kernel.vmlinux] [k] psi_task_change
0.00% swapper [kernel.vmlinux] [k] perf_adjust_freq_unthr_context
0.00% swapper [kernel.vmlinux] [k] account_idle_ticks
0.00% swapper [amdgpu] [k] 0x000000000045d365
0.00% swapper [kernel.vmlinux] [k] ttwu_do_activate
0.00% swapper [raid6_pq] [k] 0x000000000001acc5
0.00% swapper [kernel.vmlinux] [k] enqueue_entity
0.00% wpa_supplicant [kernel.vmlinux] [k] read_hpet
0.00% swapper [amdgpu] [k] 0x0000000000012205
0.00% swapper [drm] [k] 0x000000000003d649
0.00% containerd [kernel.vmlinux] [k] __update_load_avg_se
0.00% rs:main Q:Reg [kernel.vmlinux] [k] futex_wake
0.00% swapper [kernel.vmlinux] [k] __x86_indirect_thunk_r13
0.00% swapper [kernel.vmlinux] [k] sched_balance_softirq
0.00% swapper [kernel.vmlinux] [k] timerqueue_del
0.00% swapper [kernel.vmlinux] [k] cpu_util
#
# (Tip: Limit to show entries above 5% only: perf report --percent-limit 5) #
Masami Hiramatsu (Google)
maintainerQuoted 134 lines · On Wed, 11 Sep 2024 20:27:27 +0200 Jiri Olsa <[email protected]> wrote:
Quoted 90 lines · Masami Hiramatsu (Google)
Hi,
Here is the 13th version of the series to re-implement the fprobe on function-graph tracer. The previous version is;
https://lore.kernel.org/all/172000134410.63468.13742222887213469474.stgit@devnote2/
This version is based on v6.11-rc3.
In this version, I added a bugfix as [1/20], which should go to urgent branch, and dropped the performance improvement patch which was introduced in v12 because I found that does not work with new kernel.Overview
--------
This series rewrites the fprobe on this function-graph. The purposes of this change are;1) Remove dependency of the rethook from fprobe so that we can reduce the return hook code and shadow stack.
2) Make '
ftrace_regs' the common trace interface for the function boundary.1) Currently we have 2(or 3) different function return hook codes, the function-graph tracer and rethook (and legacy kretprobe). But since this is redundant and needs double maintenance cost, I would like to unify those. From the user's viewpoint, function- graph tracer is very useful to grasp the execution path. For this purpose, it is hard to use the rethook in the function-graph tracer, but the opposite is possible. (Strictly speaking, kretprobe can not use it because it requires '
pt_regs' for historical reasons.)2) Now the fprobe provides the '
pt_regs' for its handler, but that is wrong for the function entry and exit. Moreover, depending on the architecture, there is no way to accurately reproduce 'pt_regs' outside of interrupt or exception handlers. This means fprobe should not use 'pt_regs' because it does not use such exceptions. (Conversely, kprobe should use 'pt_regs' because it is an abstract interface of the software breakpoint exception.)This series changes fprobe to use function-graph tracer for tracing function entry and exit, instead of mixture of ftrace and rethook. Unlike the rethook which is a per-task list of system-wide allocated nodes, the function graph's
ret_stackis a per-task shadow stack. Thus it does not need to set 'nr_maxactive' (which is the number of pre-allocated nodes).
Also the handlers will get the 'ftrace_regs' instead of 'pt_regs'. Since eBPF mulit_kprobe/multi_kretprobe events still use 'pt_regs' as their register interface, this changes it to convert 'ftrace_regs' to 'pt_regs'. Of course this conversion makes an incomplete 'pt_regs', so users must access only registers for function parameters or return value.Design
------
Instead of using ftrace's function entry hook directly, the new fprobe is built on top of the function-graph's entry and return callbacks with 'ftrace_regs'.Since the fprobe requires access to '
ftrace_regs', the architecture must supportCONFIG_HAVE_DYNAMIC_FTRACE_WITH_ARGSandCONFIG_HAVE_FTRACE_GRAPH_FUNC, which enables to call function-graph entry callback with 'ftrace_regs', and alsoCONFIG_HAVE_FUNCTION_GRAPH_FREGS, which passes theftrace_regstoreturn_to_handler.All fprobes share a single function-graph ops (means shares a common ftrace filter) similar to the kprobe-on-ftrace. This needs another layer to find corresponding fprobe in the common function-graph callbacks, but has much better scalability, since the number of registered function-graph ops is limited.
In the entry callback, the fprobe runs its
entry_handlerand saves the address of 'fprobe' on the function-graph's shadow stack as data. The return callback decodes the data to get the 'fprobe' address, and runs theexit_handler.The fprobe introduces two hash-tables, one is for entry callback which searches fprobes related to the given function address passed by entry callback. The other is for a return callback which checks if the given 'fprobe' data structure pointer is still valid. Note that it is possible to unregister fprobe before the return callback runs. Thus the address validation must be done before using it in the return callback.
Download
--------
This series can be applied against the ftrace/for-next branch in linux-trace tree.Quoted 7 lines
This series can also be found below branch.
https://git.kernel.org/pub/scm/linux/kernel/git/mhiramat/linux.git/log/?h=topic/fprobe-on-fgraph
Thank you,
---
hi,
I ran thekprobe_multibench and I'm seeing lower throughput numbers with new fprobe implementationbase (bpf-next/master)
root@amd:/home/jolsa/bpf-next/tools/testing/selftests/bpf# ./bench -w2 -d5 -a trig-kprobe-multi Setting up benchmark 'trig-kprobe-multi'... Benchmark 'trig-kprobe-multi' started. Iter 0 ( 70.969us): hits 8.530M/s ( 8.530M/prod), drops 0.000M/s, total operations 8.530M/s Iter 1 (-24.985us): hits 8.541M/s ( 8.541M/prod), drops 0.000M/s, total operations 8.541M/s Iter 2 ( -2.976us): hits 8.537M/s ( 8.537M/prod), drops 0.000M/s, total operations 8.537M/s Iter 3 ( -1.502us): hits 8.540M/s ( 8.540M/prod), drops 0.000M/s, total operations 8.540M/s Iter 4 ( 0.392us): hits 8.540M/s ( 8.540M/prod), drops 0.000M/s, total operations 8.540M/s Iter 5 ( 1.308us): hits 8.545M/s ( 8.545M/prod), drops 0.000M/s, total operations 8.545M/s Iter 6 ( 2.783us): hits 8.530M/s ( 8.530M/prod), drops 0.000M/s, total operations 8.530M/s Iter 7 ( -3.775us): hits 8.535M/s ( 8.535M/prod), drops 0.000M/s, total operations 8.535M/s Summary: hits 8.538 ± 0.005M/s ( 8.538M/prod), drops 0.000 ± 0.000M/s, total operations 8.538 ± 0.005M/syour patchset on top of bpf-next/master
root@amd:/home/jolsa/bpf-next/tools/testing/selftests/bpf# ./bench -w2 -d5 -a trig-kprobe-multi Setting up benchmark 'trig-kprobe-multi'... Benchmark 'trig-kprobe-multi' started. Iter 0 ( 55.712us): hits 7.224M/s ( 7.224M/prod), drops 0.000M/s, total operations 7.224M/s Iter 1 ( 15.226us): hits 7.222M/s ( 7.222M/prod), drops 0.000M/s, total operations 7.222M/s Iter 2 ( -1.353us): hits 7.221M/s ( 7.221M/prod), drops 0.000M/s, total operations 7.221M/s Iter 3 (-13.029us): hits 7.223M/s ( 7.223M/prod), drops 0.000M/s, total operations 7.223M/s Iter 4 ( 9.111us): hits 7.222M/s ( 7.222M/prod), drops 0.000M/s, total operations 7.222M/s Iter 5 ( -0.106us): hits 7.222M/s ( 7.222M/prod), drops 0.000M/s, total operations 7.222M/s Iter 6 ( 0.734us): hits 7.221M/s ( 7.221M/prod), drops 0.000M/s, total operations 7.221M/s Iter 7 (-10.233us): hits 7.220M/s ( 7.220M/prod), drops 0.000M/s, total operations 7.220M/s Summary: hits 7.221 ± 0.001M/s ( 7.221M/prod), drops 0.000 ± 0.000M/s, total operations 7.221 ± 0.001M/s
Quoted 1 line
I did perf profile (attached), but nothing stands out on the first look,
Hm, we may need to compare both before and after, and need annotate in the code to find the bottleneck. Anyway, performance optimization can be done afterwards, so I'm not so worried it :)
Quoted 1 line
I'll try to check on that later this week
Thank you for your help!
Thanks,
Quoted 1,089 lines
jirka
---
# To display the perf.data header info, please use --header/--header-only options. #
#
# Total Lost Samples: 0
#
# Samples: 42K of event 'cycles:k'
# Event count (approx.): 44580427937
## Overhead Command Shared Object Symbol # ........ ............... .................................................... ........................................................#
17.47% bench [kernel.vmlinux] [k]find_kallsyms_symbol
|
---find_kallsyms_symbol
module_address_lookup
kallsyms_lookup_buildid
kallsyms_lookup
print_rec
t_show
seq_read_iter
seq_read
vfs_read
ksys_read
__x64_sys_read
x64_sys_call
do_syscall_64
entry_SYSCALL_64
read
011.71% bench [kernel.vmlinux] [k]
kprobe_multi_link_prog_run
|
---kprobe_multi_link_prog_run
|
--11.56%--kprobe_multi_link_handler
fprobe_entryfunction_graph_enter_regsftrace_graph_func0xffffffffc29850abbpf_get_numa_node_idbpf_prog_d9703036495d54b0_trigger_driver__bpf_prog_test_run_raw_tpbpf_prog_test_run_raw_tp__sys_bpf
__x64_sys_bpf
x64_sys_call
do_syscall_64entry_SYSCALL_64
syscallbpf_prog_test_run_optstrigger_producer_batch0x7a2a73a94ac37.65% bench [kernel.vmlinux] [k]
function_graph_enter_regs
|
---function_graph_enter_regs
|
--7.65%--ftrace_graph_func
0xffffffffc29850abbpf_get_numa_node_idbpf_prog_d9703036495d54b0_trigger_driver__bpf_prog_test_run_raw_tpbpf_prog_test_run_raw_tp__sys_bpf
__x64_sys_bpf
x64_sys_call
do_syscall_64entry_SYSCALL_64
syscallbpf_prog_test_run_optstrigger_producer_batch0x7a2a73a94ac37.55% bench [kernel.vmlinux] [k]
kprobe_multi_link_handler
|
---kprobe_multi_link_handler
|
|--4.35%--function_graph_enter_regs
|ftrace_graph_func
|0xffffffffc29850ab
|bpf_get_numa_node_id
|bpf_prog_d9703036495d54b0_trigger_driver
|__bpf_prog_test_run_raw_tp
|bpf_prog_test_run_raw_tp
|__sys_bpf
|__x64_sys_bpf
|x64_sys_call
|do_syscall_64
|entry_SYSCALL_64
| syscall
|bpf_prog_test_run_opts
|trigger_producer_batch
|0x7a2a73a94ac3
|
--3.20%--fprobe_entry
function_graph_enter_regsftrace_graph_func0xffffffffc29850abbpf_get_numa_node_idbpf_prog_d9703036495d54b0_trigger_driver__bpf_prog_test_run_raw_tpbpf_prog_test_run_raw_tp__sys_bpf
__x64_sys_bpf
x64_sys_call
do_syscall_64entry_SYSCALL_64
syscallbpf_prog_test_run_optstrigger_producer_batch0x7a2a73a94ac37.50% bench [kernel.vmlinux] [k]
fprobe_entry
|
---fprobe_entry
|
--7.50%--function_graph_enter_regs
ftrace_graph_func0xffffffffc29850abbpf_get_numa_node_idbpf_prog_d9703036495d54b0_trigger_driver__bpf_prog_test_run_raw_tpbpf_prog_test_run_raw_tp__sys_bpf
__x64_sys_bpf
x64_sys_call
do_syscall_64entry_SYSCALL_64
syscallbpf_prog_test_run_optstrigger_producer_batch0x7a2a73a94ac37.08% bench
bpf_prog_7790468e40a289ea_bench_trigger_kprobe_multi[k]bpf_prog_7790468e40a289ea_bench_trigger_kprobe_multi
| ---bpf_prog_7790468e40a289ea_bench_trigger_kprobe_multi
|
|--4.10%--kprobe_multi_link_handler
|fprobe_entry
|function_graph_enter_regs
|ftrace_graph_func
|0xffffffffc29850ab
|bpf_get_numa_node_id
|bpf_prog_d9703036495d54b0_trigger_driver
|__bpf_prog_test_run_raw_tp
|bpf_prog_test_run_raw_tp
|__sys_bpf
|__x64_sys_bpf
|x64_sys_call
|do_syscall_64
|entry_SYSCALL_64
| syscall
|bpf_prog_test_run_opts
|trigger_producer_batch
|0x7a2a73a94ac3
|
--2.97%--kprobe_multi_link_prog_run
kprobe_multi_link_handlerfprobe_entryfunction_graph_enter_regsftrace_graph_func0xffffffffc29850abbpf_get_numa_node_idbpf_prog_d9703036495d54b0_trigger_driver__bpf_prog_test_run_raw_tpbpf_prog_test_run_raw_tp__sys_bpf
__x64_sys_bpf
x64_sys_call
do_syscall_64
entry_SYSCALL_64
syscall
bpf_prog_test_run_optstrigger_producer_batch0x7a2a73a94ac36.11% bench [kernel.vmlinux] [k]
migrate_enable
|
---migrate_enable
|
|--3.37%--kprobe_multi_link_handler
|fprobe_entry
|function_graph_enter_regs
|ftrace_graph_func
|0xffffffffc29850ab
|bpf_get_numa_node_id
|bpf_prog_d9703036495d54b0_trigger_driver
|__bpf_prog_test_run_raw_tp
|bpf_prog_test_run_raw_tp
|__sys_bpf
|__x64_sys_bpf
|x64_sys_call
|do_syscall_64
|entry_SYSCALL_64
| syscall
|bpf_prog_test_run_opts
|trigger_producer_batch
|0x7a2a73a94ac3
|
--2.73%--kprobe_multi_link_prog_run
kprobe_multi_link_handlerfprobe_entryfunction_graph_enter_regsftrace_graph_func0xffffffffc29850abbpf_get_numa_node_idbpf_prog_d9703036495d54b0_trigger_driver__bpf_prog_test_run_raw_tpbpf_prog_test_run_raw_tp__sys_bpf
__x64_sys_bpf
x64_sys_call
do_syscall_64entry_SYSCALL_64
syscallbpf_prog_test_run_optstrigger_producer_batch0x7a2a73a94ac35.90% bench [kernel.vmlinux] [k]
ftrace_graph_func
|
---ftrace_graph_func
|
--5.75%--0xffffffffc29850ab
bpf_get_numa_node_idbpf_prog_d9703036495d54b0_trigger_driver__bpf_prog_test_run_raw_tpbpf_prog_test_run_raw_tp__sys_bpf
__x64_sys_bpf
x64_sys_call
do_syscall_64entry_SYSCALL_64
syscallbpf_prog_test_run_optstrigger_producer_batch0x7a2a73a94ac34.03% bench [kernel.vmlinux] [k]
__rcu_read_lock
|
---__rcu_read_lock
|
--4.00%--kprobe_multi_link_handler
fprobe_entryfunction_graph_enter_regsftrace_graph_func0xffffffffc29850abbpf_get_numa_node_idbpf_prog_d9703036495d54b0_trigger_driver__bpf_prog_test_run_raw_tpbpf_prog_test_run_raw_tp__sys_bpf
__x64_sys_bpf
x64_sys_call
do_syscall_64entry_SYSCALL_64
syscallbpf_prog_test_run_optstrigger_producer_batch0x7a2a73a94ac33.61% bench [kernel.vmlinux] [k]
bpf_get_numa_node_id
|
---bpf_get_numa_node_id
__bpf_prog_test_run_raw_tp
bpf_prog_test_run_raw_tp
__sys_bpf
__x64_sys_bpf
x64_sys_call
do_syscall_64
entry_SYSCALL_64
syscall
bpf_prog_test_run_opts
trigger_producer_batch
0x7a2a73a94ac32.99% bench [
nf_conntrack] [k]0x000000000002c0b3
|
---0xffffffffc29850b3
bpf_get_numa_node_idbpf_prog_d9703036495d54b0_trigger_driver__bpf_prog_test_run_raw_tpbpf_prog_test_run_raw_tp__sys_bpf
__x64_sys_bpf
x64_sys_call
do_syscall_64
entry_SYSCALL_64
syscall
bpf_prog_test_run_optstrigger_producer_batch0x7a2a73a94ac32.69% bench
bpf_prog_d9703036495d54b0_trigger_driver[k]bpf_prog_d9703036495d54b0_trigger_driver
| ---bpf_prog_d9703036495d54b0_trigger_driver
|
--2.68%--__bpf_prog_test_run_raw_tp
bpf_prog_test_run_raw_tp__sys_bpf__x64_sys_bpfx64_sys_calldo_syscall_64entry_SYSCALL_64syscallbpf_prog_test_run_optstrigger_producer_batch0x7a2a73a94ac32.04% bench [kernel.vmlinux] [k]
t_start
|
---t_start
seq_read_iter
seq_read
vfs_read
ksys_read
__x64_sys_read
x64_sys_call
do_syscall_64
entry_SYSCALL_64
read
01.90% bench [kernel.vmlinux] [k]
srso_untrain_ret
|
---srso_untrain_ret
|
|--0.68%--fprobe_entry
|function_graph_enter_regs
|ftrace_graph_func
|0xffffffffc29850ab
|bpf_get_numa_node_id
|bpf_prog_d9703036495d54b0_trigger_driver
|__bpf_prog_test_run_raw_tp
|bpf_prog_test_run_raw_tp
|__sys_bpf
|__x64_sys_bpf
|x64_sys_call
|do_syscall_64
|entry_SYSCALL_64
| syscall
|bpf_prog_test_run_opts
|trigger_producer_batch
|0x7a2a73a94ac3
|
--0.54%--seq_read_iter
seq_read
vfs_read
ksys_read
__x64_sys_read
x64_sys_call
do_syscall_64
entry_SYSCALL_64
read
01.14% bench [kernel.vmlinux] [k]
__rcu_read_unlock
|
---__rcu_read_unlock
|
--1.12%--kprobe_multi_link_handler
fprobe_entryfunction_graph_enter_regsftrace_graph_func0xffffffffc29850abbpf_get_numa_node_idbpf_prog_d9703036495d54b0_trigger_driver__bpf_prog_test_run_raw_tpbpf_prog_test_run_raw_tp__sys_bpf
__x64_sys_bpf
x64_sys_call
do_syscall_64entry_SYSCALL_64
syscallbpf_prog_test_run_optstrigger_producer_batch0x7a2a73a94ac31.02% bench [kernel.vmlinux] [k]
migrate_disable
|
---migrate_disable
kprobe_multi_link_handlerfprobe_entryfunction_graph_enter_regsftrace_graph_func0xffffffffc29850abbpf_get_numa_node_idbpf_prog_d9703036495d54b0_trigger_driver__bpf_prog_test_run_raw_tpbpf_prog_test_run_raw_tp__sys_bpf
__x64_sys_bpf
x64_sys_call
do_syscall_64
entry_SYSCALL_64
syscall
bpf_prog_test_run_optstrigger_producer_batch0x7a2a73a94ac30.99% bench [kernel.vmlinux] [k] t_func_next.isra.0
|
---t_func_next.isra.0
|
--0.83%--t_start
seq_read_iter
seq_read
vfs_read
ksys_read
__x64_sys_read
x64_sys_call
do_syscall_64
entry_SYSCALL_64
read
00.78% bench [
nf_conntrack] [k]0x000000000002c0d4
|
---0xffffffffc29850d4
__bpf_prog_test_run_raw_tp
bpf_prog_test_run_raw_tp
__sys_bpf
__x64_sys_bpf
x64_sys_call
do_syscall_64
entry_SYSCALL_64
syscall
bpf_prog_test_run_opts
trigger_producer_batch
0x7a2a73a94ac30.75% bench [
nf_conntrack] [k]0x000000000002c0ab
|
---0xffffffffc29850ab
bpf_get_numa_node_idbpf_prog_d9703036495d54b0_trigger_driver__bpf_prog_test_run_raw_tpbpf_prog_test_run_raw_tp__sys_bpf
__x64_sys_bpf
x64_sys_call
do_syscall_64
entry_SYSCALL_64
syscall
bpf_prog_test_run_optstrigger_producer_batch0x7a2a73a94ac30.68% bench [
nf_conntrack] [k]0x000000000002c00d
|
---0xffffffffc298500d
bpf_prog_d9703036495d54b0_trigger_driver__bpf_prog_test_run_raw_tpbpf_prog_test_run_raw_tp__sys_bpf
__x64_sys_bpf
x64_sys_call
do_syscall_64
entry_SYSCALL_64
syscall
bpf_prog_test_run_optstrigger_producer_batch0x7a2a73a94ac30.52% bench [kernel.vmlinux] [k]
__x86_indirect_thunk_array
|
---__x86_indirect_thunk_array0.42% bench [
nf_conntrack] [k]0x000000000002c005
0.38% bench [kernel.vmlinux] [k]__sys_bpf
0.37% bench [kernel.vmlinux] [k]srso_return_thunk
0.24% bench [nf_conntrack] [k]0x000000000002c001
0.23% bench [kernel.vmlinux] [k]read_hpet
0.21% bench [kernel.vmlinux] [k]entry_SYSCALL_64
0.19% bench [kernel.vmlinux] [k]bpf_prog_test_run_raw_tp
0.17% bench [nf_conntrack] [k]0x000000000002c000
0.15% bench [kernel.vmlinux] [k]_copy_from_user
0.15% bench [kernel.vmlinux] [k]syscall_exit_to_user_mode
0.14% bench [nf_conntrack] [k]0x000000000002c027
0.14% bench [nf_conntrack] [k]0x000000000002c0ca
0.13% swapper [kernel.vmlinux] [k]read_hpet
0.12% bench [kernel.vmlinux] [k]_copy_to_user
0.12% bench [nf_conntrack] [k]0x000000000002c086
0.11% bench [nf_conntrack] [k]0x000000000002c0c0
0.11% bench [kernel.vmlinux] [k]__fdget
0.11% bench bench [.]bpf_prog_test_run_opts
0.11% bench [kernel.vmlinux] [k]__bpf_prog_test_run_raw_tp
0.10% bench [nf_conntrack] [k]0x000000000002c059
0.09% bench [kernel.vmlinux] [k]get_symbol_offset
0.09% bench [kernel.vmlinux] [k]do_syscall_64
0.08% bench [kernel.vmlinux] [k]__bpf_prog_get
0.08% bench [kernel.vmlinux] [k]memchr_inv
0.07% bench [kernel.vmlinux] [k]syscall_return_via_sysret
0.06% bench [kernel.vmlinux] [k]x64_sys_call
0.06% bench [kernel.vmlinux] [k]rep_movs_alternative
0.06% bench [kernel.vmlinux] [k]ftrace_replace_code
0.04% bench [kernel.vmlinux] [k]__x64_sys_bpf
0.04% bench [kernel.vmlinux] [k]get_symbol_pos
0.04% bench bench [.]sys_bpf
0.04% bench [kernel.vmlinux] [k] vsnprintf
0.04% bench [kernel.vmlinux] [k] number
0.04% bench bench [.]ptr_to_u64
0.04% bench [kernel.vmlinux] [k] kfree
0.03% bench [kernel.vmlinux] [k]seq_read_iter
0.03% bench [kernel.vmlinux] [k]security_bpf
0.03% bench libc.so.6 [.] syscall
0.03% bench [kernel.vmlinux] [k] kallsyms_expand_symbol.constprop.0
0.03% kworker/2:2-eve [kernel.vmlinux] [k]memcpy_orig
0.03% swapper [amdgpu] [k]0x0000000000002f75
0.03% bench bench [.]trigger_producer_batch
0.03% bench [kernel.vmlinux] [k]__bpf_prog_put
0.02% bench [kernel.vmlinux] [k]seq_printf
0.02% bench [kernel.vmlinux] [k]smp_call_function_many_cond
0.02% kworker/2:2-eve [amdgpu] [k]0x0000000000002f75
0.02% bench [kernel.vmlinux] [k]__check_object_size
0.02% bench [kernel.vmlinux] [k]ftrace_test_record
0.02% bench [kernel.vmlinux] [k]seq_write
0.02% bench [kernel.vmlinux] [k]ftrace_lookup_ip
0.02% bench [kernel.vmlinux] [k]t_show
0.02% bench [kernel.vmlinux] [k]print_rec
0.02% swapper [kernel.vmlinux] [k]io_idle
0.01% bench [amdgpu] [k]0x0000000000002f75
0.01% kworker/2:2-eve [kernel.vmlinux] [k] memcmp
0.01% bench [kernel.vmlinux] [k]format_decode
0.01% bench [kernel.vmlinux] [k]memcpy_orig
0.01% bench [kernel.vmlinux] [k] __ftrace_hash_rec_update.part.0
0.01% bench [kernel.vmlinux] [k]mod_find
0.01% swapper [kernel.vmlinux] [k]srso_untrain_ret
0.01% bench [kernel.vmlinux] [k]kallsyms_lookup_buildid
0.01% bench [kernel.vmlinux] [k]__seq_puts
0.01% bench [kernel.vmlinux] [k]native_read_msr
0.01% bench [kernel.vmlinux] [k]check_stack_object
0.01% bench [kernel.vmlinux] [k] fput
0.01% bench bench [.]libbpf_err_errno
0.01% bench [kernel.vmlinux] [k]fpregs_assert_state_consistent
0.01% bench [kernel.vmlinux] [k]ftrace_check_record
0.01% bench [kernel.vmlinux] [k]t_next
0.01% bench [kernel.vmlinux] [k] strlen
0.01% swapper [kernel.vmlinux] [k]native_sched_clock
0.01% bench [kernel.vmlinux] [k]__sysvec_apic_timer_interrupt
0.01% bench libc.so.6 [.]0x00000000001a0f10
0.01% bench [kernel.vmlinux] [k]native_write_msr
0.01% bench [kernel.vmlinux] [k]__update_load_avg_se
0.01% bench [kernel.vmlinux] [k]amd_pmu_addr_offset
0.01% bench [kernel.vmlinux] [k]module_address_lookup
0.01% bench [kernel.vmlinux] [k]ftrace_rec_iter_next
0.01% bench [kernel.vmlinux] [k] string
0.01% bench [kernel.vmlinux] [k]asm_exc_page_fault
0.01% swapper [kernel.vmlinux] [k]__get_next_timer_interrupt
0.01% bench [kernel.vmlinux] [k]clear_page_rep
0.01% kworker/2:2-eve [kernel.vmlinux] [k]delay_halt_mwaitx
0.01% bench [kernel.vmlinux] [k]__handle_mm_fault
0.01% swapper [kernel.vmlinux] [k]ktime_get
0.01% kworker/2:2-eve [kernel.vmlinux] [k]clear_page_rep
0.01% swapper [kernel.vmlinux] [k]menu_select
0.00% perf [kernel.vmlinux] [k]clear_page_rep
0.00% bench [kernel.vmlinux] [k]ftrace_rec_iter_record
0.00% bench [kernel.vmlinux] [k]account_process_tick
0.00% bench [kernel.vmlinux] [k]__update_load_avg_cfs_rq
0.00% bench [kernel.vmlinux] [k]update_curr
0.00% bench [kernel.vmlinux] [k]do_sync_core
0.00% bench [kernel.vmlinux] [k]kallsyms_lookup
0.00% bench [kernel.vmlinux] [k]memset_orig
0.00% kworker/6:1-eve [kernel.vmlinux] [k]memcpy_orig
0.00% perf [kernel.vmlinux] [k]rep_movs_alternative
0.00% sshd [kernel.vmlinux] [k]p4d_offset
0.00% kworker/6:1-eve [amdgpu] [k]0x0000000000002f75
0.00% bench [kernel.vmlinux] [k]__mod_memcg_lruvec_state
0.00% swapper [kernel.vmlinux] [k]_raw_spin_unlock
0.00% swapper [kernel.vmlinux] [k]cpuidle_enter_state
0.00% swapper [kernel.vmlinux] [k]rb_erase
0.00% containerd [kernel.vmlinux] [k]read_hpet
0.00% kworker/6:1-eve [kernel.vmlinux] [k] memcmp
0.00% swapper [kernel.vmlinux] [k]irq_entries_start
0.00% swapper [kernel.vmlinux] [k]do_idle
0.00% kworker/2:2-eve [kernel.vmlinux] [k]read_hpet
0.00% swapper [kernel.vmlinux] [k]update_rq_clock
0.00% swapper [kernel.vmlinux] [k]psi_group_change
0.00% swapper [kernel.vmlinux] [k]sched_clock_cpu
0.00% swapper [kernel.vmlinux] [k]do_sync_core
0.00% kworker/2:2-eve [amdgpu] [k]0x000000000064ec11
0.00% swapper [kernel.vmlinux] [k]_raw_spin_lock_irqsave
0.00% swapper [kernel.vmlinux] [k]asm_sysvec_call_function_single
0.00% swapper [kernel.vmlinux] [k] update_sd_lb_stats.constprop.0
0.00% perf [kernel.vmlinux] [k]__filemap_get_folio
0.00% swapper [kernel.vmlinux] [k]irqentry_enter
0.00% bench [kernel.vmlinux] [k]amd_pmu_test_overflow_topbit
0.00% bench [amdgpu] [k]0x0000000000124f4c
0.00% bench [kernel.vmlinux] [k]update_rq_clock
0.00% bench [kernel.vmlinux] [k]perf_event_task_tick
0.00% bench [amdgpu] [k]0x0000000000126f3a
0.00% bench [kernel.vmlinux] [k]sched_balance_update_blocked_averages
0.00% bench [kernel.vmlinux] [k]hrtimer_active
0.00% bench [kernel.vmlinux] [k]_copy_to_iter
0.00% bench [kernel.vmlinux] [k]_raw_spin_lock_irqsave
0.00% bench [kernel.vmlinux] [k]calc_global_load_tick
0.00% bench [kernel.vmlinux] [k] ftrace_shutdown.part.0
0.00% bench libc.so.6 [.]0x00000000001a0fb5
0.00% bench [kernel.vmlinux] [k]task_tick_mm_cid
0.00% bench libc.so.6 [.]0x00000000001a0fba
0.00% bench [kernel.vmlinux] [k]sched_clock_cpu
0.00% bench [kernel.vmlinux] [k]update_cfs_group
0.00% bench [kernel.vmlinux] [k]irq_exit_rcu
0.00% bench [kernel.vmlinux] [k]native_sched_clock
0.00% bench [kernel.vmlinux] [k]sched_tick
0.00% bench [kernel.vmlinux] [k]sized_strscpy
0.00% bench [kernel.vmlinux] [k]task_tick_fair
0.00% bench [nf_conntrack] [k]0x000000000002c036
0.00% bench [kernel.vmlinux] [k]perf_adjust_freq_unthr_context
0.00% bench [kernel.vmlinux] [k]idle_cpu
0.00% bench [kernel.vmlinux] [k]bpf_check_uarg_tail_zero
0.00% swapper [kernel.vmlinux] [k]__hrtimer_next_event_base
0.00% swapper [kernel.vmlinux] [k]native_write_msr
0.00% bench [kernel.vmlinux] [k] __module_address.part.0
0.00% bench [kernel.vmlinux] [k]lru_gen_add_folio
0.00% bench [kernel.vmlinux] [k]set_pte_range
0.00% bench [kernel.vmlinux] [k]pfn_pte
0.00% swapper [kernel.vmlinux] [k]error_entry
0.00% swapper [kernel.vmlinux] [k]idle_cpu
0.00% bench [kernel.vmlinux] [k]unmap_page_range
0.00% bench [kernel.vmlinux] [k]__count_memcg_events
0.00% bench [kernel.vmlinux] [k]__irq_exit_rcu
0.00% perf [kernel.vmlinux] [k]__perf_event_enable
0.00% bench [kernel.vmlinux] [k]seq_putc
0.00% perf [kernel.vmlinux] [k]srso_untrain_ret
0.00% swapper [kernel.vmlinux] [k]__irq_exit_rcu
0.00% kworker/2:2-eve [kernel.vmlinux] [k]__kmalloc_cache_noprof
0.00% bench libc.so.6 [.]0x00000000001a0bd7
0.00% perf [kernel.vmlinux] [k]_raw_spin_lock
0.00% kworker/u65:2-e [kernel.vmlinux] [k]__bio_split_to_limits
0.00% bench [kernel.vmlinux] [k]do_anonymous_page
0.00% perf [kernel.vmlinux] [k]__es_insert_extent
0.00% bench [kernel.vmlinux] [k]__mem_cgroup_charge
0.00% kworker/2:2-eve [kernel.vmlinux] [k]__wait_for_common
0.00% bench [kernel.vmlinux] [k]__folio_throttle_swaprate
0.00% swapper [kernel.vmlinux] [k]__switch_to_asm
0.00% swapper [kernel.vmlinux] [k]add_interrupt_randomness
0.00% kworker/2:2-eve [kernel.vmlinux] [k]srso_untrain_ret
0.00% kworker/2:2-eve [kernel.vmlinux] [k]memset_orig
0.00% kworker/u65:2-e [kernel.vmlinux] [k]percpu_counter_add_batch
0.00% swapper [kernel.vmlinux] [k]tick_irq_enter
0.00% swapper [kernel.vmlinux] [k]tick_check_broadcast_expired
0.00% kworker/2:2-eve [amdgpu] [k]0x000000000045d28e
0.00% perf [kernel.vmlinux] [k]__lruvec_stat_mod_folio
0.00% bench [kernel.vmlinux] [k]kernfs_fop_read_iter
0.00% bench [kernel.vmlinux] [k]__mod_zone_page_state
0.00% kworker/2:2-eve [kernel.vmlinux] [k]delay_halt
0.00% perf [kernel.vmlinux] [k]__mod_memcg_lruvec_state
0.00% perf [kernel.vmlinux] [k]xas_load
0.00% perf [kernel.vmlinux] [k]workingset_update_node
0.00% perf [kernel.vmlinux] [k]_raw_spin_unlock
0.00% swapper [kernel.vmlinux] [k]__handle_irq_event_percpu
0.00% kworker/2:2-eve [kernel.vmlinux] [k]post_alloc_hook
0.00% bench [kernel.vmlinux] [k]refill_obj_stock
0.00% perf [kernel.vmlinux] [k]__alloc_pages_noprof
0.00% swapper [kernel.vmlinux] [k]cpuidle_enter
0.00% swapper [kernel.vmlinux] [k]sched_balance_domains
0.00% perf [kernel.vmlinux] [k]__handle_mm_fault
0.00% swapper [kernel.vmlinux] [k] ct_kernel_enter.constprop.0
0.00% bench [kernel.vmlinux] [k]mab_mas_cp
0.00% swapper [amdgpu] [k]0x00000000004619a7
0.00% swapper [kernel.vmlinux] [k]tick_nohz_irq_exit
0.00% perf [kernel.vmlinux] [k]__memcg_slab_post_alloc_hook
0.00% bench [kernel.vmlinux] [k]__alloc_pages_noprof
0.00% swapper [kernel.vmlinux] [k]irq_exit_rcu
0.00% bench [kernel.vmlinux] [k] memcmp
0.00% swapper [kernel.vmlinux] [k]asm_sysvec_call_function
0.00% perf [kernel.vmlinux] [k]perf_poll
0.00% swapper [kernel.vmlinux] [k]enqueue_task_fair
0.00% bench [kernel.vmlinux] [k]__rmqueue_pcplist
0.00% kworker/u65:4-e [kernel.vmlinux] [k]__iommu_map
0.00% kworker/6:1-eve [amdgpu] [k]0x0000000000992cd2
0.00% kworker/6:1-eve [amdgpu] [k]0x00000000004b2ade
0.00% swapper [kernel.vmlinux] [k]wakeup_preempt
0.00% migration/11 [kernel.vmlinux] [k]enqueue_task
0.00% swapper [kernel.vmlinux] [k]hrtimer_update_next_event
0.00% swapper [kernel.vmlinux] [k]native_apic_mem_eoi
0.00% bench [kernel.vmlinux] [k]is_sync_callback_calling_insn
0.00% kworker/6:1-eve [amdgpu] [k]0x0000000000992cb3
0.00% systemd-network libc.so.6 [.]clock_gettime
0.00% kworker/u65:4-e [kernel.vmlinux] [k]filemap_get_folios_tag
0.00% kworker/u65:4-e [kernel.vmlinux] [k]fscrypt_mergeable_bio_bh
0.00% swapper [kernel.vmlinux] [k]hrtimer_start_range_ns
0.00% multipathd [kernel.vmlinux] [k]cpuacct_charge
0.00% swapper [kernel.vmlinux] [k]hrtimer_get_next_event
0.00% kworker/12:1-ev [amdgpu] [k]0x00000000004b09fc
0.00% kworker/12:1-ev [kernel.vmlinux] [k]memcpy_orig
0.00% kworker/u65:4-e [kernel.vmlinux] [k]wbt_track
0.00% kworker/u65:4-e [kernel.vmlinux] [k]__lruvec_stat_mod_folio
0.00% kworker/12:1-ev [amdgpu] [k]0x0000000000002f75
0.00% bench [kernel.vmlinux] [k]do_jit
0.00% kworker/u65:4-e [kernel.vmlinux] [k]__folio_start_writeback
0.00% bench [kernel.vmlinux] [k]uncharge_folio
0.00% perf [kernel.vmlinux] [k]do_fault
0.00% perf [kernel.vmlinux] [k]__kmalloc_noprof
0.00% containerd [kernel.vmlinux] [k]blkcg_maybe_throttle_current
0.00% kworker/12:1-ev [amdgpu] [k]0x0000000000523901
0.00% kworker/12:1-ev [amdgpu] [k]0x0000000000538414
0.00% kworker/2:2-eve [amdgpu] [k]0x0000000000465f98
0.00% irqbalance [kernel.vmlinux] [k]format_decode
0.00% swapper [kernel.vmlinux] [k]handle_edge_irq
0.00% kworker/12:1-ev [kernel.vmlinux] [k]srso_untrain_ret
0.00% kworker/u65:4-e [kernel.vmlinux] [k]__find_get_block
0.00% systemd-journal [kernel.vmlinux] [k]__put_user_nocheck_4
0.00% systemd-journal libsystemd-shared-249.so [.]0x00000000001c9c3e
0.00% swapper [kernel.vmlinux] [k]local_touch_nmi
0.00% bench [kernel.vmlinux] [k]__mem_cgroup_uncharge_folios
0.00% swapper [kernel.vmlinux] [k]_raw_spin_lock
0.00% swapper [kernel.vmlinux] [k]select_task_rq_fair
0.00% swapper [kernel.vmlinux] [k]need_update
0.00% bench [kernel.vmlinux] [k]rcu_segcblist_enqueue
0.00% swapper [kernel.vmlinux] [k]tick_nohz_get_sleep_length
0.00% containerd [kernel.vmlinux] [k]_raw_spin_unlock
0.00% containerd [kernel.vmlinux] [k]ep_autoremove_wake_function
0.00% kworker/u66:1-e [kernel.vmlinux] [k]__percpu_counter_sum
0.00% swapper [kernel.vmlinux] [k]ktime_get_mono_fast_ns
0.00% swapper [kernel.vmlinux] [k]sysvec_apic_timer_interrupt
0.00% swapper [kernel.vmlinux] [k]_raw_spin_unlock_irqrestore
0.00% migration/10 [kernel.vmlinux] [k]dequeue_entity
0.00% swapper [kernel.vmlinux] [k]handle_irq_event
0.00% perf [kernel.vmlinux] [k]srso_return_thunk
0.00% perf [kernel.vmlinux] [k]xas_find_conflict
0.00% perf-exec [kernel.vmlinux] [k]mas_next_slot
0.00% swapper [kernel.vmlinux] [k] fetch_next_timer_interrupt.constprop.0
0.00% bench [kernel.vmlinux] [k]get_page_from_freelist
0.00% swapper [amdgpu] [k]0x0000000000125079
0.00% kworker/u65:4-e [kernel.vmlinux] [k]sched_balance_newidle
0.00% migration/6 [kernel.vmlinux] [k]raw_spin_rq_unlock
0.00% kworker/2:2-eve [amdgpu] [k]0x0000000000444a05
0.00% swapper [kernel.vmlinux] [k]fetch_pte
0.00% perf [kernel.vmlinux] [k]__pte_offset_map
0.00% kworker/2:2-eve [amdgpu] [k]0x0000000000534985
0.00% kworker/2:2-eve [amdgpu] [k]0x0000000000003ac5
0.00% bench [kernel.vmlinux] [k]perf_iterate_sb
0.00% swapper [kernel.vmlinux] [k]get_cpu_device
0.00% perf [kernel.vmlinux] [k]xas_start
0.00% kworker/2:2-eve [amdgpu] [k]0x000000000098fea5
0.00% perf [kernel.vmlinux] [k]mark_buffer_dirty
0.00% containerd containerd [.] runtime.cleantimers
0.00% bench [kernel.vmlinux] [k]__cond_resched
0.00% kworker/2:2-eve [drm_kms_helper] [k]0x00000000000008eb
0.00% kworker/2:2-eve [raid6_pq] [k]0x000000000000c24b
0.00% kworker/2:2-eve [amdgpu] [k]0x000000000064ea79
0.00% perf [kernel.vmlinux] [k]cpu_util
0.00% swapper [kernel.vmlinux] [k]asm_common_interrupt
0.00% perf [kernel.vmlinux] [k]__filemap_add_folio
0.00% kworker/2:2-eve [amdgpu] [k]0x00000000007d1eab
0.00% kworker/2:2-eve [amdgpu] [k]0x000000000051a45f
0.00% perf [kernel.vmlinux] [k]ext4_es_lookup_extent
0.00% swapper [kernel.vmlinux] [k]__flush_smp_call_function_queue
0.00% kworker/2:2-eve [amdgpu] [k]0x0000000000519af6
0.00% swapper [kernel.vmlinux] [k]refresh_cpu_vm_stats
0.00% kworker/2:2-eve [amdgpu] [k]0x0000000000477759
0.00% perf-exec [kernel.vmlinux] [k]kmem_cache_free
0.00% kworker/2:2-eve [amdgpu] [k]0x0000000000539303
0.00% kworker/2:2-eve [drm] [k]0x0000000000020c1c
0.00% swapper [kernel.vmlinux] [k]asm_sysvec_apic_timer_interrupt
0.00% bench [kernel.vmlinux] [k]alloc_pages_mpol_noprof
0.00% bench [kernel.vmlinux] [k]filemap_map_pages
0.00% kworker/2:2-eve [amdgpu] [k]0x0000000000477767
0.00% swapper [kernel.vmlinux] [k]update_load_avg
0.00% kworker/2:2-eve [amdgpu] [k]0x000000000045d3d6
0.00% kworker/2:2-eve [amdgpu] [k]0x000000000051d905
0.00% kworker/2:2-eve [drm_kms_helper] [k]0x0000000000004ae8
0.00% kworker/u65:2-e [kernel.vmlinux] [k]__mod_memcg_lruvec_state
0.00% kworker/u65:2-e [kernel.vmlinux] [k]bio_associate_blkg
0.00% kworker/2:2-eve [amdgpu] [k]0x00000000004916dd
0.00% kworker/2:2-eve [amdgpu] [k]0x0000000000465ecb
0.00% kworker/2:2-eve [amdgpu] [k]0x00000000004b780a
0.00% swapper [kernel.vmlinux] [k]sysvec_call_function
0.00% kworker/2:2-eve [amdgpu] [k]0x000000000051e764
0.00% kworker/2:2-eve [amdgpu] [k]0x000000000064ed72
0.00% kworker/2:2-eve [amdgpu] [k]0x000000000051c7bf
0.00% kworker/2:2-eve [amdgpu] [k]0x000000000064ebe0
0.00% kworker/2:2-eve [amdgpu] [k]0x0000000000523fba
0.00% kworker/2:2-eve [amdgpu] [k]0x0000000000832660
0.00% swapper [kernel.vmlinux] [k]acpi_idle_do_entry
0.00% kworker/2:2-eve [amdgpu] [k]0x000000000097ddfc
0.00% kworker/2:2-eve [amdgpu] [k]0x000000000045d334
0.00% kworker/u65:2-e [kernel.vmlinux] [k]soft_cursor
0.00% perf [kernel.vmlinux] [k]sched_balance_rq
0.00% kworker/u65:2-e [kernel.vmlinux] [k]__fprop_add_percpu
0.00% swapper [kernel.vmlinux] [k]rb_next
0.00% kworker/2:2-eve [amdgpu] [k]0x0000000000977ece
0.00% perf [kernel.vmlinux] [k]__folio_mark_dirty
0.00% perf [kernel.vmlinux] [k]filemap_alloc_folio_noprof
0.00% perf [kernel.vmlinux] [k]get_mem_cgroup_from_mm
0.00% perf [kernel.vmlinux] [k]ext4_da_reserve_space
0.00% perf [kernel.vmlinux] [k]read_hpet
0.00% kworker/2:2-eve [amdgpu] [k]0x000000000051cd3e
0.00% kworker/2:2-eve [amdgpu] [k]0x0000000000532f0f
0.00% kworker/2:2-eve [kernel.vmlinux] [k]__mod_node_page_state
0.00% systemd-journal [kernel.vmlinux] [k]mod_objcg_state
0.00% jbd2/dm-0-8 [kernel.vmlinux] [k]dm_submit_bio
0.00% kworker/2:2-eve [amdgpu] [k]0x0000000000517b6d
0.00% kcompactd0 [kernel.vmlinux] [k]idle_cpu
0.00% kworker/2:2-eve [kernel.vmlinux] [k]free_tail_page_prepare
0.00% swapper [amdgpu] [k]0x00000000002f7f65
0.00% swapper [kernel.vmlinux] [k]tick_program_event
0.00% containerd [kernel.vmlinux] [k]psi_group_change
0.00% kworker/2:2-eve [amdgpu] [k]0x000000000053776f
0.00% swapper [kernel.vmlinux] [k]srso_return_thunk
0.00% perf [kernel.vmlinux] [k]ext4_claim_free_clusters
0.00% perf [kernel.vmlinux] [k]generic_perform_write
0.00% perf [kernel.vmlinux] [k]mem_cgroup_commit_charge
0.00% perf [kernel.vmlinux] [k]file_modified
0.00% kworker/2:2-eve [amdgpu] [k]0x000000000051e779
0.00% kworker/2:2-eve [amdgpu] [k]0x000000000053974c
0.00% perf [kernel.vmlinux] [k]ext4_da_write_begin
0.00% perf [kernel.vmlinux] [k]filemap_add_folio
0.00% perf libc.so.6 [.] write
0.00% perf [kernel.vmlinux] [k]__es_remove_extent
0.00% kworker/2:2-eve [amdgpu] [k]0x000000000052244a
0.00% swapper [kernel.vmlinux] [k]ct_nmi_exit
0.00% kworker/2:2-eve [amdgpu] [k]0x000000000034bee5
0.00% kworker/2:2-eve [kernel.vmlinux] [k]__rcu_read_lock
0.00% perf [kernel.vmlinux] [k]__dquot_alloc_space
0.00% swapper [kernel.vmlinux] [k]native_read_msr
0.00% perf [kernel.vmlinux] [k]folio_unlock
0.00% perf [kernel.vmlinux] [k]radix_tree_node_ctor
0.00% kworker/2:2-eve [amdgpu] [k]0x00000000006c5b82
0.00% kworker/2:2-eve [amdgpu] [k]0x0000000000527259
0.00% perf [kernel.vmlinux] [k]__mod_node_page_state
0.00% perf [kernel.vmlinux] [k]__radix_tree_lookup
0.00% kworker/u65:2-e [kernel.vmlinux] [k]__rcu_read_unlock
0.00% perf [kernel.vmlinux] [k]ext4_get_reserved_space
0.00% swapper [kernel.vmlinux] [k]hrtimer_cancel
0.00% kworker/2:2-eve [amdgpu] [k]0x00000000004ba8ce
0.00% swapper [amdgpu] [k]0x0000000000126f3a
0.00% perf perf [.]perf_cpu_map__idx
0.00% swapper [kernel.vmlinux] [k]sched_balance_update_blocked_averages
0.00% systemd-journal [kernel.vmlinux] [k]do_timerfd_settime
0.00% kworker/2:2-eve [amdgpu] [k]0x000000000097ddc5
0.00% kworker/2:2-eve [amdgpu] [k]0x000000000097e5a4
0.00% perf [kernel.vmlinux] [k]folio_batch_move_lru
0.00% swapper [amdgpu] [k]0x000000000046f8a5
0.00% perf [kernel.vmlinux] [k]xas_nomem
0.00% kworker/2:2-eve [amdgpu] [k]0x000000000051d24c
0.00% kworker/2:2-eve [amdgpu] [k]0x000000000097df7c
0.00% tuned [kernel.vmlinux] [k]psi_task_switch
0.00% swapper [kernel.vmlinux] [k]__dequeue_entity
0.00% swapper [amdgpu] [k]0x00000000006e7c5d
0.00% swapper [kernel.vmlinux] [k]rcu_preempt_deferred_qs
0.00% kworker/7:1-eve [kernel.vmlinux] [k]__free_one_page
0.00% swapper [kernel.vmlinux] [k]memchr_inv
0.00% perf [kernel.vmlinux] [k]psi_task_switch
0.00% swapper [kernel.vmlinux] [k] _nohz_idle_balance.isra.0
0.00% kworker/2:2-eve [amdgpu] [k]0x00000000009a6fbd
0.00% swapper [kernel.vmlinux] [k]acpi_idle_enter
0.00% kworker/2:2-eve [amdgpu] [k]0x0000000000456a9f
0.00% kworker/2:2-eve [amdgpu] [k]0x00000000004ac642
0.00% kworker/2:2-eve [amdgpu] [k]0x0000000000477888
0.00% kworker/2:2-eve [amdgpu] [k]0x0000000000529a52
0.00% kworker/2:2-eve [amdgpu] [k]0x00000000004b36d2
0.00% kworker/2:2-eve [amdgpu] [k]0x0000000000525b33
0.00% swapper [kernel.vmlinux] [k]tmigr_active_up
0.00% kworker/2:2-eve [amdgpu] [k]0x0000000000452444
0.00% swapper [amdgpu] [k]0x000000000046f865
0.00% swapper [kernel.vmlinux] [k]next_timer_interrupt
0.00% kworker/6:1-eve [kernel.vmlinux] [k]__free_pages_ok
0.00% perf [kernel.vmlinux] [k]exc_page_fault
0.00% swapper [kernel.vmlinux] [k]__schedule
0.00% irqbalance [kernel.vmlinux] [k]__kmalloc_cache_noprof
0.00% swapper [kernel.vmlinux] [k]cpuidle_not_available
0.00% containerd [kernel.vmlinux] [k]pick_next_task_fair
0.00% kworker/6:1-eve [amdgpu] [k]0x00000000009a70b7
0.00% swapper [kernel.vmlinux] [k]tick_nohz_next_event
0.00% swapper [kernel.vmlinux] [k]tick_check_oneshot_broadcast_this_cpu
0.00% swapper [kernel.vmlinux] [k]irq_chip_ack_parent
0.00% irqbalance [kernel.vmlinux] [k]show_stat
0.00% kworker/2:2-eve [amdgpu] [k]0x00000000004b8295
0.00% swapper [amdgpu] [k]0x000000000045d385
0.00% swapper [kernel.vmlinux] [k]tick_nohz_idle_stop_tick
0.00% containerd [kernel.vmlinux] [k]__schedule
0.00% swapper [kernel.vmlinux] [k]switch_mm_irqs_off
0.00% swapper [amdgpu] [k]0x0000000000461a21
0.00% kworker/6:1-eve [amdgpu] [k]0x000000000051d7c2
0.00% swapper [kernel.vmlinux] [k]try_to_wake_up
0.00% kworker/2:2-eve [amdgpu] [k]0x000000000051e7cf
0.00% kworker/2:2-eve [amdgpu] [k]0x000000000064ed4e
0.00% perf [kernel.vmlinux] [k]perf_mmap_to_page
0.00% migration/7 [kernel.vmlinux] [k] update_sd_lb_stats.constprop.0
0.00% irqbalance [kernel.vmlinux] [k]__rcu_read_lock
0.00% migration/3 [kernel.vmlinux] [k]__update_load_avg_cfs_rq
0.00% swapper [br_netfilter] [k]0x0000000000000775
0.00% bench [kernel.vmlinux] [k]remove_vma
0.00% swapper [kernel.vmlinux] [k]sched_clock_noinstr
0.00% kworker/6:1-eve [amdgpu] [k]0x0000000000529169
0.00% swapper [amdgpu] [k]0x000000000000df07
0.00% swapper [kernel.vmlinux] [k]__switch_to
0.00% swapper [kernel.vmlinux] [k]place_entity
0.00% kworker/6:1-eve [amdgpu] [k]0x000000000097dd9a
0.00% swapper [amdgpu] [k]0x00000000006e7c5a
0.00% irqbalance [kernel.vmlinux] [k]__rcu_read_unlock
0.00% migration/6 [kernel.vmlinux] [k]enqueue_entity
0.00% swapper [kernel.vmlinux] [k]__update_load_avg_cfs_rq
0.00% perf [kernel.vmlinux] [k]event_function
0.00% perf [kernel.vmlinux] [k]do_user_addr_fault
0.00% kworker/2:2-eve [amdgpu] [k]0x000000000064eaee
0.00% migration/4 [kernel.vmlinux] [k]__update_load_avg_cfs_rq
0.00% swapper [amdgpu] [k]0x00000000006e79ff
0.00% containerd [kernel.vmlinux] [k]schedule_hrtimeout_range_clock
0.00% irqbalance [kernel.vmlinux] [k]security_file_open
0.00% perf [kernel.vmlinux] [k]_find_next_and_bit
0.00% multipathd [kernel.vmlinux] [k]__rseq_handle_notify_resume
0.00% swapper [kernel.vmlinux] [k]__x86_indirect_thunk_r12
0.00% swapper [kernel.vmlinux] [k]rcu_note_context_switch
0.00% bench [kernel.vmlinux] [k]free_unref_folios
0.00% migration/0 [kernel.vmlinux] [k]migration_cpu_stop
0.00% migration/1 [kernel.vmlinux] [k]rcu_note_context_switch
0.00% kworker/u66:1-e [kernel.vmlinux] [k]n_tty_receive_buf2
0.00% swapper [kernel.vmlinux] [k]__common_interrupt
0.00% swapper [drm] [k]0x000000000003d658
0.00% migration/5 [kernel.vmlinux] [k]psi_group_change
0.00% swapper [kernel.vmlinux] [k]clockevents_program_event
0.00% swapper [kernel.vmlinux] [k]__x86_indirect_thunk_array
0.00% perf [kernel.vmlinux] [k]set_pte_range
0.00% perf [kernel.vmlinux] [k]__schedule
0.00% swapper [kernel.vmlinux] [k]__update_load_avg_se
0.00% swapper [kernel.vmlinux] [k]asm_sysvec_reschedule_ipi
0.00% swapper [kernel.vmlinux] [k]local_clock_noinstr
0.00% swapper [kernel.vmlinux] [k]tick_nohz_stop_idle
0.00% swapper [amdgpu] [k]0x000000000044a039
0.00% kworker/4:1-mm_ [kernel.vmlinux] [k]native_queued_spin_lock_slowpath
0.00%rcu_preempt[kernel.vmlinux] [k]__update_idle_core
0.00%rcu_preempt[kernel.vmlinux] [k]pick_next_task_fair
0.00%rcu_preempt[kernel.vmlinux] [k]prepare_to_swait_event
0.00%rcu_preempt[kernel.vmlinux] [k]sched_balance_rq
0.00%rcu_preempt[kernel.vmlinux] [k]update_rq_clock
0.00% rs:main Q:Reg [kernel.vmlinux] [k]ext4_inode_csum
0.00% swapper [kernel.vmlinux] [k]tmigr_inactive_up
0.00% swapper [kernel.vmlinux] [k]hrtimer_forward
0.00% swapper [kernel.vmlinux] [k]cpuidle_reflect
0.00% perf [kernel.vmlinux] [k]percpu_counter_add_batch
0.00% swapper [amdgpu] [k]0x000000000031e745
0.00% swapper [kernel.vmlinux] [k]sched_idle_set_state
0.00% kworker/6:1-eve [amdgpu] [k]0x000000000045675c
0.00% kworker/6:1-eve [amdgpu] [k]0x000000000051cbb1
0.00% swapper [amdgpu] [k]0x000000000002dce5
0.00% systemd-journal [kernel.vmlinux] [k]__ext4_ext_check
0.00% swapper [kernel.vmlinux] [k]sched_core_idle_cpu
0.00% swapper [drm] [k]0x000000000003de52
0.00% swapper [kernel.vmlinux] [k]__msecs_to_jiffies
0.00% swapper [amdgpu] [k]0x000000000046f9c4
0.00% swapper [kernel.vmlinux] [k]call_cpuidle
0.00% swapper [kernel.vmlinux] [k]cpuidle_governor_latency_req
0.00% kworker/7:1-eve [kernel.vmlinux] [k]__switch_to_asm
0.00% dockerd [kernel.vmlinux] [k]apparmor_file_permission
0.00% swapper [amdgpu] [k]0x0000000000126f37
0.00% swapper [amdgpu] [k]0x00000000003218b6
0.00% swapper [amdgpu] [k]0x00000000006e8d65
0.00% swapper [amdgpu] [k]0x000000000096f62d
0.00% systemd-journal [kernel.vmlinux] [k] __es_tree_search.isra.0
0.00% swapper [kernel.vmlinux] [k]update_group_capacity
0.00% kworker/2:2-eve [amdgpu] [k]0x00000000005225c3
0.00% kworker/2:2-eve [amdgpu] [k]0x0000000000990c4f
0.00% swapper [kernel.vmlinux] [k]timer_base_try_to_set_idle
0.00% swapper [kernel.vmlinux] [k]ct_idle_exit
0.00% swapper [kernel.vmlinux] [k]__x86_indirect_thunk_rbx
0.00% swapper [kernel.vmlinux] [k]fast_mix
0.00% swapper [kernel.vmlinux] [k]sched_clock_idle_sleep_event
0.00% swapper [kernel.vmlinux] [k]touch_softlockup_watchdog_sched
0.00% containerd [kernel.vmlinux] [k]psi_task_switch
0.00% swapper [amdgpu] [k]0x0000000000123820
0.00% swapper [kernel.vmlinux] [k]sched_clock
0.00% swapper [amdgpu] [k]0x00000000002f46a5
0.00% swapper [amdgpu] [k]0x0000000000449ff5
0.00% containerd [kernel.vmlinux] [k]_copy_to_user
0.00% swapper [kernel.vmlinux] [k]enqueue_task
0.00% swapper [amdgpu] [k]0x000000000096f625
0.00% swapper [amdgpu] [k]0x00000000006e7c66
0.00% swapper [kernel.vmlinux] [k]hrtimer_interrupt
0.00% swapper [kernel.vmlinux] [k]irq_enter_rcu
0.00% perf [kernel.vmlinux] [k]_raw_spin_lock_irqsave
0.00% perf [kernel.vmlinux] [k]poll_freewait
0.00%rcu_preempt[kernel.vmlinux] [k]__rcu_read_lock
0.00% swapper [kernel.vmlinux] [k]wake_q_add
0.00% kworker/7:1H-kb [kernel.vmlinux] [k]__switch_to_asm
0.00% swapper [amdgpu] [k]0x00000000002f8058
0.00% swapper [kernel.vmlinux] [k]sched_clock_tick
0.00% swapper [kernel.vmlinux] [k] slab_update_freelist.constprop.0.isra.0
0.00% swapper [kernel.vmlinux] [k]tick_nohz_get_next_hrtimer
0.00% swapper [kernel.vmlinux] [k]ct_kernel_enter_state
0.00% swapper [kernel.vmlinux] [k]hrtimer_next_event_without
0.00% swapper [kernel.vmlinux] [k]resched_curr
0.00% swapper [amdgpu] [k]0x0000000000003a55
0.00% swapper [amdgpu] [k]0x000000000045d3df
0.00% swapper [amdgpu] [k]0x000000000098aeb9
0.00% containerd [kernel.vmlinux] [k]__switch_to
0.00% swapper [kernel.vmlinux] [k]rcu_sched_clock_irq
0.00% kworker/9:1-eve [kernel.vmlinux] [k]sched_clock_cpu
0.00% swapper [amdgpu] [k]0x0000000000124ef5
0.00% containerd [kernel.vmlinux] [k]update_curr
0.00% swapper [drm] [k]0x0000000000035f4e
0.00% swapper [kernel.vmlinux] [k]tmigr_update_events
0.00% swapper [kernel.vmlinux] [k]profile_pc
0.00% swapper [nvme] [k]0x0000000000004315
0.00% swapper [kernel.vmlinux] [k]raw_spin_rq_unlock
0.00% containerd [kernel.vmlinux] [k]posix_get_monotonic_timespec
0.00% swapper [amdgpu] [k]0x0000000000002f4b
0.00% swapper [amdgpu] [k]0x000000000034bf25
0.00% perf [kernel.vmlinux] [k]get_page_from_freelist
0.00%rcu_preempt[kernel.vmlinux] [k]__mod_timer
0.00% perf [kernel.vmlinux] [k]mutex_unlock
0.00% swapper [amdgpu] [k]0x0000000000460f85
0.00% swapper [amdgpu] [k]0x0000000000977ec5
0.00% swapper [amdgpu] [k]0x0000000000977ed6
0.00% swapper [kernel.vmlinux] [k]sched_clock_idle_wakeup_event
0.00% swapper [amdgpu] [k]0x0000000000124016
0.00% swapper [kernel.vmlinux] [k]pick_next_task_fair
0.00% swapper [raid6_pq] [k]0x000000000001acf5
0.00% swapper [amdgpu] [k]0x0000000000977ec6
0.00% systemd-journal [kernel.vmlinux] [k]security_inode_setattr
0.00% swapper [kernel.vmlinux] [k]__sysvec_apic_timer_interrupt
0.00% swapper [amdgpu] [k]0x0000000000461985
0.00% swapper [amdgpu] [k]0x0000000000123825
0.00% swapper [amdgpu] [k]0x0000000000126ee9
0.00% swapper [amdgpu] [k]0x000000000096f6cd
0.00% perf [kernel.vmlinux] [k]do_syscall_64
0.00% systemd-journal [kernel.vmlinux] [k]unmap_mapping_range
0.00% systemd-journal libc.so.6 [.]0x0000000000090a64
0.00% containerd [kernel.vmlinux] [k]dequeue_entity
0.00% systemd-journal [kernel.vmlinux] [k]dax_layout_busy_page
0.00% swapper [kernel.vmlinux] [k]apic_ack_irq
0.00% swapper [drm] [k]0x000000000003d83b
0.00% containerd [kernel.vmlinux] [k]__futex_queue
0.00% swapper [kernel.vmlinux] [k]complete_all
0.00% swapper [amdgpu] [k]0x000000000098b0d6
0.00% swapper [kernel.vmlinux] [k]can_stop_idle_tick
0.00% swapper [amdgpu] [k]0x000000000000dee5
0.00% swapper [amdgpu] [k]0x000000000044ecef
0.00% swapper [amdgpu] [k]0x000000000000dee6
0.00% migration/14 [kernel.vmlinux] [k]update_curr_common
0.00% rs:main Q:Reg [kernel.vmlinux] [k]ext4_get_group_desc
0.00% swapper [kernel.vmlinux] [k]tick_do_update_jiffies64
0.00% swapper [kernel.vmlinux] [k]tmigr_cpu_new_timer
0.00% kworker/7:1-eve [kernel.vmlinux] [k]free_pcppages_bulk
0.00% dockerd [kernel.vmlinux] [k]srso_untrain_ret
0.00% dockerd [kernel.vmlinux] [k]update_curr
0.00% swapper [amdgpu] [k]0x0000000000124f0c
0.00% swapper [drm] [k]0x000000000003f455
0.00% swapper [amdgpu] [k]0x00000000003218b5
0.00% swapper [kernel.vmlinux] [k]ct_irq_enter
0.00% swapper [kernel.vmlinux] [k]ct_irq_exit
0.00% swapper [kernel.vmlinux] [k]blk_stat_add
0.00% swapper [amdgpu] [k]0x00000000006e8dd0
0.00% swapper [amdgpu] [k]0x0000000000124f4c
0.00% swapper [amdgpu] [k]0x000000000098aef6
0.00% swapper [drm] [k]0x000000000003f468
0.00% swapper [kernel.vmlinux] [k]nohz_balance_enter_idle
0.00% swapper [kernel.vmlinux] [k]__wake_up_common
0.00% swapper [amdgpu] [k]0x00000000001240ea
0.00% swapper [kernel.vmlinux] [k]__wake_up
0.00% swapper [amdgpu] [k]0x00000000002f7f81
0.00% swapper [amdgpu] [k]0x000000000046f97f
0.00% swapper [drm] [k]0x000000000003f45c
0.00% swapper [kernel.vmlinux] [k]__mod_memcg_lruvec_state
0.00% swapper [kernel.vmlinux] [k]mempool_free_slab
0.00% swapper [amdgpu] [k]0x0000000000977ef0
0.00% swapper [kernel.vmlinux] [k]x86_pmu_disable_all
0.00% swapper [amdgpu] [k]0x00000000002f7f71
0.00% kworker/3:1H-kb [kernel.vmlinux] [k]read_hpet
0.00% swapper [kernel.vmlinux] [k]psi_task_change
0.00% swapper [kernel.vmlinux] [k]perf_adjust_freq_unthr_context
0.00% swapper [kernel.vmlinux] [k]account_idle_ticks
0.00% swapper [amdgpu] [k]0x000000000045d365
0.00% swapper [kernel.vmlinux] [k]ttwu_do_activate
0.00% swapper [raid6_pq] [k]0x000000000001acc5
0.00% swapper [kernel.vmlinux] [k]enqueue_entity
0.00%wpa_supplicant[kernel.vmlinux] [k]read_hpet
0.00% swapper [amdgpu] [k]0x0000000000012205
0.00% swapper [drm] [k]0x000000000003d649
0.00% containerd [kernel.vmlinux] [k]__update_load_avg_se
0.00% rs:main Q:Reg [kernel.vmlinux] [k]futex_wake
0.00% swapper [kernel.vmlinux] [k]__x86_indirect_thunk_r13
0.00% swapper [kernel.vmlinux] [k]sched_balance_softirq
0.00% swapper [kernel.vmlinux] [k]timerqueue_del
0.00% swapper [kernel.vmlinux] [k]cpu_util#
# (Tip: Limit to show entries above 5% only: perf report --percent-limit 5) #
Signature · 1 line
Masami Hiramatsu (Google) <[email protected]>