ftrace: Changes for 6.11
Subsystems (10)
Steven Rostedt
maintainercover ftrace: Changes for 6.11
git://git.kernel.org/pub/scm/linux/kernel/git/trace/linux-trace.git
ftrace/for-next
Head SHA1: 9b5a45eb639c46c0374b5e040e6e6db386909676
Marilene A Garcia (1):
ftrace: Add missing kerneldoc parameters to unregister_ftrace_direct()
Steven Rostedt (Google) (3):
function_graph: Make fgraph_update_pid_func() a stub for !DYNAMIC_FTRACE
function_graph: Fix up ftrace_graph_ret_addr()
function_graph: Everyone uses HAVE_FUNCTION_GRAPH_RET_ADDR_PTR, remove it
----
Documentation/trace/ftrace-design.rst | 12 ------- arch/arm64/include/asm/ftrace.h | 11 ------ arch/csky/include/asm/ftrace.h | 2 -- arch/loongarch/include/asm/ftrace.h | 1 - arch/powerpc/include/asm/ftrace.h | 2 -- arch/riscv/include/asm/ftrace.h | 1 - arch/s390/include/asm/ftrace.h | 1 - arch/x86/include/asm/ftrace.h | 2 -- include/linux/ftrace.h | 2 -- kernel/trace/fgraph.c | 65 ++++++++++++----------------------- kernel/trace/ftrace.c | 2 ++ kernel/trace/ftrace_internal.h | 4 +++ 12 files changed, 28 insertions(+), 77 deletions(-)
Steven Rostedt
maintainerPATCH 1/4 function_graph: Make fgraph_update_pid_func() a stub for !DYNAMIC_FTRACE
From: "Steven Rostedt (Google)" <[email protected]>
When CONFIG_DYNAMIC_FTRACE is not set, the function fgraph_update_pid_func() doesn't do anything. Currently, most of its logic is within a "#ifdef CONFIG_DYNAMIC_FTRACE" block, but its variables were declared outside that, and when DYNAMIC_FTRACE is not set, it produces unused variable warnings.
Instead, just place it (and the helper function fgraph_pid_func()) within the #ifdef block and have the header file use a empty stub function for when DYNAMIC_FTRACE is not defined.
--- kernel/trace/fgraph.c | 4 ++-- kernel/trace/ftrace_internal.h | 4 ++++ 2 files changed, 6 insertions(+), 2 deletions(-)
kernel/trace/fgraph.c +2 -2
@@ -1138,6 +1138,7 @@ void ftrace_graph_exit_task(struct task_struct *t)kfree (ret_stack); } +#ifdef CONFIG_DYNAMIC_FTRACE static int fgraph_pid_func (struct ftrace_graph_ent *trace,struct fgraph_ops *gops) {
@@ -1164,7 +1165,6 @@ void fgraph_update_pid_func(void)if (!(graph_ops.flags &FTRACE_OPS_FL_INITIALIZED ))return ; -#ifdef CONFIG_DYNAMIC_FTRACE list_for_each_entry (op, &graph_ops.subop_list, list) {if (op->flags &FTRACE_OPS_FL_PID ) { gops = container_of(op, struct fgraph_ops, ops);
@@ -1174,8 +1174,8 @@ void fgraph_update_pid_func(void) static_call_update(fgraph_func, gops->entryfunc); } } -#endif } +#endif /* Allocate a return stack for each task */ static int start_graph_tracing (void )
kernel/trace/ftrace_internal.h +4 -0
@@ -52,7 +52,11 @@ static inline int ftrace_shutdown_subops(struct ftrace_ops *ops, struct ftrace_o#ifdef CONFIG_FUNCTION_GRAPH_TRACER extern int ftrace_graph_active; +# ifdef CONFIG_DYNAMIC_FTRACE extern void fgraph_update_pid_func (void ); +# else +static inline void fgraph_update_pid_func (void ) {} +# endif #else /* !CONFIG_FUNCTION_GRAPH_TRACER */ # define ftrace_graph_active 0static inline void fgraph_update_pid_func (void ) {}
Signature · 1 line
2.43.0
Steven Rostedt
maintainerPATCH 2/4 function_graph: Fix up ftrace_graph_ret_addr()
In reply to Steven RostedtFrom: "Steven Rostedt (Google)" <[email protected]>
Yang Li sent a patch to fix the kerneldoc of ftrace_graph_ret_addr(). While reviewing it, I realized that the comments in the entire function header needed a rewrite. When doing that, I realized that @idx parameter was being ignored. Every time this was called by the unwinder, it would start the loop at the top of the shadow stack and look for the matching stack pointer. When it found it, it would return it. When the unwinder asked for the next function, it would search from the beginning again.
In reality, it should start from where it left off. That was the reason for the @idx parameter in the first place. The first time the unwinder calls this function, the @idx pointer would contain zero. That would mean to start from the top of the stack. The function was supposed to update the @idx with the index where it found the return address, so that the next time the unwinder calls this function it doesn't have to search through the previous addresses it found (making it O(n^2)!).
This speeds up the unwinder's use of ftrace_graph_ret_addr() by an order of magnitude.
--- kernel/trace/fgraph.c | 28 ++++++++++++++++++++-------- 1 file changed, 20 insertions(+), 8 deletions(-)
kernel/trace/fgraph.c +20 -8
@@ -870,18 +870,24 @@ ftrace_graph_get_ret_stack(struct task_struct *task, int idx) }/** -* ftrace_graph_ret_addr - convert a potentially modified stack return address -* to its original value +* ftrace_graph_ret_addr - return the original value of the return address +* @task: The task the unwinder is being executed on +* @idx: An initialized pointer to the next stack index to use +* @ret: The current return address (likely pointing to return_handler) +* @retp: The address on the stack of the current return location * * This function can be called by stack unwinding code to convert a found stack -* return address ('ret') to its original value, in case the function graph +* return address (@ret) to its original value, in case the function graph * tracer has modified it to be 'return_to_handler'. If the address hasn't -* been modified, the unchanged value of 'ret' is returned. +* been modified, the unchanged value of @ret is returned. * -* 'idx' is a state variable which should be initialized by the caller to zero -* before the first call. +* @idx holds the last index used to know where to start from. It should be +* initialized to zero for the first iteration as that will mean to start +* at the top of the shadow stack. If the location is found, this pointer +* will be assigned that location so that if called again, it will continue +* where it left off. * -* 'retp' is a pointer to the return address on the stack. It's ignored if +* @retp is a pointer to the return address on the stack. It's ignored if * the arch doesn't have HAVE_FUNCTION_GRAPH_RET_ADDR_PTR defined. */ #ifdef HAVE_FUNCTION_GRAPH_RET_ADDR_PTR
@@ -895,6 +901,10 @@ unsigned long ftrace_graph_ret_addr(struct task_struct *task, int *idx,if (ret != return_handler)return ret; +if (!idx) +return ret; + + i = *idx ? : task->curr_ret_stack;while (i >0 ) { ret_stack =get_ret_stack (current, i, &i);if (!ret_stack)
@@ -908,8 +918,10 @@ unsigned long ftrace_graph_ret_addr(struct task_struct *task, int *idx,* Thus we will continue to find real return address. */ if (ret_stack->retp == retp && - ret_stack->ret != return_handler) + ret_stack->ret != return_handler) { + *idx = i;return ret_stack->ret; + } }return ret;
Signature · 1 line
2.43.0
Steven Rostedt
maintainerPATCH 3/4 function_graph: Everyone uses HAVE_FUNCTION_GRAPH_RET_ADDR_PTR, remove it
In reply to Steven RostedtFrom: "Steven Rostedt (Google)" <[email protected]>
All architectures that implement function graph also implements HAVE_FUNCTION_GRAPH_RET_ADDR_PTR. Remove it, as it is no longer a differentiator.
--- Documentation/trace/ftrace-design.rst | 12 --------- arch/arm64/include/asm/ftrace.h | 11 --------- arch/csky/include/asm/ftrace.h | 2 -- arch/loongarch/include/asm/ftrace.h | 1 - arch/powerpc/include/asm/ftrace.h | 2 -- arch/riscv/include/asm/ftrace.h | 1 - arch/s390/include/asm/ftrace.h | 1 - arch/x86/include/asm/ftrace.h | 2 -- include/linux/ftrace.h | 2 -- kernel/trace/fgraph.c | 35 +-------------------------- 10 files changed, 1 insertion(+), 68 deletions(-)
Documentation/trace/ftrace-design.rst +0 -12
@@ -217,18 +217,6 @@ along to ftrace_push_return_trace() instead of a stub value of 0. Similarly, when you call ftrace_return_to_handler(), pass it the frame pointer. -HAVE_FUNCTION_GRAPH_RET_ADDR_PTR --------------------------------- - -An arch may pass in a pointer to the return address on the stack. This -prevents potential stack unwinding issues where the unwinder gets out of -sync with ret_stack and the wrong addresses are reported by -ftrace_graph_ret_addr(). - -Adding support for it is easy: just define the macro in asm/ftrace.h and -pass the return address pointer as the 'retp' argument to -ftrace_push_return_trace(). - HAVE_SYSCALL_TRACEPOINTS ------------------------
arch/arm64/include/asm/ftrace.h +0 -11
@@ -12,17 +12,6 @@#define HAVE_FUNCTION_GRAPH_FP_TEST -/* -* HAVE_FUNCTION_GRAPH_RET_ADDR_PTR means that the architecture can provide a -* "return address pointer" which can be used to uniquely identify a return -* address which has been overwritten. -* -* On arm64 we use the address of the caller's frame record, which remains the -* same for the lifetime of the instrumented function, unlike the return -* address in the LR. -*/ -#define HAVE_FUNCTION_GRAPH_RET_ADDR_PTR -#ifdef CONFIG_DYNAMIC_FTRACE_WITH_ARGS #define ARCH_SUPPORTS_FTRACE_OPS 1#else
arch/csky/include/asm/ftrace.h +0 -2
@@ -7,8 +7,6 @@#define HAVE_FUNCTION_GRAPH_FP_TEST -#define HAVE_FUNCTION_GRAPH_RET_ADDR_PTR -#define ARCH_SUPPORTS_FTRACE_OPS 1#define MCOUNT_ADDR ((unsigned long)_mcount)
arch/loongarch/include/asm/ftrace.h +0 -1
@@ -28,7 +28,6 @@ struct dyn_ftrace;struct dyn_arch_ftrace { };#define ARCH_SUPPORTS_FTRACE_OPS 1 -#define HAVE_FUNCTION_GRAPH_RET_ADDR_PTR #define ftrace_init_nop ftrace_init_nopint ftrace_init_nop (struct module *mod,struct dyn_ftrace *rec);
arch/powerpc/include/asm/ftrace.h +0 -2
@@ -8,8 +8,6 @@#define MCOUNT_ADDR ((unsigned long)(_mcount))#define MCOUNT_INSN_SIZE 4/* sizeof mcount call */ -#define HAVE_FUNCTION_GRAPH_RET_ADDR_PTR -/* Ignore unused weak functions which will have larger offsets */ #if defined(CONFIG_MPROFILE_KERNEL ) || defined(CONFIG_ARCH_USING_PATCHABLE_FUNCTION_ENTRY )#define FTRACE_MCOUNT_MAX_OFFSET 16
arch/riscv/include/asm/ftrace.h +0 -1
@@ -11,7 +11,6 @@#if defined(CONFIG_FUNCTION_GRAPH_TRACER ) && defined(CONFIG_FRAME_POINTER )#define HAVE_FUNCTION_GRAPH_FP_TEST #endif -#define HAVE_FUNCTION_GRAPH_RET_ADDR_PTR #define ARCH_SUPPORTS_FTRACE_OPS 1#ifndef __ASSEMBLY__
arch/s390/include/asm/ftrace.h +0 -1
@@ -2,7 +2,6 @@#ifndef _ASM_S390_FTRACE_H#define _ASM_S390_FTRACE_H -#define HAVE_FUNCTION_GRAPH_RET_ADDR_PTR #define ARCH_SUPPORTS_FTRACE_OPS 1#define MCOUNT_INSN_SIZE 6
arch/x86/include/asm/ftrace.h +0 -2
@@ -20,8 +20,6 @@#define ARCH_SUPPORTS_FTRACE_OPS 1#endif -#define HAVE_FUNCTION_GRAPH_RET_ADDR_PTR -#ifndef __ASSEMBLY__extern void __fentry__ (void );
include/linux/ftrace.h +0 -2
@@ -1071,9 +1071,7 @@ struct ftrace_ret_stack {#ifdef HAVE_FUNCTION_GRAPH_FP_TEST unsigned long fp;#endif -#ifdef HAVE_FUNCTION_GRAPH_RET_ADDR_PTR unsigned long *retp; -#endif };/*
kernel/trace/fgraph.c +1 -34
@@ -593,9 +593,7 @@ ftrace_push_return_trace(unsigned long ret, unsigned long func,#ifdef HAVE_FUNCTION_GRAPH_FP_TEST ret_stack->fp = frame_pointer;#endif -#ifdef HAVE_FUNCTION_GRAPH_RET_ADDR_PTR ret_stack->retp = retp; -#endif return offset; }
@@ -887,10 +885,8 @@ ftrace_graph_get_ret_stack(struct task_struct *task, int idx)* will be assigned that location so that if called again, it will continue * where it left off. * -* @retp is a pointer to the return address on the stack. It's ignored if -* the arch doesn't have HAVE_FUNCTION_GRAPH_RET_ADDR_PTR defined. +* @retp is a pointer to the return address on the stack. */ -#ifdef HAVE_FUNCTION_GRAPH_RET_ADDR_PTR unsigned long ftrace_graph_ret_addr (struct task_struct *task,int *idx,unsigned long ret,unsigned long *retp) {
@@ -926,35 +922,6 @@ unsigned long ftrace_graph_ret_addr(struct task_struct *task, int *idx,return ret; } -#else /* !HAVE_FUNCTION_GRAPH_RET_ADDR_PTR */ -unsigned long ftrace_graph_ret_addr (struct task_struct *task,int *idx, -unsigned long ret,unsigned long *retp) -{ -struct ftrace_ret_stack *ret_stack; -unsigned long return_handler = (unsigned long )dereference_kernel_function_descriptor (return_to_handler); -int offset = task->curr_ret_stack; -int i; - -if (ret != return_handler) -return ret; - -if (!idx) -return ret; - - i = *idx; -do { - ret_stack =get_ret_stack (task, offset, &offset); -if (ret_stack && ret_stack->ret == return_handler) -continue ; - i--; - }while (i >=0 && ret_stack); - -if (ret_stack) -return ret_stack->ret; - -return ret; -} -#endif /* HAVE_FUNCTION_GRAPH_RET_ADDR_PTR */ static struct ftrace_ops graph_ops = { .func = ftrace_graph_func,
Signature · 1 line
2.43.0
Steven Rostedt
maintainerPATCH 4/4 ftrace: Add missing kerneldoc parameters to unregister_ftrace_direct()
In reply to Steven RostedtFrom: Marilene A Garcia <[email protected]>
Add the description to the parameters addr and free_filters of the function unregister_ftrace_direct().
--- kernel/trace/ftrace.c | 2 ++ 1 file changed, 2 insertions(+)
kernel/trace/ftrace.c +2 -0
@@ -5988,6 +5988,8 @@ EXPORT_SYMBOL_GPL(register_ftrace_direct);* unregister_ftrace_direct - Remove calls to custom trampoline * previously registered by register_ftrace_direct for @ops object. * @ops: The address of the struct ftrace_ops object +* @addr: The address of the direct function that is called by the @ops functions +* @free_filters: Set to true to remove all filters for the ftrace_ops, false otherwise * * This is used to remove a direct calls to @addr from the nop locations * of the functions registered in @ops (with by ftrace_set_filter_ip
Signature · 1 line
2.43.0