kprobes: x86: Cleanup jprobe implementation on x86
Subsystems (5)
Masami Hiramatsu
maintainerv2 cover kprobes: x86: Cleanup jprobe implementation on x86
Hello,
Since we decided to remove jprobe from kernel last year, its APIs are disabled and we worked on moving in-kernel jprobe users to kprobes or trace-events. And now no jprobe users are here anymore.
This series removes jprobe implementation from x86 and generic code. I would like to send other series for each arch. After all those patches are merged, I will remove jprobes APIs and data structures, since changing those definitions will break build on other archs.
Here is the series of patches to show how to do that. I've dropped arch-independent header changes from this version and merged kprobe-user code changes into the last patch since that changed the kprobes expected behavior when the kprobes modifies execution path. (no need to enable preempt anymore)
- Remove jprobe functions (register/unregister, setjump/longjump) from generic/arch-dependent code. [1/5][2/5]
- Remove break_handler related code. [3/5][4/5]
- Do not disable preemption on exception handler [5/5]
As I said above, the last patch [5/5] will change the expected behavior on x86. Other archs also have to change it. But anyway, currently such execution-path modifying users in tree are very limited and only works on x86. So we can safely modify it.
Thank you,
---
Masami Hiramatsu (5):
kprobes: Remove jprobe API implementation
x86: kprobes: Remove jprobe implementation
kprobes: Ignore break_handler
x86: kprobes: Ignore break_handler
x86: kprobes: Do not disable preempt on int3 path
Documentation/kprobes.txt | 13 ++-- arch/x86/include/asm/kprobes.h | 3 - arch/x86/kernel/kprobes/common.h | 10 --- arch/x86/kernel/kprobes/core.c | 114 ++------------------------------------ arch/x86/kernel/kprobes/ftrace.c | 21 +------ arch/x86/kernel/kprobes/opt.c | 1 include/linux/kprobes.h | 3 - kernel/fail_function.c | 1 kernel/kprobes.c | 115 ++------------------------------------ kernel/trace/trace_kprobe.c | 3 - 10 files changed, 20 insertions(+), 264 deletions(-)
--
Masami Hiramatsu (Linaro)
Masami Hiramatsu
maintainerPATCH v2 1/5 kprobes: Remove jprobe API implementation
Remove jprobe API implementations which is no more used.
--- include/linux/kprobes.h | 3 -- kernel/kprobes.c | 78 +---------------------------------------------- 2 files changed, 1 insertion(+), 80 deletions(-)
include/linux/kprobes.h +0 -3
@@ -389,9 +389,6 @@ int register_kprobe(struct kprobe *p);void unregister_kprobe (struct kprobe *p);int register_kprobes (struct kprobe **kps,int num);void unregister_kprobes (struct kprobe **kps,int num); -int setjmp_pre_handler (struct kprobe *,struct pt_regs *); -int longjmp_break_handler (struct kprobe *,struct pt_regs *); -void jprobe_return (void );unsigned long arch_deref_entry_point (void *);int register_kretprobe (struct kretprobe *rp);
kernel/kprobes.c +1 -77
99 lines not on this page · raw message
Masami Hiramatsu
maintainerPATCH v2 2/5 x86: kprobes: Remove jprobe implementation
In reply to Masami HiramatsuRemove arch dependent setjump/longjump functions
and unused fields in kprobe_ctlblk for jprobes.
--- arch/x86/include/asm/kprobes.h | 3 - arch/x86/kernel/kprobes/core.c | 87 ---------------------------------------- 2 files changed, 90 deletions(-)
arch/x86/include/asm/kprobes.h +0 -3
@@ -111,9 +111,6 @@ struct kprobe_ctlblk {unsigned long kprobe_status;unsigned long kprobe_old_flags;unsigned long kprobe_saved_flags; -unsigned long *jprobe_saved_sp; -struct pt_regs jprobe_saved_regs; -kprobe_opcode_t jprobes_stack[MAX_STACK_SIZE ];struct prev_kprobe prev_kprobe; };
arch/x86/kernel/kprobes/core.c +0 -87
93 lines not on this page · raw message
Masami Hiramatsu
maintainerPATCH v2 3/5 kprobes: Ignore break_handler
In reply to Masami HiramatsuIgnore break_handler related code because it was only used by jprobe and jprobe is removed.
--- Documentation/kprobes.txt | 2 +- kernel/kprobes.c | 39 +++++---------------------------------- 2 files changed, 6 insertions(+), 35 deletions(-)
Documentation/kprobes.txt +1 -1
@@ -262,7 +262,7 @@ is optimized, that modification is ignored. Thus, if you want to tweak the kernel's execution path, you need to suppress optimization, using one of the following techniques: -- Specify an empty function for the kprobe's post_handler or break_handler. +- Specify an empty function for the kprobe's post_handler. or
kernel/kprobes.c +5 -34
@@ -627,8 +627,8 @@ static void optimize_kprobe(struct kprobe *p) (kprobe_disabled(p) || kprobes_all_disarmed)) return; -/* Both of break_handler and post_handler are not supported. */ -if (p->break_handler || p->post_handler) +/* kprobes with post_handler can not be optimized */ +if (p->post_handler)return ; op = container_of(p, struct optimized_kprobe, kp);
@@ -1116,20 +1116,6 @@ static int aggr_fault_handler(struct kprobe *p, struct pt_regs *regs, }NOKPROBE_SYMBOL (aggr_fault_handler); -static int aggr_break_handler (struct kprobe *p,struct pt_regs *regs) -{ -struct kprobe *cur =__this_cpu_read (kprobe_instance); -int ret =0 ; - -if (cur && cur->break_handler) { -if (cur->break_handler (cur, regs)) - ret =1 ; - } -reset_kprobe_instance (); -return ret; -} -NOKPROBE_SYMBOL (aggr_break_handler); -/* Walks the list and increments nmissed count for multiprobe case */ void kprobes_inc_nmissed_count (struct kprobe *p) {
@@ -1270,24 +1256,15 @@ static void cleanup_rp_inst(struct kretprobe *rp) }NOKPROBE_SYMBOL (cleanup_rp_inst); -/* -* Add the new probe to ap->list. Fail if this is the -* second break_handler at the address -*/ +/* Add the new probe to ap->list */ static int add_new_kprobe (struct kprobe *ap,struct kprobe *p) {BUG_ON (kprobe_gone (ap) ||kprobe_gone (p)); -if (p->break_handler || p->post_handler) +if (p->post_handler)unoptimize_kprobe (ap, true);/* Fall back to normal kprobe */ -if (p->break_handler) { -if (ap->break_handler) -return -EEXIST ; -list_add_tail_rcu (&p->list, &ap->list); - ap->break_handler = aggr_break_handler; - }else -list_add_rcu (&p->list, &ap->list); +list_add_rcu (&p->list, &ap->list);if (p->post_handler && !ap->post_handler) ap->post_handler = aggr_post_handler;
@@ -1310,8 +1287,6 @@ static void init_aggr_kprobe(struct kprobe *ap, struct kprobe *p)/* We don't care the kprobe which has gone. */ if (p->post_handler && !kprobe_gone (p)) ap->post_handler = aggr_post_handler; -if (p->break_handler && !kprobe_gone (p)) - ap->break_handler = aggr_break_handler;INIT_LIST_HEAD (&ap->list);INIT_HLIST_NODE (&ap->hlist);
@@ -1706,8 +1681,6 @@ static int __unregister_kprobe_top(struct kprobe *p) goto disarmed; else {/* If disabling probe has special handlers, update aggrprobe */ -if (p->break_handler && !kprobe_gone (p)) - ap->break_handler =NULL ;if (p->post_handler && !kprobe_gone (p)) {list_for_each_entry_rcu (list_p, &ap->list, list) {if ((list_p != p) && (list_p->post_handler))
@@ -1911,7 +1884,6 @@ int register_kretprobe(struct kretprobe *rp) rp->kp.pre_handler = pre_handler_kretprobe; rp->kp.post_handler =NULL ; rp->kp.fault_handler =NULL ; - rp->kp.break_handler =NULL ;/* Pre-allocate memory for max kretprobe instances */ if (rp->maxactive <=0 ) {
@@ -2034,7 +2006,6 @@ static void kill_kprobe(struct kprobe *p)list_for_each_entry_rcu (kp, &p->list, list) kp->flags |=KPROBE_FLAG_GONE ; p->post_handler =NULL ; - p->break_handler =NULL ;kill_optimized_kprobe (p); }/*
Masami Hiramatsu
maintainerPATCH v2 4/5 x86: kprobes: Ignore break_handler
In reply to Masami HiramatsuRemove break_handler related code since that was used only for jprobe and jprobe is removed now.
--- arch/x86/kernel/kprobes/common.h | 10 ---------- arch/x86/kernel/kprobes/core.c | 13 ++----------- arch/x86/kernel/kprobes/ftrace.c | 16 ++-------------- 3 files changed, 4 insertions(+), 35 deletions(-)
arch/x86/kernel/kprobes/common.h +0 -10
@@ -105,14 +105,4 @@ static inline unsigned long __recover_optprobed_insn(kprobe_opcode_t *buf, unsig }#endif -#ifdef CONFIG_KPROBES_ON_FTRACE -extern int skip_singlestep (struct kprobe *p,struct pt_regs *regs, -struct kprobe_ctlblk *kcb); -#else -static inline int skip_singlestep (struct kprobe *p,struct pt_regs *regs, -struct kprobe_ctlblk *kcb) -{ -return 0 ; -} -#endif #endif
arch/x86/kernel/kprobes/core.c +2 -11
@@ -686,10 +686,8 @@ int kprobe_int3_handler(struct pt_regs *regs)/* * If we have no pre-handler or it returned 0, we * continue with normal processing. If we have a -* pre-handler and it returned non-zero, it prepped -* for calling the break_handler below on re-entry -* for jprobe processing, so get out doing nothing -* more here. +* pre-handler and it returned non-zero, it modified +* regs->ip so no singlestep is needed. */ if (!p->pre_handler || !p->pre_handler (p, regs))setup_singlestep (p, regs, kcb,0 );
@@ -708,13 +706,6 @@ int kprobe_int3_handler(struct pt_regs *regs) regs->ip = (unsigned long )addr;preempt_enable_no_resched ();return 1 ; - }else if (kprobe_running ()) { - p =__this_cpu_read (current_kprobe); -if (p->break_handler && p->break_handler (p, regs)) { -if (!skip_singlestep (p, regs, kcb)) -setup_singlestep (p, regs, kcb,0 ); -return 1 ; - } }/* else: not a kprobe fault; let the kernel handle it */ preempt_enable_no_resched ();
arch/x86/kernel/kprobes/ftrace.c +2 -14
@@ -26,7 +26,7 @@#include "common.h" static nokprobe_inline -void __skip_singlestep(struct kprobe *p, struct pt_regs *regs, +void skip_singlestep(struct kprobe *p, struct pt_regs *regs,struct kprobe_ctlblk *kcb,unsigned long orig_ip) {/*
@@ -43,18 +43,6 @@ void __skip_singlestep(struct kprobe *p, struct pt_regs *regs, regs->ip = orig_ip; } -int skip_singlestep (struct kprobe *p,struct pt_regs *regs, -struct kprobe_ctlblk *kcb) -{ -if (kprobe_ftrace (p)) { -__skip_singlestep (p, regs, kcb,0 ); -preempt_enable_no_resched (); -return 1 ; - } -return 0 ; -} -NOKPROBE_SYMBOL (skip_singlestep); -/* Ftrace callback handler for kprobes -- called under preepmt disabed */ void kprobe_ftrace_handler (unsigned long ip,unsigned long parent_ip,struct ftrace_ops *ops,struct pt_regs *regs)
@@ -80,7 +68,7 @@ void kprobe_ftrace_handler(unsigned long ip, unsigned long parent_ip,__this_cpu_write (current_kprobe, p); kcb->kprobe_status =KPROBE_HIT_ACTIVE ;if (!p->pre_handler || !p->pre_handler (p, regs)) { -__skip_singlestep (p, regs, kcb, orig_ip); +skip_singlestep (p, regs, kcb, orig_ip);preempt_enable_no_resched (); }/*
Masami Hiramatsu
maintainerPATCH v2 5/5 x86: kprobes: Do not disable preempt on int3 path
In reply to Masami HiramatsuSince int3 and debug exception(for singlestep) are run with IRQ disabled and while running single stepping we drop IF from regs->flags, that path must not be preemptible. So we can remove the preempt disable/enable calls from that path.
Note that, this changes the behavior of execution path override which is done by modifying regs->ip in pre_handler(). Previously it requires reset_current_kprobe(), enable preempt and return !0.
With this change, preempt count is not changed on int3 path, so user no need to enable preempt. To fit this behavior, this modifies ftrace-based kprobe too. In total, pre_handler() does not need to recover preempt count even if it changes regs->ip.
Quoted 1 line
From above reason, this includes 2 kprobes-users which changes
regs->ip changes. Both depend on CONFIG_FUNCTION_ERROR_INJECTION which is currently implemented only on x86. This means it is enough to change x86 kprobes implementation just for these users.
Of course, since this changes the kprobes behavior when it changes execution path, we also have to update kprobes on each arch before implementing CONFIG_FUNCTION_ERROR_INJECTION.
---
Changes in v2:
- Include user-side changes.
--- Documentation/kprobes.txt | 11 +++++------ arch/x86/kernel/kprobes/core.c | 14 +++----------- arch/x86/kernel/kprobes/ftrace.c | 5 ++--- arch/x86/kernel/kprobes/opt.c | 1 - kernel/fail_function.c | 1 - kernel/trace/trace_kprobe.c | 3 --- 6 files changed, 10 insertions(+), 25 deletions(-)
Documentation/kprobes.txt +5 -6
@@ -566,12 +566,11 @@ the same handler) may run concurrently on different CPUs. Kprobes does not use mutexes or allocate memory except during registration and unregistration. -Probe handlers are run with preemption disabled. Depending on the -architecture and optimization state, handlers may also run with -interrupts disabled (e.g., kretprobe handlers and optimized kprobe -handlers run without interrupt disabled on x86/x86-64). In any case, -your handler should not yield the CPU (e.g., by attempting to acquire -a semaphore). +Probe handlers are run with preemption disabled or interrupt disabled, +which depends on the architecture and optimization state. (e.g., +kretprobe handlers and optimized kprobe handlers run without interrupt +disabled on x86/x86-64). In any case, your handler should not yield +the CPU (e.g., by attempting to acquire a semaphore, or waiting I/O). Since a return probe is implemented by replacing the return address with the trampoline's address, stack backtraces and calls
arch/x86/kernel/kprobes/core.c +3 -11
@@ -592,7 +592,6 @@ static void setup_singlestep(struct kprobe *p, struct pt_regs *regs,* stepping. */ regs->ip = (unsigned long )p->ainsn.insn; -preempt_enable_no_resched (); return; }#endif
@@ -665,12 +664,10 @@ int kprobe_int3_handler(struct pt_regs *regs) addr = (kprobe_opcode_t *)(regs->ip -sizeof (kprobe_opcode_t));/* -* We don't want to be preempted for the entire -* duration of kprobe processing. We conditionally -* re-enable preemption at the end of this function, -* and also in reenter_kprobe() and setup_singlestep(). +* We don't want to be preempted for the entire duration of kprobe +* processing. Since int3 and debug trap disables irqs and we clear +* IF while singlestepping, it must be no preemptible. */ -preempt_disable (); kcb =get_kprobe_ctlblk (); p =get_kprobe (addr);
@@ -704,11 +701,9 @@ int kprobe_int3_handler(struct pt_regs *regs)* the original instruction. */ regs->ip = (unsigned long )addr; -preempt_enable_no_resched ();return 1 ; }/* else: not a kprobe fault; let the kernel handle it */ -preempt_enable_no_resched ();return 0 ; }NOKPROBE_SYMBOL (kprobe_int3_handler);
@@ -959,8 +954,6 @@ int kprobe_debug_handler(struct pt_regs *regs) }reset_current_kprobe (); out: -preempt_enable_no_resched (); -/* * if somebody else is singlestepping across a probe point, flags * will have TF set, in which case, continue the remaining processing
@@ -1007,7 +1000,6 @@ int kprobe_fault_handler(struct pt_regs *regs, int trapnr)restore_previous_kprobe (kcb); elsereset_current_kprobe (); -preempt_enable_no_resched (); }else if (kcb->kprobe_status ==KPROBE_HIT_ACTIVE || kcb->kprobe_status ==KPROBE_HIT_SSDONE ) {/*
arch/x86/kernel/kprobes/ftrace.c +2 -3
@@ -67,10 +67,9 @@ void kprobe_ftrace_handler(unsigned long ip, unsigned long parent_ip,preempt_disable ();__this_cpu_write (current_kprobe, p); kcb->kprobe_status =KPROBE_HIT_ACTIVE ; -if (!p->pre_handler || !p->pre_handler (p, regs)) { +if (!p->pre_handler || !p->pre_handler (p, regs))skip_singlestep (p, regs, kcb, orig_ip); -preempt_enable_no_resched (); - } +preempt_enable_no_resched ();/* * If pre_handler returns !0, it sets regs->ip and * resets current kprobe, and keep preempt count +1.
arch/x86/kernel/kprobes/opt.c +0 -1
@@ -491,7 +491,6 @@ int setup_detour_execution(struct kprobe *p, struct pt_regs *regs, int reenter) regs->ip = (unsigned long )op->optinsn.insn +TMPL_END_IDX ;if (!reenter)reset_current_kprobe (); -preempt_enable_no_resched ();return 1 ; }return 0 ;
kernel/fail_function.c +0 -1
@@ -176,7 +176,6 @@ static int fei_kprobe_handler(struct kprobe *kp, struct pt_regs *regs)override_function_with_return (regs);/* Kprobe specific fixup */ reset_current_kprobe (); -preempt_enable_no_resched ();return 1 ; }
kernel/trace/trace_kprobe.c +0 -3
@@ -1221,12 +1221,9 @@ kprobe_perf_func(struct trace_kprobe *tk, struct pt_regs *regs)* We need to check and see if we modified the pc of the * pt_regs, and if so clear the kprobe and return 1 so that we * don't do the single stepping. -* The ftrace kprobe handler leaves it up to us to re-enable -* preemption here before returning if we've modified the ip. */ if (orig_ip !=instruction_pointer (regs)) {reset_current_kprobe (); -preempt_enable_no_resched ();return 1 ; }if (!ret)
Masami Hiramatsu
maintainerQuoted 28 lines · On Mon, 12 Mar 2018 23:40:55 +0900 Masami Hiramatsu <[email protected]> wrote:
Hello,
Since we decided to remove jprobe from kernel last year, its APIs are disabled and we worked on moving in-kernel jprobe users to kprobes or trace-events. And now no jprobe users are here anymore.
This series removes jprobe implementation from x86 and generic code. I would like to send other series for each arch. After all those patches are merged, I will remove jprobes APIs and data structures, since changing those definitions will break build on other archs.
Here is the series of patches to show how to do that. I've dropped arch-independent header changes from this version and merged kprobe-user code changes into the last patch since that changed the kprobes expected behavior when the kprobes modifies execution path. (no need to enable preempt anymore)
- Remove jprobe functions (register/unregister, setjump/longjump) from generic/arch-dependent code. [1/5][2/5]
- Removebreak_handlerrelated code. [3/5][4/5]
- Do not disable preemption on exception handler [5/5]
Quoted 5 lines
As I said above, the last patch [5/5] will change the expected behavior on x86. Other archs also have to change it. But anyway, currently such execution-path modifying users in tree are very limited and only works on x86. So we can safely modify it.
Ah, I forgot I had sent this in March...
Basically, this is same thing what I sent last week, and this is more aggressively removing all the jprobes related code including break_handler. I would like to merge both series and start sending new series, including removing jprobe test code too.
Thank you,
Signature · 1 line
Masami Hiramatsu <[email protected]>