Skip to contentSkip to conversation

kernel/exit: do panic earlier to get coredump if global init task exit

PATCH Superseded [email protected] 4 participants 11 messages Dec 16, 2019 – Dec 18, 2019

v2 of 3 Superseded Latest is v3 →

lore
Share & tools
lore
#0 lore raw

PATCH v2 1/1 kernel/exit: do panic earlier to get coredump if global init task exit

From: chenqiwu <[email protected]>

When global init task get a chance to be killed, panic will happen in later calling steps by do_exit()->exit_notify()->forget_original_parent() ->find_child_reaper() if all init threads have exited.

However, it's hard to extract the coredump of init task from a kernel crashdump, since exit_mm() has released its mm before panic. In order to get the backtrace of init task in userspace, it's better to do panic earlier at the beginning of exitting route.

It's worth noting that we must take case of a multi-threaded init exitting issue. We need the test for is_global_init() && group_dead to ensure that it is all of init threads exiting and not just the current thread.

---
changes in v2:
- using is_global_init() && group_dead as panic condition.
- move up group_dead = atomic_dec_and_test(&tsk->signal->live).
- add comment for this change in do_exit().

---
 kernel/exit.c | 13 ++++++++-----
 1 file changed, 8 insertions(+), 5 deletions(-)
kernel/exit.c +8 -5
index bcbd598..33364c8 100644
@@ -517,10 +517,6 @@ static struct task_struct *find_child_reaper(struct task_struct *father,
 	}
 
 	write_unlock_irq(&tasklist_lock);
-	if (unlikely(pid_ns == &init_pid_ns)) {
-		panic("Attempted to kill init! exitcode=0x%08x\n",
-			father->signal->group_exit_code ?: father->exit_code);
-	}
 
 	list_for_each_entry_safe(p, n, dead, ptrace_entry) {
 		list_del_init(&p->ptrace_entry);
@@ -728,6 +724,14 @@ void __noreturn do_exit(long code)
 		panic("Attempted to kill the idle task!");
 
 	/*
+	 * If all threads of global init have exited, do panic imeddiately
+	 * to get the coredump to find any clue for init task in userspace.
+	 */
+	group_dead = atomic_dec_and_test(&tsk->signal->live);
+	if (unlikely(is_global_init(tsk) && group_dead))
+		panic("Attempted to kill init! exitcode=0x%08lx\n", code);
+
+	/*
 	 * If do_exit is called because this processes oopsed, it's possible
 	 * that get_fs() was left as KERNEL_DS, so reset it to USER_DS before
 	 * continuing. Amongst other possible reasons, this is to prevent
@@ -764,7 +768,6 @@ void __noreturn do_exit(long code)
 	if (tsk->mm)
 		sync_mm_rss(tsk->mm);
 	acct_update_integrals(tsk);
-	group_dead = atomic_dec_and_test(&tsk->signal->live);
 	if (group_dead) {
 #ifdef CONFIG_POSIX_TIMERS
 		hrtimer_cancel(&tsk->signal->real_timer);
Signature · 1 line
1.9.1
Reviewed-by on v2 1/1
#1 lore raw
Quoted 11 lines · On Mon, Dec 16, 2019 at 11:18:44AM +0800, [email protected] wrote:

From: chenqiwu <[email protected]>

When global init task get a chance to be killed, panic will happen in later calling steps by do_exit()->exit_notify()->forget_original_parent() ->find_child_reaper() if all init threads have exited.

However, it's hard to extract the coredump of init task from a kernel crashdump, since exit_mm() has released its mm before panic. In order to get the backtrace of init task in userspace, it's better to do panic earlier at the beginning of exitting route.

Quoted 5 lines

It's worth noting that we must take case of a multi-threaded init exitting issue. We need the test for is_global_init() && group_dead to ensure that it is all of init threads exiting and not just the current thread.

Just a comment and a nit I can fixup myself.

Oleg, wdyt?

Quoted 14 lines

---
changes in v2:
- using is_global_init() && group_dead as panic condition.
- move up group_dead = atomic_dec_and_test(&tsk->signal->live).
- add comment for this change in do_exit().

---
 kernel/exit.c | 13 ++++++++-----
 1 file changed, 8 insertions(+), 5 deletions(-)
kernel/exit.c +0 -0
index bcbd598..33364c8 100644

kernel/exit.c static struct task_struct *find_child_reaper(struct task_struct *father, · line 523

Quoted 7 lines
kernel/exit.c +0 -4
@@ -517,10 +517,6 @@ static struct task_struct *find_child_reaper(struct task_struct *father,
 	}
 
 	write_unlock_irq(&tasklist_lock);
-	if (unlikely(pid_ns == &init_pid_ns)) {
-		panic("Attempted to kill init! exitcode=0x%08x\n",
-			father->signal->group_exit_code ?: father->exit_code);
-	}

This made me queasy at first but from what I can see this is safe to remove. We could've only gotten here if:
task == child_reaper && !find_alive_thread() && pid_ns == init_pid_ns that should be equivalent to the new
is_global_init(tsk) && group_dead
check, i.e. I think there's no condition we might loose by removing this check.

kernel/exit.c void __noreturn do_exit(long code) · line 727

Quoted 8 lines
kernel/exit.c +1 -0
 	list_for_each_entry_safe(p, n, dead, ptrace_entry) {
 		list_del_init(&p->ptrace_entry);
@@ -728,6 +724,14 @@ void __noreturn do_exit(long code)
 		panic("Attempted to kill the idle task!");
 
 	/*
+	 * If all threads of global init have exited, do panic imeddiately

Nit: s/imeddiately/immediately/

but I can fix this up when applying.

Quoted 21 lines
kernel/exit.c +7 -1
+	 * to get the coredump to find any clue for init task in userspace.
+	 */
+	group_dead = atomic_dec_and_test(&tsk->signal->live);
+	if (unlikely(is_global_init(tsk) && group_dead))
+		panic("Attempted to kill init! exitcode=0x%08lx\n", code);
+
+	/*
 	 * If do_exit is called because this processes oopsed, it's possible
 	 * that get_fs() was left as KERNEL_DS, so reset it to USER_DS before
 	 * continuing. Amongst other possible reasons, this is to prevent
@@ -764,7 +768,6 @@ void __noreturn do_exit(long code)
 	if (tsk->mm)
 		sync_mm_rss(tsk->mm);
 	acct_update_integrals(tsk);
-	group_dead = atomic_dec_and_test(&tsk->signal->live);
 	if (group_dead) {
 #ifdef CONFIG_POSIX_TIMERS
 		hrtimer_cancel(&tsk->signal->real_timer);
Signature · 1 line
1.9.1
#2 lore raw
In reply to [email protected]

kernel/exit.c void __noreturn do_exit(long code) · line 732

Quoted 7 lines · On 12/16, [email protected] wrote:
kernel/exit.c +6 -0
+	 * If all threads of global init have exited, do panic imeddiately
+	 * to get the coredump to find any clue for init task in userspace.
+	 */
+	group_dead = atomic_dec_and_test(&tsk->signal->live);
+	if (unlikely(is_global_init(tsk) && group_dead))
+		panic("Attempted to kill init! exitcode=0x%08lx\n", code);
                                                                    ^^^^

No, we should not throw out the useful info, please use

	signal->group_exit_code ?: code

as the current code does.

And I am worried atomic_dec_and_test() is called too early...

Say, acct_process() can report the exit while some sub-thread sleeps in PTRACE_EVENT_EXIT? I'd prefer to not move it up too much, at least before exit_signals().

Oleg.

#3 lore raw
Quoted 12 lines · Oleg Nesterov

kernel/exit.c void __noreturn do_exit(long code) · line 732

Quoted 7 lines · On 12/16, [email protected] wrote:
kernel/exit.c +6 -0
+	 * If all threads of global init have exited, do panic imeddiately
+	 * to get the coredump to find any clue for init task in userspace.
+	 */
+	group_dead = atomic_dec_and_test(&tsk->signal->live);
+	if (unlikely(is_global_init(tsk) && group_dead))
+		panic("Attempted to kill init! exitcode=0x%08lx\n", code);
                                                                    ^^^^

No, we should not throw out the useful info, please use

Quoted 7 lines
	signal->group_exit_code ?: code

as the current code does.

And I am worried atomic_dec_and_test() is called too early...

Say, acct_process() can report the exit while some sub-thread sleeps

Hm, I'm not following here. I might just be slow. acct_process() doesn't seem to report exit status and has been called after group_dead before.

Christian

author
#4 lore raw
Quoted 17 lines · Christian Brauner
Quoted 16 lines · Oleg Nesterov

Review

Quoted 7 lines · On 12/16, [email protected] wrote:
(quoted diff) +6 -0
+	 * If all threads of global init have exited, do panic imeddiately
+	 * to get the coredump to find any clue for init task in userspace.
+	 */
+	group_dead = atomic_dec_and_test(&tsk->signal->live);
+	if (unlikely(is_global_init(tsk) && group_dead))
+		panic("Attempted to kill init! exitcode=0x%08lx\n", code);
                                                                    ^^^^

No, we should not throw out the useful info, please use

	signal->group_exit_code ?: code

as the current code does.

Quoted 8 lines
Quoted 3 lines

And I am worried atomic_dec_and_test() is called too early...

Say, acct_process() can report the exit while some sub-thread sleeps

Hm, I'm not following here. I might just be slow. acct_process() doesn't seem to report exit status and has been called after group_dead before.

Christian

I agree using signal->group_exit_code ?: code is better, because there is a possibilty that the exit of main init thread is called by complete_and_exit() not by a normal exit route (get_signal()->do_group_exit()). For this case, signal->group_exit_code maybe NULL, so the arg of code should be the exitcode.

And I agree we should not move up group_dead too much. What Oleg has mentioned is just one case, what's more, there is a possibilty that some sub-threads sleep in exit_signals()->threadgroup_change_begin() and not do real exit, the main thread will do panic if all sub-threads do exit since the group_dead is 0.

For workaroud such case, I think the patch should be:

kernel/exit.c +9 -4
index bcbd598..58d90e1 100644
@@ -517,10 +517,6 @@ static struct task_struct *find_child_reaper(struct task_struct *father,
        }
 
        write_unlock_irq(&tasklist_lock);
-       if (unlikely(pid_ns == &init_pid_ns)) {
-               panic("Attempted to kill init! exitcode=0x%08x\n",
-                       father->signal->group_exit_code ?: father->exit_code);
-       }
 
        list_for_each_entry_safe(p, n, dead, ptrace_entry) {
                list_del_init(&p->ptrace_entry);
@@ -728,6 +724,15 @@ void __noreturn do_exit(long code)
                panic("Attempted to kill the idle task!");
 
        /*
+        * If all threads of global init have exited, do panic imeddiately
+        * to get the coredump to find any clue for init task in userspace.
+        */
+       if (unlikely(is_global_init(tsk) &&
+               (atomic_read(&tsk->signal->live) == 1)))
+               panic("Attempted to kill init! exitcode=0x%08x\n",
+                       tsk->signal->group_exit_code ?: (int)code);
+
+       /*
         * If do_exit is called because this processes oopsed, it's possible
         * that get_fs() was left as KERNEL_DS, so reset it to USER_DS before
         * continuing. Amongst other possible reasons, this is to prevent
#5 lore raw

kernel/exit.c void __noreturn do_exit(long code) · line 731

Quoted 10 lines · chenqiwu
kernel/exit.c +5 -0
@@ -728,6 +724,15 @@ void __noreturn do_exit(long code)
                panic("Attempted to kill the idle task!");
 
        /*
+        * If all threads of global init have exited, do panic imeddiately
+        * to get the coredump to find any clue for init task in userspace.
+        */
+       if (unlikely(is_global_init(tsk) &&
+               (atomic_read(&tsk->signal->live) == 1)))

Well, I guess this will work in practice, but in theory this is racy.

Suppose that signal->live == 2 and both threads exit in parallel. They both can see tsk->signal->live == 2 before atomic_dec_and_test().

If you are fine with this race I won't object, but please add a comment.

But why can't you simply do

	--- x/kernel/exit.c
	+++ x/kernel/exit.c
	@@ -786,6 +786,8 @@ void __noreturn do_exit(long code)
		acct_update_integrals(tsk);
		group_dead = atomic_dec_and_test(&tsk->signal->live);
		if (group_dead) {
	+		if (unlikely(is_global_init(tsk)
	+			panic(...);
	 #ifdef CONFIG_POSIX_TIMERS
			hrtimer_cancel(&tsk->signal->real_timer);
			exit_itimers(tsk->signal);

?

Oleg.

author
#6 lore raw
Quoted 33 lines · Oleg Nesterov

kernel/exit.c void __noreturn do_exit(long code) · line 731

Quoted 10 lines · chenqiwu
kernel/exit.c +5 -0
@@ -728,6 +724,15 @@ void __noreturn do_exit(long code)
                panic("Attempted to kill the idle task!");
 
        /*
+        * If all threads of global init have exited, do panic imeddiately
+        * to get the coredump to find any clue for init task in userspace.
+        */
+       if (unlikely(is_global_init(tsk) &&
+               (atomic_read(&tsk->signal->live) == 1)))

Well, I guess this will work in practice, but in theory this is racy.

Suppose that signal->live == 2 and both threads exit in parallel. They both can see tsk->signal->live == 2 before atomic_dec_and_test().

If you are fine with this race I won't object, but please add a comment.

But why can't you simply do

	--- x/kernel/exit.c
	+++ x/kernel/exit.c
	@@ -786,6 +786,8 @@ void __noreturn do_exit(long code)
		acct_update_integrals(tsk);
		group_dead = atomic_dec_and_test(&tsk->signal->live);
		if (group_dead) {
	+		if (unlikely(is_global_init(tsk)
	+			panic(...);
	 #ifdef CONFIG_POSIX_TIMERS
			hrtimer_cancel(&tsk->signal->real_timer);
			exit_itimers(tsk->signal);
Quoted 4 lines

?

Oleg.

Oh, yeah, thanks for your reminds! But in fact, I think atomic_read() can avoid the racy even if both threads exit in parallel, since it is an atomic operation forever. I agree your simply modify, is there any other questions?

#7 lore raw
Quoted 4 lines · chenqiwu

But in fact, I think atomic_read()
can avoid the racy even if both threads exit in parallel, since it is an atomic operation forever.

Hmm, not sure I understand. atomic_read() is just READ_ONCE(), it can't be re-ordered but that is all.

How can it avoid the race if it is called before atomic_dec_and_test() ?

Again, suppose that we have 2 exiting threads and signal->live == 2. With your patch each thread does atomic_read() before atomic_dec_and_test(), both threads can observe atomic_read(signal->live) == 2 simply because the counter was not decremented yet.

Oleg.

#8 lore raw
Quoted 8 lines · Oleg Nesterov
Quoted 4 lines · chenqiwu

But in fact, I think atomic_read()
can avoid the racy even if both threads exit in parallel, since it is an atomic operation forever.

Hmm, not sure I understand. atomic_read() is just READ_ONCE(), it can't be re-ordered but that is all.

That, atomic_read() is just a read. It doesn't modify the variable, therefore there isn't anything 'atomic' even remotely possible.

author
#9 lore raw
In reply to Oleg Nesterov
Quoted 9 lines · Oleg Nesterov
Quoted 4 lines · chenqiwu

But in fact, I think atomic_read()
can avoid the racy even if both threads exit in parallel, since it is an atomic operation forever.

Hmm, not sure I understand. atomic_read() is just READ_ONCE(), it can't be re-ordered but that is all.

Quoted 9 lines

How can it avoid the race if it is called before atomic_dec_and_test() ?

Again, suppose that we have 2 exiting threads and signal->live == 2. With your patch each thread does atomic_read() before atomic_dec_and_test(), both threads can observe atomic_read(signal->live) == 2 simply because the counter was not decremented yet.

Oleg.

Yeah, I agree your idea.
Now, if there are no further questions, I will resend this as a proper patch for v3.

#10 lore raw
In reply to Christian Brauner
Quoted 9 lines · Christian Brauner
Quoted 4 lines · Oleg Nesterov

And I am worried atomic_dec_and_test() is called too early...

Say, acct_process() can report the exit while some sub-thread sleeps

Hm, I'm not following here. I might just be slow. acct_process() doesn't seem to report exit status and has been called after group_dead before.

Yes, but with this patch group_dead becomes true before the process is "dead enough".

Suppose a process has 2 threads, T1, and T2.

T1 exits, decrements signal->live, and sleeps in PTRACE_EVENT_EXIT.

T2 exits, decrements signal->live, group_dead == T, it calls acct_process() which reports the fact this process has exited. Probably not a real problem, but still strange, this process has not exited yet, it is not even a zombie.

Oleg.