Patch "coredump: Standartize and fix logging" has been added to the 6.10-stable tree
A message that is not in the archive (sent off-list or not yet received): [email protected]
Sasha,
Thank you very much for taking this to the stable kernel! With the 6.12-rc1, folks saw unkillable processes, and the suspicion was that get_task_comm() takes a lock on the task_struct.
Kees was kind enough to look into that and sent out
https://lore.kernel.org/all/[email protected]/.
As much as I'd love to see these logs produced by the kernel to help with core dump diagnostics, I am really worried that lock might cause more harm than the patches bring value, let alone this is a stable kernel, and as I understand, folks might run very important workloads trusting the stable kernel.
If you see why these patches are good for the stable kernel (e.g. there is no lock as in 6.12), I trust your judgement. Added Kees and Eric in hopes they have time to help if this is a good change for the stable kernel.
Thank you all for your help!
Quoted 186 lines · Sasha Levin
This is a note to let you know that I've just added the patch titled
coredump: Standartize and fix logging
to the 6.10-stable tree which can be found at:
http://www.kernel.org/git/?p=linux/kernel/git/stable/stable-queue.git;a=summaryThe filename of the patch is:
coredump-standartize-and-fix-logging.patch
and it can be found in the queue-6.10 subdirectory.If you, or anyone else, feels it should not be added to the stable tree, please let <[email protected]> know about it.
commit
f0a5649db30d6ff2509281ace680db9cc08ce258Author: Roman Kisel <[email protected]> Date: Thu Jul 18 11:27:24 2024 -0700coredump: Standartize and fix logging
[ Upstream commit
c114e9948c2b6a0b400266e59cc656b59e795bca]The coredump code does not log the process ID and the comm consistently, logs unescaped comm when it does log it, and does not always use the ratelimited logging. That makes it harder to analyze logs and puts the system at the risk of spamming the system log incase something crashes many times over and over again.
Fix that by logging TGID and comm (escaped) consistently and using the ratelimited logging always.
Signed-off-by Roman Kisel <[email protected]>Tested-by Allen Pais <[email protected]>Signed-off-by Kees Cook <[email protected]>Signed-off-by Sasha Levin <[email protected]>fs/coredump.c +16
-27@@ -586,8 +586,7 @@ void do_coredump(const kernel_siginfo_t *siginfo)struct subprocess_info *sub_info;if (ispipe <0 ) { -printk (KERN_WARNING "format_corename failed\n" ); -printk (KERN_WARNING "Aborting core\n" ); +coredump_report_failure ("format_corename failed, aborting core" ); goto fail_unlock; }@@ -607,27 +606,21 @@ void do_coredump(const kernel_siginfo_t *siginfo)* right pid if a thread in a multi-threaded * core_pattern process dies. */ -printk (KERN_WARNING -"Process %d(%s) has RLIMIT_CORE set to 1\n" , -task_tgid_vnr (current), current->comm); -printk (KERN_WARNING "Aborting core\n" ); +coredump_report_failure ("RLIMIT_CORE is set to 1, aborting core" ); goto fail_unlock; } cprm.limit =RLIM_INFINITY ; dump_count =atomic_inc_return (&core_dump_count);if (core_pipe_limit && (core_pipe_limit < dump_count)) { -printk (KERN_WARNING "Pid %d(%s) over core_pipe_limit\n" , -task_tgid_vnr (current), current->comm); -printk (KERN_WARNING "Skipping core dump\n" ); +coredump_report_failure ("over core_pipe_limit, skipping core dump" ); goto fail_dropcount; } helper_argv =kmalloc_array (argc +1 ,sizeof (*helper_argv),GFP_KERNEL );if (!helper_argv) { -printk (KERN_WARNING "%s failed to allocate memory\n" , - __func__); +coredump_report_failure ("%s failed to allocate memory" , __func__); goto fail_dropcount; }for (argi =0 ; argi < argc; argi++)@@ -644,8 +637,7 @@ void do_coredump(const kernel_siginfo_t *siginfo)kfree (helper_argv);if (retval) { -printk (KERN_INFO "Core dump to |%s pipe failed\n" , - cn.corename); +coredump_report_failure ("|%s pipe failed" , cn.corename); goto close_fail; } }else {@@ -658,10 +650,8 @@ void do_coredump(const kernel_siginfo_t *siginfo) goto fail_unlock;if (need_suid_safe && cn.corename[0 ] !='/' ) { -printk (KERN_WARNING "Pid %d(%s) can only dump core " \ -"to fully qualified path!\n" , -task_tgid_vnr (current), current->comm); -printk (KERN_WARNING "Skipping core dump\n" ); +coredump_report_failure ( +"this process can only dump core to a fully qualified path, skipping core dump" ); goto fail_unlock; }@@ -730,13 +720,13 @@ void do_coredump(const kernel_siginfo_t *siginfo) idmap =file_mnt_idmap (cprm.file);if (!vfsuid_eq_kuid (i_uid_into_vfsuid (idmap, inode),current_fsuid ())) { -pr_info_ratelimited ("Core dump to %s aborted: cannot preserve file owner\n" , - cn.corename); +coredump_report_failure ("Core dump to %s aborted: " +"cannot preserve file owner" , cn.corename); goto close_fail; }if ((inode->i_mode &0677 ) !=0600 ) { -pr_info_ratelimited ("Core dump to %s aborted: cannot preserve file permissions\n" , - cn.corename); +coredump_report_failure ("Core dump to %s aborted: " +"cannot preserve file permissions" , cn.corename); goto close_fail; }if (!(cprm.file->f_mode &FMODE_CAN_WRITE ))@@ -757,7 +747,7 @@ void do_coredump(const kernel_siginfo_t *siginfo)* have this set to NULL. */ if (!cprm.file) { -pr_info ("Core dump to |%s disabled\n" , cn.corename); +coredump_report_failure ("Core dump to |%s disabled" , cn.corename); goto close_fail; }if (!dump_vma_snapshot (&cprm))@@ -983,11 +973,10 @@ void validate_coredump_safety(void) {if (suid_dumpable ==SUID_DUMP_ROOT && core_pattern[0 ] !='/' && core_pattern[0 ] !='|' ) { -pr_warn ( -"Unsafe core_pattern used with fs.suid_dumpable=2.\n" -"Pipe handler or fully qualified core dump path required.\n" -"Set kernel.core_pattern before fs.suid_dumpable.\n" - ); + +coredump_report_failure ("Unsafe core_pattern used with fs.suid_dumpable=2: " +"pipe handler or fully qualified core dump path required. " +"Set kernel.core_pattern before fs.suid_dumpable." ); } }include/linux/coredump.h +22
-0@@ -43,8 +43,30 @@ extern int dump_align(struct coredump_params *cprm, int align);int dump_user_range (struct coredump_params *cprm,unsigned long start,unsigned long len);extern void do_coredump (const kernel_siginfo_t *siginfo); + +/* +* Logging for the coredump code, ratelimited. +* The TGID and comm fields are added to the message. +*/ + +#define __COREDUMP_PRINTK (Level, Format, ...) \ + do { \ + char comm[TASK_COMM_LEN]; \ + \ + get_task_comm(comm, current); \ + printk_ratelimited(Level "coredump: %d(%*pE): " Format "\n", \ + task_tgid_vnr(current), (int)strlen(comm), comm, ##__VA_ARGS__); \ + } while (0) \ + +#define coredump_report (fmt, ...) __COREDUMP_PRINTK(KERN_INFO, fmt, ##__VA_ARGS__) +#define coredump_report_failure (fmt, ...) __COREDUMP_PRINTK(KERN_WARNING, fmt, ##__VA_ARGS__) +#else static inline void do_coredump (const kernel_siginfo_t *siginfo) {} + +#define coredump_report (...) +#define coredump_report_failure (...) +#endif #if defined(CONFIG_COREDUMP ) && defined(CONFIG_SYSCTL )
Signature · 2 lines
Thank you, Roman
Adding also Oleg as it was my impression from working with Oleg, this area might be of interest for Oleg. I've crossed paths with very few people who contribute to the "./kernel", and don't know who to ask for another look if this is safe for the stable kernel.
Let us err on the side of caution perhaps unless folks are sure all is going to be well with the stable kernel and get_task_comm(). Another datapoint would be that Linus reverted this change from 6.12-rc1.
Roman
Quoted 211 lines · Roman Kisel
Sasha,
Thank you very much for taking this to the stable kernel! With the 6.12-rc1, folks saw unkillable processes, and the suspicion was that
get_task_comm()takes a lock on thetask_struct.Kees was kind enough to look into that and sent out
https://lore.kernel.org/all/[email protected]/.As much as I'd love to see these logs produced by the kernel to help with core dump diagnostics, I am really worried that lock might cause more harm than the patches bring value, let alone this is a stable kernel, and as I understand, folks might run very important workloads trusting the stable kernel.
If you see why these patches are good for the stable kernel (e.g. there is no lock as in 6.12), I trust your judgement. Added Kees and Eric in hopes they have time to help if this is a good change for the stable kernel.
Thank you all for your help!
Quoted 187 lines · Sasha Levin
This is a note to let you know that I've just added the patch titled
coredump: Standartize and fix logging
to the 6.10-stable tree which can be found at:
http://www.kernel.org/git/?p=linux/kernel/git/stable/stable- queue.git;a=summaryThe filename of the patch is:
coredump-standartize-and-fix-logging.patch and it can be found in the queue-6.10 subdirectory.If you, or anyone else, feels it should not be added to the stable tree, please let <[email protected]> know about it.
commit
f0a5649db30d6ff2509281ace680db9cc08ce258
Author: Roman Kisel <[email protected]>
Date: Thu Jul 18 11:27:24 2024 -0700coredump: Standartize and fix logging
[ Upstream commitc114e9948c2b6a0b400266e59cc656b59e795bca] The coredump code does not log the process ID and the comm consistently, logs unescaped comm when it does log it, and does not always use the ratelimited logging. That makes it harder to analyze logs and puts the system at the risk of spamming the system log incase something crashes many times over and over again.
Fix that by logging TGID and comm (escaped) consistently and using the ratelimited logging always.Signed-off-by Roman Kisel <[email protected]>Tested-by Allen Pais <[email protected]>Signed-off-by Kees Cook <[email protected]>Signed-off-by Sasha Levin <[email protected]>fs/coredump.c +4
-11@@ -586,8 +586,7 @@ void do_coredump(const kernel_siginfo_t *siginfo) struct subprocess_info *sub_info; if (ispipe < 0) { - printk(KERN_WARNING "format_corename failed\n"); - printk(KERN_WARNING "Aborting core\n"); + coredump_report_failure("format_corename failed, aborting core"); goto fail_unlock; }@@ -607,27 +606,21 @@ void do_coredump(const kernel_siginfo_t *siginfo)* right pid if a thread in a multi-threaded * core_pattern process dies. */ - printk(KERN_WARNING - "Process %d(%s) has RLIMIT_CORE set to 1\n", - task_tgid_vnr(current), current->comm); - printk(KERN_WARNING "Aborting core\n"); + coredump_report_failure("RLIMIT_CORE is set to 1, aborting core"); goto fail_unlock; } cprm.limit = RLIM_INFINITY; dump_count = atomic_inc_return(&core_dump_count); if (core_pipe_limit && (core_pipe_limit < dump_count)) { - printk(KERN_WARNING "Pid %d(%s) over core_pipe_limit\n", - task_tgid_vnr(current), current->comm); - printk(KERN_WARNING "Skipping core dump\n"); + coredump_report_failure("over core_pipe_limit, skipping core dump"); goto fail_dropcount; } helper_argv = kmalloc_array(argc + 1, sizeof(*helper_argv), GFP_KERNEL); if (!helper_argv) { - printk(KERN_WARNING "%s failed to allocate memory\n", - __func__); + coredump_report_failure("%s failed to allocate memory", __func__); goto fail_dropcount; }for (argi = 0; argi < argc; argi++)
fs/coredump.c +7
-10@@ -644,8 +637,7 @@ void do_coredump(const kernel_siginfo_t *siginfo) kfree(helper_argv); if (retval) { - printk(KERN_INFO "Core dump to |%s pipe failed\n", - cn.corename); + coredump_report_failure("|%s pipe failed", cn.corename); goto close_fail; } } else {@@ -658,10 +650,8 @@ void do_coredump(const kernel_siginfo_t *siginfo) goto fail_unlock; if (need_suid_safe && cn.corename[0] != '/') { - printk(KERN_WARNING "Pid %d(%s) can only dump core "\ - "to fully qualified path!\n", - task_tgid_vnr(current), current->comm); - printk(KERN_WARNING "Skipping core dump\n"); + coredump_report_failure( + "this process can only dump core to a fully qualified path, skipping core dump"); goto fail_unlock; }@@ -730,13 +720,13 @@ void do_coredump(const kernel_siginfo_t *siginfo) idmap = file_mnt_idmap(cprm.file); if (!vfsuid_eq_kuid(i_uid_into_vfsuid(idmap, inode), current_fsuid())) { - pr_info_ratelimited("Core dump to %s aborted: cannot preserve file owner\n", - cn.corename); + coredump_report_failure("Core dump to %s aborted: " + "cannot preserve file owner", cn.corename); goto close_fail; } if ((inode->i_mode & 0677) != 0600) { - pr_info_ratelimited("Core dump to %s aborted: cannot preserve file permissions\n", - cn.corename); + coredump_report_failure("Core dump to %s aborted: " + "cannot preserve file permissions", cn.corename); goto close_fail;}
if (!(cprm.file->f_mode &FMODE_CAN_WRITE))fs/coredump.c +1
-1@@ -757,7 +747,7 @@ void do_coredump(const kernel_siginfo_t *siginfo)* have this set to NULL. */ if (!cprm.file) { - pr_info("Core dump to |%s disabled\n", cn.corename); + coredump_report_failure("Core dump to |%s disabled", cn.corename); goto close_fail; }if (!dump_vma_snapshot(&cprm))
fs/coredump.c +0
-0@@ -983,11 +973,10 @@ void validate_coredump_safety(void) {if (
suid_dumpable==SUID_DUMP_ROOT&&
core_pattern[0] != '/' && core_pattern[0] != '|') { - pr_warn(
-"Unsafecore_patternused with fs.suid_dumpable=2.\n" -"Pipe handler or fully qualified core dump path required.\n" -"Set kernel.core_pattern before fs.suid_dumpable.\n"
- );
+
+ coredump_report_failure("Unsafecore_patternused with fs.suid_dumpable=2: "
+ "pipe handler or fully qualified core dump path required. " + "Set kernel.core_pattern before fs.suid_dumpable."); }
}include/linux/coredump.h +18
-0@@ -43,8 +43,30 @@ extern int dump_align(struct coredump_params *cprm, int align); int dump_user_range(struct coredump_params *cprm, unsigned long start, unsigned long len); extern void do_coredump(const kernel_siginfo_t *siginfo); + +/* +* Logging for the coredump code, ratelimited. +* The TGID and comm fields are added to the message. +*/ + +#define __COREDUMP_PRINTK (Level, Format, ...) \ + do { \ + char comm[TASK_COMM_LEN]; \ + \ + get_task_comm(comm, current); \ + printk_ratelimited(Level "coredump: %d(%*pE): " Format "\n", \ + task_tgid_vnr(current), (int)strlen(comm), comm, ##__VA_ARGS__); \ + } while (0) \ + +#define coredump_report (fmt, ...) __COREDUMP_PRINTK(KERN_INFO, fmt, ##__VA_ARGS__) +#define coredump_report_failure (fmt, ...) __COREDUMP_PRINTK(KERN_WARNING, fmt, ##__VA_ARGS__) +#else
static inline voiddo_coredump(const kernel_siginfo_t *siginfo){}include/linux/coredump.h +4
-0+ +#define coredump_report (...) +#define coredump_report_failure (...) +#endif
#ifdefined(CONFIG_COREDUMP)&&defined(CONFIG_SYSCTL)
Signature · 2 lines
Thank you, Roman
Sasha Levin
maintainerQuoted 9 lines · Roman Kisel
Adding also Oleg as it was my impression from working with Oleg, this area might be of interest for Oleg. I've crossed paths with very few people who contribute to the "./kernel", and don't know who to ask for another look if this is safe for the stable kernel.
Let us err on the side of caution perhaps unless folks are sure all is going to be well with the stable kernel and
get_task_comm(). Another datapoint would be that Linus reverted this change from 6.12-rc1.
Let's play it safe and drop them. Thanks for the report!
Signature · 2 lines
Thanks, Sasha