exec: fix up /proc/pid/comm in the execveat(AT_EMPTY_PATH) case
Subsystems (3)
Kees Cook
maintainerPATCH 1/1 exec: fix up /proc/pid/comm in the execveat(AT_EMPTY_PATH) case
Zbigniew mentioned at Linux Plumber's that systemd is interested in switching to execveat() for service execution, but can't, because the contents of /proc/pid/comm are the file descriptor which was used, instead of the path to the binary. This makes the output of tools like top and ps useless, especially in a world where most fds are opened CLOEXEC so the number is truly meaningless.
When the filename passed in is empty (e.g. with AT_EMPTY_PATH), use the dentry's filename for "comm" instead of using the useless numeral from the synthetic fdpath construction. This way the actual exec machinery is unchanged, but cosmetically the comm looks reasonable to admins investigating things.
Instead of adding TASK_COMM_LEN more bytes to bprm, use one of the unused flag bits to indicate that we need to set "comm" from the dentry.
---
Cc: Al Viro <[email protected]>
Cc: Linus Torvalds <[email protected]>
Cc: Eric Biederman <[email protected]>
Cc: Alexander Viro <[email protected]>
Cc: Christian Brauner <[email protected]>
Cc: Jan Kara <[email protected]>
Cc: [email protected]
Cc: [email protected]
Here's what I've put together from the various suggestions. I didn't want to needlessly grow bprm, so I just added a flag instead. Otherwise, this is very similar to what Linus and Al suggested.
--- fs/exec.c | 22 +++++++++++++++++++--- include/linux/binfmts.h | 4 +++- 2 files changed, 22 insertions(+), 4 deletions(-)
fs/exec.c +19 -3
@@ -1347,7 +1347,21 @@ int begin_new_exec(struct linux_binprm * bprm)set_dumpable (current->mm,SUID_DUMP_USER );perf_event_exec (); -__set_task_comm (me,kbasename (bprm->filename), true); + +/* +* If the original filename was empty, alloc_bprm() made up a path +* that will probably not be useful to admins running ps or similar. +* Let's fix it up to be something reasonable. +*/ +if (bprm->comm_from_dentry) { +rcu_read_lock (); +/* The dentry name won't change while we hold the rcu read lock. */ +__set_task_comm (me,smp_load_acquire (&bprm->file->f_path.dentry->d_name.name), + true); +rcu_read_unlock (); + }else { +__set_task_comm (me,kbasename (bprm->filename), true); + }/* An exec changes our domain. We are no longer part of the thread group */
@@ -1521,11 +1535,13 @@ static struct linux_binprm *alloc_bprm(int fd, struct filename *filename, int flif (fd ==AT_FDCWD || filename->name[0 ] =='/' ) { bprm->filename = filename->name; }else { -if (filename->name[0 ] =='\0' ) +if (filename->name[0 ] =='\0' ) { bprm->fdpath =kasprintf (GFP_KERNEL ,"/dev/fd/%d" , fd); -else + bprm->comm_from_dentry =1 ; + }else { bprm->fdpath =kasprintf (GFP_KERNEL ,"/dev/fd/%d/%s" , fd, filename->name); + }if (!bprm->fdpath) goto out_free;
include/linux/binfmts.h +3 -1
@@ -42,7 +42,9 @@ struct linux_binprm {* Set when errors can no longer be returned to the * original userspace. */ - point_of_no_return:1 ; + point_of_no_return:1 , +/* Set when "comm" must come from the dentry. */ + comm_from_dentry:1;struct file *executable;/* Executable to pass to the interpreter */ struct file *interpreter;struct file *file;
Signature · 1 line
2.34.1
Quoted 7 lines · Kees Cook
Zbigniew mentioned at Linux Plumber's that systemd is interested in switching to
execveat()for service execution, but can't, because the contents of/proc/pid/commare the file descriptor which was used, instead of the path to the binary. This makes the output of tools like top and ps useless, especially in a world where most fds are opened CLOEXEC so the number is truly meaningless.
Quoted 8 lines
When the filename passed in is empty (e.g. with
AT_EMPTY_PATH), use the dentry's filename for "comm" instead of using the useless numeral from the synthetic fdpath construction. This way the actual exec machinery is unchanged, but cosmetically the comm looks reasonable to admins investigating things.Instead of adding
TASK_COMM_LENmore bytes to bprm, use one of the unused flag bits to indicate that we need to set "comm" from the dentry.
Looks reasonable to me, feel free to take my
Quoted 87 lines
Suggested-by Zbigniew Jędrzejewski-Szmek <[email protected]>Suggested-by Tycho Andersen <[email protected]>Suggested-by Al Viro <[email protected]>Suggested-by Linus Torvalds <[email protected]>CC Aleksa Sarai <[email protected]>Signed-off-by Kees Cook <[email protected]>---
Cc: Al Viro <[email protected]>
Cc: Linus Torvalds <[email protected]>
Cc: Eric Biederman <[email protected]>
Cc: Alexander Viro <[email protected]>
Cc: Christian Brauner <[email protected]>
Cc: Jan Kara <[email protected]>
Cc: [email protected]
Cc: [email protected]Here's what I've put together from the various suggestions. I didn't want to needlessly grow bprm, so I just added a flag instead. Otherwise, this is very similar to what Linus and Al suggested.
--- fs/exec.c | 22 +++++++++++++++++++--- include/linux/binfmts.h | 4 +++- 2 files changed, 22 insertions(+), 4 deletions(-)fs/exec.c +19
-3@@ -1347,7 +1347,21 @@ int begin_new_exec(struct linux_binprm * bprm)set_dumpable (current->mm,SUID_DUMP_USER );perf_event_exec (); -__set_task_comm (me,kbasename (bprm->filename), true); + +/* +* If the original filename was empty, alloc_bprm() made up a path +* that will probably not be useful to admins running ps or similar. +* Let's fix it up to be something reasonable. +*/ +if (bprm->comm_from_dentry) { +rcu_read_lock (); +/* The dentry name won't change while we hold the rcu read lock. */ +__set_task_comm (me,smp_load_acquire (&bprm->file->f_path.dentry->d_name.name), + true); +rcu_read_unlock (); + }else { +__set_task_comm (me,kbasename (bprm->filename), true); + }/* An exec changes our domain. We are no longer part of the thread group */ @@ -1521,11 +1535,13 @@ static struct linux_binprm *alloc_bprm(int fd, struct filename *filename, int flif (fd ==AT_FDCWD || filename->name[0 ] =='/' ) { bprm->filename = filename->name; }else { -if (filename->name[0 ] =='\0' ) +if (filename->name[0 ] =='\0' ) { bprm->fdpath =kasprintf (GFP_KERNEL ,"/dev/fd/%d" , fd); -else + bprm->comm_from_dentry =1 ; + }else { bprm->fdpath =kasprintf (GFP_KERNEL ,"/dev/fd/%d/%s" , fd, filename->name); + }if (!bprm->fdpath) goto out_free;include/linux/binfmts.h +3
-1@@ -42,7 +42,9 @@ struct linux_binprm {* Set when errors can no longer be returned to the * original userspace. */ - point_of_no_return:1 ; + point_of_no_return:1 , +/* Set when "comm" must come from the dentry. */ + comm_from_dentry:1;struct file *executable;/* Executable to pass to the interpreter */ struct file *interpreter;struct file *file;Signature · 1 line
2.34.1
Signature · 4 lines
Aleksa Sarai Senior Software Engineer (Containers) SUSE Linux GmbH <https://www.cyphar.com/>
Christian Brauner
maintainerQuoted 50 lines · Kees Cook
Zbigniew mentioned at Linux Plumber's that systemd is interested in switching to
execveat()for service execution, but can't, because the contents of/proc/pid/commare the file descriptor which was used, instead of the path to the binary. This makes the output of tools like top and ps useless, especially in a world where most fds are opened CLOEXEC so the number is truly meaningless.When the filename passed in is empty (e.g. with
AT_EMPTY_PATH), use the dentry's filename for "comm" instead of using the useless numeral from the synthetic fdpath construction. This way the actual exec machinery is unchanged, but cosmetically the comm looks reasonable to admins investigating things.Instead of adding
TASK_COMM_LENmore bytes to bprm, use one of the unused flag bits to indicate that we need to set "comm" from the dentry.Suggested-by Zbigniew Jędrzejewski-Szmek <[email protected]>Suggested-by Tycho Andersen <[email protected]>Suggested-by Al Viro <[email protected]>Suggested-by Linus Torvalds <[email protected]>CC Aleksa Sarai <[email protected]>Signed-off-by Kees Cook <[email protected]>---
Cc: Al Viro <[email protected]>
Cc: Linus Torvalds <[email protected]>
Cc: Eric Biederman <[email protected]>
Cc: Alexander Viro <[email protected]>
Cc: Christian Brauner <[email protected]>
Cc: Jan Kara <[email protected]>
Cc: [email protected]
Cc: [email protected]Here's what I've put together from the various suggestions. I didn't want to needlessly grow bprm, so I just added a flag instead. Otherwise, this is very similar to what Linus and Al suggested.
--- fs/exec.c | 22 +++++++++++++++++++--- include/linux/binfmts.h | 4 +++- 2 files changed, 22 insertions(+), 4 deletions(-)fs/exec.c +0
-1@@ -1347,7 +1347,21 @@ int begin_new_exec(struct linux_binprm * bprm)set_dumpable (current->mm,SUID_DUMP_USER );perf_event_exec (); -__set_task_comm (me,kbasename (bprm->filename), true);
fs/exec.c int begin_new_exec(struct linux_binprm * bprm) · line 1359
Quoted 10 lines
fs/exec.c +10
-0+ +/* +* If the original filename was empty, alloc_bprm() made up a path +* that will probably not be useful to admins running ps or similar. +* Let's fix it up to be something reasonable. +*/ +if (bprm->comm_from_dentry) { +rcu_read_lock (); +/* The dentry name won't change while we hold the rcu read lock. */ + __set_task_comm(me, smp_load_acquire(&bprm->file->f_path.dentry->d_name.name),
What does the smp_load_acquire() pair with?
Quoted 2 lines · Christian Brauner
What does the
smp_load_acquire()pair with?
I'm not sure we have them everywhere, but at least this one at dentry creation time.
__d_alloc():
/* Make sure we always see the terminating NUL character */
smp_store_release(&dentry->d_name.name, dname); /* ^^^ */so even at rename time, when we swap the d_name.name pointers (*without* using a store-release at that time), both of the dentry names had memory orderings before.
That said, looking at swap_name() at the non-"swap just the pointers" case, there we do just "memcpy()" the name, and it would probably be good to update the target d_name.name with a smp_store_release.
In practice, none of this ever matters. Anybody who uses the dentry name without locking either doesn't care enough (like comm[]) or will use the sequence number thing to serialize at a much higher level. So the smp_load_acquire() could probably be a READ_ONCE(), and nobody would ever see the difference.
Linus
Quoted 51 lines · Kees Cook
Zbigniew mentioned at Linux Plumber's that systemd is interested in switching to
execveat()for service execution, but can't, because the contents of/proc/pid/commare the file descriptor which was used, instead of the path to the binary. This makes the output of tools like top and ps useless, especially in a world where most fds are opened CLOEXEC so the number is truly meaningless.When the filename passed in is empty (e.g. with
AT_EMPTY_PATH), use the dentry's filename for "comm" instead of using the useless numeral from the synthetic fdpath construction. This way the actual exec machinery is unchanged, but cosmetically the comm looks reasonable to admins investigating things.Instead of adding
TASK_COMM_LENmore bytes to bprm, use one of the unused flag bits to indicate that we need to set "comm" from the dentry.Suggested-by Zbigniew Jędrzejewski-Szmek <[email protected]>Suggested-by Tycho Andersen <[email protected]>Suggested-by Al Viro <[email protected]>Suggested-by Linus Torvalds <[email protected]>CC Aleksa Sarai <[email protected]>Signed-off-by Kees Cook <[email protected]>---
Cc: Al Viro <[email protected]>
Cc: Linus Torvalds <[email protected]>
Cc: Eric Biederman <[email protected]>
Cc: Alexander Viro <[email protected]>
Cc: Christian Brauner <[email protected]>
Cc: Jan Kara <[email protected]>
Cc: [email protected]
Cc: [email protected]Here's what I've put together from the various suggestions. I didn't want to needlessly grow bprm, so I just added a flag instead. Otherwise, this is very similar to what Linus and Al suggested.
--- fs/exec.c | 22 +++++++++++++++++++--- include/linux/binfmts.h | 4 +++- 2 files changed, 22 insertions(+), 4 deletions(-)fs/exec.c +1
-1@@ -1347,7 +1347,21 @@ int begin_new_exec(struct linux_binprm * bprm)set_dumpable (current->mm,SUID_DUMP_USER );perf_event_exec (); -__set_task_comm (me,kbasename (bprm->filename), true); +
fs/exec.c int begin_new_exec(struct linux_binprm * bprm) · line 1360
Quoted 10 lines
fs/exec.c +10
-0+/* +* If the original filename was empty, alloc_bprm() made up a path +* that will probably not be useful to admins running ps or similar. +* Let's fix it up to be something reasonable. +*/ +if (bprm->comm_from_dentry) { +rcu_read_lock (); +/* The dentry name won't change while we hold the rcu read lock. */ +__set_task_comm (me,smp_load_acquire (&bprm->file->f_path.dentry->d_name.name), + true);
This does not sound legit whatsoever as it would indicate all renames wait for rcu grace periods to end, which would be prettye weird.
Even commentary above dentry_cmp states:
* Be careful about RCU walk racing with rename:
* use 'READ_ONCE' to fetch the name pointer. *
* NOTE! Even if a rename will mean that the length
* was not loaded atomically, we don't care.
It may be this is considered tolerable, but there should be no difficulty getting a real name there?
Regardless, the comment looks bogus.
Quoted 7 lines · Mateusz Guzik
fs/exec.c int begin_new_exec(struct linux_binprm * bprm) · line 1360
Quoted 4 lines
fs/exec.c +3
-0+/* The dentry name won't change while we hold the rcu read lock. */ +__set_task_comm (me,smp_load_acquire (&bprm->file->f_path.dentry->d_name.name), + true);This does not sound legit whatsoever as it would indicate all renames wait for rcu grace periods to end, which would be prettye weird.
Yes, the "won't change" should be "won't go away from under us".
Linus
Christian Brauner
maintainerQuoted 19 lines · Linus Torvalds
Quoted 2 lines · Christian Brauner
What does the
smp_load_acquire()pair with?I'm not sure we have them everywhere, but at least this one at dentry creation time.
__d_alloc():/* Make sure we always see the terminating NUL character */ smp_store_release(&dentry->d_name.name, dname); /* ^^^ */so even at rename time, when we swap the d_name.name pointers (*without* using a store-release at that time), both of the dentry names had memory orderings before.
That said, looking at
swap_name()at the non-"swap just the pointers" case, there we do just "memcpy()" the name, and it would probably be good to update the target d_name.name with asmp_store_release.
Quoted 5 lines
In practice, none of this ever matters. Anybody who uses the dentry name without locking either doesn't care enough (like comm[]) or will use the sequence number thing to serialize at a much higher level. So the
smp_load_acquire()could probably be aREAD_ONCE(), and nobody would ever see the difference.
Right now it's confusing. So no matter if we do READ_ONCE() or smp_load_acquire() there'd please be a comment explaing why so we don't pointlessly leave everyone wondering about that barrier.
/*
* Hold rcu lock to keep the name from being freed behind our back.
* Use cquire semantics to make sure the terminating NUL from
* __d_alloc() is seen.
*
* Note, we're deliberately sloppy here. We don't need to care about
* detecting a concurrent rename and just want a sensible name.
*/rcu_read_lock();__set_task_comm(me, smp_load_acquire(&file_dentry(bprm->file)->d_name.name), true); rcu_read_unlock();
or something better.
Quoted 9 lines · Christian Brauner
/*
* Hold rcu lock to keep the name from being freed behind our back.
* Use cquire semantics to make sure the terminating NUL from
*__d_alloc()is seen.
*
* Note, we're deliberately sloppy here. We don't need to care about
* detecting a concurrent rename and just want a sensible name. */
Sure. Note that even "sensible" isn't truly guaranteed in theory, since a concurrent rename could be doing a "memcpy()" into the dentry->d_name.name area at the same time on another CPU.
But "theoretically hard guarantees" isn't what this code cares about.
The only really hard rule is that the end result in comm[] needs to be NUL-terminated at all times (and hey, even *that* is arguably a "don't print garbage" rule rather than something truly fatal), and everything else is "do the best you can".
Could we take the dentry lock to be really careful? Sure. We simply don't care enough, and while other parts of execve() are much more expensive, let's not.
Linus
Christian Brauner
maintainerQuoted 11 lines · Linus Torvalds
Quoted 9 lines · Christian Brauner
/*
* Hold rcu lock to keep the name from being freed behind our back.
* Use cquire semantics to make sure the terminating NUL from
*__d_alloc()is seen.
*
* Note, we're deliberately sloppy here. We don't need to care about
* detecting a concurrent rename and just want a sensible name. */
Quoted 3 lines
Sure. Note that even "sensible" isn't truly guaranteed in theory, since a concurrent rename could be doing a "
memcpy()" into thedentry->d_name.namearea at the same time on another CPU.
Yeah, I saw, if the dname.name assignment is reorded to happen before the memcpy() afaict. Anyway, it's not that important especially since PR_SET_MM_MAP puts comm, auxv etc. fully under user control anyway.
Quoted 14 lines · Aleksa Sarai
Quoted 13 lines · Kees Cook
Zbigniew mentioned at Linux Plumber's that systemd is interested in switching to
execveat()for service execution, but can't, because the contents of/proc/pid/commare the file descriptor which was used, instead of the path to the binary. This makes the output of tools like top and ps useless, especially in a world where most fds are opened CLOEXEC so the number is truly meaningless.When the filename passed in is empty (e.g. with
AT_EMPTY_PATH), use the dentry's filename for "comm" instead of using the useless numeral from the synthetic fdpath construction. This way the actual exec machinery is unchanged, but cosmetically the comm looks reasonable to admins investigating things.
Quoted 6 lines
Quoted 2 lines
Instead of adding
TASK_COMM_LENmore bytes to bprm, use one of the unused flag bits to indicate that we need to set "comm" from the dentry.Looks reasonable to me, feel free to take my
Reviewed-by Aleksa Sarai <[email protected]>
Thank you for making another version of the patch.
I tested this with systemd compiled to use fexecve and everything seems to work as expected (the filename in /proc//comm).
Zbyszek