md / procfs: avoid Oops if md-mod removed while /proc/mdstat is being polled.
Subsystems (3)
PATCH 1/1 md / procfs: avoid Oops if md-mod removed while /proc/mdstat is being polled.
If poll or select is waiting on /proc/mdstat when md-mod is unloaded an oops will ensure when the poll/select completes.
This is because the wait_queue_head which is registered with poll_wait() is local to the module and no longer exists when the poll completes and detaches that wait_queue_head (in poll_free_wait -> remove_wait_queue).
To fix this we need the wait_queue_head to have (at least) the same life time as the proc_dir_entry. So this patch places it in that structure.
We:
- add pde_poll_wait to struct proc_dir_entry
- call poll_wait() passing this when poll() is called on the proc file
- export a function proc_wake_up which will call wake_up() on pde_poll_wait
and make use of all that in md.c
--
Do we have a maintainer for fs/proc ??
If I could get a couple of Acks, or constructive comments, on this, I would appreciate it.
Thanks,
NeilBrown
drivers/md/md.c +4 -6
@@ -193,12 +193,12 @@ EXPORT_SYMBOL_GPL(bio_clone_mddev);* start array, stop array, error, add device, remove device, * start build, activate spare */ -static DECLARE_WAIT_QUEUE_HEAD (md_event_waiters); +static struct proc_dir_entry *mdstat_pde;static atomic_t md_event_count;void md_new_event (struct mddev *mddev) {atomic_inc (&md_event_count); -wake_up (&md_event_waiters); +proc_wake_up (mdstat_pde); }EXPORT_SYMBOL_GPL (md_new_event);
@@ -208,7 +208,7 @@ EXPORT_SYMBOL_GPL(md_new_event);static void md_new_event_inintr (struct mddev *mddev) {atomic_inc (&md_event_count); -wake_up (&md_event_waiters); +proc_wake_up (mdstat_pde); }/*
@@ -7187,8 +7187,6 @@ static unsigned int mdstat_poll(struct file *filp, poll_table *wait)struct seq_file *seq = filp->private_data;int mask; -poll_wait (filp, &md_event_waiters, wait); -/* always allow read */ mask =POLLIN |POLLRDNORM ;
@@ -8557,7 +8555,7 @@ static void md_geninit(void) {pr_debug ("md: sizeof(mdp_super_t) = %d\n" , (int )sizeof (mdp_super_t)); -proc_create ("mdstat" ,S_IRUGO ,NULL , &md_seq_fops); + mdstat_pde =proc_create ("mdstat" ,S_IRUGO ,NULL , &md_seq_fops); }static int __init md_init (void )
fs/proc/generic.c +1 -0
@@ -357,6 +357,7 @@ static struct proc_dir_entry *__proc_create(struct proc_dir_entry **parent,atomic_set (&ent->count,1 );spin_lock_init (&ent->pde_unload_lock);INIT_LIST_HEAD (&ent->pde_openers); +init_waitqueue_head (&ent->pde_poll_wait); out:return ent; }
fs/proc/inode.c +9 -1
@@ -234,13 +234,21 @@ static unsigned int proc_reg_poll(struct file *file, struct poll_table_struct *punsigned int (*poll)(struct file *,struct poll_table_struct *);if (use_pde (pde)) { poll = pde->proc_fops->poll; -if (poll) +if (poll) { +poll_wait (file, &pde->pde_poll_wait, pts); rv =poll (file, pts); + }unuse_pde (pde); }return rv; } +void proc_wake_up (struct proc_dir_entry *pde) +{ +wake_up (&pde->pde_poll_wait); +} +EXPORT_SYMBOL_GPL (proc_wake_up); +static long proc_reg_unlocked_ioctl (struct file *file,unsigned int cmd,unsigned long arg) {struct proc_dir_entry *pde =PDE (file_inode (file));
fs/proc/internal.h +1 -0
@@ -46,6 +46,7 @@ struct proc_dir_entry {struct completion *pde_unload_completion;struct list_head pde_openers;/* who did ->open, but not ->release */ spinlock_t pde_unload_lock;/* proc_fops checks and pde_users bumps */ +wait_queue_head_t pde_poll_wait;/* For proc_reg_poll */ u8 namelen;char name[]; };
include/linux/proc_fs.h +1 -0
@@ -34,6 +34,7 @@ static inline struct proc_dir_entry *proc_create(return proc_create_data (name, mode, parent, proc_fops,NULL ); } +extern void proc_wake_up (struct proc_dir_entry *pde);extern void proc_set_size (struct proc_dir_entry *,loff_t );extern void proc_set_user (struct proc_dir_entry *,kuid_t ,kgid_t );extern void *PDE_DATA (const struct inode *);
Quoted 10 lines · On Thu, 27 Feb 2014 17:24:45 +1100 NeilBrown <[email protected]> wrote:
If poll or select is waiting on
/proc/mdstatwhen md-mod is unloaded an oops will ensure when the poll/select completes.This is because the
wait_queue_headwhich is registered withpoll_wait()is local to the module and no longer exists when the poll completes and detaches thatwait_queue_head(inpoll_free_wait->remove_wait_queue).To fix this we need the
wait_queue_headto have (at least) the same life time as theproc_dir_entry. So this patch places it in that structure.
Quoted 6 lines
We:
- addpde_poll_waitto structproc_dir_entry
- callpoll_wait()passing this whenpoll()is called on the proc file
- export a functionproc_wake_upwhich will callwake_up()onpde_poll_waitand make use of all that in
md.c
This sounds wrong. If a userspace process is waiting on md_event_waiters then the md module is "busy" and the rmmod attempt should fail?
Quoted 17 lines · On Thu, 27 Feb 2014 12:58:07 -0800 Andrew Morton <[email protected]>…
Quoted 15 lines · On Thu, 27 Feb 2014 17:24:45 +1100 NeilBrown <[email protected]> wrote:
If poll or select is waiting on
/proc/mdstatwhen md-mod is unloaded an oops will ensure when the poll/select completes.This is because the
wait_queue_headwhich is registered withpoll_wait()is local to the module and no longer exists when the poll completes and detaches thatwait_queue_head(inpoll_free_wait->remove_wait_queue).To fix this we need the
wait_queue_headto have (at least) the same life time as theproc_dir_entry. So this patch places it in that structure.We:
- addpde_poll_waitto structproc_dir_entry
- callpoll_wait()passing this whenpoll()is called on the proc file
- export a functionproc_wake_upwhich will callwake_up()onpde_poll_wait
Quoted 5 lines
Quoted 1 line
and make use of all that in
md.cThis sounds wrong. If a userspace process is waiting on
md_event_waitersthen the md module is "busy" and the rmmod attempt should fail?
Al Viro says "no" quite firmly.
I think the core argument is that
rmmod md-mod < /proc/mdstat
would deadlock.
http://marc.info/?l=linux-fsdevel&m=133024267507384
Thanks,
NeilBrown
Quoted 26 lines · On Fri, 28 Feb 2014 08:34:43 +1100 NeilBrown <[email protected]> wrote:
Quoted 17 lines · On Thu, 27 Feb 2014 12:58:07 -0800 Andrew Morton <[email protected]>…
Quoted 15 lines · On Thu, 27 Feb 2014 17:24:45 +1100 NeilBrown <[email protected]> wrote:
If poll or select is waiting on
/proc/mdstatwhen md-mod is unloaded an oops will ensure when the poll/select completes.This is because the
wait_queue_headwhich is registered withpoll_wait()is local to the module and no longer exists when the poll completes and detaches thatwait_queue_head(inpoll_free_wait->remove_wait_queue).To fix this we need the
wait_queue_headto have (at least) the same life time as theproc_dir_entry. So this patch places it in that structure.We:
- addpde_poll_waitto structproc_dir_entry
- callpoll_wait()passing this whenpoll()is called on the proc file
- export a functionproc_wake_upwhich will callwake_up()onpde_poll_waitQuoted 5 lines
Quoted 1 line
and make use of all that in
md.cThis sounds wrong. If a userspace process is waiting on
md_event_waitersthen the md module is "busy" and the rmmod attempt should fail?
Quoted 7 lines
Al Viro says "no" quite firmly.
I think the core argument is that
rmmod md-mod <
/proc/mdstatwould deadlock.
Well, only if the rmmod hangs around waiting for the module to go idle. I'm thinking rmmod should fail. EBUSY.
Quoted 1 line
Why don't a billion blocking-procfs-read sites have this problem?
Quoted 34 lines · On Thu, 27 Feb 2014 13:51:25 -0800 Andrew Morton <[email protected]>…
Quoted 32 lines · On Fri, 28 Feb 2014 08:34:43 +1100 NeilBrown <[email protected]> wrote:
Quoted 17 lines · On Thu, 27 Feb 2014 12:58:07 -0800 Andrew Morton <[email protected]>…
Quoted 15 lines · On Thu, 27 Feb 2014 17:24:45 +1100 NeilBrown <[email protected]> wrote:
If poll or select is waiting on
/proc/mdstatwhen md-mod is unloaded an oops will ensure when the poll/select completes.This is because the
wait_queue_headwhich is registered withpoll_wait()is local to the module and no longer exists when the poll completes and detaches thatwait_queue_head(inpoll_free_wait->remove_wait_queue).To fix this we need the
wait_queue_headto have (at least) the same life time as theproc_dir_entry. So this patch places it in that structure.We:
- addpde_poll_waitto structproc_dir_entry
- callpoll_wait()passing this whenpoll()is called on the proc file
- export a functionproc_wake_upwhich will callwake_up()onpde_poll_waitQuoted 5 lines
Quoted 1 line
and make use of all that in
md.cThis sounds wrong. If a userspace process is waiting on
md_event_waitersthen the md module is "busy" and the rmmod attempt should fail?Al Viro says "no" quite firmly.
I think the core argument is that
rmmod md-mod <
/proc/mdstat
Quoted 9 lines
Quoted 1 line
would deadlock.
Well, only if the rmmod hangs around waiting for the module to go idle. I'm thinking rmmod should fail. EBUSY.
Quoted 1 line
Why don't a billion blocking-procfs-read sites have this problem?
This issue of a file in /proc (actually /proc/fs/nfsd which is a separate filesystem) blocking came up on the NFS list recently. Experiments suggested that no other files in /proc block reads (though /proc/vmcore takes somewhat longer to 'cat' than most). So the offending file was changed to never block.
i.e. I think your 'billion' estimate is a little high, by one billion. :-)
NeilBrown
Quoted 33 lines · On Fri, 28 Feb 2014 10:07:57 +1100 NeilBrown <[email protected]> wrote:
Quoted 30 lines · On Thu, 27 Feb 2014 13:51:25 -0800 Andrew Morton <[email protected]>…
Quoted 28 lines · On Fri, 28 Feb 2014 08:34:43 +1100 NeilBrown <[email protected]> wrote:
Quoted 17 lines · On Thu, 27 Feb 2014 12:58:07 -0800 Andrew Morton <[email protected]>…
Quoted 15 lines · On Thu, 27 Feb 2014 17:24:45 +1100 NeilBrown <[email protected]> wrote:
If poll or select is waiting on
/proc/mdstatwhen md-mod is unloaded an oops will ensure when the poll/select completes.This is because the
wait_queue_headwhich is registered withpoll_wait()is local to the module and no longer exists when the poll completes and detaches thatwait_queue_head(inpoll_free_wait->remove_wait_queue).To fix this we need the
wait_queue_headto have (at least) the same life time as theproc_dir_entry. So this patch places it in that structure.We:
- addpde_poll_waitto structproc_dir_entry
- callpoll_wait()passing this whenpoll()is called on the proc file
- export a functionproc_wake_upwhich will callwake_up()onpde_poll_waitQuoted 5 lines
Quoted 1 line
and make use of all that in
md.cThis sounds wrong. If a userspace process is waiting on
md_event_waitersthen the md module is "busy" and the rmmod attempt should fail?Al Viro says "no" quite firmly.
Quoted 8 lines
Quoted 8 lines
Quoted 5 lines
I think the core argument is that
rmmod md-mod <
/proc/mdstatwould deadlock.
Well, only if the rmmod hangs around waiting for the module to go idle. I'm thinking rmmod should fail. EBUSY.
This? What happens if we just fail the rmmod when the module is busy (which it is).
Quoted 39 lines · On Thu, 27 Feb 2014 15:32:42 -0800 Andrew Morton <[email protected]>…
Quoted 37 lines · On Fri, 28 Feb 2014 10:07:57 +1100 NeilBrown <[email protected]> wrote:
Quoted 34 lines · On Thu, 27 Feb 2014 13:51:25 -0800 Andrew Morton <[email protected]>…
Quoted 32 lines · On Fri, 28 Feb 2014 08:34:43 +1100 NeilBrown <[email protected]> wrote:
Quoted 17 lines · On Thu, 27 Feb 2014 12:58:07 -0800 Andrew Morton <[email protected]>…
Quoted 15 lines · On Thu, 27 Feb 2014 17:24:45 +1100 NeilBrown <[email protected]> wrote:
If poll or select is waiting on
/proc/mdstatwhen md-mod is unloaded an oops will ensure when the poll/select completes.This is because the
wait_queue_headwhich is registered withpoll_wait()is local to the module and no longer exists when the poll completes and detaches thatwait_queue_head(inpoll_free_wait->remove_wait_queue).To fix this we need the
wait_queue_headto have (at least) the same life time as theproc_dir_entry. So this patch places it in that structure.We:
- addpde_poll_waitto structproc_dir_entry
- callpoll_wait()passing this whenpoll()is called on the proc file
- export a functionproc_wake_upwhich will callwake_up()onpde_poll_waitQuoted 5 lines
Quoted 1 line
and make use of all that in
md.cThis sounds wrong. If a userspace process is waiting on
md_event_waitersthen the md module is "busy" and the rmmod attempt should fail?Al Viro says "no" quite firmly.
I think the core argument is that
rmmod md-mod <
/proc/mdstat
Quoted 7 lines
Quoted 4 lines
Quoted 4 lines
Quoted 1 line
would deadlock.
Well, only if the rmmod hangs around waiting for the module to go idle. I'm thinking rmmod should fail. EBUSY.
This? What happens if we just fail the rmmod when the module is busy (which it is).
I was hoping that Al would step in with an answer, but I got impatient had had a look around myself.
I found
commit 99b76233803beab302123d243eea9e41149804f3
Author: Alexey Dobriyan <[email protected]> Date: Wed Mar 25 22:48:06 2009 +0300
proc 2/2: remove struct proc_dir_entry::owner
which references
https://bugzilla.kernel.org/show_bug.cgi?id=12454
which seems to suggest that we used to try to do as you suggest but it was racy and would be a lot of work to "fix". The chosen solution was to only 'get' the module during read/write, not just while the /proc file is open.
NeilBrown