nfsd: open file caching
Subsystems (6)
v6 cover nfsd: open file caching
v6:
- rename delayed_fput infrastructure to global_fput
- drop list_lru_rotate patch, rework LRU list code to use LRU_ROTATE and a new NFSD_FILE_REFERENCED flag
- rework fsnotify_mark handling to be done with separate allocation
- bugfixes
v5:
- switch to using flush_delayed_fput instead of __fput_sync
- hash on inode->i_ino instead of inode pointer
- add /proc/fs/nfsd/file_cache_stats file to track stats on the hash
- eliminate extra fh_verify in nfsd_file_acquire
v4:
- squash some of the patches down into one patch to reduce churn
- close cached open files after unlink instead of before
- don't just close files after nfsd does an unlink, must do it after any vfs-layer unlink. Use fsnotify to handle that.
- use a SRCU notifier chain for setlease
- add patch to allow non-kthreads to do a fput_sync
v3:
- open files are now hashed on inode pointer instead of fh
- eliminate the recurring workqueue job in favor of shrinker/LRU and notifier from lease setting code
- have nfsv4 use the cache as well
- removal of raparms cache
v2:
- changelog cleanups and clarifications
- allow COMMIT to use cached open files
- tracepoints for nfsd_file cache
- proactively close open files prior to REMOVE, or a RENAME over a positive dentry
This is the sixth posting of this patchset. For those just tuning in now, the basic idea here is to allow nfsd to keep a cache of open file descriptions, primarily to help NFSv3 workloads but also to clean up some nastiness in the NFSv4 file handling.
Of course, we can't keep files open indefinitely, so much of the new infrastructure is geared toward allowing the files to be closed on demand, in the following cases:
- nfsd_files are released whenever the inode's link count goes to zero
- they are released when userspace wants to set a lease on the inode
- when a shrinker callback occurs for the nfsd_file cache
- when filesystems are unexported or nfsd is shut down, we clean out the cache
This allows nfsd to keep the file open basically indefinitely. The tricky part is the setlease case. To handle that properly we have to allow userland processes to queue the fputs involved to a workqueue. This means allowing non-kthreads to queue fputs to the delayed_fput infrastructure.
Al, can you look and weigh in? Do the delayed_fput/global_fput changes look reasonable?
Jeff Layton (19):
nfsd: move include of state.h from trace.c to trace.h
fs: have flush_delayed_fput flush the workqueue job
fs: add a kerneldoc header to fput
fs: rename "delayed_fput" infrastructure to "fput_global"
fs: add fput_global
fsnotify: export several symbols
locks: create a new notifier chain for lease attempts
sunrpc: add a new cache_detail operation for when a cache is flushed
nfsd: add a new struct file caching facility to nfsd
nfsd: keep some rudimentary stats on nfsd_file cache
nfsd: allow filecache open to skip fh_verify check
nfsd: hook up nfsd_write to the new nfsd_file cache
nfsd: hook up nfsd_read to the nfsd_file cache
nfsd: hook nfsd_commit up to the nfsd_file cache
nfsd: convert nfs4_file->fi_fds array to use nfsd_files
nfsd: have nfsd_test_lock use the nfsd_file cache
nfsd: convert fi_deleg_file and ls_file fields to nfsd_file
nfsd: hook up nfs4_preprocess_stateid_op to the nfsd_file cache
nfsd: rip out the raparms cache
fs/file_table.c | 94 ++++-- fs/locks.c | 37 +++ fs/nfsd/Kconfig | 2 + fs/nfsd/Makefile | 3 +- fs/nfsd/export.c | 14 + fs/nfsd/filecache.c | 712 +++++++++++++++++++++++++++++++++++++++++++ fs/nfsd/filecache.h | 44 +++ fs/nfsd/nfs3proc.c | 2 +- fs/nfsd/nfs4layouts.c | 12 +- fs/nfsd/nfs4proc.c | 32 +- fs/nfsd/nfs4state.c | 174 +++++------ fs/nfsd/nfs4xdr.c | 16 +- fs/nfsd/nfsctl.c | 10 + fs/nfsd/nfsproc.c | 2 +- fs/nfsd/nfssvc.c | 16 +- fs/nfsd/state.h | 10 +- fs/nfsd/trace.c | 2 - fs/nfsd/trace.h | 137 +++++++++ fs/nfsd/vfs.c | 269 ++++------------ fs/nfsd/vfs.h | 11 +- fs/nfsd/xdr4.h | 15 +- fs/notify/group.c | 2 + fs/notify/inode_mark.c | 1 + fs/notify/mark.c | 4 + include/linux/file.h | 3 +- include/linux/fs.h | 1 + include/linux/sunrpc/cache.h | 1 + init/main.c | 2 +- net/sunrpc/cache.c | 3 + 29 files changed, 1249 insertions(+), 382 deletions(-) create mode 100644 fs/nfsd/filecache.c create mode 100644 fs/nfsd/filecache.h
Signature · 6 lines
2.4.3 -- To unsubscribe from this list: send the line "unsubscribe linux-nfs" in the body of a message to [email protected] More majordomo info at http://vger.kernel.org/majordomo-info.html
A message that is not in the archive (sent off-list or not yet received): 1445362432-18869-1-git-send-email-jeff.layton-7I+n7zu2hftEKMMhf/[email protected]
PATCH v6 1/19 nfsd: move include of state.h from trace.c to trace.h
Any file which includes trace.h will need to include state.h, even if they aren't using any state tracepoints. Ensure that we include any headers that might be needed in trace.h instead of relying on the *.c files to have the right ones.
--- fs/nfsd/trace.c | 2 -- fs/nfsd/trace.h | 2 ++ 2 files changed, 2 insertions(+), 2 deletions(-)
fs/nfsd/trace.c +0 -2
@@ -1,5 +1,3 @@ -#include "state.h" -#define CREATE_TRACE_POINTS #include "trace.h"
fs/nfsd/trace.h +2 -0
@@ -9,6 +9,8 @@#include <linux/tracepoint.h> +#include "state.h" + DECLARE_EVENT_CLASS(nfsd_stateid_class, TP_PROTO(stateid_t *stp), TP_ARGS(stp),
Signature · 6 lines
2.4.3 -- To unsubscribe from this list: send the line "unsubscribe linux-nfs" in the body of a message to [email protected] More majordomo info at http://vger.kernel.org/majordomo-info.html
A message that is not in the archive (sent off-list or not yet received): 1445362432-18869-2-git-send-email-jeff.layton-7I+n7zu2hftEKMMhf/[email protected]
J. Bruce Fields
AppliedRe: [PATCH v6 01/19] nfsd: move include of state.h from trace.c to trace.h
Quoted 4 lines · Jeff Layton
Any file which includes
trace.hwill need to includestate.h, even if they aren't using any state tracepoints. Ensure that we include any headers that might be needed intrace.hinstead of relying on the *.c files to have the right ones.
Applied, thanks.--b.
Quoted 33 lines
Reviewed-by Christoph Hellwig <[email protected]>--- fs/nfsd/trace.c | 2 -- fs/nfsd/trace.h | 2 ++ 2 files changed, 2 insertions(+), 2 deletions(-)fs/nfsd/trace.c +0
-2@@ -1,5 +1,3 @@ -#include "state.h" -#define CREATE_TRACE_POINTS #include "trace.h" fs/nfsd/trace.h +2
-0@@ -9,6 +9,8 @@#include <linux/tracepoint.h> +#include "state.h" + DECLARE_EVENT_CLASS(nfsd_stateid_class, TP_PROTO(stateid_t *stp), TP_ARGS(stp),Signature · 1 line
2.4.3
--
To unsubscribe from this list: send the line "unsubscribe linux-nfs" in the body of a message to [email protected] More majordomo info at http://vger.kernel.org/majordomo-info.html
PATCH v6 2/19 fs: have flush_delayed_fput flush the workqueue job
In reply to a message not in the archiveI think there's a potential race in flush_delayed_fput. A kthread does an fput() and that file gets added to the list and the delayed work is scheduled. More than 1 jiffy passes, and the workqueue thread picks up the work and starts running it. Then the kthread calls flush_delayed_work. It sees that the list is empty and returns immediately, even though the __fput for its file may not have run yet.
Close this by making flush_delayed_fput use flush_delayed_work instead, which should immediately schedule the work to run if it's not already, and block until the workqueue job completes.
--- fs/file_table.c | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-)
fs/file_table.c +3 -3
@@ -244,6 +244,8 @@ static void ____fput(struct callback_head *work) __fput(container_of(work, struct file, f_u.fu_rcuhead)); } +static DECLARE_DELAYED_WORK(delayed_fput_work, delayed_fput); +/* * If kernel thread really needs to have the final fput() it has done * to complete, call this. The only user right now is the boot - we
@@ -256,11 +258,9 @@ static void ____fput(struct callback_head *work)*/ void flush_delayed_fput (void ) { -delayed_fput (NULL ); +flush_delayed_work (&delayed_fput_work); } -static DECLARE_DELAYED_WORK(delayed_fput_work, delayed_fput); -void fput (struct file *file) {if (atomic_long_dec_and_test (&file->f_count)) {
Signature · 6 lines
2.4.3 -- To unsubscribe from this list: send the line "unsubscribe linux-nfs" in the body of a message to [email protected] More majordomo info at http://vger.kernel.org/majordomo-info.html
PATCH v6 5/19 fs: add fput_global
In reply to a message not in the archiveWhen nfsd caches a file, we want to be able to close it down in advance of setlease attempts. Setting a lease is generally done at the behest of userland, so we need a mechanism to ensure that a userland task can completely close a file without having to return back to userspace.
To do this, we borrow the global delayed_fput infrastructure that kthreads use. fput_global will queue to the global_fput list if the last reference was put. The caller can then use fput_global_flush to force the final __fput to run.
While we're at it, export fput_global_flush as nfsd will need to use that as well.
--- fs/file_table.c | 33 +++++++++++++++++++++++++++++++++ include/linux/file.h | 1 + 2 files changed, 34 insertions(+)
fs/file_table.c +33 -0
@@ -262,6 +262,7 @@ void fput_global_flush(void) {flush_delayed_work (&global_fput_work); } +EXPORT_SYMBOL (fput_global_flush);/** * fput - put a struct file reference
@@ -304,6 +305,38 @@ void fput(struct file *file) }EXPORT_SYMBOL (fput); +/** +* fput_global - do an fput without using task_work +* @file: file of which to put the reference +* +* When fput is called in the context of a userland process, it'll queue the +* actual work (__fput()) to be done just before returning to userland. In some +* cases however, we need to ensure that the __fput runs before that point. +* +* There is no safe way to flush work that has been queued via task_work_add +* however, so to do this we borrow the global_fput infrastructure that +* kthreads use. The userland process can use fput_global() on one or more +* struct files and then call fput_global_flush() to ensure that they are +* completely closed before proceeding. +* +* The main user is nfsd, which uses this to ensure that all cached but +* otherwise unused files are closed to allow a userland request for a lease +* to proceed. +* +* Returns true if the final fput was done, false otherwise. The caller can +* use this to determine whether to fput_global_flush afterward. +*/ +bool fput_global (struct file *file) +{ +if (atomic_long_dec_and_test (&file->f_count)) { +if (llist_add (&file->f_u.fu_llist, &global_fput_list)) +schedule_delayed_work (&global_fput_work,1 ); +return true; + } +return false; +} +EXPORT_SYMBOL (fput_global); +/* * synchronous analog of fput(); for kernel threads that might be needed * in some umount() (and thus can't use fput_global_flush() without
include/linux/file.h +1 -0
@@ -12,6 +12,7 @@struct file ;extern void fput (struct file *); +extern bool fput_global (struct file *);struct file_operations ;struct vfsmount ;
Signature · 6 lines
2.4.3 -- To unsubscribe from this list: send the line "unsubscribe linux-nfs" in the body of a message to [email protected] More majordomo info at http://vger.kernel.org/majordomo-info.html
PATCH v6 8/19 sunrpc: add a new cache_detail operation for when a cache is flushed
In reply to a message not in the archiveWhen the exports table is changed, exportfs will usually write a new time to the "flush" file in the nfsd.export cache procfile. This tells the kernel to flush any entries that are older than that value.
This gives us a mechanism to tell whether an unexport might have occurred. Add a new ->flush cache_detail operation that is called after flushing the cache whenever someone writes to a "flush" file.
--- include/linux/sunrpc/cache.h | 1 + net/sunrpc/cache.c | 3 +++ 2 files changed, 4 insertions(+)
include/linux/sunrpc/cache.h +1 -0
@@ -98,6 +98,7 @@ struct cache_detail { int has_died);struct cache_head * (*alloc)(void ); +void (*flush)(void );int (*match)(struct cache_head *orig,struct cache_head *new);void (*init)(struct cache_head *orig,struct cache_head *new);void (*update)(struct cache_head *orig,struct cache_head *new);
net/sunrpc/cache.c +3 -0
@@ -1451,6 +1451,9 @@ static ssize_t write_flush(struct file *file, const char __user *buf, cd->nextcheck =seconds_since_boot ();cache_flush (); +if (cd->flush) + cd->flush (); + *ppos += count;return count; }
Signature · 6 lines
2.4.3 -- To unsubscribe from this list: send the line "unsubscribe linux-nfs" in the body of a message to [email protected] More majordomo info at http://vger.kernel.org/majordomo-info.html
PATCH v6 9/19 nfsd: add a new struct file caching facility to nfsd
In reply to a message not in the archiveCurrently, NFSv2/3 reads and writes have to open a file, do the read or write and then close it again for each RPC. This is highly inefficient, especially when the underlying filesystem has a relatively slow open routine.
This patch adds a new open file cache to knfsd. Rather than doing an open for each RPC, the read/write handlers can call into this cache to see if there is one already there for the correct filehandle and NFS_MAY_READ/WRITE flags.
If there isn't an entry, then we create a new one and attempt to perform the open. If there is, then we wait until the entry is fully instantiated and return it if it is at the end of the wait. If it's not, then we attempt to take over construction.
Since the main goal is to speed up NFSv2/3 I/O, we don't want to close these files on last put of these objects. We need to keep them around for a little while since we never know when the next READ/WRITE will come in.
Note that this patch just adds the infrastructure to allow the caching of open files. Later patches will actually make nfsd use it.
--- fs/nfsd/Kconfig | 2 + fs/nfsd/Makefile | 3 +- fs/nfsd/export.c | 14 ++ fs/nfsd/filecache.c | 671 ++++++++++++++++++++++++++++++++++++++++++++++++++++ fs/nfsd/filecache.h | 43 ++++ fs/nfsd/nfssvc.c | 10 +- fs/nfsd/trace.h | 135 +++++++++++ fs/nfsd/vfs.c | 3 +- fs/nfsd/vfs.h | 1 + 9 files changed, 879 insertions(+), 3 deletions(-) create mode 100644 fs/nfsd/filecache.c create mode 100644 fs/nfsd/filecache.h
fs/nfsd/Kconfig +2 -0
@@ -6,6 +6,8 @@ config NFSD select SUNRPC select EXPORTFS select NFS_ACL_SUPPORT if NFSD_V2_ACL + select SRCU + select FSNOTIFY depends on MULTIUSER help Choose Y here if you want to allow other computers to access
fs/nfsd/Makefile +2 -1
@@ -10,7 +10,8 @@ obj-$(CONFIG_NFSD) += nfsd.o nfsd-y += trace.o nfsd-y += nfssvc.o nfsctl.o nfsproc.o nfsfh.o vfs.o \ - export.o auth.o lockd.o nfscache.o nfsxdr.o stats.o + export.o auth.o lockd.o nfscache.o nfsxdr.o \ + stats.o filecache.o nfsd-$(CONFIG_NFSD_FAULT_INJECTION) += fault_inject.o nfsd-$(CONFIG_NFSD_V2_ACL) += nfs2acl.o nfsd-$(CONFIG_NFSD_V3) += nfs3proc.o nfs3xdr.o
fs/nfsd/export.c +14 -0
@@ -21,6 +21,7 @@#include "nfsfh.h" #include "netns.h" #include "pnfs.h" +#include "filecache.h" #define NFSDDBG_FACILITY NFSDDBG_EXPORT
@@ -231,6 +232,18 @@ static struct cache_head *expkey_alloc(void)return NULL ; } +static void +expkey_flush (void ) +{ +/* +* Take the nfsd_mutex here to ensure that the file cache is not +* destroyed while we're in the middle of flushing. +*/ +mutex_lock (&nfsd_mutex); +nfsd_file_cache_purge (); +mutex_unlock (&nfsd_mutex); +} +static struct cache_detail svc_expkey_cache_template = { .owner =THIS_MODULE , .hash_size =EXPKEY_HASHMAX ,
@@ -243,6 +256,7 @@ static struct cache_detail svc_expkey_cache_template = { .init = expkey_init, .update = expkey_update, .alloc = expkey_alloc, + .flush = expkey_flush, }; static int
fs/nfsd/filecache.c new file +671 -0
671 lines not on this page · raw message
fs/nfsd/filecache.h new file +43 -0
43 lines not on this page · raw message
fs/nfsd/nfssvc.c +9 -1
@@ -22,6 +22,7 @@#include "cache.h" #include "vfs.h" #include "netns.h" +#include "filecache.h" #define NFSDDBG_FACILITY NFSDDBG_SVC
@@ -224,11 +225,17 @@ static int nfsd_startup_generic(int nrservs)if (ret) goto dec_users; - ret =nfs4_state_start (); + ret =nfsd_file_cache_init ();if (ret) goto out_racache; + + ret =nfs4_state_start (); +if (ret) + goto out_file_cache;return 0 ; +out_file_cache: +nfsd_file_cache_shutdown (); out_racache:nfsd_racache_shutdown (); dec_users:
@@ -242,6 +249,7 @@ static void nfsd_shutdown_generic(void)return ;nfs4_state_shutdown (); +nfsd_file_cache_shutdown ();nfsd_racache_shutdown (); }
fs/nfsd/trace.h +135 -0
147 lines not on this page · raw message
fs/nfsd/vfs.c +2 -1
@@ -623,7 +623,8 @@ nfsd_access(struct svc_rqst *rqstp, struct svc_fh *fhp, u32 *access, u32 *suppor }#endif /* CONFIG_NFSD_V3 */ -static int nfsd_open_break_lease (struct inode *inode,int access) +int +nfsd_open_break_lease (struct inode *inode,int access) {unsigned int mode;
fs/nfsd/vfs.h +1 -0
@@ -69,6 +69,7 @@ __be32 do_nfsd_create(struct svc_rqst *, struct svc_fh *,__be32 nfsd_commit (struct svc_rqst *,struct svc_fh *,loff_t ,unsigned long );#endif /* CONFIG_NFSD_V3 */ +int nfsd_open_break_lease (struct inode *,int );__be32 nfsd_open (struct svc_rqst *,struct svc_fh *,umode_t ,int ,struct file **);struct raparms ;
Signature · 6 lines
2.4.3 -- To unsubscribe from this list: send the line "unsubscribe linux-nfs" in the body of a message to [email protected] More majordomo info at http://vger.kernel.org/majordomo-info.html
PATCH v6 10/19 nfsd: keep some rudimentary stats on nfsd_file cache
In reply to a message not in the archivePer chain count and max length, protected by the per-chain spinlock. When the file is read, we walk the array of buckets and fetch the count from each.
--- fs/nfsd/filecache.c | 40 ++++++++++++++++++++++++++++++++++++++++ fs/nfsd/filecache.h | 1 + fs/nfsd/nfsctl.c | 10 ++++++++++ 3 files changed, 51 insertions(+)
fs/nfsd/filecache.c +40 -0
@@ -11,6 +11,7 @@#include <linux/sched.h> #include <linux/list_lru.h> #include <linux/fsnotify_backend.h> +#include <linux/seq_file.h> #include "vfs.h" #include "nfsd.h"
@@ -30,6 +31,8 @@struct nfsd_fcache_bucket {struct hlist_head nfb_head;spinlock_t nfb_lock; +unsigned int nfb_count; +unsigned int nfb_maxcount; };static struct kmem_cache *nfsd_file_slab;
@@ -171,6 +174,7 @@ nfsd_file_unhash(struct nfsd_file *nf)trace_nfsd_file_unhash (nf);if (test_bit (NFSD_FILE_HASHED , &nf->nf_flags)) { + --nfsd_file_hashtbl[nf->nf_hashval].nfb_count;clear_bit (NFSD_FILE_HASHED , &nf->nf_flags);hlist_del_rcu (&nf->nf_node);list_lru_del (&nfsd_file_lru, &nf->nf_lru);
@@ -587,6 +591,9 @@ retry:list_lru_add (&nfsd_file_lru, &new->nf_lru);hlist_add_head_rcu (&new->nf_node, &nfsd_file_hashtbl[hashval].nfb_head); + ++nfsd_file_hashtbl[hashval].nfb_count; + nfsd_file_hashtbl[hashval].nfb_maxcount =max (nfsd_file_hashtbl[hashval].nfb_maxcount, + nfsd_file_hashtbl[hashval].nfb_count);spin_unlock (&nfsd_file_hashtbl[hashval].nfb_lock); nf = new; new =NULL ;
@@ -669,3 +676,36 @@ open_file:wake_up_bit (&nf->nf_flags,NFSD_FILE_PENDING ); goto out; } + +/* +* Note that fields may be added, removed or reordered in the future. Programs +* scraping this file for info should test the labels to ensure they're +* getting the correct field. +*/ +static int nfsd_file_cache_stats_show (struct seq_file *m,void *v) +{ +unsigned int i, count =0 , longest =0 ; + +/* +* No need for spinlocks here since we're not terribly interested in +* accuracy. We do take the nfsd_mutex simply to ensure that we +* don't end up racing with server shutdown +*/ +mutex_lock (&nfsd_mutex); +if (nfsd_file_hashtbl) { +for (i =0 ; i <NFSD_FILE_HASH_SIZE ; i++) { + count += nfsd_file_hashtbl[i].nfb_count; + longest =max (longest, nfsd_file_hashtbl[i].nfb_count); + } + } +mutex_unlock (&nfsd_mutex); + +seq_printf (m,"total entries: %u\n" , count); +seq_printf (m,"longest chain: %u\n" , longest); +return 0 ; +} + +int nfsd_file_cache_stats_open (struct inode *inode,struct file *file) +{ +return single_open (file, nfsd_file_cache_stats_show,NULL ); +}
fs/nfsd/filecache.h +1 -0
@@ -40,4 +40,5 @@ struct nfsd_file *nfsd_file_get(struct nfsd_file *nf);void nfsd_file_close_inode_sync (struct inode *inode);__be32 nfsd_file_acquire (struct svc_rqst *rqstp,struct svc_fh *fhp,unsigned int may_flags,struct nfsd_file **nfp); +int nfsd_file_cache_stats_open (struct inode *,struct file *);#endif /* _FS_NFSD_FILECACHE_H */
fs/nfsd/nfsctl.c +10 -0
@@ -22,6 +22,7 @@#include "state.h" #include "netns.h" #include "pnfs.h" +#include "filecache.h" /* * We have a single directory with several nodes in it.
@@ -36,6 +37,7 @@ enum { NFSD_Threads, NFSD_Pool_Threads, NFSD_Pool_Stats, + NFSD_File_Cache_Stats, NFSD_Reply_Cache_Stats, NFSD_Versions, NFSD_Ports,
@@ -220,6 +222,13 @@ static const struct file_operations pool_stats_operations = { .owner = THIS_MODULE, }; +static struct file_operations file_cache_stats_operations = { + .open = nfsd_file_cache_stats_open, + .read = seq_read, + .llseek = seq_lseek, + .release = single_release, +}; +static struct file_operations reply_cache_stats_operations = { .open = nfsd_reply_cache_stats_open, .read = seq_read,
@@ -1138,6 +1147,7 @@ static int nfsd_fill_super(struct super_block * sb, void * data, int silent) [NFSD_Threads] = {"threads", &transaction_ops, S_IWUSR|S_IRUSR}, [NFSD_Pool_Threads] = {"pool_threads", &transaction_ops, S_IWUSR|S_IRUSR}, [NFSD_Pool_Stats] = {"pool_stats", &pool_stats_operations, S_IRUGO}, + [NFSD_File_Cache_Stats] = {"file_cache_stats", &file_cache_stats_operations, S_IRUGO}, [NFSD_Reply_Cache_Stats] = {"reply_cache_stats", &reply_cache_stats_operations, S_IRUGO}, [NFSD_Versions] = {"versions", &transaction_ops, S_IWUSR|S_IRUSR}, [NFSD_Ports] = {"portlist", &transaction_ops, S_IWUSR|S_IRUGO},
Signature · 6 lines
2.4.3 -- To unsubscribe from this list: send the line "unsubscribe linux-nfs" in the body of a message to [email protected] More majordomo info at http://vger.kernel.org/majordomo-info.html
PATCH v6 11/19 nfsd: allow filecache open to skip fh_verify check
In reply to a message not in the archiveCurrently, we call fh_verify twice on the filehandle. Once when we call into nfsd_file_acquire, and then again from nfsd_open. The second one is completely superfluous though, and fh_verify can do some things that require a fair bit of work (checking permissions, for instance).
Create a new nfsd_open_verified function that will do an nfsd_open on a filehandle that has already been verified. Call that from the filecache code.
--- fs/nfsd/filecache.c | 3 ++- fs/nfsd/vfs.c | 63 +++++++++++++++++++++++++++++++++++------------------ fs/nfsd/vfs.h | 2 ++ 3 files changed, 46 insertions(+), 22 deletions(-)
fs/nfsd/filecache.c +2 -1
@@ -670,7 +670,8 @@ open_file: }/* FIXME: should we abort opening if the link count goes to 0? */ if (status == nfs_ok) - status =nfsd_open (rqstp, fhp,S_IFREG , may_flags, &nf->nf_file); + status =nfsd_open_verified (rqstp, fhp,S_IFREG , may_flags, + &nf->nf_file);clear_bit_unlock (NFSD_FILE_PENDING , &nf->nf_flags);smp_mb__after_atomic ();wake_up_bit (&nf->nf_flags,NFSD_FILE_PENDING );
fs/nfsd/vfs.c +42 -21
81 lines not on this page · raw message
fs/nfsd/vfs.h +2 -0
@@ -72,6 +72,8 @@ __be32 nfsd_commit(struct svc_rqst *, struct svc_fh *,int nfsd_open_break_lease (struct inode *,int );__be32 nfsd_open (struct svc_rqst *,struct svc_fh *,umode_t ,int ,struct file **); +__be32 nfsd_open_verified (struct svc_rqst *,struct svc_fh *,umode_t , +int ,struct file **);struct raparms ;__be32 nfsd_splice_read (struct svc_rqst *,struct file *,loff_t ,unsigned long *);
Signature · 6 lines
2.4.3 -- To unsubscribe from this list: send the line "unsubscribe linux-nfs" in the body of a message to [email protected] More majordomo info at http://vger.kernel.org/majordomo-info.html
PATCH v6 12/19 nfsd: hook up nfsd_write to the new nfsd_file cache
In reply to a message not in the archiveNote that all callers currently pass in NULL for "file" anyway, so there was already some dead code in here. Just eliminate that parm and have it use the file cache instead of dealing directly with a filp.
--- fs/nfsd/nfs3proc.c | 2 +- fs/nfsd/nfsproc.c | 2 +- fs/nfsd/vfs.c | 33 +++++++++++---------------------- fs/nfsd/vfs.h | 2 +- 4 files changed, 14 insertions(+), 25 deletions(-)
fs/nfsd/nfs3proc.c +1 -1
@@ -192,7 +192,7 @@ nfsd3_proc_write(struct svc_rqst *rqstp, struct nfsd3_writeargs *argp,fh_copy (&resp->fh, &argp->fh); resp->committed = argp->stable; - nfserr = nfsd_write(rqstp, &resp->fh, NULL, + nfserr = nfsd_write(rqstp, &resp->fh, argp->offset, rqstp->rq_vec, argp->vlen, &cnt,
fs/nfsd/nfsproc.c +1 -1
@@ -213,7 +213,7 @@ nfsd_proc_write(struct svc_rqst *rqstp, struct nfsd_writeargs *argp,SVCFH_fmt (&argp->fh), argp->len, argp->offset); - nfserr = nfsd_write(rqstp, fh_copy(&resp->fh, &argp->fh), NULL, + nfserr = nfsd_write(rqstp, fh_copy(&resp->fh, &argp->fh), argp->offset, rqstp->rq_vec, argp->vlen, &cnt,
fs/nfsd/vfs.c +11 -22
@@ -42,6 +42,7 @@#include "nfsd.h" #include "vfs.h" +#include "filecache.h" #define NFSDDBG_FACILITY NFSDDBG_FILEOP
@@ -1030,30 +1031,18 @@ __be32 nfsd_read(struct svc_rqst *rqstp, struct svc_fh *fhp,* N.B. After this call fhp needs an fh_put */ __be32 -nfsd_write (struct svc_rqst *rqstp,struct svc_fh *fhp,struct file *file, -loff_t offset,struct kvec *vec,int vlen,unsigned long *cnt, -int *stablep) +nfsd_write (struct svc_rqst *rqstp,struct svc_fh *fhp,loff_t offset, +struct kvec *vec,int vlen,unsigned long *cnt,int *stablep) { -__be32 err =0 ; - -if (file) { - err =nfsd_permission (rqstp, fhp->fh_export, fhp->fh_dentry, -NFSD_MAY_WRITE |NFSD_MAY_OWNER_OVERRIDE ); -if (err) - goto out; - err =nfsd_vfs_write (rqstp, fhp, file, offset, vec, vlen, cnt, - stablep); - }else { - err =nfsd_open (rqstp, fhp,S_IFREG ,NFSD_MAY_WRITE , &file); -if (err) - goto out; - -if (cnt) - err =nfsd_vfs_write (rqstp, fhp, file, offset, vec, vlen, - cnt, stablep); -fput (file); +__be32 err; +struct nfsd_file *nf; + + err =nfsd_file_acquire (rqstp, fhp,NFSD_MAY_WRITE , &nf); +if (err == nfs_ok) { + err =nfsd_vfs_write (rqstp, fhp, nf->nf_file, offset, vec, + vlen, cnt, stablep); +nfsd_file_put (nf); } -out:return err; }
fs/nfsd/vfs.h +1 -1
@@ -81,7 +81,7 @@ __be32 nfsd_readv(struct file *, loff_t, struct kvec *, int, unsigned long *);__be32 nfsd_read (struct svc_rqst *,struct svc_fh *,loff_t ,struct kvec *,int ,unsigned long *); -__be32 nfsd_write (struct svc_rqst *,struct svc_fh *,struct file *, +__be32 nfsd_write (struct svc_rqst *,struct svc_fh *,loff_t ,struct kvec *,int ,unsigned long *,int *); __be32 nfsd_vfs_write(struct svc_rqst *rqstp, struct svc_fh *fhp, struct file *file, loff_t offset,
Signature · 6 lines
2.4.3 -- To unsubscribe from this list: send the line "unsubscribe linux-nfs" in the body of a message to [email protected] More majordomo info at http://vger.kernel.org/majordomo-info.html
PATCH v6 13/19 nfsd: hook up nfsd_read to the nfsd_file cache
In reply to a message not in the archive--- fs/nfsd/vfs.c | 21 ++++++++------------- 1 file changed, 8 insertions(+), 13 deletions(-)
fs/nfsd/vfs.c +8 -13
@@ -1008,20 +1008,15 @@ out_nfserr:__be32 nfsd_read (struct svc_rqst *rqstp,struct svc_fh *fhp,loff_t offset,struct kvec *vec,int vlen,unsigned long *count) { -struct file *file; -struct raparms *ra; -__be32 err; - - err =nfsd_open (rqstp, fhp,S_IFREG ,NFSD_MAY_READ , &file); -if (err) -return err; - - ra =nfsd_init_raparms (file); - err =nfsd_vfs_read (rqstp, file, offset, vec, vlen, count); -if (ra) -nfsd_put_raparams (file, ra); -fput (file); +__be32 err; +struct nfsd_file *nf; + err =nfsd_file_acquire (rqstp, fhp,NFSD_MAY_READ , &nf); +if (err == nfs_ok) { + err =nfsd_vfs_read (rqstp, nf->nf_file, offset, vec, vlen, + count); +nfsd_file_put (nf); + }return err; }
Signature · 6 lines
2.4.3 -- To unsubscribe from this list: send the line "unsubscribe linux-nfs" in the body of a message to [email protected] More majordomo info at http://vger.kernel.org/majordomo-info.html
PATCH v6 14/19 nfsd: hook nfsd_commit up to the nfsd_file cache
In reply to a message not in the archiveUse cached filps if possible instead of opening a new one every time.
--- fs/nfsd/vfs.c | 14 +++++++------- 1 file changed, 7 insertions(+), 7 deletions(-)
fs/nfsd/vfs.c +7 -7
@@ -1055,9 +1055,9 @@ __be32 nfsd_commit(struct svc_rqst *rqstp, struct svc_fh *fhp, loff_t offset, unsigned long count) { - struct file *file; -loff_t end =LLONG_MAX ; -__be32 err = nfserr_inval; + struct nfsd_file *nf; +loff_t end =LLONG_MAX ; +__be32 err = nfserr_inval;if (offset <0 ) goto out;
@@ -1067,12 +1067,12 @@ nfsd_commit(struct svc_rqst *rqstp, struct svc_fh *fhp, goto out; } - err =nfsd_open (rqstp, fhp,S_IFREG , -NFSD_MAY_WRITE |NFSD_MAY_NOT_BREAK_LEASE , &file); + err =nfsd_file_acquire (rqstp, fhp, +NFSD_MAY_WRITE |NFSD_MAY_NOT_BREAK_LEASE , &nf);if (err) goto out;if (EX_ISSYNC (fhp->fh_export)) { -int err2 =vfs_fsync_range (file, offset, end,0 ); +int err2 =vfs_fsync_range (nf->nf_file, offset, end,0 );if (err2 != -EINVAL ) err =nfserrno (err2);
@@ -1080,7 +1080,7 @@ nfsd_commit(struct svc_rqst *rqstp, struct svc_fh *fhp, err = nfserr_notsupp; } -fput (file); +nfsd_file_put (nf); out:return err; }
Signature · 6 lines
2.4.3 -- To unsubscribe from this list: send the line "unsubscribe linux-nfs" in the body of a message to [email protected] More majordomo info at http://vger.kernel.org/majordomo-info.html
PATCH v6 16/19 nfsd: have nfsd_test_lock use the nfsd_file cache
In reply to a message not in the archive--- fs/nfsd/nfs4state.c | 8 ++++---- 1 file changed, 4 insertions(+), 4 deletions(-)
fs/nfsd/nfs4state.c +4 -4
@@ -5596,11 +5596,11 @@ out:*/ static __be32 nfsd_test_lock (struct svc_rqst *rqstp,struct svc_fh *fhp,struct file_lock *lock) { -struct file *file; -__be32 err =nfsd_open (rqstp, fhp,S_IFREG ,NFSD_MAY_READ , &file); +struct nfsd_file *nf; +__be32 err =nfsd_file_acquire (rqstp, fhp,NFSD_MAY_READ , &nf);if (!err) { - err =nfserrno (vfs_test_lock (file, lock)); -fput (file); + err =nfserrno (vfs_test_lock (nf->nf_file, lock)); +nfsd_file_put (nf); }return err; }
Signature · 6 lines
2.4.3 -- To unsubscribe from this list: send the line "unsubscribe linux-nfs" in the body of a message to [email protected] More majordomo info at http://vger.kernel.org/majordomo-info.html
PATCH v6 17/19 nfsd: convert fi_deleg_file and ls_file fields to nfsd_file
In reply to a message not in the archiveHave them keep an nfsd_file reference instead of a struct file.
--- fs/nfsd/nfs4layouts.c | 12 ++--- fs/nfsd/nfs4state.c | 131 ++++++++++++++++++++++++++------------------------ fs/nfsd/state.h | 6 +-- 3 files changed, 76 insertions(+), 73 deletions(-)
fs/nfsd/nfs4layouts.c +6 -6
@@ -144,8 +144,8 @@ nfsd4_free_layout_stateid(struct nfs4_stid *stid)list_del_init (&ls->ls_perfile);spin_unlock (&fp->fi_lock); -vfs_setlease (ls->ls_file,F_UNLCK ,NULL , (void **)&ls); -fput (ls->ls_file); +vfs_setlease (ls->ls_file->nf_file,F_UNLCK ,NULL , (void **)&ls); +nfsd_file_put (ls->ls_file);if (ls->ls_recalled)atomic_dec (&ls->ls_stid.sc_file->fi_lo_recalls);
@@ -169,7 +169,7 @@ nfsd4_layout_setlease(struct nfs4_layout_stateid *ls) fl->fl_end =OFFSET_MAX ; fl->fl_owner = ls; fl->fl_pid = current->tgid; - fl->fl_file = ls->ls_file; + fl->fl_file = ls->ls_file->nf_file; status =vfs_setlease (fl->fl_file, fl->fl_type, &fl,NULL );if (status) {
@@ -207,13 +207,13 @@ nfsd4_alloc_layout_stateid(struct nfsd4_compound_state *cstate, NFSPROC4_CLNT_CB_LAYOUT);if (parent->sc_type ==NFS4_DELEG_STID ) - ls->ls_file =get_file (fp->fi_deleg_file); + ls->ls_file =nfsd_file_get (fp->fi_deleg_file);else ls->ls_file =find_any_file (fp);BUG_ON (!ls->ls_file);if (nfsd4_layout_setlease (ls)) { -fput (ls->ls_file); +nfsd_file_put (ls->ls_file);put_nfs4_file (fp);kmem_cache_free (nfs4_layout_stateid_cache, ls);return NULL ;
@@ -598,7 +598,7 @@ nfsd4_cb_layout_fail(struct nfs4_layout_stateid *ls) argv[0 ] ="/sbin/nfsd-recall-failed" ; argv[1 ] = addr_str; - argv[2 ] = ls->ls_file->f_path.mnt->mnt_sb->s_id; + argv[2 ] = ls->ls_file->nf_file->f_path.mnt->mnt_sb->s_id; argv[3 ] =NULL ; error =call_usermodehelper (argv[0 ], argv, envp,UMH_WAIT_PROC );
fs/nfsd/nfs4state.c +67 -64
353 lines not on this page · raw message
fs/nfsd/state.h +3 -3
@@ -501,7 +501,7 @@ struct nfs4_file {*/ atomic_t fi_access[2 ];u32 fi_share_deny; -struct file *fi_deleg_file; +struct nfsd_file *fi_deleg_file;int fi_delegees;struct knfsd_fh fi_fhandle;bool fi_had_conflict;
@@ -550,7 +550,7 @@ struct nfs4_layout_stateid {spinlock_t ls_lock;struct list_head ls_layouts;u32 ls_layout_type; -struct file *ls_file; +struct nfsd_file *ls_file;struct nfsd4_callback ls_recall;stateid_t ls_recall_sid;bool ls_recalled;
@@ -615,7 +615,7 @@ static inline void get_nfs4_file(struct nfs4_file *fi) {atomic_inc (&fi->fi_ref); } -struct file *find_any_file (struct nfs4_file *f); +struct nfsd_file *find_any_file (struct nfs4_file *f);/* grace period management */ void nfsd4_end_grace (struct nfsd_net *nn);
Signature · 6 lines
2.4.3 -- To unsubscribe from this list: send the line "unsubscribe linux-nfs" in the body of a message to [email protected] More majordomo info at http://vger.kernel.org/majordomo-info.html
PATCH v6 18/19 nfsd: hook up nfs4_preprocess_stateid_op to the nfsd_file cache
In reply to a message not in the archiveHave nfs4_preprocess_stateid_op pass back a nfsd_file instead of a filp. Since we now presume that the struct file will be persistent in most cases, we can stop fiddling with the raparms in the read code. This also means that we don't really care about the rd_tmp_file field anymore.
--- fs/nfsd/nfs4proc.c | 32 ++++++++++++++++---------------- fs/nfsd/nfs4state.c | 24 ++++++++++-------------- fs/nfsd/nfs4xdr.c | 16 +++++----------- fs/nfsd/state.h | 2 +- fs/nfsd/xdr4.h | 15 +++++++-------- 5 files changed, 39 insertions(+), 50 deletions(-)
fs/nfsd/nfs4proc.c +16 -16
@@ -758,7 +758,7 @@ nfsd4_read(struct svc_rqst *rqstp, struct nfsd4_compound_state *cstate, {__be32 status; - read->rd_filp =NULL ; + read->rd_nf =NULL ;if (read->rd_offset >=OFFSET_MAX )return nfserr_inval;
@@ -775,7 +775,7 @@ nfsd4_read(struct svc_rqst *rqstp, struct nfsd4_compound_state *cstate,/* check stateid */ status =nfs4_preprocess_stateid_op (rqstp, cstate, &read->rd_stateid, -RD_STATE , &read->rd_filp, &read->rd_tmp_file); +RD_STATE , &read->rd_nf);if (status) {dprintk ("NFSD: nfsd4_read: couldn't process stateid!\n" ); goto out;
@@ -921,7 +921,7 @@ nfsd4_setattr(struct svc_rqst *rqstp, struct nfsd4_compound_state *cstate,if (setattr->sa_iattr.ia_valid &ATTR_SIZE ) { status =nfs4_preprocess_stateid_op (rqstp, cstate, - &setattr->sa_stateid,WR_STATE ,NULL ,NULL ); + &setattr->sa_stateid,WR_STATE ,NULL );if (status) {dprintk ("NFSD: nfsd4_setattr: couldn't process stateid!\n" );return status;
@@ -977,7 +977,7 @@ nfsd4_write(struct svc_rqst *rqstp, struct nfsd4_compound_state *cstate, struct nfsd4_write *write) {stateid_t *stateid = &write->wr_stateid; -struct file *filp =NULL ; +struct nfsd_file *nf =NULL ;__be32 status = nfs_ok;unsigned long cnt;int nvecs;
@@ -986,7 +986,7 @@ nfsd4_write(struct svc_rqst *rqstp, struct nfsd4_compound_state *cstate,return nfserr_inval; status =nfs4_preprocess_stateid_op (rqstp, cstate, stateid,WR_STATE , - &filp,NULL ); + &nf);if (status) {dprintk ("NFSD: nfsd4_write: couldn't process stateid!\n" );return status;
@@ -999,10 +999,10 @@ nfsd4_write(struct svc_rqst *rqstp, struct nfsd4_compound_state *cstate, nvecs =fill_in_write_vector (rqstp->rq_vec, write);WARN_ON_ONCE (nvecs >ARRAY_SIZE (rqstp->rq_vec)); - status =nfsd_vfs_write (rqstp, &cstate->current_fh, filp, + status =nfsd_vfs_write (rqstp, &cstate->current_fh, nf->nf_file, write->wr_offset, rqstp->rq_vec, nvecs, &cnt, &write->wr_how_written); -fput (filp); +nfsd_file_put (nf); write->wr_bytes_written = cnt;
@@ -1014,21 +1014,21 @@ nfsd4_fallocate(struct svc_rqst *rqstp, struct nfsd4_compound_state *cstate, struct nfsd4_fallocate *fallocate, int flags) {__be32 status = nfserr_notsupp; -struct file *file; +struct nfsd_file *nf; status =nfs4_preprocess_stateid_op (rqstp, cstate, &fallocate->falloc_stateid, -WR_STATE , &file,NULL ); +WR_STATE , &nf);if (status != nfs_ok) {dprintk ("NFSD: nfsd4_fallocate: couldn't process stateid!\n" );return status; } - status =nfsd4_vfs_fallocate (rqstp, &cstate->current_fh, file, + status =nfsd4_vfs_fallocate (rqstp, &cstate->current_fh, nf->nf_file, fallocate->falloc_offset, fallocate->falloc_length, flags); -fput (file); +nfsd_file_put (nf);return status; }
@@ -1053,11 +1053,11 @@ nfsd4_seek(struct svc_rqst *rqstp, struct nfsd4_compound_state *cstate, {int whence;__be32 status; -struct file *file; +struct nfsd_file *nf; status =nfs4_preprocess_stateid_op (rqstp, cstate, &seek->seek_stateid, -RD_STATE , &file,NULL ); +RD_STATE , &nf);if (status) {dprintk ("NFSD: nfsd4_seek: couldn't process stateid!\n" );return status;
@@ -1079,14 +1079,14 @@ nfsd4_seek(struct svc_rqst *rqstp, struct nfsd4_compound_state *cstate,* Note: This call does change file->f_pos, but nothing in NFSD * should ever file->f_pos. */ - seek->seek_pos =vfs_llseek (file, seek->seek_offset, whence); + seek->seek_pos =vfs_llseek (nf->nf_file, seek->seek_offset, whence);if (seek->seek_pos <0 ) status =nfserrno (seek->seek_pos); -else if (seek->seek_pos >=i_size_read (file_inode (file))) +else if (seek->seek_pos >=i_size_read (file_inode (nf->nf_file))) seek->seek_eof = true; out: -fput (file); +nfsd_file_put (nf);return status; }
fs/nfsd/nfs4state.c +10 -14
@@ -4658,7 +4658,7 @@ nfs4_check_olstateid(struct svc_fh *fhp, struct nfs4_ol_stateid *ols, int flags)static __be32 nfs4_check_file (struct svc_rqst *rqstp,struct svc_fh *fhp,struct nfs4_stid *s, -struct file **filpp,bool *tmp_file,int flags) +struct nfsd_file **nfp,int flags) {int acc = (flags &RD_STATE ) ?NFSD_MAY_READ :NFSD_MAY_WRITE ;struct nfsd_file *nf;
@@ -4668,20 +4668,18 @@ nfs4_check_file(struct svc_rqst *rqstp, struct svc_fh *fhp, struct nfs4_stid *s,if (nf) { status =nfsd_permission (rqstp, fhp->fh_export, fhp->fh_dentry, acc |NFSD_MAY_OWNER_OVERRIDE ); -if (status) +if (status) { +nfsd_file_put (nf); goto out; + } }else { status =nfsd_file_acquire (rqstp, fhp, acc, &nf);if (status)return status; - -if (tmp_file) - *tmp_file = true; } - *filpp =get_file (nf->nf_file); + *nfp = nf; out: -nfsd_file_put (nf);return status; }
@@ -4691,7 +4689,7 @@ out:__be32 nfs4_preprocess_stateid_op (struct svc_rqst *rqstp,struct nfsd4_compound_state *cstate,stateid_t *stateid, -int flags,struct file **filpp,bool *tmp_file) +int flags,struct nfsd_file **nfp) {struct svc_fh *fhp = &cstate->current_fh;struct inode *ino =d_inode (fhp->fh_dentry);
@@ -4700,10 +4698,8 @@ nfs4_preprocess_stateid_op(struct svc_rqst *rqstp,struct nfs4_stid *s =NULL ;__be32 status; -if (filpp) - *filpp =NULL ; -if (tmp_file) - *tmp_file = false; +if (nfp) + *nfp =NULL ;if (grace_disallows_io (net, ino))return nfserr_grace;
@@ -4740,8 +4736,8 @@ nfs4_preprocess_stateid_op(struct svc_rqst *rqstp, status =nfs4_check_fh (fhp, s); done: -if (!status && filpp) - status =nfs4_check_file (rqstp, fhp, s, filpp, tmp_file, flags); +if (status == nfs_ok && nfp) + status =nfs4_check_file (rqstp, fhp, s, nfp, flags); out:if (s)nfs4_put_stid (s);
fs/nfsd/nfs4xdr.c +5 -11
@@ -49,6 +49,7 @@#include "cache.h" #include "netns.h" #include "pnfs.h" +#include "filecache.h" #ifdef CONFIG_NFSD_V4_SECURITY_LABEL #include <linux/security.h>
@@ -3460,14 +3461,14 @@ nfsd4_encode_read(struct nfsd4_compoundres *resp, __be32 nfserr, {unsigned long maxcount;struct xdr_stream *xdr = &resp->xdr; -struct file *file = read->rd_filp; +struct file *file;int starting_len = xdr->buf->len; -struct raparms *ra =NULL ;__be32 *p;if (nfserr) goto out; + file = read->rd_nf->nf_file; p =xdr_reserve_space (xdr,8 );/* eof flag and byte count */ if (!p) {WARN_ON_ONCE (test_bit (RQ_SPLICE_OK , &resp->rqstp->rq_flags));
@@ -3487,24 +3488,17 @@ nfsd4_encode_read(struct nfsd4_compoundres *resp, __be32 nfserr, (xdr->buf->buflen - xdr->buf->len)); maxcount = min_t(unsigned long, maxcount, read->rd_length); -if (read->rd_tmp_file) - ra =nfsd_init_raparms (file); -if (file->f_op->splice_read &&test_bit (RQ_SPLICE_OK , &resp->rqstp->rq_flags)) nfserr =nfsd4_encode_splice_read (resp, read, file, maxcount);else nfserr =nfsd4_encode_readv (resp, read, file, maxcount); -if (ra) -nfsd_put_raparams (file, ra); -if (nfserr)xdr_truncate_encode (xdr, starting_len); - out: -if (file) -fput (file); +if (read->rd_nf) +nfsd_file_put (read->rd_nf);return nfserr; }
fs/nfsd/state.h +1 -1
@@ -579,7 +579,7 @@ struct nfsd_net;extern __be32 nfs4_preprocess_stateid_op (struct svc_rqst *rqstp,struct nfsd4_compound_state *cstate,stateid_t *stateid, -int flags,struct file **filp,bool *tmp_file); +int flags,struct nfsd_file **filp);__be32 nfsd4_lookup_stateid (struct nfsd4_compound_state *cstate,stateid_t *stateid,unsigned char typemask,struct nfs4_stid **s,struct nfsd_net *nn);
fs/nfsd/xdr4.h +7 -8
@@ -268,15 +268,14 @@ struct nfsd4_open_downgrade {struct nfsd4_read { -stateid_t rd_stateid;/* request */ -u64 rd_offset;/* request */ -u32 rd_length;/* request */ -int rd_vlen; -struct file *rd_filp; -bool rd_tmp_file; +stateid_t rd_stateid;/* request */ +u64 rd_offset;/* request */ +u32 rd_length;/* request */ +int rd_vlen; +struct nfsd_file *rd_nf; -struct svc_rqst *rd_rqstp;/* response */ -struct svc_fh * rd_fhp;/* response */ +struct svc_rqst *rd_rqstp;/* response */ +struct svc_fh *rd_fhp;/* response */ };struct nfsd4_readdir {
Signature · 6 lines
2.4.3 -- To unsubscribe from this list: send the line "unsubscribe linux-nfs" in the body of a message to [email protected] More majordomo info at http://vger.kernel.org/majordomo-info.html
I haven't reviewed this in detail yet, sorry.
I seem to recall that a filehandle cache was something Christoph (cc'd) lobbied for for a long time, but I forget the issue--did getting rid of the raparms cache allow some sort of further vfs cleanup?
But I don't know that this is justifiable just as cleanup, so some understanding of the performance impact would be useful too.
--b.
Quoted 104 lines · Jeff Layton
v6:
- renamedelayed_fputinfrastructure toglobal_fput
- droplist_lru_rotatepatch, rework LRU list code to useLRU_ROTATEand a newNFSD_FILE_REFERENCEDflag
- reworkfsnotify_markhandling to be done with separate allocation
- bugfixesv5:
- switch to usingflush_delayed_fputinstead of__fput_sync
- hash oninode->i_inoinstead of inode pointer
- add/proc/fs/nfsd/file_cache_statsfile to track stats on the hash
- eliminate extrafh_verifyinnfsd_file_acquirev4:
- squash some of the patches down into one patch to reduce churn
- close cached open files after unlink instead of before
- don't just close files after nfsd does an unlink, must do it after any vfs-layer unlink. Use fsnotify to handle that.
- use a SRCU notifier chain for setlease
- add patch to allow non-kthreads to do afput_syncv3:
- open files are now hashed on inode pointer instead of fh
- eliminate the recurring workqueue job in favor of shrinker/LRU and notifier from lease setting code
- have nfsv4 use the cache as well
- removal of raparms cachev2:
- changelog cleanups and clarifications
- allow COMMIT to use cached open files
- tracepoints fornfsd_filecache
- proactively close open files prior to REMOVE, or a RENAME over a positive dentryThis is the sixth posting of this patchset. For those just tuning in now, the basic idea here is to allow nfsd to keep a cache of open file descriptions, primarily to help NFSv3 workloads but also to clean up some nastiness in the NFSv4 file handling.
Of course, we can't keep files open indefinitely, so much of the new infrastructure is geared toward allowing the files to be closed on demand, in the following cases:
-
nfsd_filesare released whenever the inode's link count goes to zero
- they are released when userspace wants to set a lease on the inode
- when a shrinker callback occurs for thenfsd_filecache
- when filesystems are unexported or nfsd is shut down, we clean out the cacheThis allows nfsd to keep the file open basically indefinitely. The tricky part is the setlease case. To handle that properly we have to allow userland processes to queue the fputs involved to a workqueue. This means allowing non-kthreads to queue fputs to the
delayed_fputinfrastructure.Al, can you look and weigh in? Do the delayed_fput/global_fput changes look reasonable?
Jeff Layton (19):
nfsd: move include ofstate.hfromtrace.ctotrace.h
fs: haveflush_delayed_fputflush the workqueue job
fs: add a kerneldoc header to fput
fs: rename "delayed_fput" infrastructure to "fput_global"
fs: addfput_global
fsnotify: export several symbols
locks: create a new notifier chain for lease attempts
sunrpc: add a newcache_detailoperation for when a cache is flushed
nfsd: add a new struct file caching facility to nfsd
nfsd: keep some rudimentary stats onnfsd_filecache
nfsd: allow filecache open to skipfh_verifycheck
nfsd: hook upnfsd_writeto the newnfsd_filecache
nfsd: hook upnfsd_readto thenfsd_filecache
nfsd: hooknfsd_commitup to thenfsd_filecache
nfsd: convertnfs4_file->fi_fdsarray to usenfsd_files
nfsd: havenfsd_test_lockuse thenfsd_filecache
nfsd: convertfi_deleg_fileandls_filefields tonfsd_file
nfsd: hook upnfs4_preprocess_stateid_opto thenfsd_filecache
nfsd: rip out the raparms cachefs/file_table.c | 94 ++++-- fs/locks.c | 37 +++ fs/nfsd/Kconfig | 2 + fs/nfsd/Makefile | 3 +- fs/nfsd/export.c | 14 + fs/nfsd/filecache.c | 712 +++++++++++++++++++++++++++++++++++++++++++ fs/nfsd/filecache.h | 44 +++ fs/nfsd/nfs3proc.c | 2 +- fs/nfsd/nfs4layouts.c | 12 +- fs/nfsd/nfs4proc.c | 32 +- fs/nfsd/nfs4state.c | 174 +++++------ fs/nfsd/nfs4xdr.c | 16 +- fs/nfsd/nfsctl.c | 10 + fs/nfsd/nfsproc.c | 2 +- fs/nfsd/nfssvc.c | 16 +- fs/nfsd/state.h | 10 +- fs/nfsd/trace.c | 2 - fs/nfsd/trace.h | 137 +++++++++ fs/nfsd/vfs.c | 269 ++++------------ fs/nfsd/vfs.h | 11 +- fs/nfsd/xdr4.h | 15 +- fs/notify/group.c | 2 + fs/notify/inode_mark.c | 1 + fs/notify/mark.c | 4 +
Quoted 11 lines
include/linux/file.h | 3 +- include/linux/fs.h | 1 + include/linux/sunrpc/cache.h | 1 + init/main.c | 2 +- net/sunrpc/cache.c | 3 + 29 files changed, 1249 insertions(+), 382 deletions(-) create mode 100644 fs/nfsd/filecache.c create mode 100644 fs/nfsd/filecache.hSignature · 1 line
2.4.3
--
To unsubscribe from this list: send the line "unsubscribe linux-nfs" in the body of a message to [email protected] More majordomo info at http://vger.kernel.org/majordomo-info.html
Looks like there's a leak--is this something you've seen already?
This is on my current nfsd-next, which has some other stuff too.
--b.
[ 819.980697] kmem_cache_destroy nfsd_file_mark: Slab cache still has objects [ 819.981326] CPU: 0 PID: 4360 Comm: nfsd Not tainted 4.3.0-rc3-00040-ga6bca98 #360 [ 819.981969] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.7.5-20140709_153950- 04/01/2014 [ 819.982805] ffff8800738d7d30 ffff8800738d7d20 ffffffff816053ac ffff880051ee5540 [ 819.983803] ffff8800738d7d58 ffffffff811813df ffff8800738d7d30 ffff8800738d7d30 [ 819.984782] ffff880074fd5e00 ffffffff822f9c80 ffff88007c64cf80 ffff8800738d7d68 [ 819.985751] Call Trace: [ 819.985940] [<ffffffff816053ac>] dump_stack+0x4e/0x82 [ 819.986369] [<ffffffff811813df>] kmem_cache_destroy+0xef/0x100 [ 819.986899] [<ffffffffa00c2198>] nfsd_file_cache_shutdown+0x78/0xa0 [nfsd] [ 819.987513] [<ffffffffa00b2c4d>] nfsd_shutdown_generic+0x1d/0x20 [nfsd] [ 819.988100] [<ffffffffa00b2d2d>] nfsd_shutdown_net+0xdd/0x180 [nfsd] [ 819.988656] [<ffffffffa00b2c55>] ? nfsd_shutdown_net+0x5/0x180 [nfsd] [ 819.989218] [<ffffffffa00b2f34>] nfsd_last_thread+0x164/0x190 [nfsd] [ 819.989770] [<ffffffffa00b2dd5>] ? nfsd_last_thread+0x5/0x190 [nfsd] [ 819.990328] [<ffffffffa001463e>] svc_shutdown_net+0x2e/0x40 [sunrpc] [ 819.990996] [<ffffffffa00b3936>] nfsd_destroy+0xd6/0x190 [nfsd] [ 819.991719] [<ffffffffa00b3865>] ? nfsd_destroy+0x5/0x190 [nfsd] [ 819.992373] [<ffffffffa00b3bb1>] nfsd+0x1c1/0x280 [nfsd] [ 819.992960] [<ffffffffa00b39f5>] ? nfsd+0x5/0x280 [nfsd] [ 819.993537] [<ffffffffa00b39f0>] ? nfsd_destroy+0x190/0x190 [nfsd] [ 819.994195] [<ffffffff81098d6f>] kthread+0xef/0x110 [ 819.994734] [<ffffffff81a7677c>] ? _raw_spin_unlock_irq+0x2c/0x50 [ 819.995439] [<ffffffff81098c80>] ? kthread_create_on_node+0x200/0x200 [ 819.996129] [<ffffffff81a7744f>] ret_from_fork+0x3f/0x70 [ 819.996706] [<ffffffff81098c80>] ? kthread_create_on_node+0x200/0x200 [ 819.998854] nfsd: last server has exited, flushing export cache [ 820.195957] NFSD: starting 20-second grace period (net ffffffff822f9c80)
--
To unsubscribe from this list: send the line "unsubscribe linux-nfs" in the body of a message to [email protected] More majordomo info at http://vger.kernel.org/majordomo-info.html
Quoted 26 lines · On Thu, 22 Oct 2015 17:19:28 -0400 "J. Bruce Fields" <[email protected]>…
Looks like there's a leak--is this something you've seen already?
This is on my current nfsd-next, which has some other stuff too.
--b.
[ 819.980697] kmem_cache_destroy nfsd_file_mark: Slab cache still has objects [ 819.981326] CPU: 0 PID: 4360 Comm: nfsd Not tainted 4.3.0-rc3-00040-ga6bca98 #360 [ 819.981969] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.7.5-20140709_153950- 04/01/2014 [ 819.982805] ffff8800738d7d30 ffff8800738d7d20 ffffffff816053ac ffff880051ee5540 [ 819.983803] ffff8800738d7d58 ffffffff811813df ffff8800738d7d30 ffff8800738d7d30 [ 819.984782] ffff880074fd5e00 ffffffff822f9c80 ffff88007c64cf80 ffff8800738d7d68 [ 819.985751] Call Trace: [ 819.985940] [<ffffffff816053ac>] dump_stack+0x4e/0x82 [ 819.986369] [<ffffffff811813df>] kmem_cache_destroy+0xef/0x100 [ 819.986899] [<ffffffffa00c2198>] nfsd_file_cache_shutdown+0x78/0xa0 [nfsd] [ 819.987513] [<ffffffffa00b2c4d>] nfsd_shutdown_generic+0x1d/0x20 [nfsd] [ 819.988100] [<ffffffffa00b2d2d>] nfsd_shutdown_net+0xdd/0x180 [nfsd] [ 819.988656] [<ffffffffa00b2c55>] ? nfsd_shutdown_net+0x5/0x180 [nfsd] [ 819.989218] [<ffffffffa00b2f34>] nfsd_last_thread+0x164/0x190 [nfsd] [ 819.989770] [<ffffffffa00b2dd5>] ? nfsd_last_thread+0x5/0x190 [nfsd] [ 819.990328] [<ffffffffa001463e>] svc_shutdown_net+0x2e/0x40 [sunrpc] [ 819.990996] [<ffffffffa00b3936>] nfsd_destroy+0xd6/0x190 [nfsd] [ 819.991719] [<ffffffffa00b3865>] ? nfsd_destroy+0x5/0x190 [nfsd] [ 819.992373] [<ffffffffa00b3bb1>] nfsd+0x1c1/0x280 [nfsd] [ 819.992960] [<ffffffffa00b39f5>] ? nfsd+0x5/0x280 [nfsd]
Quoted 9 lines
[ 819.993537] [<ffffffffa00b39f0>] ? nfsd_destroy+0x190/0x190 [nfsd] [ 819.994195] [<ffffffff81098d6f>] kthread+0xef/0x110 [ 819.994734] [<ffffffff81a7677c>] ? _raw_spin_unlock_irq+0x2c/0x50 [ 819.995439] [<ffffffff81098c80>] ? kthread_create_on_node+0x200/0x200 [ 819.996129] [<ffffffff81a7744f>] ret_from_fork+0x3f/0x70 [ 819.996706] [<ffffffff81098c80>] ? kthread_create_on_node+0x200/0x200 [ 819.998854] nfsd: last server has exited, flushing export cache [ 820.195957] NFSD: starting 20-second grace period (net ffffffff822f9c80)
Thanks...interesting.
I'll go over the refcounting again to be sure but I suspect that this might be a race between tearing down the cache and destruction of the fsnotify marks.
fsnotify marks are destroyed by a dedicated thread that cleans them up after the srcu grace period settles. That's a bit of a flimsy guarantee unfortunately. We can use srcu_barrier(), but if the thread hasn't picked up the list and started destroying yet then that may not help.
I'll look over that code -- maybe it's possible to use call_srcu instead, which would allow us to use srcu_barrier to wait for them all to complete.
Thanks!
Signature · 1 line
Jeff Layton <[email protected]>
PATCH v6 3/19 fs: add a kerneldoc header to fput
In reply to Jeff Layton...and move its EXPORT_SYMBOL just below the function.
--- fs/file_table.c | 21 ++++++++++++++++++++- 1 file changed, 20 insertions(+), 1 deletion(-)
fs/file_table.c +20 -1
@@ -261,6 +261,25 @@ void flush_delayed_fput(void)flush_delayed_work (&delayed_fput_work); } +/** +* fput - put a struct file reference +* @file: file of which to put the reference +* +* This function decrements the reference count for the struct file reference, +* and queues it up for destruction if the count goes to zero. In the case of +* most tasks we queue it to the task_work infrastructure, which will be run +* just before the task returns back to userspace. kthreads however never +* return to userspace, so for those we add them to a global list and schedule +* a delayed workqueue job to do the final cleanup work. +* +* Why not just do it synchronously? __fput can involve taking locks of all +* sorts, and doing it synchronously means that the callers must take extra care +* not to deadlock. That can be very difficult to ensure, so by deferring it +* until just before return to userland or to the workqueue, we sidestep that +* nastiness. Also, __fput can be quite stack intensive, so doing a final fput +* has the possibility of blowing up if we don't take steps to ensure that we +* have enough stack space to make it work. +*/ void fput (struct file *file) {if (atomic_long_dec_and_test (&file->f_count)) {
@@ -281,6 +300,7 @@ void fput(struct file *file)schedule_delayed_work (&delayed_fput_work,1 ); } } +EXPORT_SYMBOL (fput);/* * synchronous analog of fput(); for kernel threads that might be needed
@@ -299,7 +319,6 @@ void __fput_sync(struct file *file) } } -EXPORT_SYMBOL (fput);void put_filp (struct file *file) {
Signature · 1 line
2.4.3
PATCH v6 4/19 fs: rename "delayed_fput" infrastructure to "fput_global"
In reply to Jeff Laytondelayed_fput work is only delayed until the workqueue job runs. It's even possible that it will run immediately after you call it if the workqueue job happens to be executing at the time. What it does guarantee is that the final __fput will run in a different task than the the one that queued it. It's this property that we want to use in the NFSD code to close files in advance of a setlease attempt by userland.
Change the name of the "delayed_fput" infrastructure to "fput_global" as that better describes what this code does.
--- fs/file_table.c | 38 ++++++++++++++++++++------------------ include/linux/file.h | 2 +- init/main.c | 2 +- 3 files changed, 22 insertions(+), 20 deletions(-)
fs/file_table.c +20 -18
@@ -227,10 +227,10 @@ static void __fput(struct file *file)mntput (mnt); } -static LLIST_HEAD (delayed_fput_list); -static void delayed_fput (struct work_struct *unused) +static LLIST_HEAD (global_fput_list); +static void global_fput (struct work_struct *unused) { -struct llist_node *node =llist_del_all (&delayed_fput_list); +struct llist_node *node =llist_del_all (&global_fput_list);struct llist_node *next;for (; node; node = next) {
@@ -244,21 +244,23 @@ static void ____fput(struct callback_head *work) __fput(container_of(work, struct file, f_u.fu_rcuhead)); } -static DECLARE_DELAYED_WORK(delayed_fput_work, delayed_fput); +static DECLARE_DELAYED_WORK(global_fput_work, global_fput); -/* -* If kernel thread really needs to have the final fput() it has done -* to complete, call this. The only user right now is the boot - we -* *do* need to make sure our writes to binaries on initramfs has -* not left us with opened struct file waiting for __fput() - execve() -* won't work without that. Please, don't add more callers without -* very good reasons; in particular, never call that with locks -* held and never call that from a thread that might need to do -* some work on any kind of umount. +/** +* fput_global_flush - ensure that all global_fput work is complete +* +* If a kernel thread really needs to have the final fput() it has done to +* complete, call this. One of the main users is the boot - we *do* need to +* make sure our writes to binaries on initramfs has not left us with opened +* struct file waiting for __fput() - execve() won't work without that. +* +* Please, don't add more callers without very good reasons; in particular, +* never call that with locks held and never from a thread that might need to +* do some work on any kind of umount. */ -void flush_delayed_fput (void ) +void fput_global_flush (void ) { -flush_delayed_work (&delayed_fput_work); +flush_delayed_work (&global_fput_work); }/**
@@ -296,15 +298,15 @@ void fput(struct file *file)*/ } -if (llist_add (&file->f_u.fu_llist, &delayed_fput_list)) -schedule_delayed_work (&delayed_fput_work,1 ); +if (llist_add (&file->f_u.fu_llist, &global_fput_list)) +schedule_delayed_work (&global_fput_work,1 ); } }EXPORT_SYMBOL (fput);/* * synchronous analog of fput(); for kernel threads that might be needed -* in some umount() (and thus can't use flush_delayed_fput() without +* in some umount() (and thus can't use fput_global_flush() without * risking deadlocks), need to wait for completion of __fput() and know * for this specific struct file it won't involve anything that would * need them. Use only if you really need it - at the very least,
include/linux/file.h +1 -1
@@ -70,7 +70,7 @@ extern void put_unused_fd(unsigned int fd);extern void fd_install (unsigned int fd,struct file *file); -extern void flush_delayed_fput (void ); +extern void fput_global_flush (void );extern void __fput_sync (struct file *);#endif /* __LINUX_FILE_H */
init/main.c +1 -1
@@ -941,7 +941,7 @@ static int __ref kernel_init(void *unused) system_state =SYSTEM_RUNNING ;numa_default_policy (); -flush_delayed_fput (); +fput_global_flush ();if (ramdisk_execute_command) { ret =run_init_process (ramdisk_execute_command);
Signature · 1 line
2.4.3
PATCH v6 6/19 fsnotify: export several symbols
In reply to Jeff LaytonWith nfsd's new open-file caching infrastructure, we need a way to know when unlinks occur so it can close files that it may be holding open. fsnotify fits the bill nicely, but the symbols aren't currently exported to modules. Export some of its symbols so nfsd can use this infrastructure.
--- fs/notify/group.c | 2 ++ fs/notify/inode_mark.c | 1 + fs/notify/mark.c | 4 ++++ 3 files changed, 7 insertions(+)
fs/notify/group.c +2 -0
@@ -81,6 +81,7 @@ void fsnotify_put_group(struct fsnotify_group *group)if (atomic_dec_and_test (&group->refcnt))fsnotify_final_destroy_group (group); } +EXPORT_SYMBOL_GPL (fsnotify_put_group);/* * Create a new fsnotify_group and hold a reference for the group returned.
@@ -109,6 +110,7 @@ struct fsnotify_group *fsnotify_alloc_group(const struct fsnotify_ops *ops)return group; } +EXPORT_SYMBOL_GPL (fsnotify_alloc_group);int fsnotify_fasync (int fd,struct file *file,int on) {
fs/notify/inode_mark.c +1 -0
@@ -87,6 +87,7 @@ struct fsnotify_mark *fsnotify_find_inode_mark(struct fsnotify_group *group,return mark; } +EXPORT_SYMBOL_GPL (fsnotify_find_inode_mark);/* * If we are setting a mark mask on an inode mark we should pin the inode
fs/notify/mark.c +4 -0
@@ -109,6 +109,7 @@ void fsnotify_put_mark(struct fsnotify_mark *mark) mark->free_mark (mark); } } +EXPORT_SYMBOL_GPL (fsnotify_put_mark);/* Calculate mask of events for a list of marks */ u32 fsnotify_recalc_mask (struct hlist_head *head)
@@ -208,6 +209,7 @@ void fsnotify_destroy_mark(struct fsnotify_mark *mark,mutex_unlock (&group->mark_mutex);fsnotify_free_mark (mark); } +EXPORT_SYMBOL_GPL (fsnotify_destroy_mark);void fsnotify_destroy_marks (struct hlist_head *head,spinlock_t *lock) {
@@ -402,6 +404,7 @@ int fsnotify_add_mark(struct fsnotify_mark *mark, struct fsnotify_group *group,mutex_unlock (&group->mark_mutex);return ret; } +EXPORT_SYMBOL_GPL (fsnotify_add_mark);/* * Given a list of marks, find the mark associated with given group. If found
@@ -492,6 +495,7 @@ void fsnotify_init_mark(struct fsnotify_mark *mark,atomic_set (&mark->refcnt,1 ); mark->free_mark = free_mark; } +EXPORT_SYMBOL_GPL (fsnotify_init_mark);static int fsnotify_mark_destroy (void *ignored) {
Signature · 1 line
2.4.3
PATCH v6 7/19 locks: create a new notifier chain for lease attempts
In reply to Jeff LaytonWith the new file caching infrastructure in nfsd, we can end up holding files open for an indefinite period of time, even when they are still idle. This may prevent the kernel from handing out leases on the file, which is something we don't want to block.
Fix this by running a SRCU notifier call chain whenever any lease attempt is made. nfsd can then purge the nfsd_file cache of any entries associated with that inode, and use the fput_global infrastructure to make sure the final __fput is done.
Since SRCU is only conditionally compiled in, we must only define the new chain if it's enabled, and users of the chain must ensure that SRCU is enabled.
--- fs/locks.c | 37 +++++++++++++++++++++++++++++++++++++ include/linux/fs.h | 1 + 2 files changed, 38 insertions(+)
fs/locks.c +37 -0
@@ -1780,6 +1780,40 @@ int generic_setlease(struct file *filp, long arg, struct file_lock **flp, }EXPORT_SYMBOL (generic_setlease); +#if IS_ENABLED (CONFIG_SRCU ) +/* +* Kernel subsystems can register to be notified on any attempt to set +* a new lease with the lease_notifier_chain. This is used by (e.g.) nfsd +* to close files that it may have cached when there is an attempt to set a +* conflicting lease. +*/ +struct srcu_notifier_head lease_notifier_chain; +EXPORT_SYMBOL_GPL (lease_notifier_chain); + +static inline void +lease_notifier_chain_init (void ) +{ +srcu_init_notifier_head (&lease_notifier_chain); +} + +static inline void +setlease_notifier (long arg,struct file_lock *lease) +{ +if (arg !=F_UNLCK ) +srcu_notifier_call_chain (&lease_notifier_chain, arg, lease); +} +#else /* !IS_ENABLED(CONFIG_SRCU) */ +static inline void +lease_notifier_chain_init (void ) +{ +} + +static inline void +setlease_notifier (long arg,struct file_lock *lease) +{ +} +#endif /* IS_ENABLED(CONFIG_SRCU) */ +/** * vfs_setlease - sets a lease on an open file * @filp: file pointer
@@ -1800,6 +1834,8 @@ EXPORT_SYMBOL(generic_setlease);int vfs_setlease (struct file *filp,long arg,struct file_lock **lease,void **priv) { +if (lease) +setlease_notifier (arg, *lease);if (filp->f_op->setlease)return filp->f_op->setlease (filp, arg, lease, priv);else
@@ -2696,6 +2732,7 @@ static int __init filelock_init(void)for_each_possible_cpu (i)INIT_HLIST_HEAD (per_cpu_ptr (&file_lock_list, i)); +lease_notifier_chain_init ();return 0 ; }
include/linux/fs.h +1 -0
@@ -1042,6 +1042,7 @@ extern int fcntl_setlease(unsigned int fd, struct file *filp, long arg);extern int fcntl_getlease (struct file *filp);/* fs/locks.c */ +extern struct srcu_notifier_head lease_notifier_chain;void locks_free_lock_context (struct file_lock_context *ctx);void locks_free_lock (struct file_lock *fl);extern void locks_init_lock (struct file_lock *);
Signature · 1 line
2.4.3
PATCH v6 15/19 nfsd: convert nfs4_file->fi_fds array to use nfsd_files
In reply to Jeff Layton--- fs/nfsd/nfs4state.c | 23 ++++++++++++----------- fs/nfsd/state.h | 2 +- 2 files changed, 13 insertions(+), 12 deletions(-)
fs/nfsd/nfs4state.c +12 -11
@@ -49,6 +49,7 @@#include "netns.h" #include "pnfs.h" +#include "filecache.h" #define NFSDDBG_FACILITY NFSDDBG_PROC
@@ -292,7 +293,7 @@ static struct file * __nfs4_get_fd(struct nfs4_file *f, int oflag) {if (f->fi_fds[oflag]) -return get_file (f->fi_fds[oflag]); +return get_file (f->fi_fds[oflag]->nf_file);return NULL ; }
@@ -449,17 +450,17 @@ static void __nfs4_file_put_access(struct nfs4_file *fp, int oflag)might_lock (&fp->fi_lock);if (atomic_dec_and_lock (&fp->fi_access[oflag], &fp->fi_lock)) { -struct file *f1 =NULL ; -struct file *f2 =NULL ; +struct nfsd_file *f1 =NULL ; +struct nfsd_file *f2 =NULL ;swap (f1, fp->fi_fds[oflag]);if (atomic_read (&fp->fi_access[1 - oflag]) ==0 )swap (f2, fp->fi_fds[O_RDWR ]);spin_unlock (&fp->fi_lock);if (f1) -fput (f1); +nfsd_file_put (f1);if (f2) -fput (f2); +nfsd_file_put (f2); } }
@@ -3841,7 +3842,7 @@ static __be32 nfs4_get_vfs_file(struct svc_rqst *rqstp, struct nfs4_file *fp, struct svc_fh *cur_fh, struct nfs4_ol_stateid *stp, struct nfsd4_open *open) { - struct file *filp = NULL; + struct nfsd_file *nf = NULL;__be32 status;int oflag =nfs4_access_to_omode (open->op_share_access);int access =nfs4_access_to_access (open->op_share_access);
@@ -3877,18 +3878,18 @@ static __be32 nfs4_get_vfs_file(struct svc_rqst *rqstp, struct nfs4_file *fp,if (!fp->fi_fds[oflag]) {spin_unlock (&fp->fi_lock); - status =nfsd_open (rqstp, cur_fh,S_IFREG , access, &filp); + status =nfsd_file_acquire (rqstp, cur_fh, access, &nf);if (status) goto out_put_access;spin_lock (&fp->fi_lock);if (!fp->fi_fds[oflag]) { - fp->fi_fds[oflag] = filp; - filp =NULL ; + fp->fi_fds[oflag] = nf; + nf =NULL ; } }spin_unlock (&fp->fi_lock); -if (filp) -fput (filp); +if (nf) +nfsd_file_put (nf); status =nfsd4_truncate (rqstp, cur_fh, open);if (status)
fs/nfsd/state.h +1 -1
@@ -491,7 +491,7 @@ struct nfs4_file { };struct list_head fi_clnt_odstate;/* One each for O_RDONLY, O_WRONLY, O_RDWR: */ -struct file * fi_fds[3 ]; +struct nfsd_file *fi_fds[3 ];/* * Each open or lock stateid contributes 0-4 to the counts * below depending on which bits are set in st_access_bitmap:
Signature · 1 line
2.4.3
PATCH v6 19/19 nfsd: rip out the raparms cache
In reply to Jeff LaytonNothing uses it anymore.
--- fs/nfsd/nfssvc.c | 14 +----- fs/nfsd/vfs.c | 147 ------------------------------------------------------- fs/nfsd/vfs.h | 6 --- 3 files changed, 1 insertion(+), 166 deletions(-)
fs/nfsd/nfssvc.c +1 -13
@@ -216,18 +216,9 @@ static int nfsd_startup_generic(int nrservs)if (nfsd_users++)return 0 ; -/* -* Readahead param cache - will no-op if it already exists. -* (Note therefore results will be suboptimal if number of -* threads is modified after nfsd start.) -*/ - ret =nfsd_racache_init (2 *nrservs); -if (ret) - goto dec_users; - ret =nfsd_file_cache_init ();if (ret) - goto out_racache; + goto dec_users; ret =nfs4_state_start ();if (ret)
@@ -236,8 +227,6 @@ static int nfsd_startup_generic(int nrservs) out_file_cache:nfsd_file_cache_shutdown (); -out_racache: -nfsd_racache_shutdown (); dec_users: nfsd_users--;return ret;
@@ -250,7 +239,6 @@ static void nfsd_shutdown_generic(void)nfs4_state_shutdown ();nfsd_file_cache_shutdown (); -nfsd_racache_shutdown (); }static bool nfsd_needs_lockd (void )
fs/nfsd/vfs.c +0 -147
162 lines not on this page · raw message
fs/nfsd/vfs.h +0 -6
@@ -39,8 +39,6 @@typedef int (*nfsd_filldir_t )(void *,const char *,int ,loff_t ,u64 ,unsigned );/* nfsd/vfs.c */ -int nfsd_racache_init (int ); -void nfsd_racache_shutdown (void );int nfsd_cross_mnt (struct svc_rqst *rqstp,struct dentry **dpp,struct svc_export **expp); __be32 nfsd_lookup(struct svc_rqst *, struct svc_fh *,
@@ -74,7 +72,6 @@ __be32 nfsd_open(struct svc_rqst *, struct svc_fh *, umode_t, int, struct file **);__be32 nfsd_open_verified (struct svc_rqst *,struct svc_fh *,umode_t ,int ,struct file **); -struct raparms ;__be32 nfsd_splice_read (struct svc_rqst *,struct file *,loff_t ,unsigned long *); __be32 nfsd_readv(struct file *, loff_t, struct kvec *, int,
@@ -107,9 +104,6 @@ __be32 nfsd_statfs(struct svc_rqst *, struct svc_fh *,__be32 nfsd_permission (struct svc_rqst *,struct svc_export *,struct dentry *,int ); -struct raparms *nfsd_init_raparms (struct file *file); -void nfsd_put_raparams (struct file *file,struct raparms *ra); -static inline int fh_want_write (struct svc_fh *fh) {int ret =mnt_want_write (fh->fh_export->ex_path.mnt);
Signature · 1 line
2.4.3