Skip to contentSkip to conversation

exportfs: Release the get_name() directory file synchronously

PATCH Superseded Chuck Lever 3 participants 4 messages Oct 7 – Oct 8 1 message not in the archive

Subsystems (4)

v1 of 2 Superseded Latest is v2 →

lore
Share & tools
lore

Chuck Lever

author maintainer
#0 lore raw

PATCH 1/1 exportfs: Release the get_name() directory file synchronously

get_name() opens the parent directory with dentry_open() and releases it with fput(). From a kernel thread, fput() defers the final __fput() to the delayed_fput work item. NFSD threads are kernel threads, and NFSD reaches get_name() through exportfs_decode_fh() whenever a file handle's dentry is not connected to the root.

On a filesystem with more directories than the dcache retains, nearly every READDIRPLUS needs a reconnect. The deferred releases arrive faster than the work item retires them, and each pending file pins the directory's readdir state. On ext4 that state is the htree fname cache for the last leaf block read. A 64-thread NFSv3 server under a parallel tree walk showed unreclaimable slab growing by about 90 MB per second, and the same workload on a 5.15 kernel ended in a global OOM.

Commit 5ff318f645eb ("nfsd: use __fput_sync() to avoid delayed closing of files.") stopped NFSD's own closes from feeding the delayed_fput queue but did not cover the exportfs reconnect path.

Release the file with __fput_sync(). get_name() opened the file itself, read-only, on a directory, so __fput() involves nothing that could wait on the caller.

---
 fs/exportfs/expfs.c | 6 +++++-
 1 file changed, 5 insertions(+), 1 deletion(-)

Mail from kernel.org to hotmail.com was rejected. kernel.org appears to be on some deny-list. Reposting.

fs/exportfs/expfs.c +5 -1
index eafd99507afe..b5768f94fbb5 100644
@@ -336,7 +336,11 @@ static int get_name(const struct path *path, char *name, struct dentry *child)
 	}
 
 out_close:
-	fput(file);
+	/*
+	 * @file is the read-only directory opened above, so __fput()
+	 * cannot block on anything the caller holds.
+	 */
+	__fput_sync(file);
 out:
 	return error;
 }
Signature · 1 line
2.55.0

A message that is not in the archive (sent off-list or not yet received): LV2PR15MB538107FDEB65AB1A4CEA8D5EC6942@LV2PR15MB5381.namprd15.prod.outlook.com

#2 lore raw

Thanks for the quick patch. The description matches what I saw on our server.

I tested it on the kernel where I found the problem: Ubuntu 7.0.0-38 (7.0.14) built with this patch only, 64 nfsd threads, vfs_cache_pressure at the default of 100, and the same parallel tree walk over about 43 million files and 5.5 million directories.

Before the patch, unreclaimable slab grew by about 90 MB per second and reached the 8 GB limit of my test script. With the patch it peaked at 1.5 GB in the first two minutes, came down to 0.6 GB while all 64 threads were still busy, and stayed flat until the walk ended. Open files went back to the idle count once the walk finished.

One question about the stable backport. The Fixes: tag goes back to 3.10, so stable may pick this up for 5.15 and 6.1. As far as I remember, __fput_sync() on those kernels had a BUG_ON for callers that are not kernel threads, and that was removed around 6.6. get_name() can also be reached from open_by_handle_at() in process context. Could you check whether the older stable kernels need a different fix, or a guard on current->flags & PF_KTHREAD?

Danny Pidutti

________________________________________
From: Chuck Lever <[email protected]>
Sent: Wednesday, October 7, 2026 12:46 PM
To: Daniel Pidutti <[email protected]>; Christian Brauner <[email protected]>; Al Viro <[email protected]>; Amir Goldstein <[email protected]>
Cc: [email protected] <[email protected]>; [email protected] <[email protected]>; Danny Pidutti <[email protected]>
Subject: [PATCH] exportfs: Release the get_name() directory file synchronously

get_name() opens the parent directory with dentry_open() and releases it with fput(). From a kernel thread, fput() defers the final __fput() to the delayed_fput work item. NFSD threads are kernel threads, and NFSD reaches get_name() through exportfs_decode_fh() whenever a file handle's dentry is not connected to the root.

On a filesystem with more directories than the dcache retains, nearly every READDIRPLUS needs a reconnect. The deferred releases arrive faster than the work item retires them, and each pending file pins the directory's readdir state. On ext4 that state is the htree fname cache for the last leaf block read. A 64-thread NFSv3 server under a parallel tree walk showed unreclaimable slab growing by about 90 MB per second, and the same workload on a 5.15 kernel ended in a global OOM.

Commit 5ff318f645eb ("nfsd: use __fput_sync() to avoid delayed closing of files.") stopped NFSD's own closes from feeding the delayed_fput queue but did not cover the exportfs reconnect path.

Release the file with __fput_sync(). get_name() opened the file itself, read-only, on a directory, so __fput() involves nothing that could wait on the caller.

---
fs/exportfs/expfs.c | 6 +++++-

1 file changed, 5 insertions(+), 1 deletion(-)

Mail from kernel.org to hotmail.com was rejected. kernel.org appears to be on some deny-list. Reposting.

fs/exportfs/expfs.c +0 -0
index eafd99507afe..b5768f94fbb5 100644
@@ -336,7 +336,11 @@ static int get_name(const struct path *path, char *name, struct dentry *child)

}

out_close:
- fput(file);
+ /*
+ * @file is the read-only directory opened above, so __fput()
+ * cannot block on anything the caller holds.
+ */
+ __fput_sync(file);
out:
return error;
}
--
2.55.0

Disclaimer
The information contained in this communication from the sender is confidential. It is intended solely for use by the recipient and others authorized to receive it. If you are not the recipient, you are hereby notified that any disclosure, copying, distribution or taking action in relation of the contents of this information is strictly prohibited and may be unlawful.

This email has been scanned for viruses and malware, and may have been automatically archived by Mimecast, a leader in email security and cyber resilience. Mimecast integrates email defenses with brand protection, security awareness training, web security, compliance and other essential capabilities. Mimecast helps protect large and small organizations from malicious activity, human error and technology failure; and to lead the movement toward building a more resilient world. To find out more, visit our website.

author maintainer
#3 lore raw
Quoted 8 lines · Danny Pidutti

Thanks for the quick patch. The description matches what I saw on our server.

I tested it on the kernel where I found the problem: Ubuntu 7.0.0-38 (7.0.14) built with this patch only, 64 nfsd threads, vfs_cache_pressure at the default of 100, and the same parallel tree walk over about 43 million files and 5.5 million directories.

Quoted 5 lines

Before the patch, unreclaimable slab grew by about 90 MB per second and reached the 8 GB limit of my test script. With the patch it peaked at 1.5 GB in the first two minutes, came down to 0.6 GB while all 64 threads were still busy, and stayed flat until the walk ended. Open files went back to the idle count once the walk finished.

Thank you for testing. May I add your Tested-by: to the patch?

Quoted 7 lines

One question about the stable backport. The Fixes: tag goes back to 3.10, so stable may pick this up for 5.15 and 6.1. As far as I remember, __fput_sync() on those kernels had a BUG_ON for callers that are not kernel threads, and that was removed around 6.6. get_name() can also be reached from open_by_handle_at() in process context. Could you check whether the older stable kernels need a different fix, or a guard on current->flags & PF_KTHREAD?

Confirmed: the tip of linux-5.15.y and linux-6.1.y still have BUG_ON(!(task->flags & PF_KTHREAD)) in __fput_sync(); it was removed by commit 021a160abf62 ("fs: use __fput_sync in close(2)"), which went into v6.6.

The Fixes: tag has to remain unchanged, since it names the commit that introduced the behavior. Since this fix will go through one of Christian's VFS trees, I can post a v2 with a recommended Cc: stable tag, such as:

Cc <[email protected]> # see patch description, needs adjustments for <= 6.1

and note in the patch description that kernels before v6.6 need the __fput_sync() call guarded by current->flags & PF_KTHREAD, with a plain fput() otherwise. Among the choices sanctioned in Documentation/ this one comes closest.

Signature · 1 line
Chuck Lever (Come to NFS bake-a-thon! https://nfsv4bat.org)
Reviewed-by on v1 1/1
#4 lore raw
In reply to Chuck Lever
Quoted 20 lines · Chuck Lever

get_name() opens the parent directory with dentry_open() and releases it with fput(). From a kernel thread, fput() defers the final __fput() to the delayed_fput work item. NFSD threads are kernel threads, and NFSD reaches get_name() through exportfs_decode_fh() whenever a file handle's dentry is not connected to the root.

On a filesystem with more directories than the dcache retains, nearly every READDIRPLUS needs a reconnect. The deferred releases arrive faster than the work item retires them, and each pending file pins the directory's readdir state. On ext4 that state is the htree fname cache for the last leaf block read. A 64-thread NFSv3 server under a parallel tree walk showed unreclaimable slab growing by about 90 MB per second, and the same workload on a 5.15 kernel ended in a global OOM.

Commit 5ff318f645eb ("nfsd: use __fput_sync() to avoid delayed closing of files.") stopped NFSD's own closes from feeding the delayed_fput queue but did not cover the exportfs reconnect path.

Quoted 8 lines

Release the file with __fput_sync(). get_name() opened the file itself, read-only, on a directory, so __fput() involves nothing that could wait on the caller.

Ben