Skip to content

RFC vfs scalability patchset

[email protected] linux-fsdevel lkml 1 version In review

Get series with b4
b4 am [email protected]

Versions newest first

  1. v1 RFC Latest27 patches 22 repliesIn review

Patches in v1 No applies recorded yet

#Subject and filesSizeRepliesApplied
1/27fs: cleanup files_lockdrivers/char/pty.c drivers/char/tty_io.c fs/file_table.c +4 more+89 -775 replies
2/27fs: scale files_lockfs/file_table.c fs/super.c include/linux/fs.h+141 -411 reply
3/27fs: mnt_want_write speedupfs/namespace.c include/linux/mount.h+103 -1810 replies
4/27fs: introduce mnt_clone_writefs/file_table.c fs/inode.c fs/namespace.c +3 more+48 -71 reply
5/27fs: brlock vfsmount_lockfs/dcache.c fs/namei.c fs/namespace.c +6 more+158 -862 replies
6/27fs: dcache fix LRU orderingfs/dcache.c+1 -10 replies
7/27fs: dcache scale hashfs/dcache.c include/linux/dcache.h+27 -110 replies
8/27fs: dcache scale lrufs/dcache.c+85 -200 replies
9/27fs: dcache scale nr_dentryfs/dcache.c include/linux/dcache.h kernel/sysctl.c+17 -130 replies
10/27fs: dcache scale dentry refcountarch/powerpc/platforms/cell/spufs/inode.c drivers/infiniband/hw/ipath/ipath_fs.c fs/autofs4/expire.c +19 more+157 -760 replies
11/27fs: dcache scale d_unhashedarch/powerpc/platforms/cell/spufs/inode.c fs/configfs/configfs_internal.h fs/dcache.c +4 more+68 -220 replies
12/27fs: dcache scale subdirsdrivers/usb/core/inode.c fs/autofs4/expire.c fs/autofs4/inode.c +12 more+271 -800 replies
13/27fs: scale inode alias listfs/affs/amigaffs.c fs/dcache.c fs/exportfs/expfs.c +5 more+68 -70 replies
14/27fs: use RCU / seqlock logic for reverse and multi-step operaitonsdrivers/staging/pohmelfs/path_entry.c fs/autofs4/waitq.c fs/dcache.c +2 more+130 -110 replies
15/27fs: dcache remove dcache_lockDocumentation/filesystems/Locking arch/powerpc/platforms/cell/spufs/inode.c drivers/infiniband/hw/ipath/ipath_fs.c +28 more+36 -2440 replies
16/27fs: dcache reduce dput lockingfs/dcache.c+32 -270 replies
17/27fs: dcache per-bucket dcache hash lockingfs/dcache.c include/linux/dcache.h+115 -1020 replies
18/27fs: dcache reduce dcache_inode_lockfs/dcache.c+11 -120 replies
19/27fs: dcache per-inode inode alias lockingfs/affs/amigaffs.c fs/dcache.c fs/exportfs/expfs.c +5 more+87 -660 replies
20/27fs: icache lock s_inodes listfs/drop_caches.c fs/fs-writeback.c fs/hugetlbfs/inode.c +4 more+31 -00 replies
21/27fs: icache lock inode hashfs/hugetlbfs/inode.c fs/inode.c include/linux/writeback.h+28 -10 replies
22/27fs: icache lock i_statefs/drop_caches.c fs/fs-writeback.c fs/hugetlbfs/inode.c +3 more+118 -290 replies
23/27fs: icache lock i_countarch/powerpc/platforms/cell/spufs/file.c fs/affs/inode.c fs/afs/dir.c +46 more+177 -850 replies
24/27fs: icache atomic inodes_statfs/cifs/inode.c fs/fs-writeback.c fs/hugetlbfs/inode.c +3 more+26 -210 replies
25/27fs: icache lock lru/writeback listsfs/fs-writeback.c fs/hugetlbfs/inode.c fs/inode.c +1 more+81 -190 replies
26/27fs: icache protect inode statefs/hugetlbfs/inode.c fs/inode.c+36 -80 replies
27/27fs: icache remove inode_lockfs/buffer.c fs/drop_caches.c fs/fs-writeback.c +5 more+11 -1040 replies

Reviews trailers per patch

No Reviewed-by, Acked-by or Tested-by trailers for v1 yet.

Read the v1 thread

Cover letter [patch 00/27] [rfc] vfs scalability patchset

Here is my current patchset for improving vfs locking scalability. Since last posting, I have fixed several bugs, solved several more problems, and done an initial sweep of filesystems (autofs4 is probably the trickiest, and unfortunately I don't have a good test setup here for that yet, but at least I've looked through it).

Also started to tackle files_lock, vfsmount_lock, and inode_lock. (I included my mnt_want_write patches before the vfsmount_lock scalability stuff because that just made it a bit easier...). These appear to be the problematic global locks in the vfs.

It's running stably here so far on basic stress testing here on several file systems (xfs, tmpfs, ext?). But it still might eat your data of course.

Would be very interested in any feedback.

Thanks,
Nick