RFC Orangefs Through the Pagecache
Get series with b4
b4 am [email protected]Versions newest first
- v1 RFC Latest22 patches 0 repliesNew
Patches in v1 No applies recorded yet
| # | Subject and files | Size | Replies | Applied |
|---|---|---|---|---|
| 1/22 | orangefs: implement xattr cachefs/ fs/ fs/ +1 more | +127 | 0 replies | |
| 2/22 | orangefs: do not invalidate attributes on inode createfs/ fs/ | +0 | 0 replies | |
| 3/22 | orangefs: simplify orangefs_inode_getattr interfacefs/ fs/ fs/ +1 more | +28 | 0 replies | |
| 4/22 | orangefs: update attributes rather than relying on serverfs/ fs/ | +8 | 0 replies | |
| 5/22 | orangefs: hold i_lock during inode_getattrfs/ fs/ | +25 | 0 replies | |
| 6/22 | orangefs: set up and use backing_dev_infofs/ | +14 | 0 replies | |
| 7/22 | orangefs: let setattr write to cached inodefs/ fs/ | +20 | 0 replies | |
| 8/22 | orangefs: reorganize setattr functions to track attribute changesfs/ fs/ fs/ +3 more | +129 | 0 replies | |
| 9/22 | orangefs: remove orangefs_readpagesfs/ | +1 | 0 replies | |
| 10/22 | orangefs: service ops done for writeback are not killablefs/ fs/ fs/ | +12 | 0 replies | |
| 11/22 | orangefs: migrate to generic_file_read_iterfs/ fs/ fs/ | +38 | 0 replies | |
| 12/22 | orangefs: implement writepagefs/ fs/ fs/ | +80 | 0 replies | |
| 13/22 | orangefs: do not return successful read when the client-core disappearedfs/ | +4 | 0 replies | |
| 14/22 | orangefs: move do_readv_writev to direct_IOfs/ fs/ | +111 | 0 replies | |
| 15/22 | orangefs: skip inode writeout if nothing to writefs/ | +5 | 0 replies | |
| 16/22 | orangefs: avoid fsync service operation on flushfs/ | +23 | 0 replies | |
| 17/22 | orangefs: write range trackingfs/ fs/ fs/ | +274 | 0 replies | |
| 18/22 | orangefs: implement writepagesfs/ | +1 | 0 replies | |
| 19/22 | orangefs: add orangefs_revalidate_mappingfs/ fs/ fs/ +2 more | +328 | 0 replies | |
| 20/22 | orangefs: remember count when reading.fs/ fs/ | +29 | 0 replies | |
| 21/22 | orangefs: pass slot index back to readpage.fs/ fs/ fs/ | +6 | 0 replies | |
| 22/22 | orangefs: copy Orangefs-sized blocks into the pagecache if possible.fs/ fs/ fs/ +2 more | +156 | 0 replies |
Reviews trailers per patch
No Reviewed-by, Acked-by or Tested-by trailers for v1 yet.
Cover letter [RFC PATCH 00/22] Orangefs Through the Pagecache
From: Mike Marshall <[email protected]>
Until now the Orangefs kernel module has not gone through the pagecache and has been a de facto O_DIRECT style module.
This patch series adds pagecache support and greatly improves small IO. For example, xfstest generic/069 used to take several hours on our test VMs, and now finishes in seconds.
Orangefs' kernel module shares a memory buffer with Orangefs' userspace parts for IO. Orangefs can best exploit parallelism when the buffer is significantly filled, and struggles when the buffer is nearly empty. Buffering reads and writes through the pagecache helps us to communicate with userspace less often with buffers that are more full.
Reads can be tuned with "count" from read(2) to simulate page sizes more in line with Orangefs's buffer size (4 meg by default). Userspace will deposit "count" bytes in the shared buffer on a read and when the VFS calls orangefs_readpage, as many pagecache pages as possible will be filled at once.
Writes are coalesced even across pages when possible up to the size of the buffer between the OrangeFS client core and the kernel. This is 4 MB by default. This means that an application writing with a block size less than 4 MB will have its writes upgraded. For sequential writes, this is a big improvement.
Martin Brandenburg (19):
orangefs: implement xattr cache
orangefs: do not invalidate attributes on inode create
orangefs: simplify orangefs_inode_getattr interface
orangefs: update attributes rather than relying on server
orangefs: hold i_lock during inode_getattr
orangefs: set up and use backing_dev_info
orangefs: let setattr write to cached inode
orangefs: reorganize setattr functions to track attribute changes
orangefs: remove orangefs_readpages
orangefs: service ops done for writeback are not killable
orangefs: migrate to generic_file_read_iter
orangefs: implement writepage
orangefs: do not return successful read when the client-core
disappeared
orangefs: move do_readv_writev to direct_IO
orangefs: skip inode writeout if nothing to write
orangefs: avoid fsync service operation on flush
orangefs: write range tracking
orangefs: implement writepages
orangefs: add orangefs_revalidate_mapping
Mike Marshall (3):
orangefs: remember count when reading.
orangefs: pass slot index back to readpage.
orangefs: copy Orangefs-sized blocks into the pagecache if possible.
fs/orangefs/acl.c | 4 +- fs/orangefs/file.c | 389 ++++++-------- fs/orangefs/inode.c | 908 +++++++++++++++++++++++++++++---- fs/orangefs/namei.c | 40 +- fs/orangefs/orangefs-bufmap.c | 13 + fs/orangefs/orangefs-bufmap.h | 2 + fs/orangefs/orangefs-debugfs.c | 4 +- fs/orangefs/orangefs-kernel.h | 56 +- fs/orangefs/orangefs-mod.c | 1 + fs/orangefs/orangefs-sysfs.c | 22 + fs/orangefs/orangefs-utils.c | 179 +++---- fs/orangefs/super.c | 39 +- fs/orangefs/waitqueue.c | 18 +- fs/orangefs/xattr.c | 106 +++- 14 files changed, 1293 insertions(+), 488 deletions(-)
Signature · 1 line
2.20.1