Add Flexfile Layout Module
Get series with b4
b4 am [email protected]Versions newest first · linked by author and title
- v6 Latest53 patches 7 repliesIn review
- v551 patches 3 repliesSuperseded
- v450 patches 0 repliesSuperseded
Earlier versions · 3
| Version | Posted | Patches | Replies | Status |
|---|---|---|---|---|
| v3 | 49 patches | 24 replies | Superseded | |
| v2 | 49 patches | 27 replies | Superseded | |
| v1 | 50 patches | 18 replies | Superseded |
Patches in v6 No applies recorded yet
| # | Subject and files | Size | Replies | Applied |
|---|---|---|---|---|
| 1/53 | pnfs: Prepare for flexfiles by pulling out common codefs/ fs/ fs/ +3 more | +330 | 0 replies | |
| 2/53 | pnfs: Do not grab the commit_info lock twice when rescheduling writesfs/ fs/ fs/ | +23 | 0 replies | |
| 3/53 | nfs41: pull data server cache from file layout to generic pnfsfs/ fs/ fs/ +1 more | +265 | 0 replies | |
| 4/53 | nfs41: pull decode_ds_addr from file layout to generic pnfsfs/ fs/ fs/ | +154 | 0 replies | |
| 5/53 | nfs41: pull nfs4_ds_connect from file layout to generic pnfsfs/ fs/ fs/ | +89 | 0 replies | |
| 6/53 | nfs41: allow LD to choose DS connection auth flavorfs/ fs/ fs/ +2 more | +14 | 0 replies | |
| 7/53 | nfs41: move file layout macros to generic pnfsfs/ fs/ | +11 | 0 replies | |
| 8/53 | nfsv3: introduce nfs3_set_ds_clientfs/ fs/ fs/ +2 more | +46 | 0 replies | |
| 9/53 | nfs41: allow LD to choose DS connection version/minor_versionfs/ fs/ fs/ +2 more | +14 | 0 replies | |
| 10/53 | nfs41: create NFSv3 DS connection if specifiedfs/ fs/ fs/ | +89 | 1 reply | |
| 11/53 | pnfs: Add nfs_rpc_ops in calls to nfs_initiate_pgiofs/ fs/ fs/ +3 more | +13 | 0 replies | |
| 12/53 | nfs: allow different protocol in nfs_initiate_commitfs/ fs/ fs/ +1 more | +7 | 0 replies | |
| 13/53 | nfs4: pass slot table to nfs40_setup_sequencefs/ fs/ | +17 | 0 replies | |
| 14/53 | nfs4: export nfs4_sequence_donefs/ fs/ | +7 | 0 replies | |
| 15/53 | nfs: allow to specify cred in nfs_initiate_pgiofs/ fs/ fs/ | +14 | 0 replies | |
| 16/53 | NFSv4.1/NFSv3: Add pNFS callbacks for nfs3_(read|write|commit)_done()fs/ | +9 | 0 replies | |
| 17/53 | sunrpc: add rpc_count_iostats_idxinclude/ net/ | +21 | 0 replies | |
| 18/53 | nfs: set hostname when creating nfsv3 ds connectionfs/ | +7 | 0 replies | |
| 19/53 | nfs/flexclient: export pnfs_layoutcommit_inodefs/ | +1 | 0 replies | |
| 20/53 | nfs41: close a small race window when adding new layout to global listfs/ | +3 | 0 replies | |
| 21/53 | nfs41: serialize first layoutget of a filefs/ fs/ | +32 | 0 replies | |
| 22/53 | nfs: save server READ/WRITE/COMMIT statusfs/ fs/ fs/ +1 more | +15 | 0 replies | |
| 23/53 | nfs41: pass iomode through layoutreturn argsfs/ fs/ include/ | +3 | 0 replies | |
| 24/53 | nfs41: make a helper function to send layoutreturnfs/ | +33 | 0 replies | |
| 25/53 | nfs41: add a helper to mark layout for returnfs/ fs/ | +59 | 0 replies | |
| 26/53 | nfs41: don't use a layout if it is marked for returningfs/ fs/ fs/ | +20 | 0 replies | |
| 27/53 | nfs41: send layoutreturn in last put_lsegfs/ | +37 | 0 replies | |
| 28/53 | nfs41: clear NFS_LAYOUT_RETURN if layoutreturn is sent or failed to sendfs/ fs/ | +6 | 0 replies | |
| 29/53 | nfs/filelayout: use pnfs_error_mark_layout_for_returnfs/ fs/ | +1 | 0 replies | |
| 30/53 | nfs: introduce pg_cleanup op for pgio descriptorsfs/ include/ | +5 | 0 replies | |
| 31/53 | pnfs: release lseg in pnfs_generic_pg_cleanupfs/ fs/ fs/ +2 more | +21 | 0 replies | |
| 32/53 | nfs: handle overlapping reqs in lock_and_joinfs/ | +11 | 0 replies | |
| 33/53 | nfs: rename pgio header ds_idx to ds_commit_idxfs/ fs/ include/ | +9 | 0 replies | |
| 34/53 | pnfs: pass ds_commit_idx through the commit pathfs/ fs/ fs/ +3 more | +24 | 0 replies | |
| 35/53 | nfs: add mirroring support to pgio layerfs/ fs/ fs/ +6 more | +311 | 0 replies | |
| 36/53 | nfs: mirroring support for direct iofs/ | +57 | 0 replies | |
| 37/53 | pnfs: fail comparison when bucket verifier not setfs/ | +5 | 0 replies | |
| 38/53 | nfs41: add a debug warning if we destroy an unempty layoutfs/ | +2 | 0 replies | |
| 39/53 | nfs: only reset desc->pg_mirror_idx when mirroring is supportedfs/ fs/ | +11 | 0 replies | |
| 40/53 | nfs: add nfs_pgio_current_mirror helperfs/ fs/ fs/ +1 more | +24 | 0 replies | |
| 41/53 | pnfs: allow LD to ask to resend read through pnfsfs/ fs/ | +16 | 0 replies | |
| 42/53 | nfs41: add range to layoutreturn argsfs/ fs/ include/ | +7 | 0 replies | |
| 43/53 | nfs41: allow async version layoutreturnfs/ fs/ fs/ | +16 | 0 replies | |
| 44/53 | nfs41: introduce NFS_LAYOUT_RETURN_BEFORE_CLOSEfs/ fs/ fs/ | +36 | 2 replies | |
| 45/53 | nfs/flexfiles: send layoutreturn before freeing lsegfs/ | +56 | 0 replies | |
| 46/53 | nfs41: add NFS_LAYOUT_RETRY_LAYOUTGET to layout header flagsfs/ fs/ | +21 | 0 replies | |
| 47/53 | nfs: add a helper to set NFS_ODIRECT_RESCHED_WRITES to direct writesfs/ fs/ | +7 | 0 replies | |
| 48/53 | nfs41: wait for LAYOUTRETURN before retrying LAYOUTGETfs/ fs/ fs/ | +45 | 0 replies | |
| 49/53 | nfs: count DIO good bytes correctly with mirroringfs/ | +8 | 0 replies | |
| 50/53 | pnfs/flexfiles: Add the FlexFile Layout Driverfs/ fs/ fs/ +10 more | +2325 | 0 replies | |
| 51/53 | pnfs: Update documentation on the Layout DriversDocumentation/ | +7 | 0 replies | |
| 52/53 | nfs41: .init_read and .init_write can be called with valid pg_lsegfs/ | +20 | 0 replies | |
| 53/53 | pnfs: lookup new lseg at lseg boundaryfs/ | +8 | 0 replies |
Reviews trailers per patch
6 of 53 patches have a Reviewed-by or Acked-by.
| Patch | Jeff Layton |
|---|---|
| 1/53 | |
| 2/53 | A-b |
| 3/53 | R-b |
| 4/53 | R-b |
| 5/53 | R-b |
| 6/53 | R-b |
| 7/53 | R-b |
| 8/53 | |
| 9/53 | |
| 10/53 | |
| 11/53 | |
| 12/53 | |
| 13/53 | |
| 14/53 | |
| 15/53 | |
| 16/53 | |
| 17/53 | |
| 18/53 | |
| 19/53 | |
| 20/53 | |
| 21/53 | |
| 22/53 | |
| 23/53 | |
| 24/53 | |
| 25/53 | |
| 26/53 | |
| 27/53 | |
| 28/53 | |
| 29/53 | |
| 30/53 | |
| 31/53 | |
| 32/53 | |
| 33/53 | |
| 34/53 | |
| 35/53 | |
| 36/53 | |
| 37/53 | |
| 38/53 | |
| 39/53 | |
| 40/53 | |
| 41/53 | |
| 42/53 | |
| 43/53 | |
| 44/53 | |
| 45/53 | |
| 46/53 | |
| 47/53 | |
| 48/53 | |
| 49/53 | |
| 50/53 | |
| 51/53 | |
| 52/53 | |
| 53/53 |
Trailers given in replies are filled; those carried in the patches from earlier versions are outlined with dashes.
Cover letter [PATCH v6 00/53] Add Flexfile Layout Module
Hi Trond,
This patchset introduces the Flexfile Layout Module for the client.
It will correspond to draft 5
(http://tools.ietf.org/id/draft-ietf-nfsv4-flex-files-05.txt)
of the Parallel NFS (pNFS) Flexible File Layout
(https://datatracker.ietf.org/doc/draft-ietf-nfsv4-flex-files/).
This version has been rebased to v3.19-rc7 and is ready for inclusion in 3.20.
The difference from v5 is that:
- we fixed 3 nits found by the kbuild test robot
- we fixed the generic helper functions for .init_read and .init_write
- we fixed handling multiple layout segments with the blocklayout
The [flexfiles] branch of
git://git.linux-nfs.org/projects/loghyr/linux-nfs.git
also has this code.
Thanks,
Tom
Peng Tao (37):
nfs41: pull data server cache from file layout to generic pnfs
nfs41: pull decode_ds_addr from file layout to generic pnfs
nfs41: pull nfs4_ds_connect from file layout to generic pnfs
nfs41: allow LD to choose DS connection auth flavor
nfs41: move file layout macros to generic pnfs
nfsv3: introduce nfs3_set_ds_client
nfs41: allow LD to choose DS connection version/minor_version
nfs41: create NFSv3 DS connection if specified
nfs: allow different protocol in nfs_initiate_commit
nfs4: pass slot table to nfs40_setup_sequence
nfs4: export nfs4_sequence_done
nfs: allow to specify cred in nfs_initiate_pgio
nfs: set hostname when creating nfsv3 ds connection nfs/flexclient: export pnfs_layoutcommit_inode
nfs41: close a small race window when adding new layout to global list
nfs41: serialize first layoutget of a file
nfs: save server READ/WRITE/COMMIT status
nfs41: pass iomode through layoutreturn args
nfs41: make a helper function to send layoutreturn
nfs41: add a helper to mark layout for return
nfs41: don't use a layout if it is marked for returning
nfs41: send layoutreturn in last put_lseg
nfs41: clear NFS_LAYOUT_RETURN if layoutreturn is sent or failed to
send
nfs/filelayout: use pnfs_error_mark_layout_for_return
nfs41: add a debug warning if we destroy an unempty layout
nfs: only reset desc->pg_mirror_idx when mirroring is supported
nfs: add nfs_pgio_current_mirror helper
pnfs: allow LD to ask to resend read through pnfs
nfs41: add range to layoutreturn args
nfs41: allow async version layoutreturn
nfs41: introduce NFS_LAYOUT_RETURN_BEFORE_CLOSE nfs/flexfiles: send layoutreturn before freeing lseg
nfs41: add NFS_LAYOUT_RETRY_LAYOUTGET to layout header flags
nfs: add a helper to set NFS_ODIRECT_RESCHED_WRITES to direct writes
nfs41: wait for LAYOUTRETURN before retrying LAYOUTGET
nfs: count DIO good bytes correctly with mirroring
nfs41: .init_read and .init_write can be called with valid pg_lseg
Tom Haynes (5):
pnfs: Prepare for flexfiles by pulling out common code
pnfs: Do not grab the commit_info lock twice when rescheduling writes
pnfs: Add nfs_rpc_ops in calls to nfs_initiate_pgio pnfs/flexfiles: Add the FlexFile Layout Driver
pnfs: Update documentation on the Layout Drivers
Trond Myklebust (1):
NFSv4.1/NFSv3: Add pNFS callbacks for nfs3_(read|write|commit)_done()
Weston Andros Adamson (10):
sunrpc: add rpc_count_iostats_idx
nfs: introduce pg_cleanup op for pgio descriptors
pnfs: release lseg in pnfs_generic_pg_cleanup
nfs: handle overlapping reqs in lock_and_join
nfs: rename pgio header ds_idx to ds_commit_idx
pnfs: pass ds_commit_idx through the commit path
nfs: add mirroring support to pgio layer
nfs: mirroring support for direct io
pnfs: fail comparison when bucket verifier not set
pnfs: lookup new lseg at lseg boundary
Documentation/filesystems/nfs/pnfs.txt | 13 +- fs/nfs/Kconfig | 5 + fs/nfs/Makefile | 3 +- fs/nfs/blocklayout/blocklayout.c | 2 + fs/nfs/direct.c | 112 +- fs/nfs/filelayout/filelayout.c | 315 +----- fs/nfs/filelayout/filelayout.h | 40 - fs/nfs/filelayout/filelayoutdev.c | 469 +-------- fs/nfs/flexfilelayout/Makefile | 5 + fs/nfs/flexfilelayout/flexfilelayout.c | 1574 +++++++++++++++++++++++++++++ fs/nfs/flexfilelayout/flexfilelayout.h | 155 +++ fs/nfs/flexfilelayout/flexfilelayoutdev.c | 552 ++++++++++ fs/nfs/idmap.c | 3 +- fs/nfs/internal.h | 31 +- fs/nfs/nfs2xdr.c | 10 +- fs/nfs/nfs3_fs.h | 2 + fs/nfs/nfs3client.c | 41 + fs/nfs/nfs3proc.c | 9 + fs/nfs/nfs3super.c | 2 +- fs/nfs/nfs3xdr.c | 3 + fs/nfs/nfs4_fs.h | 6 + fs/nfs/nfs4client.c | 7 +- fs/nfs/nfs4proc.c | 48 +- fs/nfs/nfs4super.c | 3 + fs/nfs/nfs4xdr.c | 9 +- fs/nfs/objlayout/objio_osd.c | 5 +- fs/nfs/pagelist.c | 294 +++++- fs/nfs/pnfs.c | 470 +++++++-- fs/nfs/pnfs.h | 121 ++- fs/nfs/pnfs_nfs.c | 840 +++++++++++++++ fs/nfs/read.c | 33 +- fs/nfs/write.c | 52 +- include/linux/nfs4.h | 1 + include/linux/nfs_fs_sb.h | 9 +- include/linux/nfs_idmap.h | 2 + include/linux/nfs_page.h | 22 +- include/linux/nfs_xdr.h | 6 +- include/linux/sunrpc/metrics.h | 4 + net/sunrpc/stats.c | 26 +- 39 files changed, 4263 insertions(+), 1041 deletions(-) create mode 100644 fs/nfs/flexfilelayout/Makefile create mode 100644 fs/nfs/flexfilelayout/flexfilelayout.c create mode 100644 fs/nfs/flexfilelayout/flexfilelayout.h create mode 100644 fs/nfs/flexfilelayout/flexfilelayoutdev.c create mode 100644 fs/nfs/pnfs_nfs.c
Signature · 1 line
1.9.3