s390/dasd: ESE Performance improvements
Status from this message: Applied, thanks!
Get series with b4
b4 am [email protected]Versions newest first
Patches in v1 Applied
| # | Subject and files | Size | Replies | Applied |
|---|---|---|---|---|
| 1/19 | s390/dasd: Do not complete a failed ESE read as successfuldrivers/ | +4 | 0 replies | |
| 2/19 | s390/dasd: Propagate partial completion length across ERP recoverydrivers/ | +3 | 0 replies | |
| 3/19 | s390/dasd: Guard sysfs discipline callbacks against unallocated private datadrivers/ | +38 | 0 replies | |
| 4/19 | s390/dasd: Snapshot intrc before freeing the request blockdrivers/ | +8 | 0 replies | |
| 5/19 | s390/dasd: Optimize max blocks per request for track alignmentdrivers/ | +1 | 0 replies | |
| 6/19 | s390/dasd: Use GFP_KERNEL in dasd_alloc_device()drivers/ | +4 | 0 replies | |
| 7/19 | s390/dasd: Add defines for the Extended Address Volume track addressdrivers/ drivers/ | +10 | 0 replies | |
| 8/19 | s390/dasd: Add infrastructure for ESE full-track writedrivers/ drivers/ drivers/ +1 more | +120 | 0 replies | |
| 9/19 | s390/dasd: Add range-based format-track collision detectiondrivers/ drivers/ drivers/ | +81 | 0 replies | |
| 10/19 | s390/dasd: Extend prepare_itcw() to support WRITE_FULL_TRACKdrivers/ | +51 | 0 replies | |
| 11/19 | s390/dasd: Add dasd_eckd_build_cp_tpm_writefulltrack()drivers/ | +343 | 0 replies | |
| 12/19 | s390/dasd: Use WRITE_FULL_TRACK in ESE format handlerdrivers/ drivers/ drivers/ +2 more | +193 | 0 replies | |
| 13/19 | s390/dasd: Add full_track_bias to control fulltrack write modedrivers/ drivers/ drivers/ | +88 | 0 replies | |
| 14/19 | s390/dasd: Derive adaptive ESE fulltrack heuristic from ft_biasdrivers/ drivers/ drivers/ | +223 | 0 replies | |
| 15/19 | s390/dasd: Stamp a format label into newly formatted volumesdrivers/ drivers/ | +114 | 0 replies | |
| 16/19 | s390/dasd: Detect ESE volumes from the on-disk format labeldrivers/ drivers/ drivers/ +1 more | +175 | 0 replies | |
| 17/19 | s390/dasd: Report ESE capability and format mode at device onlinedrivers/ | +18 | 0 replies | |
| 18/19 | s390/dasd: Re-enable discard support for ESE volumesdrivers/ drivers/ drivers/ | +166 | 0 replies | |
| 19/19 | s390/dasd: Read cached unit address and LSS in the CCW build pathdrivers/ drivers/ | +24 | 0 replies |
Reviews trailers per patch
All 19 patches have a Reviewed-by or Acked-by.
| Patch | Jan Höppner |
|---|---|
| 1/19 | R-b |
| 2/19 | R-b |
| 3/19 | R-b |
| 4/19 | R-b |
| 5/19 | R-b |
| 6/19 | R-b |
| 7/19 | R-b |
| 8/19 | R-b |
| 9/19 | R-b |
| 10/19 | R-b |
| 11/19 | R-b |
| 12/19 | R-b |
| 13/19 | R-b |
| 14/19 | R-b |
| 15/19 | R-b |
| 16/19 | R-b |
| 17/19 | R-b |
| 18/19 | R-b |
| 19/19 | R-b |
Trailers given in replies are filled; those carried in the patches from earlier versions are outlined with dashes.
Cover letter [PATCH 00/19] s390/dasd: ESE Performance improvements
Hello Jens,
please apply the patch series for the upcoming merge window. It applies onto your for-next branch.
The series significantly improves the performance and overall usability of Extent Space Efficient (ESE, aka thin provisioned) DASD devices.
On a freshly provisioned ESE volume I get the following throughput improvements, depending on workload and setup:
workload change
raw seq 1 MiB writes ~53x
fs bulk-load (xfs, buffered) ~49x
raw seq full-track (48k) ~3.7x
raw random 4k writes ~1.3x
control: fully-allocated vol ~0% (no regression)
(fresh quick-formatted ESE volume, 4 jobs, iodepth 16, median of 3)
The first 4 patches are fixes for existing bugs in this area, afterwards the infrastructure for and usage of Full Track Writes is added to the driver as well as an improved collision detection. The other patches add some tuning parameters and output as well as a new on disk format label.
FWIW: The series has been reviewed by Sashiko before. The remaining findings are pre existing bugs that will be assessed and addressed separately, false positives that are not a bug or not valid for ECKD DASD devices, in-between-patch findings that are resolved at the tip of the series, or accepted limitations.
Thanks,
Stefan
Stefan Haberland (19):
s390/dasd: Do not complete a failed ESE read as successful s390/dasd: Propagate partial completion length across ERP recovery s390/dasd: Guard sysfs discipline callbacks against unallocated
private data
s390/dasd: Snapshot intrc before freeing the request block s390/dasd: Optimize max blocks per request for track alignment s390/dasd: Use GFP_KERNEL in dasd_alloc_device() s390/dasd: Add defines for the Extended Address Volume track address s390/dasd: Add infrastructure for ESE full-track write s390/dasd: Add range-based format-track collision detection s390/dasd: Extend prepare_itcw() to support WRITE_FULL_TRACK s390/dasd: Add dasd_eckd_build_cp_tpm_writefulltrack() s390/dasd: Use WRITE_FULL_TRACK in ESE format handler s390/dasd: Add full_track_bias to control fulltrack write mode s390/dasd: Derive adaptive ESE fulltrack heuristic from ft_bias s390/dasd: Stamp a format label into newly formatted volumes s390/dasd: Detect ESE volumes from the on-disk format label s390/dasd: Report ESE capability and format mode at device online s390/dasd: Re-enable discard support for ESE volumes s390/dasd: Read cached unit address and LSS in the CCW build path
drivers/s390/block/dasd.c | 242 ++++-- drivers/s390/block/dasd_3990_erp.c | 1 + drivers/s390/block/dasd_devmap.c | 90 +- drivers/s390/block/dasd_eckd.c | 1263 +++++++++++++++++++++++++--- drivers/s390/block/dasd_eckd.h | 68 +- drivers/s390/block/dasd_erp.c | 11 +- drivers/s390/block/dasd_int.h | 149 +++- 7 files changed, 1625 insertions(+), 199 deletions(-)
Signature · 1 line
2.53.0