RFC erofs-utils: support multiple block compression
Get series with b4
b4 am [email protected]Versions newest first
- v0 RFC Latest3 patches 1 replyIn review
Patches in v0 No applies recorded yet
| # | Subject and files | Size | Replies | Applied |
|---|---|---|---|---|
| 1/3 | erofs-utils: add -C# for the maximum size of pclustersinclude/ lib/ mkfs/ | +16 | 0 replies | |
| 2/3 | erofs-utils: mkfs: support multiple block compressioninclude/ include/ lib/ | +62 | 0 replies | |
| 3/3 | erofs-utils: fuse: support multiple block compressionlib/ lib/ | +68 | 0 replies |
Reviews trailers per patch
No Reviewed-by, Acked-by or Tested-by trailers for v0 yet.
Cover letter [RFC PATCH v0 0/3] erofs-utils: support multiple block compression
From: Gao Xiang <[email protected]>
Hi folks,
This is the first RFC patch of multiple block compression (including erofsfuse) after I carefully think over the on-disk design to support multiblock in-place decompression.
Compression ratio results (POC, lz4hc, lz4-1.9.3, not final result):
1000000000 enwik9 621211648 enwik9_4k.squashfs.img 557858816 enwik9_4k.erofs.img 556191744 enwik9_8k.squashfs.img 502661120 enwik9_16k.squashfs.img 500723712 enwik9_8k.erofs.img 458784768 enwik9_32k.squashfs.img 453971968 enwik9_16k.erofs.img 422318080 enwik9_64k.squashfs.img 416686080 enwik9_32k.erofs.img 398204928 enwik9_128k.squashfs.img 395276288 enwik9_64k.erofs.img
TODO:
- support compact indexes for multiple block compression **;
- support multithread compression (keep compressed data in memory);
- carefully design kernel optimized paths to maximize runtime performance;
- widely testing.
If you think that'd be useful for your products and you also have interest in development, feel free to follow that as well since I don't have abundant free time so the progress might be somewhat slow (I tend to finish them all before the next LTS).
Thanks,
Gao Xiang
Gao Xiang (3):
erofs-utils: add -C# for the maximum size of pclusters
erofs-utils: mkfs: support multiple block compression
erofs-utils: fuse: support multiple block compression
include/erofs/config.h | 2 ++ include/erofs/internal.h | 1 + include/erofs_fs.h | 19 ++++++++--- lib/compress.c | 70 ++++++++++++++++++++++++-------------- lib/config.c | 1 + lib/data.c | 4 +-- lib/zmap.c | 72 ++++++++++++++++++++++++++++++++++++---- mkfs/main.c | 14 +++++++- 8 files changed, 146 insertions(+), 37 deletions(-)
Signature · 1 line
2.24.0