erofs: 48-bit layout support
Subsystems (2)
cover erofs: 48-bit layout support
Hi folks,
The current 32-bit block addressing limits EROFS to a 16TiB maximum volume size with 4KiB blocks. However, several new use cases now require larger capacity support:
- Massive datasets for model training to boost random sampling performance for each epoch;
- Object storage clients using EROFS direct passthrough.
This extends core on-disk structures to support 48-bit block addressing, such as inodes, device slots, and inode chunks.
In addition, it introduces an mtime field to 32-byte compact inodes for basic timestamp support, as well as expands the superblock root NID to an 8-byte rootnid_8b for out-of-place update incremental builds.
In order to support larger images beyond 32-bit block addressing and efficient indexing of large compression units for compressed data, and to better support popular compression algorithms (mainly Zstd) that still lack native fixed-sized output compression support, introduce byte-oriented encoded extents, so that these compressors are allowed to retain their current methods.
Therefore, it speeds up Zstd image building a lot by using:
Processor: Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz * 96
Dataset: enwik9
Build time Size Type Command Line
3m52.339s 266653696 FO -C524288 -zzstd,22
3m48.549s 266174464 FO -E48bit -C524288 -zzstd,22
0m12.821s 272134144 FI -E48bit -C1048576 --max-extent-bytes=1048576 -zzstd,22
It has been stress-tested on my local setup for a while without any strange happens.
Thanks,
Gao Xiang
Gao Xiang (10):
erofs: get rid of erofs_map_blocks_flatmode()
erofs: simplify erofs_{read,fill}_inode()
erofs: add 48-bit block addressing on-disk support
erofs: implement 48-bit block addressing for unencoded inodes
erofs: support dot-omitted directories
erofs: initialize decompression early
erofs: add encoded extent on-disk definition
erofs: implement encoded extent metadata
erofs: support unaligned encoded data
erofs: enable 48-bit layout support
fs/erofs/Kconfig | 14 +-- fs/erofs/data.c | 133 +++++++++++------------- fs/erofs/decompressor.c | 2 +- fs/erofs/dir.c | 7 +- fs/erofs/erofs_fs.h | 191 ++++++++++++++++------------------- fs/erofs/inode.c | 126 +++++++++++------------ fs/erofs/internal.h | 30 +++--- fs/erofs/super.c | 49 ++++----- fs/erofs/sysfs.c | 2 + fs/erofs/zdata.c | 96 +++++++++--------- fs/erofs/zmap.c | 166 +++++++++++++++++++++++++----- include/trace/events/erofs.h | 2 +- 12 files changed, 455 insertions(+), 363 deletions(-)
Signature · 1 line
2.43.5
PATCH 1/10 erofs: get rid of erofs_map_blocks_flatmode()
It's simple enough to be folded into erofs_map_blocks().
--- fs/erofs/data.c | 117 +++++++++++++++++++----------------------------- 1 file changed, 47 insertions(+), 70 deletions(-)
fs/erofs/data.c +47 -70
@@ -70,58 +70,39 @@ void *erofs_read_metabuf(struct erofs_buf *buf, struct super_block *sb,return erofs_bread (buf, offset, need_kmap); } -static int erofs_map_blocks_flatmode (struct inode *inode, -struct erofs_map_blocks *map) -{ -struct erofs_inode *vi =EROFS_I (inode); -struct super_block *sb = inode->i_sb; -bool tailendpacking = (vi->datalayout ==EROFS_INODE_FLAT_INLINE ); -erofs_blk_t lastblk =erofs_iblks (inode) - tailendpacking; - - map->m_flags =EROFS_MAP_MAPPED ;/* no hole in flat inodes */ -if (map->m_la <erofs_pos (sb, lastblk)) { - map->m_pa =erofs_pos (sb, vi->raw_blkaddr) + map->m_la; - map->m_plen =erofs_pos (sb, lastblk) - map->m_la; - }else { -DBG_BUGON (!tailendpacking); - map->m_pa =erofs_iloc (inode) + vi->inode_isize + - vi->xattr_isize +erofs_blkoff (sb, map->m_la); - map->m_plen = inode->i_size - map->m_la; - -/* inline data should be located in the same meta block */ -if (erofs_blkoff (sb, map->m_pa) + map->m_plen > sb->s_blocksize) { -erofs_err (sb,"inline data across blocks @ nid %llu" , vi->nid); -DBG_BUGON (1 ); -return -EFSCORRUPTED ; - } - map->m_flags |=EROFS_MAP_META ; - } -return 0 ; -} -int erofs_map_blocks (struct inode *inode,struct erofs_map_blocks *map) { +struct erofs_buf buf = __EROFS_BUF_INITIALIZER;struct super_block *sb = inode->i_sb; +unsigned int unit, blksz = sb->s_blocksize;struct erofs_inode *vi =EROFS_I (inode);struct erofs_inode_chunk_index *idx; -struct erofs_buf buf = __EROFS_BUF_INITIALIZER; -u64 chunknr; -unsigned int unit; +erofs_blk_t startblk; +bool tailpacking;erofs_off_t pos; -void *kaddr; +u64 chunknr;int err =0 ;trace_erofs_map_blocks_enter (inode, map,0 ); map->m_deviceid =0 ; -if (map->m_la >= inode->i_size) { -/* leave out-of-bound access unmapped */ - map->m_flags =0 ; - map->m_plen = map->m_llen; + map->m_flags =0 ; +if (map->m_la >= inode->i_size) goto out; - }if (vi->datalayout !=EROFS_INODE_CHUNK_BASED ) { - err =erofs_map_blocks_flatmode (inode, map); + tailpacking = (vi->datalayout ==EROFS_INODE_FLAT_INLINE ); + pos =erofs_pos (sb,erofs_iblks (inode) - tailpacking); + + map->m_flags =EROFS_MAP_MAPPED ; +if (map->m_la < pos) { + map->m_pa =erofs_pos (sb, vi->raw_blkaddr) + map->m_la; + map->m_llen = pos - map->m_la; + }else { + map->m_pa =erofs_iloc (inode) + vi->inode_isize + + vi->xattr_isize +erofs_blkoff (sb, map->m_la); + map->m_llen = inode->i_size - map->m_la; + map->m_flags |=EROFS_MAP_META ; + } goto out; }
@@ -134,45 +115,41 @@ int erofs_map_blocks(struct inode *inode, struct erofs_map_blocks *map) pos =ALIGN (erofs_iloc (inode) + vi->inode_isize + vi->xattr_isize, unit) + unit * chunknr; - kaddr =erofs_read_metabuf (&buf, sb, pos, true); -if (IS_ERR (kaddr)) { - err =PTR_ERR (kaddr); + idx =erofs_read_metabuf (&buf, sb, pos, true); +if (IS_ERR (idx)) { + err =PTR_ERR (idx); goto out; } map->m_la = chunknr << vi->chunkbits; - map->m_plen =min_t (erofs_off_t,1UL << vi->chunkbits, -round_up (inode->i_size - map->m_la, sb->s_blocksize)); - -/* handle block map */ -if (!(vi->chunkformat &EROFS_CHUNK_FORMAT_INDEXES )) { -__le32 *blkaddr = kaddr; - -if (le32_to_cpu (*blkaddr) ==EROFS_NULL_ADDR ) { - map->m_flags =0 ; - }else { - map->m_pa =erofs_pos (sb,le32_to_cpu (*blkaddr)); + map->m_llen =min_t (erofs_off_t,1UL << vi->chunkbits, +round_up (inode->i_size - map->m_la, blksz)); +if (vi->chunkformat &EROFS_CHUNK_FORMAT_INDEXES ) { + startblk =le32_to_cpu (idx->blkaddr); +if (startblk !=EROFS_NULL_ADDR ) { + map->m_deviceid =le16_to_cpu (idx->device_id) & +EROFS_SB (sb)->device_id_mask; + map->m_pa =erofs_pos (sb, startblk); + map->m_flags =EROFS_MAP_MAPPED ; + } + }else { + startblk =le32_to_cpu (*(__le32 *)idx); +if (startblk !=EROFS_NULL_ADDR ) { + map->m_pa =erofs_pos (sb, startblk); map->m_flags =EROFS_MAP_MAPPED ; } - goto out_unlock; - } -/* parse chunk indexes */ - idx = kaddr; -switch (le32_to_cpu (idx->blkaddr)) { -case EROFS_NULL_ADDR : - map->m_flags =0 ; -break ; -default : - map->m_deviceid =le16_to_cpu (idx->device_id) & -EROFS_SB (sb)->device_id_mask; - map->m_pa =erofs_pos (sb,le32_to_cpu (idx->blkaddr)); - map->m_flags =EROFS_MAP_MAPPED ; -break ; } -out_unlock:erofs_put_metabuf (&buf); out: -if (!err) - map->m_llen = map->m_plen; +if (!err) { + map->m_plen = map->m_llen; +/* inline data should be located in the same meta block */ +if ((map->m_flags &EROFS_MAP_META ) && +erofs_blkoff (sb, map->m_pa) + map->m_plen > blksz) { +erofs_err (sb,"inline data across blocks @ nid %llu" , vi->nid); +DBG_BUGON (1 ); +return -EFSCORRUPTED ; + } + }trace_erofs_map_blocks_exit (inode, map,0 , err);return err; }
Signature · 1 line
2.43.5
PATCH 2/10 erofs: simplify erofs_{read,fill}_inode()
In reply to Gao Xiang - Switch to on-stack copied since it's just 64 bytes;
- Get rid of nblks and derive i_blocks directly;
- Use inode_set_mtime() instead of inode_set_ctime() to follow the ondisk naming;
- Rearrange the code.
--- fs/erofs/inode.c | 92 ++++++++++++++++++------------------------------ 1 file changed, 35 insertions(+), 57 deletions(-)
fs/erofs/inode.c +35 -57
@@ -27,29 +27,27 @@ static int erofs_fill_symlink(struct inode *inode, void *kaddr,static int erofs_read_inode (struct inode *inode) {struct super_block *sb = inode->i_sb; +erofs_blk_t blkaddr =erofs_blknr (sb,erofs_iloc (inode)); +unsigned int ofs =erofs_blkoff (sb,erofs_iloc (inode)); +struct erofs_buf buf = __EROFS_BUF_INITIALIZER;struct erofs_sb_info *sbi =EROFS_SB (sb);struct erofs_inode *vi =EROFS_I (inode); -const erofs_off_t inode_loc =erofs_iloc (inode); -erofs_blk_t blkaddr, nblks =0 ; -void *kaddr; +struct erofs_inode_extended *die, copied;struct erofs_inode_compact *dic; -struct erofs_inode_extended *die, *copied =NULL ;union erofs_inode_i_u iu; -struct erofs_buf buf = __EROFS_BUF_INITIALIZER; -unsigned int ifmt, ofs; +unsigned int ifmt; +void *ptr;int err =0 ; - blkaddr =erofs_blknr (sb, inode_loc); - ofs =erofs_blkoff (sb, inode_loc); - - kaddr =erofs_read_metabuf (&buf, sb,erofs_pos (sb, blkaddr), true); -if (IS_ERR (kaddr)) { -erofs_err (sb,"failed to get inode (nid: %llu) page, err %ld" , - vi->nid,PTR_ERR (kaddr)); -return PTR_ERR (kaddr); + ptr =erofs_read_metabuf (&buf, sb,erofs_pos (sb, blkaddr), true); +if (IS_ERR (ptr)) { + err =PTR_ERR (ptr); +erofs_err (sb,"failed to get inode (nid: %llu) page, err %d" , + vi->nid, err); + goto err_out; } - dic = kaddr + ofs; + dic = ptr + ofs; ifmt =le16_to_cpu (dic->i_format);if (ifmt & ~EROFS_I_ALL ) { erofs_err(sb, "unsupported i_format %u of nid %llu",
@@ -76,23 +74,18 @@ static int erofs_read_inode(struct inode *inode) }else {const unsigned int gotten = sb->s_blocksize - ofs; - copied =kmalloc (vi->inode_isize,GFP_KERNEL ); -if (!copied) { - err = -ENOMEM ; - goto err_out; - } -memcpy (copied, dic, gotten); - kaddr =erofs_read_metabuf (&buf, sb, +memcpy (&copied, dic, gotten); + ptr =erofs_read_metabuf (&buf, sb,erofs_pos (sb, blkaddr +1 ), true); -if (IS_ERR (kaddr)) { -erofs_err (sb,"failed to get inode payload block (nid: %llu), err %ld" , - vi->nid,PTR_ERR (kaddr)); -kfree (copied); -return PTR_ERR (kaddr); +if (IS_ERR (ptr)) { + err =PTR_ERR (ptr); +erofs_err (sb,"failed to get inode payload block (nid: %llu), err %d" , + vi->nid, err); + goto err_out; } ofs = vi->inode_isize - gotten; -memcpy ((u8 *)copied + gotten, kaddr, ofs); - die = copied; +memcpy ((u8 *)&copied + gotten, ptr, ofs); + die = &copied; } vi->xattr_isize =erofs_xattr_ibody_size (die->i_xattr_icount);
@@ -101,12 +94,10 @@ static int erofs_read_inode(struct inode *inode)i_uid_write (inode,le32_to_cpu (die->i_uid));i_gid_write (inode,le32_to_cpu (die->i_gid));set_nlink (inode,le32_to_cpu (die->i_nlink)); -/* each extended inode has its own timestamp */ -inode_set_ctime (inode,le64_to_cpu (die->i_mtime), +inode_set_mtime (inode,le64_to_cpu (die->i_mtime),le32_to_cpu (die->i_mtime_nsec)); inode->i_size =le64_to_cpu (die->i_size); -kfree (copied);break ;case EROFS_INODE_LAYOUT_COMPACT : vi->inode_isize =sizeof (struct erofs_inode_compact );
@@ -118,8 +109,7 @@ static int erofs_read_inode(struct inode *inode)i_uid_write (inode,le16_to_cpu (dic->i_uid));i_gid_write (inode,le16_to_cpu (dic->i_gid));set_nlink (inode,le16_to_cpu (dic->i_nlink)); -/* use build time for compact inodes */ -inode_set_ctime (inode, sbi->build_time, sbi->build_time_nsec); +inode_set_mtime (inode, sbi->build_time, sbi->build_time_nsec); inode->i_size =le32_to_cpu (dic->i_size);break ;
@@ -141,7 +131,7 @@ static int erofs_read_inode(struct inode *inode)case S_IFLNK : vi->raw_blkaddr =le32_to_cpu (iu.raw_blkaddr);if (S_ISLNK (inode->i_mode)) { - err =erofs_fill_symlink (inode, kaddr, ofs); + err =erofs_fill_symlink (inode, ptr, ofs);if (err) goto err_out; }
@@ -161,10 +151,13 @@ static int erofs_read_inode(struct inode *inode) goto err_out; } -/* total blocks for compressed files */ -if (erofs_inode_is_data_compressed (vi->datalayout)) { - nblks =le32_to_cpu (iu.compressed_blocks); - }else if (vi->datalayout ==EROFS_INODE_CHUNK_BASED ) { +if (erofs_inode_is_data_compressed (vi->datalayout)) + inode->i_blocks =le32_to_cpu (iu.compressed_blocks) << + (sb->s_blocksize_bits -9 ); +else + inode->i_blocks =round_up (inode->i_size, sb->s_blocksize) >>9 ; + +if (vi->datalayout ==EROFS_INODE_CHUNK_BASED ) {/* fill chunked inode summary info */ vi->chunkformat =le16_to_cpu (iu.c.format);if (vi->chunkformat & ~EROFS_CHUNK_FORMAT_ALL ) {
@@ -176,22 +169,15 @@ static int erofs_read_inode(struct inode *inode) vi->chunkbits = sb->s_blocksize_bits + (vi->chunkformat &EROFS_CHUNK_FORMAT_BLKBITS_MASK ); } -inode_set_mtime_to_ts (inode, -inode_set_atime_to_ts (inode,inode_get_ctime (inode))); +inode_set_atime_to_ts (inode, +inode_set_ctime_to_ts (inode,inode_get_mtime (inode))); inode->i_flags &= ~S_DAX ;if (test_opt (&sbi->opt,DAX_ALWAYS ) &&S_ISREG (inode->i_mode) && (vi->datalayout ==EROFS_INODE_FLAT_PLAIN || vi->datalayout ==EROFS_INODE_CHUNK_BASED )) inode->i_flags |=S_DAX ; - -if (!nblks) -/* measure inode.i_blocks as generic filesystems */ - inode->i_blocks =round_up (inode->i_size, sb->s_blocksize) >>9 ; -else - inode->i_blocks = nblks << (sb->s_blocksize_bits -9 ); err_out: -DBG_BUGON (err);erofs_put_metabuf (&buf);return err; }
@@ -202,13 +188,10 @@ static int erofs_fill_inode(struct inode *inode)int err;trace_erofs_fill_inode (inode); - -/* read inode base data from disk */ err =erofs_read_inode (inode);if (err)return err; -/* setup the new inode */ switch (inode->i_mode &S_IFMT ) {case S_IFREG : inode->i_op = &erofs_generic_iops;
@@ -229,15 +212,10 @@ static int erofs_fill_inode(struct inode *inode) inode->i_op = &erofs_symlink_iops;inode_nohighmem (inode);break ; -case S_IFCHR : -case S_IFBLK : -case S_IFIFO : -case S_IFSOCK : +default : inode->i_op = &erofs_generic_iops;init_special_inode (inode, inode->i_mode, inode->i_rdev);return 0 ; -default : -return -EFSCORRUPTED ; }mapping_set_large_folios (inode->i_mapping);
Signature · 1 line
2.43.5
PATCH 3/10 erofs: add 48-bit block addressing on-disk support
In reply to Gao XiangThe current 32-bit block addressing limits EROFS to a 16TiB maximum volume size with 4KiB blocks. However, several new use cases now require larger capacity support:
- Massive datasets for model training in order to boost random sampling performance for each epoch;
- Object storage clients using EROFS direct passthrough.
This extends core on-disk structures to support 48-bit block addressing, such as inodes, device slots, and inode chunks.
Additionally:
- Expand superblock root NID to 8-byte rootnid_8b to enable full out-of-place update incremental builds;
- Introduce epoch field in the superblock as well as add mtime field to 32-byte compact inodes for basic timestamp support.
--- fs/erofs/data.c | 15 ++++---- fs/erofs/erofs_fs.h | 91 +++++++++++++++++++++------------------------ fs/erofs/inode.c | 6 +-- fs/erofs/internal.h | 6 +-- fs/erofs/super.c | 12 +++--- 5 files changed, 61 insertions(+), 69 deletions(-)
fs/erofs/data.c +7 -8
@@ -95,7 +95,7 @@ int erofs_map_blocks(struct inode *inode, struct erofs_map_blocks *map) map->m_flags =EROFS_MAP_MAPPED ;if (map->m_la < pos) { - map->m_pa =erofs_pos (sb, vi->raw_blkaddr) + map->m_la; + map->m_pa =erofs_pos (sb, vi->startblk) + map->m_la; map->m_llen = pos - map->m_la; }else { map->m_pa = erofs_iloc(inode) + vi->inode_isize +
@@ -124,7 +124,7 @@ int erofs_map_blocks(struct inode *inode, struct erofs_map_blocks *map) map->m_llen =min_t (erofs_off_t,1UL << vi->chunkbits,round_up (inode->i_size - map->m_la, blksz));if (vi->chunkformat &EROFS_CHUNK_FORMAT_INDEXES ) { - startblk =le32_to_cpu (idx->blkaddr); + startblk =le32_to_cpu (idx->startblk_lo);if (startblk !=EROFS_NULL_ADDR ) { map->m_deviceid =le16_to_cpu (idx->device_id) &EROFS_SB (sb)->device_id_mask;
@@ -168,7 +168,7 @@ int erofs_map_dev(struct super_block *sb, struct erofs_map_dev *map) {struct erofs_dev_context *devs =EROFS_SB (sb)->devs;struct erofs_device_info *dif; -erofs_off_t startoff, length; +erofs_off_t startoff;int id;erofs_fill_from_devinfo (map, sb, &EROFS_SB (sb)->dif0);
@@ -181,7 +181,7 @@ int erofs_map_dev(struct super_block *sb, struct erofs_map_dev *map)return -ENODEV ; }if (devs->flatdev) { - map->m_pa +=erofs_pos (sb, dif->mapped_blkaddr); + map->m_pa +=erofs_pos (sb, dif->uniaddr);up_read (&devs->rwsem);return 0 ; }
@@ -190,13 +190,12 @@ int erofs_map_dev(struct super_block *sb, struct erofs_map_dev *map) }else if (devs->extra_devices && !devs->flatdev) {down_read (&devs->rwsem);idr_for_each_entry (&devs->tree, dif, id) { -if (!dif->mapped_blkaddr) +if (!dif->uniaddr)continue ; - startoff =erofs_pos (sb, dif->mapped_blkaddr); - length =erofs_pos (sb, dif->blocks); + startoff =erofs_pos (sb, dif->uniaddr);if (map->m_pa >= startoff && - map->m_pa < startoff + length) { + map->m_pa < startoff +erofs_pos (sb, dif->blocks)) { map->m_pa -= startoff;erofs_fill_from_devinfo (map, sb, dif);break ;
fs/erofs/erofs_fs.h +42 -49
168 lines not on this page · raw message
fs/erofs/inode.c +3 -3
@@ -108,7 +108,7 @@ static int erofs_read_inode(struct inode *inode) iu = dic->i_u;i_uid_write (inode,le16_to_cpu (dic->i_uid));i_gid_write (inode,le16_to_cpu (dic->i_gid)); -set_nlink (inode,le16_to_cpu (dic->i_nlink)); +set_nlink (inode,le16_to_cpu (dic->i_nb.nlink));inode_set_mtime (inode, sbi->build_time, sbi->build_time_nsec); inode->i_size =le32_to_cpu (dic->i_size);
@@ -129,7 +129,7 @@ static int erofs_read_inode(struct inode *inode)case S_IFREG :case S_IFDIR :case S_IFLNK : - vi->raw_blkaddr =le32_to_cpu (iu.raw_blkaddr); + vi->startblk =le32_to_cpu (iu.startblk_lo);if (S_ISLNK (inode->i_mode)) { err =erofs_fill_symlink (inode, ptr, ofs);if (err)
@@ -152,7 +152,7 @@ static int erofs_read_inode(struct inode *inode) }if (erofs_inode_is_data_compressed (vi->datalayout)) - inode->i_blocks =le32_to_cpu (iu.compressed_blocks) << + inode->i_blocks =le32_to_cpu (iu.blocks_lo) << (sb->s_blocksize_bits -9 );else inode->i_blocks =round_up (inode->i_size, sb->s_blocksize) >>9 ;
fs/erofs/internal.h +3 -3
@@ -47,8 +47,8 @@ struct erofs_device_info {struct dax_device *dax_dev;u64 dax_part_off; -u32 blocks; -u32 mapped_blkaddr; +erofs_blk_t blocks; +erofs_blk_t uniaddr; };enum {
@@ -252,7 +252,7 @@ struct erofs_inode {unsigned int *xattr_shared_xattrs;union { -erofs_blk_t raw_blkaddr; +erofs_blk_t startblk;struct {unsigned short chunkformat;unsigned char chunkbits;
fs/erofs/super.c +6 -6
@@ -178,8 +178,8 @@ static int erofs_init_device(struct erofs_buf *buf, struct super_block *sb, dif->file = file; } - dif->blocks =le32_to_cpu (dis->blocks); - dif->mapped_blkaddr =le32_to_cpu (dis->mapped_blkaddr); + dif->blocks =le32_to_cpu (dis->blocks_lo); + dif->uniaddr =le32_to_cpu (dis->uniaddr_lo); sbi->total_blocks += dif->blocks; *pos +=EROFS_DEVT_SLOT_SIZE ;return 0 ;
@@ -299,7 +299,7 @@ static int erofs_read_superblock(struct super_block *sb) sbi->sb_size); goto out; } - sbi->dif0.blocks =le32_to_cpu (dsb->blocks); + sbi->dif0.blocks =le32_to_cpu (dsb->blocks_lo); sbi->meta_blkaddr =le32_to_cpu (dsb->meta_blkaddr);#ifdef CONFIG_EROFS_FS_XATTR sbi->xattr_blkaddr =le32_to_cpu (dsb->xattr_blkaddr);
@@ -308,12 +308,12 @@ static int erofs_read_superblock(struct super_block *sb) sbi->xattr_filter_reserved = dsb->xattr_filter_reserved;#endif sbi->islotbits =ilog2 (sizeof (struct erofs_inode_compact )); - sbi->root_nid =le16_to_cpu (dsb->root_nid); + sbi->root_nid =le16_to_cpu (dsb->rb.rootnid_2b); sbi->packed_nid =le64_to_cpu (dsb->packed_nid); sbi->inos =le64_to_cpu (dsb->inos); - sbi->build_time =le64_to_cpu (dsb->build_time); - sbi->build_time_nsec =le32_to_cpu (dsb->build_time_nsec); + sbi->build_time =le64_to_cpu (dsb->epoch); + sbi->build_time_nsec =le32_to_cpu (dsb->fixed_nsec);super_set_uuid (sb, (void *)dsb->uuid,sizeof (dsb->uuid));
Signature · 1 line
2.43.5
PATCH 4/10 erofs: implement 48-bit block addressing for unencoded inodes
In reply to Gao XiangIt adapts the on-disk changes from the previous commit. It also supports EROFS_NULL_ADDR (all 1's) for EROFS_INODE_FLAT_PLAIN inodes to indicate 0-filled inodes, as it's common for composefs use cases. As a result, EROFS_INODE_CHUNK_BASED is no longer needed.
--- fs/erofs/data.c | 13 +++++++++---- fs/erofs/dir.c | 2 +- fs/erofs/inode.c | 34 +++++++++++++++++++++++++--------- fs/erofs/internal.h | 12 ++++++------ fs/erofs/super.c | 15 ++++++++++----- fs/erofs/sysfs.c | 2 ++ include/trace/events/erofs.h | 2 +- 7 files changed, 54 insertions(+), 26 deletions(-)
fs/erofs/data.c +9 -4
@@ -77,7 +77,7 @@ int erofs_map_blocks(struct inode *inode, struct erofs_map_blocks *map)unsigned int unit, blksz = sb->s_blocksize;struct erofs_inode *vi =EROFS_I (inode);struct erofs_inode_chunk_index *idx; -erofs_blk_t startblk; +erofs_blk_t startblk, addrmask;bool tailpacking;erofs_off_t pos;u64 chunknr;
@@ -91,6 +91,8 @@ int erofs_map_blocks(struct inode *inode, struct erofs_map_blocks *map)if (vi->datalayout !=EROFS_INODE_CHUNK_BASED ) { tailpacking = (vi->datalayout ==EROFS_INODE_FLAT_INLINE ); +if (!tailpacking && vi->startblk ==EROFS_NULL_ADDR ) + goto out; pos =erofs_pos (sb,erofs_iblks (inode) - tailpacking); map->m_flags =EROFS_MAP_MAPPED ;
@@ -124,8 +126,11 @@ int erofs_map_blocks(struct inode *inode, struct erofs_map_blocks *map) map->m_llen =min_t (erofs_off_t,1UL << vi->chunkbits,round_up (inode->i_size - map->m_la, blksz));if (vi->chunkformat &EROFS_CHUNK_FORMAT_INDEXES ) { - startblk =le32_to_cpu (idx->startblk_lo); -if (startblk !=EROFS_NULL_ADDR ) { + addrmask = (vi->chunkformat &EROFS_CHUNK_FORMAT_48BIT ) ? +BIT_ULL (48 ) -1 :BIT_ULL (32 ) -1 ; + startblk = (((u64 )le16_to_cpu (idx->startblk_hi) <<32 ) | +le32_to_cpu (idx->startblk_lo)) & addrmask; +if ((startblk ^EROFS_NULL_ADDR ) & addrmask) { map->m_deviceid =le16_to_cpu (idx->device_id) &EROFS_SB (sb)->device_id_mask; map->m_pa =erofs_pos (sb, startblk);
@@ -133,7 +138,7 @@ int erofs_map_blocks(struct inode *inode, struct erofs_map_blocks *map) } }else { startblk =le32_to_cpu (*(__le32 *)idx); -if (startblk !=EROFS_NULL_ADDR ) { +if (startblk != (u32 )EROFS_NULL_ADDR ) { map->m_pa =erofs_pos (sb, startblk); map->m_flags =EROFS_MAP_MAPPED ; }
fs/erofs/dir.c +1 -1
@@ -60,7 +60,7 @@ static int erofs_readdir(struct file *f, struct dir_context *ctx) de =erofs_bread (&buf, dbstart, true);if (IS_ERR (de)) { -erofs_err (sb,"fail to readdir of logical block %u of nid %llu" , +erofs_err (sb,"failed to readdir of logical block %llu of nid %llu" ,erofs_blknr (sb, dbstart),EROFS_I (dir)->nid); err =PTR_ERR (de);break ;
fs/erofs/inode.c +25 -9
@@ -31,10 +31,10 @@ static int erofs_read_inode(struct inode *inode)unsigned int ofs =erofs_blkoff (sb,erofs_iloc (inode));struct erofs_buf buf = __EROFS_BUF_INITIALIZER;struct erofs_sb_info *sbi =EROFS_SB (sb); +erofs_blk_t addrmask =BIT_ULL (48 ) -1 ;struct erofs_inode *vi =EROFS_I (inode);struct erofs_inode_extended *die, copied;struct erofs_inode_compact *dic; -union erofs_inode_i_u iu;unsigned int ifmt;void *ptr;int err =0 ;
@@ -71,6 +71,8 @@ static int erofs_read_inode(struct inode *inode)if (ofs + vi->inode_isize <= sb->s_blocksize) { ofs += vi->inode_isize; die = (struct erofs_inode_extended *)dic; + copied.i_u = die->i_u; + copied.i_nb = die->i_nb; }else {const unsigned int gotten = sb->s_blocksize - ofs;
@@ -90,7 +92,6 @@ static int erofs_read_inode(struct inode *inode) vi->xattr_isize =erofs_xattr_ibody_size (die->i_xattr_icount); inode->i_mode =le16_to_cpu (die->i_mode); - iu = die->i_u;i_uid_write (inode,le32_to_cpu (die->i_uid));i_gid_write (inode,le32_to_cpu (die->i_gid));set_nlink (inode,le32_to_cpu (die->i_nlink));
@@ -105,11 +106,21 @@ static int erofs_read_inode(struct inode *inode) vi->xattr_isize =erofs_xattr_ibody_size (dic->i_xattr_icount); inode->i_mode =le16_to_cpu (dic->i_mode); - iu = dic->i_u; + copied.i_u = dic->i_u; + copied.i_nb = dic->i_nb;i_uid_write (inode,le16_to_cpu (dic->i_uid));i_gid_write (inode,le16_to_cpu (dic->i_gid)); -set_nlink (inode,le16_to_cpu (dic->i_nb.nlink)); -inode_set_mtime (inode, sbi->build_time, sbi->build_time_nsec); +if (!S_ISDIR (inode->i_mode) && + ((ifmt >>EROFS_I_NLINK_1_BIT ) &1 )) { +set_nlink (inode,1 ); + copied.i_nb = dic->i_nb; + }else { +set_nlink (inode,le16_to_cpu (dic->i_nb.nlink)); + copied.i_nb.startblk_hi =0 ; + addrmask =BIT_ULL (32 ) -1 ; + } +inode_set_mtime (inode, sbi->epoch +le32_to_cpu (dic->i_mtime), + sbi->fixed_nsec); inode->i_size =le32_to_cpu (dic->i_size);break ;
@@ -129,7 +140,12 @@ static int erofs_read_inode(struct inode *inode)case S_IFREG :case S_IFDIR :case S_IFLNK : - vi->startblk =le32_to_cpu (iu.startblk_lo); + vi->startblk =le32_to_cpu (copied.i_u.startblk_lo) | + ((u64 )le16_to_cpu (copied.i_nb.startblk_hi) <<32 ); +if (vi->datalayout ==EROFS_INODE_FLAT_PLAIN && + !((vi->startblk ^EROFS_NULL_ADDR ) & addrmask)) + vi->startblk =EROFS_NULL_ADDR ; +if (S_ISLNK (inode->i_mode)) { err =erofs_fill_symlink (inode, ptr, ofs);if (err)
@@ -138,7 +154,7 @@ static int erofs_read_inode(struct inode *inode)break ;case S_IFCHR :case S_IFBLK : - inode->i_rdev =new_decode_dev (le32_to_cpu (iu.rdev)); + inode->i_rdev =new_decode_dev (le32_to_cpu (copied.i_u.rdev));break ;case S_IFIFO :case S_IFSOCK :
@@ -152,14 +168,14 @@ static int erofs_read_inode(struct inode *inode) }if (erofs_inode_is_data_compressed (vi->datalayout)) - inode->i_blocks =le32_to_cpu (iu.blocks_lo) << + inode->i_blocks =le32_to_cpu (copied.i_u.blocks_lo) << (sb->s_blocksize_bits -9 );else inode->i_blocks =round_up (inode->i_size, sb->s_blocksize) >>9 ;if (vi->datalayout ==EROFS_INODE_CHUNK_BASED ) {/* fill chunked inode summary info */ - vi->chunkformat =le16_to_cpu (iu.c.format); + vi->chunkformat =le16_to_cpu (copied.i_u.c.format);if (vi->chunkformat & ~EROFS_CHUNK_FORMAT_ALL ) {erofs_err (sb,"unsupported chunk format %x of nid %llu" , vi->chunkformat, vi->nid);
fs/erofs/internal.h +6 -6
@@ -37,8 +37,7 @@ __printf(2, 3) void _erofs_printk(struct super_block *sb, const char *fmt, ...);typedef u64 erofs_nid_t ;typedef u64 erofs_off_t ; -/* data type for filesystem-wide blocks number */ -typedef u32 erofs_blk_t ; +typedef u64 erofs_blk_t ;struct erofs_device_info {char *path;
@@ -143,8 +142,8 @@ struct erofs_sb_info {unsigned char blkszbits;/* filesystem block size in bit shift */ u32 sb_size;/* total superblock size */ -u32 build_time_nsec; -u64 build_time; +u32 fixed_nsec; +s64 epoch;/* what we really care is nid, rather than ino.. */ erofs_nid_t root_nid;
@@ -205,8 +204,8 @@ struct erofs_buf { };#define __EROFS_BUF_INITIALIZER ((struct erofs_buf){ .page = NULL }) -#define erofs_blknr (sb, addr) ((erofs_blk_t)((addr) >> (sb)->s_blocksize_bits)) -#define erofs_blkoff (sb, addr) ((addr) & ((sb)->s_blocksize - 1)) +#define erofs_blknr (sb, pos) ((erofs_blk_t)((pos) >> (sb)->s_blocksize_bits)) +#define erofs_blkoff (sb, pos) ((pos) & ((sb)->s_blocksize - 1))#define erofs_pos (sb, blk) ((erofs_off_t)(blk) << (sb)->s_blocksize_bits)#define erofs_iblks (i) (round_up((i)->i_size, i_blocksize(i)) >> (i)->i_blkbits)
@@ -226,6 +225,7 @@ EROFS_FEATURE_FUNCS(ztailpacking, incompat, INCOMPAT_ZTAILPACKING) EROFS_FEATURE_FUNCS(fragments, incompat, INCOMPAT_FRAGMENTS) EROFS_FEATURE_FUNCS(dedupe, incompat, INCOMPAT_DEDUPE) EROFS_FEATURE_FUNCS(xattr_prefixes, incompat, INCOMPAT_XATTR_PREFIXES) +EROFS_FEATURE_FUNCS(48bit, incompat, INCOMPAT_48BIT) EROFS_FEATURE_FUNCS(sb_chksum, compat, COMPAT_SB_CHKSUM)EROFS_FEATURE_FUNCS (xattr_filter, compat,COMPAT_XATTR_FILTER )
fs/erofs/super.c +10 -5
@@ -268,7 +268,7 @@ static int erofs_read_superblock(struct super_block *sb) goto out; } - sbi->blkszbits = dsb->blkszbits; + sbi->blkszbits = dsb->blkszbits;if (sbi->blkszbits <9 || sbi->blkszbits >PAGE_SHIFT ) {erofs_err (sb,"blkszbits %u isn't supported" , sbi->blkszbits); goto out;
@@ -308,13 +308,18 @@ static int erofs_read_superblock(struct super_block *sb) sbi->xattr_filter_reserved = dsb->xattr_filter_reserved;#endif sbi->islotbits =ilog2 (sizeof (struct erofs_inode_compact )); - sbi->root_nid =le16_to_cpu (dsb->rb.rootnid_2b); +if (erofs_sb_has_48bit (sbi) && dsb->rootnid_8b) { + sbi->root_nid =le64_to_cpu (dsb->rootnid_8b); + sbi->dif0.blocks = (sbi->dif0.blocks <<32 ) | +le16_to_cpu (dsb->rb.blocks_hi); + }else { + sbi->root_nid =le16_to_cpu (dsb->rb.rootnid_2b); + } sbi->packed_nid =le64_to_cpu (dsb->packed_nid); sbi->inos =le64_to_cpu (dsb->inos); - sbi->build_time =le64_to_cpu (dsb->epoch); - sbi->build_time_nsec =le32_to_cpu (dsb->fixed_nsec); - + sbi->epoch = (s64 )le64_to_cpu (dsb->epoch); + sbi->fixed_nsec =le32_to_cpu (dsb->fixed_nsec);super_set_uuid (sb, (void *)dsb->uuid,sizeof (dsb->uuid));/* parse on-disk compression configurations */
fs/erofs/sysfs.c +2 -0
@@ -81,6 +81,7 @@ EROFS_ATTR_FEATURE(sb_chksum);EROFS_ATTR_FEATURE (ztailpacking);EROFS_ATTR_FEATURE (fragments);EROFS_ATTR_FEATURE (dedupe); +EROFS_ATTR_FEATURE(48bit);static struct attribute *erofs_feat_attrs[] = {ATTR_LIST (zero_padding),
@@ -93,6 +94,7 @@ static struct attribute *erofs_feat_attrs[] = {ATTR_LIST (ztailpacking),ATTR_LIST (fragments),ATTR_LIST (dedupe), + ATTR_LIST(48bit),NULL , };ATTRIBUTE_GROUPS (erofs_feat);
include/trace/events/erofs.h +1 -1
@@ -75,7 +75,7 @@ TRACE_EVENT(erofs_fill_inode, __entry->ofs =erofs_blkoff (inode->i_sb,erofs_iloc (inode)); ), -TP_printk ("dev = (%d,%d), nid = %llu, blkaddr %u ofs %u" , +TP_printk ("dev = (%d,%d), nid = %llu, blkaddr %llu ofs %u" ,show_dev_nid (__entry), __entry->blkaddr, __entry->ofs) );
Signature · 1 line
2.43.5
PATCH 5/10 erofs: support dot-omitted directories
In reply to Gao XiangThere's no need to record "." dirents in the directory data (while they could be used for sanity checks, they aren't very useful.) Omitting "." dirents also improves directory data deduplication.
Use a per-inode (instead of per-sb) flag to indicate if the "." dirent is omitted or not, ensuring compatibility with incremental builds. It also reuses EROFS_I_NLINK_1_BIT, as it has very limited use cases for directories with nlink = 1.
Emit the "." entry as the last virtual dirent in the directory because it is _much_ less frequently used than the ".." dirent. It also keeps f_pos meaningful, as it strictly follows the directory data when it's less than i_size.
--- fs/erofs/dir.c | 5 +++++ fs/erofs/erofs_fs.h | 1 + fs/erofs/inode.c | 4 +++- fs/erofs/internal.h | 1 + 4 files changed, 10 insertions(+), 1 deletion(-)
fs/erofs/dir.c +5 -0
@@ -90,6 +90,11 @@ static int erofs_readdir(struct file *f, struct dir_context *ctx) ofs =0 ; }erofs_put_metabuf (&buf); +if (EROFS_I (dir)->dot_omitted && ctx->pos == dir->i_size) { +if (!dir_emit_dot (f, ctx)) +return 0 ; + ++ctx->pos; + }return err <0 ? err :0 ; }
fs/erofs/erofs_fs.h +1 -0
@@ -116,6 +116,7 @@ static inline bool erofs_inode_is_data_compressed(unsigned int datamode)#define EROFS_I_VERSION_BIT 0#define EROFS_I_DATALAYOUT_BIT 1#define EROFS_I_NLINK_1_BIT 4/* non-directory compact inodes only */ +#define EROFS_I_DOT_OMITTED_BIT 4/* (directories) omit the `.` dirent */ #define EROFS_I_ALL ((1 << (EROFS_I_NLINK_1_BIT + 1)) - 1)/* indicate chunk blkbits, thus 'chunksize = blocksize << chunk blkbits' */
fs/erofs/inode.c +3 -1
@@ -137,8 +137,10 @@ static int erofs_read_inode(struct inode *inode) goto err_out; }switch (inode->i_mode &S_IFMT ) { -case S_IFREG :case S_IFDIR : + vi->dot_omitted = (ifmt >>EROFS_I_DOT_OMITTED_BIT ) &1 ; + fallthrough; +case S_IFREG :case S_IFLNK : vi->startblk =le32_to_cpu (copied.i_u.startblk_lo) | ((u64 )le16_to_cpu (copied.i_nb.startblk_hi) <<32 );
fs/erofs/internal.h +1 -0
@@ -245,6 +245,7 @@ struct erofs_inode {unsigned char datalayout;unsigned char inode_isize; +bool dot_omitted;unsigned int xattr_isize;unsigned int xattr_name_filter;
Signature · 1 line
2.43.5
PATCH 6/10 erofs: initialize decompression early
In reply to Gao Xiang - Rename erofs_init_managed_cache() to z_erofs_init_super();
- Move the initialization of managed_pslots into z_erofs_init_super() too;
- Move z_erofs_init_super() and packed inode preparation upwards, before the root inode initialization.
Therefore, the root directory can also be compressible.
--- fs/erofs/internal.h | 4 ++-- fs/erofs/super.c | 26 ++++++++++---------------- fs/erofs/zdata.c | 4 ++-- 3 files changed, 14 insertions(+), 20 deletions(-)
fs/erofs/internal.h +2 -2
@@ -436,6 +436,7 @@ int __init erofs_init_shrinker(void);void erofs_exit_shrinker (void );int __init z_erofs_init_subsystem (void );void z_erofs_exit_subsystem (void ); +int z_erofs_init_super (struct super_block *sb);unsigned long z_erofs_shrink_scan (struct erofs_sb_info *sbi,unsigned long nr_shrink); int z_erofs_map_blocks_iter(struct inode *inode, struct erofs_map_blocks *map,
@@ -445,7 +446,6 @@ void z_erofs_put_gbuf(void *ptr);int z_erofs_gbuf_growsize (unsigned int nrpages);int __init z_erofs_gbuf_init (void );void z_erofs_gbuf_exit (void ); -int erofs_init_managed_cache (struct super_block *sb);int z_erofs_parse_cfgs (struct super_block *sb,struct erofs_super_block *dsb);#else static inline void erofs_shrinker_register (struct super_block *sb) {}
@@ -454,7 +454,7 @@ static inline int erofs_init_shrinker(void) { return 0; }static inline void erofs_exit_shrinker (void ) {}static inline int z_erofs_init_subsystem (void ) {return 0 ; }static inline void z_erofs_exit_subsystem (void ) {} -static inline int erofs_init_managed_cache (struct super_block *sb) {return 0 ; } +static inline int z_erofs_init_super (struct super_block *sb) {return 0 ; }#endif /* !CONFIG_EROFS_FS_ZIP */ #ifdef CONFIG_EROFS_FS_BACKED_BY_FILE
fs/erofs/super.c +10 -16
@@ -636,9 +636,16 @@ static int erofs_fc_fill_super(struct super_block *sb, struct fs_context *fc)else sb->s_flags &= ~SB_POSIXACL ; -#ifdef CONFIG_EROFS_FS_ZIP -xa_init (&sbi->managed_pslots); -#endif + err =z_erofs_init_super (sb); +if (err) +return err; + +if (erofs_sb_has_fragments (sbi) && sbi->packed_nid) { + inode =erofs_iget (sb, sbi->packed_nid); +if (IS_ERR (inode)) +return PTR_ERR (inode); + sbi->packed_inode = inode; + } inode =erofs_iget (sb, sbi->root_nid);if (IS_ERR (inode))
@@ -650,24 +657,11 @@ static int erofs_fc_fill_super(struct super_block *sb, struct fs_context *fc)iput (inode);return -EINVAL ; } - sb->s_root =d_make_root (inode);if (!sb->s_root)return -ENOMEM ;erofs_shrinker_register (sb); -if (erofs_sb_has_fragments (sbi) && sbi->packed_nid) { - sbi->packed_inode =erofs_iget (sb, sbi->packed_nid); -if (IS_ERR (sbi->packed_inode)) { - err =PTR_ERR (sbi->packed_inode); - sbi->packed_inode =NULL ; -return err; - } - } - err =erofs_init_managed_cache (sb); -if (err) -return err; - err =erofs_xattr_prefixes_init (sb);if (err)return err;
fs/erofs/zdata.c +2 -2
@@ -644,18 +644,18 @@ static const struct address_space_operations z_erofs_cache_aops = { .invalidate_folio = z_erofs_cache_invalidate_folio, }; -int erofs_init_managed_cache (struct super_block *sb) +int z_erofs_init_super (struct super_block *sb) {struct inode *const inode =new_inode (sb);if (!inode)return -ENOMEM ; -set_nlink (inode,1 ); inode->i_size =OFFSET_MAX ; inode->i_mapping->a_ops = &z_erofs_cache_aops;mapping_set_gfp_mask (inode->i_mapping,GFP_KERNEL );EROFS_SB (sb)->managed_cache = inode; +xa_init (&EROFS_SB (sb)->managed_pslots);return 0 ; }
Signature · 1 line
2.43.5
PATCH v2 6/10 erofs: initialize decompression early
- Rename erofs_init_managed_cache() to z_erofs_init_super();
- Move the initialization of managed_pslots into z_erofs_init_super() too;
- Move z_erofs_init_super() and packed inode preparation upwards, before the root inode initialization.
Therefore, the root directory can also be compressible.
---
v2:
- move iput(packed_inode/managed_cache) into .kill_sb() since they are initialized prior to d_make_root().
fs/erofs/internal.h | 4 ++-- fs/erofs/super.c | 40 ++++++++++++++++------------------------ fs/erofs/zdata.c | 4 ++-- 3 files changed, 20 insertions(+), 28 deletions(-)
fs/erofs/internal.h +2 -2
@@ -436,6 +436,7 @@ int __init erofs_init_shrinker(void);void erofs_exit_shrinker (void );int __init z_erofs_init_subsystem (void );void z_erofs_exit_subsystem (void ); +int z_erofs_init_super (struct super_block *sb);unsigned long z_erofs_shrink_scan (struct erofs_sb_info *sbi,unsigned long nr_shrink); int z_erofs_map_blocks_iter(struct inode *inode, struct erofs_map_blocks *map,
@@ -445,7 +446,6 @@ void z_erofs_put_gbuf(void *ptr);int z_erofs_gbuf_growsize (unsigned int nrpages);int __init z_erofs_gbuf_init (void );void z_erofs_gbuf_exit (void ); -int erofs_init_managed_cache (struct super_block *sb);int z_erofs_parse_cfgs (struct super_block *sb,struct erofs_super_block *dsb);#else static inline void erofs_shrinker_register (struct super_block *sb) {}
@@ -454,7 +454,7 @@ static inline int erofs_init_shrinker(void) { return 0; }static inline void erofs_exit_shrinker (void ) {}static inline int z_erofs_init_subsystem (void ) {return 0 ; }static inline void z_erofs_exit_subsystem (void ) {} -static inline int erofs_init_managed_cache (struct super_block *sb) {return 0 ; } +static inline int z_erofs_init_super (struct super_block *sb) {return 0 ; }#endif /* !CONFIG_EROFS_FS_ZIP */ #ifdef CONFIG_EROFS_FS_BACKED_BY_FILE
fs/erofs/super.c +16 -24
@@ -636,9 +636,16 @@ static int erofs_fc_fill_super(struct super_block *sb, struct fs_context *fc)else sb->s_flags &= ~SB_POSIXACL ; -#ifdef CONFIG_EROFS_FS_ZIP -xa_init (&sbi->managed_pslots); -#endif + err =z_erofs_init_super (sb); +if (err) +return err; + +if (erofs_sb_has_fragments (sbi) && sbi->packed_nid) { + inode =erofs_iget (sb, sbi->packed_nid); +if (IS_ERR (inode)) +return PTR_ERR (inode); + sbi->packed_inode = inode; + } inode =erofs_iget (sb, sbi->root_nid);if (IS_ERR (inode))
@@ -650,24 +657,11 @@ static int erofs_fc_fill_super(struct super_block *sb, struct fs_context *fc)iput (inode);return -EINVAL ; } - sb->s_root =d_make_root (inode);if (!sb->s_root)return -ENOMEM ;erofs_shrinker_register (sb); -if (erofs_sb_has_fragments (sbi) && sbi->packed_nid) { - sbi->packed_inode =erofs_iget (sb, sbi->packed_nid); -if (IS_ERR (sbi->packed_inode)) { - err =PTR_ERR (sbi->packed_inode); - sbi->packed_inode =NULL ; -return err; - } - } - err =erofs_init_managed_cache (sb); -if (err) -return err; - err =erofs_xattr_prefixes_init (sb);if (err)return err;
@@ -812,6 +806,12 @@ static void erofs_kill_sb(struct super_block *sb)kill_anon_super (sb); elsekill_block_super (sb ); +iput (sbi->packed_inode); + sbi->packed_inode =NULL ; +#ifdef CONFIG_EROFS_FS_ZIP +iput (sbi->managed_cache); + sbi->managed_cache =NULL ; +#endif fs_put_dax (sbi->dif0.dax_dev,NULL );erofs_fscache_unregister_fs (sb);erofs_sb_free (sbi);
@@ -822,17 +822,9 @@ static void erofs_put_super(struct super_block *sb) {struct erofs_sb_info *const sbi =EROFS_SB (sb); -DBG_BUGON (!sbi); -erofs_unregister_sysfs (sb);erofs_shrinker_unregister (sb);erofs_xattr_prefixes_cleanup (sb); -#ifdef CONFIG_EROFS_FS_ZIP -iput (sbi->managed_cache); - sbi->managed_cache =NULL ; -#endif -iput (sbi->packed_inode); - sbi->packed_inode =NULL ;erofs_free_dev_context (sbi->devs); sbi->devs =NULL ;erofs_fscache_unregister_fs (sb);
fs/erofs/zdata.c +2 -2
@@ -644,18 +644,18 @@ static const struct address_space_operations z_erofs_cache_aops = { .invalidate_folio = z_erofs_cache_invalidate_folio, }; -int erofs_init_managed_cache (struct super_block *sb) +int z_erofs_init_super (struct super_block *sb) {struct inode *const inode =new_inode (sb);if (!inode)return -ENOMEM ; -set_nlink (inode,1 ); inode->i_size =OFFSET_MAX ; inode->i_mapping->a_ops = &z_erofs_cache_aops;mapping_set_gfp_mask (inode->i_mapping,GFP_KERNEL );EROFS_SB (sb)->managed_cache = inode; +xa_init (&EROFS_SB (sb)->managed_pslots);return 0 ; }
Signature · 1 line
2.43.5
PATCH v3 6/10 erofs: initialize decompression early
- Rename erofs_init_managed_cache() to z_erofs_init_super();
- Move the initialization of managed_pslots into z_erofs_init_super() too;
- Move z_erofs_init_super() and packed inode preparation upwards, before the root inode initialization.
Therefore, the root directory can also be compressible.
---
v3:
- should handle both .put_super() and .kill_sb(), otherwise VFS will report "VFS: Busy inodes after unmount of ..."
fs/erofs/internal.h | 4 ++-- fs/erofs/super.c | 46 ++++++++++++++++++++++----------------------- fs/erofs/zdata.c | 4 ++-- 3 files changed, 26 insertions(+), 28 deletions(-)
fs/erofs/internal.h +2 -2
@@ -436,6 +436,7 @@ int __init erofs_init_shrinker(void);void erofs_exit_shrinker (void );int __init z_erofs_init_subsystem (void );void z_erofs_exit_subsystem (void ); +int z_erofs_init_super (struct super_block *sb);unsigned long z_erofs_shrink_scan (struct erofs_sb_info *sbi,unsigned long nr_shrink); int z_erofs_map_blocks_iter(struct inode *inode, struct erofs_map_blocks *map,
@@ -445,7 +446,6 @@ void z_erofs_put_gbuf(void *ptr);int z_erofs_gbuf_growsize (unsigned int nrpages);int __init z_erofs_gbuf_init (void );void z_erofs_gbuf_exit (void ); -int erofs_init_managed_cache (struct super_block *sb);int z_erofs_parse_cfgs (struct super_block *sb,struct erofs_super_block *dsb);#else static inline void erofs_shrinker_register (struct super_block *sb) {}
@@ -454,7 +454,7 @@ static inline int erofs_init_shrinker(void) { return 0; }static inline void erofs_exit_shrinker (void ) {}static inline int z_erofs_init_subsystem (void ) {return 0 ; }static inline void z_erofs_exit_subsystem (void ) {} -static inline int erofs_init_managed_cache (struct super_block *sb) {return 0 ; } +static inline int z_erofs_init_super (struct super_block *sb) {return 0 ; }#endif /* !CONFIG_EROFS_FS_ZIP */ #ifdef CONFIG_EROFS_FS_BACKED_BY_FILE
fs/erofs/super.c +22 -24
84 lines not on this page · raw message
fs/erofs/zdata.c +2 -2
@@ -644,18 +644,18 @@ static const struct address_space_operations z_erofs_cache_aops = { .invalidate_folio = z_erofs_cache_invalidate_folio, }; -int erofs_init_managed_cache (struct super_block *sb) +int z_erofs_init_super (struct super_block *sb) {struct inode *const inode =new_inode (sb);if (!inode)return -ENOMEM ; -set_nlink (inode,1 ); inode->i_size =OFFSET_MAX ; inode->i_mapping->a_ops = &z_erofs_cache_aops;mapping_set_gfp_mask (inode->i_mapping,GFP_KERNEL );EROFS_SB (sb)->managed_cache = inode; +xa_init (&EROFS_SB (sb)->managed_pslots);return 0 ; }
Signature · 1 line
2.43.5
PATCH 7/10 erofs: add encoded extent on-disk definition
In reply to Gao XiangPreviously, EROFS provided both (non-)compact compressed indexes to keep necessary hints for each logical block, enabling O(1) random indexing. This approach was originally designed for small compression units (e.g., 4KiB), where compressed data is strictly block-aligned via fixed-sized output compression.
However, EROFS now supports big pclusters up to 1MiB and many users use large configurations to minimize image sizes. For such configurations, the total number of extents decreases significantly (e.g., only 1,024 extents for a 1GiB file using 1MiB pclusters), then runtime metadata overhead becomes negligible compared to data I/O and decoding costs.
Additionally, some popular compression algorithm (mainly Zstd) still lacks native fixed-sized output compression support (although it's planned by their authors). Instead of just waiting for compressor improvements, let's adopt byte-oriented extents, allowing these compressors to retain their current methods.
For example, it speeds up Zstd compression a lot:
Processor: Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz * 96 Dataset: enwik9 Build time Size Type Command Line 3m52.339s 266653696 FO -C524288 -zzstd,22 3m48.549s 266174464 FO -E48bit -C524288 -zzstd,22 0m12.821s 272134144 FI -E48bit -C1048576 --max-extent-bytes=1048576 -zzstd,22
0m14.528s 248987648 FO -C1048576 -zlzma,9 0m14.605s 248504320 FO -E48bit -C1048576 -zlzma,9
Encoded extents are structured as an array of struct z_erofs_extent, sorted by logical address in ascending order:
__le32 plen // encoded length, algorithm id and flags __le32 pstart_lo // physical offset LSB __le32 pstart_hi // physical offset MSB __le32 lstart_lo // logical offset __le32 lstart_hi // logical offset MSB
..
Note that prefixed reduced records can be used to minimize metadata for specific cases (e.g. lstart less than 32 bits, then 32 to 16 bytes).
If the logical lengths of all encoded extents are the same, 4-byte (plen) and 8-byte (plen, pstart_lo) records can be used. Or, 16-byte (plen .. lstart_lo) and 32-byte full records have to be used instead.
If 16-byte and 32-byte records are used, the total number of extents is kept in struct z_erofs_map_header, and binary search can be applied on them. Note that eytzinger order is not considerd because data sequential access is important.
If 4-byte records are used, 8-byte start physical offset is between struct z_erofs_map_header and the plen array.
In addition, 64-bit physical offsets can be applied with new encoded extent format to match full 48-bit block addressing.
Remove redundant comments around struct z_erofs_lcluster_index too.
--- fs/erofs/erofs_fs.h | 99 +++++++++++++++++++++------------------------ fs/erofs/internal.h | 2 +- fs/erofs/zmap.c | 24 +++++------ 3 files changed, 58 insertions(+), 67 deletions(-)
fs/erofs/erofs_fs.h +45 -54
@@ -331,21 +331,20 @@ struct z_erofs_zstd_cfgs {#define Z_EROFS_ZSTD_MAX_DICT_SIZE Z_EROFS_PCLUSTER_MAX_SIZE/* -* bit 0 : COMPACTED_2B indexes (0 - off; 1 - on) -* e.g. for 4k logical cluster size, 4B if compacted 2B is off; -* (4B) + 2B + (4B) if compacted 2B is on. -* bit 1 : HEAD1 big pcluster (0 - off; 1 - on) -* bit 2 : HEAD2 big pcluster (0 - off; 1 - on) -* bit 3 : tailpacking inline pcluster (0 - off; 1 - on) -* bit 4 : interlaced plain pcluster (0 - off; 1 - on) -* bit 5 : fragment pcluster (0 - off; 1 - on) +* Enable COMPACTED_2B for EROFS_INODE_COMPRESSED_COMPACT inodes: +* 4B (disabled) vs 4B+2B+4B (enabled) */ #define Z_EROFS_ADVISE_COMPACTED_2B 0x0001 +/* Enable extent metadata for EROFS_INODE_COMPRESSED_FULL inodes */ +#define Z_EROFS_ADVISE_EXTENTS 0x0001#define Z_EROFS_ADVISE_BIG_PCLUSTER_1 0x0002#define Z_EROFS_ADVISE_BIG_PCLUSTER_2 0x0004#define Z_EROFS_ADVISE_INLINE_PCLUSTER 0x0008#define Z_EROFS_ADVISE_INTERLACED_PCLUSTER 0x0010#define Z_EROFS_ADVISE_FRAGMENT_PCLUSTER 0x0020 +/* Indicate the record size for each extent if extent metadata is used */ +#define Z_EROFS_ADVISE_EXTRECSZ_BIT 1 +#define Z_EROFS_ADVISE_EXTRECSZ_MASK 0x3#define Z_EROFS_FRAGMENT_INODE_BIT 7struct z_erofs_map_header {
@@ -357,45 +356,24 @@ struct z_erofs_map_header {/* indicates the encoded size of tailpacking data */ __le16 h_idata_size; }; +__le32 h_extents_lo;/* extent count LSB */ };__le16 h_advise; -/* -* bit 0-3 : algorithm type of head 1 (logical cluster type 01); -* bit 4-7 : algorithm type of head 2 (logical cluster type 11). -*/ -__u8 h_algorithmtype; -/* -* bit 0-2 : logical cluster bits - 12, e.g. 0 for 4096; -* bit 3-6 : reserved; -* bit 7 : move the whole file into packed inode or not. -*/ -__u8 h_clusterbits; +union { +struct { +/* algorithm type (bit 0-3: HEAD1; bit 4-7: HEAD2) */ +__u8 h_algorithmtype; +/* +* bit 0-3 : logical cluster bits - blkszbits +* bit 4-6 : reserved +* bit 7 : pack the whole file into packed inode +*/ +__u8 h_clusterbits; + }; +__le16 h_extents_hi;/* extent count MSB */ + }; }; -/* -* On-disk logical cluster type: -* 0 - literal (uncompressed) lcluster -* 1,3 - compressed lcluster (for HEAD lclusters) -* 2 - compressed lcluster (for NONHEAD lclusters) -* -* In detail, -* 0 - literal (uncompressed) lcluster, -* di_advise = 0 -* di_clusterofs = the literal data offset of the lcluster -* di_blkaddr = the blkaddr of the literal pcluster -* -* 1,3 - compressed lcluster (for HEAD lclusters) -* di_advise = 1 or 3 -* di_clusterofs = the decompressed data offset of the lcluster -* di_blkaddr = the blkaddr of the compressed pcluster -* -* 2 - compressed lcluster (for NONHEAD lclusters) -* di_advise = 2 -* di_clusterofs = -* the decompressed data offset in its own HEAD lcluster -* di_u.delta[0] = distance to this HEAD lcluster -* di_u.delta[1] = distance to the next HEAD lcluster -*/ enum {Z_EROFS_LCLUSTER_TYPE_PLAIN =0 ,Z_EROFS_LCLUSTER_TYPE_HEAD1 =1 ,
@@ -409,11 +387,7 @@ enum {/* (noncompact only, HEAD) This pcluster refers to partial decompressed data */ #define Z_EROFS_LI_PARTIAL_REF (1 << 15) -/* -* D0_CBLKCNT will be marked _only_ at the 1st non-head lcluster to store the -* compressed block count of a compressed extent (in logical clusters, aka. -* block count of a pcluster). -*/ +/* Set on 1st non-head lcluster to store compressed block counti (in blocks) */ #define Z_EROFS_LI_D0_CBLKCNT (1 << 11)struct z_erofs_lcluster_index {
@@ -422,19 +396,36 @@ struct z_erofs_lcluster_index {__le16 di_clusterofs;union { -/* for the HEAD lclusters */ -__le32 blkaddr; +__le32 blkaddr;/* for the HEAD lclusters */ /* -* for the NONHEAD lclusters * [0] - distance to its HEAD lcluster * [1] - distance to the next HEAD lcluster */ -__le16 delta[2 ]; +__le16 delta[2 ];/* for the NONHEAD lclusters */ } di_u; }; -#define Z_EROFS_FULL_INDEX_ALIGN (end) \ - (ALIGN(end, 8) + sizeof(struct z_erofs_map_header) + 8) +#define Z_EROFS_MAP_HEADER_END (end) \ + (ALIGN(end, 8) + sizeof(struct z_erofs_map_header)) +#define Z_EROFS_FULL_INDEX_START (end) (Z_EROFS_MAP_HEADER_END(end) + 8) + +#define Z_EROFS_EXTENT_PLEN_PARTIAL BIT(27) +#define Z_EROFS_EXTENT_PLEN_FMT_BIT 28 +#define Z_EROFS_EXTENT_PLEN_MASK ((Z_EROFS_PCLUSTER_MAX_SIZE << 1) - 1) +struct z_erofs_extent { +__le32 plen;/* encoded length */ +__le32 pstart_lo;/* physical offset */ +__le32 pstart_hi;/* physical offset MSB */ +__le32 lstart_lo;/* logical offset */ +__le32 lstart_hi;/* logical offset MSB (>= 4GiB inodes) */ +__u8 reserved[12 ];/* for future use */ +}; + +static inline int z_erofs_extent_recsize (unsigned int advise) +{ +return 4 << ((advise >>Z_EROFS_ADVISE_EXTRECSZ_BIT ) & +Z_EROFS_ADVISE_EXTRECSZ_MASK ); +}/* check the EROFS on-disk layout strictly at compile time */ static inline void erofs_check_ondisk_layout_definitions (void )
fs/erofs/internal.h +1 -1
@@ -262,7 +262,7 @@ struct erofs_inode {struct {unsigned short z_advise;unsigned char z_algorithmtype[2 ]; -unsigned char z_logical_clusterbits; +unsigned char z_lclusterbits;unsigned long z_tailextent_headlcn;erofs_off_t z_fragmentoff;unsigned short z_idata_size;
fs/erofs/zmap.c +12 -12
@@ -25,7 +25,7 @@ static int z_erofs_load_full_lcluster(struct z_erofs_maprecorder *m, {struct inode *const inode = m->inode;struct erofs_inode *const vi =EROFS_I (inode); -const erofs_off_t pos =Z_EROFS_FULL_INDEX_ALIGN (erofs_iloc (inode) + +const erofs_off_t pos =Z_EROFS_FULL_INDEX_START (erofs_iloc (inode) + vi->inode_isize + vi->xattr_isize) + lcn *sizeof (struct z_erofs_lcluster_index );struct z_erofs_lcluster_index *di;
@@ -40,7 +40,7 @@ static int z_erofs_load_full_lcluster(struct z_erofs_maprecorder *m, advise =le16_to_cpu (di->di_advise); m->type = advise &Z_EROFS_LI_LCLUSTER_TYPE_MASK ;if (m->type ==Z_EROFS_LCLUSTER_TYPE_NONHEAD ) { - m->clusterofs =1 << vi->z_logical_clusterbits; + m->clusterofs =1 << vi->z_lclusterbits; m->delta[0 ] =le16_to_cpu (di->di_u.delta[0 ]);if (m->delta[0 ] &Z_EROFS_LI_D0_CBLKCNT ) { if (!(vi->z_advise & (Z_EROFS_ADVISE_BIG_PCLUSTER_1 |
@@ -55,7 +55,7 @@ static int z_erofs_load_full_lcluster(struct z_erofs_maprecorder *m, }else { m->partialref = !!(advise &Z_EROFS_LI_PARTIAL_REF ); m->clusterofs =le16_to_cpu (di->di_clusterofs); -if (m->clusterofs >=1 << vi->z_logical_clusterbits) { +if (m->clusterofs >=1 << vi->z_lclusterbits) {DBG_BUGON (1 );return -EFSCORRUPTED ; }
@@ -102,9 +102,9 @@ static int z_erofs_load_compact_lcluster(struct z_erofs_maprecorder *m, {struct inode *const inode = m->inode;struct erofs_inode *const vi =EROFS_I (inode); -const erofs_off_t ebase =sizeof (struct z_erofs_map_header ) + -ALIGN (erofs_iloc (inode) + vi->inode_isize + vi->xattr_isize,8 ); -const unsigned int lclusterbits = vi->z_logical_clusterbits; +const erofs_off_t ebase =Z_EROFS_MAP_HEADER_END (erofs_iloc (inode) + + vi->inode_isize + vi->xattr_isize); +const unsigned int lclusterbits = vi->z_lclusterbits;const unsigned int totalidx =erofs_iblks (inode);unsigned int compacted_4b_initial, compacted_2b, amortizedshift;unsigned int vcnt, lo, lobits, encodebits, nblk, bytes;
@@ -255,7 +255,7 @@ static int z_erofs_extent_lookback(struct z_erofs_maprecorder *m, {struct super_block *sb = m->inode->i_sb;struct erofs_inode *const vi =EROFS_I (m->inode); -const unsigned int lclusterbits = vi->z_logical_clusterbits; +const unsigned int lclusterbits = vi->z_lclusterbits;while (m->lcn >= lookback_distance) {unsigned long lcn = m->lcn - lookback_distance;
@@ -304,7 +304,7 @@ static int z_erofs_get_extent_compressedlen(struct z_erofs_maprecorder *m,if ((m->headtype ==Z_EROFS_LCLUSTER_TYPE_HEAD1 && !bigpcl1) || ((m->headtype ==Z_EROFS_LCLUSTER_TYPE_PLAIN || m->headtype ==Z_EROFS_LCLUSTER_TYPE_HEAD2 ) && !bigpcl2) || - (lcn << vi->z_logical_clusterbits) >= inode->i_size) + (lcn << vi->z_lclusterbits) >= inode->i_size) m->compressedblks =1 ;if (m->compressedblks)
@@ -354,7 +354,7 @@ static int z_erofs_get_extent_decompressedlen(struct z_erofs_maprecorder *m)struct inode *inode = m->inode;struct erofs_inode *vi =EROFS_I (inode);struct erofs_map_blocks *map = m->map; -unsigned int lclusterbits = vi->z_logical_clusterbits; +unsigned int lclusterbits = vi->z_lclusterbits;u64 lcn = m->lcn, headlcn = map->m_la >> lclusterbits;int err;
@@ -398,16 +398,16 @@ static int z_erofs_do_map_blocks(struct inode *inode,struct super_block *sb = inode->i_sb;bool fragment = vi->z_advise &Z_EROFS_ADVISE_FRAGMENT_PCLUSTER ;bool ztailpacking = vi->z_idata_size; +unsigned int lclusterbits = vi->z_lclusterbits;struct z_erofs_maprecorder m = { .inode = inode, .map = map, };int err =0 ; -unsigned int lclusterbits, endoff, afmt; +unsigned int endoff, afmt;unsigned long initial_lcn;unsigned long long ofs, end; - lclusterbits = vi->z_logical_clusterbits; ofs = flags &EROFS_GET_BLOCKS_FINDTAIL ? inode->i_size -1 : map->m_la; initial_lcn = ofs >> lclusterbits; endoff = ofs & ((1 << lclusterbits) -1 );
@@ -569,6 +569,7 @@ static int z_erofs_fill_inode_lazy(struct inode *inode) goto done; } vi->z_advise =le16_to_cpu (h->h_advise); + vi->z_lclusterbits = sb->s_blocksize_bits + (h->h_clusterbits &15 ); vi->z_algorithmtype[0 ] = h->h_algorithmtype &15 ; vi->z_algorithmtype[1 ] = h->h_algorithmtype >>4 ;if (vi->z_advise &Z_EROFS_ADVISE_FRAGMENT_PCLUSTER )
@@ -585,7 +586,6 @@ static int z_erofs_fill_inode_lazy(struct inode *inode) goto out_put_metabuf; } - vi->z_logical_clusterbits = sb->s_blocksize_bits + (h->h_clusterbits &7 );if (!erofs_sb_has_big_pcluster (EROFS_SB (sb)) && vi->z_advise & (Z_EROFS_ADVISE_BIG_PCLUSTER_1 |Z_EROFS_ADVISE_BIG_PCLUSTER_2 )) {
Signature · 1 line
2.43.5
PATCH 8/10 erofs: implement encoded extent metadata
In reply to Gao XiangImplement the extent metadata parsing described in the previous commit. For 16-byte and 32-byte extent records, currently it is just a trivial binary search without considering the last access footprint, but it can be optimized for better sequential performance later.
Tail fragments are supported, but ztailpacking feature is not for simplicity.
--- fs/erofs/internal.h | 5 +- fs/erofs/zmap.c | 142 ++++++++++++++++++++++++++++++++++++++++---- 2 files changed, 135 insertions(+), 12 deletions(-)
fs/erofs/internal.h +4 -1
@@ -263,7 +263,10 @@ struct erofs_inode {unsigned short z_advise;unsigned char z_algorithmtype[2 ];unsigned char z_lclusterbits; -unsigned long z_tailextent_headlcn; +union { +u64 z_tailextent_headlcn; +u64 z_extents; + };erofs_off_t z_fragmentoff;unsigned short z_idata_size; };
fs/erofs/zmap.c +131 -11
178 lines not on this page · raw message
Signature · 1 line
2.43.5
PATCH 9/10 erofs: support unaligned encoded data
In reply to Gao XiangWe're almost there. It's straight-forward to adapt the current decompression subsystem to support unaligned encoded (compressed) data.
Note that unaligned data is not encouraged because of worse I/O and caching efficiency unless the corresponding compressor doesn't support fixed-sized output compression natively like Zstd.
--- fs/erofs/decompressor.c | 2 +- fs/erofs/zdata.c | 92 ++++++++++++++++++++--------------------- 2 files changed, 46 insertions(+), 48 deletions(-)
fs/erofs/decompressor.c +1 -1
@@ -313,7 +313,7 @@ static int z_erofs_transform_plain(struct z_erofs_decompress_req *rq, rq->outputsize -= cur; } -for (; rq->outputsize; rq->pageofs_in =0 , cur +=PAGE_SIZE , ni++) { +for (; rq->outputsize; rq->pageofs_in =0 , cur += insz, ni++) { insz =min (PAGE_SIZE - rq->pageofs_in, rq->outputsize); rq->outputsize -= insz;if (!rq->in[ni])
fs/erofs/zdata.c +45 -47
247 lines not on this page · raw message
Signature · 1 line
2.43.5
PATCH 10/10 erofs: enable 48-bit layout support
In reply to Gao XiangBoth 48-bit block addressing and encoded extents are implemented, let's enable them formally.
--- fs/erofs/Kconfig | 14 +++++++------- fs/erofs/erofs_fs.h | 2 +- fs/erofs/super.c | 2 ++ 3 files changed, 10 insertions(+), 8 deletions(-)
fs/erofs/Kconfig +7 -7
@@ -13,12 +13,12 @@ config EROFS_FS smartphones with Android OS, LiveCDs and high-density hosts with numerous containers; - It also provides fixed-sized output compression support in order to - improve storage density as well as keep relatively higher compression - ratios and implements in-place decompression to reuse the file page - for compressed data temporarily with proper strategies, which is - quite useful to ensure guaranteed end-to-end runtime decompression - performance under extremely memory pressure without extra cost. + It also provides transparent compression and deduplication support to + improve storage density and maintain relatively high compression + ratios, and it implements in-place decompression to temporarily reuse + page cache for compressed data using proper strategies, which is + quite useful for ensuring guaranteed end-to-end runtime decompression + performance under extreme memory pressure without extra cost. See the documentation at <file:Documentation/filesystems/erofs.rst> and the web pages at <https://erofs.docs.kernel.org> for more details.
@@ -97,7 +97,7 @@ config EROFS_FS_ZIP select LZ4_DECOMPRESS default y help - Enable fixed-sized output compression for EROFS. + Enable transparent compression support for EROFS file systems. If you don't want to enable compression feature, say N.
fs/erofs/erofs_fs.h +1 -1
@@ -32,7 +32,7 @@#define EROFS_FEATURE_INCOMPAT_XATTR_PREFIXES 0x00000040#define EROFS_FEATURE_INCOMPAT_48BIT 0x00000080#define EROFS_ALL_FEATURE_INCOMPAT \ - ((EROFS_FEATURE_INCOMPAT_XATTR_PREFIXES << 1) - 1) + ((EROFS_FEATURE_INCOMPAT_48BIT << 1) - 1)#define EROFS_SB_EXTSLOT_SIZE 16
fs/erofs/super.c +2 -0
@@ -330,6 +330,8 @@ static int erofs_read_superblock(struct super_block *sb)/* handle multiple devices */ ret =erofs_scan_devices (sb, dsb); +if (erofs_sb_has_48bit (sbi)) +erofs_info (sb,"EXPERIMENTAL 48-bit layout support in use. Use at your own risk!" );if (erofs_is_fscache_mode (sb))erofs_info (sb,"[deprecated] fscache-based on-demand read feature in use. Use at your own risk!" ); out:
Signature · 1 line
2.43.5
Quoted 31 lines · Gao Xiang
Hi folks,
The current 32-bit block addressing limits EROFS to a 16TiB maximum volume size with 4KiB blocks. However, several new use cases now require larger capacity support:
- Massive datasets for model training to boost random samplingperformance for each epoch;- Object storage clients using EROFS direct passthrough.
This extends core on-disk structures to support 48-bit block addressing, such as inodes, device slots, and inode chunks.
In addition, it introduces an mtime field to 32-byte compact inodes for basic timestamp support, as well as expands the superblock root NID to an 8-byte
rootnid_8bfor out-of-place update incremental builds.In order to support larger images beyond 32-bit block addressing and efficient indexing of large compression units for compressed data, and to better support popular compression algorithms (mainly Zstd) that still lack native fixed-sized output compression support, introduce byte-oriented encoded extents, so that these compressors are allowed to retain their current methods.
Therefore, it speeds up Zstd image building a lot by using:
Processor: Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz * 96
Dataset: enwik9
Build time Size Type Command Line
3m52.339s 266653696 FO -C524288 -zzstd,22
3m48.549s 266174464 FO -E48bit -C524288 -zzstd,22
0m12.821s 272134144 FI -E48bit -C1048576 --max-extent-bytes=1048576 -zzstd,22
Quoted 2 lines
It has been stress-tested on my local setup for a while without any strange happens.
Cool, good work! For this serial,
Hoping to grab continuous free slots to check the details, then we can change it to rvb status before merge window. :)
Thanks,
Quoted 30 lines
Thanks,
Gao XiangGao Xiang (10):
erofs: get rid oferofs_map_blocks_flatmode()
erofs: simplify erofs_{read,fill}_inode()
erofs: add 48-bit block addressing on-disk support
erofs: implement 48-bit block addressing for unencoded inodes
erofs: support dot-omitted directories
erofs: initialize decompression early
erofs: add encoded extent on-disk definition
erofs: implement encoded extent metadata
erofs: support unaligned encoded data
erofs: enable 48-bit layout supportfs/erofs/Kconfig | 14 +-- fs/erofs/data.c | 133 +++++++++++------------- fs/erofs/decompressor.c | 2 +- fs/erofs/dir.c | 7 +- fs/erofs/erofs_fs.h | 191 ++++++++++++++++------------------- fs/erofs/inode.c | 126 +++++++++++------------ fs/erofs/internal.h | 30 +++--- fs/erofs/super.c | 49 ++++----- fs/erofs/sysfs.c | 2 + fs/erofs/zdata.c | 96 +++++++++--------- fs/erofs/zmap.c | 166 +++++++++++++++++++++++++----- include/trace/events/erofs.h | 2 +- 12 files changed, 455 insertions(+), 363 deletions(-)
Quoted 35 lines · Chao Yu
Quoted 31 lines · Gao Xiang
Hi folks,
The current 32-bit block addressing limits EROFS to a 16TiB maximum volume size with 4KiB blocks. However, several new use cases now require larger capacity support:
- Massive datasets for model training to boost random sampling performance for each epoch;
- Object storage clients using EROFS direct passthrough.This extends core on-disk structures to support 48-bit block addressing, such as inodes, device slots, and inode chunks.
In addition, it introduces an mtime field to 32-byte compact inodes for basic timestamp support, as well as expands the superblock root NID to an 8-byte
rootnid_8bfor out-of-place update incremental builds.In order to support larger images beyond 32-bit block addressing and efficient indexing of large compression units for compressed data, and to better support popular compression algorithms (mainly Zstd) that still lack native fixed-sized output compression support, introduce byte-oriented encoded extents, so that these compressors are allowed to retain their current methods.
Therefore, it speeds up Zstd image building a lot by using:
Processor: Intel(R) Xeon(R) Platinum 8163 CPU @ 2.50GHz * 96
Dataset: enwik9
Build time Size Type Command Line
3m52.339s 266653696 FO -C524288 -zzstd,22
3m48.549s 266174464 FO -E48bit -C524288 -zzstd,22
0m12.821s 272134144 FI -E48bit -C1048576 --max-extent-bytes=1048576 -zzstd,22Quoted 2 lines
It has been stress-tested on my local setup for a while without any strange happens.
Quoted 6 lines
Cool, good work! For this serial,
Acked-by Chao Yu <[email protected]>Hoping to grab continuous free slots to check the details, then we can change it to rvb status before merge window. :)
Thanks, I don't find any issue so far and users would like to get 48-bit addressing and quick Zstd compression. It's not a complex update anyway.
Thanks,
Gao Xiang