minix: convert to iomap and add direct I/O
v2 cover minix: convert to iomap and add direct I/O
This is v2 of the minix iomap conversion series. The original v1 submission (3 patches) was tested by syzbot, which found four issues. Three were straightforward; the fourth, a null pointer dereference in page_symlink when creating symlinks, required more substantial changes.
The original description follows:
This series converts the minix filesystem from the buffer_head-based I/O path to the iomap API, and adds direct I/O support in the process.
The conversion is straightforward: minix's indirect block tree mapping logic (from itree_common.c) is reworked into an iomap_begin/iomap_end implementation. The iomap_end callback is a no-op since minix has no extents or transactions to finalize.
Patch 1 adds the iomap infrastructure: the new iomap.c file, wrapper functions and iomap_ops structs in itree_v1.c and itree_v2.c, and the relevant declarations in minix.h.
The iomap.c file is #include'd into itree_v1.c and itree_v2.c rather than compiled as a standalone translation unit. This is because the minix filesystem versions (V1 vs V2/V3) have different block_t sizes (16-bit vs 32-bit) and different indirect tree depths. This follows the existing pattern in minix where itree_common.c is included into both itree_v1.c and itree_v2.c. Each version provides a thin wrapper and a corresponding iomap_ops struct.
Patch 2 converts the regular file address space operations to iomap:read_folio, readahead, writepages (with a writeback callback), bmap, and folio lifecycle helpers. Directory inodes continue to use buffer_head-based operations via a new minix_dir_aops, since directory handling still relies on buffer head chunks for prepare/write_begin.
Patch 3 converts the file_operations: replacing the generic read/write iterators with iomap-aware versions, adding direct I/O read/write paths using iomap_dio_rw, and setting FMODE_CAN_ODIRECT in the open handler.
The minix iomap implementation was adapted from the out-of-tree xiafs iomap conversion. The xiafs module itself borrowed heavily from the modernized minix kernel module. The exfat iomap changes were an additional reference for both conversions.
Changes since v1:
* Added a fourth patch to fix the symlink and truncate issues:
- Replaced page_symlink with a custom __page_symlink that writes the target directly to a data block via minix_new_block + sb_getblk, bypassing the aops write path (which no longer has write_begin/write_end). Added a matching custom minix_get_link that reads the target from the data block via sb_bread, similar to ext4_get_link. No iomap-based filesystem in the kernel uses page_symlink; XFS, GFS2, and ext4 all handle symlink storage directly. The on-disk format is unchanged.
- Fixed a buffer_head/iomap type confusion in truncate:
block_truncate_page attaches buffer_heads to data folios, but minix_aops now uses iomap which interprets folio->private as struct iomap_folio_state. truncate() now dispatches between iomap_truncate_page (for regular files/symlinks) and block_truncate_page (for directories) based on the inode's aops.
- Added .setattr = minix_setattr to minix_symlink_inode_operations so symlinks truncate properly through the iomap path.
* Patch 1 (iomap infrastructure): minix_get_block is now exported (non-static) so the directory aops and iomap writeback path can use it. Added minix_iomap_ops_ver() inline helper and extern declarations for minix_aops and the version-specific iomap_ops. Fixed unsigned -> unsigned int in minix_blocks_needed and minix_find_first_zero_bit to silence checkpatch warnings.
* Patch 2 (aops conversion): unchanged in approach; minor cleanup of the writeback callback and minix_bmap conversion.
* Patch 3 (file operations): minix_setattr is now exported for reuse by the symlink inode operations in patch 4.
Testing: the full series has been tested with mkfs.minix V1/V2/V3, exercising file creation, read/write, overwrite, append, binary data, directories, symlinks (full path, relative, directory symlinks), hard links, truncation (shrink/grow), large files (1MB, exercising indirect blocks), deep nesting (20 levels), 100 files in one directory, deletions, remount persistence, and fsck.minix. All pass cleanly. The four syzbot-reported issues are resolved.
Jeremy Bingham (4):
minix: add iomap infrastructure
minix: convert address space operations to iomap
minix: convert file operations to iomap and add direct I/O
minix: fix symlilnk and truncate for iomap compatibility
fs/minix/file.c | 157 ++++++++++++++++++++++++++++++++++++++-- fs/minix/inode.c | 90 ++++++++++++++++++++--- fs/minix/iomap.c | 114 +++++++++++++++++++++++++++++ fs/minix/itree_common.c | 11 ++- fs/minix/itree_v1.c | 25 ++++++- fs/minix/itree_v2.c | 17 ++++- fs/minix/minix.h | 30 +++++++- fs/minix/namei.c | 137 ++++++++++++++++++++++++++++++++++- 8 files changed, 558 insertions(+), 23 deletions(-) create mode 100644 fs/minix/iomap.c
Signature · 1 line
2.47.3
PATCH v2 1/4 minix: add iomap infrastructure
Add an iomap implementation for minix, adapted from the out-of-tree xiafs module's iomap code. The xiafs module, in turn, borrowed heavily from minix's own code.
The iomap_begin function replaces get_block for the iomap path:
it walks the indirect block tree, allocates blocks when needed, and returns the mapping in a struct iomap. The iomap_end function is a nop since minix has no extents or transactions to finalize.
Because minix has two filesystem versions (V1 with 16-bit block numbers, V2/V3 with 32-bit) that share itree_common.c via #include, the iomap.c file follows the same pattern. It is #included into itree_v1.c and itree_v2.c so it can use the version-specific block_t, block_to_cpu, and cpu_to_block definitions directly.
Each version gets its own iomap_ops struct (V1_minix_iomap_ops, V2_minix_iomap_ops) with thin wrappers around the shared minix_iomap_begin/minix_iomap_end. A minix_iomap_ops_ver() helper selects the correct ops based on the filesystem version.
minix_get_block is exported from inode.c for use by the iomap writeback path and the directory aops that still use buffer_heads.
--- fs/minix/iomap.c | 114 ++++++++++++++++++++++++++++++++++++++++++++ fs/minix/itree_v1.c | 25 +++++++++- fs/minix/itree_v2.c | 17 ++++++- fs/minix/minix.h | 23 ++++++++- 4 files changed, 175 insertions(+), 4 deletions(-) create mode 100644 fs/minix/iomap.c
fs/minix/iomap.c new file +114 -0
@@ -0,0 +1,114 @@ +// SPDX-License-Identifier: GPL-2.0-only +/* +* iomap functions for minix. At least the first pass of this file was taken +* from the xiafs iomap.c, which is fitting since the xiafs module in turn +* borrowed heavily from the modernized minix fs kernel module. +*/ + +/* +* minix_iomap_begin - map a file range to disk blocks. It acts as a replacement +* for get_block in itree_common.c, at least in the important ways, and is +* adapted from it, but it uses iomap instead of buffer_head. This is taken +* directly from the out-of-tree xiafs iomap changes, and the exfat iomap +* changes were an inspiration for that. +*/ +static int minix_iomap_begin (struct inode *inode,loff_t offset,loff_t length, +unsigned int flags,struct iomap *iomap,struct iomap *srcmap) +{ +struct super_block *sb = inode->i_sb; +unsigned int blkbits = sb->s_blocksize_bits; +sector_t iblock = offset >> blkbits; +int create = flags &IOMAP_WRITE ; + +/* Mostly taken from modern-xiafs itree.c get_block with elements from +* similar exfat operations. +*/ +int offsets[DEPTH ]; +Indirect chain[DEPTH ]; +Indirect *partial; +int depth =block_to_path (inode, iblock, offsets); +int left; +int err = -EIO ; + +sector_t phys; + +/* block is beyond max file size */ +if (depth ==0 ) + goto out; + + iomap->bdev = inode->i_sb->s_bdev; + +reread: + partial =get_branch (inode, depth, offsets, chain, &err); + +/* Simplest case - block found, no allocation needed */ +if (!partial) { +/* Bit of a weird order, but it'll make sense when you get to +* the bottom. +*/ + iomap->flags =IOMAP_F_MERGED ; +got_it: + phys =block_to_cpu (chain[depth -1 ].key); + partial = chain+depth-1 ; +/* Set up the iomap struct before cleaning up */ + iomap->type =IOMAP_MAPPED ; + iomap->addr = (u64 )phys << blkbits; + iomap->length =1 << blkbits; + iomap->offset = (u64 )iblock << blkbits; + goto cleanup; + } + +/* Next simple case - plain lookup or failed read of indirect block */ +if (!create || err == -EIO ) { + iomap->type =IOMAP_HOLE ; + iomap->addr =IOMAP_NULL_ADDR ; + iomap->length =1 << blkbits; + iomap->offset = (u64 )iblock << blkbits; + iomap->flags =0 ; +cleanup: +while (partial > chain) { +brelse (partial->bh); + partial--; + } +out: +return err; + } + +/* +* Indirect block might be removed by truncate while we were +* reading it. Handling of that case (forget what we've got and +* reread) is taken out of the main path. +*/ +if (err == -EAGAIN ) + goto changed; + + left = (chain + depth) - partial; + err =alloc_branch (inode, left, offsets + (partial - chain), partial); +if (err) + goto cleanup; + +if (splice_branch (inode, chain, partial, left) <0 ) + goto changed; + +/* Successful allocation, mapping it. */ + iomap->flags =IOMAP_F_NEW ; + goto got_it; + +changed: +while (partial > chain) { +brelse (partial->bh); + partial--; + } + goto reread; +} + +/* +* minix_iomap_end ends up being a nop; since minix doesn't have any extents or +* transactions to worry about, there isn't anything to update here. The on-disk +* indirect blocks get dirtied in minix_iomap_begin. +*/ +static int minix_iomap_end (struct inode *inode,loff_t offset,loff_t length, +ssize_t written,unsigned int flags,struct iomap *iomap) +{ +return 0 ; +}
fs/minix/itree_v1.c +24 -1
@@ -49,6 +49,18 @@ static int block_to_path(struct inode * inode, long block, int offsets[DEPTH]) }#include "itree_common.c" +/* NOTA BENE: +* +* This is icky to me, but at the same time having it be a standalone C file +* that's compiled to object form and linked separately like it is in xiafs is +* much nastier in minix because of the different versions of the minix fs that +* have some very, very different aspects, like the size of block_t. I don't +* like it, but since minix already has this pattern where a common itree file +* is included in the itree_v1 and itree_v2(and v3) files, I'm including iomap.c +* in these files as well. It does at least avoid exporting some currently +* static functions that aren't needed anywhere but itree_common.c and iomap.c. +*/ +#include "iomap.c" int V1_minix_get_block (struct inode * inode,long block,struct buffer_head *bh_result,int create)
@@ -61,7 +73,18 @@ void V1_minix_truncate(struct inode * inode)truncate (inode); } -unsigned V1_minix_blocks (loff_t size,struct super_block *sb) +unsigned int V1_minix_blocks (loff_t size,struct super_block *sb) {return nblocks (size, sb); } + +int V1_minix_iomap_begin (struct inode *inode,loff_t offset,loff_t length, +unsigned int flags,struct iomap *iomap,struct iomap *srcmap) +{ +return minix_iomap_begin (inode, offset, length, flags, iomap, srcmap); +} + +const struct iomap_ops V1_minix_iomap_ops = { + .iomap_begin = V1_minix_iomap_begin, + .iomap_end = minix_iomap_end, +};
fs/minix/itree_v2.c +16 -1
@@ -57,6 +57,10 @@ static int block_to_path(struct inode * inode, long block, int offsets[DEPTH]) }#include "itree_common.c" +/* See the note in itree_v1 in a comment that starts "NOTA BENE" for an +* explanation for why iomap.c is included here. +*/ +#include "iomap.c" int V2_minix_get_block (struct inode * inode,long block,struct buffer_head *bh_result,int create)
@@ -69,7 +73,18 @@ void V2_minix_truncate(struct inode * inode)truncate (inode); } -unsigned V2_minix_blocks (loff_t size,struct super_block *sb) +unsigned int V2_minix_blocks (loff_t size,struct super_block *sb) {return nblocks (size, sb); } + +int V2_minix_iomap_begin (struct inode *inode,loff_t offset,loff_t length, +unsigned int flags,struct iomap *iomap,struct iomap *srcmap) +{ +return minix_iomap_begin (inode, offset, length, flags, iomap, srcmap); +} + +const struct iomap_ops V2_minix_iomap_ops = { + .iomap_begin = V2_minix_iomap_begin, + .iomap_end = minix_iomap_end, +};
fs/minix/minix.h +21 -2
@@ -5,6 +5,7 @@#include <linux/fs.h> #include <linux/pagemap.h> #include <linux/minix_fs.h> +#include <linux/iomap.h> #define INODE_VERSION (inode) minix_sb(inode->i_sb)->s_version#define MINIX_V1 0x0001/* original minix fs */
@@ -69,6 +70,8 @@ extern int V1_minix_get_block(struct inode *, long, struct buffer_head *, int);extern int V2_minix_get_block (struct inode *,long ,struct buffer_head *,int );extern unsigned V1_minix_blocks (loff_t ,struct super_block *);extern unsigned V2_minix_blocks (loff_t ,struct super_block *); +extern int minix_get_block (struct inode *inode,sector_t block, +struct buffer_head *bh_result,int create);struct minix_dir_entry *minix_find_entry (struct dentry *,struct folio **);int minix_add_link (struct dentry *,struct inode *);
@@ -80,10 +83,20 @@ int minix_set_link(struct minix_dir_entry *de, struct folio *folio,struct minix_dir_entry *minix_dotdot (struct inode *,struct folio **);ino_t minix_inode_by_name (struct dentry *); +extern int V1_minix_iomap_begin (struct inode *inode,loff_t offset, +loff_t length,unsigned int flags,struct iomap *iomap, +struct iomap *srcmap); +extern int V2_minix_iomap_begin (struct inode *inode,loff_t offset, +loff_t length,unsigned int flags,struct iomap *iomap, +struct iomap *srcmap); + +extern const struct address_space_operations minix_aops;extern const struct inode_operations minix_file_inode_operations;extern const struct inode_operations minix_dir_inode_operations;extern const struct file_operations minix_file_operations;extern const struct file_operations minix_dir_operations; +extern const struct iomap_ops V1_minix_iomap_ops; +extern const struct iomap_ops V2_minix_iomap_ops;static inline struct minix_sb_info *minix_sb (struct super_block *sb) {
@@ -95,11 +108,17 @@ static inline struct minix_inode_info *minix_i(struct inode *inode) return container_of(inode, struct minix_inode_info, vfs_inode); } -static inline unsigned minix_blocks_needed (unsigned bits,unsigned blocksize) +static inline unsigned int minix_blocks_needed (unsigned int bits,unsigned int blocksize) {return DIV_ROUND_UP (bits, blocksize *8 ); } +static inline const struct iomap_ops *minix_iomap_ops_ver (struct inode *inode) +{ +return (INODE_VERSION (inode) ==MINIX_V1 ) ? + &V1_minix_iomap_ops : &V2_minix_iomap_ops; +} +#if defined(CONFIG_MINIX_FS_NATIVE_ENDIAN ) && \ defined(CONFIG_MINIX_FS_BIG_ENDIAN_16BIT_INDEXED )
@@ -129,7 +148,7 @@ static inline unsigned minix_blocks_needed(unsigned bits, unsigned blocksize)* big-endian 16bit indexed bitmaps */ -static inline int minix_find_first_zero_bit (const void *vaddr,unsigned size) +static inline int minix_find_first_zero_bit (const void *vaddr,unsigned int size) {const unsigned short *p = vaddr, *addr = vaddr;unsigned short num;
Signature · 1 line
2.47.3
Re: [PATCH v2 1/4] minix: add iomap infrastructure
Quoted 38 lines · Jeremy Bingham
Add an iomap implementation for minix, adapted from the out-of-tree xiafs module's iomap code. The xiafs module, in turn, borrowed heavily from minix's own code.
The
iomap_beginfunction replacesget_blockfor the iomap path:
it walks the indirect block tree, allocates blocks when needed, and returns the mapping in a struct iomap. Theiomap_endfunction is a nop since minix has no extents or transactions to finalize.Because minix has two filesystem versions (V1 with 16-bit block numbers, V2/V3 with 32-bit) that share
itree_common.cvia #include, theiomap.cfile follows the same pattern. It is #included intoitree_v1.canditree_v2.cso it can use the version-specificblock_t,block_to_cpu, andcpu_to_blockdefinitions directly.Each version gets its own
iomap_opsstruct (V1_minix_iomap_ops,V2_minix_iomap_ops) with thin wrappers around the shared minix_iomap_begin/minix_iomap_end. Aminix_iomap_ops_ver()helper selects the correct ops based on the filesystem version.
minix_get_blockis exported frominode.cfor use by the iomap writeback path and the directory aops that still usebuffer_heads.Signed-off-by Jeremy Bingham <[email protected]>--- fs/minix/iomap.c | 114 ++++++++++++++++++++++++++++++++++++++++++++ fs/minix/itree_v1.c | 25 +++++++++- fs/minix/itree_v2.c | 17 ++++++- fs/minix/minix.h | 23 ++++++++- 4 files changed, 175 insertions(+), 4 deletions(-) create mode 100644 fs/minix/iomap.cfs/minix/iomap.c new file +0
-0
fs/minix/iomap.c line 5
Quoted 5 lines
fs/minix/iomap.c new file +5
-0@@ -0,0 +1,114 @@ +// SPDX-License-Identifier: GPL-2.0-only +/* +* iomap functions for minix. At least the first pass of this file was taken +* from the xiafs iomap.c, which is fitting since the xiafs module in turn +* borrowed heavily from the modernized minix fs kernel module.
Is this the "modernized" minix fs kernel module??
xiafs hasn't been in the kernel for years; I see little point in mentioning an externally maintained driver inside the kernel source.
Quoted 57 lines
fs/minix/iomap.c new file +57
-0+*/ + +/* +* minix_iomap_begin - map a file range to disk blocks. It acts as a replacement +* for get_block in itree_common.c, at least in the important ways, and is +* adapted from it, but it uses iomap instead of buffer_head. This is taken +* directly from the out-of-tree xiafs iomap changes, and the exfat iomap +* changes were an inspiration for that. +*/ +static int minix_iomap_begin (struct inode *inode,loff_t offset,loff_t length, +unsigned int flags,struct iomap *iomap,struct iomap *srcmap) +{ +struct super_block *sb = inode->i_sb; +unsigned int blkbits = sb->s_blocksize_bits; +sector_t iblock = offset >> blkbits; +int create = flags &IOMAP_WRITE ; + +/* Mostly taken from modern-xiafs itree.c get_block with elements from +* similar exfat operations. +*/ +int offsets[DEPTH ]; +Indirect chain[DEPTH ]; +Indirect *partial; +int depth =block_to_path (inode, iblock, offsets); +int left; +int err = -EIO ; + +sector_t phys; + +/* block is beyond max file size */ +if (depth ==0 ) + goto out; + + iomap->bdev = inode->i_sb->s_bdev; + +reread: + partial =get_branch (inode, depth, offsets, chain, &err); + +/* Simplest case - block found, no allocation needed */ +if (!partial) { +/* Bit of a weird order, but it'll make sense when you get to +* the bottom. +*/ + iomap->flags =IOMAP_F_MERGED ; +got_it: + phys =block_to_cpu (chain[depth -1 ].key); + partial = chain+depth-1 ; +/* Set up the iomap struct before cleaning up */ + iomap->type =IOMAP_MAPPED ; + iomap->addr = (u64 )phys << blkbits; + iomap->length =1 << blkbits; + iomap->offset = (u64 )iblock << blkbits; + goto cleanup; + } + +/* Next simple case - plain lookup or failed read of indirect block */ +if (!create || err == -EIO ) {
fs/minix/iomap.c line 72
Quoted 10 lines
fs/minix/iomap.c new file +10
-0+ iomap->type =IOMAP_HOLE ; + iomap->addr =IOMAP_NULL_ADDR ; + iomap->length =1 << blkbits; + iomap->offset = (u64 )iblock << blkbits; + iomap->flags =0 ; +cleanup: +while (partial > chain) { +brelse (partial->bh); + partial--; + }
Uhhh ... these three ought to be factored out into separate helpers to
(a) clean up @chain, (b) set up a IOMAP_MAPPED mapping, and (c) set up a IOMAP_HOLE mapping. Don't write a pile of spaghetti goes.
Also kinda surprised that you set IOMAP_F_MERGED but don't try to look forward to find adjacent blocks?
fs/minix/iomap.c line 80
Quoted 8 lines
fs/minix/iomap.c new file +8
-0+out: +return err; + } + +/* +* Indirect block might be removed by truncate while we were +* reading it. Handling of that case (forget what we've got and +* reread) is taken out of the main path.
/me wonders how we'd be racing with setattr?
--D
Quoted 186 lines
fs/minix/iomap.c new file +34
-0+*/ +if (err == -EAGAIN ) + goto changed; + + left = (chain + depth) - partial; + err =alloc_branch (inode, left, offsets + (partial - chain), partial); +if (err) + goto cleanup; + +if (splice_branch (inode, chain, partial, left) <0 ) + goto changed; + +/* Successful allocation, mapping it. */ + iomap->flags =IOMAP_F_NEW ; + goto got_it; + +changed: +while (partial > chain) { +brelse (partial->bh); + partial--; + } + goto reread; +} + +/* +* minix_iomap_end ends up being a nop; since minix doesn't have any extents or +* transactions to worry about, there isn't anything to update here. The on-disk +* indirect blocks get dirtied in minix_iomap_begin. +*/ +static int minix_iomap_end (struct inode *inode,loff_t offset,loff_t length, +ssize_t written,unsigned int flags,struct iomap *iomap) +{ +return 0 ; +}fs/minix/itree_v1.c +24
-1@@ -49,6 +49,18 @@ static int block_to_path(struct inode * inode, long block, int offsets[DEPTH]) }#include "itree_common.c" +/* NOTA BENE: +* +* This is icky to me, but at the same time having it be a standalone C file +* that's compiled to object form and linked separately like it is in xiafs is +* much nastier in minix because of the different versions of the minix fs that +* have some very, very different aspects, like the size of block_t. I don't +* like it, but since minix already has this pattern where a common itree file +* is included in the itree_v1 and itree_v2(and v3) files, I'm including iomap.c +* in these files as well. It does at least avoid exporting some currently +* static functions that aren't needed anywhere but itree_common.c and iomap.c. +*/ +#include "iomap.c" int V1_minix_get_block (struct inode * inode,long block,struct buffer_head *bh_result,int create)@@ -61,7 +73,18 @@ void V1_minix_truncate(struct inode * inode)truncate (inode); } -unsigned V1_minix_blocks (loff_t size,struct super_block *sb) +unsigned int V1_minix_blocks (loff_t size,struct super_block *sb) {return nblocks (size, sb); } + +int V1_minix_iomap_begin (struct inode *inode,loff_t offset,loff_t length, +unsigned int flags,struct iomap *iomap,struct iomap *srcmap) +{ +return minix_iomap_begin (inode, offset, length, flags, iomap, srcmap); +} + +const struct iomap_ops V1_minix_iomap_ops = { + .iomap_begin = V1_minix_iomap_begin, + .iomap_end = minix_iomap_end, +};fs/minix/itree_v2.c +16
-1@@ -57,6 +57,10 @@ static int block_to_path(struct inode * inode, long block, int offsets[DEPTH]) }#include "itree_common.c" +/* See the note in itree_v1 in a comment that starts "NOTA BENE" for an +* explanation for why iomap.c is included here. +*/ +#include "iomap.c" int V2_minix_get_block (struct inode * inode,long block,struct buffer_head *bh_result,int create)@@ -69,7 +73,18 @@ void V2_minix_truncate(struct inode * inode)truncate (inode); } -unsigned V2_minix_blocks (loff_t size,struct super_block *sb) +unsigned int V2_minix_blocks (loff_t size,struct super_block *sb) {return nblocks (size, sb); } + +int V2_minix_iomap_begin (struct inode *inode,loff_t offset,loff_t length, +unsigned int flags,struct iomap *iomap,struct iomap *srcmap) +{ +return minix_iomap_begin (inode, offset, length, flags, iomap, srcmap); +} + +const struct iomap_ops V2_minix_iomap_ops = { + .iomap_begin = V2_minix_iomap_begin, + .iomap_end = minix_iomap_end, +};fs/minix/minix.h +21
-2@@ -5,6 +5,7 @@#include <linux/fs.h> #include <linux/pagemap.h> #include <linux/minix_fs.h> +#include <linux/iomap.h> #define INODE_VERSION (inode) minix_sb(inode->i_sb)->s_version#define MINIX_V1 0x0001/* original minix fs */ @@ -69,6 +70,8 @@ extern int V1_minix_get_block(struct inode *, long, struct buffer_head *, int);extern int V2_minix_get_block (struct inode *,long ,struct buffer_head *,int );extern unsigned V1_minix_blocks (loff_t ,struct super_block *);extern unsigned V2_minix_blocks (loff_t ,struct super_block *); +extern int minix_get_block (struct inode *inode,sector_t block, +struct buffer_head *bh_result,int create);struct minix_dir_entry *minix_find_entry (struct dentry *,struct folio **);int minix_add_link (struct dentry *,struct inode *);@@ -80,10 +83,20 @@ int minix_set_link(struct minix_dir_entry *de, struct folio *folio,struct minix_dir_entry *minix_dotdot (struct inode *,struct folio **);ino_t minix_inode_by_name (struct dentry *); +extern int V1_minix_iomap_begin (struct inode *inode,loff_t offset, +loff_t length,unsigned int flags,struct iomap *iomap, +struct iomap *srcmap); +extern int V2_minix_iomap_begin (struct inode *inode,loff_t offset, +loff_t length,unsigned int flags,struct iomap *iomap, +struct iomap *srcmap); + +extern const struct address_space_operations minix_aops;extern const struct inode_operations minix_file_inode_operations;extern const struct inode_operations minix_dir_inode_operations;extern const struct file_operations minix_file_operations;extern const struct file_operations minix_dir_operations; +extern const struct iomap_ops V1_minix_iomap_ops; +extern const struct iomap_ops V2_minix_iomap_ops;static inline struct minix_sb_info *minix_sb (struct super_block *sb) {@@ -95,11 +108,17 @@ static inline struct minix_inode_info *minix_i(struct inode *inode) return container_of(inode, struct minix_inode_info, vfs_inode); } -static inline unsigned minix_blocks_needed (unsigned bits,unsigned blocksize) +static inline unsigned int minix_blocks_needed (unsigned int bits,unsigned int blocksize) {return DIV_ROUND_UP (bits, blocksize *8 ); } +static inline const struct iomap_ops *minix_iomap_ops_ver (struct inode *inode) +{ +return (INODE_VERSION (inode) ==MINIX_V1 ) ? + &V1_minix_iomap_ops : &V2_minix_iomap_ops; +} +#if defined(CONFIG_MINIX_FS_NATIVE_ENDIAN ) && \ defined(CONFIG_MINIX_FS_BIG_ENDIAN_16BIT_INDEXED )@@ -129,7 +148,7 @@ static inline unsigned minix_blocks_needed(unsigned bits, unsigned blocksize)* big-endian 16bit indexed bitmaps */ -static inline int minix_find_first_zero_bit (const void *vaddr,unsigned size) +static inline int minix_find_first_zero_bit (const void *vaddr,unsigned int size) {const unsigned short *p = vaddr, *addr = vaddr;unsigned short num;Signature · 1 line
2.47.3
Re: [PATCH v2 1/4] minix: add iomap infrastructure
Quoted 5 lines · Darrick J. Wong
Quoted 5 lines
fs/minix/iomap.c new file +0
-0
Quoted 8 lines
fs/minix/iomap.c line 5
Quoted 6 lines
fs/minix/iomap.c new file +5
-0@@ -0,0 +1,114 @@ +// SPDX-License-Identifier: GPL-2.0-only +/* +* iomap functions for minix. At least the first pass of this file was taken +* from the xiafs iomap.c, which is fitting since the xiafs module in turn +* borrowed heavily from the modernized minix fs kernel module. Is this the "modernized" minix fs kernel module??
I guess it is, yeah, in that it's been updated to use iomap. The rest of it remains pretty
ancient.
Quoted 2 lines
xiafs hasn't been in the kernel for years; I see little point in mentioning an externally maintained driver inside the kernel source.
I simply mentioned it for context on where the iomap conversion originally came from, that's all.
Quoted 72 lines
Quoted 57 lines
fs/minix/iomap.c new file +57
-0+*/ + +/* +* minix_iomap_begin - map a file range to disk blocks. It acts as a replacement +* for get_block in itree_common.c, at least in the important ways, and is +* adapted from it, but it uses iomap instead of buffer_head. This is taken +* directly from the out-of-tree xiafs iomap changes, and the exfat iomap +* changes were an inspiration for that. +*/ +static int minix_iomap_begin (struct inode *inode,loff_t offset,loff_t length, +unsigned int flags,struct iomap *iomap,struct iomap *srcmap) +{ +struct super_block *sb = inode->i_sb; +unsigned int blkbits = sb->s_blocksize_bits; +sector_t iblock = offset >> blkbits; +int create = flags &IOMAP_WRITE ; + +/* Mostly taken from modern-xiafs itree.c get_block with elements from +* similar exfat operations. +*/ +int offsets[DEPTH ]; +Indirect chain[DEPTH ]; +Indirect *partial; +int depth =block_to_path (inode, iblock, offsets); +int left; +int err = -EIO ; + +sector_t phys; + +/* block is beyond max file size */ +if (depth ==0 ) + goto out; + + iomap->bdev = inode->i_sb->s_bdev; + +reread: + partial =get_branch (inode, depth, offsets, chain, &err); + +/* Simplest case - block found, no allocation needed */ +if (!partial) { +/* Bit of a weird order, but it'll make sense when you get to +* the bottom. +*/ + iomap->flags =IOMAP_F_MERGED ; +got_it: + phys =block_to_cpu (chain[depth -1 ].key); + partial = chain+depth-1 ; +/* Set up the iomap struct before cleaning up */ + iomap->type =IOMAP_MAPPED ; + iomap->addr = (u64 )phys << blkbits; + iomap->length =1 << blkbits; + iomap->offset = (u64 )iblock << blkbits; + goto cleanup; + } + +/* Next simple case - plain lookup or failed read of indirect block */ +if (!create || err == -EIO ) {fs/minix/iomap.c line 72
Quoted 10 lines
fs/minix/iomap.c new file +10
-0+ iomap->type =IOMAP_HOLE ; + iomap->addr =IOMAP_NULL_ADDR ; + iomap->length =1 << blkbits; + iomap->offset = (u64 )iblock << blkbits; + iomap->flags =0 ; +cleanup: +while (partial > chain) { +brelse (partial->bh); + partial--; + }Uhhh ... these three ought to be factored out into separate helpers to
(a) clean up @chain, (b) set up aIOMAP_MAPPEDmapping, and (c) set up aIOMAP_HOLEmapping. Don't write a pile of spaghetti goes.
Quoted 2 lines
Also kinda surprised that you set
IOMAP_F_MERGEDbut don't try to look forward to find adjacent blocks?
That's fair. I was sticking to the same general pattern used in get_block() in itree_common.c, but just because it's done that way in the older function doesn't
mean that it needs to stay that way. I'll split that up.
Thank you for the comments,
-j
Quoted 11 lines
fs/minix/iomap.c line 80
Quoted 8 lines
fs/minix/iomap.c new file +8
-0+out: +return err; + } + +/* +* Indirect block might be removed by truncate while we were +* reading it. Handling of that case (forget what we've got and +* reread) is taken out of the main path. /me wonders how we'd be racing with setattr?
Quoted 1 line
--D
The same race would be present in get_block(), since that comment and the following code was lifted & adapted from there because they do the same things. I'll investigate to see if there are any races with setattr with both functions, though, and fix them as needed.
Quoted 186 lines
Quoted 186 lines
fs/minix/iomap.c new file +34
-0+*/ +if (err == -EAGAIN ) + goto changed; + + left = (chain + depth) - partial; + err =alloc_branch (inode, left, offsets + (partial - chain), partial); +if (err) + goto cleanup; + +if (splice_branch (inode, chain, partial, left) <0 ) + goto changed; + +/* Successful allocation, mapping it. */ + iomap->flags =IOMAP_F_NEW ; + goto got_it; + +changed: +while (partial > chain) { +brelse (partial->bh); + partial--; + } + goto reread; +} + +/* +* minix_iomap_end ends up being a nop; since minix doesn't have any extents or +* transactions to worry about, there isn't anything to update here. The on-disk +* indirect blocks get dirtied in minix_iomap_begin. +*/ +static int minix_iomap_end (struct inode *inode,loff_t offset,loff_t length, +ssize_t written,unsigned int flags,struct iomap *iomap) +{ +return 0 ; +}fs/minix/itree_v1.c +24
-1@@ -49,6 +49,18 @@ static int block_to_path(struct inode * inode, long block, int offsets[DEPTH]) }#include "itree_common.c" +/* NOTA BENE: +* +* This is icky to me, but at the same time having it be a standalone C file +* that's compiled to object form and linked separately like it is in xiafs is +* much nastier in minix because of the different versions of the minix fs that +* have some very, very different aspects, like the size of block_t. I don't +* like it, but since minix already has this pattern where a common itree file +* is included in the itree_v1 and itree_v2(and v3) files, I'm including iomap.c +* in these files as well. It does at least avoid exporting some currently +* static functions that aren't needed anywhere but itree_common.c and iomap.c. +*/ +#include "iomap.c" int V1_minix_get_block (struct inode * inode,long block,struct buffer_head *bh_result,int create)@@ -61,7 +73,18 @@ void V1_minix_truncate(struct inode * inode)truncate (inode); } -unsigned V1_minix_blocks (loff_t size,struct super_block *sb) +unsigned int V1_minix_blocks (loff_t size,struct super_block *sb) {return nblocks (size, sb); } + +int V1_minix_iomap_begin (struct inode *inode,loff_t offset,loff_t length, +unsigned int flags,struct iomap *iomap,struct iomap *srcmap) +{ +return minix_iomap_begin (inode, offset, length, flags, iomap, srcmap); +} + +const struct iomap_ops V1_minix_iomap_ops = { + .iomap_begin = V1_minix_iomap_begin, + .iomap_end = minix_iomap_end, +};fs/minix/itree_v2.c +16
-1@@ -57,6 +57,10 @@ static int block_to_path(struct inode * inode, long block, int offsets[DEPTH]) }#include "itree_common.c" +/* See the note in itree_v1 in a comment that starts "NOTA BENE" for an +* explanation for why iomap.c is included here. +*/ +#include "iomap.c" int V2_minix_get_block (struct inode * inode,long block,struct buffer_head *bh_result,int create)@@ -69,7 +73,18 @@ void V2_minix_truncate(struct inode * inode)truncate (inode); } -unsigned V2_minix_blocks (loff_t size,struct super_block *sb) +unsigned int V2_minix_blocks (loff_t size,struct super_block *sb) {return nblocks (size, sb); } + +int V2_minix_iomap_begin (struct inode *inode,loff_t offset,loff_t length, +unsigned int flags,struct iomap *iomap,struct iomap *srcmap) +{ +return minix_iomap_begin (inode, offset, length, flags, iomap, srcmap); +} + +const struct iomap_ops V2_minix_iomap_ops = { + .iomap_begin = V2_minix_iomap_begin, + .iomap_end = minix_iomap_end, +};fs/minix/minix.h +21
-3@@ -5,6 +5,7 @@#include <linux/fs.h> #include <linux/pagemap.h> #include <linux/minix_fs.h> +#include <linux/iomap.h> #define INODE_VERSION (inode) minix_sb(inode->i_sb)->s_version#define MINIX_V1 0x0001/* original minix fs */ @@ -69,6 +70,8 @@ extern int V1_minix_get_block(struct inode *, long, struct buffer_head *, int);extern int V2_minix_get_block (struct inode *,long ,struct buffer_head *,int );extern unsigned V1_minix_blocks (loff_t ,struct super_block *);extern unsigned V2_minix_blocks (loff_t ,struct super_block *); +extern int minix_get_block (struct inode *inode,sector_t block, +struct buffer_head *bh_result,int create);struct minix_dir_entry *minix_find_entry (struct dentry *,struct folio **);int minix_add_link (struct dentry *,struct inode *);@@ -80,10 +83,20 @@ int minix_set_link(struct minix_dir_entry *de, struct folio *folio,struct minix_dir_entry *minix_dotdot (struct inode *,struct folio **);ino_t minix_inode_by_name (struct dentry *); +extern int V1_minix_iomap_begin (struct inode *inode,loff_t offset, +loff_t length,unsigned int flags,struct iomap *iomap, +struct iomap *srcmap); +extern int V2_minix_iomap_begin (struct inode *inode,loff_t offset, +loff_t length,unsigned int flags,struct iomap *iomap, +struct iomap *srcmap); + +extern const struct address_space_operations minix_aops;extern const struct inode_operations minix_file_inode_operations;extern const struct inode_operations minix_dir_inode_operations;extern const struct file_operations minix_file_operations;extern const struct file_operations minix_dir_operations; +extern const struct iomap_ops V1_minix_iomap_ops; +extern const struct iomap_ops V2_minix_iomap_ops;static inline struct minix_sb_info *minix_sb (struct super_block *sb) {@@ -95,11 +108,17 @@ static inline struct minix_inode_info *minix_i(struct inode *inode) return container_of(inode, struct minix_inode_info, vfs_inode); } -static inline unsigned minix_blocks_needed (unsigned bits,unsigned blocksize) +static inline unsigned int minix_blocks_needed (unsigned int bits,unsigned int blocksize) {return DIV_ROUND_UP (bits, blocksize *8 ); } +static inline const struct iomap_ops *minix_iomap_ops_ver (struct inode *inode) +{ +return (INODE_VERSION (inode) ==MINIX_V1 ) ? + &V1_minix_iomap_ops : &V2_minix_iomap_ops; +} +#if defined(CONFIG_MINIX_FS_NATIVE_ENDIAN ) && \ defined(CONFIG_MINIX_FS_BIG_ENDIAN_16BIT_INDEXED )@@ -129,7 +148,7 @@ static inline unsigned minix_blocks_needed(unsigned bits, unsigned blocksize)* big-endian 16bit indexed bitmaps */ -static inline int minix_find_first_zero_bit (const void *vaddr,unsigned size) +static inline int minix_find_first_zero_bit (const void *vaddr,unsigned int size) {const unsigned short *p = vaddr, *addr = vaddr;unsigned short num; --2.47.3
PATCH v2 2/4 minix: convert address space operations to iomap
In reply to Jeremy BinghamConvert minix regular file and symlink address space operations from buffer_head to iomap. The new minix_aops uses iomap_dirty_folio, iomap_invalidate_folio, iomap_bio_read_folio, iomap_bio_readahead, iomap_writepages, iomap_bmap, and related iomap helpers. The write_begin/write_end callbacks are removed since buffered writes now go through iomap_file_buffered_write in file.c.
Directories keep using buffer_heads via a new minix_dir_aops, which retains the old block_dirty_folio, block_read_full_folio, block_write_begin, generic_write_end, and mpage_writepages. This is necessary because directory entry manipulation (minix_prepare_chunk, minix_write_begin) still uses the buffer_head chunk protocol.
minix_bmap is converted from generic_block_bmap to iomap_bmap.
The minix_get_block function is exported (non-static) so the directory aops can still use it for block_write_begin and mpage_writepages.
--- fs/minix/inode.c | 86 +++++++++++++++++++++++++++++++++++++++++++----- 1 file changed, 78 insertions(+), 8 deletions(-)
fs/minix/inode.c +78 -8
@@ -436,7 +436,32 @@ static int minix_statfs(struct dentry *dentry, struct kstatfs *buf)return 0 ; } -static int minix_get_block (struct inode *inode,sector_t block, +static ssize_t minix_writeback_range (struct iomap_writepage_ctx *wpc, +struct folio *folio,u64 pos,unsigned int len,u64 end_pos) +{ +int error; + +if (pos < wpc->iomap.offset || + pos >= wpc->iomap.offset + wpc->iomap.length) { +if (INODE_VERSION (wpc->inode) ==MINIX_V1 ) + error =V1_minix_iomap_begin (wpc->inode, pos, len,IOMAP_WRITE , + &wpc->iomap,NULL ); +else + error =V2_minix_iomap_begin (wpc->inode, pos, len,IOMAP_WRITE , + &wpc->iomap,NULL ); +if (error) +return error; + } + +return iomap_add_to_ioend (wpc, folio, pos, end_pos, len); +} + +static const struct iomap_writeback_ops minix_writeback_ops = { + .writeback_range = minix_writeback_range, + .writeback_submit = iomap_ioend_writeback_submit, +}; + +int minix_get_block (struct inode *inode,sector_t block,struct buffer_head *bh_result,int create) {if (INODE_VERSION (inode) ==MINIX_V1 )
@@ -445,17 +470,45 @@ static int minix_get_block(struct inode *inode, sector_t block,return V2_minix_get_block (inode, block, bh_result, create); } -static int minix_writepages (struct address_space *mapping, +/* The old minix_writepages, preserved for directory operations. */ +static int minix_block_writepages (struct address_space *mapping,struct writeback_control *wbc) {return mpage_writepages (mapping, wbc, minix_get_block); } +static int minix_writepages (struct address_space *mapping, +struct writeback_control *wbc) +{ +struct iomap_writepage_ctx wpc = { + .inode = mapping->host, + .wbc = wbc, + .ops = &minix_writeback_ops, + }; +return iomap_writepages (&wpc); +} +static int minix_read_folio (struct file *file,struct folio *folio) +{ +const struct iomap_ops *ops =minix_iomap_ops_ver (folio->mapping->host); + +iomap_bio_read_folio (folio, ops); +return 0 ; +} + +/* The old minix_read_folio, preserved for directory operations. */ +static int minix_block_read_folio (struct file *file,struct folio *folio) {return block_read_full_folio (folio, minix_get_block); } +static void minix_readahead (struct readahead_control *rac) +{ +const struct iomap_ops *ops =minix_iomap_ops_ver (rac->mapping->host); + +iomap_bio_readahead (rac, ops); +} +int minix_prepare_chunk (struct folio *folio,loff_t pos,unsigned len) {return __block_write_begin (folio, pos, len, minix_get_block);
@@ -487,19 +540,36 @@ static int minix_write_begin(const struct kiocb *iocb,static sector_t minix_bmap (struct address_space *mapping,sector_t block) { -return generic_block_bmap (mapping,block,minix_get_block); +const struct iomap_ops *ops =minix_iomap_ops_ver (mapping->host); + +return iomap_bmap (mapping, block, ops); } -static const struct address_space_operations minix_aops = { - .dirty_folio = block_dirty_folio, - .invalidate_folio = block_invalidate_folio, +const struct address_space_operations minix_aops = { + .dirty_folio = iomap_dirty_folio, + .invalidate_folio = iomap_invalidate_folio, .read_folio = minix_read_folio, + .readahead = minix_readahead, .writepages = minix_writepages, + .migrate_folio = filemap_migrate_folio, + .bmap = minix_bmap, + .is_partially_uptodate = iomap_is_partially_uptodate, + .release_folio = iomap_release_folio, + .error_remove_folio = generic_error_remove_folio, +}; + +/* A special aops for directories that keeps using the buffer head chunks, at +* least for the time being. +*/ +static const struct address_space_operations minix_dir_aops = { + .dirty_folio = block_dirty_folio, + .invalidate_folio = block_invalidate_folio, + .read_folio = minix_block_read_folio, .write_begin = minix_write_begin, .write_end = generic_write_end, .migrate_folio = buffer_migrate_folio, .bmap = minix_bmap, - .direct_IO = noop_direct_IO + .writepages = minix_block_writepages, };static const struct inode_operations minix_symlink_inode_operations = {
@@ -516,7 +586,7 @@ void minix_set_inode(struct inode *inode, dev_t rdev) }else if (S_ISDIR (inode->i_mode)) { inode->i_op = &minix_dir_inode_operations; inode->i_fop = &minix_dir_operations; - inode->i_mapping->a_ops = &minix_aops; + inode->i_mapping->a_ops = &minix_dir_aops; }else if (S_ISLNK (inode->i_mode)) { inode->i_op = &minix_symlink_inode_operations;inode_nohighmem (inode);
Signature · 1 line
2.47.3
Re: [PATCH v2 2/4] minix: convert address space operations to iomap
Quoted 7 lines · Jeremy Bingham
Convert minix regular file and symlink address space operations from
buffer_headto iomap. The newminix_aopsusesiomap_dirty_folio,iomap_invalidate_folio,iomap_bio_read_folio,iomap_bio_readahead,iomap_writepages,iomap_bmap, and related iomap helpers. The write_begin/write_end callbacks are removed since buffered writes now go throughiomap_file_buffered_writeinfile.c.
Quoted 7 lines
Directories keep using
buffer_headsvia a newminix_dir_aops, which retains the oldblock_dirty_folio,block_read_full_folio,block_write_begin,generic_write_end, andmpage_writepages. This is necessary because directory entry manipulation (minix_prepare_chunk,minix_write_begin) still uses thebuffer_headchunk protocol.
minix_bmapis converted fromgeneric_block_bmaptoiomap_bmap.
I'd drop BMAP support entirely, unless you know of people who use LILO and minixfs. If all you want is swapfile activation, use iomap_swapfile_activate... assuming that anyone actually cares about hosting swapfiles on minixfs.
Quoted 122 lines
The
minix_get_blockfunction is exported (non-static) so the directory aops can still use it forblock_write_beginandmpage_writepages.Signed-off-by Jeremy Bingham <[email protected]>--- fs/minix/inode.c | 86 +++++++++++++++++++++++++++++++++++++++++++----- 1 file changed, 78 insertions(+), 8 deletions(-)fs/minix/inode.c +71
-6@@ -436,7 +436,32 @@ static int minix_statfs(struct dentry *dentry, struct kstatfs *buf)return 0 ; } -static int minix_get_block (struct inode *inode,sector_t block, +static ssize_t minix_writeback_range (struct iomap_writepage_ctx *wpc, +struct folio *folio,u64 pos,unsigned int len,u64 end_pos) +{ +int error; + +if (pos < wpc->iomap.offset || + pos >= wpc->iomap.offset + wpc->iomap.length) { +if (INODE_VERSION (wpc->inode) ==MINIX_V1 ) + error =V1_minix_iomap_begin (wpc->inode, pos, len,IOMAP_WRITE , + &wpc->iomap,NULL ); +else + error =V2_minix_iomap_begin (wpc->inode, pos, len,IOMAP_WRITE , + &wpc->iomap,NULL ); +if (error) +return error; + } + +return iomap_add_to_ioend (wpc, folio, pos, end_pos, len); +} + +static const struct iomap_writeback_ops minix_writeback_ops = { + .writeback_range = minix_writeback_range, + .writeback_submit = iomap_ioend_writeback_submit, +}; + +int minix_get_block (struct inode *inode,sector_t block,struct buffer_head *bh_result,int create) {if (INODE_VERSION (inode) ==MINIX_V1 )@@ -445,17 +470,45 @@ static int minix_get_block(struct inode *inode, sector_t block,return V2_minix_get_block (inode, block, bh_result, create); } -static int minix_writepages (struct address_space *mapping, +/* The old minix_writepages, preserved for directory operations. */ +static int minix_block_writepages (struct address_space *mapping,struct writeback_control *wbc) {return mpage_writepages (mapping, wbc, minix_get_block); } +static int minix_writepages (struct address_space *mapping, +struct writeback_control *wbc) +{ +struct iomap_writepage_ctx wpc = { + .inode = mapping->host, + .wbc = wbc, + .ops = &minix_writeback_ops, + }; +return iomap_writepages (&wpc); +} +static int minix_read_folio (struct file *file,struct folio *folio) +{ +const struct iomap_ops *ops =minix_iomap_ops_ver (folio->mapping->host); + +iomap_bio_read_folio (folio, ops); +return 0 ; +} + +/* The old minix_read_folio, preserved for directory operations. */ +static int minix_block_read_folio (struct file *file,struct folio *folio) {return block_read_full_folio (folio, minix_get_block); } +static void minix_readahead (struct readahead_control *rac) +{ +const struct iomap_ops *ops =minix_iomap_ops_ver (rac->mapping->host); + +iomap_bio_readahead (rac, ops); +} +int minix_prepare_chunk (struct folio *folio,loff_t pos,unsigned len) {return __block_write_begin (folio, pos, len, minix_get_block);@@ -487,19 +540,36 @@ static int minix_write_begin(const struct kiocb *iocb,static sector_t minix_bmap (struct address_space *mapping,sector_t block) { -return generic_block_bmap (mapping,block,minix_get_block); +const struct iomap_ops *ops =minix_iomap_ops_ver (mapping->host); + +return iomap_bmap (mapping, block, ops); } -static const struct address_space_operations minix_aops = { - .dirty_folio = block_dirty_folio, - .invalidate_folio = block_invalidate_folio, +const struct address_space_operations minix_aops = { + .dirty_folio = iomap_dirty_folio, + .invalidate_folio = iomap_invalidate_folio, .read_folio = minix_read_folio, + .readahead = minix_readahead, .writepages = minix_writepages, + .migrate_folio = filemap_migrate_folio, + .bmap = minix_bmap, + .is_partially_uptodate = iomap_is_partially_uptodate, + .release_folio = iomap_release_folio, + .error_remove_folio = generic_error_remove_folio, +}; + +/* A special aops for directories that keeps using the buffer head chunks, at +* least for the time being.
fs/minix/inode.c static int minix_write_begin(const struct kiocb *iocb, · line 502
Quoted 10 lines
fs/minix/inode.c +5
-1+*/ +static const struct address_space_operations minix_dir_aops = { + .dirty_folio = block_dirty_folio, + .invalidate_folio = block_invalidate_folio, + .read_folio = minix_block_read_folio, .write_begin = minix_write_begin, .write_end = generic_write_end, .migrate_folio = buffer_migrate_folio, .bmap = minix_bmap, - .direct_IO = noop_direct_IO
I forget, does one have to set FMODE_CAN_ODIRECT if the address_space operations don't supply a ->direct_IO function?
--D
Quoted 17 lines
fs/minix/inode.c +2
-1+ .writepages = minix_block_writepages, };static const struct inode_operations minix_symlink_inode_operations = {@@ -516,7 +586,7 @@ void minix_set_inode(struct inode *inode, dev_t rdev) }else if (S_ISDIR (inode->i_mode)) { inode->i_op = &minix_dir_inode_operations; inode->i_fop = &minix_dir_operations; - inode->i_mapping->a_ops = &minix_aops; + inode->i_mapping->a_ops = &minix_dir_aops; }else if (S_ISLNK (inode->i_mode)) { inode->i_op = &minix_symlink_inode_operations;inode_nohighmem (inode);Signature · 1 line
2.47.3
Re: [PATCH v2 2/4] minix: convert address space operations to iomap
Quoted 15 lines · Darrick J. Wong
Quoted 13 lines · Jeremy Bingham
Convert minix regular file and symlink address space operations from
buffer_headto iomap. The newminix_aopsusesiomap_dirty_folio,iomap_invalidate_folio,iomap_bio_read_folio,iomap_bio_readahead,iomap_writepages,iomap_bmap, and related iomap helpers. The write_begin/write_end callbacks are removed since buffered writes now go throughiomap_file_buffered_writeinfile.c.Directories keep using
buffer_headsvia a newminix_dir_aops, which retains the oldblock_dirty_folio,block_read_full_folio,block_write_begin,generic_write_end, andmpage_writepages. This is necessary because directory entry manipulation (minix_prepare_chunk,minix_write_begin) still uses thebuffer_headchunk protocol.
Quoted 6 lines
Quoted 1 line
minix_bmapis converted fromgeneric_block_bmaptoiomap_bmap.I'd drop BMAP support entirely, unless you know of people who use LILO and minixfs. If all you want is swapfile activation, use
iomap_swapfile_activate... assuming that anyone actually cares about hosting swapfiles on minixfs.
I'm not dead set against dropping BMAP support entirely, but is there a compelling reason to drop it?
Thanks,
-j
Quoted 155 lines
Quoted 122 lines
The
minix_get_blockfunction is exported (non-static) so the directory aops can still use it forblock_write_beginandmpage_writepages.Signed-off-by Jeremy Bingham <[email protected]>--- fs/minix/inode.c | 86 +++++++++++++++++++++++++++++++++++++++++++----- 1 file changed, 78 insertions(+), 8 deletions(-)fs/minix/inode.c +71
-6@@ -436,7 +436,32 @@ static int minix_statfs(struct dentry *dentry, struct kstatfs *buf)return 0 ; } -static int minix_get_block (struct inode *inode,sector_t block, +static ssize_t minix_writeback_range (struct iomap_writepage_ctx *wpc, +struct folio *folio,u64 pos,unsigned int len,u64 end_pos) +{ +int error; + +if (pos < wpc->iomap.offset || + pos >= wpc->iomap.offset + wpc->iomap.length) { +if (INODE_VERSION (wpc->inode) ==MINIX_V1 ) + error =V1_minix_iomap_begin (wpc->inode, pos, len,IOMAP_WRITE , + &wpc->iomap,NULL ); +else + error =V2_minix_iomap_begin (wpc->inode, pos, len,IOMAP_WRITE , + &wpc->iomap,NULL ); +if (error) +return error; + } + +return iomap_add_to_ioend (wpc, folio, pos, end_pos, len); +} + +static const struct iomap_writeback_ops minix_writeback_ops = { + .writeback_range = minix_writeback_range, + .writeback_submit = iomap_ioend_writeback_submit, +}; + +int minix_get_block (struct inode *inode,sector_t block,struct buffer_head *bh_result,int create) {if (INODE_VERSION (inode) ==MINIX_V1 )@@ -445,17 +470,45 @@ static int minix_get_block(struct inode *inode, sector_t block,return V2_minix_get_block (inode, block, bh_result, create); } -static int minix_writepages (struct address_space *mapping, +/* The old minix_writepages, preserved for directory operations. */ +static int minix_block_writepages (struct address_space *mapping,struct writeback_control *wbc) {return mpage_writepages (mapping, wbc, minix_get_block); } +static int minix_writepages (struct address_space *mapping, +struct writeback_control *wbc) +{ +struct iomap_writepage_ctx wpc = { + .inode = mapping->host, + .wbc = wbc, + .ops = &minix_writeback_ops, + }; +return iomap_writepages (&wpc); +} +static int minix_read_folio (struct file *file,struct folio *folio) +{ +const struct iomap_ops *ops =minix_iomap_ops_ver (folio->mapping->host); + +iomap_bio_read_folio (folio, ops); +return 0 ; +} + +/* The old minix_read_folio, preserved for directory operations. */ +static int minix_block_read_folio (struct file *file,struct folio *folio) {return block_read_full_folio (folio, minix_get_block); } +static void minix_readahead (struct readahead_control *rac) +{ +const struct iomap_ops *ops =minix_iomap_ops_ver (rac->mapping->host); + +iomap_bio_readahead (rac, ops); +} +int minix_prepare_chunk (struct folio *folio,loff_t pos,unsigned len) {return __block_write_begin (folio, pos, len, minix_get_block);@@ -487,19 +540,36 @@ static int minix_write_begin(const struct kiocb *iocb,static sector_t minix_bmap (struct address_space *mapping,sector_t block) { -return generic_block_bmap (mapping,block,minix_get_block); +const struct iomap_ops *ops =minix_iomap_ops_ver (mapping->host); + +return iomap_bmap (mapping, block, ops); } -static const struct address_space_operations minix_aops = { - .dirty_folio = block_dirty_folio, - .invalidate_folio = block_invalidate_folio, +const struct address_space_operations minix_aops = { + .dirty_folio = iomap_dirty_folio, + .invalidate_folio = iomap_invalidate_folio, .read_folio = minix_read_folio, + .readahead = minix_readahead, .writepages = minix_writepages, + .migrate_folio = filemap_migrate_folio, + .bmap = minix_bmap, + .is_partially_uptodate = iomap_is_partially_uptodate, + .release_folio = iomap_release_folio, + .error_remove_folio = generic_error_remove_folio, +}; + +/* A special aops for directories that keeps using the buffer head chunks, at +* least for the time being. fs/minix/inode.c static int minix_write_begin(const struct kiocb *iocb, · line 502
Quoted 10 lines
fs/minix/inode.c +5
-1+*/ +static const struct address_space_operations minix_dir_aops = { + .dirty_folio = block_dirty_folio, + .invalidate_folio = block_invalidate_folio, + .read_folio = minix_block_read_folio, .write_begin = minix_write_begin, .write_end = generic_write_end, .migrate_folio = buffer_migrate_folio, .bmap = minix_bmap, - .direct_IO = noop_direct_IOI forget, does one have to set
FMODE_CAN_ODIRECTif theaddress_spaceoperations don't supply a ->direct_IO function?--D
Quoted 17 lines
fs/minix/inode.c +2
-2+ .writepages = minix_block_writepages, };static const struct inode_operations minix_symlink_inode_operations = {@@ -516,7 +586,7 @@ void minix_set_inode(struct inode *inode, dev_t rdev) }else if (S_ISDIR (inode->i_mode)) { inode->i_op = &minix_dir_inode_operations; inode->i_fop = &minix_dir_operations; - inode->i_mapping->a_ops = &minix_aops; + inode->i_mapping->a_ops = &minix_dir_aops; }else if (S_ISLNK (inode->i_mode)) { inode->i_op = &minix_symlink_inode_operations;inode_nohighmem (inode); --2.47.3
Re: [PATCH v2 2/4] minix: convert address space operations to iomap
Quoted 18 lines · Jeremy Bingham
Quoted 17 lines · Darrick J. Wong
Quoted 14 lines · Jeremy Bingham
Convert minix regular file and symlink address space operations from
buffer_headto iomap. The newminix_aopsusesiomap_dirty_folio,iomap_invalidate_folio,iomap_bio_read_folio,iomap_bio_readahead,iomap_writepages,iomap_bmap, and related iomap helpers. The write_begin/write_end callbacks are removed since buffered writes now go throughiomap_file_buffered_writeinfile.c.Directories keep using
buffer_headsvia a newminix_dir_aops, which retains the oldblock_dirty_folio,block_read_full_folio,block_write_begin,generic_write_end, andmpage_writepages. This is necessary because directory entry manipulation (minix_prepare_chunk,minix_write_begin) still uses thebuffer_headchunk protocol.
minix_bmapis converted fromgeneric_block_bmaptoiomap_bmap.
Quoted 7 lines
Quoted 4 lines
I'd drop BMAP support entirely, unless you know of people who use LILO and minixfs. If all you want is swapfile activation, use
iomap_swapfile_activate... assuming that anyone actually cares about hosting swapfiles on minixfs.I'm not dead set against dropping BMAP support entirely, but is there a compelling reason to drop it?
It's a terrible legacy interface -- you can only ask about a single block, the block and sector numbers are limited to u32, the magic value 0 means no mapping, and it doesn't actually tell you which device.
Anyone who really wants to find the sparse areas of a file would be better off calling SEEK_{DATA,HOLE} ... which I guess is something you could implement as part of this patchset.
--D
Quoted 160 lines
Thanks,
-j
Quoted 155 lines
Quoted 122 lines
The
minix_get_blockfunction is exported (non-static) so the directory aops can still use it forblock_write_beginandmpage_writepages.Signed-off-by Jeremy Bingham <[email protected]>--- fs/minix/inode.c | 86 +++++++++++++++++++++++++++++++++++++++++++----- 1 file changed, 78 insertions(+), 8 deletions(-)fs/minix/inode.c +71
-6@@ -436,7 +436,32 @@ static int minix_statfs(struct dentry *dentry, struct kstatfs *buf)return 0 ; } -static int minix_get_block (struct inode *inode,sector_t block, +static ssize_t minix_writeback_range (struct iomap_writepage_ctx *wpc, +struct folio *folio,u64 pos,unsigned int len,u64 end_pos) +{ +int error; + +if (pos < wpc->iomap.offset || + pos >= wpc->iomap.offset + wpc->iomap.length) { +if (INODE_VERSION (wpc->inode) ==MINIX_V1 ) + error =V1_minix_iomap_begin (wpc->inode, pos, len,IOMAP_WRITE , + &wpc->iomap,NULL ); +else + error =V2_minix_iomap_begin (wpc->inode, pos, len,IOMAP_WRITE , + &wpc->iomap,NULL ); +if (error) +return error; + } + +return iomap_add_to_ioend (wpc, folio, pos, end_pos, len); +} + +static const struct iomap_writeback_ops minix_writeback_ops = { + .writeback_range = minix_writeback_range, + .writeback_submit = iomap_ioend_writeback_submit, +}; + +int minix_get_block (struct inode *inode,sector_t block,struct buffer_head *bh_result,int create) {if (INODE_VERSION (inode) ==MINIX_V1 )@@ -445,17 +470,45 @@ static int minix_get_block(struct inode *inode, sector_t block,return V2_minix_get_block (inode, block, bh_result, create); } -static int minix_writepages (struct address_space *mapping, +/* The old minix_writepages, preserved for directory operations. */ +static int minix_block_writepages (struct address_space *mapping,struct writeback_control *wbc) {return mpage_writepages (mapping, wbc, minix_get_block); } +static int minix_writepages (struct address_space *mapping, +struct writeback_control *wbc) +{ +struct iomap_writepage_ctx wpc = { + .inode = mapping->host, + .wbc = wbc, + .ops = &minix_writeback_ops, + }; +return iomap_writepages (&wpc); +} +static int minix_read_folio (struct file *file,struct folio *folio) +{ +const struct iomap_ops *ops =minix_iomap_ops_ver (folio->mapping->host); + +iomap_bio_read_folio (folio, ops); +return 0 ; +} + +/* The old minix_read_folio, preserved for directory operations. */ +static int minix_block_read_folio (struct file *file,struct folio *folio) {return block_read_full_folio (folio, minix_get_block); } +static void minix_readahead (struct readahead_control *rac) +{ +const struct iomap_ops *ops =minix_iomap_ops_ver (rac->mapping->host); + +iomap_bio_readahead (rac, ops); +} +int minix_prepare_chunk (struct folio *folio,loff_t pos,unsigned len) {return __block_write_begin (folio, pos, len, minix_get_block);@@ -487,19 +540,36 @@ static int minix_write_begin(const struct kiocb *iocb,static sector_t minix_bmap (struct address_space *mapping,sector_t block) { -return generic_block_bmap (mapping,block,minix_get_block); +const struct iomap_ops *ops =minix_iomap_ops_ver (mapping->host); + +return iomap_bmap (mapping, block, ops); } -static const struct address_space_operations minix_aops = { - .dirty_folio = block_dirty_folio, - .invalidate_folio = block_invalidate_folio, +const struct address_space_operations minix_aops = { + .dirty_folio = iomap_dirty_folio, + .invalidate_folio = iomap_invalidate_folio, .read_folio = minix_read_folio, + .readahead = minix_readahead, .writepages = minix_writepages, + .migrate_folio = filemap_migrate_folio, + .bmap = minix_bmap, + .is_partially_uptodate = iomap_is_partially_uptodate, + .release_folio = iomap_release_folio, + .error_remove_folio = generic_error_remove_folio, +}; + +/* A special aops for directories that keeps using the buffer head chunks, at +* least for the time being. fs/minix/inode.c static int minix_write_begin(const struct kiocb *iocb, · line 502
Quoted 10 lines
fs/minix/inode.c +5
-1+*/ +static const struct address_space_operations minix_dir_aops = { + .dirty_folio = block_dirty_folio, + .invalidate_folio = block_invalidate_folio, + .read_folio = minix_block_read_folio, .write_begin = minix_write_begin, .write_end = generic_write_end, .migrate_folio = buffer_migrate_folio, .bmap = minix_bmap, - .direct_IO = noop_direct_IOI forget, does one have to set
FMODE_CAN_ODIRECTif theaddress_spaceoperations don't supply a ->direct_IO function?--D
Quoted 17 lines
fs/minix/inode.c +2
-2+ .writepages = minix_block_writepages, };static const struct inode_operations minix_symlink_inode_operations = {@@ -516,7 +586,7 @@ void minix_set_inode(struct inode *inode, dev_t rdev) }else if (S_ISDIR (inode->i_mode)) { inode->i_op = &minix_dir_inode_operations; inode->i_fop = &minix_dir_operations; - inode->i_mapping->a_ops = &minix_aops; + inode->i_mapping->a_ops = &minix_dir_aops; }else if (S_ISLNK (inode->i_mode)) { inode->i_op = &minix_symlink_inode_operations;inode_nohighmem (inode); --2.47.3
PATCH v2 3/4 minix: convert file operations to iomap and add
In reply to Jeremy BinghamReplace generic_file_read_iter and generic_file_write_iter with custom minix_file_read_iter and minix_file_write_iter that dispatch to iomap for both buffered and direct I/O.
Buffered writes now go through iomap_file_buffered_write instead of the aops write_begin/write_end path (which no longer exists for regular files). Buffered reads still use generic_file_read_iter for the non-DIO case.
Direct I/O is implemented via iomap_dio_rw for both reads and writes. minix_dio_read_iter takes a shared inode lock; minix_dio_write_iter takes an exclusive lock, does generic_write_checks, and falls back to buffered writes via iomap_file_buffered_write for the tail of a DIO write that is not block-aligned. The minix_dio_write_end_io callback updates i_size and marks the inode dirty.
minix_file_open sets FMODE_CAN_ODIRECT so the VFS allows O_DIRECT opens, and splice_write is added to the file operations.
minix_setattr is exported (made non-static) so it can be shared by the symlink inode operations in a subsequent patch.
--- fs/minix/file.c | 157 +++++++++++++++++++++++++++++++++++++++++++++-- fs/minix/minix.h | 2 + 2 files changed, 153 insertions(+), 6 deletions(-)
fs/minix/file.c +151 -6
@@ -17,21 +17,166 @@ int minix_fsync(struct file *file, loff_t start, loff_t end, int datasync) start, end, datasync); } +static ssize_t minix_dio_read_iter (struct kiocb *iocb,struct iov_iter *to) +{ +struct inode *inode = iocb->ki_filp->f_mapping->host; +ssize_t ret; + +inode_lock_shared (inode); + +const struct iomap_ops *ops =minix_iomap_ops_ver (inode); + + ret =iomap_dio_rw (iocb, to, ops,NULL ,0 ,NULL ,0 ); +inode_unlock_shared (inode); +return ret; +} + +static int minix_dio_write_end_io (struct kiocb *iocb,ssize_t size,int error, +unsigned int flags) +{ +struct inode *inode =file_inode (iocb->ki_filp); +loff_t pos = iocb->ki_pos; + +if (error) +return error; + + pos += size; +if (size && pos >i_size_read (inode)) { +i_size_write (inode, pos); +mark_inode_dirty (inode); + } +return 0 ; +} + +static const struct iomap_dio_ops minix_dio_write_ops = { + .end_io = minix_dio_write_end_io, +}; + +static ssize_t minix_dio_write_iter (struct kiocb *iocb,struct iov_iter *from) +{ +struct inode *inode = iocb->ki_filp->f_mapping->host; +ssize_t ret; +unsigned int flags =0 ; +unsigned long blocksize = inode->i_sb->s_blocksize; + +inode_lock (inode); + ret =generic_write_checks (iocb, from); +if (ret <=0 ) + goto out_unlock; + + ret =kiocb_modified (iocb); +if (ret) + goto out_unlock; + +if (iocb->ki_pos +iov_iter_count (from) >i_size_read (inode) || + !IS_ALIGNED (iocb->ki_pos |iov_iter_alignment (from), blocksize)) + flags |=IOMAP_DIO_FORCE_WAIT ; + +const struct iomap_ops *ops =minix_iomap_ops_ver (inode); + + ret =iomap_dio_rw (iocb, from, ops, + &minix_dio_write_ops, flags,NULL ,0 ); +if (ret == -ENOTBLK ) + ret =0 ;/* fallback to buffered */ + +if (ret >=0 &&iov_iter_count (from)) { +loff_t pos; +loff_t endbyte; +ssize_t status; + + iocb->ki_flags &= ~IOCB_DIRECT ; + pos = iocb->ki_pos; + status =iomap_file_buffered_write (iocb, from, ops, +NULL ,NULL ); +if (unlikely (status <0 )) { + ret = status; + goto out_unlock; + } + + ret += status; + endbyte = pos + status -1 ; + status =filemap_write_and_wait_range (inode->i_mapping, pos, endbyte); +if (!status) { +invalidate_mapping_pages (inode->i_mapping, + pos >>PAGE_SHIFT , + endbyte >>PAGE_SHIFT ); +if (ret >0 ) + ret =generic_write_sync (iocb, ret); + }else { + ret = status; + } + } + +out_unlock: +inode_unlock (inode); +return ret; +} + +static ssize_t minix_file_read_iter (struct kiocb *iocb,struct iov_iter *to) +{ +if (iocb->ki_flags &IOCB_DIRECT ) +return minix_dio_read_iter (iocb, to); + +return generic_file_read_iter (iocb, to); +} + +static ssize_t minix_file_write_iter (struct kiocb *iocb,struct iov_iter *from) +{ +struct inode *inode = iocb->ki_filp->f_mapping->host; +ssize_t ret; + +/* minix_dio_write_iter also locks the inode and appears to do the same +* general sorts of checks as this, so just return directly from there. +*/ +if (iocb->ki_flags &IOCB_DIRECT ) +return minix_dio_write_iter (iocb, from); + +inode_lock (inode); + ret =generic_write_checks (iocb, from); +if (ret <=0 ) + goto unlock; + + ret =file_modified (iocb->ki_filp); +if (ret) + goto unlock; + +const struct iomap_ops *ops =minix_iomap_ops_ver (inode); + + ret =iomap_file_buffered_write (iocb, from, ops, +NULL ,NULL ); + +if (ret >0 ) + ret =generic_write_sync (iocb, ret); + +unlock: +inode_unlock (inode); +return ret; +} + +static int minix_file_open (struct inode *inode,struct file *filp) +{ + filp->f_mode |=FMODE_CAN_ODIRECT ; +return generic_file_open (inode, filp); +} +/* -* We have mostly NULLs here: the current defaults are OK for -* the minix filesystem. +* We still have some NULLs here, but not as many of the current defaults are +* still OK for the minix filesystem. */ +const struct file_operations minix_file_operations = { .llseek = generic_file_llseek, - .read_iter = generic_file_read_iter, - .write_iter = generic_file_write_iter, + .read_iter = minix_file_read_iter, + .write_iter = minix_file_write_iter, .mmap_prepare = generic_file_mmap_prepare, + .open = minix_file_open, .fsync = minix_fsync, .splice_read = filemap_splice_read, + .splice_write = iter_file_splice_write, }; -static int minix_setattr (struct mnt_idmap *idmap, -struct dentry *dentry,struct iattr *attr) +int minix_setattr (struct mnt_idmap *idmap,struct dentry *dentry, +struct iattr *attr) {struct inode *inode =d_inode (dentry);int error;
fs/minix/minix.h +2 -0
@@ -58,6 +58,8 @@ void minix_free_block(struct inode *inode, unsigned long block);unsigned long minix_count_free_blocks (struct super_block *sb);int minix_getattr (struct mnt_idmap *,const struct path *,struct kstat *,u32 ,unsigned int ); +int minix_setattr (struct mnt_idmap *idmap,struct dentry *dentry, +struct iattr *attr);int minix_prepare_chunk (struct folio *folio,loff_t pos,unsigned len);struct mapping_metadata_bhs *minix_get_metadata_bhs (struct inode *inode);int minix_fsync (struct file *file,loff_t start,loff_t end,int datasync);
Signature · 1 line
2.47.3
Re: [PATCH v2 3/4] minix: convert file operations to iomap and add
Quoted 1 line · Jeremy Bingham
Subject: [PATCH v2 3/4] minix: convert file operations to iomap and add
...add what?
Quoted 16 lines
Replace
generic_file_read_iterandgeneric_file_write_iterwith customminix_file_read_iterandminix_file_write_iterthat dispatch to iomap for both buffered and direct I/O.Buffered writes now go through
iomap_file_buffered_writeinstead of the aops write_begin/write_end path (which no longer exists for regular files). Buffered reads still usegeneric_file_read_iterfor the non-DIO case.Direct I/O is implemented via
iomap_dio_rwfor both reads and writes.minix_dio_read_itertakes a shared inode lock;minix_dio_write_itertakes an exclusive lock, doesgeneric_write_checks, and falls back to buffered writes viaiomap_file_buffered_writefor the tail of a DIO write that is not block-aligned. Theminix_dio_write_end_iocallback updatesi_sizeand marks the inode dirty.
Quoted 2 lines
minix_file_opensetsFMODE_CAN_ODIRECTso the VFS allowsO_DIRECTopens, andsplice_writeis added to the file operations.
Ignore my question about FMODE_CAN_ODIRECT in the previous patch, then.
Quoted 75 lines
minix_setattris exported (made non-static) so it can be shared by the symlink inode operations in a subsequent patch.Signed-off-by Jeremy Bingham <[email protected]>--- fs/minix/file.c | 157 +++++++++++++++++++++++++++++++++++++++++++++-- fs/minix/minix.h | 2 + 2 files changed, 153 insertions(+), 6 deletions(-)fs/minix/file.c +58
-0@@ -17,21 +17,166 @@ int minix_fsync(struct file *file, loff_t start, loff_t end, int datasync) start, end, datasync); } +static ssize_t minix_dio_read_iter (struct kiocb *iocb,struct iov_iter *to) +{ +struct inode *inode = iocb->ki_filp->f_mapping->host; +ssize_t ret; + +inode_lock_shared (inode); + +const struct iomap_ops *ops =minix_iomap_ops_ver (inode); + + ret =iomap_dio_rw (iocb, to, ops,NULL ,0 ,NULL ,0 ); +inode_unlock_shared (inode); +return ret; +} + +static int minix_dio_write_end_io (struct kiocb *iocb,ssize_t size,int error, +unsigned int flags) +{ +struct inode *inode =file_inode (iocb->ki_filp); +loff_t pos = iocb->ki_pos; + +if (error) +return error; + + pos += size; +if (size && pos >i_size_read (inode)) { +i_size_write (inode, pos); +mark_inode_dirty (inode); + } +return 0 ; +} + +static const struct iomap_dio_ops minix_dio_write_ops = { + .end_io = minix_dio_write_end_io, +}; + +static ssize_t minix_dio_write_iter (struct kiocb *iocb,struct iov_iter *from) +{ +struct inode *inode = iocb->ki_filp->f_mapping->host; +ssize_t ret; +unsigned int flags =0 ; +unsigned long blocksize = inode->i_sb->s_blocksize; + +inode_lock (inode); + ret =generic_write_checks (iocb, from); +if (ret <=0 ) + goto out_unlock; + + ret =kiocb_modified (iocb); +if (ret) + goto out_unlock; + +if (iocb->ki_pos +iov_iter_count (from) >i_size_read (inode) || + !IS_ALIGNED (iocb->ki_pos |iov_iter_alignment (from), blocksize)) + flags |=IOMAP_DIO_FORCE_WAIT ; + +const struct iomap_ops *ops =minix_iomap_ops_ver (inode); + + ret = iomap_dio_rw(iocb, from, ops,
fs/minix/file.c int minix_fsync(struct file *file, loff_t start, loff_t end, int datasync) · line 87
Quoted 10 lines
fs/minix/file.c +10
-0+ &minix_dio_write_ops, flags, NULL, 0); +if (ret == -ENOTBLK ) + ret =0 ;/* fallback to buffered */ + +if (ret >=0 &&iov_iter_count (from)) { +loff_t pos; +loff_t endbyte; +ssize_t status; + + iocb->ki_flags &= ~IOCB_DIRECT ;
Why not set IOC_DSYNC here and let generic_write_sync do all the flushing work for you? There's no requirement to dump the pagecache after a downgraded direct write, but if you want that, use IOCB_DONTCACHE.
--D
Quoted 118 lines
fs/minix/file.c +83
-6+ pos = iocb->ki_pos; + status =iomap_file_buffered_write (iocb, from, ops, +NULL ,NULL ); +if (unlikely (status <0 )) { + ret = status; + goto out_unlock; + } + + ret += status; + endbyte = pos + status -1 ; + status =filemap_write_and_wait_range (inode->i_mapping, pos, endbyte); +if (!status) { +invalidate_mapping_pages (inode->i_mapping, + pos >>PAGE_SHIFT , + endbyte >>PAGE_SHIFT ); +if (ret >0 ) + ret =generic_write_sync (iocb, ret); + }else { + ret = status; + } + } + +out_unlock: +inode_unlock (inode); +return ret; +} + +static ssize_t minix_file_read_iter (struct kiocb *iocb,struct iov_iter *to) +{ +if (iocb->ki_flags &IOCB_DIRECT ) +return minix_dio_read_iter (iocb, to); + +return generic_file_read_iter (iocb, to); +} + +static ssize_t minix_file_write_iter (struct kiocb *iocb,struct iov_iter *from) +{ +struct inode *inode = iocb->ki_filp->f_mapping->host; +ssize_t ret; + +/* minix_dio_write_iter also locks the inode and appears to do the same +* general sorts of checks as this, so just return directly from there. +*/ +if (iocb->ki_flags &IOCB_DIRECT ) +return minix_dio_write_iter (iocb, from); + +inode_lock (inode); + ret =generic_write_checks (iocb, from); +if (ret <=0 ) + goto unlock; + + ret =file_modified (iocb->ki_filp); +if (ret) + goto unlock; + +const struct iomap_ops *ops =minix_iomap_ops_ver (inode); + + ret =iomap_file_buffered_write (iocb, from, ops, +NULL ,NULL ); + +if (ret >0 ) + ret =generic_write_sync (iocb, ret); + +unlock: +inode_unlock (inode); +return ret; +} + +static int minix_file_open (struct inode *inode,struct file *filp) +{ + filp->f_mode |=FMODE_CAN_ODIRECT ; +return generic_file_open (inode, filp); +} +/* -* We have mostly NULLs here: the current defaults are OK for -* the minix filesystem. +* We still have some NULLs here, but not as many of the current defaults are +* still OK for the minix filesystem. */ +const struct file_operations minix_file_operations = { .llseek = generic_file_llseek, - .read_iter = generic_file_read_iter, - .write_iter = generic_file_write_iter, + .read_iter = minix_file_read_iter, + .write_iter = minix_file_write_iter, .mmap_prepare = generic_file_mmap_prepare, + .open = minix_file_open, .fsync = minix_fsync, .splice_read = filemap_splice_read, + .splice_write = iter_file_splice_write, }; -static int minix_setattr (struct mnt_idmap *idmap, -struct dentry *dentry,struct iattr *attr) +int minix_setattr (struct mnt_idmap *idmap,struct dentry *dentry, +struct iattr *attr) {struct inode *inode =d_inode (dentry);int error;fs/minix/minix.h +2
-0@@ -58,6 +58,8 @@ void minix_free_block(struct inode *inode, unsigned long block);unsigned long minix_count_free_blocks (struct super_block *sb);int minix_getattr (struct mnt_idmap *,const struct path *,struct kstat *,u32 ,unsigned int ); +int minix_setattr (struct mnt_idmap *idmap,struct dentry *dentry, +struct iattr *attr);int minix_prepare_chunk (struct folio *folio,loff_t pos,unsigned len);struct mapping_metadata_bhs *minix_get_metadata_bhs (struct inode *inode);int minix_fsync (struct file *file,loff_t start,loff_t end,int datasync);Signature · 1 line
2.47.3
Re: [PATCH v2 3/4] minix: convert file operations to iomap and add
Quoted 5 lines · Darrick J. Wong
Quoted 1 line · Jeremy Bingham
Subject: [PATCH v2 3/4] minix: convert file operations to iomap and add
...add what?
Ugh, "add direct I/O". When I was preparing the second version of the patches, I screwed up.
Quoted 16 lines
Quoted 16 lines
Replace
generic_file_read_iterandgeneric_file_write_iterwith customminix_file_read_iterandminix_file_write_iterthat dispatch to iomap for both buffered and direct I/O.Buffered writes now go through
iomap_file_buffered_writeinstead of the aops write_begin/write_end path (which no longer exists for regular files). Buffered reads still usegeneric_file_read_iterfor the non-DIO case.Direct I/O is implemented via
iomap_dio_rwfor both reads and writes.minix_dio_read_itertakes a shared inode lock;minix_dio_write_itertakes an exclusive lock, doesgeneric_write_checks, and falls back to buffered writes viaiomap_file_buffered_writefor the tail of a DIO write that is not block-aligned. Theminix_dio_write_end_iocallback updatesi_sizeand marks the inode dirty.
Quoted 4 lines
Quoted 2 lines
minix_file_opensetsFMODE_CAN_ODIRECTso the VFS allowsO_DIRECTopens, andsplice_writeis added to the file operations.Ignore my question about
FMODE_CAN_ODIRECTin the previous patch, then.
Noted.
Quoted 13 lines
fs/minix/file.c int minix_fsync(struct file *file, loff_t start, loff_t end, int datasync) · line 87
Quoted 7 lines
fs/minix/file.c +7
-0+ +if (ret >=0 &&iov_iter_count (from)) { +loff_t pos; +loff_t endbyte; +ssize_t status; + + iocb->ki_flags &= ~IOCB_DIRECT ;Why not set
IOC_DSYNChere and letgeneric_write_syncdo all the flushing work for you? There's no requirement to dump the pagecache after a downgraded direct write, but if you want that, useIOCB_DONTCACHE.
Quoted 1 line
--D
*nod* I will also try this when I'm updating the minix patches.
Thank you again for your comments,
-j
PATCH v2 4/4 minix: fix symlink and truncate for iomap
In reply to Jeremy BinghamThe original minix iomap conversion patches had a couple of issues exposed by syzbot:
1. NULL pointer dereferences in page_symlink. Since the iomap based minix_aops no longer used write_begin and write_end, when page_link attempted to call aops->write_begin there was a crash because there was no longer a pointer assigned to aops->write_begin. This was fixed with a custom function that writes the symlink target directly to a newly allocated data block acquired with minix_new_block and sb_getblk, thus bypassing the aops write path entirely. The symlink read path was in turn replaced with a new minix_get_link that reads the target from the first data block directly with sb_bread, similar to how ext4_get_link does it.
2. Truncate crashed. There was a conflict in minix's truncate() function between buffer_head and iomap where block_truncate_page was attaching buffer_heads to folios, but this ran up against how iomap works. Fixed this by using iomap_truncate_page for inodes using minix_aops and block_truncate_page for inodes with minix_dir_aops.
Also, minix_symlink_inode_operations now has .setattr = minix_setattr so symlinks can be truncated more properly through iomap rather than using the default simple_setattr.
--- fs/minix/inode.c | 4 +- fs/minix/itree_common.c | 11 +++- fs/minix/minix.h | 5 +- fs/minix/namei.c | 137 +++++++++++++++++++++++++++++++++++++++- 4 files changed, 152 insertions(+), 5 deletions(-)
fs/minix/inode.c +2 -2
@@ -573,8 +573,9 @@ static const struct address_space_operations minix_dir_aops = { };static const struct inode_operations minix_symlink_inode_operations = { - .get_link = page_get_link, + .get_link = minix_get_link, .getattr = minix_getattr, + .setattr = minix_setattr, };void minix_set_inode (struct inode *inode,dev_t rdev)
@@ -838,4 +839,3 @@ module_init(init_minix_fs) module_exit(exit_minix_fs) MODULE_DESCRIPTION("Minix file system");MODULE_LICENSE ("GPL" ); -
fs/minix/itree_common.c +10 -1
@@ -311,7 +311,16 @@ static inline void truncate (struct inode * inode)long iblock; iblock = (inode->i_size + sb->s_blocksize -1 ) >> sb->s_blocksize_bits; -block_truncate_page (inode->i_mapping, inode->i_size, get_block); + +/* Depending on what address space operations are being used by the +* inode being truncated, we need to either call iomap_truncate_page or +* block_truncate_page. +*/ +if (inode->i_mapping->a_ops == &minix_aops) +iomap_truncate_page (inode, inode->i_size,NULL , +minix_iomap_ops_ver (inode),NULL ,NULL ); +else +block_truncate_page (inode->i_mapping, inode->i_size, get_block); n =block_to_path (inode, iblock, offsets);if (!n)
fs/minix/minix.h +4 -1
@@ -57,7 +57,7 @@ int minix_new_block(struct inode *inode);void minix_free_block (struct inode *inode,unsigned long block);unsigned long minix_count_free_blocks (struct super_block *sb);int minix_getattr (struct mnt_idmap *,const struct path *, -struct kstat *,u32 ,unsigned int ); +struct kstat *,u32 ,unsigned );int minix_setattr (struct mnt_idmap *idmap,struct dentry *dentry,struct iattr *attr);int minix_prepare_chunk (struct folio *folio,loff_t pos,unsigned len);
@@ -82,6 +82,9 @@ int minix_make_empty(struct inode*, struct inode*);int minix_empty_dir (struct inode *);int minix_set_link (struct minix_dir_entry *de,struct folio *folio,struct inode *inode); +extern const char *minix_get_link (struct dentry *dentry,struct inode *inode, +struct delayed_call *callback); +struct minix_dir_entry *minix_dotdot (struct inode *,struct folio **);ino_t minix_inode_by_name (struct dentry *);
fs/minix/namei.c +136 -1
161 lines not on this page · raw message
Signature · 1 line
2.47.3
syzbot ci has tested the following series
syzbot ci has tested the following series
[v2] minix: convert to iomap and add direct I/O
https://lore.kernel.org/all/[email protected]
* [PATCH v2 1/4] minix: add iomap infrastructure
* [PATCH v2 2/4] minix: convert address space operations to iomap
* [PATCH v2 3/4] minix: convert file operations to iomap and add
* [PATCH v2 4/4] minix: fix symlink and truncate for iomap
and found the following issues:
* BUG: sleeping function called from invalid context in bdev_getblk
* BUG: sleeping function called from invalid context in find_get_block_common
Full report is available here:
https://ci.syzbot.org/series/3b663c96-cf07-46e0-9b8d-785fe615029d
***
BUG: sleeping function called from invalid context in bdev_getblk
tree: torvalds URL: https://kernel.googlesource.com/pub/scm/linux/kernel/git/torvalds/linux base: 780d569e6c4b422290f5cba319eb904b355d64be arch: amd64 compiler: Debian clang version 22.1.6 (++20260514074242+fc4aad7b5db3-1~exp1~20260514074407.73), Debian LLD 22.1.6 config: https://ci.syzbot.org/builds/61f38821-60a2-4c7c-a39e-27291869d296/config syz repro: https://ci.syzbot.org/findings/dda4e5c2-7cbc-498a-98ea-83cad3c680e3/syz_repro
option from the mount to silence this warning.
=======================================================
BUG: sleeping function called from invalid context at ./include/linux/sched/mm.h:323
in_atomic(): 0, irqs_disabled(): 0, non_block: 0, pid: 5865, name: syz.1.18preempt_count: 0, expected: 0
RCU nest depth: 1, expected: 0
1 lock held by syz.1.18/5865:
#0: ffffffff8e959c20 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire include/linux/rcupdate.h:300 [inline] #0: ffffffff8e959c20 (rcu_read_lock){....}-{1:3}, at: rcu_read_lock include/linux/rcupdate.h:840 [inline] #0: ffffffff8e959c20 (rcu_read_lock){....}-{1:3}, at: path_init+0x124/0x1330 fs/namei.c:2689
CPU: 1 UID: 0 PID: 5865 Comm: syz.1.18 Not tainted syzkaller #0 PREEMPT(full) Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.16.2-debian-1.16.2-1 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0xe8/0x150 lib/dump_stack.c:120 __might_resched+0x378/0x4d0 kernel/sched/core.c:9197 might_alloc include/linux/sched/mm.h:323 [inline] bdev_getblk+0xce/0x6e0 fs/buffer.c:1435 __bread_gfp+0x89/0x380 fs/buffer.c:1493 sb_bread include/linux/buffer_head.h:348 [inline] minix_get_link+0x143/0x340 fs/minix/namei.c:396 pick_link+0x782/0xfe0 fs/namei.c:2064 step_into_slowpath+0x58a/0x820 fs/namei.c:2127 step_into fs/namei.c:2152 [inline] open_last_lookups fs/namei.c:4643 [inline] path_openat+0x224e/0x3830 fs/namei.c:4856 do_file_open+0x23e/0x4a0 fs/namei.c:4888 do_sys_openat2+0x115/0x200 fs/open.c:1368 do_sys_open fs/open.c:1374 [inline] __do_sys_openat fs/open.c:1390 [inline] __se_sys_openat fs/open.c:1385 [inline] __x64_sys_openat+0x138/0x170 fs/open.c:1385 do_syscall_x64 arch/x86/entry/syscall_64.c:63 [inline] do_syscall_64+0x174/0x580 arch/x86/entry/syscall_64.c:94 entry_SYSCALL_64_after_hwframe+0x77/0x7f RIP: 0033:0x7f9618b9ce59 Code: ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 c7 c1 e8 ff ff ff f7 d8 64 89 01 48 RSP: 002b:00007f9619a29028 EFLAGS: 00000246 ORIG_RAX: 0000000000000101 RAX: ffffffffffffffda RBX: 00007f9618e15fa0 RCX: 00007f9618b9ce59 RDX: 0000000000105042 RSI: 0000200000000080 RDI: ffffffffffffff9c RBP: 00007f9618c32e6f R08: 0000000000000000 R09: 0000000000000000 R10: 00000000000001ff R11: 0000000000000246 R12: 0000000000000000 R13: 00007f9618e16038 R14: 00007f9618e15fa0 R15: 00007fffce8916b8 </TASK>
***
BUG: sleeping function called from invalid context in find_get_block_common
tree: torvalds URL: https://kernel.googlesource.com/pub/scm/linux/kernel/git/torvalds/linux base: 780d569e6c4b422290f5cba319eb904b355d64be arch: amd64 compiler: Debian clang version 22.1.6 (++20260514074242+fc4aad7b5db3-1~exp1~20260514074407.73), Debian LLD 22.1.6 config: https://ci.syzbot.org/builds/61f38821-60a2-4c7c-a39e-27291869d296/config syz repro: https://ci.syzbot.org/findings/2af8da3b-836a-479e-9af0-fef473c2f315/syz_repro
loop2: detected capacity change from 0 to 64
bad symlink on inode 4
BUG: sleeping function called from invalid context at ./include/linux/pagemap.h:1155
in_atomic(): 0, irqs_disabled(): 0, non_block: 0, pid: 5813, name: syz.2.19preempt_count: 0, expected: 0
RCU nest depth: 1, expected: 0
1 lock held by syz.2.19/5813:
#0: ffffffff8e959c20 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire include/linux/rcupdate.h:300 [inline] #0: ffffffff8e959c20 (rcu_read_lock){....}-{1:3}, at: rcu_read_lock include/linux/rcupdate.h:840 [inline] #0: ffffffff8e959c20 (rcu_read_lock){....}-{1:3}, at: path_init+0x124/0x1330 fs/namei.c:2689
CPU: 1 UID: 0 PID: 5813 Comm: syz.2.19 Not tainted syzkaller #0 PREEMPT(full) Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.16.2-debian-1.16.2-1 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0xe8/0x150 lib/dump_stack.c:120 __might_resched+0x378/0x4d0 kernel/sched/core.c:9197 folio_lock include/linux/pagemap.h:1155 [inline] __find_get_block_slow fs/buffer.c:242 [inline] find_get_block_common+0x2d0/0xe10 fs/buffer.c:1386 bdev_getblk+0x58/0x6e0 include/linux/gfp.h:-1 __bread_gfp+0x89/0x380 fs/buffer.c:1493 sb_bread include/linux/buffer_head.h:348 [inline] minix_get_link+0x143/0x340 fs/minix/namei.c:396 pick_link+0x782/0xfe0 fs/namei.c:2064 step_into_slowpath+0x58a/0x820 fs/namei.c:2127 step_into fs/namei.c:2152 [inline] open_last_lookups fs/namei.c:4643 [inline] path_openat+0x224e/0x3830 fs/namei.c:4856 do_file_open+0x23e/0x4a0 fs/namei.c:4888 do_sys_openat2+0x115/0x200 fs/open.c:1368 do_sys_open fs/open.c:1374 [inline] __do_sys_openat fs/open.c:1390 [inline] __se_sys_openat fs/open.c:1385 [inline] __x64_sys_openat+0x138/0x170 fs/open.c:1385 do_syscall_x64 arch/x86/entry/syscall_64.c:63 [inline] do_syscall_64+0x174/0x580 arch/x86/entry/syscall_64.c:94 entry_SYSCALL_64_after_hwframe+0x77/0x7f RIP: 0033:0x7fd37ef9ce59 Code: ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 c7 c1 e8 ff ff ff f7 d8 64 89 01 48 RSP: 002b:00007fd37fe06028 EFLAGS: 00000246 ORIG_RAX: 0000000000000101 RAX: ffffffffffffffda RBX: 00007fd37f215fa0 RCX: 00007fd37ef9ce59 RDX: 0000000000000042 RSI: 0000200000000080 RDI: ffffffffffffff9c RBP: 00007fd37f032e6f R08: 0000000000000000 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 R13: 00007fd37f216038 R14: 00007fd37f215fa0 R15: 00007ffe5e5f14f8 </TASK>
bad symlink on inode 4
***
If these findings have caused you to resend the series or submit a separate fix, please add the following tag to your commit message:
---
This report is generated by a bot. It may contain errors. syzbot ci engineers can be reached at [email protected].
To test a patch for this bug, please reply with #syz test (should be on a separate line).
The patch should be attached to the email.
Note: arguments like custom git repos and branches are not supported.
#syz test
minix: add the same dentry check as ext4_get_link to minix_get_link
It turns out that minix_get_link does need to have both the sb_bread and the sb_getblk paths, like ext4_get_link does. It working with just the sb_bread one initially was deceptive.
--- fs/minix/namei.c | 23 +++++++++++++++++------ 1 file changed, 17 insertions(+), 6 deletions(-)
fs/minix/namei.c +17 -6
@@ -393,12 +393,23 @@ const char *minix_get_link(struct dentry *dentry, struct inode *inode,else blk =v2_block_to_cpu (*(v2_i_data (inode))); - bh =sb_bread (sb, blk); -if (IS_ERR (bh)) -return ERR_CAST (bh); -if (!bh) { -pr_err ("bad symlink on inode %llu" , inode->i_ino); -return ERR_PTR (-EFSCORRUPTED ); +/* This tried dodging the dentry check that ext4 does, but it turns out +* that it's necessary after all. +*/ +if (!dentry) { + bh =sb_getblk (sb, blk); +if (!bh || !buffer_uptodate (bh)) { +brelse (bh); +return ERR_PTR (-ECHILD ); + } + }else { + bh =sb_bread (sb, blk); +if (IS_ERR (bh)) +return ERR_CAST (bh); +if (!bh) { +pr_err ("bad symlink on inode %llu" , inode->i_ino); +return ERR_PTR (-EFSCORRUPTED ); + } }set_delayed_call (callback, minix_free_link, bh);
Signature · 1 line
2.47.3
syzbot ci
syzbotsyzbot ci has tested the suggested fix patch on top of the following series:
syzbot ci has tested the suggested fix patch on top of the following series:
[v2] minix: convert to iomap and add direct I/O
https://lore.kernel.org/all/[email protected]
Patch: https://ci.syzbot.org/jobs/fb0b2cff-4f4e-442b-a6f8-5fa767f200fc/patch
Testing results:
* [build 0] Build Patched: passed
* [build 0] Boot test: Patched: passed
Full report is available here:
https://ci.syzbot.org/session/4d7ba7ce-a1cf-4df0-b856-6be6475a5498
---
This report is generated by a bot. It may contain errors. syzbot ci engineers can be reached at [email protected].
Quoted 19 lines · Jeremy Bingham
This is v2 of the minix iomap conversion series. The original v1 submission (3 patches) was tested by syzbot, which found four issues. Three were straightforward; the fourth, a null pointer dereference in
page_symlinkwhen creating symlinks, required more substantial changes.The original description follows:
This series converts the minix filesystem from the buffer_head-based I/O path to the iomap API, and adds direct I/O support in the process.
The conversion is straightforward: minix's indirect block tree mapping logic (from
itree_common.c) is reworked into an iomap_begin/iomap_end implementation. Theiomap_endcallback is a no-op since minix has no extents or transactions to finalize.Patch 1 adds the iomap infrastructure: the new
iomap.cfile, wrapper functions andiomap_opsstructs initree_v1.canditree_v2.c, and the relevant declarations inminix.h.
Quoted 7 lines
The
iomap.cfile is #include'd intoitree_v1.canditree_v2.crather than compiled as a standalone translation unit. This is because the minix filesystem versions (V1 vs V2/V3) have differentblock_tsizes (16-bit vs 32-bit) and different indirect tree depths. This follows the existing pattern in minix whereitree_common.cis included into bothitree_v1.canditree_v2.c. Each version provides a thin wrapper and a correspondingiomap_opsstruct.
Yuck. I guess that's /one/ way to avoid having a geometry struct capturing those details... :(
Quoted 15 lines
Patch 2 converts the regular file address space operations to iomap:
read_folio, readahead, writepages (with a writeback callback), bmap, and folio lifecycle helpers. Directory inodes continue to use buffer_head-based operations via a newminix_dir_aops, since directory handling still relies on buffer head chunks for prepare/write_begin.Patch 3 converts the
file_operations: replacing the generic read/write iterators with iomap-aware versions, adding direct I/O read/write paths usingiomap_dio_rw, and settingFMODE_CAN_ODIRECTin the open handler.The minix iomap implementation was adapted from the out-of-tree xiafs iomap conversion. The xiafs module itself borrowed heavily from the modernized minix kernel module. The exfat iomap changes were an additional reference for both conversions.
Quoted 5 lines
Changes since v1:
* Added a fourth patch to fix the symlink and truncate issues:
- Replacedpage_symlinkwith a custom__page_symlinkthat writes the target directly to a data block viaminix_new_block+
Sounds to me like it's time to write iomap_write_symlink.
int
iomap_symlink_write(struct inode *inode, const char *target, int len,
const struct iomap_ops *ops,
const struct iomap_write_ops *write_ops, void *private)
{
struct kvec vec = {
.iov_base = target,
.iov_len = len,
};
struct iomap_iter iter = {
.inode = inode,
.pos = 0,
.len = len,
.flags = IOMAP_WRITE,
.private = private,
};
struct iov_iter iov;
int ret;
iov_iter_kvec(&iov, ITER_SRC, &vec, 1, iov.iov_len);
while ((ret = iomap_iter(&iter, ops)) > 0)
iter.status = iomap_write_iter(&iter, &iov, write_ops);
if (unlikely(iter.pos == 0))
return ret;
mark_inode_dirty(inode);
return 0;
}EXPORT_SYMBOL_GPL(iomap_symlink_write);
Quoted 5 lines
sb_getblk, bypassing the aops write path (which no longer has write_begin/write_end). Added a matching customminix_get_linkthat reads the target from the data block viasb_bread, similar toext4_get_link. No iomap-based filesystem in the kernel usespage_symlink; XFS, GFS2, and ext4 all handle symlink storage
That's because they embed headers and crcs in the symlink file data and/or do fancy things with inline targets. xfs has its own buffer cache, so there's no need to duplicate it with the pagecache and then have to interpret ondisk formats.
Quoted 52 lines
directly. The on-disk format is unchanged.
- Fixed a buffer_head/iomap type confusion in truncate:
block_truncate_pageattachesbuffer_headsto data folios, butminix_aopsnow uses iomap which interpretsfolio->privateas structiomap_folio_state.truncate()now dispatches betweeniomap_truncate_page(for regular files/symlinks) andblock_truncate_page(for directories) based on the inode's aops.
- Added .setattr =minix_setattrtominix_symlink_inode_operationsso symlinks truncate properly through the iomap path.* Patch 1 (iomap infrastructure):
minix_get_blockis now exported (non-static) so the directory aops and iomap writeback path can use it. Addedminix_iomap_ops_ver()inline helper and extern declarations forminix_aopsand the version-specificiomap_ops. Fixed unsigned -> unsigned int inminix_blocks_neededandminix_find_first_zero_bitto silence checkpatch warnings.* Patch 2 (aops conversion): unchanged in approach; minor cleanup of the writeback callback and
minix_bmapconversion.* Patch 3 (file operations):
minix_setattris now exported for reuse by the symlink inode operations in patch 4.Testing: the full series has been tested with mkfs.minix V1/V2/V3, exercising file creation, read/write, overwrite, append, binary data, directories, symlinks (full path, relative, directory symlinks), hard links, truncation (shrink/grow), large files (1MB, exercising indirect blocks), deep nesting (20 levels), 100 files in one directory, deletions, remount persistence, and fsck.minix. All pass cleanly. The four syzbot-reported issues are resolved.
Jeremy Bingham (4):
minix: add iomap infrastructure
minix: convert address space operations to iomap
minix: convert file operations to iomap and add direct I/O
minix: fix symlilnk and truncate for iomap compatibilityfs/minix/file.c | 157 ++++++++++++++++++++++++++++++++++++++-- fs/minix/inode.c | 90 ++++++++++++++++++++--- fs/minix/iomap.c | 114 +++++++++++++++++++++++++++++ fs/minix/itree_common.c | 11 ++- fs/minix/itree_v1.c | 25 ++++++- fs/minix/itree_v2.c | 17 ++++- fs/minix/minix.h | 30 +++++++- fs/minix/namei.c | 137 ++++++++++++++++++++++++++++++++++- 8 files changed, 558 insertions(+), 23 deletions(-) create mode 100644 fs/minix/iomap.cSignature · 1 line
2.47.3
Quoted 10 lines · Darrick J. Wong
Quoted 7 lines · Jeremy Bingham
The
iomap.cfile is #include'd intoitree_v1.canditree_v2.crather than compiled as a standalone translation unit. This is because the minix filesystem versions (V1 vs V2/V3) have differentblock_tsizes (16-bit vs 32-bit) and different indirect tree depths. This follows the existing pattern in minix whereitree_common.cis included into bothitree_v1.canditree_v2.c. Each version provides a thin wrapper and a correspondingiomap_opsstruct.
Quoted 2 lines
Yuck. I guess that's /one/ way to avoid having a geometry struct capturing those details... :(
It's all absolutely hideous. I've hated the way the minix module #includes itree_common.c like that with the separate itree_v1.c and itree_v2.c for years, but it's also been like that for so long that changing it is intimidating.
I could address it in this patch, if it's not out of scope. (Also I thought I had
already responded to this, my apologies.)
Quoted 38 lines
Quoted 5 lines
Changes since v1:
* Added a fourth patch to fix the symlink and truncate issues:
- Replacedpage_symlinkwith a custom__page_symlinkthat writes the target directly to a data block viaminix_new_block+Sounds to me like it's time to write
iomap_write_symlink.int
iomap_symlink_write(struct inode *inode, const char *target, int len,
const structiomap_ops*ops,
const structiomap_write_ops*write_ops, void *private){ struct kvec vec = { .iov_base = target, .iov_len = len, }; struct iomap_iter iter = { .inode = inode, .pos = 0, .len = len, .flags = IOMAP_WRITE, .private = private, }; struct iov_iter iov; int ret; iov_iter_kvec(&iov, ITER_SRC, &vec, 1, iov.iov_len); while ((ret = iomap_iter(&iter, ops)) > 0) iter.status = iomap_write_iter(&iter, &iov, write_ops); if (unlikely(iter.pos == 0)) return ret; mark_inode_dirty(inode); return 0; }
Quoted 1 line
EXPORT_SYMBOL_GPL(iomap_symlink_write);
Noted. I'll take this and the __page_symlink I originally made, smoosh them together as or if needed, and put it in fs/iomap.c.
Quoted 10 lines
Quoted 5 lines
sb_getblk, bypassing the aops write path (which no longer has write_begin/write_end). Added a matching customminix_get_linkthat reads the target from the data block viasb_bread, similar toext4_get_link. No iomap-based filesystem in the kernel usespage_symlink; XFS, GFS2, and ext4 all handle symlink storageThat's because they embed headers and crcs in the symlink file data and/or do fancy things with inline targets. xfs has its own buffer cache, so there's no need to duplicate it with the pagecache and then have to interpret ondisk formats.
Also noted.
Thanks again,
-j
Quoted 52 lines
Quoted 52 lines
directly. The on-disk format is unchanged.
- Fixed a buffer_head/iomap type confusion in truncate:
block_truncate_pageattachesbuffer_headsto data folios, butminix_aopsnow uses iomap which interpretsfolio->privateas structiomap_folio_state.truncate()now dispatches betweeniomap_truncate_page(for regular files/symlinks) andblock_truncate_page(for directories) based on the inode's aops.
- Added .setattr =minix_setattrtominix_symlink_inode_operationsso symlinks truncate properly through the iomap path.* Patch 1 (iomap infrastructure):
minix_get_blockis now exported (non-static) so the directory aops and iomap writeback path can use it. Addedminix_iomap_ops_ver()inline helper and extern declarations forminix_aopsand the version-specificiomap_ops. Fixed unsigned -> unsigned int inminix_blocks_neededandminix_find_first_zero_bitto silence checkpatch warnings.* Patch 2 (aops conversion): unchanged in approach; minor cleanup of the writeback callback and
minix_bmapconversion.* Patch 3 (file operations):
minix_setattris now exported for reuse by the symlink inode operations in patch 4.Testing: the full series has been tested with mkfs.minix V1/V2/V3, exercising file creation, read/write, overwrite, append, binary data, directories, symlinks (full path, relative, directory symlinks), hard links, truncation (shrink/grow), large files (1MB, exercising indirect blocks), deep nesting (20 levels), 100 files in one directory, deletions, remount persistence, and fsck.minix. All pass cleanly. The four syzbot-reported issues are resolved.
Jeremy Bingham (4):
minix: add iomap infrastructure
minix: convert address space operations to iomap
minix: convert file operations to iomap and add direct I/O
minix: fix symlilnk and truncate for iomap compatibilityfs/minix/file.c | 157 ++++++++++++++++++++++++++++++++++++++-- fs/minix/inode.c | 90 ++++++++++++++++++++--- fs/minix/iomap.c | 114 +++++++++++++++++++++++++++++ fs/minix/itree_common.c | 11 ++- fs/minix/itree_v1.c | 25 ++++++- fs/minix/itree_v2.c | 17 ++++- fs/minix/minix.h | 30 +++++++- fs/minix/namei.c | 137 ++++++++++++++++++++++++++++++++++- 8 files changed, 558 insertions(+), 23 deletions(-) create mode 100644 fs/minix/iomap.c--
2.47.3