iomap: Fix leakage of pipe pages while splicing
Subsystems (3)
Jan Kara
reviewercover iomap: Fix leakage of pipe pages while splicing
Hello,
here is a fix and a cleanup for iomap code. The first patch fixes a leakage of pipe pages when iomap_dio_rw() splices to a pipe, the second patch is a cleanup that removes strange copying of iter in iomap_dio_rw(). Patches have passed fstests for ext4 and xfs and fix the syzkaller reproducer for me.
Honza
Jan Kara
reviewerPATCH 1/2 iomap: Fix pipe page leakage during splicing
When splicing using iomap_dio_rw() to a pipe, we may leak pipe pages because bio_iov_iter_get_pages() records that the pipe will have full extent worth of data however if file size is not block size aligned iomap_dio_rw() returns less than what bio_iov_iter_get_pages() set up and splice code gets confused leaking a pipe page with the file tail.
Handle the situation similarly to the old direct IO implementation and revert iter to actually returned read amount which makes iter consistent with value returned from iomap_dio_rw() and thus the splice code is happy.
--- fs/iomap/direct-io.c | 9 ++++++++- 1 file changed, 8 insertions(+), 1 deletion(-)
fs/iomap/direct-io.c +8 -1
@@ -497,8 +497,15 @@ iomap_dio_rw(struct kiocb *iocb, struct iov_iter *iter, } pos += ret; -if (iov_iter_rw (iter) ==READ && pos >= dio->i_size) +if (iov_iter_rw (iter) ==READ && pos >= dio->i_size) { +/* +* We will report we've read data only upto i_size. +* Revert iter to a state corresponding to that as +* some callers (such as splice code) rely on it. +*/ +iov_iter_revert (iter, pos - dio->i_size);break ; + } }while ((count =iov_iter_count (iter)) >0 );blk_finish_plug (&plug);
Signature · 1 line
2.16.4
Re: [PATCH 1/2] iomap: Fix pipe page leakage during splicing
Quoted 24 lines · Jan Kara
When splicing using
iomap_dio_rw()to a pipe, we may leak pipe pages becausebio_iov_iter_get_pages()records that the pipe will have full extent worth of data however if file size is not block size alignediomap_dio_rw()returns less than whatbio_iov_iter_get_pages()set up and splice code gets confused leaking a pipe page with the file tail.Handle the situation similarly to the old direct IO implementation and revert iter to actually returned read amount which makes iter consistent with value returned from
iomap_dio_rw()and thus the splice code is happy.Fixes ff6a9292e6f6 ("iomap: implement direct I/O")Reported-by [email protected]Signed-off-by Jan Kara <[email protected]>--- fs/iomap/direct-io.c | 9 ++++++++- 1 file changed, 8 insertions(+), 1 deletion(-)fs/iomap/direct-io.c +0
-0
fs/iomap/direct-io.c iomap_dio_rw(struct kiocb *iocb, struct iov_iter *iter, · line 502
Quoted 7 lines
fs/iomap/direct-io.c +3
-1@@ -497,8 +497,15 @@ iomap_dio_rw(struct kiocb *iocb, struct iov_iter *iter, } pos += ret; -if (iov_iter_rw (iter) ==READ && pos >= dio->i_size) +if (iov_iter_rw (iter) ==READ && pos >= dio->i_size) { +/* +* We will report we've read data only upto i_size.
Nit: "up to"; will fix that on the way in.
fs/iomap/direct-io.c iomap_dio_rw(struct kiocb *iocb, struct iov_iter *iter, · line 506
Quoted 4 lines
fs/iomap/direct-io.c +4
-0+* Revert iter to a state corresponding to that as +* some callers (such as splice code) rely on it. +*/ +iov_iter_revert (iter, pos - dio->i_size);
Just to make sure I'm getting this right, iov_iter_revert walks the iterator variables backwards through pipe buffers/bvec/iovec, which has the effect of undoing whatever iterator walking we've just done.
In contrast, iov_iter_reexpand undoes a previous subtraction to iov->count which was (presumably) done via iov_iter_truncate.
Or to put it another way, _revert walks the iteration pointer backwards, whereas _truncate/_reexpand modify where the iteration ends. Right?
--D
Quoted 8 lines
fs/iomap/direct-io.c +1
-0break ; + } }while ((count =iov_iter_count (iter)) >0 );blk_finish_plug (&plug);Signature · 1 line
2.16.4
Re: [PATCH 1/2] iomap: Fix pipe page leakage during splicing
Quoted 11 lines · Darrick J. Wong
fs/iomap/direct-io.c iomap_dio_rw(struct kiocb *iocb, struct iov_iter *iter, · line 502
Quoted 8 lines · Jan Kara
fs/iomap/direct-io.c +3
-1@@ -497,8 +497,15 @@ iomap_dio_rw(struct kiocb *iocb, struct iov_iter *iter, } pos += ret; -if (iov_iter_rw (iter) ==READ && pos >= dio->i_size) +if (iov_iter_rw (iter) ==READ && pos >= dio->i_size) { +/* +* We will report we've read data only upto i_size. Nit: "up to"; will fix that on the way in.
A nit of a nit: "We will report that we've read..."; I think it reads better, so might as well update it if you're already fixing the other nit up as you're pulling this in. :P
/M
Jan Kara
reviewerRe: [PATCH 1/2] iomap: Fix pipe page leakage during splicing
In reply to Darrick J. WongQuoted 44 lines · Darrick J. Wong
Quoted 24 lines · Jan Kara
When splicing using
iomap_dio_rw()to a pipe, we may leak pipe pages becausebio_iov_iter_get_pages()records that the pipe will have full extent worth of data however if file size is not block size alignediomap_dio_rw()returns less than whatbio_iov_iter_get_pages()set up and splice code gets confused leaking a pipe page with the file tail.Handle the situation similarly to the old direct IO implementation and revert iter to actually returned read amount which makes iter consistent with value returned from
iomap_dio_rw()and thus the splice code is happy.Fixes ff6a9292e6f6 ("iomap: implement direct I/O")Reported-by [email protected]Signed-off-by Jan Kara <[email protected]>--- fs/iomap/direct-io.c | 9 ++++++++- 1 file changed, 8 insertions(+), 1 deletion(-)fs/iomap/direct-io.c +0
-0fs/iomap/direct-io.c iomap_dio_rw(struct kiocb *iocb, struct iov_iter *iter, · line 502
Quoted 7 lines
fs/iomap/direct-io.c +3
-1@@ -497,8 +497,15 @@ iomap_dio_rw(struct kiocb *iocb, struct iov_iter *iter, } pos += ret; -if (iov_iter_rw (iter) ==READ && pos >= dio->i_size) +if (iov_iter_rw (iter) ==READ && pos >= dio->i_size) { +/* +* We will report we've read data only upto i_size. Nit: "up to"; will fix that on the way in.
fs/iomap/direct-io.c iomap_dio_rw(struct kiocb *iocb, struct iov_iter *iter, · line 506
Quoted 4 lines
fs/iomap/direct-io.c +4
-0+* Revert iter to a state corresponding to that as +* some callers (such as splice code) rely on it. +*/ +iov_iter_revert (iter, pos - dio->i_size);Just to make sure I'm getting this right,
iov_iter_revertwalks the iterator variables backwards through pipe buffers/bvec/iovec, which has the effect of undoing whatever iterator walking we've just done.
Quoted 5 lines
In contrast,
iov_iter_reexpandundoes a previous subtraction toiov->countwhich was (presumably) done viaiov_iter_truncate.Or to put it another way,
_revertwalks the iteration pointer backwards, whereas _truncate/_reexpand modify where the iteration ends. Right?
Correct.
Quoted 1 line
Reviewed-by Darrick J. Wong <[email protected]>
Thanks!
Honza
Signature · 2 lines
Jan Kara <[email protected]> SUSE Labs, CR
Re: [PATCH 1/2] iomap: Fix pipe page leakage during splicing
In reply to Jan KaraLooks good modulo the spelling critique:
Jan Kara
reviewerPATCH 2/2 iomap: Do not create fake iter in iomap_dio_bio_actor()
In reply to Jan Karaiomap_dio_bio_actor() copies iter to a local variable and then limits it to a file extent we have mapped. When IO is submitted, iomap_dio_bio_actor() advances the original iter while the copied iter is advanced inside bio_iov_iter_get_pages(). This logic is non-obvious especially because both iters still point to same shared structures (such as pipe info) so if iov_iter_advance() changes anything in the shared structure, this scheme breaks. Let's just truncate and reexpand the original iter as needed instead of playing games with copying iters and keeping them in sync.
--- fs/iomap/direct-io.c | 25 ++++++++++++------------- 1 file changed, 12 insertions(+), 13 deletions(-)
fs/iomap/direct-io.c +12 -13
@@ -201,12 +201,12 @@ iomap_dio_bio_actor(struct inode *inode, loff_t pos, loff_t length,unsigned int blkbits =blksize_bits (bdev_logical_block_size (iomap->bdev));unsigned int fs_block_size =i_blocksize (inode), pad;unsigned int align =iov_iter_alignment (dio->submit.iter); -struct iov_iter iter;struct bio *bio;bool need_zeroout = false;bool use_fua = false;int nr_pages, ret =0 ;size_t copied =0 ; +size_t orig_count =iov_iter_count (dio->submit.iter);if ((pos | length | align) & ((1 << blkbits) -1 ))return -EINVAL ;
@@ -235,16 +235,14 @@ iomap_dio_bio_actor(struct inode *inode, loff_t pos, loff_t length, use_fua = true; } -/* -* Operate on a partial iter trimmed to the extent we were called for. -* We'll update the iter in the dio once we're done with this extent. -*/ - iter = *dio->submit.iter; -iov_iter_truncate (&iter, length); +/* Operate on a partial iter trimmed to the extent we were called for */ +iov_iter_truncate (dio->submit.iter, length); - nr_pages =iov_iter_npages (&iter,BIO_MAX_PAGES ); -if (nr_pages <=0 ) + nr_pages =iov_iter_npages (dio->submit.iter,BIO_MAX_PAGES ); +if (nr_pages <=0 ) { +iov_iter_reexpand (dio->submit.iter, orig_count);return nr_pages; + }if (need_zeroout) {/* zero out from the start of the block to the write offset */
@@ -257,6 +255,7 @@ iomap_dio_bio_actor(struct inode *inode, loff_t pos, loff_t length,size_t n;if (dio->error) {iov_iter_revert (dio->submit.iter, copied); +iov_iter_reexpand (dio->submit.iter, orig_count);return 0 ; }
@@ -268,7 +267,7 @@ iomap_dio_bio_actor(struct inode *inode, loff_t pos, loff_t length, bio->bi_private = dio; bio->bi_end_io = iomap_dio_bio_end_io; - ret =bio_iov_iter_get_pages (bio, &iter); + ret =bio_iov_iter_get_pages (bio, dio->submit.iter);if (unlikely (ret)) {/* * We have to stop part way through an IO. We must fall
@@ -294,13 +293,11 @@ iomap_dio_bio_actor(struct inode *inode, loff_t pos, loff_t length,bio_set_pages_dirty (bio); } -iov_iter_advance (dio->submit.iter, n); - dio->size += n; pos += n; copied += n; - nr_pages =iov_iter_npages (&iter,BIO_MAX_PAGES ); + nr_pages =iov_iter_npages (dio->submit.iter,BIO_MAX_PAGES );iomap_dio_submit_bio (dio, iomap, bio); }while (nr_pages);
@@ -318,6 +315,8 @@ iomap_dio_bio_actor(struct inode *inode, loff_t pos, loff_t length,if (pad)iomap_dio_zero (dio, iomap, pos, fs_block_size - pad); } +/* Undo iter limitation to current extent */ +iov_iter_reexpand (dio->submit.iter, orig_count - copied);return copied ? copied : ret; }
Signature · 1 line
2.16.4
Re: [PATCH 2/2] iomap: Do not create fake iter in iomap_dio_bio_actor()
Quoted 35 lines · Jan Kara
iomap_dio_bio_actor()copies iter to a local variable and then limits it to a file extent we have mapped. When IO is submitted,iomap_dio_bio_actor()advances the original iter while the copied iter is advanced insidebio_iov_iter_get_pages(). This logic is non-obvious especially because both iters still point to same shared structures (such as pipe info) so ifiov_iter_advance()changes anything in the shared structure, this scheme breaks. Let's just truncate and reexpand the original iter as needed instead of playing games with copying iters and keeping them in sync.Signed-off-by Jan Kara <[email protected]>--- fs/iomap/direct-io.c | 25 ++++++++++++------------- 1 file changed, 12 insertions(+), 13 deletions(-)fs/iomap/direct-io.c +1
-1@@ -201,12 +201,12 @@ iomap_dio_bio_actor(struct inode *inode, loff_t pos, loff_t length,unsigned int blkbits =blksize_bits (bdev_logical_block_size (iomap->bdev));unsigned int fs_block_size =i_blocksize (inode), pad;unsigned int align =iov_iter_alignment (dio->submit.iter); -struct iov_iter iter;struct bio *bio;bool need_zeroout = false;bool use_fua = false;int nr_pages, ret =0 ;size_t copied =0 ; +size_t orig_count =iov_iter_count (dio->submit.iter);if ((pos | length | align) & ((1 << blkbits) -1 ))return -EINVAL ;@@ -235,16 +235,14 @@ iomap_dio_bio_actor(struct inode *inode, loff_t pos, loff_t length, use_fua = true;
fs/iomap/direct-io.c iomap_dio_bio_actor(struct inode *inode, loff_t pos, loff_t length, · line 239
Quoted 10 lines
fs/iomap/direct-io.c +2
-6} -/* -* Operate on a partial iter trimmed to the extent we were called for. -* We'll update the iter in the dio once we're done with this extent. -*/ - iter = *dio->submit.iter; -iov_iter_truncate (&iter, length); +/* Operate on a partial iter trimmed to the extent we were called for */ +iov_iter_truncate (dio->submit.iter, length);
Ok... so here we shorten the dio iterator to fit the mapping we got...
fs/iomap/direct-io.c iomap_dio_bio_actor(struct inode *inode, loff_t pos, loff_t length, · line 244
Quoted 7 lines
fs/iomap/direct-io.c +3
-2- nr_pages =iov_iter_npages (&iter,BIO_MAX_PAGES ); -if (nr_pages <=0 ) + nr_pages =iov_iter_npages (dio->submit.iter,BIO_MAX_PAGES ); +if (nr_pages <=0 ) { +iov_iter_reexpand (dio->submit.iter, orig_count);return nr_pages;
...and if there aren't any pages, we revert the truncation and bail...
fs/iomap/direct-io.c iomap_dio_bio_actor(struct inode *inode, loff_t pos, loff_t length, · line 258
Quoted 9 lines
fs/iomap/direct-io.c +2
-0+ }if (need_zeroout) {/* zero out from the start of the block to the write offset */ @@ -257,6 +255,7 @@ iomap_dio_bio_actor(struct inode *inode, loff_t pos, loff_t length,size_t n;if (dio->error) {iov_iter_revert (dio->submit.iter, copied); +iov_iter_reexpand (dio->submit.iter, orig_count);
...if the bio failed, we walk the dio iterator backward the entire amount that it had advanced, undo the length truncation and bail...
fs/iomap/direct-io.c iomap_dio_bio_actor(struct inode *inode, loff_t pos, loff_t length, · line 270
Quoted 9 lines
fs/iomap/direct-io.c +1
-1return 0 ; }@@ -268,7 +267,7 @@ iomap_dio_bio_actor(struct inode *inode, loff_t pos, loff_t length, bio->bi_private = dio; bio->bi_end_io = iomap_dio_bio_end_io; - ret =bio_iov_iter_get_pages (bio, &iter); + ret =bio_iov_iter_get_pages (bio, dio->submit.iter);
...here's where we walk the dio iter forward as part of attaching pages to the bio...
Quoted 19 lines
fs/iomap/direct-io.c +1
-3if (unlikely (ret)) {/* * We have to stop part way through an IO. We must fall @@ -294,13 +293,11 @@ iomap_dio_bio_actor(struct inode *inode, loff_t pos, loff_t length,bio_set_pages_dirty (bio); } -iov_iter_advance (dio->submit.iter, n); - dio->size += n; pos += n; copied += n; - nr_pages =iov_iter_npages (&iter,BIO_MAX_PAGES ); + nr_pages =iov_iter_npages (dio->submit.iter,BIO_MAX_PAGES );iomap_dio_submit_bio (dio, iomap, bio); }while (nr_pages);
fs/iomap/direct-io.c iomap_dio_bio_actor(struct inode *inode, loff_t pos, loff_t length, · line 319
Quoted 5 lines
fs/iomap/direct-io.c +2
-0@@ -318,6 +315,8 @@ iomap_dio_bio_actor(struct inode *inode, loff_t pos, loff_t length,if (pad)iomap_dio_zero (dio, iomap, pos, fs_block_size - pad); } +/* Undo iter limitation to current extent */ +iov_iter_reexpand (dio->submit.iter, orig_count - copied);
...and here we undo the length truncation, same as all the other exit points. Assuming my understanding of the bookkeeping is correct,
(Would still like to see a proper regression test for fstests though...)
--D
Quoted 6 lines
fs/iomap/direct-io.c +0
-0return copied ? copied : ret; }Signature · 1 line
2.16.4
Jan Kara
reviewerRe: [PATCH 2/2] iomap: Do not create fake iter in iomap_dio_bio_actor()
Quoted 103 lines · Darrick J. Wong
Quoted 35 lines · Jan Kara
iomap_dio_bio_actor()copies iter to a local variable and then limits it to a file extent we have mapped. When IO is submitted,iomap_dio_bio_actor()advances the original iter while the copied iter is advanced insidebio_iov_iter_get_pages(). This logic is non-obvious especially because both iters still point to same shared structures (such as pipe info) so ifiov_iter_advance()changes anything in the shared structure, this scheme breaks. Let's just truncate and reexpand the original iter as needed instead of playing games with copying iters and keeping them in sync.Signed-off-by Jan Kara <[email protected]>--- fs/iomap/direct-io.c | 25 ++++++++++++------------- 1 file changed, 12 insertions(+), 13 deletions(-)fs/iomap/direct-io.c +1
-1@@ -201,12 +201,12 @@ iomap_dio_bio_actor(struct inode *inode, loff_t pos, loff_t length,unsigned int blkbits =blksize_bits (bdev_logical_block_size (iomap->bdev));unsigned int fs_block_size =i_blocksize (inode), pad;unsigned int align =iov_iter_alignment (dio->submit.iter); -struct iov_iter iter;struct bio *bio;bool need_zeroout = false;bool use_fua = false;int nr_pages, ret =0 ;size_t copied =0 ; +size_t orig_count =iov_iter_count (dio->submit.iter);if ((pos | length | align) & ((1 << blkbits) -1 ))return -EINVAL ;@@ -235,16 +235,14 @@ iomap_dio_bio_actor(struct inode *inode, loff_t pos, loff_t length, use_fua = true;fs/iomap/direct-io.c iomap_dio_bio_actor(struct inode *inode, loff_t pos, loff_t length, · line 239
Quoted 10 lines
fs/iomap/direct-io.c +2
-6} -/* -* Operate on a partial iter trimmed to the extent we were called for. -* We'll update the iter in the dio once we're done with this extent. -*/ - iter = *dio->submit.iter; -iov_iter_truncate (&iter, length); +/* Operate on a partial iter trimmed to the extent we were called for */ +iov_iter_truncate (dio->submit.iter, length);Ok... so here we shorten the dio iterator to fit the mapping we got...
fs/iomap/direct-io.c iomap_dio_bio_actor(struct inode *inode, loff_t pos, loff_t length, · line 244
Quoted 7 lines
fs/iomap/direct-io.c +3
-2- nr_pages =iov_iter_npages (&iter,BIO_MAX_PAGES ); -if (nr_pages <=0 ) + nr_pages =iov_iter_npages (dio->submit.iter,BIO_MAX_PAGES ); +if (nr_pages <=0 ) { +iov_iter_reexpand (dio->submit.iter, orig_count);return nr_pages;...and if there aren't any pages, we revert the truncation and bail...
fs/iomap/direct-io.c iomap_dio_bio_actor(struct inode *inode, loff_t pos, loff_t length, · line 258
Quoted 9 lines
fs/iomap/direct-io.c +2
-0+ }if (need_zeroout) {/* zero out from the start of the block to the write offset */ @@ -257,6 +255,7 @@ iomap_dio_bio_actor(struct inode *inode, loff_t pos, loff_t length,size_t n;if (dio->error) {iov_iter_revert (dio->submit.iter, copied); +iov_iter_reexpand (dio->submit.iter, orig_count);...if the bio failed, we walk the dio iterator backward the entire amount that it had advanced, undo the length truncation and bail...
fs/iomap/direct-io.c iomap_dio_bio_actor(struct inode *inode, loff_t pos, loff_t length, · line 270
Quoted 9 lines
fs/iomap/direct-io.c +1
-1return 0 ; }@@ -268,7 +267,7 @@ iomap_dio_bio_actor(struct inode *inode, loff_t pos, loff_t length, bio->bi_private = dio; bio->bi_end_io = iomap_dio_bio_end_io; - ret =bio_iov_iter_get_pages (bio, &iter); + ret =bio_iov_iter_get_pages (bio, dio->submit.iter);...here's where we walk the dio iter forward as part of attaching pages to the bio...
Quoted 18 lines
fs/iomap/direct-io.c +1
-3if (unlikely (ret)) {/* * We have to stop part way through an IO. We must fall @@ -294,13 +293,11 @@ iomap_dio_bio_actor(struct inode *inode, loff_t pos, loff_t length,bio_set_pages_dirty (bio); } -iov_iter_advance (dio->submit.iter, n); - dio->size += n; pos += n; copied += n; - nr_pages =iov_iter_npages (&iter,BIO_MAX_PAGES ); + nr_pages =iov_iter_npages (dio->submit.iter,BIO_MAX_PAGES );iomap_dio_submit_bio (dio, iomap, bio); }while (nr_pages);
Quoted 9 lines
fs/iomap/direct-io.c iomap_dio_bio_actor(struct inode *inode, loff_t pos, loff_t length, · line 319
Quoted 6 lines
fs/iomap/direct-io.c +2
-0@@ -318,6 +315,8 @@ iomap_dio_bio_actor(struct inode *inode, loff_t pos, loff_t length,if (pad)iomap_dio_zero (dio, iomap, pos, fs_block_size - pad); } +/* Undo iter limitation to current extent */ +iov_iter_reexpand (dio->submit.iter, orig_count - copied);...and here we undo the length truncation, same as all the other exit points. Assuming my understanding of the bookkeeping is correct,
Yes, it is correct (or at least the same as my understanding :).
Quoted 3 lines
Reviewed-by Darrick J. Wong <[email protected]>(Would still like to see a proper regression test for fstests though...)
So this patch does not fix any bug as such, it is just a cleanup. After more digging in the iter code and what iov_iter_advance() does to pipe iters I've convinced myself that the original code copying the iter is actually correct. But to me it seems a lot safer to do the truncate / reexpand of the original iter rather then rely on very fine details of the implementation of individual iters (and then debug the breakage if one iter type changes these details).
WRT regression test for the first patch, I'll work on that.
Honza
Signature · 2 lines
Jan Kara <[email protected]> SUSE Labs, CR
Re: [PATCH 2/2] iomap: Do not create fake iter in iomap_dio_bio_actor()
In reply to Jan Karafs/iomap/direct-io.c iomap_dio_bio_actor(struct inode *inode, loff_t pos, loff_t length, · line 239
Quoted 8 lines
fs/iomap/direct-io.c +2
-6-/* -* Operate on a partial iter trimmed to the extent we were called for. -* We'll update the iter in the dio once we're done with this extent. -*/ - iter = *dio->submit.iter; -iov_iter_truncate (&iter, length); +/* Operate on a partial iter trimmed to the extent we were called for */ +iov_iter_truncate (dio->submit.iter, length);
I think the comment could be kept a little more verbose given that the scheme isn't exactly obvious. Also I'd move the initialization of orig_count here to keep it all together. E.g.
/* * Save the original count and trim the iter to just the extent we * are operating on right now. The iter will be re-expanded once * we are done. */ orig_count = iov_iter_count(dio->submit.iter); iov_iter_truncate(dio->submit.iter, length);
fs/iomap/direct-io.c iomap_dio_bio_actor(struct inode *inode, loff_t pos, loff_t length, · line 245
Quoted 8 lines
fs/iomap/direct-io.c +4
-2- nr_pages =iov_iter_npages (&iter,BIO_MAX_PAGES ); -if (nr_pages <=0 ) + nr_pages =iov_iter_npages (dio->submit.iter,BIO_MAX_PAGES ); +if (nr_pages <=0 ) { +iov_iter_reexpand (dio->submit.iter, orig_count);return nr_pages; + }
Can we stick to a single iov_iter_reexpand call? E.g. turn this into
if (nr_pages <= 0) {
ret = nr_pages;
goto out;
}and then have the out label at the very end call iov_iter_reexpand.
fs/iomap/direct-io.c iomap_dio_bio_actor(struct inode *inode, loff_t pos, loff_t length, · line 320
Quoted 5 lines
fs/iomap/direct-io.c +2
-0iomap_dio_zero (dio, iomap, pos, fs_block_size - pad); } +/* Undo iter limitation to current extent */ +iov_iter_reexpand (dio->submit.iter, orig_count - copied);return copied ? copied : ret;
In iomap-for-next this is:
if (copied) return copied; return ret;
so please rebase to iomap-for-next for the next spin.
Jan Kara
reviewerRe: [PATCH 2/2] iomap: Do not create fake iter in iomap_dio_bio_actor()
Quoted 47 lines · Christoph Hellwig
fs/iomap/direct-io.c iomap_dio_bio_actor(struct inode *inode, loff_t pos, loff_t length, · line 239
Quoted 8 lines
fs/iomap/direct-io.c +2
-6-/* -* Operate on a partial iter trimmed to the extent we were called for. -* We'll update the iter in the dio once we're done with this extent. -*/ - iter = *dio->submit.iter; -iov_iter_truncate (&iter, length); +/* Operate on a partial iter trimmed to the extent we were called for */ +iov_iter_truncate (dio->submit.iter, length);I think the comment could be kept a little more verbose given that the scheme isn't exactly obvious. Also I'd move the initialization of
orig_counthere to keep it all together. E.g./* * Save the original count and trim the iter to just the extent we * are operating on right now. The iter will be re-expanded once * we are done. */ orig_count = iov_iter_count(dio->submit.iter); iov_iter_truncate(dio->submit.iter, length);fs/iomap/direct-io.c iomap_dio_bio_actor(struct inode *inode, loff_t pos, loff_t length, · line 245
Quoted 8 lines
fs/iomap/direct-io.c +4
-2- nr_pages =iov_iter_npages (&iter,BIO_MAX_PAGES ); -if (nr_pages <=0 ) + nr_pages =iov_iter_npages (dio->submit.iter,BIO_MAX_PAGES ); +if (nr_pages <=0 ) { +iov_iter_reexpand (dio->submit.iter, orig_count);return nr_pages; + }Can we stick to a single
iov_iter_reexpandcall? E.g. turn this intoif (nr_pages <= 0) { ret = nr_pages; goto out; }and then have the out label at the very end call
iov_iter_reexpand.fs/iomap/direct-io.c iomap_dio_bio_actor(struct inode *inode, loff_t pos, loff_t length, · line 320
Quoted 5 lines
fs/iomap/direct-io.c +2
-0iomap_dio_zero (dio, iomap, pos, fs_block_size - pad); } +/* Undo iter limitation to current extent */ +iov_iter_reexpand (dio->submit.iter, orig_count - copied);return copied ? copied : ret;In iomap-for-next this is:
Quoted 5 lines
if (copied) return copied; return ret;so please rebase to iomap-for-next for the next spin.
OK, I can see Darrick has already picked up the first patch so I'll just respin this second one with the updates you've asked for. Thanks for review!
Honza
Signature · 2 lines
Jan Kara <[email protected]> SUSE Labs, CR
Quoted 7 lines · Jan Kara
Hello,
here is a fix and a cleanup for iomap code. The first patch fixes a leakage of pipe pages when
iomap_dio_rw()splices to a pipe, the second patch is a cleanup that removes strange copying of iter iniomap_dio_rw(). Patches have passed fstests for ext4 and xfs and fix the syzkaller reproducer for me.
Will have a look, but in the meantime -- do you have quick reproducer that can be packaged for fstests? Or is it just the syzbot reproducer?
--D
Quoted 2 lines
Honza
Jan Kara
reviewerQuoted 11 lines · Darrick J. Wong
Quoted 7 lines · Jan Kara
Hello,
here is a fix and a cleanup for iomap code. The first patch fixes a leakage of pipe pages when
iomap_dio_rw()splices to a pipe, the second patch is a cleanup that removes strange copying of iter iniomap_dio_rw(). Patches have passed fstests for ext4 and xfs and fix the syzkaller reproducer for me.Will have a look, but in the meantime -- do you have quick reproducer that can be packaged for fstests? Or is it just the syzbot reproducer?
I have just the syzkaller reproducer but now that I understand the problem I might be able to write something more readable... I'll try.
Honza
Signature · 2 lines
Jan Kara <[email protected]> SUSE Labs, CR