Skip to content

mm, iomap, NFSD: stop DONTCACHE writes reading back shared pages

Mike Snitzer linux-fsdevel linux-mm linux-nfs 6 versions – In review

Get series with b4
b4 am [email protected]

Versions newest first · linked by author and title

  1. v12 Latest7 patches 5 repliesIn review
  2. v117 patches 1 replySuperseded
  3. v107 patches 9 repliesSuperseded
Earlier versions · 3
VersionPostedPatchesRepliesStatus
v96 patches9 repliesSuperseded
v87 patches4 repliesSuperseded
v56 patches6 repliesSuperseded

Changes in v12 from the cover letter

- 4/7: folio_mark_dropbehind() leaves a mapped folio unmarked. Through its page table, a mapped folio can be dirtied without the folio lock, and PG_dirty set before the folio is counted. With a stale dirty tag, folio_mark_dropbehind() then counted the folio in WB_DONTCACHE_DIRTY, and the dirtier counted it again. sashiko found this in its review of v11 4/7 (https://lore.kernel.org/r/[email protected]).
The folio lock keeps an unmapped folio unmapped, so the window is closed for every dirtier that does not use buffer heads. filemap_end_dropbehind() does not drop a mapped folio either.
- 6/7: filemap_dontcache_edge_complete() leaves a mapped folio alone, dirty or clean, to match.
- Jeff's Reviewed-by is dropped from 4/7, which now has a code change.
- Testing: a KUnit test (not in this series) runs the interleaving from sashiko's review step by step. On an unmapped folio, the folio is counted twice. On a mapped folio, v12 leaves it unmarked and the count is correct. The v11 tests through NFSD and with RWF_DONTCACHE give the same results with v12.
- Rebased on the current cel/nfsd-testing.

Patches in v12 No applies recorded yet

#Subject and filesSizeRepliesApplied
1/7mm: move clearing the dropbehind flag of a found folio into a helpermm/filemap.c+20 -131 reply
2/7mm: take a folio off WB_DONTCACHE_DIRTY only if it was counted theremm/filemap.c+28 -141 reply
3/7mm: expose WB_DONTCACHE_DIRTY in bdi debugfs statsmm/backing-dev.c+6 -01 reply
4/7mm: add folio_mark_dropbehind() to mark a folio dropbehind and account itinclude/linux/pagemap.h mm/filemap.c+43 -00 replies
5/7mm, iomap: keep a partially covered page until a DONTCACHE write completes itfs/iomap/buffered-io.c include/linux/pagemap.h mm/filemap.c+86 -40 replies
6/7mm, iomap: let a DONTCACHE writer complete its shared pages itselffs/iomap/buffered-io.c fs/iomap/trace.h include/linux/fs.h +3 more+91 -50 replies
7/7NFSD: drop a shared boundary page only once both WRITEs have written itDocumentation/filesystems/nfs/nfsd-io-modes.rst fs/nfsd/vfs.c+113 -120 replies

Reviews trailers per patch

4 of 7 patches have a Reviewed-by or Acked-by.

PatchChristoph HellwigJeff LaytonJan Kara
1/7R-b R-b
2/7R-b R-b
3/7R-b R-b
4/7
5/7
6/7
7/7R-b

Trailers given in replies are filled; those carried in the patches from earlier versions are outlined with dashes. Scroll the table sideways for all 3 reviewers.

Read the v12 thread

Cover letter [PATCH v12 0/7] mm, iomap, NFSD: stop DONTCACHE writes reading back shared pages

Hi,

An RWF_DONTCACHE write is buffered IO: its data goes through the page cache, and writeback drops each folio once the folio is written back. A write that starts or ends inside a folio covers that folio only partially. Usually another write covers the rest of the folio. If writeback drops the folio before the other write writes its part, the other write must first read the folio back from disk. 32 threads writing interleaved records to one XFS file, 4 KiB pages, before and after 5/7:

record pwritev2() flags 4 KiB device MiB/s
bytes reads per write

                                    before   after     before  after
  47008   RWF_DONTCACHE             0.97     0.0005    831     2281
  47008   RWF_DONTCACHE|RWF_DSYNC   0.99     0.0005    601     1227
  6000    RWF_DONTCACHE             0.97     0.0001    121      488
  6000    RWF_DONTCACHE|RWF_DSYNC   0.99     0.0002     90      206

47008 bytes is the transfer size of IO500's ior-hard, in which each rank writes interleaved records to one shared file. Any record size that is not a multiple of the page size has the same problem. 6000 bytes is a second example.

The test program and script: https://lore.kernel.org/linux-nfs/[email protected]/

- 1/7 moves code into a helper, with no functional change.
- 2/7 fixes 88d6f128d06d ("mm: track DONTCACHE dirty pages per bdi_writeback"), in v7.3: WB_DONTCACHE_DIRTY could drift.
- 3/7 reports WB_DONTCACHE_DIRTY in the bdi debugfs stats.
- 4/7 adds folio_mark_dropbehind() for a folio that is already dirty.
- 5/7 keeps a partially covered folio until the write that completes it.
- 6/7 lets a writer that syncs its own write complete those folios itself, after the sync.
- 7/7 makes NFSD do that for the misaligned ends of a direct-mode WRITE.

Merging: Chuck suggested taking the series through the mm tree. 1/7 to 6/7 apply cleanly to each of these mm branches:

  mm-unstable  4318887a3efa ("fs/proc/task_mmu: fix lost maps entries above 2^63")
  mm-new       daed51c91051 ("riscv: mm: fix concurrency in mark_new_valid_map()")
  mm-stable    fa4ad798f6f6 ("Merge tag 'for-7.4-rc1-tag' of git://git.kernel.org/pub/scm/linux/kernel/git/kdave/linux")

7/7 needs the NFSD direct-mode changes that are in cel/nfsd-testing. The whole series applies to cel/nfsd-testing at ab036e3a0dd4 ("NFSD:
Refuse a direct READ whose aligned range exceeds the reply pages"), where each patch builds with W=1 with no warnings. So 7/7 could follow in the nfsd tree once the mm part is merged.

Changes since v11:
- 4/7: folio_mark_dropbehind() leaves a mapped folio unmarked. Through its page table, a mapped folio can be dirtied without the folio lock, and PG_dirty set before the folio is counted. With a stale dirty tag, folio_mark_dropbehind() then counted the folio in WB_DONTCACHE_DIRTY, and the dirtier counted it again. sashiko found this in its review of v11 4/7 (https://lore.kernel.org/r/[email protected]).
The folio lock keeps an unmapped folio unmapped, so the window is closed for every dirtier that does not use buffer heads. filemap_end_dropbehind() does not drop a mapped folio either.
- 6/7: filemap_dontcache_edge_complete() leaves a mapped folio alone, dirty or clean, to match.
- Jeff's Reviewed-by is dropped from 4/7, which now has a code change.
- Testing: a KUnit test (not in this series) runs the interleaving from sashiko's review step by step. On an unmapped folio, the folio is counted twice. On a mapped folio, v12 leaves it unmarked and the count is correct. The v11 tests through NFSD and with RWF_DONTCACHE give the same results with v12.
- Rebased on the current cel/nfsd-testing.

v11: https://lore.kernel.org/linux-nfs/[email protected]/
v10: https://lore.kernel.org/linux-nfs/[email protected]/
v9: https://lore.kernel.org/linux-nfs/[email protected]/
v8: https://lore.kernel.org/linux-nfs/[email protected]/
v7: https://lore.kernel.org/linux-nfs/[email protected]/
v6: https://lore.kernel.org/linux-nfs/[email protected]/
v5: https://lore.kernel.org/linux-nfs/[email protected]/
v4: https://lore.kernel.org/linux-nfs/[email protected]/
v3: https://lore.kernel.org/linux-nfs/[email protected]/
v2: https://lore.kernel.org/linux-nfs/[email protected]/
v1: https://lore.kernel.org/linux-nfs/[email protected]/

Thanks,
Mike

Mike Snitzer (7):
mm: move clearing the dropbehind flag of a found folio into a helper
mm: take a folio off WB_DONTCACHE_DIRTY only if it was counted there
mm: expose WB_DONTCACHE_DIRTY in bdi debugfs stats
mm: add folio_mark_dropbehind() to mark a folio dropbehind and account it mm, iomap: keep a partially covered page until a DONTCACHE write completes it mm, iomap: let a DONTCACHE writer complete its shared pages itself
NFSD: drop a shared boundary page only once both WRITEs have written it

 .../filesystems/nfs/nfsd-io-modes.rst         |  18 ++
 fs/iomap/buffered-io.c                        |  30 ++-
 fs/iomap/trace.h                              |   3 +-
 fs/nfsd/vfs.c                                 | 107 ++++++++-
 include/linux/fs.h                            |   5 +-
 include/linux/iomap.h                         |   1 +
 include/linux/pagemap.h                       |  12 +
 mm/backing-dev.c                              |   6 +
 mm/filemap.c                                  | 219 ++++++++++++++++--
 9 files changed, 370 insertions(+), 31 deletions(-)

base-commit: ab036e3a0dd410f762192f33d6244e7993b36f8d

Signature · 1 line
2.52.0