Skip to content

io_uring: improve handling of buffered writes

Jens Axboe linux-block 1 version New

Get series with b4
b4 am [email protected]

Versions newest first

  1. v1 Latest2 patches 0 repliesNew

Patches in v1 No applies recorded yet

#Subject and filesSizeRepliesApplied
1/2io_uring: add io_queue_async_work() helperfs/io_uring.c+11 -50 replies
2/2io_uring: limit parallelism of buffered writesfs/io_uring.c+39 -80 replies

Reviews trailers per patch

No Reviewed-by, Acked-by or Tested-by trailers for v1 yet.

Read the v1 thread

Cover letter [PATCHSET 0/2] io_uring: improve handling of buffered writes

XFS/ext4/others all need to lock the inode for buffered writes. Since io_uring handles any IO in an async manner, this means that for higher queue depth buffered write workloads, we have a lot of workers hammering on the same mutex.

Running a QD=32 random write workload on my test box yields about 200K 4k random write IOPS with io_uring. Looking at system profiles, we're spending about half the time contending on the inode mutex. Oof.

For buffered writes, we don't necessarily need a huge amount of threads issuing that IO. If we instead rely on normal flushing to take care of getting the parallelism we need on the device side, we can limit ourselves to a much lower depth. This still gets us async behavior on the submission side.

With this small series, my 200K IOPS goes to 370K IOPS for the same workload.

This issue came out of postgres implementing io_uring support, and reporting some of the issues they saw.

Signature · 1 line
Jens Axboe