Skip to contentSkip to conversation

io_uring updates for 6.12-rc1

GIT PULL Merged Jens Axboe 2 participants 2 messages Sep 13, 2024 – Sep 16, 2024 io_uring

lore
Share & tools
lore

Jens Axboe

author maintainer
#0 lore raw

Hi Linus,

Here are the main io_uring changes for the 6.12 merge window. There will be a followup one that adds discard support, but since that depends on both this branch and the block branch, it'll be sent post both of those.

This pull request contains:

- NAPI fixes and cleanups (Pavel, Olivier)

- Add support for absolute timeouts (Pavel)

- Fixes for io-wq/sqpoll affinities (Felix)

- Efficiency improvements for dealing with huge pages (Chenliang)

- Support for a minwait mode, where the application essentially has two timouts - one smaller one that defines the batch timeout, and the overall large one similar to what we had before. This enables efficient use of batching based on count + timeout, while still working well with periods of less intensive workloads.

- Use ITER_UBUF for single segment sends

- Add support for incremental buffer consumption. Right now each operation will always consume a full buffer. With incremental consumption, a recv/read operation only consumes the part of the buffer that it needs to satisfy the operation.

- Add support for GCOV for io_uring, to help retain a high coverage of test to code ratio.

- Fix regression with ocfs2, where an odd -EOPNOTSUPP wasn't correctly converted to a blocking retry.

- Add support for cloning registered buffers from one ring to another.

- Misc cleanups (Anuj, me)

Please pull!

The following changes since commit 5be63fc19fcaa4c236b307420483578a56986a37:

Linux 6.11-rc5 (2024-08-25 19:07:11 +1200)

are available in the Git repository at:

git://git.kernel.dk/linux.git tags/for-6.12/io_uring-20240913

for you to fetch changes up to 7cc2a6eadcd7a5aa36ac63e6659f5c6138c7f4d2:

io_uring: add IORING_REGISTER_COPY_BUFFERS method (2024-09-12 10:14:15 -0600)

----------------------------------------------------------------
for-6.12/io_uring-20240913

----------------------------------------------------------------
Anuj Gupta (2):
io_uring: add new line after variable declaration
io_uring: remove unused rsrc_put_fn

Chenliang Li (2):
io_uring/rsrc: store folio shift and mask into imu io_uring/rsrc: enable multi-hugepage buffer coalescing

Felix Moessbauer (3):
io_uring/sqpoll: do not allow pinning outside of cpuset io_uring/io-wq: do not allow pinning outside of cpuset io_uring/io-wq: inherit cpuset of cgroup in io worker

Jens Axboe (22):
io_uring/kbuf: use 'bl' directly rather than req->buf_list io_uring/net: use ITER_UBUF for single segment send maps io_uring/kbuf: turn io_buffer_list booleans into flags
io_uring: encapsulate extraneous wait flags into a separate struct
io_uring: move schedule wait logic into helper
io_uring: implement our own schedule timeout handling
io_uring: add support for batch wait timeout
io_uring: wire up min batch wake timeout
io_uring/kbuf: shrink nr_iovs/mode in struct buf_sel_arg io_uring/kbuf: add io_kbuf_commit() helper io_uring/kbuf: move io_ring_head_to_buf() to kbuf.h Revert "io_uring: Require zeroed sqe->len on provided-buffers send" io_uring/kbuf: pass in 'len' argument for buffer commit io_uring/kbuf: add support for incremental buffer consumption
io_uring: add GCOV_PROFILE_URING Kconfig option io_uring/eventfd: move refs to refcount_t
io_uring/rw: treat -EOPNOTSUPP for IOCB_NOWAIT like -EAGAIN io_uring/rw: drop -EOPNOTSUPP check in __io_complete_rw_common() io_uring/rsrc: clear 'slot' entry upfront io_uring/rsrc: add reference count to struct io_mapped_ubuf io_uring/register: provide helper to get io_ring_ctx from 'fd'
io_uring: add IORING_REGISTER_COPY_BUFFERS method

Olivier Langlois (2):
io_uring: add napi busy settings to the fdinfo output
io_uring: micro optimization of __io_sq_thread() condition

Pavel Begunkov (4):
io_uring/napi: refactor __io_napi_busy_loop() io_uring/napi: postpone napi timeout adjustment
io_uring: add absolute mode wait timeouts
io_uring: user registered clockid for wait timeouts

 include/linux/io_uring_types.h |   3 +
 include/uapi/linux/io_uring.h  |  42 ++++++-
 init/Kconfig                   |  13 +++
 io_uring/Makefile              |   4 +
 io_uring/eventfd.c             |  13 ++-
 io_uring/fdinfo.c              |  14 ++-
 io_uring/io-wq.c               |  25 ++++-
 io_uring/io_uring.c            | 212 ++++++++++++++++++++++++++---------
 io_uring/io_uring.h            |  12 ++
 io_uring/kbuf.c                |  96 ++++++++--------
 io_uring/kbuf.h                |  94 +++++++++++-----
 io_uring/napi.c                |  35 ++----
 io_uring/napi.h                |  16 ---
 io_uring/net.c                 |  27 +++--
 io_uring/register.c            |  91 +++++++++++----
 io_uring/register.h            |   1 +
 io_uring/rsrc.c                | 245 ++++++++++++++++++++++++++++++++++-------
 io_uring/rsrc.h                |  14 ++-
 io_uring/rw.c                  |  19 +++-
 io_uring/sqpoll.c              |   7 +-
 20 files changed, 723 insertions(+), 260 deletions(-)
Signature · 1 line
Jens Axboe