RFC support graph like dependent sqes
Get series with b4
b4 am [email protected]Versions newest first
- v1 RFC Latest3 patches 11 repliesIn review
Patches in v1 No applies recorded yet
| # | Subject and files | Size | Replies | Applied |
|---|---|---|---|---|
| 1/3 | io_uring: add data structure for graph sqe featurefs/ | +19 | 0 replies | |
| 2/3 | io_uring: implement new sqe opcode to build graph like linksfs/ include/ | +145 | 0 replies | |
| 3/3 | io_uring: implement logic of IOSQE_GRAPH requestfs/ include/ | +71 | 0 replies |
Reviews trailers per patch
No Reviewed-by, Acked-by or Tested-by trailers for v1 yet.
Cover letter [POC RFC 0/3] support graph like dependent sqes
This is just a proof of concept which is incompleted, send it early for thoughts and suggestions.
We already have IOSQE_IO_LINK to describe linear dependency relationship sqes. While this patchset provides a new feature to support DAG dependency. For instance, 4 sqes have a relationship as below:
--> 2 --
/ \
1 --- ---> 4
\ /
--> 3 --IOSQE_IO_LINK serializes them to 1-->2-->3-->4, which unneccessarily serializes 2 and 3. But a DAG can fully describe it.
For the detail usage, see the following patches' messages.
Tested it with 100 direct read sqes, each one reads a BS=4k block data in a same file, blocks are not overlapped. These sqes form a graph:
2
3
1 --> 4 --> 100
...
99This is an extreme case, just to show the idea.
results below:io_link:
IOPS: 15898251graph_link:
IOPS: 29325513io_link:
IOPS: 16420361graph_link:
IOPS: 29585798io_link:
IOPS: 18148820graph_link:
IOPS: 27932960
Tested many times, numbers are not very stable but shows the difference.
something to concern:
1. overhead to the hot path: several IF checks
2. many memory allocations
3. many atomic_read/inc/dec stuff
many things to be done:
1. cancellation, failure path
2. integrate with other features.
3. maybe need some cache design to overcome the overhead of memory allcation
4. some thing like topological sorting to avoid rings in the graph
Any thoughts?
Hao Xu (3):
io_uring: add data structure for graph sqe feature
io_uring: implement new sqe opcode to build graph like links
io_uring: implement logic of IOSQE_GRAPH request
fs/io_uring.c | 231 +++++++++++++++++++++++++++++++++- include/uapi/linux/io_uring.h | 9 ++ 2 files changed, 235 insertions(+), 5 deletions(-)
Signature · 1 line
2.25.1