Skip to content

RFC Add vDPA multi-threads optiomization

Li Zhang dpdk-dev 1 version New

Get series with b4
b4 am [email protected]

Versions newest first

  1. v1 RFC Latest15 patches 0 repliesNew

Patches in v1 No applies recorded yet

#Subject and filesSizeRepliesApplied
1/15examples/vdpa: fix vDPA device removeexamples/vdpa/main.c+4 -00 replies
2/15vdpa/mlx5: support pre create virtq resourcedoc/guides/vdpadevs/mlx5.rst drivers/vdpa/mlx5/mlx5_vdpa.c drivers/vdpa/mlx5/mlx5_vdpa.h+89 -20 replies
3/15common/mlx5: add DevX API to move QP to reset statedrivers/common/mlx5/mlx5_devx_cmds.c drivers/common/mlx5/mlx5_prm.h+24 -00 replies
4/15vdpa/mlx5: support event qp reusedrivers/vdpa/mlx5/mlx5_vdpa.c drivers/vdpa/mlx5/mlx5_vdpa.h drivers/vdpa/mlx5/mlx5_vdpa_event.c +1 more+78 -80 replies
5/15common/mlx5: extend virtq modifiable fieldsdrivers/common/mlx5/mlx5_devx_cmds.c drivers/common/mlx5/mlx5_devx_cmds.h drivers/common/mlx5/mlx5_prm.h+76 -130 replies
6/15vdpa/mlx5: pre-create virtq in the probdrivers/vdpa/mlx5/mlx5_vdpa.h drivers/vdpa/mlx5/mlx5_vdpa_lm.c drivers/vdpa/mlx5/mlx5_vdpa_virtq.c+170 -1040 replies
7/15vdpa/mlx5: optimize datapath-control synchronizationdrivers/vdpa/mlx5/mlx5_vdpa.c drivers/vdpa/mlx5/mlx5_vdpa.h drivers/vdpa/mlx5/mlx5_vdpa_event.c +3 more+180 -780 replies
8/15vdpa/mlx5: add multi-thread management for configurationdoc/guides/vdpadevs/mlx5.rst drivers/vdpa/mlx5/meson.build drivers/vdpa/mlx5/mlx5_vdpa.c +4 more+223 -50 replies
9/15vdpa/mlx5: add task ring for MT managementdrivers/vdpa/mlx5/mlx5_vdpa.h drivers/vdpa/mlx5/mlx5_vdpa_cthread.c+133 -20 replies
10/15vdpa/mlx5: add MT task for VM memory registrationdrivers/vdpa/mlx5/mlx5_vdpa.c drivers/vdpa/mlx5/mlx5_vdpa.h drivers/vdpa/mlx5/mlx5_vdpa_cthread.c +2 more+256 -970 replies
11/15vdpa/mlx5: add virtq creation task for MT managementdrivers/vdpa/mlx5/mlx5_vdpa.h drivers/vdpa/mlx5/mlx5_vdpa_cthread.c drivers/vdpa/mlx5/mlx5_vdpa_event.c +1 more+133 -400 replies
12/15vdpa/mlx5: add virtq LM log taskdrivers/vdpa/mlx5/mlx5_vdpa.h drivers/vdpa/mlx5/mlx5_vdpa_cthread.c drivers/vdpa/mlx5/mlx5_vdpa_lm.c+110 -170 replies
13/15vdpa/mlx5: add device close taskdrivers/vdpa/mlx5/mlx5_vdpa.c drivers/vdpa/mlx5/mlx5_vdpa.h drivers/vdpa/mlx5/mlx5_vdpa_cthread.c +1 more+90 -30 replies
14/15vdpa/mlx5: add virtq sub-resources creationdrivers/vdpa/mlx5/mlx5_vdpa.c drivers/vdpa/mlx5/mlx5_vdpa.h drivers/vdpa/mlx5/mlx5_vdpa_event.c +2 more+117 -910 replies
15/15vdpa/mlx5: prepare virtqueue resource creationdrivers/vdpa/mlx5/mlx5_vdpa.c drivers/vdpa/mlx5/mlx5_vdpa.h drivers/vdpa/mlx5/mlx5_vdpa_cthread.c +1 more+104 -210 replies

Reviews trailers per patch

None of the 15 patches has a Reviewed-by or Acked-by of their own; the series has one for all of them.

PatchMatan AzradMaxime Coquelin
SeriesA-b A-b A-b A-b A-b A-b A-b A-b A-b A-b A-b A-b A-b A-b A-b A-b A-b A-b A-b A-b A-b A-b A-b A-b A-b A-b A-b A-b A-b A-b A-b A-b A-b A-b A-b A-b A-b A-b A-b A-b A-b A-b A-b A-b A-b R-b R-b R-b R-b R-b R-b R-b R-b R-b R-b R-b R-b R-b R-b R-b R-b R-b R-b R-b R-b R-b R-b R-b
1/15
2/15
3/15
4/15
5/15
6/15
7/15
8/15
9/15
10/15
11/15
12/15
13/15
14/15
15/15

Trailers given in replies are filled; those carried in the patches from earlier versions are outlined with dashes.

Read the v1 thread

Cover letter [RFC 00/15] Add vDPA multi-threads optiomization

Allow the driver to use internal threads to obtain fast configuration.
All the threads will be open on the same core of the event completion queue scheduling thread.

Add max_conf_threads parameter to configure
the maximum number of internal threads in addition to the caller thread (8 is suggested).
These internal threads to pipeline handle VDPA tasks in system and shared with all VDPA devices. Default is 0, don't use internal threads for configuration.

Depends-on: series=21868 ("vdpa/mlx5: improve device shutdown time")
http://patchwork.dpdk.org/project/dpdk/list/?series=21868

Li Zhang (11):
common/mlx5: extend virtq modifiable fields vdpa/mlx5: pre-create virtq in the prob vdpa/mlx5: optimize datapath-control synchronization vdpa/mlx5: add multi-thread management for configuration vdpa/mlx5: add task ring for MT management vdpa/mlx5: add MT task for VM memory registration vdpa/mlx5: add virtq creation task for MT management vdpa/mlx5: add virtq LM log task
vdpa/mlx5: add device close task
vdpa/mlx5: add virtq sub-resources creation vdpa/mlx5: prepare virtqueue resource creation

Yajun Wu (4):
examples/vdpa: fix vDPA device remove vdpa/mlx5: support pre create virtq resource common/mlx5: add DevX API to move QP to reset state vdpa/mlx5: support event qp reuse

 doc/guides/vdpadevs/mlx5.rst          |  25 ++
 drivers/common/mlx5/mlx5_devx_cmds.c  |  77 +++-
 drivers/common/mlx5/mlx5_devx_cmds.h  |   6 +-
 drivers/common/mlx5/mlx5_prm.h        |  30 +-
 drivers/vdpa/mlx5/meson.build         |   1 +
 drivers/vdpa/mlx5/mlx5_vdpa.c         | 227 +++++++++-
 drivers/vdpa/mlx5/mlx5_vdpa.h         | 147 ++++++-
 drivers/vdpa/mlx5/mlx5_vdpa_cthread.c | 362 ++++++++++++++++
 drivers/vdpa/mlx5/mlx5_vdpa_event.c   | 160 +++++--
 drivers/vdpa/mlx5/mlx5_vdpa_lm.c      | 133 ++++--
 drivers/vdpa/mlx5/mlx5_vdpa_mem.c     | 268 ++++++++----
 drivers/vdpa/mlx5/mlx5_vdpa_steer.c   |  20 +-
 drivers/vdpa/mlx5/mlx5_vdpa_virtq.c   | 582 ++++++++++++++++++--------
 examples/vdpa/main.c                  |   4 +
 14 files changed, 1674 insertions(+), 368 deletions(-)
 create mode 100644 drivers/vdpa/mlx5/mlx5_vdpa_cthread.c
Signature · 1 line
2.27.0