Skip to content

Move IB representors to single IB device multiple ports

Leon Romanovsky linux-rdma netdev 1 version In review

Get series with b4
b4 am [email protected]

Versions newest first

  1. v1 Latest12 patches 4 repliesIn review

Patches in v1 No applies recorded yet

#Subject and filesSizeRepliesApplied
1/12net/mlx5: E-Switch, don't use hardcoded values for FDB priosdrivers/net/ethernet/mellanox/mlx5/core/eswitch_offloads.c drivers/net/ethernet/mellanox/mlx5/core/fs_core.c include/linux/mlx5/fs.h+8 -70 replies
2/12net/mlx5: E-Switch, add a new prio to be used by the RDMA sidedrivers/net/ethernet/mellanox/mlx5/core/fs_core.c include/linux/mlx5/fs.h+8 -00 replies
3/12RDMA/mlx5: Move netdev info into the port structdrivers/infiniband/hw/mlx5/main.c drivers/infiniband/hw/mlx5/mlx5_ib.h drivers/infiniband/hw/mlx5/qp.c+23 -230 replies
4/12RDMA/mlx5: Free IB device on removedrivers/infiniband/hw/mlx5/ib_rep.c drivers/infiniband/hw/mlx5/main.c+3 -60 replies
5/12RDMA/mlx5: Move ports allocation to outside of INIT stagedrivers/infiniband/hw/mlx5/ib_rep.c drivers/infiniband/hw/mlx5/main.c+22 -140 replies
6/12RDMA/mlx5: Use correct size for device resourcesdrivers/infiniband/hw/mlx5/main.c+1 -30 replies
7/12RDMA/mlx5: Move rep into port structdrivers/infiniband/hw/mlx5/devx.c drivers/infiniband/hw/mlx5/flow.c drivers/infiniband/hw/mlx5/ib_rep.c +4 more+26 -200 replies
8/12RDMA/mlx5: Move default representors SQ steering to rule to modify QPdrivers/infiniband/hw/mlx5/ib_rep.c drivers/infiniband/hw/mlx5/ib_rep.h drivers/infiniband/hw/mlx5/qp.c+48 -300 replies
9/12RDMA/mlx5: Refactor netdev affinity codedrivers/infiniband/hw/mlx5/ib_rep.c drivers/infiniband/hw/mlx5/main.c+39 -100 replies
10/12RDMA/mlx5: Move SMI caps logicdrivers/infiniband/hw/mlx5/main.c+5 -50 replies
11/12RDMA/mlx5: Move to single device multiport ports in switchdev modedrivers/infiniband/hw/mlx5/ib_rep.c drivers/infiniband/hw/mlx5/main.c drivers/infiniband/hw/mlx5/mlx5_ib.h+49 -90 replies
12/12RDMA/mlx5: Remove VF representor profiledrivers/infiniband/hw/mlx5/ib_rep.c drivers/infiniband/hw/mlx5/main.c drivers/infiniband/hw/mlx5/mlx5_ib.h+16 -860 replies

Reviews trailers per patch

2 of 12 patches have a Reviewed-by or Acked-by.

PatchMaor Gottlieb
1/12R-b
2/12R-b
3/12
4/12
5/12
6/12
7/12
8/12
9/12
10/12
11/12
12/12

Trailers given in replies are filled; those carried in the patches from earlier versions are outlined with dashes.

Read the v1 thread

Cover letter [PATCH rdma-next 00/12] Move IB representors to single IB device multiple ports

From: Leon Romanovsky <[email protected]>

Quoted 1 line

From Mark,

Hi,

This series starts from two refactoring patches performed in mlx5_core and they are part of a larger series intended to expose the ability to insert FDB steering rules by the RDMA side.

They are followed by patches which move IB representors to single IB device. Currently when moving to switchdev mode an IB device is created per virtual function (and one for the uplink). While initially this was right approach, the limitation of this model requires us to change it.

Such limitations includes:
- Inability to share resources between IB devices.
- Lack of DEVX to allow more control and device specific functionality.
- Interacting with the E-Switch.
- Doesn't work well with namespaces.

In this series we move to a single IB device with multiple ports where each port represents a different virtual function (port 1 is for the uplink). All the limitations listed above are now resolved and the software model exposed to users is more cohesive.

Thanks

Mark Bloch (12):
net/mlx5: E-Switch, don't use hardcoded values for FDB prios net/mlx5: E-Switch, add a new prio to be used by the RDMA side RDMA/mlx5: Move netdev info into the port struct RDMA/mlx5: Free IB device on remove
RDMA/mlx5: Move ports allocation to outside of INIT stage RDMA/mlx5: Use correct size for device resources RDMA/mlx5: Move rep into port struct
RDMA/mlx5: Move default representors SQ steering to rule to modify QP RDMA/mlx5: Refactor netdev affinity code
RDMA/mlx5: Move SMI caps logic
RDMA/mlx5: Move to single device multiport ports in switchdev mode RDMA/mlx5: Remove VF representor profile

 drivers/infiniband/hw/mlx5/devx.c             |   2 +-
 drivers/infiniband/hw/mlx5/flow.c             |   2 +-
 drivers/infiniband/hw/mlx5/ib_rep.c           | 109 +++++----
 drivers/infiniband/hw/mlx5/ib_rep.h           |  13 +-
 drivers/infiniband/hw/mlx5/main.c             | 207 ++++++++++--------
 drivers/infiniband/hw/mlx5/mlx5_ib.h          |  35 +--
 drivers/infiniband/hw/mlx5/mr.c               |   6 +-
 drivers/infiniband/hw/mlx5/qp.c               |  46 ++--
 .../mellanox/mlx5/core/eswitch_offloads.c     |   5 -
 .../net/ethernet/mellanox/mlx5/core/fs_core.c |  12 +-
 include/linux/mlx5/fs.h                       |   6 +
 11 files changed, 239 insertions(+), 204 deletions(-)