Extend DEVX functionality
Subsystems (5)
cover Extend DEVX functionality
From: Leon Romanovsky <[email protected]>
Quoted 1 line
From Yishai,
This series comes to enable the DEVX functionality in some wider scope, specifically,
- It enables using kernel objects that were created by the verbs API in the DEVX flow.
- It enables white list commands without DEVX user context.
- It enables the IB link layer under CAP_NET_RAW capabilities.
- It exposes the PRM handles for RAW QP (i.e. TIRN, TISN, RQN, SQN) to be used later on directly by the DEVX interface.
In General,
Each object that is created/destroyed/modified via verbs will be stamped with a UID based on its user context. This is already done for DEVX objects commands.
This will enable the firmware to enforce the usage of kernel objects from the DEVX flow by validating that the same UID is used and the resources are really related to the same user.
For example in case a CQ was created with verbs it will be stamped with UID and once will be pointed by a DEVX create QP command the firmware will validate that the input CQN really belongs to the UID which issues the create QP command.
As of the above, all the PRM objects (except of the public ones which are managed by the kernel e.g. FLOW, etc.) will have a UID upon their create/modify/destroy commands. The detection of UMEM / physical addressed in the relevant commands will be done by firmware according to a 'umem valid bit' as the UID may be used in both cases.
The series also enables white list commands which don't require a specific DEVX context, instead of this a device UID is used so that the firmware will mask un-privileged functionality. The IB link layer is also enabled once CAP_NET_RAW permission exists.
To enable using the RAW QP underlay objects (e.g. TIRN, RQN, etc.) later on by DEVX commands the UHW output for this case was extended to return this data when a DEVX context is used.
Thanks
Leon Romanovsky (1):
net/mlx5: Update mlx5_ifc with DEVX UID bits
Yishai Hadas (24):
net/mlx5: Set uid as part of CQ commands net/mlx5: Set uid as part of QP commands net/mlx5: Set uid as part of RQ commands net/mlx5: Set uid as part of SQ commands net/mlx5: Set uid as part of SRQ commands net/mlx5: Set uid as part of DCT commands IB/mlx5: Set uid as part of CQ creation IB/mlx5: Set uid as part of QP creation IB/mlx5: Set uid as part of RQ commands IB/mlx5: Set uid as part of SQ commands IB/mlx5: Set uid as part of TIR commands IB/mlx5: Set uid as part of TIS commands IB/mlx5: Set uid as part of RQT commands IB/mlx5: Set uid as part of PD commands IB/mlx5: Set uid as part of TD commands IB/mlx5: Set uid as part of SRQ commands IB/mlx5: Set uid as part of DCT commands IB/mlx5: Set uid as part of XRCD commands IB/mlx5: Set uid as part of MCG commands IB/mlx5: Set valid umem bit on DEVX
IB/mlx5: Expose RAW QP device handles to user space IB/mlx5: Manage device uid for DEVX white list commands IB/mlx5: Enable DEVX white list commands IB/mlx5: Enable DEVX on IB
drivers/infiniband/hw/mlx5/cmd.c | 129 ++++++++++++++++++ drivers/infiniband/hw/mlx5/cmd.h | 14 ++ drivers/infiniband/hw/mlx5/cq.c | 1 + drivers/infiniband/hw/mlx5/devx.c | 182 +++++++++++++++++++++++--- drivers/infiniband/hw/mlx5/main.c | 80 +++++++---- drivers/infiniband/hw/mlx5/mlx5_ib.h | 15 +-- drivers/infiniband/hw/mlx5/qp.c | 141 +++++++++++++++----- drivers/infiniband/hw/mlx5/srq.c | 1 + drivers/net/ethernet/mellanox/mlx5/core/cq.c | 4 + drivers/net/ethernet/mellanox/mlx5/core/qp.c | 81 ++++++++---- drivers/net/ethernet/mellanox/mlx5/core/srq.c | 30 ++++- include/linux/mlx5/cq.h | 1 + include/linux/mlx5/driver.h | 1 + include/linux/mlx5/mlx5_ifc.h | 135 +++++++++++-------- include/linux/mlx5/qp.h | 1 + include/linux/mlx5/srq.h | 1 + include/uapi/rdma/mlx5-abi.h | 13 ++ 17 files changed, 657 insertions(+), 173 deletions(-)
PATCH 1/25 net/mlx5: Set uid as part of CQ commands
From: Yishai Hadas <[email protected]>
Set uid as part of CQ commands so that the firmware can manage the CQ object in a secured way.
This will enable using a CQ that was created by verbs application to be used by the DEVX flow in case the uid is equal.
--- drivers/net/ethernet/mellanox/mlx5/core/cq.c | 4 ++++ include/linux/mlx5/cq.h | 1 + include/linux/mlx5/mlx5_ifc.h | 6 +++--- 3 files changed, 8 insertions(+), 3 deletions(-)
drivers/net/ethernet/mellanox/mlx5/core/cq.c +4 -0
@@ -109,6 +109,7 @@ int mlx5_core_create_cq(struct mlx5_core_dev *dev, struct mlx5_core_cq *cq, cq->cons_index =0 ; cq->arm_sn =0 ; cq->eq = eq; + cq->uid =MLX5_GET (create_cq_in, in, uid);refcount_set (&cq->refcount,1 );init_completion (&cq->free);if (!cq->comp)
@@ -144,6 +145,7 @@ int mlx5_core_create_cq(struct mlx5_core_dev *dev, struct mlx5_core_cq *cq,memset (dout,0 ,sizeof (dout));MLX5_SET (destroy_cq_in, din, opcode,MLX5_CMD_OP_DESTROY_CQ );MLX5_SET (destroy_cq_in, din, cqn, cq->cqn); +MLX5_SET (destroy_cq_in, din, uid, cq->uid);mlx5_cmd_exec (dev, din,sizeof (din), dout,sizeof (dout));return err; }
@@ -165,6 +167,7 @@ int mlx5_core_destroy_cq(struct mlx5_core_dev *dev, struct mlx5_core_cq *cq)MLX5_SET (destroy_cq_in, in, opcode,MLX5_CMD_OP_DESTROY_CQ );MLX5_SET (destroy_cq_in, in, cqn, cq->cqn); +MLX5_SET (destroy_cq_in, in, uid, cq->uid); err =mlx5_cmd_exec (dev, in,sizeof (in), out,sizeof (out));if (err)return err;
@@ -196,6 +199,7 @@ int mlx5_core_modify_cq(struct mlx5_core_dev *dev, struct mlx5_core_cq *cq,u32 out[MLX5_ST_SZ_DW (modify_cq_out)] = {0 };MLX5_SET (modify_cq_in, in, opcode,MLX5_CMD_OP_MODIFY_CQ ); +MLX5_SET (modify_cq_in, in, uid, cq->uid);return mlx5_cmd_exec (dev, in, inlen, out,sizeof (out)); }EXPORT_SYMBOL (mlx5_core_modify_cq);
include/linux/mlx5/cq.h +1 -0
@@ -61,6 +61,7 @@ struct mlx5_core_cq {int reset_notify_added;struct list_head reset_notify;struct mlx5_eq *eq; +u16 uid; };
include/linux/mlx5/mlx5_ifc.h +3 -3
@@ -5630,7 +5630,7 @@ enum {struct mlx5_ifc_modify_cq_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
@@ -6405,7 +6405,7 @@ struct mlx5_ifc_destroy_cq_out_bits {struct mlx5_ifc_destroy_cq_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
@@ -7165,7 +7165,7 @@ struct mlx5_ifc_create_cq_out_bits {struct mlx5_ifc_create_cq_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
Signature · 1 line
2.14.4
PATCH 2/25 net/mlx5: Set uid as part of QP commands
In reply to Leon RomanovskyFrom: Yishai Hadas <[email protected]>
Set uid as part of QP commands so that the firmware can manage the QP object in a secured way.
That will enable using a QP that was created by verbs application to be used by the DEVX flow in case the uid is equal.
--- drivers/net/ethernet/mellanox/mlx5/core/qp.c | 45 +++++++++++++++++----------- include/linux/mlx5/mlx5_ifc.h | 22 +++++++------- include/linux/mlx5/qp.h | 1 + 3 files changed, 39 insertions(+), 29 deletions(-)
drivers/net/ethernet/mellanox/mlx5/core/qp.c +27 -18
@@ -240,6 +240,7 @@ int mlx5_core_create_qp(struct mlx5_core_dev *dev,if (err)return err; + qp->uid =MLX5_GET (create_qp_in, in, uid); qp->qpn =MLX5_GET (create_qp_out, out, qpn);mlx5_core_dbg (dev,"qpn = 0x%x\n" , qp->qpn);
@@ -261,6 +262,7 @@ int mlx5_core_create_qp(struct mlx5_core_dev *dev,memset (dout,0 ,sizeof (dout));MLX5_SET (destroy_qp_in, din, opcode,MLX5_CMD_OP_DESTROY_QP );MLX5_SET (destroy_qp_in, din, qpn, qp->qpn); +MLX5_SET (destroy_qp_in, din, uid, qp->uid);mlx5_cmd_exec (dev, din,sizeof (din), dout,sizeof (dout));return err; }
@@ -320,6 +322,7 @@ int mlx5_core_destroy_qp(struct mlx5_core_dev *dev,MLX5_SET (destroy_qp_in, in, opcode,MLX5_CMD_OP_DESTROY_QP );MLX5_SET (destroy_qp_in, in, qpn, qp->qpn); +MLX5_SET (destroy_qp_in, in, uid, qp->uid); err =mlx5_cmd_exec (dev, in,sizeof (in), out,sizeof (out));if (err)return err;
@@ -373,7 +376,7 @@ static void mbox_free(struct mbox_info *mbox)static int modify_qp_mbox_alloc (struct mlx5_core_dev *dev,u16 opcode,int qpn,u32 opt_param_mask,void *qpc, -struct mbox_info *mbox) +struct mbox_info *mbox,u16 uid) { mbox->out =NULL ; mbox->in =NULL ;
@@ -381,26 +384,32 @@ static int modify_qp_mbox_alloc(struct mlx5_core_dev *dev, u16 opcode, int qpn,#define MBOX_ALLOC (mbox, typ) \ mbox_alloc(mbox, MLX5_ST_SZ_BYTES(typ##_in), MLX5_ST_SZ_BYTES(typ##_out)) -#define MOD_QP_IN_SET (typ, in, _opcode, _qpn) \ - MLX5_SET(typ##_in, in, opcode, _opcode); \ - MLX5_SET(typ##_in, in, qpn, _qpn) - -#define MOD_QP_IN_SET_QPC (typ, in, _opcode, _qpn, _opt_p, _qpc) \ - MOD_QP_IN_SET(typ, in, _opcode, _qpn); \ - MLX5_SET(typ##_in, in, opt_param_mask, _opt_p); \ - memcpy(MLX5_ADDR_OF(typ##_in, in, qpc), _qpc, MLX5_ST_SZ_BYTES(qpc)) +#define MOD_QP_IN_SET (typ, in, _opcode, _qpn, _uid) \ + do { \ + MLX5_SET(typ##_in, in, opcode, _opcode); \ + MLX5_SET(typ##_in, in, qpn, _qpn); \ + MLX5_SET(typ##_in, in, uid, _uid); \ + } while (0) + +#define MOD_QP_IN_SET_QPC (typ, in, _opcode, _qpn, _opt_p, _qpc, _uid) \ + do { \ + MOD_QP_IN_SET(typ, in, _opcode, _qpn, _uid); \ + MLX5_SET(typ##_in, in, opt_param_mask, _opt_p); \ + memcpy(MLX5_ADDR_OF(typ##_in, in, qpc), \ + _qpc, MLX5_ST_SZ_BYTES(qpc)); \ + } while (0)switch (opcode) {/* 2RST & 2ERR */ case MLX5_CMD_OP_2RST_QP :if (MBOX_ALLOC (mbox, qp_2rst))return -ENOMEM ; -MOD_QP_IN_SET (qp_2rst, mbox->in, opcode, qpn); +MOD_QP_IN_SET (qp_2rst, mbox->in, opcode, qpn, uid);break ;case MLX5_CMD_OP_2ERR_QP :if (MBOX_ALLOC (mbox, qp_2err))return -ENOMEM ; -MOD_QP_IN_SET (qp_2err, mbox->in, opcode, qpn); +MOD_QP_IN_SET (qp_2err, mbox->in, opcode, qpn, uid);break ;/* MODIFY with QPC */
@@ -408,37 +417,37 @@ static int modify_qp_mbox_alloc(struct mlx5_core_dev *dev, u16 opcode, int qpn,if (MBOX_ALLOC (mbox, rst2init_qp))return -ENOMEM ;MOD_QP_IN_SET_QPC (rst2init_qp, mbox->in, opcode, qpn, - opt_param_mask, qpc); + opt_param_mask, qpc, uid);break ;case MLX5_CMD_OP_INIT2RTR_QP :if (MBOX_ALLOC (mbox, init2rtr_qp))return -ENOMEM ;MOD_QP_IN_SET_QPC (init2rtr_qp, mbox->in, opcode, qpn, - opt_param_mask, qpc); + opt_param_mask, qpc, uid);break ;case MLX5_CMD_OP_RTR2RTS_QP :if (MBOX_ALLOC (mbox, rtr2rts_qp))return -ENOMEM ;MOD_QP_IN_SET_QPC (rtr2rts_qp, mbox->in, opcode, qpn, - opt_param_mask, qpc); + opt_param_mask, qpc, uid);break ;case MLX5_CMD_OP_RTS2RTS_QP :if (MBOX_ALLOC (mbox, rts2rts_qp))return -ENOMEM ;MOD_QP_IN_SET_QPC (rts2rts_qp, mbox->in, opcode, qpn, - opt_param_mask, qpc); + opt_param_mask, qpc, uid);break ;case MLX5_CMD_OP_SQERR2RTS_QP :if (MBOX_ALLOC (mbox, sqerr2rts_qp))return -ENOMEM ;MOD_QP_IN_SET_QPC (sqerr2rts_qp, mbox->in, opcode, qpn, - opt_param_mask, qpc); + opt_param_mask, qpc, uid);break ;case MLX5_CMD_OP_INIT2INIT_QP :if (MBOX_ALLOC (mbox, init2init_qp))return -ENOMEM ;MOD_QP_IN_SET_QPC (init2init_qp, mbox->in, opcode, qpn, - opt_param_mask, qpc); + opt_param_mask, qpc, uid);break ;default : mlx5_core_err(dev, "Unknown transition for modify QP: OP(0x%x) QPN(0x%x)\n",
@@ -456,7 +465,7 @@ int mlx5_core_qp_modify(struct mlx5_core_dev *dev, u16 opcode,int err; err =modify_qp_mbox_alloc (dev, opcode, qp->qpn, - opt_param_mask, qpc, &mbox); + opt_param_mask, qpc, &mbox, qp->uid);if (err)return err;
include/linux/mlx5/mlx5_ifc.h +11 -11
@@ -3395,7 +3395,7 @@ struct mlx5_ifc_sqerr2rts_qp_out_bits {struct mlx5_ifc_sqerr2rts_qp_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
@@ -3425,7 +3425,7 @@ struct mlx5_ifc_sqd2rts_qp_out_bits {struct mlx5_ifc_sqd2rts_qp_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
@@ -3630,7 +3630,7 @@ struct mlx5_ifc_rts2rts_qp_out_bits {struct mlx5_ifc_rts2rts_qp_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
@@ -3660,7 +3660,7 @@ struct mlx5_ifc_rtr2rts_qp_out_bits {struct mlx5_ifc_rtr2rts_qp_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
@@ -3690,7 +3690,7 @@ struct mlx5_ifc_rst2init_qp_out_bits {struct mlx5_ifc_rst2init_qp_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
@@ -5193,7 +5193,7 @@ struct mlx5_ifc_qp_2rst_out_bits {struct mlx5_ifc_qp_2rst_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
@@ -5215,7 +5215,7 @@ struct mlx5_ifc_qp_2err_out_bits {struct mlx5_ifc_qp_2err_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
@@ -5790,7 +5790,7 @@ struct mlx5_ifc_init2rtr_qp_out_bits {struct mlx5_ifc_init2rtr_qp_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
@@ -5820,7 +5820,7 @@ struct mlx5_ifc_init2init_qp_out_bits {struct mlx5_ifc_init2init_qp_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
@@ -6231,7 +6231,7 @@ struct mlx5_ifc_destroy_qp_out_bits {struct mlx5_ifc_destroy_qp_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
@@ -6896,7 +6896,7 @@ struct mlx5_ifc_create_qp_out_bits {struct mlx5_ifc_create_qp_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
include/linux/mlx5/qp.h +1 -0
@@ -471,6 +471,7 @@ struct mlx5_core_qp {int qpn;struct mlx5_rsc_debug *dbg;int pid; +u16 uid; };struct mlx5_core_dct {
Signature · 1 line
2.14.4
Re: [PATCH mlx5-next 02/25] net/mlx5: Set uid as part of QP commands
Quoted 67 lines · Leon Romanovsky
From: Yishai Hadas <[email protected]>
Set uid as part of QP commands so that the firmware can manage the QP object in a secured way.
That will enable using a QP that was created by verbs application to be used by the DEVX flow in case the uid is equal.
Signed-off-by Yishai Hadas <[email protected]>Signed-off-by Leon Romanovsky <[email protected]>drivers/net/ethernet/mellanox/mlx5/core/qp.c | 45 +++++++++++++++++----------- include/linux/mlx5/mlx5_ifc.h | 22 +++++++------- include/linux/mlx5/qp.h | 1 + 3 files changed, 39 insertions(+), 29 deletions(-)drivers/net/ethernet/mellanox/mlx5/core/qp.c +9
-9+++ b/drivers/net/ethernet/mellanox/mlx5/core/qp.c@@ -240,6 +240,7 @@ int mlx5_core_create_qp(struct mlx5_core_dev *dev,if (err)return err; + qp->uid =MLX5_GET (create_qp_in, in, uid); qp->qpn =MLX5_GET (create_qp_out, out, qpn);mlx5_core_dbg (dev,"qpn = 0x%x\n" , qp->qpn);@@ -261,6 +262,7 @@ int mlx5_core_create_qp(struct mlx5_core_dev *dev,memset (dout,0 ,sizeof (dout));MLX5_SET (destroy_qp_in, din, opcode,MLX5_CMD_OP_DESTROY_QP );MLX5_SET (destroy_qp_in, din, qpn, qp->qpn); +MLX5_SET (destroy_qp_in, din, uid, qp->uid);mlx5_cmd_exec (dev, din,sizeof (din), dout,sizeof (dout));return err; }@@ -320,6 +322,7 @@ int mlx5_core_destroy_qp(struct mlx5_core_dev *dev,MLX5_SET (destroy_qp_in, in, opcode,MLX5_CMD_OP_DESTROY_QP );MLX5_SET (destroy_qp_in, in, qpn, qp->qpn); +MLX5_SET (destroy_qp_in, in, uid, qp->uid); err =mlx5_cmd_exec (dev, in,sizeof (in), out,sizeof (out));if (err)return err;@@ -373,7 +376,7 @@ static void mbox_free(struct mbox_info *mbox)static int modify_qp_mbox_alloc (struct mlx5_core_dev *dev,u16 opcode,int qpn,u32 opt_param_mask,void *qpc, -struct mbox_info *mbox) +struct mbox_info *mbox,u16 uid) { mbox->out =NULL ; mbox->in =NULL ;@@ -381,26 +384,32 @@ static int modify_qp_mbox_alloc(struct mlx5_core_dev *dev, u16 opcode, int qpn,#define MBOX_ALLOC (mbox, typ) \ mbox_alloc(mbox, MLX5_ST_SZ_BYTES(typ##_in), MLX5_ST_SZ_BYTES(typ##_out)) -#define MOD_QP_IN_SET (typ, in, _opcode, _qpn) \ - MLX5_SET(typ##_in, in, opcode, _opcode); \ - MLX5_SET(typ##_in, in, qpn, _qpn) - -#define MOD_QP_IN_SET_QPC (typ, in, _opcode, _qpn, _opt_p, _qpc) \ - MOD_QP_IN_SET(typ, in, _opcode, _qpn); \ - MLX5_SET(typ##_in, in, opt_param_mask, _opt_p); \ - memcpy(MLX5_ADDR_OF(typ##_in, in, qpc), _qpc, MLX5_ST_SZ_BYTES(qpc)) +#define MOD_QP_IN_SET (typ, in, _opcode, _qpn, _uid) \ + do { \ + MLX5_SET(typ##_in, in, opcode, _opcode); \ + MLX5_SET(typ##_in, in, qpn, _qpn); \
drivers/net/ethernet/mellanox/mlx5/core/qp.c static int modify_qp_mbox_alloc(struct mlx5_core_dev *dev, u16 opcode, int qpn, · line 400
Quoted 10 lines
drivers/net/ethernet/mellanox/mlx5/core/qp.c +10
-0+ MLX5_SET(typ##_in, in, uid, _uid); \ + } while (0) + +#define MOD_QP_IN_SET_QPC (typ, in, _opcode, _qpn, _opt_p, _qpc, _uid) \ + do { \ + MOD_QP_IN_SET(typ, in, _opcode, _qpn, _uid); \ + MLX5_SET(typ##_in, in, opt_param_mask, _opt_p); \ + memcpy(MLX5_ADDR_OF(typ##_in, in, qpc), \ + _qpc, MLX5_ST_SZ_BYTES(qpc)); \ + } while (0)
These should get touched by clang-format to follow the usual formatting for macros..
Jason
Re: [PATCH mlx5-next 02/25] net/mlx5: Set uid as part of QP commands
Quoted 73 lines · Jason Gunthorpe
Quoted 72 lines · Leon Romanovsky
From: Yishai Hadas <[email protected]>
Set uid as part of QP commands so that the firmware can manage the QP object in a secured way.
That will enable using a QP that was created by verbs application to be used by the DEVX flow in case the uid is equal.
Signed-off-by Yishai Hadas <[email protected]>Signed-off-by Leon Romanovsky <[email protected]>drivers/net/ethernet/mellanox/mlx5/core/qp.c | 45 +++++++++++++++++----------- include/linux/mlx5/mlx5_ifc.h | 22 +++++++------- include/linux/mlx5/qp.h | 1 + 3 files changed, 39 insertions(+), 29 deletions(-)drivers/net/ethernet/mellanox/mlx5/core/qp.c +14
-9+++ b/drivers/net/ethernet/mellanox/mlx5/core/qp.c@@ -240,6 +240,7 @@ int mlx5_core_create_qp(struct mlx5_core_dev *dev,if (err)return err; + qp->uid =MLX5_GET (create_qp_in, in, uid); qp->qpn =MLX5_GET (create_qp_out, out, qpn);mlx5_core_dbg (dev,"qpn = 0x%x\n" , qp->qpn);@@ -261,6 +262,7 @@ int mlx5_core_create_qp(struct mlx5_core_dev *dev,memset (dout,0 ,sizeof (dout));MLX5_SET (destroy_qp_in, din, opcode,MLX5_CMD_OP_DESTROY_QP );MLX5_SET (destroy_qp_in, din, qpn, qp->qpn); +MLX5_SET (destroy_qp_in, din, uid, qp->uid);mlx5_cmd_exec (dev, din,sizeof (din), dout,sizeof (dout));return err; }@@ -320,6 +322,7 @@ int mlx5_core_destroy_qp(struct mlx5_core_dev *dev,MLX5_SET (destroy_qp_in, in, opcode,MLX5_CMD_OP_DESTROY_QP );MLX5_SET (destroy_qp_in, in, qpn, qp->qpn); +MLX5_SET (destroy_qp_in, in, uid, qp->uid); err =mlx5_cmd_exec (dev, in,sizeof (in), out,sizeof (out));if (err)return err;@@ -373,7 +376,7 @@ static void mbox_free(struct mbox_info *mbox)static int modify_qp_mbox_alloc (struct mlx5_core_dev *dev,u16 opcode,int qpn,u32 opt_param_mask,void *qpc, -struct mbox_info *mbox) +struct mbox_info *mbox,u16 uid) { mbox->out =NULL ; mbox->in =NULL ;@@ -381,26 +384,32 @@ static int modify_qp_mbox_alloc(struct mlx5_core_dev *dev, u16 opcode, int qpn,#define MBOX_ALLOC (mbox, typ) \ mbox_alloc(mbox, MLX5_ST_SZ_BYTES(typ##_in), MLX5_ST_SZ_BYTES(typ##_out)) -#define MOD_QP_IN_SET (typ, in, _opcode, _qpn) \ - MLX5_SET(typ##_in, in, opcode, _opcode); \ - MLX5_SET(typ##_in, in, qpn, _qpn) - -#define MOD_QP_IN_SET_QPC (typ, in, _opcode, _qpn, _opt_p, _qpc) \ - MOD_QP_IN_SET(typ, in, _opcode, _qpn); \ - MLX5_SET(typ##_in, in, opt_param_mask, _opt_p); \ - memcpy(MLX5_ADDR_OF(typ##_in, in, qpc), _qpc, MLX5_ST_SZ_BYTES(qpc)) +#define MOD_QP_IN_SET (typ, in, _opcode, _qpn, _uid) \ + do { \ + MLX5_SET(typ##_in, in, opcode, _opcode); \ + MLX5_SET(typ##_in, in, qpn, _qpn); \ + MLX5_SET(typ##_in, in, uid, _uid); \ + } while (0) + +#define MOD_QP_IN_SET_QPC (typ, in, _opcode, _qpn, _opt_p, _qpc, _uid) \ + do { \
Quoted 8 lines
drivers/net/ethernet/mellanox/mlx5/core/qp.c static int modify_qp_mbox_alloc(struct mlx5_core_dev *dev, u16 opcode, int qpn, · line 400
Quoted 5 lines
drivers/net/ethernet/mellanox/mlx5/core/qp.c +5
-0+MOD_QP_IN_SET (typ, in, _opcode, _qpn, _uid); \ + MLX5_SET(typ##_in, in, opt_param_mask, _opt_p); \ + memcpy(MLX5_ADDR_OF(typ##_in, in, qpc), \ + _qpc, MLX5_ST_SZ_BYTES(qpc)); \ + }while (0 )These should get touched by clang-format to follow the usual formatting for macros..
Thanks, we will do.
Quoted 2 lines
Jason
PATCH 3/25 net/mlx5: Set uid as part of RQ commands
In reply to Leon RomanovskyFrom: Yishai Hadas <[email protected]>
Set uid as part of RQ commands so that the firmware can manage the RQ object in a secured way.
That will enable using an RQ that was created by verbs application to be used by the DEVX flow in case the uid is equal.
--- drivers/net/ethernet/mellanox/mlx5/core/qp.c | 16 ++++++++++++++-- include/linux/mlx5/mlx5_ifc.h | 6 +++--- 2 files changed, 17 insertions(+), 5 deletions(-)
drivers/net/ethernet/mellanox/mlx5/core/qp.c +14 -2
@@ -540,6 +540,17 @@ int mlx5_core_xrcd_dealloc(struct mlx5_core_dev *dev, u32 xrcdn) }EXPORT_SYMBOL_GPL (mlx5_core_xrcd_dealloc); +static void destroy_rq_tracked (struct mlx5_core_dev *dev,u32 rqn,u16 uid) +{ +u32 in[MLX5_ST_SZ_DW (destroy_rq_in)] = {0 }; +u32 out[MLX5_ST_SZ_DW (destroy_rq_out)] = {0 }; + +MLX5_SET (destroy_rq_in, in, opcode,MLX5_CMD_OP_DESTROY_RQ ); +MLX5_SET (destroy_rq_in, in, rqn, rqn); +MLX5_SET (destroy_rq_in, in, uid, uid); +mlx5_cmd_exec (dev, in,sizeof (in), out,sizeof (out)); +} +int mlx5_core_create_rq_tracked (struct mlx5_core_dev *dev,u32 *in,int inlen,struct mlx5_core_qp *rq) {
@@ -550,6 +561,7 @@ int mlx5_core_create_rq_tracked(struct mlx5_core_dev *dev, u32 *in, int inlen,if (err)return err; + rq->uid =MLX5_GET (create_rq_in, in, uid); rq->qpn = rqn; err =create_resource_common (dev, rq,MLX5_RES_RQ );if (err)
@@ -558,7 +570,7 @@ int mlx5_core_create_rq_tracked(struct mlx5_core_dev *dev, u32 *in, int inlen,return 0 ; err_destroy_rq: -mlx5_core_destroy_rq (dev, rq->qpn); +destroy_rq_tracked (dev, rq->qpn, rq->uid);return err; }
@@ -568,7 +580,7 @@ void mlx5_core_destroy_rq_tracked(struct mlx5_core_dev *dev, struct mlx5_core_qp *rq) {destroy_resource_common (dev, rq); -mlx5_core_destroy_rq (dev, rq->qpn); +destroy_rq_tracked (dev, rq->qpn, rq->uid); }EXPORT_SYMBOL (mlx5_core_destroy_rq_tracked);
include/linux/mlx5/mlx5_ifc.h +3 -3
@@ -5489,7 +5489,7 @@ enum {struct mlx5_ifc_modify_rq_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
@@ -6165,7 +6165,7 @@ struct mlx5_ifc_destroy_rq_out_bits {struct mlx5_ifc_destroy_rq_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
@@ -6848,7 +6848,7 @@ struct mlx5_ifc_create_rq_out_bits {struct mlx5_ifc_create_rq_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
Signature · 1 line
2.14.4
Re: [PATCH mlx5-next 03/25] net/mlx5: Set uid as part of RQ commands
Quoted 18 lines · Leon Romanovsky
From: Yishai Hadas <[email protected]>
Set uid as part of RQ commands so that the firmware can manage the RQ object in a secured way.
That will enable using an RQ that was created by verbs application to be used by the DEVX flow in case the uid is equal.
Signed-off-by Yishai Hadas <[email protected]>Signed-off-by Leon Romanovsky <[email protected]>drivers/net/ethernet/mellanox/mlx5/core/qp.c | 16 ++++++++++++++-- include/linux/mlx5/mlx5_ifc.h | 6 +++--- 2 files changed, 17 insertions(+), 5 deletions(-)drivers/net/ethernet/mellanox/mlx5/core/qp.c +1
-0+++ b/drivers/net/ethernet/mellanox/mlx5/core/qp.c
drivers/net/ethernet/mellanox/mlx5/core/qp.c int mlx5_core_xrcd_dealloc(struct mlx5_core_dev *dev, u32 xrcdn) · line 546
Quoted 7 lines
drivers/net/ethernet/mellanox/mlx5/core/qp.c +4
-0@@ -540,6 +540,17 @@ int mlx5_core_xrcd_dealloc(struct mlx5_core_dev *dev, u32 xrcdn) }EXPORT_SYMBOL_GPL (mlx5_core_xrcd_dealloc); +static void destroy_rq_tracked (struct mlx5_core_dev *dev,u32 rqn,u16 uid) +{ +u32 in[MLX5_ST_SZ_DW (destroy_rq_in)] = {0 }; +u32 out[MLX5_ST_SZ_DW (destroy_rq_out)] = {0 };
= {} is the preferred version of this, right?
{0} explicitly initializes the first element to zero and only works if the first element happens to be something integral..
Jason
Re: [PATCH mlx5-next 03/25] net/mlx5: Set uid as part of RQ commands
Quoted 30 lines · Jason Gunthorpe
Quoted 18 lines · Leon Romanovsky
From: Yishai Hadas <[email protected]>
Set uid as part of RQ commands so that the firmware can manage the RQ object in a secured way.
That will enable using an RQ that was created by verbs application to be used by the DEVX flow in case the uid is equal.
Signed-off-by Yishai Hadas <[email protected]>Signed-off-by Leon Romanovsky <[email protected]>drivers/net/ethernet/mellanox/mlx5/core/qp.c | 16 ++++++++++++++-- include/linux/mlx5/mlx5_ifc.h | 6 +++--- 2 files changed, 17 insertions(+), 5 deletions(-)drivers/net/ethernet/mellanox/mlx5/core/qp.c +1
-0+++ b/drivers/net/ethernet/mellanox/mlx5/core/qp.cdrivers/net/ethernet/mellanox/mlx5/core/qp.c int mlx5_core_xrcd_dealloc(struct mlx5_core_dev *dev, u32 xrcdn) · line 546
Quoted 7 lines
drivers/net/ethernet/mellanox/mlx5/core/qp.c +4
-0@@ -540,6 +540,17 @@ int mlx5_core_xrcd_dealloc(struct mlx5_core_dev *dev, u32 xrcdn) }EXPORT_SYMBOL_GPL (mlx5_core_xrcd_dealloc); +static void destroy_rq_tracked (struct mlx5_core_dev *dev,u32 rqn,u16 uid) +{ +u32 in[MLX5_ST_SZ_DW (destroy_rq_in)] = {0 }; +u32 out[MLX5_ST_SZ_DW (destroy_rq_out)] = {0 };= {} is the preferred version of this, right?
Quoted 3 lines
{0} explicitly initializes the first element to zero and only works if the first element happens to be something integral..
Both are perfectly ok in our scenarios.
I remember one of the syntaxes yielded a statistic checker warning, i don't remember which syntax and what static checker :) ..
Quoted 1 line
Jason
Re: [PATCH mlx5-next 03/25] net/mlx5: Set uid as part of RQ commands
Quoted 31 lines · Saeed Mahameed
Quoted 30 lines · Jason Gunthorpe
Quoted 18 lines · Leon Romanovsky
From: Yishai Hadas <[email protected]>
Set uid as part of RQ commands so that the firmware can manage the RQ object in a secured way.
That will enable using an RQ that was created by verbs application to be used by the DEVX flow in case the uid is equal.
Signed-off-by Yishai Hadas <[email protected]>Signed-off-by Leon Romanovsky <[email protected]>drivers/net/ethernet/mellanox/mlx5/core/qp.c | 16 ++++++++++++++-- include/linux/mlx5/mlx5_ifc.h | 6 +++--- 2 files changed, 17 insertions(+), 5 deletions(-)drivers/net/ethernet/mellanox/mlx5/core/qp.c +1
-0+++ b/drivers/net/ethernet/mellanox/mlx5/core/qp.cdrivers/net/ethernet/mellanox/mlx5/core/qp.c int mlx5_core_xrcd_dealloc(struct mlx5_core_dev *dev, u32 xrcdn) · line 546
Quoted 7 lines
drivers/net/ethernet/mellanox/mlx5/core/qp.c +4
-0@@ -540,6 +540,17 @@ int mlx5_core_xrcd_dealloc(struct mlx5_core_dev *dev, u32 xrcdn) }EXPORT_SYMBOL_GPL (mlx5_core_xrcd_dealloc); +static void destroy_rq_tracked (struct mlx5_core_dev *dev,u32 rqn,u16 uid) +{ +u32 in[MLX5_ST_SZ_DW (destroy_rq_in)] = {0 }; +u32 out[MLX5_ST_SZ_DW (destroy_rq_out)] = {0 };= {} is the preferred version of this, right?
Quoted 7 lines
Quoted 3 lines
{0} explicitly initializes the first element to zero and only works if the first element happens to be something integral..
Both are perfectly ok in our scenarios.
I remember one of the syntaxes yielded a statistic checker warning, i don't remember which syntax and what static checker :) ..
{0} will throw a 'missing-field-initializers' compiler warning, however it recognizes '= {}' as an idom meaning 'zero everything' and does not throw a warning.
Jason
PATCH 4/25 net/mlx5: Set uid as part of SQ commands
In reply to Leon RomanovskyFrom: Yishai Hadas <[email protected]>
Set uid as part of SQ commands so that the firmware can manage the SQ object in a secured way.
That will enable using an SQ that was created by verbs application to be used by the DEVX flow in case the uid is equal.
--- drivers/net/ethernet/mellanox/mlx5/core/qp.c | 16 ++++++++++++++-- include/linux/mlx5/mlx5_ifc.h | 6 +++--- 2 files changed, 17 insertions(+), 5 deletions(-)
drivers/net/ethernet/mellanox/mlx5/core/qp.c +14 -2
@@ -584,6 +584,17 @@ void mlx5_core_destroy_rq_tracked(struct mlx5_core_dev *dev, }EXPORT_SYMBOL (mlx5_core_destroy_rq_tracked); +static void destroy_sq_tracked (struct mlx5_core_dev *dev,u32 sqn,u16 uid) +{ +u32 in[MLX5_ST_SZ_DW (destroy_sq_in)] = {0 }; +u32 out[MLX5_ST_SZ_DW (destroy_sq_out)] = {0 }; + +MLX5_SET (destroy_sq_in, in, opcode,MLX5_CMD_OP_DESTROY_SQ ); +MLX5_SET (destroy_sq_in, in, sqn, sqn); +MLX5_SET (destroy_sq_in, in, uid, uid); +mlx5_cmd_exec (dev, in,sizeof (in), out,sizeof (out)); +} +int mlx5_core_create_sq_tracked (struct mlx5_core_dev *dev,u32 *in,int inlen,struct mlx5_core_qp *sq) {
@@ -594,6 +605,7 @@ int mlx5_core_create_sq_tracked(struct mlx5_core_dev *dev, u32 *in, int inlen,if (err)return err; + sq->uid =MLX5_GET (create_sq_in, in, uid); sq->qpn = sqn; err =create_resource_common (dev, sq,MLX5_RES_SQ );if (err)
@@ -602,7 +614,7 @@ int mlx5_core_create_sq_tracked(struct mlx5_core_dev *dev, u32 *in, int inlen,return 0 ; err_destroy_sq: -mlx5_core_destroy_sq (dev, sq->qpn); +destroy_sq_tracked (dev, sq->qpn, sq->uid);return err; }
@@ -612,7 +624,7 @@ void mlx5_core_destroy_sq_tracked(struct mlx5_core_dev *dev, struct mlx5_core_qp *sq) {destroy_resource_common (dev, sq); -mlx5_core_destroy_sq (dev, sq->qpn); +destroy_sq_tracked (dev, sq->qpn, sq->uid); }EXPORT_SYMBOL (mlx5_core_destroy_sq_tracked);
include/linux/mlx5/mlx5_ifc.h +3 -3
@@ -5382,7 +5382,7 @@ struct mlx5_ifc_modify_sq_out_bits {struct mlx5_ifc_modify_sq_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
@@ -6097,7 +6097,7 @@ struct mlx5_ifc_destroy_sq_out_bits {struct mlx5_ifc_destroy_sq_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
@@ -6770,7 +6770,7 @@ struct mlx5_ifc_create_sq_out_bits {struct mlx5_ifc_create_sq_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
Signature · 1 line
2.14.4
PATCH 5/25 net/mlx5: Set uid as part of SRQ commands
In reply to Leon RomanovskyFrom: Yishai Hadas <[email protected]>
Set uid as part of SRQ commands so that the firmware can manage the SRQ object in a secured way.
That will enable using an SRQ that was created by verbs application to be used by the DEVX flow in case the uid is equal.
--- drivers/net/ethernet/mellanox/mlx5/core/srq.c | 30 ++++++++++++++++++++++++--- include/linux/mlx5/driver.h | 1 + include/linux/mlx5/mlx5_ifc.h | 22 ++++++++++---------- include/linux/mlx5/srq.h | 1 + 4 files changed, 40 insertions(+), 14 deletions(-)
drivers/net/ethernet/mellanox/mlx5/core/srq.c +27 -3
@@ -166,6 +166,7 @@ static int create_srq_cmd(struct mlx5_core_dev *dev, struct mlx5_core_srq *srq,if (!create_in)return -ENOMEM ; +MLX5_SET (create_srq_in, create_in, uid, in->uid); srqc =MLX5_ADDR_OF (create_srq_in, create_in, srq_context_entry); pas =MLX5_ADDR_OF (create_srq_in, create_in, pas);
@@ -178,8 +179,10 @@ static int create_srq_cmd(struct mlx5_core_dev *dev, struct mlx5_core_srq *srq, err =mlx5_cmd_exec (dev, create_in, inlen, create_out,sizeof (create_out));kvfree (create_in); -if (!err) +if (!err) { srq->srqn =MLX5_GET (create_srq_out, create_out, srqn); + srq->uid = in->uid; + }return err; }
@@ -193,6 +196,7 @@ static int destroy_srq_cmd(struct mlx5_core_dev *dev,MLX5_SET (destroy_srq_in, srq_in, opcode,MLX5_CMD_OP_DESTROY_SRQ );MLX5_SET (destroy_srq_in, srq_in, srqn, srq->srqn); +MLX5_SET (destroy_srq_in, srq_in, uid, srq->uid);return mlx5_cmd_exec (dev, srq_in,sizeof (srq_in), srq_out,sizeof (srq_out));
@@ -208,6 +212,7 @@ static int arm_srq_cmd(struct mlx5_core_dev *dev, struct mlx5_core_srq *srq,MLX5_SET (arm_rq_in, srq_in, op_mod,MLX5_ARM_RQ_IN_OP_MOD_SRQ );MLX5_SET (arm_rq_in, srq_in, srq_number, srq->srqn);MLX5_SET (arm_rq_in, srq_in, lwm, lwm); +MLX5_SET (arm_rq_in, srq_in, uid, srq->uid);return mlx5_cmd_exec (dev, srq_in,sizeof (srq_in), srq_out,sizeof (srq_out));
@@ -260,6 +265,7 @@ static int create_xrc_srq_cmd(struct mlx5_core_dev *dev,if (!create_in)return -ENOMEM ; +MLX5_SET (create_xrc_srq_in, create_in, uid, in->uid); xrc_srqc =MLX5_ADDR_OF (create_xrc_srq_in, create_in, xrc_srq_context_entry); pas =MLX5_ADDR_OF (create_xrc_srq_in, create_in, pas);
@@ -277,6 +283,7 @@ static int create_xrc_srq_cmd(struct mlx5_core_dev *dev, goto out; srq->srqn =MLX5_GET (create_xrc_srq_out, create_out, xrc_srqn); + srq->uid = in->uid; out:kvfree (create_in);return err;
@@ -291,6 +298,7 @@ static int destroy_xrc_srq_cmd(struct mlx5_core_dev *dev,MLX5_SET (destroy_xrc_srq_in, xrcsrq_in, opcode,MLX5_CMD_OP_DESTROY_XRC_SRQ );MLX5_SET (destroy_xrc_srq_in, xrcsrq_in, xrc_srqn, srq->srqn); +MLX5_SET (destroy_xrc_srq_in, xrcsrq_in, uid, srq->uid);return mlx5_cmd_exec (dev, xrcsrq_in,sizeof (xrcsrq_in), xrcsrq_out,sizeof (xrcsrq_out));
@@ -306,6 +314,7 @@ static int arm_xrc_srq_cmd(struct mlx5_core_dev *dev,MLX5_SET (arm_xrc_srq_in, xrcsrq_in, op_mod,MLX5_ARM_XRC_SRQ_IN_OP_MOD_XRC_SRQ );MLX5_SET (arm_xrc_srq_in, xrcsrq_in, xrc_srqn, srq->srqn);MLX5_SET (arm_xrc_srq_in, xrcsrq_in, lwm, lwm); +MLX5_SET (arm_xrc_srq_in, xrcsrq_in, uid, srq->uid);return mlx5_cmd_exec (dev, xrcsrq_in,sizeof (xrcsrq_in), xrcsrq_out,sizeof (xrcsrq_out));
@@ -365,10 +374,13 @@ static int create_rmp_cmd(struct mlx5_core_dev *dev, struct mlx5_core_srq *srq, wq =MLX5_ADDR_OF (rmpc, rmpc, wq);MLX5_SET (rmpc, rmpc, state,MLX5_RMPC_STATE_RDY ); +MLX5_SET (create_rmp_in, create_in, uid, in->uid);set_wq (wq, in);memcpy (MLX5_ADDR_OF (rmpc, rmpc, wq.pas), in->pas, pas_size); err =mlx5_core_create_rmp (dev, create_in, inlen, &srq->srqn); +if (!err) + srq->uid = in->uid;kvfree (create_in);return err;
@@ -377,7 +389,13 @@ static int create_rmp_cmd(struct mlx5_core_dev *dev, struct mlx5_core_srq *srq,static int destroy_rmp_cmd (struct mlx5_core_dev *dev,struct mlx5_core_srq *srq) { -return mlx5_core_destroy_rmp (dev, srq->srqn); +u32 in[MLX5_ST_SZ_DW (destroy_rmp_in)] = {0 }; +u32 out[MLX5_ST_SZ_DW (destroy_rmp_out)] = {0 }; + +MLX5_SET (destroy_rmp_in, in, opcode,MLX5_CMD_OP_DESTROY_RMP ); +MLX5_SET (destroy_rmp_in, in, rmpn, srq->srqn); +MLX5_SET (destroy_rmp_in, in, uid, srq->uid); +return mlx5_cmd_exec (dev, in,sizeof (in), out,sizeof (out)); } static int arm_rmp_cmd(struct mlx5_core_dev *dev,
@@ -400,6 +418,7 @@ static int arm_rmp_cmd(struct mlx5_core_dev *dev,MLX5_SET (modify_rmp_in, in, rmp_state,MLX5_RMPC_STATE_RDY );MLX5_SET (modify_rmp_in, in, rmpn, srq->srqn); +MLX5_SET (modify_rmp_in, in, uid, srq->uid);MLX5_SET (wq, wq, lwm, lwm);MLX5_SET (rmp_bitmask, bitmask, lwm,1 );MLX5_SET (rmpc, rmpc, state,MLX5_RMPC_STATE_RDY );
@@ -469,11 +488,14 @@ static int create_xrq_cmd(struct mlx5_core_dev *dev, struct mlx5_core_srq *srq,MLX5_SET (xrqc, xrqc, user_index, in->user_index);MLX5_SET (xrqc, xrqc, cqn, in->cqn);MLX5_SET (create_xrq_in, create_in, opcode,MLX5_CMD_OP_CREATE_XRQ ); +MLX5_SET (create_xrq_in, create_in, uid, in->uid); err =mlx5_cmd_exec (dev, create_in, inlen, create_out,sizeof (create_out));kvfree (create_in); -if (!err) +if (!err) { srq->srqn =MLX5_GET (create_xrq_out, create_out, xrqn); + srq->uid = in->uid; + }return err; }
@@ -485,6 +507,7 @@ static int destroy_xrq_cmd(struct mlx5_core_dev *dev, struct mlx5_core_srq *srq)MLX5_SET (destroy_xrq_in, in, opcode,MLX5_CMD_OP_DESTROY_XRQ );MLX5_SET (destroy_xrq_in, in, xrqn, srq->srqn); +MLX5_SET (destroy_xrq_in, in, uid, srq->uid);return mlx5_cmd_exec (dev, in,sizeof (in), out,sizeof (out)); }
@@ -500,6 +523,7 @@ static int arm_xrq_cmd(struct mlx5_core_dev *dev,MLX5_SET (arm_rq_in, in, op_mod,MLX5_ARM_RQ_IN_OP_MOD_XRQ );MLX5_SET (arm_rq_in, in, srq_number, srq->srqn);MLX5_SET (arm_rq_in, in, lwm, lwm); +MLX5_SET (arm_rq_in, in, uid, srq->uid);return mlx5_cmd_exec (dev, in,sizeof (in), out,sizeof (out)); }
include/linux/mlx5/driver.h +1 -0
@@ -474,6 +474,7 @@ struct mlx5_core_srq {atomic_t refcount;struct completion free; +u16 uid; };struct mlx5_eq_table {
include/linux/mlx5/mlx5_ifc.h +11 -11
@@ -5525,7 +5525,7 @@ struct mlx5_ifc_rmp_bitmask_bits {struct mlx5_ifc_modify_rmp_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
@@ -5987,7 +5987,7 @@ struct mlx5_ifc_destroy_xrq_out_bits {struct mlx5_ifc_destroy_xrq_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
@@ -6009,7 +6009,7 @@ struct mlx5_ifc_destroy_xrc_srq_out_bits {struct mlx5_ifc_destroy_xrc_srq_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
@@ -6075,7 +6075,7 @@ struct mlx5_ifc_destroy_srq_out_bits {struct mlx5_ifc_destroy_srq_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
@@ -6209,7 +6209,7 @@ struct mlx5_ifc_destroy_rmp_out_bits {struct mlx5_ifc_destroy_rmp_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
@@ -6642,7 +6642,7 @@ struct mlx5_ifc_create_xrq_out_bits {struct mlx5_ifc_create_xrq_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
@@ -6666,7 +6666,7 @@ struct mlx5_ifc_create_xrc_srq_out_bits {struct mlx5_ifc_create_xrc_srq_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
@@ -6742,7 +6742,7 @@ struct mlx5_ifc_create_srq_out_bits {struct mlx5_ifc_create_srq_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
@@ -6872,7 +6872,7 @@ struct mlx5_ifc_create_rmp_out_bits {struct mlx5_ifc_create_rmp_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
@@ -7273,7 +7273,7 @@ enum {struct mlx5_ifc_arm_xrc_srq_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
@@ -7301,7 +7301,7 @@ enum {struct mlx5_ifc_arm_rq_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
include/linux/mlx5/srq.h +1 -0
@@ -61,6 +61,7 @@ struct mlx5_srq_attr {u32 tm_next_tag;u32 tm_hw_phase_cnt;u32 tm_sw_phase_cnt; +u16 uid; };struct mlx5_core_dev ;
Signature · 1 line
2.14.4
PATCH 6/25 net/mlx5: Set uid as part of DCT commands
In reply to Leon RomanovskyFrom: Yishai Hadas <[email protected]>
Set uid as part of DCT commands so that the firmware can manage the DCT object in a secured way.
That will enable using a DCT that was created by verbs application to be used by the DEVX flow in case the uid is equal.
--- drivers/net/ethernet/mellanox/mlx5/core/qp.c | 4 ++++ include/linux/mlx5/mlx5_ifc.h | 6 +++--- 2 files changed, 7 insertions(+), 3 deletions(-)
drivers/net/ethernet/mellanox/mlx5/core/qp.c +4 -0
@@ -211,6 +211,7 @@ int mlx5_core_create_dct(struct mlx5_core_dev *dev, } qp->qpn =MLX5_GET (create_dct_out, out, dctn); + qp->uid =MLX5_GET (create_dct_in, in, uid); err =create_resource_common (dev, qp,MLX5_RES_DCT );if (err) goto err_cmd;
@@ -219,6 +220,7 @@ int mlx5_core_create_dct(struct mlx5_core_dev *dev, err_cmd:MLX5_SET (destroy_dct_in, din, opcode,MLX5_CMD_OP_DESTROY_DCT );MLX5_SET (destroy_dct_in, din, dctn, qp->qpn); +MLX5_SET (destroy_dct_in, din, uid, qp->uid);mlx5_cmd_exec (dev, (void *)&in,sizeof (din), (void *)&out,sizeof (dout));return err;
@@ -277,6 +279,7 @@ static int mlx5_core_drain_dct(struct mlx5_core_dev *dev,MLX5_SET (drain_dct_in, in, opcode,MLX5_CMD_OP_DRAIN_DCT );MLX5_SET (drain_dct_in, in, dctn, qp->qpn); +MLX5_SET (drain_dct_in, in, uid, qp->uid);return mlx5_cmd_exec (dev, (void *)&in,sizeof (in), (void *)&out,sizeof (out)); }
@@ -303,6 +306,7 @@ int mlx5_core_destroy_dct(struct mlx5_core_dev *dev,destroy_resource_common (dev, &dct->mqp);MLX5_SET (destroy_dct_in, in, opcode,MLX5_CMD_OP_DESTROY_DCT );MLX5_SET (destroy_dct_in, in, dctn, qp->qpn); +MLX5_SET (destroy_dct_in, in, uid, qp->uid); err =mlx5_cmd_exec (dev, (void *)&in,sizeof (in), (void *)&out,sizeof (out));return err;
include/linux/mlx5/mlx5_ifc.h +3 -3
@@ -5919,7 +5919,7 @@ struct mlx5_ifc_drain_dct_out_bits {struct mlx5_ifc_drain_dct_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
@@ -6383,7 +6383,7 @@ struct mlx5_ifc_destroy_dct_out_bits {struct mlx5_ifc_destroy_dct_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
@@ -7139,7 +7139,7 @@ struct mlx5_ifc_create_dct_out_bits {struct mlx5_ifc_create_dct_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
Signature · 1 line
2.14.4
PATCH 7/25 net/mlx5: Update mlx5_ifc with DEVX UID bits
In reply to Leon RomanovskyFrom: Leon Romanovsky <[email protected]>
Add DEVX information to WQ, SRQ, CQ, TRI, TIS, QP, RQ, XRCD, PD, MKEY and MCG.
--- include/linux/mlx5/mlx5_ifc.h | 67 +++++++++++++++++++++++++++---------------- 1 file changed, 43 insertions(+), 24 deletions(-)
include/linux/mlx5/mlx5_ifc.h +43 -24
@@ -1291,7 +1291,9 @@ struct mlx5_ifc_wq_bits {u8 reserved_at_118[0x3 ];u8 log_wq_sz[0x5 ]; -u8 reserved_at_120[0x3 ]; +u8 dbr_umem_valid[0x1 ]; +u8 wq_umem_valid[0x1 ]; +u8 reserved_at_122[0x1 ];u8 log_hairpin_num_packets[0x5 ];u8 reserved_at_128[0x3 ];u8 log_hairpin_data_sz[0x5 ];
@@ -2365,7 +2367,10 @@ struct mlx5_ifc_qpc_bits {u8 dc_access_key[0x40 ]; -u8 reserved_at_680[0xc0 ]; +u8 reserved_at_680[0x3 ]; +u8 dbr_umem_valid[0x1 ]; + +u8 reserved_at_684[0xbc ]; };struct mlx5_ifc_roce_addr_layout_bits {
@@ -2465,7 +2470,7 @@ struct mlx5_ifc_xrc_srqc_bits {u8 wq_signature[0x1 ];u8 cont_srq[0x1 ]; -u8 reserved_at_22[0x1 ]; +u8 dbr_umem_valid[0x1 ];u8 rlky[0x1 ];u8 basic_cyclic_rcv_wqe[0x1 ];u8 log_rq_stride[0x3 ];
@@ -3129,7 +3134,9 @@ enum {struct mlx5_ifc_cqc_bits {u8 status[0x4 ]; -u8 reserved_at_4[0x4 ]; +u8 reserved_at_4[0x2 ]; +u8 dbr_umem_valid[0x1 ]; +u8 reserved_at_7[0x1 ];u8 cqe_sz[0x3 ];u8 cc[0x1 ];u8 reserved_at_c[0x1 ];
@@ -5315,7 +5322,7 @@ struct mlx5_ifc_modify_tis_bitmask_bits {struct mlx5_ifc_modify_tis_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
@@ -5354,7 +5361,7 @@ struct mlx5_ifc_modify_tir_out_bits {struct mlx5_ifc_modify_tir_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
@@ -5455,7 +5462,7 @@ struct mlx5_ifc_rqt_bitmask_bits {struct mlx5_ifc_modify_rqt_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
@@ -5642,7 +5649,10 @@ struct mlx5_ifc_modify_cq_in_bits {struct mlx5_ifc_cqc_bits cq_context; -u8 reserved_at_280[0x600 ]; +u8 reserved_at_280[0x40 ]; + +u8 cq_umem_valid[0x1 ]; +u8 reserved_at_2c1[0x5bf ];u8 pas[0 ][0x40 ]; };
@@ -5963,7 +5973,7 @@ struct mlx5_ifc_detach_from_mcg_out_bits {struct mlx5_ifc_detach_from_mcg_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
@@ -6031,7 +6041,7 @@ struct mlx5_ifc_destroy_tis_out_bits {struct mlx5_ifc_destroy_tis_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
@@ -6053,7 +6063,7 @@ struct mlx5_ifc_destroy_tir_out_bits {struct mlx5_ifc_destroy_tir_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
@@ -6143,7 +6153,7 @@ struct mlx5_ifc_destroy_rqt_out_bits {struct mlx5_ifc_destroy_rqt_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
@@ -6508,7 +6518,7 @@ struct mlx5_ifc_dealloc_xrcd_out_bits {struct mlx5_ifc_dealloc_xrcd_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
@@ -6596,7 +6606,7 @@ struct mlx5_ifc_dealloc_pd_out_bits {struct mlx5_ifc_dealloc_pd_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
@@ -6675,7 +6685,9 @@ struct mlx5_ifc_create_xrc_srq_in_bits {struct mlx5_ifc_xrc_srqc_bits xrc_srq_context_entry; -u8 reserved_at_280[0x600 ]; +u8 reserved_at_280[0x40 ]; +u8 xrc_srq_umem_valid[0x1 ]; +u8 reserved_at_2c1[0x5bf ];u8 pas[0 ][0x40 ]; };
@@ -6694,7 +6706,7 @@ struct mlx5_ifc_create_tis_out_bits {struct mlx5_ifc_create_tis_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
@@ -6718,7 +6730,7 @@ struct mlx5_ifc_create_tir_out_bits {struct mlx5_ifc_create_tir_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
@@ -6824,7 +6836,7 @@ struct mlx5_ifc_create_rqt_out_bits {struct mlx5_ifc_create_rqt_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
@@ -6909,7 +6921,10 @@ struct mlx5_ifc_create_qp_in_bits {struct mlx5_ifc_qpc_bits qpc; -u8 reserved_at_800[0x80 ]; +u8 reserved_at_800[0x60 ]; + +u8 wq_umem_valid[0x1 ]; +u8 reserved_at_861[0x1f ];u8 pas[0 ][0x40 ]; };
@@ -6971,7 +6986,8 @@ struct mlx5_ifc_create_mkey_in_bits {u8 reserved_at_40[0x20 ];u8 pg_access[0x1 ]; -u8 reserved_at_61[0x1f ]; +u8 mkey_umem_valid[0x1 ]; +u8 reserved_at_62[0x1e ];struct mlx5_ifc_mkc_bits memory_key_mkey_entry;
@@ -7174,7 +7190,10 @@ struct mlx5_ifc_create_cq_in_bits {struct mlx5_ifc_cqc_bits cq_context; -u8 reserved_at_280[0x600 ]; +u8 reserved_at_280[0x60 ]; + +u8 cq_umem_valid[0x1 ]; +u8 reserved_at_2e1[0x59f ];u8 pas[0 ][0x40 ]; };
@@ -7222,7 +7241,7 @@ struct mlx5_ifc_attach_to_mcg_out_bits {struct mlx5_ifc_attach_to_mcg_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
@@ -7349,7 +7368,7 @@ struct mlx5_ifc_alloc_xrcd_out_bits {struct mlx5_ifc_alloc_xrcd_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
@@ -7437,7 +7456,7 @@ struct mlx5_ifc_alloc_pd_out_bits {struct mlx5_ifc_alloc_pd_in_bits {u8 opcode[0x10 ]; -u8 reserved_at_10[0x10 ]; +u8 uid[0x10 ];u8 reserved_at_20[0x10 ];u8 op_mod[0x10 ];
Signature · 1 line
2.14.4
Re: [PATCH mlx5-next 07/25] net/mlx5: Update mlx5_ifc with DEVX UID bits
Quoted 9 lines · Leon Romanovsky
From: Leon Romanovsky <[email protected]>
Add DEVX information to WQ, SRQ, CQ, TRI, TIS, QP, RQ, XRCD, PD, MKEY and MCG.
Signed-off-by Leon Romanovsky <[email protected]>--- include/linux/mlx5/mlx5_ifc.h | 67 +++++++++++++++++++++++++++---------------- 1 file changed, 43 insertions(+), 24 deletions(-)
It is weird that we sometimes have these IFC bundle updates and sometimes the IFC is inlined in the patch..
Why not just do one big IFC only patch with everything the series needs?
Jason
Re: [PATCH mlx5-next 07/25] net/mlx5: Update mlx5_ifc with DEVX UID bits
Quoted 11 lines · Jason Gunthorpe
Quoted 9 lines · Leon Romanovsky
From: Leon Romanovsky <[email protected]>
Add DEVX information to WQ, SRQ, CQ, TRI, TIS, QP, RQ, XRCD, PD, MKEY and MCG.
Signed-off-by Leon Romanovsky <[email protected]>--- include/linux/mlx5/mlx5_ifc.h | 67 +++++++++++++++++++++++++++---------------- 1 file changed, 43 insertions(+), 24 deletions(-)
Quoted 5 lines
It is weird that we sometimes have these IFC bundle updates and sometimes the IFC is inlined in the patch..
Why not just do one big IFC only patch with everything the series needs?
Nothing fancy, this "ifc change" came from my need to put all mlx5-next related code in separate patches from IB and those definitions were sprinkled in all following IB-specific patches.
Thanks
Quoted 2 lines
Jason
PATCH 8/25 IB/mlx5: Set uid as part of CQ creation
In reply to Leon RomanovskyFrom: Yishai Hadas <[email protected]>
Set uid as part of CQ creation so that the firmware can manage the CQ object in a secured way.
The uid for the destroy and the modify commands is set by mlx5_core.
This will enable using a CQ that was created by verbs application to be used by the DEVX flow in case the uid is equal.
--- drivers/infiniband/hw/mlx5/cq.c | 1 + 1 file changed, 1 insertion(+)
drivers/infiniband/hw/mlx5/cq.c +1 -0
@@ -877,6 +877,7 @@ static int create_cq_user(struct mlx5_ib_dev *dev, struct ib_udata *udata, cq->private_flags |=MLX5_IB_CQ_PR_FLAGS_CQE_128_PAD ; } +MLX5_SET (create_cq_in, *cqb, uid,to_mucontext (context)->devx_uid);return 0 ; err_cqb:
Signature · 1 line
2.14.4
PATCH 9/25 IB/mlx5: Set uid as part of QP creation
In reply to Leon RomanovskyFrom: Yishai Hadas <[email protected]>
Set uid as part of QP creation so that the firmware can manage the QP object in a secured way.
The uid for the destroy and the modify commands is set by mlx5_core.
This will enable using a QP that was created by verbs application to be used by the DEVX flow in case the uid is equal.
--- drivers/infiniband/hw/mlx5/qp.c | 1 + 1 file changed, 1 insertion(+)
drivers/infiniband/hw/mlx5/qp.c +1 -0
@@ -850,6 +850,7 @@ static int create_user_qp(struct mlx5_ib_dev *dev, struct ib_pd *pd, goto err_umem; } +MLX5_SET (create_qp_in, *in, uid, context->devx_uid); pas = (__be64 *)MLX5_ADDR_OF (create_qp_in, *in, pas);if (ubuffer->umem)mlx5_ib_populate_pas (dev, ubuffer->umem, page_shift, pas,0 );
Signature · 1 line
2.14.4
PATCH 10/25 IB/mlx5: Set uid as part of RQ commands
In reply to Leon RomanovskyFrom: Yishai Hadas <[email protected]>
Set uid as part of RQ commands so that the firmware can manage the RQ object in a secured way.
The uid for the destroy command is set by mlx5_core.
This will enable using an RQ that was created by verbs application to be used by the DEVX flow in case the uid is equal.
--- drivers/infiniband/hw/mlx5/qp.c | 18 ++++++++++++++---- 1 file changed, 14 insertions(+), 4 deletions(-)
drivers/infiniband/hw/mlx5/qp.c +14 -4
@@ -1190,7 +1190,7 @@ static size_t get_rq_pas_size(void *qpc)static int create_raw_packet_qp_rq (struct mlx5_ib_dev *dev,struct mlx5_ib_rq *rq,void *qpin, -size_t qpinlen) +size_t qpinlen,u16 uid) {struct mlx5_ib_qp *mqp = rq->base.container_mibqp;__be64 *pas;
@@ -1211,6 +1211,7 @@ static int create_raw_packet_qp_rq(struct mlx5_ib_dev *dev,if (!in)return -ENOMEM ; +MLX5_SET (create_rq_in, in, uid, uid); rqc =MLX5_ADDR_OF (create_rq_in, in, ctx);if (!(rq->flags &MLX5_IB_RQ_CVLAN_STRIPPING ))MLX5_SET (rqc, rqc, vsd,1 );
@@ -1328,6 +1329,7 @@ static int create_raw_packet_qp(struct mlx5_ib_dev *dev, struct mlx5_ib_qp *qp,struct mlx5_ib_ucontext *mucontext =to_mucontext (ucontext);int err;u32 tdn = mucontext->tdn; +u16 uid = mucontext->devx_uid;if (qp->sq.wqe_cnt) { err =create_raw_packet_qp_tis (dev, qp, sq, tdn);
@@ -1349,7 +1351,7 @@ static int create_raw_packet_qp(struct mlx5_ib_dev *dev, struct mlx5_ib_qp *qp, rq->flags |=MLX5_IB_RQ_CVLAN_STRIPPING ;if (qp->flags &MLX5_IB_QP_PCI_WRITE_END_PADDING ) rq->flags |=MLX5_IB_RQ_PCI_WRITE_END_PADDING ; - err =create_raw_packet_qp_rq (dev, rq, in, inlen); + err =create_raw_packet_qp_rq (dev, rq, in, inlen, uid);if (err) goto err_destroy_sq;
@@ -2840,7 +2842,8 @@ static int ib_mask_to_mlx5_opt(int ib_mask)static int modify_raw_packet_qp_rq (struct mlx5_ib_dev *dev,struct mlx5_ib_rq *rq,int new_state, -const struct mlx5_modify_raw_qp_param *raw_qp_param) +const struct mlx5_modify_raw_qp_param *raw_qp_param, +u16 uid) {void *in;void *rqc;
@@ -2853,6 +2856,7 @@ static int modify_raw_packet_qp_rq(struct mlx5_ib_dev *dev,return -ENOMEM ;MLX5_SET (modify_rq_in, in, rq_state, rq->state); +MLX5_SET (modify_rq_in, in, uid, uid); rqc =MLX5_ADDR_OF (modify_rq_in, in, ctx);MLX5_SET (rqc, rqc, state, new_state);
@@ -2957,6 +2961,7 @@ static int modify_raw_packet_qp(struct mlx5_ib_dev *dev, struct mlx5_ib_qp *qp, u8 tx_affinity) {struct mlx5_ib_raw_packet_qp *raw_packet_qp = &qp->raw_packet_qp; +u16 uid =to_mucontext (qp->ibqp.uobject->context)->devx_uid;struct mlx5_ib_rq *rq = &raw_packet_qp->rq;struct mlx5_ib_sq *sq = &raw_packet_qp->sq;int modify_rq = !!qp->rq.wqe_cnt;
@@ -3000,7 +3005,8 @@ static int modify_raw_packet_qp(struct mlx5_ib_dev *dev, struct mlx5_ib_qp *qp, }if (modify_rq) { - err =modify_raw_packet_qp_rq (dev, rq, rq_state, raw_qp_param); + err =modify_raw_packet_qp_rq (dev, rq, rq_state, raw_qp_param, + uid);if (err)return err; }
@@ -5407,6 +5413,8 @@ static int create_rq(struct mlx5_ib_rwq *rwq, struct ib_pd *pd,if (!in)return -ENOMEM ; +MLX5_SET (create_rq_in, in, uid, +to_mucontext (pd->uobject->context)->devx_uid); rqc =MLX5_ADDR_OF (create_rq_in, in, ctx);MLX5_SET (rqc, rqc, mem_rq_type,MLX5_RQC_MEM_RQ_TYPE_MEMORY_RQ_INLINE );
@@ -5792,6 +5800,8 @@ int mlx5_ib_modify_wq(struct ib_wq *wq, struct ib_wq_attr *wq_attr,if (wq_state ==IB_WQS_ERR ) wq_state =MLX5_RQC_STATE_ERR ;MLX5_SET (modify_rq_in, in, rq_state, curr_wq_state); +MLX5_SET (modify_rq_in, in, uid, +to_mucontext (wq->uobject->context)->devx_uid);MLX5_SET (rqc, rqc, state, wq_state);if (wq_attr_mask &IB_WQ_FLAGS ) {
Signature · 1 line
2.14.4
PATCH 11/25 IB/mlx5: Set uid as part of SQ commands
In reply to Leon RomanovskyFrom: Yishai Hadas <[email protected]>
Set uid as part of SQ commands so that the firmware can manage the SQ object in a secured way.
The uid for the destroy command is set by mlx5_core.
This will enable using an SQ that was created by verbs application to be used by the DEVX flow in case the uid is equal.
--- drivers/infiniband/hw/mlx5/qp.c | 12 ++++++++---- 1 file changed, 8 insertions(+), 4 deletions(-)
drivers/infiniband/hw/mlx5/qp.c +8 -4
@@ -1088,7 +1088,7 @@ static void destroy_flow_rule_vport_sq(struct mlx5_ib_dev *dev,static int create_raw_packet_qp_sq (struct mlx5_ib_dev *dev,struct mlx5_ib_sq *sq,void *qpin, -struct ib_pd *pd) +struct ib_pd *pd,u16 uid) {struct mlx5_ib_ubuffer *ubuffer = &sq->ubuffer;__be64 *pas;
@@ -1116,6 +1116,7 @@ static int create_raw_packet_qp_sq(struct mlx5_ib_dev *dev, goto err_umem; } +MLX5_SET (create_sq_in, in, uid, uid); sqc =MLX5_ADDR_OF (create_sq_in, in, ctx);MLX5_SET (sqc, sqc, flush_in_error_en,1 );if (MLX5_CAP_ETH (dev->mdev, multi_pkt_send_wqe))
@@ -1336,7 +1337,7 @@ static int create_raw_packet_qp(struct mlx5_ib_dev *dev, struct mlx5_ib_qp *qp,if (err)return err; - err =create_raw_packet_qp_sq (dev, sq, in, pd); + err =create_raw_packet_qp_sq (dev, sq, in, pd, uid);if (err) goto err_destroy_tis;
@@ -2885,7 +2886,8 @@ static int modify_raw_packet_qp_rq(struct mlx5_ib_dev *dev,static int modify_raw_packet_qp_sq (struct mlx5_core_dev *dev,struct mlx5_ib_sq *sq,int new_state, -const struct mlx5_modify_raw_qp_param *raw_qp_param) +const struct mlx5_modify_raw_qp_param *raw_qp_param, +u16 uid) {struct mlx5_ib_qp *ibqp = sq->base.container_mibqp;struct mlx5_rate_limit old_rl = ibqp->rl;
@@ -2902,6 +2904,7 @@ static int modify_raw_packet_qp_sq(struct mlx5_core_dev *dev,if (!in)return -ENOMEM ; +MLX5_SET (modify_sq_in, in, uid, uid);MLX5_SET (modify_sq_in, in, sq_state, sq->state); sqc =MLX5_ADDR_OF (modify_sq_in, in, ctx);
@@ -3019,7 +3022,8 @@ static int modify_raw_packet_qp(struct mlx5_ib_dev *dev, struct mlx5_ib_qp *qp,return err; } -return modify_raw_packet_qp_sq (dev->mdev, sq, sq_state, raw_qp_param); +return modify_raw_packet_qp_sq (dev->mdev, sq, sq_state, + raw_qp_param, uid); }return 0 ;
Signature · 1 line
2.14.4
PATCH 12/25 IB/mlx5: Set uid as part of TIR commands
In reply to Leon RomanovskyFrom: Yishai Hadas <[email protected]>
Set uid as part of TIR commands so that the firmware can manage the TIR object in a secured way.
That will enable using a TIR that was created by verbs application to be used by the DEVX flow in case the uid is equal.
--- drivers/infiniband/hw/mlx5/cmd.c | 11 +++++++++++ drivers/infiniband/hw/mlx5/cmd.h | 1 + drivers/infiniband/hw/mlx5/qp.c | 24 ++++++++++++++++-------- 3 files changed, 28 insertions(+), 8 deletions(-)
drivers/infiniband/hw/mlx5/cmd.c +11 -0
@@ -197,3 +197,14 @@ int mlx5_cmd_query_ext_ppcnt_counters(struct mlx5_core_dev *dev, void *out)return mlx5_core_access_reg (dev, in, sz, out, sz,MLX5_REG_PPCNT ,0 ,0 ); } + +void mlx5_cmd_destroy_tir (struct mlx5_core_dev *dev,u32 tirn,u16 uid) +{ +u32 in[MLX5_ST_SZ_DW (destroy_tir_in)] = {0 }; +u32 out[MLX5_ST_SZ_DW (destroy_tir_out)] = {0 }; + +MLX5_SET (destroy_tir_in, in, opcode,MLX5_CMD_OP_DESTROY_TIR ); +MLX5_SET (destroy_tir_in, in, tirn, tirn); +MLX5_SET (destroy_tir_in, in, uid, uid); +mlx5_cmd_exec (dev, in,sizeof (in), out,sizeof (out)); +}
drivers/infiniband/hw/mlx5/cmd.h +1 -0
@@ -47,4 +47,5 @@ int mlx5_cmd_modify_cong_params(struct mlx5_core_dev *mdev,int mlx5_cmd_alloc_memic (struct mlx5_memic *memic,phys_addr_t *addr,u64 length,u32 alignment);int mlx5_cmd_dealloc_memic (struct mlx5_memic *memic,u64 addr,u64 length); +void mlx5_cmd_destroy_tir (struct mlx5_core_dev *dev,u32 tirn,u16 uid);#endif /* MLX5_IB_CMD_H */
drivers/infiniband/hw/mlx5/qp.c +16 -8
@@ -37,6 +37,7 @@#include <linux/mlx5/fs.h> #include "mlx5_ib.h" #include "ib_rep.h" +#include "cmd.h" /* not supported currently */ static int wq_signature;
@@ -1262,17 +1263,19 @@ static bool tunnel_offload_supported(struct mlx5_core_dev *dev)static void destroy_raw_packet_qp_tir (struct mlx5_ib_dev *dev,struct mlx5_ib_rq *rq, -u32 qp_flags_en) +u32 qp_flags_en, +u16 uid) {if (qp_flags_en & (MLX5_QP_FLAG_TIR_ALLOW_SELF_LB_UC |MLX5_QP_FLAG_TIR_ALLOW_SELF_LB_MC ))mlx5_ib_disable_lb (dev, false, true); -mlx5_core_destroy_tir (dev->mdev, rq->tirn); +mlx5_cmd_destroy_tir (dev->mdev, rq->tirn, uid); }static int create_raw_packet_qp_tir (struct mlx5_ib_dev *dev,struct mlx5_ib_rq *rq,u32 tdn, -u32 *qp_flags_en) +u32 *qp_flags_en, +u16 uid) {u8 lb_flag =0 ;u32 *in;
@@ -1285,6 +1288,7 @@ static int create_raw_packet_qp_tir(struct mlx5_ib_dev *dev,if (!in)return -ENOMEM ; +MLX5_SET (create_tir_in, in, uid, uid); tirc =MLX5_ADDR_OF (create_tir_in, in, ctx);MLX5_SET (tirc, tirc, disp_type,MLX5_TIRC_DISP_TYPE_DIRECT );MLX5_SET (tirc, tirc, inline_rqn, rq->base.mqp.qpn);
@@ -1311,7 +1315,7 @@ static int create_raw_packet_qp_tir(struct mlx5_ib_dev *dev, err =mlx5_ib_enable_lb (dev, false, true);if (err) -destroy_raw_packet_qp_tir (dev, rq,0 ); +destroy_raw_packet_qp_tir (dev, rq,0 , uid); }kvfree (in);
@@ -1356,8 +1360,8 @@ static int create_raw_packet_qp(struct mlx5_ib_dev *dev, struct mlx5_ib_qp *qp,if (err) goto err_destroy_sq; - - err =create_raw_packet_qp_tir (dev, rq, tdn, &qp->flags_en); + err =create_raw_packet_qp_tir (dev, rq, tdn, &qp->flags_en, + uid);if (err) goto err_destroy_rq; }
@@ -1385,9 +1389,10 @@ static void destroy_raw_packet_qp(struct mlx5_ib_dev *dev,struct mlx5_ib_raw_packet_qp *raw_packet_qp = &qp->raw_packet_qp;struct mlx5_ib_sq *sq = &raw_packet_qp->sq;struct mlx5_ib_rq *rq = &raw_packet_qp->rq; +u16 uid =to_mucontext (qp->ibqp.uobject->context)->devx_uid;if (qp->rq.wqe_cnt) { -destroy_raw_packet_qp_tir (dev, rq, qp->flags_en); +destroy_raw_packet_qp_tir (dev, rq, qp->flags_en, uid);destroy_raw_packet_qp_rq (dev, rq); }
@@ -1411,10 +1416,12 @@ static void raw_packet_qp_copy_info(struct mlx5_ib_qp *qp,static void destroy_rss_raw_qp_tir (struct mlx5_ib_dev *dev,struct mlx5_ib_qp *qp) { +u16 uid =to_mucontext (qp->ibqp.uobject->context)->devx_uid; +if (qp->flags_en & (MLX5_QP_FLAG_TIR_ALLOW_SELF_LB_UC |MLX5_QP_FLAG_TIR_ALLOW_SELF_LB_MC ))mlx5_ib_disable_lb (dev, false, true); -mlx5_core_destroy_tir (dev->mdev, qp->rss_qp.tirn); +mlx5_cmd_destroy_tir (dev->mdev, qp->rss_qp.tirn, uid); } static int create_rss_raw_qp_tir(struct mlx5_ib_dev *dev, struct mlx5_ib_qp *qp,
@@ -1512,6 +1519,7 @@ static int create_rss_raw_qp_tir(struct mlx5_ib_dev *dev, struct mlx5_ib_qp *qp,if (!in)return -ENOMEM ; +MLX5_SET (create_tir_in, in, uid, mucontext->devx_uid); tirc =MLX5_ADDR_OF (create_tir_in, in, ctx);MLX5_SET (tirc, tirc, disp_type,MLX5_TIRC_DISP_TYPE_INDIRECT );
Signature · 1 line
2.14.4
PATCH 13/25 IB/mlx5: Set uid as part of TIS commands
In reply to Leon RomanovskyFrom: Yishai Hadas <[email protected]>
Set uid as part of TIS commands so that the firmware can manage the TIS object in a secured way.
That will enable using a TIS that was created by verbs application to be used by the DEVX flow in case the uid is equal.
--- drivers/infiniband/hw/mlx5/cmd.c | 12 ++++++++++++ drivers/infiniband/hw/mlx5/cmd.h | 1 + drivers/infiniband/hw/mlx5/qp.c | 27 +++++++++++++++++---------- 3 files changed, 30 insertions(+), 10 deletions(-)
drivers/infiniband/hw/mlx5/cmd.c +12 -0
@@ -208,3 +208,15 @@ void mlx5_cmd_destroy_tir(struct mlx5_core_dev *dev, u32 tirn, u16 uid)MLX5_SET (destroy_tir_in, in, uid, uid);mlx5_cmd_exec (dev, in,sizeof (in), out,sizeof (out)); } + +void mlx5_cmd_destroy_tis (struct mlx5_core_dev *dev,u32 tisn,u16 uid) +{ +u32 in[MLX5_ST_SZ_DW (destroy_tis_in)] = {0 }; +u32 out[MLX5_ST_SZ_DW (destroy_tis_out)] = {0 }; + +MLX5_SET (destroy_tis_in, in, opcode,MLX5_CMD_OP_DESTROY_TIS ); +MLX5_SET (destroy_tis_in, in, tisn, tisn); +MLX5_SET (destroy_tis_in, in, uid, uid); +mlx5_cmd_exec (dev, in,sizeof (in), out,sizeof (out)); +} +
drivers/infiniband/hw/mlx5/cmd.h +1 -0
@@ -48,4 +48,5 @@ int mlx5_cmd_alloc_memic(struct mlx5_memic *memic, phys_addr_t *addr, u64 length, u32 alignment);int mlx5_cmd_dealloc_memic (struct mlx5_memic *memic,u64 addr,u64 length);void mlx5_cmd_destroy_tir (struct mlx5_core_dev *dev,u32 tirn,u16 uid); +void mlx5_cmd_destroy_tis (struct mlx5_core_dev *dev,u32 tisn,u16 uid);#endif /* MLX5_IB_CMD_H */
drivers/infiniband/hw/mlx5/qp.c +17 -10
@@ -1062,11 +1062,12 @@ static int is_connected(enum ib_qp_type qp_type)static int create_raw_packet_qp_tis (struct mlx5_ib_dev *dev,struct mlx5_ib_qp *qp, -struct mlx5_ib_sq *sq,u32 tdn) +struct mlx5_ib_sq *sq,u32 tdn,u16 uid) {u32 in[MLX5_ST_SZ_DW (create_tis_in)] = {0 };void *tisc =MLX5_ADDR_OF (create_tis_in, in, ctx); +MLX5_SET (create_tis_in, in, uid, uid);MLX5_SET (tisc, tisc, transport_domain, tdn);if (qp->flags &MLX5_IB_QP_UNDERLAY )MLX5_SET (tisc, tisc, underlay_qpn, qp->underlay_qpn);
@@ -1075,9 +1076,9 @@ static int create_raw_packet_qp_tis(struct mlx5_ib_dev *dev, }static void destroy_raw_packet_qp_tis (struct mlx5_ib_dev *dev, -struct mlx5_ib_sq *sq) +struct mlx5_ib_sq *sq,u16 uid) { -mlx5_core_destroy_tis (dev->mdev, sq->tisn); +mlx5_cmd_destroy_tis (dev->mdev, sq->tisn, uid); } static void destroy_flow_rule_vport_sq(struct mlx5_ib_dev *dev,
@@ -1337,7 +1338,7 @@ static int create_raw_packet_qp(struct mlx5_ib_dev *dev, struct mlx5_ib_qp *qp,u16 uid = mucontext->devx_uid;if (qp->sq.wqe_cnt) { - err =create_raw_packet_qp_tis (dev, qp, sq, tdn); + err =create_raw_packet_qp_tis (dev, qp, sq, tdn, uid);if (err)return err;
@@ -1378,7 +1379,7 @@ static int create_raw_packet_qp(struct mlx5_ib_dev *dev, struct mlx5_ib_qp *qp,return err;destroy_raw_packet_qp_sq (dev, sq); err_destroy_tis: -destroy_raw_packet_qp_tis (dev, sq); +destroy_raw_packet_qp_tis (dev, sq, uid);return err; }
@@ -1398,7 +1399,7 @@ static void destroy_raw_packet_qp(struct mlx5_ib_dev *dev,if (qp->sq.wqe_cnt) {destroy_raw_packet_qp_sq (dev, sq); -destroy_raw_packet_qp_tis (dev, sq); +destroy_raw_packet_qp_tis (dev, sq, uid); } }
@@ -2579,7 +2580,7 @@ static int ib_rate_to_mlx5(struct mlx5_ib_dev *dev, u8 rate) }static int modify_raw_packet_eth_prio (struct mlx5_core_dev *dev, -struct mlx5_ib_sq *sq,u8 sl) +struct mlx5_ib_sq *sq,u8 sl,u16 uid) {void *in;void *tisc;
@@ -2592,6 +2593,7 @@ static int modify_raw_packet_eth_prio(struct mlx5_core_dev *dev,return -ENOMEM ;MLX5_SET (modify_tis_in, in, bitmask.prio,1 ); +MLX5_SET (modify_tis_in, in, uid, uid); tisc =MLX5_ADDR_OF (modify_tis_in, in, ctx);MLX5_SET (tisc, tisc, prio, ((sl &0x7 ) <<1 ));
@@ -2604,7 +2606,8 @@ static int modify_raw_packet_eth_prio(struct mlx5_core_dev *dev, }static int modify_raw_packet_tx_affinity (struct mlx5_core_dev *dev, -struct mlx5_ib_sq *sq,u8 tx_affinity) +struct mlx5_ib_sq *sq,u8 tx_affinity, +u16 uid) {void *in;void *tisc;
@@ -2617,6 +2620,7 @@ static int modify_raw_packet_tx_affinity(struct mlx5_core_dev *dev,return -ENOMEM ;MLX5_SET (modify_tis_in, in, bitmask.lag_tx_port_affinity,1 ); +MLX5_SET (modify_tis_in, in, uid, uid); tisc =MLX5_ADDR_OF (modify_tis_in, in, ctx);MLX5_SET (tisc, tisc, lag_tx_port_affinity, tx_affinity);
@@ -2639,6 +2643,7 @@ static int mlx5_set_path(struct mlx5_ib_dev *dev, struct mlx5_ib_qp *qp,enum ib_gid_type gid_type;u8 ah_flags =rdma_ah_get_ah_flags (ah);u8 sl =rdma_ah_get_sl (ah); +u16 uid;if (attr_mask &IB_QP_PKEY_INDEX ) path->pkey_index = cpu_to_be16(alt ? attr->alt_pkey_index :
@@ -2698,10 +2703,12 @@ static int mlx5_set_path(struct mlx5_ib_dev *dev, struct mlx5_ib_qp *qp,if (attr_mask &IB_QP_TIMEOUT ) path->ackto_lt = (alt ? attr->alt_timeout : attr->timeout) <<3 ; + uid = qp->ibqp.uobject ? +to_mucontext (qp->ibqp.uobject->context)->devx_uid :0 ;if ((qp->ibqp.qp_type ==IB_QPT_RAW_PACKET ) && qp->sq.wqe_cnt)return modify_raw_packet_eth_prio (dev->mdev, &qp->raw_packet_qp.sq, - sl &0xf ); + sl &0xf , uid);return 0 ; }
@@ -3025,7 +3032,7 @@ static int modify_raw_packet_qp(struct mlx5_ib_dev *dev, struct mlx5_ib_qp *qp,if (modify_sq) {if (tx_affinity) { err =modify_raw_packet_tx_affinity (dev->mdev, sq, - tx_affinity); + tx_affinity, uid);if (err)return err; }
Signature · 1 line
2.14.4
PATCH 14/25 IB/mlx5: Set uid as part of RQT commands
In reply to Leon RomanovskyFrom: Yishai Hadas <[email protected]>
Set uid as part of RQT commands so that the firmware can manage the RQT object in a secured way.
That will enable using an RQT that was created by verbs application to be used by the DEVX flow in case the uid is equal.
--- drivers/infiniband/hw/mlx5/cmd.c | 11 +++++++++++ drivers/infiniband/hw/mlx5/cmd.h | 1 + drivers/infiniband/hw/mlx5/qp.c | 11 +++++++++-- 3 files changed, 21 insertions(+), 2 deletions(-)
drivers/infiniband/hw/mlx5/cmd.c +11 -0
@@ -220,3 +220,14 @@ void mlx5_cmd_destroy_tis(struct mlx5_core_dev *dev, u32 tisn, u16 uid)mlx5_cmd_exec (dev, in,sizeof (in), out,sizeof (out)); } +void mlx5_cmd_destroy_rqt (struct mlx5_core_dev *dev,u32 rqtn,u16 uid) +{ +u32 in[MLX5_ST_SZ_DW (destroy_rqt_in)] = {0 }; +u32 out[MLX5_ST_SZ_DW (destroy_rqt_out)] = {0 }; + +MLX5_SET (destroy_rqt_in, in, opcode,MLX5_CMD_OP_DESTROY_RQT ); +MLX5_SET (destroy_rqt_in, in, rqtn, rqtn); +MLX5_SET (destroy_rqt_in, in, uid, uid); +mlx5_cmd_exec (dev, in,sizeof (in), out,sizeof (out)); +} +
drivers/infiniband/hw/mlx5/cmd.h +1 -0
@@ -49,4 +49,5 @@ int mlx5_cmd_alloc_memic(struct mlx5_memic *memic, phys_addr_t *addr,int mlx5_cmd_dealloc_memic (struct mlx5_memic *memic,u64 addr,u64 length);void mlx5_cmd_destroy_tir (struct mlx5_core_dev *dev,u32 tirn,u16 uid);void mlx5_cmd_destroy_tis (struct mlx5_core_dev *dev,u32 tisn,u16 uid); +void mlx5_cmd_destroy_rqt (struct mlx5_core_dev *dev,u32 rqtn,u16 uid);#endif /* MLX5_IB_CMD_H */
drivers/infiniband/hw/mlx5/qp.c +9 -2
@@ -5702,6 +5702,7 @@ struct ib_rwq_ind_table *mlx5_ib_create_rwq_ind_table(struct ib_device *device,int i;u32 *in;void *rqtc; +u16 uid;if (udata->inlen >0 && !ib_is_udata_cleared(udata, 0,
@@ -5739,6 +5740,10 @@ struct ib_rwq_ind_table *mlx5_ib_create_rwq_ind_table(struct ib_device *device,for (i =0 ; i < sz; i++)MLX5_SET (rqtc, rqtc, rq_num[i], init_attr->ind_tbl[i]->wq_num); +/* Use the uid from its internal WQ */ + uid =to_mucontext (init_attr->ind_tbl[0 ]->uobject->context)->devx_uid; +MLX5_SET (create_rqt_in, in, uid, uid); + err =mlx5_core_create_rqt (dev->mdev, in, inlen, &rwq_ind_tbl->rqtn);kvfree (in);
@@ -5757,7 +5762,7 @@ struct ib_rwq_ind_table *mlx5_ib_create_rwq_ind_table(struct ib_device *device,return &rwq_ind_tbl->ib_rwq_ind_tbl; err_copy: -mlx5_core_destroy_rqt (dev->mdev, rwq_ind_tbl->rqtn); +mlx5_cmd_destroy_rqt (dev->mdev, rwq_ind_tbl->rqtn, uid); err:kfree (rwq_ind_tbl);return ERR_PTR (err);
@@ -5767,8 +5772,10 @@ int mlx5_ib_destroy_rwq_ind_table(struct ib_rwq_ind_table *ib_rwq_ind_tbl) {struct mlx5_ib_rwq_ind_table *rwq_ind_tbl =to_mrwq_ind_table (ib_rwq_ind_tbl);struct mlx5_ib_dev *dev =to_mdev (ib_rwq_ind_tbl->device); +u16 uid; -mlx5_core_destroy_rqt (dev->mdev, rwq_ind_tbl->rqtn); + uid =to_mucontext (ib_rwq_ind_tbl->uobject->context)->devx_uid; +mlx5_cmd_destroy_rqt (dev->mdev, rwq_ind_tbl->rqtn, uid);kfree (rwq_ind_tbl);return 0 ;
Signature · 1 line
2.14.4
PATCH 15/25 IB/mlx5: Set uid as part of PD commands
In reply to Leon RomanovskyFrom: Yishai Hadas <[email protected]>
Set uid as part of PD commands so that the firmware can manage the PD object in a secured way.
For example when a QP is created its uid must match the CQ uid which it uses.
--- drivers/infiniband/hw/mlx5/cmd.c | 10 ++++++++++ drivers/infiniband/hw/mlx5/cmd.h | 1 + drivers/infiniband/hw/mlx5/main.c | 16 +++++++++++++--- drivers/infiniband/hw/mlx5/mlx5_ib.h | 1 + 4 files changed, 25 insertions(+), 3 deletions(-)
drivers/infiniband/hw/mlx5/cmd.c +10 -0
@@ -231,3 +231,13 @@ void mlx5_cmd_destroy_rqt(struct mlx5_core_dev *dev, u32 rqtn, u16 uid)mlx5_cmd_exec (dev, in,sizeof (in), out,sizeof (out)); } +void mlx5_cmd_dealloc_pd (struct mlx5_core_dev *dev,u32 pdn,u16 uid) +{ +u32 out[MLX5_ST_SZ_DW (dealloc_pd_out)] = {0 }; +u32 in[MLX5_ST_SZ_DW (dealloc_pd_in)] = {0 }; + +MLX5_SET (dealloc_pd_in, in, opcode,MLX5_CMD_OP_DEALLOC_PD ); +MLX5_SET (dealloc_pd_in, in, pd, pdn); +MLX5_SET (dealloc_pd_in, in, uid, uid); +mlx5_cmd_exec (dev, in,sizeof (in), out,sizeof (out)); +}
drivers/infiniband/hw/mlx5/cmd.h +1 -0
@@ -50,4 +50,5 @@ int mlx5_cmd_dealloc_memic(struct mlx5_memic *memic, u64 addr, u64 length);void mlx5_cmd_destroy_tir (struct mlx5_core_dev *dev,u32 tirn,u16 uid);void mlx5_cmd_destroy_tis (struct mlx5_core_dev *dev,u32 tisn,u16 uid);void mlx5_cmd_destroy_rqt (struct mlx5_core_dev *dev,u32 rqtn,u16 uid); +void mlx5_cmd_dealloc_pd (struct mlx5_core_dev *dev,u32 pdn,u16 uid);#endif /* MLX5_IB_CMD_H */
drivers/infiniband/hw/mlx5/main.c +13 -3
@@ -2355,21 +2355,31 @@ static struct ib_pd *mlx5_ib_alloc_pd(struct ib_device *ibdev,struct mlx5_ib_alloc_pd_resp resp;struct mlx5_ib_pd *pd;int err; +u32 out[MLX5_ST_SZ_DW (alloc_pd_out)] = {0 }; +u32 in[MLX5_ST_SZ_DW (alloc_pd_in)] = {0 }; +u16 uid; + + uid = context ?to_mucontext (context)->devx_uid :0 ; pd =kmalloc (sizeof (*pd),GFP_KERNEL );if (!pd)return ERR_PTR (-ENOMEM ); - err =mlx5_core_alloc_pd (to_mdev (ibdev)->mdev, &pd->pdn); +MLX5_SET (alloc_pd_in, in, opcode,MLX5_CMD_OP_ALLOC_PD ); +MLX5_SET (alloc_pd_in, in, uid, uid); + err =mlx5_cmd_exec (to_mdev (ibdev)->mdev, in,sizeof (in), + out,sizeof (out));if (err) {kfree (pd);return ERR_PTR (err); } + pd->pdn =MLX5_GET (alloc_pd_out, out, pd); + pd->uid = uid;if (context) { resp.pdn = pd->pdn;if (ib_copy_to_udata (udata, &resp,sizeof (resp))) { -mlx5_core_dealloc_pd (to_mdev (ibdev)->mdev, pd->pdn); +mlx5_cmd_dealloc_pd (to_mdev (ibdev)->mdev, pd->pdn, uid);kfree (pd);return ERR_PTR (-EFAULT ); }
@@ -2383,7 +2393,7 @@ static int mlx5_ib_dealloc_pd(struct ib_pd *pd)struct mlx5_ib_dev *mdev =to_mdev (pd->device);struct mlx5_ib_pd *mpd =to_mpd (pd); -mlx5_core_dealloc_pd (mdev->mdev, mpd->pdn); +mlx5_cmd_dealloc_pd (mdev->mdev, mpd->pdn, mpd->uid);kfree (mpd);return 0 ;
drivers/infiniband/hw/mlx5/mlx5_ib.h +1 -0
@@ -153,6 +153,7 @@ static inline struct mlx5_ib_ucontext *to_mucontext(struct ib_ucontext *ibucontestruct mlx5_ib_pd {struct ib_pd ibpd;u32 pdn; +u16 uid; };enum {
Signature · 1 line
2.14.4
PATCH 16/25 IB/mlx5: Set uid as part of TD commands
In reply to Leon RomanovskyFrom: Yishai Hadas <[email protected]>
Set uid as part of TD commands so that the firmware can manage the TD object in a secured way.
--- drivers/infiniband/hw/mlx5/cmd.c | 30 ++++++++++++++++++++++++++++++ drivers/infiniband/hw/mlx5/cmd.h | 4 ++++ drivers/infiniband/hw/mlx5/main.c | 33 ++++++++++++++++++--------------- 3 files changed, 52 insertions(+), 15 deletions(-)
drivers/infiniband/hw/mlx5/cmd.c +30 -0
@@ -241,3 +241,33 @@ void mlx5_cmd_dealloc_pd(struct mlx5_core_dev *dev, u32 pdn, u16 uid)MLX5_SET (dealloc_pd_in, in, uid, uid);mlx5_cmd_exec (dev, in,sizeof (in), out,sizeof (out)); } + +int mlx5_cmd_alloc_transport_domain (struct mlx5_core_dev *dev,u32 *tdn, +u16 uid) +{ +u32 in[MLX5_ST_SZ_DW (alloc_transport_domain_in)] = {0 }; +u32 out[MLX5_ST_SZ_DW (alloc_transport_domain_out)] = {0 }; +int err; + +MLX5_SET (alloc_transport_domain_in, in, opcode, +MLX5_CMD_OP_ALLOC_TRANSPORT_DOMAIN ); + + err =mlx5_cmd_exec (dev, in,sizeof (in), out,sizeof (out)); +if (!err) + *tdn =MLX5_GET (alloc_transport_domain_out, out, + transport_domain); + +return err; +} + +void mlx5_cmd_dealloc_transport_domain (struct mlx5_core_dev *dev,u32 tdn, +u16 uid) +{ +u32 in[MLX5_ST_SZ_DW (dealloc_transport_domain_in)] = {0 }; +u32 out[MLX5_ST_SZ_DW (dealloc_transport_domain_out)] = {0 }; + +MLX5_SET (dealloc_transport_domain_in, in, opcode, +MLX5_CMD_OP_DEALLOC_TRANSPORT_DOMAIN ); +MLX5_SET (dealloc_transport_domain_in, in, transport_domain, tdn); +mlx5_cmd_exec (dev, in,sizeof (in), out,sizeof (out)); +}
drivers/infiniband/hw/mlx5/cmd.h +4 -0
@@ -51,4 +51,8 @@ void mlx5_cmd_destroy_tir(struct mlx5_core_dev *dev, u32 tirn, u16 uid);void mlx5_cmd_destroy_tis (struct mlx5_core_dev *dev,u32 tisn,u16 uid);void mlx5_cmd_destroy_rqt (struct mlx5_core_dev *dev,u32 rqtn,u16 uid);void mlx5_cmd_dealloc_pd (struct mlx5_core_dev *dev,u32 pdn,u16 uid); +int mlx5_cmd_alloc_transport_domain (struct mlx5_core_dev *dev,u32 *tdn, +u16 uid); +void mlx5_cmd_dealloc_transport_domain (struct mlx5_core_dev *dev,u32 tdn, +u16 uid);#endif /* MLX5_IB_CMD_H */
drivers/infiniband/hw/mlx5/main.c +18 -15
@@ -1613,14 +1613,15 @@ void mlx5_ib_disable_lb(struct mlx5_ib_dev *dev, bool td, bool qp)mutex_unlock (&dev->lb.mutex); } -static int mlx5_ib_alloc_transport_domain (struct mlx5_ib_dev *dev,u32 *tdn) +static int mlx5_ib_alloc_transport_domain (struct mlx5_ib_dev *dev,u32 *tdn, +u16 uid) {int err;if (!MLX5_CAP_GEN (dev->mdev, log_max_transport_domain))return 0 ; - err =mlx5_core_alloc_transport_domain (dev->mdev, tdn); + err =mlx5_cmd_alloc_transport_domain (dev->mdev, tdn, uid);if (err)return err;
@@ -1632,12 +1633,13 @@ static int mlx5_ib_alloc_transport_domain(struct mlx5_ib_dev *dev, u32 *tdn)return mlx5_ib_enable_lb (dev, true, false); } -static void mlx5_ib_dealloc_transport_domain (struct mlx5_ib_dev *dev,u32 tdn) +static void mlx5_ib_dealloc_transport_domain (struct mlx5_ib_dev *dev,u32 tdn, +u16 uid) {if (!MLX5_CAP_GEN (dev->mdev, log_max_transport_domain))return ; -mlx5_core_dealloc_transport_domain (dev->mdev, tdn); +mlx5_cmd_dealloc_transport_domain (dev->mdev, tdn, uid); if ((MLX5_CAP_GEN(dev->mdev, port_type) != MLX5_CAP_PORT_TYPE_ETH) || (!MLX5_CAP_GEN(dev->mdev, disable_local_lb_uc) &&
@@ -1756,22 +1758,23 @@ static struct ib_ucontext *mlx5_ib_alloc_ucontext(struct ib_device *ibdev, context->ibucontext.invalidate_range = &mlx5_ib_invalidate_range;#endif - err =mlx5_ib_alloc_transport_domain (dev, &context->tdn); -if (err) - goto out_uars; -if (req.flags &MLX5_IB_ALLOC_UCTX_DEVX ) {/* Block DEVX on Infiniband as of SELinux */ if (mlx5_ib_port_link_layer (ibdev,1 ) !=IB_LINK_LAYER_ETHERNET ) { err = -EPERM ; - goto out_td; + goto out_uars; } err =mlx5_ib_devx_create (dev, context);if (err) - goto out_td; + goto out_uars; } + err =mlx5_ib_alloc_transport_domain (dev, &context->tdn, + context->devx_uid); +if (err) + goto out_devx; +if (MLX5_CAP_GEN (dev->mdev, dump_fill_mkey)) { err =mlx5_cmd_dump_fill_mkey (dev->mdev, &dump_fill_mkey);if (err)
@@ -1866,10 +1869,10 @@ static struct ib_ucontext *mlx5_ib_alloc_ucontext(struct ib_device *ibdev,return &context->ibucontext; out_mdev: +mlx5_ib_dealloc_transport_domain (dev, context->tdn, context->devx_uid); +out_devx:if (req.flags &MLX5_IB_ALLOC_UCTX_DEVX )mlx5_ib_devx_destroy (dev, context); -out_td: -mlx5_ib_dealloc_transport_domain (dev, context->tdn); out_uars:deallocate_uars (dev, context);
@@ -1892,12 +1895,12 @@ static int mlx5_ib_dealloc_ucontext(struct ib_ucontext *ibcontext)struct mlx5_ib_dev *dev =to_mdev (ibcontext->device);struct mlx5_bfreg_info *bfregi; + bfregi = &context->bfregi; +mlx5_ib_dealloc_transport_domain (dev, context->tdn, context->devx_uid); +if (context->devx_uid)mlx5_ib_devx_destroy (dev, context); - bfregi = &context->bfregi; -mlx5_ib_dealloc_transport_domain (dev, context->tdn); -deallocate_uars (dev, context);kfree (bfregi->sys_pages);kfree (bfregi->count);
Signature · 1 line
2.14.4
PATCH 17/25 IB/mlx5: Set uid as part of SRQ commands
In reply to Leon RomanovskyFrom: Yishai Hadas <[email protected]>
Set uid as part of SRQ create command so that the firmware can manage the SRQ object in a secured way.
The uid for the destroy and modify commands are set by mlx5_core.
That will enable using a SRQ that was created by verbs application to be used by the DEVX flow in case the uid is equal.
--- drivers/infiniband/hw/mlx5/srq.c | 1 + 1 file changed, 1 insertion(+)
drivers/infiniband/hw/mlx5/srq.c +1 -0
@@ -144,6 +144,7 @@ static int create_srq_user(struct ib_pd *pd, struct mlx5_ib_srq *srq, in->log_page_size = page_shift -MLX5_ADAPTER_PAGE_SHIFT ; in->page_offset = offset; + in->uid =to_mucontext (pd->uobject->context)->devx_uid;if (MLX5_CAP_GEN (dev->mdev, cqe_version) ==MLX5_CQE_VERSION_V1 && in->type !=IB_SRQT_BASIC ) in->user_index = uidx;
Signature · 1 line
2.14.4
PATCH 18/25 IB/mlx5: Set uid as part of DCT commands
In reply to Leon RomanovskyFrom: Yishai Hadas <[email protected]>
Set uid as part of DCT create command so that the firmware can manage the DCT object in a secured way.
The uid for the destroy and drain commands are set by mlx5_core.
That will enable using a DCT that was created by verbs application to be used by the DEVX flow in case the uid is equal.
--- drivers/infiniband/hw/mlx5/qp.c | 2 ++ 1 file changed, 2 insertions(+)
drivers/infiniband/hw/mlx5/qp.c +2 -0
@@ -2311,6 +2311,8 @@ static struct ib_qp *mlx5_ib_create_dct(struct ib_pd *pd, goto err_free; } +MLX5_SET (create_dct_in, qp->dct.in, uid, +to_mucontext (pd->uobject->context)->devx_uid); dctc =MLX5_ADDR_OF (create_dct_in, qp->dct.in, dct_context_entry); qp->qp_sub_type =MLX5_IB_QPT_DCT ;MLX5_SET (dctc, dctc, pd,to_mpd (pd)->pdn);
Signature · 1 line
2.14.4
PATCH 19/25 IB/mlx5: Set uid as part of XRCD commands
In reply to Leon RomanovskyFrom: Yishai Hadas <[email protected]>
Set uid as part of XRCD commands so that the firmware can manage the XRCD object in a secured way.
That will enable using an XRCD that was created by verbs application to be used by the DEVX flow in case the uid is equal.
--- drivers/infiniband/hw/mlx5/cmd.c | 25 +++++++++++++++++++++++++ drivers/infiniband/hw/mlx5/cmd.h | 2 ++ drivers/infiniband/hw/mlx5/mlx5_ib.h | 1 + drivers/infiniband/hw/mlx5/qp.c | 8 ++++++-- 4 files changed, 34 insertions(+), 2 deletions(-)
drivers/infiniband/hw/mlx5/cmd.c +25 -0
@@ -271,3 +271,28 @@ void mlx5_cmd_dealloc_transport_domain(struct mlx5_core_dev *dev, u32 tdn,MLX5_SET (dealloc_transport_domain_in, in, transport_domain, tdn);mlx5_cmd_exec (dev, in,sizeof (in), out,sizeof (out)); } + +int mlx5_cmd_xrcd_alloc (struct mlx5_core_dev *dev,u32 *xrcdn,u16 uid) +{ +u32 out[MLX5_ST_SZ_DW (alloc_xrcd_out)] = {0 }; +u32 in[MLX5_ST_SZ_DW (alloc_xrcd_in)] = {0 }; +int err; + +MLX5_SET (alloc_xrcd_in, in, opcode,MLX5_CMD_OP_ALLOC_XRCD ); +MLX5_SET (alloc_xrcd_in, in, uid, uid); + err =mlx5_cmd_exec (dev, in,sizeof (in), out,sizeof (out)); +if (!err) + *xrcdn =MLX5_GET (alloc_xrcd_out, out, xrcd); +return err; +} + +int mlx5_cmd_xrcd_dealloc (struct mlx5_core_dev *dev,u32 xrcdn,u16 uid) +{ +u32 out[MLX5_ST_SZ_DW (dealloc_xrcd_out)] = {0 }; +u32 in[MLX5_ST_SZ_DW (dealloc_xrcd_in)] = {0 }; + +MLX5_SET (dealloc_xrcd_in, in, opcode,MLX5_CMD_OP_DEALLOC_XRCD ); +MLX5_SET (dealloc_xrcd_in, in, xrcd, xrcdn); +MLX5_SET (dealloc_xrcd_in, in, uid, uid); +return mlx5_cmd_exec (dev, in,sizeof (in), out,sizeof (out)); +}
drivers/infiniband/hw/mlx5/cmd.h +2 -0
@@ -55,4 +55,6 @@ int mlx5_cmd_alloc_transport_domain(struct mlx5_core_dev *dev, u32 *tdn, u16 uid);void mlx5_cmd_dealloc_transport_domain (struct mlx5_core_dev *dev,u32 tdn,u16 uid); +int mlx5_cmd_xrcd_alloc (struct mlx5_core_dev *dev,u32 *xrcdn,u16 uid); +int mlx5_cmd_xrcd_dealloc (struct mlx5_core_dev *dev,u32 xrcdn,u16 uid);#endif /* MLX5_IB_CMD_H */
drivers/infiniband/hw/mlx5/mlx5_ib.h +1 -0
@@ -548,6 +548,7 @@ struct mlx5_ib_srq {struct mlx5_ib_xrcd {struct ib_xrcd ibxrcd;u32 xrcdn; +u16 uid; };enum mlx5_ib_mtt_access_flags {
drivers/infiniband/hw/mlx5/qp.c +6 -2
@@ -5341,6 +5341,7 @@ struct ib_xrcd *mlx5_ib_alloc_xrcd(struct ib_device *ibdev,struct mlx5_ib_dev *dev =to_mdev (ibdev);struct mlx5_ib_xrcd *xrcd;int err; +u16 uid;if (!MLX5_CAP_GEN (dev->mdev, xrc))return ERR_PTR (-ENOSYS );
@@ -5349,12 +5350,14 @@ struct ib_xrcd *mlx5_ib_alloc_xrcd(struct ib_device *ibdev,if (!xrcd)return ERR_PTR (-ENOMEM ); - err =mlx5_core_xrcd_alloc (dev->mdev, &xrcd->xrcdn); + uid = context ?to_mucontext (context)->devx_uid :0 ; + err =mlx5_cmd_xrcd_alloc (dev->mdev, &xrcd->xrcdn, uid);if (err) {kfree (xrcd);return ERR_PTR (-ENOMEM ); } + xrcd->uid = uid;return &xrcd->ibxrcd; }
@@ -5362,9 +5365,10 @@ int mlx5_ib_dealloc_xrcd(struct ib_xrcd *xrcd) {struct mlx5_ib_dev *dev =to_mdev (xrcd->device);u32 xrcdn =to_mxrcd (xrcd)->xrcdn; +u16 uid =to_mxrcd (xrcd)->uid;int err; - err =mlx5_core_xrcd_dealloc (dev->mdev, xrcdn); + err =mlx5_cmd_xrcd_dealloc (dev->mdev, xrcdn, uid);if (err)mlx5_ib_warn (dev,"failed to dealloc xrcdn 0x%x\n" , xrcdn);
Signature · 1 line
2.14.4
PATCH 20/25 IB/mlx5: Set uid as part of MCG commands
In reply to Leon RomanovskyFrom: Yishai Hadas <[email protected]>
Set uid as part of MCG commands so that the firmware can manage the MCG object in a secured way.
--- drivers/infiniband/hw/mlx5/cmd.c | 30 ++++++++++++++++++++++++++++++ drivers/infiniband/hw/mlx5/cmd.h | 4 ++++ drivers/infiniband/hw/mlx5/main.c | 11 +++++++++-- 3 files changed, 43 insertions(+), 2 deletions(-)
drivers/infiniband/hw/mlx5/cmd.c +30 -0
@@ -296,3 +296,33 @@ int mlx5_cmd_xrcd_dealloc(struct mlx5_core_dev *dev, u32 xrcdn, u16 uid)MLX5_SET (dealloc_xrcd_in, in, uid, uid);return mlx5_cmd_exec (dev, in,sizeof (in), out,sizeof (out)); } + +int mlx5_cmd_attach_mcg (struct mlx5_core_dev *dev,union ib_gid *mgid, +u32 qpn,u16 uid) +{ +u32 out[MLX5_ST_SZ_DW (attach_to_mcg_out)] = {0 }; +u32 in[MLX5_ST_SZ_DW (attach_to_mcg_in)] = {0 }; +void *gid; + +MLX5_SET (attach_to_mcg_in, in, opcode,MLX5_CMD_OP_ATTACH_TO_MCG ); +MLX5_SET (attach_to_mcg_in, in, qpn, qpn); +MLX5_SET (attach_to_mcg_in, in, uid, uid); + gid =MLX5_ADDR_OF (attach_to_mcg_in, in, multicast_gid); +memcpy (gid, mgid,sizeof (*mgid)); +return mlx5_cmd_exec (dev, in,sizeof (in), out,sizeof (out)); +} + +int mlx5_cmd_detach_mcg (struct mlx5_core_dev *dev,union ib_gid *mgid, +u32 qpn,u16 uid) +{ +u32 out[MLX5_ST_SZ_DW (detach_from_mcg_out)] = {0 }; +u32 in[MLX5_ST_SZ_DW (detach_from_mcg_in)] = {0 }; +void *gid; + +MLX5_SET (detach_from_mcg_in, in, opcode,MLX5_CMD_OP_DETACH_FROM_MCG ); +MLX5_SET (detach_from_mcg_in, in, qpn, qpn); +MLX5_SET (detach_from_mcg_in, in, uid, uid); + gid =MLX5_ADDR_OF (detach_from_mcg_in, in, multicast_gid); +memcpy (gid, mgid,sizeof (*mgid)); +return mlx5_cmd_exec (dev, in,sizeof (in), out,sizeof (out)); +}
drivers/infiniband/hw/mlx5/cmd.h +4 -0
@@ -57,4 +57,8 @@ void mlx5_cmd_dealloc_transport_domain(struct mlx5_core_dev *dev, u32 tdn, u16 uid);int mlx5_cmd_xrcd_alloc (struct mlx5_core_dev *dev,u32 *xrcdn,u16 uid);int mlx5_cmd_xrcd_dealloc (struct mlx5_core_dev *dev,u32 xrcdn,u16 uid); +int mlx5_cmd_attach_mcg (struct mlx5_core_dev *dev,union ib_gid *mgid, +u32 qpn,u16 uid); +int mlx5_cmd_detach_mcg (struct mlx5_core_dev *dev,union ib_gid *mgid, +u32 qpn,u16 uid);#endif /* MLX5_IB_CMD_H */
drivers/infiniband/hw/mlx5/main.c +9 -2
@@ -4139,13 +4139,17 @@ static int mlx5_ib_mcg_attach(struct ib_qp *ibqp, union ib_gid *gid, u16 lid)struct mlx5_ib_dev *dev =to_mdev (ibqp->device);struct mlx5_ib_qp *mqp =to_mqp (ibqp);int err; +u16 uid; + + uid = ibqp->uobject ? +to_mucontext (ibqp->uobject->context)->devx_uid :0 ;if (mqp->flags &MLX5_IB_QP_UNDERLAY ) {mlx5_ib_dbg (dev,"Attaching a multi cast group to underlay QP is not supported\n" );return -EOPNOTSUPP ; } - err =mlx5_core_attach_mcg (dev->mdev, gid, ibqp->qp_num); + err =mlx5_cmd_attach_mcg (dev->mdev, gid, ibqp->qp_num, uid);if (err)mlx5_ib_warn (dev,"failed attaching QPN 0x%x, MGID %pI6\n" , ibqp->qp_num, gid->raw);
@@ -4157,8 +4161,11 @@ static int mlx5_ib_mcg_detach(struct ib_qp *ibqp, union ib_gid *gid, u16 lid) {struct mlx5_ib_dev *dev =to_mdev (ibqp->device);int err; +u16 uid; - err =mlx5_core_detach_mcg (dev->mdev, gid, ibqp->qp_num); + uid = ibqp->uobject ? +to_mucontext (ibqp->uobject->context)->devx_uid :0 ; + err =mlx5_cmd_detach_mcg (dev->mdev, gid, ibqp->qp_num, uid);if (err)mlx5_ib_warn (dev,"failed detaching QPN 0x%x, MGID %pI6\n" , ibqp->qp_num, gid->raw);
Signature · 1 line
2.14.4
PATCH 21/25 IB/mlx5: Set valid umem bit on DEVX
In reply to Leon RomanovskyFrom: Yishai Hadas <[email protected]>
Set valid umem bit on DEVX commands that use umem.
This will enforce the umem usage by the firmware and not the 'pas' info.
--- drivers/infiniband/hw/mlx5/devx.c | 95 +++++++++++++++++++++++++++++++++++++++ 1 file changed, 95 insertions(+)
drivers/infiniband/hw/mlx5/devx.c +95 -0
@@ -264,6 +264,97 @@ static int devx_is_valid_obj_id(struct devx_obj *obj, const void *in)return false; } +static void devx_set_umem_valid (const void *in) +{ +u16 opcode =MLX5_GET (general_obj_in_cmd_hdr, in, opcode); + +switch (opcode) { +case MLX5_CMD_OP_CREATE_MKEY : +MLX5_SET (create_mkey_in, in, mkey_umem_valid,1 ); +break ; +case MLX5_CMD_OP_CREATE_CQ : + { +void *cqc; + +MLX5_SET (create_cq_in, in, cq_umem_valid,1 ); + cqc =MLX5_ADDR_OF (create_cq_in, in, cq_context); +MLX5_SET (cqc, cqc, dbr_umem_valid,1 ); +break ; + } +case MLX5_CMD_OP_CREATE_QP : + { +void *qpc; + + qpc =MLX5_ADDR_OF (create_qp_in, in, qpc); +MLX5_SET (qpc, qpc, dbr_umem_valid,1 ); +MLX5_SET (create_qp_in, in, wq_umem_valid,1 ); +break ; + } + +case MLX5_CMD_OP_CREATE_RQ : + { +void *rqc, *wq; + + rqc =MLX5_ADDR_OF (create_rq_in, in, ctx); + wq =MLX5_ADDR_OF (rqc, rqc, wq); +MLX5_SET (wq, wq, dbr_umem_valid,1 ); +MLX5_SET (wq, wq, wq_umem_valid,1 ); +break ; + } + +case MLX5_CMD_OP_CREATE_SQ : + { +void *sqc, *wq; + + sqc =MLX5_ADDR_OF (create_sq_in, in, ctx); + wq =MLX5_ADDR_OF (sqc, sqc, wq); +MLX5_SET (wq, wq, dbr_umem_valid,1 ); +MLX5_SET (wq, wq, wq_umem_valid,1 ); +break ; + } + +case MLX5_CMD_OP_MODIFY_CQ : +MLX5_SET (modify_cq_in, in, cq_umem_valid,1 ); +break ; + +case MLX5_CMD_OP_CREATE_RMP : + { +void *rmpc, *wq; + + rmpc =MLX5_ADDR_OF (create_rmp_in, in, ctx); + wq =MLX5_ADDR_OF (rmpc, rmpc, wq); +MLX5_SET (wq, wq, dbr_umem_valid,1 ); +MLX5_SET (wq, wq, wq_umem_valid,1 ); +break ; + } + +case MLX5_CMD_OP_CREATE_XRQ : + { +void *xrqc, *wq; + + xrqc =MLX5_ADDR_OF (create_xrq_in, in, xrq_context); + wq =MLX5_ADDR_OF (xrqc, xrqc, wq); +MLX5_SET (wq, wq, dbr_umem_valid,1 ); +MLX5_SET (wq, wq, wq_umem_valid,1 ); +break ; + } + +case MLX5_CMD_OP_CREATE_XRC_SRQ : + { +void *xrc_srqc; + +MLX5_SET (create_xrc_srq_in, in, xrc_srq_umem_valid,1 ); + xrc_srqc =MLX5_ADDR_OF (create_xrc_srq_in, in, + xrc_srq_context_entry); +MLX5_SET (xrc_srqc, xrc_srqc, dbr_umem_valid,1 ); +break ; + } + +default : +return ; + } +} +static bool devx_is_obj_create_cmd (const void *in) {u16 opcode =MLX5_GET (general_obj_in_cmd_hdr, in, opcode);
@@ -741,6 +832,8 @@ static int UVERBS_HANDLER(MLX5_IB_METHOD_DEVX_OBJ_CREATE)(return -ENOMEM ;MLX5_SET (general_obj_in_cmd_hdr, cmd_in, uid, c->devx_uid); +devx_set_umem_valid (cmd_in); + err =mlx5_cmd_exec (dev->mdev, cmd_in,uverbs_attr_get_len (attrs,MLX5_IB_ATTR_DEVX_OBJ_CREATE_CMD_IN ), cmd_out, cmd_out_len);
@@ -790,6 +883,8 @@ static int UVERBS_HANDLER(MLX5_IB_METHOD_DEVX_OBJ_MODIFY)(return PTR_ERR (cmd_out);MLX5_SET (general_obj_in_cmd_hdr, cmd_in, uid, c->devx_uid); +devx_set_umem_valid (cmd_in); + err =mlx5_cmd_exec (obj->mdev, cmd_in,uverbs_attr_get_len (attrs,MLX5_IB_ATTR_DEVX_OBJ_MODIFY_CMD_IN ), cmd_out, cmd_out_len);
Signature · 1 line
2.14.4
PATCH 22/25 IB/mlx5: Expose RAW QP device handles to user space
In reply to Leon RomanovskyFrom: Yishai Hadas <[email protected]>
Expose RAW QP device handles to user space by extending the UHW part of mlx5_ib_create_qp_resp.
This data is returned only when DEVX context is used where it may be applicable.
--- drivers/infiniband/hw/mlx5/qp.c | 38 ++++++++++++++++++++++++++++++++++++-- include/uapi/rdma/mlx5-abi.h | 13 +++++++++++++ 2 files changed, 49 insertions(+), 2 deletions(-)
drivers/infiniband/hw/mlx5/qp.c +36 -2
@@ -1325,7 +1325,9 @@ static int create_raw_packet_qp_tir(struct mlx5_ib_dev *dev,static int create_raw_packet_qp (struct mlx5_ib_dev *dev,struct mlx5_ib_qp *qp,u32 *in,size_t inlen, -struct ib_pd *pd) +struct ib_pd *pd, +struct ib_udata *udata, +struct mlx5_ib_create_qp_resp *resp) {struct mlx5_ib_raw_packet_qp *raw_packet_qp = &qp->raw_packet_qp;struct mlx5_ib_sq *sq = &raw_packet_qp->sq;
@@ -1346,6 +1348,13 @@ static int create_raw_packet_qp(struct mlx5_ib_dev *dev, struct mlx5_ib_qp *qp,if (err) goto err_destroy_tis; +if (uid) { + resp->tisn = sq->tisn; + resp->comp_mask |=MLX5_IB_CREATE_QP_RESP_MASK_TISN ; + resp->sqn = sq->base.mqp.qpn; + resp->comp_mask |=MLX5_IB_CREATE_QP_RESP_MASK_SQN ; + } + sq->base.container_mibqp = qp; sq->base.mqp.event = mlx5_ib_qp_event; }
@@ -1365,13 +1374,26 @@ static int create_raw_packet_qp(struct mlx5_ib_dev *dev, struct mlx5_ib_qp *qp, uid);if (err) goto err_destroy_rq; + +if (uid) { + resp->rqn = rq->base.mqp.qpn; + resp->comp_mask |=MLX5_IB_CREATE_QP_RESP_MASK_RQN ; + resp->tirn = rq->tirn; + resp->comp_mask |=MLX5_IB_CREATE_QP_RESP_MASK_TIRN ; + } } qp->trans_qp.base.mqp.qpn = qp->sq.wqe_cnt ? sq->base.mqp.qpn : rq->base.mqp.qpn; + err =ib_copy_to_udata (udata, resp,min (udata->outlen,sizeof (*resp))); +if (err) + goto err_destroy_tir; +return 0 ; +err_destroy_tir: +destroy_raw_packet_qp_tir (dev, rq, qp->flags_en, uid); err_destroy_rq:destroy_raw_packet_qp_rq (dev, rq); err_destroy_sq:
@@ -1643,12 +1665,23 @@ static int create_rss_raw_qp_tir(struct mlx5_ib_dev *dev, struct mlx5_ib_qp *qp,if (err) goto err; +if (mucontext->devx_uid) { + resp.comp_mask |=MLX5_IB_CREATE_QP_RESP_MASK_TIRN ; + resp.tirn = qp->rss_qp.tirn; + } + + err =ib_copy_to_udata (udata, &resp,min (udata->outlen,sizeof (resp))); +if (err) + goto err_copy; +kvfree (in);/* qpn is reserved for that QP */ qp->trans_qp.base.mqp.qpn =0 ; qp->flags |=MLX5_IB_QP_RSS ;return 0 ; +err_copy: +mlx5_cmd_destroy_tir (dev->mdev, qp->rss_qp.tirn, mucontext->devx_uid); err:kvfree (in);return err;
@@ -2030,7 +2063,8 @@ static int create_qp_common(struct mlx5_ib_dev *dev, struct ib_pd *pd, qp->flags & MLX5_IB_QP_UNDERLAY) { qp->raw_packet_qp.sq.ubuffer.buf_addr = ucmd.sq_buf_addr; raw_packet_qp_copy_info(qp, &qp->raw_packet_qp); - err = create_raw_packet_qp(dev, qp, in, inlen, pd); + err = create_raw_packet_qp(dev, qp, in, inlen, pd, udata, + &resp); } else { err =mlx5_core_create_qp (dev->mdev, &base->mqp, in, inlen); }
include/uapi/rdma/mlx5-abi.h +13 -0
@@ -352,9 +352,22 @@ struct mlx5_ib_create_qp_rss {__u32 flags; }; +enum mlx5_ib_create_qp_resp_mask { +MLX5_IB_CREATE_QP_RESP_MASK_TIRN =1UL <<0 , +MLX5_IB_CREATE_QP_RESP_MASK_TISN =1UL <<1 , +MLX5_IB_CREATE_QP_RESP_MASK_RQN =1UL <<2 , +MLX5_IB_CREATE_QP_RESP_MASK_SQN =1UL <<3 , +}; +struct mlx5_ib_create_qp_resp {__u32 bfreg_index;__u32 reserved; +__u32 comp_mask; +__u32 tirn; +__u32 tisn; +__u32 rqn; +__u32 sqn; +__u32 reserved1; };struct mlx5_ib_alloc_mw {
Signature · 1 line
2.14.4
PATCH 23/25 IB/mlx5: Manage device uid for DEVX white list commands
In reply to Leon RomanovskyFrom: Yishai Hadas <[email protected]>
Manage device uid for DEVX white list commands.
The created device uid will be used on white list commands if the user didn't supply its own uid.
This will enable the firmware to filter out non privileged functionality as of the recognition of the uid.
--- drivers/infiniband/hw/mlx5/devx.c | 12 ++++++------ drivers/infiniband/hw/mlx5/main.c | 16 ++++++++++++---- drivers/infiniband/hw/mlx5/mlx5_ib.h | 13 +++++-------- 3 files changed, 23 insertions(+), 18 deletions(-)
drivers/infiniband/hw/mlx5/devx.c +6 -6
@@ -45,13 +45,14 @@ static struct mlx5_ib_ucontext *devx_ufile2uctx(struct ib_uverbs_file *file)return to_mucontext (ib_uverbs_get_ucontext (file)); } -int mlx5_ib_devx_create (struct mlx5_ib_dev *dev,struct mlx5_ib_ucontext *context) +int mlx5_ib_devx_create (struct mlx5_ib_dev *dev) {u32 in[MLX5_ST_SZ_DW (create_uctx_in)] = {0 };u32 out[MLX5_ST_SZ_DW (general_obj_out_cmd_hdr)] = {0 };u64 general_obj_types;void *hdr;int err; +u16 uid; hdr =MLX5_ADDR_OF (create_uctx_in, in, hdr);
@@ -70,19 +71,18 @@ int mlx5_ib_devx_create(struct mlx5_ib_dev *dev, struct mlx5_ib_ucontext *contexif (err)return err; - context->devx_uid =MLX5_GET (general_obj_out_cmd_hdr, out, obj_id); -return 0 ; + uid =MLX5_GET (general_obj_out_cmd_hdr, out, obj_id); +return uid; } -void mlx5_ib_devx_destroy (struct mlx5_ib_dev *dev, -struct mlx5_ib_ucontext *context) +void mlx5_ib_devx_destroy (struct mlx5_ib_dev *dev,u16 uid) {u32 in[MLX5_ST_SZ_DW (general_obj_in_cmd_hdr)] = {0 };u32 out[MLX5_ST_SZ_DW (general_obj_out_cmd_hdr)] = {0 };MLX5_SET (general_obj_in_cmd_hdr, in, opcode,MLX5_CMD_OP_DESTROY_GENERAL_OBJECT );MLX5_SET (general_obj_in_cmd_hdr, in, obj_type,MLX5_OBJ_TYPE_UCTX ); -MLX5_SET (general_obj_in_cmd_hdr, in, obj_id, context->devx_uid); +MLX5_SET (general_obj_in_cmd_hdr, in, obj_id, uid);mlx5_cmd_exec (dev->mdev, in,sizeof (in), out,sizeof (out)); }
drivers/infiniband/hw/mlx5/main.c +12 -4
@@ -1765,9 +1765,10 @@ static struct ib_ucontext *mlx5_ib_alloc_ucontext(struct ib_device *ibdev, goto out_uars; } - err =mlx5_ib_devx_create (dev, context); -if (err) + err =mlx5_ib_devx_create (dev); +if (err <0 ) goto out_uars; + context->devx_uid = err; } err = mlx5_ib_alloc_transport_domain(dev, &context->tdn,
@@ -1872,7 +1873,7 @@ static struct ib_ucontext *mlx5_ib_alloc_ucontext(struct ib_device *ibdev,mlx5_ib_dealloc_transport_domain (dev, context->tdn, context->devx_uid); out_devx:if (req.flags &MLX5_IB_ALLOC_UCTX_DEVX ) -mlx5_ib_devx_destroy (dev, context); +mlx5_ib_devx_destroy (dev, context->devx_uid); out_uars:deallocate_uars (dev, context);
@@ -1899,7 +1900,7 @@ static int mlx5_ib_dealloc_ucontext(struct ib_ucontext *ibcontext)mlx5_ib_dealloc_transport_domain (dev, context->tdn, context->devx_uid);if (context->devx_uid) -mlx5_ib_devx_destroy (dev, context); +mlx5_ib_devx_destroy (dev, context->devx_uid);deallocate_uars (dev, context);kfree (bfregi->sys_pages);
@@ -6287,6 +6288,8 @@ void __mlx5_ib_remove(struct mlx5_ib_dev *dev, profile->stage[stage].cleanup (dev); } +if (dev->devx_whitelist_uid) +mlx5_ib_devx_destroy (dev, dev->devx_whitelist_uid);ib_dealloc_device ((struct ib_device *)dev); }
@@ -6295,6 +6298,7 @@ void *__mlx5_ib_add(struct mlx5_ib_dev *dev, {int err;int i; +int uid;printk_once (KERN_INFO "%s" , mlx5_version);
@@ -6306,6 +6310,10 @@ void *__mlx5_ib_add(struct mlx5_ib_dev *dev, } } + uid =mlx5_ib_devx_create (dev); +if (uid >0 ) + dev->devx_whitelist_uid = uid; + dev->profile = profile; dev->ib_active = true;
drivers/infiniband/hw/mlx5/mlx5_ib.h +5 -8
@@ -934,6 +934,7 @@ struct mlx5_ib_dev {struct list_head ib_dev_list;u64 sys_image_guid;struct mlx5_memic memic; +u16 devx_whitelist_uid; };static inline struct mlx5_ib_cq *to_mibcq (struct mlx5_core_cq *mcq)
@@ -1258,10 +1259,8 @@ void mlx5_ib_put_native_port_mdev(struct mlx5_ib_dev *dev, u8 port_num);#if IS_ENABLED (CONFIG_INFINIBAND_USER_ACCESS ) -int mlx5_ib_devx_create (struct mlx5_ib_dev *dev, -struct mlx5_ib_ucontext *context); -void mlx5_ib_devx_destroy (struct mlx5_ib_dev *dev, -struct mlx5_ib_ucontext *context); +int mlx5_ib_devx_create (struct mlx5_ib_dev *dev); +void mlx5_ib_devx_destroy (struct mlx5_ib_dev *dev,u16 uid);const struct uverbs_object_tree_def *mlx5_ib_get_devx_tree (void ); struct mlx5_ib_flow_handler *mlx5_ib_raw_fs_rule_add( struct mlx5_ib_dev *dev, struct mlx5_ib_flow_matcher *fs_matcher,
@@ -1272,10 +1271,8 @@ int mlx5_ib_get_flow_trees(const struct uverbs_object_tree_def **root);void mlx5_ib_destroy_flow_action_raw (struct mlx5_ib_flow_action *maction);#else static inline int -mlx5_ib_devx_create (struct mlx5_ib_dev *dev, -struct mlx5_ib_ucontext *context) {return -EOPNOTSUPP ; }; -static inline void mlx5_ib_devx_destroy (struct mlx5_ib_dev *dev, -struct mlx5_ib_ucontext *context) {} +mlx5_ib_devx_create (struct mlx5_ib_dev *dev) {return -EOPNOTSUPP ; }; +static inline void mlx5_ib_devx_destroy (struct mlx5_ib_dev *dev,u16 uid) {}static inline const struct uverbs_object_tree_def *mlx5_ib_get_devx_tree (void ) {return NULL ; } static inline bool mlx5_ib_devx_is_flow_dest(void *obj, int *dest_id,
Signature · 1 line
2.14.4
PATCH 24/25 IB/mlx5: Enable DEVX white list commands
In reply to Leon RomanovskyFrom: Yishai Hadas <[email protected]>
Enable DEVX white list commands without the need for CAP_NET_RAW.
DEVX uid must exist from the ucontext or the device so that the firmware will mask unprivileged capabilities.
--- drivers/infiniband/hw/mlx5/devx.c | 75 +++++++++++++++++++++++++++++++-------- 1 file changed, 60 insertions(+), 15 deletions(-)
drivers/infiniband/hw/mlx5/devx.c +60 -15
@@ -61,9 +61,6 @@ int mlx5_ib_devx_create(struct mlx5_ib_dev *dev) !(general_obj_types & MLX5_GENERAL_OBJ_TYPES_CAP_UMEM))return -EINVAL ; -if (!capable (CAP_NET_RAW )) -return -EPERM ; -MLX5_SET (general_obj_in_cmd_hdr, hdr, opcode,MLX5_CMD_OP_CREATE_GENERAL_OBJECT );MLX5_SET (general_obj_in_cmd_hdr, hdr, obj_type,MLX5_OBJ_TYPE_UCTX );
@@ -476,12 +473,49 @@ static bool devx_is_obj_query_cmd(const void *in) } } +static bool devx_is_whitelist_cmd (void *in) +{ +u16 opcode =MLX5_GET (general_obj_in_cmd_hdr, in, opcode); + +switch (opcode) { +case MLX5_CMD_OP_QUERY_HCA_CAP : +case MLX5_CMD_OP_QUERY_HCA_VPORT_CONTEXT : +return true; +default : +return false; + } +} + +static int devx_get_uid (struct mlx5_ib_ucontext *c,void *cmd_in) +{ +if (devx_is_whitelist_cmd (cmd_in)) { +struct mlx5_ib_dev *dev; + +if (c->devx_uid) +return c->devx_uid; + + dev =to_mdev (c->ibucontext.device); +if (dev->devx_whitelist_uid) +return dev->devx_whitelist_uid; + +return -EOPNOTSUPP ; + } + +if (!c->devx_uid) +return -EINVAL ; + +if (!capable (CAP_NET_RAW )) +return -EPERM ; + +return c->devx_uid; +}static bool devx_is_general_cmd (void *in) {u16 opcode =MLX5_GET (general_obj_in_cmd_hdr, in, opcode);switch (opcode) {case MLX5_CMD_OP_QUERY_HCA_CAP : +case MLX5_CMD_OP_QUERY_HCA_VPORT_CONTEXT :case MLX5_CMD_OP_QUERY_VPORT_STATE :case MLX5_CMD_OP_QUERY_ADAPTER :case MLX5_CMD_OP_QUERY_ISSI :
@@ -589,14 +623,16 @@ static int UVERBS_HANDLER(MLX5_IB_METHOD_DEVX_OTHER)( MLX5_IB_ATTR_DEVX_OTHER_CMD_OUT);void *cmd_out;int err; +int uid; c =devx_ufile2uctx (file);if (IS_ERR (c))return PTR_ERR (c); dev =to_mdev (c->ibucontext.device); -if (!c->devx_uid) -return -EPERM ; + uid =devx_get_uid (c, cmd_in); +if (uid <0 ) +return uid;/* Only white list of some general HCA commands are allowed for this method. */ if (!devx_is_general_cmd (cmd_in))
@@ -606,7 +642,7 @@ static int UVERBS_HANDLER(MLX5_IB_METHOD_DEVX_OTHER)(if (IS_ERR (cmd_out))return PTR_ERR (cmd_out); -MLX5_SET (general_obj_in_cmd_hdr, cmd_in, uid, c->devx_uid); +MLX5_SET (general_obj_in_cmd_hdr, cmd_in, uid, uid); err =mlx5_cmd_exec (dev->mdev, cmd_in,uverbs_attr_get_len (attrs,MLX5_IB_ATTR_DEVX_OTHER_CMD_IN ), cmd_out, cmd_out_len);
@@ -816,9 +852,11 @@ static int UVERBS_HANDLER(MLX5_IB_METHOD_DEVX_OBJ_CREATE)(struct mlx5_ib_dev *dev =to_mdev (c->ibucontext.device);struct devx_obj *obj;int err; +int uid; -if (!c->devx_uid) -return -EPERM ; + uid =devx_get_uid (c, cmd_in); +if (uid <0 ) +return uid;if (!devx_is_obj_create_cmd (cmd_in))return -EINVAL ;
@@ -831,7 +869,7 @@ static int UVERBS_HANDLER(MLX5_IB_METHOD_DEVX_OBJ_CREATE)(if (!obj)return -ENOMEM ; -MLX5_SET (general_obj_in_cmd_hdr, cmd_in, uid, c->devx_uid); +MLX5_SET (general_obj_in_cmd_hdr, cmd_in, uid, uid);devx_set_umem_valid (cmd_in); err = mlx5_cmd_exec(dev->mdev, cmd_in,
@@ -868,9 +906,11 @@ static int UVERBS_HANDLER(MLX5_IB_METHOD_DEVX_OBJ_MODIFY)(struct devx_obj *obj = uobj->object;void *cmd_out;int err; +int uid; -if (!c->devx_uid) -return -EPERM ; + uid =devx_get_uid (c, cmd_in); +if (uid <0 ) +return uid;if (!devx_is_obj_modify_cmd (cmd_in))return -EINVAL ;
@@ -882,7 +922,7 @@ static int UVERBS_HANDLER(MLX5_IB_METHOD_DEVX_OBJ_MODIFY)(if (IS_ERR (cmd_out))return PTR_ERR (cmd_out); -MLX5_SET (general_obj_in_cmd_hdr, cmd_in, uid, c->devx_uid); +MLX5_SET (general_obj_in_cmd_hdr, cmd_in, uid, uid);devx_set_umem_valid (cmd_in); err = mlx5_cmd_exec(obj->mdev, cmd_in,
@@ -907,9 +947,11 @@ static int UVERBS_HANDLER(MLX5_IB_METHOD_DEVX_OBJ_QUERY)(struct devx_obj *obj = uobj->object;void *cmd_out;int err; +int uid; -if (!c->devx_uid) -return -EPERM ; + uid =devx_get_uid (c, cmd_in); +if (uid <0 ) +return uid;if (!devx_is_obj_query_cmd (cmd_in))return -EINVAL ;
@@ -921,7 +963,7 @@ static int UVERBS_HANDLER(MLX5_IB_METHOD_DEVX_OBJ_QUERY)(if (IS_ERR (cmd_out))return PTR_ERR (cmd_out); -MLX5_SET (general_obj_in_cmd_hdr, cmd_in, uid, c->devx_uid); +MLX5_SET (general_obj_in_cmd_hdr, cmd_in, uid, uid); err =mlx5_cmd_exec (obj->mdev, cmd_in,uverbs_attr_get_len (attrs,MLX5_IB_ATTR_DEVX_OBJ_QUERY_CMD_IN ), cmd_out, cmd_out_len);
@@ -1020,6 +1062,9 @@ static int UVERBS_HANDLER(MLX5_IB_METHOD_DEVX_UMEM_REG)(int err;if (!c->devx_uid) +return -EINVAL ; + +if (!capable (CAP_NET_RAW ))return -EPERM ; obj =kzalloc (sizeof (struct devx_umem ),GFP_KERNEL );
Signature · 1 line
2.14.4
PATCH 25/25 IB/mlx5: Enable DEVX on IB
In reply to Leon RomanovskyFrom: Yishai Hadas <[email protected]>
IB has additional protections with SELinux that cannot be extended to the DEVX domain. SELinux can restrict access to pkeys. The first version of DEVX blocked IB entirely until this could be understood.
Since DEVX requires CAP_NET_RAW, it supersedes the SELinux restriction and allows userspace to form arbitrary packets with arbitrary pkeys.
Thus we enable IB for DEVX when CAP_NET_RAW is given.
--- drivers/infiniband/hw/mlx5/main.c | 6 ------ 1 file changed, 6 deletions(-)
drivers/infiniband/hw/mlx5/main.c +0 -6
@@ -1759,12 +1759,6 @@ static struct ib_ucontext *mlx5_ib_alloc_ucontext(struct ib_device *ibdev,#endif if (req.flags &MLX5_IB_ALLOC_UCTX_DEVX ) { -/* Block DEVX on Infiniband as of SELinux */ -if (mlx5_ib_port_link_layer (ibdev,1 ) !=IB_LINK_LAYER_ETHERNET ) { - err = -EPERM ; - goto out_uars; - } - err =mlx5_ib_devx_create (dev);if (err <0 ) goto out_uars;
Signature · 1 line
2.14.4
Quoted 47 lines · Leon Romanovsky
From: Leon Romanovsky <[email protected]>
From Yishai,
This series comes to enable the DEVX functionality in some wider scope, specifically,
- It enables using kernel objects that were created by the verbs API in the DEVX flow.
- It enables white list commands without DEVX user context.
- It enables the IB link layer underCAP_NET_RAWcapabilities.
- It exposes the PRM handles for RAW QP (i.e. TIRN, TISN, RQN, SQN) to be used later on directly by the DEVX interface.In General,
Each object that is created/destroyed/modified via verbs will be stamped with a UID based on its user context. This is already done for DEVX objects commands.This will enable the firmware to enforce the usage of kernel objects from the DEVX flow by validating that the same UID is used and the resources are really related to the same user.
For example in case a CQ was created with verbs it will be stamped with UID and once will be pointed by a DEVX create QP command the firmware will validate that the input CQN really belongs to the UID which issues the create QP command.
As of the above, all the PRM objects (except of the public ones which are managed by the kernel e.g. FLOW, etc.) will have a UID upon their create/modify/destroy commands. The detection of UMEM / physical addressed in the relevant commands will be done by firmware according to a 'umem valid bit' as the UID may be used in both cases.
The series also enables white list commands which don't require a specific DEVX context, instead of this a device UID is used so that the firmware will mask un-privileged functionality. The IB link layer is also enabled once
CAP_NET_RAWpermission exists.To enable using the RAW QP underlay objects (e.g. TIRN, RQN, etc.) later on by DEVX commands the UHW output for this case was extended to return this data when a DEVX context is used.
Thanks
Leon Romanovsky (1):
net/mlx5: Updatemlx5_ifcwith DEVX UID bits
Quoted 7 lines
Yishai Hadas (24):
net/mlx5: Set uid as part of CQ commands
net/mlx5: Set uid as part of QP commands
net/mlx5: Set uid as part of RQ commands
net/mlx5: Set uid as part of SQ commands
net/mlx5: Set uid as part of SRQ commands
net/mlx5: Set uid as part of DCT commands
Hi Doug and Jason,
Do you want me to resend 7 patches above in one series and other patches in another series just to be below 15 patches limit? Please be aware that those patches above are going to mlx5-next and not to net-next/rdma-next.
No rebase, no code change, no much meaning too, but it is your call.
Thanks
Quoted 41 lines
IB/mlx5: Set uid as part of CQ creation IB/mlx5: Set uid as part of QP creation IB/mlx5: Set uid as part of RQ commands IB/mlx5: Set uid as part of SQ commands IB/mlx5: Set uid as part of TIR commands IB/mlx5: Set uid as part of TIS commands IB/mlx5: Set uid as part of RQT commands IB/mlx5: Set uid as part of PD commands IB/mlx5: Set uid as part of TD commands IB/mlx5: Set uid as part of SRQ commands IB/mlx5: Set uid as part of DCT commands IB/mlx5: Set uid as part of XRCD commands IB/mlx5: Set uid as part of MCG commands IB/mlx5: Set valid umem bit on DEVX
IB/mlx5: Expose RAW QP device handles to user space IB/mlx5: Manage device uid for DEVX white list commands IB/mlx5: Enable DEVX white list commands IB/mlx5: Enable DEVX on IBdrivers/infiniband/hw/mlx5/cmd.c | 129 ++++++++++++++++++ drivers/infiniband/hw/mlx5/cmd.h | 14 ++ drivers/infiniband/hw/mlx5/cq.c | 1 + drivers/infiniband/hw/mlx5/devx.c | 182 +++++++++++++++++++++++--- drivers/infiniband/hw/mlx5/main.c | 80 +++++++---- drivers/infiniband/hw/mlx5/mlx5_ib.h | 15 +-- drivers/infiniband/hw/mlx5/qp.c | 141 +++++++++++++++----- drivers/infiniband/hw/mlx5/srq.c | 1 + drivers/net/ethernet/mellanox/mlx5/core/cq.c | 4 + drivers/net/ethernet/mellanox/mlx5/core/qp.c | 81 ++++++++---- drivers/net/ethernet/mellanox/mlx5/core/srq.c | 30 ++++- include/linux/mlx5/cq.h | 1 + include/linux/mlx5/driver.h | 1 + include/linux/mlx5/mlx5_ifc.h | 135 +++++++++++-------- include/linux/mlx5/qp.h | 1 + include/linux/mlx5/srq.h | 1 + include/uapi/rdma/mlx5-abi.h | 13 ++ 17 files changed, 657 insertions(+), 173 deletions(-)--
2.14.4
Quoted 56 lines · Leon Romanovsky
Quoted 47 lines · Leon Romanovsky
From: Leon Romanovsky <[email protected]>
From Yishai,
This series comes to enable the DEVX functionality in some wider scope, specifically,
- It enables using kernel objects that were created by the verbs API in the DEVX flow.
- It enables white list commands without DEVX user context.
- It enables the IB link layer underCAP_NET_RAWcapabilities.
- It exposes the PRM handles for RAW QP (i.e. TIRN, TISN, RQN, SQN) to be used later on directly by the DEVX interface.In General,
Each object that is created/destroyed/modified via verbs will be stamped with a UID based on its user context. This is already done for DEVX objects commands.This will enable the firmware to enforce the usage of kernel objects from the DEVX flow by validating that the same UID is used and the resources are really related to the same user.
For example in case a CQ was created with verbs it will be stamped with UID and once will be pointed by a DEVX create QP command the firmware will validate that the input CQN really belongs to the UID which issues the create QP command.
As of the above, all the PRM objects (except of the public ones which are managed by the kernel e.g. FLOW, etc.) will have a UID upon their create/modify/destroy commands. The detection of UMEM / physical addressed in the relevant commands will be done by firmware according to a 'umem valid bit' as the UID may be used in both cases.
The series also enables white list commands which don't require a specific DEVX context, instead of this a device UID is used so that the firmware will mask un-privileged functionality. The IB link layer is also enabled once
CAP_NET_RAWpermission exists.To enable using the RAW QP underlay objects (e.g. TIRN, RQN, etc.) later on by DEVX commands the UHW output for this case was extended to return this data when a DEVX context is used.
Thanks
Leon Romanovsky (1):
net/mlx5: Updatemlx5_ifcwith DEVX UID bitsQuoted 7 lines
Yishai Hadas (24):
net/mlx5: Set uid as part of CQ commands
net/mlx5: Set uid as part of QP commands
net/mlx5: Set uid as part of RQ commands
net/mlx5: Set uid as part of SQ commands
net/mlx5: Set uid as part of SRQ commands
net/mlx5: Set uid as part of DCT commands
Quoted 8 lines
Hi Doug and Jason,
Do you want me to resend 7 patches above in one series and other patches in another series just to be below 15 patches limit? Please be aware that those patches above are going to mlx5-next and not to net-next/rdma-next.
No rebase, no code change, no much meaning too, but it is your call.
how about yes! for stop shitting on Dave Miller?
Quoted 59 lines · Or Gerlitz
Quoted 58 lines · Leon Romanovsky
Quoted 47 lines · Leon Romanovsky
From: Leon Romanovsky <[email protected]>
From Yishai,
This series comes to enable the DEVX functionality in some wider scope, specifically,
- It enables using kernel objects that were created by the verbs API in the DEVX flow.
- It enables white list commands without DEVX user context.
- It enables the IB link layer underCAP_NET_RAWcapabilities.
- It exposes the PRM handles for RAW QP (i.e. TIRN, TISN, RQN, SQN) to be used later on directly by the DEVX interface.In General,
Each object that is created/destroyed/modified via verbs will be stamped with a UID based on its user context. This is already done for DEVX objects commands.This will enable the firmware to enforce the usage of kernel objects from the DEVX flow by validating that the same UID is used and the resources are really related to the same user.
For example in case a CQ was created with verbs it will be stamped with UID and once will be pointed by a DEVX create QP command the firmware will validate that the input CQN really belongs to the UID which issues the create QP command.
As of the above, all the PRM objects (except of the public ones which are managed by the kernel e.g. FLOW, etc.) will have a UID upon their create/modify/destroy commands. The detection of UMEM / physical addressed in the relevant commands will be done by firmware according to a 'umem valid bit' as the UID may be used in both cases.
The series also enables white list commands which don't require a specific DEVX context, instead of this a device UID is used so that the firmware will mask un-privileged functionality. The IB link layer is also enabled once
CAP_NET_RAWpermission exists.To enable using the RAW QP underlay objects (e.g. TIRN, RQN, etc.) later on by DEVX commands the UHW output for this case was extended to return this data when a DEVX context is used.
Thanks
Leon Romanovsky (1):
net/mlx5: Updatemlx5_ifcwith DEVX UID bitsQuoted 7 lines
Yishai Hadas (24):
net/mlx5: Set uid as part of CQ commands
net/mlx5: Set uid as part of QP commands
net/mlx5: Set uid as part of RQ commands
net/mlx5: Set uid as part of SQ commands
net/mlx5: Set uid as part of SRQ commands
net/mlx5: Set uid as part of DCT commandsHi Doug and Jason,
Quoted 8 lines
Quoted 6 lines
Do you want me to resend 7 patches above in one series and other patches in another series just to be below 15 patches limit? Please be aware that those patches above are going to mlx5-next and not to net-next/rdma-next.
No rebase, no code change, no much meaning too, but it is your call.
how about yes! for stop shitting on Dave Miller?
Or, are you ok?
This series is not relevant to Dave Miller and he didn't even listed in CC or TO.
I still prefer to hear answer from respective maintainer to whom this series was sent.
Thanks
Quoted 65 lines · Leon Romanovsky
Quoted 64 lines · Or Gerlitz
Quoted 63 lines · Leon Romanovsky
Quoted 47 lines · Leon Romanovsky
From: Leon Romanovsky <[email protected]>
From Yishai,
This series comes to enable the DEVX functionality in some wider scope, specifically,
- It enables using kernel objects that were created by the verbs API in the DEVX flow.
- It enables white list commands without DEVX user context.
- It enables the IB link layer underCAP_NET_RAWcapabilities.
- It exposes the PRM handles for RAW QP (i.e. TIRN, TISN, RQN, SQN) to be used later on directly by the DEVX interface.In General,
Each object that is created/destroyed/modified via verbs will be stamped with a UID based on its user context. This is already done for DEVX objects commands.This will enable the firmware to enforce the usage of kernel objects from the DEVX flow by validating that the same UID is used and the resources are really related to the same user.
For example in case a CQ was created with verbs it will be stamped with UID and once will be pointed by a DEVX create QP command the firmware will validate that the input CQN really belongs to the UID which issues the create QP command.
As of the above, all the PRM objects (except of the public ones which are managed by the kernel e.g. FLOW, etc.) will have a UID upon their create/modify/destroy commands. The detection of UMEM / physical addressed in the relevant commands will be done by firmware according to a 'umem valid bit' as the UID may be used in both cases.
The series also enables white list commands which don't require a specific DEVX context, instead of this a device UID is used so that the firmware will mask un-privileged functionality. The IB link layer is also enabled once
CAP_NET_RAWpermission exists.To enable using the RAW QP underlay objects (e.g. TIRN, RQN, etc.) later on by DEVX commands the UHW output for this case was extended to return this data when a DEVX context is used.
Thanks
Leon Romanovsky (1):
net/mlx5: Updatemlx5_ifcwith DEVX UID bitsQuoted 7 lines
Yishai Hadas (24):
net/mlx5: Set uid as part of CQ commands
net/mlx5: Set uid as part of QP commands
net/mlx5: Set uid as part of RQ commands
net/mlx5: Set uid as part of SQ commands
net/mlx5: Set uid as part of SRQ commands
net/mlx5: Set uid as part of DCT commandsHi Doug and Jason,
Do you want me to resend 7 patches above in one series and other patches in another series just to be below 15 patches limit? Please be aware that those patches above are going to mlx5-next and not to net-next/rdma-next.
Quoted 7 lines
Quoted 3 lines
Quoted 1 line
No rebase, no code change, no much meaning too, but it is your call.
how about yes! for stop shitting on Dave Miller?
Or, are you ok?
This series is not relevant to Dave Miller and he didn't even listed in CC or TO.
correct, but Dave asked MLNX/Saeed to do X, you should respect X when you post to the community Dave is maintaining, even if he didn't ask you, not doing so hurts
our positioning with Dave.
Quoted 3 lines
I still prefer to hear answer from respective maintainer to whom this series was sent.
Your maintainer asked you to do X, just do it, once and for all
Quoted 70 lines · Or Gerlitz
Quoted 69 lines · Leon Romanovsky
Quoted 67 lines · Or Gerlitz
Quoted 56 lines · Leon Romanovsky
Quoted 47 lines · Leon Romanovsky
From: Leon Romanovsky <[email protected]>
From Yishai,
This series comes to enable the DEVX functionality in some wider scope, specifically,
- It enables using kernel objects that were created by the verbs API in the DEVX flow.
- It enables white list commands without DEVX user context.
- It enables the IB link layer underCAP_NET_RAWcapabilities.
- It exposes the PRM handles for RAW QP (i.e. TIRN, TISN, RQN, SQN) to be used later on directly by the DEVX interface.In General,
Each object that is created/destroyed/modified via verbs will be stamped with a UID based on its user context. This is already done for DEVX objects commands.This will enable the firmware to enforce the usage of kernel objects from the DEVX flow by validating that the same UID is used and the resources are really related to the same user.
For example in case a CQ was created with verbs it will be stamped with UID and once will be pointed by a DEVX create QP command the firmware will validate that the input CQN really belongs to the UID which issues the create QP command.
As of the above, all the PRM objects (except of the public ones which are managed by the kernel e.g. FLOW, etc.) will have a UID upon their create/modify/destroy commands. The detection of UMEM / physical addressed in the relevant commands will be done by firmware according to a 'umem valid bit' as the UID may be used in both cases.
The series also enables white list commands which don't require a specific DEVX context, instead of this a device UID is used so that the firmware will mask un-privileged functionality. The IB link layer is also enabled once
CAP_NET_RAWpermission exists.To enable using the RAW QP underlay objects (e.g. TIRN, RQN, etc.) later on by DEVX commands the UHW output for this case was extended to return this data when a DEVX context is used.
Thanks
Leon Romanovsky (1):
net/mlx5: Updatemlx5_ifcwith DEVX UID bitsQuoted 7 lines
Yishai Hadas (24):
net/mlx5: Set uid as part of CQ commands
net/mlx5: Set uid as part of QP commands
net/mlx5: Set uid as part of RQ commands
net/mlx5: Set uid as part of SQ commands
net/mlx5: Set uid as part of SRQ commands
net/mlx5: Set uid as part of DCT commandsQuoted 8 lines
Hi Doug and Jason,
Do you want me to resend 7 patches above in one series and other patches in another series just to be below 15 patches limit? Please be aware that those patches above are going to mlx5-next and not to net-next/rdma-next.
No rebase, no code change, no much meaning too, but it is your call.
how about yes! for stop shitting on Dave Miller?
Quoted 8 lines
Quoted 3 lines
Or, are you ok?
This series is not relevant to Dave Miller and he didn't even listed in CC or TO.
correct, but Dave asked MLNX/Saeed to do X, you should respect X when you post to the community Dave is maintaining, even if he didn't ask you, not doing so hurts
our positioning with Dave.
Saeed is going to see/apply/review first 7 patches, which is less than 15, so we are ok here.
Quoted 7 lines
Quoted 5 lines
I still prefer to hear answer from respective maintainer to whom this series was sent.
Your maintainer asked you to do X, just do it, once and for all
Both Doug and Jason known how to write emails, they will request "X" if THEY decide that it is needed/better, there is no need to be their voice.
Thanks
Quoted 59 lines · Leon Romanovsky
From: Leon Romanovsky <[email protected]>
From Yishai,
This series comes to enable the DEVX functionality in some wider scope, specifically,
- It enables using kernel objects that were created by the verbs API in the DEVX flow.
- It enables white list commands without DEVX user context.
- It enables the IB link layer underCAP_NET_RAWcapabilities.
- It exposes the PRM handles for RAW QP (i.e. TIRN, TISN, RQN, SQN) to be used later on directly by the DEVX interface.In General,
Each object that is created/destroyed/modified via verbs will be stamped with a UID based on its user context. This is already done for DEVX objects commands.This will enable the firmware to enforce the usage of kernel objects from the DEVX flow by validating that the same UID is used and the resources are really related to the same user.
For example in case a CQ was created with verbs it will be stamped with UID and once will be pointed by a DEVX create QP command the firmware will validate that the input CQN really belongs to the UID which issues the create QP command.
As of the above, all the PRM objects (except of the public ones which are managed by the kernel e.g. FLOW, etc.) will have a UID upon their create/modify/destroy commands. The detection of UMEM / physical addressed in the relevant commands will be done by firmware according to a 'umem valid bit' as the UID may be used in both cases.
The series also enables white list commands which don't require a specific DEVX context, instead of this a device UID is used so that the firmware will mask un-privileged functionality. The IB link layer is also enabled once
CAP_NET_RAWpermission exists.To enable using the RAW QP underlay objects (e.g. TIRN, RQN, etc.) later on by DEVX commands the UHW output for this case was extended to return this data when a DEVX context is used.
Thanks
Leon Romanovsky (1):
net/mlx5: Updatemlx5_ifcwith DEVX UID bitsYishai Hadas (24):
net/mlx5: Set uid as part of CQ commands
net/mlx5: Set uid as part of QP commands
net/mlx5: Set uid as part of RQ commands
net/mlx5: Set uid as part of SQ commands
net/mlx5: Set uid as part of SRQ commands
net/mlx5: Set uid as part of DCT commands
IB/mlx5: Set uid as part of CQ creation
IB/mlx5: Set uid as part of QP creation
IB/mlx5: Set uid as part of RQ commands
IB/mlx5: Set uid as part of SQ commands
IB/mlx5: Set uid as part of TIR commands
Quoted 8 lines
IB/mlx5: Set uid as part of TIS commands
IB/mlx5: Set uid as part of RQT commands
IB/mlx5: Set uid as part of PD commands
IB/mlx5: Set uid as part of TD commands
IB/mlx5: Set uid as part of SRQ commands
IB/mlx5: Set uid as part of DCT commands
IB/mlx5: Set uid as part of XRCD commands
IB/mlx5: Set uid as part of MCG commands
This is really too many patches.. They are small and not too hard to review, but it is well beyond the guideline.
And I'm not totally happy with the extensive use of ucontext in the IB portions, it is problematic looking into the future, and uboject is really not supposed to be used in the drivers.
The driver needs to store the uid in the PD (copied from the ucontext that created it) and use that in all the dependent places, not use pd->uobject->ucontext->devx_uid or some other convoluted way to get to it.
The ucontext variable should only be used when creating the PD, CQ and devx objects.
This detail becomes quite important, for instance, if we get to the 'shared pd' that has been talked about at conference. In this case when the 'receiver' of the 'shared pd' creates a child object, like a MR, the MR must be stamped with the devx_uid of the PD (ie the originating context's devx_uid), not the dev_uid of its local ufile!
If we do that, then the series can be split, so long as pd->devx_uid == 0 until the entire series is applied. uid tagging is an all-or-nothing thing, as partial tagging will break verbs. So breaking it up also makes it more bi-section safe.
Something like these patches:
Quoted 5 lines
net/mlx5: Update
mlx5_ifcwith DEVX UID bits
net/mlx5: Set uid as part of CQ commands
net/mlx5: Set uid as part of QP commands
net/mlx5: Set uid as part of RQ commands
net/mlx5: Set uid as part of SQ commands
Quoted 8 lines
net/mlx5: Set uid as part of SRQ commands
net/mlx5: Set uid as part of DCT commands
IB/mlx5: Set uid as part of PD commands
IB/mlx5: Set uid as part of QP creation
IB/mlx5: Set uid as part of RQ commands
IB/mlx5: Set uid as part of SQ commands
IB/mlx5: Set uid as part of SRQ commands
IB/mlx5: Set uid as part of DCT commands
(13 patches)
Followed by the rest of the IB uid patches
Followed by a patch to make pd->uid != 0 along with these:
Quoted 6 lines
IB/mlx5: Set uid as part of CQ creation IB/mlx5: Set valid umem bit on DEVX
IB/mlx5: Expose RAW QP device handles to user space IB/mlx5: Manage device uid for DEVX white list commands IB/mlx5: Enable DEVX white list commands IB/mlx5: Enable DEVX on IB
Jason
Quoted 90 lines · Jason Gunthorpe
Quoted 59 lines · Leon Romanovsky
From: Leon Romanovsky <[email protected]>
From Yishai,
This series comes to enable the DEVX functionality in some wider scope, specifically,
- It enables using kernel objects that were created by the verbs API in the DEVX flow.
- It enables white list commands without DEVX user context.
- It enables the IB link layer underCAP_NET_RAWcapabilities.
- It exposes the PRM handles for RAW QP (i.e. TIRN, TISN, RQN, SQN) to be used later on directly by the DEVX interface.In General,
Each object that is created/destroyed/modified via verbs will be stamped with a UID based on its user context. This is already done for DEVX objects commands.This will enable the firmware to enforce the usage of kernel objects from the DEVX flow by validating that the same UID is used and the resources are really related to the same user.
For example in case a CQ was created with verbs it will be stamped with UID and once will be pointed by a DEVX create QP command the firmware will validate that the input CQN really belongs to the UID which issues the create QP command.
As of the above, all the PRM objects (except of the public ones which are managed by the kernel e.g. FLOW, etc.) will have a UID upon their create/modify/destroy commands. The detection of UMEM / physical addressed in the relevant commands will be done by firmware according to a 'umem valid bit' as the UID may be used in both cases.
The series also enables white list commands which don't require a specific DEVX context, instead of this a device UID is used so that the firmware will mask un-privileged functionality. The IB link layer is also enabled once
CAP_NET_RAWpermission exists.To enable using the RAW QP underlay objects (e.g. TIRN, RQN, etc.) later on by DEVX commands the UHW output for this case was extended to return this data when a DEVX context is used.
Thanks
Leon Romanovsky (1):
net/mlx5: Updatemlx5_ifcwith DEVX UID bitsYishai Hadas (24):
net/mlx5: Set uid as part of CQ commands
net/mlx5: Set uid as part of QP commands
net/mlx5: Set uid as part of RQ commands
net/mlx5: Set uid as part of SQ commands
net/mlx5: Set uid as part of SRQ commands
net/mlx5: Set uid as part of DCT commands
IB/mlx5: Set uid as part of CQ creation
IB/mlx5: Set uid as part of QP creation
IB/mlx5: Set uid as part of RQ commands
IB/mlx5: Set uid as part of SQ commands
IB/mlx5: Set uid as part of TIR commandsQuoted 8 lines
IB/mlx5: Set uid as part of TIS commands
IB/mlx5: Set uid as part of RQT commands
IB/mlx5: Set uid as part of PD commands
IB/mlx5: Set uid as part of TD commands
IB/mlx5: Set uid as part of SRQ commands
IB/mlx5: Set uid as part of DCT commands
IB/mlx5: Set uid as part of XRCD commands
IB/mlx5: Set uid as part of MCG commandsThis is really too many patches.. They are small and not too hard to review, but it is well beyond the guideline.
And I'm not totally happy with the extensive use of ucontext in the IB portions, it is problematic looking into the future, and uboject is really not supposed to be used in the drivers.
The driver needs to store the uid in the PD (copied from the ucontext that created it) and use that in all the dependent places, not use
pd->uobject->ucontext->devx_uidor some other convoluted way to get to it.The ucontext variable should only be used when creating the PD, CQ and devx objects.
This detail becomes quite important, for instance, if we get to the 'shared pd' that has been talked about at conference. In this case when the 'receiver' of the 'shared pd' creates a child object, like a MR, the MR must be stamped with the
devx_uidof the PD (ie the originating context'sdevx_uid), not thedev_uidof its local ufile!
Quoted 4 lines
If we do that, then the series can be split, so long as
pd->devx_uid== 0 until the entire series is applied. uid tagging is an all-or-nothing thing, as partial tagging will break verbs. So breaking it up also makes it more bi-section safe.
There is very simple reason why this series was sent as one piece. The basic requirement that the code posted will be as one feature, from the beginning till the end, easy to follow, cherry-pick, proper ordering and less errors.
However if you want to see three series posted immediately one after another and have two of them with dead code, I'll do it.
Thanks