Broadcom RoCE Driver (bnxt_re)
Subsystems (4)
Selvin Xavier
maintainerv5 cover Broadcom RoCE Driver (bnxt_re)
This series introduces the RoCE driver for the Broadcom NetXtreme-E 10/25/40/50G RoCE HCAs.
This driver is dependent on the bnxt_en NIC driver and is based on the for-4.11 branch in linux-rdma repository. bnxt_en changes required for this patch series are already available afore mentioned branch.
These changes are available for your reference in
the bnxt_re_v5 branch of following repository.
https://github.com/Broadcom/linux-rdma-nxt/
Doug,
This patchset addresses review comments from you and Leon. This series also includes some changes required for the latest FW. Please consider applying this to linux-rdma tree.
Thanks,
Selvin Xavier
v4->v5:
* Removes rdev ref_count as this is not necessary.
* Adds a check to see if the device is supporting RoCE
* Updating the PF FW communication channel offset as per the latest FW changes
* Use min_t macro to calculate the number CQ and QP entries
* Adds ib_udata parameter to create_ah verb
* Uses ETH_P_IBOE macro for RoCE ethertype
* Code refactoring based on the review comments from Leon
v3->v4:
* Changes driver folder name to bnxt_re and remove the bnxt_re/bnxt prefix from the individual files inside the driver folder.
* Changes the file name bnxtre-abi to bnxt_re-abi.h to align with convention <module_name>-abi.h
* Updates the Makefile and Kconfig file with new format change.
v2->v3:
* Fix 0day build breakage
* Fix cocci, kbuild robot, sparse, smatch and checkpatch warnings
* Changed the filename bnxt_re_uverbs_abi.h to bnxtre-abi.h
* Removed the __packed qualifier from the uverbs structure and adjusted the structure alignment to 64bits.
* Added retry count to bail out in case of delayed or no response to FW commands
* Removed the debugfs support from this patch series
* Changed some of the defines as inline functions based on Jason's comment
* Split two functions to get rid of switch within switch construct
* Removed bnxt_re_copy_to_udata as it is just a wrapper for ib_copy_to_udata
* Added maintainers information to MAINTAINERS file
v1-> v2:
* The license text in each file updated to reflect Dual license.
* Makefile and Kconfig changes are pushed to the last patch
* Moved bnxt_re_uverbs_abi.h to include/uapi/rdma folder
* Remove duplicate structure definitions from bnxt_re_hsi.h as it is available in the corresponding bnxt_en header file (bnxt_hsi.h)
* Removed some unused code reported during code review.
* Fixed few sparse warnings
Selvin Xavier (21):
RDMA/bnxt_re: Add bnxt_re RoCE driver files
RDMA/bnxt_re: Introducing autogenerated Host Software Interface(hsi)
file
RDMA/bnxt_re: register with the NIC driver
RDMA/bnxt_re: Enabling RoCE control path
RDMA/bnxt_re: Adding Notification Queue support RDMA/bnxt_re: Support for PD, ucontext and mmap verbs RDMA/bnxt_re: Support for query and modify device verbs RDMA/bnxt_re: Adding support for port related verbs RDMA/bnxt_re: Support for GID related verbs
RDMA/bnxt_re: Support for CQ verbs
RDMA/bnxt_re: Support for AH verbs
RDMA/bnxt_re: Support memory registration verbs RDMA/bnxt_re: Support QP verbs
RDMA/bnxt_re: Support post_send verb
RDMA/bnxt_re: Support post_recv
RDMA/bnxt_re: Support poll_cq verb
RDMA/bnxt_re: Handling dispatching of events to IB stack RDMA/bnxt_re: Support for DCB
RDMA/bnxt_re: Set uverbs command mask
RDMA/bnxt_re: Add QP event handling
RDMA/bnxt_re: Add bnxt_re driver build support
MAINTAINERS | 11 + drivers/infiniband/Kconfig | 2 + drivers/infiniband/hw/Makefile | 1 + drivers/infiniband/hw/bnxt_re/Kconfig | 9 + drivers/infiniband/hw/bnxt_re/Makefile | 6 + drivers/infiniband/hw/bnxt_re/bnxt_re.h | 146 ++ drivers/infiniband/hw/bnxt_re/ib_verbs.c | 3202 ++++++++++++++++++++++++++++ drivers/infiniband/hw/bnxt_re/ib_verbs.h | 197 ++ drivers/infiniband/hw/bnxt_re/main.c | 1315 ++++++++++++ drivers/infiniband/hw/bnxt_re/qplib_fp.c | 2167 +++++++++++++++++++ drivers/infiniband/hw/bnxt_re/qplib_fp.h | 439 ++++ drivers/infiniband/hw/bnxt_re/qplib_rcfw.c | 694 ++++++ drivers/infiniband/hw/bnxt_re/qplib_rcfw.h | 231 ++ drivers/infiniband/hw/bnxt_re/qplib_res.c | 825 +++++++ drivers/infiniband/hw/bnxt_re/qplib_res.h | 223 ++ drivers/infiniband/hw/bnxt_re/qplib_sp.c | 838 ++++++++ drivers/infiniband/hw/bnxt_re/qplib_sp.h | 160 ++ drivers/infiniband/hw/bnxt_re/roce_hsi.h | 2821 ++++++++++++++++++++++++ include/uapi/rdma/bnxt_re-abi.h | 89 + 19 files changed, 13376 insertions(+) create mode 100644 drivers/infiniband/hw/bnxt_re/Kconfig create mode 100644 drivers/infiniband/hw/bnxt_re/Makefile create mode 100644 drivers/infiniband/hw/bnxt_re/bnxt_re.h create mode 100644 drivers/infiniband/hw/bnxt_re/ib_verbs.c create mode 100644 drivers/infiniband/hw/bnxt_re/ib_verbs.h create mode 100644 drivers/infiniband/hw/bnxt_re/main.c create mode 100644 drivers/infiniband/hw/bnxt_re/qplib_fp.c create mode 100644 drivers/infiniband/hw/bnxt_re/qplib_fp.h create mode 100644 drivers/infiniband/hw/bnxt_re/qplib_rcfw.c create mode 100644 drivers/infiniband/hw/bnxt_re/qplib_rcfw.h create mode 100644 drivers/infiniband/hw/bnxt_re/qplib_res.c create mode 100644 drivers/infiniband/hw/bnxt_re/qplib_res.h create mode 100644 drivers/infiniband/hw/bnxt_re/qplib_sp.c create mode 100644 drivers/infiniband/hw/bnxt_re/qplib_sp.h create mode 100644 drivers/infiniband/hw/bnxt_re/roce_hsi.h create mode 100644 include/uapi/rdma/bnxt_re-abi.h
Signature · 1 line
2.5.5
Selvin Xavier
maintainerPATCH v5 1/21 RDMA/bnxt_re: Add bnxt_re RoCE driver files
This patch adds the required skeletal files for Broadcom NetXtreme-E RoCE driver. Also, added the load/unload routines for bnxt_re driver.
v2: Modified the license text to include Dual License
v4: Modifies the directory and file names as per the review comment
v5: Changes the year in copyright text
--- drivers/infiniband/hw/bnxt_re/bnxt_re.h | 46 ++++++++++++ drivers/infiniband/hw/bnxt_re/ib_verbs.c | 37 +++++++++ drivers/infiniband/hw/bnxt_re/ib_verbs.h | 42 +++++++++++ drivers/infiniband/hw/bnxt_re/main.c | 116 +++++++++++++++++++++++++++++ drivers/infiniband/hw/bnxt_re/qplib_fp.c | 37 +++++++++ drivers/infiniband/hw/bnxt_re/qplib_fp.h | 42 +++++++++++ drivers/infiniband/hw/bnxt_re/qplib_rcfw.c | 37 +++++++++ drivers/infiniband/hw/bnxt_re/qplib_rcfw.h | 42 +++++++++++ drivers/infiniband/hw/bnxt_re/qplib_res.c | 37 +++++++++ drivers/infiniband/hw/bnxt_re/qplib_res.h | 42 +++++++++++ drivers/infiniband/hw/bnxt_re/qplib_sp.c | 37 +++++++++ drivers/infiniband/hw/bnxt_re/qplib_sp.h | 43 +++++++++++ drivers/infiniband/hw/bnxt_re/roce_hsi.h | 42 +++++++++++ 13 files changed, 600 insertions(+) create mode 100644 drivers/infiniband/hw/bnxt_re/bnxt_re.h create mode 100644 drivers/infiniband/hw/bnxt_re/ib_verbs.c create mode 100644 drivers/infiniband/hw/bnxt_re/ib_verbs.h create mode 100644 drivers/infiniband/hw/bnxt_re/main.c create mode 100644 drivers/infiniband/hw/bnxt_re/qplib_fp.c create mode 100644 drivers/infiniband/hw/bnxt_re/qplib_fp.h create mode 100644 drivers/infiniband/hw/bnxt_re/qplib_rcfw.c create mode 100644 drivers/infiniband/hw/bnxt_re/qplib_rcfw.h create mode 100644 drivers/infiniband/hw/bnxt_re/qplib_res.c create mode 100644 drivers/infiniband/hw/bnxt_re/qplib_res.h create mode 100644 drivers/infiniband/hw/bnxt_re/qplib_sp.c create mode 100644 drivers/infiniband/hw/bnxt_re/qplib_sp.h create mode 100644 drivers/infiniband/hw/bnxt_re/roce_hsi.h
drivers/infiniband/hw/bnxt_re/bnxt_re.h new file +46 -0
@@ -0,0 +1,46 @@ +/* +* Broadcom NetXtreme-E RoCE driver. +* +* Copyright (c) 2016 - 2017, Broadcom. All rights reserved. The term +* Broadcom refers to Broadcom Limited and/or its subsidiaries. +* +* This software is available to you under a choice of one of two +* licenses. You may choose to be licensed under the terms of the GNU +* General Public License (GPL) Version 2, available from the file +* COPYING in the main directory of this source tree, or the +* BSD license below: +* +* Redistribution and use in source and binary forms, with or without +* modification, are permitted provided that the following conditions +* are met: +* +* 1. Redistributions of source code must retain the above copyright +* notice, this list of conditions and the following disclaimer. +* 2. Redistributions in binary form must reproduce the above copyright +* notice, this list of conditions and the following disclaimer in +* the documentation and/or other materials provided with the +* distribution. +* +* THIS SOFTWARE IS PROVIDED BY THE AUTHOR AND CONTRIBUTORS ``AS IS'' +* AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, +* THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR +* PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE AUTHOR OR CONTRIBUTORS +* BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR +* CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF +* SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR +* BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, +* WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE +* OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN +* IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE. +* +* Description: Slow Path Operators (header) +* +*/ + +#ifndef __BNXT_RE_H__ +#define __BNXT_RE_H__ +#define ROCE_DRV_MODULE_NAME "bnxt_re" +#define ROCE_DRV_MODULE_VERSION "1.0.0" + +#define BNXT_RE_DESC "Broadcom NetXtreme-C/E RoCE Driver" +#endif
drivers/infiniband/hw/bnxt_re/ib_verbs.c new file +37 -0
@@ -0,0 +1,37 @@ +/* +* Broadcom NetXtreme-E RoCE driver. +* +* Copyright (c) 2016 - 2017, Broadcom. All rights reserved. The term +* Broadcom refers to Broadcom Limited and/or its subsidiaries. +* +* This software is available to you under a choice of one of two +* licenses. You may choose to be licensed under the terms of the GNU +* General Public License (GPL) Version 2, available from the file +* COPYING in the main directory of this source tree, or the +* BSD license below: +* +* Redistribution and use in source and binary forms, with or without +* modification, are permitted provided that the following conditions +* are met: +* +* 1. Redistributions of source code must retain the above copyright +* notice, this list of conditions and the following disclaimer. +* 2. Redistributions in binary form must reproduce the above copyright +* notice, this list of conditions and the following disclaimer in +* the documentation and/or other materials provided with the +* distribution. +* +* THIS SOFTWARE IS PROVIDED BY THE AUTHOR AND CONTRIBUTORS ``AS IS'' +* AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, +* THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR +* PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE AUTHOR OR CONTRIBUTORS +* BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR +* CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF +* SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR +* BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, +* WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE +* OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN +* IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE. +* +* Description: IB Verbs interpreter +*/
drivers/infiniband/hw/bnxt_re/ib_verbs.h new file +42 -0
42 lines not on this page · raw message
drivers/infiniband/hw/bnxt_re/main.c new file +116 -0
116 lines not on this page · raw message
drivers/infiniband/hw/bnxt_re/qplib_fp.c new file +37 -0
@@ -0,0 +1,37 @@ +/* +* Broadcom NetXtreme-E RoCE driver. +* +* Copyright (c) 2016 - 2017, Broadcom. All rights reserved. The term +* Broadcom refers to Broadcom Limited and/or its subsidiaries. +* +* This software is available to you under a choice of one of two +* licenses. You may choose to be licensed under the terms of the GNU +* General Public License (GPL) Version 2, available from the file +* COPYING in the main directory of this source tree, or the +* BSD license below: +* +* Redistribution and use in source and binary forms, with or without +* modification, are permitted provided that the following conditions +* are met: +* +* 1. Redistributions of source code must retain the above copyright +* notice, this list of conditions and the following disclaimer. +* 2. Redistributions in binary form must reproduce the above copyright +* notice, this list of conditions and the following disclaimer in +* the documentation and/or other materials provided with the +* distribution. +* +* THIS SOFTWARE IS PROVIDED BY THE AUTHOR AND CONTRIBUTORS ``AS IS'' +* AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, +* THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR +* PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE AUTHOR OR CONTRIBUTORS +* BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR +* CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF +* SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR +* BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, +* WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE +* OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN +* IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE. +* +* Description: Fast Path Operators +*/
drivers/infiniband/hw/bnxt_re/qplib_fp.h new file +42 -0
42 lines not on this page · raw message
drivers/infiniband/hw/bnxt_re/qplib_rcfw.c new file +37 -0
@@ -0,0 +1,37 @@ +/* +* Broadcom NetXtreme-E RoCE driver. +* +* Copyright (c) 2016 - 2017, Broadcom. All rights reserved. The term +* Broadcom refers to Broadcom Limited and/or its subsidiaries. +* +* This software is available to you under a choice of one of two +* licenses. You may choose to be licensed under the terms of the GNU +* General Public License (GPL) Version 2, available from the file +* COPYING in the main directory of this source tree, or the +* BSD license below: +* +* Redistribution and use in source and binary forms, with or without +* modification, are permitted provided that the following conditions +* are met: +* +* 1. Redistributions of source code must retain the above copyright +* notice, this list of conditions and the following disclaimer. +* 2. Redistributions in binary form must reproduce the above copyright +* notice, this list of conditions and the following disclaimer in +* the documentation and/or other materials provided with the +* distribution. +* +* THIS SOFTWARE IS PROVIDED BY THE AUTHOR AND CONTRIBUTORS ``AS IS'' +* AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, +* THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR +* PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE AUTHOR OR CONTRIBUTORS +* BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR +* CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF +* SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR +* BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, +* WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE +* OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN +* IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE. +* +* Description: RDMA Controller HW interface +*/
drivers/infiniband/hw/bnxt_re/qplib_rcfw.h new file +42 -0
42 lines not on this page · raw message
drivers/infiniband/hw/bnxt_re/qplib_res.c new file +37 -0
@@ -0,0 +1,37 @@ +/* +* Broadcom NetXtreme-E RoCE driver. +* +* Copyright (c) 2016 - 2017, Broadcom. All rights reserved. The term +* Broadcom refers to Broadcom Limited and/or its subsidiaries. +* +* This software is available to you under a choice of one of two +* licenses. You may choose to be licensed under the terms of the GNU +* General Public License (GPL) Version 2, available from the file +* COPYING in the main directory of this source tree, or the +* BSD license below: +* +* Redistribution and use in source and binary forms, with or without +* modification, are permitted provided that the following conditions +* are met: +* +* 1. Redistributions of source code must retain the above copyright +* notice, this list of conditions and the following disclaimer. +* 2. Redistributions in binary form must reproduce the above copyright +* notice, this list of conditions and the following disclaimer in +* the documentation and/or other materials provided with the +* distribution. +* +* THIS SOFTWARE IS PROVIDED BY THE AUTHOR AND CONTRIBUTORS ``AS IS'' +* AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, +* THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR +* PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE AUTHOR OR CONTRIBUTORS +* BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR +* CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF +* SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR +* BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, +* WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE +* OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN +* IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE. +* +* Description: QPLib resource manager +*/
drivers/infiniband/hw/bnxt_re/qplib_res.h new file +42 -0
42 lines not on this page · raw message
drivers/infiniband/hw/bnxt_re/qplib_sp.c new file +37 -0
@@ -0,0 +1,37 @@ +/* +* Broadcom NetXtreme-E RoCE driver. +* +* Copyright (c) 2016 - 2017, Broadcom. All rights reserved. The term +* Broadcom refers to Broadcom Limited and/or its subsidiaries. +* +* This software is available to you under a choice of one of two +* licenses. You may choose to be licensed under the terms of the GNU +* General Public License (GPL) Version 2, available from the file +* COPYING in the main directory of this source tree, or the +* BSD license below: +* +* Redistribution and use in source and binary forms, with or without +* modification, are permitted provided that the following conditions +* are met: +* +* 1. Redistributions of source code must retain the above copyright +* notice, this list of conditions and the following disclaimer. +* 2. Redistributions in binary form must reproduce the above copyright +* notice, this list of conditions and the following disclaimer in +* the documentation and/or other materials provided with the +* distribution. +* +* THIS SOFTWARE IS PROVIDED BY THE AUTHOR AND CONTRIBUTORS ``AS IS'' +* AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, +* THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR +* PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE AUTHOR OR CONTRIBUTORS +* BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR +* CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF +* SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR +* BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, +* WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE +* OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN +* IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE. +* +* Description: Slow Path Operators +*/
drivers/infiniband/hw/bnxt_re/qplib_sp.h new file +43 -0
43 lines not on this page · raw message
drivers/infiniband/hw/bnxt_re/roce_hsi.h new file +42 -0
42 lines not on this page · raw message
Signature · 1 line
2.5.5
A message that is not in the archive (sent off-list or not yet received): 1486725593-9872-1-git-send-email-selvin.xavier-dY08KVG/lbpWk0Htik3J/[email protected]
PATCH v5 2/21 RDMA/bnxt_re: Introducing autogenerated Host Software Interface(hsi) file
This patch introduces all the structures used by the driver for communicating with the Hardware. This file is the equivalent of the bnxt_hsi.h used by bnxt_en driver.
v2: Remove duplicate structure definitions from bnxt_en HSI file and
include bnxt_hsi.h from bnxt_en driver
v3: Remove the checkpatch warnings for coloumns more than 80 characters
--- drivers/infiniband/hw/bnxt_re/roce_hsi.h | 2779 ++++++++++++++++++++++++++++++ 1 file changed, 2779 insertions(+)
drivers/infiniband/hw/bnxt_re/roce_hsi.h +2779 -0
@@ -39,4 +39,2783 @@#ifndef __BNXT_RE_HSI_H__#define __BNXT_RE_HSI_H__ +/* include bnxt_hsi.h from bnxt_en driver */ +#include "bnxt_hsi.h" + +/* CMP Door Bell Format (4 bytes) */ +struct cmpl_doorbell { +__le32 key_mask_valid_idx; +#define CMPL_DOORBELL_IDX_MASK 0xffffffUL +#define CMPL_DOORBELL_IDX_SFT 0 +#define CMPL_DOORBELL_RESERVED_MASK 0x3000000UL +#define CMPL_DOORBELL_RESERVED_SFT 24 +#define CMPL_DOORBELL_IDX_VALID 0x4000000UL +#define CMPL_DOORBELL_MASK 0x8000000UL +#define CMPL_DOORBELL_KEY_MASK 0xf0000000UL +#define CMPL_DOORBELL_KEY_SFT 28 +#define CMPL_DOORBELL_KEY_CMPL (0x2UL << 28) +}; + +/* Status Door Bell Format (4 bytes) */ +struct status_doorbell { +__le32 key_idx; +#define STATUS_DOORBELL_IDX_MASK 0xffffffUL +#define STATUS_DOORBELL_IDX_SFT 0 +#define STATUS_DOORBELL_RESERVED_MASK 0xf000000UL +#define STATUS_DOORBELL_RESERVED_SFT 24 +#define STATUS_DOORBELL_KEY_MASK 0xf0000000UL +#define STATUS_DOORBELL_KEY_SFT 28 +#define STATUS_DOORBELL_KEY_STAT (0x3UL << 28) +}; + +/* RoCE Host Structures */ + +/* Doorbell Structures */ +/* 64b Doorbell Format (8 bytes) */ +struct dbr_dbr { +__le32 index; +#define DBR_DBR_INDEX_MASK 0xfffffUL +#define DBR_DBR_INDEX_SFT 0 +#define DBR_DBR_RESERVED12_MASK 0xfff00000UL +#define DBR_DBR_RESERVED12_SFT 20 +__le32 type_xid; +#define DBR_DBR_XID_MASK 0xfffffUL +#define DBR_DBR_XID_SFT 0 +#define DBR_DBR_RESERVED8_MASK 0xff00000UL +#define DBR_DBR_RESERVED8_SFT 20 +#define DBR_DBR_TYPE_MASK 0xf0000000UL +#define DBR_DBR_TYPE_SFT 28 +#define DBR_DBR_TYPE_SQ (0x0UL << 28) +#define DBR_DBR_TYPE_RQ (0x1UL << 28) +#define DBR_DBR_TYPE_SRQ (0x2UL << 28) +#define DBR_DBR_TYPE_SRQ_ARM (0x3UL << 28) +#define DBR_DBR_TYPE_CQ (0x4UL << 28) +#define DBR_DBR_TYPE_CQ_ARMSE (0x5UL << 28) +#define DBR_DBR_TYPE_CQ_ARMALL (0x6UL << 28) +#define DBR_DBR_TYPE_CQ_ARMENA (0x7UL << 28) +#define DBR_DBR_TYPE_SRQ_ARMENA (0x8UL << 28) +#define DBR_DBR_TYPE_CQ_CUTOFF_ACK (0x9UL << 28) +#define DBR_DBR_TYPE_NULL (0xfUL << 28) +}; + +/* 32b Doorbell Format (4 bytes) */ +struct dbr_dbr32 { +__le32 type_abs_incr_xid; +#define DBR_DBR32_XID_MASK 0xfffffUL +#define DBR_DBR32_XID_SFT 0 +#define DBR_DBR32_RESERVED4_MASK 0xf00000UL +#define DBR_DBR32_RESERVED4_SFT 20 +#define DBR_DBR32_INCR_MASK 0xf000000UL +#define DBR_DBR32_INCR_SFT 24 +#define DBR_DBR32_ABS 0x10000000UL +#define DBR_DBR32_TYPE_MASK 0xe0000000UL +#define DBR_DBR32_TYPE_SFT 29 +#define DBR_DBR32_TYPE_SQ (0x0UL << 29) +}; + +/* SQ WQE Structures */ +/* Base SQ WQE (8 bytes) */ +struct sq_base { +u8 wqe_type; +#define SQ_BASE_WQE_TYPE_SEND 0x0UL +#define SQ_BASE_WQE_TYPE_SEND_W_IMMEAD 0x1UL +#define SQ_BASE_WQE_TYPE_SEND_W_INVALID 0x2UL +#define SQ_BASE_WQE_TYPE_WRITE_WQE 0x4UL +#define SQ_BASE_WQE_TYPE_WRITE_W_IMMEAD 0x5UL +#define SQ_BASE_WQE_TYPE_READ_WQE 0x6UL +#define SQ_BASE_WQE_TYPE_ATOMIC_CS 0x8UL +#define SQ_BASE_WQE_TYPE_ATOMIC_FA 0xbUL +#define SQ_BASE_WQE_TYPE_LOCAL_INVALID 0xcUL +#define SQ_BASE_WQE_TYPE_FR_PMR 0xdUL +#define SQ_BASE_WQE_TYPE_BIND 0xeUL +u8 unused_0[7 ]; +}; + +/* WQE SGE (16 bytes) */ +struct sq_sge { +__le64 va_or_pa; +__le32 l_key; +__le32 size; +}; + +/* PSN Search Structure (8 bytes) */ +struct sq_psn_search { +__le32 opcode_start_psn; +#define SQ_PSN_SEARCH_START_PSN_MASK 0xffffffUL +#define SQ_PSN_SEARCH_START_PSN_SFT 0 +#define SQ_PSN_SEARCH_OPCODE_MASK 0xff000000UL +#define SQ_PSN_SEARCH_OPCODE_SFT 24 +__le32 flags_next_psn; +#define SQ_PSN_SEARCH_NEXT_PSN_MASK 0xffffffUL +#define SQ_PSN_SEARCH_NEXT_PSN_SFT 0 +#define SQ_PSN_SEARCH_FLAGS_MASK 0xff000000UL +#define SQ_PSN_SEARCH_FLAGS_SFT 24 +}; + +/* Send SQ WQE (40 bytes) */ +struct sq_send { +u8 wqe_type; +#define SQ_SEND_WQE_TYPE_SEND 0x0UL +#define SQ_SEND_WQE_TYPE_SEND_W_IMMEAD 0x1UL +#define SQ_SEND_WQE_TYPE_SEND_W_INVALID 0x2UL +u8 flags; +#define SQ_SEND_FLAGS_SIGNAL_COMP 0x1UL +#define SQ_SEND_FLAGS_RD_OR_ATOMIC_FENCE 0x2UL +#define SQ_SEND_FLAGS_UC_FENCE 0x4UL +#define SQ_SEND_FLAGS_SE 0x8UL +#define SQ_SEND_FLAGS_INLINE 0x10UL +u8 wqe_size; +u8 reserved8_1; +__le32 inv_key_or_imm_data; +__le32 length; +__le32 q_key; +__le32 dst_qp; +#define SQ_SEND_DST_QP_MASK 0xffffffUL +#define SQ_SEND_DST_QP_SFT 0 +#define SQ_SEND_RESERVED8_2_MASK 0xff000000UL +#define SQ_SEND_RESERVED8_2_SFT 24 +__le32 avid; +#define SQ_SEND_AVID_MASK 0xfffffUL +#define SQ_SEND_AVID_SFT 0 +#define SQ_SEND_RESERVED_AVID_MASK 0xfff00000UL +#define SQ_SEND_RESERVED_AVID_SFT 20 +__le64 reserved64; +__le32 data[24 ]; +}; + +/* Send Raw Ethernet and QP1 SQ WQE (40 bytes) */ +struct sq_send_raweth_qp1 { +u8 wqe_type; +#define SQ_SEND_RAWETH_QP1_WQE_TYPE_SEND 0x0UL +u8 flags; +#define SQ_SEND_RAWETH_QP1_FLAGS_SIGNAL_COMP 0x1UL +#define SQ_SEND_RAWETH_QP1_FLAGS_RD_OR_ATOMIC_FENCE 0x2UL +#define SQ_SEND_RAWETH_QP1_FLAGS_UC_FENCE 0x4UL +#define SQ_SEND_RAWETH_QP1_FLAGS_SE 0x8UL +#define SQ_SEND_RAWETH_QP1_FLAGS_INLINE 0x10UL +u8 wqe_size; +u8 reserved8; +__le16 lflags; +#define SQ_SEND_RAWETH_QP1_LFLAGS_TCP_UDP_CHKSUM 0x1UL +#define SQ_SEND_RAWETH_QP1_LFLAGS_IP_CHKSUM 0x2UL +#define SQ_SEND_RAWETH_QP1_LFLAGS_NOCRC 0x4UL +#define SQ_SEND_RAWETH_QP1_LFLAGS_STAMP 0x8UL +#define SQ_SEND_RAWETH_QP1_LFLAGS_T_IP_CHKSUM 0x10UL +#define SQ_SEND_RAWETH_QP1_LFLAGS_RESERVED1_1 0x20UL +#define SQ_SEND_RAWETH_QP1_LFLAGS_RESERVED1_2 0x40UL +#define SQ_SEND_RAWETH_QP1_LFLAGS_RESERVED1_3 0x80UL +#define SQ_SEND_RAWETH_QP1_LFLAGS_ROCE_CRC 0x100UL +#define SQ_SEND_RAWETH_QP1_LFLAGS_FCOE_CRC 0x200UL +__le16 cfa_action; +__le32 length; +__le32 reserved32_1; +__le32 cfa_meta; +#define SQ_SEND_RAWETH_QP1_CFA_META_VLAN_VID_MASK 0xfffUL +#define SQ_SEND_RAWETH_QP1_CFA_META_VLAN_VID_SFT 0 +#define SQ_SEND_RAWETH_QP1_CFA_META_VLAN_DE 0x1000UL +#define SQ_SEND_RAWETH_QP1_CFA_META_VLAN_PRI_MASK 0xe000UL +#define SQ_SEND_RAWETH_QP1_CFA_META_VLAN_PRI_SFT 13 +#define SQ_SEND_RAWETH_QP1_CFA_META_VLAN_TPID_MASK 0x70000UL +#define SQ_SEND_RAWETH_QP1_CFA_META_VLAN_TPID_SFT 16 +#define SQ_SEND_RAWETH_QP1_CFA_META_VLAN_TPID_TPID88A8 (0x0UL << 16) +#define SQ_SEND_RAWETH_QP1_CFA_META_VLAN_TPID_TPID8100 (0x1UL << 16) +#define SQ_SEND_RAWETH_QP1_CFA_META_VLAN_TPID_TPID9100 (0x2UL << 16) +#define SQ_SEND_RAWETH_QP1_CFA_META_VLAN_TPID_TPID9200 (0x3UL << 16) +#define SQ_SEND_RAWETH_QP1_CFA_META_VLAN_TPID_TPID9300 (0x4UL << 16) +#define SQ_SEND_RAWETH_QP1_CFA_META_VLAN_TPID_TPIDCFG (0x5UL << 16) +#define SQ_SEND_RAWETH_QP1_CFA_META_VLAN_TPID_LAST \ + SQ_SEND_RAWETH_QP1_CFA_META_VLAN_TPID_TPIDCFG +#define SQ_SEND_RAWETH_QP1_CFA_META_VLAN_RESERVED_MASK 0xff80000UL +#define SQ_SEND_RAWETH_QP1_CFA_META_VLAN_RESERVED_SFT 19 +#define SQ_SEND_RAWETH_QP1_CFA_META_KEY_MASK 0xf0000000UL +#define SQ_SEND_RAWETH_QP1_CFA_META_KEY_SFT 28 +#define SQ_SEND_RAWETH_QP1_CFA_META_KEY_NONE (0x0UL << 28) +#define SQ_SEND_RAWETH_QP1_CFA_META_KEY_VLAN_TAG (0x1UL << 28) +#define SQ_SEND_RAWETH_QP1_CFA_META_KEY_LAST \ + SQ_SEND_RAWETH_QP1_CFA_META_KEY_VLAN_TAG +__le32 reserved32_2; +__le64 reserved64; +__le32 data[24 ]; +}; + +/* RDMA SQ WQE (40 bytes) */ +struct sq_rdma { +u8 wqe_type; +#define SQ_RDMA_WQE_TYPE_WRITE_WQE 0x4UL +#define SQ_RDMA_WQE_TYPE_WRITE_W_IMMEAD 0x5UL +#define SQ_RDMA_WQE_TYPE_READ_WQE 0x6UL +u8 flags; +#define SQ_RDMA_FLAGS_SIGNAL_COMP 0x1UL +#define SQ_RDMA_FLAGS_RD_OR_ATOMIC_FENCE 0x2UL +#define SQ_RDMA_FLAGS_UC_FENCE 0x4UL +#define SQ_RDMA_FLAGS_SE 0x8UL +#define SQ_RDMA_FLAGS_INLINE 0x10UL +u8 wqe_size; +u8 reserved8; +__le32 imm_data; +__le32 length; +__le32 reserved32_1; +__le64 remote_va; +__le32 remote_key; +__le32 reserved32_2; +__le32 data[24 ]; +}; + +/* Atomic SQ WQE (40 bytes) */ +struct sq_atomic { +u8 wqe_type; +#define SQ_ATOMIC_WQE_TYPE_ATOMIC_CS 0x8UL +#define SQ_ATOMIC_WQE_TYPE_ATOMIC_FA 0xbUL +u8 flags; +#define SQ_ATOMIC_FLAGS_SIGNAL_COMP 0x1UL +#define SQ_ATOMIC_FLAGS_RD_OR_ATOMIC_FENCE 0x2UL +#define SQ_ATOMIC_FLAGS_UC_FENCE 0x4UL +#define SQ_ATOMIC_FLAGS_SE 0x8UL +#define SQ_ATOMIC_FLAGS_INLINE 0x10UL +__le16 reserved16; +__le32 remote_key; +__le64 remote_va; +__le64 swap_data; +__le64 cmp_data; +__le32 data[24 ]; +}; + +/* Local Invalidate SQ WQE (40 bytes) */ +struct sq_localinvalidate { +u8 wqe_type; +#define SQ_LOCALINVALIDATE_WQE_TYPE_LOCAL_INVALID 0xcUL +u8 flags; +#define SQ_LOCALINVALIDATE_FLAGS_SIGNAL_COMP 0x1UL +#define SQ_LOCALINVALIDATE_FLAGS_RD_OR_ATOMIC_FENCE 0x2UL +#define SQ_LOCALINVALIDATE_FLAGS_UC_FENCE 0x4UL +#define SQ_LOCALINVALIDATE_FLAGS_SE 0x8UL +#define SQ_LOCALINVALIDATE_FLAGS_INLINE 0x10UL +__le16 reserved16; +__le32 inv_l_key; +__le64 reserved64; +__le32 reserved128[4 ]; +__le32 data[24 ]; +}; + +/* FR-PMR SQ WQE (40 bytes) */ +struct sq_fr_pmr { +u8 wqe_type; +#define SQ_FR_PMR_WQE_TYPE_FR_PMR 0xdUL +u8 flags; +#define SQ_FR_PMR_FLAGS_SIGNAL_COMP 0x1UL +#define SQ_FR_PMR_FLAGS_RD_OR_ATOMIC_FENCE 0x2UL +#define SQ_FR_PMR_FLAGS_UC_FENCE 0x4UL +#define SQ_FR_PMR_FLAGS_SE 0x8UL +#define SQ_FR_PMR_FLAGS_INLINE 0x10UL +u8 access_cntl; +#define SQ_FR_PMR_ACCESS_CNTL_LOCAL_WRITE 0x1UL +#define SQ_FR_PMR_ACCESS_CNTL_REMOTE_READ 0x2UL +#define SQ_FR_PMR_ACCESS_CNTL_REMOTE_WRITE 0x4UL +#define SQ_FR_PMR_ACCESS_CNTL_REMOTE_ATOMIC 0x8UL +#define SQ_FR_PMR_ACCESS_CNTL_WINDOW_BIND 0x10UL +u8 zero_based_page_size_log; +#define SQ_FR_PMR_PAGE_SIZE_LOG_MASK 0x1fUL +#define SQ_FR_PMR_PAGE_SIZE_LOG_SFT 0 +#define SQ_FR_PMR_PAGE_SIZE_LOG_PGSZ_4K 0x0UL +#define SQ_FR_PMR_PAGE_SIZE_LOG_PGSZ_8K 0x1UL +#define SQ_FR_PMR_PAGE_SIZE_LOG_PGSZ_64K 0x4UL +#define SQ_FR_PMR_PAGE_SIZE_LOG_PGSZ_256K 0x6UL +#define SQ_FR_PMR_PAGE_SIZE_LOG_PGSZ_1M 0x8UL +#define SQ_FR_PMR_PAGE_SIZE_LOG_PGSZ_2M 0x9UL +#define SQ_FR_PMR_PAGE_SIZE_LOG_PGSZ_4M 0xaUL +#define SQ_FR_PMR_PAGE_SIZE_LOG_PGSZ_1G 0x12UL +#define SQ_FR_PMR_ZERO_BASED 0x20UL +#define SQ_FR_PMR_RESERVED2_MASK 0xc0UL +#define SQ_FR_PMR_RESERVED2_SFT 6 +__le32 l_key; +u8 length[5 ]; +u8 reserved8_1; +u8 reserved8_2; +u8 numlevels_pbl_page_size_log; +#define SQ_FR_PMR_PBL_PAGE_SIZE_LOG_MASK 0x1fUL +#define SQ_FR_PMR_PBL_PAGE_SIZE_LOG_SFT 0 +#define SQ_FR_PMR_PBL_PAGE_SIZE_LOG_PGSZ_4K 0x0UL +#define SQ_FR_PMR_PBL_PAGE_SIZE_LOG_PGSZ_8K 0x1UL +#define SQ_FR_PMR_PBL_PAGE_SIZE_LOG_PGSZ_64K 0x4UL +#define SQ_FR_PMR_PBL_PAGE_SIZE_LOG_PGSZ_256K 0x6UL +#define SQ_FR_PMR_PBL_PAGE_SIZE_LOG_PGSZ_1M 0x8UL +#define SQ_FR_PMR_PBL_PAGE_SIZE_LOG_PGSZ_2M 0x9UL +#define SQ_FR_PMR_PBL_PAGE_SIZE_LOG_PGSZ_4M 0xaUL +#define SQ_FR_PMR_PBL_PAGE_SIZE_LOG_PGSZ_1G 0x12UL +#define SQ_FR_PMR_RESERVED1 0x20UL +#define SQ_FR_PMR_NUMLEVELS_MASK 0xc0UL +#define SQ_FR_PMR_NUMLEVELS_SFT 6 +#define SQ_FR_PMR_NUMLEVELS_PHYSICAL (0x0UL << 6) +#define SQ_FR_PMR_NUMLEVELS_LAYER1 (0x1UL << 6) +#define SQ_FR_PMR_NUMLEVELS_LAYER2 (0x2UL << 6) +__le64 pblptr; +__le64 va; +__le32 data[24 ]; +}; + +/* Bind SQ WQE (40 bytes) */ +struct sq_bind { +u8 wqe_type; +#define SQ_BIND_WQE_TYPE_BIND 0xeUL +u8 flags; +#define SQ_BIND_FLAGS_SIGNAL_COMP 0x1UL +#define SQ_BIND_FLAGS_RD_OR_ATOMIC_FENCE 0x2UL +#define SQ_BIND_FLAGS_UC_FENCE 0x4UL +#define SQ_BIND_FLAGS_SE 0x8UL +#define SQ_BIND_FLAGS_INLINE 0x10UL +u8 access_cntl; +#define SQ_BIND_ACCESS_CNTL_LOCAL_WRITE 0x1UL +#define SQ_BIND_ACCESS_CNTL_REMOTE_READ 0x2UL +#define SQ_BIND_ACCESS_CNTL_REMOTE_WRITE 0x4UL +#define SQ_BIND_ACCESS_CNTL_REMOTE_ATOMIC 0x8UL +#define SQ_BIND_ACCESS_CNTL_WINDOW_BIND 0x10UL +u8 reserved8_1; +u8 mw_type_zero_based; +#define SQ_BIND_ZERO_BASED 0x1UL +#define SQ_BIND_MW_TYPE 0x2UL +#define SQ_BIND_MW_TYPE_TYPE1 (0x0UL << 1) +#define SQ_BIND_MW_TYPE_TYPE2 (0x1UL << 1) +#define SQ_BIND_RESERVED6_MASK 0xfcUL +#define SQ_BIND_RESERVED6_SFT 2 +u8 reserved8_2; +__le16 reserved16; +__le32 parent_l_key; +__le32 l_key; +__le64 va; +u8 length[5 ]; +u8 data_reserved24[99 ]; +#define SQ_BIND_RESERVED24_MASK 0xffffff00UL +#define SQ_BIND_RESERVED24_SFT 8 +#define SQ_BIND_DATA_MASK 0xffffffffUL +#define SQ_BIND_DATA_SFT 0 +}; + +/* RQ/SRQ WQE Structures */ +/* RQ/SRQ WQE (40 bytes) */ +struct rq_wqe { +u8 wqe_type; +#define RQ_WQE_WQE_TYPE_RCV 0x80UL +u8 flags; +u8 wqe_size; +u8 reserved8; +__le32 reserved32; +__le32 wr_id[2 ]; +#define RQ_WQE_WR_ID_MASK 0xfffffUL +#define RQ_WQE_WR_ID_SFT 0 +#define RQ_WQE_RESERVED44_MASK 0xfff00000UL +#define RQ_WQE_RESERVED44_SFT 20 +__le32 reserved128[4 ]; +__le32 data[24 ]; +}; + +/* CQ CQE Structures */ +/* Base CQE (32 bytes) */ +struct cq_base { +__le64 reserved64_1; +__le64 reserved64_2; +__le64 reserved64_3; +u8 cqe_type_toggle; +#define CQ_BASE_TOGGLE 0x1UL +#define CQ_BASE_CQE_TYPE_MASK 0x1eUL +#define CQ_BASE_CQE_TYPE_SFT 1 +#define CQ_BASE_CQE_TYPE_REQ (0x0UL << 1) +#define CQ_BASE_CQE_TYPE_RES_RC (0x1UL << 1) +#define CQ_BASE_CQE_TYPE_RES_UD (0x2UL << 1) +#define CQ_BASE_CQE_TYPE_RES_RAWETH_QP1 (0x3UL << 1) +#define CQ_BASE_CQE_TYPE_TERMINAL (0xeUL << 1) +#define CQ_BASE_CQE_TYPE_CUT_OFF (0xfUL << 1) +#define CQ_BASE_RESERVED3_MASK 0xe0UL +#define CQ_BASE_RESERVED3_SFT 5 +u8 status; +__le16 reserved16; +__le32 reserved32; +}; + +/* Requester CQ CQE (32 bytes) */ +struct cq_req { +__le64 qp_handle; +__le16 sq_cons_idx; +__le16 reserved16_1; +__le32 reserved32_2; +__le64 reserved64; +u8 cqe_type_toggle; +#define CQ_REQ_TOGGLE 0x1UL +#define CQ_REQ_CQE_TYPE_MASK 0x1eUL +#define CQ_REQ_CQE_TYPE_SFT 1 +#define CQ_REQ_CQE_TYPE_REQ (0x0UL << 1) +#define CQ_REQ_RESERVED3_MASK 0xe0UL +#define CQ_REQ_RESERVED3_SFT 5 +u8 status; +#define CQ_REQ_STATUS_OK 0x0UL +#define CQ_REQ_STATUS_BAD_RESPONSE_ERR 0x1UL +#define CQ_REQ_STATUS_LOCAL_LENGTH_ERR 0x2UL +#define CQ_REQ_STATUS_LOCAL_QP_OPERATION_ERR 0x3UL +#define CQ_REQ_STATUS_LOCAL_PROTECTION_ERR 0x4UL +#define CQ_REQ_STATUS_MEMORY_MGT_OPERATION_ERR 0x5UL +#define CQ_REQ_STATUS_REMOTE_INVALID_REQUEST_ERR 0x6UL +#define CQ_REQ_STATUS_REMOTE_ACCESS_ERR 0x7UL +#define CQ_REQ_STATUS_REMOTE_OPERATION_ERR 0x8UL +#define CQ_REQ_STATUS_RNR_NAK_RETRY_CNT_ERR 0x9UL +#define CQ_REQ_STATUS_TRANSPORT_RETRY_CNT_ERR 0xaUL +#define CQ_REQ_STATUS_WORK_REQUEST_FLUSHED_ERR 0xbUL +__le16 reserved16_2; +__le32 reserved32_1; +}; + +/* Responder RC CQE (32 bytes) */ +struct cq_res_rc { +__le32 length; +__le32 imm_data_or_inv_r_key; +__le64 qp_handle; +__le64 mr_handle; +u8 cqe_type_toggle; +#define CQ_RES_RC_TOGGLE 0x1UL +#define CQ_RES_RC_CQE_TYPE_MASK 0x1eUL +#define CQ_RES_RC_CQE_TYPE_SFT 1 +#define CQ_RES_RC_CQE_TYPE_RES_RC (0x1UL << 1) +#define CQ_RES_RC_RESERVED3_MASK 0xe0UL +#define CQ_RES_RC_RESERVED3_SFT 5 +u8 status; +#define CQ_RES_RC_STATUS_OK 0x0UL +#define CQ_RES_RC_STATUS_LOCAL_ACCESS_ERROR 0x1UL +#define CQ_RES_RC_STATUS_LOCAL_LENGTH_ERR 0x2UL +#define CQ_RES_RC_STATUS_LOCAL_PROTECTION_ERR 0x3UL +#define CQ_RES_RC_STATUS_LOCAL_QP_OPERATION_ERR 0x4UL +#define CQ_RES_RC_STATUS_MEMORY_MGT_OPERATION_ERR 0x5UL +#define CQ_RES_RC_STATUS_REMOTE_INVALID_REQUEST_ERR 0x6UL +#define CQ_RES_RC_STATUS_WORK_REQUEST_FLUSHED_ERR 0x7UL +#define CQ_RES_RC_STATUS_HW_FLUSH_ERR 0x8UL +__le16 flags; +#define CQ_RES_RC_FLAGS_SRQ 0x1UL +#define CQ_RES_RC_FLAGS_SRQ_RQ (0x0UL << 0) +#define CQ_RES_RC_FLAGS_SRQ_SRQ (0x1UL << 0) +#define CQ_RES_RC_FLAGS_SRQ_LAST CQ_RES_RC_FLAGS_SRQ_SRQ +#define CQ_RES_RC_FLAGS_IMM 0x2UL +#define CQ_RES_RC_FLAGS_INV 0x4UL +#define CQ_RES_RC_FLAGS_RDMA 0x8UL +#define CQ_RES_RC_FLAGS_RDMA_SEND (0x0UL << 3) +#define CQ_RES_RC_FLAGS_RDMA_RDMA_WRITE (0x1UL << 3) +#define CQ_RES_RC_FLAGS_RDMA_LAST CQ_RES_RC_FLAGS_RDMA_RDMA_WRITE +__le32 srq_or_rq_wr_id; +#define CQ_RES_RC_SRQ_OR_RQ_WR_ID_MASK 0xfffffUL +#define CQ_RES_RC_SRQ_OR_RQ_WR_ID_SFT 0 +#define CQ_RES_RC_RESERVED12_MASK 0xfff00000UL +#define CQ_RES_RC_RESERVED12_SFT 20 +}; + +/* Responder UD CQE (32 bytes) */ +struct cq_res_ud { +__le32 length; +#define CQ_RES_UD_LENGTH_MASK 0x3fffUL +#define CQ_RES_UD_LENGTH_SFT 0 +#define CQ_RES_UD_RESERVED18_MASK 0xffffc000UL +#define CQ_RES_UD_RESERVED18_SFT 14 +__le32 imm_data; +__le64 qp_handle; +__le16 src_mac[3 ]; +__le16 src_qp_low; +u8 cqe_type_toggle; +#define CQ_RES_UD_TOGGLE 0x1UL +#define CQ_RES_UD_CQE_TYPE_MASK 0x1eUL +#define CQ_RES_UD_CQE_TYPE_SFT 1 +#define CQ_RES_UD_CQE_TYPE_RES_UD (0x2UL << 1) +#define CQ_RES_UD_RESERVED3_MASK 0xe0UL +#define CQ_RES_UD_RESERVED3_SFT 5 +u8 status; +#define CQ_RES_UD_STATUS_OK 0x0UL +#define CQ_RES_UD_STATUS_LOCAL_ACCESS_ERROR 0x1UL +#define CQ_RES_UD_STATUS_HW_LOCAL_LENGTH_ERR 0x2UL +#define CQ_RES_UD_STATUS_LOCAL_PROTECTION_ERR 0x3UL +#define CQ_RES_UD_STATUS_LOCAL_QP_OPERATION_ERR 0x4UL +#define CQ_RES_UD_STATUS_MEMORY_MGT_OPERATION_ERR 0x5UL +#define CQ_RES_UD_STATUS_WORK_REQUEST_FLUSHED_ERR 0x7UL +#define CQ_RES_UD_STATUS_HW_FLUSH_ERR 0x8UL +__le16 flags; +#define CQ_RES_UD_FLAGS_SRQ 0x1UL +#define CQ_RES_UD_FLAGS_SRQ_RQ (0x0UL << 0) +#define CQ_RES_UD_FLAGS_SRQ_SRQ (0x1UL << 0) +#define CQ_RES_UD_FLAGS_SRQ_LAST CQ_RES_UD_FLAGS_SRQ_SRQ +#define CQ_RES_UD_FLAGS_IMM 0x2UL +#define CQ_RES_UD_FLAGS_ROCE_IP_VER_MASK 0xcUL +#define CQ_RES_UD_FLAGS_ROCE_IP_VER_SFT 2 +#define CQ_RES_UD_FLAGS_ROCE_IP_VER_V1 (0x0UL << 2) +#define CQ_RES_UD_FLAGS_ROCE_IP_VER_V2IPV4 (0x2UL << 2) +#define CQ_RES_UD_FLAGS_ROCE_IP_VER_V2IPV6 (0x3UL << 2) +#define CQ_RES_UD_FLAGS_ROCE_IP_VER_LAST \ + CQ_RES_UD_FLAGS_ROCE_IP_VER_V2IPV6 +__le32 src_qp_high_srq_or_rq_wr_id; +#define CQ_RES_UD_SRQ_OR_RQ_WR_ID_MASK 0xfffffUL +#define CQ_RES_UD_SRQ_OR_RQ_WR_ID_SFT 0 +#define CQ_RES_UD_RESERVED4_MASK 0xf00000UL +#define CQ_RES_UD_RESERVED4_SFT 20 +#define CQ_RES_UD_SRC_QP_HIGH_MASK 0xff000000UL +#define CQ_RES_UD_SRC_QP_HIGH_SFT 24 +}; + +/* Responder RawEth and QP1 CQE (32 bytes) */ +struct cq_res_raweth_qp1 { +__le16 length; +#define CQ_RES_RAWETH_QP1_LENGTH_MASK 0x3fffUL +#define CQ_RES_RAWETH_QP1_LENGTH_SFT 0 +#define CQ_RES_RAWETH_QP1_RESERVED2_MASK 0xc000UL +#define CQ_RES_RAWETH_QP1_RESERVED2_SFT 14 +__le16 raweth_qp1_flags; +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_FLAGS_ERROR 0x1UL +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_FLAGS_RESERVED5_1_MASK 0x3eUL +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_FLAGS_RESERVED5_1_SFT 1 +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_FLAGS_ITYPE_MASK 0x3c0UL +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_FLAGS_ITYPE_SFT 6 +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_FLAGS_ITYPE_NOT_KNOWN (0x0UL << 6) +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_FLAGS_ITYPE_IP (0x1UL << 6) +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_FLAGS_ITYPE_TCP (0x2UL << 6) +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_FLAGS_ITYPE_UDP (0x3UL << 6) +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_FLAGS_ITYPE_FCOE (0x4UL << 6) +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_FLAGS_ITYPE_ROCE (0x5UL << 6) +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_FLAGS_ITYPE_ICMP (0x7UL << 6) +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_FLAGS_ITYPE_PTP_WO_TIMESTAMP \ + (0x8UL << 6) +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_FLAGS_ITYPE_PTP_W_TIMESTAMP \ + (0x9UL << 6) +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_FLAGS_ITYPE_LAST \ + CQ_RES_RAWETH_QP1_RAWETH_QP1_FLAGS_ITYPE_PTP_W_TIMESTAMP +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_FLAGS_MASK 0x3ffUL +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_FLAGS_SFT 0 +#define CQ_RES_RAWETH_QP1_RESERVED6_MASK 0xfc00UL +#define CQ_RES_RAWETH_QP1_RESERVED6_SFT 10 +__le16 raweth_qp1_errors; +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_ERRORS_RESERVED4_MASK 0xfUL +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_ERRORS_RESERVED4_SFT 0 +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_ERRORS_IP_CS_ERROR 0x10UL +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_ERRORS_L4_CS_ERROR 0x20UL +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_ERRORS_T_IP_CS_ERROR 0x40UL +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_ERRORS_T_L4_CS_ERROR 0x80UL +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_ERRORS_CRC_ERROR 0x100UL +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_ERRORS_T_PKT_ERROR_MASK 0xe00UL +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_ERRORS_T_PKT_ERROR_SFT 9 +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_ERRORS_T_PKT_ERROR_NO_ERROR \ + (0x0UL << 9) +#define \ +CQ_RES_RAWETH_QP1_RAWETH_QP1_ERRORS_T_PKT_ERROR_T_L3_BAD_VERSION \ + (0x1UL << 9) +#define \ +CQ_RES_RAWETH_QP1_RAWETH_QP1_ERRORS_T_PKT_ERROR_T_L3_BAD_HDR_LEN \ + (0x2UL << 9) +#define \ +CQ_RES_RAWETH_QP1_RAWETH_QP1_ERRORS_T_PKT_ERROR_TUNNEL_TOTAL_ERROR \ + (0x3UL << 9) +#define \ +CQ_RES_RAWETH_QP1_RAWETH_QP1_ERRORS_T_PKT_ERROR_T_IP_TOTAL_ERROR \ + (0x4UL << 9) +#define \ +CQ_RES_RAWETH_QP1_RAWETH_QP1_ERRORS_T_PKT_ERROR_T_UDP_TOTAL_ERROR \ + (0x5UL << 9) +#define \ +CQ_RES_RAWETH_QP1_RAWETH_QP1_ERRORS_T_PKT_ERROR_T_L3_BAD_TTL \ + (0x6UL << 9) +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_ERRORS_T_PKT_ERROR_LAST \ + CQ_RES_RAWETH_QP1_RAWETH_QP1_ERRORS_T_PKT_ERROR_T_L3_BAD_TTL +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_ERRORS_PKT_ERROR_MASK 0xf000UL +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_ERRORS_PKT_ERROR_SFT 12 +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_ERRORS_PKT_ERROR_NO_ERROR \ + (0x0UL << 12) +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_ERRORS_PKT_ERROR_L3_BAD_VERSION \ + (0x1UL << 12) +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_ERRORS_PKT_ERROR_L3_BAD_HDR_LEN \ + (0x2UL << 12) +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_ERRORS_PKT_ERROR_L3_BAD_TTL \ + (0x3UL << 12) +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_ERRORS_PKT_ERROR_IP_TOTAL_ERROR \ + (0x4UL << 12) +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_ERRORS_PKT_ERROR_UDP_TOTAL_ERROR \ + (0x5UL << 12) +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_ERRORS_PKT_ERROR_L4_BAD_HDR_LEN \ + (0x6UL << 12) +#define \ +CQ_RES_RAWETH_QP1_RAWETH_QP1_ERRORS_PKT_ERROR_L4_BAD_HDR_LEN_TOO_SMALL \ + (0x7UL << 12) +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_ERRORS_PKT_ERROR_L4_BAD_OPT_LEN \ + (0x8UL << 12) +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_ERRORS_PKT_ERROR_LAST \ + CQ_RES_RAWETH_QP1_RAWETH_QP1_ERRORS_PKT_ERROR_L4_BAD_OPT_LEN +__le16 raweth_qp1_cfa_code; +__le64 qp_handle; +__le32 raweth_qp1_flags2; +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_FLAGS2_IP_CS_CALC 0x1UL +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_FLAGS2_L4_CS_CALC 0x2UL +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_FLAGS2_T_IP_CS_CALC 0x4UL +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_FLAGS2_T_L4_CS_CALC 0x8UL +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_FLAGS2_META_FORMAT_MASK 0xf0UL +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_FLAGS2_META_FORMAT_SFT 4 +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_FLAGS2_META_FORMAT_NONE \ + (0x0UL << 4) +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_FLAGS2_META_FORMAT_VLAN \ + (0x1UL << 4) +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_FLAGS2_META_FORMAT_LAST \ + CQ_RES_RAWETH_QP1_RAWETH_QP1_FLAGS2_META_FORMAT_VLAN +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_FLAGS2_IP_TYPE 0x100UL +__le32 raweth_qp1_metadata; +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_METADATA_VID_MASK 0xfffUL +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_METADATA_VID_SFT 0 +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_METADATA_DE 0x1000UL +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_METADATA_PRI_MASK 0xe000UL +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_METADATA_PRI_SFT 13 +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_METADATA_TPID_MASK 0xffff0000UL +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_METADATA_TPID_SFT 16 +u8 cqe_type_toggle; +#define CQ_RES_RAWETH_QP1_TOGGLE 0x1UL +#define CQ_RES_RAWETH_QP1_CQE_TYPE_MASK 0x1eUL +#define CQ_RES_RAWETH_QP1_CQE_TYPE_SFT 1 +#define CQ_RES_RAWETH_QP1_CQE_TYPE_RES_RAWETH_QP1 (0x3UL << 1) +#define CQ_RES_RAWETH_QP1_RESERVED3_MASK 0xe0UL +#define CQ_RES_RAWETH_QP1_RESERVED3_SFT 5 +u8 status; +#define CQ_RES_RAWETH_QP1_STATUS_OK 0x0UL +#define CQ_RES_RAWETH_QP1_STATUS_LOCAL_ACCESS_ERROR 0x1UL +#define CQ_RES_RAWETH_QP1_STATUS_HW_LOCAL_LENGTH_ERR 0x2UL +#define CQ_RES_RAWETH_QP1_STATUS_LOCAL_PROTECTION_ERR 0x3UL +#define CQ_RES_RAWETH_QP1_STATUS_LOCAL_QP_OPERATION_ERR 0x4UL +#define CQ_RES_RAWETH_QP1_STATUS_MEMORY_MGT_OPERATION_ERR 0x5UL +#define CQ_RES_RAWETH_QP1_STATUS_WORK_REQUEST_FLUSHED_ERR 0x7UL +#define CQ_RES_RAWETH_QP1_STATUS_HW_FLUSH_ERR 0x8UL +__le16 flags; +#define CQ_RES_RAWETH_QP1_FLAGS_SRQ 0x1UL +#define CQ_RES_RAWETH_QP1_FLAGS_SRQ_RQ 0x0UL +#define CQ_RES_RAWETH_QP1_FLAGS_SRQ_SRQ 0x1UL +#define CQ_RES_RAWETH_QP1_FLAGS_SRQ_LAST \ + CQ_RES_RAWETH_QP1_FLAGS_SRQ_SRQ +__le32 raweth_qp1_payload_offset_srq_or_rq_wr_id; +#define CQ_RES_RAWETH_QP1_SRQ_OR_RQ_WR_ID_MASK 0xfffffUL +#define CQ_RES_RAWETH_QP1_SRQ_OR_RQ_WR_ID_SFT 0 +#define CQ_RES_RAWETH_QP1_RESERVED4_MASK 0xf00000UL +#define CQ_RES_RAWETH_QP1_RESERVED4_SFT 20 +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_PAYLOAD_OFFSET_MASK 0xff000000UL +#define CQ_RES_RAWETH_QP1_RAWETH_QP1_PAYLOAD_OFFSET_SFT 24 +}; + +/* Terminal CQE (32 bytes) */ +struct cq_terminal { +__le64 qp_handle; +__le16 sq_cons_idx; +__le16 rq_cons_idx; +__le32 reserved32_1; +__le64 reserved64_3; +u8 cqe_type_toggle; +#define CQ_TERMINAL_TOGGLE 0x1UL +#define CQ_TERMINAL_CQE_TYPE_MASK 0x1eUL +#define CQ_TERMINAL_CQE_TYPE_SFT 1 +#define CQ_TERMINAL_CQE_TYPE_TERMINAL (0xeUL << 1) +#define CQ_TERMINAL_RESERVED3_MASK 0xe0UL +#define CQ_TERMINAL_RESERVED3_SFT 5 +u8 status; +#define CQ_TERMINAL_STATUS_OK 0x0UL +__le16 reserved16; +__le32 reserved32_2; +}; + +/* Cutoff CQE (32 bytes) */ +struct cq_cutoff { +__le64 reserved64_1; +__le64 reserved64_2; +__le64 reserved64_3; +u8 cqe_type_toggle; +#define CQ_CUTOFF_TOGGLE 0x1UL +#define CQ_CUTOFF_CQE_TYPE_MASK 0x1eUL +#define CQ_CUTOFF_CQE_TYPE_SFT 1 +#define CQ_CUTOFF_CQE_TYPE_CUT_OFF (0xfUL << 1) +#define CQ_CUTOFF_RESERVED3_MASK 0xe0UL +#define CQ_CUTOFF_RESERVED3_SFT 5 +u8 status; +#define CQ_CUTOFF_STATUS_OK 0x0UL +__le16 reserved16; +__le32 reserved32; +}; + +/* Notification Queue (NQ) Structures */ +/* Base NQ Record (16 bytes) */ +struct nq_base { +__le16 info10_type; +#define NQ_BASE_TYPE_MASK 0x3fUL +#define NQ_BASE_TYPE_SFT 0 +#define NQ_BASE_TYPE_CQ_NOTIFICATION 0x30UL +#define NQ_BASE_TYPE_SRQ_EVENT 0x32UL +#define NQ_BASE_TYPE_DBQ_EVENT 0x34UL +#define NQ_BASE_TYPE_QP_EVENT 0x38UL +#define NQ_BASE_TYPE_FUNC_EVENT 0x3aUL +#define NQ_BASE_INFO10_MASK 0xffc0UL +#define NQ_BASE_INFO10_SFT 6 +__le16 info16; +__le32 info32; +__le32 info63_v[2 ]; +#define NQ_BASE_V 0x1UL +#define NQ_BASE_INFO63_MASK 0xfffffffeUL +#define NQ_BASE_INFO63_SFT 1 +}; + +/* Completion Queue Notification (16 bytes) */ +struct nq_cn { +__le16 type; +#define NQ_CN_TYPE_MASK 0x3fUL +#define NQ_CN_TYPE_SFT 0 +#define NQ_CN_TYPE_CQ_NOTIFICATION 0x30UL +#define NQ_CN_RESERVED9_MASK 0xffc0UL +#define NQ_CN_RESERVED9_SFT 6 +__le16 reserved16; +__le32 cq_handle_low; +__le32 v; +#define NQ_CN_V 0x1UL +#define NQ_CN_RESERVED31_MASK 0xfffffffeUL +#define NQ_CN_RESERVED31_SFT 1 +__le32 cq_handle_high; +}; + +/* SRQ Event Notification (16 bytes) */ +struct nq_srq_event { +u8 type; +#define NQ_SRQ_EVENT_TYPE_MASK 0x3fUL +#define NQ_SRQ_EVENT_TYPE_SFT 0 +#define NQ_SRQ_EVENT_TYPE_SRQ_EVENT 0x32UL +#define NQ_SRQ_EVENT_RESERVED1_MASK 0xc0UL +#define NQ_SRQ_EVENT_RESERVED1_SFT 6 +u8 event; +#define NQ_SRQ_EVENT_EVENT_SRQ_THRESHOLD_EVENT 0x1UL +__le16 reserved16; +__le32 srq_handle_low; +__le32 v; +#define NQ_SRQ_EVENT_V 0x1UL +#define NQ_SRQ_EVENT_RESERVED31_MASK 0xfffffffeUL +#define NQ_SRQ_EVENT_RESERVED31_SFT 1 +__le32 srq_handle_high; +}; + +/* DBQ Async Event Notification (16 bytes) */ +struct nq_dbq_event { +u8 type; +#define NQ_DBQ_EVENT_TYPE_MASK 0x3fUL +#define NQ_DBQ_EVENT_TYPE_SFT 0 +#define NQ_DBQ_EVENT_TYPE_DBQ_EVENT 0x34UL +#define NQ_DBQ_EVENT_RESERVED1_MASK 0xc0UL +#define NQ_DBQ_EVENT_RESERVED1_SFT 6 +u8 event; +#define NQ_DBQ_EVENT_EVENT_DBQ_THRESHOLD_EVENT 0x1UL +__le16 db_pfid; +#define NQ_DBQ_EVENT_DB_PFID_MASK 0xfUL +#define NQ_DBQ_EVENT_DB_PFID_SFT 0 +#define NQ_DBQ_EVENT_RESERVED12_MASK 0xfff0UL +#define NQ_DBQ_EVENT_RESERVED12_SFT 4 +__le32 db_dpi; +#define NQ_DBQ_EVENT_DB_DPI_MASK 0xfffffUL +#define NQ_DBQ_EVENT_DB_DPI_SFT 0 +#define NQ_DBQ_EVENT_RESERVED12_2_MASK 0xfff00000UL +#define NQ_DBQ_EVENT_RESERVED12_2_SFT 20 +__le32 v; +#define NQ_DBQ_EVENT_V 0x1UL +#define NQ_DBQ_EVENT_RESERVED32_MASK 0xfffffffeUL +#define NQ_DBQ_EVENT_RESERVED32_SFT 1 +__le32 db_type_db_xid; +#define NQ_DBQ_EVENT_DB_XID_MASK 0xfffffUL +#define NQ_DBQ_EVENT_DB_XID_SFT 0 +#define NQ_DBQ_EVENT_RESERVED8_MASK 0xff00000UL +#define NQ_DBQ_EVENT_RESERVED8_SFT 20 +#define NQ_DBQ_EVENT_DB_TYPE_MASK 0xf0000000UL +#define NQ_DBQ_EVENT_DB_TYPE_SFT 28 +}; + +/* Read Request/Response Queue Structures */ +/* Input Read Request Queue (IRRQ) Message (32 bytes) */ +struct xrrq_irrq { +__le16 credits_type; +#define XRRQ_IRRQ_TYPE 0x1UL +#define XRRQ_IRRQ_TYPE_READ_REQ 0x0UL +#define XRRQ_IRRQ_TYPE_ATOMIC_REQ 0x1UL +#define XRRQ_IRRQ_RESERVED10_MASK 0x7feUL +#define XRRQ_IRRQ_RESERVED10_SFT 1 +#define XRRQ_IRRQ_CREDITS_MASK 0xf800UL +#define XRRQ_IRRQ_CREDITS_SFT 11 +__le16 reserved16; +__le32 reserved32; +__le32 psn; +#define XRRQ_IRRQ_PSN_MASK 0xffffffUL +#define XRRQ_IRRQ_PSN_SFT 0 +#define XRRQ_IRRQ_RESERVED8_1_MASK 0xff000000UL +#define XRRQ_IRRQ_RESERVED8_1_SFT 24 +__le32 msn; +#define XRRQ_IRRQ_MSN_MASK 0xffffffUL +#define XRRQ_IRRQ_MSN_SFT 0 +#define XRRQ_IRRQ_RESERVED8_2_MASK 0xff000000UL +#define XRRQ_IRRQ_RESERVED8_2_SFT 24 +__le64 va_or_atomic_result; +__le32 rdma_r_key; +__le32 length; +}; + +/* Output Read Request Queue (ORRQ) Message (32 bytes) */ +struct xrrq_orrq { +__le16 num_sges_type; +#define XRRQ_ORRQ_TYPE 0x1UL +#define XRRQ_ORRQ_TYPE_READ_REQ 0x0UL +#define XRRQ_ORRQ_TYPE_ATOMIC_REQ 0x1UL +#define XRRQ_ORRQ_RESERVED10_MASK 0x7feUL +#define XRRQ_ORRQ_RESERVED10_SFT 1 +#define XRRQ_ORRQ_NUM_SGES_MASK 0xf800UL +#define XRRQ_ORRQ_NUM_SGES_SFT 11 +__le16 reserved16; +__le32 length; +__le32 psn; +#define XRRQ_ORRQ_PSN_MASK 0xffffffUL +#define XRRQ_ORRQ_PSN_SFT 0 +#define XRRQ_ORRQ_RESERVED8_1_MASK 0xff000000UL +#define XRRQ_ORRQ_RESERVED8_1_SFT 24 +__le32 end_psn; +#define XRRQ_ORRQ_END_PSN_MASK 0xffffffUL +#define XRRQ_ORRQ_END_PSN_SFT 0 +#define XRRQ_ORRQ_RESERVED8_2_MASK 0xff000000UL +#define XRRQ_ORRQ_RESERVED8_2_SFT 24 +__le64 first_sge_phy_or_sing_sge_va; +__le32 single_sge_l_key; +__le32 single_sge_size; +}; + +/* Page Buffer List Memory Structures (PBL) */ +/* Page Table Entry (PTE) (8 bytes) */ +struct ptu_pte { +__le32 page_next_to_last_last_valid[2 ]; +#define PTU_PTE_VALID 0x1UL +#define PTU_PTE_LAST 0x2UL +#define PTU_PTE_NEXT_TO_LAST 0x4UL +#define PTU_PTE_PAGE_MASK 0xfffff000UL +#define PTU_PTE_PAGE_SFT 12 +}; + +/* Page Directory Entry (PDE) (8 bytes) */ +struct ptu_pde { +__le32 page_valid[2 ]; +#define PTU_PDE_VALID 0x1UL +#define PTU_PDE_PAGE_MASK 0xfffff000UL +#define PTU_PDE_PAGE_SFT 12 +}; + +/* RoCE Fastpath Host Structures */ +/* Command Queue (CMDQ) Interface */ +/* Init CMDQ (16 bytes) */ +struct cmdq_init { +__le64 cmdq_pbl; +__le16 cmdq_size_cmdq_lvl; +#define CMDQ_INIT_CMDQ_LVL_MASK 0x3UL +#define CMDQ_INIT_CMDQ_LVL_SFT 0 +#define CMDQ_INIT_CMDQ_SIZE_MASK 0xfffcUL +#define CMDQ_INIT_CMDQ_SIZE_SFT 2 +__le16 creq_ring_id; +__le32 prod_idx; +}; + +/* Update CMDQ producer index (16 bytes) */ +struct cmdq_update { +__le64 reserved64; +__le32 reserved32; +__le32 prod_idx; +}; + +/* CMDQ common header structure (16 bytes) */ +struct cmdq_base { +u8 opcode; +#define CMDQ_BASE_OPCODE_CREATE_QP 0x1UL +#define CMDQ_BASE_OPCODE_DESTROY_QP 0x2UL +#define CMDQ_BASE_OPCODE_MODIFY_QP 0x3UL +#define CMDQ_BASE_OPCODE_QUERY_QP 0x4UL +#define CMDQ_BASE_OPCODE_CREATE_SRQ 0x5UL +#define CMDQ_BASE_OPCODE_DESTROY_SRQ 0x6UL +#define CMDQ_BASE_OPCODE_QUERY_SRQ 0x8UL +#define CMDQ_BASE_OPCODE_CREATE_CQ 0x9UL +#define CMDQ_BASE_OPCODE_DESTROY_CQ 0xaUL +#define CMDQ_BASE_OPCODE_RESIZE_CQ 0xcUL +#define CMDQ_BASE_OPCODE_ALLOCATE_MRW 0xdUL +#define CMDQ_BASE_OPCODE_DEALLOCATE_KEY 0xeUL +#define CMDQ_BASE_OPCODE_REGISTER_MR 0xfUL +#define CMDQ_BASE_OPCODE_DEREGISTER_MR 0x10UL +#define CMDQ_BASE_OPCODE_ADD_GID 0x11UL +#define CMDQ_BASE_OPCODE_DELETE_GID 0x12UL +#define CMDQ_BASE_OPCODE_MODIFY_GID 0x17UL +#define CMDQ_BASE_OPCODE_QUERY_GID 0x18UL +#define CMDQ_BASE_OPCODE_CREATE_QP1 0x13UL +#define CMDQ_BASE_OPCODE_DESTROY_QP1 0x14UL +#define CMDQ_BASE_OPCODE_CREATE_AH 0x15UL +#define CMDQ_BASE_OPCODE_DESTROY_AH 0x16UL +#define CMDQ_BASE_OPCODE_INITIALIZE_FW 0x80UL +#define CMDQ_BASE_OPCODE_DEINITIALIZE_FW 0x81UL +#define CMDQ_BASE_OPCODE_STOP_FUNC 0x82UL +#define CMDQ_BASE_OPCODE_QUERY_FUNC 0x83UL +#define CMDQ_BASE_OPCODE_SET_FUNC_RESOURCES 0x84UL +#define CMDQ_BASE_OPCODE_READ_CONTEXT 0x85UL +#define CMDQ_BASE_OPCODE_VF_BACKCHANNEL_REQUEST 0x86UL +#define CMDQ_BASE_OPCODE_READ_VF_MEMORY 0x87UL +#define CMDQ_BASE_OPCODE_COMPLETE_VF_REQUEST 0x88UL +#define CMDQ_BASE_OPCODE_EXTEND_CONTEXT_ARRRAY 0x89UL +#define CMDQ_BASE_OPCODE_MAP_TC_TO_COS 0x8aUL +#define CMDQ_BASE_OPCODE_QUERY_VERSION 0x8bUL +#define CMDQ_BASE_OPCODE_MODIFY_CC 0x8cUL +#define CMDQ_BASE_OPCODE_QUERY_CC 0x8dUL +u8 cmd_size; +__le16 flags; +__le16 cookie; +u8 resp_size; +u8 reserved8; +__le64 resp_addr; +}; + +/* Create QP command (96 bytes) */ +struct cmdq_create_qp { +u8 opcode; +#define CMDQ_CREATE_QP_OPCODE_CREATE_QP 0x1UL +u8 cmd_size; +__le16 flags; +__le16 cookie; +u8 resp_size; +u8 reserved8; +__le64 resp_addr; +__le64 qp_handle; +__le32 qp_flags; +#define CMDQ_CREATE_QP_QP_FLAGS_SRQ_USED 0x1UL +#define CMDQ_CREATE_QP_QP_FLAGS_FORCE_COMPLETION 0x2UL +#define CMDQ_CREATE_QP_QP_FLAGS_RESERVED_LKEY_ENABLE 0x4UL +#define CMDQ_CREATE_QP_QP_FLAGS_FR_PMR_ENABLED 0x8UL +u8 type; +#define CMDQ_CREATE_QP_TYPE_RC 0x2UL +#define CMDQ_CREATE_QP_TYPE_UD 0x4UL +#define CMDQ_CREATE_QP_TYPE_RAW_ETHERTYPE 0x6UL +u8 sq_pg_size_sq_lvl; +#define CMDQ_CREATE_QP_SQ_LVL_MASK 0xfUL +#define CMDQ_CREATE_QP_SQ_LVL_SFT 0 +#define CMDQ_CREATE_QP_SQ_LVL_LVL_0 0x0UL +#define CMDQ_CREATE_QP_SQ_LVL_LVL_1 0x1UL +#define CMDQ_CREATE_QP_SQ_LVL_LVL_2 0x2UL +#define CMDQ_CREATE_QP_SQ_PG_SIZE_MASK 0xf0UL +#define CMDQ_CREATE_QP_SQ_PG_SIZE_SFT 4 +#define CMDQ_CREATE_QP_SQ_PG_SIZE_PG_4K (0x0UL << 4) +#define CMDQ_CREATE_QP_SQ_PG_SIZE_PG_8K (0x1UL << 4) +#define CMDQ_CREATE_QP_SQ_PG_SIZE_PG_64K (0x2UL << 4) +#define CMDQ_CREATE_QP_SQ_PG_SIZE_PG_2M (0x3UL << 4) +#define CMDQ_CREATE_QP_SQ_PG_SIZE_PG_8M (0x4UL << 4) +#define CMDQ_CREATE_QP_SQ_PG_SIZE_PG_1G (0x5UL << 4) +u8 rq_pg_size_rq_lvl; +#define CMDQ_CREATE_QP_RQ_LVL_MASK 0xfUL +#define CMDQ_CREATE_QP_RQ_LVL_SFT 0 +#define CMDQ_CREATE_QP_RQ_LVL_LVL_0 0x0UL +#define CMDQ_CREATE_QP_RQ_LVL_LVL_1 0x1UL +#define CMDQ_CREATE_QP_RQ_LVL_LVL_2 0x2UL +#define CMDQ_CREATE_QP_RQ_PG_SIZE_MASK 0xf0UL +#define CMDQ_CREATE_QP_RQ_PG_SIZE_SFT 4 +#define CMDQ_CREATE_QP_RQ_PG_SIZE_PG_4K (0x0UL << 4) +#define CMDQ_CREATE_QP_RQ_PG_SIZE_PG_8K (0x1UL << 4) +#define CMDQ_CREATE_QP_RQ_PG_SIZE_PG_64K (0x2UL << 4) +#define CMDQ_CREATE_QP_RQ_PG_SIZE_PG_2M (0x3UL << 4) +#define CMDQ_CREATE_QP_RQ_PG_SIZE_PG_8M (0x4UL << 4) +#define CMDQ_CREATE_QP_RQ_PG_SIZE_PG_1G (0x5UL << 4) +u8 unused_0; +__le32 dpi; +__le32 sq_size; +__le32 rq_size; +__le16 sq_fwo_sq_sge; +#define CMDQ_CREATE_QP_SQ_SGE_MASK 0xfUL +#define CMDQ_CREATE_QP_SQ_SGE_SFT 0 +#define CMDQ_CREATE_QP_SQ_FWO_MASK 0xfff0UL +#define CMDQ_CREATE_QP_SQ_FWO_SFT 4 +__le16 rq_fwo_rq_sge; +#define CMDQ_CREATE_QP_RQ_SGE_MASK 0xfUL +#define CMDQ_CREATE_QP_RQ_SGE_SFT 0 +#define CMDQ_CREATE_QP_RQ_FWO_MASK 0xfff0UL +#define CMDQ_CREATE_QP_RQ_FWO_SFT 4 +__le32 scq_cid; +__le32 rcq_cid; +__le32 srq_cid; +__le32 pd_id; +__le64 sq_pbl; +__le64 rq_pbl; +__le64 irrq_addr; +__le64 orrq_addr; +}; + +/* Destroy QP command (24 bytes) */ +struct cmdq_destroy_qp { +u8 opcode; +#define CMDQ_DESTROY_QP_OPCODE_DESTROY_QP 0x2UL +u8 cmd_size; +__le16 flags; +__le16 cookie; +u8 resp_size; +u8 reserved8; +__le64 resp_addr; +__le32 qp_cid; +__le32 unused_0; +}; + +/* Modify QP command (112 bytes) */ +struct cmdq_modify_qp { +u8 opcode; +#define CMDQ_MODIFY_QP_OPCODE_MODIFY_QP 0x3UL +u8 cmd_size; +__le16 flags; +__le16 cookie; +u8 resp_size; +u8 reserved8; +__le64 resp_addr; +__le32 modify_mask; +#define CMDQ_MODIFY_QP_MODIFY_MASK_STATE 0x1UL +#define CMDQ_MODIFY_QP_MODIFY_MASK_EN_SQD_ASYNC_NOTIFY 0x2UL +#define CMDQ_MODIFY_QP_MODIFY_MASK_ACCESS 0x4UL +#define CMDQ_MODIFY_QP_MODIFY_MASK_PKEY 0x8UL +#define CMDQ_MODIFY_QP_MODIFY_MASK_QKEY 0x10UL +#define CMDQ_MODIFY_QP_MODIFY_MASK_DGID 0x20UL +#define CMDQ_MODIFY_QP_MODIFY_MASK_FLOW_LABEL 0x40UL +#define CMDQ_MODIFY_QP_MODIFY_MASK_SGID_INDEX 0x80UL +#define CMDQ_MODIFY_QP_MODIFY_MASK_HOP_LIMIT 0x100UL +#define CMDQ_MODIFY_QP_MODIFY_MASK_TRAFFIC_CLASS 0x200UL +#define CMDQ_MODIFY_QP_MODIFY_MASK_DEST_MAC 0x400UL +#define CMDQ_MODIFY_QP_MODIFY_MASK_PATH_MTU 0x1000UL +#define CMDQ_MODIFY_QP_MODIFY_MASK_TIMEOUT 0x2000UL +#define CMDQ_MODIFY_QP_MODIFY_MASK_RETRY_CNT 0x4000UL +#define CMDQ_MODIFY_QP_MODIFY_MASK_RNR_RETRY 0x8000UL +#define CMDQ_MODIFY_QP_MODIFY_MASK_RQ_PSN 0x10000UL +#define CMDQ_MODIFY_QP_MODIFY_MASK_MAX_RD_ATOMIC 0x20000UL +#define CMDQ_MODIFY_QP_MODIFY_MASK_MIN_RNR_TIMER 0x40000UL +#define CMDQ_MODIFY_QP_MODIFY_MASK_SQ_PSN 0x80000UL +#define CMDQ_MODIFY_QP_MODIFY_MASK_MAX_DEST_RD_ATOMIC 0x100000UL +#define CMDQ_MODIFY_QP_MODIFY_MASK_SQ_SIZE 0x200000UL +#define CMDQ_MODIFY_QP_MODIFY_MASK_RQ_SIZE 0x400000UL +#define CMDQ_MODIFY_QP_MODIFY_MASK_SQ_SGE 0x800000UL +#define CMDQ_MODIFY_QP_MODIFY_MASK_RQ_SGE 0x1000000UL +#define CMDQ_MODIFY_QP_MODIFY_MASK_MAX_INLINE_DATA 0x2000000UL +#define CMDQ_MODIFY_QP_MODIFY_MASK_DEST_QP_ID 0x4000000UL +#define CMDQ_MODIFY_QP_MODIFY_MASK_SRC_MAC 0x8000000UL +#define CMDQ_MODIFY_QP_MODIFY_MASK_VLAN_ID 0x10000000UL +#define CMDQ_MODIFY_QP_MODIFY_MASK_ENABLE_CC 0x20000000UL +#define CMDQ_MODIFY_QP_MODIFY_MASK_TOS_ECN 0x40000000UL +#define CMDQ_MODIFY_QP_MODIFY_MASK_TOS_DSCP 0x80000000UL +__le32 qp_cid; +u8 network_type_en_sqd_async_notify_new_state; +#define CMDQ_MODIFY_QP_NEW_STATE_MASK 0xfUL +#define CMDQ_MODIFY_QP_NEW_STATE_SFT 0 +#define CMDQ_MODIFY_QP_NEW_STATE_RESET 0x0UL +#define CMDQ_MODIFY_QP_NEW_STATE_INIT 0x1UL +#define CMDQ_MODIFY_QP_NEW_STATE_RTR 0x2UL +#define CMDQ_MODIFY_QP_NEW_STATE_RTS 0x3UL +#define CMDQ_MODIFY_QP_NEW_STATE_SQD 0x4UL +#define CMDQ_MODIFY_QP_NEW_STATE_SQE 0x5UL +#define CMDQ_MODIFY_QP_NEW_STATE_ERR 0x6UL +#define CMDQ_MODIFY_QP_EN_SQD_ASYNC_NOTIFY 0x10UL +#define CMDQ_MODIFY_QP_NETWORK_TYPE_MASK 0xc0UL +#define CMDQ_MODIFY_QP_NETWORK_TYPE_SFT 6 +#define CMDQ_MODIFY_QP_NETWORK_TYPE_ROCEV1 (0x0UL << 6) +#define CMDQ_MODIFY_QP_NETWORK_TYPE_ROCEV2_IPV4 (0x2UL << 6) +#define CMDQ_MODIFY_QP_NETWORK_TYPE_ROCEV2_IPV6 (0x3UL << 6) +u8 access; +#define CMDQ_MODIFY_QP_ACCESS_LOCAL_WRITE 0x1UL +#define CMDQ_MODIFY_QP_ACCESS_REMOTE_WRITE 0x2UL +#define CMDQ_MODIFY_QP_ACCESS_REMOTE_READ 0x4UL +#define CMDQ_MODIFY_QP_ACCESS_REMOTE_ATOMIC 0x8UL +__le16 pkey; +__le32 qkey; +__le32 dgid[4 ]; +__le32 flow_label; +__le16 sgid_index; +u8 hop_limit; +u8 traffic_class; +__le16 dest_mac[3 ]; +u8 tos_dscp_tos_ecn; +#define CMDQ_MODIFY_QP_TOS_ECN_MASK 0x3UL +#define CMDQ_MODIFY_QP_TOS_ECN_SFT 0 +#define CMDQ_MODIFY_QP_TOS_DSCP_MASK 0xfcUL +#define CMDQ_MODIFY_QP_TOS_DSCP_SFT 2 +u8 path_mtu; +#define CMDQ_MODIFY_QP_PATH_MTU_MASK 0xf0UL +#define CMDQ_MODIFY_QP_PATH_MTU_SFT 4 +#define CMDQ_MODIFY_QP_PATH_MTU_MTU_256 (0x0UL << 4) +#define CMDQ_MODIFY_QP_PATH_MTU_MTU_512 (0x1UL << 4) +#define CMDQ_MODIFY_QP_PATH_MTU_MTU_1024 (0x2UL << 4) +#define CMDQ_MODIFY_QP_PATH_MTU_MTU_2048 (0x3UL << 4) +#define CMDQ_MODIFY_QP_PATH_MTU_MTU_4096 (0x4UL << 4) +#define CMDQ_MODIFY_QP_PATH_MTU_MTU_8192 (0x5UL << 4) +u8 timeout; +u8 retry_cnt; +u8 rnr_retry; +u8 min_rnr_timer; +__le32 rq_psn; +__le32 sq_psn; +u8 max_rd_atomic; +u8 max_dest_rd_atomic; +__le16 enable_cc; +#define CMDQ_MODIFY_QP_ENABLE_CC 0x1UL +__le32 sq_size; +__le32 rq_size; +__le16 sq_sge; +__le16 rq_sge; +__le32 max_inline_data; +__le32 dest_qp_id; +__le32 unused_3; +__le16 src_mac[3 ]; +__le16 vlan_pcp_vlan_dei_vlan_id; +#define CMDQ_MODIFY_QP_VLAN_ID_MASK 0xfffUL +#define CMDQ_MODIFY_QP_VLAN_ID_SFT 0 +#define CMDQ_MODIFY_QP_VLAN_DEI 0x1000UL +#define CMDQ_MODIFY_QP_VLAN_PCP_MASK 0xe000UL +#define CMDQ_MODIFY_QP_VLAN_PCP_SFT 13 +}; + +/* Query QP command (24 bytes) */ +struct cmdq_query_qp { +u8 opcode; +#define CMDQ_QUERY_QP_OPCODE_QUERY_QP 0x4UL +u8 cmd_size; +__le16 flags; +__le16 cookie; +u8 resp_size; +u8 reserved8; +__le64 resp_addr; +__le32 qp_cid; +__le32 unused_0; +}; + +/* Create SRQ command (48 bytes) */ +struct cmdq_create_srq { +u8 opcode; +#define CMDQ_CREATE_SRQ_OPCODE_CREATE_SRQ 0x5UL +u8 cmd_size; +__le16 flags; +__le16 cookie; +u8 resp_size; +u8 reserved8; +__le64 resp_addr; +__le64 srq_handle; +__le16 pg_size_lvl; +#define CMDQ_CREATE_SRQ_LVL_MASK 0x3UL +#define CMDQ_CREATE_SRQ_LVL_SFT 0 +#define CMDQ_CREATE_SRQ_LVL_LVL_0 0x0UL +#define CMDQ_CREATE_SRQ_LVL_LVL_1 0x1UL +#define CMDQ_CREATE_SRQ_LVL_LVL_2 0x2UL +#define CMDQ_CREATE_SRQ_PG_SIZE_MASK 0x1cUL +#define CMDQ_CREATE_SRQ_PG_SIZE_SFT 2 +#define CMDQ_CREATE_SRQ_PG_SIZE_PG_4K (0x0UL << 2) +#define CMDQ_CREATE_SRQ_PG_SIZE_PG_8K (0x1UL << 2) +#define CMDQ_CREATE_SRQ_PG_SIZE_PG_64K (0x2UL << 2) +#define CMDQ_CREATE_SRQ_PG_SIZE_PG_2M (0x3UL << 2) +#define CMDQ_CREATE_SRQ_PG_SIZE_PG_8M (0x4UL << 2) +#define CMDQ_CREATE_SRQ_PG_SIZE_PG_1G (0x5UL << 2) +__le16 eventq_id; +#define CMDQ_CREATE_SRQ_EVENTQ_ID_MASK 0xfffUL +#define CMDQ_CREATE_SRQ_EVENTQ_ID_SFT 0 +__le16 srq_size; +__le16 srq_fwo; +__le32 dpi; +__le32 pd_id; +__le64 pbl; +}; + +/* Destroy SRQ command (24 bytes) */ +struct cmdq_destroy_srq { +u8 opcode; +#define CMDQ_DESTROY_SRQ_OPCODE_DESTROY_SRQ 0x6UL +u8 cmd_size; +__le16 flags; +__le16 cookie; +u8 resp_size; +u8 reserved8; +__le64 resp_addr; +__le32 srq_cid; +__le32 unused_0; +}; + +/* Query SRQ command (24 bytes) */ +struct cmdq_query_srq { +u8 opcode; +#define CMDQ_QUERY_SRQ_OPCODE_QUERY_SRQ 0x8UL +u8 cmd_size; +__le16 flags; +__le16 cookie; +u8 resp_size; +u8 reserved8; +__le64 resp_addr; +__le32 srq_cid; +__le32 unused_0; +}; + +/* Create CQ command (48 bytes) */ +struct cmdq_create_cq { +u8 opcode; +#define CMDQ_CREATE_CQ_OPCODE_CREATE_CQ 0x9UL +u8 cmd_size; +__le16 flags; +__le16 cookie; +u8 resp_size; +u8 reserved8; +__le64 resp_addr; +__le64 cq_handle; +__le32 pg_size_lvl; +#define CMDQ_CREATE_CQ_LVL_MASK 0x3UL +#define CMDQ_CREATE_CQ_LVL_SFT 0 +#define CMDQ_CREATE_CQ_LVL_LVL_0 0x0UL +#define CMDQ_CREATE_CQ_LVL_LVL_1 0x1UL +#define CMDQ_CREATE_CQ_LVL_LVL_2 0x2UL +#define CMDQ_CREATE_CQ_PG_SIZE_MASK 0x1cUL +#define CMDQ_CREATE_CQ_PG_SIZE_SFT 2 +#define CMDQ_CREATE_CQ_PG_SIZE_PG_4K (0x0UL << 2) +#define CMDQ_CREATE_CQ_PG_SIZE_PG_8K (0x1UL << 2) +#define CMDQ_CREATE_CQ_PG_SIZE_PG_64K (0x2UL << 2) +#define CMDQ_CREATE_CQ_PG_SIZE_PG_2M (0x3UL << 2) +#define CMDQ_CREATE_CQ_PG_SIZE_PG_8M (0x4UL << 2) +#define CMDQ_CREATE_CQ_PG_SIZE_PG_1G (0x5UL << 2) +__le32 cq_fco_cnq_id; +#define CMDQ_CREATE_CQ_CNQ_ID_MASK 0xfffUL +#define CMDQ_CREATE_CQ_CNQ_ID_SFT 0 +#define CMDQ_CREATE_CQ_CQ_FCO_MASK 0xfffff000UL +#define CMDQ_CREATE_CQ_CQ_FCO_SFT 12 +__le32 dpi; +__le32 cq_size; +__le64 pbl; +}; + +/* Destroy CQ command (24 bytes) */ +struct cmdq_destroy_cq { +u8 opcode; +#define CMDQ_DESTROY_CQ_OPCODE_DESTROY_CQ 0xaUL +u8 cmd_size; +__le16 flags; +__le16 cookie; +u8 resp_size; +u8 reserved8; +__le64 resp_addr; +__le32 cq_cid; +__le32 unused_0; +}; + +/* Resize CQ command (40 bytes) */ +struct cmdq_resize_cq { +u8 opcode; +#define CMDQ_RESIZE_CQ_OPCODE_RESIZE_CQ 0xcUL +u8 cmd_size; +__le16 flags; +__le16 cookie; +u8 resp_size; +u8 reserved8; +__le64 resp_addr; +__le32 cq_cid; +__le32 new_cq_size_pg_size_lvl; +#define CMDQ_RESIZE_CQ_LVL_MASK 0x3UL +#define CMDQ_RESIZE_CQ_LVL_SFT 0 +#define CMDQ_RESIZE_CQ_LVL_LVL_0 0x0UL +#define CMDQ_RESIZE_CQ_LVL_LVL_1 0x1UL +#define CMDQ_RESIZE_CQ_LVL_LVL_2 0x2UL +#define CMDQ_RESIZE_CQ_PG_SIZE_MASK 0x1cUL +#define CMDQ_RESIZE_CQ_PG_SIZE_SFT 2 +#define CMDQ_RESIZE_CQ_PG_SIZE_PG_4K (0x0UL << 2) +#define CMDQ_RESIZE_CQ_PG_SIZE_PG_8K (0x1UL << 2) +#define CMDQ_RESIZE_CQ_PG_SIZE_PG_64K (0x2UL << 2) +#define CMDQ_RESIZE_CQ_PG_SIZE_PG_2M (0x3UL << 2) +#define CMDQ_RESIZE_CQ_PG_SIZE_PG_8M (0x4UL << 2) +#define CMDQ_RESIZE_CQ_PG_SIZE_PG_1G (0x5UL << 2) +#define CMDQ_RESIZE_CQ_NEW_CQ_SIZE_MASK 0x1fffe0UL +#define CMDQ_RESIZE_CQ_NEW_CQ_SIZE_SFT 5 +__le64 new_pbl; +__le32 new_cq_fco; +__le32 unused_2; +}; + +/* Allocate MRW command (32 bytes) */ +struct cmdq_allocate_mrw { +u8 opcode; +#define CMDQ_ALLOCATE_MRW_OPCODE_ALLOCATE_MRW 0xdUL +u8 cmd_size; +__le16 flags; +__le16 cookie; +u8 resp_size; +u8 reserved8; +__le64 resp_addr; +__le64 mrw_handle; +u8 mrw_flags; +#define CMDQ_ALLOCATE_MRW_MRW_FLAGS_MASK 0xfUL +#define CMDQ_ALLOCATE_MRW_MRW_FLAGS_SFT 0 +#define CMDQ_ALLOCATE_MRW_MRW_FLAGS_MR 0x0UL +#define CMDQ_ALLOCATE_MRW_MRW_FLAGS_PMR 0x1UL +#define CMDQ_ALLOCATE_MRW_MRW_FLAGS_MW_TYPE1 0x2UL +#define CMDQ_ALLOCATE_MRW_MRW_FLAGS_MW_TYPE2A 0x3UL +#define CMDQ_ALLOCATE_MRW_MRW_FLAGS_MW_TYPE2B 0x4UL +u8 access; +#define CMDQ_ALLOCATE_MRW_ACCESS_RESERVED_MASK 0x1fUL +#define CMDQ_ALLOCATE_MRW_ACCESS_RESERVED_SFT 0 +#define CMDQ_ALLOCATE_MRW_ACCESS_CONSUMER_OWNED_KEY 0x20UL +__le16 unused_1; +__le32 pd_id; +}; + +/* De-allocate key command (24 bytes) */ +struct cmdq_deallocate_key { +u8 opcode; +#define CMDQ_DEALLOCATE_KEY_OPCODE_DEALLOCATE_KEY 0xeUL +u8 cmd_size; +__le16 flags; +__le16 cookie; +u8 resp_size; +u8 reserved8; +__le64 resp_addr; +u8 mrw_flags; +#define CMDQ_DEALLOCATE_KEY_MRW_FLAGS_MASK 0xfUL +#define CMDQ_DEALLOCATE_KEY_MRW_FLAGS_SFT 0 +#define CMDQ_DEALLOCATE_KEY_MRW_FLAGS_MR 0x0UL +#define CMDQ_DEALLOCATE_KEY_MRW_FLAGS_PMR 0x1UL +#define CMDQ_DEALLOCATE_KEY_MRW_FLAGS_MW_TYPE1 0x2UL +#define CMDQ_DEALLOCATE_KEY_MRW_FLAGS_MW_TYPE2A 0x3UL +#define CMDQ_DEALLOCATE_KEY_MRW_FLAGS_MW_TYPE2B 0x4UL +u8 unused_1[3 ]; +__le32 key; +}; + +/* Register MR command (48 bytes) */ +struct cmdq_register_mr { +u8 opcode; +#define CMDQ_REGISTER_MR_OPCODE_REGISTER_MR 0xfUL +u8 cmd_size; +__le16 flags; +__le16 cookie; +u8 resp_size; +u8 reserved8; +__le64 resp_addr; +u8 log2_pg_size_lvl; +#define CMDQ_REGISTER_MR_LVL_MASK 0x3UL +#define CMDQ_REGISTER_MR_LVL_SFT 0 +#define CMDQ_REGISTER_MR_LVL_LVL_0 0x0UL +#define CMDQ_REGISTER_MR_LVL_LVL_1 0x1UL +#define CMDQ_REGISTER_MR_LVL_LVL_2 0x2UL +#define CMDQ_REGISTER_MR_LOG2_PG_SIZE_MASK 0x7cUL +#define CMDQ_REGISTER_MR_LOG2_PG_SIZE_SFT 2 +u8 access; +#define CMDQ_REGISTER_MR_ACCESS_LOCAL_WRITE 0x1UL +#define CMDQ_REGISTER_MR_ACCESS_REMOTE_READ 0x2UL +#define CMDQ_REGISTER_MR_ACCESS_REMOTE_WRITE 0x4UL +#define CMDQ_REGISTER_MR_ACCESS_REMOTE_ATOMIC 0x8UL +#define CMDQ_REGISTER_MR_ACCESS_MW_BIND 0x10UL +#define CMDQ_REGISTER_MR_ACCESS_ZERO_BASED 0x20UL +__le16 unused_1; +__le32 key; +__le64 pbl; +__le64 va; +__le64 mr_size; +}; + +/* Deregister MR command (24 bytes) */ +struct cmdq_deregister_mr { +u8 opcode; +#define CMDQ_DEREGISTER_MR_OPCODE_DEREGISTER_MR 0x10UL +u8 cmd_size; +__le16 flags; +__le16 cookie; +u8 resp_size; +u8 reserved8; +__le64 resp_addr; +__le32 lkey; +__le32 unused_0; +}; + +/* Add GID command (48 bytes) */ +struct cmdq_add_gid { +u8 opcode; +#define CMDQ_ADD_GID_OPCODE_ADD_GID 0x11UL +u8 cmd_size; +__le16 flags; +__le16 cookie; +u8 resp_size; +u8 reserved8; +__le64 resp_addr; +__be32 gid[4 ]; +__be16 src_mac[3 ]; +__le16 vlan; +#define CMDQ_ADD_GID_VLAN_VLAN_ID_MASK 0xfffUL +#define CMDQ_ADD_GID_VLAN_VLAN_ID_SFT 0 +#define CMDQ_ADD_GID_VLAN_TPID_MASK 0x7000UL +#define CMDQ_ADD_GID_VLAN_TPID_SFT 12 +#define CMDQ_ADD_GID_VLAN_TPID_TPID_88A8 (0x0UL << 12) +#define CMDQ_ADD_GID_VLAN_TPID_TPID_8100 (0x1UL << 12) +#define CMDQ_ADD_GID_VLAN_TPID_TPID_9100 (0x2UL << 12) +#define CMDQ_ADD_GID_VLAN_TPID_TPID_9200 (0x3UL << 12) +#define CMDQ_ADD_GID_VLAN_TPID_TPID_9300 (0x4UL << 12) +#define CMDQ_ADD_GID_VLAN_TPID_TPID_CFG1 (0x5UL << 12) +#define CMDQ_ADD_GID_VLAN_TPID_TPID_CFG2 (0x6UL << 12) +#define CMDQ_ADD_GID_VLAN_TPID_TPID_CFG3 (0x7UL << 12) +#define CMDQ_ADD_GID_VLAN_TPID_LAST CMDQ_ADD_GID_VLAN_TPID_TPID_CFG3 +#define CMDQ_ADD_GID_VLAN_VLAN_EN 0x8000UL +__le16 ipid; +__le16 stats_ctx; +#define CMDQ_ADD_GID_STATS_CTX_STATS_CTX_ID_MASK 0x7fffUL +#define CMDQ_ADD_GID_STATS_CTX_STATS_CTX_ID_SFT 0 +#define CMDQ_ADD_GID_STATS_CTX_STATS_CTX_VALID 0x8000UL +__le32 unused_0; +}; + +/* Delete GID command (24 bytes) */ +struct cmdq_delete_gid { +u8 opcode; +#define CMDQ_DELETE_GID_OPCODE_DELETE_GID 0x12UL +u8 cmd_size; +__le16 flags; +__le16 cookie; +u8 resp_size; +u8 reserved8; +__le64 resp_addr; +__le16 gid_index; +__le16 unused_0; +__le32 unused_1; +}; + +/* Modify GID command (48 bytes) */ +struct cmdq_modify_gid { +u8 opcode; +#define CMDQ_MODIFY_GID_OPCODE_MODIFY_GID 0x17UL +u8 cmd_size; +__le16 flags; +__le16 cookie; +u8 resp_size; +u8 reserved8; +__le64 resp_addr; +__le32 gid[4 ]; +__le16 src_mac[3 ]; +__le16 vlan; +#define CMDQ_MODIFY_GID_VLAN_VLAN_ID_MASK 0xfffUL +#define CMDQ_MODIFY_GID_VLAN_VLAN_ID_SFT 0 +#define CMDQ_MODIFY_GID_VLAN_TPID_MASK 0x7000UL +#define CMDQ_MODIFY_GID_VLAN_TPID_SFT 12 +#define CMDQ_MODIFY_GID_VLAN_TPID_TPID_88A8 (0x0UL << 12) +#define CMDQ_MODIFY_GID_VLAN_TPID_TPID_8100 (0x1UL << 12) +#define CMDQ_MODIFY_GID_VLAN_TPID_TPID_9100 (0x2UL << 12) +#define CMDQ_MODIFY_GID_VLAN_TPID_TPID_9200 (0x3UL << 12) +#define CMDQ_MODIFY_GID_VLAN_TPID_TPID_9300 (0x4UL << 12) +#define CMDQ_MODIFY_GID_VLAN_TPID_TPID_CFG1 (0x5UL << 12) +#define CMDQ_MODIFY_GID_VLAN_TPID_TPID_CFG2 (0x6UL << 12) +#define CMDQ_MODIFY_GID_VLAN_TPID_TPID_CFG3 (0x7UL << 12) +#define CMDQ_MODIFY_GID_VLAN_TPID_LAST \ + CMDQ_MODIFY_GID_VLAN_TPID_TPID_CFG3 +#define CMDQ_MODIFY_GID_VLAN_VLAN_EN 0x8000UL +__le16 ipid; +__le16 gid_index; +__le16 stats_ctx; +#define CMDQ_MODIFY_GID_STATS_CTX_STATS_CTX_ID_MASK 0x7fffUL +#define CMDQ_MODIFY_GID_STATS_CTX_STATS_CTX_ID_SFT 0 +#define CMDQ_MODIFY_GID_STATS_CTX_STATS_CTX_VALID 0x8000UL +__le16 unused_0; +}; + +/* Query GID command (24 bytes) */ +struct cmdq_query_gid { +u8 opcode; +#define CMDQ_QUERY_GID_OPCODE_QUERY_GID 0x18UL +u8 cmd_size; +__le16 flags; +__le16 cookie; +u8 resp_size; +u8 reserved8; +__le64 resp_addr; +__le16 gid_index; +__le16 unused_0; +__le32 unused_1; +}; + +/* Create QP1 command (80 bytes) */ +struct cmdq_create_qp1 { +u8 opcode; +#define CMDQ_CREATE_QP1_OPCODE_CREATE_QP1 0x13UL +u8 cmd_size; +__le16 flags; +__le16 cookie; +u8 resp_size; +u8 reserved8; +__le64 resp_addr; +__le64 qp_handle; +__le32 qp_flags; +#define CMDQ_CREATE_QP1_QP_FLAGS_SRQ_USED 0x1UL +#define CMDQ_CREATE_QP1_QP_FLAGS_FORCE_COMPLETION 0x2UL +#define CMDQ_CREATE_QP1_QP_FLAGS_RESERVED_LKEY_ENABLE 0x4UL +u8 type; +#define CMDQ_CREATE_QP1_TYPE_GSI 0x1UL +u8 sq_pg_size_sq_lvl; +#define CMDQ_CREATE_QP1_SQ_LVL_MASK 0xfUL +#define CMDQ_CREATE_QP1_SQ_LVL_SFT 0 +#define CMDQ_CREATE_QP1_SQ_LVL_LVL_0 0x0UL +#define CMDQ_CREATE_QP1_SQ_LVL_LVL_1 0x1UL +#define CMDQ_CREATE_QP1_SQ_LVL_LVL_2 0x2UL +#define CMDQ_CREATE_QP1_SQ_PG_SIZE_MASK 0xf0UL +#define CMDQ_CREATE_QP1_SQ_PG_SIZE_SFT 4 +#define CMDQ_CREATE_QP1_SQ_PG_SIZE_PG_4K (0x0UL << 4) +#define CMDQ_CREATE_QP1_SQ_PG_SIZE_PG_8K (0x1UL << 4) +#define CMDQ_CREATE_QP1_SQ_PG_SIZE_PG_64K (0x2UL << 4) +#define CMDQ_CREATE_QP1_SQ_PG_SIZE_PG_2M (0x3UL << 4) +#define CMDQ_CREATE_QP1_SQ_PG_SIZE_PG_8M (0x4UL << 4) +#define CMDQ_CREATE_QP1_SQ_PG_SIZE_PG_1G (0x5UL << 4) +u8 rq_pg_size_rq_lvl; +#define CMDQ_CREATE_QP1_RQ_LVL_MASK 0xfUL +#define CMDQ_CREATE_QP1_RQ_LVL_SFT 0 +#define CMDQ_CREATE_QP1_RQ_LVL_LVL_0 0x0UL +#define CMDQ_CREATE_QP1_RQ_LVL_LVL_1 0x1UL +#define CMDQ_CREATE_QP1_RQ_LVL_LVL_2 0x2UL +#define CMDQ_CREATE_QP1_RQ_PG_SIZE_MASK 0xf0UL +#define CMDQ_CREATE_QP1_RQ_PG_SIZE_SFT 4 +#define CMDQ_CREATE_QP1_RQ_PG_SIZE_PG_4K (0x0UL << 4) +#define CMDQ_CREATE_QP1_RQ_PG_SIZE_PG_8K (0x1UL << 4) +#define CMDQ_CREATE_QP1_RQ_PG_SIZE_PG_64K (0x2UL << 4) +#define CMDQ_CREATE_QP1_RQ_PG_SIZE_PG_2M (0x3UL << 4) +#define CMDQ_CREATE_QP1_RQ_PG_SIZE_PG_8M (0x4UL << 4) +#define CMDQ_CREATE_QP1_RQ_PG_SIZE_PG_1G (0x5UL << 4) +u8 unused_0; +__le32 dpi; +__le32 sq_size; +__le32 rq_size; +__le16 sq_fwo_sq_sge; +#define CMDQ_CREATE_QP1_SQ_SGE_MASK 0xfUL +#define CMDQ_CREATE_QP1_SQ_SGE_SFT 0 +#define CMDQ_CREATE_QP1_SQ_FWO_MASK 0xfff0UL +#define CMDQ_CREATE_QP1_SQ_FWO_SFT 4 +__le16 rq_fwo_rq_sge; +#define CMDQ_CREATE_QP1_RQ_SGE_MASK 0xfUL +#define CMDQ_CREATE_QP1_RQ_SGE_SFT 0 +#define CMDQ_CREATE_QP1_RQ_FWO_MASK 0xfff0UL +#define CMDQ_CREATE_QP1_RQ_FWO_SFT 4 +__le32 scq_cid; +__le32 rcq_cid; +__le32 srq_cid; +__le32 pd_id; +__le64 sq_pbl; +__le64 rq_pbl; +}; + +/* Destroy QP1 command (24 bytes) */ +struct cmdq_destroy_qp1 { +u8 opcode; +#define CMDQ_DESTROY_QP1_OPCODE_DESTROY_QP1 0x14UL +u8 cmd_size; +__le16 flags; +__le16 cookie; +u8 resp_size; +u8 reserved8; +__le64 resp_addr; +__le32 qp1_cid; +__le32 unused_0; +}; + +/* Create AH command (64 bytes) */ +struct cmdq_create_ah { +u8 opcode; +#define CMDQ_CREATE_AH_OPCODE_CREATE_AH 0x15UL +u8 cmd_size; +__le16 flags; +__le16 cookie; +u8 resp_size; +u8 reserved8; +__le64 resp_addr; +__le64 ah_handle; +__le32 dgid[4 ]; +u8 type; +#define CMDQ_CREATE_AH_TYPE_V1 0x0UL +#define CMDQ_CREATE_AH_TYPE_V2IPV4 0x2UL +#define CMDQ_CREATE_AH_TYPE_V2IPV6 0x3UL +u8 hop_limit; +__le16 sgid_index; +__le32 dest_vlan_id_flow_label; +#define CMDQ_CREATE_AH_FLOW_LABEL_MASK 0xfffffUL +#define CMDQ_CREATE_AH_FLOW_LABEL_SFT 0 +#define CMDQ_CREATE_AH_DEST_VLAN_ID_MASK 0xfff00000UL +#define CMDQ_CREATE_AH_DEST_VLAN_ID_SFT 20 +__le32 pd_id; +__le32 unused_0; +__le16 dest_mac[3 ]; +u8 traffic_class; +u8 unused_1; +}; + +/* Destroy AH command (24 bytes) */ +struct cmdq_destroy_ah { +u8 opcode; +#define CMDQ_DESTROY_AH_OPCODE_DESTROY_AH 0x16UL +u8 cmd_size; +__le16 flags; +__le16 cookie; +u8 resp_size; +u8 reserved8; +__le64 resp_addr; +__le32 ah_cid; +__le32 unused_0; +}; + +/* Initialize Firmware command (112 bytes) */ +struct cmdq_initialize_fw { +u8 opcode; +#define CMDQ_INITIALIZE_FW_OPCODE_INITIALIZE_FW 0x80UL +u8 cmd_size; +__le16 flags; +__le16 cookie; +u8 resp_size; +u8 reserved8; +__le64 resp_addr; +u8 qpc_pg_size_qpc_lvl; +#define CMDQ_INITIALIZE_FW_QPC_LVL_MASK 0xfUL +#define CMDQ_INITIALIZE_FW_QPC_LVL_SFT 0 +#define CMDQ_INITIALIZE_FW_QPC_LVL_LVL_0 0x0UL +#define CMDQ_INITIALIZE_FW_QPC_LVL_LVL_1 0x1UL +#define CMDQ_INITIALIZE_FW_QPC_LVL_LVL_2 0x2UL +#define CMDQ_INITIALIZE_FW_QPC_PG_SIZE_MASK 0xf0UL +#define CMDQ_INITIALIZE_FW_QPC_PG_SIZE_SFT 4 +#define CMDQ_INITIALIZE_FW_QPC_PG_SIZE_PG_4K (0x0UL << 4) +#define CMDQ_INITIALIZE_FW_QPC_PG_SIZE_PG_8K (0x1UL << 4) +#define CMDQ_INITIALIZE_FW_QPC_PG_SIZE_PG_64K (0x2UL << 4) +#define CMDQ_INITIALIZE_FW_QPC_PG_SIZE_PG_2M (0x3UL << 4) +#define CMDQ_INITIALIZE_FW_QPC_PG_SIZE_PG_8M (0x4UL << 4) +#define CMDQ_INITIALIZE_FW_QPC_PG_SIZE_PG_1G (0x5UL << 4) +u8 mrw_pg_size_mrw_lvl; +#define CMDQ_INITIALIZE_FW_MRW_LVL_MASK 0xfUL +#define CMDQ_INITIALIZE_FW_MRW_LVL_SFT 0 +#define CMDQ_INITIALIZE_FW_MRW_LVL_LVL_0 0x0UL +#define CMDQ_INITIALIZE_FW_MRW_LVL_LVL_1 0x1UL +#define CMDQ_INITIALIZE_FW_MRW_LVL_LVL_2 0x2UL +#define CMDQ_INITIALIZE_FW_MRW_PG_SIZE_MASK 0xf0UL +#define CMDQ_INITIALIZE_FW_MRW_PG_SIZE_SFT 4 +#define CMDQ_INITIALIZE_FW_MRW_PG_SIZE_PG_4K (0x0UL << 4) +#define CMDQ_INITIALIZE_FW_MRW_PG_SIZE_PG_8K (0x1UL << 4) +#define CMDQ_INITIALIZE_FW_MRW_PG_SIZE_PG_64K (0x2UL << 4) +#define CMDQ_INITIALIZE_FW_MRW_PG_SIZE_PG_2M (0x3UL << 4) +#define CMDQ_INITIALIZE_FW_MRW_PG_SIZE_PG_8M (0x4UL << 4) +#define CMDQ_INITIALIZE_FW_MRW_PG_SIZE_PG_1G (0x5UL << 4) +u8 srq_pg_size_srq_lvl; +#define CMDQ_INITIALIZE_FW_SRQ_LVL_MASK 0xfUL +#define CMDQ_INITIALIZE_FW_SRQ_LVL_SFT 0 +#define CMDQ_INITIALIZE_FW_SRQ_LVL_LVL_0 0x0UL +#define CMDQ_INITIALIZE_FW_SRQ_LVL_LVL_1 0x1UL +#define CMDQ_INITIALIZE_FW_SRQ_LVL_LVL_2 0x2UL +#define CMDQ_INITIALIZE_FW_SRQ_PG_SIZE_MASK 0xf0UL +#define CMDQ_INITIALIZE_FW_SRQ_PG_SIZE_SFT 4 +#define CMDQ_INITIALIZE_FW_SRQ_PG_SIZE_PG_4K (0x0UL << 4) +#define CMDQ_INITIALIZE_FW_SRQ_PG_SIZE_PG_8K (0x1UL << 4) +#define CMDQ_INITIALIZE_FW_SRQ_PG_SIZE_PG_64K (0x2UL << 4) +#define CMDQ_INITIALIZE_FW_SRQ_PG_SIZE_PG_2M (0x3UL << 4) +#define CMDQ_INITIALIZE_FW_SRQ_PG_SIZE_PG_8M (0x4UL << 4) +#define CMDQ_INITIALIZE_FW_SRQ_PG_SIZE_PG_1G (0x5UL << 4) +u8 cq_pg_size_cq_lvl; +#define CMDQ_INITIALIZE_FW_CQ_LVL_MASK 0xfUL +#define CMDQ_INITIALIZE_FW_CQ_LVL_SFT 0 +#define CMDQ_INITIALIZE_FW_CQ_LVL_LVL_0 0x0UL +#define CMDQ_INITIALIZE_FW_CQ_LVL_LVL_1 0x1UL +#define CMDQ_INITIALIZE_FW_CQ_LVL_LVL_2 0x2UL +#define CMDQ_INITIALIZE_FW_CQ_PG_SIZE_MASK 0xf0UL +#define CMDQ_INITIALIZE_FW_CQ_PG_SIZE_SFT 4 +#define CMDQ_INITIALIZE_FW_CQ_PG_SIZE_PG_4K (0x0UL << 4) +#define CMDQ_INITIALIZE_FW_CQ_PG_SIZE_PG_8K (0x1UL << 4) +#define CMDQ_INITIALIZE_FW_CQ_PG_SIZE_PG_64K (0x2UL << 4) +#define CMDQ_INITIALIZE_FW_CQ_PG_SIZE_PG_2M (0x3UL << 4) +#define CMDQ_INITIALIZE_FW_CQ_PG_SIZE_PG_8M (0x4UL << 4) +#define CMDQ_INITIALIZE_FW_CQ_PG_SIZE_PG_1G (0x5UL << 4) +u8 tqm_pg_size_tqm_lvl; +#define CMDQ_INITIALIZE_FW_TQM_LVL_MASK 0xfUL +#define CMDQ_INITIALIZE_FW_TQM_LVL_SFT 0 +#define CMDQ_INITIALIZE_FW_TQM_LVL_LVL_0 0x0UL +#define CMDQ_INITIALIZE_FW_TQM_LVL_LVL_1 0x1UL +#define CMDQ_INITIALIZE_FW_TQM_LVL_LVL_2 0x2UL +#define CMDQ_INITIALIZE_FW_TQM_PG_SIZE_MASK 0xf0UL +#define CMDQ_INITIALIZE_FW_TQM_PG_SIZE_SFT 4 +#define CMDQ_INITIALIZE_FW_TQM_PG_SIZE_PG_4K (0x0UL << 4) +#define CMDQ_INITIALIZE_FW_TQM_PG_SIZE_PG_8K (0x1UL << 4) +#define CMDQ_INITIALIZE_FW_TQM_PG_SIZE_PG_64K (0x2UL << 4) +#define CMDQ_INITIALIZE_FW_TQM_PG_SIZE_PG_2M (0x3UL << 4) +#define CMDQ_INITIALIZE_FW_TQM_PG_SIZE_PG_8M (0x4UL << 4) +#define CMDQ_INITIALIZE_FW_TQM_PG_SIZE_PG_1G (0x5UL << 4) +u8 tim_pg_size_tim_lvl; +#define CMDQ_INITIALIZE_FW_TIM_LVL_MASK 0xfUL +#define CMDQ_INITIALIZE_FW_TIM_LVL_SFT 0 +#define CMDQ_INITIALIZE_FW_TIM_LVL_LVL_0 0x0UL +#define CMDQ_INITIALIZE_FW_TIM_LVL_LVL_1 0x1UL +#define CMDQ_INITIALIZE_FW_TIM_LVL_LVL_2 0x2UL +#define CMDQ_INITIALIZE_FW_TIM_PG_SIZE_MASK 0xf0UL +#define CMDQ_INITIALIZE_FW_TIM_PG_SIZE_SFT 4 +#define CMDQ_INITIALIZE_FW_TIM_PG_SIZE_PG_4K (0x0UL << 4) +#define CMDQ_INITIALIZE_FW_TIM_PG_SIZE_PG_8K (0x1UL << 4) +#define CMDQ_INITIALIZE_FW_TIM_PG_SIZE_PG_64K (0x2UL << 4) +#define CMDQ_INITIALIZE_FW_TIM_PG_SIZE_PG_2M (0x3UL << 4) +#define CMDQ_INITIALIZE_FW_TIM_PG_SIZE_PG_8M (0x4UL << 4) +#define CMDQ_INITIALIZE_FW_TIM_PG_SIZE_PG_1G (0x5UL << 4) +__le16 reserved16; +__le64 qpc_page_dir; +__le64 mrw_page_dir; +__le64 srq_page_dir; +__le64 cq_page_dir; +__le64 tqm_page_dir; +__le64 tim_page_dir; +__le32 number_of_qp; +__le32 number_of_mrw; +__le32 number_of_srq; +__le32 number_of_cq; +__le32 max_qp_per_vf; +__le32 max_mrw_per_vf; +__le32 max_srq_per_vf; +__le32 max_cq_per_vf; +__le32 max_gid_per_vf; +__le32 stat_ctx_id; +}; + +/* De-initialize Firmware command (16 bytes) */ +struct cmdq_deinitialize_fw { +u8 opcode; +#define CMDQ_DEINITIALIZE_FW_OPCODE_DEINITIALIZE_FW 0x81UL +u8 cmd_size; +__le16 flags; +__le16 cookie; +u8 resp_size; +u8 reserved8; +__le64 resp_addr; +}; + +/* Stop function command (16 bytes) */ +struct cmdq_stop_func { +u8 opcode; +#define CMDQ_STOP_FUNC_OPCODE_STOP_FUNC 0x82UL +u8 cmd_size; +__le16 flags; +__le16 cookie; +u8 resp_size; +u8 reserved8; +__le64 resp_addr; +}; + +/* Query function command (16 bytes) */ +struct cmdq_query_func { +u8 opcode; +#define CMDQ_QUERY_FUNC_OPCODE_QUERY_FUNC 0x83UL +u8 cmd_size; +__le16 flags; +__le16 cookie; +u8 resp_size; +u8 reserved8; +__le64 resp_addr; +}; + +/* Set function resources command (16 bytes) */ +struct cmdq_set_func_resources { +u8 opcode; +#define CMDQ_SET_FUNC_RESOURCES_OPCODE_SET_FUNC_RESOURCES 0x84UL +u8 cmd_size; +__le16 flags; +__le16 cookie; +u8 resp_size; +u8 reserved8; +__le64 resp_addr; +}; + +/* Read hardware resource context command (24 bytes) */ +struct cmdq_read_context { +u8 opcode; +#define CMDQ_READ_CONTEXT_OPCODE_READ_CONTEXT 0x85UL +u8 cmd_size; +__le16 flags; +__le16 cookie; +u8 resp_size; +u8 reserved8; +__le64 resp_addr; +__le32 type_xid; +#define CMDQ_READ_CONTEXT_XID_MASK 0xffffffUL +#define CMDQ_READ_CONTEXT_XID_SFT 0 +#define CMDQ_READ_CONTEXT_TYPE_MASK 0xff000000UL +#define CMDQ_READ_CONTEXT_TYPE_SFT 24 +#define CMDQ_READ_CONTEXT_TYPE_QPC (0x0UL << 24) +#define CMDQ_READ_CONTEXT_TYPE_CQ (0x1UL << 24) +#define CMDQ_READ_CONTEXT_TYPE_MRW (0x2UL << 24) +#define CMDQ_READ_CONTEXT_TYPE_SRQ (0x3UL << 24) +__le32 unused_0; +}; + +/* Map TC to COS. Can only be issued from a PF (24 bytes) */ +struct cmdq_map_tc_to_cos { +u8 opcode; +#define CMDQ_MAP_TC_TO_COS_OPCODE_MAP_TC_TO_COS 0x8aUL +u8 cmd_size; +__le16 flags; +__le16 cookie; +u8 resp_size; +u8 reserved8; +__le64 resp_addr; +__le16 cos0; +#define CMDQ_MAP_TC_TO_COS_COS0_NO_CHANGE 0xffffUL +__le16 cos1; +#define CMDQ_MAP_TC_TO_COS_COS1_DISABLE 0x8000UL +#define CMDQ_MAP_TC_TO_COS_COS1_NO_CHANGE 0xffffUL +__le32 unused_0; +}; + +/* Query version command (16 bytes) */ +struct cmdq_query_version { +u8 opcode; +#define CMDQ_QUERY_VERSION_OPCODE_QUERY_VERSION 0x8bUL +u8 cmd_size; +__le16 flags; +__le16 cookie; +u8 resp_size; +u8 reserved8; +__le64 resp_addr; +}; + +/* Command-Response Event Queue (CREQ) Structures */ +/* Base CREQ Record (16 bytes) */ +struct creq_base { +u8 type; +#define CREQ_BASE_TYPE_MASK 0x3fUL +#define CREQ_BASE_TYPE_SFT 0 +#define CREQ_BASE_TYPE_QP_EVENT 0x38UL +#define CREQ_BASE_TYPE_FUNC_EVENT 0x3aUL +#define CREQ_BASE_RESERVED2_MASK 0xc0UL +#define CREQ_BASE_RESERVED2_SFT 6 +u8 reserved56[7 ]; +u8 v; +#define CREQ_BASE_V 0x1UL +#define CREQ_BASE_RESERVED7_MASK 0xfeUL +#define CREQ_BASE_RESERVED7_SFT 1 +u8 event; +__le16 reserved48[3 ]; +}; + +/* RoCE Function Async Event Notification (16 bytes) */ +struct creq_func_event { +u8 type; +#define CREQ_FUNC_EVENT_TYPE_MASK 0x3fUL +#define CREQ_FUNC_EVENT_TYPE_SFT 0 +#define CREQ_FUNC_EVENT_TYPE_FUNC_EVENT 0x3aUL +#define CREQ_FUNC_EVENT_RESERVED2_MASK 0xc0UL +#define CREQ_FUNC_EVENT_RESERVED2_SFT 6 +u8 reserved56[7 ]; +u8 v; +#define CREQ_FUNC_EVENT_V 0x1UL +#define CREQ_FUNC_EVENT_RESERVED7_MASK 0xfeUL +#define CREQ_FUNC_EVENT_RESERVED7_SFT 1 +u8 event; +#define CREQ_FUNC_EVENT_EVENT_TX_WQE_ERROR 0x1UL +#define CREQ_FUNC_EVENT_EVENT_TX_DATA_ERROR 0x2UL +#define CREQ_FUNC_EVENT_EVENT_RX_WQE_ERROR 0x3UL +#define CREQ_FUNC_EVENT_EVENT_RX_DATA_ERROR 0x4UL +#define CREQ_FUNC_EVENT_EVENT_CQ_ERROR 0x5UL +#define CREQ_FUNC_EVENT_EVENT_TQM_ERROR 0x6UL +#define CREQ_FUNC_EVENT_EVENT_CFCQ_ERROR 0x7UL +#define CREQ_FUNC_EVENT_EVENT_CFCS_ERROR 0x8UL +#define CREQ_FUNC_EVENT_EVENT_CFCC_ERROR 0x9UL +#define CREQ_FUNC_EVENT_EVENT_CFCM_ERROR 0xaUL +#define CREQ_FUNC_EVENT_EVENT_TIM_ERROR 0xbUL +#define CREQ_FUNC_EVENT_EVENT_VF_COMM_REQUEST 0x80UL +#define CREQ_FUNC_EVENT_EVENT_RESOURCE_EXHAUSTED 0x81UL +__le16 reserved48[3 ]; +}; + +/* RoCE Slowpath Command Completion (16 bytes) */ +struct creq_qp_event { +u8 type; +#define CREQ_QP_EVENT_TYPE_MASK 0x3fUL +#define CREQ_QP_EVENT_TYPE_SFT 0 +#define CREQ_QP_EVENT_TYPE_QP_EVENT 0x38UL +#define CREQ_QP_EVENT_RESERVED2_MASK 0xc0UL +#define CREQ_QP_EVENT_RESERVED2_SFT 6 +u8 status; +__le16 cookie; +__le32 reserved32; +u8 v; +#define CREQ_QP_EVENT_V 0x1UL +#define CREQ_QP_EVENT_RESERVED7_MASK 0xfeUL +#define CREQ_QP_EVENT_RESERVED7_SFT 1 +u8 event; +#define CREQ_QP_EVENT_EVENT_CREATE_QP 0x1UL +#define CREQ_QP_EVENT_EVENT_DESTROY_QP 0x2UL +#define CREQ_QP_EVENT_EVENT_MODIFY_QP 0x3UL +#define CREQ_QP_EVENT_EVENT_QUERY_QP 0x4UL +#define CREQ_QP_EVENT_EVENT_CREATE_SRQ 0x5UL +#define CREQ_QP_EVENT_EVENT_DESTROY_SRQ 0x6UL +#define CREQ_QP_EVENT_EVENT_QUERY_SRQ 0x8UL +#define CREQ_QP_EVENT_EVENT_CREATE_CQ 0x9UL +#define CREQ_QP_EVENT_EVENT_DESTROY_CQ 0xaUL +#define CREQ_QP_EVENT_EVENT_RESIZE_CQ 0xcUL +#define CREQ_QP_EVENT_EVENT_ALLOCATE_MRW 0xdUL +#define CREQ_QP_EVENT_EVENT_DEALLOCATE_KEY 0xeUL +#define CREQ_QP_EVENT_EVENT_REGISTER_MR 0xfUL +#define CREQ_QP_EVENT_EVENT_DEREGISTER_MR 0x10UL +#define CREQ_QP_EVENT_EVENT_ADD_GID 0x11UL +#define CREQ_QP_EVENT_EVENT_DELETE_GID 0x12UL +#define CREQ_QP_EVENT_EVENT_MODIFY_GID 0x17UL +#define CREQ_QP_EVENT_EVENT_QUERY_GID 0x18UL +#define CREQ_QP_EVENT_EVENT_CREATE_QP1 0x13UL +#define CREQ_QP_EVENT_EVENT_DESTROY_QP1 0x14UL +#define CREQ_QP_EVENT_EVENT_CREATE_AH 0x15UL +#define CREQ_QP_EVENT_EVENT_DESTROY_AH 0x16UL +#define CREQ_QP_EVENT_EVENT_INITIALIZE_FW 0x80UL +#define CREQ_QP_EVENT_EVENT_DEINITIALIZE_FW 0x81UL +#define CREQ_QP_EVENT_EVENT_STOP_FUNC 0x82UL +#define CREQ_QP_EVENT_EVENT_QUERY_FUNC 0x83UL +#define CREQ_QP_EVENT_EVENT_SET_FUNC_RESOURCES 0x84UL +#define CREQ_QP_EVENT_EVENT_MAP_TC_TO_COS 0x8aUL +#define CREQ_QP_EVENT_EVENT_QUERY_VERSION 0x8bUL +#define CREQ_QP_EVENT_EVENT_MODIFY_CC 0x8cUL +#define CREQ_QP_EVENT_EVENT_QUERY_CC 0x8dUL +#define CREQ_QP_EVENT_EVENT_QP_ERROR_NOTIFICATION 0xc0UL +__le16 reserved48[3 ]; +}; + +/* Create QP command response (16 bytes) */ +struct creq_create_qp_resp { +u8 type; +#define CREQ_CREATE_QP_RESP_TYPE_MASK 0x3fUL +#define CREQ_CREATE_QP_RESP_TYPE_SFT 0 +#define CREQ_CREATE_QP_RESP_TYPE_QP_EVENT 0x38UL +#define CREQ_CREATE_QP_RESP_RESERVED2_MASK 0xc0UL +#define CREQ_CREATE_QP_RESP_RESERVED2_SFT 6 +u8 status; +__le16 cookie; +__le32 xid; +u8 v; +#define CREQ_CREATE_QP_RESP_V 0x1UL +#define CREQ_CREATE_QP_RESP_RESERVED7_MASK 0xfeUL +#define CREQ_CREATE_QP_RESP_RESERVED7_SFT 1 +u8 event; +#define CREQ_CREATE_QP_RESP_EVENT_CREATE_QP 0x1UL +__le16 reserved48[3 ]; +}; + +/* Destroy QP command response (16 bytes) */ +struct creq_destroy_qp_resp { +u8 type; +#define CREQ_DESTROY_QP_RESP_TYPE_MASK 0x3fUL +#define CREQ_DESTROY_QP_RESP_TYPE_SFT 0 +#define CREQ_DESTROY_QP_RESP_TYPE_QP_EVENT 0x38UL +#define CREQ_DESTROY_QP_RESP_RESERVED2_MASK 0xc0UL +#define CREQ_DESTROY_QP_RESP_RESERVED2_SFT 6 +u8 status; +__le16 cookie; +__le32 xid; +u8 v; +#define CREQ_DESTROY_QP_RESP_V 0x1UL +#define CREQ_DESTROY_QP_RESP_RESERVED7_MASK 0xfeUL +#define CREQ_DESTROY_QP_RESP_RESERVED7_SFT 1 +u8 event; +#define CREQ_DESTROY_QP_RESP_EVENT_DESTROY_QP 0x2UL +__le16 reserved48[3 ]; +}; + +/* Modify QP command response (16 bytes) */ +struct creq_modify_qp_resp { +u8 type; +#define CREQ_MODIFY_QP_RESP_TYPE_MASK 0x3fUL +#define CREQ_MODIFY_QP_RESP_TYPE_SFT 0 +#define CREQ_MODIFY_QP_RESP_TYPE_QP_EVENT 0x38UL +#define CREQ_MODIFY_QP_RESP_RESERVED2_MASK 0xc0UL +#define CREQ_MODIFY_QP_RESP_RESERVED2_SFT 6 +u8 status; +__le16 cookie; +__le32 xid; +u8 v; +#define CREQ_MODIFY_QP_RESP_V 0x1UL +#define CREQ_MODIFY_QP_RESP_RESERVED7_MASK 0xfeUL +#define CREQ_MODIFY_QP_RESP_RESERVED7_SFT 1 +u8 event; +#define CREQ_MODIFY_QP_RESP_EVENT_MODIFY_QP 0x3UL +__le16 reserved48[3 ]; +}; + +/* Query QP command response (16 bytes) */ +struct creq_query_qp_resp { +u8 type; +#define CREQ_QUERY_QP_RESP_TYPE_MASK 0x3fUL +#define CREQ_QUERY_QP_RESP_TYPE_SFT 0 +#define CREQ_QUERY_QP_RESP_TYPE_QP_EVENT 0x38UL +#define CREQ_QUERY_QP_RESP_RESERVED2_MASK 0xc0UL +#define CREQ_QUERY_QP_RESP_RESERVED2_SFT 6 +u8 status; +__le16 cookie; +__le32 size; +u8 v; +#define CREQ_QUERY_QP_RESP_V 0x1UL +#define CREQ_QUERY_QP_RESP_RESERVED7_MASK 0xfeUL +#define CREQ_QUERY_QP_RESP_RESERVED7_SFT 1 +u8 event; +#define CREQ_QUERY_QP_RESP_EVENT_QUERY_QP 0x4UL +__le16 reserved48[3 ]; +}; + +/* Query QP command response side buffer structure (104 bytes) */ +struct creq_query_qp_resp_sb { +u8 opcode; +#define CREQ_QUERY_QP_RESP_SB_OPCODE_QUERY_QP 0x4UL +u8 status; +__le16 cookie; +__le16 flags; +u8 resp_size; +u8 reserved8; +__le32 xid; +u8 en_sqd_async_notify_state; +#define CREQ_QUERY_QP_RESP_SB_STATE_MASK 0xfUL +#define CREQ_QUERY_QP_RESP_SB_STATE_SFT 0 +#define CREQ_QUERY_QP_RESP_SB_STATE_RESET 0x0UL +#define CREQ_QUERY_QP_RESP_SB_STATE_INIT 0x1UL +#define CREQ_QUERY_QP_RESP_SB_STATE_RTR 0x2UL +#define CREQ_QUERY_QP_RESP_SB_STATE_RTS 0x3UL +#define CREQ_QUERY_QP_RESP_SB_STATE_SQD 0x4UL +#define CREQ_QUERY_QP_RESP_SB_STATE_SQE 0x5UL +#define CREQ_QUERY_QP_RESP_SB_STATE_ERR 0x6UL +#define CREQ_QUERY_QP_RESP_SB_EN_SQD_ASYNC_NOTIFY 0x10UL +u8 access; +#define CREQ_QUERY_QP_RESP_SB_ACCESS_LOCAL_WRITE 0x1UL +#define CREQ_QUERY_QP_RESP_SB_ACCESS_REMOTE_WRITE 0x2UL +#define CREQ_QUERY_QP_RESP_SB_ACCESS_REMOTE_READ 0x4UL +#define CREQ_QUERY_QP_RESP_SB_ACCESS_REMOTE_ATOMIC 0x8UL +__le16 pkey; +__le32 qkey; +__le32 reserved32; +__le32 dgid[4 ]; +__le32 flow_label; +__le16 sgid_index; +u8 hop_limit; +u8 traffic_class; +__le16 dest_mac[3 ]; +__le16 path_mtu_dest_vlan_id; +#define CREQ_QUERY_QP_RESP_SB_DEST_VLAN_ID_MASK 0xfffUL +#define CREQ_QUERY_QP_RESP_SB_DEST_VLAN_ID_SFT 0 +#define CREQ_QUERY_QP_RESP_SB_PATH_MTU_MASK 0xf000UL +#define CREQ_QUERY_QP_RESP_SB_PATH_MTU_SFT 12 +#define CREQ_QUERY_QP_RESP_SB_PATH_MTU_MTU_256 (0x0UL << 12) +#define CREQ_QUERY_QP_RESP_SB_PATH_MTU_MTU_512 (0x1UL << 12) +#define CREQ_QUERY_QP_RESP_SB_PATH_MTU_MTU_1024 (0x2UL << 12) +#define CREQ_QUERY_QP_RESP_SB_PATH_MTU_MTU_2048 (0x3UL << 12) +#define CREQ_QUERY_QP_RESP_SB_PATH_MTU_MTU_4096 (0x4UL << 12) +#define CREQ_QUERY_QP_RESP_SB_PATH_MTU_MTU_8192 (0x5UL << 12) +u8 timeout; +u8 retry_cnt; +u8 rnr_retry; +u8 min_rnr_timer; +__le32 rq_psn; +__le32 sq_psn; +u8 max_rd_atomic; +u8 max_dest_rd_atomic; +u8 tos_dscp_tos_ecn; +#define CREQ_QUERY_QP_RESP_SB_TOS_ECN_MASK 0x3UL +#define CREQ_QUERY_QP_RESP_SB_TOS_ECN_SFT 0 +#define CREQ_QUERY_QP_RESP_SB_TOS_DSCP_MASK 0xfcUL +#define CREQ_QUERY_QP_RESP_SB_TOS_DSCP_SFT 2 +u8 enable_cc; +#define CREQ_QUERY_QP_RESP_SB_ENABLE_CC 0x1UL +#define CREQ_QUERY_QP_RESP_SB_RESERVED7_MASK 0xfeUL +#define CREQ_QUERY_QP_RESP_SB_RESERVED7_SFT 1 +__le32 sq_size; +__le32 rq_size; +__le16 sq_sge; +__le16 rq_sge; +__le32 max_inline_data; +__le32 dest_qp_id; +__le32 unused_1; +__le16 src_mac[3 ]; +__le16 vlan_pcp_vlan_dei_vlan_id; +#define CREQ_QUERY_QP_RESP_SB_VLAN_ID_MASK 0xfffUL +#define CREQ_QUERY_QP_RESP_SB_VLAN_ID_SFT 0 +#define CREQ_QUERY_QP_RESP_SB_VLAN_DEI 0x1000UL +#define CREQ_QUERY_QP_RESP_SB_VLAN_PCP_MASK 0xe000UL +#define CREQ_QUERY_QP_RESP_SB_VLAN_PCP_SFT 13 +}; + +/* Create SRQ command response (16 bytes) */ +struct creq_create_srq_resp { +u8 type; +#define CREQ_CREATE_SRQ_RESP_TYPE_MASK 0x3fUL +#define CREQ_CREATE_SRQ_RESP_TYPE_SFT 0 +#define CREQ_CREATE_SRQ_RESP_TYPE_QP_EVENT 0x38UL +#define CREQ_CREATE_SRQ_RESP_RESERVED2_MASK 0xc0UL +#define CREQ_CREATE_SRQ_RESP_RESERVED2_SFT 6 +u8 status; +__le16 cookie; +__le32 xid; +u8 v; +#define CREQ_CREATE_SRQ_RESP_V 0x1UL +#define CREQ_CREATE_SRQ_RESP_RESERVED7_MASK 0xfeUL +#define CREQ_CREATE_SRQ_RESP_RESERVED7_SFT 1 +u8 event; +#define CREQ_CREATE_SRQ_RESP_EVENT_CREATE_SRQ 0x5UL +__le16 reserved48[3 ]; +}; + +/* Destroy SRQ command response (16 bytes) */ +struct creq_destroy_srq_resp { +u8 type; +#define CREQ_DESTROY_SRQ_RESP_TYPE_MASK 0x3fUL +#define CREQ_DESTROY_SRQ_RESP_TYPE_SFT 0 +#define CREQ_DESTROY_SRQ_RESP_TYPE_QP_EVENT 0x38UL +#define CREQ_DESTROY_SRQ_RESP_RESERVED2_MASK 0xc0UL +#define CREQ_DESTROY_SRQ_RESP_RESERVED2_SFT 6 +u8 status; +__le16 cookie; +__le32 xid; +u8 v; +#define CREQ_DESTROY_SRQ_RESP_V 0x1UL +#define CREQ_DESTROY_SRQ_RESP_RESERVED7_MASK 0xfeUL +#define CREQ_DESTROY_SRQ_RESP_RESERVED7_SFT 1 +u8 event; +#define CREQ_DESTROY_SRQ_RESP_EVENT_DESTROY_SRQ 0x6UL +__le16 enable_for_arm[3 ]; +#define CREQ_DESTROY_SRQ_RESP_ENABLE_FOR_ARM_MASK 0x30000UL +#define CREQ_DESTROY_SRQ_RESP_ENABLE_FOR_ARM_SFT 16 +#define CREQ_DESTROY_SRQ_RESP_RESERVED46_MASK 0xfffc0000UL +#define CREQ_DESTROY_SRQ_RESP_RESERVED46_SFT 18 +}; + +/* Query SRQ command response (16 bytes) */ +struct creq_query_srq_resp { +u8 type; +#define CREQ_QUERY_SRQ_RESP_TYPE_MASK 0x3fUL +#define CREQ_QUERY_SRQ_RESP_TYPE_SFT 0 +#define CREQ_QUERY_SRQ_RESP_TYPE_QP_EVENT 0x38UL +#define CREQ_QUERY_SRQ_RESP_RESERVED2_MASK 0xc0UL +#define CREQ_QUERY_SRQ_RESP_RESERVED2_SFT 6 +u8 status; +__le16 cookie; +__le32 size; +u8 v; +#define CREQ_QUERY_SRQ_RESP_V 0x1UL +#define CREQ_QUERY_SRQ_RESP_RESERVED7_MASK 0xfeUL +#define CREQ_QUERY_SRQ_RESP_RESERVED7_SFT 1 +u8 event; +#define CREQ_QUERY_SRQ_RESP_EVENT_QUERY_SRQ 0x8UL +__le16 reserved48[3 ]; +}; + +/* Query SRQ command response side buffer structure (24 bytes) */ +struct creq_query_srq_resp_sb { +u8 opcode; +#define CREQ_QUERY_SRQ_RESP_SB_OPCODE_QUERY_SRQ 0x8UL +u8 status; +__le16 cookie; +__le16 flags; +u8 resp_size; +u8 reserved8; +__le32 xid; +__le16 srq_limit; +__le16 reserved16; +__le32 data[4 ]; +}; + +/* Create CQ command Response (16 bytes) */ +struct creq_create_cq_resp { +u8 type; +#define CREQ_CREATE_CQ_RESP_TYPE_MASK 0x3fUL +#define CREQ_CREATE_CQ_RESP_TYPE_SFT 0 +#define CREQ_CREATE_CQ_RESP_TYPE_QP_EVENT 0x38UL +#define CREQ_CREATE_CQ_RESP_RESERVED2_MASK 0xc0UL +#define CREQ_CREATE_CQ_RESP_RESERVED2_SFT 6 +u8 status; +__le16 cookie; +__le32 xid; +u8 v; +#define CREQ_CREATE_CQ_RESP_V 0x1UL +#define CREQ_CREATE_CQ_RESP_RESERVED7_MASK 0xfeUL +#define CREQ_CREATE_CQ_RESP_RESERVED7_SFT 1 +u8 event; +#define CREQ_CREATE_CQ_RESP_EVENT_CREATE_CQ 0x9UL +__le16 reserved48[3 ]; +}; + +/* Destroy CQ command response (16 bytes) */ +struct creq_destroy_cq_resp { +u8 type; +#define CREQ_DESTROY_CQ_RESP_TYPE_MASK 0x3fUL +#define CREQ_DESTROY_CQ_RESP_TYPE_SFT 0 +#define CREQ_DESTROY_CQ_RESP_TYPE_QP_EVENT 0x38UL +#define CREQ_DESTROY_CQ_RESP_RESERVED2_MASK 0xc0UL +#define CREQ_DESTROY_CQ_RESP_RESERVED2_SFT 6 +u8 status; +__le16 cookie; +__le32 xid; +u8 v; +#define CREQ_DESTROY_CQ_RESP_V 0x1UL +#define CREQ_DESTROY_CQ_RESP_RESERVED7_MASK 0xfeUL +#define CREQ_DESTROY_CQ_RESP_RESERVED7_SFT 1 +u8 event; +#define CREQ_DESTROY_CQ_RESP_EVENT_DESTROY_CQ 0xaUL +__le16 cq_arm_lvl; +#define CREQ_DESTROY_CQ_RESP_CQ_ARM_LVL_MASK 0x3UL +#define CREQ_DESTROY_CQ_RESP_CQ_ARM_LVL_SFT 0 +#define CREQ_DESTROY_CQ_RESP_RESERVED14_MASK 0xfffcUL +#define CREQ_DESTROY_CQ_RESP_RESERVED14_SFT 2 +__le16 total_cnq_events; +__le16 reserved16; +}; + +/* Resize CQ command response (16 bytes) */ +struct creq_resize_cq_resp { +u8 type; +#define CREQ_RESIZE_CQ_RESP_TYPE_MASK 0x3fUL +#define CREQ_RESIZE_CQ_RESP_TYPE_SFT 0 +#define CREQ_RESIZE_CQ_RESP_TYPE_QP_EVENT 0x38UL +#define CREQ_RESIZE_CQ_RESP_RESERVED2_MASK 0xc0UL +#define CREQ_RESIZE_CQ_RESP_RESERVED2_SFT 6 +u8 status; +__le16 cookie; +__le32 xid; +u8 v; +#define CREQ_RESIZE_CQ_RESP_V 0x1UL +#define CREQ_RESIZE_CQ_RESP_RESERVED7_MASK 0xfeUL +#define CREQ_RESIZE_CQ_RESP_RESERVED7_SFT 1 +u8 event; +#define CREQ_RESIZE_CQ_RESP_EVENT_RESIZE_CQ 0xcUL +__le16 reserved48[3 ]; +}; + +/* Allocate MRW command response (16 bytes) */ +struct creq_allocate_mrw_resp { +u8 type; +#define CREQ_ALLOCATE_MRW_RESP_TYPE_MASK 0x3fUL +#define CREQ_ALLOCATE_MRW_RESP_TYPE_SFT 0 +#define CREQ_ALLOCATE_MRW_RESP_TYPE_QP_EVENT 0x38UL +#define CREQ_ALLOCATE_MRW_RESP_RESERVED2_MASK 0xc0UL +#define CREQ_ALLOCATE_MRW_RESP_RESERVED2_SFT 6 +u8 status; +__le16 cookie; +__le32 xid; +u8 v; +#define CREQ_ALLOCATE_MRW_RESP_V 0x1UL +#define CREQ_ALLOCATE_MRW_RESP_RESERVED7_MASK 0xfeUL +#define CREQ_ALLOCATE_MRW_RESP_RESERVED7_SFT 1 +u8 event; +#define CREQ_ALLOCATE_MRW_RESP_EVENT_ALLOCATE_MRW 0xdUL +__le16 reserved48[3 ]; +}; + +/* De-allocate key command response (16 bytes) */ +struct creq_deallocate_key_resp { +u8 type; +#define CREQ_DEALLOCATE_KEY_RESP_TYPE_MASK 0x3fUL +#define CREQ_DEALLOCATE_KEY_RESP_TYPE_SFT 0 +#define CREQ_DEALLOCATE_KEY_RESP_TYPE_QP_EVENT 0x38UL +#define CREQ_DEALLOCATE_KEY_RESP_RESERVED2_MASK 0xc0UL +#define CREQ_DEALLOCATE_KEY_RESP_RESERVED2_SFT 6 +u8 status; +__le16 cookie; +__le32 xid; +u8 v; +#define CREQ_DEALLOCATE_KEY_RESP_V 0x1UL +#define CREQ_DEALLOCATE_KEY_RESP_RESERVED7_MASK 0xfeUL +#define CREQ_DEALLOCATE_KEY_RESP_RESERVED7_SFT 1 +u8 event; +#define CREQ_DEALLOCATE_KEY_RESP_EVENT_DEALLOCATE_KEY 0xeUL +__le16 reserved16; +__le32 bound_window_info; +}; + +/* Register MR command response (16 bytes) */ +struct creq_register_mr_resp { +u8 type; +#define CREQ_REGISTER_MR_RESP_TYPE_MASK 0x3fUL +#define CREQ_REGISTER_MR_RESP_TYPE_SFT 0 +#define CREQ_REGISTER_MR_RESP_TYPE_QP_EVENT 0x38UL +#define CREQ_REGISTER_MR_RESP_RESERVED2_MASK 0xc0UL +#define CREQ_REGISTER_MR_RESP_RESERVED2_SFT 6 +u8 status; +__le16 cookie; +__le32 xid; +u8 v; +#define CREQ_REGISTER_MR_RESP_V 0x1UL +#define CREQ_REGISTER_MR_RESP_RESERVED7_MASK 0xfeUL +#define CREQ_REGISTER_MR_RESP_RESERVED7_SFT 1 +u8 event; +#define CREQ_REGISTER_MR_RESP_EVENT_REGISTER_MR 0xfUL +__le16 reserved48[3 ]; +}; + +/* Deregister MR command response (16 bytes) */ +struct creq_deregister_mr_resp { +u8 type; +#define CREQ_DEREGISTER_MR_RESP_TYPE_MASK 0x3fUL +#define CREQ_DEREGISTER_MR_RESP_TYPE_SFT 0 +#define CREQ_DEREGISTER_MR_RESP_TYPE_QP_EVENT 0x38UL +#define CREQ_DEREGISTER_MR_RESP_RESERVED2_MASK 0xc0UL +#define CREQ_DEREGISTER_MR_RESP_RESERVED2_SFT 6 +u8 status; +__le16 cookie; +__le32 xid; +u8 v; +#define CREQ_DEREGISTER_MR_RESP_V 0x1UL +#define CREQ_DEREGISTER_MR_RESP_RESERVED7_MASK 0xfeUL +#define CREQ_DEREGISTER_MR_RESP_RESERVED7_SFT 1 +u8 event; +#define CREQ_DEREGISTER_MR_RESP_EVENT_DEREGISTER_MR 0x10UL +__le16 reserved16; +__le32 bound_windows; +}; + +/* Add GID command response (16 bytes) */ +struct creq_add_gid_resp { +u8 type; +#define CREQ_ADD_GID_RESP_TYPE_MASK 0x3fUL +#define CREQ_ADD_GID_RESP_TYPE_SFT 0 +#define CREQ_ADD_GID_RESP_TYPE_QP_EVENT 0x38UL +#define CREQ_ADD_GID_RESP_RESERVED2_MASK 0xc0UL +#define CREQ_ADD_GID_RESP_RESERVED2_SFT 6 +u8 status; +__le16 cookie; +__le32 xid; +u8 v; +#define CREQ_ADD_GID_RESP_V 0x1UL +#define CREQ_ADD_GID_RESP_RESERVED7_MASK 0xfeUL +#define CREQ_ADD_GID_RESP_RESERVED7_SFT 1 +u8 event; +#define CREQ_ADD_GID_RESP_EVENT_ADD_GID 0x11UL +__le16 reserved48[3 ]; +}; + +/* Delete GID command response (16 bytes) */ +struct creq_delete_gid_resp { +u8 type; +#define CREQ_DELETE_GID_RESP_TYPE_MASK 0x3fUL +#define CREQ_DELETE_GID_RESP_TYPE_SFT 0 +#define CREQ_DELETE_GID_RESP_TYPE_QP_EVENT 0x38UL +#define CREQ_DELETE_GID_RESP_RESERVED2_MASK 0xc0UL +#define CREQ_DELETE_GID_RESP_RESERVED2_SFT 6 +u8 status; +__le16 cookie; +__le32 xid; +u8 v; +#define CREQ_DELETE_GID_RESP_V 0x1UL +#define CREQ_DELETE_GID_RESP_RESERVED7_MASK 0xfeUL +#define CREQ_DELETE_GID_RESP_RESERVED7_SFT 1 +u8 event; +#define CREQ_DELETE_GID_RESP_EVENT_DELETE_GID 0x12UL +__le16 reserved48[3 ]; +}; + +/* Modify GID command response (16 bytes) */ +struct creq_modify_gid_resp { +u8 type; +#define CREQ_MODIFY_GID_RESP_TYPE_MASK 0x3fUL +#define CREQ_MODIFY_GID_RESP_TYPE_SFT 0 +#define CREQ_MODIFY_GID_RESP_TYPE_QP_EVENT 0x38UL +#define CREQ_MODIFY_GID_RESP_RESERVED2_MASK 0xc0UL +#define CREQ_MODIFY_GID_RESP_RESERVED2_SFT 6 +u8 status; +__le16 cookie; +__le32 xid; +u8 v; +#define CREQ_MODIFY_GID_RESP_V 0x1UL +#define CREQ_MODIFY_GID_RESP_RESERVED7_MASK 0xfeUL +#define CREQ_MODIFY_GID_RESP_RESERVED7_SFT 1 +u8 event; +#define CREQ_MODIFY_GID_RESP_EVENT_ADD_GID 0x11UL +__le16 reserved48[3 ]; +}; + +/* Query GID command response (16 bytes) */ +struct creq_query_gid_resp { +u8 type; +#define CREQ_QUERY_GID_RESP_TYPE_MASK 0x3fUL +#define CREQ_QUERY_GID_RESP_TYPE_SFT 0 +#define CREQ_QUERY_GID_RESP_TYPE_QP_EVENT 0x38UL +#define CREQ_QUERY_GID_RESP_RESERVED2_MASK 0xc0UL +#define CREQ_QUERY_GID_RESP_RESERVED2_SFT 6 +u8 status; +__le16 cookie; +__le32 size; +u8 v; +#define CREQ_QUERY_GID_RESP_V 0x1UL +#define CREQ_QUERY_GID_RESP_RESERVED7_MASK 0xfeUL +#define CREQ_QUERY_GID_RESP_RESERVED7_SFT 1 +u8 event; +#define CREQ_QUERY_GID_RESP_EVENT_QUERY_GID 0x18UL +__le16 reserved48[3 ]; +}; + +/* Query GID command response side buffer structure (40 bytes) */ +struct creq_query_gid_resp_sb { +u8 opcode; +#define CREQ_QUERY_GID_RESP_SB_OPCODE_QUERY_GID 0x18UL +u8 status; +__le16 cookie; +__le16 flags; +u8 resp_size; +u8 reserved8; +__le32 gid[4 ]; +__le16 src_mac[3 ]; +__le16 vlan; +#define CREQ_QUERY_GID_RESP_SB_VLAN_VLAN_ID_MASK 0xfffUL +#define CREQ_QUERY_GID_RESP_SB_VLAN_VLAN_ID_SFT 0 +#define CREQ_QUERY_GID_RESP_SB_VLAN_TPID_MASK 0x7000UL +#define CREQ_QUERY_GID_RESP_SB_VLAN_TPID_SFT 12 +#define CREQ_QUERY_GID_RESP_SB_VLAN_TPID_TPID_88A8 (0x0UL << 12) +#define CREQ_QUERY_GID_RESP_SB_VLAN_TPID_TPID_8100 (0x1UL << 12) +#define CREQ_QUERY_GID_RESP_SB_VLAN_TPID_TPID_9100 (0x2UL << 12) +#define CREQ_QUERY_GID_RESP_SB_VLAN_TPID_TPID_9200 (0x3UL << 12) +#define CREQ_QUERY_GID_RESP_SB_VLAN_TPID_TPID_9300 (0x4UL << 12) +#define CREQ_QUERY_GID_RESP_SB_VLAN_TPID_TPID_CFG1 (0x5UL << 12) +#define CREQ_QUERY_GID_RESP_SB_VLAN_TPID_TPID_CFG2 (0x6UL << 12) +#define CREQ_QUERY_GID_RESP_SB_VLAN_TPID_TPID_CFG3 (0x7UL << 12) +#define CREQ_QUERY_GID_RESP_SB_VLAN_TPID_LAST \ + CREQ_QUERY_GID_RESP_SB_VLAN_TPID_TPID_CFG3 +#define CREQ_QUERY_GID_RESP_SB_VLAN_VLAN_EN 0x8000UL +__le16 ipid; +__le16 gid_index; +__le32 unused_0; +}; + +/* Create QP1 command response (16 bytes) */ +struct creq_create_qp1_resp { +u8 type; +#define CREQ_CREATE_QP1_RESP_TYPE_MASK 0x3fUL +#define CREQ_CREATE_QP1_RESP_TYPE_SFT 0 +#define CREQ_CREATE_QP1_RESP_TYPE_QP_EVENT 0x38UL +#define CREQ_CREATE_QP1_RESP_RESERVED2_MASK 0xc0UL +#define CREQ_CREATE_QP1_RESP_RESERVED2_SFT 6 +u8 status; +__le16 cookie; +__le32 xid; +u8 v; +#define CREQ_CREATE_QP1_RESP_V 0x1UL +#define CREQ_CREATE_QP1_RESP_RESERVED7_MASK 0xfeUL +#define CREQ_CREATE_QP1_RESP_RESERVED7_SFT 1 +u8 event; +#define CREQ_CREATE_QP1_RESP_EVENT_CREATE_QP1 0x13UL +__le16 reserved48[3 ]; +}; + +/* Destroy QP1 command response (16 bytes) */ +struct creq_destroy_qp1_resp { +u8 type; +#define CREQ_DESTROY_QP1_RESP_TYPE_MASK 0x3fUL +#define CREQ_DESTROY_QP1_RESP_TYPE_SFT 0 +#define CREQ_DESTROY_QP1_RESP_TYPE_QP_EVENT 0x38UL +#define CREQ_DESTROY_QP1_RESP_RESERVED2_MASK 0xc0UL +#define CREQ_DESTROY_QP1_RESP_RESERVED2_SFT 6 +u8 status; +__le16 cookie; +__le32 xid; +u8 v; +#define CREQ_DESTROY_QP1_RESP_V 0x1UL +#define CREQ_DESTROY_QP1_RESP_RESERVED7_MASK 0xfeUL +#define CREQ_DESTROY_QP1_RESP_RESERVED7_SFT 1 +u8 event; +#define CREQ_DESTROY_QP1_RESP_EVENT_DESTROY_QP1 0x14UL +__le16 reserved48[3 ]; +}; + +/* Create AH command response (16 bytes) */ +struct creq_create_ah_resp { +u8 type; +#define CREQ_CREATE_AH_RESP_TYPE_MASK 0x3fUL +#define CREQ_CREATE_AH_RESP_TYPE_SFT 0 +#define CREQ_CREATE_AH_RESP_TYPE_QP_EVENT 0x38UL +#define CREQ_CREATE_AH_RESP_RESERVED2_MASK 0xc0UL +#define CREQ_CREATE_AH_RESP_RESERVED2_SFT 6 +u8 status; +__le16 cookie; +__le32 xid; +u8 v; +#define CREQ_CREATE_AH_RESP_V 0x1UL +#define CREQ_CREATE_AH_RESP_RESERVED7_MASK 0xfeUL +#define CREQ_CREATE_AH_RESP_RESERVED7_SFT 1 +u8 event; +#define CREQ_CREATE_AH_RESP_EVENT_CREATE_AH 0x15UL +__le16 reserved48[3 ]; +}; + +/* Destroy AH command response (16 bytes) */ +struct creq_destroy_ah_resp { +u8 type; +#define CREQ_DESTROY_AH_RESP_TYPE_MASK 0x3fUL +#define CREQ_DESTROY_AH_RESP_TYPE_SFT 0 +#define CREQ_DESTROY_AH_RESP_TYPE_QP_EVENT 0x38UL +#define CREQ_DESTROY_AH_RESP_RESERVED2_MASK 0xc0UL +#define CREQ_DESTROY_AH_RESP_RESERVED2_SFT 6 +u8 status; +__le16 cookie; +__le32 xid; +u8 v; +#define CREQ_DESTROY_AH_RESP_V 0x1UL +#define CREQ_DESTROY_AH_RESP_RESERVED7_MASK 0xfeUL +#define CREQ_DESTROY_AH_RESP_RESERVED7_SFT 1 +u8 event; +#define CREQ_DESTROY_AH_RESP_EVENT_DESTROY_AH 0x16UL +__le16 reserved48[3 ]; +}; + +/* Initialize Firmware command response (16 bytes) */ +struct creq_initialize_fw_resp { +u8 type; +#define CREQ_INITIALIZE_FW_RESP_TYPE_MASK 0x3fUL +#define CREQ_INITIALIZE_FW_RESP_TYPE_SFT 0 +#define CREQ_INITIALIZE_FW_RESP_TYPE_QP_EVENT 0x38UL +#define CREQ_INITIALIZE_FW_RESP_RESERVED2_MASK 0xc0UL +#define CREQ_INITIALIZE_FW_RESP_RESERVED2_SFT 6 +u8 status; +__le16 cookie; +__le32 reserved32; +u8 v; +#define CREQ_INITIALIZE_FW_RESP_V 0x1UL +#define CREQ_INITIALIZE_FW_RESP_RESERVED7_MASK 0xfeUL +#define CREQ_INITIALIZE_FW_RESP_RESERVED7_SFT 1 +u8 event; +#define CREQ_INITIALIZE_FW_RESP_EVENT_INITIALIZE_FW 0x80UL +__le16 reserved48[3 ]; +}; + +/* De-initialize Firmware command response (16 bytes) */ +struct creq_deinitialize_fw_resp { +u8 type; +#define CREQ_DEINITIALIZE_FW_RESP_TYPE_MASK 0x3fUL +#define CREQ_DEINITIALIZE_FW_RESP_TYPE_SFT 0 +#define CREQ_DEINITIALIZE_FW_RESP_TYPE_QP_EVENT 0x38UL +#define CREQ_DEINITIALIZE_FW_RESP_RESERVED2_MASK 0xc0UL +#define CREQ_DEINITIALIZE_FW_RESP_RESERVED2_SFT 6 +u8 status; +__le16 cookie; +__le32 reserved32; +u8 v; +#define CREQ_DEINITIALIZE_FW_RESP_V 0x1UL +#define CREQ_DEINITIALIZE_FW_RESP_RESERVED7_MASK 0xfeUL +#define CREQ_DEINITIALIZE_FW_RESP_RESERVED7_SFT 1 +u8 event; +#define CREQ_DEINITIALIZE_FW_RESP_EVENT_DEINITIALIZE_FW 0x81UL +__le16 reserved48[3 ]; +}; + +/* Stop function command response (16 bytes) */ +struct creq_stop_func_resp { +u8 type; +#define CREQ_STOP_FUNC_RESP_TYPE_MASK 0x3fUL +#define CREQ_STOP_FUNC_RESP_TYPE_SFT 0 +#define CREQ_STOP_FUNC_RESP_TYPE_QP_EVENT 0x38UL +#define CREQ_STOP_FUNC_RESP_RESERVED2_MASK 0xc0UL +#define CREQ_STOP_FUNC_RESP_RESERVED2_SFT 6 +u8 status; +__le16 cookie; +__le32 reserved32; +u8 v; +#define CREQ_STOP_FUNC_RESP_V 0x1UL +#define CREQ_STOP_FUNC_RESP_RESERVED7_MASK 0xfeUL +#define CREQ_STOP_FUNC_RESP_RESERVED7_SFT 1 +u8 event; +#define CREQ_STOP_FUNC_RESP_EVENT_STOP_FUNC 0x82UL +__le16 reserved48[3 ]; +}; + +/* Query function command response (16 bytes) */ +struct creq_query_func_resp { +u8 type; +#define CREQ_QUERY_FUNC_RESP_TYPE_MASK 0x3fUL +#define CREQ_QUERY_FUNC_RESP_TYPE_SFT 0 +#define CREQ_QUERY_FUNC_RESP_TYPE_QP_EVENT 0x38UL +#define CREQ_QUERY_FUNC_RESP_RESERVED2_MASK 0xc0UL +#define CREQ_QUERY_FUNC_RESP_RESERVED2_SFT 6 +u8 status; +__le16 cookie; +__le32 size; +u8 v; +#define CREQ_QUERY_FUNC_RESP_V 0x1UL +#define CREQ_QUERY_FUNC_RESP_RESERVED7_MASK 0xfeUL +#define CREQ_QUERY_FUNC_RESP_RESERVED7_SFT 1 +u8 event; +#define CREQ_QUERY_FUNC_RESP_EVENT_QUERY_FUNC 0x83UL +__le16 reserved48[3 ]; +}; + +/* Query function command response side buffer structure (88 bytes) */ +struct creq_query_func_resp_sb { +u8 opcode; +#define CREQ_QUERY_FUNC_RESP_SB_OPCODE_QUERY_FUNC 0x83UL +u8 status; +__le16 cookie; +__le16 flags; +u8 resp_size; +u8 reserved8; +__le64 max_mr_size; +__le32 max_qp; +__le16 max_qp_wr; +__le16 dev_cap_flags; +#define CREQ_QUERY_FUNC_RESP_SB_DEV_CAP_FLAGS_RESIZE_QP 0x1UL +__le32 max_cq; +__le32 max_cqe; +__le32 max_pd; +u8 max_sge; +u8 max_srq_sge; +u8 max_qp_rd_atom; +u8 max_qp_init_rd_atom; +__le32 max_mr; +__le32 max_mw; +__le32 max_raw_eth_qp; +__le32 max_ah; +__le32 max_fmr; +__le32 max_srq_wr; +__le32 max_pkeys; +__le32 max_inline_data; +u8 max_map_per_fmr; +u8 l2_db_space_size; +__le16 max_srq; +__le32 max_gid; +__le32 tqm_alloc_reqs[8 ]; +}; + +/* Set resources command response (16 bytes) */ +struct creq_set_func_resources_resp { +u8 type; +#define CREQ_SET_FUNC_RESOURCES_RESP_TYPE_MASK 0x3fUL +#define CREQ_SET_FUNC_RESOURCES_RESP_TYPE_SFT 0 +#define CREQ_SET_FUNC_RESOURCES_RESP_TYPE_QP_EVENT 0x38UL +#define CREQ_SET_FUNC_RESOURCES_RESP_RESERVED2_MASK 0xc0UL +#define CREQ_SET_FUNC_RESOURCES_RESP_RESERVED2_SFT 6 +u8 status; +__le16 cookie; +__le32 reserved32; +u8 v; +#define CREQ_SET_FUNC_RESOURCES_RESP_V 0x1UL +#define CREQ_SET_FUNC_RESOURCES_RESP_RESERVED7_MASK 0xfeUL +#define CREQ_SET_FUNC_RESOURCES_RESP_RESERVED7_SFT 1 +u8 event; +#define CREQ_SET_FUNC_RESOURCES_RESP_EVENT_SET_FUNC_RESOURCES 0x84UL +__le16 reserved48[3 ]; +}; + +/* Map TC to COS response (16 bytes) */ +struct creq_map_tc_to_cos_resp { +u8 type; +#define CREQ_MAP_TC_TO_COS_RESP_TYPE_MASK 0x3fUL +#define CREQ_MAP_TC_TO_COS_RESP_TYPE_SFT 0 +#define CREQ_MAP_TC_TO_COS_RESP_TYPE_QP_EVENT 0x38UL +#define CREQ_MAP_TC_TO_COS_RESP_RESERVED2_MASK 0xc0UL +#define CREQ_MAP_TC_TO_COS_RESP_RESERVED2_SFT 6 +u8 status; +__le16 cookie; +__le32 reserved32; +u8 v; +#define CREQ_MAP_TC_TO_COS_RESP_V 0x1UL +#define CREQ_MAP_TC_TO_COS_RESP_RESERVED7_MASK 0xfeUL +#define CREQ_MAP_TC_TO_COS_RESP_RESERVED7_SFT 1 +u8 event; +#define CREQ_MAP_TC_TO_COS_RESP_EVENT_MAP_TC_TO_COS 0x8aUL +__le16 reserved48[3 ]; +}; + +/* Query version response (16 bytes) */ +struct creq_query_version_resp { +u8 type; +#define CREQ_QUERY_VERSION_RESP_TYPE_MASK 0x3fUL +#define CREQ_QUERY_VERSION_RESP_TYPE_SFT 0 +#define CREQ_QUERY_VERSION_RESP_TYPE_QP_EVENT 0x38UL +#define CREQ_QUERY_VERSION_RESP_RESERVED2_MASK 0xc0UL +#define CREQ_QUERY_VERSION_RESP_RESERVED2_SFT 6 +u8 status; +__le16 cookie; +u8 fw_maj; +u8 fw_minor; +u8 fw_bld; +u8 fw_rsvd; +u8 v; +#define CREQ_QUERY_VERSION_RESP_V 0x1UL +#define CREQ_QUERY_VERSION_RESP_RESERVED7_MASK 0xfeUL +#define CREQ_QUERY_VERSION_RESP_RESERVED7_SFT 1 +u8 event; +#define CREQ_QUERY_VERSION_RESP_EVENT_QUERY_VERSION 0x8bUL +__le16 reserved16; +u8 intf_maj; +u8 intf_minor; +u8 intf_bld; +u8 intf_rsvd; +}; + +/* Modify congestion control command response (16 bytes) */ +struct creq_modify_cc_resp { +u8 type; +#define CREQ_MODIFY_CC_RESP_TYPE_MASK 0x3fUL +#define CREQ_MODIFY_CC_RESP_TYPE_SFT 0 +#define CREQ_MODIFY_CC_RESP_TYPE_QP_EVENT 0x38UL +#define CREQ_MODIFY_CC_RESP_RESERVED2_MASK 0xc0UL +#define CREQ_MODIFY_CC_RESP_RESERVED2_SFT 6 +u8 status; +__le16 cookie; +__le32 reserved32; +u8 v; +#define CREQ_MODIFY_CC_RESP_V 0x1UL +#define CREQ_MODIFY_CC_RESP_RESERVED7_MASK 0xfeUL +#define CREQ_MODIFY_CC_RESP_RESERVED7_SFT 1 +u8 event; +#define CREQ_MODIFY_CC_RESP_EVENT_MODIFY_CC 0x8cUL +__le16 reserved48[3 ]; +}; + +/* Query congestion control command response (16 bytes) */ +struct creq_query_cc_resp { +u8 type; +#define CREQ_QUERY_CC_RESP_TYPE_MASK 0x3fUL +#define CREQ_QUERY_CC_RESP_TYPE_SFT 0 +#define CREQ_QUERY_CC_RESP_TYPE_QP_EVENT 0x38UL +#define CREQ_QUERY_CC_RESP_RESERVED2_MASK 0xc0UL +#define CREQ_QUERY_CC_RESP_RESERVED2_SFT 6 +u8 status; +__le16 cookie; +__le32 size; +u8 v; +#define CREQ_QUERY_CC_RESP_V 0x1UL +#define CREQ_QUERY_CC_RESP_RESERVED7_MASK 0xfeUL +#define CREQ_QUERY_CC_RESP_RESERVED7_SFT 1 +u8 event; +#define CREQ_QUERY_CC_RESP_EVENT_QUERY_CC 0x8dUL +__le16 reserved48[3 ]; +}; + +/* Query congestion control command response side buffer structure (32 bytes) */ +struct creq_query_cc_resp_sb { +u8 opcode; +#define CREQ_QUERY_CC_RESP_SB_OPCODE_QUERY_CC 0x8dUL +u8 status; +__le16 cookie; +__le16 flags; +u8 resp_size; +u8 reserved8; +u8 enable_cc; +#define CREQ_QUERY_CC_RESP_SB_ENABLE_CC 0x1UL +u8 g; +#define CREQ_QUERY_CC_RESP_SB_G_MASK 0x7UL +#define CREQ_QUERY_CC_RESP_SB_G_SFT 0 +u8 num_phases_per_state; +__le16 init_cr; +u8 unused_2; +__le16 unused_3; +u8 unused_4; +__le16 init_tr; +u8 tos_dscp_tos_ecn; +#define CREQ_QUERY_CC_RESP_SB_TOS_ECN_MASK 0x3UL +#define CREQ_QUERY_CC_RESP_SB_TOS_ECN_SFT 0 +#define CREQ_QUERY_CC_RESP_SB_TOS_DSCP_MASK 0xfcUL +#define CREQ_QUERY_CC_RESP_SB_TOS_DSCP_SFT 2 +__le64 reserved64; +__le64 reserved64_1; +}; + +/* QP error notification event (16 bytes) */ +struct creq_qp_error_notification { +u8 type; +#define CREQ_QP_ERROR_NOTIFICATION_TYPE_MASK 0x3fUL +#define CREQ_QP_ERROR_NOTIFICATION_TYPE_SFT 0 +#define CREQ_QP_ERROR_NOTIFICATION_TYPE_QP_EVENT 0x38UL +#define CREQ_QP_ERROR_NOTIFICATION_RESERVED2_MASK 0xc0UL +#define CREQ_QP_ERROR_NOTIFICATION_RESERVED2_SFT 6 +u8 status; +u8 req_slow_path_state; +u8 req_err_state_reason; +__le32 xid; +u8 v; +#define CREQ_QP_ERROR_NOTIFICATION_V 0x1UL +#define CREQ_QP_ERROR_NOTIFICATION_RESERVED7_MASK 0xfeUL +#define CREQ_QP_ERROR_NOTIFICATION_RESERVED7_SFT 1 +u8 event; +#define CREQ_QP_ERROR_NOTIFICATION_EVENT_QP_ERROR_NOTIFICATION 0xc0UL +u8 res_slow_path_state; +u8 res_err_state_reason; +__le16 sq_cons_idx; +__le16 rq_cons_idx; +}; + +/* RoCE Slowpath HSI Specification 1.6.0 */ +#define ROCE_SP_HSI_VERSION_MAJOR 1 +#define ROCE_SP_HSI_VERSION_MINOR 6 +#define ROCE_SP_HSI_VERSION_UPDATE 0 + +#define ROCE_SP_HSI_VERSION_STR "1.6.0" +/* +* Following is the signature for ROCE_SP_HSI message field that indicates not +* applicable (All F's). Need to cast it the size of the field if needed. +*/ +#define ROCE_SP_HSI_NA_SIGNATURE ((__le32)(-1))#endif /* __BNXT_RE_HSI_H__ */
Signature · 6 lines
2.5.5 -- To unsubscribe from this list: send the line "unsubscribe linux-rdma" in the body of a message to [email protected] More majordomo info at http://vger.kernel.org/majordomo-info.html
PATCH v5 3/21 RDMA/bnxt_re: register with the NIC driver
In reply to a message not in the archiveThis patch handles the registration with the bnxt_en driver. The bnxt_re driver first registers with netdev notifier chain and upon receiving the NETDEV_REGISTER event, it registers with bnxt_en driver.
1. bnxt_en's ulp_probe function returns a structure that contains
information about the device and additional entry points.
2. bnxt_en driver returns 'struct bnxt_eth_dev' that contains set of operation vectors that bnxt_re driver invokes later.
3. bnxt_request_msix() allows the bnxt_re driver to specify the number of MSI-X vectors that are needed.
4. bnxt_send_fw_msg () is used to send messages to the FW
5. bnxt_register_async_events() is used to register for async event callbacks.
v2: Remove some sparse warning. Also, remove some unused code from unreg
path.
v3: Removed condition checks for rdev reported during static code analysis.
Check the return value of try_module_get while getting bnxt_en reference.
v5: rdev->ref_count is not used for any check. So removing the code that
operates on this ref_count. This will take care of the comments from Doug and Leon. Code is refactored to avoid using 'goto' in the middle of a switch/case construct. This patch also adds a check for RoCE support in the device before proceeding with initialization.
--- drivers/infiniband/hw/bnxt_re/bnxt_re.h | 49 ++++ drivers/infiniband/hw/bnxt_re/main.c | 424 ++++++++++++++++++++++++++++++++ 2 files changed, 473 insertions(+)
drivers/infiniband/hw/bnxt_re/bnxt_re.h +49 -0
@@ -43,4 +43,53 @@#define ROCE_DRV_MODULE_VERSION "1.0.0"#define BNXT_RE_DESC "Broadcom NetXtreme-C/E RoCE Driver" + +struct bnxt_re_work { +struct work_struct work; +unsigned long event; +struct bnxt_re_dev *rdev; +struct net_device *vlan_dev; +}; + +#define BNXT_RE_MIN_MSIX 2 +#define BNXT_RE_MAX_MSIX 16 +struct bnxt_re_dev { +struct ib_device ibdev; +struct list_head list; +unsigned long flags; +#define BNXT_RE_FLAG_NETDEV_REGISTERED 0 +#define BNXT_RE_FLAG_IBDEV_REGISTERED 1 +#define BNXT_RE_FLAG_GOT_MSIX 2 +#define BNXT_RE_FLAG_RCFW_CHANNEL_EN 8 +#define BNXT_RE_FLAG_QOS_WORK_REG 16 +struct net_device *netdev; +unsigned int version, major, minor; +struct bnxt_en_dev *en_dev; +struct bnxt_msix_entry msix_entries[BNXT_RE_MAX_MSIX ]; +int num_msix; + +int id; + +atomic_t qp_count; +struct mutex qp_lock;/* protect qp list */ +struct list_head qp_list; + +atomic_t cq_count; +atomic_t srq_count; +atomic_t mr_count; +atomic_t mw_count; +/* Max of 2 lossless traffic class supported per port */ +u16 cosq[2 ]; +}; + +#define to_bnxt_re_dev (ptr, member) \ + container_of((ptr), struct bnxt_re_dev, member) + +static inline struct device *rdev_to_dev (struct bnxt_re_dev *rdev) +{ +if (rdev) +return &rdev->ibdev.dev; +return NULL ; +} +#endif
drivers/infiniband/hw/bnxt_re/main.c +424 -0
446 lines not on this page · raw message
Signature · 6 lines
2.5.5 -- To unsubscribe from this list: send the line "unsubscribe linux-rdma" in the body of a message to [email protected] More majordomo info at http://vger.kernel.org/majordomo-info.html
PATCH v5 8/21 RDMA/bnxt_re: Adding support for port related verbs
In reply to a message not in the archiveImplements query_port, modify_port and port_immutable verbs
--- drivers/infiniband/hw/bnxt_re/ib_verbs.c | 122 +++++++++++++++++++++++++++++++ drivers/infiniband/hw/bnxt_re/ib_verbs.h | 7 ++ drivers/infiniband/hw/bnxt_re/main.c | 4 + 3 files changed, 133 insertions(+)
drivers/infiniband/hw/bnxt_re/ib_verbs.c +122 -0
@@ -150,6 +150,128 @@ int bnxt_re_modify_device(struct ib_device *ibdev,return 0 ; } +static void __to_ib_speed_width (struct net_device *netdev,u8 *speed,u8 *width) +{ +struct ethtool_link_ksettings lksettings; +u32 espeed; + +if (netdev->ethtool_ops && netdev->ethtool_ops->get_link_ksettings) { +memset (&lksettings,0 ,sizeof (lksettings)); +rtnl_lock (); + netdev->ethtool_ops->get_link_ksettings (netdev, &lksettings); +rtnl_unlock (); + espeed = lksettings.base.speed; + }else { + espeed =SPEED_UNKNOWN ; + } +switch (espeed) { +case SPEED_1000 : + *speed =IB_SPEED_SDR ; + *width =IB_WIDTH_1X ; +break ; +case SPEED_10000 : + *speed =IB_SPEED_QDR ; + *width =IB_WIDTH_1X ; +break ; +case SPEED_20000 : + *speed =IB_SPEED_DDR ; + *width =IB_WIDTH_4X ; +break ; +case SPEED_25000 : + *speed =IB_SPEED_EDR ; + *width =IB_WIDTH_1X ; +break ; +case SPEED_40000 : + *speed =IB_SPEED_QDR ; + *width =IB_WIDTH_4X ; +break ; +case SPEED_50000 : +break ; +default : + *speed =IB_SPEED_SDR ; + *width =IB_WIDTH_1X ; +break ; + } +} + +/* Port */ +int bnxt_re_query_port (struct ib_device *ibdev,u8 port_num, +struct ib_port_attr *port_attr) +{ +struct bnxt_re_dev *rdev =to_bnxt_re_dev (ibdev, ibdev); +struct bnxt_qplib_dev_attr *dev_attr = &rdev->dev_attr; + +memset (port_attr,0 ,sizeof (*port_attr)); + +if (netif_running (rdev->netdev) &&netif_carrier_ok (rdev->netdev)) { + port_attr->state =IB_PORT_ACTIVE ; + port_attr->phys_state =5 ; + }else { + port_attr->state =IB_PORT_DOWN ; + port_attr->phys_state =3 ; + } + port_attr->max_mtu =IB_MTU_4096 ; + port_attr->active_mtu =iboe_get_mtu (rdev->netdev->mtu); + port_attr->gid_tbl_len = dev_attr->max_sgid; + port_attr->port_cap_flags =IB_PORT_CM_SUP |IB_PORT_REINIT_SUP | +IB_PORT_DEVICE_MGMT_SUP | +IB_PORT_VENDOR_CLASS_SUP | +IB_PORT_IP_BASED_GIDS ; + +/* Max MSG size set to 2G for now */ + port_attr->max_msg_sz =0x80000000 ; + port_attr->bad_pkey_cntr =0 ; + port_attr->qkey_viol_cntr =0 ; + port_attr->pkey_tbl_len = dev_attr->max_pkey; + port_attr->lid =0 ; + port_attr->sm_lid =0 ; + port_attr->lmc =0 ; + port_attr->max_vl_num =4 ; + port_attr->sm_sl =0 ; + port_attr->subnet_timeout =0 ; + port_attr->init_type_reply =0 ; +/* call the underlying netdev's ethtool hooks to query speed settings +* for which we acquire rtnl_lock _only_ if it's registered with +* IB stack to avoid race in the NETDEV_UNREG path +*/ +if (test_bit (BNXT_RE_FLAG_IBDEV_REGISTERED , &rdev->flags)) +__to_ib_speed_width (rdev->netdev, &port_attr->active_speed, + &port_attr->active_width); +return 0 ; +} + +int bnxt_re_modify_port (struct ib_device *ibdev,u8 port_num, +int port_modify_mask, +struct ib_port_modify *port_modify) +{ +switch (port_modify_mask) { +case IB_PORT_SHUTDOWN : +break ; +case IB_PORT_INIT_TYPE : +break ; +case IB_PORT_RESET_QKEY_CNTR : +break ; +default : +break ; + } +return 0 ; +} + +int bnxt_re_get_port_immutable (struct ib_device *ibdev,u8 port_num, +struct ib_port_immutable *immutable) +{ +struct ib_port_attr port_attr; + +if (bnxt_re_query_port (ibdev, port_num, &port_attr)) +return -EINVAL ; + + immutable->pkey_tbl_len = port_attr.pkey_tbl_len; + immutable->gid_tbl_len = port_attr.gid_tbl_len; + immutable->core_cap_flags =RDMA_CORE_PORT_IBA_ROCE ; + immutable->core_cap_flags |=RDMA_CORE_CAP_PROT_ROCE_UDP_ENCAP ; + immutable->max_mad_size =IB_MGMT_MAD_SIZE ; +return 0 ; +}/* Protection Domains */ int bnxt_re_dealloc_pd (struct ib_pd *ib_pd) {
drivers/infiniband/hw/bnxt_re/ib_verbs.h +7 -0
@@ -60,6 +60,13 @@ int bnxt_re_query_device(struct ib_device *ibdev,int bnxt_re_modify_device (struct ib_device *ibdev,int device_modify_mask,struct ib_device_modify *device_modify); +int bnxt_re_query_port (struct ib_device *ibdev,u8 port_num, +struct ib_port_attr *port_attr); +int bnxt_re_modify_port (struct ib_device *ibdev,u8 port_num, +int port_modify_mask, +struct ib_port_modify *port_modify); +int bnxt_re_get_port_immutable (struct ib_device *ibdev,u8 port_num, +struct ib_port_immutable *immutable);struct ib_pd *bnxt_re_alloc_pd (struct ib_device *ibdev,struct ib_ucontext *context,struct ib_udata *udata);
drivers/infiniband/hw/bnxt_re/main.c +4 -0
@@ -434,6 +434,10 @@ static int bnxt_re_register_ib(struct bnxt_re_dev *rdev) ibdev->dma_device = &rdev->en_dev->pdev->dev; ibdev->query_device = bnxt_re_query_device; ibdev->modify_device = bnxt_re_modify_device; + + ibdev->query_port = bnxt_re_query_port; + ibdev->modify_port = bnxt_re_modify_port; + ibdev->get_port_immutable = bnxt_re_get_port_immutable; ibdev->alloc_pd = bnxt_re_alloc_pd; ibdev->dealloc_pd = bnxt_re_dealloc_pd; ibdev->alloc_ucontext = bnxt_re_alloc_ucontext;
Signature · 6 lines
2.5.5 -- To unsubscribe from this list: send the line "unsubscribe linux-rdma" in the body of a message to [email protected] More majordomo info at http://vger.kernel.org/majordomo-info.html
PATCH v5 16/21 RDMA/bnxt_re: Support poll_cq verb
In reply to a message not in the archiveEnables the fastpath ib_poll_cq verb.
v2: Fixed sparse warnings
v3: Fixes endianness related warnings reported by sparse. Also, fixes
smatch and checkpatch warnings
v5: Uses ETH_P_IBOE macro for RoCE ethertype
--- drivers/infiniband/hw/bnxt_re/ib_verbs.c | 522 ++++++++++++++++++++++++++++ drivers/infiniband/hw/bnxt_re/ib_verbs.h | 1 + drivers/infiniband/hw/bnxt_re/main.c | 22 +- drivers/infiniband/hw/bnxt_re/qplib_fp.c | 560 ++++++++++++++++++++++++++++++- drivers/infiniband/hw/bnxt_re/qplib_fp.h | 7 +- 5 files changed, 1107 insertions(+), 5 deletions(-)
drivers/infiniband/hw/bnxt_re/ib_verbs.c +522 -0
@@ -2230,6 +2230,528 @@ struct ib_cq *bnxt_re_create_cq(struct ib_device *ibdev,return ERR_PTR (rc); } +static u8 __req_to_ib_wc_status (u8 qstatus) +{ +switch (qstatus) { +case CQ_REQ_STATUS_OK : +return IB_WC_SUCCESS ; +case CQ_REQ_STATUS_BAD_RESPONSE_ERR : +return IB_WC_BAD_RESP_ERR ; +case CQ_REQ_STATUS_LOCAL_LENGTH_ERR : +return IB_WC_LOC_LEN_ERR ; +case CQ_REQ_STATUS_LOCAL_QP_OPERATION_ERR : +return IB_WC_LOC_QP_OP_ERR ; +case CQ_REQ_STATUS_LOCAL_PROTECTION_ERR : +return IB_WC_LOC_PROT_ERR ; +case CQ_REQ_STATUS_MEMORY_MGT_OPERATION_ERR : +return IB_WC_GENERAL_ERR ; +case CQ_REQ_STATUS_REMOTE_INVALID_REQUEST_ERR : +return IB_WC_REM_INV_REQ_ERR ; +case CQ_REQ_STATUS_REMOTE_ACCESS_ERR : +return IB_WC_REM_ACCESS_ERR ; +case CQ_REQ_STATUS_REMOTE_OPERATION_ERR : +return IB_WC_REM_OP_ERR ; +case CQ_REQ_STATUS_RNR_NAK_RETRY_CNT_ERR : +return IB_WC_RNR_RETRY_EXC_ERR ; +case CQ_REQ_STATUS_TRANSPORT_RETRY_CNT_ERR : +return IB_WC_RETRY_EXC_ERR ; +case CQ_REQ_STATUS_WORK_REQUEST_FLUSHED_ERR : +return IB_WC_WR_FLUSH_ERR ; +default : +return IB_WC_GENERAL_ERR ; + } +return 0 ; +} + +static u8 __rawqp1_to_ib_wc_status (u8 qstatus) +{ +switch (qstatus) { +case CQ_RES_RAWETH_QP1_STATUS_OK : +return IB_WC_SUCCESS ; +case CQ_RES_RAWETH_QP1_STATUS_LOCAL_ACCESS_ERROR : +return IB_WC_LOC_ACCESS_ERR ; +case CQ_RES_RAWETH_QP1_STATUS_HW_LOCAL_LENGTH_ERR : +return IB_WC_LOC_LEN_ERR ; +case CQ_RES_RAWETH_QP1_STATUS_LOCAL_PROTECTION_ERR : +return IB_WC_LOC_PROT_ERR ; +case CQ_RES_RAWETH_QP1_STATUS_LOCAL_QP_OPERATION_ERR : +return IB_WC_LOC_QP_OP_ERR ; +case CQ_RES_RAWETH_QP1_STATUS_MEMORY_MGT_OPERATION_ERR : +return IB_WC_GENERAL_ERR ; +case CQ_RES_RAWETH_QP1_STATUS_WORK_REQUEST_FLUSHED_ERR : +return IB_WC_WR_FLUSH_ERR ; +case CQ_RES_RAWETH_QP1_STATUS_HW_FLUSH_ERR : +return IB_WC_WR_FLUSH_ERR ; +default : +return IB_WC_GENERAL_ERR ; + } +} + +static u8 __rc_to_ib_wc_status (u8 qstatus) +{ +switch (qstatus) { +case CQ_RES_RC_STATUS_OK : +return IB_WC_SUCCESS ; +case CQ_RES_RC_STATUS_LOCAL_ACCESS_ERROR : +return IB_WC_LOC_ACCESS_ERR ; +case CQ_RES_RC_STATUS_LOCAL_LENGTH_ERR : +return IB_WC_LOC_LEN_ERR ; +case CQ_RES_RC_STATUS_LOCAL_PROTECTION_ERR : +return IB_WC_LOC_PROT_ERR ; +case CQ_RES_RC_STATUS_LOCAL_QP_OPERATION_ERR : +return IB_WC_LOC_QP_OP_ERR ; +case CQ_RES_RC_STATUS_MEMORY_MGT_OPERATION_ERR : +return IB_WC_GENERAL_ERR ; +case CQ_RES_RC_STATUS_REMOTE_INVALID_REQUEST_ERR : +return IB_WC_REM_INV_REQ_ERR ; +case CQ_RES_RC_STATUS_WORK_REQUEST_FLUSHED_ERR : +return IB_WC_WR_FLUSH_ERR ; +case CQ_RES_RC_STATUS_HW_FLUSH_ERR : +return IB_WC_WR_FLUSH_ERR ; +default : +return IB_WC_GENERAL_ERR ; + } +} + +static void bnxt_re_process_req_wc (struct ib_wc *wc,struct bnxt_qplib_cqe *cqe) +{ +switch (cqe->type) { +case BNXT_QPLIB_SWQE_TYPE_SEND : + wc->opcode =IB_WC_SEND ; +break ; +case BNXT_QPLIB_SWQE_TYPE_SEND_WITH_IMM : + wc->opcode =IB_WC_SEND ; + wc->wc_flags |=IB_WC_WITH_IMM ; +break ; +case BNXT_QPLIB_SWQE_TYPE_SEND_WITH_INV : + wc->opcode =IB_WC_SEND ; + wc->wc_flags |=IB_WC_WITH_INVALIDATE ; +break ; +case BNXT_QPLIB_SWQE_TYPE_RDMA_WRITE : + wc->opcode =IB_WC_RDMA_WRITE ; +break ; +case BNXT_QPLIB_SWQE_TYPE_RDMA_WRITE_WITH_IMM : + wc->opcode =IB_WC_RDMA_WRITE ; + wc->wc_flags |=IB_WC_WITH_IMM ; +break ; +case BNXT_QPLIB_SWQE_TYPE_RDMA_READ : + wc->opcode =IB_WC_RDMA_READ ; +break ; +case BNXT_QPLIB_SWQE_TYPE_ATOMIC_CMP_AND_SWP : + wc->opcode =IB_WC_COMP_SWAP ; +break ; +case BNXT_QPLIB_SWQE_TYPE_ATOMIC_FETCH_AND_ADD : + wc->opcode =IB_WC_FETCH_ADD ; +break ; +case BNXT_QPLIB_SWQE_TYPE_LOCAL_INV : + wc->opcode =IB_WC_LOCAL_INV ; +break ; +case BNXT_QPLIB_SWQE_TYPE_REG_MR : + wc->opcode =IB_WC_REG_MR ; +break ; +default : + wc->opcode =IB_WC_SEND ; +break ; + } + + wc->status =__req_to_ib_wc_status (cqe->status); +} + +static int bnxt_re_check_packet_type (u16 raweth_qp1_flags, +u16 raweth_qp1_flags2) +{ +bool is_udp = false, is_ipv6 = false, is_ipv4 = false; + +/* raweth_qp1_flags Bit 9-6 indicates itype */ +if ((raweth_qp1_flags &CQ_RES_RAWETH_QP1_RAWETH_QP1_FLAGS_ITYPE_ROCE ) + !=CQ_RES_RAWETH_QP1_RAWETH_QP1_FLAGS_ITYPE_ROCE ) +return -1 ; + +if (raweth_qp1_flags2 & +CQ_RES_RAWETH_QP1_RAWETH_QP1_FLAGS2_IP_CS_CALC && + raweth_qp1_flags2 & +CQ_RES_RAWETH_QP1_RAWETH_QP1_FLAGS2_L4_CS_CALC ) { + is_udp = true; +/* raweth_qp1_flags2 Bit 8 indicates ip_type. 0-v4 1 - v6 */ + (raweth_qp1_flags2 & +CQ_RES_RAWETH_QP1_RAWETH_QP1_FLAGS2_IP_TYPE ) ? + (is_ipv6 = true) : (is_ipv4 = true); +return ((is_ipv6) ? +BNXT_RE_ROCEV2_IPV6_PACKET : +BNXT_RE_ROCEV2_IPV4_PACKET ); + }else { +return BNXT_RE_ROCE_V1_PACKET ; + } +} + +static int bnxt_re_to_ib_nw_type (int nw_type) +{ +u8 nw_hdr_type =0xFF ; + +switch (nw_type) { +case BNXT_RE_ROCE_V1_PACKET : + nw_hdr_type =RDMA_NETWORK_ROCE_V1 ; +break ; +case BNXT_RE_ROCEV2_IPV4_PACKET : + nw_hdr_type =RDMA_NETWORK_IPV4 ; +break ; +case BNXT_RE_ROCEV2_IPV6_PACKET : + nw_hdr_type =RDMA_NETWORK_IPV6 ; +break ; + } +return nw_hdr_type; +} + +static bool bnxt_re_is_loopback_packet (struct bnxt_re_dev *rdev, +void *rq_hdr_buf) +{ +u8 *tmp_buf =NULL ; +struct ethhdr *eth_hdr; +u16 eth_type; +bool rc = false; + + tmp_buf = (u8 *)rq_hdr_buf; +/* +* If dest mac is not same as I/F mac, this could be a +* loopback address or multicast address, check whether +* it is a loopback packet +*/ +if (!ether_addr_equal (tmp_buf, rdev->netdev->dev_addr)) { + tmp_buf +=4 ; +/* Check the ether type */ + eth_hdr = (struct ethhdr *)tmp_buf; + eth_type =ntohs (eth_hdr->h_proto); +switch (eth_type) { +case ETH_P_IBOE : + rc = true; +break ; +case ETH_P_IP : +case ETH_P_IPV6 : { +u32 len; +struct udphdr *udp_hdr; + + len = (eth_type ==ETH_P_IP ?sizeof (struct iphdr ) : +sizeof (struct ipv6hdr )); + tmp_buf +=sizeof (struct ethhdr ) + len; + udp_hdr = (struct udphdr *)tmp_buf; +if (ntohs (udp_hdr->dest) == +ROCE_V2_UDP_DPORT ) + rc = true; +break ; + } +default : +break ; + } + } + +return rc; +} + +static int bnxt_re_process_raw_qp_pkt_rx (struct bnxt_re_qp *qp1_qp, +struct bnxt_qplib_cqe *cqe) +{ +struct bnxt_re_dev *rdev = qp1_qp->rdev; +struct bnxt_re_sqp_entries *sqp_entry =NULL ; +struct bnxt_re_qp *qp = rdev->qp1_sqp; +struct ib_send_wr *swr; +struct ib_ud_wr udwr; +struct ib_recv_wr rwr; +int pkt_type =0 ; +u32 tbl_idx; +void *rq_hdr_buf; +dma_addr_t rq_hdr_buf_map; +dma_addr_t shrq_hdr_buf_map; +u32 offset =0 ; +u32 skip_bytes =0 ; +struct ib_sge s_sge[2 ]; +struct ib_sge r_sge[2 ]; +int rc; + +memset (&udwr,0 ,sizeof (udwr)); +memset (&rwr,0 ,sizeof (rwr)); +memset (&s_sge,0 ,sizeof (s_sge)); +memset (&r_sge,0 ,sizeof (r_sge)); + + swr = &udwr.wr; + tbl_idx = cqe->wr_id; + + rq_hdr_buf = qp1_qp->qplib_qp.rq_hdr_buf + + (tbl_idx * qp1_qp->qplib_qp.rq_hdr_buf_size); + rq_hdr_buf_map =bnxt_qplib_get_qp_buf_from_index (&qp1_qp->qplib_qp, + tbl_idx); + +/* Shadow QP header buffer */ + shrq_hdr_buf_map =bnxt_qplib_get_qp_buf_from_index (&qp->qplib_qp, + tbl_idx); + sqp_entry = &rdev->sqp_tbl[tbl_idx]; + +/* Store this cqe */ +memcpy (&sqp_entry->cqe, cqe,sizeof (struct bnxt_qplib_cqe )); + sqp_entry->qp1_qp = qp1_qp; + +/* Find packet type from the cqe */ + + pkt_type =bnxt_re_check_packet_type (cqe->raweth_qp1_flags, + cqe->raweth_qp1_flags2); +if (pkt_type <0 ) { +dev_err (rdev_to_dev (rdev),"Invalid packet\n" ); +return -EINVAL ; + } + +/* Adjust the offset for the user buffer and post in the rq */ + +if (pkt_type ==BNXT_RE_ROCEV2_IPV4_PACKET ) + offset =20 ; + +/* +* QP1 loopback packet has 4 bytes of internal header before +* ether header. Skip these four bytes. +*/ +if (bnxt_re_is_loopback_packet (rdev, rq_hdr_buf)) + skip_bytes =4 ; + +/* First send SGE . Skip the ether header*/ + s_sge[0 ].addr = rq_hdr_buf_map +BNXT_QPLIB_MAX_QP1_RQ_ETH_HDR_SIZE + + skip_bytes; + s_sge[0 ].lkey =0xFFFFFFFF ; + s_sge[0 ].length = offset ?BNXT_QPLIB_MAX_GRH_HDR_SIZE_IPV4 : +BNXT_QPLIB_MAX_GRH_HDR_SIZE_IPV6 ; + +/* Second Send SGE */ + s_sge[1 ].addr = s_sge[0 ].addr + s_sge[0 ].length + +BNXT_QPLIB_MAX_QP1_RQ_BDETH_HDR_SIZE ; +if (pkt_type !=BNXT_RE_ROCE_V1_PACKET ) + s_sge[1 ].addr +=8 ; + s_sge[1 ].lkey =0xFFFFFFFF ; + s_sge[1 ].length =256 ; + +/* First recv SGE */ + + r_sge[0 ].addr = shrq_hdr_buf_map; + r_sge[0 ].lkey =0xFFFFFFFF ; + r_sge[0 ].length =40 ; + + r_sge[1 ].addr = sqp_entry->sge.addr + offset; + r_sge[1 ].lkey = sqp_entry->sge.lkey; + r_sge[1 ].length =BNXT_QPLIB_MAX_GRH_HDR_SIZE_IPV6 +256 - offset; + +/* Create receive work request */ + rwr.num_sge =2 ; + rwr.sg_list = r_sge; + rwr.wr_id = tbl_idx; + rwr.next =NULL ; + + rc =bnxt_re_post_recv_shadow_qp (rdev, qp, &rwr); +if (rc) { +dev_err (rdev_to_dev (rdev), +"Failed to post Rx buffers to shadow QP" ); +return -ENOMEM ; + } + + swr->num_sge =2 ; + swr->sg_list = s_sge; + swr->wr_id = tbl_idx; + swr->opcode =IB_WR_SEND ; + swr->next =NULL ; + + udwr.ah = &rdev->sqp_ah->ib_ah; + udwr.remote_qpn = rdev->qp1_sqp->qplib_qp.id; + udwr.remote_qkey = rdev->qp1_sqp->qplib_qp.qkey; + +/* post data received in the send queue */ + rc =bnxt_re_post_send_shadow_qp (rdev, qp, swr); + +return 0 ; +} + +static void bnxt_re_process_res_rawqp1_wc (struct ib_wc *wc, +struct bnxt_qplib_cqe *cqe) +{ + wc->opcode =IB_WC_RECV ; + wc->status =__rawqp1_to_ib_wc_status (cqe->status); + wc->wc_flags |=IB_WC_GRH ; +} + +static void bnxt_re_process_res_rc_wc (struct ib_wc *wc, +struct bnxt_qplib_cqe *cqe) +{ + wc->opcode =IB_WC_RECV ; + wc->status =__rc_to_ib_wc_status (cqe->status); + +if (cqe->flags &CQ_RES_RC_FLAGS_IMM ) + wc->wc_flags |=IB_WC_WITH_IMM ; +if (cqe->flags &CQ_RES_RC_FLAGS_INV ) + wc->wc_flags |=IB_WC_WITH_INVALIDATE ; +if ((cqe->flags & (CQ_RES_RC_FLAGS_RDMA |CQ_RES_RC_FLAGS_IMM )) == + (CQ_RES_RC_FLAGS_RDMA |CQ_RES_RC_FLAGS_IMM )) + wc->opcode =IB_WC_RECV_RDMA_WITH_IMM ; +} + +static void bnxt_re_process_res_shadow_qp_wc (struct bnxt_re_qp *qp, +struct ib_wc *wc, +struct bnxt_qplib_cqe *cqe) +{ +u32 tbl_idx; +struct bnxt_re_dev *rdev = qp->rdev; +struct bnxt_re_qp *qp1_qp =NULL ; +struct bnxt_qplib_cqe *orig_cqe =NULL ; +struct bnxt_re_sqp_entries *sqp_entry =NULL ; +int nw_type; + + tbl_idx = cqe->wr_id; + + sqp_entry = &rdev->sqp_tbl[tbl_idx]; + qp1_qp = sqp_entry->qp1_qp; + orig_cqe = &sqp_entry->cqe; + + wc->wr_id = sqp_entry->wrid; + wc->byte_len = orig_cqe->length; + wc->qp = &qp1_qp->ib_qp; + + wc->ex.imm_data = orig_cqe->immdata; + wc->src_qp = orig_cqe->src_qp; +memcpy (wc->smac, orig_cqe->smac,ETH_ALEN ); + wc->port_num =1 ; + wc->vendor_err = orig_cqe->status; + + wc->opcode =IB_WC_RECV ; + wc->status =__rawqp1_to_ib_wc_status (orig_cqe->status); + wc->wc_flags |=IB_WC_GRH ; + + nw_type =bnxt_re_check_packet_type (orig_cqe->raweth_qp1_flags, + orig_cqe->raweth_qp1_flags2); +if (nw_type >=0 ) { + wc->network_hdr_type =bnxt_re_to_ib_nw_type (nw_type); + wc->wc_flags |=IB_WC_WITH_NETWORK_HDR_TYPE ; + } +} + +static void bnxt_re_process_res_ud_wc (struct ib_wc *wc, +struct bnxt_qplib_cqe *cqe) +{ + wc->opcode =IB_WC_RECV ; + wc->status =__rc_to_ib_wc_status (cqe->status); + +if (cqe->flags &CQ_RES_RC_FLAGS_IMM ) + wc->wc_flags |=IB_WC_WITH_IMM ; +if (cqe->flags &CQ_RES_RC_FLAGS_INV ) + wc->wc_flags |=IB_WC_WITH_INVALIDATE ; +if ((cqe->flags & (CQ_RES_RC_FLAGS_RDMA |CQ_RES_RC_FLAGS_IMM )) == + (CQ_RES_RC_FLAGS_RDMA |CQ_RES_RC_FLAGS_IMM )) + wc->opcode =IB_WC_RECV_RDMA_WITH_IMM ; +} + +int bnxt_re_poll_cq (struct ib_cq *ib_cq,int num_entries,struct ib_wc *wc) +{ + struct bnxt_re_cq *cq = container_of(ib_cq, struct bnxt_re_cq, ib_cq); +struct bnxt_re_qp *qp; +struct bnxt_qplib_cqe *cqe; +int i, ncqe, budget; +u32 tbl_idx; +struct bnxt_re_sqp_entries *sqp_entry =NULL ; +unsigned long flags; + +spin_lock_irqsave (&cq->cq_lock, flags); + budget =min_t (u32, num_entries, cq->max_cql); +if (!cq->cql) { +dev_err (rdev_to_dev (cq->rdev),"POLL CQ : no CQL to use" ); + goto exit; + } + cqe = &cq->cql[0 ]; +while (budget) { + ncqe =bnxt_qplib_poll_cq (&cq->qplib_cq, cqe, budget); +if (!ncqe) +break ; + +for (i =0 ; i < ncqe; i++, cqe++) { +/* Transcribe each qplib_wqe back to ib_wc */ +memset (wc,0 ,sizeof (*wc)); + + wc->wr_id = cqe->wr_id; + wc->byte_len = cqe->length; + qp =container_of + ((struct bnxt_qplib_qp *) + (unsigned long )(cqe->qp_handle), + struct bnxt_re_qp, qplib_qp); +if (!qp) { +dev_err (rdev_to_dev (cq->rdev), +"POLL CQ : bad QP handle" ); +continue ; + } + wc->qp = &qp->ib_qp; + wc->ex.imm_data = cqe->immdata; + wc->src_qp = cqe->src_qp; +memcpy (wc->smac, cqe->smac,ETH_ALEN ); + wc->port_num =1 ; + wc->vendor_err = cqe->status; + +switch (cqe->opcode) { +case CQ_BASE_CQE_TYPE_REQ : +if (qp->qplib_qp.id == + qp->rdev->qp1_sqp->qplib_qp.id) { +/* Handle this completion with +* the stored completion +*/ +memset (wc,0 ,sizeof (*wc)); +continue ; + } +bnxt_re_process_req_wc (wc, cqe); +break ; +case CQ_BASE_CQE_TYPE_RES_RAWETH_QP1 : +if (!cqe->status) { +int rc =0 ; + + rc =bnxt_re_process_raw_qp_pkt_rx + (qp, cqe); +if (!rc) { +memset (wc,0 ,sizeof (*wc)); +continue ; + } + cqe->status =-1 ; + } +/* Errors need not be looped back. +* But change the wr_id to the one +* stored in the table +*/ + tbl_idx = cqe->wr_id; + sqp_entry = &cq->rdev->sqp_tbl[tbl_idx]; + wc->wr_id = sqp_entry->wrid; +bnxt_re_process_res_rawqp1_wc (wc, cqe); +break ; +case CQ_BASE_CQE_TYPE_RES_RC : +bnxt_re_process_res_rc_wc (wc, cqe); +break ; +case CQ_BASE_CQE_TYPE_RES_UD : +if (qp->qplib_qp.id == + qp->rdev->qp1_sqp->qplib_qp.id) { +/* Handle this completion with +* the stored completion +*/ +if (cqe->status) { +continue ; + }else { +bnxt_re_process_res_shadow_qp_wc + (qp, wc, cqe); +break ; + } + } +bnxt_re_process_res_ud_wc (wc, cqe); +break ; +default : +dev_err (rdev_to_dev (cq->rdev), +"POLL CQ : type 0x%x not handled" , + cqe->opcode); +continue ; + } + wc++; + budget--; + } + } +exit: +spin_unlock_irqrestore (&cq->cq_lock, flags); +return num_entries - budget; +} +int bnxt_re_req_notify_cq (struct ib_cq *ib_cq,enum ib_cq_notify_flags ib_cqn_flags) {
drivers/infiniband/hw/bnxt_re/ib_verbs.h +1 -0
@@ -172,6 +172,7 @@ struct ib_cq *bnxt_re_create_cq(struct ib_device *ibdev,struct ib_ucontext *context, struct ib_udata *udata);int bnxt_re_destroy_cq (struct ib_cq *cq); +int bnxt_re_poll_cq (struct ib_cq *cq,int num_entries,struct ib_wc *wc);int bnxt_re_req_notify_cq (struct ib_cq *cq,enum ib_cq_notify_flags flags);struct ib_mr *bnxt_re_get_dma_mr (struct ib_pd *pd,int mr_access_flags);
drivers/infiniband/hw/bnxt_re/main.c +21 -1
@@ -463,6 +463,7 @@ static int bnxt_re_register_ib(struct bnxt_re_dev *rdev) ibdev->create_cq = bnxt_re_create_cq; ibdev->destroy_cq = bnxt_re_destroy_cq; + ibdev->poll_cq = bnxt_re_poll_cq; ibdev->req_notify_cq = bnxt_re_req_notify_cq; ibdev->get_dma_mr = bnxt_re_get_dma_mr;
@@ -597,6 +598,25 @@ static int bnxt_re_aeq_handler(struct bnxt_qplib_rcfw *rcfw,return 0 ; } +static int bnxt_re_cqn_handler (struct bnxt_qplib_nq *nq, +struct bnxt_qplib_cq *handle) +{ + struct bnxt_re_cq *cq = container_of(handle, struct bnxt_re_cq, + qplib_cq); + +if (!cq) { +dev_err (NULL ,"%s: CQ is NULL, CQN not handled" , +ROCE_DRV_MODULE_NAME ); +return -EINVAL ; + } +if (cq->ib_cq.comp_handler) { +/* Lock comp_handler? */ + (*cq->ib_cq.comp_handler)(&cq->ib_cq, cq->ib_cq.cq_context); + } + +return 0 ; +} +static void bnxt_re_cleanup_res (struct bnxt_re_dev *rdev) {if (rdev->nq.hwq.max_elements)
@@ -618,7 +638,7 @@ static int bnxt_re_init_res(struct bnxt_re_dev *rdev) rc =bnxt_qplib_enable_nq (rdev->en_dev->pdev, &rdev->nq, rdev->msix_entries[BNXT_RE_NQ_IDX ].vector, rdev->msix_entries[BNXT_RE_NQ_IDX ].db_offset, -NULL , + &bnxt_re_cqn_handler,NULL );if (rc)
drivers/infiniband/hw/bnxt_re/qplib_fp.c +559 -1
572 lines not on this page · raw message
drivers/infiniband/hw/bnxt_re/qplib_fp.h +4 -3
@@ -396,7 +396,7 @@ struct bnxt_qplib_nq {int (*cqn_handler) (struct bnxt_qplib_nq *nq, -void *cq); +struct bnxt_qplib_cq *cq); int (*srqn_handler) (struct bnxt_qplib_nq *nq, void *srq,
@@ -407,7 +407,7 @@ void bnxt_qplib_disable_nq(struct bnxt_qplib_nq *nq);int bnxt_qplib_enable_nq (struct pci_dev *pdev,struct bnxt_qplib_nq *nq,int msix_vector,int bar_reg_offset,int (*cqn_handler)(struct bnxt_qplib_nq *nq, -void *cq), +struct bnxt_qplib_cq *cq),int (*srqn_handler)(struct bnxt_qplib_nq *nq,void *srq,u8 event));
@@ -431,7 +431,8 @@ int bnxt_qplib_post_recv(struct bnxt_qplib_qp *qp, struct bnxt_qplib_swqe *wqe);int bnxt_qplib_create_cq (struct bnxt_qplib_res *res,struct bnxt_qplib_cq *cq);int bnxt_qplib_destroy_cq (struct bnxt_qplib_res *res,struct bnxt_qplib_cq *cq); - +int bnxt_qplib_poll_cq (struct bnxt_qplib_cq *cq,struct bnxt_qplib_cqe *cqe, +int num);void bnxt_qplib_req_notify_cq (struct bnxt_qplib_cq *cq,u32 arm_type);void bnxt_qplib_free_nq (struct bnxt_qplib_nq *nq);int bnxt_qplib_alloc_nq (struct pci_dev *pdev,struct bnxt_qplib_nq *nq);
Signature · 6 lines
2.5.5 -- To unsubscribe from this list: send the line "unsubscribe linux-rdma" in the body of a message to [email protected] More majordomo info at http://vger.kernel.org/majordomo-info.html
A message that is not in the archive (sent off-list or not yet received): 1486725593-9872-17-git-send-email-selvin.xavier-dY08KVG/lbpWk0Htik3J/[email protected]
Re: [PATCH V5 for-next 16/21] RDMA/bnxt_re: Support poll_cq verb
Quoted 101 lines · Selvin Xavier
Enables the fastpath
ib_poll_cqverb.v2: Fixed sparse warnings
v3: Fixes endianness related warnings reported by sparse. Also, fixes
smatch and checkpatch warnings
v5: UsesETH_P_IBOEmacro for RoCE ethertype--- drivers/infiniband/hw/bnxt_re/ib_verbs.c | 522 ++++++++++++++++++++++++++++ drivers/infiniband/hw/bnxt_re/ib_verbs.h | 1 + drivers/infiniband/hw/bnxt_re/main.c | 22 +- drivers/infiniband/hw/bnxt_re/qplib_fp.c | 560 ++++++++++++++++++++++++++++++- drivers/infiniband/hw/bnxt_re/qplib_fp.h | 7 +- 5 files changed, 1107 insertions(+), 5 deletions(-)drivers/infiniband/hw/bnxt_re/ib_verbs.c +73
-0@@ -2230,6 +2230,528 @@ struct ib_cq *bnxt_re_create_cq(struct ib_device *ibdev,return ERR_PTR (rc); } +static u8 __req_to_ib_wc_status (u8 qstatus) +{ +switch (qstatus) { +case CQ_REQ_STATUS_OK : +return IB_WC_SUCCESS ; +case CQ_REQ_STATUS_BAD_RESPONSE_ERR : +return IB_WC_BAD_RESP_ERR ; +case CQ_REQ_STATUS_LOCAL_LENGTH_ERR : +return IB_WC_LOC_LEN_ERR ; +case CQ_REQ_STATUS_LOCAL_QP_OPERATION_ERR : +return IB_WC_LOC_QP_OP_ERR ; +case CQ_REQ_STATUS_LOCAL_PROTECTION_ERR : +return IB_WC_LOC_PROT_ERR ; +case CQ_REQ_STATUS_MEMORY_MGT_OPERATION_ERR : +return IB_WC_GENERAL_ERR ; +case CQ_REQ_STATUS_REMOTE_INVALID_REQUEST_ERR : +return IB_WC_REM_INV_REQ_ERR ; +case CQ_REQ_STATUS_REMOTE_ACCESS_ERR : +return IB_WC_REM_ACCESS_ERR ; +case CQ_REQ_STATUS_REMOTE_OPERATION_ERR : +return IB_WC_REM_OP_ERR ; +case CQ_REQ_STATUS_RNR_NAK_RETRY_CNT_ERR : +return IB_WC_RNR_RETRY_EXC_ERR ; +case CQ_REQ_STATUS_TRANSPORT_RETRY_CNT_ERR : +return IB_WC_RETRY_EXC_ERR ; +case CQ_REQ_STATUS_WORK_REQUEST_FLUSHED_ERR : +return IB_WC_WR_FLUSH_ERR ; +default : +return IB_WC_GENERAL_ERR ; + } +return 0 ; +} + +static u8 __rawqp1_to_ib_wc_status (u8 qstatus) +{ +switch (qstatus) { +case CQ_RES_RAWETH_QP1_STATUS_OK : +return IB_WC_SUCCESS ; +case CQ_RES_RAWETH_QP1_STATUS_LOCAL_ACCESS_ERROR : +return IB_WC_LOC_ACCESS_ERR ; +case CQ_RES_RAWETH_QP1_STATUS_HW_LOCAL_LENGTH_ERR : +return IB_WC_LOC_LEN_ERR ; +case CQ_RES_RAWETH_QP1_STATUS_LOCAL_PROTECTION_ERR : +return IB_WC_LOC_PROT_ERR ; +case CQ_RES_RAWETH_QP1_STATUS_LOCAL_QP_OPERATION_ERR : +return IB_WC_LOC_QP_OP_ERR ; +case CQ_RES_RAWETH_QP1_STATUS_MEMORY_MGT_OPERATION_ERR : +return IB_WC_GENERAL_ERR ; +case CQ_RES_RAWETH_QP1_STATUS_WORK_REQUEST_FLUSHED_ERR : +return IB_WC_WR_FLUSH_ERR ; +case CQ_RES_RAWETH_QP1_STATUS_HW_FLUSH_ERR : +return IB_WC_WR_FLUSH_ERR ; +default : +return IB_WC_GENERAL_ERR ; + } +} + +static u8 __rc_to_ib_wc_status (u8 qstatus) +{ +switch (qstatus) { +case CQ_RES_RC_STATUS_OK : +return IB_WC_SUCCESS ; +case CQ_RES_RC_STATUS_LOCAL_ACCESS_ERROR : +return IB_WC_LOC_ACCESS_ERR ; +case CQ_RES_RC_STATUS_LOCAL_LENGTH_ERR : +return IB_WC_LOC_LEN_ERR ; +case CQ_RES_RC_STATUS_LOCAL_PROTECTION_ERR : +return IB_WC_LOC_PROT_ERR ; +case CQ_RES_RC_STATUS_LOCAL_QP_OPERATION_ERR : +return IB_WC_LOC_QP_OP_ERR ; +case CQ_RES_RC_STATUS_MEMORY_MGT_OPERATION_ERR : +return IB_WC_GENERAL_ERR ; +case CQ_RES_RC_STATUS_REMOTE_INVALID_REQUEST_ERR :
drivers/infiniband/hw/bnxt_re/ib_verbs.c struct ib_cq *bnxt_re_create_cq(struct ib_device *ibdev, · line 2315
Quoted 10 lines
drivers/infiniband/hw/bnxt_re/ib_verbs.c +10
-0+return IB_WC_REM_INV_REQ_ERR ; +case CQ_RES_RC_STATUS_WORK_REQUEST_FLUSHED_ERR : +return IB_WC_WR_FLUSH_ERR ; +case CQ_RES_RC_STATUS_HW_FLUSH_ERR : +return IB_WC_WR_FLUSH_ERR ; +default : +return IB_WC_GENERAL_ERR ; + } +} +
Why don't you use these defines directly?
Thanks
A message that is not in the archive (sent off-list or not yet received): 20170212143051.GD14015-U/[email protected]
Re: [PATCH V5 for-next 16/21] RDMA/bnxt_re: Support poll_cq verb
Quoted 20 lines · Leon Romanovsky
Quoted 20 lines
drivers/infiniband/hw/bnxt_re/ib_verbs.c +20
-0+static u8 __rc_to_ib_wc_status (u8 qstatus) +{ +switch (qstatus) { +case CQ_RES_RC_STATUS_OK : +return IB_WC_SUCCESS ; +case CQ_RES_RC_STATUS_LOCAL_ACCESS_ERROR : +return IB_WC_LOC_ACCESS_ERR ; +case CQ_RES_RC_STATUS_LOCAL_LENGTH_ERR : +return IB_WC_LOC_LEN_ERR ; +case CQ_RES_RC_STATUS_LOCAL_PROTECTION_ERR : +return IB_WC_LOC_PROT_ERR ; +case CQ_RES_RC_STATUS_LOCAL_QP_OPERATION_ERR : +return IB_WC_LOC_QP_OP_ERR ; +case CQ_RES_RC_STATUS_MEMORY_MGT_OPERATION_ERR : +return IB_WC_GENERAL_ERR ; +case CQ_RES_RC_STATUS_REMOTE_INVALID_REQUEST_ERR : +return IB_WC_REM_INV_REQ_ERR ; +case CQ_RES_RC_STATUS_WORK_REQUEST_FLUSHED_ERR : +return IB_WC_WR_FLUSH_ERR ; +case CQ_RES_RC_STATUS_HW_FLUSH_ERR :
Quoted 8 lines
drivers/infiniband/hw/bnxt_re/ib_verbs.c struct ib_cq *bnxt_re_create_cq(struct ib_device *ibdev, · line 2265
Quoted 6 lines
drivers/infiniband/hw/bnxt_re/ib_verbs.c +6
-0+return IB_WC_WR_FLUSH_ERR ; +default : +return IB_WC_GENERAL_ERR ; + } +} +Why don't you use these defines directly?
CQ_RES* values are returned by the HW and these values are
different from the corresponding IB_WC status values. say,CQ_RES_RC_STATUS_HW_FLUSH_ERR is 8 where as IB_WC_WR_FLUSH_ERR is 5.
So we thought it is better to map these values in a function rather than having a switch/case in the calling function.
Let me know if you meant something different in your query.
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in the body of a message to [email protected] More majordomo info at http://vger.kernel.org/majordomo-info.html
A message that is not in the archive (sent off-list or not yet received): CA+sbYW36txPueFBWFOWigHu_XmnTPY+-Vdu5MmGeOQ7uFjrWag-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org
Leon Romanovsky
Reviewed-byRe: [PATCH V5 for-next 16/21] RDMA/bnxt_re: Support poll_cq verb
Quoted 30 lines · Selvin Xavier
Quoted 20 lines · Leon Romanovsky
Quoted 20 lines
drivers/infiniband/hw/bnxt_re/ib_verbs.c +20
-0+static u8 __rc_to_ib_wc_status (u8 qstatus) +{ +switch (qstatus) { +case CQ_RES_RC_STATUS_OK : +return IB_WC_SUCCESS ; +case CQ_RES_RC_STATUS_LOCAL_ACCESS_ERROR : +return IB_WC_LOC_ACCESS_ERR ; +case CQ_RES_RC_STATUS_LOCAL_LENGTH_ERR : +return IB_WC_LOC_LEN_ERR ; +case CQ_RES_RC_STATUS_LOCAL_PROTECTION_ERR : +return IB_WC_LOC_PROT_ERR ; +case CQ_RES_RC_STATUS_LOCAL_QP_OPERATION_ERR : +return IB_WC_LOC_QP_OP_ERR ; +case CQ_RES_RC_STATUS_MEMORY_MGT_OPERATION_ERR : +return IB_WC_GENERAL_ERR ; +case CQ_RES_RC_STATUS_REMOTE_INVALID_REQUEST_ERR : +return IB_WC_REM_INV_REQ_ERR ; +case CQ_RES_RC_STATUS_WORK_REQUEST_FLUSHED_ERR : +return IB_WC_WR_FLUSH_ERR ; +case CQ_RES_RC_STATUS_HW_FLUSH_ERR :Quoted 8 lines
drivers/infiniband/hw/bnxt_re/ib_verbs.c struct ib_cq *bnxt_re_create_cq(struct ib_device *ibdev, · line 2265
Quoted 6 lines
drivers/infiniband/hw/bnxt_re/ib_verbs.c +6
-0+return IB_WC_WR_FLUSH_ERR ; +default : +return IB_WC_GENERAL_ERR ; + } +} +Why don't you use these defines directly?
Quoted 8 lines
CQ_RES* values are returned by the HW and these values are
different from the correspondingIB_WCstatus values. say,CQ_RES_RC_STATUS_HW_FLUSH_ERRis 8 where asIB_WC_WR_FLUSH_ERRis 5.
So we thought it is better to map these values in a function rather than having a switch/case in the calling function.Let me know if you meant something different in your query.
Thanks,
This from_u8 -> to_u8 conversion confused me, because of our similar function mlx5_handle_error_cqe() which updates wc->status at the same time as it is called. So I expected to see something similar in your code where you fill wc.
PATCH v5 18/21 RDMA/bnxt_re: Support for DCB
In reply to a message not in the archiveThis patch queries the configured RoCE APP Priority on the host using the dcbnl API and programs the RoCE FW with the corresponding Traffic Class(es) for the priority.
v2: Fixed some sparse warning and cleanup of function bnxt_re_query_hwrm_pri2cos
v3: Adds bnxt_qplib_map_tc2cos as a part of this patch. Uses
ROCE_V2_UDP_DPORT instead of BNXT_RE_ROCE_V2_PORT_NO.
v5: Uses ETH_P_IBOE macro for RoCE ethertype
--- drivers/infiniband/hw/bnxt_re/bnxt_re.h | 3 + drivers/infiniband/hw/bnxt_re/main.c | 141 +++++++++++++++++++++++++++++++ drivers/infiniband/hw/bnxt_re/qplib_sp.c | 37 ++++++++ drivers/infiniband/hw/bnxt_re/qplib_sp.h | 1 + 4 files changed, 182 insertions(+)
drivers/infiniband/hw/bnxt_re/bnxt_re.h +3 -0
@@ -93,6 +93,9 @@ struct bnxt_re_dev {int id; +struct delayed_work worker; +u8 cur_prio_map; +/* FP Notification Queue (CQ & SRQ) */ struct tasklet_struct nq_task;
drivers/infiniband/hw/bnxt_re/main.c +141 -0
179 lines not on this page · raw message
drivers/infiniband/hw/bnxt_re/qplib_sp.c +37 -0
@@ -799,3 +799,40 @@ int bnxt_qplib_free_fast_reg_page_list(struct bnxt_qplib_res *res,bnxt_qplib_free_hwq (res->pdev, &frpl->hwq);return 0 ; } + +int bnxt_qplib_map_tc2cos (struct bnxt_qplib_res *res,u16 *cids) +{ +struct bnxt_qplib_rcfw *rcfw = res->rcfw; +struct cmdq_map_tc_to_cos req; +struct creq_map_tc_to_cos_resp *resp; +u16 cmd_flags =0 ; +int tleft; + +RCFW_CMD_PREP (req,MAP_TC_TO_COS , cmd_flags); + req.cos0 =cpu_to_le16 (cids[0 ]); + req.cos1 =cpu_to_le16 (cids[1 ]); + + resp =bnxt_qplib_rcfw_send_message (rcfw, (void *)&req,NULL ,0 ); +if (!resp) { +dev_err (&res->pdev->dev,"QPLIB: SP: MAP_TC2COS send failed" ); +return -EINVAL ; + } + + tleft =bnxt_qplib_rcfw_block_for_resp (rcfw,le16_to_cpu (req.cookie)); +if (!tleft) { +dev_err (&res->pdev->dev,"QPLIB: SP: MAP_TC2COS timed out" ); +return -ETIMEDOUT ; + } + +if (resp->status || +le16_to_cpu (resp->cookie) !=le16_to_cpu (req.cookie)) { +dev_err (&res->pdev->dev,"QPLIB: SP: MAP_TC2COS failed " ); +dev_err (&res->pdev->dev, +"QPLIB: with status 0x%x cmdq 0x%x resp 0x%x" , + resp->status,le16_to_cpu (req.cookie), +le16_to_cpu (resp->cookie)); +return -EINVAL ; + } + +return 0 ; +}
drivers/infiniband/hw/bnxt_re/qplib_sp.h +1 -0
@@ -156,4 +156,5 @@ int bnxt_qplib_alloc_fast_reg_page_list(struct bnxt_qplib_res *res, struct bnxt_qplib_frpl *frpl, int max);int bnxt_qplib_free_fast_reg_page_list (struct bnxt_qplib_res *res,struct bnxt_qplib_frpl *frpl); +int bnxt_qplib_map_tc2cos (struct bnxt_qplib_res *res,u16 *cids);#endif /* __BNXT_QPLIB_SP_H__*/
Signature · 6 lines
2.5.5 -- To unsubscribe from this list: send the line "unsubscribe linux-rdma" in the body of a message to [email protected] More majordomo info at http://vger.kernel.org/majordomo-info.html
PATCH v5 21/21 RDMA/bnxt_re: Add bnxt_re driver build support
In reply to a message not in the archiveMakefile and Kconfig changes for enabling bnxt_re compilation
v3: Adds list of MAINTAINERS of bnxt_re driver. Removes bnxt_re_debugfs.c
from Makefile as this file is no longer present
--- MAINTAINERS | 11 +++++++++++ drivers/infiniband/Kconfig | 2 ++ drivers/infiniband/hw/Makefile | 1 + drivers/infiniband/hw/bnxt_re/Kconfig | 9 +++++++++ drivers/infiniband/hw/bnxt_re/Makefile | 6 ++++++ 5 files changed, 29 insertions(+) create mode 100644 drivers/infiniband/hw/bnxt_re/Kconfig create mode 100644 drivers/infiniband/hw/bnxt_re/Makefile
MAINTAINERS +11 -0
@@ -2808,6 +2808,17 @@ L: linux-arm-kernel-IAPFreCvJWM7uuMidbF8XUB+6BGkLq7r@public.gmane.org (moderated for non-subscribers) S: Maintained F: arch/arm64/boot/dts/broadcom/vulcan* +BROADCOM NETXTREME-E ROCE DRIVER +M: Selvin Xavier <selvin.xavier-dY08KVG/lbpWk0Htik3J/[email protected]> +M: Devesh Sharma <devesh.sharma-dY08KVG/lbpWk0Htik3J/[email protected]> +M: Somnath Kotur <somnath.kotur-dY08KVG/lbpWk0Htik3J/[email protected]> +M: Sriharsha Basavapatna <sriharsha.basavapatna-dY08KVG/lbpWk0Htik3J/[email protected]> +L: [email protected] +W: http://www.broadcom.com +S: Supported +F: drivers/infiniband/hw/bnxt_re/ +F: include/uapi/rdma/bnxt_re-abi.h + BROCADE BFA FC SCSI DRIVER M: Anil Gurumurthy <[email protected]> M: Sudarsana Kalluru <[email protected]>
drivers/infiniband/Kconfig +2 -0
@@ -92,4 +92,6 @@ source "drivers/infiniband/hw/hfi1/Kconfig" source "drivers/infiniband/hw/qedr/Kconfig" +source "drivers/infiniband/hw/bnxt_re/Kconfig" + endif # INFINIBAND
drivers/infiniband/hw/Makefile +1 -0
@@ -12,3 +12,4 @@ obj-$(CONFIG_INFINIBAND_USNIC) += usnic/ obj-$(CONFIG_INFINIBAND_HFI1) += hfi1/ obj-$(CONFIG_INFINIBAND_HNS) += hns/ obj-$(CONFIG_INFINIBAND_QEDR) += qedr/ +obj-$(CONFIG_INFINIBAND_BNXT_RE) += bnxt_re/
drivers/infiniband/hw/bnxt_re/Kconfig new file +9 -0
@@ -0,0 +1,9 @@ +config INFINIBAND_BNXT_RE + tristate "Broadcom Netxtreme HCA support" + depends on ETHERNET && NETDEVICES && PCI && INET + select NET_VENDOR_BROADCOM + select BNXT + ---help--- + This driver supports Broadcom NetXtreme-E 10/25/40/50 gigabit + RoCE HCAs. To compile this driver as a module, choose M here: + the module will be called bnxt_re.
drivers/infiniband/hw/bnxt_re/Makefile new file +6 -0
@@ -0,0 +1,6 @@ + +ccflags-y := -Idrivers/net/ethernet/broadcom/bnxt +obj-$(CONFIG_INFINIBAND_BNXT_RE) += bnxt_re.o +bnxt_re-y := main.o ib_verbs.o \ + qplib_res.o qplib_rcfw.o \ + qplib_sp.o qplib_fp.o
Signature · 6 lines
2.5.5 -- To unsubscribe from this list: send the line "unsubscribe linux-rdma" in the body of a message to [email protected] More majordomo info at http://vger.kernel.org/majordomo-info.html
Re: [PATCH V5 for-next 21/21] RDMA/bnxt_re: Add bnxt_re driver build support
Quoted 28 lines · Selvin Xavier
MakefileandKconfigchanges for enablingbnxt_recompilationv3: Adds list of
MAINTAINERSofbnxt_redriver. Removesbnxt_re_debugfs.c
fromMakefileas this file is no longer presentSigned-off-by Devesh Sharma <[email protected]>Signed-off-by Somnath Kotur <[email protected]>Signed-off-by Sriharsha Basavapatna <[email protected]>Signed-off-by Selvin Xavier <[email protected]>--- MAINTAINERS | 11 +++++++++++ drivers/infiniband/Kconfig | 2 ++ drivers/infiniband/hw/Makefile | 1 + drivers/infiniband/hw/bnxt_re/Kconfig | 9 +++++++++ drivers/infiniband/hw/bnxt_re/Makefile | 6 ++++++ 5 files changed, 29 insertions(+) create mode 100644 drivers/infiniband/hw/bnxt_re/Kconfig create mode 100644 drivers/infiniband/hw/bnxt_re/MakefileMAINTAINERS +1
-0@@ -2808,6 +2808,17 @@ L: [email protected] (moderated for non-subscribers) S: Maintained F: arch/arm64/boot/dts/broadcom/vulcan* +BROADCOM NETXTREME-E ROCE DRIVER
MAINTAINERS L: [email protected] (moderated for non-subscribers) · line 2821
Quoted 10 lines
MAINTAINERS +10
-0+M: Selvin Xavier <[email protected]> +M: Devesh Sharma <[email protected]> +M: Somnath Kotur <[email protected]> +M: Sriharsha Basavapatna <[email protected]> +L: [email protected] +W: http://www.broadcom.com +S: Supported +F: drivers/infiniband/hw/bnxt_re/ +F: include/uapi/rdma/bnxt_re-abi.h +
Please take a look on the note which I gave to Faisal a long time ago [1]. Our experience shows that the more people you add here, the less chances to be CCed on the relevant patches.
It is definitely up to you.
Thanks,
Quoted 10 lines · Selvin Xavier
This series introduces the RoCE driver for the Broadcom NetXtreme-E 10/25/40/50G RoCE HCAs.
This driver is dependent on thebnxt_enNIC driver and is based on the for-4.11 branch in linux-rdma repository.bnxt_enchanges required for this patch series are already available afore mentioned branch.These changes are available for your reference in the
bnxt_re_v5branch of following repository.
https://github.com/Broadcom/linux-rdma-nxt/
Did you post user-space bits for this driver? I don't see it under Jason's tree
Or.
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in the body of a message to [email protected] More majordomo info at http://vger.kernel.org/majordomo-info.html
Hi Or,
Yes, Those has been posted and are under review as of now. I am to post V3 for that series, you should expect V3 somewhere early next week.
-regards
Devesh
Quoted 14 lines · Or Gerlitz
Quoted 10 lines · Selvin Xavier
This series introduces the RoCE driver for the Broadcom NetXtreme-E 10/25/40/50G RoCE HCAs.
This driver is dependent on thebnxt_enNIC driver and is based on the for-4.11 branch in linux-rdma repository.bnxt_enchanges required for this patch series are already available afore mentioned branch.These changes are available for your reference in the
bnxt_re_v5branch of following repository.
https://github.com/Broadcom/linux-rdma-nxt/
Quoted 7 lines
Did you post user-space bits for this driver? I don't see it under Jason's tree
Or.
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in the body of a message to [email protected] More majordomo info at http://vger.kernel.org/majordomo-info.html
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in the body of a message to [email protected] More majordomo info at http://vger.kernel.org/majordomo-info.html
A message that is not in the archive (sent off-list or not yet received): CANjDDBg_QoSwHMqjUOr2UrobaBHwyfrHzzK8N7VXcmq1eEONSA-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org
Quoted 2 lines · Devesh Sharma
Yes, Those has been posted and are under review as of now. I am to post V3 for that series, you should expect V3 somewhere early next week.
thank you
Or.
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in the body of a message to [email protected] More majordomo info at http://vger.kernel.org/majordomo-info.html
Quoted 9 lines · Or Gerlitz
Quoted 7 lines · Selvin Xavier
This series introduces the RoCE driver for the Broadcom NetXtreme-E 10/25/40/50G RoCE HCAs.
This driver is dependent on thebnxt_enNIC driver and is based on the for-4.11 branch in linux-rdma repository.bnxt_enchanges required for this patch series are already available afore mentioned branch.
Quoted 6 lines
Quoted 3 lines
These changes are available for your reference in the
bnxt_re_v5branch of following repository.
https://github.com/Broadcom/linux-rdma-nxt/Did you post user-space bits for this driver? I don't see it under Jason's tree
Yes, it was posted on the list.
https://www.spinics.net/lists/linux-rdma/msg46472.html
Thanks
Quoted 6 lines
Or.
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in the body of a message to [email protected] More majordomo info at http://vger.kernel.org/majordomo-info.html
Selvin Xavier
maintainerPATCH v5 4/21 RDMA/bnxt_re: Enabling RoCE control path
In reply to Selvin XavierThis patch covers the basic initialization of the HW interface. Implements some of the slow path FW commands required for the HW intialization. It also handles registration with the IB stack.
v2: Fix some of the sparse warnings
v3: Removed some more smatch and sparse warnings related to endianness.
Fixes cross compilation failure warnings. Also, fixes the retry logic to avoid system hangs in case of delay or no response for the FW commands.
v4: Changes header file names
v5: Updating the PF FW communication channel offset as per the latest FW changes
--- drivers/infiniband/hw/bnxt_re/bnxt_re.h | 15 + drivers/infiniband/hw/bnxt_re/main.c | 424 ++++++++++++++++- drivers/infiniband/hw/bnxt_re/qplib_rcfw.c | 608 ++++++++++++++++++++++++ drivers/infiniband/hw/bnxt_re/qplib_rcfw.h | 189 ++++++++ drivers/infiniband/hw/bnxt_re/qplib_res.c | 738 +++++++++++++++++++++++++++++ drivers/infiniband/hw/bnxt_re/qplib_res.h | 165 +++++++ drivers/infiniband/hw/bnxt_re/qplib_sp.c | 163 +++++++ drivers/infiniband/hw/bnxt_re/qplib_sp.h | 42 ++ 8 files changed, 2343 insertions(+), 1 deletion(-)
drivers/infiniband/hw/bnxt_re/bnxt_re.h +15 -0
@@ -44,6 +44,11 @@#define BNXT_RE_DESC "Broadcom NetXtreme-C/E RoCE Driver" +#define BNXT_RE_MAX_QPC_COUNT (64 * 1024) +#define BNXT_RE_MAX_MRW_COUNT (64 * 1024) +#define BNXT_RE_MAX_SRQC_COUNT (64 * 1024) +#define BNXT_RE_MAX_CQ_COUNT (64 * 1024) +struct bnxt_re_work {struct work_struct work;unsigned long event;
@@ -53,6 +58,7 @@ struct bnxt_re_work {#define BNXT_RE_MIN_MSIX 2#define BNXT_RE_MAX_MSIX 16 +#define BNXT_RE_AEQ_IDX 0struct bnxt_re_dev {struct ib_device ibdev;struct list_head list;
@@ -70,6 +76,15 @@ struct bnxt_re_dev {int id; +/* RCFW Channel */ +struct bnxt_qplib_rcfw rcfw; + +/* Device Resources */ +struct bnxt_qplib_dev_attr dev_attr; +struct bnxt_qplib_ctx qplib_ctx; +struct bnxt_qplib_res qplib_res; +struct bnxt_qplib_dpi dpi_privileged; +atomic_t qp_count;struct mutex qp_lock;/* protect qp list */ struct list_head qp_list;
drivers/infiniband/hw/bnxt_re/main.c +423 -1
464 lines not on this page · raw message
drivers/infiniband/hw/bnxt_re/qplib_rcfw.c +608 -0
611 lines not on this page · raw message
drivers/infiniband/hw/bnxt_re/qplib_rcfw.h +189 -0
193 lines not on this page · raw message
drivers/infiniband/hw/bnxt_re/qplib_res.c +738 -0
741 lines not on this page · raw message
drivers/infiniband/hw/bnxt_re/qplib_res.h +165 -0
169 lines not on this page · raw message
drivers/infiniband/hw/bnxt_re/qplib_sp.c +163 -0
166 lines not on this page · raw message
drivers/infiniband/hw/bnxt_re/qplib_sp.h +42 -0
46 lines not on this page · raw message
Signature · 1 line
2.5.5
Selvin Xavier
maintainerPATCH v5 5/21 RDMA/bnxt_re: Adding Notification Queue support
In reply to Selvin XavierCompletion Notifcations are handled by Notification Queue (NQ). This patch configures the NQs. Also, configures the Door bell page mapping
v3: Fixes some sparse warnings related to endianness checks
v4: Change include file names
--- drivers/infiniband/hw/bnxt_re/bnxt_re.h | 8 ++ drivers/infiniband/hw/bnxt_re/main.c | 52 +++++++++- drivers/infiniband/hw/bnxt_re/qplib_fp.c | 161 ++++++++++++++++++++++++++++++ drivers/infiniband/hw/bnxt_re/qplib_fp.h | 60 +++++++++++ drivers/infiniband/hw/bnxt_re/qplib_res.h | 6 ++ 5 files changed, 286 insertions(+), 1 deletion(-)
drivers/infiniband/hw/bnxt_re/bnxt_re.h +8 -0
@@ -59,6 +59,8 @@ struct bnxt_re_work {#define BNXT_RE_MIN_MSIX 2#define BNXT_RE_MAX_MSIX 16#define BNXT_RE_AEQ_IDX 0 +#define BNXT_RE_NQ_IDX 1 +struct bnxt_re_dev {struct ib_device ibdev;struct list_head list;
@@ -76,9 +78,15 @@ struct bnxt_re_dev {int id; +/* FP Notification Queue (CQ & SRQ) */ +struct tasklet_struct nq_task; +/* RCFW Channel */ struct bnxt_qplib_rcfw rcfw; +/* NQ */ +struct bnxt_qplib_nq nq; +/* Device Resources */ struct bnxt_qplib_dev_attr dev_attr;struct bnxt_qplib_ctx qplib_ctx;
drivers/infiniband/hw/bnxt_re/main.c +51 -1
76 lines not on this page · raw message
drivers/infiniband/hw/bnxt_re/qplib_fp.c +161 -0
164 lines not on this page · raw message
drivers/infiniband/hw/bnxt_re/qplib_fp.h +60 -0
64 lines not on this page · raw message
drivers/infiniband/hw/bnxt_re/qplib_res.h +6 -0
@@ -193,6 +193,12 @@ int bnxt_qplib_alloc_init_hwq(struct pci_dev *pdev, struct bnxt_qplib_hwq *hwq, struct scatterlist *sl, int nmap, u32 *elements, u32 elements_per_page, u32 aux, u32 pg_size, enum bnxt_qplib_hwq_type hwq_type); +int bnxt_qplib_alloc_dpi (struct bnxt_qplib_dpi_tbl *dpit, +struct bnxt_qplib_dpi *dpi, +void *app); +int bnxt_qplib_dealloc_dpi (struct bnxt_qplib_res *res, +struct bnxt_qplib_dpi_tbl *dpi_tbl, +struct bnxt_qplib_dpi *dpi);void bnxt_qplib_cleanup_res (struct bnxt_qplib_res *res);int bnxt_qplib_init_res (struct bnxt_qplib_res *res);void bnxt_qplib_free_res (struct bnxt_qplib_res *res);
Signature · 1 line
2.5.5
Selvin Xavier
maintainerPATCH v5 6/21 RDMA/bnxt_re: Support for PD, ucontext and mmap verbs
In reply to Selvin XavierThis patch includes the uverbs ABI header file to enable user verbs. Also, adds support for the Protection Domain, User Context and mmap verbs.
v2: Moved the bnxt_re_uverbs_abi.h file to include/uapi/rdma folder.
Also, Fixed one sparse warning.
v3: Fixes some cross compile and sparse warnings. Changes the
bnxt_re_uverbs_abi.h file name to bnxtre-abi.h. Aligns the data structure to 64 bit and eliminates __packed qualifier from bnxtre-abi.h
v4: Changes the bnxtre_abi.h file name to bnxt_re-abi.h to follow
modulename-abi.h format. Also, modifies the include file name.
v5: Changes the year in copyright text
--- drivers/infiniband/hw/bnxt_re/ib_verbs.c | 218 ++++++++++++++++++++++++++++++ drivers/infiniband/hw/bnxt_re/ib_verbs.h | 23 ++++ drivers/infiniband/hw/bnxt_re/main.c | 7 + drivers/infiniband/hw/bnxt_re/qplib_res.c | 28 ++++ drivers/infiniband/hw/bnxt_re/qplib_res.h | 6 + drivers/infiniband/hw/bnxt_re/qplib_sp.h | 4 + include/uapi/rdma/bnxt_re-abi.h | 59 ++++++++ 7 files changed, 345 insertions(+) create mode 100644 include/uapi/rdma/bnxt_re-abi.h
drivers/infiniband/hw/bnxt_re/ib_verbs.c +218 -0
@@ -35,3 +35,221 @@* * Description: IB Verbs interpreter */ + +#include <linux/interrupt.h> +#include <linux/types.h> +#include <linux/pci.h> +#include <linux/netdevice.h> + +#include <rdma/ib_verbs.h> +#include <rdma/ib_user_verbs.h> +#include <rdma/ib_umem.h> +#include <rdma/ib_addr.h> +#include <rdma/ib_mad.h> +#include <rdma/ib_cache.h> + +#include "bnxt_ulp.h" + +#include "roce_hsi.h" +#include "qplib_res.h" +#include "qplib_sp.h" +#include "qplib_fp.h" +#include "qplib_rcfw.h" + +#include "bnxt_re.h" +#include "ib_verbs.h" +#include <rdma/bnxt_re-abi.h> + +/* Protection Domains */ +int bnxt_re_dealloc_pd (struct ib_pd *ib_pd) +{ + struct bnxt_re_pd *pd = container_of(ib_pd, struct bnxt_re_pd, ib_pd); +struct bnxt_re_dev *rdev = pd->rdev; +int rc; + +if (ib_pd->uobject && pd->dpi.dbr) { +struct ib_ucontext *ib_uctx = ib_pd->uobject->context; +struct bnxt_re_ucontext *ucntx; + +/* Free DPI only if this is the first PD allocated by the +* application and mark the context dpi as NULL +*/ + ucntx = container_of(ib_uctx, struct bnxt_re_ucontext, ib_uctx); + + rc =bnxt_qplib_dealloc_dpi (&rdev->qplib_res, + &rdev->qplib_res.dpi_tbl, + &pd->dpi); +if (rc) +dev_err (rdev_to_dev (rdev),"Failed to deallocate HW DPI" ); +/* Don't fail, continue*/ + ucntx->dpi =NULL ; + } + + rc =bnxt_qplib_dealloc_pd (&rdev->qplib_res, + &rdev->qplib_res.pd_tbl, + &pd->qplib_pd); +if (rc) { +dev_err (rdev_to_dev (rdev),"Failed to deallocate HW PD" ); +return rc; + } + +kfree (pd); +return 0 ; +} + +struct ib_pd *bnxt_re_alloc_pd (struct ib_device *ibdev, +struct ib_ucontext *ucontext, +struct ib_udata *udata) +{ +struct bnxt_re_dev *rdev =to_bnxt_re_dev (ibdev, ibdev); +struct bnxt_re_ucontext *ucntx =container_of (ucontext, + struct bnxt_re_ucontext, + ib_uctx); +struct bnxt_re_pd *pd; +int rc; + + pd =kzalloc (sizeof (*pd),GFP_KERNEL ); +if (!pd) +return ERR_PTR (-ENOMEM ); + + pd->rdev = rdev; +if (bnxt_qplib_alloc_pd (&rdev->qplib_res.pd_tbl, &pd->qplib_pd)) { +dev_err (rdev_to_dev (rdev),"Failed to allocate HW PD" ); + rc = -ENOMEM ; + goto fail; + } + +if (udata) { +struct bnxt_re_pd_resp resp; + +if (!ucntx->dpi) { +/* Allocate DPI in alloc_pd to avoid failing of +* ibv_devinfo and family of application when DPIs +* are depleted. +*/ +if (bnxt_qplib_alloc_dpi (&rdev->qplib_res.dpi_tbl, + &pd->dpi, ucntx)) { + rc = -ENOMEM ; + goto dbfail; + } + ucntx->dpi = &pd->dpi; + } + + resp.pdid = pd->qplib_pd.id; +/* Still allow mapping this DBR to the new user PD. */ + resp.dpi = ucntx->dpi->dpi; + resp.dbr = (u64 )ucntx->dpi->umdbr; + + rc =ib_copy_to_udata (udata, &resp,sizeof (resp)); +if (rc) { +dev_err (rdev_to_dev (rdev), +"Failed to copy user response\n" ); + goto dbfail; + } + } + +return &pd->ib_pd; +dbfail: + (void )bnxt_qplib_dealloc_pd (&rdev->qplib_res, &rdev->qplib_res.pd_tbl, + &pd->qplib_pd); +fail: +kfree (pd); +return ERR_PTR (rc); +} + +struct ib_ucontext *bnxt_re_alloc_ucontext (struct ib_device *ibdev, +struct ib_udata *udata) +{ +struct bnxt_re_dev *rdev =to_bnxt_re_dev (ibdev, ibdev); +struct bnxt_re_uctx_resp resp; +struct bnxt_re_ucontext *uctx; +struct bnxt_qplib_dev_attr *dev_attr = &rdev->dev_attr; +int rc; + +dev_dbg (rdev_to_dev (rdev),"ABI version requested %d" , + ibdev->uverbs_abi_ver); + +if (ibdev->uverbs_abi_ver !=BNXT_RE_ABI_VERSION ) { +dev_dbg (rdev_to_dev (rdev)," is different from the device %d " , +BNXT_RE_ABI_VERSION ); +return ERR_PTR (-EPERM ); + } + + uctx =kzalloc (sizeof (*uctx),GFP_KERNEL ); +if (!uctx) +return ERR_PTR (-ENOMEM ); + + uctx->rdev = rdev; + + uctx->shpg = (void *)__get_free_page (GFP_KERNEL ); +if (!uctx->shpg) { + rc = -ENOMEM ; + goto fail; + } +spin_lock_init (&uctx->sh_lock); + + resp.dev_id = rdev->en_dev->pdev->devfn;/*Temp, Use idr_alloc instead*/ + resp.max_qp = rdev->qplib_ctx.qpc_count; + resp.pg_size =PAGE_SIZE ; + resp.cqe_sz =sizeof (struct cq_base ); + resp.max_cqd = dev_attr->max_cq_wqes; + resp.rsvd =0 ; + + rc =ib_copy_to_udata (udata, &resp,sizeof (resp)); +if (rc) { +dev_err (rdev_to_dev (rdev),"Failed to copy user context" ); + rc = -EFAULT ; + goto cfail; + } + +return &uctx->ib_uctx; +cfail: +free_page ((unsigned long )uctx->shpg); + uctx->shpg =NULL ; +fail: +kfree (uctx); +return ERR_PTR (rc); +} + +int bnxt_re_dealloc_ucontext (struct ib_ucontext *ib_uctx) +{ +struct bnxt_re_ucontext *uctx =container_of (ib_uctx, + struct bnxt_re_ucontext, + ib_uctx); +if (uctx->shpg) +free_page ((unsigned long )uctx->shpg); +kfree (uctx); +return 0 ; +} + +/* Helper function to mmap the virtual memory from user app */ +int bnxt_re_mmap (struct ib_ucontext *ib_uctx,struct vm_area_struct *vma) +{ +struct bnxt_re_ucontext *uctx =container_of (ib_uctx, + struct bnxt_re_ucontext, + ib_uctx); +struct bnxt_re_dev *rdev = uctx->rdev; +u64 pfn; + +if (vma->vm_end - vma->vm_start !=PAGE_SIZE ) +return -EINVAL ; + +if (vma->vm_pgoff) { + vma->vm_page_prot =pgprot_noncached (vma->vm_page_prot); +if (io_remap_pfn_range (vma, vma->vm_start, vma->vm_pgoff, +PAGE_SIZE , vma->vm_page_prot)) { +dev_err (rdev_to_dev (rdev),"Failed to map DPI" ); +return -EAGAIN ; + } + }else { + pfn =virt_to_phys (uctx->shpg) >>PAGE_SHIFT ; +if (remap_pfn_range (vma, vma->vm_start, + pfn,PAGE_SIZE , vma->vm_page_prot)) { +dev_err (rdev_to_dev (rdev), +"Failed to map shared page" ); +return -EAGAIN ; + } + } + +return 0 ; +}
drivers/infiniband/hw/bnxt_re/ib_verbs.h +23 -0
@@ -39,4 +39,27 @@#ifndef __BNXT_RE_IB_VERBS_H__#define __BNXT_RE_IB_VERBS_H__ +struct bnxt_re_pd { +struct bnxt_re_dev *rdev; +struct ib_pd ib_pd; +struct bnxt_qplib_pd qplib_pd; +struct bnxt_qplib_dpi dpi; +}; + +struct bnxt_re_ucontext { +struct bnxt_re_dev *rdev; +struct ib_ucontext ib_uctx; +struct bnxt_qplib_dpi *dpi; +void *shpg; +spinlock_t sh_lock;/* protect shpg */ +}; + +struct ib_pd *bnxt_re_alloc_pd (struct ib_device *ibdev, +struct ib_ucontext *context, +struct ib_udata *udata); +int bnxt_re_dealloc_pd (struct ib_pd *pd); +struct ib_ucontext *bnxt_re_alloc_ucontext (struct ib_device *ibdev, +struct ib_udata *udata); +int bnxt_re_dealloc_ucontext (struct ib_ucontext *context); +int bnxt_re_mmap (struct ib_ucontext *context,struct vm_area_struct *vma);#endif /* __BNXT_RE_IB_VERBS_H__ */
drivers/infiniband/hw/bnxt_re/main.c +7 -0
@@ -59,6 +59,7 @@#include "qplib_fp.h" #include "qplib_rcfw.h" #include "bnxt_re.h" +#include "ib_verbs.h" #include "bnxt.h" static char version[] =BNXT_RE_DESC " v" ROCE_DRV_MODULE_VERSION "\n" ;
@@ -431,6 +432,12 @@ static int bnxt_re_register_ib(struct bnxt_re_dev *rdev) ibdev->num_comp_vectors =1 ; ibdev->dma_device = &rdev->en_dev->pdev->dev; + ibdev->alloc_pd = bnxt_re_alloc_pd; + ibdev->dealloc_pd = bnxt_re_dealloc_pd; + ibdev->alloc_ucontext = bnxt_re_alloc_ucontext; + ibdev->dealloc_ucontext = bnxt_re_dealloc_ucontext; + ibdev->mmap = bnxt_re_mmap; +return ib_register_device (ibdev,NULL ); }
drivers/infiniband/hw/bnxt_re/qplib_res.c +28 -0
@@ -527,6 +527,34 @@ static int bnxt_qplib_alloc_pkey_tbl(struct bnxt_qplib_res *res,return 0 ; }; +/* PDs */ +int bnxt_qplib_alloc_pd (struct bnxt_qplib_pd_tbl *pdt,struct bnxt_qplib_pd *pd) +{ +u32 bit_num; + + bit_num =find_first_bit (pdt->tbl, pdt->max); +if (bit_num == pdt->max) +return -ENOMEM ; + +/* Found unused PD */ +clear_bit (bit_num, pdt->tbl); + pd->id = bit_num; +return 0 ; +} + +int bnxt_qplib_dealloc_pd (struct bnxt_qplib_res *res, +struct bnxt_qplib_pd_tbl *pdt, +struct bnxt_qplib_pd *pd) +{ +if (test_and_set_bit (pd->id, pdt->tbl)) { +dev_warn (&res->pdev->dev,"Freeing an unused PD? pdn = %d" , + pd->id); +return -EINVAL ; + } + pd->id =0 ; +return 0 ; +} +static void bnxt_qplib_free_pd_tbl (struct bnxt_qplib_pd_tbl *pdt) {kfree (pdt->tbl);
drivers/infiniband/hw/bnxt_re/qplib_res.h +6 -0
@@ -186,6 +186,7 @@ struct bnxt_qplib_res {struct bnxt_qplib_dpi_tbl dpi_tbl; }; +struct bnxt_qplib_pd ;struct bnxt_qplib_dev_attr ;void bnxt_qplib_free_hwq (struct pci_dev *pdev,struct bnxt_qplib_hwq *hwq);
@@ -193,6 +194,11 @@ int bnxt_qplib_alloc_init_hwq(struct pci_dev *pdev, struct bnxt_qplib_hwq *hwq, struct scatterlist *sl, int nmap, u32 *elements, u32 elements_per_page, u32 aux, u32 pg_size, enum bnxt_qplib_hwq_type hwq_type); +int bnxt_qplib_alloc_pd (struct bnxt_qplib_pd_tbl *pd_tbl, +struct bnxt_qplib_pd *pd); +int bnxt_qplib_dealloc_pd (struct bnxt_qplib_res *res, +struct bnxt_qplib_pd_tbl *pd_tbl, +struct bnxt_qplib_pd *pd);int bnxt_qplib_alloc_dpi (struct bnxt_qplib_dpi_tbl *dpit,struct bnxt_qplib_dpi *dpi,void *app);
drivers/infiniband/hw/bnxt_re/qplib_sp.h +4 -0
@@ -70,6 +70,10 @@ struct bnxt_qplib_dev_attr {u8 tqm_alloc_reqs[MAX_TQM_ALLOC_REQ ]; }; +struct bnxt_qplib_pd { +u32 id; +}; +struct bnxt_qplib_gid {u8 data[16 ]; };
include/uapi/rdma/bnxt_re-abi.h new file +59 -0
59 lines not on this page · raw message
Signature · 1 line
2.5.5
Selvin Xavier
maintainerPATCH v5 7/21 RDMA/bnxt_re: Support for query and modify device verbs
In reply to Selvin XavierImplements the query device and modify device verbs
v3: Fix sparse warnings related to endianness checks
--- drivers/infiniband/hw/bnxt_re/bnxt_re.h | 7 +++ drivers/infiniband/hw/bnxt_re/ib_verbs.c | 90 +++++++++++++++++++++++++++++++ drivers/infiniband/hw/bnxt_re/ib_verbs.h | 6 +++ drivers/infiniband/hw/bnxt_re/main.c | 2 + drivers/infiniband/hw/bnxt_re/qplib_res.c | 17 ++++++ drivers/infiniband/hw/bnxt_re/qplib_res.h | 1 + 6 files changed, 123 insertions(+)
drivers/infiniband/hw/bnxt_re/bnxt_re.h +7 -0
@@ -44,6 +44,13 @@#define BNXT_RE_DESC "Broadcom NetXtreme-C/E RoCE Driver" +#define BNXT_RE_PAGE_SIZE_4K BIT(12) +#define BNXT_RE_PAGE_SIZE_8K BIT(13) +#define BNXT_RE_PAGE_SIZE_64K BIT(16) +#define BNXT_RE_PAGE_SIZE_2M BIT(21) +#define BNXT_RE_PAGE_SIZE_8M BIT(23) +#define BNXT_RE_PAGE_SIZE_1G BIT(30) +#define BNXT_RE_MAX_QPC_COUNT (64 * 1024)#define BNXT_RE_MAX_MRW_COUNT (64 * 1024)#define BNXT_RE_MAX_SRQC_COUNT (64 * 1024)
drivers/infiniband/hw/bnxt_re/ib_verbs.c +90 -0
96 lines not on this page · raw message
drivers/infiniband/hw/bnxt_re/ib_verbs.h +6 -0
@@ -54,6 +54,12 @@ struct bnxt_re_ucontext {spinlock_t sh_lock;/* protect shpg */ }; +int bnxt_re_query_device (struct ib_device *ibdev, +struct ib_device_attr *ib_attr, +struct ib_udata *udata); +int bnxt_re_modify_device (struct ib_device *ibdev, +int device_modify_mask, +struct ib_device_modify *device_modify);struct ib_pd *bnxt_re_alloc_pd (struct ib_device *ibdev,struct ib_ucontext *context,struct ib_udata *udata);
drivers/infiniband/hw/bnxt_re/main.c +2 -0
@@ -432,6 +432,8 @@ static int bnxt_re_register_ib(struct bnxt_re_dev *rdev) ibdev->num_comp_vectors =1 ; ibdev->dma_device = &rdev->en_dev->pdev->dev; + ibdev->query_device = bnxt_re_query_device; + ibdev->modify_device = bnxt_re_modify_device; ibdev->alloc_pd = bnxt_re_alloc_pd; ibdev->dealloc_pd = bnxt_re_dealloc_pd; ibdev->alloc_ucontext = bnxt_re_alloc_ucontext;
drivers/infiniband/hw/bnxt_re/qplib_res.c +17 -0
@@ -445,6 +445,23 @@ int bnxt_qplib_alloc_ctx(struct pci_dev *pdev,return rc; } +/* GUID */ +void bnxt_qplib_get_guid (u8 *dev_addr,u8 *guid) +{ +u8 mac[ETH_ALEN ]; + +/* MAC-48 to EUI-64 mapping */ +memcpy (mac, dev_addr,ETH_ALEN ); + guid[0 ] = mac[0 ] ^2 ; + guid[1 ] = mac[1 ]; + guid[2 ] = mac[2 ]; + guid[3 ] =0xff ; + guid[4 ] =0xfe ; + guid[5 ] = mac[3 ]; + guid[6 ] = mac[4 ]; + guid[7 ] = mac[5 ]; +} +static void bnxt_qplib_free_sgid_tbl (struct bnxt_qplib_res *res,struct bnxt_qplib_sgid_tbl *sgid_tbl) {
drivers/infiniband/hw/bnxt_re/qplib_res.h +1 -0
@@ -194,6 +194,7 @@ int bnxt_qplib_alloc_init_hwq(struct pci_dev *pdev, struct bnxt_qplib_hwq *hwq, struct scatterlist *sl, int nmap, u32 *elements, u32 elements_per_page, u32 aux, u32 pg_size, enum bnxt_qplib_hwq_type hwq_type); +void bnxt_qplib_get_guid (u8 *dev_addr,u8 *guid);int bnxt_qplib_alloc_pd (struct bnxt_qplib_pd_tbl *pd_tbl,struct bnxt_qplib_pd *pd); int bnxt_qplib_dealloc_pd(struct bnxt_qplib_res *res,
Signature · 1 line
2.5.5
Selvin Xavier
maintainerPATCH v5 9/21 RDMA/bnxt_re: Support for GID related verbs
In reply to Selvin XavierImplements add GID, del GID, get_netdev and pkey related verbs.
v3: Fixes some sparse warning related to endianness check. Removes
macros which are just wrapper for standard defines.
--- drivers/infiniband/hw/bnxt_re/ib_verbs.c | 123 +++++++++++++++++ drivers/infiniband/hw/bnxt_re/ib_verbs.h | 18 +++ drivers/infiniband/hw/bnxt_re/main.c | 7 + drivers/infiniband/hw/bnxt_re/qplib_res.c | 5 + drivers/infiniband/hw/bnxt_re/qplib_res.h | 3 + drivers/infiniband/hw/bnxt_re/qplib_sp.c | 218 ++++++++++++++++++++++++++++++ drivers/infiniband/hw/bnxt_re/qplib_sp.h | 11 ++ 7 files changed, 385 insertions(+)
drivers/infiniband/hw/bnxt_re/ib_verbs.c +123 -0
@@ -60,6 +60,22 @@#include "ib_verbs.h" #include <rdma/bnxt_re-abi.h> +/* Device */ +struct net_device *bnxt_re_get_netdev (struct ib_device *ibdev,u8 port_num) +{ +struct bnxt_re_dev *rdev =to_bnxt_re_dev (ibdev, ibdev); +struct net_device *netdev =NULL ; + +rcu_read_lock (); +if (rdev) + netdev = rdev->netdev; +if (netdev) +dev_hold (netdev); + +rcu_read_unlock (); +return netdev; +} +int bnxt_re_query_device (struct ib_device *ibdev,struct ib_device_attr *ib_attr,struct ib_udata *udata)
@@ -272,6 +288,113 @@ int bnxt_re_get_port_immutable(struct ib_device *ibdev, u8 port_num, immutable->max_mad_size =IB_MGMT_MAD_SIZE ;return 0 ; } + +int bnxt_re_query_pkey (struct ib_device *ibdev,u8 port_num, +u16 index,u16 *pkey) +{ +struct bnxt_re_dev *rdev =to_bnxt_re_dev (ibdev, ibdev); + +/* Ignore port_num */ + +memset (pkey,0 ,sizeof (*pkey)); +return bnxt_qplib_get_pkey (&rdev->qplib_res, + &rdev->qplib_res.pkey_tbl, index, pkey); +} + +int bnxt_re_query_gid (struct ib_device *ibdev,u8 port_num, +int index,union ib_gid *gid) +{ +struct bnxt_re_dev *rdev =to_bnxt_re_dev (ibdev, ibdev); +int rc =0 ; + +/* Ignore port_num */ +memset (gid,0 ,sizeof (*gid)); + rc =bnxt_qplib_get_sgid (&rdev->qplib_res, + &rdev->qplib_res.sgid_tbl, index, + (struct bnxt_qplib_gid *)gid); +return rc; +} + +int bnxt_re_del_gid (struct ib_device *ibdev,u8 port_num, +unsigned int index,void **context) +{ +int rc =0 ; +struct bnxt_re_gid_ctx *ctx, **ctx_tbl; +struct bnxt_re_dev *rdev =to_bnxt_re_dev (ibdev, ibdev); +struct bnxt_qplib_sgid_tbl *sgid_tbl = &rdev->qplib_res.sgid_tbl; + +/* Delete the entry from the hardware */ + ctx = *context; +if (!ctx) +return -EINVAL ; + +if (sgid_tbl && sgid_tbl->active) { +if (ctx->idx >= sgid_tbl->max) +return -EINVAL ; + ctx->refcnt--; +if (!ctx->refcnt) { + rc =bnxt_qplib_del_sgid + (sgid_tbl, + &sgid_tbl->tbl[ctx->idx], true); +if (rc) +dev_err (rdev_to_dev (rdev), +"Failed to remove GID: %#x" , rc); + ctx_tbl = sgid_tbl->ctx; + ctx_tbl[ctx->idx] =NULL ; +kfree (ctx); + } + }else { +return -EINVAL ; + } +return rc; +} + +int bnxt_re_add_gid (struct ib_device *ibdev,u8 port_num, +unsigned int index,const union ib_gid *gid, +const struct ib_gid_attr *attr,void **context) +{ +int rc; +u32 tbl_idx =0 ; +u16 vlan_id =0xFFFF ; +struct bnxt_re_gid_ctx *ctx, **ctx_tbl; +struct bnxt_re_dev *rdev =to_bnxt_re_dev (ibdev, ibdev); +struct bnxt_qplib_sgid_tbl *sgid_tbl = &rdev->qplib_res.sgid_tbl; + +if ((attr->ndev) &&is_vlan_dev (attr->ndev)) + vlan_id =vlan_dev_vlan_id (attr->ndev); + + rc =bnxt_qplib_add_sgid (sgid_tbl, (struct bnxt_qplib_gid *)gid, + rdev->qplib_res.netdev->dev_addr, + vlan_id, true, &tbl_idx); +if (rc == -EALREADY ) { + ctx_tbl = sgid_tbl->ctx; + ctx_tbl[tbl_idx]->refcnt++; + *context = ctx_tbl[tbl_idx]; +return 0 ; + } + +if (rc <0 ) { +dev_err (rdev_to_dev (rdev),"Failed to add GID: %#x" , rc); +return rc; + } + + ctx =kmalloc (sizeof (*ctx),GFP_KERNEL ); +if (!ctx) +return -ENOMEM ; + ctx_tbl = sgid_tbl->ctx; + ctx->idx = tbl_idx; + ctx->refcnt =1 ; + ctx_tbl[tbl_idx] = ctx; + +return rc; +} + +enum rdma_link_layer bnxt_re_get_link_layer (struct ib_device *ibdev, +u8 port_num) +{ +return IB_LINK_LAYER_ETHERNET ; +} +/* Protection Domains */ int bnxt_re_dealloc_pd (struct ib_pd *ib_pd) {
drivers/infiniband/hw/bnxt_re/ib_verbs.h +18 -0
@@ -39,6 +39,11 @@ #ifndef __BNXT_RE_IB_VERBS_H__ #define __BNXT_RE_IB_VERBS_H__ +struct bnxt_re_gid_ctx { + u32 idx; + u32 refcnt; +}; + struct bnxt_re_pd { struct bnxt_re_dev *rdev; struct ib_pd ib_pd;
@@ -54,6 +59,8 @@ struct bnxt_re_ucontext {spinlock_t sh_lock;/* protect shpg */ }; +struct net_device *bnxt_re_get_netdev (struct ib_device *ibdev,u8 port_num); +int bnxt_re_query_device (struct ib_device *ibdev,struct ib_device_attr *ib_attr,struct ib_udata *udata);
@@ -67,6 +74,17 @@ int bnxt_re_modify_port(struct ib_device *ibdev, u8 port_num, struct ib_port_modify *port_modify);int bnxt_re_get_port_immutable (struct ib_device *ibdev,u8 port_num,struct ib_port_immutable *immutable); +int bnxt_re_query_pkey (struct ib_device *ibdev,u8 port_num, +u16 index,u16 *pkey); +int bnxt_re_del_gid (struct ib_device *ibdev,u8 port_num, +unsigned int index,void **context); +int bnxt_re_add_gid (struct ib_device *ibdev,u8 port_num, +unsigned int index,const union ib_gid *gid, +const struct ib_gid_attr *attr,void **context); +int bnxt_re_query_gid (struct ib_device *ibdev,u8 port_num, +int index,union ib_gid *gid); +enum rdma_link_layer bnxt_re_get_link_layer (struct ib_device *ibdev, +u8 port_num);struct ib_pd *bnxt_re_alloc_pd (struct ib_device *ibdev,struct ib_ucontext *context,struct ib_udata *udata);
drivers/infiniband/hw/bnxt_re/main.c +7 -0
@@ -438,6 +438,13 @@ static int bnxt_re_register_ib(struct bnxt_re_dev *rdev) ibdev->query_port = bnxt_re_query_port; ibdev->modify_port = bnxt_re_modify_port; ibdev->get_port_immutable = bnxt_re_get_port_immutable; + ibdev->query_pkey = bnxt_re_query_pkey; + ibdev->query_gid = bnxt_re_query_gid; + ibdev->get_netdev = bnxt_re_get_netdev; + ibdev->add_gid = bnxt_re_add_gid; + ibdev->del_gid = bnxt_re_del_gid; + ibdev->get_link_layer = bnxt_re_get_link_layer; + ibdev->alloc_pd = bnxt_re_alloc_pd; ibdev->dealloc_pd = bnxt_re_dealloc_pd; ibdev->alloc_ucontext = bnxt_re_alloc_ucontext;
drivers/infiniband/hw/bnxt_re/qplib_res.c +5 -0
@@ -507,6 +507,11 @@ static void bnxt_qplib_cleanup_sgid_tbl(struct bnxt_qplib_res *res, {int i; +for (i =0 ; i < sgid_tbl->max; i++) { +if (memcmp (&sgid_tbl->tbl[i], &bnxt_qplib_gid_zero, +sizeof (bnxt_qplib_gid_zero))) +bnxt_qplib_del_sgid (sgid_tbl, &sgid_tbl->tbl[i], true); + }memset (sgid_tbl->tbl,0 ,sizeof (struct bnxt_qplib_gid ) * sgid_tbl->max);memset (sgid_tbl->hw_id,-1 ,sizeof (u16) * sgid_tbl->max); sgid_tbl->active =0 ;
drivers/infiniband/hw/bnxt_re/qplib_res.h +3 -0
@@ -186,6 +186,9 @@ struct bnxt_qplib_res {struct bnxt_qplib_dpi_tbl dpi_tbl; }; +#define to_bnxt_qplib (ptr, type, member) \ + container_of(ptr, type, member) +struct bnxt_qplib_pd ;struct bnxt_qplib_dev_attr ;
drivers/infiniband/hw/bnxt_re/qplib_sp.c +218 -0
230 lines not on this page · raw message
drivers/infiniband/hw/bnxt_re/qplib_sp.h +11 -0
@@ -78,6 +78,17 @@ struct bnxt_qplib_gid {u8 data[16 ]; }; +int bnxt_qplib_get_sgid (struct bnxt_qplib_res *res, +struct bnxt_qplib_sgid_tbl *sgid_tbl,int index, +struct bnxt_qplib_gid *gid); +int bnxt_qplib_del_sgid (struct bnxt_qplib_sgid_tbl *sgid_tbl, +struct bnxt_qplib_gid *gid,bool update); +int bnxt_qplib_add_sgid (struct bnxt_qplib_sgid_tbl *sgid_tbl, +struct bnxt_qplib_gid *gid,u8 *mac,u16 vlan_id, +bool update,u32 *index); +int bnxt_qplib_get_pkey (struct bnxt_qplib_res *res, +struct bnxt_qplib_pkey_tbl *pkey_tbl,u16 index, +u16 *pkey);int bnxt_qplib_del_pkey (struct bnxt_qplib_res *res,struct bnxt_qplib_pkey_tbl *pkey_tbl,u16 *pkey,bool update);
Signature · 1 line
2.5.5
Selvin Xavier
maintainerPATCH v5 10/21 RDMA/bnxt_re: Support for CQ verbs
In reply to Selvin XavierImplements support for create_cq, destroy_cq and req_notify_cq verbs.
v3: Code cleanup based on errors reported by sparse on endianness check.
Removes unwanted macros.
v5: Use min_t macro to calculate the CQ entries
--- drivers/infiniband/hw/bnxt_re/ib_verbs.c | 144 ++++++++++++++++++++++++ drivers/infiniband/hw/bnxt_re/ib_verbs.h | 19 ++++ drivers/infiniband/hw/bnxt_re/main.c | 4 + drivers/infiniband/hw/bnxt_re/qplib_fp.c | 181 +++++++++++++++++++++++++++++++ drivers/infiniband/hw/bnxt_re/qplib_fp.h | 50 +++++++++ include/uapi/rdma/bnxt_re-abi.h | 12 ++ 6 files changed, 410 insertions(+)
drivers/infiniband/hw/bnxt_re/ib_verbs.c +144 -0
@@ -492,6 +492,150 @@ struct ib_pd *bnxt_re_alloc_pd(struct ib_device *ibdev,return ERR_PTR (rc); } +/* Completion Queues */ +int bnxt_re_destroy_cq (struct ib_cq *ib_cq) +{ + struct bnxt_re_cq *cq = container_of(ib_cq, struct bnxt_re_cq, ib_cq); +struct bnxt_re_dev *rdev = cq->rdev; +int rc; + + rc =bnxt_qplib_destroy_cq (&rdev->qplib_res, &cq->qplib_cq); +if (rc) { +dev_err (rdev_to_dev (rdev),"Failed to destroy HW CQ" ); +return rc; + } +if (cq->umem && !IS_ERR (cq->umem)) +ib_umem_release (cq->umem); + +if (cq) { +kfree (cq->cql); +kfree (cq); + } +atomic_dec (&rdev->cq_count); + rdev->nq.budget--; +return 0 ; +} + +struct ib_cq *bnxt_re_create_cq (struct ib_device *ibdev, +const struct ib_cq_init_attr *attr, +struct ib_ucontext *context, +struct ib_udata *udata) +{ +struct bnxt_re_dev *rdev =to_bnxt_re_dev (ibdev, ibdev); +struct bnxt_qplib_dev_attr *dev_attr = &rdev->dev_attr; +struct bnxt_re_cq *cq =NULL ; +int rc, entries; +int cqe = attr->cqe; + +/* Validate CQ fields */ +if (cqe <1 || cqe > dev_attr->max_cq_wqes) { +dev_err (rdev_to_dev (rdev),"Failed to create CQ -max exceeded" ); +return ERR_PTR (-EINVAL ); + } + cq =kzalloc (sizeof (*cq),GFP_KERNEL ); +if (!cq) +return ERR_PTR (-ENOMEM ); + + cq->rdev = rdev; + cq->qplib_cq.cq_handle = (u64 )(unsigned long )(&cq->qplib_cq); + + entries =roundup_pow_of_two (cqe +1 ); +if (entries > dev_attr->max_cq_wqes +1 ) + entries = dev_attr->max_cq_wqes +1 ; + +if (context) { +struct bnxt_re_cq_req req; +struct bnxt_re_ucontext *uctx =container_of + (context, + struct bnxt_re_ucontext, + ib_uctx); +if (ib_copy_from_udata (&req, udata,sizeof (req))) { + rc = -EFAULT ; + goto fail; + } + + cq->umem =ib_umem_get (context, req.cq_va, + entries *sizeof (struct cq_base ), +IB_ACCESS_LOCAL_WRITE ,1 ); +if (IS_ERR (cq->umem)) { + rc =PTR_ERR (cq->umem); + goto fail; + } + cq->qplib_cq.sghead = cq->umem->sg_head.sgl; + cq->qplib_cq.nmap = cq->umem->nmap; + cq->qplib_cq.dpi = uctx->dpi; + }else { + cq->max_cql =min_t (u32, entries,MAX_CQL_PER_POLL ); + cq->cql =kcalloc (cq->max_cql,sizeof (struct bnxt_qplib_cqe ), +GFP_KERNEL ); +if (!cq->cql) { + rc = -ENOMEM ; + goto fail; + } + + cq->qplib_cq.dpi = &rdev->dpi_privileged; + cq->qplib_cq.sghead =NULL ; + cq->qplib_cq.nmap =0 ; + } + cq->qplib_cq.max_wqe = entries; + cq->qplib_cq.cnq_hw_ring_id = rdev->nq.ring_id; + + rc =bnxt_qplib_create_cq (&rdev->qplib_res, &cq->qplib_cq); +if (rc) { +dev_err (rdev_to_dev (rdev),"Failed to create HW CQ" ); + goto fail; + } + + cq->ib_cq.cqe = entries; + cq->cq_period = cq->qplib_cq.period; + rdev->nq.budget++; + +atomic_inc (&rdev->cq_count); + +if (context) { +struct bnxt_re_cq_resp resp; + + resp.cqid = cq->qplib_cq.id; + resp.tail = cq->qplib_cq.hwq.cons; + resp.phase = cq->qplib_cq.period; + resp.rsvd =0 ; + rc =ib_copy_to_udata (udata, &resp,sizeof (resp)); +if (rc) { +dev_err (rdev_to_dev (rdev),"Failed to copy CQ udata" ); +bnxt_qplib_destroy_cq (&rdev->qplib_res, &cq->qplib_cq); + goto c2fail; + } + } + +return &cq->ib_cq; + +c2fail: +if (context) +ib_umem_release (cq->umem); +fail: +kfree (cq->cql); +kfree (cq); +return ERR_PTR (rc); +} + +int bnxt_re_req_notify_cq (struct ib_cq *ib_cq, +enum ib_cq_notify_flags ib_cqn_flags) +{ + struct bnxt_re_cq *cq = container_of(ib_cq, struct bnxt_re_cq, ib_cq); +int type =0 ; + +/* Trigger on the very next completion */ +if (ib_cqn_flags &IB_CQ_NEXT_COMP ) + type =DBR_DBR_TYPE_CQ_ARMALL ; +/* Trigger on the next solicited completion */ +else if (ib_cqn_flags &IB_CQ_SOLICITED ) + type =DBR_DBR_TYPE_CQ_ARMSE ; + +bnxt_qplib_req_notify_cq (&cq->qplib_cq, type); + +return 0 ; +} +struct ib_ucontext *bnxt_re_alloc_ucontext (struct ib_device *ibdev,struct ib_udata *udata) {
drivers/infiniband/hw/bnxt_re/ib_verbs.h +19 -0
@@ -51,6 +51,19 @@ struct bnxt_re_pd {struct bnxt_qplib_dpi dpi; }; +struct bnxt_re_cq { +struct bnxt_re_dev *rdev; +spinlock_t cq_lock;/* protect cq */ +u16 cq_count; +u16 cq_period; +struct ib_cq ib_cq; +struct bnxt_qplib_cq qplib_cq; +struct bnxt_qplib_cqe *cql; +#define MAX_CQL_PER_POLL 1024 +u32 max_cql; +struct ib_umem *umem; +}; +struct bnxt_re_ucontext {struct bnxt_re_dev *rdev;struct ib_ucontext ib_uctx;
@@ -89,6 +102,12 @@ struct ib_pd *bnxt_re_alloc_pd(struct ib_device *ibdev,struct ib_ucontext *context, struct ib_udata *udata);int bnxt_re_dealloc_pd (struct ib_pd *pd); +struct ib_cq *bnxt_re_create_cq (struct ib_device *ibdev, +const struct ib_cq_init_attr *attr, +struct ib_ucontext *context, +struct ib_udata *udata); +int bnxt_re_destroy_cq (struct ib_cq *cq); +int bnxt_re_req_notify_cq (struct ib_cq *cq,enum ib_cq_notify_flags flags);struct ib_ucontext *bnxt_re_alloc_ucontext (struct ib_device *ibdev,struct ib_udata *udata);int bnxt_re_dealloc_ucontext (struct ib_ucontext *context);
drivers/infiniband/hw/bnxt_re/main.c +4 -0
@@ -447,6 +447,10 @@ static int bnxt_re_register_ib(struct bnxt_re_dev *rdev) ibdev->alloc_pd = bnxt_re_alloc_pd; ibdev->dealloc_pd = bnxt_re_dealloc_pd; + + ibdev->create_cq = bnxt_re_create_cq; + ibdev->destroy_cq = bnxt_re_destroy_cq; + ibdev->req_notify_cq = bnxt_re_req_notify_cq; ibdev->alloc_ucontext = bnxt_re_alloc_ucontext; ibdev->dealloc_ucontext = bnxt_re_dealloc_ucontext; ibdev->mmap = bnxt_re_mmap;
drivers/infiniband/hw/bnxt_re/qplib_fp.c +181 -0
205 lines not on this page · raw message
drivers/infiniband/hw/bnxt_re/qplib_fp.h +50 -0
62 lines not on this page · raw message
include/uapi/rdma/bnxt_re-abi.h +12 -0
@@ -56,4 +56,16 @@ struct bnxt_re_pd_resp { __u64 dbr; }; +struct bnxt_re_cq_req { +__u64 cq_va; +__u64 cq_handle; +}; + +struct bnxt_re_cq_resp { +__u32 cqid; +__u32 tail; +__u32 phase; +__u32 rsvd; +}; +#endif /* __BNXT_RE_UVERBS_ABI_H__*/
Signature · 1 line
2.5.5
Re: [PATCH V5 for-next 10/21] RDMA/bnxt_re: Support for CQ verbs
Quoted 13 lines · Selvin Xavier
Implements support for
create_cq,destroy_cqandreq_notify_cqverbs.v3: Code cleanup based on errors reported by sparse on endianness check.
Removes unwanted macros.
v5: Usemin_tmacro to calculate the CQ entriesSigned-off-by Eddie Wai <[email protected]>Signed-off-by Devesh Sharma <[email protected]>Signed-off-by Somnath Kotur <[email protected]>Signed-off-by Sriharsha Basavapatna <[email protected]>Signed-off-by Selvin Xavier <[email protected]>---
<...>
drivers/infiniband/hw/bnxt_re/qplib_fp.h line 42
Quoted 10 lines
drivers/infiniband/hw/bnxt_re/qplib_fp.h +2
-0@@ -38,6 +38,52 @@#ifndef __BNXT_QPLIB_FP_H__#define __BNXT_QPLIB_FP_H__ +#define BNXT_QPLIB_MAX_CQE_ENTRY_SIZE sizeof(struct cq_base) +
IMHO, this define is redundant.
Thanks
Selvin Xavier
maintainerPATCH v5 11/21 RDMA/bnxt_re: Support for AH verbs
In reply to Selvin XavierThis patch implements support for create_ah, destroy_ah, query_ah and modify_ah verbs.
v3: Removes unwanted macros and does cleanup listed by checkpatch
v5: Adds ib_udata parameter to create_ah verb
--- drivers/infiniband/hw/bnxt_re/ib_verbs.c | 148 +++++++++++++++++++++++++++++++ drivers/infiniband/hw/bnxt_re/ib_verbs.h | 12 +++ drivers/infiniband/hw/bnxt_re/main.c | 4 + drivers/infiniband/hw/bnxt_re/qplib_sp.c | 94 ++++++++++++++++++++ drivers/infiniband/hw/bnxt_re/qplib_sp.h | 18 ++++ include/uapi/rdma/bnxt_re-abi.h | 7 ++ 6 files changed, 283 insertions(+)
drivers/infiniband/hw/bnxt_re/ib_verbs.c +148 -0
@@ -492,6 +492,154 @@ struct ib_pd *bnxt_re_alloc_pd(struct ib_device *ibdev,return ERR_PTR (rc); } +/* Address Handles */ +int bnxt_re_destroy_ah (struct ib_ah *ib_ah) +{ + struct bnxt_re_ah *ah = container_of(ib_ah, struct bnxt_re_ah, ib_ah); +struct bnxt_re_dev *rdev = ah->rdev; +int rc; + + rc =bnxt_qplib_destroy_ah (&rdev->qplib_res, &ah->qplib_ah); +if (rc) { +dev_err (rdev_to_dev (rdev),"Failed to destroy HW AH" ); +return rc; + } +kfree (ah); +return 0 ; +} + +struct ib_ah *bnxt_re_create_ah (struct ib_pd *ib_pd, +struct ib_ah_attr *ah_attr, +struct ib_udata *udata) +{ + struct bnxt_re_pd *pd = container_of(ib_pd, struct bnxt_re_pd, ib_pd); +struct bnxt_re_dev *rdev = pd->rdev; +struct bnxt_re_ah *ah; +int rc; +u16 vlan_tag; +u8 nw_type; + +struct ib_gid_attr sgid_attr; + +if (!(ah_attr->ah_flags &IB_AH_GRH )) { +dev_err (rdev_to_dev (rdev),"Failed to alloc AH: GRH not set" ); +return ERR_PTR (-EINVAL ); + } + ah =kzalloc (sizeof (*ah),GFP_ATOMIC ); +if (!ah) +return ERR_PTR (-ENOMEM ); + + ah->rdev = rdev; + ah->qplib_ah.pd = &pd->qplib_pd; + +/* Supply the configuration for the HW */ +memcpy (ah->qplib_ah.dgid.data, ah_attr->grh.dgid.raw, +sizeof (union ib_gid )); +/* +* If RoCE V2 is enabled, stack will have two entries for +* each GID entry. Avoiding this duplicte entry in HW. Dividing +* the GID index by 2 for RoCE V2 +*/ + ah->qplib_ah.sgid_index = ah_attr->grh.sgid_index /2 ; + ah->qplib_ah.host_sgid_index = ah_attr->grh.sgid_index; + ah->qplib_ah.traffic_class = ah_attr->grh.traffic_class; + ah->qplib_ah.flow_label = ah_attr->grh.flow_label; + ah->qplib_ah.hop_limit = ah_attr->grh.hop_limit; + ah->qplib_ah.sl = ah_attr->sl; +if (ib_pd->uobject && + !rdma_is_multicast_addr ((struct in6_addr *) + ah_attr->grh.dgid.raw) && + !rdma_link_local_addr ((struct in6_addr *) + ah_attr->grh.dgid.raw)) { +union ib_gid sgid; + + rc =ib_get_cached_gid (&rdev->ibdev,1 , + ah_attr->grh.sgid_index, &sgid, + &sgid_attr); +if (rc) { +dev_err (rdev_to_dev (rdev), +"Failed to query gid at index %d" , + ah_attr->grh.sgid_index); + goto fail; + } +if (sgid_attr.ndev) { +if (is_vlan_dev (sgid_attr.ndev)) + vlan_tag =vlan_dev_vlan_id (sgid_attr.ndev); +dev_put (sgid_attr.ndev); + } +/* Get network header type for this GID */ + nw_type =ib_gid_to_network_type (sgid_attr.gid_type, &sgid); +switch (nw_type) { +case RDMA_NETWORK_IPV4 : + ah->qplib_ah.nw_type =CMDQ_CREATE_AH_TYPE_V2IPV4 ; +break ; +case RDMA_NETWORK_IPV6 : + ah->qplib_ah.nw_type =CMDQ_CREATE_AH_TYPE_V2IPV6 ; +break ; +default : + ah->qplib_ah.nw_type =CMDQ_CREATE_AH_TYPE_V1 ; +break ; + } + rc =rdma_addr_find_l2_eth_by_grh (&sgid, &ah_attr->grh.dgid, + ah_attr->dmac, &vlan_tag, + &sgid_attr.ndev->ifindex, +NULL ); +if (rc) { +dev_err (rdev_to_dev (rdev),"Failed to get dmac\n" ); + goto fail; + } + } + +memcpy (ah->qplib_ah.dmac, ah_attr->dmac,ETH_ALEN ); + rc =bnxt_qplib_create_ah (&rdev->qplib_res, &ah->qplib_ah); +if (rc) { +dev_err (rdev_to_dev (rdev),"Failed to allocate HW AH" ); + goto fail; + } + +/* Write AVID to shared page. */ +if (ib_pd->uobject) { +struct ib_ucontext *ib_uctx = ib_pd->uobject->context; +struct bnxt_re_ucontext *uctx; +unsigned long flag; +u32 *wrptr; + + uctx = container_of(ib_uctx, struct bnxt_re_ucontext, ib_uctx); +spin_lock_irqsave (&uctx->sh_lock, flag); + wrptr = (u32 *)(uctx->shpg +BNXT_RE_AVID_OFFT ); + *wrptr = ah->qplib_ah.id; +wmb ();/* make sure cache is updated. */ +spin_unlock_irqrestore (&uctx->sh_lock, flag); + } + +return &ah->ib_ah; + +fail: +kfree (ah); +return ERR_PTR (rc); +} + +int bnxt_re_modify_ah (struct ib_ah *ib_ah,struct ib_ah_attr *ah_attr) +{ +return 0 ; +} + +int bnxt_re_query_ah (struct ib_ah *ib_ah,struct ib_ah_attr *ah_attr) +{ + struct bnxt_re_ah *ah = container_of(ib_ah, struct bnxt_re_ah, ib_ah); + +memcpy (ah_attr->grh.dgid.raw, ah->qplib_ah.dgid.data, +sizeof (union ib_gid )); + ah_attr->grh.sgid_index = ah->qplib_ah.host_sgid_index; + ah_attr->grh.traffic_class = ah->qplib_ah.traffic_class; + ah_attr->sl = ah->qplib_ah.sl; +memcpy (ah_attr->dmac, ah->qplib_ah.dmac,ETH_ALEN ); + ah_attr->ah_flags =IB_AH_GRH ; + ah_attr->port_num =1 ; + ah_attr->static_rate =0 ; +return 0 ; +} +/* Completion Queues */ int bnxt_re_destroy_cq (struct ib_cq *ib_cq) {
drivers/infiniband/hw/bnxt_re/ib_verbs.h +12 -0
@@ -51,6 +51,12 @@ struct bnxt_re_pd {struct bnxt_qplib_dpi dpi; }; +struct bnxt_re_ah { +struct bnxt_re_dev *rdev; +struct ib_ah ib_ah; +struct bnxt_qplib_ah qplib_ah; +}; +struct bnxt_re_cq {struct bnxt_re_dev *rdev;spinlock_t cq_lock;/* protect cq */
@@ -102,6 +108,12 @@ struct ib_pd *bnxt_re_alloc_pd(struct ib_device *ibdev,struct ib_ucontext *context, struct ib_udata *udata);int bnxt_re_dealloc_pd (struct ib_pd *pd); +struct ib_ah *bnxt_re_create_ah (struct ib_pd *pd, +struct ib_ah_attr *ah_attr, +struct ib_udata *udata); +int bnxt_re_modify_ah (struct ib_ah *ah,struct ib_ah_attr *ah_attr); +int bnxt_re_query_ah (struct ib_ah *ah,struct ib_ah_attr *ah_attr); +int bnxt_re_destroy_ah (struct ib_ah *ah); struct ib_cq *bnxt_re_create_cq(struct ib_device *ibdev, const struct ib_cq_init_attr *attr, struct ib_ucontext *context,
drivers/infiniband/hw/bnxt_re/main.c +4 -0
@@ -448,6 +448,10 @@ static int bnxt_re_register_ib(struct bnxt_re_dev *rdev) ibdev->alloc_pd = bnxt_re_alloc_pd; ibdev->dealloc_pd = bnxt_re_dealloc_pd; + ibdev->create_ah = bnxt_re_create_ah; + ibdev->modify_ah = bnxt_re_modify_ah; + ibdev->query_ah = bnxt_re_query_ah; + ibdev->destroy_ah = bnxt_re_destroy_ah; ibdev->create_cq = bnxt_re_create_cq; ibdev->destroy_cq = bnxt_re_destroy_cq; ibdev->req_notify_cq = bnxt_re_req_notify_cq;
drivers/infiniband/hw/bnxt_re/qplib_sp.c +94 -0
97 lines not on this page · raw message
drivers/infiniband/hw/bnxt_re/qplib_sp.h +18 -0
@@ -78,6 +78,22 @@ struct bnxt_qplib_gid {u8 data[16 ]; }; +struct bnxt_qplib_ah { +struct bnxt_qplib_gid dgid; +struct bnxt_qplib_pd *pd; +u32 id; +u8 sgid_index; +/* For Query AH if the hw table and SW table are differnt */ +u8 host_sgid_index; +u8 traffic_class; +u32 flow_label; +u8 hop_limit; +u8 sl; +u8 dmac[6 ]; +u16 vlan_id; +u8 nw_type; +}; +int bnxt_qplib_get_sgid (struct bnxt_qplib_res *res,struct bnxt_qplib_sgid_tbl *sgid_tbl,int index,struct bnxt_qplib_gid *gid);
@@ -97,4 +113,6 @@ int bnxt_qplib_add_pkey(struct bnxt_qplib_res *res, bool update);int bnxt_qplib_get_dev_attr (struct bnxt_qplib_rcfw *rcfw,struct bnxt_qplib_dev_attr *attr); +int bnxt_qplib_create_ah (struct bnxt_qplib_res *res,struct bnxt_qplib_ah *ah); +int bnxt_qplib_destroy_ah (struct bnxt_qplib_res *res,struct bnxt_qplib_ah *ah);#endif /* __BNXT_QPLIB_SP_H__*/
include/uapi/rdma/bnxt_re-abi.h +7 -0
@@ -68,4 +68,11 @@ struct bnxt_re_cq_resp { __u32 rsvd; }; +enum bnxt_re_shpg_offt { +BNXT_RE_BEG_RESV_OFFT =0x00 , +BNXT_RE_AVID_OFFT =0x10 , +BNXT_RE_AVID_SIZE =0x04 , +BNXT_RE_END_RESV_OFFT =0xFF0 +}; +#endif /* __BNXT_RE_UVERBS_ABI_H__*/
Signature · 1 line
2.5.5
Selvin Xavier
maintainerPATCH v5 12/21 RDMA/bnxt_re: Support memory registration verbs
In reply to Selvin XavierThis patch implements the kernel and user memory region registration supported by the bnxt_re driver.
This includes the user MR, FRMR, FMR and DMA MR support.
v3: Moves bnxt_qplib_map_tc2cos to DCB patch as the functionality is used
by DCB patch. Also, removed some unwanted macros.
--- drivers/infiniband/hw/bnxt_re/ib_verbs.c | 376 +++++++++++++++++++++++++++++++ drivers/infiniband/hw/bnxt_re/ib_verbs.h | 44 ++++ drivers/infiniband/hw/bnxt_re/main.c | 11 + drivers/infiniband/hw/bnxt_re/qplib_sp.c | 289 ++++++++++++++++++++++++ drivers/infiniband/hw/bnxt_re/qplib_sp.h | 41 ++++ 5 files changed, 761 insertions(+)
drivers/infiniband/hw/bnxt_re/ib_verbs.c +376 -0
@@ -640,6 +640,48 @@ int bnxt_re_query_ah(struct ib_ah *ib_ah, struct ib_ah_attr *ah_attr)return 0 ; } +static int __from_ib_access_flags (int iflags) +{ +int qflags =0 ; + +if (iflags &IB_ACCESS_LOCAL_WRITE ) + qflags |=BNXT_QPLIB_ACCESS_LOCAL_WRITE ; +if (iflags &IB_ACCESS_REMOTE_READ ) + qflags |=BNXT_QPLIB_ACCESS_REMOTE_READ ; +if (iflags &IB_ACCESS_REMOTE_WRITE ) + qflags |=BNXT_QPLIB_ACCESS_REMOTE_WRITE ; +if (iflags &IB_ACCESS_REMOTE_ATOMIC ) + qflags |=BNXT_QPLIB_ACCESS_REMOTE_ATOMIC ; +if (iflags &IB_ACCESS_MW_BIND ) + qflags |=BNXT_QPLIB_ACCESS_MW_BIND ; +if (iflags &IB_ZERO_BASED ) + qflags |=BNXT_QPLIB_ACCESS_ZERO_BASED ; +if (iflags &IB_ACCESS_ON_DEMAND ) + qflags |=BNXT_QPLIB_ACCESS_ON_DEMAND ; +return qflags; +}; + +static enum ib_access_flags __to_ib_access_flags (int qflags) +{ +enum ib_access_flags iflags =0 ; + +if (qflags &BNXT_QPLIB_ACCESS_LOCAL_WRITE ) + iflags |=IB_ACCESS_LOCAL_WRITE ; +if (qflags &BNXT_QPLIB_ACCESS_REMOTE_WRITE ) + iflags |=IB_ACCESS_REMOTE_WRITE ; +if (qflags &BNXT_QPLIB_ACCESS_REMOTE_READ ) + iflags |=IB_ACCESS_REMOTE_READ ; +if (qflags &BNXT_QPLIB_ACCESS_REMOTE_ATOMIC ) + iflags |=IB_ACCESS_REMOTE_ATOMIC ; +if (qflags &BNXT_QPLIB_ACCESS_MW_BIND ) + iflags |=IB_ACCESS_MW_BIND ; +if (qflags &BNXT_QPLIB_ACCESS_ZERO_BASED ) + iflags |=IB_ZERO_BASED ; +if (qflags &BNXT_QPLIB_ACCESS_ON_DEMAND ) + iflags |=IB_ACCESS_ON_DEMAND ; +return iflags; +}; +/* Completion Queues */ int bnxt_re_destroy_cq (struct ib_cq *ib_cq) {
@@ -784,6 +826,340 @@ int bnxt_re_req_notify_cq(struct ib_cq *ib_cq,return 0 ; } +/* Memory Regions */ +struct ib_mr *bnxt_re_get_dma_mr (struct ib_pd *ib_pd,int mr_access_flags) +{ + struct bnxt_re_pd *pd = container_of(ib_pd, struct bnxt_re_pd, ib_pd); +struct bnxt_re_dev *rdev = pd->rdev; +struct bnxt_re_mr *mr; +u64 pbl =0 ; +int rc; + + mr =kzalloc (sizeof (*mr),GFP_KERNEL ); +if (!mr) +return ERR_PTR (-ENOMEM ); + + mr->rdev = rdev; + mr->qplib_mr.pd = &pd->qplib_pd; + mr->qplib_mr.flags =__from_ib_access_flags (mr_access_flags); + mr->qplib_mr.type =CMDQ_ALLOCATE_MRW_MRW_FLAGS_PMR ; + +/* Allocate and register 0 as the address */ + rc =bnxt_qplib_alloc_mrw (&rdev->qplib_res, &mr->qplib_mr); +if (rc) + goto fail; + + mr->qplib_mr.hwq.level =PBL_LVL_MAX ; + mr->qplib_mr.total_size =-1 ;/* Infinte length */ + rc =bnxt_qplib_reg_mr (&rdev->qplib_res, &mr->qplib_mr, &pbl,0 , false); +if (rc) + goto fail_mr; + + mr->ib_mr.lkey = mr->qplib_mr.lkey; +if (mr_access_flags & (IB_ACCESS_REMOTE_WRITE |IB_ACCESS_REMOTE_READ | +IB_ACCESS_REMOTE_ATOMIC )) + mr->ib_mr.rkey = mr->ib_mr.lkey; +atomic_inc (&rdev->mr_count); + +return &mr->ib_mr; + +fail_mr: +bnxt_qplib_free_mrw (&rdev->qplib_res, &mr->qplib_mr); +fail: +kfree (mr); +return ERR_PTR (rc); +} + +int bnxt_re_dereg_mr (struct ib_mr *ib_mr) +{ + struct bnxt_re_mr *mr = container_of(ib_mr, struct bnxt_re_mr, ib_mr); +struct bnxt_re_dev *rdev = mr->rdev; +int rc =0 ; + +if (mr->npages && mr->pages) { + rc =bnxt_qplib_free_fast_reg_page_list (&rdev->qplib_res, + &mr->qplib_frpl); +kfree (mr->pages); + mr->npages =0 ; + mr->pages =NULL ; + } + rc =bnxt_qplib_free_mrw (&rdev->qplib_res, &mr->qplib_mr); + +if (!IS_ERR (mr->ib_umem) && mr->ib_umem) +ib_umem_release (mr->ib_umem); + +kfree (mr); +atomic_dec (&rdev->mr_count); +return rc; +} + +static int bnxt_re_set_page (struct ib_mr *ib_mr,u64 addr) +{ + struct bnxt_re_mr *mr = container_of(ib_mr, struct bnxt_re_mr, ib_mr); + +if (unlikely (mr->npages == mr->qplib_frpl.max_pg_ptrs)) +return -ENOMEM ; + + mr->pages[mr->npages++] = addr; +return 0 ; +} + +int bnxt_re_map_mr_sg (struct ib_mr *ib_mr,struct scatterlist *sg,int sg_nents, +unsigned int *sg_offset) +{ + struct bnxt_re_mr *mr = container_of(ib_mr, struct bnxt_re_mr, ib_mr); + + mr->npages =0 ; +return ib_sg_to_pages (ib_mr, sg, sg_nents, sg_offset, bnxt_re_set_page); +} + +struct ib_mr *bnxt_re_alloc_mr (struct ib_pd *ib_pd,enum ib_mr_type type, +u32 max_num_sg) +{ + struct bnxt_re_pd *pd = container_of(ib_pd, struct bnxt_re_pd, ib_pd); +struct bnxt_re_dev *rdev = pd->rdev; +struct bnxt_re_mr *mr =NULL ; +int rc; + +if (type !=IB_MR_TYPE_MEM_REG ) { +dev_dbg (rdev_to_dev (rdev),"MR type 0x%x not supported" , type); +return ERR_PTR (-EINVAL ); + } +if (max_num_sg >MAX_PBL_LVL_1_PGS ) +return ERR_PTR (-EINVAL ); + + mr =kzalloc (sizeof (*mr),GFP_KERNEL ); +if (!mr) +return ERR_PTR (-ENOMEM ); + + mr->rdev = rdev; + mr->qplib_mr.pd = &pd->qplib_pd; + mr->qplib_mr.flags =BNXT_QPLIB_FR_PMR ; + mr->qplib_mr.type =CMDQ_ALLOCATE_MRW_MRW_FLAGS_PMR ; + + rc =bnxt_qplib_alloc_mrw (&rdev->qplib_res, &mr->qplib_mr); +if (rc) + goto fail; + + mr->ib_mr.lkey = mr->qplib_mr.lkey; + mr->ib_mr.rkey = mr->ib_mr.lkey; + + mr->pages =kcalloc (max_num_sg,sizeof (u64),GFP_KERNEL ); +if (!mr->pages) { + rc = -ENOMEM ; + goto fail; + } + rc =bnxt_qplib_alloc_fast_reg_page_list (&rdev->qplib_res, + &mr->qplib_frpl, max_num_sg); +if (rc) { +dev_err (rdev_to_dev (rdev), +"Failed to allocate HW FR page list" ); + goto fail_mr; + } + +atomic_inc (&rdev->mr_count); +return &mr->ib_mr; + +fail_mr: +bnxt_qplib_free_mrw (&rdev->qplib_res, &mr->qplib_mr); +fail: +kfree (mr->pages); +kfree (mr); +return ERR_PTR (rc); +} + +/* Fast Memory Regions */ +struct ib_fmr *bnxt_re_alloc_fmr (struct ib_pd *ib_pd,int mr_access_flags, +struct ib_fmr_attr *fmr_attr) +{ + struct bnxt_re_pd *pd = container_of(ib_pd, struct bnxt_re_pd, ib_pd); +struct bnxt_re_dev *rdev = pd->rdev; +struct bnxt_re_fmr *fmr; +int rc; + +if (fmr_attr->max_pages >MAX_PBL_LVL_2_PGS || + fmr_attr->max_maps > rdev->dev_attr.max_map_per_fmr) { +dev_err (rdev_to_dev (rdev),"Allocate FMR exceeded Max limit" ); +return ERR_PTR (-ENOMEM ); + } + fmr =kzalloc (sizeof (*fmr),GFP_KERNEL ); +if (!fmr) +return ERR_PTR (-ENOMEM ); + + fmr->rdev = rdev; + fmr->qplib_fmr.pd = &pd->qplib_pd; + fmr->qplib_fmr.type =CMDQ_ALLOCATE_MRW_MRW_FLAGS_PMR ; + + rc =bnxt_qplib_alloc_mrw (&rdev->qplib_res, &fmr->qplib_fmr); +if (rc) + goto fail; + + fmr->qplib_fmr.flags =__from_ib_access_flags (mr_access_flags); + fmr->ib_fmr.lkey = fmr->qplib_fmr.lkey; + fmr->ib_fmr.rkey = fmr->ib_fmr.lkey; + +atomic_inc (&rdev->mr_count); +return &fmr->ib_fmr; +fail: +kfree (fmr); +return ERR_PTR (rc); +} + +int bnxt_re_map_phys_fmr (struct ib_fmr *ib_fmr,u64 *page_list,int list_len, +u64 iova) +{ + struct bnxt_re_fmr *fmr = container_of(ib_fmr, struct bnxt_re_fmr, + ib_fmr); +struct bnxt_re_dev *rdev = fmr->rdev; +int rc; + + fmr->qplib_fmr.va = iova; + fmr->qplib_fmr.total_size = list_len *PAGE_SIZE ; + + rc =bnxt_qplib_reg_mr (&rdev->qplib_res, &fmr->qplib_fmr, page_list, + list_len, true); +if (rc) +dev_err (rdev_to_dev (rdev),"Failed to map FMR for lkey = 0x%x!" , + fmr->ib_fmr.lkey); +return rc; +} + +int bnxt_re_unmap_fmr (struct list_head *fmr_list) +{ +struct bnxt_re_dev *rdev; +struct bnxt_re_fmr *fmr; +struct ib_fmr *ib_fmr; +int rc =0 ; + +/* Validate each FMRs inside the fmr_list */ +list_for_each_entry (ib_fmr, fmr_list, list) { + fmr = container_of(ib_fmr, struct bnxt_re_fmr, ib_fmr); + rdev = fmr->rdev; + +if (rdev) { + rc =bnxt_qplib_dereg_mrw (&rdev->qplib_res, + &fmr->qplib_fmr, true); +if (rc) +break ; + } + } +return rc; +} + +int bnxt_re_dealloc_fmr (struct ib_fmr *ib_fmr) +{ + struct bnxt_re_fmr *fmr = container_of(ib_fmr, struct bnxt_re_fmr, + ib_fmr); +struct bnxt_re_dev *rdev = fmr->rdev; +int rc; + + rc =bnxt_qplib_free_mrw (&rdev->qplib_res, &fmr->qplib_fmr); +if (rc) +dev_err (rdev_to_dev (rdev),"Failed to free FMR" ); + +kfree (fmr); +atomic_dec (&rdev->mr_count); +return rc; +} + +/* uverbs */ +struct ib_mr *bnxt_re_reg_user_mr (struct ib_pd *ib_pd,u64 start,u64 length, +u64 virt_addr,int mr_access_flags, +struct ib_udata *udata) +{ + struct bnxt_re_pd *pd = container_of(ib_pd, struct bnxt_re_pd, ib_pd); +struct bnxt_re_dev *rdev = pd->rdev; +struct bnxt_re_mr *mr; +struct ib_umem *umem; +u64 *pbl_tbl, *pbl_tbl_orig; +int i, umem_pgs, pages, page_shift, rc; +struct scatterlist *sg; +int entry; + + mr =kzalloc (sizeof (*mr),GFP_KERNEL ); +if (!mr) +return ERR_PTR (-ENOMEM ); + + mr->rdev = rdev; + mr->qplib_mr.pd = &pd->qplib_pd; + mr->qplib_mr.flags =__from_ib_access_flags (mr_access_flags); + mr->qplib_mr.type =CMDQ_ALLOCATE_MRW_MRW_FLAGS_MR ; + + umem =ib_umem_get (ib_pd->uobject->context, start, length, + mr_access_flags,0 ); +if (IS_ERR (umem)) { +dev_err (rdev_to_dev (rdev),"Failed to get umem" ); + rc = -EFAULT ; + goto free_mr; + } + mr->ib_umem = umem; + + rc =bnxt_qplib_alloc_mrw (&rdev->qplib_res, &mr->qplib_mr); +if (rc) { +dev_err (rdev_to_dev (rdev),"Failed to allocate MR" ); + goto release_umem; + } +/* The fixed portion of the rkey is the same as the lkey */ + mr->ib_mr.rkey = mr->qplib_mr.rkey; + + mr->qplib_mr.va = virt_addr; + umem_pgs =ib_umem_page_count (umem); +if (!umem_pgs) { +dev_err (rdev_to_dev (rdev),"umem is invalid!" ); + rc = -EINVAL ; + goto free_mrw; + } + mr->qplib_mr.total_size = length; + + pbl_tbl =kcalloc (umem_pgs,sizeof (u64 *),GFP_KERNEL ); +if (!pbl_tbl) { + rc = -EINVAL ; + goto free_mrw; + } + pbl_tbl_orig = pbl_tbl; + + page_shift =ilog2 (umem->page_size); +if (umem->hugetlb) { +dev_err (rdev_to_dev (rdev),"umem hugetlb not supported!" ); + rc = -EFAULT ; + goto fail; + } +if (umem->page_size !=PAGE_SIZE ) { +dev_err (rdev_to_dev (rdev),"umem page size unsupported!" ); + rc = -EFAULT ; + goto fail; + } +/* Map umem buf ptrs to the PBL */ +for_each_sg (umem->sg_head.sgl, sg, umem->nmap, entry) { + pages =sg_dma_len (sg) >> page_shift; +for (i =0 ; i < pages; i++, pbl_tbl++) + *pbl_tbl =sg_dma_address (sg) + (i << page_shift); + } + rc =bnxt_qplib_reg_mr (&rdev->qplib_res, &mr->qplib_mr, pbl_tbl_orig, + umem_pgs, false); +if (rc) { +dev_err (rdev_to_dev (rdev),"Failed to register user MR" ); + goto fail; + } + +kfree (pbl_tbl_orig); + + mr->ib_mr.lkey = mr->qplib_mr.lkey; + mr->ib_mr.rkey = mr->qplib_mr.lkey; +atomic_inc (&rdev->mr_count); + +return &mr->ib_mr; +fail: +kfree (pbl_tbl_orig); +free_mrw: +bnxt_qplib_free_mrw (&rdev->qplib_res, &mr->qplib_mr); +release_umem: +ib_umem_release (umem); +free_mr: +kfree (mr); +return ERR_PTR (rc); +} +struct ib_ucontext *bnxt_re_alloc_ucontext (struct ib_device *ibdev,struct ib_udata *udata) {
drivers/infiniband/hw/bnxt_re/ib_verbs.h +44 -0
56 lines not on this page · raw message
drivers/infiniband/hw/bnxt_re/main.c +11 -0
@@ -455,6 +455,17 @@ static int bnxt_re_register_ib(struct bnxt_re_dev *rdev) ibdev->create_cq = bnxt_re_create_cq; ibdev->destroy_cq = bnxt_re_destroy_cq; ibdev->req_notify_cq = bnxt_re_req_notify_cq; + + ibdev->get_dma_mr = bnxt_re_get_dma_mr; + ibdev->dereg_mr = bnxt_re_dereg_mr; + ibdev->alloc_mr = bnxt_re_alloc_mr; + ibdev->map_mr_sg = bnxt_re_map_mr_sg; + ibdev->alloc_fmr = bnxt_re_alloc_fmr; + ibdev->map_phys_fmr = bnxt_re_map_phys_fmr; + ibdev->unmap_fmr = bnxt_re_unmap_fmr; + ibdev->dealloc_fmr = bnxt_re_dealloc_fmr; + + ibdev->reg_user_mr = bnxt_re_reg_user_mr; ibdev->alloc_ucontext = bnxt_re_alloc_ucontext; ibdev->dealloc_ucontext = bnxt_re_dealloc_ucontext; ibdev->mmap = bnxt_re_mmap;
drivers/infiniband/hw/bnxt_re/qplib_sp.c +289 -0
292 lines not on this page · raw message
drivers/infiniband/hw/bnxt_re/qplib_sp.h +41 -0
51 lines not on this page · raw message
Signature · 1 line
2.5.5
Selvin Xavier
maintainerPATCH v5 13/21 RDMA/bnxt_re: Support QP verbs
In reply to Selvin XavierThis patch implements create_qp, destroy_qp, query_qp and modify_qp verbs.
v2: Fixed sparse warnings
v3: Splits __filter_modify_flags function to avoid nested switch cases.
Removes unwanted macros. Also, fix the endianness related issues reported by sparse.
v5: Use kernel macros to find min value
--- drivers/infiniband/hw/bnxt_re/bnxt_re.h | 14 + drivers/infiniband/hw/bnxt_re/ib_verbs.c | 760 +++++++++++++++++++++++++++ drivers/infiniband/hw/bnxt_re/ib_verbs.h | 21 + drivers/infiniband/hw/bnxt_re/main.c | 6 + drivers/infiniband/hw/bnxt_re/qplib_fp.c | 862 +++++++++++++++++++++++++++++++ drivers/infiniband/hw/bnxt_re/qplib_fp.h | 272 ++++++++++ include/uapi/rdma/bnxt_re-abi.h | 11 + 7 files changed, 1946 insertions(+)
drivers/infiniband/hw/bnxt_re/bnxt_re.h +14 -0
@@ -63,6 +63,14 @@ struct bnxt_re_work {struct net_device *vlan_dev; }; +struct bnxt_re_sqp_entries { +struct bnxt_qplib_sge sge; +u64 wrid; +/* For storing the actual qp1 cqe */ +struct bnxt_qplib_cqe cqe; +struct bnxt_re_qp *qp1_qp; +}; +#define BNXT_RE_MIN_MSIX 2#define BNXT_RE_MAX_MSIX 16#define BNXT_RE_AEQ_IDX 0
@@ -110,6 +118,12 @@ struct bnxt_re_dev {atomic_t mw_count;/* Max of 2 lossless traffic class supported per port */ u16 cosq[2 ]; + +/* QP for for handling QP1 packets */ +u32 sqp_id; +struct bnxt_re_qp *qp1_sqp; +struct bnxt_re_ah *sqp_ah; +struct bnxt_re_sqp_entries sqp_tbl[1024 ]; };#define to_bnxt_re_dev (ptr, member) \
drivers/infiniband/hw/bnxt_re/ib_verbs.c +760 -0
772 lines not on this page · raw message
drivers/infiniband/hw/bnxt_re/ib_verbs.h +21 -0
@@ -57,6 +57,19 @@ struct bnxt_re_ah {struct bnxt_qplib_ah qplib_ah; }; +struct bnxt_re_qp { +struct list_head list; +struct bnxt_re_dev *rdev; +struct ib_qp ib_qp; +spinlock_t sq_lock;/* protect sq */ +struct bnxt_qplib_qp qplib_qp; +struct ib_umem *sumem; +struct ib_umem *rumem; +/* QP1 */ +u32 send_psn; +struct ib_ud_header qp1_hdr; +}; +struct bnxt_re_cq {struct bnxt_re_dev *rdev;spinlock_t cq_lock;/* protect cq */
@@ -142,6 +155,14 @@ struct ib_ah *bnxt_re_create_ah(struct ib_pd *pd,int bnxt_re_modify_ah (struct ib_ah *ah,struct ib_ah_attr *ah_attr);int bnxt_re_query_ah (struct ib_ah *ah,struct ib_ah_attr *ah_attr);int bnxt_re_destroy_ah (struct ib_ah *ah); +struct ib_qp *bnxt_re_create_qp (struct ib_pd *pd, +struct ib_qp_init_attr *qp_init_attr, +struct ib_udata *udata); +int bnxt_re_modify_qp (struct ib_qp *qp,struct ib_qp_attr *qp_attr, +int qp_attr_mask,struct ib_udata *udata); +int bnxt_re_query_qp (struct ib_qp *qp,struct ib_qp_attr *qp_attr, +int qp_attr_mask,struct ib_qp_init_attr *qp_init_attr); +int bnxt_re_destroy_qp (struct ib_qp *qp); struct ib_cq *bnxt_re_create_cq(struct ib_device *ibdev, const struct ib_cq_init_attr *attr, struct ib_ucontext *context,
drivers/infiniband/hw/bnxt_re/main.c +6 -0
@@ -452,6 +452,12 @@ static int bnxt_re_register_ib(struct bnxt_re_dev *rdev) ibdev->modify_ah = bnxt_re_modify_ah; ibdev->query_ah = bnxt_re_query_ah; ibdev->destroy_ah = bnxt_re_destroy_ah; + + ibdev->create_qp = bnxt_re_create_qp; + ibdev->modify_qp = bnxt_re_modify_qp; + ibdev->query_qp = bnxt_re_query_qp; + ibdev->destroy_qp = bnxt_re_destroy_qp; + ibdev->create_cq = bnxt_re_create_cq; ibdev->destroy_cq = bnxt_re_destroy_cq; ibdev->req_notify_cq = bnxt_re_req_notify_cq;
drivers/infiniband/hw/bnxt_re/qplib_fp.c +862 -0
874 lines not on this page · raw message
drivers/infiniband/hw/bnxt_re/qplib_fp.h +272 -0
292 lines not on this page · raw message
include/uapi/rdma/bnxt_re-abi.h +11 -0
@@ -68,6 +68,17 @@ struct bnxt_re_cq_resp {__u32 rsvd; }; +struct bnxt_re_qp_req { +__u64 qpsva; +__u64 qprva; +__u64 qp_handle; +}; + +struct bnxt_re_qp_resp { +__u32 qpid; +__u32 rsvd; +}; +enum bnxt_re_shpg_offt {BNXT_RE_BEG_RESV_OFFT =0x00 ,BNXT_RE_AVID_OFFT =0x10 ,
Signature · 1 line
2.5.5
Selvin Xavier
maintainerPATCH v5 14/21 RDMA/bnxt_re: Support post_send verb
In reply to Selvin XavierEnables the ib_post_send fastpath verb for posting Send work requests on QPs.
v2: Fixed some sparse warnings
v3: Fixes endianness related warnings reported by sparse. Changes
some of the macros to inline functions.
v5: Uses ETH_P_IBOE macro for RoCE ethertype
--- drivers/infiniband/hw/bnxt_re/bnxt_re.h | 4 + drivers/infiniband/hw/bnxt_re/ib_verbs.c | 545 ++++++++++++++++++++++++++++++- drivers/infiniband/hw/bnxt_re/ib_verbs.h | 2 + drivers/infiniband/hw/bnxt_re/main.c | 1 + drivers/infiniband/hw/bnxt_re/qplib_fp.c | 268 +++++++++++++++ drivers/infiniband/hw/bnxt_re/qplib_fp.h | 6 + 6 files changed, 823 insertions(+), 3 deletions(-)
drivers/infiniband/hw/bnxt_re/bnxt_re.h +4 -0
@@ -129,6 +129,10 @@ struct bnxt_re_dev {#define to_bnxt_re_dev (ptr, member) \ container_of((ptr), struct bnxt_re_dev, member) +#define BNXT_RE_ROCE_V1_PACKET 0 +#define BNXT_RE_ROCEV2_IPV4_PACKET 2 +#define BNXT_RE_ROCEV2_IPV6_PACKET 3 +static inline struct device *rdev_to_dev (struct bnxt_re_dev *rdev) {if (rdev)
drivers/infiniband/hw/bnxt_re/ib_verbs.c +542 -3
575 lines not on this page · raw message
drivers/infiniband/hw/bnxt_re/ib_verbs.h +2 -0
@@ -163,6 +163,8 @@ int bnxt_re_modify_qp(struct ib_qp *qp, struct ib_qp_attr *qp_attr,int bnxt_re_query_qp (struct ib_qp *qp,struct ib_qp_attr *qp_attr,int qp_attr_mask,struct ib_qp_init_attr *qp_init_attr);int bnxt_re_destroy_qp (struct ib_qp *qp); +int bnxt_re_post_send (struct ib_qp *qp,struct ib_send_wr *send_wr, +struct ib_send_wr **bad_send_wr); struct ib_cq *bnxt_re_create_cq(struct ib_device *ibdev, const struct ib_cq_init_attr *attr, struct ib_ucontext *context,
drivers/infiniband/hw/bnxt_re/main.c +1 -0
@@ -458,6 +458,7 @@ static int bnxt_re_register_ib(struct bnxt_re_dev *rdev) ibdev->query_qp = bnxt_re_query_qp; ibdev->destroy_qp = bnxt_re_destroy_qp; + ibdev->post_send = bnxt_re_post_send; ibdev->create_cq = bnxt_re_create_cq; ibdev->destroy_cq = bnxt_re_destroy_cq; ibdev->req_notify_cq = bnxt_re_req_notify_cq;
drivers/infiniband/hw/bnxt_re/qplib_fp.c +268 -0
274 lines not on this page · raw message
drivers/infiniband/hw/bnxt_re/qplib_fp.h +6 -0
@@ -38,6 +38,7 @@ #ifndef __BNXT_QPLIB_FP_H__ #define __BNXT_QPLIB_FP_H__ + struct bnxt_qplib_sge { u64 addr; u32 lkey;
@@ -415,6 +416,11 @@ int bnxt_qplib_create_qp(struct bnxt_qplib_res *res, struct bnxt_qplib_qp *qp);int bnxt_qplib_modify_qp (struct bnxt_qplib_res *res,struct bnxt_qplib_qp *qp);int bnxt_qplib_query_qp (struct bnxt_qplib_res *res,struct bnxt_qplib_qp *qp);int bnxt_qplib_destroy_qp (struct bnxt_qplib_res *res,struct bnxt_qplib_qp *qp); +void *bnxt_qplib_get_qp1_sq_buf (struct bnxt_qplib_qp *qp, +struct bnxt_qplib_sge *sge); +void bnxt_qplib_post_send_db (struct bnxt_qplib_qp *qp); +int bnxt_qplib_post_send (struct bnxt_qplib_qp *qp, +struct bnxt_qplib_swqe *wqe);int bnxt_qplib_create_cq (struct bnxt_qplib_res *res,struct bnxt_qplib_cq *cq);int bnxt_qplib_destroy_cq (struct bnxt_qplib_res *res,struct bnxt_qplib_cq *cq);
Signature · 1 line
2.5.5
Selvin Xavier
maintainerPATCH v5 15/21 RDMA/bnxt_re: Support post_recv
In reply to Selvin XavierEnables the fastpath verb ib_post_recv.
v3: Fixes sparse warnings
v5: Code cleanup to avoid goto statement in post_recv
routines, as per Leon's suggestions.
--- drivers/infiniband/hw/bnxt_re/ib_verbs.c | 123 +++++++++++++++++++++++++++++++ drivers/infiniband/hw/bnxt_re/ib_verbs.h | 2 + drivers/infiniband/hw/bnxt_re/main.c | 2 + drivers/infiniband/hw/bnxt_re/qplib_fp.c | 100 +++++++++++++++++++++++++ drivers/infiniband/hw/bnxt_re/qplib_fp.h | 8 ++ 5 files changed, 235 insertions(+)
drivers/infiniband/hw/bnxt_re/ib_verbs.c +123 -0
@@ -1635,6 +1635,52 @@ static int bnxt_re_build_qp1_send_v2(struct bnxt_re_qp *qp,return rc; } +/* For the MAD layer, it only provides the recv SGE the size of +* ib_grh + MAD datagram. No Ethernet headers, Ethertype, BTH, DETH, +* nor RoCE iCRC. The Cu+ solution must provide buffer for the entire +* receive packet (334 bytes) with no VLAN and then copy the GRH +* and the MAD datagram out to the provided SGE. +*/ +static int bnxt_re_build_qp1_shadow_qp_recv (struct bnxt_re_qp *qp, +struct ib_recv_wr *wr, +struct bnxt_qplib_swqe *wqe, +int payload_size) +{ +struct bnxt_qplib_sge ref, sge; +u32 rq_prod_index; +struct bnxt_re_sqp_entries *sqp_entry; + + rq_prod_index =bnxt_qplib_get_rq_prod_index (&qp->qplib_qp); + +if (!bnxt_qplib_get_qp1_rq_buf (&qp->qplib_qp, &sge)) +return -ENOMEM ; + +/* Create 1 SGE to receive the entire +* ethernet packet +*/ +/* Save the reference from ULP */ + ref.addr = wqe->sg_list[0 ].addr; + ref.lkey = wqe->sg_list[0 ].lkey; + ref.size = wqe->sg_list[0 ].size; + + sqp_entry = &qp->rdev->sqp_tbl[rq_prod_index]; + +/* SGE 1 */ + wqe->sg_list[0 ].addr = sge.addr; + wqe->sg_list[0 ].lkey = sge.lkey; + wqe->sg_list[0 ].size =BNXT_QPLIB_MAX_QP1_RQ_HDR_SIZE_V2 ; + sge.size -= wqe->sg_list[0 ].size; + + sqp_entry->sge.addr = ref.addr; + sqp_entry->sge.lkey = ref.lkey; + sqp_entry->sge.size = ref.size; +/* Store the wrid for reporting completion */ + sqp_entry->wrid = wqe->wr_id; +/* change the wqe->wrid to table index */ + wqe->wr_id = rq_prod_index; +return 0 ; +} +static int is_ud_qp (struct bnxt_re_qp *qp) {return qp->qplib_qp.type ==CMDQ_CREATE_QP_TYPE_UD ;
@@ -1981,6 +2027,83 @@ int bnxt_re_post_send(struct ib_qp *ib_qp, struct ib_send_wr *wr,return rc; } +static int bnxt_re_post_recv_shadow_qp (struct bnxt_re_dev *rdev, +struct bnxt_re_qp *qp, +struct ib_recv_wr *wr) +{ +struct bnxt_qplib_swqe wqe; +int rc =0 , payload_sz =0 ; + +memset (&wqe,0 ,sizeof (wqe)); +while (wr) { +/* House keeping */ +memset (&wqe,0 ,sizeof (wqe)); + +/* Common */ + wqe.num_sge = wr->num_sge; +if (wr->num_sge > qp->qplib_qp.rq.max_sge) { +dev_err (rdev_to_dev (rdev), +"Limit exceeded for Receive SGEs" ); + rc = -EINVAL ; +break ; + } + payload_sz =bnxt_re_build_sgl (wr->sg_list, wqe.sg_list, + wr->num_sge); + wqe.wr_id = wr->wr_id; + wqe.type =BNXT_QPLIB_SWQE_TYPE_RECV ; + + rc =bnxt_qplib_post_recv (&qp->qplib_qp, &wqe); +if (rc) +break ; + + wr = wr->next; + } +if (!rc) +bnxt_qplib_post_recv_db (&qp->qplib_qp); +return rc; +} + +int bnxt_re_post_recv (struct ib_qp *ib_qp,struct ib_recv_wr *wr, +struct ib_recv_wr **bad_wr) +{ + struct bnxt_re_qp *qp = container_of(ib_qp, struct bnxt_re_qp, ib_qp); +struct bnxt_qplib_swqe wqe; +int rc =0 , payload_sz =0 ; + +while (wr) { +/* House keeping */ +memset (&wqe,0 ,sizeof (wqe)); + +/* Common */ + wqe.num_sge = wr->num_sge; +if (wr->num_sge > qp->qplib_qp.rq.max_sge) { +dev_err (rdev_to_dev (qp->rdev), +"Limit exceeded for Receive SGEs" ); + rc = -EINVAL ; + *bad_wr = wr; +break ; + } + + payload_sz =bnxt_re_build_sgl (wr->sg_list, wqe.sg_list, + wr->num_sge); + wqe.wr_id = wr->wr_id; + wqe.type =BNXT_QPLIB_SWQE_TYPE_RECV ; + +if (ib_qp->qp_type ==IB_QPT_GSI ) + rc =bnxt_re_build_qp1_shadow_qp_recv (qp, wr, &wqe, + payload_sz); +if (!rc) + rc =bnxt_qplib_post_recv (&qp->qplib_qp, &wqe); +if (rc) { + *bad_wr = wr; +break ; + } + wr = wr->next; + } +bnxt_qplib_post_recv_db (&qp->qplib_qp); +return rc; +} +/* Completion Queues */ int bnxt_re_destroy_cq (struct ib_cq *ib_cq) {
drivers/infiniband/hw/bnxt_re/ib_verbs.h +2 -0
@@ -165,6 +165,8 @@ int bnxt_re_query_qp(struct ib_qp *qp, struct ib_qp_attr *qp_attr,int bnxt_re_destroy_qp (struct ib_qp *qp);int bnxt_re_post_send (struct ib_qp *qp,struct ib_send_wr *send_wr,struct ib_send_wr **bad_send_wr); +int bnxt_re_post_recv (struct ib_qp *qp,struct ib_recv_wr *recv_wr, +struct ib_recv_wr **bad_recv_wr); struct ib_cq *bnxt_re_create_cq(struct ib_device *ibdev, const struct ib_cq_init_attr *attr, struct ib_ucontext *context,
drivers/infiniband/hw/bnxt_re/main.c +2 -0
@@ -459,6 +459,8 @@ static int bnxt_re_register_ib(struct bnxt_re_dev *rdev) ibdev->destroy_qp = bnxt_re_destroy_qp; ibdev->post_send = bnxt_re_post_send; + ibdev->post_recv = bnxt_re_post_recv; + ibdev->create_cq = bnxt_re_create_cq; ibdev->destroy_cq = bnxt_re_destroy_cq; ibdev->req_notify_cq = bnxt_re_req_notify_cq;
drivers/infiniband/hw/bnxt_re/qplib_fp.c +100 -0
112 lines not on this page · raw message
drivers/infiniband/hw/bnxt_re/qplib_fp.h +8 -0
@@ -418,9 +418,17 @@ int bnxt_qplib_query_qp(struct bnxt_qplib_res *res, struct bnxt_qplib_qp *qp);int bnxt_qplib_destroy_qp (struct bnxt_qplib_res *res,struct bnxt_qplib_qp *qp);void *bnxt_qplib_get_qp1_sq_buf (struct bnxt_qplib_qp *qp,struct bnxt_qplib_sge *sge); +void *bnxt_qplib_get_qp1_rq_buf (struct bnxt_qplib_qp *qp, +struct bnxt_qplib_sge *sge); +u32 bnxt_qplib_get_rq_prod_index (struct bnxt_qplib_qp *qp); +dma_addr_t bnxt_qplib_get_qp_buf_from_index (struct bnxt_qplib_qp *qp, +u32 index);void bnxt_qplib_post_send_db (struct bnxt_qplib_qp *qp);int bnxt_qplib_post_send (struct bnxt_qplib_qp *qp,struct bnxt_qplib_swqe *wqe); +void bnxt_qplib_post_recv_db (struct bnxt_qplib_qp *qp); +int bnxt_qplib_post_recv (struct bnxt_qplib_qp *qp, +struct bnxt_qplib_swqe *wqe);int bnxt_qplib_create_cq (struct bnxt_qplib_res *res,struct bnxt_qplib_cq *cq);int bnxt_qplib_destroy_cq (struct bnxt_qplib_res *res,struct bnxt_qplib_cq *cq);
Signature · 1 line
2.5.5
Selvin Xavier
maintainerPATCH v5 17/21 RDMA/bnxt_re: Handling dispatching of events to IB stack
In reply to Selvin XavierThis patch implements events dispatching to the IB stack based on NETDEV events received.
v2: Removed cleanup of the resources during driver unload since
we are calling unregister_netdevice_notifier first in the exit.
v3: Fixes cocci warnings and some sparse warnings
v5: Removes qp_wait parameter from bnxt_re_dev_stop() as it was never used
--- drivers/infiniband/hw/bnxt_re/main.c | 59 ++++++++++++++++++++++++++++++++++++ 1 file changed, 59 insertions(+)
drivers/infiniband/hw/bnxt_re/main.c +59 -0
@@ -712,6 +712,51 @@ static int bnxt_re_alloc_res(struct bnxt_re_dev *rdev)return rc; } +static void bnxt_re_dispatch_event (struct ib_device *ibdev,struct ib_qp *qp, +u8 port_num,enum ib_event_type event) +{ +struct ib_event ib_event; + + ib_event.device = ibdev; +if (qp) + ib_event.element.qp = qp; +else + ib_event.element.port_num = port_num; + ib_event.event = event; +ib_dispatch_event (&ib_event); +} + +static bool bnxt_re_is_qp1_or_shadow_qp (struct bnxt_re_dev *rdev, +struct bnxt_re_qp *qp) +{ +return (qp->ib_qp.qp_type ==IB_QPT_GSI ) || (qp == rdev->qp1_sqp); +} + +static void bnxt_re_dev_stop (struct bnxt_re_dev *rdev) +{ +int mask =IB_QP_STATE ; +struct ib_qp_attr qp_attr; +struct bnxt_re_qp *qp; + + qp_attr.qp_state =IB_QPS_ERR ; +mutex_lock (&rdev->qp_lock); +list_for_each_entry (qp, &rdev->qp_list, list) { +/* Modify the state of all QPs except QP1/Shadow QP */ +if (!bnxt_re_is_qp1_or_shadow_qp (rdev, qp)) { +if (qp->qplib_qp.state != +CMDQ_MODIFY_QP_NEW_STATE_RESET && + qp->qplib_qp.state != +CMDQ_MODIFY_QP_NEW_STATE_ERR ) { +bnxt_re_dispatch_event (&rdev->ibdev, &qp->ib_qp, +1 ,IB_EVENT_QP_FATAL ); +bnxt_re_modify_qp (&qp->ib_qp, &qp_attr, mask, +NULL ); + } + } + } +mutex_unlock (&rdev->qp_lock); +} +static void bnxt_re_ib_unreg (struct bnxt_re_dev *rdev,bool lock_wait) {int i, rc;
@@ -871,6 +916,9 @@ static int bnxt_re_ib_reg(struct bnxt_re_dev *rdev) } }set_bit (BNXT_RE_FLAG_IBDEV_REGISTERED , &rdev->flags); +bnxt_re_dispatch_event (&rdev->ibdev,NULL ,1 ,IB_EVENT_PORT_ACTIVE ); +bnxt_re_dispatch_event (&rdev->ibdev,NULL ,1 ,IB_EVENT_GID_CHANGE ); +return 0 ; free_sctx:bnxt_re_net_stats_ctx_free (rdev, rdev->qplib_ctx.stats.fw_id, true);
@@ -950,8 +998,19 @@ static void bnxt_re_task(struct work_struct *work) "Failed to register with IB: %#x", rc);break ;case NETDEV_UP : +bnxt_re_dispatch_event (&rdev->ibdev,NULL ,1 , +IB_EVENT_PORT_ACTIVE ); +break ;case NETDEV_DOWN : +bnxt_re_dev_stop (rdev); +break ;case NETDEV_CHANGE : +if (!netif_carrier_ok (rdev->netdev)) +bnxt_re_dev_stop (rdev); +else if (netif_carrier_ok (rdev->netdev)) +bnxt_re_dispatch_event (&rdev->ibdev,NULL ,1 , +IB_EVENT_PORT_ACTIVE ); +break ;default :break ; }
Signature · 1 line
2.5.5
Selvin Xavier
maintainerPATCH v5 19/21 RDMA/bnxt_re: Set uverbs command mask
In reply to Selvin XavierThis patch exports available uverbs command mask to the IB stack. Also, populates some of the missing parameters in the ibdev structure used for registration.
v4: Changes the include file names
--- drivers/infiniband/hw/bnxt_re/main.c | 35 +++++++++++++++++++++++++++++++++++ 1 file changed, 35 insertions(+)
drivers/infiniband/hw/bnxt_re/main.c +35 -0
@@ -62,6 +62,7 @@#include "qplib_rcfw.h" #include "bnxt_re.h" #include "ib_verbs.h" +#include <rdma/bnxt_re-abi.h> #include "bnxt.h" static char version[] =BNXT_RE_DESC " v" ROCE_DRV_MODULE_VERSION "\n" ;
@@ -432,8 +433,42 @@ static int bnxt_re_register_ib(struct bnxt_re_dev *rdev) strlen(BNXT_RE_DESC) + 5); ibdev->phys_port_cnt =1 ; +bnxt_qplib_get_guid (rdev->netdev->dev_addr, (u8 *)&ibdev->node_guid); + ibdev->num_comp_vectors =1 ; ibdev->dma_device = &rdev->en_dev->pdev->dev; + ibdev->local_dma_lkey =BNXT_QPLIB_RSVD_LKEY ; + +/* User space */ + ibdev->uverbs_abi_ver =BNXT_RE_ABI_VERSION ; + ibdev->uverbs_cmd_mask = + (1ull <<IB_USER_VERBS_CMD_GET_CONTEXT ) | + (1ull <<IB_USER_VERBS_CMD_QUERY_DEVICE ) | + (1ull <<IB_USER_VERBS_CMD_QUERY_PORT ) | + (1ull <<IB_USER_VERBS_CMD_ALLOC_PD ) | + (1ull <<IB_USER_VERBS_CMD_DEALLOC_PD ) | + (1ull <<IB_USER_VERBS_CMD_REG_MR ) | + (1ull <<IB_USER_VERBS_CMD_REREG_MR ) | + (1ull <<IB_USER_VERBS_CMD_DEREG_MR ) | + (1ull <<IB_USER_VERBS_CMD_CREATE_COMP_CHANNEL ) | + (1ull <<IB_USER_VERBS_CMD_CREATE_CQ ) | + (1ull <<IB_USER_VERBS_CMD_RESIZE_CQ ) | + (1ull <<IB_USER_VERBS_CMD_DESTROY_CQ ) | + (1ull <<IB_USER_VERBS_CMD_CREATE_QP ) | + (1ull <<IB_USER_VERBS_CMD_MODIFY_QP ) | + (1ull <<IB_USER_VERBS_CMD_QUERY_QP ) | + (1ull <<IB_USER_VERBS_CMD_DESTROY_QP ) | + (1ull <<IB_USER_VERBS_CMD_CREATE_SRQ ) | + (1ull <<IB_USER_VERBS_CMD_MODIFY_SRQ ) | + (1ull <<IB_USER_VERBS_CMD_QUERY_SRQ ) | + (1ull <<IB_USER_VERBS_CMD_DESTROY_SRQ ) | + (1ull <<IB_USER_VERBS_CMD_CREATE_AH ) | + (1ull <<IB_USER_VERBS_CMD_MODIFY_AH ) | + (1ull <<IB_USER_VERBS_CMD_QUERY_AH ) | + (1ull <<IB_USER_VERBS_CMD_DESTROY_AH ); +/* POLL_CQ and REQ_NOTIFY_CQ is directly handled in libbnxt_re */ + +/* Kernel verbs */ ibdev->query_device = bnxt_re_query_device; ibdev->modify_device = bnxt_re_modify_device;
Signature · 1 line
2.5.5
Selvin Xavier
maintainerPATCH v5 20/21 RDMA/bnxt_re: Add QP event handling
In reply to Selvin XavierImplements callback handler for processing Async events related to a QP. This patch also implements the control path command completion handling.
v3: Removes unwanted braces
v5: Added a debug print QP error notification
--- drivers/infiniband/hw/bnxt_re/qplib_rcfw.c | 49 ++++++++++++++++++++++++++++++ 1 file changed, 49 insertions(+)
drivers/infiniband/hw/bnxt_re/qplib_rcfw.c +49 -0
@@ -257,6 +257,46 @@ static int bnxt_qplib_process_func_event(struct bnxt_qplib_rcfw *rcfw,return 0 ; } +static int bnxt_qplib_process_qp_event (struct bnxt_qplib_rcfw *rcfw, +struct creq_qp_event *qp_event) +{ +struct bnxt_qplib_crsq *crsq = &rcfw->crsq; +struct bnxt_qplib_hwq *cmdq = &rcfw->cmdq; +struct bnxt_qplib_crsqe *crsqe; +u16 cbit, cookie, blocked =0 ; +unsigned long flags; +u32 sw_cons; + +switch (qp_event->event) { +case CREQ_QP_EVENT_EVENT_QP_ERROR_NOTIFICATION : +dev_dbg (&rcfw->pdev->dev, +"QPLIB: Received QP error notification" ); +break ; +default : +/* Command Response */ +spin_lock_irqsave (&cmdq->lock, flags); + sw_cons =HWQ_CMP (crsq->cons, crsq); + crsqe = &crsq->crsq[sw_cons]; + crsq->cons++; +memcpy (&crsqe->qp_event, qp_event,sizeof (crsqe->qp_event)); + + cookie =le16_to_cpu (crsqe->qp_event.cookie); + blocked = cookie &RCFW_CMD_IS_BLOCKING ; + cookie &=RCFW_MAX_COOKIE_VALUE ; + cbit = cookie %RCFW_MAX_OUTSTANDING_CMD ; +if (!test_and_clear_bit (cbit, rcfw->cmdq_bitmap)) +dev_warn (&rcfw->pdev->dev, +"QPLIB: CMD bit %d was not requested" , cbit); + + cmdq->cons += crsqe->req_size; +spin_unlock_irqrestore (&cmdq->lock, flags); +if (!blocked) +wake_up (&rcfw->waitq); +break ; + } +return 0 ; +} +/* SP - CREQ Completion handlers */ static void bnxt_qplib_service_creq (unsigned long data) {
@@ -280,6 +320,15 @@ static void bnxt_qplib_service_creq(unsigned long data) type = creqe->type &CREQ_BASE_TYPE_MASK ;switch (type) {case CREQ_BASE_TYPE_QP_EVENT : +if (!bnxt_qplib_process_qp_event + (rcfw, (struct creq_qp_event *)creqe)) + rcfw->creq_qp_event_processed++; +else { +dev_warn (&rcfw->pdev->dev,"QPLIB: crsqe with" ); +dev_warn (&rcfw->pdev->dev, +"QPLIB: type = 0x%x not handled" , + type); + }break ;case CREQ_BASE_TYPE_FUNC_EVENT : if (!bnxt_qplib_process_func_event
Signature · 1 line
2.5.5
Quoted 7 lines · Selvin Xavier
This series introduces the RoCE driver for the Broadcom NetXtreme-E 10/25/40/50G RoCE HCAs.
This driver is dependent on thebnxt_enNIC driver and is based on the for-4.11 branch in linux-rdma repository.bnxt_enchanges required for this patch series are already available afore mentioned branch.
Quoted 8 lines
These changes are available for your reference in
thebnxt_re_v5branch of following repository.
https://github.com/Broadcom/linux-rdma-nxt/Doug,
This patchset addresses review comments from you and Leon. This series also includes some changes required for the latest FW. Please consider applying this to linux-rdma tree.
Thanks, v5 applied. I squashed it down to just two commits: 1 to add the driver itself, and 1 that only adds the build makefiles. I've pushed it to github so far, I'll push it to k.o once I get 0day build tests back on it. Feel free to look it over on github if you want to see how it came out after the squashing and such.
Signature · 4 lines
Doug Ledford <[email protected]> GPG KeyID: B826A3330E572FDD Key fingerprint = AE6B 1BDA 122B 23B4 265B 1274 B826 A333 0E57 2FDD