Adding GAUDI NIC code to habanalabs driver
Subsystems (4)
cover Adding GAUDI NIC code to habanalabs driver
This patch-set adds support for initializing and using the GAUDI NIC ports, functioning as scale-out interconnect when doing distributed Deep Learning training. The training can be performed over tens of thousands of GAUDIs and it is done using the RDMA-over-converged-Ethernet (RoCE) v2 protocol.
Each GAUDI exposes 10x100GbE ports that are designed to scale-out the inter-GAUDI communication by integrating a complete communication engine on-die. This native integration allows users to use the same scaling technology, both inside the server and rack (termed as scale-up), as well as for scaling across racks (scale-out). The racks can be connected directly between GAUDI processors, or through any number of standard Ethernet switches.
The driver exposes the NIC ports to the user as standard Ethernet ports by registering each port to the networking subsystem. This allows the user to manage the ports with standard tools such as ifconfig, ethtool, etc. It also enables us to connect to the Linux networking stack and thus support standard networking protocols, such as IPv4, IPv6, TCP, etc. In addition, we can also leverage protocols such as DCB for dynamically configuring priorities to avoid congestion.
For each NIC port there is a matching QMAN entity. For RoCE, the user submits workloads to the NIC through the QMAN, same as he does for the compute engines. For regular Ethernet, the user sends and receives packets through the standard Ethernet sockets. Those sockets are used only as a control path. The data path that is used for AI training goes through the RoCE interface.
It is important to note that there are some limitations and uniqueness in GAUDI's NIC H/W, compared to other networking adapters that enforced us to use a less-than-common driver design:
1. The NIC functionality is NOT exposed as different PCI Physical Functions. There is a single PF which is used for compute and networking, as the main goal of the NIC ports is to be used as intra-communication and not as standard network interfaces. This implies we can't connect different drivers to handle the networking ports because it is the same device, from the kernel POV, as the compute. Therefore, we must integrate the networking code into the main habanalabs driver.
2. Although our communication engine implements RDMA, and the driver code uses well-known RDMA concepts such as QP context, CQ, WQ, etc., the GAUDI architecture does NOT support other basic IBverbs concepts, such as MR and protection domain. Therefore, we can't connect to the standard IBverb infrastructure in the user-space and kernel (rdma-core library and infiniband subsystem, respectively) because the standard RDMA s/w and tools won't work on our H/W. Instead, we added a new IOCTL to the driver's existing IOCTL API. The new IOCTL exposes the available NIC control operations to the user (e.g. Create a QP context).
3. The die-on communication engine provides minimal offloading for standard Ethernet and TCP/IP protocols, as those are only used for control plane. E.g. the packets are copied rather than using descriptors. Therefore, the Ethernet performance is quite low compared to standard Ethernet adapters.
4. There is no virtualization support per port.
Most or all of the above limitations will hopefully be improved in future ASIC generations.
Patch-set organization:
- Patches 1 & 2 are just adding some auto-generated register header files and NIC-related definitions to the interface between the driver and the GAUDI firmware.
- Patch 3 adds initialization of security restrictions on the NIC engines.
- Patch 4 adds initialization of the NIC QMANs. The QMANs are needed to send RDMA packets through the NIC engines.
- Patches 5-11 adds the NIC driver code. It contains the basic Ethernet driver and H/W initialization, the NIC PHY driver code and the new NIC control IOCTL operations.
- Patch 12-14 adds support for debugfs, ethtool and DCB.
- Patch 15 adds the implementation of the high-level init/fini functions and their calls from the common code. This is the patch that actually enables the NIC ports and allows the user to work with them.
Thanks,
Oded
Omer Shpigelman (15):
habanalabs/gaudi: add NIC H/W and registers definitions habanalabs/gaudi: add NIC firmware-related definitions habanalabs/gaudi: add NIC security configuration habanalabs/gaudi: add support for NIC QMANs habanalabs/gaudi: add NIC Ethernet support habanalabs/gaudi: add NIC PHY code
habanalabs/gaudi: allow user to get MAC addresses in INFO IOCTL habanalabs/gaudi: add a new IOCTL for NIC control operations habanalabs/gaudi: add CQ control operations habanalabs/gaudi: add WQ control operations habanalabs/gaudi: add QP error handling habanalabs/gaudi: add debugfs entries for the NIC habanalabs/gaudi: Add ethtool support using coresight habanalabs/gaudi: support DCB protocol habanalabs/gaudi: add NIC init/fini calls from common code
.../ABI/testing/debugfs-driver-habanalabs | 69 + drivers/misc/habanalabs/common/context.c | 1 + drivers/misc/habanalabs/common/device.c | 24 +- drivers/misc/habanalabs/common/firmware_if.c | 44 + drivers/misc/habanalabs/common/habanalabs.h | 33 +- .../misc/habanalabs/common/habanalabs_drv.c | 11 + .../misc/habanalabs/common/habanalabs_ioctl.c | 151 +- drivers/misc/habanalabs/common/pci.c | 1 + drivers/misc/habanalabs/gaudi/Makefile | 4 + drivers/misc/habanalabs/gaudi/gaudi.c | 958 +++- drivers/misc/habanalabs/gaudi/gaudiP.h | 333 +- .../misc/habanalabs/gaudi/gaudi_coresight.c | 144 + drivers/misc/habanalabs/gaudi/gaudi_nic.c | 4063 +++++++++++++++++ drivers/misc/habanalabs/gaudi/gaudi_nic.h | 354 ++ .../misc/habanalabs/gaudi/gaudi_nic_dcbnl.c | 108 + .../misc/habanalabs/gaudi/gaudi_nic_debugfs.c | 402 ++ .../misc/habanalabs/gaudi/gaudi_nic_ethtool.c | 582 +++ drivers/misc/habanalabs/gaudi/gaudi_phy.c | 1272 ++++++ .../misc/habanalabs/gaudi/gaudi_security.c | 3973 ++++++++++++++++ drivers/misc/habanalabs/goya/goya.c | 44 + .../misc/habanalabs/include/common/cpucp_if.h | 34 +- .../include/gaudi/asic_reg/gaudi_regs.h | 26 +- .../include/gaudi/asic_reg/nic0_qm0_masks.h | 800 ++++ .../include/gaudi/asic_reg/nic0_qm0_regs.h | 834 ++++ .../include/gaudi/asic_reg/nic0_qm1_regs.h | 834 ++++ .../include/gaudi/asic_reg/nic0_qpc0_masks.h | 500 ++ .../include/gaudi/asic_reg/nic0_qpc0_regs.h | 710 +++ .../include/gaudi/asic_reg/nic0_qpc1_regs.h | 710 +++ .../include/gaudi/asic_reg/nic0_rxb_regs.h | 508 +++ .../include/gaudi/asic_reg/nic0_rxe0_masks.h | 354 ++ .../include/gaudi/asic_reg/nic0_rxe0_regs.h | 158 + .../include/gaudi/asic_reg/nic0_rxe1_regs.h | 158 + .../include/gaudi/asic_reg/nic0_stat_regs.h | 518 +++ .../include/gaudi/asic_reg/nic0_tmr_regs.h | 184 + .../include/gaudi/asic_reg/nic0_txe0_masks.h | 336 ++ .../include/gaudi/asic_reg/nic0_txe0_regs.h | 264 ++ .../include/gaudi/asic_reg/nic0_txe1_regs.h | 264 ++ .../include/gaudi/asic_reg/nic0_txs0_masks.h | 336 ++ .../include/gaudi/asic_reg/nic0_txs0_regs.h | 214 + .../include/gaudi/asic_reg/nic0_txs1_regs.h | 214 + .../include/gaudi/asic_reg/nic1_qm0_regs.h | 834 ++++ .../include/gaudi/asic_reg/nic1_qm1_regs.h | 834 ++++ .../include/gaudi/asic_reg/nic2_qm0_regs.h | 834 ++++ .../include/gaudi/asic_reg/nic2_qm1_regs.h | 834 ++++ .../include/gaudi/asic_reg/nic3_qm0_regs.h | 834 ++++ .../include/gaudi/asic_reg/nic3_qm1_regs.h | 834 ++++ .../include/gaudi/asic_reg/nic4_qm0_regs.h | 834 ++++ .../include/gaudi/asic_reg/nic4_qm1_regs.h | 834 ++++ drivers/misc/habanalabs/include/gaudi/gaudi.h | 12 + .../habanalabs/include/gaudi/gaudi_fw_if.h | 24 + .../habanalabs/include/gaudi/gaudi_masks.h | 15 + .../include/hw_ip/nic/nic_general.h | 13 + include/uapi/misc/habanalabs.h | 296 +- 53 files changed, 27497 insertions(+), 62 deletions(-) create mode 100644 drivers/misc/habanalabs/gaudi/gaudi_nic.c create mode 100644 drivers/misc/habanalabs/gaudi/gaudi_nic.h create mode 100644 drivers/misc/habanalabs/gaudi/gaudi_nic_dcbnl.c create mode 100644 drivers/misc/habanalabs/gaudi/gaudi_nic_debugfs.c create mode 100644 drivers/misc/habanalabs/gaudi/gaudi_nic_ethtool.c create mode 100644 drivers/misc/habanalabs/gaudi/gaudi_phy.c create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qm0_masks.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qm0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qm1_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qpc0_masks.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qpc0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qpc1_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_rxb_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_rxe0_masks.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_rxe0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_rxe1_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_stat_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_tmr_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txe0_masks.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txe0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txe1_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txs0_masks.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txs0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txs1_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic1_qm0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic1_qm1_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic2_qm0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic2_qm1_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic3_qm0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic3_qm1_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic4_qm0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic4_qm1_regs.h create mode 100644 drivers/misc/habanalabs/include/hw_ip/nic/nic_general.h
Signature · 1 line
2.17.1
PATCH 8/15 habanalabs/gaudi: add a new IOCTL for NIC control operations
From: Omer Shpigelman <[email protected]>
Add Queue Pair (QP) opcodes to the NIC ioctl.
A QP represents a connection between two Gaudi ports. Each port currently supports 1024 QPs where QP 0 is reserved for the driver for Ethernet. User-space process needs to create a QP in order to communicate with other Gaudis.
QP can have two contexts: requester (sender) and responder (receiver). Both have unique parameters as well as shared ones.
The QP numbers are not recycled immediately but only after wraparound. This to avoid cases where a QP was closed and reopened and got data of the "old" QP.
The added opcodes are:
- Create a QP
- Set requester context
- Set responder context
- Destroy a QP
--- drivers/misc/habanalabs/common/habanalabs.h | 3 + .../misc/habanalabs/common/habanalabs_ioctl.c | 98 ++++- drivers/misc/habanalabs/gaudi/gaudi.c | 1 + drivers/misc/habanalabs/gaudi/gaudiP.h | 2 + drivers/misc/habanalabs/gaudi/gaudi_nic.c | 409 ++++++++++++++++++ drivers/misc/habanalabs/goya/goya.c | 9 + include/uapi/misc/habanalabs.h | 129 +++++- 7 files changed, 649 insertions(+), 2 deletions(-)
drivers/misc/habanalabs/common/habanalabs.h +3 -0
@@ -679,6 +679,7 @@ struct hl_info_mac_addr;* then the timeout is the default timeout for the specific * ASIC * @get_hw_state: retrieve the H/W state +* @nic_control: Perform NIC related operations. * @pci_bars_map: Map PCI BARs. * @init_iatu: Initialize the iATU unit inside the PCI controller. * @get_mac_addr: Get list of MAC addresses.
@@ -783,6 +784,8 @@ struct hl_asic_funcs {int (*send_cpu_message)(struct hl_device *hdev,u32 *msg,u16 len,u32 timeout,long *result);enum hl_device_hw_state (*get_hw_state)(struct hl_device *hdev); +int (*nic_control)(struct hl_device *hdev,u32 op,void *input, +void *output);int (*pci_bars_map)(struct hl_device *hdev);int (*init_iatu)(struct hl_device *hdev); int (*get_mac_addr)(struct hl_device *hdev,
drivers/misc/habanalabs/common/habanalabs_ioctl.c +97 -1
116 lines not on this page · raw message
drivers/misc/habanalabs/gaudi/gaudi.c +1 -0
@@ -7468,6 +7468,7 @@ static const struct hl_asic_funcs gaudi_funcs = { .get_eeprom_data = gaudi_get_eeprom_data, .send_cpu_message = gaudi_send_cpu_message, .get_hw_state = gaudi_get_hw_state, + .nic_control = gaudi_nic_control, .pci_bars_map = gaudi_pci_bars_map, .init_iatu = gaudi_init_iatu, .get_mac_addr = gaudi_nic_get_mac_addr,
drivers/misc/habanalabs/gaudi/gaudiP.h +2 -0
@@ -568,6 +568,8 @@ void gaudi_nic_stop(struct hl_device *hdev);void gaudi_nic_ports_reopen (struct hl_device *hdev);int gaudi_nic_get_mac_addr (struct hl_device *hdev,struct hl_info_mac_addr *mac_addr); +int gaudi_nic_control (struct hl_device *hdev,u32 op,void *input, +void *output);void gaudi_nic_ctx_fini (struct hl_ctx *ctx);irqreturn_t gaudi_nic_rx_irq_handler (int irq,void *arg);irqreturn_t gaudi_nic_cq_irq_handler (int irq,void *arg);
drivers/misc/habanalabs/gaudi/gaudi_nic.c +409 -0
421 lines not on this page · raw message
drivers/misc/habanalabs/goya/goya.c +9 -0
@@ -5265,6 +5265,14 @@ static enum hl_device_hw_state goya_get_hw_state(struct hl_device *hdev)return RREG32 (mmHW_STATE); } +static int goya_nic_control (struct hl_device *hdev,u32 op,void *input, +void *output) +{ +dev_err_ratelimited (hdev->dev, +"NIC operations cannot be performed on Goya\n" ); +return -ENXIO ; +} +static int goya_get_mac_addr (struct hl_device *hdev,struct hl_info_mac_addr *mac_addr) {
@@ -5390,6 +5398,7 @@ static const struct hl_asic_funcs goya_funcs = { .get_eeprom_data = goya_get_eeprom_data, .send_cpu_message = goya_send_cpu_message, .get_hw_state = goya_get_hw_state, + .nic_control = goya_nic_control, .pci_bars_map = goya_pci_bars_map, .init_iatu = goya_init_iatu, .get_mac_addr = goya_get_mac_addr,
include/uapi/misc/habanalabs.h +128 -1
141 lines not on this page · raw message
Signature · 1 line
2.17.1
PATCH 7/15 habanalabs/gaudi: allow user to get MAC addresses in INFO IOCTL
In reply to Oded GabbayFrom: Omer Shpigelman <[email protected]>
The user needs this information when working in a distributed environment with master/slave configuration. All the slaves get their MAC addresses from the driver and send them to the master.
--- drivers/misc/habanalabs/common/habanalabs.h | 5 +++ .../misc/habanalabs/common/habanalabs_ioctl.c | 31 +++++++++++++++++++ drivers/misc/habanalabs/gaudi/gaudi.c | 1 + drivers/misc/habanalabs/gaudi/gaudiP.h | 2 ++ drivers/misc/habanalabs/gaudi/gaudi_nic.c | 27 ++++++++++++++++ drivers/misc/habanalabs/goya/goya.c | 9 ++++++ include/uapi/misc/habanalabs.h | 20 +++++++++++- 7 files changed, 94 insertions(+), 1 deletion(-)
drivers/misc/habanalabs/common/habanalabs.h +5 -0
@@ -602,6 +602,8 @@ enum div_select_defs { DIV_SEL_DIVIDED_PLL = 3, }; +struct hl_info_mac_addr ; +/** * struct hl_asic_funcs - ASIC specific functions that are can be called from * common code.
@@ -679,6 +681,7 @@ enum div_select_defs {* @get_hw_state: retrieve the H/W state * @pci_bars_map: Map PCI BARs. * @init_iatu: Initialize the iATU unit inside the PCI controller. +* @get_mac_addr: Get list of MAC addresses. * @rreg: Read a register. Needed for simulator support. * @wreg: Write a register. Needed for simulator support. * @halt_coresight: stop the ETF and ETR traces.
@@ -782,6 +785,8 @@ struct hl_asic_funcs {enum hl_device_hw_state (*get_hw_state)(struct hl_device *hdev);int (*pci_bars_map)(struct hl_device *hdev);int (*init_iatu)(struct hl_device *hdev); +int (*get_mac_addr)(struct hl_device *hdev, +struct hl_info_mac_addr *mac_addr);u32 (*rreg)(struct hl_device *hdev,u32 reg);void (*wreg)(struct hl_device *hdev,u32 reg,u32 val);void (*halt_coresight)(struct hl_device *hdev);
drivers/misc/habanalabs/common/habanalabs_ioctl.c +31 -0
@@ -203,6 +203,33 @@ static int debug_coresight(struct hl_device *hdev, struct hl_debug_args *args)return rc; } +static int mac_addr_info (struct hl_device *hdev,struct hl_info_args *args) +{ +struct hl_info_mac_addr *mac_addr; +u32 max_size = args->return_size; +void __user *out = (void __user *) (uintptr_t ) args->return_pointer; +int rc; + +if (!max_size || !out) +return -EINVAL ; + + mac_addr =kzalloc (sizeof (struct hl_info_mac_addr ),GFP_KERNEL ); +if (!mac_addr) +return -ENOMEM ; + + rc = hdev->asic_funcs->get_mac_addr (hdev, mac_addr); +if (rc) + goto out; + + rc =copy_to_user (out, mac_addr, +min ((size_t ) max_size,sizeof (struct hl_info_mac_addr ))) ? + -EFAULT :0 ; + +out: +kfree (mac_addr); +return rc; +} +static int device_utilization (struct hl_device *hdev,struct hl_info_args *args) {struct hl_info_device_utilization device_util = {0 };
@@ -423,6 +450,10 @@ static int _hl_info_ioctl(struct hl_fpriv *hpriv, void *data, rc =hw_idle (hdev, args);break ; +case HL_INFO_MAC_ADDR : + rc =mac_addr_info (hdev, args); +break ; +case HL_INFO_DEVICE_UTILIZATION : rc =device_utilization (hdev, args);break ;
drivers/misc/habanalabs/gaudi/gaudi.c +1 -0
@@ -7470,6 +7470,7 @@ static const struct hl_asic_funcs gaudi_funcs = { .get_hw_state = gaudi_get_hw_state, .pci_bars_map = gaudi_pci_bars_map, .init_iatu = gaudi_init_iatu, + .get_mac_addr = gaudi_nic_get_mac_addr, .rreg = hl_rreg, .wreg = hl_wreg, .halt_coresight = gaudi_halt_coresight,
drivers/misc/habanalabs/gaudi/gaudiP.h +2 -0
@@ -566,6 +566,8 @@ void gaudi_nic_ports_fini(struct hl_device *hdev);int gaudi_nic_hard_reset_prepare (struct hl_device *hdev);void gaudi_nic_stop (struct hl_device *hdev);void gaudi_nic_ports_reopen (struct hl_device *hdev); +int gaudi_nic_get_mac_addr (struct hl_device *hdev, +struct hl_info_mac_addr *mac_addr);void gaudi_nic_ctx_fini (struct hl_ctx *ctx);irqreturn_t gaudi_nic_rx_irq_handler (int irq,void *arg);irqreturn_t gaudi_nic_cq_irq_handler (int irq,void *arg);
drivers/misc/habanalabs/gaudi/gaudi_nic.c +27 -0
@@ -2743,6 +2743,33 @@ void gaudi_nic_ports_reopen(struct hl_device *hdev) gaudi->hw_cap_initialized |=HW_CAP_NIC_DRV ; } +int gaudi_nic_get_mac_addr (struct hl_device *hdev, +struct hl_info_mac_addr *mac_addr) +{ +struct gaudi_device *gaudi = hdev->asic_specific; +struct net_device *ndev; +int i, number_of_ports; + +if (!(gaudi->hw_cap_initialized &HW_CAP_NIC_DRV )) + goto out; + + number_of_ports =min_t (int,NIC_NUMBER_OF_PORTS , +HL_INFO_MAC_ADDR_MAX_NUM ); + +for (i =0 ; i < number_of_ports ; i++) { +if (!(hdev->nic_ports_mask &BIT (i))) +continue ; + + ndev = gaudi->nic_devices[i].ndev; +if (!ndev) +continue ; + +ether_addr_copy (mac_addr->array[i].addr, ndev->dev_addr); + mac_addr->mask[i /64 ] |=BIT_ULL (i %64 ); + } +out: +return 0 ; +}void gaudi_nic_ctx_fini (struct hl_ctx *ctx) { }
drivers/misc/habanalabs/goya/goya.c +9 -0
@@ -5265,6 +5265,14 @@ static enum hl_device_hw_state goya_get_hw_state(struct hl_device *hdev)return RREG32 (mmHW_STATE); } +static int goya_get_mac_addr (struct hl_device *hdev, +struct hl_info_mac_addr *mac_addr) +{ +dev_err_ratelimited (hdev->dev, +"No MAC addresses are assigned to Goya\n" ); +return -ENXIO ; +} +static int goya_ctx_init (struct hl_ctx *ctx) {return 0 ;
@@ -5384,6 +5392,7 @@ static const struct hl_asic_funcs goya_funcs = { .get_hw_state = goya_get_hw_state, .pci_bars_map = goya_pci_bars_map, .init_iatu = goya_init_iatu, + .get_mac_addr = goya_get_mac_addr, .rreg = hl_rreg, .wreg = hl_wreg, .halt_coresight = goya_halt_coresight,
include/uapi/misc/habanalabs.h +19 -1
@@ -10,6 +10,7 @@#include <linux/types.h> #include <linux/ioctl.h> +#include <linux/if_ether.h> /* * Defines that are asic-specific but constitutes as ABI between kernel driver
@@ -248,6 +249,8 @@ enum hl_device_status {* internal engine. * HL_INFO_DEVICE_STATUS - Retrieve the device's status. This opcode doesn't * require an open context. +* HL_INFO_MAC_ADDR - Retrieve the list of MAC addresses of the device's +* network ports, if the device has network ports. * HL_INFO_DEVICE_UTILIZATION - Retrieve the total utilization of the device * over the last period specified by the user. * The period can be between 100ms to 1s, in
@@ -274,6 +277,7 @@ enum hl_device_status {#define HL_INFO_DRAM_USAGE 2#define HL_INFO_HW_IDLE 3#define HL_INFO_DEVICE_STATUS 4 +#define HL_INFO_MAC_ADDR 5#define HL_INFO_DEVICE_UTILIZATION 6#define HL_INFO_HW_EVENTS_AGGREGATE 7#define HL_INFO_CLK_RATE 8
@@ -285,9 +289,11 @@ enum hl_device_status {#define HL_INFO_SYNC_MANAGER 14#define HL_INFO_TOTAL_ENERGY 15 -#define HL_INFO_VERSION_MAX_LEN 128 +#define HL_INFO_VERSION_MAX_LEN 128#define HL_INFO_CARD_NAME_MAX_LEN 16 +#define HL_INFO_MAC_ADDR_MAX_NUM 128 +struct hl_info_hw_ip_info {__u64 sram_base_address;__u64 dram_base_address;
@@ -334,6 +340,18 @@ struct hl_info_device_status {__u32 pad; }; +struct hl_mac_addr { +__u8 addr[ETH_ALEN ]; +__u8 pad[2 ]; +}; + +struct hl_info_mac_addr { +/* MAC address at index N is of the corresponding PORT ID */ +struct hl_mac_addr array[HL_INFO_MAC_ADDR_MAX_NUM ]; +/* Mask of valid entries at the MAC addresses array */ +__u64 mask[2 ]; +}; +struct hl_info_device_utilization {__u32 utilization;__u32 pad;
Signature · 1 line
2.17.1
PATCH 15/15 habanalabs/gaudi: add NIC init/fini calls from common code
In reply to Oded GabbayFrom: Omer Shpigelman <[email protected]>
Finally, enable the NIC engines. Initialize the NIC ports mask variable with full mask so all ports will be initialized.
Call the NIC init/fini from the common code.
--- drivers/misc/habanalabs/common/device.c | 18 +++++++++++++++ drivers/misc/habanalabs/common/habanalabs.h | 6 +++++ .../misc/habanalabs/common/habanalabs_drv.c | 1 + drivers/misc/habanalabs/common/pci.c | 1 + drivers/misc/habanalabs/gaudi/gaudi.c | 23 +++++++++++++++++++ drivers/misc/habanalabs/goya/goya.c | 12 ++++++++++ 6 files changed, 61 insertions(+)
drivers/misc/habanalabs/common/device.c +18 -0
@@ -1077,6 +1077,12 @@ int hl_device_reset(struct hl_device *hdev, bool hard_reset, goto out_err; } + rc = hdev->asic_funcs->nic_init (hdev); +if (rc) { +dev_err (hdev->dev,"Failed to init NIC driver\n" ); + goto out_err; + } +hl_set_max_power (hdev); }else { rc = hdev->asic_funcs->soft_reset_late_init (hdev);
@@ -1312,6 +1318,13 @@ int hl_device_init(struct hl_device *hdev, struct class *hclass) goto out_disabled; } + rc = hdev->asic_funcs->nic_init (hdev); +if (rc) { +dev_err (hdev->dev,"Failed to init NIC driver\n" ); + rc =0 ; + goto out_disabled; + } +/* * Expose devices and sysfs nodes to user. * From here there is no need to add char devices and create sysfs nodes
@@ -1463,6 +1476,11 @@ void hl_device_fini(struct hl_device *hdev)hl_cb_pool_fini (hdev); +/* the NIC uses the kernel context for MMU mappings, therefore must be +* cleaned before it +*/ + hdev->asic_funcs->nic_fini (hdev); +/* Release kernel context */ if ((hdev->kernel_ctx) && (hl_ctx_put (hdev->kernel_ctx) !=1 ))dev_err (hdev->dev,"kernel ctx is still alive\n" );
drivers/misc/habanalabs/common/habanalabs.h +6 -0
@@ -680,6 +680,10 @@ struct hl_info_mac_addr;* then the timeout is the default timeout for the specific * ASIC * @get_hw_state: retrieve the H/W state +* @nic_init: init the NIC H/W and I/F. This should be called in the final satge +* of the init flow, as we must not have anything that might fail +* during its initialization after the NIC init. +* @nic_fini: perform NIC cleanup. * @nic_control: Perform NIC related operations. * @nic_cq_mmap: map the NIC CQ buffer. * @pci_bars_map: Map PCI BARs.
@@ -786,6 +790,8 @@ struct hl_asic_funcs {int (*send_cpu_message)(struct hl_device *hdev,u32 *msg,u16 len,u32 timeout,long *result);enum hl_device_hw_state (*get_hw_state)(struct hl_device *hdev); +int (*nic_init)(struct hl_device *hdev); +void (*nic_fini)(struct hl_device *hdev);int (*nic_control)(struct hl_device *hdev,u32 op,void *input,void *output);int (*nic_cq_mmap)(struct hl_device *hdev,struct vm_area_struct *vma);
drivers/misc/habanalabs/common/habanalabs_drv.c +1 -0
@@ -247,6 +247,7 @@ static void set_driver_behavior_per_device(struct hl_device *hdev) hdev->bmc_enable =1 ; hdev->hard_reset_on_fw_events =1 ; hdev->card_type = cpucp_card_type_pci; + hdev->nic_ports_mask =0x3FF ; hdev->nic_ports_ext_mask =0x3FF ; hdev->nic_auto_neg_mask =0x3FF ; hdev->nic_load_fw =0 ;
drivers/misc/habanalabs/common/pci.c +1 -0
@@ -230,6 +230,7 @@ int hl_pci_set_inbound_region(struct hl_device *hdev, u8 region, lower_32_bits(pci_region->addr)); rc |=hl_pci_iatu_write (hdev, offset +0x18 ,upper_32_bits (pci_region->addr)); +/* Set bar type as memory */ rc |=hl_pci_iatu_write (hdev, offset +0x0 ,0 );/* Enable + bar/address match + match enable + bar number */
drivers/misc/habanalabs/gaudi/gaudi.c +23 -0
@@ -882,6 +882,27 @@ static void gaudi_late_fini(struct hl_device *hdev) hdev->hl_chip_info->info =NULL ; } +static int gaudi_nic_init (struct hl_device *hdev) +{ +/* +* In init flow we initialize the NIC ports from scratch. In hard reset +* flow, we get here after the NIC ports were halted, hence we only +* need to reopen them. +*/ +if (atomic_read (&hdev->in_reset)) { +gaudi_nic_ports_reopen (hdev); +return 0 ; + } + +return gaudi_nic_ports_init (hdev); +} + +static void gaudi_nic_fini (struct hl_device *hdev) +{ +/* must be called after MSI was disabled */ +gaudi_nic_ports_fini (hdev); +} +static void gaudi_nic_handle_rx (struct gaudi_nic_device *gaudi_nic) {/* at this point, interrupts were disabled by the H/W */
@@ -7482,6 +7503,8 @@ static const struct hl_asic_funcs gaudi_funcs = { .get_eeprom_data = gaudi_get_eeprom_data, .send_cpu_message = gaudi_send_cpu_message, .get_hw_state = gaudi_get_hw_state, + .nic_init = gaudi_nic_init, + .nic_fini = gaudi_nic_fini, .nic_control = gaudi_nic_control, .nic_cq_mmap = gaudi_nic_cq_mmap, .pci_bars_map = gaudi_pci_bars_map,
drivers/misc/habanalabs/goya/goya.c +12 -0
@@ -5265,6 +5265,16 @@ static enum hl_device_hw_state goya_get_hw_state(struct hl_device *hdev)return RREG32 (mmHW_STATE); } +static int goya_nic_init (struct hl_device *hdev) +{ +return 0 ; +} + +static void goya_nic_fini (struct hl_device *hdev) +{ + +} +static int goya_nic_control (struct hl_device *hdev,u32 op,void *input,void *output) {
@@ -5405,6 +5415,8 @@ static const struct hl_asic_funcs goya_funcs = { .get_eeprom_data = goya_get_eeprom_data, .send_cpu_message = goya_send_cpu_message, .get_hw_state = goya_get_hw_state, + .nic_init = goya_nic_init, + .nic_fini = goya_nic_fini, .nic_control = goya_nic_control, .nic_cq_mmap = goya_nic_mmap, .pci_bars_map = goya_pci_bars_map,
Signature · 1 line
2.17.1
PATCH 10/15 habanalabs/gaudi: add WQ control operations
In reply to Oded GabbayFrom: Omer Shpigelman <[email protected]>
Add Work Queue (WQ) opcodes to NIC ioctl. A WQ contains entries (WQEs) where each WQE represents a packet that should be sent or received.
Each WQ has two types: requester (sender) and responder (receiver).
The added opcodes are:
- Set WQ: set the WQ configuration in the HW. The user should provide the device virtual address of the WQ.
- Unset WQ: reset the WQ configuration in the HW.
--- .../misc/habanalabs/common/habanalabs_ioctl.c | 10 +- drivers/misc/habanalabs/gaudi/gaudi_nic.c | 184 ++++++++++++++++++ include/uapi/misc/habanalabs.h | 33 ++++ 3 files changed, 225 insertions(+), 2 deletions(-)
drivers/misc/habanalabs/common/habanalabs_ioctl.c +8 -2
@@ -24,7 +24,7 @@ static u32 hl_debug_struct_size[HL_DEBUG_OP_TIMESTAMP + 1] = { }; -static u32 hl_nic_input_size[HL_NIC_OP_CQ_UPDATE_CONSUMED_CQES +1 ] = { +static u32 hl_nic_input_size[HL_NIC_OP_USER_WQ_UNSET +1 ] = { [HL_NIC_OP_ALLOC_CONN ] =sizeof (struct hl_nic_alloc_conn_in ), [HL_NIC_OP_SET_REQ_CONN_CTX ] =sizeof (struct hl_nic_req_conn_ctx_in ), [HL_NIC_OP_SET_RES_CONN_CTX ] =sizeof (struct hl_nic_res_conn_ctx_in ),
@@ -35,9 +35,11 @@ static u32 hl_nic_input_size[HL_NIC_OP_CQ_UPDATE_CONSUMED_CQES + 1] = { [HL_NIC_OP_CQ_POLL] = sizeof(struct hl_nic_cq_poll_wait_in), [HL_NIC_OP_CQ_UPDATE_CONSUMED_CQES ] = sizeof(struct hl_nic_cq_update_consumed_cqes_in), + [HL_NIC_OP_USER_WQ_SET] = sizeof(struct hl_nic_user_wq_arr_set_in), + [HL_NIC_OP_USER_WQ_UNSET ] =sizeof (struct hl_nic_user_wq_arr_unset_in ) }; -static u32 hl_nic_output_size[HL_NIC_OP_CQ_UPDATE_CONSUMED_CQES +1 ] = { +static u32 hl_nic_output_size[HL_NIC_OP_USER_WQ_UNSET +1 ] = { [HL_NIC_OP_ALLOC_CONN ] =sizeof (struct hl_nic_alloc_conn_out ), [HL_NIC_OP_SET_REQ_CONN_CTX ] =0 , [HL_NIC_OP_SET_RES_CONN_CTX ] =0 ,
@@ -47,6 +49,8 @@ static u32 hl_nic_output_size[HL_NIC_OP_CQ_UPDATE_CONSUMED_CQES + 1] = { [HL_NIC_OP_CQ_WAIT] = sizeof(struct hl_nic_cq_poll_wait_out), [HL_NIC_OP_CQ_POLL] = sizeof(struct hl_nic_cq_poll_wait_out), [HL_NIC_OP_CQ_UPDATE_CONSUMED_CQES] = 0, + [HL_NIC_OP_USER_WQ_SET] = 0, + [HL_NIC_OP_USER_WQ_UNSET] = 0 };static int device_status_info (struct hl_device *hdev,struct hl_info_args *args)
@@ -641,6 +645,8 @@ static int hl_nic_ioctl(struct hl_fpriv *hpriv, void *data)case HL_NIC_OP_CQ_WAIT :case HL_NIC_OP_CQ_POLL :case HL_NIC_OP_CQ_UPDATE_CONSUMED_CQES : +case HL_NIC_OP_USER_WQ_SET : +case HL_NIC_OP_USER_WQ_UNSET : args->input_size =min (args->input_size, hl_nic_input_size[args->op]); args->output_size =
drivers/misc/habanalabs/gaudi/gaudi_nic.c +184 -0
208 lines not on this page · raw message
include/uapi/misc/habanalabs.h +33 -0
@@ -1021,6 +1021,31 @@ struct hl_nic_cq_poll_wait_out {__u32 pad; }; +/* Send user WQ array type */ +#define HL_NIC_USER_WQ_SEND 0 +/* Receive user WQ array type */ +#define HL_NIC_USER_WQ_RECV 1 + +struct hl_nic_user_wq_arr_set_in { +/* WQ array address */ +__u64 addr; +/* NIC port ID */ +__u32 port; +/* Number of user WQs */ +__u32 num_of_wqs; +/* Number of entries per user WQ */ +__u32 num_of_wq_entries; +/* Type of user WQ array */ +__u32 type; +}; + +struct hl_nic_user_wq_arr_unset_in { +/* NIC port ID */ +__u32 port; +/* Type of user WQ array */ +__u32 type; +}; +/* Opcode to allocate connection ID */ #define HL_NIC_OP_ALLOC_CONN 0/* Opcode to set up a requester connection context */
@@ -1039,6 +1064,10 @@ struct hl_nic_cq_poll_wait_out {#define HL_NIC_OP_CQ_POLL 7/* Opcode to update the number of consumed CQ entries */ #define HL_NIC_OP_CQ_UPDATE_CONSUMED_CQES 8 +/* Opcode to set a user WQ array */ +#define HL_NIC_OP_USER_WQ_SET 9 +/* Opcode to unset a user WQ array */ +#define HL_NIC_OP_USER_WQ_UNSET 10struct hl_nic_args {/* Pointer to user input structure (relevant to specific opcodes) */
@@ -1225,6 +1254,8 @@ struct hl_nic_args {* - Wait on completion queue * - Poll a completion queue * - Update consumed completion queue entries +* - Set a work queue +* - Unset a work queue * * For all operations, the user should provide a pointer to an input structure * with the context parameters. Some of the operations also require a pointer to
@@ -1238,6 +1269,8 @@ struct hl_nic_args {* driver regarding how many of the available CQEs were actually * processed/consumed. Only then the driver will override them with newer * entries. +* The set WQ operation should provide the device virtual address of the WQ with +* a matching size for the number of WQs and entries per WQ. * */ #define HL_IOCTL_NIC _IOWR('H', 0x07, struct hl_nic_args)
Signature · 1 line
2.17.1
PATCH 3/15 habanalabs/gaudi: add NIC security configuration
In reply to Oded GabbayFrom: Omer Shpigelman <[email protected]>
Configure the security properties of the NIC IP. This is to prevent the user process from doing something with the NIC that he shouldn't do. e.g. crash the server, steal data, etc.
--- .../misc/habanalabs/gaudi/gaudi_security.c | 3973 +++++++++++++++++ 1 file changed, 3973 insertions(+)
drivers/misc/habanalabs/gaudi/gaudi_security.c +3973 -0
@@ -5157,6 +5157,3977 @@ static void gaudi_init_dma_protection_bits(struct hl_device *hdev)WREG32 (pb_addr + word_offset, ~mask); } +static void gaudi_init_nic_protection_bits (struct hl_device *hdev) +{ +u32 pb_addr, mask; +u8 word_offset; + +WREG32 (mmNIC0_QM0_BASE -CFG_BASE +PROT_BITS_OFFS +0x7C ,0 ); +WREG32 (mmNIC0_QM1_BASE -CFG_BASE +PROT_BITS_OFFS +0x7C ,0 ); + + pb_addr = (mmNIC0_QM0_GLBL_CFG0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC0_QM0_GLBL_CFG0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC0_QM0_GLBL_CFG0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_GLBL_CFG1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_GLBL_PROT &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_GLBL_ERR_CFG &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_GLBL_SECURE_PROPS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_GLBL_SECURE_PROPS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_GLBL_SECURE_PROPS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_GLBL_SECURE_PROPS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_GLBL_SECURE_PROPS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_GLBL_NON_SECURE_PROPS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_GLBL_NON_SECURE_PROPS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_GLBL_NON_SECURE_PROPS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_GLBL_NON_SECURE_PROPS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_GLBL_NON_SECURE_PROPS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_GLBL_STS0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_GLBL_STS1_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_GLBL_STS1_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_GLBL_STS1_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_GLBL_STS1_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_GLBL_STS1_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_GLBL_MSG_EN_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_GLBL_MSG_EN_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_GLBL_MSG_EN_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_GLBL_MSG_EN_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_GLBL_MSG_EN_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_PQ_BASE_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_PQ_BASE_LO_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_PQ_BASE_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_PQ_BASE_LO_3 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC0_QM0_PQ_BASE_HI_0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC0_QM0_PQ_BASE_HI_0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC0_QM0_PQ_BASE_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_PQ_BASE_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_PQ_BASE_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_PQ_BASE_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_PQ_SIZE_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_PQ_SIZE_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_PQ_SIZE_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_PQ_SIZE_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_PQ_PI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_PQ_PI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_PQ_PI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_PQ_PI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_PQ_CI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_PQ_CI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_PQ_CI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_PQ_CI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_PQ_CFG0_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_PQ_CFG0_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_PQ_CFG0_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_PQ_CFG0_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_PQ_CFG1_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_PQ_CFG1_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_PQ_CFG1_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_PQ_CFG1_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_PQ_ARUSER_31_11_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_PQ_ARUSER_31_11_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_PQ_ARUSER_31_11_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_PQ_ARUSER_31_11_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_PQ_STS0_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_PQ_STS0_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_PQ_STS0_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_PQ_STS0_3 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC0_QM0_PQ_STS1_0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC0_QM0_PQ_STS1_0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC0_QM0_PQ_STS1_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_PQ_STS1_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_PQ_STS1_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_PQ_STS1_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CQ_STS0_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CQ_STS0_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CQ_STS0_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CQ_STS0_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CQ_STS1_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CQ_STS1_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CQ_STS1_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CQ_STS1_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CQ_PTR_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CQ_PTR_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CQ_TSIZE_0 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC0_QM0_CQ_CTL_0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC0_QM0_CQ_CTL_0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC0_QM0_CQ_CTL_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CQ_PTR_LO_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CQ_PTR_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CQ_TSIZE_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CQ_CTL_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CQ_PTR_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CQ_PTR_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CQ_TSIZE_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CQ_CTL_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CQ_PTR_LO_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CQ_PTR_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CQ_TSIZE_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CQ_CTL_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CQ_PTR_LO_STS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CQ_PTR_LO_STS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CQ_PTR_LO_STS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CQ_PTR_LO_STS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CQ_PTR_LO_STS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CQ_PTR_HI_STS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CQ_PTR_HI_STS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CQ_PTR_HI_STS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CQ_PTR_HI_STS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CQ_PTR_HI_STS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CQ_TSIZE_STS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CQ_TSIZE_STS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CQ_TSIZE_STS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CQ_TSIZE_STS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CQ_TSIZE_STS_4 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC0_QM0_CQ_CTL_STS_0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC0_QM0_CQ_CTL_STS_0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC0_QM0_CQ_CTL_STS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CQ_CTL_STS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CQ_CTL_STS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CQ_CTL_STS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CQ_CTL_STS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CQ_IFIFO_CNT_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CQ_IFIFO_CNT_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CQ_IFIFO_CNT_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CQ_IFIFO_CNT_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CQ_IFIFO_CNT_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_MSG_BASE0_ADDR_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_MSG_BASE0_ADDR_LO_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_MSG_BASE0_ADDR_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_MSG_BASE0_ADDR_LO_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_MSG_BASE0_ADDR_LO_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_MSG_BASE0_ADDR_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_MSG_BASE0_ADDR_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_MSG_BASE0_ADDR_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_MSG_BASE0_ADDR_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_MSG_BASE0_ADDR_HI_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_MSG_BASE1_ADDR_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_MSG_BASE1_ADDR_LO_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_MSG_BASE1_ADDR_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_MSG_BASE1_ADDR_LO_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_MSG_BASE1_ADDR_LO_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_MSG_BASE1_ADDR_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_MSG_BASE1_ADDR_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_MSG_BASE1_ADDR_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_MSG_BASE1_ADDR_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_MSG_BASE1_ADDR_HI_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_MSG_BASE2_ADDR_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_MSG_BASE2_ADDR_LO_1 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC0_QM0_CP_MSG_BASE2_ADDR_LO_2 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC0_QM0_CP_MSG_BASE2_ADDR_LO_2 & +PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC0_QM0_CP_MSG_BASE2_ADDR_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_MSG_BASE2_ADDR_LO_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_MSG_BASE2_ADDR_LO_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_MSG_BASE2_ADDR_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_MSG_BASE2_ADDR_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_MSG_BASE2_ADDR_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_MSG_BASE2_ADDR_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_MSG_BASE2_ADDR_HI_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_MSG_BASE3_ADDR_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_MSG_BASE3_ADDR_LO_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_MSG_BASE3_ADDR_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_MSG_BASE3_ADDR_LO_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_MSG_BASE3_ADDR_LO_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_MSG_BASE3_ADDR_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_MSG_BASE3_ADDR_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_MSG_BASE3_ADDR_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_MSG_BASE3_ADDR_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_MSG_BASE3_ADDR_HI_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_LDMA_TSIZE_OFFSET_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_LDMA_TSIZE_OFFSET_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_LDMA_TSIZE_OFFSET_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_LDMA_TSIZE_OFFSET_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_LDMA_TSIZE_OFFSET_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_LDMA_SRC_BASE_LO_OFFSET_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_LDMA_SRC_BASE_LO_OFFSET_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_LDMA_SRC_BASE_LO_OFFSET_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_LDMA_SRC_BASE_LO_OFFSET_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_LDMA_SRC_BASE_LO_OFFSET_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_LDMA_DST_BASE_LO_OFFSET_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_LDMA_DST_BASE_LO_OFFSET_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_LDMA_DST_BASE_LO_OFFSET_2 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC0_QM0_CP_LDMA_DST_BASE_LO_OFFSET_3 & ~0xFFF ) + +PROT_BITS_OFFS ; + word_offset = ((mmNIC0_QM0_CP_LDMA_DST_BASE_LO_OFFSET_3 & +PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC0_QM0_CP_LDMA_DST_BASE_LO_OFFSET_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_LDMA_DST_BASE_LO_OFFSET_4 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC0_QM0_CP_STS_0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC0_QM0_CP_STS_0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC0_QM0_CP_STS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_STS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_STS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_STS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_STS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_CURRENT_INST_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_CURRENT_INST_LO_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_CURRENT_INST_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_CURRENT_INST_LO_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_CURRENT_INST_LO_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_CURRENT_INST_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_CURRENT_INST_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_CURRENT_INST_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_CURRENT_INST_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_CURRENT_INST_HI_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_BARRIER_CFG_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_BARRIER_CFG_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_BARRIER_CFG_2 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC0_QM0_CP_BARRIER_CFG_3 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC0_QM0_CP_BARRIER_CFG_3 &PROT_BITS_OFFS ) + >>7 ) <<2 ; + mask =1U << ((mmNIC0_QM0_CP_BARRIER_CFG_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_BARRIER_CFG_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_DBG_0_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_DBG_0_1 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC0_QM0_CP_DBG_0_2 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC0_QM0_CP_DBG_0_2 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC0_QM0_CP_DBG_0_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_DBG_0_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_DBG_0_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_ARUSER_31_11_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_ARUSER_31_11_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_ARUSER_31_11_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_ARUSER_31_11_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_ARUSER_31_11_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_AWUSER_31_11_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_AWUSER_31_11_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_AWUSER_31_11_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_AWUSER_31_11_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CP_AWUSER_31_11_4 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC0_QM0_ARB_CFG_0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC0_QM0_ARB_CFG_0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC0_QM0_ARB_CFG_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_AVAIL_CRED_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_AVAIL_CRED_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_AVAIL_CRED_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_AVAIL_CRED_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_AVAIL_CRED_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_AVAIL_CRED_5 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_AVAIL_CRED_6 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_AVAIL_CRED_7 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_AVAIL_CRED_8 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_AVAIL_CRED_9 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_AVAIL_CRED_10 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_AVAIL_CRED_11 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_AVAIL_CRED_12 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_AVAIL_CRED_13 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_AVAIL_CRED_14 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_AVAIL_CRED_15 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_AVAIL_CRED_16 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_AVAIL_CRED_17 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_AVAIL_CRED_18 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_AVAIL_CRED_19 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_AVAIL_CRED_20 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_AVAIL_CRED_21 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_AVAIL_CRED_22 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_AVAIL_CRED_23 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC0_QM0_ARB_MST_AVAIL_CRED_24 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC0_QM0_ARB_MST_AVAIL_CRED_24 & +PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC0_QM0_ARB_MST_AVAIL_CRED_24 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_AVAIL_CRED_25 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_AVAIL_CRED_26 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_AVAIL_CRED_27 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_AVAIL_CRED_28 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_AVAIL_CRED_29 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_AVAIL_CRED_30 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_AVAIL_CRED_31 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC0_QM0_ARB_MST_CHOISE_PUSH_OFST_23 & ~0xFFF ) + +PROT_BITS_OFFS ; + word_offset = ((mmNIC0_QM0_ARB_MST_CHOISE_PUSH_OFST_23 & +PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC0_QM0_ARB_SLV_CHOISE_WDT &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MSG_MAX_INFLIGHT &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MSG_AWUSER_31_11 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MSG_AWUSER_SEC_PROP &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MSG_AWUSER_NON_SEC_PROP &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC0_QM0_ARB_STATE_STS & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC0_QM0_ARB_STATE_STS &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC0_QM0_ARB_STATE_STS &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_CHOISE_FULLNESS_STS &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MSG_STS &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_SLV_CHOISE_Q_HEAD &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_ERR_CAUSE &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_ERR_MSG_EN &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_ERR_STS_DRP &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_CRED_STS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_CRED_STS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_CRED_STS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_CRED_STS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_CRED_STS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_CRED_STS_5 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_CRED_STS_6 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_CRED_STS_7 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_CRED_STS_8 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_CRED_STS_9 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_CRED_STS_10 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_CRED_STS_11 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_CRED_STS_12 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_CRED_STS_13 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_CRED_STS_14 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_CRED_STS_15 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_CRED_STS_16 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_CRED_STS_17 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_CRED_STS_18 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_CRED_STS_19 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC0_QM0_ARB_MST_CRED_STS_20 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC0_QM0_ARB_MST_CRED_STS_20 &PROT_BITS_OFFS ) + >>7 ) <<2 ; + mask =1U << ((mmNIC0_QM0_ARB_MST_CRED_STS_20 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_CRED_STS_21 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_CRED_STS_22 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_CRED_STS_23 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_CRED_STS_24 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_CRED_STS_25 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_CRED_STS_26 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_CRED_STS_27 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_CRED_STS_28 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_CRED_STS_29 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_CRED_STS_30 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_ARB_MST_CRED_STS_31 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CGM_CFG &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CGM_STS &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CGM_CFG1 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC0_QM0_LOCAL_RANGE_BASE & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC0_QM0_LOCAL_RANGE_BASE &PROT_BITS_OFFS ) + >>7 ) <<2 ; + mask =1U << ((mmNIC0_QM0_LOCAL_RANGE_BASE &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_LOCAL_RANGE_SIZE &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_CSMR_STRICT_PRIO_CFG &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_HBW_RD_RATE_LIM_CFG_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_LBW_WR_RATE_LIM_CFG_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_LBW_WR_RATE_LIM_CFG_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_HBW_RD_RATE_LIM_CFG_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_GLBL_AXCACHE &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_IND_GW_APB_CFG &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_IND_GW_APB_WDATA &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_IND_GW_APB_RDATA &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_IND_GW_APB_STATUS &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_GLBL_ERR_ADDR_LO &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_GLBL_ERR_ADDR_HI &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM0_GLBL_ERR_WDATA &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC0_QM0_GLBL_MEM_INIT_BUSY & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC0_QM0_GLBL_MEM_INIT_BUSY &PROT_BITS_OFFS ) + >>7 ) <<2 ; + mask =1U << ((mmNIC0_QM0_GLBL_MEM_INIT_BUSY &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC0_QM1_GLBL_CFG0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC0_QM1_GLBL_CFG0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC0_QM1_GLBL_CFG0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_GLBL_CFG1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_GLBL_PROT &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_GLBL_ERR_CFG &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_GLBL_SECURE_PROPS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_GLBL_SECURE_PROPS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_GLBL_SECURE_PROPS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_GLBL_SECURE_PROPS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_GLBL_SECURE_PROPS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_GLBL_NON_SECURE_PROPS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_GLBL_NON_SECURE_PROPS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_GLBL_NON_SECURE_PROPS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_GLBL_NON_SECURE_PROPS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_GLBL_NON_SECURE_PROPS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_GLBL_STS0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_GLBL_STS1_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_GLBL_STS1_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_GLBL_STS1_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_GLBL_STS1_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_GLBL_STS1_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_GLBL_MSG_EN_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_GLBL_MSG_EN_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_GLBL_MSG_EN_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_GLBL_MSG_EN_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_GLBL_MSG_EN_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_PQ_BASE_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_PQ_BASE_LO_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_PQ_BASE_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_PQ_BASE_LO_3 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC0_QM1_PQ_BASE_HI_0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC0_QM1_PQ_BASE_HI_0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC0_QM1_PQ_BASE_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_PQ_BASE_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_PQ_BASE_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_PQ_BASE_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_PQ_SIZE_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_PQ_SIZE_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_PQ_SIZE_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_PQ_SIZE_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_PQ_PI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_PQ_PI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_PQ_PI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_PQ_PI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_PQ_CI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_PQ_CI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_PQ_CI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_PQ_CI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_PQ_CFG0_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_PQ_CFG0_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_PQ_CFG0_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_PQ_CFG0_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_PQ_CFG1_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_PQ_CFG1_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_PQ_CFG1_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_PQ_CFG1_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_PQ_ARUSER_31_11_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_PQ_ARUSER_31_11_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_PQ_ARUSER_31_11_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_PQ_ARUSER_31_11_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_PQ_STS0_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_PQ_STS0_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_PQ_STS0_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_PQ_STS0_3 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC0_QM1_PQ_STS1_0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC0_QM1_PQ_STS1_0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC0_QM1_PQ_STS1_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_PQ_STS1_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_PQ_STS1_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_PQ_STS1_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CQ_STS0_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CQ_STS0_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CQ_STS0_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CQ_STS0_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CQ_STS1_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CQ_STS1_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CQ_STS1_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CQ_STS1_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CQ_PTR_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CQ_PTR_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CQ_TSIZE_0 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC0_QM1_CQ_CTL_0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC0_QM1_CQ_CTL_0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC0_QM1_CQ_CTL_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CQ_PTR_LO_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CQ_PTR_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CQ_TSIZE_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CQ_CTL_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CQ_PTR_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CQ_PTR_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CQ_TSIZE_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CQ_CTL_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CQ_PTR_LO_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CQ_PTR_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CQ_TSIZE_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CQ_CTL_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CQ_PTR_LO_STS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CQ_PTR_LO_STS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CQ_PTR_LO_STS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CQ_PTR_LO_STS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CQ_PTR_LO_STS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CQ_PTR_HI_STS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CQ_PTR_HI_STS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CQ_PTR_HI_STS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CQ_PTR_HI_STS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CQ_PTR_HI_STS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CQ_TSIZE_STS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CQ_TSIZE_STS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CQ_TSIZE_STS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CQ_TSIZE_STS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CQ_TSIZE_STS_4 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC0_QM1_CQ_CTL_STS_0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC0_QM1_CQ_CTL_STS_0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC0_QM1_CQ_CTL_STS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CQ_CTL_STS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CQ_CTL_STS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CQ_CTL_STS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CQ_CTL_STS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CQ_IFIFO_CNT_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CQ_IFIFO_CNT_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CQ_IFIFO_CNT_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CQ_IFIFO_CNT_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CQ_IFIFO_CNT_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_MSG_BASE0_ADDR_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_MSG_BASE0_ADDR_LO_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_MSG_BASE0_ADDR_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_MSG_BASE0_ADDR_LO_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_MSG_BASE0_ADDR_LO_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_MSG_BASE0_ADDR_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_MSG_BASE0_ADDR_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_MSG_BASE0_ADDR_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_MSG_BASE0_ADDR_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_MSG_BASE0_ADDR_HI_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_MSG_BASE1_ADDR_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_MSG_BASE1_ADDR_LO_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_MSG_BASE1_ADDR_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_MSG_BASE1_ADDR_LO_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_MSG_BASE1_ADDR_LO_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_MSG_BASE1_ADDR_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_MSG_BASE1_ADDR_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_MSG_BASE1_ADDR_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_MSG_BASE1_ADDR_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_MSG_BASE1_ADDR_HI_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_MSG_BASE2_ADDR_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_MSG_BASE2_ADDR_LO_1 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC0_QM1_CP_MSG_BASE2_ADDR_LO_2 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC0_QM1_CP_MSG_BASE2_ADDR_LO_2 & +PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC0_QM1_CP_MSG_BASE2_ADDR_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_MSG_BASE2_ADDR_LO_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_MSG_BASE2_ADDR_LO_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_MSG_BASE2_ADDR_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_MSG_BASE2_ADDR_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_MSG_BASE2_ADDR_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_MSG_BASE2_ADDR_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_MSG_BASE2_ADDR_HI_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_MSG_BASE3_ADDR_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_MSG_BASE3_ADDR_LO_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_MSG_BASE3_ADDR_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_MSG_BASE3_ADDR_LO_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_MSG_BASE3_ADDR_LO_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_MSG_BASE3_ADDR_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_MSG_BASE3_ADDR_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_MSG_BASE3_ADDR_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_MSG_BASE3_ADDR_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_MSG_BASE3_ADDR_HI_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_LDMA_TSIZE_OFFSET_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_LDMA_TSIZE_OFFSET_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_LDMA_TSIZE_OFFSET_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_LDMA_TSIZE_OFFSET_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_LDMA_TSIZE_OFFSET_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_LDMA_SRC_BASE_LO_OFFSET_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_LDMA_SRC_BASE_LO_OFFSET_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_LDMA_SRC_BASE_LO_OFFSET_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_LDMA_SRC_BASE_LO_OFFSET_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_LDMA_SRC_BASE_LO_OFFSET_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_LDMA_DST_BASE_LO_OFFSET_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_LDMA_DST_BASE_LO_OFFSET_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_LDMA_DST_BASE_LO_OFFSET_2 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC0_QM1_CP_LDMA_DST_BASE_LO_OFFSET_3 & ~0xFFF ) + +PROT_BITS_OFFS ; + word_offset = ((mmNIC0_QM1_CP_LDMA_DST_BASE_LO_OFFSET_3 & +PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC0_QM1_CP_LDMA_DST_BASE_LO_OFFSET_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_LDMA_DST_BASE_LO_OFFSET_4 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC0_QM1_CP_STS_0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC0_QM1_CP_STS_0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC0_QM1_CP_STS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_STS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_STS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_STS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_STS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_CURRENT_INST_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_CURRENT_INST_LO_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_CURRENT_INST_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_CURRENT_INST_LO_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_CURRENT_INST_LO_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_CURRENT_INST_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_CURRENT_INST_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_CURRENT_INST_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_CURRENT_INST_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_CURRENT_INST_HI_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_BARRIER_CFG_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_BARRIER_CFG_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_BARRIER_CFG_2 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC0_QM1_CP_BARRIER_CFG_3 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC0_QM1_CP_BARRIER_CFG_3 &PROT_BITS_OFFS ) + >>7 ) <<2 ; + mask =1U << ((mmNIC0_QM1_CP_BARRIER_CFG_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_BARRIER_CFG_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_DBG_0_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_DBG_0_1 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC0_QM1_CP_DBG_0_2 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC0_QM1_CP_DBG_0_2 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC0_QM1_CP_DBG_0_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_DBG_0_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_DBG_0_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_ARUSER_31_11_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_ARUSER_31_11_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_ARUSER_31_11_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_ARUSER_31_11_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_ARUSER_31_11_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_AWUSER_31_11_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_AWUSER_31_11_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_AWUSER_31_11_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_AWUSER_31_11_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CP_AWUSER_31_11_4 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC0_QM1_ARB_CFG_0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC0_QM1_ARB_CFG_0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC0_QM1_ARB_CFG_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_AVAIL_CRED_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_AVAIL_CRED_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_AVAIL_CRED_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_AVAIL_CRED_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_AVAIL_CRED_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_AVAIL_CRED_5 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_AVAIL_CRED_6 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_AVAIL_CRED_7 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_AVAIL_CRED_8 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_AVAIL_CRED_9 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_AVAIL_CRED_10 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_AVAIL_CRED_11 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_AVAIL_CRED_12 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_AVAIL_CRED_13 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_AVAIL_CRED_14 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_AVAIL_CRED_15 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_AVAIL_CRED_16 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_AVAIL_CRED_17 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_AVAIL_CRED_18 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_AVAIL_CRED_19 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_AVAIL_CRED_20 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_AVAIL_CRED_21 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_AVAIL_CRED_22 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_AVAIL_CRED_23 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC0_QM1_ARB_MST_AVAIL_CRED_24 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC0_QM1_ARB_MST_AVAIL_CRED_24 & +PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC0_QM1_ARB_MST_AVAIL_CRED_24 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_AVAIL_CRED_25 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_AVAIL_CRED_26 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_AVAIL_CRED_27 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_AVAIL_CRED_28 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_AVAIL_CRED_29 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_AVAIL_CRED_30 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_AVAIL_CRED_31 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC0_QM1_ARB_MST_CHOISE_PUSH_OFST_23 & ~0xFFF ) + +PROT_BITS_OFFS ; + word_offset = ((mmNIC0_QM1_ARB_MST_CHOISE_PUSH_OFST_23 & +PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC0_QM1_ARB_SLV_CHOISE_WDT &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MSG_MAX_INFLIGHT &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MSG_AWUSER_31_11 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MSG_AWUSER_SEC_PROP &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MSG_AWUSER_NON_SEC_PROP &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC0_QM1_ARB_STATE_STS & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC0_QM1_ARB_STATE_STS &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC0_QM1_ARB_STATE_STS &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_CHOISE_FULLNESS_STS &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MSG_STS &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_SLV_CHOISE_Q_HEAD &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_ERR_CAUSE &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_ERR_MSG_EN &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_ERR_STS_DRP &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_CRED_STS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_CRED_STS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_CRED_STS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_CRED_STS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_CRED_STS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_CRED_STS_5 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_CRED_STS_6 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_CRED_STS_7 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_CRED_STS_8 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_CRED_STS_9 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_CRED_STS_10 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_CRED_STS_11 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_CRED_STS_12 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_CRED_STS_13 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_CRED_STS_14 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_CRED_STS_15 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_CRED_STS_16 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_CRED_STS_17 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_CRED_STS_18 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_CRED_STS_19 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC0_QM1_ARB_MST_CRED_STS_20 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC0_QM1_ARB_MST_CRED_STS_20 &PROT_BITS_OFFS ) + >>7 ) <<2 ; + mask =1U << ((mmNIC0_QM1_ARB_MST_CRED_STS_20 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_CRED_STS_21 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_CRED_STS_22 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_CRED_STS_23 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_CRED_STS_24 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_CRED_STS_25 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_CRED_STS_26 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_CRED_STS_27 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_CRED_STS_28 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_CRED_STS_29 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_CRED_STS_30 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_ARB_MST_CRED_STS_31 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CGM_CFG &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CGM_STS &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CGM_CFG1 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC0_QM1_LOCAL_RANGE_BASE & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC0_QM1_LOCAL_RANGE_BASE &PROT_BITS_OFFS ) + >>7 ) <<2 ; + mask =1U << ((mmNIC0_QM1_LOCAL_RANGE_BASE &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_LOCAL_RANGE_SIZE &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_CSMR_STRICT_PRIO_CFG &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_HBW_RD_RATE_LIM_CFG_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_LBW_WR_RATE_LIM_CFG_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_LBW_WR_RATE_LIM_CFG_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_HBW_RD_RATE_LIM_CFG_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_GLBL_AXCACHE &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_IND_GW_APB_CFG &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_IND_GW_APB_WDATA &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_IND_GW_APB_RDATA &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_IND_GW_APB_STATUS &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_GLBL_ERR_ADDR_LO &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_GLBL_ERR_ADDR_HI &0x7F ) >>2 ); + mask |=1U << ((mmNIC0_QM1_GLBL_ERR_WDATA &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC0_QM1_GLBL_MEM_INIT_BUSY & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC0_QM1_GLBL_MEM_INIT_BUSY &PROT_BITS_OFFS ) + >>7 ) <<2 ; + mask =1U << ((mmNIC0_QM1_GLBL_MEM_INIT_BUSY &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + +WREG32 (mmNIC1_QM0_BASE -CFG_BASE +PROT_BITS_OFFS +0x7C ,0 ); +WREG32 (mmNIC1_QM1_BASE -CFG_BASE +PROT_BITS_OFFS +0x7C ,0 ); + + pb_addr = (mmNIC1_QM0_GLBL_CFG0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC1_QM0_GLBL_CFG0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC1_QM0_GLBL_CFG0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_GLBL_CFG1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_GLBL_PROT &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_GLBL_ERR_CFG &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_GLBL_SECURE_PROPS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_GLBL_SECURE_PROPS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_GLBL_SECURE_PROPS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_GLBL_SECURE_PROPS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_GLBL_SECURE_PROPS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_GLBL_NON_SECURE_PROPS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_GLBL_NON_SECURE_PROPS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_GLBL_NON_SECURE_PROPS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_GLBL_NON_SECURE_PROPS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_GLBL_NON_SECURE_PROPS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_GLBL_STS0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_GLBL_STS1_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_GLBL_STS1_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_GLBL_STS1_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_GLBL_STS1_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_GLBL_STS1_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_GLBL_MSG_EN_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_GLBL_MSG_EN_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_GLBL_MSG_EN_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_GLBL_MSG_EN_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_GLBL_MSG_EN_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_PQ_BASE_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_PQ_BASE_LO_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_PQ_BASE_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_PQ_BASE_LO_3 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC1_QM0_PQ_BASE_HI_0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC1_QM0_PQ_BASE_HI_0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC1_QM0_PQ_BASE_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_PQ_BASE_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_PQ_BASE_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_PQ_BASE_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_PQ_SIZE_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_PQ_SIZE_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_PQ_SIZE_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_PQ_SIZE_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_PQ_PI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_PQ_PI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_PQ_PI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_PQ_PI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_PQ_CI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_PQ_CI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_PQ_CI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_PQ_CI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_PQ_CFG0_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_PQ_CFG0_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_PQ_CFG0_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_PQ_CFG0_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_PQ_CFG1_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_PQ_CFG1_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_PQ_CFG1_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_PQ_CFG1_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_PQ_ARUSER_31_11_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_PQ_ARUSER_31_11_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_PQ_ARUSER_31_11_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_PQ_ARUSER_31_11_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_PQ_STS0_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_PQ_STS0_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_PQ_STS0_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_PQ_STS0_3 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC1_QM0_PQ_STS1_0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC1_QM0_PQ_STS1_0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC1_QM0_PQ_STS1_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_PQ_STS1_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_PQ_STS1_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_PQ_STS1_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CQ_STS0_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CQ_STS0_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CQ_STS0_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CQ_STS0_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CQ_STS1_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CQ_STS1_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CQ_STS1_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CQ_STS1_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CQ_PTR_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CQ_PTR_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CQ_TSIZE_0 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC1_QM0_CQ_CTL_0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC1_QM0_CQ_CTL_0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC1_QM0_CQ_CTL_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CQ_PTR_LO_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CQ_PTR_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CQ_TSIZE_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CQ_CTL_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CQ_PTR_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CQ_PTR_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CQ_TSIZE_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CQ_CTL_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CQ_PTR_LO_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CQ_PTR_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CQ_TSIZE_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CQ_CTL_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CQ_PTR_LO_STS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CQ_PTR_LO_STS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CQ_PTR_LO_STS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CQ_PTR_LO_STS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CQ_PTR_LO_STS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CQ_PTR_HI_STS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CQ_PTR_HI_STS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CQ_PTR_HI_STS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CQ_PTR_HI_STS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CQ_PTR_HI_STS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CQ_TSIZE_STS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CQ_TSIZE_STS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CQ_TSIZE_STS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CQ_TSIZE_STS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CQ_TSIZE_STS_4 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC1_QM0_CQ_CTL_STS_0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC1_QM0_CQ_CTL_STS_0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC1_QM0_CQ_CTL_STS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CQ_CTL_STS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CQ_CTL_STS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CQ_CTL_STS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CQ_CTL_STS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CQ_IFIFO_CNT_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CQ_IFIFO_CNT_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CQ_IFIFO_CNT_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CQ_IFIFO_CNT_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CQ_IFIFO_CNT_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_MSG_BASE0_ADDR_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_MSG_BASE0_ADDR_LO_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_MSG_BASE0_ADDR_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_MSG_BASE0_ADDR_LO_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_MSG_BASE0_ADDR_LO_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_MSG_BASE0_ADDR_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_MSG_BASE0_ADDR_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_MSG_BASE0_ADDR_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_MSG_BASE0_ADDR_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_MSG_BASE0_ADDR_HI_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_MSG_BASE1_ADDR_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_MSG_BASE1_ADDR_LO_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_MSG_BASE1_ADDR_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_MSG_BASE1_ADDR_LO_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_MSG_BASE1_ADDR_LO_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_MSG_BASE1_ADDR_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_MSG_BASE1_ADDR_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_MSG_BASE1_ADDR_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_MSG_BASE1_ADDR_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_MSG_BASE1_ADDR_HI_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_MSG_BASE2_ADDR_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_MSG_BASE2_ADDR_LO_1 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC1_QM0_CP_MSG_BASE2_ADDR_LO_2 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC1_QM0_CP_MSG_BASE2_ADDR_LO_2 & +PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC1_QM0_CP_MSG_BASE2_ADDR_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_MSG_BASE2_ADDR_LO_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_MSG_BASE2_ADDR_LO_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_MSG_BASE2_ADDR_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_MSG_BASE2_ADDR_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_MSG_BASE2_ADDR_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_MSG_BASE2_ADDR_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_MSG_BASE2_ADDR_HI_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_MSG_BASE3_ADDR_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_MSG_BASE3_ADDR_LO_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_MSG_BASE3_ADDR_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_MSG_BASE3_ADDR_LO_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_MSG_BASE3_ADDR_LO_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_MSG_BASE3_ADDR_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_MSG_BASE3_ADDR_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_MSG_BASE3_ADDR_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_MSG_BASE3_ADDR_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_MSG_BASE3_ADDR_HI_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_LDMA_TSIZE_OFFSET_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_LDMA_TSIZE_OFFSET_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_LDMA_TSIZE_OFFSET_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_LDMA_TSIZE_OFFSET_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_LDMA_TSIZE_OFFSET_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_LDMA_SRC_BASE_LO_OFFSET_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_LDMA_SRC_BASE_LO_OFFSET_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_LDMA_SRC_BASE_LO_OFFSET_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_LDMA_SRC_BASE_LO_OFFSET_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_LDMA_SRC_BASE_LO_OFFSET_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_LDMA_DST_BASE_LO_OFFSET_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_LDMA_DST_BASE_LO_OFFSET_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_LDMA_DST_BASE_LO_OFFSET_2 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC1_QM0_CP_LDMA_DST_BASE_LO_OFFSET_3 & ~0xFFF ) + +PROT_BITS_OFFS ; + word_offset = ((mmNIC1_QM0_CP_LDMA_DST_BASE_LO_OFFSET_3 & +PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC1_QM0_CP_LDMA_DST_BASE_LO_OFFSET_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_LDMA_DST_BASE_LO_OFFSET_4 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC1_QM0_CP_STS_0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC1_QM0_CP_STS_0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC1_QM0_CP_STS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_STS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_STS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_STS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_STS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_CURRENT_INST_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_CURRENT_INST_LO_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_CURRENT_INST_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_CURRENT_INST_LO_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_CURRENT_INST_LO_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_CURRENT_INST_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_CURRENT_INST_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_CURRENT_INST_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_CURRENT_INST_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_CURRENT_INST_HI_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_BARRIER_CFG_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_BARRIER_CFG_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_BARRIER_CFG_2 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC1_QM0_CP_BARRIER_CFG_3 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC1_QM0_CP_BARRIER_CFG_3 &PROT_BITS_OFFS ) + >>7 ) <<2 ; + mask =1U << ((mmNIC1_QM0_CP_BARRIER_CFG_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_BARRIER_CFG_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_DBG_0_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_DBG_0_1 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC1_QM0_CP_DBG_0_2 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC1_QM0_CP_DBG_0_2 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC1_QM0_CP_DBG_0_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_DBG_0_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_DBG_0_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_ARUSER_31_11_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_ARUSER_31_11_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_ARUSER_31_11_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_ARUSER_31_11_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_ARUSER_31_11_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_AWUSER_31_11_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_AWUSER_31_11_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_AWUSER_31_11_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_AWUSER_31_11_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CP_AWUSER_31_11_4 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC1_QM0_ARB_CFG_0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC1_QM0_ARB_CFG_0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC1_QM0_ARB_CFG_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_AVAIL_CRED_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_AVAIL_CRED_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_AVAIL_CRED_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_AVAIL_CRED_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_AVAIL_CRED_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_AVAIL_CRED_5 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_AVAIL_CRED_6 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_AVAIL_CRED_7 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_AVAIL_CRED_8 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_AVAIL_CRED_9 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_AVAIL_CRED_10 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_AVAIL_CRED_11 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_AVAIL_CRED_12 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_AVAIL_CRED_13 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_AVAIL_CRED_14 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_AVAIL_CRED_15 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_AVAIL_CRED_16 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_AVAIL_CRED_17 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_AVAIL_CRED_18 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_AVAIL_CRED_19 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_AVAIL_CRED_20 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_AVAIL_CRED_21 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_AVAIL_CRED_22 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_AVAIL_CRED_23 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC1_QM0_ARB_MST_AVAIL_CRED_24 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC1_QM0_ARB_MST_AVAIL_CRED_24 & +PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC1_QM0_ARB_MST_AVAIL_CRED_24 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_AVAIL_CRED_25 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_AVAIL_CRED_26 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_AVAIL_CRED_27 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_AVAIL_CRED_28 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_AVAIL_CRED_29 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_AVAIL_CRED_30 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_AVAIL_CRED_31 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC1_QM0_ARB_MST_CHOISE_PUSH_OFST_23 & ~0xFFF ) + +PROT_BITS_OFFS ; + word_offset = ((mmNIC1_QM0_ARB_MST_CHOISE_PUSH_OFST_23 & +PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC1_QM0_ARB_SLV_CHOISE_WDT &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MSG_MAX_INFLIGHT &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MSG_AWUSER_31_11 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MSG_AWUSER_SEC_PROP &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MSG_AWUSER_NON_SEC_PROP &0x7F ) >>2 ); +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC1_QM0_ARB_STATE_STS & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC1_QM0_ARB_STATE_STS &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC1_QM0_ARB_STATE_STS &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_CHOISE_FULLNESS_STS &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MSG_STS &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_SLV_CHOISE_Q_HEAD &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_ERR_CAUSE &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_ERR_MSG_EN &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_ERR_STS_DRP &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_CRED_STS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_CRED_STS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_CRED_STS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_CRED_STS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_CRED_STS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_CRED_STS_5 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_CRED_STS_6 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_CRED_STS_7 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_CRED_STS_8 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_CRED_STS_9 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_CRED_STS_10 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_CRED_STS_11 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_CRED_STS_12 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_CRED_STS_13 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_CRED_STS_14 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_CRED_STS_15 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_CRED_STS_16 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_CRED_STS_17 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_CRED_STS_18 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_CRED_STS_19 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC1_QM0_ARB_MST_CRED_STS_20 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC1_QM0_ARB_MST_CRED_STS_20 &PROT_BITS_OFFS ) + >>7 ) <<2 ; + mask =1U << ((mmNIC1_QM0_ARB_MST_CRED_STS_20 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_CRED_STS_21 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_CRED_STS_22 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_CRED_STS_23 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_CRED_STS_24 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_CRED_STS_25 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_CRED_STS_26 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_CRED_STS_27 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_CRED_STS_28 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_CRED_STS_29 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_CRED_STS_30 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_ARB_MST_CRED_STS_31 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CGM_CFG &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CGM_STS &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CGM_CFG1 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC1_QM0_LOCAL_RANGE_BASE & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC1_QM0_LOCAL_RANGE_BASE &PROT_BITS_OFFS ) + >>7 ) <<2 ; + mask =1U << ((mmNIC1_QM0_LOCAL_RANGE_BASE &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_LOCAL_RANGE_SIZE &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_CSMR_STRICT_PRIO_CFG &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_HBW_RD_RATE_LIM_CFG_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_LBW_WR_RATE_LIM_CFG_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_LBW_WR_RATE_LIM_CFG_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_HBW_RD_RATE_LIM_CFG_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_GLBL_AXCACHE &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_IND_GW_APB_CFG &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_IND_GW_APB_WDATA &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_IND_GW_APB_RDATA &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_IND_GW_APB_STATUS &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_GLBL_ERR_ADDR_LO &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_GLBL_ERR_ADDR_HI &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM0_GLBL_ERR_WDATA &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC1_QM0_GLBL_MEM_INIT_BUSY & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC1_QM0_GLBL_MEM_INIT_BUSY &PROT_BITS_OFFS ) + >>7 ) <<2 ; + mask =1U << ((mmNIC1_QM0_GLBL_MEM_INIT_BUSY &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC1_QM1_GLBL_CFG0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC1_QM1_GLBL_CFG0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC1_QM1_GLBL_CFG0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_GLBL_CFG1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_GLBL_PROT &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_GLBL_ERR_CFG &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_GLBL_SECURE_PROPS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_GLBL_SECURE_PROPS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_GLBL_SECURE_PROPS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_GLBL_SECURE_PROPS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_GLBL_SECURE_PROPS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_GLBL_NON_SECURE_PROPS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_GLBL_NON_SECURE_PROPS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_GLBL_NON_SECURE_PROPS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_GLBL_NON_SECURE_PROPS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_GLBL_NON_SECURE_PROPS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_GLBL_STS0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_GLBL_STS1_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_GLBL_STS1_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_GLBL_STS1_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_GLBL_STS1_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_GLBL_STS1_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_GLBL_MSG_EN_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_GLBL_MSG_EN_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_GLBL_MSG_EN_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_GLBL_MSG_EN_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_GLBL_MSG_EN_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_PQ_BASE_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_PQ_BASE_LO_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_PQ_BASE_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_PQ_BASE_LO_3 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC1_QM1_PQ_BASE_HI_0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC1_QM1_PQ_BASE_HI_0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC1_QM1_PQ_BASE_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_PQ_BASE_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_PQ_BASE_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_PQ_BASE_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_PQ_SIZE_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_PQ_SIZE_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_PQ_SIZE_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_PQ_SIZE_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_PQ_PI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_PQ_PI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_PQ_PI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_PQ_PI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_PQ_CI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_PQ_CI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_PQ_CI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_PQ_CI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_PQ_CFG0_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_PQ_CFG0_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_PQ_CFG0_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_PQ_CFG0_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_PQ_CFG1_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_PQ_CFG1_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_PQ_CFG1_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_PQ_CFG1_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_PQ_ARUSER_31_11_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_PQ_ARUSER_31_11_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_PQ_ARUSER_31_11_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_PQ_ARUSER_31_11_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_PQ_STS0_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_PQ_STS0_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_PQ_STS0_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_PQ_STS0_3 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC1_QM1_PQ_STS1_0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC1_QM1_PQ_STS1_0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC1_QM1_PQ_STS1_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_PQ_STS1_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_PQ_STS1_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_PQ_STS1_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CQ_STS0_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CQ_STS0_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CQ_STS0_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CQ_STS0_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CQ_STS1_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CQ_STS1_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CQ_STS1_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CQ_STS1_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CQ_PTR_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CQ_PTR_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CQ_TSIZE_0 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC1_QM1_CQ_CTL_0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC1_QM1_CQ_CTL_0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC1_QM1_CQ_CTL_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CQ_PTR_LO_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CQ_PTR_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CQ_TSIZE_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CQ_CTL_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CQ_PTR_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CQ_PTR_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CQ_TSIZE_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CQ_CTL_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CQ_PTR_LO_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CQ_PTR_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CQ_TSIZE_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CQ_CTL_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CQ_PTR_LO_STS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CQ_PTR_LO_STS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CQ_PTR_LO_STS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CQ_PTR_LO_STS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CQ_PTR_LO_STS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CQ_PTR_HI_STS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CQ_PTR_HI_STS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CQ_PTR_HI_STS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CQ_PTR_HI_STS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CQ_PTR_HI_STS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CQ_TSIZE_STS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CQ_TSIZE_STS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CQ_TSIZE_STS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CQ_TSIZE_STS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CQ_TSIZE_STS_4 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC1_QM1_CQ_CTL_STS_0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC1_QM1_CQ_CTL_STS_0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC1_QM1_CQ_CTL_STS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CQ_CTL_STS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CQ_CTL_STS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CQ_CTL_STS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CQ_CTL_STS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CQ_IFIFO_CNT_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CQ_IFIFO_CNT_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CQ_IFIFO_CNT_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CQ_IFIFO_CNT_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CQ_IFIFO_CNT_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_MSG_BASE0_ADDR_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_MSG_BASE0_ADDR_LO_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_MSG_BASE0_ADDR_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_MSG_BASE0_ADDR_LO_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_MSG_BASE0_ADDR_LO_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_MSG_BASE0_ADDR_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_MSG_BASE0_ADDR_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_MSG_BASE0_ADDR_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_MSG_BASE0_ADDR_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_MSG_BASE0_ADDR_HI_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_MSG_BASE1_ADDR_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_MSG_BASE1_ADDR_LO_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_MSG_BASE1_ADDR_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_MSG_BASE1_ADDR_LO_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_MSG_BASE1_ADDR_LO_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_MSG_BASE1_ADDR_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_MSG_BASE1_ADDR_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_MSG_BASE1_ADDR_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_MSG_BASE1_ADDR_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_MSG_BASE1_ADDR_HI_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_MSG_BASE2_ADDR_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_MSG_BASE2_ADDR_LO_1 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC1_QM1_CP_MSG_BASE2_ADDR_LO_2 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC1_QM1_CP_MSG_BASE2_ADDR_LO_2 & +PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC1_QM1_CP_MSG_BASE2_ADDR_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_MSG_BASE2_ADDR_LO_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_MSG_BASE2_ADDR_LO_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_MSG_BASE2_ADDR_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_MSG_BASE2_ADDR_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_MSG_BASE2_ADDR_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_MSG_BASE2_ADDR_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_MSG_BASE2_ADDR_HI_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_MSG_BASE3_ADDR_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_MSG_BASE3_ADDR_LO_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_MSG_BASE3_ADDR_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_MSG_BASE3_ADDR_LO_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_MSG_BASE3_ADDR_LO_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_MSG_BASE3_ADDR_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_MSG_BASE3_ADDR_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_MSG_BASE3_ADDR_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_MSG_BASE3_ADDR_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_MSG_BASE3_ADDR_HI_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_LDMA_TSIZE_OFFSET_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_LDMA_TSIZE_OFFSET_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_LDMA_TSIZE_OFFSET_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_LDMA_TSIZE_OFFSET_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_LDMA_TSIZE_OFFSET_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_LDMA_SRC_BASE_LO_OFFSET_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_LDMA_SRC_BASE_LO_OFFSET_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_LDMA_SRC_BASE_LO_OFFSET_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_LDMA_SRC_BASE_LO_OFFSET_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_LDMA_SRC_BASE_LO_OFFSET_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_LDMA_DST_BASE_LO_OFFSET_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_LDMA_DST_BASE_LO_OFFSET_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_LDMA_DST_BASE_LO_OFFSET_2 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC1_QM1_CP_LDMA_DST_BASE_LO_OFFSET_3 & ~0xFFF ) + +PROT_BITS_OFFS ; + word_offset = ((mmNIC1_QM1_CP_LDMA_DST_BASE_LO_OFFSET_3 & +PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC1_QM1_CP_LDMA_DST_BASE_LO_OFFSET_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_LDMA_DST_BASE_LO_OFFSET_4 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC1_QM1_CP_STS_0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC1_QM1_CP_STS_0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC1_QM1_CP_STS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_STS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_STS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_STS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_STS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_CURRENT_INST_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_CURRENT_INST_LO_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_CURRENT_INST_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_CURRENT_INST_LO_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_CURRENT_INST_LO_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_CURRENT_INST_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_CURRENT_INST_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_CURRENT_INST_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_CURRENT_INST_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_CURRENT_INST_HI_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_BARRIER_CFG_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_BARRIER_CFG_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_BARRIER_CFG_2 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC1_QM1_CP_BARRIER_CFG_3 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC1_QM1_CP_BARRIER_CFG_3 &PROT_BITS_OFFS ) + >>7 ) <<2 ; + mask =1U << ((mmNIC1_QM1_CP_BARRIER_CFG_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_BARRIER_CFG_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_DBG_0_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_DBG_0_1 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC1_QM1_CP_DBG_0_2 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC1_QM1_CP_DBG_0_2 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC1_QM1_CP_DBG_0_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_DBG_0_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_DBG_0_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_ARUSER_31_11_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_ARUSER_31_11_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_ARUSER_31_11_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_ARUSER_31_11_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_ARUSER_31_11_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_AWUSER_31_11_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_AWUSER_31_11_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_AWUSER_31_11_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_AWUSER_31_11_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CP_AWUSER_31_11_4 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC1_QM1_ARB_CFG_0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC1_QM1_ARB_CFG_0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC1_QM1_ARB_CFG_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_AVAIL_CRED_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_AVAIL_CRED_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_AVAIL_CRED_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_AVAIL_CRED_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_AVAIL_CRED_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_AVAIL_CRED_5 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_AVAIL_CRED_6 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_AVAIL_CRED_7 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_AVAIL_CRED_8 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_AVAIL_CRED_9 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_AVAIL_CRED_10 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_AVAIL_CRED_11 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_AVAIL_CRED_12 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_AVAIL_CRED_13 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_AVAIL_CRED_14 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_AVAIL_CRED_15 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_AVAIL_CRED_16 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_AVAIL_CRED_17 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_AVAIL_CRED_18 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_AVAIL_CRED_19 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_AVAIL_CRED_20 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_AVAIL_CRED_21 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_AVAIL_CRED_22 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_AVAIL_CRED_23 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC1_QM1_ARB_MST_AVAIL_CRED_24 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC1_QM1_ARB_MST_AVAIL_CRED_24 & +PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC1_QM1_ARB_MST_AVAIL_CRED_24 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_AVAIL_CRED_25 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_AVAIL_CRED_26 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_AVAIL_CRED_27 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_AVAIL_CRED_28 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_AVAIL_CRED_29 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_AVAIL_CRED_30 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_AVAIL_CRED_31 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC1_QM1_ARB_MST_CHOISE_PUSH_OFST_23 & ~0xFFF ) + +PROT_BITS_OFFS ; + word_offset = ((mmNIC1_QM1_ARB_MST_CHOISE_PUSH_OFST_23 & +PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC1_QM1_ARB_SLV_CHOISE_WDT &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MSG_MAX_INFLIGHT &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MSG_AWUSER_31_11 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MSG_AWUSER_SEC_PROP &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MSG_AWUSER_NON_SEC_PROP &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC1_QM1_ARB_STATE_STS & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC1_QM1_ARB_STATE_STS &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC1_QM1_ARB_STATE_STS &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_CHOISE_FULLNESS_STS &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MSG_STS &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_SLV_CHOISE_Q_HEAD &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_ERR_CAUSE &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_ERR_MSG_EN &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_ERR_STS_DRP &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_CRED_STS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_CRED_STS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_CRED_STS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_CRED_STS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_CRED_STS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_CRED_STS_5 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_CRED_STS_6 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_CRED_STS_7 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_CRED_STS_8 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_CRED_STS_9 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_CRED_STS_10 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_CRED_STS_11 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_CRED_STS_12 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_CRED_STS_13 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_CRED_STS_14 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_CRED_STS_15 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_CRED_STS_16 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_CRED_STS_17 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_CRED_STS_18 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_CRED_STS_19 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC1_QM1_ARB_MST_CRED_STS_20 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC1_QM1_ARB_MST_CRED_STS_20 &PROT_BITS_OFFS ) + >>7 ) <<2 ; + mask =1U << ((mmNIC1_QM1_ARB_MST_CRED_STS_20 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_CRED_STS_21 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_CRED_STS_22 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_CRED_STS_23 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_CRED_STS_24 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_CRED_STS_25 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_CRED_STS_26 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_CRED_STS_27 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_CRED_STS_28 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_CRED_STS_29 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_CRED_STS_30 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_ARB_MST_CRED_STS_31 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CGM_CFG &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CGM_STS &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CGM_CFG1 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC1_QM1_LOCAL_RANGE_BASE & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC1_QM1_LOCAL_RANGE_BASE &PROT_BITS_OFFS ) + >>7 ) <<2 ; + mask =1U << ((mmNIC1_QM1_LOCAL_RANGE_BASE &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_LOCAL_RANGE_SIZE &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_CSMR_STRICT_PRIO_CFG &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_HBW_RD_RATE_LIM_CFG_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_LBW_WR_RATE_LIM_CFG_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_LBW_WR_RATE_LIM_CFG_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_HBW_RD_RATE_LIM_CFG_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_GLBL_AXCACHE &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_IND_GW_APB_CFG &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_IND_GW_APB_WDATA &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_IND_GW_APB_RDATA &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_IND_GW_APB_STATUS &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_GLBL_ERR_ADDR_LO &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_GLBL_ERR_ADDR_HI &0x7F ) >>2 ); + mask |=1U << ((mmNIC1_QM1_GLBL_ERR_WDATA &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC1_QM1_GLBL_MEM_INIT_BUSY & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC1_QM1_GLBL_MEM_INIT_BUSY &PROT_BITS_OFFS ) + >>7 ) <<2 ; + mask =1U << ((mmNIC1_QM1_GLBL_MEM_INIT_BUSY &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + +WREG32 (mmNIC2_QM0_BASE -CFG_BASE +PROT_BITS_OFFS +0x7C ,0 ); +WREG32 (mmNIC2_QM1_BASE -CFG_BASE +PROT_BITS_OFFS +0x7C ,0 ); + + pb_addr = (mmNIC2_QM0_GLBL_CFG0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC2_QM0_GLBL_CFG0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC2_QM0_GLBL_CFG0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_GLBL_CFG1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_GLBL_PROT &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_GLBL_ERR_CFG &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_GLBL_SECURE_PROPS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_GLBL_SECURE_PROPS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_GLBL_SECURE_PROPS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_GLBL_SECURE_PROPS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_GLBL_SECURE_PROPS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_GLBL_NON_SECURE_PROPS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_GLBL_NON_SECURE_PROPS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_GLBL_NON_SECURE_PROPS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_GLBL_NON_SECURE_PROPS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_GLBL_NON_SECURE_PROPS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_GLBL_STS0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_GLBL_STS1_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_GLBL_STS1_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_GLBL_STS1_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_GLBL_STS1_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_GLBL_STS1_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_GLBL_MSG_EN_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_GLBL_MSG_EN_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_GLBL_MSG_EN_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_GLBL_MSG_EN_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_GLBL_MSG_EN_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_PQ_BASE_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_PQ_BASE_LO_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_PQ_BASE_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_PQ_BASE_LO_3 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC2_QM0_PQ_BASE_HI_0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC2_QM0_PQ_BASE_HI_0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC2_QM0_PQ_BASE_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_PQ_BASE_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_PQ_BASE_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_PQ_BASE_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_PQ_SIZE_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_PQ_SIZE_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_PQ_SIZE_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_PQ_SIZE_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_PQ_PI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_PQ_PI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_PQ_PI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_PQ_PI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_PQ_CI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_PQ_CI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_PQ_CI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_PQ_CI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_PQ_CFG0_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_PQ_CFG0_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_PQ_CFG0_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_PQ_CFG0_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_PQ_CFG1_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_PQ_CFG1_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_PQ_CFG1_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_PQ_CFG1_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_PQ_ARUSER_31_11_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_PQ_ARUSER_31_11_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_PQ_ARUSER_31_11_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_PQ_ARUSER_31_11_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_PQ_STS0_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_PQ_STS0_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_PQ_STS0_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_PQ_STS0_3 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC2_QM0_PQ_STS1_0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC2_QM0_PQ_STS1_0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC2_QM0_PQ_STS1_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_PQ_STS1_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_PQ_STS1_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_PQ_STS1_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CQ_STS0_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CQ_STS0_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CQ_STS0_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CQ_STS0_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CQ_STS1_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CQ_STS1_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CQ_STS1_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CQ_STS1_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CQ_PTR_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CQ_PTR_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CQ_TSIZE_0 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC2_QM0_CQ_CTL_0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC2_QM0_CQ_CTL_0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC2_QM0_CQ_CTL_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CQ_PTR_LO_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CQ_PTR_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CQ_TSIZE_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CQ_CTL_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CQ_PTR_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CQ_PTR_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CQ_TSIZE_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CQ_CTL_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CQ_PTR_LO_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CQ_PTR_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CQ_TSIZE_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CQ_CTL_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CQ_PTR_LO_STS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CQ_PTR_LO_STS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CQ_PTR_LO_STS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CQ_PTR_LO_STS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CQ_PTR_LO_STS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CQ_PTR_HI_STS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CQ_PTR_HI_STS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CQ_PTR_HI_STS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CQ_PTR_HI_STS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CQ_PTR_HI_STS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CQ_TSIZE_STS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CQ_TSIZE_STS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CQ_TSIZE_STS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CQ_TSIZE_STS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CQ_TSIZE_STS_4 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC2_QM0_CQ_CTL_STS_0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC2_QM0_CQ_CTL_STS_0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC2_QM0_CQ_CTL_STS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CQ_CTL_STS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CQ_CTL_STS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CQ_CTL_STS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CQ_CTL_STS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CQ_IFIFO_CNT_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CQ_IFIFO_CNT_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CQ_IFIFO_CNT_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CQ_IFIFO_CNT_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CQ_IFIFO_CNT_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_MSG_BASE0_ADDR_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_MSG_BASE0_ADDR_LO_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_MSG_BASE0_ADDR_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_MSG_BASE0_ADDR_LO_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_MSG_BASE0_ADDR_LO_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_MSG_BASE0_ADDR_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_MSG_BASE0_ADDR_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_MSG_BASE0_ADDR_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_MSG_BASE0_ADDR_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_MSG_BASE0_ADDR_HI_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_MSG_BASE1_ADDR_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_MSG_BASE1_ADDR_LO_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_MSG_BASE1_ADDR_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_MSG_BASE1_ADDR_LO_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_MSG_BASE1_ADDR_LO_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_MSG_BASE1_ADDR_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_MSG_BASE1_ADDR_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_MSG_BASE1_ADDR_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_MSG_BASE1_ADDR_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_MSG_BASE1_ADDR_HI_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_MSG_BASE2_ADDR_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_MSG_BASE2_ADDR_LO_1 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC2_QM0_CP_MSG_BASE2_ADDR_LO_2 & ~0xFFF ) + +PROT_BITS_OFFS ; + word_offset = ((mmNIC2_QM0_CP_MSG_BASE2_ADDR_LO_2 &PROT_BITS_OFFS ) + >>7 ) <<2 ; + mask =1U << ((mmNIC2_QM0_CP_MSG_BASE2_ADDR_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_MSG_BASE2_ADDR_LO_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_MSG_BASE2_ADDR_LO_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_MSG_BASE2_ADDR_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_MSG_BASE2_ADDR_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_MSG_BASE2_ADDR_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_MSG_BASE2_ADDR_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_MSG_BASE2_ADDR_HI_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_MSG_BASE3_ADDR_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_MSG_BASE3_ADDR_LO_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_MSG_BASE3_ADDR_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_MSG_BASE3_ADDR_LO_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_MSG_BASE3_ADDR_LO_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_MSG_BASE3_ADDR_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_MSG_BASE3_ADDR_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_MSG_BASE3_ADDR_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_MSG_BASE3_ADDR_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_MSG_BASE3_ADDR_HI_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_LDMA_TSIZE_OFFSET_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_LDMA_TSIZE_OFFSET_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_LDMA_TSIZE_OFFSET_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_LDMA_TSIZE_OFFSET_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_LDMA_TSIZE_OFFSET_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_LDMA_SRC_BASE_LO_OFFSET_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_LDMA_SRC_BASE_LO_OFFSET_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_LDMA_SRC_BASE_LO_OFFSET_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_LDMA_SRC_BASE_LO_OFFSET_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_LDMA_SRC_BASE_LO_OFFSET_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_LDMA_DST_BASE_LO_OFFSET_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_LDMA_DST_BASE_LO_OFFSET_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_LDMA_DST_BASE_LO_OFFSET_2 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC2_QM0_CP_LDMA_DST_BASE_LO_OFFSET_3 & ~0xFFF ) + +PROT_BITS_OFFS ; + word_offset = ((mmNIC2_QM0_CP_LDMA_DST_BASE_LO_OFFSET_3 & +PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC2_QM0_CP_LDMA_DST_BASE_LO_OFFSET_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_LDMA_DST_BASE_LO_OFFSET_4 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC2_QM0_CP_STS_0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC2_QM0_CP_STS_0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC2_QM0_CP_STS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_STS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_STS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_STS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_STS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_CURRENT_INST_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_CURRENT_INST_LO_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_CURRENT_INST_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_CURRENT_INST_LO_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_CURRENT_INST_LO_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_CURRENT_INST_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_CURRENT_INST_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_CURRENT_INST_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_CURRENT_INST_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_CURRENT_INST_HI_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_BARRIER_CFG_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_BARRIER_CFG_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_BARRIER_CFG_2 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC2_QM0_CP_BARRIER_CFG_3 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC2_QM0_CP_BARRIER_CFG_3 &PROT_BITS_OFFS ) + >>7 ) <<2 ; + mask =1U << ((mmNIC2_QM0_CP_BARRIER_CFG_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_BARRIER_CFG_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_DBG_0_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_DBG_0_1 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC2_QM0_CP_DBG_0_2 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC2_QM0_CP_DBG_0_2 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC2_QM0_CP_DBG_0_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_DBG_0_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_DBG_0_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_ARUSER_31_11_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_ARUSER_31_11_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_ARUSER_31_11_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_ARUSER_31_11_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_ARUSER_31_11_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_AWUSER_31_11_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_AWUSER_31_11_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_AWUSER_31_11_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_AWUSER_31_11_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CP_AWUSER_31_11_4 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC2_QM0_ARB_CFG_0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC2_QM0_ARB_CFG_0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC2_QM0_ARB_CFG_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_AVAIL_CRED_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_AVAIL_CRED_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_AVAIL_CRED_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_AVAIL_CRED_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_AVAIL_CRED_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_AVAIL_CRED_5 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_AVAIL_CRED_6 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_AVAIL_CRED_7 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_AVAIL_CRED_8 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_AVAIL_CRED_9 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_AVAIL_CRED_10 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_AVAIL_CRED_11 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_AVAIL_CRED_12 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_AVAIL_CRED_13 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_AVAIL_CRED_14 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_AVAIL_CRED_15 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_AVAIL_CRED_16 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_AVAIL_CRED_17 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_AVAIL_CRED_18 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_AVAIL_CRED_19 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_AVAIL_CRED_20 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_AVAIL_CRED_21 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_AVAIL_CRED_22 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_AVAIL_CRED_23 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC2_QM0_ARB_MST_AVAIL_CRED_24 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC2_QM0_ARB_MST_AVAIL_CRED_24 & +PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC2_QM0_ARB_MST_AVAIL_CRED_24 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_AVAIL_CRED_25 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_AVAIL_CRED_26 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_AVAIL_CRED_27 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_AVAIL_CRED_28 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_AVAIL_CRED_29 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_AVAIL_CRED_30 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_AVAIL_CRED_31 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC2_QM0_ARB_MST_CHOISE_PUSH_OFST_23 & ~0xFFF ) + +PROT_BITS_OFFS ; + word_offset = ((mmNIC2_QM0_ARB_MST_CHOISE_PUSH_OFST_23 & +PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC2_QM0_ARB_SLV_CHOISE_WDT &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MSG_MAX_INFLIGHT &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MSG_AWUSER_31_11 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MSG_AWUSER_SEC_PROP &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MSG_AWUSER_NON_SEC_PROP &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC2_QM0_ARB_STATE_STS & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC2_QM0_ARB_STATE_STS &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC2_QM0_ARB_STATE_STS &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_CHOISE_FULLNESS_STS &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MSG_STS &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_SLV_CHOISE_Q_HEAD &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_ERR_CAUSE &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_ERR_MSG_EN &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_ERR_STS_DRP &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_CRED_STS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_CRED_STS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_CRED_STS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_CRED_STS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_CRED_STS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_CRED_STS_5 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_CRED_STS_6 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_CRED_STS_7 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_CRED_STS_8 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_CRED_STS_9 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_CRED_STS_10 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_CRED_STS_11 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_CRED_STS_12 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_CRED_STS_13 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_CRED_STS_14 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_CRED_STS_15 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_CRED_STS_16 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_CRED_STS_17 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_CRED_STS_18 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_CRED_STS_19 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC2_QM0_ARB_MST_CRED_STS_20 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC2_QM0_ARB_MST_CRED_STS_20 &PROT_BITS_OFFS ) + >>7 ) <<2 ; + mask =1U << ((mmNIC2_QM0_ARB_MST_CRED_STS_20 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_CRED_STS_21 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_CRED_STS_22 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_CRED_STS_23 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_CRED_STS_24 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_CRED_STS_25 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_CRED_STS_26 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_CRED_STS_27 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_CRED_STS_28 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_CRED_STS_29 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_CRED_STS_30 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_ARB_MST_CRED_STS_31 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CGM_CFG &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CGM_STS &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CGM_CFG1 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC2_QM0_LOCAL_RANGE_BASE & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC2_QM0_LOCAL_RANGE_BASE &PROT_BITS_OFFS ) + >>7 ) <<2 ; + mask =1U << ((mmNIC2_QM0_LOCAL_RANGE_BASE &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_LOCAL_RANGE_SIZE &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_CSMR_STRICT_PRIO_CFG &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_HBW_RD_RATE_LIM_CFG_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_LBW_WR_RATE_LIM_CFG_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_LBW_WR_RATE_LIM_CFG_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_HBW_RD_RATE_LIM_CFG_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_GLBL_AXCACHE &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_IND_GW_APB_CFG &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_IND_GW_APB_WDATA &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_IND_GW_APB_RDATA &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_IND_GW_APB_STATUS &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_GLBL_ERR_ADDR_LO &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_GLBL_ERR_ADDR_HI &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM0_GLBL_ERR_WDATA &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC2_QM0_GLBL_MEM_INIT_BUSY & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC2_QM0_GLBL_MEM_INIT_BUSY &PROT_BITS_OFFS ) + >>7 ) <<2 ; + mask =1U << ((mmNIC2_QM0_GLBL_MEM_INIT_BUSY &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC2_QM1_GLBL_CFG0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC2_QM1_GLBL_CFG0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC2_QM1_GLBL_CFG0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_GLBL_CFG1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_GLBL_PROT &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_GLBL_ERR_CFG &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_GLBL_SECURE_PROPS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_GLBL_SECURE_PROPS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_GLBL_SECURE_PROPS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_GLBL_SECURE_PROPS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_GLBL_SECURE_PROPS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_GLBL_NON_SECURE_PROPS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_GLBL_NON_SECURE_PROPS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_GLBL_NON_SECURE_PROPS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_GLBL_NON_SECURE_PROPS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_GLBL_NON_SECURE_PROPS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_GLBL_STS0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_GLBL_STS1_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_GLBL_STS1_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_GLBL_STS1_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_GLBL_STS1_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_GLBL_STS1_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_GLBL_MSG_EN_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_GLBL_MSG_EN_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_GLBL_MSG_EN_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_GLBL_MSG_EN_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_GLBL_MSG_EN_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_PQ_BASE_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_PQ_BASE_LO_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_PQ_BASE_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_PQ_BASE_LO_3 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC2_QM1_PQ_BASE_HI_0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC2_QM1_PQ_BASE_HI_0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC2_QM1_PQ_BASE_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_PQ_BASE_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_PQ_BASE_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_PQ_BASE_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_PQ_SIZE_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_PQ_SIZE_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_PQ_SIZE_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_PQ_SIZE_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_PQ_PI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_PQ_PI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_PQ_PI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_PQ_PI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_PQ_CI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_PQ_CI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_PQ_CI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_PQ_CI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_PQ_CFG0_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_PQ_CFG0_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_PQ_CFG0_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_PQ_CFG0_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_PQ_CFG1_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_PQ_CFG1_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_PQ_CFG1_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_PQ_CFG1_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_PQ_ARUSER_31_11_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_PQ_ARUSER_31_11_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_PQ_ARUSER_31_11_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_PQ_ARUSER_31_11_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_PQ_STS0_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_PQ_STS0_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_PQ_STS0_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_PQ_STS0_3 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC2_QM1_PQ_STS1_0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC2_QM1_PQ_STS1_0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC2_QM1_PQ_STS1_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_PQ_STS1_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_PQ_STS1_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_PQ_STS1_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CQ_STS0_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CQ_STS0_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CQ_STS0_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CQ_STS0_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CQ_STS1_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CQ_STS1_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CQ_STS1_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CQ_STS1_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CQ_PTR_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CQ_PTR_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CQ_TSIZE_0 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC2_QM1_CQ_CTL_0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC2_QM1_CQ_CTL_0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC2_QM1_CQ_CTL_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CQ_PTR_LO_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CQ_PTR_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CQ_TSIZE_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CQ_CTL_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CQ_PTR_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CQ_PTR_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CQ_TSIZE_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CQ_CTL_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CQ_PTR_LO_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CQ_PTR_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CQ_TSIZE_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CQ_CTL_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CQ_PTR_LO_STS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CQ_PTR_LO_STS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CQ_PTR_LO_STS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CQ_PTR_LO_STS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CQ_PTR_LO_STS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CQ_PTR_HI_STS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CQ_PTR_HI_STS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CQ_PTR_HI_STS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CQ_PTR_HI_STS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CQ_PTR_HI_STS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CQ_TSIZE_STS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CQ_TSIZE_STS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CQ_TSIZE_STS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CQ_TSIZE_STS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CQ_TSIZE_STS_4 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC2_QM1_CQ_CTL_STS_0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC2_QM1_CQ_CTL_STS_0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC2_QM1_CQ_CTL_STS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CQ_CTL_STS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CQ_CTL_STS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CQ_CTL_STS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CQ_CTL_STS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CQ_IFIFO_CNT_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CQ_IFIFO_CNT_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CQ_IFIFO_CNT_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CQ_IFIFO_CNT_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CQ_IFIFO_CNT_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_MSG_BASE0_ADDR_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_MSG_BASE0_ADDR_LO_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_MSG_BASE0_ADDR_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_MSG_BASE0_ADDR_LO_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_MSG_BASE0_ADDR_LO_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_MSG_BASE0_ADDR_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_MSG_BASE0_ADDR_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_MSG_BASE0_ADDR_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_MSG_BASE0_ADDR_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_MSG_BASE0_ADDR_HI_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_MSG_BASE1_ADDR_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_MSG_BASE1_ADDR_LO_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_MSG_BASE1_ADDR_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_MSG_BASE1_ADDR_LO_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_MSG_BASE1_ADDR_LO_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_MSG_BASE1_ADDR_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_MSG_BASE1_ADDR_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_MSG_BASE1_ADDR_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_MSG_BASE1_ADDR_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_MSG_BASE1_ADDR_HI_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_MSG_BASE2_ADDR_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_MSG_BASE2_ADDR_LO_1 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC2_QM1_CP_MSG_BASE2_ADDR_LO_2 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC2_QM1_CP_MSG_BASE2_ADDR_LO_2 & +PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC2_QM1_CP_MSG_BASE2_ADDR_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_MSG_BASE2_ADDR_LO_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_MSG_BASE2_ADDR_LO_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_MSG_BASE2_ADDR_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_MSG_BASE2_ADDR_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_MSG_BASE2_ADDR_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_MSG_BASE2_ADDR_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_MSG_BASE2_ADDR_HI_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_MSG_BASE3_ADDR_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_MSG_BASE3_ADDR_LO_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_MSG_BASE3_ADDR_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_MSG_BASE3_ADDR_LO_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_MSG_BASE3_ADDR_LO_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_MSG_BASE3_ADDR_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_MSG_BASE3_ADDR_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_MSG_BASE3_ADDR_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_MSG_BASE3_ADDR_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_MSG_BASE3_ADDR_HI_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_LDMA_TSIZE_OFFSET_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_LDMA_TSIZE_OFFSET_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_LDMA_TSIZE_OFFSET_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_LDMA_TSIZE_OFFSET_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_LDMA_TSIZE_OFFSET_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_LDMA_SRC_BASE_LO_OFFSET_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_LDMA_SRC_BASE_LO_OFFSET_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_LDMA_SRC_BASE_LO_OFFSET_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_LDMA_SRC_BASE_LO_OFFSET_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_LDMA_SRC_BASE_LO_OFFSET_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_LDMA_DST_BASE_LO_OFFSET_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_LDMA_DST_BASE_LO_OFFSET_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_LDMA_DST_BASE_LO_OFFSET_2 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC2_QM1_CP_LDMA_DST_BASE_LO_OFFSET_3 & ~0xFFF ) + +PROT_BITS_OFFS ; + word_offset = ((mmNIC2_QM1_CP_LDMA_DST_BASE_LO_OFFSET_3 & +PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC2_QM1_CP_LDMA_DST_BASE_LO_OFFSET_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_LDMA_DST_BASE_LO_OFFSET_4 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC2_QM1_CP_STS_0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC2_QM1_CP_STS_0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC2_QM1_CP_STS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_STS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_STS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_STS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_STS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_CURRENT_INST_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_CURRENT_INST_LO_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_CURRENT_INST_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_CURRENT_INST_LO_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_CURRENT_INST_LO_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_CURRENT_INST_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_CURRENT_INST_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_CURRENT_INST_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_CURRENT_INST_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_CURRENT_INST_HI_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_BARRIER_CFG_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_BARRIER_CFG_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_BARRIER_CFG_2 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC2_QM1_CP_BARRIER_CFG_3 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC2_QM1_CP_BARRIER_CFG_3 &PROT_BITS_OFFS ) + >>7 ) <<2 ; + mask =1U << ((mmNIC2_QM1_CP_BARRIER_CFG_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_BARRIER_CFG_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_DBG_0_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_DBG_0_1 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC2_QM1_CP_DBG_0_2 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC2_QM1_CP_DBG_0_2 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC2_QM1_CP_DBG_0_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_DBG_0_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_DBG_0_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_ARUSER_31_11_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_ARUSER_31_11_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_ARUSER_31_11_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_ARUSER_31_11_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_ARUSER_31_11_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_AWUSER_31_11_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_AWUSER_31_11_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_AWUSER_31_11_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_AWUSER_31_11_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CP_AWUSER_31_11_4 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC2_QM1_ARB_CFG_0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC2_QM1_ARB_CFG_0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC2_QM1_ARB_CFG_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_AVAIL_CRED_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_AVAIL_CRED_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_AVAIL_CRED_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_AVAIL_CRED_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_AVAIL_CRED_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_AVAIL_CRED_5 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_AVAIL_CRED_6 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_AVAIL_CRED_7 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_AVAIL_CRED_8 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_AVAIL_CRED_9 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_AVAIL_CRED_10 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_AVAIL_CRED_11 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_AVAIL_CRED_12 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_AVAIL_CRED_13 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_AVAIL_CRED_14 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_AVAIL_CRED_15 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_AVAIL_CRED_16 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_AVAIL_CRED_17 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_AVAIL_CRED_18 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_AVAIL_CRED_19 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_AVAIL_CRED_20 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_AVAIL_CRED_21 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_AVAIL_CRED_22 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_AVAIL_CRED_23 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC2_QM1_ARB_MST_AVAIL_CRED_24 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC2_QM1_ARB_MST_AVAIL_CRED_24 & +PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC2_QM1_ARB_MST_AVAIL_CRED_24 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_AVAIL_CRED_25 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_AVAIL_CRED_26 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_AVAIL_CRED_27 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_AVAIL_CRED_28 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_AVAIL_CRED_29 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_AVAIL_CRED_30 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_AVAIL_CRED_31 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC2_QM1_ARB_MST_CHOISE_PUSH_OFST_23 & ~0xFFF ) + +PROT_BITS_OFFS ; + word_offset = ((mmNIC2_QM1_ARB_MST_CHOISE_PUSH_OFST_23 & +PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC2_QM1_ARB_SLV_CHOISE_WDT &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MSG_MAX_INFLIGHT &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MSG_AWUSER_31_11 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MSG_AWUSER_SEC_PROP &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MSG_AWUSER_NON_SEC_PROP &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC2_QM1_ARB_STATE_STS & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC2_QM1_ARB_STATE_STS &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC2_QM1_ARB_STATE_STS &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_CHOISE_FULLNESS_STS &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MSG_STS &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_SLV_CHOISE_Q_HEAD &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_ERR_CAUSE &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_ERR_MSG_EN &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_ERR_STS_DRP &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_CRED_STS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_CRED_STS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_CRED_STS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_CRED_STS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_CRED_STS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_CRED_STS_5 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_CRED_STS_6 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_CRED_STS_7 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_CRED_STS_8 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_CRED_STS_9 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_CRED_STS_10 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_CRED_STS_11 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_CRED_STS_12 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_CRED_STS_13 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_CRED_STS_14 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_CRED_STS_15 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_CRED_STS_16 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_CRED_STS_17 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_CRED_STS_18 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_CRED_STS_19 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC2_QM1_ARB_MST_CRED_STS_20 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC2_QM1_ARB_MST_CRED_STS_20 &PROT_BITS_OFFS ) + >>7 ) <<2 ; + mask =1U << ((mmNIC2_QM1_ARB_MST_CRED_STS_20 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_CRED_STS_21 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_CRED_STS_22 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_CRED_STS_23 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_CRED_STS_24 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_CRED_STS_25 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_CRED_STS_26 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_CRED_STS_27 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_CRED_STS_28 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_CRED_STS_29 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_CRED_STS_30 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_ARB_MST_CRED_STS_31 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CGM_CFG &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CGM_STS &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CGM_CFG1 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC2_QM1_LOCAL_RANGE_BASE & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC2_QM1_LOCAL_RANGE_BASE &PROT_BITS_OFFS ) + >>7 ) <<2 ; + mask =1U << ((mmNIC2_QM1_LOCAL_RANGE_BASE &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_LOCAL_RANGE_SIZE &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_CSMR_STRICT_PRIO_CFG &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_HBW_RD_RATE_LIM_CFG_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_LBW_WR_RATE_LIM_CFG_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_LBW_WR_RATE_LIM_CFG_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_HBW_RD_RATE_LIM_CFG_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_GLBL_AXCACHE &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_IND_GW_APB_CFG &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_IND_GW_APB_WDATA &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_IND_GW_APB_RDATA &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_IND_GW_APB_STATUS &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_GLBL_ERR_ADDR_LO &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_GLBL_ERR_ADDR_HI &0x7F ) >>2 ); + mask |=1U << ((mmNIC2_QM1_GLBL_ERR_WDATA &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC2_QM1_GLBL_MEM_INIT_BUSY & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC2_QM1_GLBL_MEM_INIT_BUSY &PROT_BITS_OFFS ) + >>7 ) <<2 ; + mask =1U << ((mmNIC2_QM1_GLBL_MEM_INIT_BUSY &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + +WREG32 (mmNIC3_QM0_BASE -CFG_BASE +PROT_BITS_OFFS +0x7C ,0 ); +WREG32 (mmNIC3_QM1_BASE -CFG_BASE +PROT_BITS_OFFS +0x7C ,0 ); + + pb_addr = (mmNIC3_QM0_GLBL_CFG0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC3_QM0_GLBL_CFG0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC3_QM0_GLBL_CFG0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_GLBL_CFG1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_GLBL_PROT &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_GLBL_ERR_CFG &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_GLBL_SECURE_PROPS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_GLBL_SECURE_PROPS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_GLBL_SECURE_PROPS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_GLBL_SECURE_PROPS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_GLBL_SECURE_PROPS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_GLBL_NON_SECURE_PROPS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_GLBL_NON_SECURE_PROPS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_GLBL_NON_SECURE_PROPS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_GLBL_NON_SECURE_PROPS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_GLBL_NON_SECURE_PROPS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_GLBL_STS0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_GLBL_STS1_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_GLBL_STS1_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_GLBL_STS1_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_GLBL_STS1_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_GLBL_STS1_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_GLBL_MSG_EN_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_GLBL_MSG_EN_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_GLBL_MSG_EN_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_GLBL_MSG_EN_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_GLBL_MSG_EN_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_PQ_BASE_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_PQ_BASE_LO_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_PQ_BASE_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_PQ_BASE_LO_3 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC3_QM0_PQ_BASE_HI_0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC3_QM0_PQ_BASE_HI_0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC3_QM0_PQ_BASE_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_PQ_BASE_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_PQ_BASE_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_PQ_BASE_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_PQ_SIZE_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_PQ_SIZE_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_PQ_SIZE_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_PQ_SIZE_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_PQ_PI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_PQ_PI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_PQ_PI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_PQ_PI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_PQ_CI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_PQ_CI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_PQ_CI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_PQ_CI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_PQ_CFG0_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_PQ_CFG0_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_PQ_CFG0_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_PQ_CFG0_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_PQ_CFG1_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_PQ_CFG1_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_PQ_CFG1_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_PQ_CFG1_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_PQ_ARUSER_31_11_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_PQ_ARUSER_31_11_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_PQ_ARUSER_31_11_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_PQ_ARUSER_31_11_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_PQ_STS0_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_PQ_STS0_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_PQ_STS0_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_PQ_STS0_3 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC3_QM0_PQ_STS1_0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC3_QM0_PQ_STS1_0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC3_QM0_PQ_STS1_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_PQ_STS1_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_PQ_STS1_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_PQ_STS1_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CQ_STS0_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CQ_STS0_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CQ_STS0_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CQ_STS0_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CQ_STS1_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CQ_STS1_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CQ_STS1_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CQ_STS1_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CQ_PTR_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CQ_PTR_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CQ_TSIZE_0 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC3_QM0_CQ_CTL_0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC3_QM0_CQ_CTL_0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC3_QM0_CQ_CTL_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CQ_PTR_LO_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CQ_PTR_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CQ_TSIZE_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CQ_CTL_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CQ_PTR_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CQ_PTR_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CQ_TSIZE_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CQ_CTL_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CQ_PTR_LO_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CQ_PTR_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CQ_TSIZE_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CQ_CTL_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CQ_PTR_LO_STS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CQ_PTR_LO_STS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CQ_PTR_LO_STS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CQ_PTR_LO_STS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CQ_PTR_LO_STS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CQ_PTR_HI_STS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CQ_PTR_HI_STS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CQ_PTR_HI_STS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CQ_PTR_HI_STS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CQ_PTR_HI_STS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CQ_TSIZE_STS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CQ_TSIZE_STS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CQ_TSIZE_STS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CQ_TSIZE_STS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CQ_TSIZE_STS_4 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC3_QM0_CQ_CTL_STS_0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC3_QM0_CQ_CTL_STS_0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC3_QM0_CQ_CTL_STS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CQ_CTL_STS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CQ_CTL_STS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CQ_CTL_STS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CQ_CTL_STS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CQ_IFIFO_CNT_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CQ_IFIFO_CNT_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CQ_IFIFO_CNT_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CQ_IFIFO_CNT_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CQ_IFIFO_CNT_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_MSG_BASE0_ADDR_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_MSG_BASE0_ADDR_LO_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_MSG_BASE0_ADDR_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_MSG_BASE0_ADDR_LO_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_MSG_BASE0_ADDR_LO_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_MSG_BASE0_ADDR_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_MSG_BASE0_ADDR_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_MSG_BASE0_ADDR_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_MSG_BASE0_ADDR_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_MSG_BASE0_ADDR_HI_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_MSG_BASE1_ADDR_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_MSG_BASE1_ADDR_LO_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_MSG_BASE1_ADDR_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_MSG_BASE1_ADDR_LO_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_MSG_BASE1_ADDR_LO_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_MSG_BASE1_ADDR_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_MSG_BASE1_ADDR_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_MSG_BASE1_ADDR_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_MSG_BASE1_ADDR_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_MSG_BASE1_ADDR_HI_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_MSG_BASE2_ADDR_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_MSG_BASE2_ADDR_LO_1 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC3_QM0_CP_MSG_BASE2_ADDR_LO_2 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC3_QM0_CP_MSG_BASE2_ADDR_LO_2 & +PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC3_QM0_CP_MSG_BASE2_ADDR_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_MSG_BASE2_ADDR_LO_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_MSG_BASE2_ADDR_LO_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_MSG_BASE2_ADDR_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_MSG_BASE2_ADDR_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_MSG_BASE2_ADDR_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_MSG_BASE2_ADDR_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_MSG_BASE2_ADDR_HI_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_MSG_BASE3_ADDR_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_MSG_BASE3_ADDR_LO_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_MSG_BASE3_ADDR_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_MSG_BASE3_ADDR_LO_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_MSG_BASE3_ADDR_LO_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_MSG_BASE3_ADDR_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_MSG_BASE3_ADDR_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_MSG_BASE3_ADDR_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_MSG_BASE3_ADDR_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_MSG_BASE3_ADDR_HI_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_LDMA_TSIZE_OFFSET_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_LDMA_TSIZE_OFFSET_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_LDMA_TSIZE_OFFSET_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_LDMA_TSIZE_OFFSET_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_LDMA_TSIZE_OFFSET_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_LDMA_SRC_BASE_LO_OFFSET_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_LDMA_SRC_BASE_LO_OFFSET_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_LDMA_SRC_BASE_LO_OFFSET_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_LDMA_SRC_BASE_LO_OFFSET_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_LDMA_SRC_BASE_LO_OFFSET_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_LDMA_DST_BASE_LO_OFFSET_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_LDMA_DST_BASE_LO_OFFSET_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_LDMA_DST_BASE_LO_OFFSET_2 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC3_QM0_CP_LDMA_DST_BASE_LO_OFFSET_3 & ~0xFFF ) + +PROT_BITS_OFFS ; + word_offset = ((mmNIC3_QM0_CP_LDMA_DST_BASE_LO_OFFSET_3 & +PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC3_QM0_CP_LDMA_DST_BASE_LO_OFFSET_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_LDMA_DST_BASE_LO_OFFSET_4 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC3_QM0_CP_STS_0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC3_QM0_CP_STS_0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC3_QM0_CP_STS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_STS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_STS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_STS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_STS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_CURRENT_INST_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_CURRENT_INST_LO_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_CURRENT_INST_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_CURRENT_INST_LO_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_CURRENT_INST_LO_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_CURRENT_INST_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_CURRENT_INST_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_CURRENT_INST_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_CURRENT_INST_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_CURRENT_INST_HI_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_BARRIER_CFG_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_BARRIER_CFG_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_BARRIER_CFG_2 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC3_QM0_CP_BARRIER_CFG_3 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC3_QM0_CP_BARRIER_CFG_3 &PROT_BITS_OFFS ) + >>7 ) <<2 ; + mask =1U << ((mmNIC3_QM0_CP_BARRIER_CFG_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_BARRIER_CFG_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_DBG_0_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_DBG_0_1 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC3_QM0_CP_DBG_0_2 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC3_QM0_CP_DBG_0_2 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC3_QM0_CP_DBG_0_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_DBG_0_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_DBG_0_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_ARUSER_31_11_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_ARUSER_31_11_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_ARUSER_31_11_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_ARUSER_31_11_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_ARUSER_31_11_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_AWUSER_31_11_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_AWUSER_31_11_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_AWUSER_31_11_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_AWUSER_31_11_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CP_AWUSER_31_11_4 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC3_QM0_ARB_CFG_0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC3_QM0_ARB_CFG_0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC3_QM0_ARB_CFG_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_AVAIL_CRED_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_AVAIL_CRED_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_AVAIL_CRED_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_AVAIL_CRED_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_AVAIL_CRED_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_AVAIL_CRED_5 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_AVAIL_CRED_6 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_AVAIL_CRED_7 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_AVAIL_CRED_8 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_AVAIL_CRED_9 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_AVAIL_CRED_10 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_AVAIL_CRED_11 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_AVAIL_CRED_12 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_AVAIL_CRED_13 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_AVAIL_CRED_14 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_AVAIL_CRED_15 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_AVAIL_CRED_16 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_AVAIL_CRED_17 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_AVAIL_CRED_18 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_AVAIL_CRED_19 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_AVAIL_CRED_20 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_AVAIL_CRED_21 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_AVAIL_CRED_22 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_AVAIL_CRED_23 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC3_QM0_ARB_MST_AVAIL_CRED_24 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC3_QM0_ARB_MST_AVAIL_CRED_24 & +PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC3_QM0_ARB_MST_AVAIL_CRED_24 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_AVAIL_CRED_25 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_AVAIL_CRED_26 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_AVAIL_CRED_27 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_AVAIL_CRED_28 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_AVAIL_CRED_29 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_AVAIL_CRED_30 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_AVAIL_CRED_31 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC3_QM0_ARB_MST_CHOISE_PUSH_OFST_23 & ~0xFFF ) + +PROT_BITS_OFFS ; + word_offset = ((mmNIC3_QM0_ARB_MST_CHOISE_PUSH_OFST_23 & +PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC3_QM0_ARB_SLV_CHOISE_WDT &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MSG_MAX_INFLIGHT &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MSG_AWUSER_31_11 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MSG_AWUSER_SEC_PROP &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MSG_AWUSER_NON_SEC_PROP &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC3_QM0_ARB_STATE_STS & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC3_QM0_ARB_STATE_STS &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC3_QM0_ARB_STATE_STS &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_CHOISE_FULLNESS_STS &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MSG_STS &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_SLV_CHOISE_Q_HEAD &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_ERR_CAUSE &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_ERR_MSG_EN &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_ERR_STS_DRP &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_CRED_STS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_CRED_STS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_CRED_STS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_CRED_STS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_CRED_STS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_CRED_STS_5 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_CRED_STS_6 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_CRED_STS_7 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_CRED_STS_8 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_CRED_STS_9 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_CRED_STS_10 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_CRED_STS_11 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_CRED_STS_12 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_CRED_STS_13 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_CRED_STS_14 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_CRED_STS_15 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_CRED_STS_16 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_CRED_STS_17 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_CRED_STS_18 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_CRED_STS_19 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC3_QM0_ARB_MST_CRED_STS_20 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC3_QM0_ARB_MST_CRED_STS_20 &PROT_BITS_OFFS ) + >>7 ) <<2 ; + mask =1U << ((mmNIC3_QM0_ARB_MST_CRED_STS_20 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_CRED_STS_21 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_CRED_STS_22 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_CRED_STS_23 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_CRED_STS_24 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_CRED_STS_25 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_CRED_STS_26 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_CRED_STS_27 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_CRED_STS_28 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_CRED_STS_29 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_CRED_STS_30 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_ARB_MST_CRED_STS_31 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CGM_CFG &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CGM_STS &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CGM_CFG1 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC3_QM0_LOCAL_RANGE_BASE & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC3_QM0_LOCAL_RANGE_BASE &PROT_BITS_OFFS ) + >>7 ) <<2 ; + mask =1U << ((mmNIC3_QM0_LOCAL_RANGE_BASE &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_LOCAL_RANGE_SIZE &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_CSMR_STRICT_PRIO_CFG &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_HBW_RD_RATE_LIM_CFG_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_LBW_WR_RATE_LIM_CFG_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_LBW_WR_RATE_LIM_CFG_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_HBW_RD_RATE_LIM_CFG_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_GLBL_AXCACHE &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_IND_GW_APB_CFG &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_IND_GW_APB_WDATA &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_IND_GW_APB_RDATA &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_IND_GW_APB_STATUS &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_GLBL_ERR_ADDR_LO &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_GLBL_ERR_ADDR_HI &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM0_GLBL_ERR_WDATA &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC3_QM0_GLBL_MEM_INIT_BUSY & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC3_QM0_GLBL_MEM_INIT_BUSY &PROT_BITS_OFFS ) + >>7 ) <<2 ; + mask =1U << ((mmNIC3_QM0_GLBL_MEM_INIT_BUSY &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC3_QM1_GLBL_CFG0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC3_QM1_GLBL_CFG0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC3_QM1_GLBL_CFG0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_GLBL_CFG1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_GLBL_PROT &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_GLBL_ERR_CFG &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_GLBL_SECURE_PROPS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_GLBL_SECURE_PROPS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_GLBL_SECURE_PROPS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_GLBL_SECURE_PROPS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_GLBL_SECURE_PROPS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_GLBL_NON_SECURE_PROPS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_GLBL_NON_SECURE_PROPS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_GLBL_NON_SECURE_PROPS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_GLBL_NON_SECURE_PROPS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_GLBL_NON_SECURE_PROPS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_GLBL_STS0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_GLBL_STS1_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_GLBL_STS1_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_GLBL_STS1_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_GLBL_STS1_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_GLBL_STS1_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_GLBL_MSG_EN_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_GLBL_MSG_EN_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_GLBL_MSG_EN_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_GLBL_MSG_EN_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_GLBL_MSG_EN_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_PQ_BASE_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_PQ_BASE_LO_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_PQ_BASE_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_PQ_BASE_LO_3 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC3_QM1_PQ_BASE_HI_0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC3_QM1_PQ_BASE_HI_0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC3_QM1_PQ_BASE_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_PQ_BASE_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_PQ_BASE_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_PQ_BASE_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_PQ_SIZE_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_PQ_SIZE_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_PQ_SIZE_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_PQ_SIZE_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_PQ_PI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_PQ_PI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_PQ_PI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_PQ_PI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_PQ_CI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_PQ_CI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_PQ_CI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_PQ_CI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_PQ_CFG0_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_PQ_CFG0_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_PQ_CFG0_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_PQ_CFG0_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_PQ_CFG1_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_PQ_CFG1_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_PQ_CFG1_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_PQ_CFG1_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_PQ_ARUSER_31_11_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_PQ_ARUSER_31_11_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_PQ_ARUSER_31_11_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_PQ_ARUSER_31_11_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_PQ_STS0_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_PQ_STS0_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_PQ_STS0_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_PQ_STS0_3 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC3_QM1_PQ_STS1_0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC3_QM1_PQ_STS1_0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC3_QM1_PQ_STS1_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_PQ_STS1_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_PQ_STS1_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_PQ_STS1_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CQ_STS0_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CQ_STS0_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CQ_STS0_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CQ_STS0_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CQ_STS1_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CQ_STS1_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CQ_STS1_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CQ_STS1_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CQ_PTR_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CQ_PTR_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CQ_TSIZE_0 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC3_QM1_CQ_CTL_0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC3_QM1_CQ_CTL_0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC3_QM1_CQ_CTL_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CQ_PTR_LO_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CQ_PTR_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CQ_TSIZE_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CQ_CTL_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CQ_PTR_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CQ_PTR_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CQ_TSIZE_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CQ_CTL_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CQ_PTR_LO_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CQ_PTR_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CQ_TSIZE_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CQ_CTL_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CQ_PTR_LO_STS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CQ_PTR_LO_STS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CQ_PTR_LO_STS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CQ_PTR_LO_STS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CQ_PTR_LO_STS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CQ_PTR_HI_STS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CQ_PTR_HI_STS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CQ_PTR_HI_STS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CQ_PTR_HI_STS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CQ_PTR_HI_STS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CQ_TSIZE_STS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CQ_TSIZE_STS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CQ_TSIZE_STS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CQ_TSIZE_STS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CQ_TSIZE_STS_4 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC3_QM1_CQ_CTL_STS_0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC3_QM1_CQ_CTL_STS_0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC3_QM1_CQ_CTL_STS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CQ_CTL_STS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CQ_CTL_STS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CQ_CTL_STS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CQ_CTL_STS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CQ_IFIFO_CNT_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CQ_IFIFO_CNT_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CQ_IFIFO_CNT_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CQ_IFIFO_CNT_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CQ_IFIFO_CNT_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_MSG_BASE0_ADDR_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_MSG_BASE0_ADDR_LO_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_MSG_BASE0_ADDR_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_MSG_BASE0_ADDR_LO_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_MSG_BASE0_ADDR_LO_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_MSG_BASE0_ADDR_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_MSG_BASE0_ADDR_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_MSG_BASE0_ADDR_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_MSG_BASE0_ADDR_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_MSG_BASE0_ADDR_HI_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_MSG_BASE1_ADDR_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_MSG_BASE1_ADDR_LO_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_MSG_BASE1_ADDR_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_MSG_BASE1_ADDR_LO_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_MSG_BASE1_ADDR_LO_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_MSG_BASE1_ADDR_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_MSG_BASE1_ADDR_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_MSG_BASE1_ADDR_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_MSG_BASE1_ADDR_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_MSG_BASE1_ADDR_HI_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_MSG_BASE2_ADDR_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_MSG_BASE2_ADDR_LO_1 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC3_QM1_CP_MSG_BASE2_ADDR_LO_2 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC3_QM1_CP_MSG_BASE2_ADDR_LO_2 & +PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC3_QM1_CP_MSG_BASE2_ADDR_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_MSG_BASE2_ADDR_LO_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_MSG_BASE2_ADDR_LO_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_MSG_BASE2_ADDR_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_MSG_BASE2_ADDR_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_MSG_BASE2_ADDR_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_MSG_BASE2_ADDR_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_MSG_BASE2_ADDR_HI_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_MSG_BASE3_ADDR_LO_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_MSG_BASE3_ADDR_LO_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_MSG_BASE3_ADDR_LO_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_MSG_BASE3_ADDR_LO_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_MSG_BASE3_ADDR_LO_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_MSG_BASE3_ADDR_HI_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_MSG_BASE3_ADDR_HI_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_MSG_BASE3_ADDR_HI_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_MSG_BASE3_ADDR_HI_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_MSG_BASE3_ADDR_HI_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_LDMA_TSIZE_OFFSET_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_LDMA_TSIZE_OFFSET_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_LDMA_TSIZE_OFFSET_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_LDMA_TSIZE_OFFSET_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_LDMA_TSIZE_OFFSET_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_LDMA_SRC_BASE_LO_OFFSET_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_LDMA_SRC_BASE_LO_OFFSET_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_LDMA_SRC_BASE_LO_OFFSET_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_LDMA_SRC_BASE_LO_OFFSET_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_LDMA_SRC_BASE_LO_OFFSET_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_LDMA_DST_BASE_LO_OFFSET_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_LDMA_DST_BASE_LO_OFFSET_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_LDMA_DST_BASE_LO_OFFSET_2 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC3_QM1_CP_LDMA_DST_BASE_LO_OFFSET_3 & ~0xFFF ) + +PROT_BITS_OFFS ; + word_offset = ((mmNIC3_QM1_CP_LDMA_DST_BASE_LO_OFFSET_3 & +PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC3_QM1_CP_LDMA_DST_BASE_LO_OFFSET_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_LDMA_DST_BASE_LO_OFFSET_4 &0x7F ) >>2 ); + +WREG32 (pb_addr + word_offset, ~mask); + + pb_addr = (mmNIC3_QM1_CP_STS_0 & ~0xFFF ) +PROT_BITS_OFFS ; + word_offset = ((mmNIC3_QM1_CP_STS_0 &PROT_BITS_OFFS ) >>7 ) <<2 ; + mask =1U << ((mmNIC3_QM1_CP_STS_0 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_STS_1 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_STS_2 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_STS_3 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_STS_4 &0x7F ) >>2 ); + mask |=1U << ((mmNIC3_QM1_CP_CURRENT_INST_LO_0 &0x7F ) >>2 );
Lines of this file are not shown. View the raw message.
The rest of this diff is not shown. View the raw message.
Signature · 1 line
2.17.1
Part of the diff is not shown here. View the raw message.
PATCH 6/15 habanalabs/gaudi: add NIC PHY code
In reply to Oded GabbayFrom: Omer Shpigelman <[email protected]>
Configure the NIC PHY (physical layer). The PHY is configured with the correct polarity and Tx taps depending on the card type.
After the initial configuration, the PHY flow contains the following:
- Auto-negotiation (if enabled)
- PHY F/W tuning
- Physical Coding Sublayer (PCS) link check
After acquiring the initial PCS link, it is checked periodically. Once we detect that there is no link, we fall to PHY F/W tuning or even Auto-negotiation to re-acquire the link.
Currently we use Auto-negotiation only because it is a prerequisite for link training (physical layer quality improvement) and not for setting the transmission parameters. As a result, the Auto-negotiation is currently supported only between Gaudi cards.
--- drivers/misc/habanalabs/gaudi/Makefile | 2 +- drivers/misc/habanalabs/gaudi/gaudi_nic.c | 454 +++++++- drivers/misc/habanalabs/gaudi/gaudi_nic.h | 17 + drivers/misc/habanalabs/gaudi/gaudi_phy.c | 1272 +++++++++++++++++++++ 4 files changed, 1742 insertions(+), 3 deletions(-) create mode 100644 drivers/misc/habanalabs/gaudi/gaudi_phy.c
drivers/misc/habanalabs/gaudi/Makefile +1 -1
@@ -2,4 +2,4 @@ HL_GAUDI_FILES := gaudi/gaudi.o gaudi/gaudi_hwmgr.o gaudi/gaudi_security.o \ gaudi/gaudi_coresight.o -HL_GAUDI_FILES += gaudi/gaudi_nic.o +HL_GAUDI_FILES += gaudi/gaudi_nic.o gaudi/gaudi_phy.o
drivers/misc/habanalabs/gaudi/gaudi_nic.c +452 -2
512 lines not on this page · raw message
drivers/misc/habanalabs/gaudi/gaudi_nic.h +17 -0
@@ -333,5 +333,22 @@ int gaudi_nic_port_reset(struct gaudi_nic_device *gaudi_nic);bool disabled_or_in_reset (struct gaudi_nic_device *gaudi_nic);u64 gaudi_nic_read_mac_stat_counter (struct hl_device *hdev,u32 port,int idx,bool is_rx); +int gaudi_nic_phy_reset_macro (struct gaudi_nic_device *gaudi_nic); +int gaudi_nic_phy_power_up (struct gaudi_nic_device *gaudi_nic,int lane, +bool do_auto_neg); +int gaudi_nic_phy_has_fw (struct hl_device *hdev); +int gaudi_nic_phy_fw_tuning (struct gaudi_nic_device *gaudi_nic,int lane, +bool check_status); +int gaudi_nic_phy_fw_load_all (struct hl_device *hdev); +int gaudi_nic_phy_check_link_status (struct gaudi_nic_device *gaudi_nic, +int lane); +int gaudi_nic_phy_config_pam4_link_training (struct gaudi_nic_device *gaudi_nic, +int lane); +int gaudi_nic_phy_fw_config_auto_neg (struct gaudi_nic_device *gaudi_nic, +int lane); +u16 gaudi_nic_phy_get_crc (struct hl_device *hdev); +void gaudi_nic_phy_reset_tx (struct gaudi_nic_device *gaudi_nic,int lane); +void gaudi_nic_phy_start_stop (struct gaudi_nic_device *gaudi_nic,int lane, +bool is_start);#endif /* GAUDI_NIC_DRV_H_ */
drivers/misc/habanalabs/gaudi/gaudi_phy.c new file +1272 -0
1,272 lines not on this page · raw message
Signature · 1 line
2.17.1
PATCH 12/15 habanalabs/gaudi: add debugfs entries for the NIC
In reply to Oded GabbayFrom: Omer Shpigelman <[email protected]>
Add several debugfs entries to help us debug the NIC engines and ports and also the communication layer of the DL training application that use them.
There are eight new entries. Detailed description is in the documentation file but here is a summary:
- nic_mac_loopback: enable mac loopback mode per port
- nic_ports_status: print physical connection status per port
- nic_pcs_fail_time_frame: configure windows size for measuring pcs failures
- nic_pcs_fail_threshold: configure pcs failures threshold for reconfiguring the link
- nic_pam4_tx_taps: configure PAM4 TX taps
- nic_polarity: configure polarity for NIC port lanes
- nic_check_link: configure whether to check the PCS link periodically
- nic_phy_auto_neg_lpbk: enable PHY auto-negotiation loopback
--- .../ABI/testing/debugfs-driver-habanalabs | 69 +++ drivers/misc/habanalabs/gaudi/Makefile | 3 +- drivers/misc/habanalabs/gaudi/gaudi_nic.c | 2 + .../misc/habanalabs/gaudi/gaudi_nic_debugfs.c | 402 ++++++++++++++++++ 4 files changed, 475 insertions(+), 1 deletion(-) create mode 100644 drivers/misc/habanalabs/gaudi/gaudi_nic_debugfs.c
Documentation/ABI/testing/debugfs-driver-habanalabs +69 -0
@@ -176,3 +176,72 @@ KernelVersion: 5.6 Contact: [email protected] Description: Sets the stop-on_error option for the device engines. Value of "0" is for disable, otherwise enable. + +What: /sys/kernel/debug/habanalabs/hl<n>/nic_mac_loopback +Date: Nov 2020 +KernelVersion: 5.10 +Contact: [email protected] +Description: Allows the root user to disable/enable MAC loopback for Gaudi + NIC ports. The ports will function as if a physical loopback + transceiver was connected. A bitmask should be provided where + each bit represents a port, up to 20 bits. + Known issues for this mode: + 1. Odd ports PHY is not stopped so the peer's odd ports will get + PCS link. + 2. Might cause an interrupt storm due to high B/W. + +What: /sys/kernel/debug/habanalabs/hl<n>/nic_ports_status +Date: Nov 2020 +KernelVersion: 5.10 +Contact: [email protected] +Description: Displays a summary the PC link state of all Gaudi NIC ports. + +What: /sys/kernel/debug/habanalabs/hl<n>/nic_pcs_fail_time_frame +Date: Nov 2020 +KernelVersion: 5.10 +Contact: [email protected] +Description: Allows the root user to set the used time frame in seconds for + detecting a loose PCS link of a Gaudi NIC port. We count how + many PCS link failures occurred in a time frame up to a + threshold which will cause PHY reconfiguration for getting a new + PCS link. + +What: /sys/kernel/debug/habanalabs/hl<n>/nic_pcs_fail_threshold +Date: Nov 2020 +KernelVersion: 5.10 +Contact: [email protected] +Description: Allows the root user to set the used threshold for detecting a + loose PCS link of a Gaudi NIC port. We count how many PCS link + failures occurred in a time frame up to the threshold which will + cause PHY reconfiguration for getting a new PCS link. + +What: /sys/kernel/debug/habanalabs/hl<n>/nic_pam4_tx_taps +Date: Nov 2020 +KernelVersion: 5.10 +Contact: [email protected] +Description: Allows the root user to set the PAM4 Tx taps for Gaudi NIC port + lanes. The lanes indices are 0-39. + Acceptable input string form: + <lane> <tx_pre2> <tx_pre1> <tx_main> <tx_post1> <tx_post2>. + +What: /sys/kernel/debug/habanalabs/hl<n>/nic_polarity +Date: Nov 2020 +KernelVersion: 5.10 +Contact: [email protected] +Description: Allows the root user to set the polarity for Gaudi NIC port + lanes. The lanes indices are 0-39. + Acceptable input string form: <lane> <pol_tx> <pol_rx>. + +What: /sys/kernel/debug/habanalabs/hl<n>/nic_check_link +Date: Nov 2020 +KernelVersion: 5.10 +Contact: [email protected] +Description: Sets the PCS link periodic check for all Gaudi NIC ports. Value + of "0" is for disable, otherwise enable. + +What: /sys/kernel/debug/habanalabs/hl<n>/nic_phy_auto_neg_lpbk +Date: Nov 2020 +KernelVersion: 5.10 +Contact: [email protected] +Description: Sets the PHY Autoneg loopback support for all Gaudi NIC ports. + Value of "0" is for disable, otherwise enable.
drivers/misc/habanalabs/gaudi/Makefile +2 -1
@@ -2,4 +2,5 @@ HL_GAUDI_FILES := gaudi/gaudi.o gaudi/gaudi_hwmgr.o gaudi/gaudi_security.o \ gaudi/gaudi_coresight.o -HL_GAUDI_FILES += gaudi/gaudi_nic.o gaudi/gaudi_phy.o +HL_GAUDI_FILES += gaudi/gaudi_nic.o gaudi/gaudi_phy.o \ + gaudi/gaudi_nic_debugfs.o
drivers/misc/habanalabs/gaudi/gaudi_nic.c +2 -0
@@ -3025,6 +3025,8 @@ int gaudi_nic_ports_init(struct hl_device *hdev) } } +gaudi_nic_debugfs_init (hdev); + gaudi->hw_cap_initialized |=HW_CAP_NIC_DRV ;return 0 ;
drivers/misc/habanalabs/gaudi/gaudi_nic_debugfs.c new file +402 -0
402 lines not on this page · raw message
Signature · 1 line
2.17.1
PATCH 5/15 habanalabs/gaudi: add NIC Ethernet support
In reply to Oded GabbayFrom: Omer Shpigelman <[email protected]>
Basic NIC driver which handles Ethernet packet of several types like IPv4, IPv6, LLDP, VLAN and ARP.
The NIC HW is composed of 5 NIC macros, in each macro 2 NIC engines of 100GbE each. Each engine exposes a single port of 100GbE, so in total we have 10 ports per GAUDI device.
The driver gets the needed information for initialization from the firmware such as card type, available ports, Auto-negotiation support, polarity and Tx taps configuration.
Two card types are supported: standalone PCI and PCI Mezzanine Card (PMC) which is part of a server called HLS-1. Each type has its own unique configurations.
We define two types of port connectivity - internal and external. Internal port is connected to a port on another Gaudi card and external port is connected to a switch.
The Ethernet support is needed only for control flows e.g. get IP. Hence it is implemented in a very simple way - the packets are copied rather than using descriptors.
The Rx flow uses NAPI by default and polling mode is supported by a kernel module parameter.
Because we must not access the HW while doing hard reset to the device, a new stage of stopping all NIC activity is added at the beginning of the reset flow.
--- drivers/misc/habanalabs/common/context.c | 1 + drivers/misc/habanalabs/common/firmware_if.c | 44 + drivers/misc/habanalabs/common/habanalabs.h | 13 +- .../misc/habanalabs/common/habanalabs_drv.c | 10 + drivers/misc/habanalabs/gaudi/Makefile | 2 + drivers/misc/habanalabs/gaudi/gaudi.c | 177 +- drivers/misc/habanalabs/gaudi/gaudiP.h | 288 ++- drivers/misc/habanalabs/gaudi/gaudi_nic.c | 2298 +++++++++++++++++ drivers/misc/habanalabs/gaudi/gaudi_nic.h | 337 +++ drivers/misc/habanalabs/goya/goya.c | 6 + include/uapi/misc/habanalabs.h | 3 + 11 files changed, 3171 insertions(+), 8 deletions(-) create mode 100644 drivers/misc/habanalabs/gaudi/gaudi_nic.c create mode 100644 drivers/misc/habanalabs/gaudi/gaudi_nic.h
drivers/misc/habanalabs/common/context.c +1 -0
@@ -37,6 +37,7 @@ static void hl_ctx_fini(struct hl_ctx *ctx)if ((hdev->in_debug) && (hdev->compute_ctx == ctx))hl_device_set_debug_mode (hdev, false); + hdev->asic_funcs->ctx_fini (ctx);hl_vm_ctx_fini (ctx);hl_asid_free (hdev, ctx->asid); }else {
drivers/misc/habanalabs/common/firmware_if.c +44 -0
50 lines not on this page · raw message
drivers/misc/habanalabs/common/habanalabs.h +12 -1
@@ -264,6 +264,8 @@ struct hl_mmu_properties {* @hw_queues_props: H/W queues properties. * @cpucp_info: received various information from CPU-CP regarding the H/W, e.g. * available sensors. +* @cpucp_nic_info: received various information from CPU-CP regarding the NIC +* H/W, e.g. MAC addresses. * @uboot_ver: F/W U-boot version. * @preboot_ver: F/W Preboot version. * @dmmu: DRAM MMU address translation properties.
@@ -278,7 +280,7 @@ struct hl_mmu_properties {* @dram_user_base_address: DRAM physical start address for user access. * @dram_size: DRAM total size. * @dram_pci_bar_size: size of PCI bar towards DRAM. -* @max_power_default: max power of the device after reset +* @max_power_default: max power of the device after reset. * @dram_size_for_default_page_mapping: DRAM size needed to map to avoid page * fault. * @pcie_dbi_base_address: Base address of the PCIE_DBI block.
@@ -314,6 +316,7 @@ struct hl_mmu_properties {struct asic_fixed_properties {struct hw_queue_properties *hw_queues_props;struct cpucp_info cpucp_info; +struct cpucp_nic_info cpucp_nic_info;char uboot_ver[VERSION_MAX_LEN ];char preboot_ver[VERSION_MAX_LEN ];struct hl_mmu_properties dmmu;
@@ -680,6 +683,7 @@ enum div_select_defs {* @wreg: Write a register. Needed for simulator support. * @halt_coresight: stop the ETF and ETR traces. * @ctx_init: context dependent initialization. +* @ctx_fini: context dependent cleanup. * @get_clk_rate: Retrieve the ASIC current and maximum clock rate in MHz * @get_queue_id_for_cq: Get the H/W queue id related to the given CQ index. * @read_device_fw_version: read the device's firmware versions that are
@@ -782,6 +786,7 @@ struct hl_asic_funcs {void (*wreg)(struct hl_device *hdev,u32 reg,u32 val);void (*halt_coresight)(struct hl_device *hdev);int (*ctx_init)(struct hl_ctx *ctx); +void (*ctx_fini)(struct hl_ctx *ctx);int (*get_clk_rate)(struct hl_device *hdev,u32 *cur_clk,u32 *max_clk);u32 (*get_queue_id_for_cq)(struct hl_device *hdev,u32 cq_idx); void (*read_device_fw_version)(struct hl_device *hdev,
@@ -1528,6 +1533,7 @@ struct hl_device_idle_busy_ts {* @sync_stream_queue_idx: helper index for sync stream queues initialization. * @supports_coresight: is CoreSight supported. * @supports_soft_reset: is soft reset supported. +* @nic_rx_poll: enable NIC Rx in polling mode rather than IRQ. */ struct hl_device {struct pci_dev *pdev;
@@ -1626,9 +1632,12 @@ struct hl_device {u8 sync_stream_queue_idx;u8 supports_coresight;u8 supports_soft_reset; +u8 nic_rx_poll;/* Parameters for bring-up */ u64 nic_ports_mask; +u64 nic_ports_ext_mask; +u64 nic_auto_neg_mask;u8 mmu_enable;u8 mmu_huge_page_opt;u8 cpu_enable;
@@ -1641,6 +1650,7 @@ struct hl_device {u8 dram_scrambler_enable;u8 hard_reset_on_fw_events;u8 bmc_enable; +u8 nic_load_fw;u8 rl_enable; };
@@ -1858,6 +1868,7 @@ void hl_fw_cpu_accessible_dma_pool_free(struct hl_device *hdev, size_t size,int hl_fw_send_heartbeat (struct hl_device *hdev);int hl_fw_cpucp_info_get (struct hl_device *hdev);int hl_fw_get_eeprom_data (struct hl_device *hdev,void *data,size_t max_size); +int hl_fw_cpucp_nic_info_get (struct hl_device *hdev);int hl_fw_cpucp_pci_counters_get (struct hl_device *hdev,struct hl_info_pci_counters *counters); int hl_fw_cpucp_total_energy_get(struct hl_device *hdev,
drivers/misc/habanalabs/common/habanalabs_drv.c +10 -0
@@ -29,6 +29,7 @@ static DEFINE_MUTEX(hl_devs_idr_lock);static int timeout_locked =5 ;static int reset_on_lockup =1 ; +static int nic_rx_poll;module_param (timeout_locked, int,0444 ); MODULE_PARM_DESC(timeout_locked,
@@ -38,6 +39,10 @@ module_param(reset_on_lockup, int, 0444);MODULE_PARM_DESC (reset_on_lockup,"Do device reset on lockup (0 = no, 1 = yes, default yes)" ); +module_param (nic_rx_poll, int,0444 ); +MODULE_PARM_DESC (nic_rx_poll, +"Enable NIC Rx polling mode (0 = no, 1 = yes, default no)" ); +#define PCI_VENDOR_ID_HABANALABS 0x1da3#define PCI_IDS_GOYA 0x0001
@@ -241,6 +246,10 @@ static void set_driver_behavior_per_device(struct hl_device *hdev) hdev->dram_scrambler_enable =1 ; hdev->bmc_enable =1 ; hdev->hard_reset_on_fw_events =1 ; + hdev->card_type = cpucp_card_type_pci; + hdev->nic_ports_ext_mask =0x3FF ; + hdev->nic_auto_neg_mask =0x3FF ; + hdev->nic_load_fw =0 ; }/*
@@ -283,6 +292,7 @@ int create_hdev(struct hl_device **dev, struct pci_dev *pdev, hdev->major = hl_major; hdev->reset_on_lockup = reset_on_lockup; + hdev->nic_rx_poll = nic_rx_poll; hdev->pldm =0 ;set_driver_behavior_per_device (hdev);
drivers/misc/habanalabs/gaudi/Makefile +2 -0
@@ -1,3 +1,5 @@ # SPDX-License-Identifier: GPL-2.0-only HL_GAUDI_FILES := gaudi/gaudi.o gaudi/gaudi_hwmgr.o gaudi/gaudi_security.o \ gaudi/gaudi_coresight.o + +HL_GAUDI_FILES += gaudi/gaudi_nic.o
drivers/misc/habanalabs/gaudi/gaudi.c +175 -2
323 lines not on this page · raw message
drivers/misc/habanalabs/gaudi/gaudiP.h +283 -5
389 lines not on this page · raw message
drivers/misc/habanalabs/gaudi/gaudi_nic.c new file +2298 -0
2,122 lines not on this page · raw message
drivers/misc/habanalabs/gaudi/gaudi_nic.h new file +337 -0
337 lines not on this page · raw message
The rest of this diff is not shown. View the raw message.
Signature · 1 line
2.17.1
Part of the diff is not shown here. View the raw message.
PATCH 4/15 habanalabs/gaudi: add support for NIC QMANs
In reply to Oded GabbayFrom: Omer Shpigelman <[email protected]>
Initialize the QMANs that are responsible to submit doorbells to the NIC engines. Add support for stopping and disabling them, and reset them as part of the hard-reset procedure of GAUDI. This will allow the user to submit work to the NICs.
Add support for receiving events on QMAN errors from the firmware.
However, the nic_ports_mask is still initialized to 0. That means this code won't initialize the QMANs just yet. That will be in a later patch.
--- drivers/misc/habanalabs/common/habanalabs.h | 3 +- drivers/misc/habanalabs/gaudi/gaudi.c | 741 ++++++++++++++++++-- drivers/misc/habanalabs/gaudi/gaudiP.h | 32 + 3 files changed, 731 insertions(+), 45 deletions(-)
drivers/misc/habanalabs/common/habanalabs.h +1 -2
@@ -1516,8 +1516,6 @@ struct hl_device_idle_busy_ts {* @pmmu_huge_range: is a different virtual addresses range used for PMMU with * huge pages. * @init_done: is the initialization of the device done. -* @mmu_enable: is MMU enabled. -* @mmu_huge_page_opt: is MMU huge pages optimization enabled. * @device_cpu_disabled: is the device CPU disabled (due to timeouts) * @dma_mask: the dma mask that was set for this device * @in_debug: is device under debug. This, together with fpriv_list, enforces
@@ -1630,6 +1628,7 @@ struct hl_device {u8 supports_soft_reset;/* Parameters for bring-up */ +u64 nic_ports_mask;u8 mmu_enable;u8 mmu_huge_page_opt;u8 cpu_enable;
drivers/misc/habanalabs/gaudi/gaudi.c +698 -43
862 lines not on this page · raw message
drivers/misc/habanalabs/gaudi/gaudiP.h +32 -0
@@ -79,6 +79,7 @@#define TPC_QMAN_OFFSET (mmTPC1_QM_BASE - mmTPC0_QM_BASE)#define MME_QMAN_OFFSET (mmMME1_QM_BASE - mmMME0_QM_BASE)#define NIC_MACRO_QMAN_OFFSET (mmNIC1_QM0_BASE - mmNIC0_QM0_BASE) +#define NIC_ENGINE_QMAN_OFFSET (mmNIC0_QM1_BASE - mmNIC0_QM0_BASE)#define TPC_CFG_OFFSET (mmTPC1_CFG_BASE - mmTPC0_CFG_BASE)
@@ -132,6 +133,10 @@#define TPC_QMAN_LENGTH 1024#define TPC_QMAN_SIZE_IN_BYTES (TPC_QMAN_LENGTH * QMAN_PQ_ENTRY_SIZE) +#define NIC_QMAN_LENGTH 1024 +#define NIC_QMAN_SIZE_IN_BYTES (NIC_QMAN_LENGTH * QMAN_PQ_ENTRY_SIZE) + +#define SRAM_USER_BASE_OFFSET GAUDI_DRIVER_SRAM_RESERVED_SIZE_FROM_START/* Virtual address space */
@@ -153,6 +158,19 @@#define HW_CAP_SRAM_SCRAMBLER BIT(10)#define HW_CAP_HBM_SCRAMBLER BIT(11) +#define HW_CAP_NIC0 BIT(14) +#define HW_CAP_NIC1 BIT(15) +#define HW_CAP_NIC2 BIT(16) +#define HW_CAP_NIC3 BIT(17) +#define HW_CAP_NIC4 BIT(18) +#define HW_CAP_NIC5 BIT(19) +#define HW_CAP_NIC6 BIT(20) +#define HW_CAP_NIC7 BIT(21) +#define HW_CAP_NIC8 BIT(22) +#define HW_CAP_NIC9 BIT(23) +#define HW_CAP_NIC_MASK GENMASK(23, 14) +#define HW_CAP_NIC_SHIFT 14 +#define HW_CAP_TPC0 BIT(24)#define HW_CAP_TPC1 BIT(25)#define HW_CAP_TPC2 BIT(26)
@@ -200,6 +218,20 @@ enum gaudi_tpc_mask { GAUDI_TPC_MASK_ALL = 0xFF }; +enum gaudi_nic_mask { +GAUDI_NIC_MASK_NIC0 =0x01 , +GAUDI_NIC_MASK_NIC1 =0x02 , +GAUDI_NIC_MASK_NIC2 =0x04 , +GAUDI_NIC_MASK_NIC3 =0x08 , +GAUDI_NIC_MASK_NIC4 =0x10 , +GAUDI_NIC_MASK_NIC5 =0x20 , +GAUDI_NIC_MASK_NIC6 =0x40 , +GAUDI_NIC_MASK_NIC7 =0x80 , +GAUDI_NIC_MASK_NIC8 =0x100 , +GAUDI_NIC_MASK_NIC9 =0x200 , +GAUDI_NIC_MASK_ALL =0x3FF +}; +/** * struct gaudi_internal_qman_info - Internal QMAN information. * @pq_kernel_addr: Kernel address of the PQ memory area in the host.
Signature · 1 line
2.17.1
PATCH 14/15 habanalabs/gaudi: support DCB protocol
In reply to Oded GabbayFrom: Omer Shpigelman <[email protected]>
Add DCB support to configure the NIC's Priority Flow Control (PFC). The added support is minimal because a full support is not currently required.
A summary of the supported callbacks:
- ieee_getpfc: get the current PFC configuration. PFC is enabled by default.
- ieee_setpfc: set PFC configuration. Only 0 or all 4 priorities can be enabled, no subset is allowed.
- getdcbx: get DCBX capability.
- setdcbx: set DCBX capability. Only host LLDP agent and IEEE protocol flavors are supported.
--- drivers/misc/habanalabs/gaudi/Makefile | 2 +- drivers/misc/habanalabs/gaudi/gaudi_nic.c | 3 + .../misc/habanalabs/gaudi/gaudi_nic_dcbnl.c | 108 ++++++++++++++++++ 3 files changed, 112 insertions(+), 1 deletion(-) create mode 100644 drivers/misc/habanalabs/gaudi/gaudi_nic_dcbnl.c
drivers/misc/habanalabs/gaudi/Makefile +1 -1
@@ -3,5 +3,5 @@ HL_GAUDI_FILES := gaudi/gaudi.o gaudi/gaudi_hwmgr.o gaudi/gaudi_security.o \ gaudi/gaudi_coresight.o HL_GAUDI_FILES += gaudi/gaudi_nic.o gaudi/gaudi_phy.o \ - gaudi/gaudi_nic_ethtool.o \ + gaudi/gaudi_nic_ethtool.o gaudi/gaudi_nic_dcbnl.o \ gaudi/gaudi_nic_debugfs.o
drivers/misc/habanalabs/gaudi/gaudi_nic.c +3 -0
@@ -2745,6 +2745,9 @@ static int port_register(struct hl_device *hdev, int port) ndev->netdev_ops = &gaudi_nic_netdev_ops; ndev->ethtool_ops = &gaudi_nic_ethtool_ops; +#ifdef CONFIG_DCB + ndev->dcbnl_ops = &gaudi_nic_dcbnl_ops; +#endif ndev->watchdog_timeo =NIC_TX_TIMEOUT ; ndev->min_mtu =ETH_MIN_MTU ; ndev->max_mtu =NIC_MAX_MTU ;
drivers/misc/habanalabs/gaudi/gaudi_nic_dcbnl.c new file +108 -0
108 lines not on this page · raw message
Signature · 1 line
2.17.1
PATCH 13/15 habanalabs/gaudi: Add ethtool support using coresight
In reply to Oded GabbayFrom: Omer Shpigelman <[email protected]>
The driver supports ethtool callbacks and provides statistics using the device's profiling infrastructure (coresight).
We support the basic ethtool functionality and counters, as far as our H/W provides support.
A summary of the supported callbacks:
- get_drvinfo: fill some basic information regarding the driver
- get_link_ksettings: get basic settings like speed, duplex, Auto-negotiation and link modes.
- set_link_ksettings: only speed and Auto-negotiation setting is supported.
- get_link: returns link indication.
- get_strings: get counters strings.
- get_sset_count: get counters number.
- get_ethtool_stats: get counters values.
- get_module_info: get EEPROM type and length.
- get_module_eeprom: get EEPROM (supported in raw mode only).
--- drivers/misc/habanalabs/gaudi/Makefile | 1 + drivers/misc/habanalabs/gaudi/gaudi.c | 1 + drivers/misc/habanalabs/gaudi/gaudiP.h | 7 + .../misc/habanalabs/gaudi/gaudi_coresight.c | 144 +++++ drivers/misc/habanalabs/gaudi/gaudi_nic.c | 5 + .../misc/habanalabs/gaudi/gaudi_nic_ethtool.c | 582 ++++++++++++++++++ 6 files changed, 740 insertions(+) create mode 100644 drivers/misc/habanalabs/gaudi/gaudi_nic_ethtool.c
drivers/misc/habanalabs/gaudi/Makefile +1 -0
@@ -3,4 +3,5 @@ HL_GAUDI_FILES := gaudi/gaudi.o gaudi/gaudi_hwmgr.o gaudi/gaudi_security.o \ gaudi/gaudi_coresight.o HL_GAUDI_FILES += gaudi/gaudi_nic.o gaudi/gaudi_phy.o \ + gaudi/gaudi_nic_ethtool.o \ gaudi/gaudi_nic_debugfs.o
drivers/misc/habanalabs/gaudi/gaudi.c +1 -0
@@ -1043,6 +1043,7 @@ static int gaudi_sw_init(struct hl_device *hdev) gaudi->cpucp_info_get = gaudi_cpucp_info_get; gaudi->nic_handle_rx = gaudi_nic_handle_rx; gaudi->nic_handle_tx = gaudi_nic_handle_tx; + gaudi->nic_spmu_init = gaudi_nic_spmu_init; gaudi->max_freq_value =GAUDI_MAX_CLK_FREQ ;
drivers/misc/habanalabs/gaudi/gaudiP.h +7 -0
@@ -438,6 +438,7 @@ struct gaudi_internal_qman_info {* @cpucp_info_get: get information on device from CPU-CP * @nic_handle_rx: NIC handler for incoming packet. * @nic_handle_tx: NIC handler for outgoing packet. +* @nic_spmu_init: initialize NIC CoreSight spmu counters. * @nic_devices: array that holds all NIC ports manage structures. * @nic_macros: array that holds all NIC macros manage structures. * @nic_pam4_tx_taps: array that holds all PAM4 Tx taps of all NIC lanes.
@@ -502,6 +503,7 @@ struct gaudi_device {int (*cpucp_info_get)(struct hl_device *hdev);void (*nic_handle_rx)(struct gaudi_nic_device *gaudi_nic);int (*nic_handle_tx)(struct gaudi_nic_device *gaudi_nic,void *data); +void (*nic_spmu_init)(struct hl_device *hdev,int port);struct gaudi_nic_device nic_devices[NIC_NUMBER_OF_PORTS ];struct gaudi_nic_macro nic_macros[NIC_NUMBER_OF_MACROS ];struct gaudi_nic_tx_taps nic_pam4_tx_taps[NIC_MAX_NUM_OF_LANES ];
@@ -576,8 +578,13 @@ irqreturn_t gaudi_nic_rx_irq_handler(int irq, void *arg);irqreturn_t gaudi_nic_cq_irq_handler (int irq,void *arg);netdev_tx_t gaudi_nic_handle_tx_pkt (struct gaudi_nic_device *gaudi_nic,struct sk_buff *skb); +void gaudi_nic_spmu_init (struct hl_device *hdev,int port);int gaudi_nic_sw_init (struct hl_device *hdev);void gaudi_nic_sw_fini (struct hl_device *hdev);void gaudi_nic_handle_qp_err (struct hl_device *hdev,u16 event_type); +int gaudi_config_spmu_nic (struct hl_device *hdev,u32 port, +u32 num_event_types,u32 event_types[]); +int gaudi_sample_spmu_nic (struct hl_device *hdev,u32 port, +u32 num_out_data,u64 out_data[]);#endif /* GAUDIP_H_ */
drivers/misc/habanalabs/gaudi/gaudi_coresight.c +144 -0
168 lines not on this page · raw message
drivers/misc/habanalabs/gaudi/gaudi_nic.c +5 -0
@@ -2744,6 +2744,7 @@ static int port_register(struct hl_device *hdev, int port) ndev->dev_port = port; ndev->netdev_ops = &gaudi_nic_netdev_ops; + ndev->ethtool_ops = &gaudi_nic_ethtool_ops; ndev->watchdog_timeo =NIC_TX_TIMEOUT ; ndev->min_mtu =ETH_MIN_MTU ; ndev->max_mtu =NIC_MAX_MTU ;
@@ -2769,6 +2770,8 @@ static int port_register(struct hl_device *hdev, int port) port); } + gaudi->nic_spmu_init (hdev, port); +if (register_netdev (ndev)) {dev_err (hdev->dev,"Could not register netdevice, port: %d\n" , port);
@@ -3233,6 +3236,8 @@ void gaudi_nic_ports_reopen(struct hl_device *hdev)continue ; } + gaudi->nic_spmu_init (hdev, port); +schedule_delayed_work (&gaudi_nic->port_open_work,msecs_to_jiffies (1 )); }
drivers/misc/habanalabs/gaudi/gaudi_nic_ethtool.c new file +582 -0
582 lines not on this page · raw message
Signature · 1 line
2.17.1
PATCH 11/15 habanalabs/gaudi: add QP error handling
In reply to Oded GabbayFrom: Omer Shpigelman <[email protected]>
Add Queue Pair (QP) error notification to the user e.g. security violation, too many retransmissions, invalid QP etc.
Whenever a QP caused an error, the firmware will send an event to the driver which will push the error as an error entry to the Completion Queue (if exists).
--- drivers/misc/habanalabs/gaudi/gaudi.c | 13 ++++ drivers/misc/habanalabs/gaudi/gaudiP.h | 1 + drivers/misc/habanalabs/gaudi/gaudi_nic.c | 93 +++++++++++++++++++++++ 3 files changed, 107 insertions(+)
drivers/misc/habanalabs/gaudi/gaudi.c +13 -0
@@ -6658,6 +6658,19 @@ static void gaudi_handle_eqe(struct hl_device *hdev,hl_fw_unmask_irq (hdev, event_type);break ; +case GAUDI_EVENT_NIC0_QP0 : +case GAUDI_EVENT_NIC0_QP1 : +case GAUDI_EVENT_NIC1_QP0 : +case GAUDI_EVENT_NIC1_QP1 : +case GAUDI_EVENT_NIC2_QP0 : +case GAUDI_EVENT_NIC2_QP1 : +case GAUDI_EVENT_NIC3_QP0 : +case GAUDI_EVENT_NIC3_QP1 : +case GAUDI_EVENT_NIC4_QP0 : +case GAUDI_EVENT_NIC4_QP1 : +gaudi_nic_handle_qp_err (hdev, event_type); +break ; +case GAUDI_EVENT_PSOC_GPIO_U16_0 : cause =le64_to_cpu (eq_entry->data[0 ]) &0xFF ; dev_err(hdev->dev,
drivers/misc/habanalabs/gaudi/gaudiP.h +1 -0
@@ -578,5 +578,6 @@ netdev_tx_t gaudi_nic_handle_tx_pkt(struct gaudi_nic_device *gaudi_nic, struct sk_buff *skb);int gaudi_nic_sw_init (struct hl_device *hdev);void gaudi_nic_sw_fini (struct hl_device *hdev); +void gaudi_nic_handle_qp_err (struct hl_device *hdev,u16 event_type);#endif /* GAUDIP_H_ */
drivers/misc/habanalabs/gaudi/gaudi_nic.c +93 -0
96 lines not on this page · raw message
Signature · 1 line
2.17.1
PATCH 9/15 habanalabs/gaudi: add CQ control operations
In reply to Oded GabbayFrom: Omer Shpigelman <[email protected]>
Add NIC Completion Queue (CQ) opcodes to NIC ioctl. The CQ is used by the user-space process to get notification of a completed work.
A CQ entry (CQE) has three types: requester (sender), responder (receiver) and error. Each type has unique fields as well as shared ones.
Currently only a single user CQ is supported but it may be extended in the future, hence proper locking was added as well. In addition, an error interrupt was added to identify CQ overrun.
The added opcodes are:
- Create CQ
- Destroy CQ
- Wait on CQ: sleeps until CQEs are available in the buffer.
- Poll CQ: check if there are available CQEs in the buffer. It is a non-blocking function.
- Update consumed CQEs: The user informs the driver regarding processed CQEs so these can be overridden by the driver.
--- drivers/misc/habanalabs/common/device.c | 6 +- drivers/misc/habanalabs/common/habanalabs.h | 3 + .../misc/habanalabs/common/habanalabs_ioctl.c | 20 +- drivers/misc/habanalabs/gaudi/gaudi.c | 1 + drivers/misc/habanalabs/gaudi/gaudiP.h | 1 + drivers/misc/habanalabs/gaudi/gaudi_nic.c | 592 ++++++++++++++++++ drivers/misc/habanalabs/goya/goya.c | 8 + include/uapi/misc/habanalabs.h | 111 ++++ 8 files changed, 739 insertions(+), 3 deletions(-)
drivers/misc/habanalabs/common/device.c +5 -1
@@ -117,12 +117,13 @@ static int hl_device_release_ctrl(struct inode *inode, struct file *filp)* @*filp: pointer to file structure * @*vma: pointer to vm_area_struct of the process * -* Called when process does an mmap on habanalabs device. Call the device's mmap +* Called when process does an mmap on habanalabs device. Call the relevant mmap * function at the end of the common code. */ static int hl_mmap (struct file *filp,struct vm_area_struct *vma) {struct hl_fpriv *hpriv = filp->private_data; +struct hl_device *hdev = hpriv->hdev;unsigned long vm_pgoff; vm_pgoff = vma->vm_pgoff;
@@ -131,6 +132,9 @@ static int hl_mmap(struct file *filp, struct vm_area_struct *vma)switch (vm_pgoff &HL_MMAP_TYPE_MASK ) {case HL_MMAP_TYPE_CB :return hl_cb_mmap (hpriv, vma); + +case HL_MMAP_TYPE_NIC_CQ : +return hdev->asic_funcs->nic_cq_mmap (hdev, vma); }return -EINVAL ;
drivers/misc/habanalabs/common/habanalabs.h +3 -0
@@ -32,6 +32,7 @@#define HL_MMAP_TYPE_SHIFT (62 - PAGE_SHIFT)#define HL_MMAP_TYPE_MASK (0x3ull << HL_MMAP_TYPE_SHIFT)#define HL_MMAP_TYPE_CB (0x2ull << HL_MMAP_TYPE_SHIFT) +#define HL_MMAP_TYPE_NIC_CQ (0x1ull << HL_MMAP_TYPE_SHIFT)#define HL_MMAP_OFFSET_VALUE_MASK (0x3FFFFFFFFFFFull >> PAGE_SHIFT)#define HL_MMAP_OFFSET_VALUE_GET (off) (off & HL_MMAP_OFFSET_VALUE_MASK)
@@ -680,6 +681,7 @@ struct hl_info_mac_addr;* ASIC * @get_hw_state: retrieve the H/W state * @nic_control: Perform NIC related operations. +* @nic_cq_mmap: map the NIC CQ buffer. * @pci_bars_map: Map PCI BARs. * @init_iatu: Initialize the iATU unit inside the PCI controller. * @get_mac_addr: Get list of MAC addresses.
@@ -786,6 +788,7 @@ struct hl_asic_funcs {enum hl_device_hw_state (*get_hw_state)(struct hl_device *hdev);int (*nic_control)(struct hl_device *hdev,u32 op,void *input,void *output); +int (*nic_cq_mmap)(struct hl_device *hdev,struct vm_area_struct *vma);int (*pci_bars_map)(struct hl_device *hdev);int (*init_iatu)(struct hl_device *hdev); int (*get_mac_addr)(struct hl_device *hdev,
drivers/misc/habanalabs/common/habanalabs_ioctl.c +18 -2
@@ -24,18 +24,29 @@ static u32 hl_debug_struct_size[HL_DEBUG_OP_TIMESTAMP + 1] = { }; -static u32 hl_nic_input_size[HL_NIC_OP_DESTROY_CONN +1 ] = { +static u32 hl_nic_input_size[HL_NIC_OP_CQ_UPDATE_CONSUMED_CQES +1 ] = { [HL_NIC_OP_ALLOC_CONN ] =sizeof (struct hl_nic_alloc_conn_in ), [HL_NIC_OP_SET_REQ_CONN_CTX ] =sizeof (struct hl_nic_req_conn_ctx_in ), [HL_NIC_OP_SET_RES_CONN_CTX ] =sizeof (struct hl_nic_res_conn_ctx_in ), [HL_NIC_OP_DESTROY_CONN ] =sizeof (struct hl_nic_destroy_conn_in ), + [HL_NIC_OP_CQ_CREATE ] =sizeof (struct hl_nic_cq_create_in ), + [HL_NIC_OP_CQ_DESTROY ] =sizeof (struct hl_nic_cq_destroy_in ), + [HL_NIC_OP_CQ_WAIT ] =sizeof (struct hl_nic_cq_poll_wait_in ), + [HL_NIC_OP_CQ_POLL ] =sizeof (struct hl_nic_cq_poll_wait_in ), + [HL_NIC_OP_CQ_UPDATE_CONSUMED_CQES ] = +sizeof (struct hl_nic_cq_update_consumed_cqes_in ), }; -static u32 hl_nic_output_size[HL_NIC_OP_DESTROY_CONN +1 ] = { +static u32 hl_nic_output_size[HL_NIC_OP_CQ_UPDATE_CONSUMED_CQES +1 ] = { [HL_NIC_OP_ALLOC_CONN ] =sizeof (struct hl_nic_alloc_conn_out ), [HL_NIC_OP_SET_REQ_CONN_CTX ] =0 , [HL_NIC_OP_SET_RES_CONN_CTX ] =0 , [HL_NIC_OP_DESTROY_CONN ] =0 , + [HL_NIC_OP_CQ_CREATE ] =sizeof (struct hl_nic_cq_create_out ), + [HL_NIC_OP_CQ_DESTROY ] =0 , + [HL_NIC_OP_CQ_WAIT ] =sizeof (struct hl_nic_cq_poll_wait_out ), + [HL_NIC_OP_CQ_POLL ] =sizeof (struct hl_nic_cq_poll_wait_out ), + [HL_NIC_OP_CQ_UPDATE_CONSUMED_CQES ] =0 , };static int device_status_info (struct hl_device *hdev,struct hl_info_args *args)
@@ -625,6 +636,11 @@ static int hl_nic_ioctl(struct hl_fpriv *hpriv, void *data)case HL_NIC_OP_SET_REQ_CONN_CTX :case HL_NIC_OP_SET_RES_CONN_CTX :case HL_NIC_OP_DESTROY_CONN : +case HL_NIC_OP_CQ_CREATE : +case HL_NIC_OP_CQ_DESTROY : +case HL_NIC_OP_CQ_WAIT : +case HL_NIC_OP_CQ_POLL : +case HL_NIC_OP_CQ_UPDATE_CONSUMED_CQES : args->input_size =min (args->input_size, hl_nic_input_size[args->op]); args->output_size =
drivers/misc/habanalabs/gaudi/gaudi.c +1 -0
@@ -7469,6 +7469,7 @@ static const struct hl_asic_funcs gaudi_funcs = { .send_cpu_message = gaudi_send_cpu_message, .get_hw_state = gaudi_get_hw_state, .nic_control = gaudi_nic_control, + .nic_cq_mmap = gaudi_nic_cq_mmap, .pci_bars_map = gaudi_pci_bars_map, .init_iatu = gaudi_init_iatu, .get_mac_addr = gaudi_nic_get_mac_addr,
drivers/misc/habanalabs/gaudi/gaudiP.h +1 -0
@@ -571,6 +571,7 @@ int gaudi_nic_get_mac_addr(struct hl_device *hdev,int gaudi_nic_control (struct hl_device *hdev,u32 op,void *input,void *output);void gaudi_nic_ctx_fini (struct hl_ctx *ctx); +int gaudi_nic_cq_mmap (struct hl_device *hdev,struct vm_area_struct *vma);irqreturn_t gaudi_nic_rx_irq_handler (int irq,void *arg);irqreturn_t gaudi_nic_cq_irq_handler (int irq,void *arg); netdev_tx_t gaudi_nic_handle_tx_pkt(struct gaudi_nic_device *gaudi_nic,
drivers/misc/habanalabs/gaudi/gaudi_nic.c +592 -0
638 lines not on this page · raw message
drivers/misc/habanalabs/goya/goya.c +8 -0
@@ -5273,6 +5273,13 @@ static int goya_nic_control(struct hl_device *hdev, u32 op, void *input,return -ENXIO ; } +static int goya_nic_mmap (struct hl_device *hdev,struct vm_area_struct *vma) +{ +dev_err_ratelimited (hdev->dev, +"NIC mmap operations cannot be performed on Goya\n" ); +return -ENXIO ; +} +static int goya_get_mac_addr (struct hl_device *hdev,struct hl_info_mac_addr *mac_addr) {
@@ -5399,6 +5406,7 @@ static const struct hl_asic_funcs goya_funcs = { .send_cpu_message = goya_send_cpu_message, .get_hw_state = goya_get_hw_state, .nic_control = goya_nic_control, + .nic_cq_mmap = goya_nic_mmap, .pci_bars_map = goya_pci_bars_map, .init_iatu = goya_init_iatu, .get_mac_addr = goya_get_mac_addr,
include/uapi/misc/habanalabs.h +111 -0
139 lines not on this page · raw message
Signature · 1 line
2.17.1
PATCH 1/15 habanalabs/gaudi: add NIC H/W and registers definitions
In reply to Oded GabbayFrom: Omer Shpigelman <[email protected]>
Add auto-generated header files that describe the NIC registers used by the driver.
Add also NIC H/W definitions regarding the number of engines, number of ports, habanalabs MAC OUI, etc
--- .../include/gaudi/asic_reg/gaudi_regs.h | 26 +- .../include/gaudi/asic_reg/nic0_qm0_masks.h | 800 +++++++++++++++++ .../include/gaudi/asic_reg/nic0_qm0_regs.h | 834 ++++++++++++++++++ .../include/gaudi/asic_reg/nic0_qm1_regs.h | 834 ++++++++++++++++++ .../include/gaudi/asic_reg/nic0_qpc0_masks.h | 500 +++++++++++ .../include/gaudi/asic_reg/nic0_qpc0_regs.h | 710 +++++++++++++++ .../include/gaudi/asic_reg/nic0_qpc1_regs.h | 710 +++++++++++++++ .../include/gaudi/asic_reg/nic0_rxb_regs.h | 508 +++++++++++ .../include/gaudi/asic_reg/nic0_rxe0_masks.h | 354 ++++++++ .../include/gaudi/asic_reg/nic0_rxe0_regs.h | 158 ++++ .../include/gaudi/asic_reg/nic0_rxe1_regs.h | 158 ++++ .../include/gaudi/asic_reg/nic0_stat_regs.h | 518 +++++++++++ .../include/gaudi/asic_reg/nic0_tmr_regs.h | 184 ++++ .../include/gaudi/asic_reg/nic0_txe0_masks.h | 336 +++++++ .../include/gaudi/asic_reg/nic0_txe0_regs.h | 264 ++++++ .../include/gaudi/asic_reg/nic0_txe1_regs.h | 264 ++++++ .../include/gaudi/asic_reg/nic0_txs0_masks.h | 336 +++++++ .../include/gaudi/asic_reg/nic0_txs0_regs.h | 214 +++++ .../include/gaudi/asic_reg/nic0_txs1_regs.h | 214 +++++ .../include/gaudi/asic_reg/nic1_qm0_regs.h | 834 ++++++++++++++++++ .../include/gaudi/asic_reg/nic1_qm1_regs.h | 834 ++++++++++++++++++ .../include/gaudi/asic_reg/nic2_qm0_regs.h | 834 ++++++++++++++++++ .../include/gaudi/asic_reg/nic2_qm1_regs.h | 834 ++++++++++++++++++ .../include/gaudi/asic_reg/nic3_qm0_regs.h | 834 ++++++++++++++++++ .../include/gaudi/asic_reg/nic3_qm1_regs.h | 834 ++++++++++++++++++ .../include/gaudi/asic_reg/nic4_qm0_regs.h | 834 ++++++++++++++++++ .../include/gaudi/asic_reg/nic4_qm1_regs.h | 834 ++++++++++++++++++ drivers/misc/habanalabs/include/gaudi/gaudi.h | 12 + .../habanalabs/include/gaudi/gaudi_masks.h | 15 + .../include/hw_ip/nic/nic_general.h | 13 + 30 files changed, 14633 insertions(+), 1 deletion(-) create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qm0_masks.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qm0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qm1_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qpc0_masks.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qpc0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qpc1_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_rxb_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_rxe0_masks.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_rxe0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_rxe1_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_stat_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_tmr_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txe0_masks.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txe0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txe1_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txs0_masks.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txs0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txs1_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic1_qm0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic1_qm1_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic2_qm0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic2_qm1_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic3_qm0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic3_qm1_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic4_qm0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic4_qm1_regs.h create mode 100644 drivers/misc/habanalabs/include/hw_ip/nic/nic_general.h
drivers/misc/habanalabs/include/gaudi/asic_reg/gaudi_regs.h +25 -1
@@ -89,7 +89,31 @@#include "tpc0_cfg_masks.h" #include "psoc_global_conf_masks.h" -#include "psoc_pci_pll_regs.h" +#include "nic0_qm0_regs.h" +#include "nic1_qm0_regs.h" +#include "nic2_qm0_regs.h" +#include "nic3_qm0_regs.h" +#include "nic4_qm0_regs.h" +#include "nic0_qm1_regs.h" +#include "nic1_qm1_regs.h" +#include "nic2_qm1_regs.h" +#include "nic3_qm1_regs.h" +#include "nic4_qm1_regs.h" +#include "nic0_txs0_regs.h" +#include "nic0_txe0_regs.h" +#include "nic0_qpc0_regs.h" +#include "nic0_qpc1_regs.h" +#include "nic0_rxe0_regs.h" +#include "nic0_rxb_regs.h" +#include "nic0_tmr_regs.h" +#include "nic0_stat_regs.h" + +#include "nic0_qm0_masks.h" +#include "nic0_rxe0_masks.h" +#include "nic0_qpc0_masks.h" +#include "nic0_txs0_masks.h" +#include "nic0_txe0_masks.h" +#include "psoc_hbm_pll_regs.h" #include "psoc_cpu_pll_regs.h"
drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qm0_masks.h new file +800 -0
800 lines not on this page · raw message
drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qm0_regs.h new file +834 -0
834 lines not on this page · raw message
drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qm1_regs.h new file +834 -0
834 lines not on this page · raw message
drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qpc0_masks.h new file +500 -0
500 lines not on this page · raw message
drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qpc0_regs.h new file +710 -0
710 lines not on this page · raw message
drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qpc1_regs.h new file +710 -0
710 lines not on this page · raw message
drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_rxb_regs.h new file +508 -0
508 lines not on this page · raw message
drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_rxe0_masks.h new file +354 -0
354 lines not on this page · raw message
drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_rxe0_regs.h new file +158 -0
158 lines not on this page · raw message
drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_rxe1_regs.h new file +158 -0
158 lines not on this page · raw message
drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_stat_regs.h new file +518 -0
518 lines not on this page · raw message
drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_tmr_regs.h new file +184 -0
184 lines not on this page · raw message
drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txe0_masks.h new file +336 -0
336 lines not on this page · raw message
drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txe0_regs.h new file +264 -0
264 lines not on this page · raw message
drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txe1_regs.h new file +264 -0
264 lines not on this page · raw message
drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txs0_masks.h new file +336 -0
336 lines not on this page · raw message
drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txs0_regs.h new file +214 -0
214 lines not on this page · raw message
drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txs1_regs.h new file +214 -0
214 lines not on this page · raw message
drivers/misc/habanalabs/include/gaudi/asic_reg/nic1_qm0_regs.h new file +834 -0
834 lines not on this page · raw message
drivers/misc/habanalabs/include/gaudi/asic_reg/nic1_qm1_regs.h new file +834 -0
834 lines not on this page · raw message
drivers/misc/habanalabs/include/gaudi/asic_reg/nic2_qm0_regs.h new file +834 -0
834 lines not on this page · raw message
drivers/misc/habanalabs/include/gaudi/asic_reg/nic2_qm1_regs.h new file +834 -0
834 lines not on this page · raw message
drivers/misc/habanalabs/include/gaudi/asic_reg/nic3_qm0_regs.h new file +834 -0
834 lines not on this page · raw message
drivers/misc/habanalabs/include/gaudi/asic_reg/nic3_qm1_regs.h new file +834 -0
834 lines not on this page · raw message
drivers/misc/habanalabs/include/gaudi/asic_reg/nic4_qm0_regs.h new file +834 -0
834 lines not on this page · raw message
drivers/misc/habanalabs/include/gaudi/asic_reg/nic4_qm1_regs.h new file +834 -0
834 lines not on this page · raw message
drivers/misc/habanalabs/include/gaudi/gaudi.h +12 -0
Lines of this file are not shown. View the raw message.
drivers/misc/habanalabs/include/gaudi/gaudi_masks.h +15 -0
Lines of this file are not shown. View the raw message.
drivers/misc/habanalabs/include/hw_ip/nic/nic_general.h new file +13 -0
Lines of this file are not shown. View the raw message.
The rest of this diff is not shown. View the raw message.
Signature · 1 line
2.17.1
Part of the diff is not shown here. View the raw message.
PATCH 2/15 habanalabs/gaudi: add NIC firmware-related definitions
In reply to Oded GabbayFrom: Omer Shpigelman <[email protected]>
Add new structures and messages that the driver use to interact with the firmware to receive information and events (errors) about GAUDI's NIC.
--- .../misc/habanalabs/include/common/cpucp_if.h | 34 ++++++++++++++++--- .../habanalabs/include/gaudi/gaudi_fw_if.h | 24 +++++++++++++ 2 files changed, 54 insertions(+), 4 deletions(-)
drivers/misc/habanalabs/include/common/cpucp_if.h +30 -4
@@ -9,6 +9,7 @@#define CPUCP_IF_H #include <linux/types.h> +#include <linux/if_ether.h> /* * EVENT QUEUE
@@ -199,6 +200,11 @@ enum pq_init_status {* CpuCP to write to the structure, to prevent data corruption in case of * mismatched driver/FW versions. * +* CPUCP_PACKET_NIC_INFO_GET - +* Fetch information from the device regarding the NIC. the host's driver +* passes the max size it allows the CpuCP to write to the structure, to +* prevent data corruption in case of mismatched driver/FW versions. +* * CPUCP_PACKET_TEMPERATURE_SET - * Set the value of the offset property of a specified thermal sensor. * The packet's arguments specify the desired sensor and the field to
@@ -238,12 +244,12 @@ enum cpucp_packet_id {CPUCP_PACKET_MAX_POWER_GET ,/* sysfs */ CPUCP_PACKET_MAX_POWER_SET ,/* sysfs */ CPUCP_PACKET_EEPROM_DATA_GET ,/* sysfs */ -CPUCP_RESERVED , +CPUCP_PACKET_NIC_INFO_GET ,/* internal */ CPUCP_PACKET_TEMPERATURE_SET ,/* sysfs */ CPUCP_PACKET_VOLTAGE_SET ,/* sysfs */ CPUCP_PACKET_CURRENT_SET ,/* sysfs */ -CPUCP_PACKET_PCIE_THROUGHPUT_GET ,/* internal */ -CPUCP_PACKET_PCIE_REPLAY_CNT_GET ,/* internal */ +CPUCP_PACKET_PCIE_THROUGHPUT_GET ,/* internal */ +CPUCP_PACKET_PCIE_REPLAY_CNT_GET ,/* internal */ CPUCP_PACKET_TOTAL_ENERGY_GET, /* internal */ };
@@ -288,7 +294,7 @@ struct cpucp_packet {/* For led set */ __le32 led_index; -/* For get CpuCP info/EEPROM data */ +/* For get CpuCP info/EEPROM data/NIC info */ __le32 data_max_size; };
@@ -367,6 +373,12 @@ struct eq_generic_event {#define CARD_NAME_MAX_LEN 16#define VERSION_MAX_LEN 128#define CPUCP_MAX_SENSORS 128 +#define CPUCP_MAX_NICS 128 +#define CPUCP_LANES_PER_NIC 4 +#define CPUCP_NIC_QSFP_EEPROM_MAX_LEN 1024 +#define CPUCP_MAX_NIC_LANES (CPUCP_MAX_NICS * CPUCP_LANES_PER_NIC) +#define CPUCP_NIC_MASK_ARR_LEN ((CPUCP_MAX_NICS + 63) / 64) +#define CPUCP_NIC_POLARITY_ARR_LEN ((CPUCP_MAX_NIC_LANES + 63) / 64)struct cpucp_sensor {__le32 type;
@@ -415,4 +427,18 @@ struct cpucp_info { char card_name[CARD_NAME_MAX_LEN]; }; +struct cpucp_mac_addr { +__u8 mac_addr[ETH_ALEN ]; +}; + +struct cpucp_nic_info { +struct cpucp_mac_addr mac_addrs[CPUCP_MAX_NICS ]; +__le64 link_mask[CPUCP_NIC_MASK_ARR_LEN ]; +__le64 pol_tx_mask[CPUCP_NIC_POLARITY_ARR_LEN ]; +__le64 pol_rx_mask[CPUCP_NIC_POLARITY_ARR_LEN ]; +__le64 link_ext_mask[CPUCP_NIC_MASK_ARR_LEN ]; +__u8 qsfp_eeprom[CPUCP_NIC_QSFP_EEPROM_MAX_LEN ]; +__le64 auto_neg_mask[CPUCP_NIC_MASK_ARR_LEN ]; +}; +#endif /* CPUCP_IF_H */
drivers/misc/habanalabs/include/gaudi/gaudi_fw_if.h +24 -0
@@ -8,6 +8,8 @@#ifndef GAUDI_FW_IF_H #define GAUDI_FW_IF_H +#include <linux/types.h> +#define GAUDI_EVENT_QUEUE_MSI_IDX 8#define GAUDI_NIC_PORT1_MSI_IDX 10#define GAUDI_NIC_PORT3_MSI_IDX 12
@@ -31,6 +33,28 @@ enum gaudi_pll_index {IF_PLL }; +enum gaudi_nic_axi_error { +RXB , +RXE , +TXS , +TXE , +QPC_RESP , +NON_AXI_ERR , +}; + +/* +* struct eq_nic_sei_event - describes an AXI error cause. +* @axi_error_cause: one of the events defined in enum gaudi_nic_axi_error. +* @id: can be either 0 or 1, to further describe unit with interrupt cause +* (i.e. TXE0 or TXE1). +* @pad[6]: padding structure to 64bit. +*/ +struct eq_nic_sei_event { +__u8 axi_error_cause; +__u8 id; +__u8 pad[6 ]; +}; +#define GAUDI_PLL_FREQ_LOW 200000000/* 200 MHz */ #endif /* GAUDI_FW_IF_H */
Signature · 1 line
2.17.1
Jakub Kicinski
maintainerRe: [PATCH 12/15] habanalabs/gaudi: add debugfs entries for the NIC
In reply to Oded GabbayQuoted 19 lines · On Thu, 10 Sep 2020 19:11:23 +0300 Oded Gabbay wrote:
From: Omer Shpigelman <[email protected]>
Add several debugfs entries to help us debug the NIC engines and ports and also the communication layer of the DL training application that use them.
There are eight new entries. Detailed description is in the documentation file but here is a summary:
-
nic_mac_loopback: enable mac loopback mode per port
-nic_ports_status: print physical connection status per port
-nic_pcs_fail_time_frame: configure windows size for measuring pcs failures
-nic_pcs_fail_threshold: configure pcs failures threshold for reconfiguring the link
-nic_pam4_tx_taps: configure PAM4 TX taps
-nic_polarity: configure polarity for NIC port lanes
-nic_check_link: configure whether to check the PCS link periodically
-nic_phy_auto_neg_lpbk: enable PHY auto-negotiation loopback
Quoted 3 lines
Signed-off-by Omer Shpigelman <[email protected]>Reviewed-by Oded Gabbay <[email protected]>Signed-off-by Oded Gabbay <[email protected]>
debugfs configuration interfaces are not acceptable in netdev.
Jakub Kicinski
maintainerQuoted 25 lines · On Thu, 10 Sep 2020 19:11:11 +0300 Oded Gabbay wrote:
create mode 100644 drivers/misc/habanalabs/gaudi/gaudi_nic.c create mode 100644 drivers/misc/habanalabs/gaudi/gaudi_nic.h create mode 100644 drivers/misc/habanalabs/gaudi/gaudi_nic_dcbnl.c create mode 100644 drivers/misc/habanalabs/gaudi/gaudi_nic_debugfs.c create mode 100644 drivers/misc/habanalabs/gaudi/gaudi_nic_ethtool.c create mode 100644 drivers/misc/habanalabs/gaudi/gaudi_phy.c create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qm0_masks.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qm0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qm1_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qpc0_masks.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qpc0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qpc1_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_rxb_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_rxe0_masks.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_rxe0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_rxe1_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_stat_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_tmr_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txe0_masks.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txe0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txe1_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txs0_masks.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txs0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txs1_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic1_qm0_regs.h
Quoted 8 lines
create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic1_qm1_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic2_qm0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic2_qm1_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic3_qm0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic3_qm1_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic4_qm0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic4_qm1_regs.h create mode 100644 drivers/misc/habanalabs/include/hw_ip/nic/nic_general.h
The relevant code needs to live under drivers/net/(ethernet/). For one thing our automation won't trigger for drivers in random (/misc) part of the tree.
Jakub Kicinski
maintainerRe: [PATCH 05/15] habanalabs/gaudi: add NIC Ethernet support
In reply to Oded Gabbaydrivers/misc/habanalabs/common/habanalabs_drv.c module_param(reset_on_lockup, int, 0444); · line 44
Quoted 3 lines · On Thu, 10 Sep 2020 19:11:16 +0300 Oded Gabbay wrote:
drivers/misc/habanalabs/common/habanalabs_drv.c +3
-0+module_param (nic_rx_poll, int,0444 ); +MODULE_PARM_DESC (nic_rx_poll, +"Enable NIC Rx polling mode (0 = no, 1 = yes, default no)" );
If your chip does not support IRQ coalescing you can configure polling and the timeout via ethtool -C, rather than a module parameter.
Re: [PATCH 12/15] habanalabs/gaudi: add debugfs entries for the NIC
In reply to Jakub KicinskiQuoted 21 lines · Jakub Kicinski
Quoted 19 lines · On Thu, 10 Sep 2020 19:11:23 +0300 Oded Gabbay wrote:
From: Omer Shpigelman <[email protected]>
Add several debugfs entries to help us debug the NIC engines and ports and also the communication layer of the DL training application that use them.
There are eight new entries. Detailed description is in the documentation file but here is a summary:
-
nic_mac_loopback: enable mac loopback mode per port
-nic_ports_status: print physical connection status per port
-nic_pcs_fail_time_frame: configure windows size for measuring pcs failures
-nic_pcs_fail_threshold: configure pcs failures threshold for reconfiguring the link
-nic_pam4_tx_taps: configure PAM4 TX taps
-nic_polarity: configure polarity for NIC port lanes
-nic_check_link: configure whether to check the PCS link periodically
-nic_phy_auto_neg_lpbk: enable PHY auto-negotiation loopback
Quoted 5 lines
Quoted 3 lines
Signed-off-by Omer Shpigelman <[email protected]>Reviewed-by Oded Gabbay <[email protected]>Signed-off-by Oded Gabbay <[email protected]>debugfs configuration interfaces are not acceptable in netdev.
no problem, but can we have only these two entries:
Quoted 2 lines
-
nic_mac_loopback: enable mac loopback mode per port
-nic_ports_status: print physical connection status per port
nic_ports_status is print only (not configuration). nic_mac_loopback is to set a port to loopback mode and out of it. It's not really configuration but rather a mode change.
If not, what's the alternative ?
Thanks,
Oded
Jakub Kicinski
maintainerRe: [PATCH 12/15] habanalabs/gaudi: add debugfs entries for the NIC
Quoted 26 lines · On Thu, 10 Sep 2020 23:10:47 +0300 Oded Gabbay wrote:
Quoted 25 lines · Jakub Kicinski
Quoted 22 lines · On Thu, 10 Sep 2020 19:11:23 +0300 Oded Gabbay wrote:
From: Omer Shpigelman <[email protected]>
Add several debugfs entries to help us debug the NIC engines and ports and also the communication layer of the DL training application that use them.
There are eight new entries. Detailed description is in the documentation file but here is a summary:
-
nic_mac_loopback: enable mac loopback mode per port
-nic_ports_status: print physical connection status per port
-nic_pcs_fail_time_frame: configure windows size for measuring pcs failures
-nic_pcs_fail_threshold: configure pcs failures threshold for reconfiguring the link
-nic_pam4_tx_taps: configure PAM4 TX taps
-nic_polarity: configure polarity for NIC port lanes
-nic_check_link: configure whether to check the PCS link periodically
-nic_phy_auto_neg_lpbk: enable PHY auto-negotiation loopbackSigned-off-by Omer Shpigelman <[email protected]>Reviewed-by Oded Gabbay <[email protected]>Signed-off-by Oded Gabbay <[email protected]>
Quoted 7 lines
Quoted 1 line
debugfs configuration interfaces are not acceptable in netdev.
no problem, but can we have only these two entries:
Quoted 2 lines
-
nic_mac_loopback: enable mac loopback mode per port
-nic_ports_status: print physical connection status per port
nic_ports_statusis print only (not configuration).
Doesn't seem like this one shows any more information than can be queried with ethtool, right?
Quoted 3 lines
nic_mac_loopback
is to set a port to loopback mode and out of it. It's not really configuration but rather a mode change.
What is this loopback for? Testing?
Quoted 36 lines · Jakub Kicinski
Quoted 25 lines · On Thu, 10 Sep 2020 19:11:11 +0300 Oded Gabbay wrote:
create mode 100644 drivers/misc/habanalabs/gaudi/gaudi_nic.c create mode 100644 drivers/misc/habanalabs/gaudi/gaudi_nic.h create mode 100644 drivers/misc/habanalabs/gaudi/gaudi_nic_dcbnl.c create mode 100644 drivers/misc/habanalabs/gaudi/gaudi_nic_debugfs.c create mode 100644 drivers/misc/habanalabs/gaudi/gaudi_nic_ethtool.c create mode 100644 drivers/misc/habanalabs/gaudi/gaudi_phy.c create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qm0_masks.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qm0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qm1_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qpc0_masks.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qpc0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qpc1_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_rxb_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_rxe0_masks.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_rxe0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_rxe1_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_stat_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_tmr_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txe0_masks.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txe0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txe1_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txs0_masks.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txs0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txs1_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic1_qm0_regs.hQuoted 8 lines
create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic1_qm1_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic2_qm0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic2_qm1_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic3_qm0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic3_qm1_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic4_qm0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic4_qm1_regs.h create mode 100644 drivers/misc/habanalabs/include/hw_ip/nic/nic_general.h
Quoted 3 lines
The relevant code needs to live under drivers/net/(ethernet/). For one thing our automation won't trigger for drivers in random (/misc) part of the tree.
Can you please elaborate on how to do this with a single driver that is already in misc ?
As I mentioned in the cover letter, we are not developing a stand-alone NIC. We have a deep-learning accelerator with a NIC interface.
Therefore, we don't have a separate PCI physical function for the NIC and I can't have a second driver registering to it.
We did this design based on existing examples in the kernel (registering to netdev), such as (just a few examples):
1. sgi-xp driver in drivers/misc/sgi-xp (see file xpnet.c)
2. bnx2fc in drivers/scsi/bnx2fc
Thanks,
Oded
Re: [PATCH 12/15] habanalabs/gaudi: add debugfs entries for the NIC
In reply to Jakub KicinskiQuoted 30 lines · Jakub Kicinski
Quoted 28 lines · On Thu, 10 Sep 2020 23:10:47 +0300 Oded Gabbay wrote:
Quoted 26 lines · Jakub Kicinski
Quoted 19 lines · On Thu, 10 Sep 2020 19:11:23 +0300 Oded Gabbay wrote:
From: Omer Shpigelman <[email protected]>
Add several debugfs entries to help us debug the NIC engines and ports and also the communication layer of the DL training application that use them.
There are eight new entries. Detailed description is in the documentation file but here is a summary:
-
nic_mac_loopback: enable mac loopback mode per port
-nic_ports_status: print physical connection status per port
-nic_pcs_fail_time_frame: configure windows size for measuring pcs failures
-nic_pcs_fail_threshold: configure pcs failures threshold for reconfiguring the link
-nic_pam4_tx_taps: configure PAM4 TX taps
-nic_polarity: configure polarity for NIC port lanes
-nic_check_link: configure whether to check the PCS link periodically
-nic_phy_auto_neg_lpbk: enable PHY auto-negotiation loopbackQuoted 3 lines
Signed-off-by Omer Shpigelman <[email protected]>Reviewed-by Oded Gabbay <[email protected]>Signed-off-by Oded Gabbay <[email protected]>debugfs configuration interfaces are not acceptable in netdev.
Quoted 8 lines
Quoted 5 lines
no problem, but can we have only these two entries:
Quoted 2 lines
-
nic_mac_loopback: enable mac loopback mode per port
-nic_ports_status: print physical connection status per port
nic_ports_statusis print only (not configuration).Doesn't seem like this one shows any more information than can be queried with ethtool, right?
correct, it just displays it in a format that is much more readable
Quoted 6 lines
Quoted 4 lines
nic_mac_loopback
is to set a port to loopback mode and out of it. It's not really configuration but rather a mode change.What is this loopback for? Testing?
Correct.
Thanks,
Oded
Re: [PATCH 05/15] habanalabs/gaudi: add NIC Ethernet support
In reply to Jakub KicinskiQuoted 8 lines · Jakub Kicinski
drivers/misc/habanalabs/common/habanalabs_drv.c module_param(reset_on_lockup, int, 0444); · line 44
Quoted 3 lines · On Thu, 10 Sep 2020 19:11:16 +0300 Oded Gabbay wrote:
drivers/misc/habanalabs/common/habanalabs_drv.c +3
-0+module_param (nic_rx_poll, int,0444 ); +MODULE_PARM_DESC (nic_rx_poll, +"Enable NIC Rx polling mode (0 = no, 1 = yes, default no)" );If your chip does not support IRQ coalescing you can configure polling and the timeout via ethtool -C, rather than a module parameter.
Thanks for the pointer, we will take a look at that.
Oded
Re: [PATCH 13/15] habanalabs/gaudi: Add ethtool support using coresight
In reply to Oded Gabbaydrivers/misc/habanalabs/gaudi/gaudi_nic_ethtool.c line 194
Quoted 7 lines
drivers/misc/habanalabs/gaudi/gaudi_nic_ethtool.c new file +7
-0+static int gaudi_nic_get_link_ksettings (struct net_device *netdev, +struct ethtool_link_ksettings *cmd) +{ +struct gaudi_nic_device **ptr =netdev_priv (netdev); +struct gaudi_nic_device *gaudi_nic = *ptr; +struct hl_device *hdev = gaudi_nic->hdev; +u32 port = gaudi_nic->port, speed = gaudi_nic->speed;
Please go through the code and fixup Reverse Christmas tree.
Quoted 56 lines
drivers/misc/habanalabs/gaudi/gaudi_nic_ethtool.c new file +56
-0+ + cmd->base.speed = speed; + cmd->base.duplex =DUPLEX_FULL ; + +ethtool_link_ksettings_zero_link_mode (cmd, supported); +ethtool_link_ksettings_zero_link_mode (cmd, advertising); + + ethtool_add_mode(cmd, supported, 100000baseCR4_Full); + ethtool_add_mode(cmd, supported, 100000baseSR4_Full); + ethtool_add_mode(cmd, supported, 100000baseKR4_Full); + ethtool_add_mode(cmd, supported, 100000baseLR4_ER4_Full); + + ethtool_add_mode(cmd, supported, 50000baseSR2_Full); + ethtool_add_mode(cmd, supported, 50000baseCR2_Full); + ethtool_add_mode(cmd, supported, 50000baseKR2_Full); + +if (speed ==SPEED_100000 ) { + ethtool_add_mode(cmd, advertising, 100000baseCR4_Full); + ethtool_add_mode(cmd, advertising, 100000baseSR4_Full); + ethtool_add_mode(cmd, advertising, 100000baseKR4_Full); + ethtool_add_mode(cmd, advertising, 100000baseLR4_ER4_Full); + + cmd->base.port =PORT_FIBRE ; + +ethtool_add_mode (cmd, supported,FIBRE ); +ethtool_add_mode (cmd, advertising,FIBRE ); + +ethtool_add_mode (cmd, supported, Backplane); +ethtool_add_mode (cmd, advertising, Backplane); + }else if (speed ==SPEED_50000 ) { + ethtool_add_mode(cmd, advertising, 50000baseSR2_Full); + ethtool_add_mode(cmd, advertising, 50000baseCR2_Full); + ethtool_add_mode(cmd, advertising, 50000baseKR2_Full); + }else { +dev_err (hdev->dev,"unknown speed %d, port %d\n" , speed, port); +return -EFAULT ; + } + +ethtool_add_mode (cmd, supported, Autoneg); + +if (gaudi_nic->auto_neg_enable) { +ethtool_add_mode (cmd, advertising, Autoneg); + cmd->base.autoneg =AUTONEG_ENABLE ; +if (gaudi_nic->auto_neg_resolved) +ethtool_add_mode (cmd, lp_advertising, Autoneg); + }else { + cmd->base.autoneg =AUTONEG_DISABLE ; + } + +ethtool_add_mode (cmd, supported, Pause); + +if (gaudi_nic->pfc_enable) +ethtool_add_mode (cmd, advertising, Pause); + +return 0 ; +}
drivers/misc/habanalabs/gaudi/gaudi_nic_ethtool.c line 260
Quoted 10 lines
drivers/misc/habanalabs/gaudi/gaudi_nic_ethtool.c new file +10
-0+ +static int gaudi_nic_set_link_ksettings (struct net_device *netdev, +const struct ethtool_link_ksettings *cmd) +{ +struct gaudi_nic_device **ptr =netdev_priv (netdev); +struct gaudi_nic_device *gaudi_nic = *ptr; +struct hl_device *hdev = gaudi_nic->hdev; +u32 port = gaudi_nic->port; +int rc =0 , speed = cmd->base.speed; +bool auto_neg = cmd->base.autoneg ==AUTONEG_ENABLE ;
It appears you only support speed and auto_neg. You should check that all other things which could be configured are empty, e.g. none of the bits are set in cmd->link_modes.advertising. If you are requested to configure something which is not supported, you need to return -EOPNOTSUPP.
Andrew
Re: [PATCH 13/15] habanalabs/gaudi: Add ethtool support using coresight
Quoted 10 lines · Andrew Lunn
drivers/misc/habanalabs/gaudi/gaudi_nic_ethtool.c line 194
Quoted 8 lines
drivers/misc/habanalabs/gaudi/gaudi_nic_ethtool.c new file +7
-0+static int gaudi_nic_get_link_ksettings (struct net_device *netdev, +struct ethtool_link_ksettings *cmd) +{ +struct gaudi_nic_device **ptr =netdev_priv (netdev); +struct gaudi_nic_device *gaudi_nic = *ptr; +struct hl_device *hdev = gaudi_nic->hdev; +u32 port = gaudi_nic->port, speed = gaudi_nic->speed;Please go through the code and fixup Reverse Christmas tree.
Of course, we will fix this.
Quoted 74 lines
Quoted 57 lines
drivers/misc/habanalabs/gaudi/gaudi_nic_ethtool.c new file +56
-0+ + cmd->base.speed = speed; + cmd->base.duplex =DUPLEX_FULL ; + +ethtool_link_ksettings_zero_link_mode (cmd, supported); +ethtool_link_ksettings_zero_link_mode (cmd, advertising); + + ethtool_add_mode(cmd, supported, 100000baseCR4_Full); + ethtool_add_mode(cmd, supported, 100000baseSR4_Full); + ethtool_add_mode(cmd, supported, 100000baseKR4_Full); + ethtool_add_mode(cmd, supported, 100000baseLR4_ER4_Full); + + ethtool_add_mode(cmd, supported, 50000baseSR2_Full); + ethtool_add_mode(cmd, supported, 50000baseCR2_Full); + ethtool_add_mode(cmd, supported, 50000baseKR2_Full); + +if (speed ==SPEED_100000 ) { + ethtool_add_mode(cmd, advertising, 100000baseCR4_Full); + ethtool_add_mode(cmd, advertising, 100000baseSR4_Full); + ethtool_add_mode(cmd, advertising, 100000baseKR4_Full); + ethtool_add_mode(cmd, advertising, 100000baseLR4_ER4_Full); + + cmd->base.port =PORT_FIBRE ; + +ethtool_add_mode (cmd, supported,FIBRE ); +ethtool_add_mode (cmd, advertising,FIBRE ); + +ethtool_add_mode (cmd, supported, Backplane); +ethtool_add_mode (cmd, advertising, Backplane); + }else if (speed ==SPEED_50000 ) { + ethtool_add_mode(cmd, advertising, 50000baseSR2_Full); + ethtool_add_mode(cmd, advertising, 50000baseCR2_Full); + ethtool_add_mode(cmd, advertising, 50000baseKR2_Full); + }else { +dev_err (hdev->dev,"unknown speed %d, port %d\n" , speed, port); +return -EFAULT ; + } + +ethtool_add_mode (cmd, supported, Autoneg); + +if (gaudi_nic->auto_neg_enable) { +ethtool_add_mode (cmd, advertising, Autoneg); + cmd->base.autoneg =AUTONEG_ENABLE ; +if (gaudi_nic->auto_neg_resolved) +ethtool_add_mode (cmd, lp_advertising, Autoneg); + }else { + cmd->base.autoneg =AUTONEG_DISABLE ; + } + +ethtool_add_mode (cmd, supported, Pause); + +if (gaudi_nic->pfc_enable) +ethtool_add_mode (cmd, advertising, Pause); + +return 0 ; +}drivers/misc/habanalabs/gaudi/gaudi_nic_ethtool.c line 260
Quoted 10 lines
drivers/misc/habanalabs/gaudi/gaudi_nic_ethtool.c new file +10
-0+ +static int gaudi_nic_set_link_ksettings (struct net_device *netdev, +const struct ethtool_link_ksettings *cmd) +{ +struct gaudi_nic_device **ptr =netdev_priv (netdev); +struct gaudi_nic_device *gaudi_nic = *ptr; +struct hl_device *hdev = gaudi_nic->hdev; +u32 port = gaudi_nic->port; +int rc =0 , speed = cmd->base.speed; +bool auto_neg = cmd->base.autoneg ==AUTONEG_ENABLE ;It appears you only support speed and
auto_neg. You should check that all other things which could be configured are empty, e.g. none of the bits are set incmd->link_modes.advertising. If you are requested to configure something which is not supported, you need to return-EOPNOTSUPP.
Quoted 1 line
Andrew
Thanks Andrew,
We will do that and send an updated version.
Oded
Quoted 5 lines
Can you please elaborate on how to do this with a single driver that is already in misc ?
As I mentioned in the cover letter, we are not developing a stand-alone NIC. We have a deep-learning accelerator with a NIC interface.
This sounds like an MFD.
Andrew
Jakub Kicinski
maintainerRe: [PATCH 12/15] habanalabs/gaudi: add debugfs entries for the NIC
In reply to Oded GabbayQuoted 3 lines · On Thu, 10 Sep 2020 23:17:59 +0300 Oded Gabbay wrote:
Quoted 2 lines
Doesn't seem like this one shows any more information than can be queried with ethtool, right?
correct, it just displays it in a format that is much more readable
You can cat /sys/class/net/$ifc/carrier if you want 0/1.
Quoted 7 lines
Quoted 5 lines
Quoted 3 lines
nic_mac_loopback
is to set a port to loopback mode and out of it. It's not really configuration but rather a mode change.What is this loopback for? Testing?
Correct.
Loopback test is commonly implemented via ethtool -t
Re: [PATCH 12/15] habanalabs/gaudi: add debugfs entries for the NIC
Quoted 12 lines · Jakub Kicinski
Quoted 3 lines · On Thu, 10 Sep 2020 23:17:59 +0300 Oded Gabbay wrote:
Quoted 2 lines
Doesn't seem like this one shows any more information than can be queried with ethtool, right?
correct, it just displays it in a format that is much more readable
You can cat
/sys/class/net/$ifc/carrierif you want 0/1.Quoted 4 lines
Quoted 4 lines
Quoted 3 lines
nic_mac_loopback
is to set a port to loopback mode and out of it. It's not really configuration but rather a mode change.
Quoted 5 lines
Quoted 3 lines
Quoted 1 line
What is this loopback for? Testing?
Correct.
Loopback test is commonly implemented via ethtool -t
ok, thanks for the feedback, we will take a look at it and update the patch. Oded
Quoted 50 lines · Jakub Kicinski
Quoted 40 lines · On Thu, 10 Sep 2020 23:16:22 +0300 Oded Gabbay wrote:
Quoted 35 lines · Jakub Kicinski
Quoted 25 lines · On Thu, 10 Sep 2020 19:11:11 +0300 Oded Gabbay wrote:
create mode 100644 drivers/misc/habanalabs/gaudi/gaudi_nic.c create mode 100644 drivers/misc/habanalabs/gaudi/gaudi_nic.h create mode 100644 drivers/misc/habanalabs/gaudi/gaudi_nic_dcbnl.c create mode 100644 drivers/misc/habanalabs/gaudi/gaudi_nic_debugfs.c create mode 100644 drivers/misc/habanalabs/gaudi/gaudi_nic_ethtool.c create mode 100644 drivers/misc/habanalabs/gaudi/gaudi_phy.c create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qm0_masks.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qm0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qm1_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qpc0_masks.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qpc0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qpc1_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_rxb_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_rxe0_masks.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_rxe0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_rxe1_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_stat_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_tmr_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txe0_masks.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txe0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txe1_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txs0_masks.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txs0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txs1_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic1_qm0_regs.hQuoted 8 lines
create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic1_qm1_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic2_qm0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic2_qm1_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic3_qm0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic3_qm1_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic4_qm0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic4_qm1_regs.h create mode 100644 drivers/misc/habanalabs/include/hw_ip/nic/nic_general.hQuoted 3 lines
The relevant code needs to live under drivers/net/(ethernet/). For one thing our automation won't trigger for drivers in random (/misc) part of the tree.
Quoted 7 lines
Can you please elaborate on how to do this with a single driver that is already in misc ?
As I mentioned in the cover letter, we are not developing a stand-alone NIC. We have a deep-learning accelerator with a NIC interface.
Therefore, we don't have a separate PCI physical function for the NIC and I can't have a second driver registering to it.
Quoted 2 lines
Is it not possible to move the files and still build them into a single module?
hmm...
I actually didn't try that as I thought it will be very strange and I'm not familiar with other drivers that build as a single ko but have files spread out in different subsystems.
I don't feel it is a better option than what we did here.
Will I need to split pull requests to different subsystem maintainers ? For the same driver ?
Sounds to me this is not going to fly.
Thanks,
Oded
Quoted 9 lines
Quoted 8 lines
We did this design based on existing examples in the kernel (registering to netdev), such as (just a few examples):
1. sgi-xp driver indrivers/misc/sgi-xp(see filexpnet.c)
2. bnx2fc indrivers/scsi/bnx2fcThanks,
Oded
Quoted 10 lines · Andrew Lunn
Quoted 6 lines
Can you please elaborate on how to do this with a single driver that is already in misc ?
As I mentioned in the cover letter, we are not developing a stand-alone NIC. We have a deep-learning accelerator with a NIC interface.This sounds like an MFD.
Andrew
Yes and no. There is only one functionality - training of deep learning (Accelerating compute operations) :)
The rdma is just our method of scaling-out - our method of intra-connection between GAUDI devices (similar to NVlink or AMD crossfire).
So the H/W exposes a single physical function at the PCI level. And thus Linux can call a single driver for it during the PCI probe.
I hope that in future generations we will improve that, but it is what it is for GAUDI.
I don't see how to do it otherwise currently but if you have ideas please share. Oded
Quoted 12 lines · Oded Gabbay
Quoted 10 lines · Andrew Lunn
Quoted 6 lines
Can you please elaborate on how to do this with a single driver that is already in misc ?
As I mentioned in the cover letter, we are not developing a stand-alone NIC. We have a deep-learning accelerator with a NIC interface.This sounds like an MFD.
Andrew
Quoted 7 lines
Yes and no. There is only one functionality - training of deep learning (Accelerating compute operations) :)
The rdma is just our method of scaling-out - our method of intra-connection between GAUDI devices (similar to NVlink or AMD crossfire).
So the H/W exposes a single physical function at the PCI level. And thus Linux can call a single driver for it during the PCI probe.
Yes, it probes the MFD driver. The MFD driver then creates platform drivers for the sub functions. i.e. it would create an Ethernet platform driver. That then gets probed in the usual way. The child device can get access to the parent device, if it needs to share things, e.g. a device on a bus. This is typically I2C or SPI, but there is no reason it cannot be a PCI device.
Go look in drivers/mfd.
Andrew
Jakub Kicinski
maintainerQuoted 40 lines · On Thu, 10 Sep 2020 23:16:22 +0300 Oded Gabbay wrote:
Quoted 35 lines · Jakub Kicinski
Quoted 25 lines · On Thu, 10 Sep 2020 19:11:11 +0300 Oded Gabbay wrote:
create mode 100644 drivers/misc/habanalabs/gaudi/gaudi_nic.c create mode 100644 drivers/misc/habanalabs/gaudi/gaudi_nic.h create mode 100644 drivers/misc/habanalabs/gaudi/gaudi_nic_dcbnl.c create mode 100644 drivers/misc/habanalabs/gaudi/gaudi_nic_debugfs.c create mode 100644 drivers/misc/habanalabs/gaudi/gaudi_nic_ethtool.c create mode 100644 drivers/misc/habanalabs/gaudi/gaudi_phy.c create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qm0_masks.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qm0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qm1_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qpc0_masks.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qpc0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qpc1_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_rxb_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_rxe0_masks.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_rxe0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_rxe1_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_stat_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_tmr_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txe0_masks.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txe0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txe1_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txs0_masks.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txs0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txs1_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic1_qm0_regs.hQuoted 8 lines
create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic1_qm1_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic2_qm0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic2_qm1_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic3_qm0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic3_qm1_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic4_qm0_regs.h create mode 100644 drivers/misc/habanalabs/include/gaudi/asic_reg/nic4_qm1_regs.h create mode 100644 drivers/misc/habanalabs/include/hw_ip/nic/nic_general.hQuoted 3 lines
The relevant code needs to live under drivers/net/(ethernet/). For one thing our automation won't trigger for drivers in random (/misc) part of the tree.
Quoted 7 lines
Can you please elaborate on how to do this with a single driver that is already in misc ?
As I mentioned in the cover letter, we are not developing a stand-alone NIC. We have a deep-learning accelerator with a NIC interface.
Therefore, we don't have a separate PCI physical function for the NIC and I can't have a second driver registering to it.
Is it not possible to move the files and still build them into a single module?
Quoted 7 lines
We did this design based on existing examples in the kernel (registering to netdev), such as (just a few examples):
1. sgi-xp driver indrivers/misc/sgi-xp(see filexpnet.c)
2. bnx2fc indrivers/scsi/bnx2fcThanks,
Oded
Quoted 29 lines · Andrew Lunn
Quoted 12 lines · Oded Gabbay
Quoted 10 lines · Andrew Lunn
Quoted 6 lines
Can you please elaborate on how to do this with a single driver that is already in misc ?
As I mentioned in the cover letter, we are not developing a stand-alone NIC. We have a deep-learning accelerator with a NIC interface.This sounds like an MFD.
Andrew
Quoted 7 lines
Yes and no. There is only one functionality - training of deep learning (Accelerating compute operations) :)
The rdma is just our method of scaling-out - our method of intra-connection between GAUDI devices (similar to NVlink or AMD crossfire).
So the H/W exposes a single physical function at the PCI level. And thus Linux can call a single driver for it during the PCI probe.Yes, it probes the MFD driver. The MFD driver then creates platform drivers for the sub functions. i.e. it would create an Ethernet platform driver. That then gets probed in the usual way. The child device can get access to the parent device, if it needs to share things, e.g. a device on a bus. This is typically I2C or SPI, but there is no reason it cannot be a PCI device.
Quoted 3 lines
Go look in
drivers/mfd.Andrew
I'm slightly familiar with drivers/mfd and as you mentioned, those are for "simple" devices, which use a bus with different functionality on them, like I2C with many devices (sensors for various things, etc). I've never seen anyone doing a PCI device there and frankly, I don't see the benefit of trying to migrate our complex PCI driver to that subsystem, if it will even work.
And I would like to reiterate that our NIC ports are highly integrated with our compute engines.
They "talk" to each other via sync objects inside the SOC, and all of them are used as part of the training of the deep learning network. Another example why this is not MFD - when a compute engine gets stuck, all the NIC ports are going through reset.
So it's not the same as multiple devices that use the same bus or H/W. It's a single device with some engines that work in harmony. The bottom line is that we have single functionality and the scale-out is done via RDMA that is integrated on the device.
We could have chosen other ways to scale-out (like some proprietary bus) and then would that count as another functionality ? I think not.
So I'm not going to drivers/mfd with our driver. I wish that I had multiple PCI PF so I could do a proper Ethernet driver but I can't for this H/W.
And I think that physically splitting the files into two subsystems will be very hard to maintain and definitely I will want to hear Greg's opinion on that.
Thanks,
Oded
Quoted 59 lines · Oded Gabbay
Quoted 50 lines · Jakub Kicinski
Quoted 40 lines · On Thu, 10 Sep 2020 23:16:22 +0300 Oded Gabbay wrote:
Quoted 35 lines · Jakub Kicinski
Quoted 25 lines · On Thu, 10 Sep 2020 19:11:11 +0300 Oded Gabbay wrote:
create mode 100644
drivers/misc/habanalabs/gaudi/gaudi_nic.c
create mode 100644drivers/misc/habanalabs/gaudi/gaudi_nic.h
create mode 100644drivers/misc/habanalabs/gaudi/gaudi_nic_dcbnl.ccreate mode 100644drivers/misc/habanalabs/gaudi/gaudi_nic_debugfs.ccreate mode 100644drivers/misc/habanalabs/gaudi/gaudi_nic_ethtool.ccreate mode 100644drivers/misc/habanalabs/gaudi/gaudi_phy.c
create mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qm0_masks.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qm0_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qm1_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qpc0_masks.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qpc0_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qpc1_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_rxb_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_rxe0_masks.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_rxe0_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_rxe1_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_stat_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_tmr_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txe0_masks.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txe0_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txe1_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txs0_masks.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txs0_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txs1_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic1_qm0_regs.hQuoted 8 lines
create mode 100644
drivers/misc/habanalabs/include/gaudi/asic_reg/nic1_qm1_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic2_qm0_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic2_qm1_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic3_qm0_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic3_qm1_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic4_qm0_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic4_qm1_regs.hcreate mode 100644drivers/misc/habanalabs/include/hw_ip/nic/nic_general.hQuoted 3 lines
The relevant code needs to live under drivers/net/(ethernet/). For one thing our automation won't trigger for drivers in random (/misc) part of the tree.
Quoted 7 lines
Can you please elaborate on how to do this with a single driver that is already in misc ?
As I mentioned in the cover letter, we are not developing a stand-alone NIC. We have a deep-learning accelerator with a NIC interface.
Therefore, we don't have a separate PCI physical function for the NIC and I can't have a second driver registering to it.Quoted 2 lines
Is it not possible to move the files and still build them into a single module?
hmm...
I actually didn't try that as I thought it will be very strange and I'm not familiar with other drivers that build as a single ko but have files spread out in different subsystems.
I don't feel it is a better option than what we did here.
Quoted 3 lines
Will I need to split pull requests to different subsystem maintainers ? For the same driver ?
Sounds to me this is not going to fly.
Not necessarily, you can post your patches to all relevant lists and seek maintainer review/acked-by tags from the relevant maintainers. This is not unheard of with mlx5 for instance.
Have you considered using notifiers to get your NIC driver registered while the NIC code lives in a different module?
Signature · 1 line
Florian
Quoted 63 lines · Florian Fainelli
Quoted 59 lines · Oded Gabbay
Quoted 50 lines · Jakub Kicinski
Quoted 40 lines · On Thu, 10 Sep 2020 23:16:22 +0300 Oded Gabbay wrote:
Quoted 35 lines · Jakub Kicinski
Quoted 25 lines · On Thu, 10 Sep 2020 19:11:11 +0300 Oded Gabbay wrote:
create mode 100644
drivers/misc/habanalabs/gaudi/gaudi_nic.c
create mode 100644drivers/misc/habanalabs/gaudi/gaudi_nic.h
create mode 100644drivers/misc/habanalabs/gaudi/gaudi_nic_dcbnl.ccreate mode 100644drivers/misc/habanalabs/gaudi/gaudi_nic_debugfs.ccreate mode 100644drivers/misc/habanalabs/gaudi/gaudi_nic_ethtool.ccreate mode 100644drivers/misc/habanalabs/gaudi/gaudi_phy.c
create mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qm0_masks.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qm0_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qm1_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qpc0_masks.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qpc0_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qpc1_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_rxb_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_rxe0_masks.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_rxe0_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_rxe1_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_stat_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_tmr_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txe0_masks.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txe0_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txe1_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txs0_masks.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txs0_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txs1_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic1_qm0_regs.hQuoted 8 lines
create mode 100644
drivers/misc/habanalabs/include/gaudi/asic_reg/nic1_qm1_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic2_qm0_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic2_qm1_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic3_qm0_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic3_qm1_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic4_qm0_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic4_qm1_regs.hcreate mode 100644drivers/misc/habanalabs/include/hw_ip/nic/nic_general.hQuoted 3 lines
The relevant code needs to live under drivers/net/(ethernet/). For one thing our automation won't trigger for drivers in random (/misc) part of the tree.
Quoted 7 lines
Can you please elaborate on how to do this with a single driver that is already in misc ?
As I mentioned in the cover letter, we are not developing a stand-alone NIC. We have a deep-learning accelerator with a NIC interface.
Therefore, we don't have a separate PCI physical function for the NIC and I can't have a second driver registering to it.Quoted 2 lines
Is it not possible to move the files and still build them into a single module?
hmm...
I actually didn't try that as I thought it will be very strange and I'm not familiar with other drivers that build as a single ko but have files spread out in different subsystems.
I don't feel it is a better option than what we did here.
Quoted 7 lines
Quoted 3 lines
Will I need to split pull requests to different subsystem maintainers ? For the same driver ?
Sounds to me this is not going to fly.Not necessarily, you can post your patches to all relevant lists and seek maintainer review/acked-by tags from the relevant maintainers. This is not unheard of with mlx5 for instance.
Yeah, I see what you are saying, the problem is that sometimes, because everything is tightly integrated in our SOC, the patches contain code from common code (common to ALL our ASICs, even those who don't have NIC at all), GAUDI specific code which is not NIC related and the NIC code itself.
But I guess that as a last resort if this is a *must* I can do that. Though I would like to hear Greg's opinion on this as he is my current maintainer.
Personally I do want to send relevant patches to netdev because I want to get your expert reviews on them, but still keep the code in a single location.
Quoted 3 lines
Have you considered using notifiers to get your NIC driver registered while the NIC code lives in a different module?
Yes, and I prefered to keep it simple. I didn't want to start sending notifications to the NIC driver every time, for example, I needed to reset the SOC because a compute engine got stuck. Or vice-versa - when some error happened in the NIC to start sending notifications to the common driver.
In addition, from my AMD days, we had a very tough time managing two drivers that "talk" to each other and manage the same H/W. I'm talking about amdgpu for graphics and amdkfd for compute (which I was the maintainer). AMD is working in the past years to unite those two drivers to get out of that mess. That's why I didn't want to go down that road.
Thanks,
Oded
Quoted 2 lines
--
Florian
Quoted 80 lines · Oded Gabbay
Quoted 63 lines · Florian Fainelli
Quoted 59 lines · Oded Gabbay
Quoted 50 lines · Jakub Kicinski
Quoted 40 lines · On Thu, 10 Sep 2020 23:16:22 +0300 Oded Gabbay wrote:
Quoted 35 lines · Jakub Kicinski
Quoted 25 lines · On Thu, 10 Sep 2020 19:11:11 +0300 Oded Gabbay wrote:
create mode 100644
drivers/misc/habanalabs/gaudi/gaudi_nic.c
create mode 100644drivers/misc/habanalabs/gaudi/gaudi_nic.h
create mode 100644drivers/misc/habanalabs/gaudi/gaudi_nic_dcbnl.ccreate mode 100644drivers/misc/habanalabs/gaudi/gaudi_nic_debugfs.ccreate mode 100644drivers/misc/habanalabs/gaudi/gaudi_nic_ethtool.ccreate mode 100644drivers/misc/habanalabs/gaudi/gaudi_phy.c
create mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qm0_masks.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qm0_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qm1_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qpc0_masks.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qpc0_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_qpc1_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_rxb_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_rxe0_masks.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_rxe0_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_rxe1_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_stat_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_tmr_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txe0_masks.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txe0_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txe1_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txs0_masks.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txs0_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic0_txs1_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic1_qm0_regs.hQuoted 8 lines
create mode 100644
drivers/misc/habanalabs/include/gaudi/asic_reg/nic1_qm1_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic2_qm0_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic2_qm1_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic3_qm0_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic3_qm1_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic4_qm0_regs.hcreate mode 100644drivers/misc/habanalabs/include/gaudi/asic_reg/nic4_qm1_regs.hcreate mode 100644drivers/misc/habanalabs/include/hw_ip/nic/nic_general.hQuoted 3 lines
The relevant code needs to live under drivers/net/(ethernet/). For one thing our automation won't trigger for drivers in random (/misc) part of the tree.
Quoted 7 lines
Can you please elaborate on how to do this with a single driver that is already in misc ?
As I mentioned in the cover letter, we are not developing a stand-alone NIC. We have a deep-learning accelerator with a NIC interface.
Therefore, we don't have a separate PCI physical function for the NIC and I can't have a second driver registering to it.Quoted 2 lines
Is it not possible to move the files and still build them into a single module?
hmm...
I actually didn't try that as I thought it will be very strange and I'm not familiar with other drivers that build as a single ko but have files spread out in different subsystems.
I don't feel it is a better option than what we did here.Quoted 7 lines
Quoted 3 lines
Will I need to split pull requests to different subsystem maintainers ? For the same driver ?
Sounds to me this is not going to fly.Not necessarily, you can post your patches to all relevant lists and seek maintainer review/acked-by tags from the relevant maintainers. This is not unheard of with mlx5 for instance.
Yeah, I see what you are saying, the problem is that sometimes, because everything is tightly integrated in our SOC, the patches contain code from common code (common to ALL our ASICs, even those who don't have NIC at all), GAUDI specific code which is not NIC related and the NIC code itself.
But I guess that as a last resort if this is a *must* I can do that. Though I would like to hear Greg's opinion on this as he is my current maintainer.
Quoted 3 lines
Personally I do want to send relevant patches to netdev because I want to get your expert reviews on them, but still keep the code in a single location.
We do have network drivers sprinkled across the kernel tree already, but I would agree that from a networking maintainer perspective this makes auditing code harder, you would naturally grep for net/ and drivers/net and easily miss arch/uml/ for instance. When you do treewide changes, having all your ducklings in the same pond is a lot easier.
There is a possible "risk" with posting a patch series for the habanalabs driver to netdev that people will be wondering what this is about and completely miss it is about the networking bits. If there is a NIC driver under drivers/net then people will start to filter or pay attention based on the directory.
Quoted 10 lines
Quoted 4 lines
Have you considered using notifiers to get your NIC driver registered while the NIC code lives in a different module?
Yes, and I prefered to keep it simple. I didn't want to start sending notifications to the NIC driver every time, for example, I needed to reset the SOC because a compute engine got stuck. Or vice-versa - when some error happened in the NIC to start sending notifications to the common driver.
Quoted 6 lines
In addition, from my AMD days, we had a very tough time managing two drivers that "talk" to each other and manage the same H/W. I'm talking about amdgpu for graphics and amdkfd for compute (which I was the maintainer). AMD is working in the past years to unite those two drivers to get out of that mess. That's why I didn't want to go down that road.
You are trading an indirect call for a direct call, and it does provide some nice interface, but it could be challenging to work with given the context in which the notifier is called can be problematic. You could still have direct module references then, and that would avoid the need for notifiers.
You are the driver maintainer, so you definitively have a bigger say in the matter than most of us, drive by contributors.
Signature · 1 line
Florian
Greg Kroah-Hartman
maintainerQuoted 21 lines · Andrew Lunn
Quoted 12 lines · Oded Gabbay
Quoted 10 lines · Andrew Lunn
Quoted 6 lines
Can you please elaborate on how to do this with a single driver that is already in misc ?
As I mentioned in the cover letter, we are not developing a stand-alone NIC. We have a deep-learning accelerator with a NIC interface.This sounds like an MFD.
Andrew
Quoted 7 lines
Yes and no. There is only one functionality - training of deep learning (Accelerating compute operations) :)
The rdma is just our method of scaling-out - our method of intra-connection between GAUDI devices (similar to NVlink or AMD crossfire).
So the H/W exposes a single physical function at the PCI level. And thus Linux can call a single driver for it during the PCI probe.
Quoted 8 lines
Yes, it probes the MFD driver. The MFD driver then creates platform drivers for the sub functions. i.e. it would create an Ethernet platform driver. That then gets probed in the usual way. The child device can get access to the parent device, if it needs to share things, e.g. a device on a bus. This is typically I2C or SPI, but there is no reason it cannot be a PCI device.
Go look in
drivers/mfd.
Why do we keep going down this path each time this comes up...
No, mfd doesn't work for this case, but the "virtual bus" that gets posted ever once in a while would solve this issue. Hopefully one day the Intel developers will wake up and post it again here so that we can review it and hopefully merge it to solve this very common problem...
thanks,
greg k-h
RE: [PATCH 05/15] habanalabs/gaudi: add NIC Ethernet support
In reply to Jakub KicinskiQuoted 7 lines · Jakub Kicinski
Quoted 1 line · On Thu, 10 Sep 2020 19:11:16 +0300 Oded Gabbay wrote:
+module_param(nic_rx_poll, int, 0444);
MODULE_PARM_DESC(nic_rx_poll,
drivers/misc/habanalabs/common/habanalabs_drv.c module_param(reset_on_lockup, int, 0444); · line 44
Quoted 1 line
drivers/misc/habanalabs/common/habanalabs_drv.c +1
-0+ "Enable NIC Rx polling mode (0 = no, 1 = yes, default no)");If your chip does not support IRQ coalescing you can configure polling and the timeout via ethtool -C, rather than a module parameter.
I couldn't find an example for that in other drivers and I didn't see anything regarding polling mode in the parameters description of this ethtool callback. Can you please specify some pointer for that? Or in other words, what parameter can we use to enable polling/setting the timeout?
Thanks,
Omer
RE: [PATCH 12/15] habanalabs/gaudi: add debugfs entries for the NIC
In reply to Jakub KicinskiQuoted 11 lines · Jakub Kicinski
Quoted 3 lines · On Thu, 10 Sep 2020 23:17:59 +0300 Oded Gabbay wrote:
Quoted 2 lines
Doesn't seem like this one shows any more information than can be queried with ethtool, right?
correct, it just displays it in a format that is much more readable
You can cat
/sys/class/net/$ifc/carrierif you want 0/1.Quoted 4 lines
Quoted 4 lines
Quoted 3 lines
nic_mac_loopback
is to set a port to loopback mode and out of it. It's not really configuration but rather a mode change.
Quoted 5 lines
Quoted 3 lines
Quoted 1 line
What is this loopback for? Testing?
Correct.
Loopback test is commonly implemented via ethtool -t
This debugfs entry is only to set the port to loopback mode, not running a loopback test.
Hence IMO adding a private flag is more suitable here and please correct me if I'm wrong.
But either way, doing that from ethtool instead of debugfs is not a good practice in our case.
Due to HW limitations, when we switch a port to/from loopback mode, we need to reset the device.
Since ethtool works on specific interface rather than an entire device, we'll need to reset the device 10 times in order to switch the entire device to loopback mode. Moreover, running this command for one interface affects other interfaces which is not desirable when using ethtool AFAIK.
Is there any other acceptable debugfs-like mechanism for that?
Thanks,
Omer
Jakub Kicinski
maintainerRe: [PATCH 05/15] habanalabs/gaudi: add NIC Ethernet support
In reply to Omer ShpigelmanQuoted 9 lines · On Mon, 14 Sep 2020 09:52:00 +0000 Omer Shpigelman wrote:
Quoted 7 lines · Jakub Kicinski
Quoted 1 line · On Thu, 10 Sep 2020 19:11:16 +0300 Oded Gabbay wrote:
+module_param(nic_rx_poll, int, 0444);
MODULE_PARM_DESC(nic_rx_poll,
drivers/misc/habanalabs/common/habanalabs_drv.c module_param(reset_on_lockup, int, 0444); · line 44
Quoted 1 line
drivers/misc/habanalabs/common/habanalabs_drv.c +1
-0+ "Enable NIC Rx polling mode (0 = no, 1 = yes, default no)");If your chip does not support IRQ coalescing you can configure polling and the timeout via ethtool -C, rather than a module parameter.
Quoted 5 lines
I couldn't find an example for that in other drivers and I didn't see anything regarding polling mode in the parameters description of this ethtool callback.
Can you please specify some pointer for that? Or in other words, what parameter can we use to enable polling/setting the timeout?
Look at stmmac, hip04_eth..
Jakub Kicinski
maintainerRe: [PATCH 12/15] habanalabs/gaudi: add debugfs entries for the NIC
In reply to Omer ShpigelmanQuoted 18 lines · On Mon, 14 Sep 2020 13:48:14 +0000 Omer Shpigelman wrote:
Quoted 11 lines · Jakub Kicinski
Quoted 3 lines · On Thu, 10 Sep 2020 23:17:59 +0300 Oded Gabbay wrote:
Quoted 2 lines
Doesn't seem like this one shows any more information than can be queried with ethtool, right?
correct, it just displays it in a format that is much more readable
You can cat
/sys/class/net/$ifc/carrierif you want 0/1.Quoted 4 lines
Quoted 4 lines
Quoted 3 lines
nic_mac_loopback
is to set a port to loopback mode and out of it. It's not really configuration but rather a mode change.Quoted 5 lines
Quoted 3 lines
Quoted 1 line
What is this loopback for? Testing?
Correct.
Loopback test is commonly implemented via ethtool -t
Quoted 7 lines
This debugfs entry is only to set the port to loopback mode, not running a loopback test.
Hence IMO adding a private flag is more suitable here and please correct me if I'm wrong.
But either way, doing that from ethtool instead of debugfs is not a good practice in our case.
Due to HW limitations, when we switch a port to/from loopback mode, we need to reset the device.
Since ethtool works on specific interface rather than an entire device, we'll need to reset the device 10 times in order to switch the entire device to loopback mode. Moreover, running this command for one interface affects other interfaces which is not desirable when using ethtool AFAIK.
Is there any other acceptable debugfs-like mechanism for that?
What's the use for a networking device which only communicates with itself, other than testing?
Re: [PATCH 12/15] habanalabs/gaudi: add debugfs entries for the NIC
Quoted 28 lines · Jakub Kicinski
Quoted 18 lines · On Mon, 14 Sep 2020 13:48:14 +0000 Omer Shpigelman wrote:
Quoted 11 lines · Jakub Kicinski
Quoted 3 lines · On Thu, 10 Sep 2020 23:17:59 +0300 Oded Gabbay wrote:
Quoted 2 lines
Doesn't seem like this one shows any more information than can be queried with ethtool, right?
correct, it just displays it in a format that is much more readable
You can cat
/sys/class/net/$ifc/carrierif you want 0/1.Quoted 4 lines
Quoted 4 lines
Quoted 3 lines
nic_mac_loopback
is to set a port to loopback mode and out of it. It's not really configuration but rather a mode change.Quoted 5 lines
Quoted 3 lines
Quoted 1 line
What is this loopback for? Testing?
Correct.
Loopback test is commonly implemented via ethtool -t
Quoted 7 lines
This debugfs entry is only to set the port to loopback mode, not running a loopback test.
Hence IMO adding a private flag is more suitable here and please correct me if I'm wrong.
But either way, doing that from ethtool instead of debugfs is not a good practice in our case.
Due to HW limitations, when we switch a port to/from loopback mode, we need to reset the device.
Since ethtool works on specific interface rather than an entire device, we'll need to reset the device 10 times in order to switch the entire device to loopback mode. Moreover, running this command for one interface affects other interfaces which is not desirable when using ethtool AFAIK.
Is there any other acceptable debugfs-like mechanism for that?
Quoted 2 lines
What's the use for a networking device which only communicates with itself, other than testing?
No use, and we do have a suite of tests that runs from user-space on the device after we move the interfaces to loopback mode. The main problem, as Omer said, is that we have two H/W bugs:
1. Where you need to reset the entire SoC in case you want to move a single interface into (or out of) loopback mode. So doing it via ethtool will cause a reset to the entire SoC, and if you want to move all 10 ports to loopback mode, you need to reset the device 10 times before you can actually use that.
2. Our 10 ports are divided into 5 groups of 2 ports each, from H/W POV. That means if you move port 0 to loopback mode, it will affect port 1 (and vice-versa). I don't think we want that behavior.
That's why we need this specific exception to the rule and do it via debugfs. I understand it is not common practice, but due to H/W bugs we can't workaround, we ask this exception.
Thanks,
Oded
Jakub Kicinski
maintainerRe: [PATCH 12/15] habanalabs/gaudi: add debugfs entries for the NIC
Quoted 14 lines · On Tue, 15 Sep 2020 15:57:16 +0300 Oded Gabbay wrote:
Quoted 2 lines · Jakub Kicinski
What's the use for a networking device which only communicates with itself, other than testing?
No use, and we do have a suite of tests that runs from user-space on the device after we move the interfaces to loopback mode. The main problem, as Omer said, is that we have two H/W bugs:
1. Where you need to reset the entire SoC in case you want to move a single interface into (or out of) loopback mode. So doing it via ethtool will cause a reset to the entire SoC, and if you want to move all 10 ports to loopback mode, you need to reset the device 10 times before you can actually use that.
Quoted 7 lines
2. Our 10 ports are divided into 5 groups of 2 ports each, from H/W POV. That means if you move port 0 to loopback mode, it will affect port 1 (and vice-versa). I don't think we want that behavior.
That's why we need this specific exception to the rule and do it via debugfs. I understand it is not common practice, but due to H/W bugs we can't workaround, we ask this exception.
Are those tests open source?
Are you sure you need this upstream? Are your users going to run those tests?