Add octeon_ep driver
Subsystems (4)
Veerasenareddy Burru
maintainerv3 cover Add octeon_ep driver
This driver implements networking functionality of Marvell's Octeon PCI Endpoint NIC.
This driver support following devices:
* Network controller: Cavium, Inc. Device b200
V2 -> V3:
Fix warnings and errors reported by kernel test robot:
V1 -> V2:
Address review comments on original patch series. Divide PATCH 1/4 from the original series into 4 patches in v2 patch series: PATCH 1/7 to PATCH 4/7.
Fix clang build errors.
Veerasenareddy Burru (7):
octeon_ep: Add driver framework and device initialization
octeon_ep: add hardware configuration APIs
octeon_ep: Add mailbox for control commands
octeon_ep: add Tx/Rx ring resource setup and cleanup
octeon_ep: add support for ndo ops
octeon_ep: add Tx/Rx processing and interrupt support
octeon_ep: add ethtool support for Octeon PCI Endpoint NIC
.../device_drivers/ethernet/index.rst | 1 + .../ethernet/marvell/octeon_ep.rst | 35 + MAINTAINERS | 7 + drivers/net/ethernet/marvell/Kconfig | 1 + drivers/net/ethernet/marvell/Makefile | 1 + .../net/ethernet/marvell/octeon_ep/Kconfig | 20 + .../net/ethernet/marvell/octeon_ep/Makefile | 9 + .../marvell/octeon_ep/octep_cn9k_pf.c | 737 +++++++++++ .../ethernet/marvell/octeon_ep/octep_config.h | 204 +++ .../marvell/octeon_ep/octep_ctrl_mbox.c | 254 ++++ .../marvell/octeon_ep/octep_ctrl_mbox.h | 170 +++ .../marvell/octeon_ep/octep_ctrl_net.c | 197 +++ .../marvell/octeon_ep/octep_ctrl_net.h | 299 +++++ .../marvell/octeon_ep/octep_ethtool.c | 463 +++++++ .../ethernet/marvell/octeon_ep/octep_main.c | 1178 +++++++++++++++++ .../ethernet/marvell/octeon_ep/octep_main.h | 379 ++++++ .../marvell/octeon_ep/octep_regs_cn9k_pf.h | 367 +++++ .../net/ethernet/marvell/octeon_ep/octep_rx.c | 509 +++++++ .../net/ethernet/marvell/octeon_ep/octep_rx.h | 199 +++ .../net/ethernet/marvell/octeon_ep/octep_tx.c | 335 +++++ .../net/ethernet/marvell/octeon_ep/octep_tx.h | 284 ++++ 21 files changed, 5649 insertions(+) create mode 100644 Documentation/networking/device_drivers/ethernet/marvell/octeon_ep.rst create mode 100644 drivers/net/ethernet/marvell/octeon_ep/Kconfig create mode 100644 drivers/net/ethernet/marvell/octeon_ep/Makefile create mode 100644 drivers/net/ethernet/marvell/octeon_ep/octep_cn9k_pf.c create mode 100644 drivers/net/ethernet/marvell/octeon_ep/octep_config.h create mode 100644 drivers/net/ethernet/marvell/octeon_ep/octep_ctrl_mbox.c create mode 100644 drivers/net/ethernet/marvell/octeon_ep/octep_ctrl_mbox.h create mode 100644 drivers/net/ethernet/marvell/octeon_ep/octep_ctrl_net.c create mode 100644 drivers/net/ethernet/marvell/octeon_ep/octep_ctrl_net.h create mode 100644 drivers/net/ethernet/marvell/octeon_ep/octep_ethtool.c create mode 100644 drivers/net/ethernet/marvell/octeon_ep/octep_main.c create mode 100644 drivers/net/ethernet/marvell/octeon_ep/octep_main.h create mode 100644 drivers/net/ethernet/marvell/octeon_ep/octep_regs_cn9k_pf.h create mode 100644 drivers/net/ethernet/marvell/octeon_ep/octep_rx.c create mode 100644 drivers/net/ethernet/marvell/octeon_ep/octep_rx.h create mode 100644 drivers/net/ethernet/marvell/octeon_ep/octep_tx.c create mode 100644 drivers/net/ethernet/marvell/octeon_ep/octep_tx.h
base-commit: 669b258a793db9f1c3bff29ce2bbd61b810503ad
Signature · 1 line
2.17.1
Veerasenareddy Burru
maintainerPATCH v3 1/7 octeon_ep: Add driver framework and device initialization
Add driver framework and device setup and initialization for Octeon PCI Endpoint NIC.
Add implementation to load module, initilaize, register network device, cleanup and unload module.
---
V2 -> V3:
- fix the Title overline & underline mismatch in octeon_ep.rst, reported by kernel test robot:
V1 -> V2:
- split the patch into smaller patches.
- fix build errors observed with clang and "make W=1 C=1".
.../device_drivers/ethernet/index.rst | 1 + .../ethernet/marvell/octeon_ep.rst | 35 ++ MAINTAINERS | 7 + drivers/net/ethernet/marvell/Kconfig | 1 + drivers/net/ethernet/marvell/Makefile | 1 + .../net/ethernet/marvell/octeon_ep/Kconfig | 20 + .../net/ethernet/marvell/octeon_ep/Makefile | 9 + .../marvell/octeon_ep/octep_cn9k_pf.c | 241 +++++++++ .../ethernet/marvell/octeon_ep/octep_config.h | 204 +++++++ .../marvell/octeon_ep/octep_ctrl_mbox.c | 84 +++ .../marvell/octeon_ep/octep_ctrl_mbox.h | 170 ++++++ .../marvell/octeon_ep/octep_ctrl_net.c | 42 ++ .../marvell/octeon_ep/octep_ctrl_net.h | 299 ++++++++++ .../ethernet/marvell/octeon_ep/octep_main.c | 512 ++++++++++++++++++ .../ethernet/marvell/octeon_ep/octep_main.h | 379 +++++++++++++ .../marvell/octeon_ep/octep_regs_cn9k_pf.h | 367 +++++++++++++ .../net/ethernet/marvell/octeon_ep/octep_rx.c | 42 ++ .../net/ethernet/marvell/octeon_ep/octep_rx.h | 199 +++++++ .../net/ethernet/marvell/octeon_ep/octep_tx.c | 43 ++ .../net/ethernet/marvell/octeon_ep/octep_tx.h | 284 ++++++++++ 20 files changed, 2940 insertions(+) create mode 100644 Documentation/networking/device_drivers/ethernet/marvell/octeon_ep.rst create mode 100644 drivers/net/ethernet/marvell/octeon_ep/Kconfig create mode 100644 drivers/net/ethernet/marvell/octeon_ep/Makefile create mode 100644 drivers/net/ethernet/marvell/octeon_ep/octep_cn9k_pf.c create mode 100644 drivers/net/ethernet/marvell/octeon_ep/octep_config.h create mode 100644 drivers/net/ethernet/marvell/octeon_ep/octep_ctrl_mbox.c create mode 100644 drivers/net/ethernet/marvell/octeon_ep/octep_ctrl_mbox.h create mode 100644 drivers/net/ethernet/marvell/octeon_ep/octep_ctrl_net.c create mode 100644 drivers/net/ethernet/marvell/octeon_ep/octep_ctrl_net.h create mode 100644 drivers/net/ethernet/marvell/octeon_ep/octep_main.c create mode 100644 drivers/net/ethernet/marvell/octeon_ep/octep_main.h create mode 100644 drivers/net/ethernet/marvell/octeon_ep/octep_regs_cn9k_pf.h create mode 100644 drivers/net/ethernet/marvell/octeon_ep/octep_rx.c create mode 100644 drivers/net/ethernet/marvell/octeon_ep/octep_rx.h create mode 100644 drivers/net/ethernet/marvell/octeon_ep/octep_tx.c create mode 100644 drivers/net/ethernet/marvell/octeon_ep/octep_tx.h
Documentation/networking/device_drivers/ethernet/index.rst +1 -0
@@ -39,6 +39,7 @@ Contents: intel/iavf intel/ice marvell/octeontx2 + marvell/octeon_ep mellanox/mlx5 microsoft/netvsc neterion/s2io
Documentation/networking/device_drivers/ethernet/marvell/octeon_ep.rst new file +35 -0
@@ -0,0 +1,35 @@ +.. SPDX-License-Identifier: GPL-2.0+ + +==================================================================== +Linux kernel networking driver for Marvell's Octeon PCI Endpoint NIC +==================================================================== + +Network driver for Marvell's Octeon PCI EndPoint NIC. +Copyright (c) 2020 Marvell International Ltd. + +Contents +======== + +- `Overview`_ +- `Supported Devices`_ +- `Interface Control`_ + +Overview +======== +This driver implements networking functionality of Marvell's Octeon PCI +EndPoint NIC. + +Supported Devices +================= +Currently, this driver support following devices: + * Network controller: Cavium, Inc. Device b200 + +Interface Control +================= +Network Interface control like changing mtu, link speed, link down/up are +done by writing command to mailbox command queue, a mailbox interface +implemented through a reserved region in BAR4. +This driver writes the commands into the mailbox and the firmware on the +Octeon device processes them. The firmware also sends unsolicited notifications +to driver for events suchs as link change, through notification queue +implemented as part of mailbox interface.
MAINTAINERS +7 -0
@@ -11606,6 +11606,13 @@ S: Supported F: Documentation/devicetree/bindings/mmc/marvell,xenon-sdhci.txt F: drivers/mmc/host/sdhci-xenon* +MARVELL OCTEON ENDPOINT DRIVER +M: Veerasenareddy Burru <[email protected]> +M: Abhijit Ayarekar <[email protected]> +L: [email protected] +S: Supported +F: drivers/net/ethernet/marvell/octeon_ep + MATROX FRAMEBUFFER DRIVER L: [email protected] S: Orphan
drivers/net/ethernet/marvell/Kconfig +1 -0
@@ -177,6 +177,7 @@ config SKY2_DEBUG source "drivers/net/ethernet/marvell/octeontx2/Kconfig" +source "drivers/net/ethernet/marvell/octeon_ep/Kconfig" source "drivers/net/ethernet/marvell/prestera/Kconfig" endif # NET_VENDOR_MARVELL
drivers/net/ethernet/marvell/Makefile +1 -0
@@ -11,5 +11,6 @@ obj-$(CONFIG_MVPP2) += mvpp2/ obj-$(CONFIG_PXA168_ETH) += pxa168_eth.o obj-$(CONFIG_SKGE) += skge.o obj-$(CONFIG_SKY2) += sky2.o +obj-y += octeon_ep/ obj-y += octeontx2/ obj-y += prestera/
drivers/net/ethernet/marvell/octeon_ep/Kconfig new file +20 -0
@@ -0,0 +1,20 @@ +# SPDX-License-Identifier: GPL-2.0-only +# +# Marvell's Octeon PCI Endpoint NIC Driver Configuration +# + +config OCTEON_EP + tristate "Marvell Octeon PCI Endpoint NIC Driver" + depends on 64BIT + depends on PCI + depends on PTP_1588_CLOCK_OPTIONAL + help + This driver supports networking functionality of Marvell's + Octeon PCI Endpoint NIC. + + To know the list of devices supported by this driver, refer + documentation in + <file:Documentation/networking/device_drivers/ethernet/marvell/octeon_ep.rst>. + + To compile this drivers as a module, choose M here. Name of the + module is octeon_ep.
drivers/net/ethernet/marvell/octeon_ep/Makefile new file +9 -0
@@ -0,0 +1,9 @@ +# SPDX-License-Identifier: GPL-2.0 +# +# Network driver for Marvell's Octeon PCI Endpoint NIC +# + +obj-$(CONFIG_OCTEON_EP) += octeon_ep.o + +octeon_ep-y := octep_main.o octep_cn9k_pf.o octep_tx.o octep_rx.o \ + octep_ctrl_mbox.o octep_ctrl_net.o
drivers/net/ethernet/marvell/octeon_ep/octep_cn9k_pf.c new file +241 -0
241 lines not on this page · raw message
drivers/net/ethernet/marvell/octeon_ep/octep_config.h new file +204 -0
204 lines not on this page · raw message
drivers/net/ethernet/marvell/octeon_ep/octep_ctrl_mbox.c new file +84 -0
84 lines not on this page · raw message
drivers/net/ethernet/marvell/octeon_ep/octep_ctrl_mbox.h new file +170 -0
170 lines not on this page · raw message
drivers/net/ethernet/marvell/octeon_ep/octep_ctrl_net.c new file +42 -0
42 lines not on this page · raw message
drivers/net/ethernet/marvell/octeon_ep/octep_ctrl_net.h new file +299 -0
299 lines not on this page · raw message
drivers/net/ethernet/marvell/octeon_ep/octep_main.c new file +512 -0
512 lines not on this page · raw message
drivers/net/ethernet/marvell/octeon_ep/octep_main.h new file +379 -0
379 lines not on this page · raw message
drivers/net/ethernet/marvell/octeon_ep/octep_regs_cn9k_pf.h new file +367 -0
367 lines not on this page · raw message
drivers/net/ethernet/marvell/octeon_ep/octep_rx.c new file +42 -0
42 lines not on this page · raw message
drivers/net/ethernet/marvell/octeon_ep/octep_rx.h new file +199 -0
199 lines not on this page · raw message
drivers/net/ethernet/marvell/octeon_ep/octep_tx.c new file +43 -0
43 lines not on this page · raw message
drivers/net/ethernet/marvell/octeon_ep/octep_tx.h new file +284 -0
284 lines not on this page · raw message
Signature · 1 line
2.17.1
Re: [PATCH v3 1/7] octeon_ep: Add driver framework and device initialization
Quoted 56 lines · Veerasenareddy Burru
Add driver framework and device setup and initialization for Octeon PCI Endpoint NIC.
Add implementation to load module, initilaize, register network device, cleanup and unload module.
Signed-off-by Veerasenareddy Burru <[email protected]>Signed-off-by Abhijit Ayarekar <[email protected]>Signed-off-by Satananda Burla <[email protected]>---
V2 -> V3:
- fix the Title overline & underline mismatch inocteon_ep.rst, reported by kernel test robot:Reported-by kernel test robot <[email protected]>V1 -> V2:
- split the patch into smaller patches.
- fix build errors observed with clang and "make W=1 C=1"..../device_drivers/ethernet/index.rst | 1 + .../ethernet/marvell/octeon_ep.rst | 35 ++ MAINTAINERS | 7 + drivers/net/ethernet/marvell/Kconfig | 1 + drivers/net/ethernet/marvell/Makefile | 1 + .../net/ethernet/marvell/octeon_ep/Kconfig | 20 + .../net/ethernet/marvell/octeon_ep/Makefile | 9 + .../marvell/octeon_ep/octep_cn9k_pf.c | 241 +++++++++ .../ethernet/marvell/octeon_ep/octep_config.h | 204 +++++++ .../marvell/octeon_ep/octep_ctrl_mbox.c | 84 +++ .../marvell/octeon_ep/octep_ctrl_mbox.h | 170 ++++++ .../marvell/octeon_ep/octep_ctrl_net.c | 42 ++ .../marvell/octeon_ep/octep_ctrl_net.h | 299 ++++++++++ .../ethernet/marvell/octeon_ep/octep_main.c | 512 ++++++++++++++++++ .../ethernet/marvell/octeon_ep/octep_main.h | 379 +++++++++++++ .../marvell/octeon_ep/octep_regs_cn9k_pf.h | 367 +++++++++++++ .../net/ethernet/marvell/octeon_ep/octep_rx.c | 42 ++ .../net/ethernet/marvell/octeon_ep/octep_rx.h | 199 +++++++ .../net/ethernet/marvell/octeon_ep/octep_tx.c | 43 ++ .../net/ethernet/marvell/octeon_ep/octep_tx.h | 284 ++++++++++ 20 files changed, 2940 insertions(+) create mode 100644 Documentation/networking/device_drivers/ethernet/marvell/octeon_ep.rst create mode 100644 drivers/net/ethernet/marvell/octeon_ep/Kconfig create mode 100644 drivers/net/ethernet/marvell/octeon_ep/Makefile create mode 100644 drivers/net/ethernet/marvell/octeon_ep/octep_cn9k_pf.c create mode 100644 drivers/net/ethernet/marvell/octeon_ep/octep_config.h create mode 100644 drivers/net/ethernet/marvell/octeon_ep/octep_ctrl_mbox.c create mode 100644 drivers/net/ethernet/marvell/octeon_ep/octep_ctrl_mbox.h create mode 100644 drivers/net/ethernet/marvell/octeon_ep/octep_ctrl_net.c create mode 100644 drivers/net/ethernet/marvell/octeon_ep/octep_ctrl_net.h create mode 100644 drivers/net/ethernet/marvell/octeon_ep/octep_main.c create mode 100644 drivers/net/ethernet/marvell/octeon_ep/octep_main.h create mode 100644 drivers/net/ethernet/marvell/octeon_ep/octep_regs_cn9k_pf.h create mode 100644 drivers/net/ethernet/marvell/octeon_ep/octep_rx.c create mode 100644 drivers/net/ethernet/marvell/octeon_ep/octep_rx.h create mode 100644 drivers/net/ethernet/marvell/octeon_ep/octep_tx.c create mode 100644 drivers/net/ethernet/marvell/octeon_ep/octep_tx.h
<...>
drivers/net/ethernet/marvell/octeon_ep/octep_main.c line 33
Quoted 4 lines
drivers/net/ethernet/marvell/octeon_ep/octep_main.c new file +4
-0+MODULE_AUTHOR ("Veerasenareddy Burru <[email protected]>" ); +MODULE_DESCRIPTION (OCTEP_DRV_STRING ); +MODULE_LICENSE ("GPL" ); +MODULE_VERSION (OCTEP_DRV_VERSION_STR );
Please don't add driver versions to new drivers.
Thanks
Veerasenareddy Burru
maintainerPATCH v3 2/7 octeon_ep: add hardware configuration APIs
In reply to Veerasenareddy BurruImplement hardware resource init and shutdown helper APIs. This includes hardware Tx/Rx queue init/enable/disable/reset, non queue interrupt handler that decodes non-queue interrupt type.
---
V2 -> V3: no change.
V1 -> V2:
- created by dividing PATCH 1/4 of original patch series.
.../marvell/octeon_ep/octep_cn9k_pf.c | 498 +++++++++++++++++- 1 file changed, 497 insertions(+), 1 deletion(-)
drivers/net/ethernet/marvell/octeon_ep/octep_cn9k_pf.c +497 -1
@@ -33,19 +33,164 @@ static char *cn93_non_ioq_msix_names[] = { "epf_rsvd", }; +/* Dump useful hardware CSRs for debug purpose */ +static void cn93_dump_regs (struct octep_device *oct,int qno) +{ +struct device *dev = &oct->pdev->dev; + +dev_info (dev,"IQ-%d register dump\n" , qno); +dev_info (dev,"R[%d]_IN_INSTR_DBELL[0x%llx]: 0x%016llx\n" , + qno,CN93_SDP_R_IN_INSTR_DBELL (qno), +octep_read_csr64 (oct,CN93_SDP_R_IN_INSTR_DBELL (qno))); +dev_info (dev,"R[%d]_IN_CONTROL[0x%llx]: 0x%016llx\n" , + qno,CN93_SDP_R_IN_CONTROL (qno), +octep_read_csr64 (oct,CN93_SDP_R_IN_CONTROL (qno))); +dev_info (dev,"R[%d]_IN_ENABLE[0x%llx]: 0x%016llx\n" , + qno,CN93_SDP_R_IN_ENABLE (qno), +octep_read_csr64 (oct,CN93_SDP_R_IN_ENABLE (qno))); +dev_info (dev,"R[%d]_IN_INSTR_BADDR[0x%llx]: 0x%016llx\n" , + qno,CN93_SDP_R_IN_INSTR_BADDR (qno), +octep_read_csr64 (oct,CN93_SDP_R_IN_INSTR_BADDR (qno))); +dev_info (dev,"R[%d]_IN_INSTR_RSIZE[0x%llx]: 0x%016llx\n" , + qno,CN93_SDP_R_IN_INSTR_RSIZE (qno), +octep_read_csr64 (oct,CN93_SDP_R_IN_INSTR_RSIZE (qno))); +dev_info (dev,"R[%d]_IN_CNTS[0x%llx]: 0x%016llx\n" , + qno,CN93_SDP_R_IN_CNTS (qno), +octep_read_csr64 (oct,CN93_SDP_R_IN_CNTS (qno))); +dev_info (dev,"R[%d]_IN_INT_LEVELS[0x%llx]: 0x%016llx\n" , + qno,CN93_SDP_R_IN_INT_LEVELS (qno), +octep_read_csr64 (oct,CN93_SDP_R_IN_INT_LEVELS (qno))); +dev_info (dev,"R[%d]_IN_PKT_CNT[0x%llx]: 0x%016llx\n" , + qno,CN93_SDP_R_IN_PKT_CNT (qno), +octep_read_csr64 (oct,CN93_SDP_R_IN_PKT_CNT (qno))); +dev_info (dev,"R[%d]_IN_BYTE_CNT[0x%llx]: 0x%016llx\n" , + qno,CN93_SDP_R_IN_BYTE_CNT (qno), +octep_read_csr64 (oct,CN93_SDP_R_IN_BYTE_CNT (qno))); + +dev_info (dev,"OQ-%d register dump\n" , qno); +dev_info (dev,"R[%d]_OUT_SLIST_DBELL[0x%llx]: 0x%016llx\n" , + qno,CN93_SDP_R_OUT_SLIST_DBELL (qno), +octep_read_csr64 (oct,CN93_SDP_R_OUT_SLIST_DBELL (qno))); +dev_info (dev,"R[%d]_OUT_CONTROL[0x%llx]: 0x%016llx\n" , + qno,CN93_SDP_R_OUT_CONTROL (qno), +octep_read_csr64 (oct,CN93_SDP_R_OUT_CONTROL (qno))); +dev_info (dev,"R[%d]_OUT_ENABLE[0x%llx]: 0x%016llx\n" , + qno,CN93_SDP_R_OUT_ENABLE (qno), +octep_read_csr64 (oct,CN93_SDP_R_OUT_ENABLE (qno))); +dev_info (dev,"R[%d]_OUT_SLIST_BADDR[0x%llx]: 0x%016llx\n" , + qno,CN93_SDP_R_OUT_SLIST_BADDR (qno), +octep_read_csr64 (oct,CN93_SDP_R_OUT_SLIST_BADDR (qno))); +dev_info (dev,"R[%d]_OUT_SLIST_RSIZE[0x%llx]: 0x%016llx\n" , + qno,CN93_SDP_R_OUT_SLIST_RSIZE (qno), +octep_read_csr64 (oct,CN93_SDP_R_OUT_SLIST_RSIZE (qno))); +dev_info (dev,"R[%d]_OUT_CNTS[0x%llx]: 0x%016llx\n" , + qno,CN93_SDP_R_OUT_CNTS (qno), +octep_read_csr64 (oct,CN93_SDP_R_OUT_CNTS (qno))); +dev_info (dev,"R[%d]_OUT_INT_LEVELS[0x%llx]: 0x%016llx\n" , + qno,CN93_SDP_R_OUT_INT_LEVELS (qno), +octep_read_csr64 (oct,CN93_SDP_R_OUT_INT_LEVELS (qno))); +dev_info (dev,"R[%d]_OUT_PKT_CNT[0x%llx]: 0x%016llx\n" , + qno,CN93_SDP_R_OUT_PKT_CNT (qno), +octep_read_csr64 (oct,CN93_SDP_R_OUT_PKT_CNT (qno))); +dev_info (dev,"R[%d]_OUT_BYTE_CNT[0x%llx]: 0x%016llx\n" , + qno,CN93_SDP_R_OUT_BYTE_CNT (qno), +octep_read_csr64 (oct,CN93_SDP_R_OUT_BYTE_CNT (qno))); +dev_info (dev,"R[%d]_ERR_TYPE[0x%llx]: 0x%016llx\n" , + qno,CN93_SDP_R_ERR_TYPE (qno), +octep_read_csr64 (oct,CN93_SDP_R_ERR_TYPE (qno))); +} + +/* Reset Hardware Tx queue */ +static int cn93_reset_iq (struct octep_device *oct,int q_no) +{ +struct octep_config *conf = oct->conf; +u64 val =0ULL ; + +dev_dbg (&oct->pdev->dev,"Reset PF IQ-%d\n" , q_no); + +/* Get absolute queue number */ + q_no += conf->pf_ring_cfg.srn; + +/* Disable the Tx/Instruction Ring */ +octep_write_csr64 (oct,CN93_SDP_R_IN_ENABLE (q_no), val); + +/* clear the Instruction Ring packet/byte counts and doorbell CSRs */ +octep_write_csr64 (oct,CN93_SDP_R_IN_CNTS (q_no), val); +octep_write_csr64 (oct,CN93_SDP_R_IN_INT_LEVELS (q_no), val); +octep_write_csr64 (oct,CN93_SDP_R_IN_PKT_CNT (q_no), val); +octep_write_csr64 (oct,CN93_SDP_R_IN_BYTE_CNT (q_no), val); +octep_write_csr64 (oct,CN93_SDP_R_IN_INSTR_BADDR (q_no), val); +octep_write_csr64 (oct,CN93_SDP_R_IN_INSTR_RSIZE (q_no), val); + + val =0xFFFFFFFF ; +octep_write_csr64 (oct,CN93_SDP_R_IN_INSTR_DBELL (q_no), val); + +return 0 ; +} + +/* Reset Hardware Rx queue */ +static void cn93_reset_oq (struct octep_device *oct,int q_no) +{ +u64 val =0ULL ; + + q_no +=CFG_GET_PORTS_PF_SRN (oct->conf); + +/* Disable Output (Rx) Ring */ +octep_write_csr64 (oct,CN93_SDP_R_OUT_ENABLE (q_no), val); + +/* Clear count CSRs */ + val =octep_read_csr (oct,CN93_SDP_R_OUT_CNTS (q_no)); +octep_write_csr (oct,CN93_SDP_R_OUT_CNTS (q_no), val); + +octep_write_csr64 (oct,CN93_SDP_R_OUT_PKT_CNT (q_no),0xFFFFFFFFFULL ); +octep_write_csr64 (oct,CN93_SDP_R_OUT_SLIST_DBELL (q_no),0xFFFFFFFF ); +} +/* Reset all hardware Tx/Rx queues */ static void octep_reset_io_queues_cn93_pf (struct octep_device *oct) { +struct pci_dev *pdev = oct->pdev; +int q; + +dev_dbg (&pdev->dev,"Reset OCTEP_CN93 PF IO Queues\n" ); + +for (q =0 ; q <CFG_GET_PORTS_ACTIVE_IO_RINGS (oct->conf); q++) { +cn93_reset_iq (oct, q); +cn93_reset_oq (oct, q); + } }/* Initialize windowed addresses to access some hardware registers */ static void octep_setup_pci_window_regs_cn93_pf (struct octep_device *oct) { +u8 __iomem *bar0_pciaddr = oct->mmio[0 ].hw_addr; + + oct->pci_win_regs.pci_win_wr_addr = (u8 __iomem *)(bar0_pciaddr +CN93_SDP_WIN_WR_ADDR64 ); + oct->pci_win_regs.pci_win_rd_addr = (u8 __iomem *)(bar0_pciaddr +CN93_SDP_WIN_RD_ADDR64 ); + oct->pci_win_regs.pci_win_wr_data = (u8 __iomem *)(bar0_pciaddr +CN93_SDP_WIN_WR_DATA64 ); + oct->pci_win_regs.pci_win_rd_data = (u8 __iomem *)(bar0_pciaddr +CN93_SDP_WIN_RD_DATA64 ); }/* Configure Hardware mapping: inform hardware which rings belong to PF. */ static void octep_configure_ring_mapping_cn93_pf (struct octep_device *oct) { +struct octep_config *conf = oct->conf; +struct pci_dev *pdev = oct->pdev; +u64 pf_srn =CFG_GET_PORTS_PF_SRN (oct->conf); +int q; + +for (q =0 ; q <CFG_GET_PORTS_ACTIVE_IO_RINGS (conf); q++) { +u64 regval =0 ; + +if (oct->pcie_port) + regval =8 <<CN93_SDP_FUNC_SEL_EPF_BIT_POS ; + +octep_write_csr64 (oct,CN93_SDP_EPVF_RING (pf_srn + q), regval); + + regval =octep_read_csr64 (oct,CN93_SDP_EPVF_RING (pf_srn + q)); +dev_dbg (&pdev->dev,"Write SDP_EPVF_RING[0x%llx] = 0x%llx\n" , +CN93_SDP_EPVF_RING (pf_srn + q), regval); + } }/* Initialize configuration limits and initial active config 93xx PF. */
@@ -95,27 +240,265 @@ static void octep_init_config_cn93_pf(struct octep_device *oct)/* Setup registers for a hardware Tx Queue */ static void octep_setup_iq_regs_cn93_pf (struct octep_device *oct,int iq_no) { +struct octep_iq *iq = oct->iq[iq_no]; +u32 reset_instr_cnt; +u64 reg_val; + + iq_no +=CFG_GET_PORTS_PF_SRN (oct->conf); + reg_val =octep_read_csr64 (oct,CN93_SDP_R_IN_CONTROL (iq_no)); + +/* wait for IDLE to set to 1 */ +if (!(reg_val &CN93_R_IN_CTL_IDLE )) { +do { + reg_val =octep_read_csr64 (oct,CN93_SDP_R_IN_CONTROL (iq_no)); + }while (!(reg_val &CN93_R_IN_CTL_IDLE )); + } + + reg_val |=CN93_R_IN_CTL_RDSIZE ; + reg_val |=CN93_R_IN_CTL_IS_64B ; + reg_val |=CN93_R_IN_CTL_ESR ; +octep_write_csr64 (oct,CN93_SDP_R_IN_CONTROL (iq_no), reg_val); + +/* Write the start of the input queue's ring and its size */ +octep_write_csr64 (oct,CN93_SDP_R_IN_INSTR_BADDR (iq_no), + iq->desc_ring_dma); +octep_write_csr64 (oct,CN93_SDP_R_IN_INSTR_RSIZE (iq_no), + iq->max_count); + +/* Remember the doorbell & instruction count register addr +* for this queue +*/ + iq->doorbell_reg = oct->mmio[0 ].hw_addr + +CN93_SDP_R_IN_INSTR_DBELL (iq_no); + iq->inst_cnt_reg = oct->mmio[0 ].hw_addr + +CN93_SDP_R_IN_CNTS (iq_no); + iq->intr_lvl_reg = oct->mmio[0 ].hw_addr + +CN93_SDP_R_IN_INT_LEVELS (iq_no); + +/* Store the current instruction counter (used in flush_iq calculation) */ + reset_instr_cnt =readl (iq->inst_cnt_reg); +writel (reset_instr_cnt, iq->inst_cnt_reg); + +/* INTR_THRESHOLD is set to max(FFFFFFFF) to disable the INTR */ + reg_val =CFG_GET_IQ_INTR_THRESHOLD (oct->conf) &0xffffffff ; +octep_write_csr64 (oct,CN93_SDP_R_IN_INT_LEVELS (iq_no), reg_val); }/* Setup registers for a hardware Rx Queue */ static void octep_setup_oq_regs_cn93_pf (struct octep_device *oct,int oq_no) { +u64 reg_val; +u64 oq_ctl =0ULL ; +u32 time_threshold =0 ; +struct octep_oq *oq = oct->oq[oq_no]; + + oq_no +=CFG_GET_PORTS_PF_SRN (oct->conf); + reg_val =octep_read_csr64 (oct,CN93_SDP_R_OUT_CONTROL (oq_no)); + +/* wait for IDLE to set to 1 */ +if (!(reg_val &CN93_R_OUT_CTL_IDLE )) { +do { + reg_val =octep_read_csr64 (oct,CN93_SDP_R_OUT_CONTROL (oq_no)); + }while (!(reg_val &CN93_R_OUT_CTL_IDLE )); + } + + reg_val &= ~(CN93_R_OUT_CTL_IMODE ); + reg_val &= ~(CN93_R_OUT_CTL_ROR_P ); + reg_val &= ~(CN93_R_OUT_CTL_NSR_P ); + reg_val &= ~(CN93_R_OUT_CTL_ROR_I ); + reg_val &= ~(CN93_R_OUT_CTL_NSR_I ); + reg_val &= ~(CN93_R_OUT_CTL_ES_I ); + reg_val &= ~(CN93_R_OUT_CTL_ROR_D ); + reg_val &= ~(CN93_R_OUT_CTL_NSR_D ); + reg_val &= ~(CN93_R_OUT_CTL_ES_D ); + reg_val |= (CN93_R_OUT_CTL_ES_P ); + +octep_write_csr64 (oct,CN93_SDP_R_OUT_CONTROL (oq_no), reg_val); +octep_write_csr64 (oct,CN93_SDP_R_OUT_SLIST_BADDR (oq_no), + oq->desc_ring_dma); +octep_write_csr64 (oct,CN93_SDP_R_OUT_SLIST_RSIZE (oq_no), + oq->max_count); + + oq_ctl =octep_read_csr64 (oct,CN93_SDP_R_OUT_CONTROL (oq_no)); + oq_ctl &= ~0x7fffffULL ;//clear the ISIZE and BSIZE (22-0) + oq_ctl |= (oq->buffer_size &0xffff );//populate the BSIZE (15-0) +octep_write_csr64 (oct,CN93_SDP_R_OUT_CONTROL (oq_no), oq_ctl); + +/* Get the mapped address of the pkt_sent and pkts_credit regs */ + oq->pkts_sent_reg = oct->mmio[0 ].hw_addr +CN93_SDP_R_OUT_CNTS (oq_no); + oq->pkts_credit_reg = oct->mmio[0 ].hw_addr + +CN93_SDP_R_OUT_SLIST_DBELL (oq_no); + + time_threshold =CFG_GET_OQ_INTR_TIME (oct->conf); + reg_val = ((u64 )time_threshold <<32 ) | +CFG_GET_OQ_INTR_PKT (oct->conf); +octep_write_csr64 (oct,CN93_SDP_R_OUT_INT_LEVELS (oq_no), reg_val); }/* Setup registers for a PF mailbox */ static void octep_setup_mbox_regs_cn93_pf (struct octep_device *oct,int q_no) { +struct octep_mbox *mbox = oct->mbox[q_no]; + + mbox->q_no = q_no; + +/* PF mbox interrupt reg */ + mbox->mbox_int_reg = (u8 *)oct->mmio[0 ].hw_addr +CN93_SDP_EPF_MBOX_RINT (0 ); + +/* PF to VF DATA reg. PF writes into this reg */ + mbox->mbox_write_reg = (u8 *)oct->mmio[0 ].hw_addr +CN93_SDP_R_MBOX_PF_VF_DATA (q_no); + +/* VF to PF DATA reg. PF reads from this reg */ + mbox->mbox_read_reg = (u8 *)oct->mmio[0 ].hw_addr +CN93_SDP_R_MBOX_VF_PF_DATA (q_no); +} + +/* Mailbox Interrupt handler */ +static void cn93_handle_pf_mbox_intr (struct octep_device *oct) +{ +u64 mbox_int_val =0ULL , val =0ULL , qno =0ULL ; + + mbox_int_val =readq (oct->mbox[0 ]->mbox_int_reg); +for (qno =0 ; qno <OCTEP_MAX_VF ; qno++) { + val =readq (oct->mbox[qno]->mbox_read_reg); +dev_dbg (&oct->pdev->dev, +"PF MBOX READ: val:%llx from VF:%llx\n" , val, qno); + } + +writeq (mbox_int_val, oct->mbox[0 ]->mbox_int_reg); }/* Interrupts handler for all non-queue generic interrupts. */ static irqreturn_t octep_non_ioq_intr_handler_cn93_pf (void *dev) { +struct octep_device *oct = (struct octep_device *)dev; +struct pci_dev *pdev = oct->pdev; +u64 reg_val =0 ; +int i =0 ; + +/* Check for IRERR INTR */ + reg_val =octep_read_csr64 (oct,CN93_SDP_EPF_IRERR_RINT ); +if (reg_val) { +dev_info (&pdev->dev, +"received IRERR_RINT intr: 0x%llx\n" , reg_val); +octep_write_csr64 (oct,CN93_SDP_EPF_IRERR_RINT , reg_val); + +for (i =0 ; i <CFG_GET_PORTS_ACTIVE_IO_RINGS (oct->conf); i++) { + reg_val =octep_read_csr64 (oct, +CN93_SDP_R_ERR_TYPE (i)); +if (reg_val) { +dev_info (&pdev->dev, +"Received err type on IQ-%d: 0x%llx\n" , + i, reg_val); +octep_write_csr64 (oct,CN93_SDP_R_ERR_TYPE (i), + reg_val); + } + } + goto irq_handled; + } + +/* Check for ORERR INTR */ + reg_val =octep_read_csr64 (oct,CN93_SDP_EPF_ORERR_RINT ); +if (reg_val) { +dev_info (&pdev->dev, +"Received ORERR_RINT intr: 0x%llx\n" , reg_val); +octep_write_csr64 (oct,CN93_SDP_EPF_ORERR_RINT , reg_val); +for (i =0 ; i <CFG_GET_PORTS_ACTIVE_IO_RINGS (oct->conf); i++) { + reg_val =octep_read_csr64 (oct,CN93_SDP_R_ERR_TYPE (i)); +if (reg_val) { +dev_info (&pdev->dev, +"Received err type on OQ-%d: 0x%llx\n" , + i, reg_val); +octep_write_csr64 (oct,CN93_SDP_R_ERR_TYPE (i), + reg_val); + } + } + + goto irq_handled; + } + +/* Check for VFIRE INTR */ + reg_val =octep_read_csr64 (oct,CN93_SDP_EPF_VFIRE_RINT (0 )); +if (reg_val) { +dev_info (&pdev->dev, +"Received VFIRE_RINT intr: 0x%llx\n" , reg_val); +octep_write_csr64 (oct,CN93_SDP_EPF_VFIRE_RINT (0 ), reg_val); + goto irq_handled; + } + +/* Check for VFORE INTR */ + reg_val =octep_read_csr64 (oct,CN93_SDP_EPF_VFORE_RINT (0 )); +if (reg_val) { +dev_info (&pdev->dev, +"Received VFORE_RINT intr: 0x%llx\n" , reg_val); +octep_write_csr64 (oct,CN93_SDP_EPF_VFORE_RINT (0 ), reg_val); + goto irq_handled; + } + +/* Check for MBOX INTR */ + reg_val =octep_read_csr64 (oct,CN93_SDP_EPF_MBOX_RINT (0 )); +if (reg_val) { +dev_info (&pdev->dev, +"Received MBOX_RINT intr: 0x%llx\n" , reg_val); +cn93_handle_pf_mbox_intr (oct); + goto irq_handled; + } + +/* Check for OEI INTR */ + reg_val =octep_read_csr64 (oct,CN93_SDP_EPF_OEI_RINT ); +if (reg_val) { +dev_info (&pdev->dev, +"Received OEI_EINT intr: 0x%llx\n" , reg_val); +octep_write_csr64 (oct,CN93_SDP_EPF_OEI_RINT , reg_val); +queue_work (octep_wq, &oct->ctrl_mbox_task); + goto irq_handled; + } + +/* Check for DMA INTR */ + reg_val =octep_read_csr64 (oct,CN93_SDP_EPF_DMA_RINT ); +if (reg_val) { +octep_write_csr64 (oct,CN93_SDP_EPF_DMA_RINT , reg_val); + goto irq_handled; + } + +/* Check for DMA VF INTR */ + reg_val =octep_read_csr64 (oct,CN93_SDP_EPF_DMA_VF_RINT (0 )); +if (reg_val) { +dev_info (&pdev->dev, +"Received DMA_VF_RINT intr: 0x%llx\n" , reg_val); +octep_write_csr64 (oct,CN93_SDP_EPF_DMA_VF_RINT (0 ), reg_val); + goto irq_handled; + } + +/* Check for PPVF INTR */ + reg_val =octep_read_csr64 (oct,CN93_SDP_EPF_PP_VF_RINT (0 )); +if (reg_val) { +dev_info (&pdev->dev, +"Received PP_VF_RINT intr: 0x%llx\n" , reg_val); +octep_write_csr64 (oct,CN93_SDP_EPF_PP_VF_RINT (0 ), reg_val); + goto irq_handled; + } + +/* Check for MISC INTR */ + reg_val =octep_read_csr64 (oct,CN93_SDP_EPF_MISC_RINT ); +if (reg_val) { +dev_info (&pdev->dev, +"Received MISC_RINT intr: 0x%llx\n" , reg_val); +octep_write_csr64 (oct,CN93_SDP_EPF_MISC_RINT , reg_val); + goto irq_handled; + } + +dev_info (&pdev->dev,"Reserved inerrupts raised; Ignore\n" ); +irq_handled:return IRQ_HANDLED ; }/* Tx/Rx queue interrupt handler */ static irqreturn_t octep_ioq_intr_handler_cn93_pf (void *data) { +struct octep_ioq_vector *vector = (struct octep_ioq_vector *)data; +struct octep_oq *oq = vector->oq; + +napi_schedule_irqoff (oq->napi);return IRQ_HANDLED ; }
@@ -139,57 +522,170 @@ static int octep_soft_reset_cn93_pf(struct octep_device *oct)/* Re-initialize Octeon hardware registers */ static void octep_reinit_regs_cn93_pf (struct octep_device *oct) { +u32 i; + +for (i =0 ; i <CFG_GET_PORTS_ACTIVE_IO_RINGS (oct->conf); i++) + oct->hw_ops.setup_iq_regs (oct, i); + +for (i =0 ; i <CFG_GET_PORTS_ACTIVE_IO_RINGS (oct->conf); i++) + oct->hw_ops.setup_oq_regs (oct, i); + + oct->hw_ops.enable_interrupts (oct); + oct->hw_ops.enable_io_queues (oct); + +for (i =0 ; i <CFG_GET_PORTS_ACTIVE_IO_RINGS (oct->conf); i++) +writel (oct->oq[i]->max_count, oct->oq[i]->pkts_credit_reg); }/* Enable all interrupts */ static void octep_enable_interrupts_cn93_pf (struct octep_device *oct) { +u64 intr_mask =0ULL ; +int srn, num_rings, i; + + srn =CFG_GET_PORTS_PF_SRN (oct->conf); + num_rings =CFG_GET_PORTS_ACTIVE_IO_RINGS (oct->conf); + +for (i =0 ; i < num_rings; i++) + intr_mask |= (0x1ULL << (srn + i)); + +octep_write_csr64 (oct,CN93_SDP_EPF_IRERR_RINT_ENA_W1S , intr_mask); +octep_write_csr64 (oct,CN93_SDP_EPF_ORERR_RINT_ENA_W1S , intr_mask); +octep_write_csr64 (oct,CN93_SDP_EPF_OEI_RINT_ENA_W1S ,-1ULL ); +octep_write_csr64 (oct,CN93_SDP_EPF_MISC_RINT_ENA_W1S , intr_mask); +octep_write_csr64 (oct,CN93_SDP_EPF_DMA_RINT_ENA_W1S , intr_mask); }/* Disable all interrupts */ static void octep_disable_interrupts_cn93_pf (struct octep_device *oct) { +u64 intr_mask =0ULL ; +int srn, num_rings, i; + + srn =CFG_GET_PORTS_PF_SRN (oct->conf); + num_rings =CFG_GET_PORTS_ACTIVE_IO_RINGS (oct->conf); + +for (i =0 ; i < num_rings; i++) + intr_mask |= (0x1ULL << (srn + i)); + +octep_write_csr64 (oct,CN93_SDP_EPF_IRERR_RINT_ENA_W1C , intr_mask); +octep_write_csr64 (oct,CN93_SDP_EPF_ORERR_RINT_ENA_W1C , intr_mask); +octep_write_csr64 (oct,CN93_SDP_EPF_OEI_RINT_ENA_W1C ,-1ULL ); +octep_write_csr64 (oct,CN93_SDP_EPF_MISC_RINT_ENA_W1C , intr_mask); +octep_write_csr64 (oct,CN93_SDP_EPF_DMA_RINT_ENA_W1C , intr_mask); }/* Get new Octeon Read Index: index of descriptor that Octeon reads next. */ static u32 octep_update_iq_read_index_cn93_pf (struct octep_iq *iq) { -return 0 ; +u32 pkt_in_done =readl (iq->inst_cnt_reg); +u32 last_done, new_idx; + + last_done = pkt_in_done - iq->pkt_in_done; + iq->pkt_in_done = pkt_in_done; + + new_idx = (iq->octep_read_index + last_done) % iq->max_count; + +return new_idx; }/* Enable a hardware Tx Queue */ static void octep_enable_iq_cn93_pf (struct octep_device *oct,int iq_no) { +u64 loop =HZ ; +u64 reg_val; + + iq_no +=CFG_GET_PORTS_PF_SRN (oct->conf); + +octep_write_csr64 (oct,CN93_SDP_R_IN_INSTR_DBELL (iq_no),0xFFFFFFFF ); + +while (octep_read_csr64 (oct,CN93_SDP_R_IN_INSTR_DBELL (iq_no)) && + loop--) { +schedule_timeout_interruptible (1 ); + } + + reg_val =octep_read_csr64 (oct,CN93_SDP_R_IN_INT_LEVELS (iq_no)); + reg_val |= (0x1ULL <<62 ); +octep_write_csr64 (oct,CN93_SDP_R_IN_INT_LEVELS (iq_no), reg_val); + + reg_val =octep_read_csr64 (oct,CN93_SDP_R_IN_ENABLE (iq_no)); + reg_val |=0x1ULL ; +octep_write_csr64 (oct,CN93_SDP_R_IN_ENABLE (iq_no), reg_val); }/* Enable a hardware Rx Queue */ static void octep_enable_oq_cn93_pf (struct octep_device *oct,int oq_no) { +u64 reg_val =0ULL ; + + oq_no +=CFG_GET_PORTS_PF_SRN (oct->conf); + + reg_val =octep_read_csr64 (oct,CN93_SDP_R_OUT_INT_LEVELS (oq_no)); + reg_val |= (0x1ULL <<62 ); +octep_write_csr64 (oct,CN93_SDP_R_OUT_INT_LEVELS (oq_no), reg_val); + +octep_write_csr64 (oct,CN93_SDP_R_OUT_SLIST_DBELL (oq_no),0xFFFFFFFF ); + + reg_val =octep_read_csr64 (oct,CN93_SDP_R_OUT_ENABLE (oq_no)); + reg_val |=0x1ULL ; +octep_write_csr64 (oct,CN93_SDP_R_OUT_ENABLE (oq_no), reg_val); }/* Enable all hardware Tx/Rx Queues assined to PF */ static void octep_enable_io_queues_cn93_pf (struct octep_device *oct) { +u8 q; + +for (q =0 ; q <CFG_GET_PORTS_ACTIVE_IO_RINGS (oct->conf); q++) { +octep_enable_iq_cn93_pf (oct, q); +octep_enable_oq_cn93_pf (oct, q); + } }/* Disable a hardware Tx Queue assined to PF */ static void octep_disable_iq_cn93_pf (struct octep_device *oct,int iq_no) { +u64 reg_val =0ULL ; + + iq_no +=CFG_GET_PORTS_PF_SRN (oct->conf); + + reg_val =octep_read_csr64 (oct,CN93_SDP_R_IN_ENABLE (iq_no)); + reg_val &= ~0x1ULL ; +octep_write_csr64 (oct,CN93_SDP_R_IN_ENABLE (iq_no), reg_val); }/* Disable a hardware Rx Queue assined to PF */ static void octep_disable_oq_cn93_pf (struct octep_device *oct,int oq_no) { +u64 reg_val =0ULL ; + + oq_no +=CFG_GET_PORTS_PF_SRN (oct->conf); + reg_val =octep_read_csr64 (oct,CN93_SDP_R_OUT_ENABLE (oq_no)); + reg_val &= ~0x1ULL ; +octep_write_csr64 (oct,CN93_SDP_R_OUT_ENABLE (oq_no), reg_val); }/* Disable all hardware Tx/Rx Queues assined to PF */ static void octep_disable_io_queues_cn93_pf (struct octep_device *oct) { +int q =0 ; + +for (q =0 ; q <CFG_GET_PORTS_ACTIVE_IO_RINGS (oct->conf); q++) { +octep_disable_iq_cn93_pf (oct, q); +octep_disable_oq_cn93_pf (oct, q); + } }/* Dump hardware registers (including Tx/Rx queues) for debugging. */ static void octep_dump_registers_cn93_pf (struct octep_device *oct) { +u8 srn, num_rings, q; + + srn =CFG_GET_PORTS_PF_SRN (oct->conf); + num_rings =CFG_GET_PORTS_ACTIVE_IO_RINGS (oct->conf); + +for (q = srn; q < srn + num_rings; q++) +cn93_dump_regs (oct, q); }/**
Signature · 1 line
2.17.1
Veerasenareddy Burru
maintainerPATCH v3 3/7 octeon_ep: Add mailbox for control commands
In reply to Veerasenareddy BurruAdd mailbox between host and NIC to send control commands from host to NIC and receive responses and notifications from NIC to host driver, like link status update.
---
V2 -> V3: no change.
V1 -> V2:
- created by dividing PATCH 1/4 of original patch series.
.../marvell/octeon_ep/octep_ctrl_mbox.c | 178 +++++++++++++++++- .../marvell/octeon_ep/octep_ctrl_net.c | 100 +++++++++- 2 files changed, 270 insertions(+), 8 deletions(-)
drivers/net/ethernet/marvell/octeon_ep/octep_ctrl_mbox.c +174 -4
@@ -65,20 +65,190 @@ static inline u32 octep_ctrl_mbox_circq_depth(u32 pi, u32 ci, u32 mask)int octep_ctrl_mbox_init (struct octep_ctrl_mbox *mbox) { -return -EINVAL ; +u64 version, magic_num, status; + +if (!mbox) +return -EINVAL ; + +if (!mbox->barmem) { +pr_info ("octep_ctrl_mbox : Invalid barmem %p\n" , mbox->barmem); +return -EINVAL ; + } + + magic_num =readq (OCTEP_CTRL_MBOX_INFO_MAGIC_NUM_OFFSET (mbox->barmem)); +if (magic_num !=OCTEP_CTRL_MBOX_MAGIC_NUMBER ) { +pr_info ("octep_ctrl_mbox : Invalid magic number %llx\n" , magic_num); +return -EINVAL ; + } + + version =readq (OCTEP_CTRL_MBOX_INFO_FW_VERSION_OFFSET (mbox->barmem)); +if (version !=OCTEP_DRV_VERSION ) { +pr_info ("octep_ctrl_mbox : Firmware version mismatch %llx != %x\n" , + version,OCTEP_DRV_VERSION ); +return -EINVAL ; + } + + status =readq (OCTEP_CTRL_MBOX_INFO_FW_STATUS_OFFSET (mbox->barmem)); +if (status !=OCTEP_CTRL_MBOX_STATUS_READY ) { +pr_info ("octep_ctrl_mbox : Firmware is not ready.\n" ); +return -EINVAL ; + } + + mbox->barmem_sz =readl (OCTEP_CTRL_MBOX_INFO_BARMEM_SZ_OFFSET (mbox->barmem)); + +writeq (mbox->version,OCTEP_CTRL_MBOX_INFO_HOST_VERSION_OFFSET (mbox->barmem)); +writeq (OCTEP_CTRL_MBOX_STATUS_INIT ,OCTEP_CTRL_MBOX_INFO_HOST_STATUS_OFFSET (mbox->barmem)); + + mbox->h2fq.elem_cnt =readl (OCTEP_CTRL_MBOX_H2FQ_ELEM_CNT_OFFSET (mbox->barmem)); + mbox->h2fq.elem_sz =readl (OCTEP_CTRL_MBOX_H2FQ_ELEM_SZ_OFFSET (mbox->barmem)); + mbox->h2fq.mask = (mbox->h2fq.elem_cnt -1 ); +mutex_init (&mbox->h2fq_lock); + + mbox->f2hq.elem_cnt =readl (OCTEP_CTRL_MBOX_F2HQ_ELEM_CNT_OFFSET (mbox->barmem)); + mbox->f2hq.elem_sz =readl (OCTEP_CTRL_MBOX_F2HQ_ELEM_SZ_OFFSET (mbox->barmem)); + mbox->f2hq.mask = (mbox->f2hq.elem_cnt -1 ); +mutex_init (&mbox->f2hq_lock); + + mbox->h2fq.hw_prod =OCTEP_CTRL_MBOX_H2FQ_PROD_OFFSET (mbox->barmem); + mbox->h2fq.hw_cons =OCTEP_CTRL_MBOX_H2FQ_CONS_OFFSET (mbox->barmem); + mbox->h2fq.hw_q = mbox->barmem + +OCTEP_CTRL_MBOX_INFO_SZ + +OCTEP_CTRL_MBOX_H2FQ_INFO_SZ + +OCTEP_CTRL_MBOX_F2HQ_INFO_SZ ; + + mbox->f2hq.hw_prod =OCTEP_CTRL_MBOX_F2HQ_PROD_OFFSET (mbox->barmem); + mbox->f2hq.hw_cons =OCTEP_CTRL_MBOX_F2HQ_CONS_OFFSET (mbox->barmem); + mbox->f2hq.hw_q = mbox->h2fq.hw_q + + ((mbox->h2fq.elem_sz +sizeof (union octep_ctrl_mbox_msg_hdr )) * + mbox->h2fq.elem_cnt); + +/* ensure ready state is seen after everything is initialized */ +wmb (); +writeq (OCTEP_CTRL_MBOX_STATUS_READY ,OCTEP_CTRL_MBOX_INFO_HOST_STATUS_OFFSET (mbox->barmem)); + +pr_info ("Octep ctrl mbox : Init successful.\n" ); + +return 0 ; }int octep_ctrl_mbox_send (struct octep_ctrl_mbox *mbox,struct octep_ctrl_mbox_msg *msg) { -return -EINVAL ; +unsigned long timeout =msecs_to_jiffies (OCTEP_CTRL_MBOX_MSG_TIMEOUT_MS ); +unsigned long period =msecs_to_jiffies (OCTEP_CTRL_MBOX_MSG_WAIT_MS ); +unsigned long expire; +struct octep_ctrl_mbox_q *q; +u16 pi, ci; +u64 *mbuf, *qidx, *word0; +int i; + +if (!mbox || !msg) +return -EINVAL ; + + q = &mbox->h2fq; + pi =readl (q->hw_prod); + ci =readl (q->hw_cons); + +if (!octep_ctrl_mbox_circq_space (pi, ci, q->mask)) +return -ENOMEM ; + + qidx =OCTEP_CTRL_MBOX_Q_OFFSET (q->hw_q, pi); + mbuf = (u64 *)msg->msg; + word0 = &msg->hdr.word0; + +mutex_lock (&mbox->h2fq_lock); +for (i =1 ; i <= msg->hdr.sizew; i++) +writeq (*mbuf++, (qidx + i)); + +writeq (*word0, qidx); + + pi =octep_ctrl_mbox_circq_inc (pi, q->mask); +writel (pi, q->hw_prod); +mutex_unlock (&mbox->h2fq_lock); + +/* don't check for notification response */ +if (msg->hdr.flags &OCTEP_CTRL_MBOX_MSG_HDR_FLAG_NOTIFY ) +return 0 ; + + expire = jiffies + timeout; +while (true) { + *word0 =readq (qidx); +if (msg->hdr.flags ==OCTEP_CTRL_MBOX_MSG_HDR_FLAG_RESP ) +break ; +schedule_timeout_interruptible (period); +if (signal_pending (current) ||time_after (jiffies, expire)) { +pr_info ("octep_ctrl_mbox: Timed out\n" ); +return -EBUSY ; + } + } + mbuf = (u64 *)msg->msg; +for (i =1 ; i <= msg->hdr.sizew; i++) + *mbuf++ =readq (qidx + i); + +return 0 ; }int octep_ctrl_mbox_recv (struct octep_ctrl_mbox *mbox,struct octep_ctrl_mbox_msg *msg) { -return -EINVAL ; +struct octep_ctrl_mbox_q *q; +u32 count, pi, ci; +u64 *qidx, *mbuf; +int i; + +if (!mbox || !msg) +return -EINVAL ; + + q = &mbox->f2hq; + pi =readl (q->hw_prod); + ci =readl (q->hw_cons); + count =octep_ctrl_mbox_circq_depth (pi, ci, q->mask); +if (!count) +return -EAGAIN ; + + qidx =OCTEP_CTRL_MBOX_Q_OFFSET (q->hw_q, ci); + mbuf = (u64 *)msg->msg; + +mutex_lock (&mbox->f2hq_lock); + + msg->hdr.word0 =readq (qidx); +for (i =1 ; i <= msg->hdr.sizew; i++) + *mbuf++ =readq (qidx + i); + + ci =octep_ctrl_mbox_circq_inc (ci, q->mask); +writel (ci, q->hw_cons); + +mutex_unlock (&mbox->f2hq_lock); + +if (msg->hdr.flags !=OCTEP_CTRL_MBOX_MSG_HDR_FLAG_REQ || !mbox->process_req) +return 0 ; + + mbox->process_req (mbox->user_ctx, msg); + mbuf = (u64 *)msg->msg; +for (i =1 ; i <= msg->hdr.sizew; i++) +writeq (*mbuf++, (qidx + i)); + +writeq (msg->hdr.word0, qidx); + +return 0 ; }int octep_ctrl_mbox_uninit (struct octep_ctrl_mbox *mbox) { -return -EINVAL ; +if (!mbox) +return -EINVAL ; + +writeq (OCTEP_CTRL_MBOX_STATUS_UNINIT , +OCTEP_CTRL_MBOX_INFO_HOST_STATUS_OFFSET (mbox->barmem)); +/* ensure uninit state is written before uninitialization */ +wmb (); + +mutex_destroy (&mbox->h2fq_lock); +mutex_destroy (&mbox->f2hq_lock); + +writeq (OCTEP_CTRL_MBOX_STATUS_INVALID , +OCTEP_CTRL_MBOX_INFO_HOST_STATUS_OFFSET (mbox->barmem)); +writeq (0 ,OCTEP_CTRL_MBOX_INFO_HOST_VERSION_OFFSET (mbox->barmem)); + +pr_info ("Octep ctrl mbox : Uninit successful.\n" ); + +return 0 ; }
drivers/net/ethernet/marvell/octeon_ep/octep_ctrl_net.c +96 -4
124 lines not on this page · raw message
Signature · 1 line
2.17.1
Veerasenareddy Burru
maintainerPATCH v3 4/7 octeon_ep: add Tx/Rx ring resource setup and cleanup
In reply to Veerasenareddy BurruImplement Tx/Rx ring resource allocation and cleanup.
---
V2 -> V3:
- fix the implicit declaration errors for vmalloc() and vfree() calls, reported by kernel test robot:
V1 -> V2:
- created by dividing PATCH 1/4 of original patch series
.../net/ethernet/marvell/octeon_ep/octep_rx.c | 222 ++++++++++++++++++ .../net/ethernet/marvell/octeon_ep/octep_tx.c | 219 +++++++++++++++++ 2 files changed, 441 insertions(+)
drivers/net/ethernet/marvell/octeon_ep/octep_rx.c +222 -0
@@ -7,10 +7,199 @@#include <linux/pci.h> #include <linux/etherdevice.h> +#include <linux/vmalloc.h> #include "octep_config.h" #include "octep_main.h" +static void octep_oq_reset_indices (struct octep_oq *oq) +{ + oq->host_read_idx =0 ; + oq->host_refill_idx =0 ; + oq->refill_count =0 ; + oq->last_pkt_count =0 ; + oq->pkts_pending =0 ; +} + +/** +* octep_oq_fill_ring_buffers() - fill initial receive buffers for Rx ring. +* +* @oq: Octeon Rx queue data structure. +* +* Return: 0, if successfully filled receive buffers for all descriptors. +* -1, if failed to allocate a buffer or failed to map for DMA. +*/ +static int octep_oq_fill_ring_buffers (struct octep_oq *oq) +{ +struct octep_oq_desc_hw *desc_ring = oq->desc_ring; +struct page *page; +u32 i; + +for (i =0 ; i < oq->max_count; i++) { + page =dev_alloc_page (); +if (unlikely (!page)) { +dev_err (oq->dev,"Rx buffer alloc failed\n" ); + goto rx_buf_alloc_err; + } + desc_ring[i].buffer_ptr =dma_map_page (oq->dev, page,0 , +PAGE_SIZE , +DMA_FROM_DEVICE ); +if (dma_mapping_error (oq->dev, desc_ring[i].buffer_ptr)) { +dev_err (oq->dev, +"OQ-%d buffer alloc: DMA mapping error!\n" , + oq->q_no); +put_page (page); + goto dma_map_err; + } + oq->buff_info[i].page = page; + } + +return 0 ; + +dma_map_err: +rx_buf_alloc_err: +while (i) { + i--; +dma_unmap_page (oq->dev, desc_ring[i].buffer_ptr,PAGE_SIZE ,DMA_FROM_DEVICE ); +put_page (oq->buff_info[i].page); + oq->buff_info[i].page =NULL ; + } + +return -1 ; +} + +/** +* octep_setup_oq() - Setup a Rx queue. +* +* @oct: Octeon device private data structure. +* @q_no: Rx queue number to be setup. +* +* Allocate resources for a Rx queue. +*/ +static int octep_setup_oq (struct octep_device *oct,int q_no) +{ +struct octep_oq *oq; +u32 desc_ring_size; + + oq =vzalloc (sizeof (*oq)); +if (!oq) + goto create_oq_fail; + oct->oq[q_no] = oq; + + oq->octep_dev = oct; + oq->netdev = oct->netdev; + oq->dev = &oct->pdev->dev; + oq->q_no = q_no; + oq->max_count =CFG_GET_OQ_NUM_DESC (oct->conf); + oq->ring_size_mask = oq->max_count -1 ; + oq->buffer_size =CFG_GET_OQ_BUF_SIZE (oct->conf); + oq->max_single_buffer_size = oq->buffer_size -OCTEP_OQ_RESP_HW_SIZE ; + +/* When the hardware/firmware supports additional capabilities, +* additional header is filled-in by Octeon after length field in +* Rx packets. this header contains additional packet information. +*/ +if (oct->caps_enabled) + oq->max_single_buffer_size -=OCTEP_OQ_RESP_HW_EXT_SIZE ; + + oq->refill_threshold =CFG_GET_OQ_REFILL_THRESHOLD (oct->conf); + + desc_ring_size = oq->max_count *OCTEP_OQ_DESC_SIZE ; + oq->desc_ring =dma_alloc_coherent (oq->dev, desc_ring_size, + &oq->desc_ring_dma,GFP_KERNEL ); + +if (unlikely (!oq->desc_ring)) { +dev_err (oq->dev, +"Failed to allocate DMA memory for OQ-%d !!\n" , q_no); + goto desc_dma_alloc_err; + } + + oq->buff_info = (struct octep_rx_buffer *) +vzalloc (oq->max_count *OCTEP_OQ_RECVBUF_SIZE ); +if (unlikely (!oq->buff_info)) { +dev_err (&oct->pdev->dev, +"Failed to allocate buffer info for OQ-%d\n" , q_no); + goto buf_list_err; + } + +if (octep_oq_fill_ring_buffers (oq)) + goto oq_fill_buff_err; + +octep_oq_reset_indices (oq); + oct->hw_ops.setup_oq_regs (oct, q_no); + oct->num_oqs++; + +return 0 ; + +oq_fill_buff_err: +vfree (oq->buff_info); + oq->buff_info =NULL ; +buf_list_err: +dma_free_coherent (oq->dev, desc_ring_size, + oq->desc_ring, oq->desc_ring_dma); + oq->desc_ring =NULL ; +desc_dma_alloc_err: +vfree (oq); + oct->oq[q_no] =NULL ; +create_oq_fail: +return -1 ; +} + +/** +* octep_oq_free_ring_buffers() - Free ring buffers. +* +* @oq: Octeon Rx queue data structure. +* +* Free receive buffers in unused Rx queue descriptors. +*/ +static void octep_oq_free_ring_buffers (struct octep_oq *oq) +{ +struct octep_oq_desc_hw *desc_ring = oq->desc_ring; +int i; + +if (!oq->desc_ring || !oq->buff_info) +return ; + +for (i =0 ; i < oq->max_count; i++) { +if (oq->buff_info[i].page) { +dma_unmap_page (oq->dev, desc_ring[i].buffer_ptr, +PAGE_SIZE ,DMA_FROM_DEVICE ); +put_page (oq->buff_info[i].page); + oq->buff_info[i].page =NULL ; + desc_ring[i].buffer_ptr =0 ; + } + } +octep_oq_reset_indices (oq); +} + +/** +* octep_free_oq() - Free Rx queue resources. +* +* @oq: Octeon Rx queue data structure. +* +* Free all resources of a Rx queue. +*/ +static int octep_free_oq (struct octep_oq *oq) +{ +struct octep_device *oct = oq->octep_dev; +int q_no = oq->q_no; + +octep_oq_free_ring_buffers (oq); + +if (oq->buff_info) +vfree (oq->buff_info); + +if (oq->desc_ring) +dma_free_coherent (oq->dev, + oq->max_count *OCTEP_OQ_DESC_SIZE , + oq->desc_ring, oq->desc_ring_dma); + +vfree (oq); + oct->oq[q_no] =NULL ; + oct->num_oqs--; +return 0 ; +} +/** * octep_setup_oqs() - setup resources for all Rx queues. *
@@ -18,6 +207,26 @@*/ int octep_setup_oqs (struct octep_device *oct) { +int i, retval =0 ; + + oct->num_oqs =0 ; +for (i =0 ; i <CFG_GET_PORTS_ACTIVE_IO_RINGS (oct->conf); i++) { + retval =octep_setup_oq (oct, i); +if (retval) { +dev_err (&oct->pdev->dev, +"Failed to setup OQ(RxQ)-%d.\n" , i); + goto oq_setup_err; + } +dev_dbg (&oct->pdev->dev,"Successfully setup OQ(RxQ)-%d.\n" , i); + } + +return 0 ; + +oq_setup_err: +while (i) { + i--; +octep_free_oq (oct->oq[i]); + }return -1 ; }
@@ -30,6 +239,10 @@ int octep_setup_oqs(struct octep_device *oct)*/ void octep_oq_dbell_init (struct octep_device *oct) { +int i; + +for (i =0 ; i < oct->num_oqs; i++) +writel (oct->oq[i]->max_count, oct->oq[i]->pkts_credit_reg); }/**
@@ -39,4 +252,13 @@ void octep_oq_dbell_init(struct octep_device *oct)*/ void octep_free_oqs (struct octep_device *oct) { +int i; + +for (i =0 ; i <CFG_GET_PORTS_ACTIVE_IO_RINGS (oct->conf); i++) { +if (!oct->oq[i]) +continue ; +octep_free_oq (oct->oq[i]); +dev_dbg (&oct->pdev->dev, +"Successfully freed OQ(RxQ)-%d.\n" , i); + } }
drivers/net/ethernet/marvell/octeon_ep/octep_tx.c +219 -0
245 lines not on this page · raw message
Signature · 1 line
2.17.1
Veerasenareddy Burru
maintainerPATCH v3 5/7 octeon_ep: add support for ndo ops
In reply to Veerasenareddy BurruAdd support for ndo ops to set MAC address, change MTU, get stats. Add control path support to set MAC address, change MTU, get stats, set speed, get and set link mode.
---
V2 -> V3: no change.
V1 -> V2:
- Address review comments:
- declare variables in reversed Christmas tree, in all functions.
- Replace {0} with {} to zero initialize a structure.
- use success oriented approach when returning on error; Replace
err = foo(..);
if (!err) {
/* Scucess */
....
}
return err;
with
err = foo(..);
if (err)
return err;
/* Success */
....- fix build errors observed with clang and "make W=1 C=1".
.../marvell/octeon_ep/octep_ctrl_net.c | 63 +++++++++++++++ .../ethernet/marvell/octeon_ep/octep_main.c | 78 +++++++++++++++++++ 2 files changed, 141 insertions(+)
drivers/net/ethernet/marvell/octeon_ep/octep_ctrl_net.c +63 -0
@@ -87,6 +87,69 @@ int octep_get_mac_addr(struct octep_device *oct, u8 *addr)return err; } +int octep_set_mac_addr (struct octep_device *oct,u8 *addr) +{ +struct octep_ctrl_net_h2f_req req = {}; +struct octep_ctrl_mbox_msg msg = {}; + + req.hdr.cmd =OCTEP_CTRL_NET_H2F_CMD_MAC ; + req.mac.cmd =OCTEP_CTRL_NET_CMD_SET ; +memcpy (&req.mac.addr, addr,ETH_ALEN ); + + msg.hdr.flags =OCTEP_CTRL_MBOX_MSG_HDR_FLAG_REQ ; + msg.hdr.sizew =OCTEP_CTRL_NET_H2F_MAC_REQ_SZW ; + msg.msg = &req; + +return octep_ctrl_mbox_send (&oct->ctrl_mbox, &msg); +} + +int octep_set_mtu (struct octep_device *oct,int mtu) +{ +struct octep_ctrl_net_h2f_req req = {}; +struct octep_ctrl_mbox_msg msg = {}; + + req.hdr.cmd =OCTEP_CTRL_NET_H2F_CMD_MTU ; + req.mtu.cmd =OCTEP_CTRL_NET_CMD_SET ; + req.mtu.val = mtu; + + msg.hdr.flags =OCTEP_CTRL_MBOX_MSG_HDR_FLAG_REQ ; + msg.hdr.sizew =OCTEP_CTRL_NET_H2F_MTU_REQ_SZW ; + msg.msg = &req; + +return octep_ctrl_mbox_send (&oct->ctrl_mbox, &msg); +} + +int octep_get_if_stats (struct octep_device *oct) +{ +struct octep_iface_rx_stats *iface_rx_stats; +struct octep_iface_tx_stats *iface_tx_stats; +struct octep_ctrl_net_h2f_req req = {}; +struct octep_ctrl_mbox_msg msg = {}; +int err; + + req.hdr.cmd =OCTEP_CTRL_NET_H2F_CMD_GET_IF_STATS ; + req.mac.cmd =OCTEP_CTRL_NET_CMD_GET ; + req.get_stats.offset = oct->ctrl_mbox_ifstats_offset; + + msg.hdr.flags =OCTEP_CTRL_MBOX_MSG_HDR_FLAG_REQ ; + msg.hdr.sizew =OCTEP_CTRL_NET_H2F_GET_STATS_REQ_SZW ; + msg.msg = &req; + err =octep_ctrl_mbox_send (&oct->ctrl_mbox, &msg); +if (err) +return err; + + iface_rx_stats = (struct octep_iface_rx_stats *)(oct->ctrl_mbox.barmem + + oct->ctrl_mbox_ifstats_offset); + iface_tx_stats = (struct octep_iface_tx_stats *)(oct->ctrl_mbox.barmem + + oct->ctrl_mbox_ifstats_offset + +sizeof (struct octep_iface_rx_stats ) + ); +memcpy (&oct->iface_rx_stats, iface_rx_stats,sizeof (struct octep_iface_rx_stats )); +memcpy (&oct->iface_tx_stats, iface_tx_stats,sizeof (struct octep_iface_tx_stats )); + +return err; +} +int octep_get_link_info (struct octep_device *oct) {struct octep_ctrl_net_h2f_req req = {};
drivers/net/ethernet/marvell/octeon_ep/octep_main.c +78 -0
95 lines not on this page · raw message
Signature · 1 line
2.17.1
Veerasenareddy Burru
maintainerPATCH v3 6/7 octeon_ep: add Tx/Rx processing and interrupt support
In reply to Veerasenareddy BurruAdd support to enable MSI-x and register interrupts. Add support to process Tx and Rx traffic. Includes processing Tx completions and Rx refill.
---
V2 -> V3: no change.
V1 -> V2:
- fix build errors observed with clang and "make W=1 C=1".
.../ethernet/marvell/octeon_ep/octep_main.c | 587 ++++++++++++++++++ .../net/ethernet/marvell/octeon_ep/octep_rx.c | 245 ++++++++ .../net/ethernet/marvell/octeon_ep/octep_tx.c | 73 +++ 3 files changed, 905 insertions(+)
drivers/net/ethernet/marvell/octeon_ep/octep_main.c +587 -0
@@ -32,6 +32,431 @@ MODULE_DESCRIPTION(OCTEP_DRV_STRING);MODULE_LICENSE ("GPL" );MODULE_VERSION (OCTEP_DRV_VERSION_STR ); +/** +* octep_alloc_ioq_vectors() - Allocate Tx/Rx Queue interrupt info. +* +* @oct: Octeon device private data structure. +* +* Allocate resources to hold per Tx/Rx queue interrupt info. +* This is the information passed to interrupt handler, from which napi poll +* is scheduled and includes quick access to private data of Tx/Rx queue +* corresponding to the interrupt being handled. +* +* Return: 0, on successful allocation of resources for all queue interrupts. +* -1, if failed to allocate any resource. +*/ +static int octep_alloc_ioq_vectors (struct octep_device *oct) +{ +int i; +struct octep_ioq_vector *ioq_vector; + +for (i =0 ; i < oct->num_oqs; i++) { + oct->ioq_vector[i] =vzalloc (sizeof (*oct->ioq_vector[i])); +if (!oct->ioq_vector[i]) + goto free_ioq_vector; + + ioq_vector = oct->ioq_vector[i]; + ioq_vector->iq = oct->iq[i]; + ioq_vector->oq = oct->oq[i]; + ioq_vector->octep_dev = oct; + } + +dev_info (&oct->pdev->dev,"Allocated %d IOQ vectors\n" , oct->num_oqs); +return 0 ; + +free_ioq_vector: +while (i) { + i--; +vfree (oct->ioq_vector[i]); + oct->ioq_vector[i] =NULL ; + } +return -1 ; +} + +/** +* octep_free_ioq_vectors() - Free Tx/Rx Queue interrupt vector info. +* +* @oct: Octeon device private data structure. +*/ +static void octep_free_ioq_vectors (struct octep_device *oct) +{ +int i; + +for (i =0 ; i < oct->num_oqs; i++) { +if (oct->ioq_vector[i]) { +vfree (oct->ioq_vector[i]); + oct->ioq_vector[i] =NULL ; + } + } +netdev_info (oct->netdev,"Freed IOQ Vectors\n" ); +} + +/** +* octep_enable_msix_range() - enable MSI-x interrupts. +* +* @oct: Octeon device private data structure. +* +* Allocate and enable all MSI-x interrupts (queue and non-queue interrupts) +* for the Octeon device. +* +* Return: 0, on successfully enabling all MSI-x interrupts. +* -1, if failed to enable any MSI-x interrupt. +*/ +static int octep_enable_msix_range (struct octep_device *oct) +{ +int num_msix, msix_allocated; +int i; + +/* Generic interrupts apart from input/output queues */ + num_msix = oct->num_oqs +CFG_GET_NON_IOQ_MSIX (oct->conf); + oct->msix_entries =kcalloc (num_msix, +sizeof (struct msix_entry ),GFP_KERNEL ); +if (!oct->msix_entries) + goto msix_alloc_err; + +for (i =0 ; i < num_msix; i++) + oct->msix_entries[i].entry = i; + + msix_allocated =pci_enable_msix_range (oct->pdev, oct->msix_entries, + num_msix, num_msix); +if (msix_allocated != num_msix) { +dev_err (&oct->pdev->dev, +"Failed to enable %d msix irqs; got only %d\n" , + num_msix, msix_allocated); + goto enable_msix_err; + } + oct->num_irqs = msix_allocated; +dev_info (&oct->pdev->dev,"MSI-X enabled successfully\n" ); + +return 0 ; + +enable_msix_err: +if (msix_allocated >0 ) +pci_disable_msix (oct->pdev); +kfree (oct->msix_entries); + oct->msix_entries =NULL ; +msix_alloc_err: +return -1 ; +} + +/** +* octep_disable_msix() - disable MSI-x interrupts. +* +* @oct: Octeon device private data structure. +* +* Disable MSI-x on the Octeon device. +*/ +static void octep_disable_msix (struct octep_device *oct) +{ +pci_disable_msix (oct->pdev); +kfree (oct->msix_entries); + oct->msix_entries =NULL ; +dev_info (&oct->pdev->dev,"Disabled MSI-X\n" ); +} + +/** +* octep_non_ioq_intr_handler() - common handler for all generic interrupts. +* +* @irq: Interrupt number. +* @data: interrupt data. +* +* this is common handler for all non-queue (generic) interrupts. +*/ +static irqreturn_t octep_non_ioq_intr_handler (int irq,void *data) +{ +struct octep_device *oct = data; + +return oct->hw_ops.non_ioq_intr_handler (oct); +} + +/** +* octep_ioq_intr_handler() - handler for all Tx/Rx queue interrupts. +* +* @irq: Interrupt number. +* @data: interrupt data contains pointers to Tx/Rx queue private data +* and correspong NAPI context. +* +* this is common handler for all non-queue (generic) interrupts. +*/ +static irqreturn_t octep_ioq_intr_handler (int irq,void *data) +{ +struct octep_ioq_vector *ioq_vector = data; +struct octep_device *oct = ioq_vector->octep_dev; + +return oct->hw_ops.ioq_intr_handler (ioq_vector); +} + +/** +* octep_request_irqs() - Register interrupt handlers. +* +* @oct: Octeon device private data structure. +* +* Register handlers for all queue and non-queue interrupts. +* +* Return: 0, on successful registration of all interrupt handlers. +* -1, on any error. +*/ +static int octep_request_irqs (struct octep_device *oct) +{ +struct net_device *netdev = oct->netdev; +struct octep_ioq_vector *ioq_vector; +struct msix_entry *msix_entry; +char **non_ioq_msix_names; +int num_non_ioq_msix; +int ret, i; + + num_non_ioq_msix =CFG_GET_NON_IOQ_MSIX (oct->conf); + non_ioq_msix_names =CFG_GET_NON_IOQ_MSIX_NAMES (oct->conf); + + oct->non_ioq_irq_names =kcalloc (num_non_ioq_msix, +OCTEP_MSIX_NAME_SIZE ,GFP_KERNEL ); +if (!oct->non_ioq_irq_names) + goto alloc_err; + +/* First few MSI-X interrupts are non-queue interrupts */ +for (i =0 ; i < num_non_ioq_msix; i++) { +char *irq_name; + + irq_name = &oct->non_ioq_irq_names[i *OCTEP_MSIX_NAME_SIZE ]; + msix_entry = &oct->msix_entries[i]; + +snprintf (irq_name,OCTEP_MSIX_NAME_SIZE , +"%s-%s" , netdev->name, non_ioq_msix_names[i]); + ret =request_irq (msix_entry->vector, + octep_non_ioq_intr_handler,0 , + irq_name, oct); +if (ret) { +netdev_err (netdev, +"request_irq failed for %s; err=%d" , + irq_name, ret); + goto non_ioq_irq_err; + } + } + +/* Request IRQs for Tx/Rx queues */ +for (i =0 ; i < oct->num_oqs; i++) { + ioq_vector = oct->ioq_vector[i]; + msix_entry = &oct->msix_entries[i + num_non_ioq_msix]; + +snprintf (ioq_vector->name,sizeof (ioq_vector->name), +"%s-q%d" , netdev->name, i); + ret =request_irq (msix_entry->vector, + octep_ioq_intr_handler,0 , + ioq_vector->name, ioq_vector); +if (ret) { +netdev_err (netdev, +"request_irq failed for Q-%d; err=%d" , + i, ret); + goto ioq_irq_err; + } + +cpumask_set_cpu (i %num_online_cpus (), + &ioq_vector->affinity_mask); +irq_set_affinity_hint (msix_entry->vector, + &ioq_vector->affinity_mask); + } + +return 0 ; +ioq_irq_err: +while (i > num_non_ioq_msix) { + --i; +irq_set_affinity_hint (oct->msix_entries[i].vector,NULL ); +free_irq (oct->msix_entries[i].vector, oct->ioq_vector[i]); + } +non_ioq_irq_err: +while (i) { + --i; +free_irq (oct->msix_entries[i].vector, oct); + } +alloc_err: +return -1 ; +} + +/** +* octep_free_irqs() - free all registered interrupts. +* +* @oct: Octeon device private data structure. +* +* Free all queue and non-queue interrupts of the Octeon device. +*/ +static void octep_free_irqs (struct octep_device *oct) +{ +int i; + +/* First few MSI-X interrupts are non queue interrupts; free them */ +for (i =0 ; i <CFG_GET_NON_IOQ_MSIX (oct->conf); i++) +free_irq (oct->msix_entries[i].vector, oct); +kfree (oct->non_ioq_irq_names); + +/* Free IRQs for Input/Output (Tx/Rx) queues */ +for (i =CFG_GET_NON_IOQ_MSIX (oct->conf); i < oct->num_irqs; i++) { +irq_set_affinity_hint (oct->msix_entries[i].vector,NULL ); +free_irq (oct->msix_entries[i].vector, + oct->ioq_vector[i -CFG_GET_NON_IOQ_MSIX (oct->conf)]); + } +netdev_info (oct->netdev,"IRQs freed\n" ); +} + +/** +* octep_setup_irqs() - setup interrupts for the Octeon device. +* +* @oct: Octeon device private data structure. +* +* Allocate data structures to hold per interrupt information, allocate/enable +* MSI-x interrupt and register interrupt handlers. +* +* Return: 0, on successful allocation and registration of all interrupts. +* -1, on any error. +*/ +static int octep_setup_irqs (struct octep_device *oct) +{ +if (octep_alloc_ioq_vectors (oct)) + goto ioq_vector_err; + +if (octep_enable_msix_range (oct)) + goto enable_msix_err; + +if (octep_request_irqs (oct)) + goto request_irq_err; + +return 0 ; + +request_irq_err: +octep_disable_msix (oct); +enable_msix_err: +octep_free_ioq_vectors (oct); +ioq_vector_err: +return -1 ; +} + +/** +* octep_clean_irqs() - free all interrupts and its resources. +* +* @oct: Octeon device private data structure. +*/ +static void octep_clean_irqs (struct octep_device *oct) +{ +octep_free_irqs (oct); +octep_disable_msix (oct); +octep_free_ioq_vectors (oct); +} + +/** +* octep_enable_ioq_irq() - Enable MSI-x interrupt of a Tx/Rx queue. +* +* @iq: Octeon Tx queue data structure. +* @oq: Octeon Rx queue data structure. +*/ +static void octep_enable_ioq_irq (struct octep_iq *iq,struct octep_oq *oq) +{ +u32 pkts_pend = oq->pkts_pending; + +netdev_dbg (iq->netdev,"enabling intr for Q-%u\n" , iq->q_no); +if (iq->pkts_processed) { +writel (iq->pkts_processed, iq->inst_cnt_reg); + iq->pkt_in_done -= iq->pkts_processed; + iq->pkts_processed =0 ; + } +if (oq->last_pkt_count - pkts_pend) { +writel (oq->last_pkt_count - pkts_pend, oq->pkts_sent_reg); + oq->last_pkt_count = pkts_pend; + } + +/* Flush the previous wrties before writing to RESEND bit */ +wmb (); +writeq (1UL <<OCTEP_OQ_INTR_RESEND_BIT , oq->pkts_sent_reg); +writeq (1UL <<OCTEP_IQ_INTR_RESEND_BIT , iq->inst_cnt_reg); +} + +/** +* octep_napi_poll() - NAPI poll function for Tx/Rx. +* +* @napi: pointer to napi context. +* @budget: max number of packets to be processed in single invocation. +*/ +static int octep_napi_poll (struct napi_struct *napi,int budget) +{ +struct octep_ioq_vector *ioq_vector = + container_of(napi, struct octep_ioq_vector, napi); +u32 tx_pending, rx_done; + + tx_pending =octep_iq_process_completions (ioq_vector->iq, budget); + rx_done =octep_oq_process_rx (ioq_vector->oq, budget); + +/* need more polling if tx completion processing is still pending or +* processed at least 'budget' number of rx packets. +*/ +if (tx_pending || rx_done >= budget) +return budget; + +napi_complete (napi); +octep_enable_ioq_irq (ioq_vector->iq, ioq_vector->oq); +return rx_done; +} + +/** +* octep_napi_add() - Add NAPI poll for all Tx/Rx queues. +* +* @oct: Octeon device private data structure. +*/ +static void octep_napi_add (struct octep_device *oct) +{ +int i; + +for (i =0 ; i < oct->num_oqs; i++) { +netdev_dbg (oct->netdev,"Adding NAPI on Q-%d\n" , i); +netif_napi_add (oct->netdev, &oct->ioq_vector[i]->napi, + octep_napi_poll,64 ); + oct->oq[i]->napi = &oct->ioq_vector[i]->napi; + } +} + +/** +* octep_napi_delete() - delete NAPI poll callback for all Tx/Rx queues. +* +* @oct: Octeon device private data structure. +*/ +static void octep_napi_delete (struct octep_device *oct) +{ +int i; + +for (i =0 ; i < oct->num_oqs; i++) { +netdev_dbg (oct->netdev,"Deleting NAPI on Q-%d\n" , i); +netif_napi_del (&oct->ioq_vector[i]->napi); + oct->oq[i]->napi =NULL ; + } +} + +/** +* octep_napi_enable() - enable NAPI for all Tx/Rx queues. +* +* @oct: Octeon device private data structure. +*/ +static void octep_napi_enable (struct octep_device *oct) +{ +int i; + +for (i =0 ; i < oct->num_oqs; i++) { +netdev_dbg (oct->netdev,"Enabling NAPI on Q-%d\n" , i); +napi_enable (&oct->ioq_vector[i]->napi); + } +} + +/** +* octep_napi_disable() - disable NAPI for all Tx/Rx queues. +* +* @oct: Octeon device private data structure. +*/ +static void octep_napi_disable (struct octep_device *oct) +{ +int i; + +for (i =0 ; i < oct->num_oqs; i++) { +netdev_dbg (oct->netdev,"Disabling NAPI on Q-%d\n" , i); +napi_disable (&oct->ioq_vector[i]->napi); + } +} +static void octep_link_up (struct net_device *netdev) {netif_carrier_on (netdev);
@@ -63,6 +488,8 @@ static int octep_open(struct net_device *netdev) goto setup_iq_err;if (octep_setup_oqs (oct)) goto setup_oq_err; +if (octep_setup_irqs (oct)) + goto setup_irq_err; err =netif_set_real_num_tx_queues (netdev, oct->num_oqs);if (err)
@@ -71,6 +498,9 @@ static int octep_open(struct net_device *netdev)if (err) goto set_queues_err; +octep_napi_add (oct); +octep_napi_enable (oct); + oct->link_info.admin_up =1 ;octep_set_rx_state (oct, true);
@@ -93,6 +523,10 @@ static int octep_open(struct net_device *netdev)return 0 ; set_queues_err: +octep_napi_disable (oct); +octep_napi_delete (oct); +octep_clean_irqs (oct); +setup_irq_err:octep_free_oqs (oct); setup_oq_err:octep_free_iqs (oct);
@@ -126,7 +560,10 @@ static int octep_stop(struct net_device *netdev) oct->link_info.oper_up =0 ; oct->hw_ops.disable_interrupts (oct); +octep_napi_disable (oct); +octep_napi_delete (oct); +octep_clean_irqs (oct);octep_clean_iqs (oct); oct->hw_ops.disable_io_queues (oct);
@@ -137,6 +574,36 @@ static int octep_stop(struct net_device *netdev)return 0 ; } +/** +* octep_iq_full_check() - check if a Tx queue is full. +* +* @iq: Octeon Tx queue data structure. +* +* Return: 0, if the Tx queue is not full. +* 1, if the Tx queue is full. +*/ +static inline int octep_iq_full_check (struct octep_iq *iq) +{ +if (likely ((iq->max_count -atomic_read (&iq->instr_pending)) >= +OCTEP_WAKE_QUEUE_THRESHOLD )) +return 0 ; + +/* Stop the queue if unable to send */ +netif_stop_subqueue (iq->netdev, iq->q_no); + +/* check again and restart the queue, in case NAPI has just freed +* enough Tx ring entries. +*/ +if (unlikely ((iq->max_count -atomic_read (&iq->instr_pending)) >= +OCTEP_WAKE_QUEUE_THRESHOLD )) { +netif_start_subqueue (iq->netdev, iq->q_no); + iq->stats.restart_cnt++; +return 0 ; + } + +return 1 ; +} +/** * octep_start_xmit() - Enqueue packet to Octoen hardware Tx Queue. *
@@ -149,6 +616,126 @@ static int octep_stop(struct net_device *netdev)static netdev_tx_t octep_start_xmit (struct sk_buff *skb,struct net_device *netdev) { +struct octep_device *oct =netdev_priv (netdev); +struct octep_tx_sglist_desc *sglist; +struct octep_tx_buffer *tx_buffer; +struct octep_tx_desc_hw *hw_desc; +struct skb_shared_info *shinfo; +struct octep_instr_hdr *ih; +struct octep_iq *iq; +skb_frag_t *frag; +u16 nr_frags, si; +u16 q_no, wi; + + q_no =skb_get_queue_mapping (skb); +if (q_no >= oct->num_iqs) { +netdev_err (netdev,"Invalid Tx skb->queue_mapping=%d\n" , q_no); + q_no = q_no % oct->num_iqs; + } + + iq = oct->iq[q_no]; +if (octep_iq_full_check (iq)) { + iq->stats.tx_busy++; +return NETDEV_TX_BUSY ; + } + + shinfo =skb_shinfo (skb); + nr_frags = shinfo->nr_frags; + + wi = iq->host_write_index; + hw_desc = &iq->desc_ring[wi]; + hw_desc->ih64 =0 ; + + tx_buffer = iq->buff_info + wi; + tx_buffer->skb = skb; + + ih = &hw_desc->ih; + ih->tlen = skb->len; + ih->pkind = oct->pkind; + +if (!nr_frags) { + tx_buffer->gather =0 ; + tx_buffer->dma =dma_map_single (iq->dev, skb->data, + skb->len,DMA_TO_DEVICE ); +if (dma_mapping_error (iq->dev, tx_buffer->dma)) + goto dma_map_err; + hw_desc->dptr = tx_buffer->dma; + }else { +/* Scatter/Gather */ +dma_addr_t dma; +u16 len; + + sglist = tx_buffer->sglist; + + ih->gsz = nr_frags +1 ; + ih->gather =1 ; + tx_buffer->gather =1 ; + + len =skb_headlen (skb); + dma =dma_map_single (iq->dev, skb->data, len,DMA_TO_DEVICE ); +if (dma_mapping_error (iq->dev, dma)) + goto dma_map_err; + +dma_sync_single_for_cpu (iq->dev, tx_buffer->sglist_dma, +OCTEP_SGLIST_SIZE_PER_PKT , +DMA_TO_DEVICE ); +memset (sglist,0 ,OCTEP_SGLIST_SIZE_PER_PKT ); + sglist[0 ].len[3 ] = len; + sglist[0 ].dma_ptr[0 ] = dma; + + si =1 ;/* entry 0 is main skb, mapped above */ + frag = &shinfo->frags[0 ]; +while (nr_frags--) { + len =skb_frag_size (frag); + dma =skb_frag_dma_map (iq->dev, frag,0 , + len,DMA_TO_DEVICE ); +if (dma_mapping_error (iq->dev, dma)) + goto dma_map_sg_err; + + sglist[si >>2 ].len[3 - (si &3 )] = len; + sglist[si >>2 ].dma_ptr[si &3 ] = dma; + + frag++; + si++; + } +dma_sync_single_for_device (iq->dev, tx_buffer->sglist_dma, +OCTEP_SGLIST_SIZE_PER_PKT , +DMA_TO_DEVICE ); + + hw_desc->dptr = tx_buffer->sglist_dma; + } + +/* Flush the hw descriptor before writing to doorbell */ +wmb (); + +/* Ring Doorbell to notify the NIC there is a new packet */ +writel (1 , iq->doorbell_reg); +atomic_inc (&iq->instr_pending); + wi++; +if (wi == iq->max_count) + wi =0 ; + iq->host_write_index = wi; + +netdev_tx_sent_queue (iq->netdev_q, skb->len); + iq->stats.instr_posted++; +skb_tx_timestamp (skb); +return NETDEV_TX_OK ; + +dma_map_sg_err: +if (si >0 ) { +dma_unmap_single (iq->dev, sglist[0 ].dma_ptr[0 ], + sglist[0 ].len[0 ],DMA_TO_DEVICE ); + sglist[0 ].len[0 ] =0 ; + } +while (si >1 ) { +dma_unmap_page (iq->dev, sglist[si >>2 ].dma_ptr[si &3 ], + sglist[si >>2 ].len[si &3 ],DMA_TO_DEVICE ); + sglist[si >>2 ].len[si &3 ] =0 ; + si--; + } + tx_buffer->gather =0 ; +dma_map_err: +dev_kfree_skb_any (skb);return NETDEV_TX_OK ; }
drivers/net/ethernet/marvell/octeon_ep/octep_rx.c +245 -0
254 lines not on this page · raw message
drivers/net/ethernet/marvell/octeon_ep/octep_tx.c +73 -0
79 lines not on this page · raw message
Signature · 1 line
2.17.1
Veerasenareddy Burru
maintainerPATCH v3 7/7 octeon_ep: add ethtool support for Octeon PCI Endpoint NIC
In reply to Veerasenareddy BurruAdd support for the following ethtool commands:
ethtool -i|--driver devname
ethtool devname
ethtool -s devname [speed N] [autoneg on|off] [advertise N] ethtool -S|--statistics devname
---
V2 -> V3: no change.
V1 -> V2:
- Fix build errors observed with clang and "make W=1 C=1".
- Address review comments:
- removed setting version string in get_drvinfo.
- defined helper macro for common code to set supported and advertised modes in get_link_ksettings.
.../net/ethernet/marvell/octeon_ep/Makefile | 2 +- .../marvell/octeon_ep/octep_ethtool.c | 463 ++++++++++++++++++ .../ethernet/marvell/octeon_ep/octep_main.c | 1 + 3 files changed, 465 insertions(+), 1 deletion(-) create mode 100644 drivers/net/ethernet/marvell/octeon_ep/octep_ethtool.c
drivers/net/ethernet/marvell/octeon_ep/Makefile +1 -1
@@ -6,4 +6,4 @@ obj-$(CONFIG_OCTEON_EP) += octeon_ep.o octeon_ep-y := octep_main.o octep_cn9k_pf.o octep_tx.o octep_rx.o \ - octep_ctrl_mbox.o octep_ctrl_net.o + octep_ethtool.o octep_ctrl_mbox.o octep_ctrl_net.o
drivers/net/ethernet/marvell/octeon_ep/octep_ethtool.c new file +463 -0
463 lines not on this page · raw message
drivers/net/ethernet/marvell/octeon_ep/octep_main.c +1 -0
@@ -1059,6 +1059,7 @@ static int octep_probe(struct pci_dev *pdev, const struct pci_device_id *ent)INIT_WORK (&octep_dev->ctrl_mbox_task, octep_ctrl_mbox_task); netdev->netdev_ops = &octep_netdev_ops; +octep_set_ethtool_ops (netdev);netif_carrier_off (netdev); netdev->hw_features =NETIF_F_SG ;
Signature · 1 line
2.17.1
Jakub Kicinski
maintainerQuoted 3 lines · On Mon, 7 Mar 2022 01:26:39 -0800 Veerasenareddy Burru wrote:
V2 -> V3:
Fix warnings and errors reported by kernel test robot:Reported-by kernel test robot <[email protected]>
Try building each patch with W=1 C=1, there's more to fix.