ENA driver XDP changes
Subsystems (5)
[email protected]
maintainerv2 cover ENA driver XDP changes
From: David Arinzon <[email protected]>
This patchset contains multiple XDP-related changes in the ENA driver, including moving the XDP code to dedicated files.
Changes in v2:
- Moved changes to right commits in order to avoid compilation errors
David Arinzon (11):
net: ena: Move XDP code to its new files
net: ena: Pass ena_adapter instead of net_device to ena_xmit_common()
net: ena: Put orthogonal fields in ena_tx_buffer in a union
net: ena: Introduce total_tx_size field in ena_tx_buffer struct
net: ena: Use tx_ring instead of xdp_ring for XDP channel TX
net: ena: Don't check if XDP program is loaded in ena_xdp_execute()
net: ena: Refactor napi functions
net: ena: Add more debug prints to XDP related function
net: ena: Always register RX queue info
net: ena: Make queue stats code cleaner by removing the if block
net: ena: Take xdp packets stats into account in ena_get_stats64()
.../device_drivers/ethernet/amazon/ena.rst | 1 + drivers/net/ethernet/amazon/ena/Makefile | 2 +- drivers/net/ethernet/amazon/ena/ena_ethtool.c | 18 +- drivers/net/ethernet/amazon/ena/ena_netdev.c | 689 ++---------------- drivers/net/ethernet/amazon/ena/ena_netdev.h | 99 ++- drivers/net/ethernet/amazon/ena/ena_xdp.c | 468 ++++++++++++ drivers/net/ethernet/amazon/ena/ena_xdp.h | 151 ++++ 7 files changed, 736 insertions(+), 692 deletions(-) create mode 100644 drivers/net/ethernet/amazon/ena/ena_xdp.c create mode 100644 drivers/net/ethernet/amazon/ena/ena_xdp.h
Signature · 1 line
2.40.1
[email protected]
maintainerPATCH v2 1/11 net: ena: Move XDP code to its new files
From: David Arinzon <[email protected]>
XDP system has a very large footprint in the driver's overall code. makes the whole driver's code much harder to read.
Moving XDP code to dedicated files.
This patch doesn't make any changes to the code itself and only cut-pastes the code into ena_xdp.c and ena_xdp.h files so the change is purely cosmetic.
--- .../device_drivers/ethernet/amazon/ena.rst | 1 + drivers/net/ethernet/amazon/ena/Makefile | 2 +- drivers/net/ethernet/amazon/ena/ena_ethtool.c | 1 + drivers/net/ethernet/amazon/ena/ena_netdev.c | 634 +----------------- drivers/net/ethernet/amazon/ena/ena_netdev.h | 82 +-- drivers/net/ethernet/amazon/ena/ena_xdp.c | 465 +++++++++++++ drivers/net/ethernet/amazon/ena/ena_xdp.h | 152 +++++ 7 files changed, 680 insertions(+), 657 deletions(-) create mode 100644 drivers/net/ethernet/amazon/ena/ena_xdp.c create mode 100644 drivers/net/ethernet/amazon/ena/ena_xdp.h
Documentation/networking/device_drivers/ethernet/amazon/ena.rst +1 -0
@@ -54,6 +54,7 @@ ena_common_defs.h Common definitions for ena_com layer. ena_regs_defs.h Definition of ENA PCI memory-mapped (MMIO) registers. ena_netdev.[ch] Main Linux kernel driver. ena_ethtool.c ethtool callbacks. +ena_xdp.[ch] XDP files ena_pci_id_tbl.h Supported device IDs. ================= ======================================================
drivers/net/ethernet/amazon/ena/Makefile +1 -1
@@ -5,4 +5,4 @@ obj-$(CONFIG_ENA_ETHERNET) += ena.o -ena-y := ena_netdev.o ena_com.o ena_eth_com.o ena_ethtool.o +ena-y := ena_netdev.o ena_com.o ena_eth_com.o ena_ethtool.o ena_xdp.o
drivers/net/ethernet/amazon/ena/ena_ethtool.c +1 -0
@@ -7,6 +7,7 @@#include <linux/pci.h> #include "ena_netdev.h" +#include "ena_xdp.h" struct ena_stats {char name[ETH_GSTRING_LEN ];
drivers/net/ethernet/amazon/ena/ena_netdev.c +27 -607
743 lines not on this page · raw message
drivers/net/ethernet/amazon/ena/ena_netdev.h +33 -49
99 lines not on this page · raw message
drivers/net/ethernet/amazon/ena/ena_xdp.c new file +465 -0
465 lines not on this page · raw message
drivers/net/ethernet/amazon/ena/ena_xdp.h new file +152 -0
152 lines not on this page · raw message
Signature · 1 line
2.40.1
[email protected]
maintainerPATCH v2 2/11 net: ena: Pass ena_adapter instead of net_device to ena_xmit_common()
In reply to [email protected]From: David Arinzon <[email protected]>
This change will enable the ability to use ena_xmit_common() in functions that don't have a net_device pointer. While it can be retrieved by dereferencing ena_adapter (adapter->netdev), there's no reason to do it in fast path code where this pointer is only needed for debug prints.
--- drivers/net/ethernet/amazon/ena/ena_netdev.c | 9 ++++----- drivers/net/ethernet/amazon/ena/ena_netdev.h | 2 +- drivers/net/ethernet/amazon/ena/ena_xdp.c | 6 +++--- drivers/net/ethernet/amazon/ena/ena_xdp.h | 4 ++-- 4 files changed, 10 insertions(+), 11 deletions(-)
drivers/net/ethernet/amazon/ena/ena_netdev.c +4 -5
@@ -88,19 +88,18 @@ static int ena_change_mtu(struct net_device *dev, int new_mtu)return ret; } -int ena_xmit_common (struct net_device *dev, +int ena_xmit_common (struct ena_adapter *adapter,struct ena_ring *ring,struct ena_tx_buffer *tx_info,struct ena_com_tx_ctx *ena_tx_ctx,u16 next_to_use,u32 bytes) { -struct ena_adapter *adapter =netdev_priv (dev);int rc, nb_hw_desc;if (unlikely (ena_com_is_doorbell_needed (ring->ena_com_io_sq, ena_tx_ctx))) { -netif_dbg (adapter, tx_queued, dev, +netif_dbg (adapter, tx_queued, adapter->netdev,"llq tx max burst size of queue %d achieved, writing doorbell to send burst\n" , ring->qid);ena_ring_tx_doorbell (ring);
@@ -115,7 +114,7 @@ int ena_xmit_common(struct net_device *dev,* ena_com_prepare_tx() are fatal and therefore require a device reset. */ if (unlikely (rc)) { -netif_err (adapter, tx_queued, dev, +netif_err (adapter, tx_queued, adapter->netdev,"Failed to prepare tx bufs\n" );ena_increase_stat (&ring->tx_stats.prepare_ctx_err,1 , &ring->syncp);
@@ -2599,7 +2598,7 @@ static netdev_tx_t ena_start_xmit(struct sk_buff *skb, struct net_device *dev)/* set flags and meta data */ ena_tx_csum (&ena_tx_ctx, skb, tx_ring->disable_meta_caching); - rc = ena_xmit_common(dev, + rc = ena_xmit_common(adapter, tx_ring, tx_info, &ena_tx_ctx,
drivers/net/ethernet/amazon/ena/ena_netdev.h +1 -1
@@ -426,7 +426,7 @@ static inline void ena_ring_tx_doorbell(struct ena_ring *tx_ring)ena_increase_stat (&tx_ring->tx_stats.doorbells,1 , &tx_ring->syncp); } -int ena_xmit_common(struct net_device *dev, +int ena_xmit_common(struct ena_adapter *adapter, struct ena_ring *ring, struct ena_tx_buffer *tx_info, struct ena_com_tx_ctx *ena_tx_ctx,
drivers/net/ethernet/amazon/ena/ena_xdp.c +3 -3
@@ -73,7 +73,7 @@ error_report_dma_error: }int ena_xdp_xmit_frame (struct ena_ring *xdp_ring, -struct net_device *dev, +struct ena_adapter *adapter,struct xdp_frame *xdpf,int flags) {
@@ -93,7 +93,7 @@ int ena_xdp_xmit_frame(struct ena_ring *xdp_ring, ena_tx_ctx.req_id = req_id; - rc = ena_xmit_common(dev, + rc = ena_xmit_common(adapter, xdp_ring, tx_info, &ena_tx_ctx,
@@ -141,7 +141,7 @@ int ena_xdp_xmit(struct net_device *dev, int n,spin_lock (&xdp_ring->xdp_tx_lock);for (i =0 ; i < n; i++) { -if (ena_xdp_xmit_frame (xdp_ring, dev, frames[i],0 )) +if (ena_xdp_xmit_frame (xdp_ring, adapter, frames[i],0 ))break ; nxmit++; }
drivers/net/ethernet/amazon/ena/ena_xdp.h +2 -2
@@ -36,7 +36,7 @@ void ena_xdp_exchange_program_rx_in_range(struct ena_adapter *adapter, int first, int count);int ena_xdp_io_poll (struct napi_struct *napi,int budget);int ena_xdp_xmit_frame (struct ena_ring *xdp_ring, -struct net_device *dev, +struct ena_adapter *adapter,struct xdp_frame *xdpf,int flags); int ena_xdp_xmit(struct net_device *dev, int n,
@@ -108,7 +108,7 @@ static inline int ena_xdp_execute(struct ena_ring *rx_ring, struct xdp_buff *xdp/* The XDP queues are shared between XDP_TX and XDP_REDIRECT */ spin_lock (&xdp_ring->xdp_tx_lock); -if (ena_xdp_xmit_frame (xdp_ring, rx_ring->netdev, xdpf, +if (ena_xdp_xmit_frame (xdp_ring, rx_ring->adapter, xdpf,XDP_XMIT_FLUSH ))xdp_return_frame (xdpf);
Signature · 1 line
2.40.1
[email protected]
maintainerPATCH v2 3/11 net: ena: Put orthogonal fields in ena_tx_buffer in a union
In reply to [email protected]From: David Arinzon <[email protected]>
The skb and xdpf pointers cannot be set together in the driver (each TX descriptor can send either an SKB or an XDP frame), and so it makes more sense to put them both in a union.
This decreases the overall size of the ena_tx_buffer struct which improves cache locality.
--- drivers/net/ethernet/amazon/ena/ena_netdev.h | 12 +++++++----- 1 file changed, 7 insertions(+), 5 deletions(-)
drivers/net/ethernet/amazon/ena/ena_netdev.h +7 -5
@@ -131,7 +131,13 @@ struct ena_napi { };struct ena_tx_buffer { -struct sk_buff *skb; +union { +struct sk_buff *skb; +/* XDP buffer structure which is used for sending packets in +* the xdp queues +*/ +struct xdp_frame *xdpf; + };/* num of ena desc for this specific skb * (includes data desc and metadata desc) */
@@ -139,10 +145,6 @@ struct ena_tx_buffer {/* num of buffers used by this skb */ u32 num_of_bufs; -/* XDP buffer structure which is used for sending packets in -* the xdp queues -*/ -struct xdp_frame *xdpf;/* Indicate if bufs[0] map the linear data of the skb. */ u8 map_linear_data;
Signature · 1 line
2.40.1
[email protected]
maintainerPATCH v2 4/11 net: ena: Introduce total_tx_size field in ena_tx_buffer struct
In reply to [email protected]From: David Arinzon <[email protected]>
To avoid de-referencing skb or xdp_frame when we poll for TX completion (where they might not be in the cache), save the total TX packet size in the ena_tx_buffer object representing the packet.
Also the 'print_once' field's type was changed from u32 to u8 to allow adding the 'total_tx_size' without changing the total size of the struct.
--- drivers/net/ethernet/amazon/ena/ena_netdev.c | 3 ++- drivers/net/ethernet/amazon/ena/ena_netdev.h | 4 +++- 2 files changed, 5 insertions(+), 2 deletions(-)
drivers/net/ethernet/amazon/ena/ena_netdev.c +2 -1
@@ -130,6 +130,7 @@ int ena_xmit_common(struct ena_adapter *adapter,u64_stats_update_end (&ring->syncp); tx_info->tx_descs = nb_hw_desc; + tx_info->total_tx_size = bytes; tx_info->last_jiffies = jiffies; tx_info->print_once =0 ;
@@ -842,7 +843,7 @@ static int ena_clean_tx_irq(struct ena_ring *tx_ring, u32 budget)"tx_poll: q %d skb %p completed\n" , tx_ring->qid, skb); - tx_bytes += skb->len; + tx_bytes += tx_info->total_tx_size;dev_kfree_skb (skb); tx_pkts++; total_done += tx_info->tx_descs;
drivers/net/ethernet/amazon/ena/ena_netdev.h +3 -1
@@ -145,12 +145,14 @@ struct ena_tx_buffer {/* num of buffers used by this skb */ u32 num_of_bufs; +/* Total size of all buffers in bytes */ +u32 total_tx_size;/* Indicate if bufs[0] map the linear data of the skb. */ u8 map_linear_data;/* Used for detect missing tx packets to limit the number of prints */ -u32 print_once; +u8 print_once;/* Save the last jiffies to detect missing tx packets * * sets to non zero value on ena_start_xmit and set to zero on
Signature · 1 line
2.40.1
[email protected]
maintainerPATCH v2 5/11 net: ena: Use tx_ring instead of xdp_ring for XDP channel TX
In reply to [email protected]From: David Arinzon <[email protected]>
When an XDP program is loaded the existing channels in the driver split into two halves:
- The first half of the channels contain RX and TX rings, these queues are used for receiving traffic and sending packets originating from kernel.
- The second half of the channels contain only a TX ring. These queues are used for sending packets that were redirected using XDP_TX or XDP_REDIRECT.
Referring to the queues in the second half of the channels as "xdp_ring" can be confusing and may give the impression that ENA has the capability to generate an additional special queue.
This patch ensures that the xdp_ring field is exclusively used to describe the XDP TX queue that a specific RX queue needs to utilize when forwarding packets with XDP TX and XDP REDIRECT, preserving the integrity of the xdp_ring field in ena_ring.
--- drivers/net/ethernet/amazon/ena/ena_netdev.c | 12 +- drivers/net/ethernet/amazon/ena/ena_netdev.h | 1 - drivers/net/ethernet/amazon/ena/ena_xdp.c | 111 +++++++++---------- drivers/net/ethernet/amazon/ena/ena_xdp.h | 2 +- 4 files changed, 61 insertions(+), 65 deletions(-)
drivers/net/ethernet/amazon/ena/ena_netdev.c +5 -7
@@ -1746,8 +1746,8 @@ static void ena_del_napi_in_range(struct ena_adapter *adapter,for (i = first_index; i < first_index + count; i++) {netif_napi_del (&adapter->ena_napi[i].napi); -WARN_ON (!ENA_IS_XDP_INDEX (adapter, i) && - adapter->ena_napi[i].xdp_ring); +WARN_ON (ENA_IS_XDP_INDEX (adapter, i) && + adapter->ena_napi[i].rx_ring); } }
@@ -1762,12 +1762,10 @@ static void ena_init_napi_in_range(struct ena_adapter *adapter,netif_napi_add (adapter->netdev, &napi->napi,ENA_IS_XDP_INDEX (adapter, i) ? ena_xdp_io_poll : ena_io_poll); -if (!ENA_IS_XDP_INDEX (adapter, i)) { +if (!ENA_IS_XDP_INDEX (adapter, i)) napi->rx_ring = &adapter->rx_ring[i]; - napi->tx_ring = &adapter->tx_ring[i]; - }else { - napi->xdp_ring = &adapter->tx_ring[i]; - } + + napi->tx_ring = &adapter->tx_ring[i]; napi->qid = i; } }
drivers/net/ethernet/amazon/ena/ena_netdev.h +0 -1
@@ -125,7 +125,6 @@ struct ena_napi {struct napi_struct napi;struct ena_ring *tx_ring;struct ena_ring *rx_ring; -struct ena_ring *xdp_ring;u32 qid;struct dim dim; };
drivers/net/ethernet/amazon/ena/ena_xdp.c +55 -56
277 lines not on this page · raw message
drivers/net/ethernet/amazon/ena/ena_xdp.h +1 -1
@@ -35,7 +35,7 @@ void ena_xdp_exchange_program_rx_in_range(struct ena_adapter *adapter,struct bpf_prog *prog, int first, int count);int ena_xdp_io_poll (struct napi_struct *napi,int budget); -int ena_xdp_xmit_frame (struct ena_ring *xdp_ring, +int ena_xdp_xmit_frame (struct ena_ring *tx_ring,struct ena_adapter *adapter,struct xdp_frame *xdpf,int flags);
Signature · 1 line
2.40.1
[email protected]
maintainerPATCH v2 6/11 net: ena: Don't check if XDP program is loaded in ena_xdp_execute()
In reply to [email protected]From: David Arinzon <[email protected]>
This check is already done in ena_clean_rx_irq() which indirectly calls it.
This function is called in napi context and the driver doesn't allow to change the XDP program without performing destruction and reinitialization of napi context (part of ena_down/ena_up sequence).
--- drivers/net/ethernet/amazon/ena/ena_xdp.h | 3 --- 1 file changed, 3 deletions(-)
drivers/net/ethernet/amazon/ena/ena_xdp.h +0 -3
@@ -87,9 +87,6 @@ static inline int ena_xdp_execute(struct ena_ring *rx_ring, struct xdp_buff *xdp xdp_prog =READ_ONCE (rx_ring->xdp_bpf_prog); -if (!xdp_prog) -return verdict; - verdict =bpf_prog_run_xdp (xdp_prog, xdp);switch (verdict) {
Signature · 1 line
2.40.1
[email protected]
maintainerPATCH v2 8/11 net: ena: Add more debug prints to XDP related function
In reply to [email protected]From: David Arinzon <[email protected]>
Used for better readability and debugging of XDP
flow.
--- drivers/net/ethernet/amazon/ena/ena_xdp.c | 4 ++++ 1 file changed, 4 insertions(+)
drivers/net/ethernet/amazon/ena/ena_xdp.c +4 -0
@@ -301,6 +301,8 @@ static int ena_xdp_set(struct net_device *netdev, struct netdev_bpf *bpf) }ena_xdp_exchange_program (adapter, prog); +netif_dbg (adapter, drv, adapter->netdev,"Set a new XDP program\n" ); +if (is_up && !old_bpf_prog) { rc =ena_up (adapter);if (rc)
@@ -309,6 +311,8 @@ static int ena_xdp_set(struct net_device *netdev, struct netdev_bpf *bpf)xdp_features_set_redirect_target (netdev, false); }else if (old_bpf_prog) {xdp_features_clear_redirect_target (netdev); +netif_dbg (adapter, drv, adapter->netdev,"Removing XDP program\n" ); + rc =ena_destroy_and_free_all_xdp_queues (adapter);if (rc)return rc;
Signature · 1 line
2.40.1
[email protected]
maintainerPATCH v2 7/11 net: ena: Refactor napi functions
In reply to [email protected]From: David Arinzon <[email protected]>
This patch focuses on changes to the XDP part of the napi polling routine.
1. Update the napi_comp stat only when napi is actually complete.
2. Simplify the code by using a function pointer to the right napi routine (XDP vs non-XDP path)
3. Remove unnecessary local variables.
4. Adjust a debug print to show the processed XDP frame index rather than the pointer.
--- drivers/net/ethernet/amazon/ena/ena_netdev.c | 18 +++++++--- drivers/net/ethernet/amazon/ena/ena_xdp.c | 35 +++++++++----------- 2 files changed, 30 insertions(+), 23 deletions(-)
drivers/net/ethernet/amazon/ena/ena_netdev.c +14 -4
@@ -1754,18 +1754,28 @@ static void ena_del_napi_in_range(struct ena_adapter *adapter,static void ena_init_napi_in_range (struct ena_adapter *adapter,int first_index,int count) { +int (*napi_handler)(struct napi_struct *napi,int budget);int i;for (i = first_index; i < first_index + count; i++) {struct ena_napi *napi = &adapter->ena_napi[i]; +struct ena_ring *rx_ring, *tx_ring; -netif_napi_add (adapter->netdev, &napi->napi, -ENA_IS_XDP_INDEX (adapter, i) ? ena_xdp_io_poll : ena_io_poll); +memset (napi,0 ,sizeof (*napi)); + + rx_ring = &adapter->rx_ring[i]; + tx_ring = &adapter->tx_ring[i]; + + napi_handler = ena_io_poll; +if (ENA_IS_XDP_INDEX (adapter, i)) + napi_handler = ena_xdp_io_poll; + +netif_napi_add (adapter->netdev, &napi->napi, napi_handler);if (!ENA_IS_XDP_INDEX (adapter, i)) - napi->rx_ring = &adapter->rx_ring[i]; + napi->rx_ring = rx_ring; - napi->tx_ring = &adapter->tx_ring[i]; + napi->tx_ring = tx_ring; napi->qid = i; } }
drivers/net/ethernet/amazon/ena/ena_xdp.c +16 -19
@@ -385,23 +385,22 @@ static int ena_clean_xdp_irq(struct ena_ring *tx_ring, u32 budget)break ; tx_info = &tx_ring->tx_buffer_info[req_id]; - xdpf = tx_info->xdpf; - tx_info->xdpf =NULL ; tx_info->last_jiffies =0 ; -ena_unmap_tx_buff (tx_ring, tx_info); -netif_dbg (tx_ring->adapter, tx_done, tx_ring->netdev, -"tx_poll: q %d skb %p completed\n" , tx_ring->qid, - xdpf); + xdpf = tx_info->xdpf; + tx_info->xdpf =NULL ; +ena_unmap_tx_buff (tx_ring, tx_info); +xdp_return_frame (xdpf); tx_pkts++; total_done += tx_info->tx_descs; - -xdp_return_frame (xdpf); tx_ring->free_ids[next_to_clean] = req_id; next_to_clean =ENA_TX_RING_IDX_NEXT (next_to_clean, tx_ring->ring_size); + +netif_dbg (tx_ring->adapter, tx_done, tx_ring->netdev, +"tx_poll: q %d pkt #%d req_id %d\n" , tx_ring->qid, tx_pkts, req_id); } tx_ring->next_to_clean = next_to_clean;
@@ -421,22 +420,19 @@ static int ena_clean_xdp_irq(struct ena_ring *tx_ring, u32 budget)int ena_xdp_io_poll (struct napi_struct *napi,int budget) { struct ena_napi *ena_napi = container_of(napi, struct ena_napi, napi); -u32 xdp_work_done, xdp_budget;struct ena_ring *tx_ring; -int napi_comp_call =0 ; +u32 work_done;int ret; tx_ring = ena_napi->tx_ring; - xdp_budget = budget; -if (!test_bit (ENA_FLAG_DEV_UP , &tx_ring->adapter->flags) ||test_bit (ENA_FLAG_TRIGGER_RESET , &tx_ring->adapter->flags)) {napi_complete_done (napi,0 );return 0 ; } - xdp_work_done =ena_clean_xdp_irq (tx_ring, xdp_budget); + work_done =ena_clean_xdp_irq (tx_ring, budget);/* If the device is about to reset or down, avoid unmask * the interrupt and return 0 so NAPI won't reschedule
@@ -444,18 +440,19 @@ int ena_xdp_io_poll(struct napi_struct *napi, int budget)if (unlikely (!test_bit (ENA_FLAG_DEV_UP , &tx_ring->adapter->flags))) {napi_complete_done (napi,0 ); ret =0 ; - }else if (xdp_budget > xdp_work_done) { - napi_comp_call =1 ; -if (napi_complete_done (napi, xdp_work_done)) + }else if (budget > work_done) { +ena_increase_stat (&tx_ring->tx_stats.napi_comp,1 , + &tx_ring->syncp); +if (napi_complete_done (napi, work_done))ena_unmask_interrupt (tx_ring,NULL ); +ena_update_ring_numa_node (tx_ring,NULL ); - ret = xdp_work_done; + ret = work_done; }else { - ret = xdp_budget; + ret = budget; }u64_stats_update_begin (&tx_ring->syncp); - tx_ring->tx_stats.napi_comp += napi_comp_call; tx_ring->tx_stats.tx_poll++;u64_stats_update_end (&tx_ring->syncp); tx_ring->tx_stats.last_napi_jiffies = jiffies;
Signature · 1 line
2.40.1
[email protected]
maintainerPATCH v2 9/11 net: ena: Always register RX queue info
In reply to [email protected]From: David Arinzon <[email protected]>
The RX queue info contains information about the RX queue which might be relevant to the kernel.
To avoid configuring this queue for different scenarios, this patch moves the RX queue configuration to ena_up()/ena_down() function and makes it configured every interface state toggle.
--- drivers/net/ethernet/amazon/ena/ena_netdev.c | 4 ++++ drivers/net/ethernet/amazon/ena/ena_xdp.c | 11 +++++++---- drivers/net/ethernet/amazon/ena/ena_xdp.h | 2 ++ 3 files changed, 13 insertions(+), 4 deletions(-)
drivers/net/ethernet/amazon/ena/ena_netdev.c +4 -0
@@ -753,6 +753,7 @@ static void ena_destroy_all_rx_queues(struct ena_adapter *adapter)for (i =0 ; i < adapter->num_io_queues; i++) { ena_qid =ENA_IO_RXQ_IDX (i);cancel_work_sync (&adapter->ena_napi[i].dim.work); +ena_xdp_unregister_rxq_info (&adapter->rx_ring[i]);ena_com_destroy_io_queue (adapter->ena_dev, ena_qid); } }
@@ -1984,12 +1985,15 @@ static int ena_create_all_io_rx_queues(struct ena_adapter *adapter)if (rc) goto create_err;INIT_WORK (&adapter->ena_napi[i].dim.work, ena_dim_work); + +ena_xdp_register_rxq_info (&adapter->rx_ring[i]); }return 0 ; create_err:while (i--) { +ena_xdp_unregister_rxq_info (&adapter->rx_ring[i]);cancel_work_sync (&adapter->ena_napi[i].dim.work);ena_com_destroy_io_queue (ena_dev,ENA_IO_RXQ_IDX (i)); }
drivers/net/ethernet/amazon/ena/ena_xdp.c +7 -4
@@ -191,12 +191,14 @@ setup_err:/* Provides a way for both kernel and bpf-prog to know * more about the RX-queue a given XDP frame arrived on. */ -static int ena_xdp_register_rxq_info (struct ena_ring *rx_ring) +int ena_xdp_register_rxq_info (struct ena_ring *rx_ring) {int rc; rc =xdp_rxq_info_reg (&rx_ring->xdp_rxq, rx_ring->netdev, rx_ring->qid,0 ); +netif_dbg (rx_ring->adapter, ifup, rx_ring->netdev,"Registering RX info for queue %d" , + rx_ring->qid);if (rc) { netif_err(rx_ring->adapter, ifup, rx_ring->netdev, "Failed to register xdp rx queue info. RX queue num %d rc: %d\n",
@@ -217,8 +219,11 @@ err:return rc; } -static void ena_xdp_unregister_rxq_info (struct ena_ring *rx_ring) +void ena_xdp_unregister_rxq_info (struct ena_ring *rx_ring) { +netif_dbg (rx_ring->adapter, ifdown, rx_ring->netdev, +"Unregistering RX info for queue %d" , + rx_ring->qid);xdp_rxq_info_unreg_mem_model (&rx_ring->xdp_rxq);xdp_rxq_info_unreg (&rx_ring->xdp_rxq); }
@@ -236,10 +241,8 @@ void ena_xdp_exchange_program_rx_in_range(struct ena_adapter *adapter, old_bpf_prog =xchg (&rx_ring->xdp_bpf_prog, prog);if (!old_bpf_prog && prog) { -ena_xdp_register_rxq_info (rx_ring); rx_ring->rx_headroom =XDP_PACKET_HEADROOM ; }else if (old_bpf_prog && !prog) { -ena_xdp_unregister_rxq_info (rx_ring); rx_ring->rx_headroom =NET_SKB_PAD ; } }
drivers/net/ethernet/amazon/ena/ena_xdp.h +2 -0
@@ -42,6 +42,8 @@ int ena_xdp_xmit_frame(struct ena_ring *tx_ring,int ena_xdp_xmit (struct net_device *dev,int n,struct xdp_frame **frames,u32 flags);int ena_xdp (struct net_device *netdev,struct netdev_bpf *bpf); +int ena_xdp_register_rxq_info (struct ena_ring *rx_ring); +void ena_xdp_unregister_rxq_info (struct ena_ring *rx_ring);enum ena_xdp_errors_t {ENA_XDP_ALLOWED =0 ,
Signature · 1 line
2.40.1
[email protected]
maintainerPATCH v2 10/11 net: ena: Make queue stats code cleaner by removing the if block
In reply to [email protected]From: David Arinzon <[email protected]>
Also shorten comment related to it.
--- drivers/net/ethernet/amazon/ena/ena_ethtool.c | 17 +++++++---------- 1 file changed, 7 insertions(+), 10 deletions(-)
drivers/net/ethernet/amazon/ena/ena_ethtool.c +7 -10
@@ -263,17 +263,14 @@ static void ena_queue_strings(struct ena_adapter *adapter, u8 **data) ena_stats->name); } -if (!is_xdp) { -/* RX stats, in XDP there isn't a RX queue -* counterpart -*/ -for (j =0 ; j <ENA_STATS_ARRAY_RX ; j++) { - ena_stats = &ena_stats_rx_strings[j]; +/* In XDP there isn't an RX queue counterpart */ +if (is_xdp) +continue ; -ethtool_sprintf (data, -"queue_%u_rx_%s" , i, - ena_stats->name); - } +for (j =0 ; j <ENA_STATS_ARRAY_RX ; j++) { + ena_stats = &ena_stats_rx_strings[j]; + +ethtool_sprintf (data,"queue_%u_rx_%s" , i, ena_stats->name); } } }
Signature · 1 line
2.40.1
[email protected]
maintainerPATCH v2 11/11 net: ena: Take xdp packets stats into account in ena_get_stats64()
In reply to [email protected]From: David Arinzon <[email protected]>
Queue stats using ifconfig and ip are retrieved via ena_get_stats64(). This function currently does not take the xdp sent or dropped packets stats into account.
This commit adds the following xdp stats to ena_get_stats64():
tx bytes sent
tx packets sent
rx dropped packets
--- drivers/net/ethernet/amazon/ena/ena_netdev.c | 13 ++++++++++--- 1 file changed, 10 insertions(+), 3 deletions(-)
drivers/net/ethernet/amazon/ena/ena_netdev.c +10 -3
@@ -2795,6 +2795,7 @@ static void ena_get_stats64(struct net_device *netdev, {struct ena_adapter *adapter =netdev_priv (netdev);struct ena_ring *rx_ring, *tx_ring; +u64 total_xdp_rx_drops =0 ;unsigned int start;u64 rx_drops;u64 tx_drops;
@@ -2803,8 +2804,8 @@ static void ena_get_stats64(struct net_device *netdev,if (!test_bit (ENA_FLAG_DEV_UP , &adapter->flags))return ; -for (i =0 ; i < adapter->num_io_queues; i++) { -u64 bytes, packets; +for (i =0 ; i < adapter->num_io_queues + adapter->xdp_num_queues; i++) { +u64 bytes, packets, xdp_rx_drops; tx_ring = &adapter->tx_ring[i];
@@ -2817,16 +2818,22 @@ static void ena_get_stats64(struct net_device *netdev, stats->tx_packets += packets; stats->tx_bytes += bytes; +/* In XDP there isn't an RX queue counterpart */ +if (ENA_IS_XDP_INDEX (adapter, i)) +continue ; + rx_ring = &adapter->rx_ring[i];do { start =u64_stats_fetch_begin (&rx_ring->syncp); packets = rx_ring->rx_stats.cnt; bytes = rx_ring->rx_stats.bytes; + xdp_rx_drops = rx_ring->rx_stats.xdp_drop; }while (u64_stats_fetch_retry (&rx_ring->syncp, start)); stats->rx_packets += packets; stats->rx_bytes += bytes; + total_xdp_rx_drops += xdp_rx_drops; } do {
@@ -2835,7 +2842,7 @@ static void ena_get_stats64(struct net_device *netdev, tx_drops = adapter->dev_stats.tx_drops; }while (u64_stats_fetch_retry (&adapter->syncp, start)); - stats->rx_dropped = rx_drops; + stats->rx_dropped = rx_drops + total_xdp_rx_drops; stats->tx_dropped = tx_drops; stats->multicast =0 ;
Signature · 1 line
2.40.1
Jakub Kicinski
maintainerQuoted 2 lines · On Mon, 1 Jan 2024 19:08:44 +0000 [email protected] wrote:
Changes in v2:
- Moved changes to right commits in order to avoid compilation errors
Please read:
https://www.kernel.org/doc/html/next/process/maintainer-netdev.html#tl-dr
Signature · 1 line
pv-bot: 24h
Arinzon, David
maintainerQuoted 10 lines · On Mon, 1 Jan 2024 19:08:44 +0000 [email protected] wrote:
Quoted 2 lines
Changes in v2:
- Moved changes to right commits in order to avoid compilation errorsPlease read:
https://www.kernel.org/doc/html/next/process/maintainer-
netdev.html#tl-dr
--
pv-bot: 24h
Apologies, I've noticed the failures in patchwork and decided to act quickly. Thank you for the guidelines link.
Shall I resend v3 after the waiting time?
Jakub Kicinski
maintainerQuoted 4 lines · David
Apologies, I've noticed the failures in patchwork and decided to act quickly. Thank you for the guidelines link.
Shall I resend v3 after the waiting time?
No need, just a note for future submissions.
I'll get to reviewing the code itself later today, fingers crossed, and then we'll see if v3 is in order :)
Jakub Kicinski
maintainerRe: [PATCH v2 net-next 07/11] net: ena: Refactor napi functions
In reply to [email protected]drivers/net/ethernet/amazon/ena/ena_xdp.c static int ena_clean_xdp_irq(struct ena_ring *tx_ring, u32 budget) · line 435
Quoted 2 lines · On Mon, 1 Jan 2024 19:08:51 +0000 [email protected] wrote:
drivers/net/ethernet/amazon/ena/ena_xdp.c +1
-1- xdp_work_done =ena_clean_xdp_irq (tx_ring, xdp_budget); + work_done =ena_clean_xdp_irq (tx_ring, budget);
Not related to this series, but please make sure that if budget is 0 you do *no* XDP processing, Rx or Tx. XDP expects to run in softirq context, when budget is 0 we may be in hard IRQ.
This series was applied to netdev/net-next.git (main) by Jakub Kicinski <[email protected]>:
Hello:
This series was applied to netdev/net-next.git (main) by Jakub Kicinski <[email protected]>:
Quoted 10 lines · On Mon, 1 Jan 2024 19:08:44 +0000 you wrote:
From: David Arinzon <[email protected]>
This patchset contains multiple XDP-related changes in the ENA driver, including moving the XDP code to dedicated files.
Changes in v2:
- Moved changes to right commits in order to avoid compilation errors[...]
Here is the summary with links:
- [v2,net-next,01/11] net: ena: Move XDP code to its new files
https://git.kernel.org/netdev/net-next/c/d000574d0287 - [v2,net-next,02/11] net: ena: Pass ena_adapter instead of net_device to ena_xmit_common() https://git.kernel.org/netdev/net-next/c/39a044f4dcfe - [v2,net-next,03/11] net: ena: Put orthogonal fields in ena_tx_buffer in a union https://git.kernel.org/netdev/net-next/c/009b387659d3 - [v2,net-next,04/11] net: ena: Introduce total_tx_size field in ena_tx_buffer struct https://git.kernel.org/netdev/net-next/c/23ec97498026 - [v2,net-next,05/11] net: ena: Use tx_ring instead of xdp_ring for XDP channel TX https://git.kernel.org/netdev/net-next/c/911a8c960110 - [v2,net-next,06/11] net: ena: Don't check if XDP program is loaded in ena_xdp_execute() https://git.kernel.org/netdev/net-next/c/436c79358595 - [v2,net-next,07/11] net: ena: Refactor napi functions https://git.kernel.org/netdev/net-next/c/b626fd9627d4 - [v2,net-next,08/11] net: ena: Add more debug prints to XDP related function https://git.kernel.org/netdev/net-next/c/2b02e332c151 - [v2,net-next,09/11] net: ena: Always register RX queue info https://git.kernel.org/netdev/net-next/c/ea5c460023aa - [v2,net-next,10/11] net: ena: Make queue stats code cleaner by removing the if block https://git.kernel.org/netdev/net-next/c/4f28e789be76 - [v2,net-next,11/11] net: ena: Take xdp packets stats into account in ena_get_stats64() https://git.kernel.org/netdev/net-next/c/782345d24874
You are awesome, thank you!
Signature · 2 lines
Deet-doot-dot, I am a bot. https://korg.docs.kernel.org/patchwork/pwbot.html
Arinzon, David
maintainerRE: [PATCH v2 net-next 07/11] net: ena: Refactor napi functions
In reply to Jakub KicinskiQuoted 7 lines · On Mon, 1 Jan 2024 19:08:51 +0000 [email protected] wrote:
drivers/net/ethernet/amazon/ena/ena_xdp.c static int ena_clean_xdp_irq(struct ena_ring *tx_ring, u32 budget) · line 435
Quoted 2 lines
drivers/net/ethernet/amazon/ena/ena_xdp.c +1
-1- xdp_work_done =ena_clean_xdp_irq (tx_ring, xdp_budget); + work_done =ena_clean_xdp_irq (tx_ring, budget);Not related to this series, but please make sure that if budget is 0 you do *no* XDP processing, Rx or Tx. XDP expects to run in softirq context, when budget is 0 we may be in hard IRQ.
Thank you for the feedback, Jakub, we will look into it and will make the needed changes.