mlx5 updates 2023-08-07
Subsystems (12)
From: Saeed Mahameed <[email protected]>
This series provides some minor cleanup and Dynamic completion EQ allocation mechanism in the mlx5 driver.
For more information please see tag log below.
Please pull and let me know if there is any problem.
Thanks,
Saeed.
The following changes since commit cc97777c80fdfabe12997581131872a03fdcf683:
udp/udplite: Remove unused function declarations udp{,lite}_get_port() (2023-08-07 08:53:55 +0100)
are available in the Git repository at:
git://git.kernel.org/pub/scm/linux/kernel/git/saeed/linux.git tags/mlx5-updates-2023-08-07
for you to fetch changes up to b56fb19c337951fc4daba646fab2c50bb4c41c58:
net/mlx5: Bridge, Only handle registered netdev bridge events (2023-08-07 10:53:52 -0700)
----------------------------------------------------------------
mlx5-updates-2023-08-07
1) Few cleanups
2) Dynamic completion EQs
The driver creates completion EQs for all vectors directly on driver load, even if those EQs will not be utilized later on.
To allow more flexibility in managing completion EQs and to reduce the memory overhead of driver load, this series will adjust completion EQs creation to be dynamic. Meaning, completion EQs will be created only when needed.
Patch #1 introduces a counter for tracking the current number of completion EQs.
Patches #2-6 refactor the existing infrastructure of managing completion EQs and completion IRQs to be compatible with per-vector allocation/release requests.
Patches #7-8 modify the CPU-to-IRQ affinity calculation to be resilient in case the affinity is requested but completion IRQ is not allocated yet. Patch #9 function rename.
Patch #10 handles the corner case of SF performing an IRQ request when no SF IRQ pool is found, and no PF IRQ exists for the same vector. Patch #11 modify driver to use dynamically allocate completion EQs.
----------------------------------------------------------------
Gal Pressman (1):
net/mlx5: Fix typo reminder -> remainder
Maher Sanalla (11):
net/mlx5: Track the current number of completion EQs net/mlx5: Refactor completion IRQ request/release API net/mlx5: Use xarray to store and manage completion IRQs net/mlx5: Refactor completion IRQ request/release handlers in EQ layer net/mlx5: Use xarray to store and manage completion EQs net/mlx5: Implement single completion EQ create/destroy methods net/mlx5: Introduce mlx5_cpumask_default_spread
net/mlx5: Add IRQ vector to CPU lookup function
net/mlx5: Rename mlx5_comp_vectors_count() to mlx5_comp_vectors_max() net/mlx5: Handle SF IRQ request in the absence of SF IRQ pool net/mlx5: Allocate completion EQs dynamically
Roi Dayan (2):
net/mlx5: E-Switch, Remove redundant arg ignore_flow_lvl net/mlx5: Bridge, Only handle registered netdev bridge events
Ruan Jinjie (1):
net/mlx5: remove many unnecessary NULL values
drivers/infiniband/hw/mlx5/cq.c | 2 +- drivers/infiniband/hw/mlx5/devx.c | 2 +- drivers/infiniband/hw/mlx5/main.c | 2 +- drivers/net/ethernet/mellanox/mlx5/core/en.h | 2 +- .../ethernet/mellanox/mlx5/core/en/rep/bridge.c | 4 + drivers/net/ethernet/mellanox/mlx5/core/en/trap.c | 2 +- drivers/net/ethernet/mellanox/mlx5/core/en_main.c | 10 +- drivers/net/ethernet/mellanox/mlx5/core/eq.c | 360 ++++++++++++--------- drivers/net/ethernet/mellanox/mlx5/core/esw/qos.c | 6 +- .../ethernet/mellanox/mlx5/core/eswitch_offloads.c | 6 +- .../net/ethernet/mellanox/mlx5/core/fpga/conn.c | 2 +- .../net/ethernet/mellanox/mlx5/core/fpga/core.c | 4 +- .../net/ethernet/mellanox/mlx5/core/irq_affinity.c | 78 ++--- drivers/net/ethernet/mellanox/mlx5/core/lib/aso.c | 2 +- drivers/net/ethernet/mellanox/mlx5/core/lib/eq.h | 2 +- .../net/ethernet/mellanox/mlx5/core/lib/hv_vhca.c | 2 +- drivers/net/ethernet/mellanox/mlx5/core/mlx5_irq.h | 26 +- drivers/net/ethernet/mellanox/mlx5/core/pci_irq.c | 60 ++-- .../ethernet/mellanox/mlx5/core/steering/dr_send.c | 4 +- drivers/vdpa/mlx5/net/mlx5_vnet.c | 2 +- drivers/vfio/pci/mlx5/cmd.c | 4 +- include/linux/mlx5/driver.h | 7 +- 22 files changed, 309 insertions(+), 280 deletions(-)
PATCH 1/15 net/mlx5: Track the current number of completion EQs
From: Maher Sanalla <[email protected]>
In preparation to allocate completion EQs, add a counter to track the number of completion EQs currently allocated. Store the maximum number of EQs in max_comp_eqs variable.
--- drivers/net/ethernet/mellanox/mlx5/core/eq.c | 24 ++++++++++++-------- 1 file changed, 14 insertions(+), 10 deletions(-)
drivers/net/ethernet/mellanox/mlx5/core/eq.c +14 -10
@@ -58,7 +58,8 @@ struct mlx5_eq_table {struct mlx5_nb cq_err_nb;struct mutex lock;/* sync async eqs creations */ -int num_comp_eqs; +int curr_comp_eqs; +int max_comp_eqs;struct mlx5_irq_table *irq_table;struct mlx5_irq **comp_irqs;struct mlx5_irq *ctrl_irq;
@@ -452,6 +453,7 @@ int mlx5_eq_table_init(struct mlx5_core_dev *dev)ATOMIC_INIT_NOTIFIER_HEAD (&eq_table->nh[i]); eq_table->irq_table =mlx5_irq_table_get (dev); + eq_table->curr_comp_eqs =0 ;return 0 ; }
@@ -807,7 +809,7 @@ static void comp_irqs_release_pci(struct mlx5_core_dev *dev) {struct mlx5_eq_table *table = dev->priv.eq_table; -mlx5_irqs_release_vectors (table->comp_irqs, table->num_comp_eqs); +mlx5_irqs_release_vectors (table->comp_irqs, table->max_comp_eqs); }static int comp_irqs_request_pci (struct mlx5_core_dev *dev)
@@ -821,7 +823,7 @@ static int comp_irqs_request_pci(struct mlx5_core_dev *dev)int cpu;int i; - ncomp_eqs = table->num_comp_eqs; + ncomp_eqs = table->max_comp_eqs; cpus =kcalloc (ncomp_eqs,sizeof (*cpus),GFP_KERNEL );if (!cpus)return -ENOMEM ;
@@ -847,13 +849,13 @@ static void comp_irqs_release_sf(struct mlx5_core_dev *dev) {struct mlx5_eq_table *table = dev->priv.eq_table; -mlx5_irq_affinity_irqs_release (dev, table->comp_irqs, table->num_comp_eqs); +mlx5_irq_affinity_irqs_release (dev, table->comp_irqs, table->max_comp_eqs); }static int comp_irqs_request_sf (struct mlx5_core_dev *dev) {struct mlx5_eq_table *table = dev->priv.eq_table; -int ncomp_eqs = table->num_comp_eqs; +int ncomp_eqs = table->max_comp_eqs;return mlx5_irq_affinity_irqs_request_auto (dev, ncomp_eqs, table->comp_irqs); }
@@ -874,7 +876,7 @@ static int comp_irqs_request(struct mlx5_core_dev *dev)int ncomp_eqs;int ret; - ncomp_eqs = table->num_comp_eqs; + ncomp_eqs = table->max_comp_eqs; table->comp_irqs =kcalloc (ncomp_eqs,sizeof (*table->comp_irqs),GFP_KERNEL );if (!table->comp_irqs)return -ENOMEM ;
@@ -901,7 +903,7 @@ static int alloc_rmap(struct mlx5_core_dev *mdev)if (mlx5_core_is_sf (mdev))return 0 ; - eq_table->rmap =alloc_irq_cpu_rmap (eq_table->num_comp_eqs); + eq_table->rmap =alloc_irq_cpu_rmap (eq_table->max_comp_eqs);if (!eq_table->rmap)return -ENOMEM ;return 0 ;
@@ -934,6 +936,7 @@ static void destroy_comp_eqs(struct mlx5_core_dev *dev) eq->core.eqn);tasklet_disable (&eq->tasklet_ctx.task);kfree (eq); + table->curr_comp_eqs--; }comp_irqs_release (dev);free_rmap (dev);
@@ -973,6 +976,7 @@ static int create_comp_eqs(struct mlx5_core_dev *dev) goto err_irqs_req; } + table->max_comp_eqs = ncomp_eqs;INIT_LIST_HEAD (&table->comp_eqs_list); nent =comp_eq_depth_devlink_param_get (dev);
@@ -1008,9 +1012,9 @@ static int create_comp_eqs(struct mlx5_core_dev *dev)mlx5_core_dbg (dev,"allocated completion EQN %d\n" , eq->core.eqn);/* add tail, to keep the list ordered, for mlx5_vector2eqn to work */ list_add_tail (&eq->list, &table->comp_eqs_list); + table->curr_comp_eqs++; } - table->num_comp_eqs = ncomp_eqs;return 0 ; clean_eq:
@@ -1057,7 +1061,7 @@ int mlx5_vector2irqn(struct mlx5_core_dev *dev, int vector, unsigned int *irqn)unsigned int mlx5_comp_vectors_count (struct mlx5_core_dev *dev) { -return dev->priv.eq_table->num_comp_eqs; +return dev->priv.eq_table->max_comp_eqs; }EXPORT_SYMBOL (mlx5_comp_vectors_count);
@@ -1148,7 +1152,7 @@ int mlx5_eq_table_create(struct mlx5_core_dev *dev)struct mlx5_eq_table *eq_table = dev->priv.eq_table;int err; - eq_table->num_comp_eqs =get_num_eqs (dev); + eq_table->max_comp_eqs =get_num_eqs (dev); err =create_async_eqs (dev);if (err) {mlx5_core_err (dev,"Failed to create async EQs\n" );
Signature · 1 line
2.41.0
Re: [net-next 01/15] net/mlx5: Track the current number of completion EQs
This series was applied to netdev/net-next.git (main) by Saeed Mahameed <[email protected]>:
Hello:
This series was applied to netdev/net-next.git (main) by Saeed Mahameed <[email protected]>:
Quoted 6 lines · On Mon, 7 Aug 2023 10:56:28 -0700 you wrote:
From: Maher Sanalla <[email protected]>
In preparation to allocate completion EQs, add a counter to track the number of completion EQs currently allocated. Store the maximum number of EQs in
max_comp_eqsvariable.
Quoted 6 lines
Signed-off-by Maher Sanalla <[email protected]>Reviewed-by Shay Drory <[email protected]>Reviewed-by Moshe Shemesh <[email protected]>Signed-off-by Saeed Mahameed <[email protected]>[...]
Here is the summary with links:
- [net-next,01/15] net/mlx5: Track the current number of completion EQs
https://git.kernel.org/netdev/net-next/c/18cf3d31f829 - [net-next,02/15] net/mlx5: Refactor completion IRQ request/release API https://git.kernel.org/netdev/net-next/c/a1772de78d73 - [net-next,03/15] net/mlx5: Use xarray to store and manage completion IRQs https://git.kernel.org/netdev/net-next/c/c8a0245c3937 - [net-next,04/15] net/mlx5: Refactor completion IRQ request/release handlers in EQ layer https://git.kernel.org/netdev/net-next/c/54b2cf41b853 - [net-next,05/15] net/mlx5: Use xarray to store and manage completion EQs https://git.kernel.org/netdev/net-next/c/273c697fdedc - [net-next,06/15] net/mlx5: Implement single completion EQ create/destroy methods https://git.kernel.org/netdev/net-next/c/e3e56775e913 - [net-next,07/15] net/mlx5: Introduce mlx5_cpumask_default_spread https://git.kernel.org/netdev/net-next/c/ddd2c79da020 - [net-next,08/15] net/mlx5: Add IRQ vector to CPU lookup function https://git.kernel.org/netdev/net-next/c/f3147015fa07 - [net-next,09/15] net/mlx5: Rename mlx5_comp_vectors_count() to mlx5_comp_vectors_max() https://git.kernel.org/netdev/net-next/c/674dd4e2e04e - [net-next,10/15] net/mlx5: Handle SF IRQ request in the absence of SF IRQ pool https://git.kernel.org/netdev/net-next/c/54c5297801f3 - [net-next,11/15] net/mlx5: Allocate completion EQs dynamically https://git.kernel.org/netdev/net-next/c/f14c1a14e632 - [net-next,12/15] net/mlx5: remove many unnecessary NULL values https://git.kernel.org/netdev/net-next/c/a0ae00e71e3e - [net-next,13/15] net/mlx5: Fix typo reminder -> remainder https://git.kernel.org/netdev/net-next/c/58f6d9d04489 - [net-next,14/15] net/mlx5: E-Switch, Remove redundant arg ignore_flow_lvl https://git.kernel.org/netdev/net-next/c/d602be220cf9 - [net-next,15/15] net/mlx5: Bridge, Only handle registered netdev bridge events https://git.kernel.org/netdev/net-next/c/b56fb19c3379
You are awesome, thank you!
Signature · 2 lines
Deet-doot-dot, I am a bot. https://korg.docs.kernel.org/patchwork/pwbot.html
PATCH 2/15 net/mlx5: Refactor completion IRQ request/release API
In reply to Saeed MahameedFrom: Maher Sanalla <[email protected]>
Introduce a per-vector completion IRQ request API that requests a single IRQ for a given vector index instead of multiple IRQs request API. On driver load, loop over all completion vectors and request an IRQ for each one via the newly introduced API.
Symmetrically, introduce an IRQ release API per vector. On driver unload, loop over all vectors and release each completion IRQ via the new per-vector API.
As IRQ vectors will be requested dynamically later in the patchset, add a cpumask of the bounded CPUs to avoid the possible mapping of two IRQs of the same device to the same cpu.
--- drivers/net/ethernet/mellanox/mlx5/core/eq.c | 36 ++++++-- .../mellanox/mlx5/core/irq_affinity.c | 82 +++++++++---------- .../ethernet/mellanox/mlx5/core/mlx5_irq.h | 26 +++--- .../net/ethernet/mellanox/mlx5/core/pci_irq.c | 60 +++++--------- 4 files changed, 101 insertions(+), 103 deletions(-)
drivers/net/ethernet/mellanox/mlx5/core/eq.c +29 -7
@@ -64,6 +64,7 @@ struct mlx5_eq_table {struct mlx5_irq **comp_irqs;struct mlx5_irq *ctrl_irq;struct cpu_rmap *rmap; +struct cpumask used_cpus; };#define MLX5_ASYNC_EVENT_MASK ((1ull << MLX5_EVENT_TYPE_PATH_MIG) | \
@@ -453,6 +454,7 @@ int mlx5_eq_table_init(struct mlx5_core_dev *dev)ATOMIC_INIT_NOTIFIER_HEAD (&eq_table->nh[i]); eq_table->irq_table =mlx5_irq_table_get (dev); +cpumask_clear (&eq_table->used_cpus); eq_table->curr_comp_eqs =0 ;return 0 ; }
@@ -808,8 +810,10 @@ EXPORT_SYMBOL(mlx5_eq_update_ci);static void comp_irqs_release_pci (struct mlx5_core_dev *dev) {struct mlx5_eq_table *table = dev->priv.eq_table; +int i; -mlx5_irqs_release_vectors (table->comp_irqs, table->max_comp_eqs); +for (i =0 ; i < table->max_comp_eqs; i++) +mlx5_irq_release_vector (table->comp_irqs[i]); }static int comp_irqs_request_pci (struct mlx5_core_dev *dev)
@@ -817,9 +821,9 @@ static int comp_irqs_request_pci(struct mlx5_core_dev *dev)struct mlx5_eq_table *table = dev->priv.eq_table;const struct cpumask *prev = cpu_none_mask;const struct cpumask *mask; +struct mlx5_irq *irq;int ncomp_eqs;u16 *cpus; -int ret;int cpu;int i;
@@ -840,24 +844,42 @@ static int comp_irqs_request_pci(struct mlx5_core_dev *dev) } spread_done:rcu_read_unlock (); - ret =mlx5_irqs_request_vectors (dev, cpus, ncomp_eqs, table->comp_irqs, &table->rmap); +for (i =0 ; i < ncomp_eqs; i++) { + irq =mlx5_irq_request_vector (dev, cpus[i], i, &table->rmap); +if (IS_ERR (irq)) +break ; + + table->comp_irqs[i] = irq; + } +kfree (cpus); -return ret; +return i ? i :PTR_ERR (irq); }static void comp_irqs_release_sf (struct mlx5_core_dev *dev) {struct mlx5_eq_table *table = dev->priv.eq_table; +int i; -mlx5_irq_affinity_irqs_release (dev, table->comp_irqs, table->max_comp_eqs); +for (i =0 ; i < table->max_comp_eqs; i++) +mlx5_irq_affinity_irq_release (dev, table->comp_irqs[i]); }static int comp_irqs_request_sf (struct mlx5_core_dev *dev) {struct mlx5_eq_table *table = dev->priv.eq_table; -int ncomp_eqs = table->max_comp_eqs; +struct mlx5_irq *irq; +int i; + +for (i =0 ; i < table->max_comp_eqs; i++) { + irq =mlx5_irq_affinity_irq_request_auto (dev, &table->used_cpus, i); +if (IS_ERR (irq)) +break ; + + table->comp_irqs[i] = irq; + } -return mlx5_irq_affinity_irqs_request_auto (dev, ncomp_eqs, table->comp_irqs); +return i ? i :PTR_ERR (irq); }static void comp_irqs_release (struct mlx5_core_dev *dev)
drivers/net/ethernet/mellanox/mlx5/core/irq_affinity.c +38 -44
105 lines not on this page · raw message
drivers/net/ethernet/mellanox/mlx5/core/mlx5_irq.h +14 -12
@@ -29,9 +29,9 @@ void mlx5_ctrl_irq_release(struct mlx5_irq *ctrl_irq);struct mlx5_irq *mlx5_irq_request (struct mlx5_core_dev *dev,u16 vecidx,struct irq_affinity_desc *af_desc,struct cpu_rmap **rmap); -int mlx5_irqs_request_vectors (struct mlx5_core_dev *dev,u16 *cpus,int nirqs, -struct mlx5_irq **irqs,struct cpu_rmap **rmap); -void mlx5_irqs_release_vectors (struct mlx5_irq **irqs,int nirqs); +struct mlx5_irq *mlx5_irq_request_vector (struct mlx5_core_dev *dev,u16 cpu, +u16 vecidx,struct cpu_rmap **rmap); +void mlx5_irq_release_vector (struct mlx5_irq *irq);int mlx5_irq_attach_nb (struct mlx5_irq *irq,struct notifier_block *nb);int mlx5_irq_detach_nb (struct mlx5_irq *irq,struct notifier_block *nb);struct cpumask *mlx5_irq_get_affinity_mask (struct mlx5_irq *irq);
@@ -39,17 +39,17 @@ int mlx5_irq_get_index(struct mlx5_irq *irq);struct mlx5_irq_pool ;#ifdef CONFIG_MLX5_SF -int mlx5_irq_affinity_irqs_request_auto (struct mlx5_core_dev *dev,int nirqs, -struct mlx5_irq **irqs); +struct mlx5_irq *mlx5_irq_affinity_irq_request_auto (struct mlx5_core_dev *dev, +struct cpumask *used_cpus,u16 vecidx);struct mlx5_irq *mlx5_irq_affinity_request (struct mlx5_irq_pool *pool,struct irq_affinity_desc *af_desc); -void mlx5_irq_affinity_irqs_release (struct mlx5_core_dev *dev,struct mlx5_irq **irqs, -int num_irqs); +void mlx5_irq_affinity_irq_release (struct mlx5_core_dev *dev,struct mlx5_irq *irq);#else -static inline int mlx5_irq_affinity_irqs_request_auto (struct mlx5_core_dev *dev,int nirqs, -struct mlx5_irq **irqs) +static inline +struct mlx5_irq *mlx5_irq_affinity_irq_request_auto (struct mlx5_core_dev *dev, +struct cpumask *used_cpus,u16 vecidx) { -return -EOPNOTSUPP ; +return ERR_PTR (-EOPNOTSUPP ); } static inline struct mlx5_irq *
@@ -58,7 +58,9 @@ mlx5_irq_affinity_request(struct mlx5_irq_pool *pool, struct irq_affinity_desc *return ERR_PTR (-EOPNOTSUPP ); } -static inline void mlx5_irq_affinity_irqs_release (struct mlx5_core_dev *dev, -struct mlx5_irq **irqs,int num_irqs) {} +static inline +void mlx5_irq_affinity_irq_release (struct mlx5_core_dev *dev,struct mlx5_irq *irq) +{ +}#endif #endif /* __MLX5_IRQ_H__ */
drivers/net/ethernet/mellanox/mlx5/core/pci_irq.c +20 -40
99 lines not on this page · raw message
Signature · 1 line
2.41.0
PATCH 3/15 net/mlx5: Use xarray to store and manage completion IRQs
In reply to Saeed MahameedFrom: Maher Sanalla <[email protected]>
Use xarray to store the completion IRQs instead of a fixed-size allocated array as not all completion IRQs will be requested on driver load, but rather on demand when an EQ is created. The xarray offers more scalability, reduced memory overhead, and provides the ability to dynamically resize the array when needed.
--- drivers/net/ethernet/mellanox/mlx5/core/eq.c | 61 ++++++++++---------- 1 file changed, 29 insertions(+), 32 deletions(-)
drivers/net/ethernet/mellanox/mlx5/core/eq.c +29 -32
@@ -61,7 +61,7 @@ struct mlx5_eq_table {int curr_comp_eqs;int max_comp_eqs;struct mlx5_irq_table *irq_table; -struct mlx5_irq **comp_irqs; +struct xarray comp_irqs;struct mlx5_irq *ctrl_irq;struct cpu_rmap *rmap;struct cpumask used_cpus;
@@ -455,14 +455,18 @@ int mlx5_eq_table_init(struct mlx5_core_dev *dev) eq_table->irq_table =mlx5_irq_table_get (dev);cpumask_clear (&eq_table->used_cpus); +xa_init (&eq_table->comp_irqs); eq_table->curr_comp_eqs =0 ;return 0 ; }void mlx5_eq_table_cleanup (struct mlx5_core_dev *dev) { +struct mlx5_eq_table *table = dev->priv.eq_table; +mlx5_eq_debugfs_cleanup (dev); -kvfree (dev->priv.eq_table); +xa_destroy (&table->comp_irqs); +kvfree (table); }/* Async EQs */
@@ -810,10 +814,13 @@ EXPORT_SYMBOL(mlx5_eq_update_ci);static void comp_irqs_release_pci (struct mlx5_core_dev *dev) {struct mlx5_eq_table *table = dev->priv.eq_table; -int i; +struct mlx5_irq *irq; +unsigned long index; -for (i =0 ; i < table->max_comp_eqs; i++) -mlx5_irq_release_vector (table->comp_irqs[i]); +xa_for_each (&table->comp_irqs, index, irq) { +xa_erase (&table->comp_irqs, index); +mlx5_irq_release_vector (irq); + } }static int comp_irqs_request_pci (struct mlx5_core_dev *dev)
@@ -849,7 +856,8 @@ static int comp_irqs_request_pci(struct mlx5_core_dev *dev)if (IS_ERR (irq))break ; - table->comp_irqs[i] = irq; +if (xa_err (xa_store (&table->comp_irqs, i, irq,GFP_KERNEL ))) +break ; }kfree (cpus);
@@ -859,10 +867,13 @@ static int comp_irqs_request_pci(struct mlx5_core_dev *dev)static void comp_irqs_release_sf (struct mlx5_core_dev *dev) {struct mlx5_eq_table *table = dev->priv.eq_table; -int i; +struct mlx5_irq *irq; +unsigned long index; -for (i =0 ; i < table->max_comp_eqs; i++) -mlx5_irq_affinity_irq_release (dev, table->comp_irqs[i]); +xa_for_each (&table->comp_irqs, index, irq) { +xa_erase (&table->comp_irqs, index); +mlx5_irq_affinity_irq_release (dev, irq); + } }static int comp_irqs_request_sf (struct mlx5_core_dev *dev)
@@ -876,7 +887,8 @@ static int comp_irqs_request_sf(struct mlx5_core_dev *dev)if (IS_ERR (irq))break ; - table->comp_irqs[i] = irq; +if (xa_err (xa_store (&table->comp_irqs, i, irq,GFP_KERNEL ))) +break ; }return i ? i :PTR_ERR (irq);
@@ -884,31 +896,14 @@ static int comp_irqs_request_sf(struct mlx5_core_dev *dev)static void comp_irqs_release (struct mlx5_core_dev *dev) { -struct mlx5_eq_table *table = dev->priv.eq_table; -mlx5_core_is_sf (dev) ?comp_irqs_release_sf (dev) :comp_irqs_release_pci (dev); - -kfree (table->comp_irqs); }static int comp_irqs_request (struct mlx5_core_dev *dev) { -struct mlx5_eq_table *table = dev->priv.eq_table; -int ncomp_eqs; -int ret; - - ncomp_eqs = table->max_comp_eqs; - table->comp_irqs =kcalloc (ncomp_eqs,sizeof (*table->comp_irqs),GFP_KERNEL ); -if (!table->comp_irqs) -return -ENOMEM ; - - ret =mlx5_core_is_sf (dev) ?comp_irqs_request_sf (dev) : -comp_irqs_request_pci (dev); -if (ret <0 ) -kfree (table->comp_irqs); - -return ret; +return mlx5_core_is_sf (dev) ?comp_irqs_request_sf (dev) : +comp_irqs_request_pci (dev); }#ifdef CONFIG_RFS_ACCEL
@@ -983,10 +978,11 @@ static int create_comp_eqs(struct mlx5_core_dev *dev) {struct mlx5_eq_table *table = dev->priv.eq_table;struct mlx5_eq_comp *eq; +struct mlx5_irq *irq; +unsigned long index;int ncomp_eqs;int nent;int err; -int i; err =alloc_rmap (dev);if (err)
@@ -1002,7 +998,8 @@ static int create_comp_eqs(struct mlx5_core_dev *dev)INIT_LIST_HEAD (&table->comp_eqs_list); nent =comp_eq_depth_devlink_param_get (dev); -for (i =0 ; i < ncomp_eqs; i++) { +xa_for_each (&table->comp_irqs, index, irq) + {struct mlx5_eq_param param = {}; eq =kzalloc_node (sizeof (*eq),GFP_KERNEL , dev->priv.numa_node);
@@ -1018,7 +1015,7 @@ static int create_comp_eqs(struct mlx5_core_dev *dev) eq->irq_nb.notifier_call = mlx5_eq_comp_int; param = (struct mlx5_eq_param ) { - .irq = table->comp_irqs[i], + .irq = irq, .nent = nent, };
Signature · 1 line
2.41.0
PATCH 4/15 net/mlx5: Refactor completion IRQ request/release handlers in EQ layer
In reply to Saeed MahameedFrom: Maher Sanalla <[email protected]>
Break the completion IRQ request/release functions into per-vector handlers for both PCI devices and SFs in the EQ layer.
On EQ table creation, loop over all vectors and request an IRQ for each one using the new per-vector functions. Perform the symmetrical change when releasing IRQs on EQ table cleanup.
--- drivers/net/ethernet/mellanox/mlx5/core/eq.c | 109 +++++++++---------- 1 file changed, 51 insertions(+), 58 deletions(-)
drivers/net/ethernet/mellanox/mlx5/core/eq.c +51 -58
@@ -811,99 +811,84 @@ void mlx5_eq_update_ci(struct mlx5_eq *eq, u32 cc, bool arm) }EXPORT_SYMBOL (mlx5_eq_update_ci); -static void comp_irqs_release_pci (struct mlx5_core_dev *dev) +static void comp_irq_release_pci (struct mlx5_core_dev *dev,u16 vecidx) {struct mlx5_eq_table *table = dev->priv.eq_table;struct mlx5_irq *irq; -unsigned long index; -xa_for_each (&table->comp_irqs, index, irq) { -xa_erase (&table->comp_irqs, index); -mlx5_irq_release_vector (irq); - } + irq =xa_load (&table->comp_irqs, vecidx); +if (!irq) +return ; + +xa_erase (&table->comp_irqs, vecidx); +mlx5_irq_release_vector (irq); } -static int comp_irqs_request_pci (struct mlx5_core_dev *dev) +static int comp_irq_request_pci (struct mlx5_core_dev *dev,u16 vecidx) {struct mlx5_eq_table *table = dev->priv.eq_table;const struct cpumask *prev = cpu_none_mask;const struct cpumask *mask;struct mlx5_irq *irq; -int ncomp_eqs; -u16 *cpus; +int found_cpu =0 ; +int i =0 ;int cpu; -int i; - - ncomp_eqs = table->max_comp_eqs; - cpus =kcalloc (ncomp_eqs,sizeof (*cpus),GFP_KERNEL ); -if (!cpus) -return -ENOMEM ; - i =0 ;rcu_read_lock ();for_each_numa_hop_mask (mask, dev->priv.numa_node) {for_each_cpu_andnot (cpu, mask, prev) { - cpus[i] = cpu; -if (++i == ncomp_eqs) +if (i++ == vecidx) { + found_cpu = cpu; goto spread_done; + } } prev = mask; } + spread_done:rcu_read_unlock (); -for (i =0 ; i < ncomp_eqs; i++) { - irq =mlx5_irq_request_vector (dev, cpus[i], i, &table->rmap); -if (IS_ERR (irq)) -break ; - -if (xa_err (xa_store (&table->comp_irqs, i, irq,GFP_KERNEL ))) -break ; - } + irq =mlx5_irq_request_vector (dev, found_cpu, vecidx, &table->rmap); +if (IS_ERR (irq)) +return PTR_ERR (irq); -kfree (cpus); -return i ? i :PTR_ERR (irq); +return xa_err (xa_store (&table->comp_irqs, vecidx, irq,GFP_KERNEL )); } -static void comp_irqs_release_sf (struct mlx5_core_dev *dev) +static void comp_irq_release_sf (struct mlx5_core_dev *dev,u16 vecidx) {struct mlx5_eq_table *table = dev->priv.eq_table;struct mlx5_irq *irq; -unsigned long index; -xa_for_each (&table->comp_irqs, index, irq) { -xa_erase (&table->comp_irqs, index); -mlx5_irq_affinity_irq_release (dev, irq); - } + irq =xa_load (&table->comp_irqs, vecidx); +if (!irq) +return ; + +xa_erase (&table->comp_irqs, vecidx); +mlx5_irq_affinity_irq_release (dev, irq); } -static int comp_irqs_request_sf (struct mlx5_core_dev *dev) +static int comp_irq_request_sf (struct mlx5_core_dev *dev,u16 vecidx) {struct mlx5_eq_table *table = dev->priv.eq_table;struct mlx5_irq *irq; -int i; - -for (i =0 ; i < table->max_comp_eqs; i++) { - irq =mlx5_irq_affinity_irq_request_auto (dev, &table->used_cpus, i); -if (IS_ERR (irq)) -break ; -if (xa_err (xa_store (&table->comp_irqs, i, irq,GFP_KERNEL ))) -break ; - } + irq =mlx5_irq_affinity_irq_request_auto (dev, &table->used_cpus, vecidx); +if (IS_ERR (irq)) +return PTR_ERR (irq); -return i ? i :PTR_ERR (irq); +return xa_err (xa_store (&table->comp_irqs, vecidx, irq,GFP_KERNEL )); } -static void comp_irqs_release (struct mlx5_core_dev *dev) +static void comp_irq_release (struct mlx5_core_dev *dev,u16 vecidx) { -mlx5_core_is_sf (dev) ?comp_irqs_release_sf (dev) : -comp_irqs_release_pci (dev); +mlx5_core_is_sf (dev) ?comp_irq_release_sf (dev, vecidx) : +comp_irq_release_pci (dev, vecidx); } -static int comp_irqs_request (struct mlx5_core_dev *dev) +static int comp_irq_request (struct mlx5_core_dev *dev,u16 vecidx) { -return mlx5_core_is_sf (dev) ?comp_irqs_request_sf (dev) : -comp_irqs_request_pci (dev); +return mlx5_core_is_sf (dev) ?comp_irq_request_sf (dev, vecidx) : +comp_irq_request_pci (dev, vecidx); }#ifdef CONFIG_RFS_ACCEL
@@ -944,6 +929,8 @@ static void destroy_comp_eqs(struct mlx5_core_dev *dev) {struct mlx5_eq_table *table = dev->priv.eq_table;struct mlx5_eq_comp *eq, *n; +struct mlx5_irq *irq; +unsigned long index;list_for_each_entry_safe (eq, n, &table->comp_eqs_list, list) {list_del (&eq->list);
@@ -955,7 +942,10 @@ static void destroy_comp_eqs(struct mlx5_core_dev *dev)kfree (eq); table->curr_comp_eqs--; } -comp_irqs_release (dev); + +xa_for_each (&table->comp_irqs, index, irq) +comp_irq_release (dev, index); +free_rmap (dev); }
@@ -980,7 +970,7 @@ static int create_comp_eqs(struct mlx5_core_dev *dev)struct mlx5_eq_comp *eq;struct mlx5_irq *irq;unsigned long index; -int ncomp_eqs; +int vecidx;int nent;int err;
@@ -988,13 +978,16 @@ static int create_comp_eqs(struct mlx5_core_dev *dev)if (err)return err; - ncomp_eqs =comp_irqs_request (dev); -if (ncomp_eqs <0 ) { - err = ncomp_eqs; - goto err_irqs_req; +for (vecidx =0 ; vecidx < table->max_comp_eqs; vecidx++) { + err =comp_irq_request (dev, vecidx); +if (err <0 ) +break ; } - table->max_comp_eqs = ncomp_eqs; +if (!vecidx) + goto err_irqs_req; + + table->max_comp_eqs = vecidx;INIT_LIST_HEAD (&table->comp_eqs_list); nent =comp_eq_depth_devlink_param_get (dev);
Signature · 1 line
2.41.0
PATCH 5/15 net/mlx5: Use xarray to store and manage completion EQs
In reply to Saeed MahameedFrom: Maher Sanalla <[email protected]>
Use xarray to store the completion EQs instead of a linked list. The xarray offers more scalability, reduced memory overhead, and facilitates the lookup of a certain EQ given a vector index.
--- drivers/net/ethernet/mellanox/mlx5/core/eq.c | 50 ++++++++++---------- 1 file changed, 24 insertions(+), 26 deletions(-)
drivers/net/ethernet/mellanox/mlx5/core/eq.c +24 -26
@@ -47,7 +47,7 @@ enum {static_assert (MLX5_EQ_POLLING_BUDGET <=MLX5_NUM_SPARE_EQE );struct mlx5_eq_table { -struct list_head comp_eqs_list; +struct xarray comp_eqs;struct mlx5_eq_async pages_eq;struct mlx5_eq_async cmd_eq;struct mlx5_eq_async async_eq;
@@ -455,6 +455,7 @@ int mlx5_eq_table_init(struct mlx5_core_dev *dev) eq_table->irq_table =mlx5_irq_table_get (dev);cpumask_clear (&eq_table->used_cpus); +xa_init (&eq_table->comp_eqs);xa_init (&eq_table->comp_irqs); eq_table->curr_comp_eqs =0 ;return 0 ;
@@ -466,6 +467,7 @@ void mlx5_eq_table_cleanup(struct mlx5_core_dev *dev)mlx5_eq_debugfs_cleanup (dev);xa_destroy (&table->comp_irqs); +xa_destroy (&table->comp_eqs);kvfree (table); }
@@ -928,12 +930,12 @@ static void free_rmap(struct mlx5_core_dev *mdev) {}static void destroy_comp_eqs (struct mlx5_core_dev *dev) {struct mlx5_eq_table *table = dev->priv.eq_table; -struct mlx5_eq_comp *eq, *n; +struct mlx5_eq_comp *eq;struct mlx5_irq *irq;unsigned long index; -list_for_each_entry_safe (eq, n, &table->comp_eqs_list, list) { -list_del (&eq->list); +xa_for_each (&table->comp_eqs, index, eq) { +xa_erase (&table->comp_eqs, index);mlx5_eq_disable (dev, &eq->core, &eq->irq_nb);if (destroy_unmap_eq (dev, &eq->core)) mlx5_core_warn(dev, "failed to destroy comp EQ 0x%x\n",
@@ -988,7 +990,6 @@ static int create_comp_eqs(struct mlx5_core_dev *dev) goto err_irqs_req; table->max_comp_eqs = vecidx; -INIT_LIST_HEAD (&table->comp_eqs_list); nent =comp_eq_depth_devlink_param_get (dev);xa_for_each (&table->comp_irqs, index, irq)
@@ -1022,13 +1023,16 @@ static int create_comp_eqs(struct mlx5_core_dev *dev) }mlx5_core_dbg (dev,"allocated completion EQN %d\n" , eq->core.eqn); -/* add tail, to keep the list ordered, for mlx5_vector2eqn to work */ -list_add_tail (&eq->list, &table->comp_eqs_list); + err =xa_err (xa_store (&table->comp_eqs, index, eq,GFP_KERNEL )); +if (err) + goto disable_eq; table->curr_comp_eqs++; }return 0 ; +disable_eq: +mlx5_eq_disable (dev, &eq->core, &eq->irq_nb); clean_eq:kfree (eq); clean:
@@ -1043,21 +1047,16 @@ static int vector2eqnirqn(struct mlx5_core_dev *dev, int vector, int *eqn, {struct mlx5_eq_table *table = dev->priv.eq_table;struct mlx5_eq_comp *eq; -int err = -ENOENT ; -int i =0 ; -list_for_each_entry (eq, &table->comp_eqs_list, list) { -if (i++ == vector) { -if (irqn) - *irqn = eq->core.irqn; -if (eqn) - *eqn = eq->core.eqn; - err =0 ; -break ; - } - } + eq =xa_load (&table->comp_eqs, vector); +if (!eq) +return -ENOENT ; -return err; +if (irqn) + *irqn = eq->core.irqn; +if (eqn) + *eqn = eq->core.eqn; +return 0 ; }int mlx5_vector2eqn (struct mlx5_core_dev *dev,int vector,int *eqn)
@@ -1082,12 +1081,10 @@ mlx5_comp_irq_get_affinity_mask(struct mlx5_core_dev *dev, int vector) {struct mlx5_eq_table *table = dev->priv.eq_table;struct mlx5_eq_comp *eq; -int i =0 ; -list_for_each_entry (eq, &table->comp_eqs_list, list) { -if (i++ == vector) -return mlx5_irq_get_affinity_mask (eq->core.irq); - } + eq =xa_load (&table->comp_eqs, vector); +if (eq) +return mlx5_irq_get_affinity_mask (eq->core.irq);WARN_ON_ONCE (1 );return NULL ;
@@ -1105,8 +1102,9 @@ struct mlx5_eq_comp *mlx5_eqn2comp_eq(struct mlx5_core_dev *dev, int eqn) {struct mlx5_eq_table *table = dev->priv.eq_table;struct mlx5_eq_comp *eq; +unsigned long index; -list_for_each_entry (eq, &table->comp_eqs_list, list) { +xa_for_each (&table->comp_eqs, index, eq) {if (eq->core.eqn == eqn)return eq; }
Signature · 1 line
2.41.0
PATCH 6/15 net/mlx5: Implement single completion EQ create/destroy methods
In reply to Saeed MahameedFrom: Maher Sanalla <[email protected]>
Currently, create_comp_eqs() function handles the creation of all completion EQs for all the vectors on driver load. While on driver unload, destroy_comp_eqs() performs the equivalent job.
In preparation for dynamic EQ creation, replace create_comp_eqs() / destroy_comp_eqs() with create_comp_eq() / destroy_comp_eq() functions which will receive a vector index and allocate/destroy an EQ for that specific vector. Thus, allowing more flexibility in the management of completion EQs.
--- drivers/net/ethernet/mellanox/mlx5/core/eq.c | 137 +++++++++---------- 1 file changed, 66 insertions(+), 71 deletions(-)
drivers/net/ethernet/mellanox/mlx5/core/eq.c +66 -71
@@ -927,28 +927,19 @@ static int alloc_rmap(struct mlx5_core_dev *mdev) { return 0; }static void free_rmap (struct mlx5_core_dev *mdev) {}#endif -static void destroy_comp_eqs (struct mlx5_core_dev *dev) +static void destroy_comp_eq (struct mlx5_core_dev *dev,struct mlx5_eq_comp *eq,u16 vecidx) {struct mlx5_eq_table *table = dev->priv.eq_table; -struct mlx5_eq_comp *eq; -struct mlx5_irq *irq; -unsigned long index; - -xa_for_each (&table->comp_eqs, index, eq) { -xa_erase (&table->comp_eqs, index); -mlx5_eq_disable (dev, &eq->core, &eq->irq_nb); -if (destroy_unmap_eq (dev, &eq->core)) -mlx5_core_warn (dev,"failed to destroy comp EQ 0x%x\n" , - eq->core.eqn); -tasklet_disable (&eq->tasklet_ctx.task); -kfree (eq); - table->curr_comp_eqs--; - } -xa_for_each (&table->comp_irqs, index, irq) -comp_irq_release (dev, index); - -free_rmap (dev); +xa_erase (&table->comp_eqs, vecidx); +mlx5_eq_disable (dev, &eq->core, &eq->irq_nb); +if (destroy_unmap_eq (dev, &eq->core)) +mlx5_core_warn (dev,"failed to destroy comp EQ 0x%x\n" , + eq->core.eqn); +tasklet_disable (&eq->tasklet_ctx.task); +kfree (eq); +comp_irq_release (dev, vecidx); + table->curr_comp_eqs--; }static u16 comp_eq_depth_devlink_param_get (struct mlx5_core_dev *dev)
@@ -966,79 +957,62 @@ static u16 comp_eq_depth_devlink_param_get(struct mlx5_core_dev *dev)return MLX5_COMP_EQ_SIZE ; } -static int create_comp_eqs (struct mlx5_core_dev *dev) +static int create_comp_eq (struct mlx5_core_dev *dev,u16 vecidx) {struct mlx5_eq_table *table = dev->priv.eq_table; +struct mlx5_eq_param param = {};struct mlx5_eq_comp *eq;struct mlx5_irq *irq; -unsigned long index; -int vecidx;int nent;int err; - err =alloc_rmap (dev); + err =comp_irq_request (dev, vecidx);if (err)return err; -for (vecidx =0 ; vecidx < table->max_comp_eqs; vecidx++) { - err =comp_irq_request (dev, vecidx); -if (err <0 ) -break ; - } - -if (!vecidx) - goto err_irqs_req; - - table->max_comp_eqs = vecidx; nent =comp_eq_depth_devlink_param_get (dev); -xa_for_each (&table->comp_irqs, index, irq) - { -struct mlx5_eq_param param = {}; + eq =kzalloc_node (sizeof (*eq),GFP_KERNEL , dev->priv.numa_node); +if (!eq) { + err = -ENOMEM ; + goto clean_irq; + } - eq =kzalloc_node (sizeof (*eq),GFP_KERNEL , dev->priv.numa_node); -if (!eq) { - err = -ENOMEM ; - goto clean; - } +INIT_LIST_HEAD (&eq->tasklet_ctx.list); +INIT_LIST_HEAD (&eq->tasklet_ctx.process_list); +spin_lock_init (&eq->tasklet_ctx.lock); +tasklet_setup (&eq->tasklet_ctx.task, mlx5_cq_tasklet_cb); -INIT_LIST_HEAD (&eq->tasklet_ctx.list); -INIT_LIST_HEAD (&eq->tasklet_ctx.process_list); -spin_lock_init (&eq->tasklet_ctx.lock); -tasklet_setup (&eq->tasklet_ctx.task, mlx5_cq_tasklet_cb); - - eq->irq_nb.notifier_call = mlx5_eq_comp_int; - param = (struct mlx5_eq_param ) { - .irq = irq, - .nent = nent, - }; - - err =create_map_eq (dev, &eq->core, ¶m); -if (err) - goto clean_eq; - err =mlx5_eq_enable (dev, &eq->core, &eq->irq_nb); -if (err) { -destroy_unmap_eq (dev, &eq->core); - goto clean_eq; - } + irq =xa_load (&table->comp_irqs, vecidx); + eq->irq_nb.notifier_call = mlx5_eq_comp_int; + param = (struct mlx5_eq_param ) { + .irq = irq, + .nent = nent, + }; -mlx5_core_dbg (dev,"allocated completion EQN %d\n" , eq->core.eqn); - err =xa_err (xa_store (&table->comp_eqs, index, eq,GFP_KERNEL )); -if (err) - goto disable_eq; - table->curr_comp_eqs++; + err =create_map_eq (dev, &eq->core, ¶m); +if (err) + goto clean_eq; + err =mlx5_eq_enable (dev, &eq->core, &eq->irq_nb); +if (err) { +destroy_unmap_eq (dev, &eq->core); + goto clean_eq; } +mlx5_core_dbg (dev,"allocated completion EQN %d\n" , eq->core.eqn); + err =xa_err (xa_store (&table->comp_eqs, vecidx, eq,GFP_KERNEL )); +if (err) + goto disable_eq; + + table->curr_comp_eqs++;return 0 ; disable_eq:mlx5_eq_disable (dev, &eq->core, &eq->irq_nb); clean_eq:kfree (eq); -clean: -destroy_comp_eqs (dev); -err_irqs_req: -free_rmap (dev); +clean_irq: +comp_irq_release (dev, vecidx);return err; }
@@ -1161,6 +1135,7 @@ int mlx5_eq_table_create(struct mlx5_core_dev *dev) {struct mlx5_eq_table *eq_table = dev->priv.eq_table;int err; +int i; eq_table->max_comp_eqs =get_num_eqs (dev); err =create_async_eqs (dev);
@@ -1169,8 +1144,19 @@ int mlx5_eq_table_create(struct mlx5_core_dev *dev) goto err_async_eqs; } - err =create_comp_eqs (dev); + err =alloc_rmap (dev);if (err) { +mlx5_core_err (dev,"Failed to allocate rmap\n" ); + goto err_rmap; + } + +for (i =0 ; i < eq_table->max_comp_eqs; i++) { + err =create_comp_eq (dev, i); +if (err <0 ) +break ; + } + +if (!i) {mlx5_core_err (dev,"Failed to create completion EQs\n" ); goto err_comp_eqs; }
@@ -1178,6 +1164,8 @@ int mlx5_eq_table_create(struct mlx5_core_dev *dev)return 0 ; err_comp_eqs: +free_rmap (dev); +err_rmap:destroy_async_eqs (dev); err_async_eqs:return err;
@@ -1185,7 +1173,14 @@ int mlx5_eq_table_create(struct mlx5_core_dev *dev)void mlx5_eq_table_destroy (struct mlx5_core_dev *dev) { -destroy_comp_eqs (dev); +struct mlx5_eq_table *table = dev->priv.eq_table; +struct mlx5_eq_comp *eq; +unsigned long index; + +xa_for_each (&table->comp_eqs, index, eq) +destroy_comp_eq (dev, eq, index); + +free_rmap (dev);destroy_async_eqs (dev); }
Signature · 1 line
2.41.0
PATCH 7/15 net/mlx5: Introduce mlx5_cpumask_default_spread
In reply to Saeed MahameedFrom: Maher Sanalla <[email protected]>
For better code readability in the completion IRQ request code, define the cpu lookup per completion vector logic in a separate function.
The new method mlx5_cpumask_default_spread() given a vector index 'n' will return the 'nth' cpu. This new method will be used also in the next patch.
--- drivers/net/ethernet/mellanox/mlx5/core/eq.c | 20 ++++++++++++++------ 1 file changed, 14 insertions(+), 6 deletions(-)
drivers/net/ethernet/mellanox/mlx5/core/eq.c +14 -6
@@ -826,20 +826,18 @@ static void comp_irq_release_pci(struct mlx5_core_dev *dev, u16 vecidx)mlx5_irq_release_vector (irq); } -static int comp_irq_request_pci (struct mlx5_core_dev *dev,u16 vecidx) +static int mlx5_cpumask_default_spread (int numa_node,int index) { -struct mlx5_eq_table *table = dev->priv.eq_table;const struct cpumask *prev = cpu_none_mask;const struct cpumask *mask; -struct mlx5_irq *irq;int found_cpu =0 ;int i =0 ;int cpu;rcu_read_lock (); -for_each_numa_hop_mask (mask, dev->priv.numa_node) { +for_each_numa_hop_mask (mask, numa_node) {for_each_cpu_andnot (cpu, mask, prev) { -if (i++ == vecidx) { +if (i++ == index) { found_cpu = cpu; goto spread_done; }
@@ -849,7 +847,17 @@ static int comp_irq_request_pci(struct mlx5_core_dev *dev, u16 vecidx) spread_done:rcu_read_unlock (); - irq =mlx5_irq_request_vector (dev, found_cpu, vecidx, &table->rmap); +return found_cpu; +} + +static int comp_irq_request_pci (struct mlx5_core_dev *dev,u16 vecidx) +{ +struct mlx5_eq_table *table = dev->priv.eq_table; +struct mlx5_irq *irq; +int cpu; + + cpu =mlx5_cpumask_default_spread (dev->priv.numa_node, vecidx); + irq =mlx5_irq_request_vector (dev, cpu, vecidx, &table->rmap);if (IS_ERR (irq))return PTR_ERR (irq);
Signature · 1 line
2.41.0
PATCH 8/15 net/mlx5: Add IRQ vector to CPU lookup function
In reply to Saeed MahameedFrom: Maher Sanalla <[email protected]>
Currently, once driver load completes, IRQ requests were performed for all vectors. However, as we move to support dynamic creation of EQs, this will not be the case as some IRQs will not exist at this stage. Thus, in such case, use the default CPU to IRQ mapping which is the serial mapping based on IRQ vector index. Meaning, the n'th vector gets mapped to the n'th CPU.
Introduce an API function mlx5_comp_vector_cpu() that takes an IRQ index and provides the corresponding CPU mapping. It utilizes the existing IRQ affinity if defined, or resorts to the default serialized CPU mapping otherwise.
--- .../net/ethernet/mellanox/mlx5/core/en/trap.c | 2 +- .../net/ethernet/mellanox/mlx5/core/en_main.c | 4 ++-- drivers/net/ethernet/mellanox/mlx5/core/eq.c | 19 ++++++++++++++++--- include/linux/mlx5/driver.h | 3 +-- 4 files changed, 20 insertions(+), 8 deletions(-)
drivers/net/ethernet/mellanox/mlx5/core/en/trap.c +1 -1
@@ -128,7 +128,7 @@ static void mlx5e_build_trap_params(struct mlx5_core_dev *mdev,static struct mlx5e_trap *mlx5e_open_trap (struct mlx5e_priv *priv) { -int cpu =cpumask_first (mlx5_comp_irq_get_affinity_mask (priv->mdev,0 )); +int cpu =mlx5_comp_vector_get_cpu (priv->mdev,0 );struct net_device *netdev = priv->netdev;struct mlx5e_trap *t;int err;
drivers/net/ethernet/mellanox/mlx5/core/en_main.c +2 -2
@@ -2445,7 +2445,7 @@ static int mlx5e_open_channel(struct mlx5e_priv *priv, int ix,struct xsk_buff_pool *xsk_pool, struct mlx5e_channel **cp) { - int cpu = cpumask_first(mlx5_comp_irq_get_affinity_mask(priv->mdev, ix)); + int cpu = mlx5_comp_vector_get_cpu(priv->mdev, ix);struct net_device *netdev = priv->netdev;struct mlx5e_xsk_param xsk;struct mlx5e_channel *c;
@@ -2862,7 +2862,7 @@ static void mlx5e_set_default_xps_cpumasks(struct mlx5e_priv *priv,cpumask_clear (priv->scratchpad.cpumask);for (irq = ix; irq < num_comp_vectors; irq += params->num_channels) { -int cpu =cpumask_first (mlx5_comp_irq_get_affinity_mask (mdev, irq)); +int cpu =mlx5_comp_vector_get_cpu (mdev, irq);cpumask_set_cpu (cpu, priv->scratchpad.cpumask); }
drivers/net/ethernet/mellanox/mlx5/core/eq.c +16 -3
@@ -1058,7 +1058,7 @@ unsigned int mlx5_comp_vectors_count(struct mlx5_core_dev *dev) }EXPORT_SYMBOL (mlx5_comp_vectors_count); -struct cpumask * +static struct cpumask *mlx5_comp_irq_get_affinity_mask (struct mlx5_core_dev *dev,int vector) {struct mlx5_eq_table *table = dev->priv.eq_table;
@@ -1068,10 +1068,23 @@ mlx5_comp_irq_get_affinity_mask(struct mlx5_core_dev *dev, int vector)if (eq)return mlx5_irq_get_affinity_mask (eq->core.irq); -WARN_ON_ONCE (1 );return NULL ; } -EXPORT_SYMBOL (mlx5_comp_irq_get_affinity_mask); + +int mlx5_comp_vector_get_cpu (struct mlx5_core_dev *dev,int vector) +{ +struct cpumask *mask; +int cpu; + + mask =mlx5_comp_irq_get_affinity_mask (dev, vector); +if (mask) + cpu =cpumask_first (mask); +else + cpu =mlx5_cpumask_default_spread (dev->priv.numa_node, vector); + +return cpu; +} +EXPORT_SYMBOL (mlx5_comp_vector_get_cpu);#ifdef CONFIG_RFS_ACCEL struct cpu_rmap *mlx5_eq_table_get_rmap (struct mlx5_core_dev *dev)
include/linux/mlx5/driver.h +1 -2
@@ -1109,8 +1109,7 @@ int mlx5_alloc_bfreg(struct mlx5_core_dev *mdev, struct mlx5_sq_bfreg *bfreg,void mlx5_free_bfreg (struct mlx5_core_dev *mdev,struct mlx5_sq_bfreg *bfreg);unsigned int mlx5_comp_vectors_count (struct mlx5_core_dev *dev); -struct cpumask * -mlx5_comp_irq_get_affinity_mask (struct mlx5_core_dev *dev,int vector); +int mlx5_comp_vector_get_cpu (struct mlx5_core_dev *dev,int vector);unsigned int mlx5_core_reserved_gids_count (struct mlx5_core_dev *dev); int mlx5_core_roce_gid_set(struct mlx5_core_dev *dev, unsigned int index, u8 roce_version, u8 roce_l3_type, const u8 *gid,
Signature · 1 line
2.41.0
PATCH 9/15 net/mlx5: Rename mlx5_comp_vectors_count() to mlx5_comp_vectors_max()
In reply to Saeed MahameedFrom: Maher Sanalla <[email protected]>
To accurately represent its purpose, rename the function that retrieves the value of maximum vectors from mlx5_comp_vectors_count() to mlx5_comp_vectors_max().
--- drivers/infiniband/hw/mlx5/main.c | 2 +- drivers/net/ethernet/mellanox/mlx5/core/en.h | 2 +- drivers/net/ethernet/mellanox/mlx5/core/en_main.c | 2 +- drivers/net/ethernet/mellanox/mlx5/core/eq.c | 4 ++-- drivers/net/ethernet/mellanox/mlx5/core/steering/dr_send.c | 2 +- drivers/vfio/pci/mlx5/cmd.c | 2 +- include/linux/mlx5/driver.h | 2 +- 7 files changed, 8 insertions(+), 8 deletions(-)
drivers/infiniband/hw/mlx5/main.c +1 -1
@@ -3685,7 +3685,7 @@ static int mlx5_ib_stage_init_init(struct mlx5_ib_dev *dev)if (mlx5_use_mad_ifc (dev))get_ext_port_caps (dev); - dev->ib_dev.num_comp_vectors =mlx5_comp_vectors_count (mdev); + dev->ib_dev.num_comp_vectors =mlx5_comp_vectors_max (mdev);mutex_init (&dev->cap_mask_mutex);INIT_LIST_HEAD (&dev->qp_list);
drivers/net/ethernet/mellanox/mlx5/core/en.h +1 -1
@@ -193,7 +193,7 @@ static inline int mlx5e_get_max_num_channels(struct mlx5_core_dev *mdev) {return is_kdump_kernel () ?MLX5E_MIN_NUM_CHANNELS : -min_t (int,mlx5_comp_vectors_count (mdev),MLX5E_MAX_NUM_CHANNELS ); +min_t (int,mlx5_comp_vectors_max (mdev),MLX5E_MAX_NUM_CHANNELS ); }/* The maximum WQE size can be retrieved by max_wqe_sz_sq in
drivers/net/ethernet/mellanox/mlx5/core/en_main.c +1 -1
@@ -2856,7 +2856,7 @@ static void mlx5e_set_default_xps_cpumasks(struct mlx5e_priv *priv,struct mlx5_core_dev *mdev = priv->mdev;int num_comp_vectors, ix, irq; - num_comp_vectors =mlx5_comp_vectors_count (mdev); + num_comp_vectors =mlx5_comp_vectors_max (mdev);for (ix =0 ; ix < params->num_channels; ix++) {cpumask_clear (priv->scratchpad.cpumask);
drivers/net/ethernet/mellanox/mlx5/core/eq.c +2 -2
@@ -1052,11 +1052,11 @@ int mlx5_vector2irqn(struct mlx5_core_dev *dev, int vector, unsigned int *irqn)return vector2eqnirqn (dev, vector,NULL , irqn); } -unsigned int mlx5_comp_vectors_count (struct mlx5_core_dev *dev) +unsigned int mlx5_comp_vectors_max (struct mlx5_core_dev *dev) {return dev->priv.eq_table->max_comp_eqs; } -EXPORT_SYMBOL (mlx5_comp_vectors_count); +EXPORT_SYMBOL (mlx5_comp_vectors_max);static struct cpumask *mlx5_comp_irq_get_affinity_mask (struct mlx5_core_dev *dev,int vector)
drivers/net/ethernet/mellanox/mlx5/core/steering/dr_send.c +1 -1
@@ -1096,7 +1096,7 @@ static struct mlx5dr_cq *dr_create_cq(struct mlx5_core_dev *mdev,if (!in) goto err_cqwq; - vector =raw_smp_processor_id () %mlx5_comp_vectors_count (mdev); + vector =raw_smp_processor_id () %mlx5_comp_vectors_max (mdev); err =mlx5_vector2eqn (mdev, vector, &eqn);if (err) {kvfree (in);
drivers/vfio/pci/mlx5/cmd.c +1 -1
@@ -1025,7 +1025,7 @@ static int mlx5vf_create_cq(struct mlx5_core_dev *mdev, goto err_buff; } - vector =raw_smp_processor_id () %mlx5_comp_vectors_count (mdev); + vector =raw_smp_processor_id () %mlx5_comp_vectors_max (mdev); err =mlx5_vector2eqn (mdev, vector, &eqn);if (err) goto err_vec;
include/linux/mlx5/driver.h +1 -1
@@ -1108,7 +1108,7 @@ int mlx5_alloc_bfreg(struct mlx5_core_dev *mdev, struct mlx5_sq_bfreg *bfreg, bool map_wc, bool fast_path);void mlx5_free_bfreg (struct mlx5_core_dev *mdev,struct mlx5_sq_bfreg *bfreg); -unsigned int mlx5_comp_vectors_count (struct mlx5_core_dev *dev); +unsigned int mlx5_comp_vectors_max (struct mlx5_core_dev *dev);int mlx5_comp_vector_get_cpu (struct mlx5_core_dev *dev,int vector);unsigned int mlx5_core_reserved_gids_count (struct mlx5_core_dev *dev); int mlx5_core_roce_gid_set(struct mlx5_core_dev *dev, unsigned int index,
Signature · 1 line
2.41.0
PATCH 10/15 net/mlx5: Handle SF IRQ request in the absence of SF IRQ pool
In reply to Saeed MahameedFrom: Maher Sanalla <[email protected]>
In case the SF IRQ pool is not available due to setup limitations, SF currently relies on the already allocated PF IRQs to fulfill its IRQ vector requests.
However, with the dynamic EQ allocation introduced in the next patch, it is possible that not all IRQs of PF will be allocated after the driver is loaded. In such case, if a SF requests a completion IRQ without having its own independent IRQ pool, SF will lack a PF IRQ to utilize.
To address this scenario, allocate an IRQ for the SF from the PF's IRQ pool on demand. The new IRQ will be shared between the SF and it's PF.
--- drivers/net/ethernet/mellanox/mlx5/core/eq.c | 24 +++++++++++++++++-- .../mellanox/mlx5/core/irq_affinity.c | 12 ++++------ 2 files changed, 26 insertions(+), 10 deletions(-)
drivers/net/ethernet/mellanox/mlx5/core/eq.c +22 -2
@@ -850,14 +850,29 @@ static int mlx5_cpumask_default_spread(int numa_node, int index)return found_cpu; } +static struct cpu_rmap *mlx5_eq_table_get_pci_rmap (struct mlx5_core_dev *dev) +{ +#ifdef CONFIG_RFS_ACCEL +#ifdef CONFIG_MLX5_SF +if (mlx5_core_is_sf (dev)) +return dev->priv.parent_mdev->priv.eq_table->rmap; +#endif +return dev->priv.eq_table->rmap; +#else +return NULL ; +#endif +} +static int comp_irq_request_pci (struct mlx5_core_dev *dev,u16 vecidx) {struct mlx5_eq_table *table = dev->priv.eq_table; +struct cpu_rmap *rmap;struct mlx5_irq *irq;int cpu; + rmap =mlx5_eq_table_get_pci_rmap (dev); cpu =mlx5_cpumask_default_spread (dev->priv.numa_node, vecidx); - irq =mlx5_irq_request_vector (dev, cpu, vecidx, &table->rmap); + irq =mlx5_irq_request_vector (dev, cpu, vecidx, &rmap);if (IS_ERR (irq))return PTR_ERR (irq);
@@ -883,8 +898,13 @@ static int comp_irq_request_sf(struct mlx5_core_dev *dev, u16 vecidx)struct mlx5_irq *irq; irq =mlx5_irq_affinity_irq_request_auto (dev, &table->used_cpus, vecidx); -if (IS_ERR (irq)) +if (IS_ERR (irq)) { +/* In case SF irq pool does not exist, fallback to the PF irqs*/ +if (PTR_ERR (irq) == -ENOENT ) +return comp_irq_request_pci (dev, vecidx); +return PTR_ERR (irq); + }return xa_err (xa_store (&table->comp_irqs, vecidx, irq,GFP_KERNEL )); }
drivers/net/ethernet/mellanox/mlx5/core/irq_affinity.c +4 -8
@@ -191,17 +191,13 @@ struct mlx5_irq *mlx5_irq_affinity_irq_request_auto(struct mlx5_core_dev *dev,struct irq_affinity_desc af_desc = {};struct mlx5_irq *irq; +if (!mlx5_irq_pool_is_sf_pool (pool)) +return ERR_PTR (-ENOENT ); + af_desc.is_managed =1 ;cpumask_copy (&af_desc.mask, cpu_online_mask);cpumask_andnot (&af_desc.mask, &af_desc.mask, used_cpus); -if (mlx5_irq_pool_is_sf_pool (pool)) - irq =mlx5_irq_affinity_request (pool, &af_desc); -else -/* In case SF pool doesn't exists, fallback to the PF IRQs. -* The PF IRQs are already allocated and binded to CPU -* at this point. Hence, only an index is needed. -*/ - irq =mlx5_irq_request (dev, vecidx,NULL ,NULL ); + irq =mlx5_irq_affinity_request (pool, &af_desc);if (IS_ERR (irq))return irq;
Signature · 1 line
2.41.0
PATCH 11/15 net/mlx5: Allocate completion EQs dynamically
In reply to Saeed MahameedFrom: Maher Sanalla <[email protected]>
This commit enables the dynamic allocation of EQs at runtime, allowing for more flexibility in managing completion EQs and reducing the memory overhead of driver load. Whenever a CQ is created for a given vector index, the driver will lookup to see if there is an already mapped completion EQ for that vector, if so, utilize it. Otherwise, allocate a new EQ on demand and then utilize it for the CQ completion events.
Add a protection lock to the EQ table to protect from concurrent EQ creation attempts.
While at it, replace mlx5_vector2irqn()/mlx5_vector2eqn() with mlx5_comp_eqn_get() and mlx5_comp_irqn_get() which will allocate an EQ on demand if no EQ is found for the given vector.
--- drivers/infiniband/hw/mlx5/cq.c | 2 +- drivers/infiniband/hw/mlx5/devx.c | 2 +- .../net/ethernet/mellanox/mlx5/core/en_main.c | 4 +- drivers/net/ethernet/mellanox/mlx5/core/eq.c | 80 ++++++++++--------- .../ethernet/mellanox/mlx5/core/fpga/conn.c | 2 +- .../net/ethernet/mellanox/mlx5/core/lib/aso.c | 2 +- .../net/ethernet/mellanox/mlx5/core/lib/eq.h | 2 +- .../mellanox/mlx5/core/steering/dr_send.c | 2 +- drivers/vdpa/mlx5/net/mlx5_vnet.c | 2 +- drivers/vfio/pci/mlx5/cmd.c | 2 +- include/linux/mlx5/driver.h | 2 +- 11 files changed, 54 insertions(+), 48 deletions(-)
drivers/infiniband/hw/mlx5/cq.c +1 -1
@@ -993,7 +993,7 @@ int mlx5_ib_create_cq(struct ib_cq *ibcq, const struct ib_cq_init_attr *attr,INIT_WORK (&cq->notify_work, notify_soft_wc_handler); } - err =mlx5_vector2eqn (dev->mdev, vector, &eqn); + err =mlx5_comp_eqn_get (dev->mdev, vector, &eqn);if (err) goto err_cqb;
drivers/infiniband/hw/mlx5/devx.c +1 -1
@@ -1002,7 +1002,7 @@ static int UVERBS_HANDLER(MLX5_IB_METHOD_DEVX_QUERY_EQN)(return PTR_ERR (c); dev =to_mdev (c->ibucontext.device); - err =mlx5_vector2eqn (dev->mdev, user_vector, &dev_eqn); + err =mlx5_comp_eqn_get (dev->mdev, user_vector, &dev_eqn);if (err <0 )return err;
drivers/net/ethernet/mellanox/mlx5/core/en_main.c +2 -2
@@ -1989,7 +1989,7 @@ static int mlx5e_create_cq(struct mlx5e_cq *cq, struct mlx5e_cq_param *param)int eqn;int err; - err =mlx5_vector2eqn (mdev, param->eq_ix, &eqn); + err =mlx5_comp_eqn_get (mdev, param->eq_ix, &eqn);if (err)return err;
@@ -2452,7 +2452,7 @@ static int mlx5e_open_channel(struct mlx5e_priv *priv, int ix,unsigned int irq;int err; - err =mlx5_vector2irqn (priv->mdev, ix, &irq); + err =mlx5_comp_irqn_get (priv->mdev, ix, &irq);if (err)return err;
drivers/net/ethernet/mellanox/mlx5/core/eq.c +43 -37
155 lines not on this page · raw message
drivers/net/ethernet/mellanox/mlx5/core/fpga/conn.c +1 -1
@@ -445,7 +445,7 @@ static int mlx5_fpga_conn_create_cq(struct mlx5_fpga_conn *conn, int cq_size) goto err_cqwq; } - err =mlx5_vector2eqn (mdev,smp_processor_id (), &eqn); + err =mlx5_comp_eqn_get (mdev,smp_processor_id (), &eqn);if (err) {kvfree (in); goto err_cqwq;
drivers/net/ethernet/mellanox/mlx5/core/lib/aso.c +1 -1
@@ -81,7 +81,7 @@ static int create_aso_cq(struct mlx5_aso_cq *cq, void *cqc_data)int inlen, eqn;int err; - err =mlx5_vector2eqn (mdev,0 , &eqn); + err =mlx5_comp_eqn_get (mdev,0 , &eqn);if (err)return err;
drivers/net/ethernet/mellanox/mlx5/core/lib/eq.h +1 -1
@@ -104,6 +104,6 @@ void mlx5_core_eq_free_irqs(struct mlx5_core_dev *dev);struct cpu_rmap *mlx5_eq_table_get_rmap (struct mlx5_core_dev *dev);#endif -int mlx5_vector2irqn (struct mlx5_core_dev *dev,int vector,unsigned int *irqn); +int mlx5_comp_irqn_get (struct mlx5_core_dev *dev,int vector,unsigned int *irqn);#endif
drivers/net/ethernet/mellanox/mlx5/core/steering/dr_send.c +1 -1
@@ -1097,7 +1097,7 @@ static struct mlx5dr_cq *dr_create_cq(struct mlx5_core_dev *mdev, goto err_cqwq; vector =raw_smp_processor_id () %mlx5_comp_vectors_max (mdev); - err =mlx5_vector2eqn (mdev, vector, &eqn); + err =mlx5_comp_eqn_get (mdev, vector, &eqn);if (err) {kvfree (in); goto err_cqwq;
drivers/vdpa/mlx5/net/mlx5_vnet.c +1 -1
@@ -580,7 +580,7 @@ static int cq_create(struct mlx5_vdpa_net *ndev, u16 idx, u32 num_ent)/* Use vector 0 by default. Consider adding code to choose least used * vector. */ - err =mlx5_vector2eqn (mdev,0 , &eqn); + err =mlx5_comp_eqn_get (mdev,0 , &eqn);if (err) goto err_vec;
drivers/vfio/pci/mlx5/cmd.c +1 -1
@@ -1026,7 +1026,7 @@ static int mlx5vf_create_cq(struct mlx5_core_dev *mdev, } vector =raw_smp_processor_id () %mlx5_comp_vectors_max (mdev); - err =mlx5_vector2eqn (mdev, vector, &eqn); + err =mlx5_comp_eqn_get (mdev, vector, &eqn);if (err) goto err_vec;
include/linux/mlx5/driver.h +1 -1
@@ -1058,7 +1058,7 @@ void mlx5_unregister_debugfs(void);void mlx5_fill_page_frag_array_perm (struct mlx5_frag_buf *buf,__be64 *pas,u8 perm);void mlx5_fill_page_frag_array (struct mlx5_frag_buf *frag_buf,__be64 *pas); -int mlx5_vector2eqn (struct mlx5_core_dev *dev,int vector,int *eqn); +int mlx5_comp_eqn_get (struct mlx5_core_dev *dev,u16 vecidx,int *eqn);int mlx5_core_attach_mcg (struct mlx5_core_dev *dev,union ib_gid *mgid,u32 qpn);int mlx5_core_detach_mcg (struct mlx5_core_dev *dev,union ib_gid *mgid,u32 qpn);
Signature · 1 line
2.41.0
PATCH 12/15 net/mlx5: remove many unnecessary NULL values
In reply to Saeed MahameedFrom: Ruan Jinjie <[email protected]>
There are many pointers assigned first, which need not to be initialized, so remove the NULL assignments.
--- drivers/net/ethernet/mellanox/mlx5/core/fpga/core.c | 4 ++-- drivers/net/ethernet/mellanox/mlx5/core/lib/hv_vhca.c | 2 +- 2 files changed, 3 insertions(+), 3 deletions(-)
drivers/net/ethernet/mellanox/mlx5/core/fpga/core.c +2 -2
@@ -57,7 +57,7 @@ static const char * const mlx5_fpga_qp_error_strings[] = { };static struct mlx5_fpga_device *mlx5_fpga_device_alloc (void ) { -struct mlx5_fpga_device *fdev =NULL ; +struct mlx5_fpga_device *fdev; fdev =kzalloc (sizeof (*fdev),GFP_KERNEL );if (!fdev)
@@ -252,7 +252,7 @@ int mlx5_fpga_device_start(struct mlx5_core_dev *mdev)int mlx5_fpga_init (struct mlx5_core_dev *mdev) { -struct mlx5_fpga_device *fdev =NULL ; +struct mlx5_fpga_device *fdev;if (!MLX5_CAP_GEN (mdev, fpga)) {mlx5_core_dbg (mdev,"FPGA capability not present\n" );
drivers/net/ethernet/mellanox/mlx5/core/lib/hv_vhca.c +1 -1
@@ -40,7 +40,7 @@ struct mlx5_hv_vhca_agent {struct mlx5_hv_vhca *mlx5_hv_vhca_create (struct mlx5_core_dev *dev) { -struct mlx5_hv_vhca *hv_vhca =NULL ; +struct mlx5_hv_vhca *hv_vhca; hv_vhca =kzalloc (sizeof (*hv_vhca),GFP_KERNEL );if (!hv_vhca)
Signature · 1 line
2.41.0
PATCH 13/15 net/mlx5: Fix typo reminder -> remainder
In reply to Saeed MahameedFrom: Gal Pressman <[email protected]>
Fix a typo in esw_qos_devlink_rate_to_mbps(): reminder -> remainder.
--- drivers/net/ethernet/mellanox/mlx5/core/esw/qos.c | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-)
drivers/net/ethernet/mellanox/mlx5/core/esw/qos.c +3 -3
@@ -740,7 +740,7 @@ int mlx5_esw_qos_modify_vport_rate(struct mlx5_eswitch *esw, u16 vport_num, u32static int esw_qos_devlink_rate_to_mbps (struct mlx5_core_dev *mdev,const char *name,u64 *rate,struct netlink_ext_ack *extack) { -u32 link_speed_max, reminder; +u32 link_speed_max, remainder;u64 value;int err;
@@ -750,8 +750,8 @@ static int esw_qos_devlink_rate_to_mbps(struct mlx5_core_dev *mdev, const char *return err; } - value =div_u64_rem (*rate,MLX5_LINKSPEED_UNIT , &reminder); -if (reminder) { + value =div_u64_rem (*rate,MLX5_LINKSPEED_UNIT , &remainder); +if (remainder) {pr_err ("%s rate value %lluBps not in link speed units of 1Mbps.\n" , name, *rate);NL_SET_ERR_MSG_MOD (extack,"TX rate value not in link speed units of 1Mbps" );
Signature · 1 line
2.41.0
PATCH 14/15 net/mlx5: E-Switch, Remove redundant arg ignore_flow_lvl
In reply to Saeed MahameedFrom: Roi Dayan <[email protected]>
The arg is always passed as true and thus redundant.
--- drivers/net/ethernet/mellanox/mlx5/core/eswitch_offloads.c | 6 ++---- 1 file changed, 2 insertions(+), 4 deletions(-)
drivers/net/ethernet/mellanox/mlx5/core/eswitch_offloads.c +2 -4
@@ -375,7 +375,6 @@ esw_setup_indir_table(struct mlx5_flow_destination *dest,struct mlx5_flow_act *flow_act, struct mlx5_eswitch *esw, struct mlx5_flow_attr *attr, - bool ignore_flow_lvl, int *i) { struct mlx5_esw_flow_attr *esw_attr = attr->esw_attr;
@@ -385,8 +384,7 @@ esw_setup_indir_table(struct mlx5_flow_destination *dest,return -EOPNOTSUPP ;for (j = esw_attr->split_count; j < esw_attr->out_count; j++, (*i)++) { -if (ignore_flow_lvl) - flow_act->flags |=FLOW_ACT_IGNORE_FLOW_LEVEL ; + flow_act->flags |=FLOW_ACT_IGNORE_FLOW_LEVEL ; dest[*i].type =MLX5_FLOW_DESTINATION_TYPE_FLOW_TABLE ; dest[*i].ft = mlx5_esw_indir_table_get(esw, attr,
@@ -569,7 +567,7 @@ esw_setup_dests(struct mlx5_flow_destination *dest, err =esw_setup_mtu_dest (dest, &attr->meter_attr, *i); (*i)++; }else if (esw_is_indir_table (esw, attr)) { - err =esw_setup_indir_table (dest, flow_act, esw, attr, true, i); + err =esw_setup_indir_table (dest, flow_act, esw, attr, i); }else if (esw_is_chain_src_port_rewrite (esw, esw_attr)) { err =esw_setup_chain_src_port_rewrite (dest, flow_act, esw, chains, attr, i); }else {
Signature · 1 line
2.41.0
PATCH 15/15 net/mlx5: Bridge, Only handle registered netdev bridge events
In reply to Saeed MahameedFrom: Roi Dayan <[email protected]>
Don't handle bridge events for a netdev that doesn't belong to an eswitch that registered for bridge events.
--- drivers/net/ethernet/mellanox/mlx5/core/en/rep/bridge.c | 4 ++++ 1 file changed, 4 insertions(+)
drivers/net/ethernet/mellanox/mlx5/core/en/rep/bridge.c +4 -0
@@ -77,6 +77,10 @@ mlx5_esw_bridge_rep_vport_num_vhca_id_get(struct net_device *dev, struct mlx5_esreturn NULL ; priv =netdev_priv (dev); + +if (!priv->mdev->priv.eswitch->br_offloads) +return NULL ; + rpriv = priv->ppriv; *vport_num = rpriv->rep->vport; *esw_owner_vhca_id =MLX5_CAP_GEN (priv->mdev, vhca_id);
Signature · 1 line
2.41.0