Mellanox, mlx5 updates 2019-03-01
Subsystems (5)
Hi Dave,
This series adds multi path offloads support and 2 small updates to mlx5 driver.
For more information please see tag log below.
I am terribly sorry for the 2 extra patches, but mostly Roi's and Eran's patches are very small and due to the lack of time I couldn't split this to two submissions.
Please pull and let me know if there is any problem.
Thanks,
Saeed.
---
The following changes since commit be9cefe796f3abfbef02e66fbe3bff766b93b867:
selftests: rtnetlink: use internal netns switch for ip commands (2019-02-28 13:02:43 -0800)
are available in the Git repository at:
git://git.kernel.org/pub/scm/linux/kernel/git/saeed/linux.git tags/mlx5-updates-2019-03-01
for you to fetch changes up to 85327a9c415057259b337805d356705d0d0f4200:
net/mlx5: Update the list of the PCI supported devices (2019-03-01 12:04:18 -0800)
----------------------------------------------------------------
mlx5-updates-2019-03-01
This series adds multipath offload support and contains some small updates to mlx5 driver.
Multipath offload support from Roi Dayan:
We are going to track SW multipath route and related nexthops and reflect that as port affinity to the HW.
1) Some patches are preparation.
2) add the multipath mode and fib events handling.
3) add support to handle offload failure for net error, i.e. port down.
4) Small updates to match the behavior of multipath
Two small updates from Eran Ben Elisha,
5) Make a function static
6) Update PCIe supported devices list.
----------------------------------------------------------------
Eran Ben Elisha (2):
net/mlx5e: Declare mlx5e_tx_reporter_recover_from_ctx as static net/mlx5: Update the list of the PCI supported devices
Roi Dayan (15):
net/mlx5e: Cleanup attach encap function
net/mlx5e: Don't make internal use of errno to denote missing neigh net/mlx5: Use unsigned int bit instead of bool as a struct member net/mlx5: Expose lag operations in header file
net/mlx5: Use own workqueue for lag netdev events processing net/mlx5: Add multipath mode
net/mlx5e: Activate HW multipath and handle port affinity based on FIB events net/mlx5e: Don't inherit flow flags on peer flow creation net/mlx5e: Allow one failure when offloading tc encap rules under multipath net/mlx5: Emit port affinity event for multipath offloads net/mlx5e: Re-attempt to offload flows on multipath port affinity events net/mlx5e: Always query offloaded tc peer rule counter net/mlx5e: Use hint to resolve route when in HW multipath mode net/mlx5e: Update check for merged eswitch device
net/mlx5e: Set peer flow needed also for multipath
drivers/net/ethernet/mellanox/mlx5/core/Makefile | 2 +- .../ethernet/mellanox/mlx5/core/en/reporter_tx.c | 2 +- .../net/ethernet/mellanox/mlx5/core/en/tc_tun.c | 20 +- drivers/net/ethernet/mellanox/mlx5/core/en_rep.c | 40 ++- drivers/net/ethernet/mellanox/mlx5/core/en_rep.h | 3 + drivers/net/ethernet/mellanox/mlx5/core/en_tc.c | 155 +++++++--- drivers/net/ethernet/mellanox/mlx5/core/en_tc.h | 1 + drivers/net/ethernet/mellanox/mlx5/core/eswitch.c | 7 + drivers/net/ethernet/mellanox/mlx5/core/eswitch.h | 2 + drivers/net/ethernet/mellanox/mlx5/core/lag.c | 73 ++--- drivers/net/ethernet/mellanox/mlx5/core/lag.h | 65 +++++ drivers/net/ethernet/mellanox/mlx5/core/lag_mp.c | 315 +++++++++++++++++++++ drivers/net/ethernet/mellanox/mlx5/core/lag_mp.h | 26 ++ drivers/net/ethernet/mellanox/mlx5/core/main.c | 2 + include/linux/mlx5/driver.h | 2 + 15 files changed, 606 insertions(+), 109 deletions(-) create mode 100644 drivers/net/ethernet/mellanox/mlx5/core/lag.h create mode 100644 drivers/net/ethernet/mellanox/mlx5/core/lag_mp.c create mode 100644 drivers/net/ethernet/mellanox/mlx5/core/lag_mp.h
PATCH 1/17 net/mlx5e: Declare mlx5e_tx_reporter_recover_from_ctx as static
From: Eran Ben Elisha <[email protected]>
Function mlx5e_tx_reporter_recover_from_ctx is only used within mlx5e tx reporter, move it to be statically declared in en/reporter_tx.c.
--- drivers/net/ethernet/mellanox/mlx5/core/en/reporter_tx.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
drivers/net/ethernet/mellanox/mlx5/core/en/reporter_tx.c +1 -1
@@ -179,7 +179,7 @@ int mlx5e_tx_reporter_timeout(struct mlx5e_txqsq *sq)/* state lock cannot be grabbed within this function. * It can cause a dead lock or a read-after-free. */ -int mlx5e_tx_reporter_recover_from_ctx (struct mlx5e_tx_err_ctx *err_ctx) +static int mlx5e_tx_reporter_recover_from_ctx (struct mlx5e_tx_err_ctx *err_ctx) {return err_ctx->recover (err_ctx->sq); }
Signature · 1 line
2.20.1
PATCH 2/17 net/mlx5e: Cleanup attach encap function
In reply to Saeed MahameedFrom: Roi Dayan <[email protected]>
Remove the tunnel info argument which we can get from the other args. Also reorder the args to have input args first and output args later.
This patch doesn't change functionality.
--- .../net/ethernet/mellanox/mlx5/core/en_tc.c | 31 ++++++++++--------- 1 file changed, 17 insertions(+), 14 deletions(-)
drivers/net/ethernet/mellanox/mlx5/core/en_tc.c +17 -14
@@ -850,12 +850,11 @@ static void mlx5e_detach_encap(struct mlx5e_priv *priv, struct mlx5e_tc_flow *flow, int out_index);static int mlx5e_attach_encap (struct mlx5e_priv *priv, -struct ip_tunnel_info *tun_info, -struct net_device *mirred_dev, -struct net_device **encap_dev,struct mlx5e_tc_flow *flow, +struct net_device *mirred_dev, +int out_index,struct netlink_ext_ack *extack, -int out_index); +struct net_device **encap_dev);static struct mlx5_flow_handle * mlx5e_tc_offload_fdb_rules(struct mlx5_eswitch *esw,
@@ -970,10 +969,8 @@ mlx5e_tc_add_fdb_flow(struct mlx5e_priv *priv, mirred_ifindex = parse_attr->mirred_ifindex[out_index]; out_dev =__dev_get_by_index (dev_net (priv->netdev), mirred_ifindex); - err =mlx5e_attach_encap (priv, - &parse_attr->tun_info[out_index], - out_dev, &encap_dev, flow, - extack, out_index); + err =mlx5e_attach_encap (priv, flow, out_dev, out_index, + extack, &encap_dev);if (err && err != -EAGAIN ) goto err_attach_encap;if (err == -EAGAIN )
@@ -2342,22 +2339,28 @@ static bool is_merged_eswitch_dev(struct mlx5e_priv *priv,static int mlx5e_attach_encap (struct mlx5e_priv *priv, -struct ip_tunnel_info *tun_info, -struct net_device *mirred_dev, -struct net_device **encap_dev,struct mlx5e_tc_flow *flow, +struct net_device *mirred_dev, +int out_index,struct netlink_ext_ack *extack, -int out_index) +struct net_device **encap_dev) {struct mlx5_eswitch *esw = priv->mdev->priv.eswitch; -unsigned short family =ip_tunnel_info_af (tun_info);struct mlx5_esw_flow_attr *attr = flow->esw_attr; -struct ip_tunnel_key *key = &tun_info->key; +struct mlx5e_tc_flow_parse_attr *parse_attr; +struct ip_tunnel_info *tun_info; +struct ip_tunnel_key *key;struct mlx5e_encap_entry *e; +unsigned short family;uintptr_t hash_key;bool found = false;int err =0 ; + parse_attr = attr->parse_attr; + tun_info = &parse_attr->tun_info[out_index]; + family =ip_tunnel_info_af (tun_info); + key = &tun_info->key; + hash_key =hash_encap_info (key); hash_for_each_possible_rcu(esw->offloads.encap_tbl, e,
Signature · 1 line
2.20.1
PATCH 3/17 net/mlx5e: Don't make internal use of errno to denote missing neigh
In reply to Saeed MahameedFrom: Roi Dayan <[email protected]>
EAGAIN is treated as a specific case when we consider the attachment successful but wait for neigh event before offloading the flow. This can result in unwanted behavior when sub calls on the offloading path will return EAGAIN and we pass this error up.
Instead of attaching to a specific error code return a boolean value from the attach encap operation saying if the encap is valid or not.
--- .../ethernet/mellanox/mlx5/core/en/tc_tun.c | 8 ++++-- .../net/ethernet/mellanox/mlx5/core/en_tc.c | 28 +++++++++++-------- 2 files changed, 22 insertions(+), 14 deletions(-)
drivers/net/ethernet/mellanox/mlx5/core/en/tc_tun.c +6 -2
@@ -295,7 +295,9 @@ int mlx5e_tc_tun_create_header_ipv4(struct mlx5e_priv *priv,if (!(nud_state &NUD_VALID )) {neigh_event_send (n,NULL ); - err = -EAGAIN ; +/* the encap entry will be made valid on neigh update event +* and not used before that. +*/ goto out; }
@@ -408,7 +410,9 @@ int mlx5e_tc_tun_create_header_ipv6(struct mlx5e_priv *priv,if (!(nud_state &NUD_VALID )) {neigh_event_send (n,NULL ); - err = -EAGAIN ; +/* the encap entry will be made valid on neigh update event +* and not used before that. +*/ goto out; }
drivers/net/ethernet/mellanox/mlx5/core/en_tc.c +16 -12
@@ -854,7 +854,8 @@ static int mlx5e_attach_encap(struct mlx5e_priv *priv,struct net_device *mirred_dev, int out_index, struct netlink_ext_ack *extack, - struct net_device **encap_dev); + struct net_device **encap_dev, + bool *encap_valid);static struct mlx5_flow_handle * mlx5e_tc_offload_fdb_rules(struct mlx5_eswitch *esw,
@@ -940,7 +941,8 @@ mlx5e_tc_add_fdb_flow(struct mlx5e_priv *priv,struct mlx5_fc *counter =NULL ;struct mlx5e_rep_priv *rpriv;struct mlx5e_priv *out_priv; -int err =0 , encap_err =0 ; +bool encap_valid = true; +int err =0 ;int out_index;if (!mlx5_eswitch_prios_supported (esw) && attr->prio !=1 ) {
@@ -970,11 +972,10 @@ mlx5e_tc_add_fdb_flow(struct mlx5e_priv *priv, out_dev =__dev_get_by_index (dev_net (priv->netdev), mirred_ifindex); err =mlx5e_attach_encap (priv, flow, out_dev, out_index, - extack, &encap_dev); -if (err && err != -EAGAIN ) + extack, &encap_dev, &encap_valid); +if (err) goto err_attach_encap; -if (err == -EAGAIN ) - encap_err = err; + out_priv =netdev_priv (encap_dev); rpriv = out_priv->ppriv; attr->dests[out_index].rep = rpriv->rep;
@@ -1002,10 +1003,11 @@ mlx5e_tc_add_fdb_flow(struct mlx5e_priv *priv, attr->counter = counter; } -/* we get here if (1) there's no error or when -* (2) there's an encap action and we're on -EAGAIN (no valid neigh) +/* we get here if one of the following takes place: +* (1) there's no error +* (2) there's an encap action and we don't have valid neigh */ -if (encap_err == -EAGAIN ) { +if (!encap_valid) {/* continue with goto slow path rule instead */ struct mlx5_esw_flow_attr slow_attr;
@@ -2343,7 +2345,8 @@ static int mlx5e_attach_encap(struct mlx5e_priv *priv,struct net_device *mirred_dev, int out_index, struct netlink_ext_ack *extack, - struct net_device **encap_dev) + struct net_device **encap_dev, + bool *encap_valid) { struct mlx5_eswitch *esw = priv->mdev->priv.eswitch;struct mlx5_esw_flow_attr *attr = flow->esw_attr;
@@ -2391,7 +2394,7 @@ static int mlx5e_attach_encap(struct mlx5e_priv *priv,else if (family ==AF_INET6 ) err =mlx5e_tc_tun_create_header_ipv6 (priv, mirred_dev, e); -if (err && err != -EAGAIN ) +if (err) goto out_err;hash_add_rcu (esw->offloads.encap_tbl, &e->encap_hlist, hash_key);
@@ -2403,8 +2406,9 @@ static int mlx5e_attach_encap(struct mlx5e_priv *priv,if (e->flags &MLX5_ENCAP_ENTRY_VALID ) { attr->dests[out_index].encap_id = e->encap_id; attr->dests[out_index].flags |=MLX5_ESW_DEST_ENCAP_VALID ; + *encap_valid = true; }else { - err = -EAGAIN ; + *encap_valid = false; }return err;
Signature · 1 line
2.20.1
PATCH 4/17 net/mlx5: Use unsigned int bit instead of bool as a struct member
In reply to Saeed MahameedFrom: Roi Dayan <[email protected]>
This fix checkpatch check
CHECK: Avoid using bool structure members because of possible alignment issues
--- drivers/net/ethernet/mellanox/mlx5/core/lag.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
drivers/net/ethernet/mellanox/mlx5/core/lag.c +1 -1
@@ -52,7 +52,7 @@ struct lag_func {struct lag_tracker {enum netdev_lag_tx_type tx_type;struct netdev_lag_lower_state_info netdev_state[MLX5_MAX_PORTS ]; -bool is_bonded; +unsigned int is_bonded:1 ; };/* LAG data of a ConnectX card.
Signature · 1 line
2.20.1
PATCH 5/17 net/mlx5: Expose lag operations in header file
In reply to Saeed MahameedFrom: Roi Dayan <[email protected]>
The change is a refactoring step towards a multipath use case.
--- drivers/net/ethernet/mellanox/mlx5/core/lag.c | 56 +++-------------- drivers/net/ethernet/mellanox/mlx5/core/lag.h | 60 +++++++++++++++++++ 2 files changed, 68 insertions(+), 48 deletions(-) create mode 100644 drivers/net/ethernet/mellanox/mlx5/core/lag.h
drivers/net/ethernet/mellanox/mlx5/core/lag.c +8 -48
@@ -35,37 +35,7 @@#include <linux/mlx5/vport.h> #include "mlx5_core.h" #include "eswitch.h" - -enum { -MLX5_LAG_FLAG_ROCE =1 <<0 , -MLX5_LAG_FLAG_SRIOV =1 <<1 , -}; - -#define MLX5_LAG_MODE_FLAGS (MLX5_LAG_FLAG_ROCE | MLX5_LAG_FLAG_SRIOV) - -struct lag_func { -struct mlx5_core_dev *dev; -struct net_device *netdev; -}; - -/* Used for collection of netdev event info. */ -struct lag_tracker { -enum netdev_lag_tx_type tx_type; -struct netdev_lag_lower_state_info netdev_state[MLX5_MAX_PORTS ]; -unsigned int is_bonded:1 ; -}; - -/* LAG data of a ConnectX card. -* It serves both its phys functions. -*/ -struct mlx5_lag { -u8 flags; -u8 v2p_map[MLX5_MAX_PORTS ]; -struct lag_func pf[MLX5_MAX_PORTS ]; -struct lag_tracker tracker; -struct delayed_work bond_work; -struct notifier_block nb; -}; +#include "lag.h" /* General purpose, use for short periods of time. * Beware of lock dependencies (preferably, no locks should be acquired
@@ -147,13 +117,8 @@ static int mlx5_cmd_query_cong_counter(struct mlx5_core_dev *dev,return mlx5_cmd_exec (dev, in,sizeof (in), out, out_size); } -static struct mlx5_lag *mlx5_lag_dev_get (struct mlx5_core_dev *dev) -{ -return dev->priv.lag; -} - -static int mlx5_lag_dev_get_netdev_idx (struct mlx5_lag *ldev, -struct net_device *ndev) +int mlx5_lag_dev_get_netdev_idx (struct mlx5_lag *ldev, +struct net_device *ndev) {int i;
@@ -174,11 +139,6 @@ static bool __mlx5_lag_is_sriov(struct mlx5_lag *ldev)return !!(ldev->flags &MLX5_LAG_FLAG_SRIOV ); } -static bool __mlx5_lag_is_active (struct mlx5_lag *ldev) -{ -return !!(ldev->flags &MLX5_LAG_MODE_FLAGS ); -} -static void mlx5_infer_tx_affinity_mapping (struct lag_tracker *tracker,u8 *port1,u8 *port2) {
@@ -195,8 +155,8 @@ static void mlx5_infer_tx_affinity_mapping(struct lag_tracker *tracker, *port2 =1 ; } -static void mlx5_modify_lag (struct mlx5_lag *ldev, -struct lag_tracker *tracker) +void mlx5_modify_lag (struct mlx5_lag *ldev, +struct lag_tracker *tracker) {struct mlx5_core_dev *dev0 = ldev->pf[0 ].dev;u8 v2p_port1, v2p_port2;
@@ -241,9 +201,9 @@ static int mlx5_create_lag(struct mlx5_lag *ldev,return err; } -static int mlx5_activate_lag (struct mlx5_lag *ldev, -struct lag_tracker *tracker, -u8 flags) +int mlx5_activate_lag (struct mlx5_lag *ldev, +struct lag_tracker *tracker, +u8 flags) {bool roce_lag = !!(flags &MLX5_LAG_FLAG_ROCE );struct mlx5_core_dev *dev0 = ldev->pf[0 ].dev;
drivers/net/ethernet/mellanox/mlx5/core/lag.h new file +60 -0
60 lines not on this page · raw message
Signature · 1 line
2.20.1
PATCH 6/17 net/mlx5: Use own workqueue for lag netdev events processing
In reply to Saeed MahameedFrom: Roi Dayan <[email protected]>
Instead of using the system workqueue, allocate our own workqueue. This workqueue will be used to handle more work in the next patch.
This patch doesn't change functionality.
--- drivers/net/ethernet/mellanox/mlx5/core/lag.c | 9 ++++++++- drivers/net/ethernet/mellanox/mlx5/core/lag.h | 1 + 2 files changed, 9 insertions(+), 1 deletion(-)
drivers/net/ethernet/mellanox/mlx5/core/lag.c +8 -1
@@ -346,7 +346,7 @@ static void mlx5_do_bond(struct mlx5_lag *ldev)static void mlx5_queue_bond_work (struct mlx5_lag *ldev,unsigned long delay) { -schedule_delayed_work (&ldev->bond_work, delay); +queue_delayed_work (ldev->wq, &ldev->bond_work, delay); }static void mlx5_do_bond_work (struct work_struct *work)
@@ -498,6 +498,12 @@ static struct mlx5_lag *mlx5_lag_dev_alloc(void)if (!ldev)return NULL ; + ldev->wq =create_singlethread_workqueue ("mlx5_lag" ); +if (!ldev->wq) { +kfree (ldev); +return NULL ; + } +INIT_DELAYED_WORK (&ldev->bond_work, mlx5_do_bond_work);return ldev;
@@ -505,6 +511,7 @@ static struct mlx5_lag *mlx5_lag_dev_alloc(void)static void mlx5_lag_dev_free (struct mlx5_lag *ldev) { +destroy_workqueue (ldev->wq);kfree (ldev); }
drivers/net/ethernet/mellanox/mlx5/core/lag.h +1 -0
@@ -33,6 +33,7 @@ struct mlx5_lag {u8 v2p_map[MLX5_MAX_PORTS ];struct lag_func pf[MLX5_MAX_PORTS ];struct lag_tracker tracker; +struct workqueue_struct *wq;struct delayed_work bond_work;struct notifier_block nb; };
Signature · 1 line
2.20.1
PATCH 7/17 net/mlx5: Add multipath mode
In reply to Saeed MahameedFrom: Roi Dayan <[email protected]>
In order to offload ecmp-on-host scheme where next-hop routes are used, we will make use of HW LAG. Add accessor function to let upper layers in the driver to realize if the lag acts in multi-path mode.
--- .../net/ethernet/mellanox/mlx5/core/Makefile | 2 +- drivers/net/ethernet/mellanox/mlx5/core/lag.h | 4 +++- .../net/ethernet/mellanox/mlx5/core/lag_mp.c | 23 +++++++++++++++++++ include/linux/mlx5/driver.h | 1 + 4 files changed, 28 insertions(+), 2 deletions(-) create mode 100644 drivers/net/ethernet/mellanox/mlx5/core/lag_mp.c
drivers/net/ethernet/mellanox/mlx5/core/Makefile +1 -1
@@ -30,7 +30,7 @@ mlx5_core-$(CONFIG_MLX5_CORE_EN) += en_main.o en_common.o en_fs.o en_ethtool.o \ mlx5_core-$(CONFIG_MLX5_EN_ARFS) += en_arfs.o mlx5_core-$(CONFIG_MLX5_EN_RXNFC) += en_fs_ethtool.o mlx5_core-$(CONFIG_MLX5_CORE_EN_DCB) += en_dcbnl.o en/port_buffer.o -mlx5_core-$(CONFIG_MLX5_ESWITCH) += en_rep.o en_tc.o en/tc_tun.o lib/port_tun.o +mlx5_core-$(CONFIG_MLX5_ESWITCH) += en_rep.o en_tc.o en/tc_tun.o lib/port_tun.o lag_mp.o # # Core extra
drivers/net/ethernet/mellanox/mlx5/core/lag.h +3 -1
@@ -9,9 +9,11 @@enum {MLX5_LAG_FLAG_ROCE =1 <<0 ,MLX5_LAG_FLAG_SRIOV =1 <<1 , +MLX5_LAG_FLAG_MULTIPATH =1 <<2 , }; -#define MLX5_LAG_MODE_FLAGS (MLX5_LAG_FLAG_ROCE | MLX5_LAG_FLAG_SRIOV) +#define MLX5_LAG_MODE_FLAGS (MLX5_LAG_FLAG_ROCE | MLX5_LAG_FLAG_SRIOV |\ + MLX5_LAG_FLAG_MULTIPATH)struct lag_func {struct mlx5_core_dev *dev;
drivers/net/ethernet/mellanox/mlx5/core/lag_mp.c new file +23 -0
@@ -0,0 +1,23 @@ +// SPDX-License-Identifier: GPL-2.0 OR Linux-OpenIB +/* Copyright (c) 2019 Mellanox Technologies. */ + +#include <linux/netdevice.h> +#include "lag.h" +#include "mlx5_core.h" +#include "eswitch.h" + +static bool __mlx5_lag_is_multipath (struct mlx5_lag *ldev) +{ +return !!(ldev->flags &MLX5_LAG_FLAG_MULTIPATH ); +} + +bool mlx5_lag_is_multipath (struct mlx5_core_dev *dev) +{ +struct mlx5_lag *ldev; +bool res; + + ldev =mlx5_lag_dev_get (dev); + res = ldev &&__mlx5_lag_is_multipath (ldev); + +return res; +}
include/linux/mlx5/driver.h +1 -0
@@ -1041,6 +1041,7 @@ int mlx5_cmd_create_vport_lag(struct mlx5_core_dev *dev);int mlx5_cmd_destroy_vport_lag (struct mlx5_core_dev *dev);bool mlx5_lag_is_roce (struct mlx5_core_dev *dev);bool mlx5_lag_is_sriov (struct mlx5_core_dev *dev); +bool mlx5_lag_is_multipath (struct mlx5_core_dev *dev);bool mlx5_lag_is_active (struct mlx5_core_dev *dev);struct net_device *mlx5_lag_get_roce_netdev (struct mlx5_core_dev *dev); int mlx5_lag_query_cong_counters(struct mlx5_core_dev *dev,
Signature · 1 line
2.20.1
PATCH 8/17 net/mlx5e: Activate HW multipath and handle port affinity based on FIB events
In reply to Saeed MahameedFrom: Roi Dayan <[email protected]>
To support multipath offload we are going to track SW multipath route and related nexthops. To do that we register to FIB notifier and handle the route and next-hops events and reflect that as port affinity to HW.
When there is a new multipath route entry that all next-hops are the ports of an HCA we will activate LAG in HW.
Egress wise, we use HW LAG as the means to emulate multipath on current HW which doesn't support port selection based on xmit hash. In the presence of multiple VFs which use multiple SQs (send queues) this yields fairly good distribution.
HA wise, HW LAG buys us the ability for a given RQ (receive queue) to receive traffic from both ports and for SQs to migrate xmitting over the active port if their base port fails.
When the route entry is being updated to single path we will update the HW port affinity to use that port only.
If a next-hop becomes dead we update the HW port affinity to the living port.
When all next-hops are alive again we reset the affinity to default.
Due to FW/HW limitations, when a route is deleted we are not disabling the HW LAG since doing so will not allow us to enable it again while VFs are bounded. Typically this is just a temporary state when a routing daemon removes dead routes and later adds them back as needed.
This patch only handles events for AF_INET.
--- .../net/ethernet/mellanox/mlx5/core/eswitch.c | 7 + .../net/ethernet/mellanox/mlx5/core/eswitch.h | 2 + drivers/net/ethernet/mellanox/mlx5/core/lag.c | 8 + drivers/net/ethernet/mellanox/mlx5/core/lag.h | 2 + .../net/ethernet/mellanox/mlx5/core/lag_mp.c | 281 ++++++++++++++++++ .../net/ethernet/mellanox/mlx5/core/lag_mp.h | 26 ++ 6 files changed, 326 insertions(+) create mode 100644 drivers/net/ethernet/mellanox/mlx5/core/lag_mp.h
drivers/net/ethernet/mellanox/mlx5/core/eswitch.c +7 -0
@@ -2476,3 +2476,10 @@ bool mlx5_esw_lag_prereq(struct mlx5_core_dev *dev0, struct mlx5_core_dev *dev1)return false; } + +bool mlx5_esw_multipath_prereq (struct mlx5_core_dev *dev0, +struct mlx5_core_dev *dev1) +{ +return (dev0->priv.eswitch->mode ==SRIOV_OFFLOADS && + dev1->priv.eswitch->mode ==SRIOV_OFFLOADS ); +}
drivers/net/ethernet/mellanox/mlx5/core/eswitch.h +2 -0
@@ -371,6 +371,8 @@ static inline bool mlx5_eswitch_vlan_actions_supported(struct mlx5_core_dev *devbool mlx5_esw_lag_prereq (struct mlx5_core_dev *dev0,struct mlx5_core_dev *dev1); +bool mlx5_esw_multipath_prereq (struct mlx5_core_dev *dev0, +struct mlx5_core_dev *dev1);#define MLX5_DEBUG_ESWITCH_MASK BIT(3)
drivers/net/ethernet/mellanox/mlx5/core/lag.c +8 -0
@@ -36,6 +36,7 @@#include "mlx5_core.h" #include "eswitch.h" #include "lag.h" +#include "lag_mp.h" /* General purpose, use for short periods of time. * Beware of lock dependencies (preferably, no locks should be acquired
@@ -559,6 +560,7 @@ void mlx5_lag_add(struct mlx5_core_dev *dev, struct net_device *netdev) {struct mlx5_lag *ldev =NULL ;struct mlx5_core_dev *tmp_dev; +int err; if (!MLX5_CAP_GEN(dev, vport_group_manager) || !MLX5_CAP_GEN(dev, lag_master) ||
@@ -586,6 +588,11 @@ void mlx5_lag_add(struct mlx5_core_dev *dev, struct net_device *netdev)mlx5_core_err (dev,"Failed to register LAG netdev notifier\n" ); } } + + err =mlx5_lag_mp_init (ldev); +if (err) +mlx5_core_err (dev,"Failed to init multipath lag err=%d\n" , + err); }int mlx5_lag_get_pf_num (struct mlx5_core_dev *dev,int *pf_num)
@@ -631,6 +638,7 @@ void mlx5_lag_remove(struct mlx5_core_dev *dev)if (i ==MLX5_MAX_PORTS ) {if (ldev->nb.notifier_call)unregister_netdevice_notifier (&ldev->nb); +mlx5_lag_mp_cleanup (ldev);cancel_delayed_work_sync (&ldev->bond_work);mlx5_lag_dev_free (ldev); }
drivers/net/ethernet/mellanox/mlx5/core/lag.h +2 -0
@@ -5,6 +5,7 @@#define __MLX5_LAG_H__#include "mlx5_core.h" +#include "lag_mp.h" enum {MLX5_LAG_FLAG_ROCE =1 <<0 ,
@@ -38,6 +39,7 @@ struct mlx5_lag {struct workqueue_struct *wq;struct delayed_work bond_work;struct notifier_block nb; +struct lag_mp lag_mp; }; static inline struct mlx5_lag *
drivers/net/ethernet/mellanox/mlx5/core/lag_mp.c +281 -0
293 lines not on this page · raw message
drivers/net/ethernet/mellanox/mlx5/core/lag_mp.h new file +26 -0
@@ -0,0 +1,26 @@ +/* SPDX-License-Identifier: GPL-2.0 OR Linux-OpenIB */ +/* Copyright (c) 2019 Mellanox Technologies. */ + +#ifndef __MLX5_LAG_MP_H__ +#define __MLX5_LAG_MP_H__ + +#include "lag.h" +#include "mlx5_core.h" + +struct lag_mp { +struct notifier_block fib_nb; +struct fib_info *mfi;/* used in tracking fib events */ +}; + +#ifdef CONFIG_MLX5_ESWITCH + +int mlx5_lag_mp_init (struct mlx5_lag *ldev); +void mlx5_lag_mp_cleanup (struct mlx5_lag *ldev); + +#else /* CONFIG_MLX5_ESWITCH */ + +static inline int mlx5_lag_mp_init (struct mlx5_lag *ldev) {return 0 ; } +static inline void mlx5_lag_mp_cleanup (struct mlx5_lag *ldev) {} + +#endif /* CONFIG_MLX5_ESWITCH */ +#endif /* __MLX5_LAG_MP_H__ */
Signature · 1 line
2.20.1
PATCH 9/17 net/mlx5e: Don't inherit flow flags on peer flow creation
In reply to Saeed MahameedFrom: Roi Dayan <[email protected]>
Currently the peer flow inherits the flags from the original flow after we've set it. At this time the flags are set according to the flow state, e.g marked as going to slow path and such.
Even if not getting us to real bugs now, this opens the door to get us to troubles later. Future proof the code and avoid the inheritance, use the peer flags as were set on input when we started adding the original flow.
--- drivers/net/ethernet/mellanox/mlx5/core/en_tc.c | 7 ++++--- 1 file changed, 4 insertions(+), 3 deletions(-)
drivers/net/ethernet/mellanox/mlx5/core/en_tc.c +4 -3
@@ -2813,7 +2813,8 @@ __mlx5e_add_fdb_flow(struct mlx5e_priv *priv, }static int mlx5e_tc_add_fdb_peer_flow (struct tc_cls_flower_offload *f, -struct mlx5e_tc_flow *flow) +struct mlx5e_tc_flow *flow, +u16 flow_flags) {struct mlx5e_priv *priv = flow->priv, *peer_priv;struct mlx5_eswitch *esw = priv->mdev->priv.eswitch, *peer_esw;
@@ -2842,7 +2843,7 @@ static int mlx5e_tc_add_fdb_peer_flow(struct tc_cls_flower_offload *f, in_mdev = priv->mdev; parse_attr = flow->esw_attr->parse_attr; - peer_flow =__mlx5e_add_fdb_flow (peer_priv, f, flow->flags, + peer_flow =__mlx5e_add_fdb_flow (peer_priv, f, flow_flags, parse_attr->filter_dev, flow->esw_attr->in_rep, in_mdev);if (IS_ERR (peer_flow)) {
@@ -2880,7 +2881,7 @@ mlx5e_add_fdb_flow(struct mlx5e_priv *priv,return PTR_ERR (flow);if (is_peer_flow_needed (flow)) { - err =mlx5e_tc_add_fdb_peer_flow (f, flow); + err =mlx5e_tc_add_fdb_peer_flow (f, flow, flow_flags);if (err) {mlx5e_tc_del_fdb_flow (priv, flow); goto out;
Signature · 1 line
2.20.1
PATCH 10/17 net/mlx5e: Allow one failure when offloading tc encap rules under multipath
In reply to Saeed MahameedFrom: Roi Dayan <[email protected]>
In a similar manner to uplink/VF LAG, under multipath we add encap peer rule on the second port as well.
However, unlike the LAG case, we do want to allow failure for adding one of the rules. This happens due to using a routing hint while doing the route lookup when one path (next hop device) is down.
Introduce a new flag to indicate that route lookup failed for encap flow. Note that a flow may still not be offloaded to hw due to missing neighbour, in that case, the neigh update event will take care of it.
--- drivers/net/ethernet/mellanox/mlx5/core/en_tc.c | 14 ++++++++++++-- 1 file changed, 12 insertions(+), 2 deletions(-)
drivers/net/ethernet/mellanox/mlx5/core/en_tc.c +12 -2
@@ -75,6 +75,7 @@ enum {MLX5E_TC_FLOW_HAIRPIN_RSS =BIT (MLX5E_TC_FLOW_BASE +2 ),MLX5E_TC_FLOW_SLOW =BIT (MLX5E_TC_FLOW_BASE +3 ),MLX5E_TC_FLOW_DUP =BIT (MLX5E_TC_FLOW_BASE +4 ), + MLX5E_TC_FLOW_NOT_READY = BIT(MLX5E_TC_FLOW_BASE + 5), };#define MLX5E_TC_MAX_SPLITS 1
@@ -1047,6 +1048,11 @@ static void mlx5e_tc_del_fdb_flow(struct mlx5e_priv *priv,struct mlx5_esw_flow_attr slow_attr;int out_index; +if (flow->flags &MLX5E_TC_FLOW_NOT_READY ) { +kvfree (attr->parse_attr); +return ; + } +if (flow->flags &MLX5E_TC_FLOW_OFFLOADED ) {if (flow->flags &MLX5E_TC_FLOW_SLOW )mlx5e_tc_unoffload_from_slow_path (esw, flow, &slow_attr);
@@ -2800,8 +2806,12 @@ __mlx5e_add_fdb_flow(struct mlx5e_priv *priv, goto err_free; err =mlx5e_tc_add_fdb_flow (priv, flow, extack); -if (err) - goto err_free; +if (err) { +if (!(err == -ENETUNREACH &&mlx5_lag_is_multipath (in_mdev))) + goto err_free; + + flow->flags |=MLX5E_TC_FLOW_NOT_READY ; + }return flow;
Signature · 1 line
2.20.1
PATCH 11/17 net/mlx5: Emit port affinity event for multipath offloads
In reply to Saeed MahameedFrom: Roi Dayan <[email protected]>
Under multipath offload scheme, as part of handling fib events, emit mlx5 port affinity event on the enabled ports which will be handled by the tc offloads code.
--- drivers/net/ethernet/mellanox/mlx5/core/lag_mp.c | 11 +++++++++++ include/linux/mlx5/driver.h | 1 + 2 files changed, 12 insertions(+)
drivers/net/ethernet/mellanox/mlx5/core/lag_mp.c +11 -0
@@ -6,6 +6,7 @@#include "lag_mp.h" #include "mlx5_core.h" #include "eswitch.h" +#include "lib/mlx5.h" static bool mlx5_lag_multipath_check_prereq (struct mlx5_lag *ldev) {
@@ -73,6 +74,16 @@ static void mlx5_lag_set_port_affinity(struct mlx5_lag *ldev, int port)return ; } +if (tracker.netdev_state[0 ].tx_enabled) +mlx5_notifier_call_chain (ldev->pf[0 ].dev->priv.events, +MLX5_DEV_EVENT_PORT_AFFINITY , + (void *)0 ); + +if (tracker.netdev_state[1 ].tx_enabled) +mlx5_notifier_call_chain (ldev->pf[1 ].dev->priv.events, +MLX5_DEV_EVENT_PORT_AFFINITY , + (void *)0 ); +mlx5_modify_lag (ldev, &tracker); }
include/linux/mlx5/driver.h +1 -0
@@ -195,6 +195,7 @@ struct mlx5_rsc_debug {enum mlx5_dev_event {MLX5_DEV_EVENT_SYS_ERROR =128 ,/* 0 - 127 are FW events */ +MLX5_DEV_EVENT_PORT_AFFINITY =129 , };enum mlx5_port_status {
Signature · 1 line
2.20.1
PATCH 12/17 net/mlx5e: Re-attempt to offload flows on multipath port affinity events
In reply to Saeed MahameedFrom: Roi Dayan <[email protected]>
Under multipath it's possible for us to offload the flow only through the e-switch for which proper route through the uplink exists. When the port is up and the next-hop route is set again we want to offload through it as well.
We generate SW event from the FIB event handler when multipath port affinity changes. The tc offloads code gets this event, goes over the flows which were marked as of having missing route and attempts to offload them.
--- .../net/ethernet/mellanox/mlx5/core/en_rep.c | 40 ++++++++++++++----- .../net/ethernet/mellanox/mlx5/core/en_rep.h | 3 ++ .../net/ethernet/mellanox/mlx5/core/en_tc.c | 39 +++++++++++++++++- .../net/ethernet/mellanox/mlx5/core/en_tc.h | 1 + 4 files changed, 71 insertions(+), 12 deletions(-)
drivers/net/ethernet/mellanox/mlx5/core/en_rep.c +29 -11
@@ -1573,6 +1573,8 @@ static int mlx5e_init_rep_tx(struct mlx5e_priv *priv)if (rpriv->rep->vport ==MLX5_VPORT_UPLINK ) { uplink_priv = &rpriv->uplink_priv; +INIT_LIST_HEAD (&uplink_priv->unready_flows); +/* init shared tc flow table */ err =mlx5e_tc_esw_init (&uplink_priv->tc_ht);if (err)
@@ -1632,27 +1634,38 @@ static void mlx5e_vf_rep_enable(struct mlx5e_priv *priv)static int uplink_rep_async_event (struct notifier_block *nb,unsigned long event,void *data) { struct mlx5e_priv *priv = container_of(nb, struct mlx5e_priv, events_nb); -struct mlx5_eqe *eqe = data; -if (event !=MLX5_EVENT_TYPE_PORT_CHANGE ) -return NOTIFY_DONE ; +if (event ==MLX5_EVENT_TYPE_PORT_CHANGE ) { +struct mlx5_eqe *eqe = data; -switch (eqe->sub_type) { -case MLX5_PORT_CHANGE_SUBTYPE_DOWN : -case MLX5_PORT_CHANGE_SUBTYPE_ACTIVE : -queue_work (priv->wq, &priv->update_carrier_work); -break ; -default : -return NOTIFY_DONE ; +switch (eqe->sub_type) { +case MLX5_PORT_CHANGE_SUBTYPE_DOWN : +case MLX5_PORT_CHANGE_SUBTYPE_ACTIVE : +queue_work (priv->wq, &priv->update_carrier_work); +break ; +default : +return NOTIFY_DONE ; + } + +return NOTIFY_OK ; } -return NOTIFY_OK ; +if (event ==MLX5_DEV_EVENT_PORT_AFFINITY ) { +struct mlx5e_rep_priv *rpriv = priv->ppriv; + +queue_work (priv->wq, &rpriv->uplink_priv.reoffload_flows_work); + +return NOTIFY_OK ; + } + +return NOTIFY_DONE ; }static void mlx5e_uplink_rep_enable (struct mlx5e_priv *priv) {struct net_device *netdev = priv->netdev;struct mlx5_core_dev *mdev = priv->mdev; +struct mlx5e_rep_priv *rpriv = priv->ppriv;u16 max_mtu; netdev->min_mtu =ETH_MIN_MTU ;
@@ -1660,6 +1673,9 @@ static void mlx5e_uplink_rep_enable(struct mlx5e_priv *priv) netdev->max_mtu =MLX5E_HW2SW_MTU (&priv->channels.params, max_mtu);mlx5e_set_dev_port_mtu (priv); +INIT_WORK (&rpriv->uplink_priv.reoffload_flows_work, + mlx5e_tc_reoffload_flows_work); +mlx5_lag_add (mdev, netdev); priv->events_nb.notifier_call = uplink_rep_async_event;mlx5_notifier_register (mdev, &priv->events_nb);
@@ -1672,11 +1688,13 @@ static void mlx5e_uplink_rep_enable(struct mlx5e_priv *priv)static void mlx5e_uplink_rep_disable (struct mlx5e_priv *priv) {struct mlx5_core_dev *mdev = priv->mdev; +struct mlx5e_rep_priv *rpriv = priv->ppriv;#ifdef CONFIG_MLX5_CORE_EN_DCB mlx5e_dcbnl_delete_app (priv);#endif mlx5_notifier_unregister (mdev, &priv->events_nb); +cancel_work_sync (&rpriv->uplink_priv.reoffload_flows_work);mlx5_lag_remove (mdev); }
drivers/net/ethernet/mellanox/mlx5/core/en_rep.h +3 -0
@@ -74,6 +74,9 @@ struct mlx5_rep_uplink_priv {struct notifier_block netdevice_nb;struct mlx5_tun_entropy tun_entropy; + +struct list_head unready_flows; +struct work_struct reoffload_flows_work; };struct mlx5e_rep_priv {
drivers/net/ethernet/mellanox/mlx5/core/en_tc.c +38 -1
@@ -117,6 +117,7 @@ struct mlx5e_tc_flow {struct list_head mod_hdr;/* flows sharing the same mod hdr ID */ struct list_head hairpin;/* flows sharing the same hairpin */ struct list_head peer;/* flows with peer flow */ +struct list_head unready;/* flows not ready to be offloaded (e.g due to missing route) */ union {struct mlx5_esw_flow_attr esw_attr[0 ];struct mlx5_nic_flow_attr nic_attr[0 ];
@@ -928,6 +929,26 @@ mlx5e_tc_unoffload_from_slow_path(struct mlx5_eswitch *esw, flow->flags &= ~MLX5E_TC_FLOW_SLOW ; } +static void add_unready_flow (struct mlx5e_tc_flow *flow) +{ +struct mlx5_rep_uplink_priv *uplink_priv; +struct mlx5e_rep_priv *rpriv; +struct mlx5_eswitch *esw; + + esw = flow->priv->mdev->priv.eswitch; + rpriv =mlx5_eswitch_get_uplink_priv (esw,REP_ETH ); + uplink_priv = &rpriv->uplink_priv; + + flow->flags |=MLX5E_TC_FLOW_NOT_READY ; +list_add_tail (&flow->unready, &uplink_priv->unready_flows); +} + +static void remove_unready_flow (struct mlx5e_tc_flow *flow) +{ +list_del (&flow->unready); + flow->flags &= ~MLX5E_TC_FLOW_NOT_READY ; +} + static int mlx5e_tc_add_fdb_flow(struct mlx5e_priv *priv, struct mlx5e_tc_flow *flow,
@@ -1049,6 +1070,7 @@ static void mlx5e_tc_del_fdb_flow(struct mlx5e_priv *priv,int out_index;if (flow->flags &MLX5E_TC_FLOW_NOT_READY ) { +remove_unready_flow (flow);kvfree (attr->parse_attr);return ; }
@@ -2810,7 +2832,7 @@ __mlx5e_add_fdb_flow(struct mlx5e_priv *priv,if (!(err == -ENETUNREACH &&mlx5_lag_is_multipath (in_mdev))) goto err_free; - flow->flags |=MLX5E_TC_FLOW_NOT_READY ; +add_unready_flow (flow); }return flow;
@@ -3214,3 +3236,18 @@ void mlx5e_tc_clean_fdb_peer_flows(struct mlx5_eswitch *esw)list_for_each_entry_safe (flow, tmp, &esw->offloads.peer_flows, peer)__mlx5e_tc_del_fdb_peer_flow (flow); } + +void mlx5e_tc_reoffload_flows_work (struct work_struct *work) +{ +struct mlx5_rep_uplink_priv *rpriv = + container_of(work, struct mlx5_rep_uplink_priv, + reoffload_flows_work); +struct mlx5e_tc_flow *flow, *tmp; + +rtnl_lock (); +list_for_each_entry_safe (flow, tmp, &rpriv->unready_flows, unready) { +if (!mlx5e_tc_add_fdb_flow (flow->priv, flow,NULL )) +remove_unready_flow (flow); + } +rtnl_unlock (); +}
drivers/net/ethernet/mellanox/mlx5/core/en_tc.h +1 -0
@@ -72,6 +72,7 @@ void mlx5e_tc_update_neigh_used_value(struct mlx5e_neigh_hash_entry *nhe);int mlx5e_tc_num_filters (struct mlx5e_priv *priv,int flags); +void mlx5e_tc_reoffload_flows_work (struct work_struct *work);#else /* CONFIG_MLX5_ESWITCH */ static inline int mlx5e_tc_nic_init (struct mlx5e_priv *priv) {return 0 ; }
Signature · 1 line
2.20.1
PATCH 13/17 net/mlx5e: Always query offloaded tc peer rule counter
In reply to Saeed MahameedFrom: Roi Dayan <[email protected]>
Under multipath when encap rules are duplicated to HW in the driver, it's possible for one flow to be currently un-offloaded (e.g. lack of next-hop route or neigh entry) while the other flow is offloaded. As such, we move to query the counters of both flows at all times.
--- .../net/ethernet/mellanox/mlx5/core/en_tc.c | 26 +++++++++++-------- 1 file changed, 15 insertions(+), 11 deletions(-)
drivers/net/ethernet/mellanox/mlx5/core/en_tc.c +15 -11
@@ -3078,23 +3078,25 @@ int mlx5e_stats_flower(struct net_device *dev, struct mlx5e_priv *priv,struct mlx5_eswitch *peer_esw;struct mlx5e_tc_flow *flow;struct mlx5_fc *counter; -u64 bytes; -u64 packets; -u64 lastuse; +u64 lastuse =0 ; +u64 packets =0 ; +u64 bytes =0 ; flow =rhashtable_lookup_fast (tc_ht, &f->cookie, tc_ht_params);if (!flow || !same_flow_direction (flow, flags))return -EINVAL ; -if (!(flow->flags &MLX5E_TC_FLOW_OFFLOADED )) -return 0 ; - - counter =mlx5e_tc_get_counter (flow); -if (!counter) -return 0 ; +if (flow->flags &MLX5E_TC_FLOW_OFFLOADED ) { + counter =mlx5e_tc_get_counter (flow); +if (!counter) +return 0 ; -mlx5_fc_query_cached (counter, &bytes, &packets, &lastuse); +mlx5_fc_query_cached (counter, &bytes, &packets, &lastuse); + } +/* Under multipath it's possible for one rule to be currently +* un-offloaded while the other rule is offloaded. +*/ peer_esw =mlx5_devcom_get_peer_data (devcom,MLX5_DEVCOM_ESW_OFFLOADS );if (!peer_esw) goto out;
@@ -3106,6 +3108,8 @@ int mlx5e_stats_flower(struct net_device *dev, struct mlx5e_priv *priv,u64 lastuse2; counter =mlx5e_tc_get_counter (flow->peer_flow); +if (!counter) + goto no_peer_counter;mlx5_fc_query_cached (counter, &bytes2, &packets2, &lastuse2); bytes += bytes2;
@@ -3113,8 +3117,8 @@ int mlx5e_stats_flower(struct net_device *dev, struct mlx5e_priv *priv, lastuse =max_t (u64, lastuse, lastuse2); } +no_peer_counter:mlx5_devcom_release_peer_data (devcom,MLX5_DEVCOM_ESW_OFFLOADS ); - out:flow_stats_update (&f->stats, bytes, packets, lastuse);
Signature · 1 line
2.20.1
PATCH 14/17 net/mlx5e: Use hint to resolve route when in HW multipath mode
In reply to Saeed MahameedFrom: Roi Dayan <[email protected]>
As part of creating the tunnel headers while offloading TC encap rules, we resolve the route and neighbour in order to get the source / destination mac.
Since the way we offload multipath route is by having two HW rules, one per uplink port, doing naive route lookup might get us a "wrong" routing path which goes through the peer uplink and this will get us eventually to create a wrong L2 header for the tunnel.
To avoid that, we use a device hint to get the correct route.
--- drivers/net/ethernet/mellanox/mlx5/core/en/tc_tun.c | 12 ++++++++++++ 1 file changed, 12 insertions(+)
drivers/net/ethernet/mellanox/mlx5/core/en/tc_tun.c +12 -0
@@ -54,12 +54,24 @@ static int mlx5e_route_lookup_ipv4(struct mlx5e_priv *priv,struct neighbour *n =NULL ;#if IS_ENABLED (CONFIG_INET ) +struct mlx5_core_dev *mdev = priv->mdev; +struct net_device *uplink_dev;int ret; +if (mlx5_lag_is_multipath (mdev)) { +struct mlx5_eswitch *esw = mdev->priv.eswitch; + + uplink_dev =mlx5_eswitch_uplink_get_proto_dev (esw,REP_ETH ); + fl4->flowi4_oif = uplink_dev->ifindex; + } + rt =ip_route_output_key (dev_net (mirred_dev), fl4); ret =PTR_ERR_OR_ZERO (rt);if (ret)return ret; + +if (mlx5_lag_is_multipath (mdev) && !rt->rt_gateway) +return -ENETUNREACH ;#else return -EOPNOTSUPP ;#endif
Signature · 1 line
2.20.1
PATCH 15/17 net/mlx5e: Update check for merged eswitch device
In reply to Saeed MahameedFrom: Roi Dayan <[email protected]>
The current check only validates if both netdevs use the same ops which means both are vf reps or both uplink reps.
Unlike the case where the two uplinks are bonded (VF LAG), under multipath scheme the switchdev parent id is not unified between the uplink reps (and all the associated vf reps). However, we still want to duplicate in the driver encap flows, adjust the merged eswitch check for that matter.
--- drivers/net/ethernet/mellanox/mlx5/core/en_tc.c | 7 +++---- 1 file changed, 3 insertions(+), 4 deletions(-)
drivers/net/ethernet/mellanox/mlx5/core/en_tc.c +3 -4
@@ -2360,10 +2360,9 @@ static bool is_merged_eswitch_dev(struct mlx5e_priv *priv, peer_priv =netdev_priv (peer_netdev);return (MLX5_CAP_ESW (priv->mdev, merged_eswitch) && - (priv->netdev->netdev_ops == peer_netdev->netdev_ops) && -same_hw_devs (priv, peer_priv) && -MLX5_VPORT_MANAGER (peer_priv->mdev) && - (peer_priv->mdev->priv.eswitch->mode ==SRIOV_OFFLOADS )); +mlx5e_eswitch_rep (priv->netdev) && +mlx5e_eswitch_rep (peer_netdev) && +same_hw_devs (priv, peer_priv)); }
Signature · 1 line
2.20.1
PATCH 16/17 net/mlx5e: Set peer flow needed also for multipath
In reply to Saeed MahameedFrom: Roi Dayan <[email protected]>
Update the predicate that determines if to duplicate rules installed on vport reps to account also for the multipath case.
--- drivers/net/ethernet/mellanox/mlx5/core/en_tc.c | 11 +++++++++-- 1 file changed, 9 insertions(+), 2 deletions(-)
drivers/net/ethernet/mellanox/mlx5/core/en_tc.c +9 -2
@@ -2731,8 +2731,15 @@ static bool is_peer_flow_needed(struct mlx5e_tc_flow *flow)bool esw_paired =mlx5_devcom_is_paired (attr->in_mdev->priv.devcom,MLX5_DEVCOM_ESW_OFFLOADS ); -return esw_paired &&mlx5_lag_is_sriov (attr->in_mdev) && - (is_rep_ingress || act_is_encap); +if (!esw_paired) +return false; + +if ((mlx5_lag_is_sriov (attr->in_mdev) || +mlx5_lag_is_multipath (attr->in_mdev)) && + (is_rep_ingress || act_is_encap)) +return true; + +return false; } static int
Signature · 1 line
2.20.1
PATCH 17/17 net/mlx5: Update the list of the PCI supported devices
In reply to Saeed MahameedFrom: Eran Ben Elisha <[email protected]>
Add the upcoming ConnectX-6 Dx.
In addition, add "ConnectX Family mlx5Gen Virtual Function" device ID. Every new HCA VF will be identified with this device ID. Different VF models will be distinguished by their revision id.
--- drivers/net/ethernet/mellanox/mlx5/core/main.c | 2 ++ 1 file changed, 2 insertions(+)
drivers/net/ethernet/mellanox/mlx5/core/main.c +2 -0
@@ -1486,6 +1486,8 @@ static const struct pci_device_id mlx5_core_pci_table[] = { { PCI_VDEVICE(MELLANOX, 0x101a), MLX5_PCI_DEV_IS_VF}, /* ConnectX-5 Ex VF */ { PCI_VDEVICE(MELLANOX, 0x101b) }, /* ConnectX-6 */ { PCI_VDEVICE(MELLANOX, 0x101c), MLX5_PCI_DEV_IS_VF}, /* ConnectX-6 VF */ + { PCI_VDEVICE(MELLANOX, 0x101d) }, /* ConnectX-6 Dx */ + { PCI_VDEVICE(MELLANOX, 0x101e), MLX5_PCI_DEV_IS_VF}, /* ConnectX Family mlx5Gen Virtual Function */ { PCI_VDEVICE(MELLANOX, 0xa2d2) }, /* BlueField integrated ConnectX-5 network controller */ { PCI_VDEVICE(MELLANOX, 0xa2d3), MLX5_PCI_DEV_IS_VF}, /* BlueField integrated ConnectX-5 network controller VF */ { 0, }
Signature · 1 line
2.20.1
David Miller
maintainerFrom: Saeed Mahameed <[email protected]>
Date: Fri, 1 Mar 2019 12:08:31 -0800
Quoted 10 lines
This series adds multi path offloads support and 2 small updates to mlx5 driver.
For more information please see tag log below.
I am terribly sorry for the 2 extra patches, but mostly Roi's and Eran's patches are very small and due to the lack of time I couldn't split this to two submissions.
Please pull and let me know if there is any problem.
No worries, pulled, thanks Saeed.