mlx5 fixes 2023-08-07
From: Saeed Mahameed <[email protected]>
This series provides bug fixes to mlx5 driver. Please pull and let me know if there is any problem.
Thanks,
Saeed.
The following changes since commit 52417a95ff2d810dc31a68ae71102e741efea772:
ionic: Add missing err handling for queue reconfig (2023-08-06 16:44:03 +0100)
are available in the Git repository at:
git://git.kernel.org/pub/scm/linux/kernel/git/saeed/linux.git tags/mlx5-fixes-2023-08-07
for you to fetch changes up to 548ee049b19fb9a3d0a4335314d0d1217a521bc5:
net/mlx5e: Add capability check for vnic counters (2023-08-07 11:48:40 -0700)
----------------------------------------------------------------
mlx5-fixes-2023-08-07
----------------------------------------------------------------
Chris Mi (1):
net/mlx5e: Unoffload post act rule when handling FIB events
Daniel Jurgens (3):
net/mlx5: Return correct EC_VF function ID net/mlx5: Allow 0 for total host VFs net/mlx5: Fix devlink controller number for ECVF
Gal Pressman (1):
net/mlx5e: Take RTNL lock when needed before calling xdp_set_features()
Jianbo Liu (1):
net/mlx5e: TC, Fix internal port memory leak
Lama Kayal (1):
net/mlx5e: Add capability check for vnic counters
Moshe Shemesh (2):
net/mlx5: Skip clock update work when device is in error state net/mlx5: Reload auxiliary devices in pci error handlers
Shay Drory (1):
net/mlx5: LAG, Check correct bucket when modifying LAG
Yevgeny Kliteynik (1):
net/mlx5: DR, Fix wrong allocation of modify hdr pattern
.../mellanox/mlx5/core/diag/reporter_vnic.c | 116 ++++++++++++--------- .../ethernet/mellanox/mlx5/core/en/tc_tun_encap.c | 6 +- drivers/net/ethernet/mellanox/mlx5/core/en_main.c | 11 ++ drivers/net/ethernet/mellanox/mlx5/core/en_tc.c | 21 ++-- .../ethernet/mellanox/mlx5/core/esw/devlink_port.c | 2 +- .../net/ethernet/mellanox/mlx5/core/lag/port_sel.c | 2 +- .../net/ethernet/mellanox/mlx5/core/lib/clock.c | 5 + drivers/net/ethernet/mellanox/mlx5/core/main.c | 2 +- .../net/ethernet/mellanox/mlx5/core/mlx5_core.h | 2 +- drivers/net/ethernet/mellanox/mlx5/core/sriov.c | 3 +- .../ethernet/mellanox/mlx5/core/steering/dr_ptrn.c | 2 +- 11 files changed, 106 insertions(+), 66 deletions(-)
PATCH 1/11 net/mlx5e: Take RTNL lock when needed before calling xdp_set_features()
From: Gal Pressman <[email protected]>
Hold RTNL lock when calling xdp_set_features() with a registered netdev, as the call triggers the netdev notifiers. This could happen when switching from uplink rep to nic profile for example.
This resolves the following call trace:
RTNL: assertion failed at net/core/dev.c (1953)
WARNING: CPU: 6 PID: 112670 at net/core/dev.c:1953 call_netdevice_notifiers_info+0x7c/0x80 Modules linked in: sch_mqprio sch_mqprio_lib act_tunnel_key act_mirred act_skbedit cls_matchall nfnetlink_cttimeout act_gact cls_flower sch_ingress bonding ib_umad ip_gre rdma_ucm mlx5_vfio_pci ipip tunnel4 ip6_gre gre mlx5_ib vfio_pci vfio_pci_core vfio_iommu_type1 ib_uverbs vfio mlx5_core ib_ipoib geneve nf_tables ip6_tunnel tunnel6 iptable_raw openvswitch nsh rpcrdma ib_iser libiscsi scsi_transport_iscsi rdma_cm iw_cm ib_cm ib_core xt_conntrack xt_MASQUERADE nf_conntrack_netlink nfnetlink xt_addrtype iptable_nat nf_nat br_netfilter rpcsec_gss_krb5 auth_rpcgss oid_registry overlay zram zsmalloc fuse [last unloaded: ib_uverbs] CPU: 6 PID: 112670 Comm: devlink Not tainted 6.4.0-rc7_for_upstream_min_debug_2023_06_28_17_02 #1 Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.13.0-0-gf21b5a4aeb02-prebuilt.qemu.org 04/01/2014 RIP: 0010:call_netdevice_notifiers_info+0x7c/0x80 Code: 90 ff 80 3d 2d 6b f7 00 00 75 c5 ba a1 07 00 00 48 c7 c6 e4 ce 0b 82 48 c7 c7 c8 f4 04 82 c6 05 11 6b f7 00 01 e8 a4 7c 8e ff <0f> 0b eb a2 0f 1f 44 00 00 55 48 89 e5 41 54 48 83 e4 f0 48 83 ec RSP: 0018:ffff8882a21c3948 EFLAGS: 00010282 RAX: 0000000000000000 RBX: ffffffff82e6f880 RCX: 0000000000000027 RDX: ffff88885f99b5c8 RSI: 0000000000000001 RDI: ffff88885f99b5c0 RBP: 0000000000000028 R08: ffff88887ffabaa8 R09: 0000000000000003 R10: ffff88887fecbac0 R11: ffff88887ff7bac0 R12: ffff8882a21c3968 R13: ffff88811c018940 R14: 0000000000000000 R15: ffff8881274401a0 FS: 00007fe141c81800(0000) GS:ffff88885f980000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007f787c28b948 CR3: 000000014bcf3005 CR4: 0000000000370ea0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 Call Trace: <TASK> ? __warn+0x79/0x120 ? call_netdevice_notifiers_info+0x7c/0x80 ? report_bug+0x17c/0x190 ? handle_bug+0x3c/0x60 ? exc_invalid_op+0x14/0x70 ? asm_exc_invalid_op+0x16/0x20 ? call_netdevice_notifiers_info+0x7c/0x80 ? call_netdevice_notifiers_info+0x7c/0x80 call_netdevice_notifiers+0x2e/0x50 mlx5e_set_xdp_feature+0x21/0x50 [mlx5_core] mlx5e_nic_init+0xf1/0x1a0 [mlx5_core] mlx5e_netdev_init_profile+0x76/0x110 [mlx5_core] mlx5e_netdev_attach_profile+0x1f/0x90 [mlx5_core] mlx5e_netdev_change_profile+0x92/0x160 [mlx5_core] mlx5e_netdev_attach_nic_profile+0x1b/0x30 [mlx5_core] mlx5e_vport_rep_unload+0xaa/0xc0 [mlx5_core] __esw_offloads_unload_rep+0x52/0x60 [mlx5_core] mlx5_esw_offloads_rep_unload+0x52/0x70 [mlx5_core] esw_offloads_unload_rep+0x34/0x70 [mlx5_core] esw_offloads_disable+0x2b/0x90 [mlx5_core] mlx5_eswitch_disable_locked+0x1b9/0x210 [mlx5_core] mlx5_devlink_eswitch_mode_set+0xf5/0x630 [mlx5_core] ? devlink_get_from_attrs_lock+0x9e/0x110 devlink_nl_cmd_eswitch_set_doit+0x60/0xe0 genl_family_rcv_msg_doit.isra.0+0xc2/0x110 genl_rcv_msg+0x17d/0x2b0 ? devlink_get_from_attrs_lock+0x110/0x110 ? devlink_nl_cmd_eswitch_get_doit+0x290/0x290 ? devlink_pernet_pre_exit+0xf0/0xf0 ? genl_family_rcv_msg_doit.isra.0+0x110/0x110 netlink_rcv_skb+0x54/0x100 genl_rcv+0x24/0x40 netlink_unicast+0x1f6/0x2c0 netlink_sendmsg+0x232/0x4a0 sock_sendmsg+0x38/0x60 ? _copy_from_user+0x2a/0x60 __sys_sendto+0x110/0x160 ? __count_memcg_events+0x48/0x90 ? handle_mm_fault+0x161/0x260 ? do_user_addr_fault+0x278/0x6e0 __x64_sys_sendto+0x20/0x30 do_syscall_64+0x3d/0x90 entry_SYSCALL_64_after_hwframe+0x46/0xb0 RIP: 0033:0x7fe141b1340a Code: d8 64 89 02 48 c7 c0 ff ff ff ff eb b8 0f 1f 00 f3 0f 1e fa 41 89 ca 64 8b 04 25 18 00 00 00 85 c0 75 15 b8 2c 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 7e c3 0f 1f 44 00 00 41 54 48 83 ec 30 44 89 RSP: 002b:00007fff61d03de8 EFLAGS: 00000246 ORIG_RAX: 000000000000002c RAX: ffffffffffffffda RBX: 0000000000afab00 RCX: 00007fe141b1340a RDX: 0000000000000038 RSI: 0000000000afab00 RDI: 0000000000000003 RBP: 0000000000afa910 R08: 00007fe141d80200 R09: 000000000000000c R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000001 </TASK>
--- drivers/net/ethernet/mellanox/mlx5/core/en_main.c | 11 +++++++++++ 1 file changed, 11 insertions(+)
drivers/net/ethernet/mellanox/mlx5/core/en_main.c +11 -0
@@ -5266,6 +5266,7 @@ void mlx5e_destroy_q_counters(struct mlx5e_priv *priv)static int mlx5e_nic_init (struct mlx5_core_dev *mdev,struct net_device *netdev) { +const bool take_rtnl = netdev->reg_state ==NETREG_REGISTERED ;struct mlx5e_priv *priv =netdev_priv (netdev);struct mlx5e_flow_steering *fs;int err;
@@ -5294,9 +5295,19 @@ static int mlx5e_nic_init(struct mlx5_core_dev *mdev,mlx5_core_err (mdev,"TLS initialization failed, %d\n" , err);mlx5e_health_create_reporters (priv); + +/* If netdev is already registered (e.g. move from uplink to nic profile), +* RTNL lock must be held before triggering netdev notifiers. +*/ +if (take_rtnl) +rtnl_lock (); +/* update XDP supported features */ mlx5e_set_xdp_feature (netdev); +if (take_rtnl) +rtnl_unlock (); +return 0 ; }
Signature · 1 line
2.41.0
Re: [net 01/11] net/mlx5e: Take RTNL lock when needed before calling xdp_set_features()
This series was applied to netdev/net.git (main) by Saeed Mahameed <[email protected]>:
Hello:
This series was applied to netdev/net.git (main)
by Saeed Mahameed <[email protected]>:
Quoted 9 lines · On Mon, 7 Aug 2023 14:25:57 -0700 you wrote:
From: Gal Pressman <[email protected]>
Hold RTNL lock when calling
xdp_set_features()with a registered netdev, as the call triggers the netdev notifiers. This could happen when switching from uplink rep to nic profile for example.This resolves the following call trace:
[...]
Here is the summary with links:
- [net,01/11] net/mlx5e: Take RTNL lock when needed before calling xdp_set_features()
https://git.kernel.org/netdev/net/c/72cc65497065 - [net,02/11] net/mlx5e: TC, Fix internal port memory leak https://git.kernel.org/netdev/net/c/ac5da544a3c2 - [net,03/11] net/mlx5: DR, Fix wrong allocation of modify hdr pattern https://git.kernel.org/netdev/net/c/8bfe1e19fb96 - [net,04/11] net/mlx5: Return correct EC_VF function ID https://git.kernel.org/netdev/net/c/06c868fde61f - [net,05/11] net/mlx5: Allow 0 for total host VFs https://git.kernel.org/netdev/net/c/2dc2b3922d3c - [net,06/11] net/mlx5: Fix devlink controller number for ECVF https://git.kernel.org/netdev/net/c/2d691c90f45a - [net,07/11] net/mlx5e: Unoffload post act rule when handling FIB events https://git.kernel.org/netdev/net/c/6b5926eb1c03 - [net,08/11] net/mlx5: LAG, Check correct bucket when modifying LAG https://git.kernel.org/netdev/net/c/86ed7b773c01 - [net,09/11] net/mlx5: Skip clock update work when device is in error state https://git.kernel.org/netdev/net/c/d00620762565 - [net,10/11] net/mlx5: Reload auxiliary devices in pci error handlers https://git.kernel.org/netdev/net/c/aab8e1a200b9 - [net,11/11] net/mlx5e: Add capability check for vnic counters https://git.kernel.org/netdev/net/c/548ee049b19f
You are awesome, thank you!
Signature · 2 lines
Deet-doot-dot, I am a bot. https://korg.docs.kernel.org/patchwork/pwbot.html
PATCH 2/11 net/mlx5e: TC, Fix internal port memory leak
In reply to Saeed MahameedFrom: Jianbo Liu <[email protected]>
The flow rule can be splited, and the extra post_act rules are added to post_act table. It's possible to trigger memleak when the rule forwards packets from internal port and over tunnel, in the case that, for example, CT 'new' state offload is allowed. As int_port object is assigned to the flow attribute of post_act rule, and its refcnt is incremented by mlx5e_tc_int_port_get(), but mlx5e_tc_int_port_put() is not called, the refcnt is never decremented, then int_port is never freed.
The kmemleak reports the following error:
unreferenced object 0xffff888128204b80 (size 64):
comm "handler20", pid 50121, jiffies 4296973009 (age 642.932s) hex dump (first 32 bytes):
01 00 00 00 19 00 00 00 03 f0 00 00 04 00 00 00 ................
98 77 67 41 81 88 ff ff 98 77 67 41 81 88 ff ff .wgA.....wgA....
backtrace:
[<00000000e992680d>] kmalloc_trace+0x27/0x120
[<000000009e945a98>] mlx5e_tc_int_port_get+0x3f3/0xe20 [mlx5_core]
[<0000000035a537f0>] mlx5e_tc_add_fdb_flow+0x473/0xcf0 [mlx5_core]
[<0000000070c2cec6>] __mlx5e_add_fdb_flow+0x7cf/0xe90 [mlx5_core]
[<000000005cc84048>] mlx5e_configure_flower+0xd40/0x4c40 [mlx5_core]
[<000000004f8a2031>] mlx5e_rep_indr_offload.isra.0+0x10e/0x1c0 [mlx5_core]
[<000000007df797dc>] mlx5e_rep_indr_setup_tc_cb+0x90/0x130 [mlx5_core]
[<0000000016c15cc3>] tc_setup_cb_add+0x1cf/0x410
[<00000000a63305b4>] fl_hw_replace_filter+0x38f/0x670 [cls_flower]
[<000000008bc9e77c>] fl_change+0x1fd5/0x4430 [cls_flower]
[<00000000e7f766e4>] tc_new_tfilter+0x867/0x2010
[<00000000e101c0ef>] rtnetlink_rcv_msg+0x6fc/0x9f0
[<00000000e1111d44>] netlink_rcv_skb+0x12c/0x360
[<0000000082dd6c8b>] netlink_unicast+0x438/0x710
[<00000000fc568f70>] netlink_sendmsg+0x794/0xc50
[<0000000016e92590>] sock_sendmsg+0xc5/0x190So fix this by moving int_port cleanup code to the flow attribute free helper, which is used by all the attribute free cases.
--- .../net/ethernet/mellanox/mlx5/core/en_tc.c | 21 ++++++++++++------- 1 file changed, 13 insertions(+), 8 deletions(-)
drivers/net/ethernet/mellanox/mlx5/core/en_tc.c +13 -8
@@ -1943,9 +1943,7 @@ static void mlx5e_tc_del_fdb_flow(struct mlx5e_priv *priv, {struct mlx5_eswitch *esw = priv->mdev->priv.eswitch;struct mlx5_flow_attr *attr = flow->attr; -struct mlx5_esw_flow_attr *esw_attr; - esw_attr = attr->esw_attr;mlx5e_put_flow_tunnel_id (flow);remove_unready_flow (flow);
@@ -1966,12 +1964,6 @@ static void mlx5e_tc_del_fdb_flow(struct mlx5e_priv *priv,mlx5_tc_ct_match_del (get_ct_priv (priv), &flow->attr->ct_attr); -if (esw_attr->int_port) -mlx5e_tc_int_port_put (mlx5e_get_int_port_priv (priv), esw_attr->int_port); - -if (esw_attr->dest_int_port) -mlx5e_tc_int_port_put (mlx5e_get_int_port_priv (priv), esw_attr->dest_int_port); -if (flow_flag_test (flow,L3_TO_L2_DECAP ))mlx5e_detach_decap (priv, flow);
@@ -4268,6 +4260,7 @@ static void mlx5_free_flow_attr_actions(struct mlx5e_tc_flow *flow, struct mlx5_flow_attr *attr) { struct mlx5_core_dev *counter_dev = get_flow_counter_dev(flow); +struct mlx5_esw_flow_attr *esw_attr;if (!attr)return ;
@@ -4285,6 +4278,18 @@ mlx5_free_flow_attr_actions(struct mlx5e_tc_flow *flow, struct mlx5_flow_attr *amlx5e_tc_detach_mod_hdr (flow->priv, flow, attr); } +if (mlx5e_is_eswitch_flow (flow)) { + esw_attr = attr->esw_attr; + +if (esw_attr->int_port) +mlx5e_tc_int_port_put (mlx5e_get_int_port_priv (flow->priv), + esw_attr->int_port); + +if (esw_attr->dest_int_port) +mlx5e_tc_int_port_put (mlx5e_get_int_port_priv (flow->priv), + esw_attr->dest_int_port); + } +mlx5_tc_ct_delete_flow (get_ct_priv (flow->priv), attr);free_branch_attr (flow, attr->branch_true);
Signature · 1 line
2.41.0
PATCH 3/11 net/mlx5: DR, Fix wrong allocation of modify hdr pattern
In reply to Saeed MahameedFrom: Yevgeny Kliteynik <[email protected]>
Fixing wrong calculation of the modify hdr pattern size, where the previously calculated number would not be enough to accommodate the required number of actions.
--- drivers/net/ethernet/mellanox/mlx5/core/steering/dr_ptrn.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
drivers/net/ethernet/mellanox/mlx5/core/steering/dr_ptrn.c +1 -1
@@ -82,7 +82,7 @@ dr_ptrn_alloc_pattern(struct mlx5dr_ptrn_mgr *mgr,u32 chunk_size;u32 index; - chunk_size =ilog2 (num_of_actions); + chunk_size =ilog2 (roundup_pow_of_two (num_of_actions));/* HW modify action index granularity is at least 64B */ chunk_size =max_t (u32, chunk_size,DR_CHUNK_SIZE_8 );
Signature · 1 line
2.41.0
PATCH 4/11 net/mlx5: Return correct EC_VF function ID
In reply to Saeed MahameedFrom: Daniel Jurgens <[email protected]>
The ECVF function ID range is 1..max_ec_vfs. Currently mlx5_vport_to_func_id returns 0..max_ec_vfs - 1. Which results in a syndrome when querying the caps with more recent firmware, or reading incorrect caps with older firmware that supports EC VFs.
--- drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.h | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.h +1 -1
@@ -361,7 +361,7 @@ static inline bool mlx5_core_is_ec_vf_vport(const struct mlx5_core_dev *dev, u16static inline int mlx5_vport_to_func_id (const struct mlx5_core_dev *dev,u16 vport,bool ec_vf_func) { -return ec_vf_func ? vport -mlx5_core_ec_vf_vport_base (dev) +return ec_vf_func ? vport -mlx5_core_ec_vf_vport_base (dev) +1 : vport; }
Signature · 1 line
2.41.0
PATCH 5/11 net/mlx5: Allow 0 for total host VFs
In reply to Saeed MahameedFrom: Daniel Jurgens <[email protected]>
When querying eswitch functions 0 is a valid number of host VFs. After introducing ARM SRIOV falling through to getting the max value from PCI results in using the total VFs allowed on the ARM for the host.
--- drivers/net/ethernet/mellanox/mlx5/core/sriov.c | 3 +-- 1 file changed, 1 insertion(+), 2 deletions(-)
drivers/net/ethernet/mellanox/mlx5/core/sriov.c +1 -2
@@ -285,8 +285,7 @@ static u16 mlx5_get_max_vfs(struct mlx5_core_dev *dev) host_total_vfs =MLX5_GET (query_esw_functions_out, out, host_params_context.host_total_vfs);kvfree (out); -if (host_total_vfs) -return host_total_vfs; +return host_total_vfs; } done:
Signature · 1 line
2.41.0
PATCH 6/11 net/mlx5: Fix devlink controller number for ECVF
In reply to Saeed MahameedFrom: Daniel Jurgens <[email protected]>
The controller number for ECVFs is always 0, because the ECPF must be the eswitch owner for EC VFs to be enabled.
--- drivers/net/ethernet/mellanox/mlx5/core/esw/devlink_port.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
drivers/net/ethernet/mellanox/mlx5/core/esw/devlink_port.c +1 -1
@@ -60,7 +60,7 @@ static struct devlink_port *mlx5_esw_dl_port_alloc(struct mlx5_eswitch *esw, u16 }else if (mlx5_core_is_ec_vf_vport (esw->dev, vport_num)) {memcpy (dl_port->attrs.switch_id.id, ppid.id, ppid.id_len); dl_port->attrs.switch_id.id_len = ppid.id_len; -devlink_port_attrs_pci_vf_set (dl_port, controller_num, pfnum, +devlink_port_attrs_pci_vf_set (dl_port,0 , pfnum, vport_num -1 , false); }return dl_port;
Signature · 1 line
2.41.0
PATCH 7/11 net/mlx5e: Unoffload post act rule when handling FIB events
In reply to Saeed MahameedFrom: Chris Mi <[email protected]>
If having the following tc rule on stack device:
filter parent ffff: protocol ip pref 3 flower chain 1
filter parent ffff: protocol ip pref 3 flower chain 1 handle 0x1
dst_mac 24:25:d0:e1:00:00
src_mac 02:25:d0:25:01:02
eth_type ipv4
ct_state +trk+new
in_hw in_hw_count 1
action order 1: ct commit zone 0 pipe
index 2 ref 1 bind 1 installed 3807 sec used 3779 sec firstused 3800 sec
Action statistics:
Sent 120 bytes 2 pkt (dropped 0, overlimits 0 requeues 0) backlog 0b 0p requeues 0
used_hw_stats delayed
action order 2: tunnel_key set
src_ip 192.168.1.25
dst_ip 192.168.1.26
key_id 4
dst_port 4789
csum pipe
index 3 ref 1 bind 1 installed 3807 sec used 3779 sec firstused 3800 sec
Action statistics:
Sent 120 bytes 2 pkt (dropped 0, overlimits 0 requeues 0) backlog 0b 0p requeues 0
used_hw_stats delayed
action order 3: mirred (Egress Redirect to device vxlan1) stolen index 9 ref 1 bind 1 installed 3807 sec used 3779 sec firstused 3800 sec Action statistics:
Sent 120 bytes 2 pkt (dropped 0, overlimits 0 requeues 0) backlog 0b 0p requeues 0
used_hw_stats delayed
When handling FIB events, the rule in post act will not be deleted. And because the post act rule has packet reformat and modify header actions, also will hit the following syndromes:
mlx5_core 0000:08:00.0: mlx5_cmd_out_err:829:(pid 11613): DEALLOC_MODIFY_HEADER_CONTEXT(0x941) op_mod(0x0) failed, status bad resource state(0x9), syndrome (0x1ab444), err(-22) mlx5_core 0000:08:00.0: mlx5_cmd_out_err:829:(pid 11613): DEALLOC_PACKET_REFORMAT_CONTEXT(0x93e) op_mod(0x0) failed, status bad resource state(0x9), syndrome (0x179e84), err(-22)
Fix it by unoffloading post act rule when handling FIB events.
--- drivers/net/ethernet/mellanox/mlx5/core/en/tc_tun_encap.c | 6 ++++-- 1 file changed, 4 insertions(+), 2 deletions(-)
drivers/net/ethernet/mellanox/mlx5/core/en/tc_tun_encap.c +4 -2
@@ -1461,10 +1461,12 @@ static void mlx5e_invalidate_encap(struct mlx5e_priv *priv, attr =mlx5e_tc_get_encap_attr (flow); esw_attr = attr->esw_attr; -if (flow_flag_test (flow,SLOW )) +if (flow_flag_test (flow,SLOW )) {mlx5e_tc_unoffload_from_slow_path (esw, flow); -else + }else {mlx5e_tc_unoffload_fdb_rules (esw, flow, flow->attr); +mlx5e_tc_unoffload_flow_post_acts (flow); + }mlx5e_tc_detach_mod_hdr (priv, flow, attr); attr->modify_hdr =NULL ;
Signature · 1 line
2.41.0
PATCH 8/11 net/mlx5: LAG, Check correct bucket when modifying LAG
In reply to Saeed MahameedFrom: Shay Drory <[email protected]>
Cited patch introduced buckets in hash mode, but missed to update the ports/bucket check when modifying LAG.
Fix the check.
--- drivers/net/ethernet/mellanox/mlx5/core/lag/port_sel.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
drivers/net/ethernet/mellanox/mlx5/core/lag/port_sel.c +1 -1
@@ -574,7 +574,7 @@ static int __mlx5_lag_modify_definers_destinations(struct mlx5_lag *ldev,for (i =0 ; i < ldev->ports; i++) {for (j =0 ; j < ldev->buckets; j++) { idx = i * ldev->buckets + j; -if (ldev->v2p_map[i] == ports[i]) +if (ldev->v2p_map[idx] == ports[idx])continue ; dest.vport.vhca_id = MLX5_CAP_GEN(ldev->pf[ports[idx] - 1].dev,
Signature · 1 line
2.41.0
PATCH 9/11 net/mlx5: Skip clock update work when device is in error state
In reply to Saeed MahameedFrom: Moshe Shemesh <[email protected]>
When device is in error state, marked by the flag MLX5_DEVICE_STATE_INTERNAL_ERROR, the HW and PCI may not be accessible and so clock update work should be skipped. Furthermore, such access through PCI in error state, after calling mlx5_pci_disable_device() can result in failing to recover from pci errors.
--- drivers/net/ethernet/mellanox/mlx5/core/lib/clock.c | 5 +++++ 1 file changed, 5 insertions(+)
drivers/net/ethernet/mellanox/mlx5/core/lib/clock.c +5 -0
@@ -227,10 +227,15 @@ static void mlx5_timestamp_overflow(struct work_struct *work) clock = container_of(timer, struct mlx5_clock, timer); mdev = container_of(clock, struct mlx5_core_dev, clock); +if (mdev->state ==MLX5_DEVICE_STATE_INTERNAL_ERROR ) + goto out; +write_seqlock_irqsave (&clock->lock, flags);timecounter_read (&timer->tc);mlx5_update_clock_info_page (mdev);write_sequnlock_irqrestore (&clock->lock, flags); + +out:schedule_delayed_work (&timer->overflow_work, timer->overflow_period); }
Signature · 1 line
2.41.0
PATCH 10/11 net/mlx5: Reload auxiliary devices in pci error handlers
In reply to Saeed MahameedFrom: Moshe Shemesh <[email protected]>
Handling pci errors should fully teardown and load back auxiliary devices, same as done through mlx5 health recovery flow.
--- drivers/net/ethernet/mellanox/mlx5/core/main.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
drivers/net/ethernet/mellanox/mlx5/core/main.c +1 -1
@@ -1989,7 +1989,7 @@ static pci_ers_result_t mlx5_pci_err_detected(struct pci_dev *pdev,mlx5_enter_error_state (dev, false);mlx5_error_sw_reset (dev); -mlx5_unload_one (dev, true); +mlx5_unload_one (dev, false);mlx5_drain_health_wq (dev);mlx5_pci_disable_device (dev);
Signature · 1 line
2.41.0
PATCH 11/11 net/mlx5e: Add capability check for vnic counters
In reply to Saeed MahameedFrom: Lama Kayal <[email protected]>
Add missing capability check for each of the vnic counters exposed by devlink health reporter, and thus avoid unexpected behavior due to invalid access to registers.
While at it, read only the exact number of bits for each counter whether it was 32 bits or 64 bits.
--- .../mellanox/mlx5/core/diag/reporter_vnic.c | 116 ++++++++++-------- 1 file changed, 67 insertions(+), 49 deletions(-)
drivers/net/ethernet/mellanox/mlx5/core/diag/reporter_vnic.c +67 -49
@@ -2,6 +2,7 @@/* Copyright (c) 2023, NVIDIA CORPORATION & AFFILIATES. */ #include "reporter_vnic.h" +#include "en_stats.h" #include "devlink.h" #define VNIC_ENV_GET64 (vnic_env_stats, c) \
@@ -36,55 +37,72 @@ int mlx5_reporter_vnic_diagnose_counters(struct mlx5_core_dev *dev,if (err)return err; - err =devlink_fmsg_u64_pair_put (fmsg,"total_error_queues" , -VNIC_ENV_GET64 (&vnic, total_error_queues)); -if (err) -return err; - - err =devlink_fmsg_u64_pair_put (fmsg,"send_queue_priority_update_flow" , -VNIC_ENV_GET64 (&vnic, send_queue_priority_update_flow)); -if (err) -return err; - - err =devlink_fmsg_u64_pair_put (fmsg,"comp_eq_overrun" , -VNIC_ENV_GET64 (&vnic, comp_eq_overrun)); -if (err) -return err; - - err =devlink_fmsg_u64_pair_put (fmsg,"async_eq_overrun" , -VNIC_ENV_GET64 (&vnic, async_eq_overrun)); -if (err) -return err; - - err =devlink_fmsg_u64_pair_put (fmsg,"cq_overrun" , -VNIC_ENV_GET64 (&vnic, cq_overrun)); -if (err) -return err; - - err =devlink_fmsg_u64_pair_put (fmsg,"invalid_command" , -VNIC_ENV_GET64 (&vnic, invalid_command)); -if (err) -return err; - - err =devlink_fmsg_u64_pair_put (fmsg,"quota_exceeded_command" , -VNIC_ENV_GET64 (&vnic, quota_exceeded_command)); -if (err) -return err; - - err =devlink_fmsg_u64_pair_put (fmsg,"nic_receive_steering_discard" , -VNIC_ENV_GET64 (&vnic, nic_receive_steering_discard)); -if (err) -return err; - - err =devlink_fmsg_u64_pair_put (fmsg,"generated_pkt_steering_fail" , -VNIC_ENV_GET64 (&vnic, generated_pkt_steering_fail)); -if (err) -return err; - - err =devlink_fmsg_u64_pair_put (fmsg,"handled_pkt_steering_fail" , -VNIC_ENV_GET64 (&vnic, handled_pkt_steering_fail)); -if (err) -return err; +if (MLX5_CAP_GEN (dev, vnic_env_queue_counters)) { + err =devlink_fmsg_u32_pair_put (fmsg,"total_error_queues" , +VNIC_ENV_GET (&vnic, total_error_queues)); +if (err) +return err; + + err =devlink_fmsg_u32_pair_put (fmsg,"send_queue_priority_update_flow" , +VNIC_ENV_GET (&vnic, + send_queue_priority_update_flow)); +if (err) +return err; + } + +if (MLX5_CAP_GEN (dev, eq_overrun_count)) { + err =devlink_fmsg_u32_pair_put (fmsg,"comp_eq_overrun" , +VNIC_ENV_GET (&vnic, comp_eq_overrun)); +if (err) +return err; + + err =devlink_fmsg_u32_pair_put (fmsg,"async_eq_overrun" , +VNIC_ENV_GET (&vnic, async_eq_overrun)); +if (err) +return err; + } + +if (MLX5_CAP_GEN (dev, vnic_env_cq_overrun)) { + err =devlink_fmsg_u32_pair_put (fmsg,"cq_overrun" , +VNIC_ENV_GET (&vnic, cq_overrun)); +if (err) +return err; + } + +if (MLX5_CAP_GEN (dev, invalid_command_count)) { + err =devlink_fmsg_u32_pair_put (fmsg,"invalid_command" , +VNIC_ENV_GET (&vnic, invalid_command)); +if (err) +return err; + } + +if (MLX5_CAP_GEN (dev, quota_exceeded_count)) { + err =devlink_fmsg_u32_pair_put (fmsg,"quota_exceeded_command" , +VNIC_ENV_GET (&vnic, quota_exceeded_command)); +if (err) +return err; + } + +if (MLX5_CAP_GEN (dev, nic_receive_steering_discard)) { + err =devlink_fmsg_u64_pair_put (fmsg,"nic_receive_steering_discard" , +VNIC_ENV_GET64 (&vnic, + nic_receive_steering_discard)); +if (err) +return err; + } + +if (MLX5_CAP_GEN (dev, vnic_env_cnt_steering_fail)) { + err =devlink_fmsg_u64_pair_put (fmsg,"generated_pkt_steering_fail" , +VNIC_ENV_GET64 (&vnic, + generated_pkt_steering_fail)); +if (err) +return err; + + err =devlink_fmsg_u64_pair_put (fmsg,"handled_pkt_steering_fail" , +VNIC_ENV_GET64 (&vnic, handled_pkt_steering_fail)); +if (err) +return err; + } err =devlink_fmsg_obj_nest_end (fmsg);if (err)
Signature · 1 line
2.41.0