bnxt_en: AER fixes
Michael Chan
maintainercover bnxt_en: AER fixes
This patchset fixes issues in the AER recovery logic. The first patch refactors the code to make a shutdown function available for AER fatal errors. The second patch fixes the AER fatal recovery logic. The third patch fixes the health register logic to fix AER recovery failure for the new P7 chips.
Michael Chan (1):
bnxt_en: Fix error recovery for 5760X (P7) chips
Vikas Gupta (2):
bnxt_en: refactor reset close code
bnxt_en: Fix the PCI-AER routines
drivers/net/ethernet/broadcom/bnxt/bnxt.c | 38 +++++++++++++++++------ 1 file changed, 28 insertions(+), 10 deletions(-)
Signature · 1 line
2.30.1
Michael Chan
maintainerPATCH 1/3 bnxt_en: refactor reset close code
From: Vikas Gupta <[email protected]>
Introduce bnxt_fw_fatal_close() API which can be used to stop data path and disable device when firmware is in fatal state.
--- drivers/net/ethernet/broadcom/bnxt/bnxt.c | 17 +++++++++++------ 1 file changed, 11 insertions(+), 6 deletions(-)
drivers/net/ethernet/broadcom/bnxt/bnxt.c +11 -6
@@ -13037,6 +13037,16 @@ static void bnxt_rx_ring_reset(struct bnxt *bp)bnxt_rtnl_unlock_sp (bp); } +static void bnxt_fw_fatal_close (struct bnxt *bp) +{ +bnxt_tx_disable (bp); +bnxt_disable_napi (bp); +bnxt_disable_int_sync (bp); +bnxt_free_irq (bp); +bnxt_clear_int_mode (bp); +pci_disable_device (bp->pdev); +} +static void bnxt_fw_reset_close (struct bnxt *bp) {bnxt_ulp_stop (bp);
@@ -13050,12 +13060,7 @@ static void bnxt_fw_reset_close(struct bnxt *bp)pci_read_config_word (bp->pdev,PCI_SUBSYSTEM_ID , &val);if (val ==0xffff ) bp->fw_reset_min_dsecs =0 ; -bnxt_tx_disable (bp); -bnxt_disable_napi (bp); -bnxt_disable_int_sync (bp); -bnxt_free_irq (bp); -bnxt_clear_int_mode (bp); -pci_disable_device (bp->pdev); +bnxt_fw_fatal_close (bp); }__bnxt_close_nic (bp, true, false);bnxt_vf_reps_free (bp);
Signature · 1 line
2.30.1
Michael Chan
maintainerPATCH 2/3 bnxt_en: Fix the PCI-AER routines
In reply to Michael ChanFrom: Vikas Gupta <[email protected]>
We do not support two simultaneous recoveries so check for reset flag, BNXT_STATE_IN_FW_RESET, and do not proceed with AER further. When the pci channel state is pci_channel_io_frozen, the PCIe link can not be trusted so we disable the traffic immediately and stop BAR access by calling bnxt_fw_fatal_close(). BAR access after AER fatal error can cause an NMI.
--- drivers/net/ethernet/broadcom/bnxt/bnxt.c | 19 ++++++++++++++++--- 1 file changed, 16 insertions(+), 3 deletions(-)
drivers/net/ethernet/broadcom/bnxt/bnxt.c +16 -3
@@ -15378,6 +15378,7 @@ static pci_ers_result_t bnxt_io_error_detected(struct pci_dev *pdev, {struct net_device *netdev =pci_get_drvdata (pdev);struct bnxt *bp =netdev_priv (netdev); +bool abort = false;netdev_info (netdev,"PCI I/O error detected\n" );
@@ -15386,16 +15387,27 @@ static pci_ers_result_t bnxt_io_error_detected(struct pci_dev *pdev,bnxt_ulp_stop (bp); -if (state == pci_channel_io_perm_failure) { +if (test_and_set_bit (BNXT_STATE_IN_FW_RESET , &bp->state)) { +netdev_err (bp->dev,"Firmware reset already in progress\n" ); + abort = true; + } + +if (abort || state == pci_channel_io_perm_failure) {rtnl_unlock ();return PCI_ERS_RESULT_DISCONNECT ; } -if (state == pci_channel_io_frozen) +/* Link is not reliable anymore if state is pci_channel_io_frozen +* so we disable bus master to prevent any potential bad DMAs before +* freeing kernel memory. +*/ +if (state == pci_channel_io_frozen) {set_bit (BNXT_STATE_PCI_CHANNEL_IO_FROZEN , &bp->state); +bnxt_fw_fatal_close (bp); + }if (netif_running (netdev)) -bnxt_close (netdev); +__bnxt_close_nic (bp, true, true);if (pci_is_enabled (pdev))pci_disable_device (pdev);
@@ -15479,6 +15491,7 @@ static pci_ers_result_t bnxt_io_slot_reset(struct pci_dev *pdev) } reset_exit: +clear_bit (BNXT_STATE_IN_FW_RESET , &bp->state);bnxt_clear_reservations (bp, true);rtnl_unlock ();
Signature · 1 line
2.30.1
Michael Chan
maintainerPATCH 3/3 bnxt_en: Fix error recovery for 5760X (P7) chips
In reply to Michael ChanDuring error recovery, such as AER fatal error slot reset, we call bnxt_try_map_fw_health_reg() to try to get access to the health register to determine the firmware state. Fix bnxt_try_map_fw_health_reg() to recognize the P7 chip correctly and set up the health register.
This fixes this type of AER slot reset failure:
bnxt_en 0000:04:00.0: AER: PCIe Bus Error: severity=Uncorrectable (Fatal), type=Inaccessible, (Unregistered Agent ID) bnxt_en 0000:04:00.0 enp4s0f0np0: PCI I/O error detectedbnxt_en 0000:04:00.0 bnxt_re0: Handle device suspend callbnxt_en 0000:04:00.1 enp4s0f1np1: PCI I/O error detectedbnxt_en 0000:04:00.1 bnxt_re1: Handle device suspend call
pcieport 0000:00:02.0: AER: Root Port link has been reset (0)bnxt_en 0000:04:00.0 enp4s0f0np0: PCI Slot Resetbnxt_en 0000:04:00.0: enabling device (0000 -> 0002)bnxt_en 0000:04:00.0: Firmware not readybnxt_en 0000:04:00.1 enp4s0f1np1: PCI Slot Resetbnxt_en 0000:04:00.1: enabling device (0000 -> 0002)bnxt_en 0000:04:00.1: Firmware not ready
pcieport 0000:00:02.0: AER: device recovery failed
--- drivers/net/ethernet/broadcom/bnxt/bnxt.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
drivers/net/ethernet/broadcom/bnxt/bnxt.c +1 -1
@@ -9089,7 +9089,7 @@ static void bnxt_try_map_fw_health_reg(struct bnxt *bp)BNXT_FW_HEALTH_WIN_BASE + BNXT_GRC_REG_CHIP_NUM); } -if (!BNXT_CHIP_P5 (bp)) +if (!BNXT_CHIP_P5_PLUS (bp))return ; status_loc = BNXT_GRC_REG_STATUS_P5 |
Signature · 1 line
2.30.1
This series was applied to netdev/net.git (main) by David S. Miller <[email protected]>:
Hello:
This series was applied to netdev/net.git (main)
by David S. Miller <[email protected]>:
Quoted 10 lines · On Fri, 19 Apr 2024 11:34:46 -0700 you wrote:
This patchset fixes issues in the AER recovery logic. The first patch refactors the code to make a shutdown function available for AER fatal errors. The second patch fixes the AER fatal recovery logic. The third patch fixes the health register logic to fix AER recovery failure for the new P7 chips.
Michael Chan (1):
bnxt_en: Fix error recovery for 5760X (P7) chips[...]
Here is the summary with links:
- [net,1/3] bnxt_en: refactor reset close code
https://git.kernel.org/netdev/net/c/7474b1c82be3 - [net,2/3] bnxt_en: Fix the PCI-AER routines https://git.kernel.org/netdev/net/c/a1acdc226bae - [net,3/3] bnxt_en: Fix error recovery for 5760X (P7) chips https://git.kernel.org/netdev/net/c/41e54045b741
You are awesome, thank you!
Signature · 2 lines
Deet-doot-dot, I am a bot. https://korg.docs.kernel.org/patchwork/pwbot.html