Skip to contentSkip to conversation

bnx2 breaks Dell R815 BMC IPMI since 4.8

DISCUSSION Brice Goglin 3 participants 5 messages Nov 29, 2016 – Nov 30, 2016

Subsystems (2)
lore
Share & tools
lore
#0 lore raw

Hello

My Dell PowerEdge R815 doesn't have IPMI anymore when I boot a 4.8 kernel, the BMC doesn't even ping anymore. Its Ethernet devices are 4 of those:

01:00.0 Ethernet controller: Broadcom Corporation NetXtreme II BCM5709 Gigabit Ethernet (rev 20)
DeviceName: Embedded NIC 1
Subsystem: Dell NetXtreme II BCM5709 Gigabit Ethernet
Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
Latency: 0, Cache Line Size: 64 bytes
Interrupt: pin A routed to IRQ 42
Region 0: Memory at e6000000 (64-bit, non-prefetchable) [size=32M]
Capabilities: <access denied>
Kernel driver in use: bnx2
Kernel modules: bnx2

The only change in bnx2 between 4.7 and 4.8 appears to be this one:

commit 3e1be7ad2d38c6bd6aeef96df9bd0a7822f4e51c

Author: Baoquan He <[email protected]>
Date:   Fri Sep 9 22:43:12 2016 +0800

bnx2: Reset device during driver initialization

Could you patch actually break the BMC? What do I need to further debug this issue?

Thanks
Brice

#1 lore raw

Sorry, Brice. This has been reported by people, and it has been fixed by later post. The commits within linus's tree are:

commit 6df77862f63f389df3b1ad879738e04440d7385d

Author: Baoquan He <[email protected]>
Date:   Sun Nov 13 13:01:33 2016 +0800

bnx2: Wait for in-flight DMA to complete at probe stage

commit 5d0d4b91bf627f14f95167b738d524156c9d440b

Author: Baoquan He <[email protected]>
Date:   Sun Nov 13 13:01:32 2016 +0800

Revert "bnx2: Reset device during driver initialization"

This reverts commit 3e1be7ad2d38c6bd6aeef96df9bd0a7822f4e51c.

And I believe both of them also are picked up into 4.8-stable kernel. Please have a way to get them.

Sorry again!

Thanks
Baoquan

Quoted 32 lines · Brice Goglin

Hello

My Dell PowerEdge R815 doesn't have IPMI anymore when I boot a 4.8 kernel, the BMC doesn't even ping anymore. Its Ethernet devices are 4 of those:

01:00.0 Ethernet controller: Broadcom Corporation NetXtreme II BCM5709 Gigabit Ethernet (rev 20)
DeviceName: Embedded NIC 1
Subsystem: Dell NetXtreme II BCM5709 Gigabit Ethernet
Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
Latency: 0, Cache Line Size: 64 bytes
Interrupt: pin A routed to IRQ 42
Region 0: Memory at e6000000 (64-bit, non-prefetchable) [size=32M]
Capabilities: <access denied>
Kernel driver in use: bnx2
Kernel modules: bnx2

The only change in bnx2 between 4.7 and 4.8 appears to be this one:

commit 3e1be7ad2d38c6bd6aeef96df9bd0a7822f4e51c

Author: Baoquan He <[email protected]>
Date:   Fri Sep 9 22:43:12 2016 +0800

bnx2: Reset device during driver initialization

Could you patch actually break the BMC? What do I need to further debug this issue?

Thanks
Brice

#2 lore raw

I only tested 4.8.5 and 4.9-rc5 unfortunately, they came later. I'll ping my distro.
Thanks for the quick reply!
Brice

Quoted 59 lines · Baoquan He

Sorry, Brice. This has been reported by people, and it has been fixed by later post. The commits within linus's tree are:

commit 6df77862f63f389df3b1ad879738e04440d7385d

Author: Baoquan He <[email protected]>
Date:   Sun Nov 13 13:01:33 2016 +0800

bnx2: Wait for in-flight DMA to complete at probe stage

commit 5d0d4b91bf627f14f95167b738d524156c9d440b

Author: Baoquan He <[email protected]>
Date:   Sun Nov 13 13:01:32 2016 +0800

Revert "bnx2: Reset device during driver initialization"

This reverts commit 3e1be7ad2d38c6bd6aeef96df9bd0a7822f4e51c.

And I believe both of them also are picked up into 4.8-stable kernel. Please have a way to get them.

Sorry again!

Thanks
Baoquan

Quoted 32 lines · Brice Goglin

Hello

My Dell PowerEdge R815 doesn't have IPMI anymore when I boot a 4.8 kernel, the BMC doesn't even ping anymore. Its Ethernet devices are 4 of those:

01:00.0 Ethernet controller: Broadcom Corporation NetXtreme II BCM5709 Gigabit Ethernet (rev 20)
DeviceName: Embedded NIC 1
Subsystem: Dell NetXtreme II BCM5709 Gigabit Ethernet
Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
Latency: 0, Cache Line Size: 64 bytes
Interrupt: pin A routed to IRQ 42
Region 0: Memory at e6000000 (64-bit, non-prefetchable) [size=32M]
Capabilities: <access denied>
Kernel driver in use: bnx2
Kernel modules: bnx2

The only change in bnx2 between 4.7 and 4.8 appears to be this one:

commit 3e1be7ad2d38c6bd6aeef96df9bd0a7822f4e51c

Author: Baoquan He <[email protected]>
Date:   Fri Sep 9 22:43:12 2016 +0800

bnx2: Reset device during driver initialization

Could you patch actually break the BMC? What do I need to further debug this issue?

Thanks
Brice

#3 lore raw
In reply to Brice Goglin
Quoted 20 lines · Brice Goglin

Hello

My Dell PowerEdge R815 doesn't have IPMI anymore when I boot a 4.8 kernel, the BMC doesn't even ping anymore. Its Ethernet devices are 4 of those:

01:00.0 Ethernet controller: Broadcom Corporation NetXtreme II BCM5709 Gigabit Ethernet (rev 20)
DeviceName: Embedded NIC 1
Subsystem: Dell NetXtreme II BCM5709 Gigabit Ethernet
Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
Latency: 0, Cache Line Size: 64 bytes
Interrupt: pin A routed to IRQ 42
Region 0: Memory at e6000000 (64-bit, non-prefetchable) [size=32M]
Capabilities: <access denied>
Kernel driver in use: bnx2
Kernel modules: bnx2

The only change in bnx2 between 4.7 and 4.8 appears to be this one:

Quoted 9 lines

commit 3e1be7ad2d38c6bd6aeef96df9bd0a7822f4e51c

Author: Baoquan He <[email protected]>
Date:   Fri Sep 9 22:43:12 2016 +0800

bnx2: Reset device during driver initialization

Could you patch actually break the BMC? What do I need to further debug this issue?

Brice, could you please confirm NCSI is enabled on BMC? It seems NCSI AEN pakets aren't handled by NCSI stack on BMC side when resetting NIC on host side. Those AEN packets usually help to reconfigure the (active) NCSI channel and bring it back to service after the reset.

Thanks,
Gavin

#4 lore raw
Quoted 33 lines · Gavin Shan
Quoted 4 lines · Brice Goglin

Hello

My Dell PowerEdge R815 doesn't have IPMI anymore when I boot a 4.8 kernel, the BMC doesn't even ping anymore. Its Ethernet devices are 4

of

Quoted 3 lines

those:

01:00.0 Ethernet controller: Broadcom Corporation NetXtreme II BCM5709

Gigabit Ethernet (rev 20)

Quoted 3 lines

DeviceName: Embedded NIC 1
Subsystem: Dell NetXtreme II BCM5709 Gigabit Ethernet
Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr-

Stepping- SERR- FastB2B- DisINTx+

Quoted 1 line

Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort-

<TAbort- <MAbort- >SERR- <PERR- INTx-

Quoted 9 lines

Latency: 0, Cache Line Size: 64 bytes
Interrupt: pin A routed to IRQ 42
Region 0: Memory at e6000000 (64-bit, non-prefetchable) [size=32M]
Capabilities: <access denied>
Kernel driver in use: bnx2
Kernel modules: bnx2

The only change in bnx2 between 4.7 and 4.8 appears to be this one:

Quoted 7 lines

commit 3e1be7ad2d38c6bd6aeef96df9bd0a7822f4e51c

Author: Baoquan He <[email protected]>
Date:   Fri Sep 9 22:43:12 2016 +0800

bnx2: Reset device during driver initialization

Could you patch actually break the BMC? What do I need to further

debug

Quoted 8 lines
Quoted 2 lines

this issue?

Brice, could you please confirm NCSI is enabled on BMC? It seems NCSI AEN pakets aren't handled by NCSI stack on BMC side when resetting NIC on host side. Those AEN packets usually help to reconfigure the (active)
NCSI channel and bring it back to service after the reset.

I don't remember ever seeing the name NCSI in those Dell BMC configs. Any other word to look for?

By the way, the bug is gone in 4.8.11.

Brice