Bringing up secondary rtl8169-based interface causes network hang/dma issues
Also posted at:
http://www.linuxquestions.org/questions/linux-networking-3/rtl8169-hanging-networkdma-issues-on-secondary-interface-ifup-753532/
Hi All,
The issue I am having is when bringing up a second Ethernet interface that uses the rtl8169 driver, it seems to cause network issues. I lose all network connectivity to the machine, and I simultaneously see a DMA error occur for my primary IDE drive.
Two interfaces:
Quote:
eth0 (rtl8168 (using rtl8169 driver) - Onboard PCI-E Gigabit Ethernet) eth1 (rtl8169 (using rtl8169 driver) - RTL8169 PCI Gigabit Ethernet) The chipset running the IDE drive that experiences the DMA crash is:
Quote:
ATI Technologies Inc SB700/SB800 IDE Controller (atiixp) Vitals:
Debian 5.0.1 @ Kernel 2.6.30
00:00.0 Host bridge: Advanced Micro Devices [AMD] RS780 Host Bridge
00:01.0 PCI bridge: ASUSTeK Computer Inc. Device 9602
00:06.0 PCI bridge: Advanced Micro Devices [AMD] RS780 PCI to PCI bridge (PCIE port 2)
00:11.0 SATA controller: ATI Technologies Inc SB700/SB800 SATA Controller [IDE mode]
00:12.0 USB Controller: ATI Technologies Inc SB700/SB800 USB OHCI0 Controller
00:12.1 USB Controller: ATI Technologies Inc SB700 USB OHCI1 Controller
00:12.2 USB Controller: ATI Technologies Inc SB700/SB800 USB EHCI Controller
00:13.0 USB Controller: ATI Technologies Inc SB700/SB800 USB OHCI0 Controller
00:13.1 USB Controller: ATI Technologies Inc SB700 USB OHCI1 Controller
00:13.2 USB Controller: ATI Technologies Inc SB700/SB800 USB EHCI Controller
00:14.0 SMBus: ATI Technologies Inc SBx00 SMBus Controller (rev 3a)
00:14.1 IDE interface: ATI Technologies Inc SB700/SB800 IDE Controller
00:14.3 ISA bridge: ATI Technologies Inc SB700/SB800 LPC host controller
00:14.4 PCI bridge: ATI Technologies Inc SBx00 PCI to PCI Bridge
00:14.5 USB Controller: ATI Technologies Inc SB700/SB800 USB OHCI2 Controller
00:18.0 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] HyperTransport Technology Configuration 00:18.1 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] Address Map
00:18.2 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] DRAM Controller
00:18.3 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] Miscellaneous Control
01:05.0 VGA compatible controller: ATI Technologies Inc Radeon HD 3200 Graphics
02:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168B PCI Express Gigabit Ethernet controller (rev 02) 03:07.0 Multimedia audio controller: Creative Labs SB Audigy (rev 04)
03:07.1 Input device controller: Creative Labs SB Audigy Game Port (rev 04)
03:07.2 FireWire (IEEE 1394): Creative Labs SB Audigy FireWire Port (rev 04)
The output from kern.log is as follows (right after bringing the link up)
Sep 8 19:36:42 wdhq kernel: r8169: eth1: link up
Sep 8 19:36:45 wdhq kernel: hda: ide_dma_intr: bad DMA status (0x76) Sep 8 19:36:45 wdhq kernel: hda: dma_intr: status=0x50 { DriveReady SeekComplete } Sep 8 19:36:45 wdhq kernel: hda: possibly failed opcode: 0x35
Sep 8 19:36:45 wdhq kernel: hda: ide_dma_intr: bad DMA status (0x76) Sep 8 19:36:45 wdhq kernel: hda: dma_intr: status=0x50 { DriveReady SeekComplete } Sep 8 19:36:45 wdhq kernel: hda: possibly failed opcode: 0x35
Sep 8 19:36:45 wdhq kernel: hda: ide_dma_intr: bad DMA status (0x76) Sep 8 19:36:45 wdhq kernel: hda: dma_intr: status=0x50 { DriveReady SeekComplete } Sep 8 19:36:45 wdhq kernel: hda: possibly failed opcode: 0x35
Sep 8 19:36:45 wdhq kernel: hda: ide_dma_intr: bad DMA status (0x76) Sep 8 19:36:45 wdhq kernel: hda: dma_intr: status=0x50 { DriveReady SeekComplete } Sep 8 19:36:45 wdhq kernel: hda: possibly failed opcode: 0x35
Sep 8 19:36:46 wdhq kernel: hda: ide_dma_intr: bad DMA status (0x76) Sep 8 19:36:46 wdhq kernel: hda: dma_intr: status=0x50 { DriveReady SeekComplete } Sep 8 19:36:46 wdhq kernel: hda: possibly failed opcode: 0x35
Sep 8 19:36:46 wdhq kernel: hda: DMA disabled
Sep 8 19:36:46 wdhq kernel: hdb: DMA disabled
Sep 8 19:36:46 wdhq kernel: ide0: reset: success
If you guys need any package versions just ask. Also feel free to point me in the direction of a better place to post this issue.
HELP! I want to be able to multihome but this is stopping me :(
Shane Arnold <[email protected]> :
[...]
Quoted 10 lines
The issue I am having is when bringing up a second Ethernet interface that uses the rtl8169 driver, it seems to cause network issues. I lose all network connectivity to the machine, and I simultaneously see a DMA error occur for my primary IDE drive.
Two interfaces:
Quote:
eth0 (rtl8168 (using rtl8169 driver) - Onboard PCI-E Gigabit Ethernet) eth1 (rtl8169 (using rtl8169 driver) - RTL8169 PCI Gigabit Ethernet)
^^^^^^^
Do you mean the in-kernel r8169 driver or Realtek's one ?
Quoted 35 lines
The chipset running the IDE drive that experiences the DMA crash is:
Quote:
ATI Technologies Inc SB700/SB800 IDE Controller (atiixp) Vitals:Debian 5.0.1 @ Kernel 2.6.30
00:00.0 Host bridge: Advanced Micro Devices [AMD] RS780 Host Bridge 00:01.0 PCI bridge: ASUSTeK Computer Inc. Device 9602
00:06.0 PCI bridge: Advanced Micro Devices [AMD] RS780 PCI to PCI bridge (PCIE port 2)
00:11.0 SATA controller: ATI Technologies Inc SB700/SB800 SATA Controller [IDE mode]
00:12.0 USB Controller: ATI Technologies Inc SB700/SB800 USB OHCI0 Controller
00:12.1 USB Controller: ATI Technologies Inc SB700 USB OHCI1 Controller 00:12.2 USB Controller: ATI Technologies Inc SB700/SB800 USB EHCI Controller 00:13.0 USB Controller: ATI Technologies Inc SB700/SB800 USB OHCI0 Controller
00:13.1 USB Controller: ATI Technologies Inc SB700 USB OHCI1 Controller 00:13.2 USB Controller: ATI Technologies Inc SB700/SB800 USB EHCI Controller 00:14.0 SMBus: ATI Technologies Inc SBx00 SMBus Controller (rev 3a) 00:14.1 IDE interface: ATI Technologies Inc SB700/SB800 IDE Controller 00:14.3 ISA bridge: ATI Technologies Inc SB700/SB800 LPC host controller 00:14.4 PCI bridge: ATI Technologies Inc SBx00 PCI to PCI Bridge 00:14.5 USB Controller: ATI Technologies Inc SB700/SB800 USB OHCI2 Controller
00:18.0 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] HyperTransport Technology Configuration
00:18.1 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] Address Map
00:18.2 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] DRAM Controller
00:18.3 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron]
Quoted 8 lines
Miscellaneous Control
01:05.0 VGA compatible controller: ATI Technologies Inc Radeon HD 3200 Graphics
02:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168B PCI Express Gigabit Ethernet controller (rev 02) 03:07.0 Multimedia audio controller: Creative Labs SB Audigy (rev 04) 03:07.1 Input device controller: Creative Labs SB Audigy Game Port (rev 04) 03:07.2 FireWire (IEEE 1394): Creative Labs SB Audigy FireWire Port (rev 04)
The second (PCI only ?) network card is plugged and lspci does not display it, right ?
Quoted 1 line
The output from kern.log is as follows (right after bringing the link up)
Please send a complete dmesg from boot and the content of /proc/interrupts once the link is brought up.
[...]
Quoted 2 lines
If you guys need any package versions just ask. Also feel free to point me in the direction of a better place to post this issue.
It is suggested to send network related problems to [email protected]
Signature · 1 line
Ueimor
Well it seems I have solved it by disabling APIC and MSI/MSI-X interrupts. Both NIC's up and playing nicely.
Now just to figure out why it's not communicating with anything...
Thanks Francois!
Quoted 58 lines · Francois Romieu
Shane Arnold <[email protected]> :
[...]Quoted 7 lines
The issue I am having is when bringing up a second Ethernet interface that uses the rtl8169 driver, it seems to cause network issues. I lose all network connectivity to the machine, and I simultaneously see a DMA error occur for my primary IDE drive.
Two interfaces:
Quote:
eth0 (rtl8168 (using rtl8169 driver) - Onboard PCI-E Gigabit Ethernet) eth1 (rtl8169 (using rtl8169 driver) - RTL8169 PCI Gigabit Ethernet)^^^^^^^Do you mean the in-kernel r8169 driver or Realtek's one ?
Quoted 27 lines
The chipset running the IDE drive that experiences the DMA crash is:
Quote:
ATI Technologies Inc SB700/SB800 IDE Controller (atiixp) Vitals:Debian 5.0.1 @ Kernel 2.6.30
00:00.0 Host bridge: Advanced Micro Devices [AMD] RS780 Host Bridge 00:01.0 PCI bridge: ASUSTeK Computer Inc. Device 9602
00:06.0 PCI bridge: Advanced Micro Devices [AMD] RS780 PCI to PCI bridge (PCIE port 2) 00:11.0 SATA controller: ATI Technologies Inc SB700/SB800 SATA Controller [IDE mode] 00:12.0 USB Controller: ATI Technologies Inc SB700/SB800 USB OHCI0 Controller 00:12.1 USB Controller: ATI Technologies Inc SB700 USB OHCI1 Controller 00:12.2 USB Controller: ATI Technologies Inc SB700/SB800 USB EHCI Controller 00:13.0 USB Controller: ATI Technologies Inc SB700/SB800 USB OHCI0 Controller 00:13.1 USB Controller: ATI Technologies Inc SB700 USB OHCI1 Controller 00:13.2 USB Controller: ATI Technologies Inc SB700/SB800 USB EHCI Controller 00:14.0 SMBus: ATI Technologies Inc SBx00 SMBus Controller (rev 3a) 00:14.1 IDE interface: ATI Technologies Inc SB700/SB800 IDE Controller 00:14.3 ISA bridge: ATI Technologies Inc SB700/SB800 LPC host controller 00:14.4 PCI bridge: ATI Technologies Inc SBx00 PCI to PCI Bridge
00:14.5 USB Controller: ATI Technologies Inc SB700/SB800 USB OHCI2 Controller00:18.0 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] HyperTransport Technology Configuration 00:18.1 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] Address Map 00:18.2 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] DRAM Controller 00:18.3 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] Miscellaneous ControlQuoted 5 lines
01:05.0 VGA compatible controller: ATI Technologies Inc Radeon HD 3200 Graphics
02:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168B PCI Express Gigabit Ethernet controller (rev 02) 03:07.0 Multimedia audio controller: Creative Labs SB Audigy (rev 04)
03:07.1 Input device controller: Creative Labs SB Audigy Game Port (rev 04)
03:07.2 FireWire (IEEE 1394): Creative Labs SB Audigy FireWire Port (rev 04)The second (PCI only ?) network card is plugged and lspci does not display it, right ?
Quoted 1 line
The output from kern.log is as follows (right after bringing the link up)
Please send a complete dmesg from boot and the content of
/proc/interruptsonce the link is brought up.[...]
Quoted 1 line
If you guys need any package versions just ask. Also feel free to point me in the direction of a better place to post this issue.
It is suggested to send network related problems to [email protected]
Shane Arnold <[email protected]> :
Quoted 4 lines
Well it seems I have solved it by disabling APIC and MSI/MSI-X interrupts. Both NIC's up and playing nicely.
Now just to figure out why it's not communicating with anything...
How can we tell that the nic are playing nicely if they are not communicating with anything (i.e. no change in the rx / tx packets count nor in ethtool statistitcs) ?
It is a bit confusing.
Signature · 1 line
Ueimor