ixgb problem
Subsystems (2)
Hello,
I'm trying to get a high-speed network setup and am having a problem with the ixgb driver.
The setup I'm running is: s1 -- Cisco -- s2
s1 and s2 are identical Dell 1U servers, each having two onboard 1GbE cards, one extra 1GbE card and one 10GbE card. The GbE are all copper and the 10GbE is fiber.
The Cisco is a 6503 with a 10GbE line card with two ports. It also has a 1GbE line card used to connect to another set of machines.
I'm running a test of iperf with a window of 16MB, at first the performance shows about 3.2Gbps rate (which sucks by itself, but that's another issue), after some time, usually 30-40 seconds, but sometimes 100 seconds, the performance drops to almost nothing, about 60Kbps.
I have tried it on 2.6.11 and 2.6.11 with the latest snapshot of Jeff Garzik net drivers (2.6.11-netdev1.patch.bz2). It happens in both of them.
I have tried with an without NAPI, there is no noticeable change.
Is it known? What can I do to help debug this?
Baruch
Quoted 4 lines · Baruch Even
I'm running a test of iperf with a window of 16MB, at first the performance shows about 3.2Gbps rate (which sucks by itself, but that's another issue), after some time, usually 30-40 seconds, but sometimes 100 seconds, the performance drops to almost nothing, about 60Kbps.
If you could get sysrq-p and sysrq-t output, that would be useful.
Also, check and see what your CPU load is, at the time.
Jeff
Quoted 5 lines · Jeff Garzik
Quoted 1 line · Baruch Even
I'm running a test of iperf with a window of 16MB, at first the performance shows about 3.2Gbps rate (which sucks by itself, but that's another issue), after some time, usually 30-40 seconds, but sometimes 100 seconds, the performance drops to almost nothing, about 60Kbps.
If you could get sysrq-p and sysrq-t output, that would be useful.
Attached. sysrq-p seems to be empty though.
sysrq.log is from s1 - sender
sysrq2.log is from s2 - receiver
Quoted 1 line
Also, check and see what your CPU load is, at the time.
It goes from 60% system to 0% system when the problem appears. user is around 2-3% most of the time, it's just iperf generating packets.
Baruch
������
Debian GNU/Linux 3.1 source1ng ttyS0
source1ng login: SysRq : Show State