Problem with 10Gbit Broadcom NetXtreme II 5771x/578xx 10/20-Gigabit Ethernet Driver

DISCUSSION Stefan Bottelier | Ocius.nl 2 participants 4 messages Oct 24, 2014 – Oct 28, 2014 17 messages not in the archive

Subsystems (2)

Networking Network drivers

lore

Share & tools

lore

Stefan Bottelier | Ocius.nl

author

2014-10-24 09:00 UTC #0 lore raw

Hello,

We are using Dell Blade Centers, but we get a error on the 10Gbit Broadcom adapter bnx2x

bnx2x 0000:01:00.0: part number 394D4342-31383735-30315430-473030

WARNING: at drivers/net/ethernet/broadcom/bnx2x/bnx2x_main.c:9410 bnx2x_init_one+0x1194/0x32b9
Hardware name: PowerEdge M620
 Modules linked in:
 Pid: 1, comm: swapper/0 Not tainted 3.2.63 #1
Call Trace:
warn_slowpath_common+0x78/0xb0
bnx2x_init_one+0x1194/0x32b9
bnx2x_init_one+0x1194/0x32b9
warn_slowpath_null+0x1b/0x20
bnx2x_init_one+0x1194/0x32b9
load_balance+0xb5/0x600
soft_cursor+0x19d/0x220
idr_get_empty_slot+0xf2/0x290
sysfs_link_sibling+0x6a/0xb0
__sysfs_add_one+0x5b/0x100
ida_get_new_above+0x49/0x1e0
kmem_cache_alloc+0xa9/0xb0
sysfs_add_one+0x1c/0xe0
sysfs_addrm_finish+0x12/0x90
sysfs_new_dirent+0x6d/0xf0
sysfs_do_create_link+0xbe/0x1f0
notifier_call_chain+0x44/0x60
pci_device_probe+0xf7/0x100
driver_probe_device+0x60/0x1f0
pci_match_device+0xf/0xa0
driver_probe_device+0x1f0/0x1f0
driver_attach+0x79/0x80
bus_for_each_dev+0x38/0x70
driver_attach+0x16/0x20
driver_probe_device+0x1f0/0x1f0
bus_add_driver+0x16f/0x250
pci_dev_put+0x20/0x20
driver_register+0x63/0x130
process_scheduled_works+0x30/0x30
cnic_init+0x7f/0x7f
__pci_register_driver+0x3c/0xa0
cnic_init+0x7f/0x7f
bnx2x_init+0x71/0x94
do_one_initcall+0x112/0x160
kernel_init+0x10f/0x1ab
do_early_param+0x77/0x77
start_kernel+0x327/0x327
kernel_thread_helper+0x6/0xd

bnx2x 0000:01:00.0: irq 132 for MSI/MSI-X
bnx2x 0000:01:00.0: irq 133 for MSI/MSI-X
bnx2x 0000:01:00.0: irq 134 for MSI/MSI-X
bnx2x 0000:01:00.0: irq 135 for MSI/MSI-X
bnx2x 0000:01:00.0: irq 136 for MSI/MSI-X
bnx2x 0000:01:00.0: irq 137 for MSI/MSI-X
bnx2x 0000:01:00.0: irq 138 for MSI/MSI-X
bnx2x 0000:01:00.0: irq 139 for MSI/MSI-X
bnx2x 0000:01:00.0: irq 140 for MSI/MSI-X
bnx2x 0000:01:00.0: irq 141 for MSI/MSI-X
bnx2x 0000:01:00.0: irq 142 for MSI/MSI-X
bnx2x 0000:01:00.0: irq 143 for MSI/MSI-X
bnx2x 0000:01:00.0: irq 144 for MSI/MSI-X
bnx2x 0000:01:00.0: irq 145 for MSI/MSI-X
bnx2x 0000:01:00.0: irq 146 for MSI/MSI-X
bnx2x 0000:01:00.0: irq 147 for MSI/MSI-X
bnx2x 0000:01:00.0: irq 148 for MSI/MSI-X
bnx2x 0000:01:00.0: eth0: Added CNIC device
bnx2x 0000:01:00.1: part number 394D4342-31383735-30315430-473030

Signature · 8 lines

Met vriendelijke groet,

Stefan Bottelier
Ocius Internet Services

E: [email protected]
T: +31 (0)20 716 39 09
W: http://www.ocius.nl

Yuval Mintz

2014-10-26 09:07 UTC #1 lore raw

Quoted 5 lines

We are using Dell Blade Centers, but we get a error on the 10Gbit Broadcom adapter bnx2x
bnx2x 0000:01:00.0: part number 394D4342-31383735-30315430-473030
WARNING: at drivers/net/ethernet/broadcom/bnx2x/bnx2x_main.c:9410

Hi Stefan,

Which distro & linux kernel are you using?
[Obviously not net-next]

Thanks,
Yuval

________________________________

This message and any attached documents contain information from the sending company or its parent company(s), subsidiaries, divisions or branch offices that may be confidential. If you are not the intended recipient, you may not read, copy, distribute, or use this information. If you have received this transmission in error, please notify the sender immediately by reply e-mail and then delete this message.

Stefan Bottelier | Ocius.nl

author

2014-10-27 08:42 UTC #2 lore raw

Hello Yuval,

Thanks for this messages.

We use now the kernel 3.10.57 and then the interface working, only we must back to the kernel we always use 3.2.63 , its work better with use systems. I have compiler the kernel by my self on a Suse system.

I hope we can fix it, that this working with the kernel 3.2.63.

Quoted 15 lines

Quoted 4 lines
We are using Dell Blade Centers, but we get a error on the 10Gbit Broadcom adapter bnx2x
bnx2x 0000:01:00.0: part number 394D4342-31383735-30315430-473030
WARNING: at drivers/net/ethernet/broadcom/bnx2x/bnx2x_main.c:9410
Hi Stefan,
Which distro & linux kernel are you using?
[Obviously not net-next]
Thanks,
Yuval
________________________________
This message and any attached documents contain information from the sending company or its parent company(s), subsidiaries, divisions or branch offices that may be confidential. If you are not the intended recipient, you may not read, copy, distribute, or use this information. If you have received this transmission in error, please notify the sender immediately by reply e-mail and then delete this message.

Signature · 8 lines

Met vriendelijke groet,

Stefan Bottelier
Ocius Internet Services

E: [email protected]
T: +31 (0)20 716 39 09
W: http://www.ocius.nl

A message that is not in the archive (sent off-list or not yet received): [email protected]

A message that is not in the archive (sent off-list or not yet received): B5657A6538887 [email protected]

A message that is not in the archive (sent off-list or not yet received): [email protected]

Stefan Bottelier | Ocius.nl

author

2014-10-28 14:07 UTC #20 lore raw

Hello,

We have fix some problems, but now i get the interface firmware not working, are the some tips of tricks for this ? Its for a Blade Servers, and this working the best with the kernel 3.2.0 branch. So i hope somebody can help me whit this.

[   76.803495] bnx2x: [bnx2x_init_firmware:10573(eth0)]Can't load firmware file bnx2x/bnx2x-e2-7.0.29.0.fw
[   76.803508] bnx2x: [bnx2x_func_hw_init:5382(eth0)]Error loading firmware
[   76.803523] bnx2x: [bnx2x_nic_load:1847(eth0)]HW init failed, aborting

Quoted 444 lines

You can try netdev again, or you should try with the distro bugzillas
[I'm not sure if request_firmware() is contained entirely in kernel or is dependent on some tools in the filesystem provided by the distro]
Quoted 431 lines
-----Original Message-----
From: Stefan Bottelier | Ocius.nl [mailto:[email protected]]
Sent: Tuesday, October 28, 2014 2:40 PM
To: Yuval Mintz
Subject: Re: Problem with 10Gbit Broadcom NetXtreme II 5771x/578xx 10/20- Gigabit Ethernet Driver
Are the some places where i get drop this question ? I hope so that i get it working on this Dell Server.
Quoted 43 lines
Sounds like a small technicality, but sadly I cannot help you from afar.
Quoted 41 lines
-----Original Message-----
From: Stefan Bottelier | Ocius.nl [mailto:[email protected]]
Sent: Tuesday, October 28, 2014 2:29 PM
To: Yuval Mintz
Subject: Re: Problem with 10Gbit Broadcom NetXtreme II 5771x/578xx 10/20- Gigabit Ethernet Driver
Any ideas?
why this message will be coming up.
[   76.074999] bnx2x: [bnx2x_init_firmware:10573(eth0)]Can't load
firmware file bnx2x/bnx2x-e2-7.0.29.0.fw
[   76.075011] bnx2x: [bnx2x_func_hw_init:5382(eth0)]Error loading firmware
[   76.075032] bnx2x: [bnx2x_nic_load:1847(eth0)]HW init failed, aborting
I have change the firmware in
bnx2x_main.c and i have set the firmware images in /lib/firmware/bnx2x
Quoted 19 lines
You can get it from by cloning the linux-firmware git repository at
- git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.
git
Quoted 15 lines
-----Original Message-----
From: Stefan Bottelier | Ocius.nl [mailto:[email protected]]
Sent: Tuesday, October 28, 2014 1:17 PM
To: Yuval Mintz
Subject: Re: Problem with 10Gbit Broadcom NetXtreme II 5771x/578xx 10/20- Gigabit Ethernet Driver
Hello Yuval,
Now i get no erro's only the follwing imforation
[   18.340531] bnx2x 0000:01:00.0: Bad FW version:6.2.9.0. Should be
7.0.29.0
[   18.340542] bnx2x: [bnx2x_init_firmware:10579(eth0)]Corrupt firmware
file bnx2x/bnx2x-e2-6.2.9.0.fw
[   18.340550] bnx2x: [bnx2x_func_hw_init:5382(eth0)]Error loading
firmware
Quoted 48 lines
Quoted 48 lines
Quoted 48 lines
Quoted 48 lines
[   18.340562] bnx2x: [bnx2x_nic_load:1847(eth0)]HW init failed, aborting
If are a location where i can download the 7.0.29.0 firmware, i change to the kernel firmware but this don't work. So i a searching for the
7.0.29.0 firmware.
Quoted 41 lines
Hi,
The change might affect you - you're using a new board.
Cheers,
Yuval
Quoted 34 lines
-----Original Message-----
From: Stefan Bottelier | Ocius.nl [mailto:[email protected]]
Sent: Tuesday, October 28, 2014 12:15 PM
To: Yuval Mintz
Subject: Re: Problem with 10Gbit Broadcom NetXtreme II 5771x/578xx
10/20- Gigabit Ethernet Driver
Hello Yuval,
Whithout code change i see.
bash-4.3# ethtool -i eth0
driver: bnx2x
version: 1.70.30-0
firmware-version: bc 7.10.11
bus-info: 0000:01:00.0
Quoted 4 lines
Btw,
You can supply `ethtool -i' output on one of the interfaces to see whether the
warning would actually apply.
Quoted 11 lines
Thanks,
Yuval
Quoted 8 lines
-----Original Message-----
From: Yuval Mintz
Sent: Tuesday, October 28, 2014 12:07 PM
To: 'Stefan Bottelier | Ocius.nl'
Subject: RE: Problem with 10Gbit Broadcom NetXtreme II 5771x/578xx
10/20- Gigabit Ethernet Driver
Quoted 7 lines
Quoted 7 lines
Quoted 7 lines
Quoted 7 lines
Quoted 7 lines
Quoted 7 lines
Quoted 7 lines
Quoted 7 lines
Well,
There is actually a WARN_ON in line 8886, and that warning was later removed for newer boards.
Please try removing it and changing to the code in bnx2x_get_igu_cam_info() from upstream kernel, and see what's
next.
Quoted 271 lines
Quoted 271 lines
Quoted 13 lines
Quoted 13 lines
Quoted 13 lines
Quoted 13 lines
Quoted 13 lines
Quoted 13 lines
Cheers,
Yuval
Quoted 10 lines
-----Original Message-----
From: Stefan Bottelier | Ocius.nl [mailto:[email protected]]
Sent: Tuesday, October 28, 2014 11:59 AM
To: Yuval Mintz
Subject: Re: Problem with 10Gbit Broadcom NetXtreme II 5771x/578xx
10/20- Gigabit Ethernet Driver
Hello Yuval,
Quoted 7 lines
Quoted 7 lines
Quoted 7 lines
Quoted 7 lines
Quoted 7 lines
Quoted 7 lines
Quoted 7 lines
I have change this in the
drivers/net/ethernet/broadcom/bnx2x/bnx2x_main.c
With new code from the 3.10 kernel
static void bnx2x_set_mac_buf(u8 *mac_buf, u32 mac_lo, u16 mac_hi)
{
Quoted 230 lines
Quoted 230 lines
Quoted 210 lines
Quoted 210 lines
Quoted 210 lines
Quoted 210 lines
Quoted 150 lines
              __be16 mac_hi_be = cpu_to_be16(mac_hi);
              __be32 mac_lo_be = cpu_to_be32(mac_lo);
              memcpy(mac_buf, &mac_hi_be, sizeof(mac_hi_be));
              memcpy(mac_buf + sizeof(mac_hi_be), &mac_lo_be,
sizeof(mac_lo_be)); }
Now i get the following message back
[    5.748765] WARNING: at
drivers/net/ethernet/broadcom/bnx2x/bnx2x_main.c:8886
bnx2x_init_one+0xd04/0x2786()
[    5.748767] Hardware name: PowerEdge M620
[    5.748769] Modules linked in:
[    5.748773] Pid: 1, comm: swapper/0 Tainted: G        W 3.2.63 #1
Are this correct my change in this code ?
Quoted 8 lines
Hi Stefan,
Are you using a Big-Endian machine?
Regardless, I don't really have anything 'good' to tell you - the code you've given me is the same as the one I've looked at, and line
9410 doesn't
really include anything that should produce a warn [at most, a NULL pointer dereference].
Quoted 4 lines
Regardless, if you can - you can try to replace the implementation of
bnx2x_set_mac_buf() in your kernel in bnx2x_main.c with the one from more
modern kernels; [It doesn't pass address of parameters to the function] and see if it solves your issue.
Quoted 116 lines
Cheers,
Yuval
Quoted 113 lines
-----Original Message-----
From: Stefan Bottelier | Ocius.nl [mailto:[email protected]]
Sent: Tuesday, October 28, 2014 10:31 AM
To: Yuval Mintz
Subject: Re: Problem with 10Gbit Broadcom NetXtreme II
5771x/578xx
10/20- Gigabit Ethernet Driver
Hello Yuval,
Correct i use 32bits machine
3.2.63 #1 SMP Mon Oct 27 11:22:59 CET 2014 i686 i686 i386
GNU/Linux
I have added new files. objdump i have run this command in
the bnx2x dir from the kernel source, i hope thats is oke ?
Thanks,
Stefan
Hi Stefan,
2 things:
1. For some reason the source files I'm looking at don't
look the same as
yours.
If you can, please tarball me the bnx2x directory from the
kernel sources
you've compile and send it to me.
2. objdump doesn't contain the source code; Are you sure
you've used
`objdump -S' as opposed to simple `objdump' when generating it?
3. Just to be certain, you're using a 32-bit machine, right?
[Don't know if it's related, but it's rare enough that I
should consider it when I look at the issue]
Thanks,
Yuval
________________________________________
From: Yuval Mintz
Sent: Monday, October 27, 2014 8:38 AM
To: Stefan Bottelier | Ocius.nl
Subject: RE: Problem with 10Gbit Broadcom NetXtreme II
5771x/578xx 10/20-Gigabit Ethernet Driver
Hi Stefan - I have, but I still haven't been able to look into it.
________________________________________
From: Stefan Bottelier | Ocius.nl [[email protected]]
Sent: Monday, October 27, 2014 8:32 AM
To: Yuval Mintz
Subject: Re: Problem with 10Gbit Broadcom NetXtreme II
5771x/578xx 10/20-Gigabit Ethernet Driver
Hello Yuval,
Do you have received my file's good ? I am not sure..
Thanks,
Hi Stefan,
Just looked into 3.2.63 [Saber-toothed Squirrel] sources,
and
bnx2x_main:9410 doesn't look as if it contains any code
that can throw a
stack trace, Nor is it a [direct] part of bnx2x_init_one.
Perhaps you can send the output of `objdump -S bnx2x.ko',
so I could take a
look at the place the stack trace points as the source of the issue?
Cheers,
Yuval
-----Original Message-----
From: Stefan Bottelier | Ocius.nl
[mailto:[email protected]]
Sent: Monday, October 27, 2014 10:43 AM
To: Yuval Mintz
Cc: netdev
Subject: Re: Problem with 10Gbit Broadcom NetXtreme II
5771x/578xx
10/20- Gigabit Ethernet Driver
Hello Yuval,
Thanks for this messages.
We use now the kernel 3.10.57 and then the interface
working, only we must back to the kernel we always use
3.2.63 , its work better with use
systems.
I have compiler the kernel by my self on a Suse system.
I hope we can fix it, that this working with the kernel 3.2.63.
We are using Dell Blade Centers, but we get a error on
the 10Gbit Broadcom adapter bnx2x bnx2x 0000:01:00.0:
part number
394D4342-31383735-30315430-473030
WARNING: at
drivers/net/ethernet/broadcom/bnx2x/bnx2x_main.c:9410
Hi Stefan,
Which distro & linux kernel are you using?
[Obviously not net-next]
Thanks,
Yuval
________________________________
This message and any attached documents contain
information from the
Quoted 26 lines
Quoted 6 lines
Quoted 6 lines
sending company or its parent company(s), subsidiaries,
divisions or branch offices that may be confidential. If
you are not the intended recipient, you may not read,
copy, distribute, or use this information. If you have
received this transmission in error, please notify the
sender immediately by reply e-mail and then delete this
message.
Quoted 19 lines
Quoted 19 lines
--
Met vriendelijke groet,
Stefan Bottelier
Ocius Internet Services
E: [email protected]
T: +31 (0)20 716 39 09
W: http://www.ocius.nl
________________________________
This message and any attached documents contain
information from the
sending company or its parent company(s), subsidiaries,
divisions or branch offices that may be confidential. If you
are not the intended recipient, you may not read, copy,
distribute, or use this information. If you have received
this transmission in error, please notify the sender
immediately by reply e-mail and then delete this
message.
Quoted 13 lines
Quoted 13 lines
Quoted 13 lines
--
Met vriendelijke groet,
Stefan Bottelier
Ocius Internet Services
E: [email protected]
T: +31 (0)20 716 39 09
W: http://www.ocius.nl
________________________________
Quoted 8 lines
Quoted 8 lines
Quoted 8 lines
This message and any attached documents contain information
from the
sending company or its parent company(s), subsidiaries,
divisions or branch offices that may be confidential. If you
are not the intended recipient, you may not read, copy,
distribute, or use this information. If you have received
this transmission in error, please notify the sender
immediately by reply e-mail and then delete this
message.
Quoted 11 lines
Quoted 11 lines
Quoted 9 lines
--
Met vriendelijke groet,
Stefan Bottelier
Ocius Internet Services
E: [email protected]
T: +31 (0)20 716 39 09
W: http://www.ocius.nl
________________________________
Quoted 8 lines
Quoted 8 lines
Quoted 8 lines
Quoted 8 lines
Quoted 8 lines
Quoted 2 lines
This message and any attached documents contain information from the
sending company or its parent company(s), subsidiaries, divisions or branch offices that may be confidential. If you are not the intended recipient, you may not read, copy, distribute, or use this information. If you have received this transmission in error, please notify the sender immediately by reply e-mail and then delete this
message.
Quoted 11 lines
Quoted 11 lines
Quoted 11 lines
Quoted 9 lines
Quoted 9 lines
--
Met vriendelijke groet,
Stefan Bottelier
Ocius Internet Services
E: [email protected]
T: +31 (0)20 716 39 09
W: http://www.ocius.nl
________________________________
Quoted 8 lines
Quoted 8 lines
Quoted 8 lines
Quoted 8 lines
Quoted 2 lines
This message and any attached documents contain information from the
sending company or its parent company(s), subsidiaries, divisions or branch offices that may be confidential. If you are not the intended recipient, you may not read, copy, distribute, or use this information. If you have received this transmission in error, please notify the sender immediately by reply e-mail and then delete this
message.
Quoted 11 lines
Quoted 11 lines
Quoted 11 lines
Quoted 9 lines
--
Met vriendelijke groet,
Stefan Bottelier
Ocius Internet Services
E: [email protected]
T: +31 (0)20 716 39 09
W: http://www.ocius.nl
________________________________
Quoted 7 lines
Quoted 7 lines
Quoted 7 lines
Quoted 7 lines
Quoted 2 lines
This message and any attached documents contain information from the
sending company or its parent company(s), subsidiaries, divisions or branch offices that may be confidential. If you are not the intended recipient, you may not read, copy, distribute, or use this information. If you have received this transmission in error, please notify the sender immediately by reply e-mail and then delete this
message.
Quoted 26 lines
Quoted 26 lines
Quoted 7 lines
Quoted 7 lines
--
Met vriendelijke groet,
Stefan Bottelier
Ocius Internet Services
Quoted 6 lines
Quoted 3 lines
E: [email protected]
T: +31 (0)20 716 39 09
W: http://www.ocius.nl
________________________________
This message and any attached documents contain information from the
sending company or its parent company(s), subsidiaries, divisions or branch offices that may be confidential. If you are not the intended recipient, you may not read, copy, distribute, or use this information. If you have received this transmission in error, please notify the sender immediately by reply e-mail and then delete this message.
--
Met vriendelijke groet,
Stefan Bottelier
Ocius Internet Services
Quoted 6 lines
Quoted 3 lines
E: [email protected]
T: +31 (0)20 716 39 09
W: http://www.ocius.nl
________________________________
This message and any attached documents contain information from the
sending company or its parent company(s), subsidiaries, divisions or branch offices that may be confidential. If you are not the intended recipient, you may not read, copy, distribute, or use this information. If you have received this transmission in error, please notify the sender immediately by reply e-mail and then delete this message.
--
Met vriendelijke groet,
Quoted 6 lines
Stefan Bottelier
Ocius Internet Services
E: [email protected]
T: +31 (0)20 716 39 09
W: http://www.ocius.nl
________________________________
This message and any attached documents contain information from the sending company or its parent company(s), subsidiaries, divisions or branch offices that may be confidential. If you are not the intended recipient, you may not read, copy, distribute, or use this information. If you have received this transmission in error, please notify the sender immediately by reply e-mail and then delete this message.

Signature · 8 lines

Met vriendelijke groet,

Stefan Bottelier
Ocius Internet Services

E: [email protected]
T: +31 (0)20 716 39 09
W: http://www.ocius.nl