Problems when testing l2fwd with ixgbevf pmd dirver

DISCUSSION Lilijun 4 participants 11 messages Oct 23, 2014 7 messages not in the archive

Share & tools

Lilijun

author

2014-10-23 03:36 UTC #0 lore raw

Hi all,

I am testing the example l2fwd of dpdk-1.7.0 using intel 82599 VF NICs. But the VF can't be used when doing probe pmd driver with following error:

EAL: PCI device 0000:02:10.0 on NUMA socket -1
EAL:   probe driver: 8086:10ed rte_ixgbevf_pmd
EAL:   PCI memory mapped at 0x7f78b181f000
EAL:   PCI memory mapped at 0x7f78b181b000
EAL: Error - exiting with code: 1

Cause: Requested device 0000:02:10.0 cannot be used

Any suggestions?

Thanks,
Jerry

Zhang, Helin

2014-10-23 03:44 UTC #2 lore raw

In reply to a message not in the archive

Quoted 11 lines

-----Original Message-----
From: dev [mailto:[email protected]] On Behalf Of Lilijun
Sent: Thursday, October 23, 2014 11:36 AM
To: [email protected]
Subject: [dpdk-dev] Problems when testing l2fwd with ixgbevf pmd dirver
Hi all,
I am testing the example l2fwd of dpdk-1.7.0 using intel 82599 VF NICs. But the VF can't be used when doing probe pmd driver with following error:

Quoted 8 lines

EAL: PCI device 0000:02:10.0 on NUMA socket -1
EAL:   probe driver: 8086:10ed rte_ixgbevf_pmd
EAL:   PCI memory mapped at 0x7f78b181f000
EAL:   PCI memory mapped at 0x7f78b181b000
EAL: Error - exiting with code: 1

Cause: Requested device 0000:02:10.0 cannot be used

Any suggestions?

Did you launch DPDK host application?

Quoted 3 lines

Thanks,
Jerry

Regards,
Helin

Lilijun

author

2014-10-23 04:31 UTC #4 lore raw

In reply to a message not in the archive

Quoted 20 lines · Helin

Hi
Quoted 18 lines
-----Original Message-----
From: dev [mailto:[email protected]] On Behalf Of Lilijun
Sent: Thursday, October 23, 2014 11:36 AM
To: [email protected]
Subject: [dpdk-dev] Problems when testing l2fwd with ixgbevf pmd dirver
Hi all,
I am testing the example l2fwd of dpdk-1.7.0 using intel 82599 VF NICs. But the VF can't be used when doing probe pmd driver with following error:
EAL: PCI device 0000:02:10.0 on NUMA socket -1
EAL:   probe driver: 8086:10ed rte_ixgbevf_pmd
EAL:   PCI memory mapped at 0x7f78b181f000
EAL:   PCI memory mapped at 0x7f78b181b000
EAL: Error - exiting with code: 1
Cause: Requested device 0000:02:10.0 cannot be used

Quoted 2 lines

Quoted 1 line
Any suggestions?
Did you launch DPDK host application?

My test steps:
1) rmmod ixgbe; modprobe ixgbe max_vfs=3,3
2) insmod dpdk-1.7.0/x86_64-native-linuxapp-gcc/kmod/igb_uio.ko
3) dpdk_nic_bind.py -b igb_uio 02:10.0 02:10.1
4) ./build/l2fwd -c 0xf -n 3 -- -p 3 -q 1

Then l2fwd run failed with error messages shown as above email.

Is my test steps correctly?

Quoted 9 lines

Quoted 4 lines
Thanks,
Jerry
Regards,
Helin

Zhang, Helin

2014-10-23 04:56 UTC #6 lore raw

In reply to a message not in the archive

Quoted 32 lines

-----Original Message-----
From: Lilijun [mailto:[email protected]]
Sent: Thursday, October 23, 2014 12:31 PM
To: Zhang, Helin; [email protected]
Subject: Re: [dpdk-dev] Problems when testing l2fwd with ixgbevf pmd dirver
Quoted 20 lines · Helin
Hi
Quoted 18 lines
-----Original Message-----
From: dev [mailto:[email protected]] On Behalf Of Lilijun
Sent: Thursday, October 23, 2014 11:36 AM
To: [email protected]
Subject: [dpdk-dev] Problems when testing l2fwd with ixgbevf pmd dirver
Hi all,
I am testing the example l2fwd of dpdk-1.7.0 using intel 82599 VF NICs. But the VF can't be used when doing probe pmd driver with following error:
EAL: PCI device 0000:02:10.0 on NUMA socket -1
EAL:   probe driver: 8086:10ed rte_ixgbevf_pmd
EAL:   PCI memory mapped at 0x7f78b181f000
EAL:   PCI memory mapped at 0x7f78b181b000
EAL: Error - exiting with code: 1
Cause: Requested device 0000:02:10.0 cannot be used
Quoted 2 lines
Quoted 1 line
Any suggestions?
Did you launch DPDK host application?

Quoted 7 lines

My test steps:
1) rmmod ixgbe; modprobe ixgbe max_vfs=3,3
2) insmod dpdk-1.7.0/x86_64-native-linuxapp-gcc/kmod/igb_uio.ko
3) dpdk_nic_bind.py -b igb_uio 02:10.0 02:10.1
4) ./build/l2fwd -c 0xf -n 3 -- -p 3 -q 1
Then l2fwd run failed with error messages shown as above email.

All done in guest, right?
If yes, you need to check if host runs in host. It could be standard Linux host driver, or DPDK host driver.

Quoted 13 lines

Is my test steps correctly?
Quoted 9 lines
Quoted 4 lines
Thanks,
Jerry
Regards,
Helin

Regards,
Helin

Dong, Binghua

2014-10-23 05:37 UTC #12 lore raw

In reply to a message not in the archive

Hi Lilijun,

I think you need unbind the device 02:10.0 from driver ixgbevf first; In Host Linux, you also need ifconfig up the PF eth of this VF; Please ref my script to unbind a VF device and pass into VM, such as:
PCI_eth="0000:02:10.0"
ID_eth="ffff ffff"
PCIX_eth=" -device pci-assign,host="${PCI_eth}
echo $ID_eth > /sys/bus/pci/drivers/pci-stub/new_id
echo ${PCI_eth} > /sys/bus/pci/devices/${PCI_eth}/driver/unbind
echo ${PCI_eth} > /sys/bus/pci/drivers/pci-stub/bind
CMD=${CMD}${PCIX_eth}

==============================================================================================
#!/bin/bash
ID="8086 0442"
PCI="0000:83:01"
IMG="/root/test_image/sles11sp2.img"
HOST=" -vnc 172.16.200.166:1 "
PCIX=" -device pci-assign,host="${PCI}
CDROM=" -cdrom /root/QAT/driver.iso "

CMD="qemu-system-x86_64 -m 2048 -smp 4 -hda "${IMG}${HOST}" -enable-kvm " #ADD CCK
if [ 1 -eq 0 ];then
echo $ID > /sys/bus/pci/drivers/pci-stub/new_id
for i in 4 5 6 7
do
echo ${PCI}"."$i > /sys/bus/pci/devices/${PCI}"."$i/driver/unbind echo ${PCI}"."$i > /sys/bus/pci/drivers/pci-stub/bind CMD=${CMD}${PCIX}.$i
done
fi

#ADD ETH
if [ 1 -eq 0 ];then
PCI_eth="0000:02:00.1"
ID_eth="8086 1521"
PCIX_eth=" -device pci-assign,host="${PCI_eth}
echo $ID_eth > /sys/bus/pci/drivers/pci-stub/new_id echo ${PCI_eth} > /sys/bus/pci/devices/${PCI_eth}/driver/unbind echo ${PCI_eth} > /sys/bus/pci/drivers/pci-stub/bind CMD=${CMD}${PCIX_eth}
fi

#ADD CDROM
#CMD=${CMD}${CDROM}
echo $CMD

#rmmod kvm_intel
#rmmod kvm
modprobe kvm
modprobe kvm_intel
$CMD

-----Original Message-----
From: dev [mailto:[email protected]] On Behalf Of Lilijun
Sent: Thursday, October 23, 2014 11:36 AM
To: [email protected]
Subject: [dpdk-dev] Problems when testing l2fwd with ixgbevf pmd dirver

Hi all,

I am testing the example l2fwd of dpdk-1.7.0 using intel 82599 VF NICs. But the VF can't be used when doing probe pmd driver with following error:

EAL: PCI device 0000:02:10.0 on NUMA socket -1
EAL:   probe driver: 8086:10ed rte_ixgbevf_pmd
EAL:   PCI memory mapped at 0x7f78b181f000
EAL:   PCI memory mapped at 0x7f78b181b000
EAL: Error - exiting with code: 1

Cause: Requested device 0000:02:10.0 cannot be used

Any suggestions?

Thanks,
Jerry

Lilijun

author

2014-10-23 05:51 UTC #8 lore raw

In reply to a message not in the archive

Quoted 38 lines · Helin

Quoted 38 lines
-----Original Message-----
From: Lilijun [mailto:[email protected]]
Sent: Thursday, October 23, 2014 12:31 PM
To: Zhang, Helin; [email protected]
Subject: Re: [dpdk-dev] Problems when testing l2fwd with ixgbevf pmd dirver
Quoted 20 lines · Helin
Hi
Quoted 18 lines
-----Original Message-----
From: dev [mailto:[email protected]] On Behalf Of Lilijun
Sent: Thursday, October 23, 2014 11:36 AM
To: [email protected]
Subject: [dpdk-dev] Problems when testing l2fwd with ixgbevf pmd dirver
Hi all,
I am testing the example l2fwd of dpdk-1.7.0 using intel 82599 VF NICs. But the VF can't be used when doing probe pmd driver with following error:
EAL: PCI device 0000:02:10.0 on NUMA socket -1
EAL:   probe driver: 8086:10ed rte_ixgbevf_pmd
EAL:   PCI memory mapped at 0x7f78b181f000
EAL:   PCI memory mapped at 0x7f78b181b000
EAL: Error - exiting with code: 1
Cause: Requested device 0000:02:10.0 cannot be used
Quoted 2 lines
Quoted 1 line
Any suggestions?
Did you launch DPDK host application?
My test steps:
1) rmmod ixgbe; modprobe ixgbe max_vfs=3,3
2) insmod dpdk-1.7.0/x86_64-native-linuxapp-gcc/kmod/igb_uio.ko
3) dpdk_nic_bind.py -b igb_uio 02:10.0 02:10.1
4) ./build/l2fwd -c 0xf -n 3 -- -p 3 -q 1

Quoted 3 lines

Quoted 1 line
Then l2fwd run failed with error messages shown as above email.
All done in guest, right?
If yes, you need to check if host runs in host. It could be standard Linux host driver, or DPDK host driver.

Thanks for the reply.
The example application runs in host. Now the problem has been fixed for that I haven't make my PF NIC up yet.

Quoted 20 lines

Quoted 14 lines
Is my test steps correctly?
Quoted 9 lines
Quoted 4 lines
Thanks,
Jerry
Regards,
Helin
Regards,
Helin

Dong, Binghua

2014-10-23 05:52 UTC #9 lore raw

In reply to a message not in the archive

Hi all,

It looks like that Lilijun runs the four steps are both in HOST?

Lilijun, you did not startup a VM, pass through the VF to VM, and runs l2fwd in VM?

-----Original Message-----
From: dev [mailto:[email protected]] On Behalf Of Lilijun
Sent: Thursday, October 23, 2014 12:31 PM
To: Zhang, Helin; [email protected]
Subject: Re: [dpdk-dev] Problems when testing l2fwd with ixgbevf pmd dirver

Quoted 20 lines · Helin

Hi
Quoted 18 lines
-----Original Message-----
From: dev [mailto:[email protected]] On Behalf Of Lilijun
Sent: Thursday, October 23, 2014 11:36 AM
To: [email protected]
Subject: [dpdk-dev] Problems when testing l2fwd with ixgbevf pmd dirver
Hi all,
I am testing the example l2fwd of dpdk-1.7.0 using intel 82599 VF NICs. But the VF can't be used when doing probe pmd driver with following error:
EAL: PCI device 0000:02:10.0 on NUMA socket -1
EAL:   probe driver: 8086:10ed rte_ixgbevf_pmd
EAL:   PCI memory mapped at 0x7f78b181f000
EAL:   PCI memory mapped at 0x7f78b181b000
EAL: Error - exiting with code: 1
Cause: Requested device 0000:02:10.0 cannot be used

Quoted 2 lines

Quoted 1 line
Any suggestions?
Did you launch DPDK host application?

Then l2fwd run failed with error messages shown as above email.

Is my test steps correctly?

Quoted 9 lines

Quoted 4 lines
Thanks,
Jerry
Regards,
Helin

Lilijun

author

2014-10-23 05:54 UTC #14 lore raw

In reply to a message not in the archive

Quoted 3 lines · Binghua

Hi Lilijun,
I think you need unbind the device 02:10.0 from driver ixgbevf first; In Host Linux, you also need ifconfig up the PF eth of this VF;

The script dpdk_nic_bind.py will unbind ixgbevf automatically when doing dpdk_nic_bind.py -b igb_uio 02:10.0. As you said, the problem is fixed by executing ifconfig up my PF eth.

Thanks very much.

Quoted 79 lines

Please ref my script to unbind a VF device and pass into VM, such as:
PCI_eth="0000:02:10.0"
ID_eth="ffff ffff"
PCIX_eth=" -device pci-assign,host="${PCI_eth}
echo $ID_eth > /sys/bus/pci/drivers/pci-stub/new_id
echo ${PCI_eth} > /sys/bus/pci/devices/${PCI_eth}/driver/unbind echo ${PCI_eth} > /sys/bus/pci/drivers/pci-stub/bind CMD=${CMD}${PCIX_eth}
==============================================================================================
#!/bin/bash
ID="8086 0442"
PCI="0000:83:01"
IMG="/root/test_image/sles11sp2.img"
HOST=" -vnc 172.16.200.166:1 "
PCIX=" -device pci-assign,host="${PCI}
CDROM=" -cdrom /root/QAT/driver.iso "
CMD="qemu-system-x86_64 -m 2048 -smp 4 -hda "${IMG}${HOST}" -enable-kvm " #ADD CCK
if [ 1 -eq 0 ];then
echo $ID > /sys/bus/pci/drivers/pci-stub/new_id
for i in 4 5 6 7
do
echo ${PCI}"."$i > /sys/bus/pci/devices/${PCI}"."$i/driver/unbind echo ${PCI}"."$i > /sys/bus/pci/drivers/pci-stub/bind CMD=${CMD}${PCIX}.$i
done
fi
#ADD ETH
if [ 1 -eq 0 ];then
PCI_eth="0000:02:00.1"
ID_eth="8086 1521"
PCIX_eth=" -device pci-assign,host="${PCI_eth}
echo $ID_eth > /sys/bus/pci/drivers/pci-stub/new_id echo ${PCI_eth} > /sys/bus/pci/devices/${PCI_eth}/driver/unbind echo ${PCI_eth} > /sys/bus/pci/drivers/pci-stub/bind CMD=${CMD}${PCIX_eth}
fi
#ADD CDROM
#CMD=${CMD}${CDROM}
echo $CMD
#rmmod kvm_intel
#rmmod kvm
modprobe kvm
modprobe kvm_intel
$CMD
-----Original Message-----
From: dev [mailto:[email protected]] On Behalf Of Lilijun
Sent: Thursday, October 23, 2014 11:36 AM
To: [email protected]
Subject: [dpdk-dev] Problems when testing l2fwd with ixgbevf pmd dirver
Hi all,
I am testing the example l2fwd of dpdk-1.7.0 using intel 82599 VF NICs. But the VF can't be used when doing probe pmd driver with following error:
EAL: PCI device 0000:02:10.0 on NUMA socket -1
EAL:   probe driver: 8086:10ed rte_ixgbevf_pmd
EAL:   PCI memory mapped at 0x7f78b181f000
EAL:   PCI memory mapped at 0x7f78b181b000
EAL: Error - exiting with code: 1
Cause: Requested device 0000:02:10.0 cannot be used
Any suggestions?
Thanks,
Jerry
.

Zhang, Jerry

2014-10-23 05:56 UTC #15 lore raw

In reply to a message not in the archive

Hi lijun,

It seems that one of the PCI BAR mapping failed. Need to identify the accurate code line of the mapping error.

Is this a common issue for all 82599 VFs in your environment or just one rare case? If it's just one case, maybe it is caused by configure problem and please try to reconfigure your PF/VF.

Thank you!

发自我的 iPhone

Quoted 19 lines · 在 2014年10月23日，11:37，Lilijun <[email protected]> 写道：

Hi all,
I am testing the example l2fwd of dpdk-1.7.0 using intel 82599 VF NICs. But the VF can't be used when doing probe pmd driver with following error:
EAL: PCI device 0000:02:10.0 on NUMA socket -1
EAL:   probe driver: 8086:10ed rte_ixgbevf_pmd
EAL:   PCI memory mapped at 0x7f78b181f000
EAL:   PCI memory mapped at 0x7f78b181b000
EAL: Error - exiting with code: 1
Cause: Requested device 0000:02:10.0 cannot be used
Any suggestions?
Thanks,
Jerry

Lilijun

author

2014-10-23 07:02 UTC #11 lore raw

In reply to a message not in the archive

Quoted 5 lines · Binghua

Hi all,
It looks like that Lilijun runs the four steps are both in HOST?
Lilijun, you did not startup a VM, pass through the VF to VM, and runs l2fwd in VM?

Yes, that's all in HOST. The problem has been fixed.

Quoted 54 lines

-----Original Message-----
From: dev [mailto:[email protected]] On Behalf Of Lilijun
Sent: Thursday, October 23, 2014 12:31 PM
To: Zhang, Helin; [email protected]
Subject: Re: [dpdk-dev] Problems when testing l2fwd with ixgbevf pmd dirver
Quoted 20 lines · Helin
Hi
Quoted 18 lines
-----Original Message-----
From: dev [mailto:[email protected]] On Behalf Of Lilijun
Sent: Thursday, October 23, 2014 11:36 AM
To: [email protected]
Subject: [dpdk-dev] Problems when testing l2fwd with ixgbevf pmd dirver
Hi all,
I am testing the example l2fwd of dpdk-1.7.0 using intel 82599 VF NICs. But the VF can't be used when doing probe pmd driver with following error:
EAL: PCI device 0000:02:10.0 on NUMA socket -1
EAL:   probe driver: 8086:10ed rte_ixgbevf_pmd
EAL:   PCI memory mapped at 0x7f78b181f000
EAL:   PCI memory mapped at 0x7f78b181b000
EAL: Error - exiting with code: 1
Cause: Requested device 0000:02:10.0 cannot be used
Quoted 2 lines
Quoted 1 line
Any suggestions?
Did you launch DPDK host application?
My test steps:
1) rmmod ixgbe; modprobe ixgbe max_vfs=3,3
2) insmod dpdk-1.7.0/x86_64-native-linuxapp-gcc/kmod/igb_uio.ko
3) dpdk_nic_bind.py -b igb_uio 02:10.0 02:10.1
4) ./build/l2fwd -c 0xf -n 3 -- -p 3 -q 1
Then l2fwd run failed with error messages shown as above email.
Is my test steps correctly?
Quoted 9 lines
Quoted 4 lines
Thanks,
Jerry
Regards,
Helin

Lilijun

author

2014-10-23 07:03 UTC #17 lore raw

In reply to a message not in the archive

Quoted 5 lines · Jerry

Hi lijun,
It seems that one of the PCI BAR mapping failed. Need to identify the accurate code line of the mapping error.
Is this a common issue for all 82599 VFs in your environment or just one rare case? If it's just one case, maybe it is caused by configure problem and please try to reconfigure your PF/VF.

The PF nic has not been up yet, so VF pmd dirver initialize failed. That's ok now.

Thanks.

Quoted 24 lines

Thank you!
发自我的 iPhone
Quoted 19 lines · 在 2014年10月23日，11:37，Lilijun <[email protected].…
Hi all,
I am testing the example l2fwd of dpdk-1.7.0 using intel 82599 VF NICs. But the VF can't be used when doing probe pmd driver with following error:
EAL: PCI device 0000:02:10.0 on NUMA socket -1
EAL:   probe driver: 8086:10ed rte_ixgbevf_pmd
EAL:   PCI memory mapped at 0x7f78b181f000
EAL:   PCI memory mapped at 0x7f78b181b000
EAL: Error - exiting with code: 1
Cause: Requested device 0000:02:10.0 cannot be used
Any suggestions?
Thanks,
Jerry