DPDK xen-dom0 not working at all

DISCUSSION Murillo 2 participants 5 messages Oct 30, 2014 – Nov 3, 2014 4 messages not in the archive

Share & tools

Murillo

author

2014-10-30 10:26 UTC #0 lore raw

English is not my native language; please excuse typing errors.

I am new to DPDK with Xen, but I am able to run DPDK applications without xen using hugepages. But when I try to do it in xen-dom0 it does not work. Let me explain:

I have followed the intructions on the Getting Started Guide, so I execute the next steps:

Dpdk/config/common_linuxapp

CONFIG_RTE_LIBRTE_XEN_DOM0=y

make config T=x86_64-native-linuxapp-gcc

make install T=x86_64-native-linuxapp-gcc

sudo modprobe uio

sudo insmod x86_64-native-linuxapp-gcc/kmod/igb_uio.ko

sudo insmod x86_64-native-linuxapp-gcc/kmod/rte_dom0_mm.ko rsv_memsize=2048

echo 2048 /sys/kernel/mm/dom0-mm/memsize-mB/memsize

tools/dpdk_nic_bind.py --bind=igb_uio $(tools/dpdk_nic_bind.py --status | sed -rn 's,.* if=([^ ]*).*igb_uio *$,\1,p')

The main problem appears when I try to execute helloworld for example.

Sudo ./build/helloworld -c 0xf -n 2 –xen-dom0

Output:

EAL: Detected lcore 0 as core 0 on socket 0

EAL: Detected lcore 1 as core 0 on socket 0

EAL: Detected lcore 2 as core 1 on socket 0

…

EAL: Detected lcore 39 as core 12 on socket 0

EAL: Support maximum 64 logical core(s) by configuration.

EAL: Detected 40 lcore(s)

And it stops.

If I execute dmegs I get the following:

[ 1098.120193] helloworld[20116] trap invalid opcode ip:45adb7 sp:7fff4cf7e150 error:0 in helloworld[400000+115000]

Here are the characteristics of the server:

DPDK 1.7.1

xm info:

host : vh05

release : 3.5.0-47-generic

version : #71~precise1-Ubuntu SMP Wed Feb 19 22:02:52 UTC 2014

machine : x86_64

nr_cpus : 40

nr_nodes : 2

cores_per_socket : 10

threads_per_core : 2

cpu_mhz : 3000

hw_caps : bfebfbff:2c100800:00000000:00007f40:73bee3ff:00000000:00000001:00000281

virt_caps : hvm hvm_directio

total_memory : 32722

free_memory : 28196

free_cpus : 0

xen_major : 4

xen_minor : 1

xen_extra : .5

xen_caps : xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32 hvm-3.0-x86_32p hvm-3.0-x86_64

xen_scheduler : credit

xen_pagesize : 4096

platform_params : virt_start=0xffff800000000000

xen_changeset : unavailable

xen_commandline : placeholder dom0_mem=4096M max_loop=64

cc_compiler : gcc version 4.6.3 (Ubuntu/Linaro 4.6.3-1ubuntu5)

cc_compile_by : stefan.bader

cc_compile_domain : canonical.com

cc_compile_date : Wed Feb 19 15:32:59 UTC 2014

xend_config_format : 4

Thank you in anvanced.

A message that is not in the archive (sent off-list or not yet received): 54521263.5020600-+ngl/[email protected]

Liu, Jijiang

2014-10-30 12:59 UTC #2 lore raw

">" was missed in the following command.

echo 2048 > /sys/kernel/mm/dom0-mm/memsize-mB/memsize

Quoted 148 lines

-----Original Message-----
From: dev [mailto:[email protected]] On Behalf Of Murillo
Sent: Thursday, October 30, 2014 6:27 PM
To: [email protected]
Subject: [dpdk-dev] DPDK xen-dom0 not working at all
English is not my native language; please excuse typing errors.
I am new to DPDK with Xen, but I am able to run DPDK applications without xen using hugepages. But when I try to do it in xen-dom0 it does not work. Let me explain:
I have followed the intructions on the Getting Started Guide, so I execute the next steps:
Dpdk/config/common_linuxapp
CONFIG_RTE_LIBRTE_XEN_DOM0=y
make config T=x86_64-native-linuxapp-gcc
make install T=x86_64-native-linuxapp-gcc
sudo modprobe uio
sudo insmod x86_64-native-linuxapp-gcc/kmod/igb_uio.ko
sudo insmod x86_64-native-linuxapp-gcc/kmod/rte_dom0_mm.ko rsv_memsize=2048
echo 2048 /sys/kernel/mm/dom0-mm/memsize-mB/memsize
tools/dpdk_nic_bind.py --bind=igb_uio $(tools/dpdk_nic_bind.py --status | sed -rn 's,.* if=([^ ]*).*igb_uio *$,\1,p')
The main problem appears when I try to execute helloworld for example.
Sudo ./build/helloworld -c 0xf -n 2 –xen-dom0
Output:
EAL: Detected lcore 0 as core 0 on socket 0
EAL: Detected lcore 1 as core 0 on socket 0
EAL: Detected lcore 2 as core 1 on socket 0
…
EAL: Detected lcore 39 as core 12 on socket 0
EAL: Support maximum 64 logical core(s) by configuration.
EAL: Detected 40 lcore(s)
And it stops.
If I execute dmegs I get the following:
[ 1098.120193] helloworld[20116] trap invalid opcode ip:45adb7
sp:7fff4cf7e150 error:0 in helloworld[400000+115000]
Here are the characteristics of the server:
DPDK 1.7.1
xm info:
host : vh05
release : 3.5.0-47-generic
version : #71~precise1-Ubuntu SMP Wed Feb 19 22:02:52 UTC 2014
machine : x86_64
nr_cpus : 40
nr_nodes : 2
cores_per_socket : 10
threads_per_core : 2
cpu_mhz : 3000
hw_caps :
bfebfbff:2c100800:00000000:00007f40:73bee3ff:00000000:00000001:00000281
virt_caps : hvm hvm_directio
total_memory : 32722
free_memory : 28196
free_cpus : 0
xen_major : 4
xen_minor : 1
xen_extra : .5
xen_caps : xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32 hvm-3.0-x86_32p hvm-3.0-x86_64
xen_scheduler : credit
xen_pagesize : 4096
platform_params : virt_start=0xffff800000000000
xen_changeset : unavailable
xen_commandline : placeholder dom0_mem=4096M max_loop=64
cc_compiler : gcc version 4.6.3 (Ubuntu/Linaro 4.6.3-1ubuntu5)
cc_compile_by : stefan.bader
cc_compile_domain : canonical.com
cc_compile_date : Wed Feb 19 15:32:59 UTC 2014
xend_config_format : 4
Thank you in anvanced.

A message that is not in the archive (sent off-list or not yet received): 1ED644BD7E0A5F4091CF203DAFB8E4CC01D8438A-0J0gbvR4kThpB2pF5aRoyrfspsVTdybXVpNB7YpNyf8@public.gmane.org

Murillo

author

2014-10-30 15:10 UTC #4 lore raw

I am sorry, I missed it during the redaction of the email. I executed it correcly. When I do "cat /sys/kernel/mm/dom0-mm/memsize-mB/memsize" it prints 2048.

Thank you for your answer and your time.

Quoted 152 lines · Jijiang

">" was missed in the following command.
echo 2048 > /sys/kernel/mm/dom0-mm/memsize-mB/memsize
Quoted 148 lines
-----Original Message-----
From: dev [mailto:[email protected]] On Behalf Of Murillo
Sent: Thursday, October 30, 2014 6:27 PM
To: [email protected]
Subject: [dpdk-dev] DPDK xen-dom0 not working at all
English is not my native language; please excuse typing errors.
I am new to DPDK with Xen, but I am able to run DPDK applications without xen using hugepages. But when I try to do it in xen-dom0 it does not work. Let me explain:
I have followed the intructions on the Getting Started Guide, so I execute the next steps:
Dpdk/config/common_linuxapp
CONFIG_RTE_LIBRTE_XEN_DOM0=y
make config T=x86_64-native-linuxapp-gcc
make install T=x86_64-native-linuxapp-gcc
sudo modprobe uio
sudo insmod x86_64-native-linuxapp-gcc/kmod/igb_uio.ko
sudo insmod x86_64-native-linuxapp-gcc/kmod/rte_dom0_mm.ko rsv_memsize=2048
echo 2048 /sys/kernel/mm/dom0-mm/memsize-mB/memsize
tools/dpdk_nic_bind.py --bind=igb_uio $(tools/dpdk_nic_bind.py --status | sed -rn 's,.* if=([^ ]*).*igb_uio *$,\1,p')
The main problem appears when I try to execute helloworld for example.
Sudo ./build/helloworld -c 0xf -n 2 –xen-dom0
Output:
EAL: Detected lcore 0 as core 0 on socket 0
EAL: Detected lcore 1 as core 0 on socket 0
EAL: Detected lcore 2 as core 1 on socket 0
…
EAL: Detected lcore 39 as core 12 on socket 0
EAL: Support maximum 64 logical core(s) by configuration.
EAL: Detected 40 lcore(s)
And it stops.
If I execute dmegs I get the following:
[ 1098.120193] helloworld[20116] trap invalid opcode ip:45adb7
sp:7fff4cf7e150 error:0 in helloworld[400000+115000]
Here are the characteristics of the server:
DPDK 1.7.1
xm info:
host : vh05
release : 3.5.0-47-generic
version : #71~precise1-Ubuntu SMP Wed Feb 19 22:02:52 UTC 2014
machine : x86_64
nr_cpus : 40
nr_nodes : 2
cores_per_socket : 10
threads_per_core : 2
cpu_mhz : 3000
hw_caps :
bfebfbff:2c100800:00000000:00007f40:73bee3ff:00000000:00000001:00000281
virt_caps : hvm hvm_directio
total_memory : 32722
free_memory : 28196
free_cpus : 0
xen_major : 4
xen_minor : 1
xen_extra : .5
xen_caps : xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32 hvm-3.0-x86_32p hvm-3.0-x86_64
xen_scheduler : credit
xen_pagesize : 4096
platform_params : virt_start=0xffff800000000000
xen_changeset : unavailable
xen_commandline : placeholder dom0_mem=4096M max_loop=64
cc_compiler : gcc version 4.6.3 (Ubuntu/Linaro 4.6.3-1ubuntu5)
cc_compile_by : stefan.bader
cc_compile_domain : canonical.com
cc_compile_date : Wed Feb 19 15:32:59 UTC 2014
xend_config_format : 4
Thank you in anvanced.

A message that is not in the archive (sent off-list or not yet received): 545254FE.3080200-+ngl/[email protected]

Liu, Jijiang

2014-11-03 02:47 UTC #6 lore raw

You are using Xen 4.1.5, and try to do following change In dpdk/config/defconfig_x86_64-native-linuxapp-gcc(assuming you use x86_64-native-linuxapp-gcc to compile).

Change
CONFIG_RTE_MACHINE="native"
To
CONFIG_RTE_MACHINE="default"

Quoted 170 lines

-----Original Message-----
From: dev [mailto:[email protected]] On Behalf Of Murillo
Sent: Thursday, October 30, 2014 11:11 PM
To: [email protected]
Subject: Re: [dpdk-dev] DPDK xen-dom0 not working at all
I am sorry, I missed it during the redaction of the email. I executed it correcly. When I do "cat /sys/kernel/mm/dom0-mm/memsize-mB/memsize" it prints 2048.
Thank you for your answer and your time.
Quoted 157 lines · Jijiang
">" was missed in the following command.
echo 2048 > /sys/kernel/mm/dom0-mm/memsize-mB/memsize
Quoted 153 lines
-----Original Message-----
From: dev [mailto:[email protected]] On Behalf Of Murillo
Sent: Thursday, October 30, 2014 6:27 PM
To: [email protected]
Subject: [dpdk-dev] DPDK xen-dom0 not working at all
English is not my native language; please excuse typing errors.
I am new to DPDK with Xen, but I am able to run DPDK applications without xen using hugepages. But when I try to do it in xen-dom0 it does not work. Let me
explain:
I have followed the intructions on the Getting Started Guide, so I execute the next
steps:
Dpdk/config/common_linuxapp
CONFIG_RTE_LIBRTE_XEN_DOM0=y
make config T=x86_64-native-linuxapp-gcc
make install T=x86_64-native-linuxapp-gcc
sudo modprobe uio
sudo insmod x86_64-native-linuxapp-gcc/kmod/igb_uio.ko
sudo insmod x86_64-native-linuxapp-gcc/kmod/rte_dom0_mm.ko rsv_memsize=2048
echo 2048 /sys/kernel/mm/dom0-mm/memsize-mB/memsize
tools/dpdk_nic_bind.py --bind=igb_uio $(tools/dpdk_nic_bind.py --status
| sed -rn 's,.* if=([^ ]*).*igb_uio *$,\1,p')
The main problem appears when I try to execute helloworld for example.
Sudo ./build/helloworld -c 0xf -n 2 –xen-dom0
Output:
EAL: Detected lcore 0 as core 0 on socket 0
EAL: Detected lcore 1 as core 0 on socket 0
EAL: Detected lcore 2 as core 1 on socket 0
…
EAL: Detected lcore 39 as core 12 on socket 0
EAL: Support maximum 64 logical core(s) by configuration.
EAL: Detected 40 lcore(s)
And it stops.
If I execute dmegs I get the following:
[ 1098.120193] helloworld[20116] trap invalid opcode ip:45adb7
sp:7fff4cf7e150 error:0 in helloworld[400000+115000]
Here are the characteristics of the server:
DPDK 1.7.1
xm info:
host : vh05
release : 3.5.0-47-generic
version : #71~precise1-Ubuntu SMP Wed Feb 19 22:02:52 UTC 2014
machine : x86_64
nr_cpus : 40
nr_nodes : 2
cores_per_socket : 10
threads_per_core : 2
cpu_mhz : 3000
hw_caps :
bfebfbff:2c100800:00000000:00007f40:73bee3ff:00000000:00000001:000002 81
virt_caps : hvm hvm_directio
total_memory : 32722
free_memory : 28196
free_cpus : 0
xen_major : 4
xen_minor : 1
xen_extra : .5
xen_caps : xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32 hvm-3.0-x86_32p
hvm-3.0-x86_64
xen_scheduler : credit
xen_pagesize : 4096
platform_params : virt_start=0xffff800000000000
xen_changeset : unavailable
xen_commandline : placeholder dom0_mem=4096M max_loop=64
cc_compiler : gcc version 4.6.3 (Ubuntu/Linaro 4.6.3-1ubuntu5)
cc_compile_by : stefan.bader
cc_compile_domain : canonical.com
cc_compile_date : Wed Feb 19 15:32:59 UTC 2014
xend_config_format : 4
Thank you in anvanced.

A message that is not in the archive (sent off-list or not yet received): 1ED644BD7E0A5F4091CF203DAFB8E4CC01D84914-0J0gbvR4kThpB2pF5aRoyrfspsVTdybXVpNB7YpNyf8@public.gmane.org

Murillo

author

2014-11-03 08:58 UTC #8 lore raw

Hello,

Thank you for your help. It worked for me.

Quoted 178 lines · Jijiang

You are using Xen 4.1.5, and try to do following change In dpdk/config/defconfig_x86_64-native-linuxapp-gcc(assuming you use x86_64-native-linuxapp-gcc to compile).
Change
CONFIG_RTE_MACHINE="native"
To
CONFIG_RTE_MACHINE="default"
Quoted 170 lines
-----Original Message-----
From: dev [mailto:[email protected]] On Behalf Of Murillo
Sent: Thursday, October 30, 2014 11:11 PM
To: [email protected]
Subject: Re: [dpdk-dev] DPDK xen-dom0 not working at all
I am sorry, I missed it during the redaction of the email. I executed it correcly. When I do "cat /sys/kernel/mm/dom0-mm/memsize-mB/memsize" it prints 2048.
Thank you for your answer and your time.
Quoted 157 lines · Jijiang
">" was missed in the following command.
echo 2048 > /sys/kernel/mm/dom0-mm/memsize-mB/memsize
Quoted 153 lines
-----Original Message-----
From: dev [mailto:[email protected]] On Behalf Of Murillo
Sent: Thursday, October 30, 2014 6:27 PM
To: [email protected]
Subject: [dpdk-dev] DPDK xen-dom0 not working at all
English is not my native language; please excuse typing errors.
I am new to DPDK with Xen, but I am able to run DPDK applications without xen using hugepages. But when I try to do it in xen-dom0 it does not work. Let me
explain:
I have followed the intructions on the Getting Started Guide, so I execute the next
steps:
Dpdk/config/common_linuxapp
CONFIG_RTE_LIBRTE_XEN_DOM0=y
make config T=x86_64-native-linuxapp-gcc
make install T=x86_64-native-linuxapp-gcc
sudo modprobe uio
sudo insmod x86_64-native-linuxapp-gcc/kmod/igb_uio.ko
sudo insmod x86_64-native-linuxapp-gcc/kmod/rte_dom0_mm.ko rsv_memsize=2048
echo 2048 /sys/kernel/mm/dom0-mm/memsize-mB/memsize
tools/dpdk_nic_bind.py --bind=igb_uio $(tools/dpdk_nic_bind.py --status
| sed -rn 's,.* if=([^ ]*).*igb_uio *$,\1,p')
The main problem appears when I try to execute helloworld for example.
Sudo ./build/helloworld -c 0xf -n 2 –xen-dom0
Output:
EAL: Detected lcore 0 as core 0 on socket 0
EAL: Detected lcore 1 as core 0 on socket 0
EAL: Detected lcore 2 as core 1 on socket 0
…
EAL: Detected lcore 39 as core 12 on socket 0
EAL: Support maximum 64 logical core(s) by configuration.
EAL: Detected 40 lcore(s)
And it stops.
If I execute dmegs I get the following:
[ 1098.120193] helloworld[20116] trap invalid opcode ip:45adb7
sp:7fff4cf7e150 error:0 in helloworld[400000+115000]
Here are the characteristics of the server:
DPDK 1.7.1
xm info:
host : vh05
release : 3.5.0-47-generic
version : #71~precise1-Ubuntu SMP Wed Feb 19 22:02:52 UTC 2014
machine : x86_64
nr_cpus : 40
nr_nodes : 2
cores_per_socket : 10
threads_per_core : 2
cpu_mhz : 3000
hw_caps :
bfebfbff:2c100800:00000000:00007f40:73bee3ff:00000000:00000001:000002 81
virt_caps : hvm hvm_directio
total_memory : 32722
free_memory : 28196
free_cpus : 0
xen_major : 4
xen_minor : 1
xen_extra : .5
xen_caps : xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32 hvm-3.0-x86_32p
hvm-3.0-x86_64
xen_scheduler : credit
xen_pagesize : 4096
platform_params : virt_start=0xffff800000000000
xen_changeset : unavailable
xen_commandline : placeholder dom0_mem=4096M max_loop=64
cc_compiler : gcc version 4.6.3 (Ubuntu/Linaro 4.6.3-1ubuntu5)
cc_compile_by : stefan.bader
cc_compile_domain : canonical.com
cc_compile_date : Wed Feb 19 15:32:59 UTC 2014
xend_config_format : 4
Thank you in anvanced.