Skip to contentSkip to conversation

I need help with the rdmacm tests

DISCUSSION Bob Pearson 3 participants 3 messages Apr 9, 2021 – Apr 12, 2021 InfiniBand

lore
Share & tools
lore
#0 lore raw

The tests in tests/test_rdmacm.py for rxe are failing because they are not able to compute an IP address for the rxe ports.

The python code depends on having the directory /sys/class/infiniband/<IB_DEVICE>/device/net present. But rxe does not have this directory. Apparently it would find a list of network devices in this directory and once it has that it can succeed. If I hack the code in get_net_name in base.py to just return the Ethernet device rxe is using ("enp5s0") the tests all pass.

There are two ways to go forward here. I can figure out how to make rdma-core to create the missing directory or if that is not correct I can figure out how to add another way for the python code to find the netdev for rxe.

I need help on which way to proceed and any hints how to fix this would be very helpful.

Bob

maintainer
#1 lore raw
Quoted 6 lines · Bob Pearson

The tests in tests/test_rdmacm.py for rxe are failing because they are not able to compute an IP address for the rxe ports.

The python code depends on having the directory /sys/class/infiniband/<IB_DEVICE>/device/net present. But rxe does not have this directory.

Oh this is a mistake the tests need to the use APIs to get this information not muck about in sysfs.

Quoted 2 lines

I can figure out how to add another way for the python code to find the netdev for rxe.

Yes. netlink and the gid table reports the netdev for all rdma devices, that is what the tests should be using.

Call ibv_query_gid_table(), put every ndev_ifindex in a set, then that set is the list of every netdev index affiliated with the rdma device.

if_indextoname() will convert to a string name

Jason

#2 lore raw

Thanks.

-----Original Message-----
From: Jason Gunthorpe <[email protected]>
Sent: Monday, April 12, 2021 7:05 AM
To: Bob Pearson <[email protected]>
Cc: Zhu Yanjun <[email protected]>; Edward Srouji <[email protected]>; [email protected]
Subject: Re: I need help with the rdmacm tests

Quoted 6 lines · Bob Pearson

The tests in tests/test_rdmacm.py for rxe are failing because they are not able to compute an IP address for the rxe ports.

The python code depends on having the directory /sys/class/infiniband/<IB_DEVICE>/device/net present. But rxe does not have this directory.

Oh this is a mistake the tests need to the use APIs to get this information not muck about in sysfs.

Quoted 2 lines

I can figure out how to add another way for the python code to find the netdev for rxe.

Yes. netlink and the gid table reports the netdev for all rdma devices, that is what the tests should be using.

Call ibv_query_gid_table(), put every ndev_ifindex in a set, then that set is the list of every netdev index affiliated with the rdma device.

if_indextoname() will convert to a string name

Jason