IB/ipoib: Use dev_port to disambiguate port numbers
Subsystems (3)
v3 cover IB/ipoib: Use dev_port to disambiguate port numbers
Pre-3.15 userspace had trouble distinguishing different ports of a NIC on a single PCI bus/device/function. To solve this, a sysfs field `dev_port' was introduced quite a while ago (commit v3.14-rc3-739-g3f85944fe207), and some relevant device drivers were fixed to use it, but not in case of IPoIB.
The convention for some reason never got documented in the kernel, but was immediately adopted by userspace (notably udev[1][2], biosdevname[3])
1/3 documents the sysfs field — that's why I'm CC-ing netdev.
This series was tested on and applies to 4.19-rc2.
[1] https://lists.freedesktop.org/archives/systemd-devel/2014-June/020788.html
[2] https://lists.freedesktop.org/archives/systemd-devel/2014-July/020804.html
[3] https://github.com/CloudAutomationNTools/biosdevname/blob/c795d51dd93a5309652f0d635f12a3ecfabfaa72/src/eths.c#L38
v1->v2: replace a line instead of inserting and then removing. v2->v3: restore both attributes, output a notice of deprecation to kmsg.
Arseny Maslennikov (3):
Documentation/ABI: document /sys/class/net/*/dev_port IB/ipoib: Use dev_port to expose network interface port numbers IB/ipoib: Log sysfs 'dev_id' accesses from userspace
Documentation/ABI/testing/sysfs-class-net | 18 ++++++++++ drivers/infiniband/ulp/ipoib/ipoib_main.c | 40 +++++++++++++++++++++++ 2 files changed, 58 insertions(+)
Signature · 1 line
2.19.0.rc1
PATCH v3 1/3 Documentation/ABI: document /sys/class/net/*/dev_port
The sysfs field was introduced 4 years ago along with fixes to various drivers that erroneously used `dev_id' for that purpose, but it was not properly documented anywhere.
See commit v3.14-rc3-739-g3f85944fe207.
--- Documentation/ABI/testing/sysfs-class-net | 18 ++++++++++++++++++ 1 file changed, 18 insertions(+)
Documentation/ABI/testing/sysfs-class-net +18 -0
@@ -91,6 +91,24 @@ Description: stacked (e.g: VLAN interfaces) but still have the same MAC address as their parent device. +What: /sys/class/net/<iface>/dev_port +Date: February 2014 +KernelVersion: 3.15 +Contact: [email protected] +Description: + Indicates the port number of this network device, formatted + as a decimal value. Some NICs have multiple independent ports + on the same PCI bus, device and function. This attribute allows + userspace to distinguish the respective interfaces. + + Note: some device drivers started to use 'dev_id' for this + purpose since long before 3.15 and have not adopted the new + attribute ever since. To query the port number, some tools look + exclusively at 'dev_port', while others only consult 'dev_id'. + If a network device has multiple client adapter ports as + described in the previous paragraph and does not set this + attribute to its port number, it's a kernel bug. + What: /sys/class/net/<iface>/dormant Date: March 2006 KernelVersion: 2.6.17
Signature · 1 line
2.19.0.rc1
PATCH v3 2/3 IB/ipoib: Use dev_port to expose network interface port numbers
In reply to Arseny MaslennikovSome InfiniBand network devices have multiple ports on the same PCI function. This initializes the `dev_port' sysfs field of those network interfaces with their port number.
Prior to this the kernel erroneously used the `dev_id' sysfs field of those network interfaces to convey the port number to userspace.
The use of dev_id' was considered correct until Linux 3.15, when another field, dev_port', was defined for this particular purpose and `dev_id' was reserved for distinguishing stacked ifaces (e.g: VLANs) with the same hardware address as their parent device.
Similar fixes to net/mlx4_en and many other drivers, which started exporting this information through `dev_id' before 3.15, were accepted into the kernel 4 years ago.
See 76a066f2a2a0 (`net/mlx4_en: Expose port number through sysfs').
--- drivers/infiniband/ulp/ipoib/ipoib_main.c | 2 ++ 1 file changed, 2 insertions(+)
drivers/infiniband/ulp/ipoib/ipoib_main.c +2 -0
@@ -1880,6 +1880,8 @@ static int ipoib_parent_init(struct net_device *ndev) sizeof(union ib_gid));SET_NETDEV_DEV (priv->dev, priv->ca->dev.parent); + priv->dev->dev_port = priv->port -1 ; +/* Let's set this one too for backwards compatibility. */ priv->dev->dev_id = priv->port -1 ;return 0 ;
Signature · 1 line
2.19.0.rc1
Re: [PATCH v3 2/3] IB/ipoib: Use dev_port to expose network interface port numbers
Quoted 17 lines · Arseny Maslennikov
Some InfiniBand network devices have multiple ports on the same PCI function. This initializes the `dev_port' sysfs field of those network interfaces with their port number.
Prior to this the kernel erroneously used the `dev_id' sysfs field of those network interfaces to convey the port number to userspace.
The use of
dev_id' was considered correct until Linux 3.15, when another field,dev_port', was defined for this particular purpose and `dev_id' was reserved for distinguishing stacked ifaces (e.g: VLANs) with the same hardware address as their parent device.Similar fixes to
net/mlx4_enand many other drivers, which started exporting this information through `dev_id' before 3.15, were accepted into the kernel 4 years ago.
See76a066f2a2a0(`net/mlx4_en: Expose port number through sysfs').
Quoted 5 lines
Signed-off-by Arseny Maslennikov <[email protected]>--- drivers/infiniband/ulp/ipoib/ipoib_main.c | 2 ++ 1 file changed, 2 insertions(+)
Thanks,
PATCH v3 3/3 IB/ipoib: Log sysfs 'dev_id' accesses from userspace
In reply to Arseny Maslennikov--- drivers/infiniband/ulp/ipoib/ipoib_main.c | 38 +++++++++++++++++++++++ 1 file changed, 38 insertions(+)
drivers/infiniband/ulp/ipoib/ipoib_main.c +38 -0
@@ -2386,6 +2386,42 @@ int ipoib_add_pkey_attr(struct net_device *dev)return device_create_file (&dev->dev, &dev_attr_pkey); } +/* +* We erroneously exposed the iface's port number in the dev_id +* sysfs field long after dev_port was introduced for that purpose[1], +* and we need to stop everyone from relying on that. +* Let's overload the shower routine for the dev_id file here +* to gently bring the issue up. +* +* [1] https://www.spinics.net/lists/netdev/msg272123.html +*/ +static ssize_t dev_id_show (struct device *dev, +struct device_attribute *attr,char *buf) +{ +struct net_device *ndev =to_net_dev (dev); +ssize_t ret = -EINVAL ; + +if (ndev->dev_id == ndev->dev_port) { +netdev_info_once (ndev, +"\"%s\" wants to know my dev_id. " +"Should it look at dev_port instead?\n" , + current->comm); +netdev_info_once (ndev, +"See Documentation/ABI/testing/sysfs-class-net for more info.\n" ); + } + + ret =sprintf (buf,"%#x\n" , ndev->dev_id); + +return ret; +} +static DEVICE_ATTR_RO (dev_id); + +int ipoib_intercept_dev_id_attr (struct net_device *dev) +{ +device_remove_file (&dev->dev, &dev_attr_dev_id); +return device_create_file (&dev->dev, &dev_attr_dev_id); +} +static struct net_device *ipoib_add_port (const char *format,struct ib_device *hca,u8 port) {
@@ -2427,6 +2463,8 @@ static struct net_device *ipoib_add_port(const char *format,*/ ndev->priv_destructor = ipoib_intf_free; +if (ipoib_intercept_dev_id_attr (ndev)) + goto sysfs_failed;if (ipoib_cm_add_mode_attr (ndev)) goto sysfs_failed;if (ipoib_add_pkey_attr (ndev))
Signature · 1 line
2.19.0.rc1
Re: [PATCH v3 3/3] IB/ipoib: Log sysfs 'dev_id' accesses from userspace
Quoted 33 lines · Arseny Maslennikov
Signed-off-by Arseny Maslennikov <[email protected]>--- drivers/infiniband/ulp/ipoib/ipoib_main.c | 38 +++++++++++++++++++++++ 1 file changed, 38 insertions(+)drivers/infiniband/ulp/ipoib/ipoib_main.c +20
-0@@ -2386,6 +2386,42 @@ int ipoib_add_pkey_attr(struct net_device *dev)return device_create_file (&dev->dev, &dev_attr_pkey); } +/* +* We erroneously exposed the iface's port number in the dev_id +* sysfs field long after dev_port was introduced for that purpose[1], +* and we need to stop everyone from relying on that. +* Let's overload the shower routine for the dev_id file here +* to gently bring the issue up. +* +* [1] https://www.spinics.net/lists/netdev/msg272123.html +*/ +static ssize_t dev_id_show (struct device *dev, +struct device_attribute *attr,char *buf) +{ +struct net_device *ndev =to_net_dev (dev); +ssize_t ret = -EINVAL ; + +if (ndev->dev_id == ndev->dev_port) { +netdev_info_once (ndev, +"\"%s\" wants to know my dev_id. " +"Should it look at dev_port instead?\n" , + current->comm);
drivers/infiniband/ulp/ipoib/ipoib_main.c int ipoib_add_pkey_attr(struct net_device *dev) · line 2418
Quoted 10 lines
drivers/infiniband/ulp/ipoib/ipoib_main.c +10
-0+netdev_info_once (ndev, +"See Documentation/ABI/testing/sysfs-class-net for more info.\n" ); + } + + ret =sprintf (buf,"%#x\n" , ndev->dev_id); + +return ret; +} +static DEVICE_ATTR_RO (dev_id); +
I don't see this field among exposed by IPoIB, why should we expose it now?
drivers/infiniband/ulp/ipoib/ipoib_main.c int ipoib_add_pkey_attr(struct net_device *dev) · line 2422
Quoted 4 lines
drivers/infiniband/ulp/ipoib/ipoib_main.c +4
-0+int ipoib_intercept_dev_id_attr (struct net_device *dev) +{ +device_remove_file (&dev->dev, &dev_attr_dev_id); +return device_create_file (&dev->dev, &dev_attr_dev_id);
Why isn't enough to rely on netdev code?
Quoted 17 lines
drivers/infiniband/ulp/ipoib/ipoib_main.c +4
-1+} +static struct net_device *ipoib_add_port (const char *format,struct ib_device *hca,u8 port) {@@ -2427,6 +2463,8 @@ static struct net_device *ipoib_add_port(const char *format,*/ ndev->priv_destructor = ipoib_intf_free; +if (ipoib_intercept_dev_id_attr (ndev)) + goto sysfs_failed;if (ipoib_cm_add_mode_attr (ndev)) goto sysfs_failed;if (ipoib_add_pkey_attr (ndev)) --2.19.0.rc1
Re: [PATCH v3 3/3] IB/ipoib: Log sysfs 'dev_id' accesses from userspace
Quoted 38 lines · Leon Romanovsky
Quoted 37 lines · Arseny Maslennikov
Signed-off-by Arseny Maslennikov <[email protected]>--- drivers/infiniband/ulp/ipoib/ipoib_main.c | 38 +++++++++++++++++++++++ 1 file changed, 38 insertions(+)drivers/infiniband/ulp/ipoib/ipoib_main.c +24
-0@@ -2386,6 +2386,42 @@ int ipoib_add_pkey_attr(struct net_device *dev)return device_create_file (&dev->dev, &dev_attr_pkey); } +/* +* We erroneously exposed the iface's port number in the dev_id +* sysfs field long after dev_port was introduced for that purpose[1], +* and we need to stop everyone from relying on that. +* Let's overload the shower routine for the dev_id file here +* to gently bring the issue up. +* +* [1] https://www.spinics.net/lists/netdev/msg272123.html +*/ +static ssize_t dev_id_show (struct device *dev, +struct device_attribute *attr,char *buf) +{ +struct net_device *ndev =to_net_dev (dev); +ssize_t ret = -EINVAL ; + +if (ndev->dev_id == ndev->dev_port) { +netdev_info_once (ndev, +"\"%s\" wants to know my dev_id. " +"Should it look at dev_port instead?\n" , + current->comm); +netdev_info_once (ndev, +"See Documentation/ABI/testing/sysfs-class-net for more info.\n" ); + } +
Quoted 9 lines
drivers/infiniband/ulp/ipoib/ipoib_main.c int ipoib_add_pkey_attr(struct net_device *dev) · line 2418
Quoted 6 lines
drivers/infiniband/ulp/ipoib/ipoib_main.c +6
-0+ ret =sprintf (buf,"%#x\n" , ndev->dev_id); + +return ret; +} +static DEVICE_ATTR_RO (dev_id); +I don't see this field among exposed by IPoIB, why should we expose it now?
To deviate from standard netdev behaviour, which only prints the field out. Doug wanted this to also print a deprecation message, and netdev (obviously) does not do that. See below.
Quoted 7 lines
drivers/infiniband/ulp/ipoib/ipoib_main.c int ipoib_add_pkey_attr(struct net_device *dev) · line 2422
Quoted 4 lines
drivers/infiniband/ulp/ipoib/ipoib_main.c +4
-0+int ipoib_intercept_dev_id_attr (struct net_device *dev) +{ +device_remove_file (&dev->dev, &dev_attr_dev_id); +return device_create_file (&dev->dev, &dev_attr_dev_id);Why isn't enough to rely on netdev code?
Netdev code relies on macros around a *static* function 'netdev_show', which is defined in net/core/net-sysfs.c; it is not listed in any header files, and the macros aren't as well. This all leads me to believe it was not really meant to be used from outside net/core/net-sysfs.
The only way we could use any netdev code here is to set up our own handler (again), printk() a message, then call netdev_show — but we have no access to it.
Of course, it also may be that I'm terribly missing a clue.
Quoted 17 lines
Quoted 17 lines
drivers/infiniband/ulp/ipoib/ipoib_main.c +4
-1+} +static struct net_device *ipoib_add_port (const char *format,struct ib_device *hca,u8 port) {@@ -2427,6 +2463,8 @@ static struct net_device *ipoib_add_port(const char *format,*/ ndev->priv_destructor = ipoib_intf_free; +if (ipoib_intercept_dev_id_attr (ndev)) + goto sysfs_failed;if (ipoib_cm_add_mode_attr (ndev)) goto sysfs_failed;if (ipoib_add_pkey_attr (ndev)) --2.19.0.rc1
Re: [PATCH v3 3/3] IB/ipoib: Log sysfs 'dev_id' accesses from userspace
Quoted 66 lines · Arseny Maslennikov
Quoted 38 lines · Leon Romanovsky
Quoted 37 lines · Arseny Maslennikov
Signed-off-by Arseny Maslennikov <[email protected]>--- drivers/infiniband/ulp/ipoib/ipoib_main.c | 38 +++++++++++++++++++++++ 1 file changed, 38 insertions(+)drivers/infiniband/ulp/ipoib/ipoib_main.c +24
-0@@ -2386,6 +2386,42 @@ int ipoib_add_pkey_attr(struct net_device *dev)return device_create_file (&dev->dev, &dev_attr_pkey); } +/* +* We erroneously exposed the iface's port number in the dev_id +* sysfs field long after dev_port was introduced for that purpose[1], +* and we need to stop everyone from relying on that. +* Let's overload the shower routine for the dev_id file here +* to gently bring the issue up. +* +* [1] https://www.spinics.net/lists/netdev/msg272123.html +*/ +static ssize_t dev_id_show (struct device *dev, +struct device_attribute *attr,char *buf) +{ +struct net_device *ndev =to_net_dev (dev); +ssize_t ret = -EINVAL ; + +if (ndev->dev_id == ndev->dev_port) { +netdev_info_once (ndev, +"\"%s\" wants to know my dev_id. " +"Should it look at dev_port instead?\n" , + current->comm); +netdev_info_once (ndev, +"See Documentation/ABI/testing/sysfs-class-net for more info.\n" ); + } +Quoted 9 lines
drivers/infiniband/ulp/ipoib/ipoib_main.c int ipoib_add_pkey_attr(struct net_device *dev) · line 2418
Quoted 6 lines
drivers/infiniband/ulp/ipoib/ipoib_main.c +6
-0+ ret =sprintf (buf,"%#x\n" , ndev->dev_id); + +return ret; +} +static DEVICE_ATTR_RO (dev_id); +I don't see this field among exposed by IPoIB, why should we expose it now?
To deviate from standard netdev behaviour, which only prints the field out. Doug wanted this to also print a deprecation message, and netdev (obviously) does not do that. See below.
Quoted 7 lines
drivers/infiniband/ulp/ipoib/ipoib_main.c int ipoib_add_pkey_attr(struct net_device *dev) · line 2422
Quoted 4 lines
drivers/infiniband/ulp/ipoib/ipoib_main.c +4
-0+int ipoib_intercept_dev_id_attr (struct net_device *dev) +{ +device_remove_file (&dev->dev, &dev_attr_dev_id); +return device_create_file (&dev->dev, &dev_attr_dev_id);Why isn't enough to rely on netdev code?
Netdev code relies on macros around a *static* function '
netdev_show', which is defined innet/core/net-sysfs.c; it is not listed in any header files, and the macros aren't as well. This all leads me to believe it was not really meant to be used from outsidenet/core/net-sysfs.
Quoted 5 lines
The only way we could use any netdev code here is to set up our own handler (again),
printk()a message, then callnetdev_show— but we have no access to it.Of course, it also may be that I'm terribly missing a clue.
Thanks,
IMHO, the end result of adequate Doug's request is a little bit too much. I don't think that it justifies such remove->create construction.
Personal opinion.
Quoted 20 lines
Quoted 18 lines
Quoted 18 lines
drivers/infiniband/ulp/ipoib/ipoib_main.c +4
-1+} +static struct net_device *ipoib_add_port (const char *format,struct ib_device *hca,u8 port) {@@ -2427,6 +2463,8 @@ static struct net_device *ipoib_add_port(const char *format,*/ ndev->priv_destructor = ipoib_intf_free; +if (ipoib_intercept_dev_id_attr (ndev)) + goto sysfs_failed;if (ipoib_cm_add_mode_attr (ndev)) goto sysfs_failed;if (ipoib_add_pkey_attr (ndev)) --2.19.0.rc1
Re: [PATCH v3 3/3] IB/ipoib: Log sysfs 'dev_id' accesses from userspace
Quoted 71 lines · Leon Romanovsky
Quoted 70 lines · Arseny Maslennikov
Quoted 38 lines · Leon Romanovsky
Quoted 37 lines · Arseny Maslennikov
Signed-off-by Arseny Maslennikov <[email protected]>--- drivers/infiniband/ulp/ipoib/ipoib_main.c | 38 +++++++++++++++++++++++ 1 file changed, 38 insertions(+)drivers/infiniband/ulp/ipoib/ipoib_main.c +24
-0@@ -2386,6 +2386,42 @@ int ipoib_add_pkey_attr(struct net_device *dev)return device_create_file (&dev->dev, &dev_attr_pkey); } +/* +* We erroneously exposed the iface's port number in the dev_id +* sysfs field long after dev_port was introduced for that purpose[1], +* and we need to stop everyone from relying on that. +* Let's overload the shower routine for the dev_id file here +* to gently bring the issue up. +* +* [1] https://www.spinics.net/lists/netdev/msg272123.html +*/ +static ssize_t dev_id_show (struct device *dev, +struct device_attribute *attr,char *buf) +{ +struct net_device *ndev =to_net_dev (dev); +ssize_t ret = -EINVAL ; + +if (ndev->dev_id == ndev->dev_port) { +netdev_info_once (ndev, +"\"%s\" wants to know my dev_id. " +"Should it look at dev_port instead?\n" , + current->comm); +netdev_info_once (ndev, +"See Documentation/ABI/testing/sysfs-class-net for more info.\n" ); + } +Quoted 9 lines
drivers/infiniband/ulp/ipoib/ipoib_main.c int ipoib_add_pkey_attr(struct net_device *dev) · line 2418
Quoted 6 lines
drivers/infiniband/ulp/ipoib/ipoib_main.c +6
-0+ ret =sprintf (buf,"%#x\n" , ndev->dev_id); + +return ret; +} +static DEVICE_ATTR_RO (dev_id); +I don't see this field among exposed by IPoIB, why should we expose it now?
To deviate from standard netdev behaviour, which only prints the field out. Doug wanted this to also print a deprecation message, and netdev (obviously) does not do that. See below.
Quoted 7 lines
drivers/infiniband/ulp/ipoib/ipoib_main.c int ipoib_add_pkey_attr(struct net_device *dev) · line 2422
Quoted 4 lines
drivers/infiniband/ulp/ipoib/ipoib_main.c +4
-0+int ipoib_intercept_dev_id_attr (struct net_device *dev) +{ +device_remove_file (&dev->dev, &dev_attr_dev_id); +return device_create_file (&dev->dev, &dev_attr_dev_id);Why isn't enough to rely on netdev code?
Netdev code relies on macros around a *static* function '
netdev_show', which is defined innet/core/net-sysfs.c; it is not listed in any header files, and the macros aren't as well. This all leads me to believe it was not really meant to be used from outsidenet/core/net-sysfs.The only way we could use any netdev code here is to set up our own handler (again),
printk()a message, then callnetdev_show— but we have no access to it.
Quoted 8 lines
Quoted 1 line
Of course, it also may be that I'm terribly missing a clue.
Thanks,
IMHO, the end result of adequate Doug's request is a little bit too much. I don't think that it justifies such
remove->createconstruction.Personal opinion.
I agree with you that the end result is kinda bulky, *but*, we will need to know if there are things using the old dev_id before we can remove it. In particular, I'm concerned the IPoIB handling code of NetworkManager uses it. It's worth the cost I think.
Signature · 3 lines
Doug Ledford <[email protected]> GPG KeyID: B826A3330E572FDD Key fingerprint = AE6B 1BDA 122B 23B4 265B 1274 B826 A333 0E57 2FDD
Re: [PATCH v3 3/3] IB/ipoib: Log sysfs 'dev_id' accesses from userspace
Quoted 79 lines · Doug Ledford
Quoted 78 lines · Leon Romanovsky
Quoted 66 lines · Arseny Maslennikov
Quoted 38 lines · Leon Romanovsky
Quoted 37 lines · Arseny Maslennikov
Signed-off-by Arseny Maslennikov <[email protected]>--- drivers/infiniband/ulp/ipoib/ipoib_main.c | 38 +++++++++++++++++++++++ 1 file changed, 38 insertions(+)drivers/infiniband/ulp/ipoib/ipoib_main.c +24
-0@@ -2386,6 +2386,42 @@ int ipoib_add_pkey_attr(struct net_device *dev)return device_create_file (&dev->dev, &dev_attr_pkey); } +/* +* We erroneously exposed the iface's port number in the dev_id +* sysfs field long after dev_port was introduced for that purpose[1], +* and we need to stop everyone from relying on that. +* Let's overload the shower routine for the dev_id file here +* to gently bring the issue up. +* +* [1] https://www.spinics.net/lists/netdev/msg272123.html +*/ +static ssize_t dev_id_show (struct device *dev, +struct device_attribute *attr,char *buf) +{ +struct net_device *ndev =to_net_dev (dev); +ssize_t ret = -EINVAL ; + +if (ndev->dev_id == ndev->dev_port) { +netdev_info_once (ndev, +"\"%s\" wants to know my dev_id. " +"Should it look at dev_port instead?\n" , + current->comm); +netdev_info_once (ndev, +"See Documentation/ABI/testing/sysfs-class-net for more info.\n" ); + } +Quoted 9 lines
drivers/infiniband/ulp/ipoib/ipoib_main.c int ipoib_add_pkey_attr(struct net_device *dev) · line 2418
Quoted 6 lines
drivers/infiniband/ulp/ipoib/ipoib_main.c +6
-0+ ret =sprintf (buf,"%#x\n" , ndev->dev_id); + +return ret; +} +static DEVICE_ATTR_RO (dev_id); +I don't see this field among exposed by IPoIB, why should we expose it now?
To deviate from standard netdev behaviour, which only prints the field out. Doug wanted this to also print a deprecation message, and netdev (obviously) does not do that. See below.
Quoted 7 lines
drivers/infiniband/ulp/ipoib/ipoib_main.c int ipoib_add_pkey_attr(struct net_device *dev) · line 2422
Quoted 4 lines
drivers/infiniband/ulp/ipoib/ipoib_main.c +4
-0+int ipoib_intercept_dev_id_attr (struct net_device *dev) +{ +device_remove_file (&dev->dev, &dev_attr_dev_id); +return device_create_file (&dev->dev, &dev_attr_dev_id);Why isn't enough to rely on netdev code?
Netdev code relies on macros around a *static* function '
netdev_show', which is defined innet/core/net-sysfs.c; it is not listed in any header files, and the macros aren't as well. This all leads me to believe it was not really meant to be used from outsidenet/core/net-sysfs.Quoted 5 lines
The only way we could use any netdev code here is to set up our own handler (again),
printk()a message, then callnetdev_show— but we have no access to it.Of course, it also may be that I'm terribly missing a clue.
Thanks,
IMHO, the end result of adequate Doug's request is a little bit too much. I don't think that it justifies such
remove->createconstruction.
Quoted 6 lines
Quoted 1 line
Personal opinion.
I agree with you that the end result is kinda bulky, *but*, we will need to know if there are things using the old
dev_idbefore we can remove it. In particular, I'm concerned the IPoIB handling code of NetworkManager uses it. It's worth the cost I think.
I did my checks now and saw that ibdev2netdev uses the value provided from this dev_id, so every invocation of that script will generate the warning.
See this line in Parav's repo
https://github.com/Mellanox/container_scripts/blob/master/ibdev2netdev#L112
Thanks
Quoted 5 lines
--
Doug Ledford <[email protected]>GPG KeyID: B826A3330E572FDD Key fingerprint = AE6B 1BDA 122B 23B4 265B 1274 B826 A333 0E57 2FDD
Re: [PATCH v3 3/3] IB/ipoib: Log sysfs 'dev_id' accesses from userspace
Quoted 87 lines · Leon Romanovsky
Quoted 79 lines · Doug Ledford
Quoted 78 lines · Leon Romanovsky
Quoted 66 lines · Arseny Maslennikov
Quoted 38 lines · Leon Romanovsky
Quoted 37 lines · Arseny Maslennikov
Signed-off-by Arseny Maslennikov <[email protected]>--- drivers/infiniband/ulp/ipoib/ipoib_main.c | 38 +++++++++++++++++++++++ 1 file changed, 38 insertions(+)drivers/infiniband/ulp/ipoib/ipoib_main.c +24
-0@@ -2386,6 +2386,42 @@ int ipoib_add_pkey_attr(struct net_device *dev)return device_create_file (&dev->dev, &dev_attr_pkey); } +/* +* We erroneously exposed the iface's port number in the dev_id +* sysfs field long after dev_port was introduced for that purpose[1], +* and we need to stop everyone from relying on that. +* Let's overload the shower routine for the dev_id file here +* to gently bring the issue up. +* +* [1] https://www.spinics.net/lists/netdev/msg272123.html +*/ +static ssize_t dev_id_show (struct device *dev, +struct device_attribute *attr,char *buf) +{ +struct net_device *ndev =to_net_dev (dev); +ssize_t ret = -EINVAL ; + +if (ndev->dev_id == ndev->dev_port) { +netdev_info_once (ndev, +"\"%s\" wants to know my dev_id. " +"Should it look at dev_port instead?\n" , + current->comm); +netdev_info_once (ndev, +"See Documentation/ABI/testing/sysfs-class-net for more info.\n" ); + } +Quoted 9 lines
drivers/infiniband/ulp/ipoib/ipoib_main.c int ipoib_add_pkey_attr(struct net_device *dev) · line 2418
Quoted 6 lines
drivers/infiniband/ulp/ipoib/ipoib_main.c +6
-0+ ret =sprintf (buf,"%#x\n" , ndev->dev_id); + +return ret; +} +static DEVICE_ATTR_RO (dev_id); +I don't see this field among exposed by IPoIB, why should we expose it now?
To deviate from standard netdev behaviour, which only prints the field out. Doug wanted this to also print a deprecation message, and netdev (obviously) does not do that. See below.
Quoted 7 lines
drivers/infiniband/ulp/ipoib/ipoib_main.c int ipoib_add_pkey_attr(struct net_device *dev) · line 2422
Quoted 4 lines
drivers/infiniband/ulp/ipoib/ipoib_main.c +4
-0+int ipoib_intercept_dev_id_attr (struct net_device *dev) +{ +device_remove_file (&dev->dev, &dev_attr_dev_id); +return device_create_file (&dev->dev, &dev_attr_dev_id);Why isn't enough to rely on netdev code?
Netdev code relies on macros around a *static* function '
netdev_show', which is defined innet/core/net-sysfs.c; it is not listed in any header files, and the macros aren't as well. This all leads me to believe it was not really meant to be used from outsidenet/core/net-sysfs.Quoted 5 lines
The only way we could use any netdev code here is to set up our own handler (again),
printk()a message, then callnetdev_show— but we have no access to it.Of course, it also may be that I'm terribly missing a clue.
Thanks,
IMHO, the end result of adequate Doug's request is a little bit too much. I don't think that it justifies such
remove->createconstruction.Quoted 6 lines
Quoted 1 line
Personal opinion.
I agree with you that the end result is kinda bulky, *but*, we will need to know if there are things using the old
dev_idbefore we can remove it. In particular, I'm concerned the IPoIB handling code of NetworkManager uses it. It's worth the cost I think.
Quoted 6 lines
I did my checks now and saw that ibdev2netdev uses the value provided from this
dev_id, so every invocation of that script will generate the warning.See this line in Parav's repo
https://github.com/Mellanox/container_scripts/blob/master/ibdev2netdev#L112
I'm pretty sure libvirt + qemu will trigger it too.
Signature · 3 lines
Doug Ledford <[email protected]> GPG KeyID: B826A3330E572FDD Key fingerprint = AE6B 1BDA 122B 23B4 265B 1274 B826 A333 0E57 2FDD
Re: [PATCH v3 3/3] IB/ipoib: Log sysfs 'dev_id' accesses from userspace
In reply to Arseny Maslennikovdrivers/infiniband/ulp/ipoib/ipoib_main.c int ipoib_add_pkey_attr(struct net_device *dev) · line 2411
Quoted 8 lines · On Mon, 3 Sep 2018 19:13:16 +0300 Arseny Maslennikov <[email protected]> wrote:
drivers/infiniband/ulp/ipoib/ipoib_main.c +8
-0+if (ndev->dev_id == ndev->dev_port) { +netdev_info_once (ndev, +"\"%s\" wants to know my dev_id. " +"Should it look at dev_port instead?\n" , + current->comm); +netdev_info_once (ndev, +"See Documentation/ABI/testing/sysfs-class-net for more info.\n" ); + }
Single line message is sufficient.
Also don't break strings in messages.
drivers/infiniband/ulp/ipoib/ipoib_main.c int ipoib_add_pkey_attr(struct net_device *dev) · line 2415
Quoted 5 lines
drivers/infiniband/ulp/ipoib/ipoib_main.c +5
-0+ } + + ret =sprintf (buf,"%#x\n" , ndev->dev_id); + +return ret;
Why not?
return sprintf...
Re: [PATCH v3 3/3] IB/ipoib: Log sysfs 'dev_id' accesses from userspace
Quoted 15 lines · Stephen Hemminger
drivers/infiniband/ulp/ipoib/ipoib_main.c int ipoib_add_pkey_attr(struct net_device *dev) · line 2411
Quoted 8 lines · On Mon, 3 Sep 2018 19:13:16 +0300 Arseny Maslennikov <[email protected]> wrote:
drivers/infiniband/ulp/ipoib/ipoib_main.c +8
-0+if (ndev->dev_id == ndev->dev_port) { +netdev_info_once (ndev, +"\"%s\" wants to know my dev_id. " +"Should it look at dev_port instead?\n" , + current->comm); +netdev_info_once (ndev, +"See Documentation/ABI/testing/sysfs-class-net for more info.\n" ); + }Single line message is sufficient.
Also don't break strings in messages.
OK, will fix in v4.
(Sorry if the following is too off-topic here)
Multi-line messages in separate printk calls can be racy, I get that. But I'd like to hear some reasoning behind the style decision to not break a long string into many string literals. (I'll most certainly not be alone in this, Documentation/process/ does not mention reasons, only the requirements themselves)
The only drawback I currently see is that breaking a long message into multiple string literals makes it impossible to git grep the kernel tree for the whole message text.
However, splitting a long line this way allows us to nicely wrap the code at 80 columns, which is a readability boon.
Are there any other reasons to avoid that? Except maybe matters of taste. :)
Quoted 8 lines
drivers/infiniband/ulp/ipoib/ipoib_main.c int ipoib_add_pkey_attr(struct net_device *dev) · line 2415
Quoted 5 lines
drivers/infiniband/ulp/ipoib/ipoib_main.c +5
-0+ } + + ret =sprintf (buf,"%#x\n" , ndev->dev_id); + +return ret;Why not?
return sprintf...
Re: [PATCH v3 3/3] IB/ipoib: Log sysfs 'dev_id' accesses from userspace
Quoted 27 lines · Arseny Maslennikov
Quoted 15 lines · Stephen Hemminger
drivers/infiniband/ulp/ipoib/ipoib_main.c int ipoib_add_pkey_attr(struct net_device *dev) · line 2411
Quoted 8 lines · On Mon, 3 Sep 2018 19:13:16 +0300 Arseny Maslennikov <[email protected]> wrote:
drivers/infiniband/ulp/ipoib/ipoib_main.c +8
-0+if (ndev->dev_id == ndev->dev_port) { +netdev_info_once (ndev, +"\"%s\" wants to know my dev_id. " +"Should it look at dev_port instead?\n" , + current->comm); +netdev_info_once (ndev, +"See Documentation/ABI/testing/sysfs-class-net for more info.\n" ); + }Single line message is sufficient.
Also don't break strings in messages.OK, will fix in v4.
(Sorry if the following is too off-topic here)
Multi-line messages in separate printk calls can be racy, I get that. But I'd like to hear some reasoning behind the style decision to not break a long string into many string literals. (I'll most certainly not be alone in this,Documentation/process/does not mention reasons, only the requirements themselves)
Quoted 7 lines
The only drawback I currently see is that breaking a long message into multiple string literals makes it impossible to git grep the kernel tree for the whole message text.
However, splitting a long line this way allows us to nicely wrap the code at 80 columns, which is a readability boon.Are there any other reasons to avoid that? Except maybe matters of taste. :)
AFAIK "grep" is the reason.
Quoted 9 lines
Quoted 9 lines
drivers/infiniband/ulp/ipoib/ipoib_main.c int ipoib_add_pkey_attr(struct net_device *dev) · line 2415
Quoted 6 lines
drivers/infiniband/ulp/ipoib/ipoib_main.c +5
-0+ } + + ret =sprintf (buf,"%#x\n" , ndev->dev_id); + +return ret;Why not?
return sprintf...