Skip to contentSkip to conversation

Export PCIe bandwidth via sysfs

PATCH In review Alexandru Gagniuc 5 participants 18 messages Sep 3, 2018 – Oct 8, 2018

Subsystems (11)
lore
Share & tools
lore
#0 lore raw

cover Export PCIe bandwidth via sysfs

This is a follow-on series to
Commit 2d1ce5ec2117 ("PCI: Check for PCIe Link downtraining")

The remaining issues was that some pcie drivers print link status directly, sometimes resulting in duplicate system log messages with degraded links.

Quoted 1 line

From my understanding, the maintainers of these drivers are fine with

removing the duplicate prints as long as the bandwidth information is readily available. sysfs seemed to be the consensus.

Example:

	$ cat /sys/bus/pci/devices/0000:b1:00.0/available_bandwidth
	7.876 Gb/s

Alexandru Gagniuc (9):
PCI: sysfs: Export available PCIe bandwidth
bnx2x: Do not call pcie_print_link_status()
bnxt_en: Do not call pcie_print_link_status()
cxgb4: Do not call pcie_print_link_status()
fm10k: Do not call pcie_print_link_status()
ixgbe: Do not call pcie_print_link_status()
net/mlx4: Do not call pcie_print_link_status()
net/mlx5: Do not call pcie_print_link_status()
nfp: Do not call pcie_print_link_status()

 .../net/ethernet/broadcom/bnx2x/bnx2x_main.c  |  1 -
 drivers/net/ethernet/broadcom/bnxt/bnxt.c     |  1 -
 .../net/ethernet/chelsio/cxgb4/cxgb4_main.c   |  3 ---
 drivers/net/ethernet/intel/fm10k/fm10k_pci.c  |  3 ---
 drivers/net/ethernet/intel/ixgbe/ixgbe_main.c | 26 -------------------
 drivers/net/ethernet/mellanox/mlx4/main.c     |  7 -----
 .../net/ethernet/mellanox/mlx5/core/main.c    |  4 ---
 .../netronome/nfp/nfpcore/nfp6000_pcie.c      |  1 -
 drivers/pci/pci-sysfs.c                       | 13 ++++++++++
 9 files changed, 13 insertions(+), 46 deletions(-)
Signature · 1 line
2.17.1
#1 lore raw

PATCH 1/9 PCI: sysfs: Export available PCIe bandwidth

For certain bandwidth-critical devices (e.g. multi-port network cards) it is useful to know the available bandwidth to the root complex. This information is only available via the system log, which doesn't account for link degradation after probing.

With a sysfs attribute, we can computes the bandwidth on-demand, and will detect degraded links.

---
 drivers/pci/pci-sysfs.c | 13 +++++++++++++
 1 file changed, 13 insertions(+)
drivers/pci/pci-sysfs.c +13 -0
index 9ecfe13157c0..6658e927b1f5 100644
@@ -218,6 +218,18 @@ static ssize_t current_link_width_show(struct device *dev,
 }
 static DEVICE_ATTR_RO(current_link_width);
 
+static ssize_t available_bandwidth_show(struct device *dev,
+				       struct device_attribute *attr, char *buf)
+{
+	struct pci_dev *pci_dev = to_pci_dev(dev);
+	u32 bw_avail;
+
+	bw_avail = pcie_bandwidth_available(pci_dev, NULL, NULL, NULL);
+
+	return sprintf(buf, "%u.%03u Gb/s\n", bw_avail / 1000, bw_avail % 1000);
+}
+static DEVICE_ATTR_RO(available_bandwidth);
+
 static ssize_t secondary_bus_number_show(struct device *dev,
 					 struct device_attribute *attr,
 					 char *buf)
@@ -786,6 +798,7 @@ static struct attribute *pcie_dev_attrs[] = {
 	&dev_attr_current_link_width.attr,
 	&dev_attr_max_link_width.attr,
 	&dev_attr_max_link_speed.attr,
+	&dev_attr_available_bandwidth.attr,
 	NULL,
 };
 
Signature · 1 line
2.17.1
#2 lore raw

Re: [PATCH 1/9] PCI: sysfs: Export available PCIe bandwidth

Quoted 9 lines · On Mon, 3 Sep 2018 13:02:28 -0500 Alexandru Gagniuc <[email protected]>…

For certain bandwidth-critical devices (e.g. multi-port network cards) it is useful to know the available bandwidth to the root complex. This information is only available via the system log, which doesn't account for link degradation after probing.

With a sysfs attribute, we can computes the bandwidth on-demand, and will detect degraded links.

In other places (like /sys/class/net/eth0/speed) only the raw value is printed without suffix. The general convention in sysfs is that it should be one value per file and in more raw format. So why not just print it in bits/sec without suffix?

author
#3 lore raw

Re: [PATCH 1/9] PCI: sysfs: Export available PCIe bandwidth

Quoted 11 lines · Stephen Hemminger
Quoted 8 lines · On Mon, 3 Sep 2018 13:02:28 -0500 Alexandru Gagniuc <[email protected]>…

For certain bandwidth-critical devices (e.g. multi-port network cards) it is useful to know the available bandwidth to the root complex. This information is only available via the system log, which doesn't account for link degradation after probing.

With a sysfs attribute, we can computes the bandwidth on-demand, and will detect degraded links.

Quoted 6 lines
Quoted 1 line

In other places (like /sys/class/net/eth0/speed) only the raw value is printed without suffix. The general convention in sysfs is that it should be one value per file and in more raw format. So why not just print it in bits/sec without suffix?

I wanted to be consistent with other PCIe exports that use units.For example:

/sys/devices/pci0000:3a/0000:3a:00.0/0000:3b:00.0/0000:3c:05.0/max_link_speed:8 GT/s /sys/devices/pci0000:3a/0000:3a:00.0/0000:3b:00.0/0000:3c:05.0/current_link_speed:2.5 GT/s /sys/bus/pci/slots/182/cur_bus_speed:2.5 GT/s PCIe /sys/bus/pci/slots/182/max_bus_speed:8.0 GT/s PCIe

#4 lore raw

Re: [PATCH 1/9] PCI: sysfs: Export available PCIe bandwidth

In reply to Alexandru Gagniuc

[+cc Stephen, Martin (for possible lspci changes)]

Hi Alexandru,

Quoted 22 lines · Alexandru Gagniuc

For certain bandwidth-critical devices (e.g. multi-port network cards) it is useful to know the available bandwidth to the root complex. This information is only available via the system log, which doesn't account for link degradation after probing.

With a sysfs attribute, we can computes the bandwidth on-demand, and will detect degraded links.

---
 drivers/pci/pci-sysfs.c | 13 +++++++++++++
 1 file changed, 13 insertions(+)
drivers/pci/pci-sysfs.c +1 -0
index 9ecfe13157c0..6658e927b1f5 100644
@@ -218,6 +218,18 @@ static ssize_t current_link_width_show(struct device *dev,
 }
 static DEVICE_ATTR_RO(current_link_width);
 
+static ssize_t available_bandwidth_show(struct device *dev,

drivers/pci/pci-sysfs.c static ssize_t current_link_width_show(struct device *dev, · line 231

Quoted 10 lines
drivers/pci/pci-sysfs.c +10 -0
+				       struct device_attribute *attr, char *buf)
+{
+	struct pci_dev *pci_dev = to_pci_dev(dev);
+	u32 bw_avail;
+
+	bw_avail = pcie_bandwidth_available(pci_dev, NULL, NULL, NULL);
+
+	return sprintf(buf, "%u.%03u Gb/s\n", bw_avail / 1000, bw_avail % 1000);
+}
+static DEVICE_ATTR_RO(available_bandwidth);

Help me understand this. We already have these sysfs attributes:

  max_link_speed          # eg, 16 GT/s
  max_link_width          # eg, 8
  current_link_speed      # eg, 16 GT/s
  current_link_width      # eg, 8

so I think the raw materials are already exposed.

The benefits I see for this new file are that

- pcie_bandwidth_available() does the work of traversing up the tree, doing the computations (link width * speed, reduced by encoding overhead), and finding the minimum, and

- it re-traverses the path every time we look at it, while the boot-time check is a one-time event.

In principle this could all be done in user space with the attributes that are already exported. There's some precedent for things like this in lspci, e.g., "NUMA node" [1], and lspci might even be a more user-friendly place for users to look for this, as opposed to searching through sysfs.

[1] https://git.kernel.org/pub/scm/utils/pciutils/pciutils.git/commit/?id=90ec4a6d0ae8

Quoted 14 lines
drivers/pci/pci-sysfs.c +1 -0
 static ssize_t secondary_bus_number_show(struct device *dev,
 					 struct device_attribute *attr,
 					 char *buf)
@@ -786,6 +798,7 @@ static struct attribute *pcie_dev_attrs[] = {
 	&dev_attr_current_link_width.attr,
 	&dev_attr_max_link_width.attr,
 	&dev_attr_max_link_speed.attr,
+	&dev_attr_available_bandwidth.attr,
 	NULL,
 };
 
Signature · 1 line
2.17.1
#5 lore raw

Re: [PATCH 1/9] PCI: sysfs: Export available PCIe bandwidth

Quoted 57 lines · Bjorn Helgaas

[EXTERNAL EMAIL]
Please report any suspicious attachments, links, or requests for sensitive information.

[+cc Stephen, Martin (for possible lspci changes)]

Hi Alexandru,

Quoted 22 lines · Alexandru Gagniuc

For certain bandwidth-critical devices (e.g. multi-port network cards) it is useful to know the available bandwidth to the root complex. This information is only available via the system log, which doesn't account for link degradation after probing.

With a sysfs attribute, we can computes the bandwidth on-demand, and will detect degraded links.

---
  drivers/pci/pci-sysfs.c | 13 +++++++++++++
  1 file changed, 13 insertions(+)
drivers/pci/pci-sysfs.c +1 -0
index 9ecfe13157c0..6658e927b1f5 100644
@@ -218,6 +218,18 @@ static ssize_t current_link_width_show(struct device *dev,
  }
  static DEVICE_ATTR_RO(current_link_width);
 
+static ssize_t available_bandwidth_show(struct device *dev,

drivers/pci/pci-sysfs.c static ssize_t current_link_width_show(struct device *dev, · line 231

Quoted 10 lines
drivers/pci/pci-sysfs.c +10 -0
+				       struct device_attribute *attr, char *buf)
+{
+	struct pci_dev *pci_dev = to_pci_dev(dev);
+	u32 bw_avail;
+
+	bw_avail = pcie_bandwidth_available(pci_dev, NULL, NULL, NULL);
+
+	return sprintf(buf, "%u.%03u Gb/s\n", bw_avail / 1000, bw_avail % 1000);
+}
+static DEVICE_ATTR_RO(available_bandwidth);

Help me understand this. We already have these sysfs attributes:

   max_link_speed          # eg, 16 GT/s
   max_link_width          # eg, 8
   current_link_speed      # eg, 16 GT/s
   current_link_width      # eg, 8

so I think the raw materials are already exposed.

Quoted 1 line

The benefits I see for this new file are that

- pcie_bandwidth_available() does the work of traversing up the tree, doing the computations (link width * speed, reduced by encoding overhead), and finding the minimum, and

Quoted 8 lines

- it re-traverses the path every time we look at it, while the boot-time check is a one-time event.

In principle this could all be done in user space with the attributes that are already exported. There's some precedent for things like this in lspci, e.g., "NUMA node" [1], and lspci might even be a more user-friendly place for users to look for this, as opposed to searching through sysfs.

Parsing the endpoint to root port bandwidth is, in principle, possible from userspace. It's just that in practice it's very clumsy to do, and, as you pointed out, not that reliable.

I understand it's not information that all users would jump in the air to know. However, it was important enough for certain use cases, that the kernel already has a very reliable way to calculate it.

It seems to me that the most elegant way is to let the kernel tell us, since the kernel already has this facility. To quote one of the texts under Documentation/, it is an elegant way to "avoid reinventing kernel wheels in userspace".

Alex

Quoted 17 lines

[1] https://git.kernel.org/pub/scm/utils/pciutils/pciutils.git/commit/?id=90ec4a6d0ae8

Quoted 14 lines

static ssize_t secondary_bus_number_show(struct device *dev,
struct device_attribute *attr, char *buf)

drivers/pci/pci-sysfs.c +1 -0
@@ -786,6 +798,7 @@ static struct attribute *pcie_dev_attrs[] = {
  	&dev_attr_current_link_width.attr,
  	&dev_attr_max_link_width.attr,
  	&dev_attr_max_link_speed.attr,
+	&dev_attr_available_bandwidth.attr,
  	NULL,
  };
 
Signature · 1 line
2.17.1
#6 lore raw

Re: [PATCH 1/9] PCI: sysfs: Export available PCIe bandwidth

[+cc Alex (VC mentioned below)]

Quoted 59 lines · Alex_Gagniuc at Dellteam.com
Quoted 49 lines · Bjorn Helgaas
Quoted 22 lines · Alexandru Gagniuc

For certain bandwidth-critical devices (e.g. multi-port network cards) it is useful to know the available bandwidth to the root complex. This information is only available via the system log, which doesn't account for link degradation after probing.

With a sysfs attribute, we can computes the bandwidth on-demand, and will detect degraded links.

---
  drivers/pci/pci-sysfs.c | 13 +++++++++++++
  1 file changed, 13 insertions(+)
drivers/pci/pci-sysfs.c +1 -0
index 9ecfe13157c0..6658e927b1f5 100644
@@ -218,6 +218,18 @@ static ssize_t current_link_width_show(struct device *dev,
  }
  static DEVICE_ATTR_RO(current_link_width);
 
+static ssize_t available_bandwidth_show(struct device *dev,

drivers/pci/pci-sysfs.c static ssize_t current_link_width_show(struct device *dev, · line 231

Quoted 10 lines
drivers/pci/pci-sysfs.c +10 -0
+				       struct device_attribute *attr, char *buf)
+{
+	struct pci_dev *pci_dev = to_pci_dev(dev);
+	u32 bw_avail;
+
+	bw_avail = pcie_bandwidth_available(pci_dev, NULL, NULL, NULL);
+
+	return sprintf(buf, "%u.%03u Gb/s\n", bw_avail / 1000, bw_avail % 1000);
+}
+static DEVICE_ATTR_RO(available_bandwidth);

Help me understand this. We already have these sysfs attributes:

   max_link_speed          # eg, 16 GT/s
   max_link_width          # eg, 8
   current_link_speed      # eg, 16 GT/s
   current_link_width      # eg, 8

so I think the raw materials are already exposed.

The benefits I see for this new file are that

- pcie_bandwidth_available() does the work of traversing up the tree, doing the computations (link width * speed, reduced by encoding overhead), and finding the minimum, and

Quoted 8 lines

- it re-traverses the path every time we look at it, while the boot-time check is a one-time event.

In principle this could all be done in user space with the attributes that are already exported. There's some precedent for things like this in lspci, e.g., "NUMA node" [1], and lspci might even be a more user-friendly place for users to look for this, as opposed to searching through sysfs.

Quoted 3 lines

Parsing the endpoint to root port bandwidth is, in principle, possible from userspace. It's just that in practice it's very clumsy to do, and, as you pointed out, not that reliable.

I don't remember the reliability issue. Was that in a previous conversation? AFAICT, using current_link_speed and current_link_width should be as reliable as pcie_bandwidth_available() because they're both based on reading PCI_EXP_LNKSTA.

This patch exposes only the available bandwidth, not the limiting device, link speed, or link width. Maybe that extra information isn't important in this context. Of course, it's easy to derive using current_link_speed and current_link_width, but if we do that, there's really no benefit to adding a new file.

Linux doesn't really support Virtual Channels (VC) yet, and I don't know much about it, but it seems like Quality-of-Service features like VC could affect this idea of available bandwidth.

Since we already expose the necessary information, and we might throw additional things like VC into the mix, I'm a little hesitant about adding things to sysfs because they're very difficult to change later.

Quoted 29 lines

I understand it's not information that all users would jump in the air to know. However, it was important enough for certain use cases, that the kernel already has a very reliable way to calculate it.

It seems to me that the most elegant way is to let the kernel tell us, since the kernel already has this facility. To quote one of the texts under Documentation/, it is an elegant way to "avoid reinventing kernel wheels in userspace".

Alex

Quoted 17 lines

[1] https://git.kernel.org/pub/scm/utils/pciutils/pciutils.git/commit/?id=90ec4a6d0ae8

Quoted 14 lines
drivers/pci/pci-sysfs.c +1 -0
  static ssize_t secondary_bus_number_show(struct device *dev,
  					 struct device_attribute *attr,
  					 char *buf)
@@ -786,6 +798,7 @@ static struct attribute *pcie_dev_attrs[] = {
  	&dev_attr_current_link_width.attr,
  	&dev_attr_max_link_width.attr,
  	&dev_attr_max_link_speed.attr,
+	&dev_attr_available_bandwidth.attr,
  	NULL,
  };
 
Signature · 1 line
2.17.1
#7 lore raw

Re: [PATCH 1/9] PCI: sysfs: Export available PCIe bandwidth

Quoted 82 lines · Bjorn Helgaas

[EXTERNAL EMAIL]
Please report any suspicious attachments, links, or requests for sensitive information.

[+cc Alex (VC mentioned below)]

Quoted 59 lines · Alex_Gagniuc at Dellteam.com
Quoted 49 lines · Bjorn Helgaas
Quoted 22 lines · Alexandru Gagniuc

For certain bandwidth-critical devices (e.g. multi-port network cards) it is useful to know the available bandwidth to the root complex. This information is only available via the system log, which doesn't account for link degradation after probing.

With a sysfs attribute, we can computes the bandwidth on-demand, and will detect degraded links.

---
   drivers/pci/pci-sysfs.c | 13 +++++++++++++
   1 file changed, 13 insertions(+)
drivers/pci/pci-sysfs.c +1 -0
index 9ecfe13157c0..6658e927b1f5 100644
@@ -218,6 +218,18 @@ static ssize_t current_link_width_show(struct device *dev,
   }
   static DEVICE_ATTR_RO(current_link_width);
 
+static ssize_t available_bandwidth_show(struct device *dev,

drivers/pci/pci-sysfs.c static ssize_t current_link_width_show(struct device *dev, · line 231

Quoted 10 lines
drivers/pci/pci-sysfs.c +10 -0
+				       struct device_attribute *attr, char *buf)
+{
+	struct pci_dev *pci_dev = to_pci_dev(dev);
+	u32 bw_avail;
+
+	bw_avail = pcie_bandwidth_available(pci_dev, NULL, NULL, NULL);
+
+	return sprintf(buf, "%u.%03u Gb/s\n", bw_avail / 1000, bw_avail % 1000);
+}
+static DEVICE_ATTR_RO(available_bandwidth);

Help me understand this. We already have these sysfs attributes:

    max_link_speed          # eg, 16 GT/s
    max_link_width          # eg, 8
    current_link_speed      # eg, 16 GT/s
    current_link_width      # eg, 8

so I think the raw materials are already exposed.

The benefits I see for this new file are that

- pcie_bandwidth_available() does the work of traversing up the tree, doing the computations (link width * speed, reduced by encoding overhead), and finding the minimum, and

Quoted 8 lines

- it re-traverses the path every time we look at it, while the boot-time check is a one-time event.

In principle this could all be done in user space with the attributes that are already exported. There's some precedent for things like this in lspci, e.g., "NUMA node" [1], and lspci might even be a more user-friendly place for users to look for this, as opposed to searching through sysfs.

Quoted 3 lines

Parsing the endpoint to root port bandwidth is, in principle, possible from userspace. It's just that in practice it's very clumsy to do, and, as you pointed out, not that reliable.

I don't remember the reliability issue. Was that in a previous conversation? AFAICT, using current_link_speed and current_link_width should be as reliable as pcie_bandwidth_available() because they're both based on reading PCI_EXP_LNKSTA.

This patch exposes only the available bandwidth, not the limiting device, link speed, or link width. Maybe that extra information isn't important in this context. Of course, it's easy to derive using current_link_speed and current_link_width, but if we do that, there's really no benefit to adding a new file.

Quoted 7 lines

Linux doesn't really support Virtual Channels (VC) yet, and I don't know much about it, but it seems like Quality-of-Service features like VC could affect this idea of available bandwidth.

Since we already expose the necessary information, and we might throw additional things like VC into the mix, I'm a little hesitant about adding things to sysfs because they're very difficult to change later.

I understand your concerns with VC and crazy PCIe outliers. 'available_bandwidth' is meant to mean physical bandwidth, rather than "what comcast gives you". I see now the possibility for confusion. My motivation is to save drivers from the hassle of having to call pcie_print_link_status(), and prevent the rare duplicate syslog messages.

I prefer re-using the kernel logic over doing it over again from userspace, but I won't insist over your doubts.

Alex

Quoted 30 lines
Quoted 29 lines

I understand it's not information that all users would jump in the air to know. However, it was important enough for certain use cases, that the kernel already has a very reliable way to calculate it.

It seems to me that the most elegant way is to let the kernel tell us, since the kernel already has this facility. To quote one of the texts under Documentation/, it is an elegant way to "avoid reinventing kernel wheels in userspace".

Alex

Quoted 17 lines

[1] https://git.kernel.org/pub/scm/utils/pciutils/pciutils.git/commit/?id=90ec4a6d0ae8

Quoted 14 lines
drivers/pci/pci-sysfs.c +1 -0
   static ssize_t secondary_bus_number_show(struct device *dev,
   					 struct device_attribute *attr,
   					 char *buf)
@@ -786,6 +798,7 @@ static struct attribute *pcie_dev_attrs[] = {
   	&dev_attr_current_link_width.attr,
   	&dev_attr_max_link_width.attr,
   	&dev_attr_max_link_speed.attr,
+	&dev_attr_available_bandwidth.attr,
   	NULL,
   };
 
Signature · 1 line
2.17.1
#8 lore raw

PATCH 2/9 bnx2x: Do not call pcie_print_link_status()

In reply to Alexandru Gagniuc

This is now done by the PCI core to warn of sub-optimal bandwidth.

---
 drivers/net/ethernet/broadcom/bnx2x/bnx2x_main.c | 1 -
 1 file changed, 1 deletion(-)
drivers/net/ethernet/broadcom/bnx2x/bnx2x_main.c +0 -1
index 71362b7f6040..9bd0852d9a66 100644
@@ -14100,7 +14100,6 @@ static int bnx2x_init_one(struct pci_dev *pdev,
 	       board_info[ent->driver_data].name,
 	       (CHIP_REV(bp) >> 12) + 'A', (CHIP_METAL(bp) >> 4),
 	       dev->base_addr, bp->pdev->irq, dev->dev_addr);
-	pcie_print_link_status(bp->pdev);
 
 	bnx2x_register_phc(bp);
 
Signature · 1 line
2.17.1
#9 lore raw

PATCH 3/9 bnxt_en: Do not call pcie_print_link_status()

In reply to Alexandru Gagniuc

This is now done by the PCI core to warn of sub-optimal bandwidth.

---
 drivers/net/ethernet/broadcom/bnxt/bnxt.c | 1 -
 1 file changed, 1 deletion(-)
drivers/net/ethernet/broadcom/bnxt/bnxt.c +0 -1
index 8bb1e38b1681..246f33d2cc9c 100644
@@ -9046,7 +9046,6 @@ static int bnxt_init_one(struct pci_dev *pdev, const struct pci_device_id *ent)
 	netdev_info(dev, "%s found at mem %lx, node addr %pM\n",
 		    board_info[ent->driver_data].name,
 		    (long)pci_resource_start(pdev, 0), dev->dev_addr);
-	pcie_print_link_status(pdev);
 
 	return 0;
 
Signature · 1 line
2.17.1
#10 lore raw

PATCH 4/9 cxgb4: Do not call pcie_print_link_status()

In reply to Alexandru Gagniuc

This is now done by the PCI core to warn of sub-optimal bandwidth.

---
 drivers/net/ethernet/chelsio/cxgb4/cxgb4_main.c | 3 ---
 1 file changed, 3 deletions(-)
drivers/net/ethernet/chelsio/cxgb4/cxgb4_main.c +0 -3
index 961e3087d1d3..1deb68c99a63 100644
@@ -5782,9 +5782,6 @@ static int init_one(struct pci_dev *pdev, const struct pci_device_id *ent)
 			free_msix_info(adapter);
 	}
 
-	/* check for PCI Express bandwidth capabiltites */
-	pcie_print_link_status(pdev);
-
 	err = init_rss(adapter);
 	if (err)
 		goto out_free_dev;
Signature · 1 line
2.17.1
#11 lore raw

PATCH 5/9 fm10k: Do not call pcie_print_link_status()

In reply to Alexandru Gagniuc

This is now done by the PCI core to warn of sub-optimal bandwidth.

---
 drivers/net/ethernet/intel/fm10k/fm10k_pci.c | 3 ---
 1 file changed, 3 deletions(-)
drivers/net/ethernet/intel/fm10k/fm10k_pci.c +0 -3
index 15071e4adb98..079fd3c884ea 100644
@@ -2224,9 +2224,6 @@ static int fm10k_probe(struct pci_dev *pdev, const struct pci_device_id *ent)
 	/* kick off service timer now, even when interface is down */
 	mod_timer(&interface->service_timer, (HZ * 2) + jiffies);
 
-	/* print warning for non-optimal configurations */
-	pcie_print_link_status(interface->pdev);
-
 	/* report MAC address for logging */
 	dev_info(&pdev->dev, "%pM\n", netdev->dev_addr);
 
Signature · 1 line
2.17.1
#12 lore raw

PATCH 6/9 ixgbe: Do not call pcie_print_link_status()

In reply to Alexandru Gagniuc

This is now done by the PCI core to warn of sub-optimal bandwidth.

---
 drivers/net/ethernet/intel/ixgbe/ixgbe_main.c | 26 -------------------
 1 file changed, 26 deletions(-)
drivers/net/ethernet/intel/ixgbe/ixgbe_main.c +0 -26
index 9a23d33a47ed..9663419e0ceb 100644
@@ -241,28 +241,6 @@ static inline bool ixgbe_pcie_from_parent(struct ixgbe_hw *hw)
 	}
 }
 
-static void ixgbe_check_minimum_link(struct ixgbe_adapter *adapter,
-				     int expected_gts)
-{
-	struct ixgbe_hw *hw = &adapter->hw;
-	struct pci_dev *pdev;
-
-	/* Some devices are not connected over PCIe and thus do not negotiate
-	 * speed. These devices do not have valid bus info, and thus any report
-	 * we generate may not be correct.
-	 */
-	if (hw->bus.type == ixgbe_bus_type_internal)
-		return;
-
-	/* determine whether to use the parent device */
-	if (ixgbe_pcie_from_parent(&adapter->hw))
-		pdev = adapter->pdev->bus->parent->self;
-	else
-		pdev = adapter->pdev;
-
-	pcie_print_link_status(pdev);
-}
-
 static void ixgbe_service_event_schedule(struct ixgbe_adapter *adapter)
 {
 	if (!test_bit(__IXGBE_DOWN, &adapter->state) &&
@@ -10792,10 +10770,6 @@ static int ixgbe_probe(struct pci_dev *pdev, const struct pci_device_id *ent)
 		break;
 	}
 
-	/* don't check link if we failed to enumerate functions */
-	if (expected_gts > 0)
-		ixgbe_check_minimum_link(adapter, expected_gts);
-
 	err = ixgbe_read_pba_string_generic(hw, part_str, sizeof(part_str));
 	if (err)
 		strlcpy(part_str, "Unknown", sizeof(part_str));
Signature · 1 line
2.17.1
#13 lore raw

PATCH 7/9 net/mlx4: Do not call pcie_print_link_status()

In reply to Alexandru Gagniuc

This is now done by the PCI core to warn of sub-optimal bandwidth.

---
 drivers/net/ethernet/mellanox/mlx4/main.c | 7 -------
 1 file changed, 7 deletions(-)
drivers/net/ethernet/mellanox/mlx4/main.c +0 -7
index d2d59444f562..9902fa3a2c13 100644
@@ -3525,13 +3525,6 @@ static int mlx4_load_one(struct pci_dev *pdev, int pci_dev_data,
 		}
 	}
 
-	/* check if the device is functioning at its maximum possible speed.
-	 * No return code for this call, just warn the user in case of PCI
-	 * express device capabilities are under-satisfied by the bus.
-	 */
-	if (!mlx4_is_slave(dev))
-		pcie_print_link_status(dev->persist->pdev);
-
 	/* In master functions, the communication channel must be initialized
 	 * after obtaining its address from fw */
 	if (mlx4_is_master(dev)) {
Signature · 1 line
2.17.1
Acked-by on v1 7/9
#14 lore raw

Re: [PATCH 7/9] net/mlx4: Do not call pcie_print_link_status()

Quoted 7 lines · Alexandru Gagniuc

This is now done by the PCI core to warn of sub-optimal bandwidth.

---
 drivers/net/ethernet/mellanox/mlx4/main.c | 7 -------
 1 file changed, 7 deletions(-)

Thanks,

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 801 bytes
Desc: not available
URL: <http://lists.osuosl.org/pipermail/intel-wired-lan/attachments/20180904/ac23a18e/attachment-0001.asc>

#15 lore raw

PATCH 8/9 net/mlx5: Do not call pcie_print_link_status()

In reply to Alexandru Gagniuc

This is now done by the PCI core to warn of sub-optimal bandwidth.

---
 drivers/net/ethernet/mellanox/mlx5/core/main.c | 4 ----
 1 file changed, 4 deletions(-)
drivers/net/ethernet/mellanox/mlx5/core/main.c +0 -4
index cf3e4a659052..888af98694f8 100644
@@ -1056,10 +1056,6 @@ static int mlx5_load_one(struct mlx5_core_dev *dev, struct mlx5_priv *priv,
 	dev_info(&pdev->dev, "firmware version: %d.%d.%d\n", fw_rev_maj(dev),
 		 fw_rev_min(dev), fw_rev_sub(dev));
 
-	/* Only PFs hold the relevant PCIe information for this query */
-	if (mlx5_core_is_pf(dev))
-		pcie_print_link_status(dev->pdev);
-
 	/* on load removing any previous indication of internal error, device is
 	 * up
 	 */
Signature · 1 line
2.17.1
Acked-by on v1 8/9
#16 lore raw

Re: [PATCH 8/9] net/mlx5: Do not call pcie_print_link_status()

Quoted 7 lines · Alexandru Gagniuc

This is now done by the PCI core to warn of sub-optimal bandwidth.

---
 drivers/net/ethernet/mellanox/mlx5/core/main.c | 4 ----
 1 file changed, 4 deletions(-)

Thanks,

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 801 bytes
Desc: not available
URL: <http://lists.osuosl.org/pipermail/intel-wired-lan/attachments/20180904/a8949bfa/attachment-0001.asc>

#17 lore raw

PATCH 9/9 nfp: Do not call pcie_print_link_status()

In reply to Alexandru Gagniuc

This is now done by the PCI core to warn of sub-optimal bandwidth.

---
 drivers/net/ethernet/netronome/nfp/nfpcore/nfp6000_pcie.c | 1 -
 1 file changed, 1 deletion(-)
drivers/net/ethernet/netronome/nfp/nfpcore/nfp6000_pcie.c +0 -1
index c8d0b1016a64..87dde0f787e9 100644
@@ -1328,7 +1328,6 @@ struct nfp_cpp *nfp_cpp_from_nfp6000_pcie(struct pci_dev *pdev)
 	/*  Finished with card initialization. */
 	dev_info(&pdev->dev,
 		 "Netronome Flow Processor NFP4000/NFP6000 PCIe Card Probe\n");
-	pcie_print_link_status(pdev);
 
 	nfp = kzalloc(sizeof(*nfp), GFP_KERNEL);
 	if (!nfp) {
Signature · 1 line
2.17.1