Skip to contentSkip to conversation

drm/radeon: insist on 32-bit DMA for Cedar

PATCH In review Ben Crocker 8 participants 16 messages Feb 21, 2018 – Feb 23, 2018 9 messages not in the archive

Subsystems (2)
lore
Share & tools
lore
#0 lore raw

PATCH 1/1 drm/radeon: insist on 32-bit DMA for Cedar

In radeon_device_init, set the need_dma32 flag for Cedar chips (e.g. FirePro 2270). This fixes, or at least works around, a bug on PowerPC exposed by last year's commits

8e3f1b1d8255105f31556aacf8aeb6071b00d469 (Russell Currey)

and

253fd51e2f533552ae35a0c661705da6c4842c1b (Alistair Popple)

which enabled the 64-bit DMA iommu bypass.

This caused the device to freeze, in some cases unrecoverably, and is the subject of several bug reports internal to Red Hat.

---
 drivers/gpu/drm/radeon/radeon_device.c | 5 ++++-
 1 file changed, 4 insertions(+), 1 deletion(-)
drivers/gpu/drm/radeon/radeon_device.c +4 -1
index ffc10cadcf34..02538903830d 100644
@@ -1395,7 +1395,10 @@ int radeon_device_init(struct radeon_device *rdev,
 	if (rdev->flags & RADEON_IS_AGP)
 		rdev->need_dma32 = true;
 	if ((rdev->flags & RADEON_IS_PCI) &&
-	    (rdev->family <= CHIP_RS740))
+	    (rdev->family <= CHIP_RS740 || rdev->family == CHIP_CEDAR))
+		rdev->need_dma32 = true;
+	if ((rdev->flags & RADEON_IS_PCIE) &&
+	    (rdev->family == CHIP_CEDAR))
 		rdev->need_dma32 = true;
 
 	dma_bits = rdev->need_dma32 ? 32 : 40;
Signature · 6 lines
2.13.6

_______________________________________________
dri-devel mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/dri-devel

A message that is not in the archive (sent off-list or not yet received): 20180221234154.6877-1-bcrocker-H+wXaHxf7aLQT0dZR+AlfA@public.gmane.org

#2 lore raw
Quoted 6 lines · Ben Crocker

In radeon_device_init, set the need_dma32 flag for Cedar chips (e.g. FirePro 2270). This fixes, or at least works around, a bug on PowerPC exposed by last year's commits

8e3f1b1d8255105f31556aacf8aeb6071b00d469 (Russell Currey)

Quoted 8 lines

and

253fd51e2f533552ae35a0c661705da6c4842c1b (Alistair Popple)

which enabled the 64-bit DMA iommu bypass.

This caused the device to freeze, in some cases unrecoverably, and is the subject of several bug reports internal to Red Hat.

Can we make this ppc only? 40 bit DMA works fine on x86.

Alex

Quoted 25 lines
---
 drivers/gpu/drm/radeon/radeon_device.c | 5 ++++-
 1 file changed, 4 insertions(+), 1 deletion(-)
drivers/gpu/drm/radeon/radeon_device.c +4 -2
index ffc10cadcf34..02538903830d 100644
@@ -1395,7 +1395,10 @@ int radeon_device_init(struct radeon_device *rdev,
        if (rdev->flags & RADEON_IS_AGP)
                rdev->need_dma32 = true;
        if ((rdev->flags & RADEON_IS_PCI) &&
-           (rdev->family <= CHIP_RS740))
+           (rdev->family <= CHIP_RS740 || rdev->family == CHIP_CEDAR))
+               rdev->need_dma32 = true;
+       if ((rdev->flags & RADEON_IS_PCIE) &&
+           (rdev->family == CHIP_CEDAR))
                rdev->need_dma32 = true;
 
        dma_bits = rdev->need_dma32 ? 32 : 40;
--

2.13.6

Quoted 4 lines

_______________________________________________
dri-devel mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/dri-devel

_______________________________________________
amd-gfx mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/amd-gfx

A message that is not in the archive (sent off-list or not yet received): CADnq5_M8ZiV2b+LW5oKu0XSQOJvg9idvZ6eBOaHMJRPC2iMj3w-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org

#4 lore raw

Am 22.02.2018 um 03:05 schrieb Alex Deucher:

Quoted 9 lines · Ben Crocker
Quoted 8 lines

In radeon_device_init, set the need_dma32 flag for Cedar chips (e.g. FirePro 2270). This fixes, or at least works around, a bug on PowerPC exposed by last year's commits

8e3f1b1d8255105f31556aacf8aeb6071b00d469 (Russell Currey)

and

Quoted 7 lines
Quoted 6 lines

253fd51e2f533552ae35a0c661705da6c4842c1b (Alistair Popple)

which enabled the 64-bit DMA iommu bypass.

This caused the device to freeze, in some cases unrecoverably, and is the subject of several bug reports internal to Red Hat.

Can we make this ppc only? 40 bit DMA works fine on x86.

Yeah and at least when the dma_coherent allocator path is used it should work fine on PPC as well.

So that is not really a driver bug, but a platform bug and we should think about reverting or at least disabling those two patches instead.

Christian.

Quoted 27 lines

Alex

Quoted 24 lines
---
  drivers/gpu/drm/radeon/radeon_device.c | 5 ++++-
  1 file changed, 4 insertions(+), 1 deletion(-)
drivers/gpu/drm/radeon/radeon_device.c +4 -2
index ffc10cadcf34..02538903830d 100644
@@ -1395,7 +1395,10 @@ int radeon_device_init(struct radeon_device *rdev,
         if (rdev->flags & RADEON_IS_AGP)
                 rdev->need_dma32 = true;
         if ((rdev->flags & RADEON_IS_PCI) &&
-           (rdev->family <= CHIP_RS740))
+           (rdev->family <= CHIP_RS740 || rdev->family == CHIP_CEDAR))
+               rdev->need_dma32 = true;
+       if ((rdev->flags & RADEON_IS_PCIE) &&
+           (rdev->family == CHIP_CEDAR))
                 rdev->need_dma32 = true;
 
         dma_bits = rdev->need_dma32 ? 32 : 40;
--

2.13.6

Quoted 8 lines
Quoted 4 lines

_______________________________________________
dri-devel mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/dri-devel

_______________________________________________
amd-gfx mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/amd-gfx

_______________________________________________
amd-gfx mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/amd-gfx

A message that is not in the archive (sent off-list or not yet received): 7d6a06dc-9e88-2427-ec6a-4f48b9aa8f6b-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org

#6 lore raw

Alex, Christian, et al.

Thanks for your rapid response!

I can certainly make the change PPC-only (#ifdef CONFIG_PPC64...) and I think
that's the safest way to go right now. It makes the patch very specific to Cedar
on PowerPC64, so it doesn't break anything that may have come to depend on Russell's and Alistair's changes, and my timetable for getting a fix in is very short.

-- Ben

Quoted 22 lines · Christian König

Am 22.02.2018 um 03:05 schrieb Alex Deucher:

Quoted 10 lines · Ben Crocker
Quoted 9 lines

In radeon_device_init, set the need_dma32 flag for Cedar chips (e.g. FirePro 2270). This fixes, or at least works around, a bug on PowerPC exposed by last year's commits

8e3f1b1d8255105f31556aacf8aeb6071b00d469 (Russell Currey)

and

Quoted 9 lines
Quoted 7 lines

253fd51e2f533552ae35a0c661705da6c4842c1b (Alistair Popple)

which enabled the 64-bit DMA iommu bypass.

This caused the device to freeze, in some cases unrecoverably, and is the subject of several bug reports internal to Red Hat.

Can we make this ppc only? 40 bit DMA works fine on x86.

Quoted 48 lines

Yeah and at least when the dma_coherent allocator path is used it should work fine on PPC as well.

So that is not really a driver bug, but a platform bug and we should think about reverting or at least disabling those two patches instead.

Christian.

Quoted 37 lines

Alex

Quoted 24 lines
---
  drivers/gpu/drm/radeon/radeon_device.c | 5 ++++-
  1 file changed, 4 insertions(+), 1 deletion(-)
drivers/gpu/drm/radeon/radeon_device.c +4 -2
index ffc10cadcf34..02538903830d 100644
@@ -1395,7 +1395,10 @@ int radeon_device_init(struct radeon_device *rdev,
         if (rdev->flags & RADEON_IS_AGP)
                 rdev->need_dma32 = true;
         if ((rdev->flags & RADEON_IS_PCI) &&
-           (rdev->family <= CHIP_RS740))
+           (rdev->family <= CHIP_RS740 || rdev->family == CHIP_CEDAR))
+               rdev->need_dma32 = true;
+       if ((rdev->flags & RADEON_IS_PCIE) &&
+           (rdev->family == CHIP_CEDAR))
                 rdev->need_dma32 = true;
 
         dma_bits = rdev->need_dma32 ? 32 : 40;
--

2.13.6

Quoted 5 lines

_______________________________________________
dri-devel mailing list [email protected]
https://lists.freedesktop.org/mailman/listinfo/dri-devel

_______________________________________________
amd-gfx mailing list [email protected]
https://lists.freedesktop.org/mailman/listinfo/amd-gfx

_______________________________________________
amd-gfx mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/amd-gfx

A message that is not in the archive (sent off-list or not yet received): CALk+eRcPH+g-eBMKWyO4FrPwuc_VLnp_w89WYKNE51=iV5Y=wg-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org

#8 lore raw
Quoted 11 lines · Ben Crocker

Alex, Christian, et al.

Thanks for your rapid response!

I can certainly make the change PPC-only (#ifdef CONFIG_PPC64...) and I think
that's the safest way to go right now. It makes the patch very specific to Cedar
on PowerPC64, so it doesn't break anything that may have come to depend on Russell's and Alistair's changes, and my timetable for getting a fix in is very short.

If you want to go this route, you might just set need_dma32 unconditionally for PPC64. The bus interface hw is pretty much the same across all asics in this time period.

Alex

Quoted 79 lines

-- Ben

Quoted 71 lines · Christian König

Am 22.02.2018 um 03:05 schrieb Alex Deucher:

Quoted 11 lines · Ben Crocker
Quoted 9 lines

In radeon_device_init, set the need_dma32 flag for Cedar chips (e.g. FirePro 2270). This fixes, or at least works around, a bug on PowerPC exposed by last year's commits

8e3f1b1d8255105f31556aacf8aeb6071b00d469 (Russell Currey)

and

Quoted 8 lines
Quoted 6 lines

253fd51e2f533552ae35a0c661705da6c4842c1b (Alistair Popple)

which enabled the 64-bit DMA iommu bypass.

This caused the device to freeze, in some cases unrecoverably, and is the subject of several bug reports internal to Red Hat.

Can we make this ppc only? 40 bit DMA works fine on x86.

Yeah and at least when the dma_coherent allocator path is used it should work fine on PPC as well.

So that is not really a driver bug, but a platform bug and we should think about reverting or at least disabling those two patches instead.

Christian.

Quoted 38 lines

Alex

Quoted 23 lines
---
  drivers/gpu/drm/radeon/radeon_device.c | 5 ++++-
  1 file changed, 4 insertions(+), 1 deletion(-)
drivers/gpu/drm/radeon/radeon_device.c +4 -1
index ffc10cadcf34..02538903830d 100644
@@ -1395,7 +1395,10 @@ int radeon_device_init(struct radeon_device
 *rdev,
         if (rdev->flags & RADEON_IS_AGP)
                 rdev->need_dma32 = true;
         if ((rdev->flags & RADEON_IS_PCI) &&
-           (rdev->family <= CHIP_RS740))
+           (rdev->family <= CHIP_RS740 || rdev->family == CHIP_CEDAR))
+               rdev->need_dma32 = true;
+       if ((rdev->flags & RADEON_IS_PCIE) &&
+           (rdev->family == CHIP_CEDAR))
                 rdev->need_dma32 = true;
 
         dma_bits = rdev->need_dma32 ? 32 : 40;
Quoted 7 lines

--
2.13.6

_______________________________________________
dri-devel mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/dri-devel

_______________________________________________
amd-gfx mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/amd-gfx

_______________________________________________
amd-gfx mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/amd-gfx

#9 lore raw

I considered that, but I'm only equipped to test on a few cards--the ones IBM is interested in.
So this Cedar-specific change fixes the problem on the FirePro 2270; the other cards seem
perfectly capable of handling 40+ bit DMA addresses on the Power8 platform.

Quoted 105 lines · Alex Deucher
Quoted 7 lines · Ben Crocker

Alex, Christian, et al.

Thanks for your rapid response!

I can certainly make the change PPC-only (#ifdef CONFIG_PPC64...) and I think
that's the safest way to go right now. It makes the patch very specific

to

Quoted 2 lines

Cedar
on PowerPC64, so it doesn't break anything that may have come to depend

on

Quoted 1 line

Russell's and Alistair's changes, and my timetable for getting a fix in

is

Quoted 1 line

very short.

If you want to go this route, you might just set need_dma32 unconditionally for PPC64. The bus interface hw is pretty much the same across all asics in this time period.

Alex

Quoted 11 lines

-- Ben

Quoted 4 lines · Christian König

Am 22.02.2018 um 03:05 schrieb Alex Deucher:

Quoted 2 lines

On Wed, Feb 21, 2018 at 6:41 PM, Ben Crocker <[email protected]>

Quoted 16 lines · wrote:
Quoted 16 lines
Quoted 16 lines
Quoted 15 lines

In radeon_device_init, set the need_dma32 flag for Cedar chips (e.g. FirePro 2270). This fixes, or at least works around, a bug on PowerPC exposed by last year's commits

8e3f1b1d8255105f31556aacf8aeb6071b00d469 (Russell Currey)

and

253fd51e2f533552ae35a0c661705da6c4842c1b (Alistair Popple)

which enabled the 64-bit DMA iommu bypass.

This caused the device to freeze, in some cases unrecoverably, and is the subject of several bug reports internal to Red Hat.

Quoted 7 lines
Quoted 7 lines
Quoted 1 line

Can we make this ppc only? 40 bit DMA works fine on x86.

Yeah and at least when the dma_coherent allocator path is used it should work fine on PPC as well.

So that is not really a driver bug, but a platform bug and we should

think

Quoted 12 lines
Quoted 12 lines

about reverting or at least disabling those two patches instead.

Christian.

Quoted 8 lines

Alex

Quoted 5 lines
---
  drivers/gpu/drm/radeon/radeon_device.c | 5 ++++-
  1 file changed, 4 insertions(+), 1 deletion(-)
Quoted 12 lines
Quoted 4 lines
Quoted 4 lines
Quoted 4 lines
drivers/gpu/drm/radeon/radeon_device.c +0 -1
index ffc10cadcf34..02538903830d 100644
--- a/drivers/gpu/drm/radeon/radeon_device.c
Quoted 8 lines
Quoted 8 lines

drivers/gpu/drm/radeon/radeon_device.c int radeon_device_init(struct radeon_device · line 1399

Quoted 8 lines

+++ b/drivers/gpu/drm/radeon/radeon_device.c

drivers/gpu/drm/radeon/radeon_device.c +1 -1
@@ -1395,7 +1395,10 @@ int radeon_device_init(struct radeon_device
 *rdev,
         if (rdev->flags & RADEON_IS_AGP)
                 rdev->need_dma32 = true;
         if ((rdev->flags & RADEON_IS_PCI) &&
-           (rdev->family <= CHIP_RS740))
+           (rdev->family <= CHIP_RS740 || rdev->family ==

CHIP_CEDAR))

Quoted 14 lines
Quoted 14 lines
Quoted 14 lines
Quoted 13 lines
drivers/gpu/drm/radeon/radeon_device.c +3 -0
+               rdev->need_dma32 = true;
+       if ((rdev->flags & RADEON_IS_PCIE) &&
+           (rdev->family == CHIP_CEDAR))
                 rdev->need_dma32 = true;
 
         dma_bits = rdev->need_dma32 ? 32 : 40;

--
2.13.6

_______________________________________________
dri-devel mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/dri-devel

Quoted 7 lines
Quoted 6 lines
Quoted 4 lines

_______________________________________________
amd-gfx mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/amd-gfx

Quoted 5 lines

_______________________________________________
amd-gfx mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/amd-gfx

_______________________________________________
dri-devel mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/dri-devel

#10 lore raw
Quoted 5 lines · Ben Crocker

I considered that, but I'm only equipped to test on a few cards--the ones IBM is interested in.
So this Cedar-specific change fixes the problem on the FirePro 2270; the other cards seem
perfectly capable of handling 40+ bit DMA addresses on the Power8 platform.

Which other cards?

Alex

Quoted 111 lines
Quoted 107 lines · Alex Deucher
Quoted 4 lines · Ben Crocker

Alex, Christian, et al.

Thanks for your rapid response!

Quoted 10 lines

I can certainly make the change PPC-only (#ifdef CONFIG_PPC64...) and I think
that's the safest way to go right now. It makes the patch very specific to
Cedar
on PowerPC64, so it doesn't break anything that may have come to depend on
Russell's and Alistair's changes, and my timetable for getting a fix in is
very short.

If you want to go this route, you might just set need_dma32 unconditionally for PPC64. The bus interface hw is pretty much the same across all asics in this time period.

Alex

Quoted 83 lines

-- Ben

Quoted 75 lines · Christian König

Am 22.02.2018 um 03:05 schrieb Alex Deucher:

Quoted 12 lines
Quoted 9 lines · Ben Crocker

In radeon_device_init, set the need_dma32 flag for Cedar chips (e.g. FirePro 2270). This fixes, or at least works around, a bug on PowerPC exposed by last year's commits

8e3f1b1d8255105f31556aacf8aeb6071b00d469 (Russell Currey)

and

Quoted 8 lines
Quoted 6 lines

253fd51e2f533552ae35a0c661705da6c4842c1b (Alistair Popple)

which enabled the 64-bit DMA iommu bypass.

This caused the device to freeze, in some cases unrecoverably, and is the subject of several bug reports internal to Red Hat.

Can we make this ppc only? 40 bit DMA works fine on x86.

Yeah and at least when the dma_coherent allocator path is used it should
work fine on PPC as well.

So that is not really a driver bug, but a platform bug and we should think
about reverting or at least disabling those two patches instead.

Christian.

Quoted 39 lines

Alex

Quoted 23 lines
---
  drivers/gpu/drm/radeon/radeon_device.c | 5 ++++-
  1 file changed, 4 insertions(+), 1 deletion(-)
drivers/gpu/drm/radeon/radeon_device.c +4 -1
index ffc10cadcf34..02538903830d 100644
@@ -1395,7 +1395,10 @@ int radeon_device_init(struct radeon_device
 *rdev,
         if (rdev->flags & RADEON_IS_AGP)
                 rdev->need_dma32 = true;
         if ((rdev->flags & RADEON_IS_PCI) &&
-           (rdev->family <= CHIP_RS740))
+           (rdev->family <= CHIP_RS740 || rdev->family ==
 CHIP_CEDAR))
+               rdev->need_dma32 = true;
+       if ((rdev->flags & RADEON_IS_PCIE) &&
+           (rdev->family == CHIP_CEDAR))
                 rdev->need_dma32 = true;
Quoted 8 lines
         dma_bits = rdev->need_dma32 ? 32 : 40;

--
2.13.6

_______________________________________________
dri-devel mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/dri-devel

_______________________________________________
amd-gfx mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/amd-gfx

Quoted 6 lines
Quoted 4 lines

_______________________________________________
amd-gfx mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/amd-gfx

_______________________________________________
dri-devel mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/dri-devel

#11 lore raw

PATCH 1/1 drm/radeon: insist on 32-bit DMA for Cedar on PPC64/PPC64LE

In reply to Ben Crocker

In radeon_device_init, set the need_dma32 flag for Cedar chips (e.g. FirePro 2270). This fixes, or at least works around, a bug on PowerPC exposed by last year's commits

8e3f1b1d8255105f31556aacf8aeb6071b00d469 (Russell Currey)

and

253fd51e2f533552ae35a0c661705da6c4842c1b (Alistair Popple)

which enabled the 64-bit DMA iommu bypass.

This caused the device to freeze, in some cases unrecoverably, and is the subject of several bug reports internal to Red Hat.

---
 drivers/gpu/drm/radeon/radeon_device.c | 5 +++++
 1 file changed, 5 insertions(+)
drivers/gpu/drm/radeon/radeon_device.c +5 -0
index ffc10cadcf34..ba7435bcd208 100644
@@ -1397,6 +1397,11 @@ int radeon_device_init(struct radeon_device *rdev,
 	if ((rdev->flags & RADEON_IS_PCI) &&
 	    (rdev->family <= CHIP_RS740))
 		rdev->need_dma32 = true;
+#ifdef CONFIG_PPC64
+	if ((rdev->flags & (RADEON_IS_PCI | RADEON_IS_PCIE)) &&
+	    (rdev->family == CHIP_CEDAR))
+		rdev->need_dma32 = true;
+#endif
 
 	dma_bits = rdev->need_dma32 ? 32 : 40;
 	r = pci_set_dma_mask(rdev->pdev, DMA_BIT_MASK(dma_bits));
Signature · 6 lines
2.13.6

_______________________________________________
dri-devel mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/dri-devel
#12 lore raw

Re: [PATCH] drm/radeon: insist on 32-bit DMA for Cedar on PPC64/PPC64LE

Quoted 25 lines · Ben Crocker

In radeon_device_init, set the need_dma32 flag for Cedar chips (e.g. FirePro 2270). This fixes, or at least works around, a bug on PowerPC exposed by last year's commits

8e3f1b1d8255105f31556aacf8aeb6071b00d469 (Russell Currey)

and

253fd51e2f533552ae35a0c661705da6c4842c1b (Alistair Popple)

which enabled the 64-bit DMA iommu bypass.

This caused the device to freeze, in some cases unrecoverably, and is the subject of several bug reports internal to Red Hat.

---
 drivers/gpu/drm/radeon/radeon_device.c | 5 +++++
 1 file changed, 5 insertions(+)
drivers/gpu/drm/radeon/radeon_device.c +0 -0
index ffc10cadcf34..ba7435bcd208 100644

drivers/gpu/drm/radeon/radeon_device.c int radeon_device_init(struct radeon_device *rdev, · line 1401

Quoted 5 lines
drivers/gpu/drm/radeon/radeon_device.c +2 -0
@@ -1397,6 +1397,11 @@ int radeon_device_init(struct radeon_device *rdev,
 	if ((rdev->flags & RADEON_IS_PCI) &&
 	    (rdev->family <= CHIP_RS740))
 		rdev->need_dma32 = true;
+#ifdef CONFIG_PPC64
+	if ((rdev->flags & (RADEON_IS_PCI | RADEON_IS_PCIE)) &&

Cedar is (like all Radeons from the last decade) always PCIe, so this flags check is redundant FWIW.

Signature · 6 lines
Earthling Michel Dänzer               |               http://www.amd.com
Libre software enthusiast             |             Mesa and X developer
_______________________________________________
dri-devel mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/dri-devel
#13 lore raw

Re: [PATCH] drm/radeon: insist on 32-bit DMA for Cedar on PPC64/PPC64LE

One of my colleagues did discover a "Radeon HG 5450 PCI" from February 2010 which did, apparently, have a Cedar GPU and very definitely had a (plain old) PCI connector.

But I take your point, and will just drop the PCI/PCIE check.

Quoted 37 lines · Michel Dänzer
Quoted 15 lines · Ben Crocker

In radeon_device_init, set the need_dma32 flag for Cedar chips (e.g. FirePro 2270). This fixes, or at least works around, a bug on PowerPC exposed by last year's commits

8e3f1b1d8255105f31556aacf8aeb6071b00d469 (Russell Currey)

and

253fd51e2f533552ae35a0c661705da6c4842c1b (Alistair Popple)

which enabled the 64-bit DMA iommu bypass.

This caused the device to freeze, in some cases unrecoverably, and is the subject of several bug reports internal to Red Hat.

Review

Quoted 6 lines
---
 drivers/gpu/drm/radeon/radeon_device.c | 5 +++++
 1 file changed, 5 insertions(+)
(quoted diff) +0 -0

b/drivers/gpu/drm/radeon/radeon_device.c

drivers/gpu/drm/radeon/radeon_device.c int radeon_device_init(struct radeon_device *rdev, · line 1401

Quoted 9 lines

index ffc10cadcf34..ba7435bcd208 100644

drivers/gpu/drm/radeon/radeon_device.c +2 -0
@@ -1397,6 +1397,11 @@ int radeon_device_init(struct radeon_device *rdev,
      if ((rdev->flags & RADEON_IS_PCI) &&
          (rdev->family <= CHIP_RS740))
              rdev->need_dma32 = true;
+#ifdef CONFIG_PPC64
+     if ((rdev->flags & (RADEON_IS_PCI | RADEON_IS_PCIE)) &&

Cedar is (like all Radeons from the last decade) always PCIe, so this flags check is redundant FWIW.

Quoted 8 lines

--
Earthling Michel Dänzer | http://www.amd.com
Libre software enthusiast | Mesa and X developer
_______________________________________________
amd-gfx mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/amd-gfx

_______________________________________________
dri-devel mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/dri-devel

A message that is not in the archive (sent off-list or not yet received): CALk+eRew=1nHZXRtXR430eFStOiQFUDgrp8VfsBAfcp8W9qAOA-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org

#15 lore raw

Re: [PATCH] drm/radeon: insist on 32-bit DMA for Cedar on PPC64/PPC64LE

Quoted 3 lines · Ben Crocker

One of my colleagues did discover a "Radeon HG 5450 PCI" from February 2010 which did, apparently, have a Cedar GPU and very definitely had a (plain old) PCI connector.

There must be a PCIe-to-PCI bridge on that board. The GPU itself is always PCIe, and treated accordingly by the driver.

Signature · 6 lines
Earthling Michel Dänzer               |               http://www.amd.com
Libre software enthusiast             |             Mesa and X developer
_______________________________________________
amd-gfx mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/amd-gfx

A message that is not in the archive (sent off-list or not yet received): CALk+eRc+EOry_G6Ovy0Z-pvE7jQWy5gSx+1kpHA4q3A0oEZs1w@mail.gmail.com

A message that is not in the archive (sent off-list or not yet received): CALk+eRc+EOry_G6Ovy0Z-pvE7jQWy5gSx+1kpHA4q3A0oEZs1w-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org

#18 lore raw

Re: [PATCH] drm/radeon: insist on 32-bit DMA for Cedar on PPC64/PPC64LE

Alex asked what other GPUs I've tested on, and the answer is: E6465 (Caicos GPU).

-- Ben

Quoted 6 lines · Ben Crocker

I think that last version I sent a few minutes ago is final form, now. Thanks for all your help!

If there's anything you could do to expedite posting this patch to the main repo, that would be GREATLY appreciated!

Quoted 22 lines

-- Thanks,
Ben

Quoted 13 lines · Michel Dänzer
Quoted 3 lines · Ben Crocker

One of my colleagues did discover a "Radeon HG 5450 PCI" from February 2010 which did, apparently, have a Cedar GPU and very definitely had a (plain old) PCI connector.

There must be a PCIe-to-PCI bridge on that board. The GPU itself is always PCIe, and treated accordingly by the driver.

--
Earthling Michel Dänzer | http://www.amd.com
Libre software enthusiast | Mesa and X developer

_______________________________________________
amd-gfx mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/amd-gfx

A message that is not in the archive (sent off-list or not yet received): CALk+eReghDHuv23-62pD0PbdBt6p+g_XeE+_c2gRdkoaOQh+CQ-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org

#20 lore raw

Re: [PATCH] drm/radeon: insist on 32-bit DMA for Cedar on PPC64/PPC64LE

That's what IBM is most interested in at this juncture:
FirePro 2270
Embedded Radeon E6465

The E6465 already worked without this patch.

Quoted 37 lines · Ben Crocker

Alex asked what other GPUs I've tested on, and the answer is: E6465 (Caicos GPU).

-- Ben

Quoted 28 lines · Ben Crocker

I think that last version I sent a few minutes ago is final form, now. Thanks for all your help!

If there's anything you could do to expedite posting this patch to the main repo, that would be GREATLY appreciated!

-- Thanks,
Ben

Quoted 13 lines · Michel Dänzer
Quoted 3 lines · Ben Crocker

One of my colleagues did discover a "Radeon HG 5450 PCI" from February 2010 which did, apparently, have a Cedar GPU and very definitely had a (plain old) PCI connector.

There must be a PCIe-to-PCI bridge on that board. The GPU itself is always PCIe, and treated accordingly by the driver.

--
Earthling Michel Dänzer | http://www.amd.com
Libre software enthusiast | Mesa and X developer

_______________________________________________
amd-gfx mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/amd-gfx

A message that is not in the archive (sent off-list or not yet received): 1bcf5b27-aa25-deb6-85e9-161dd038276b-otUistvHUpPR7s880joybQ@public.gmane.org

#22 lore raw

Re: [PATCH] drm/radeon: insist on 32-bit DMA for Cedar on PPC64/PPC64LE

Am 22.02.2018 um 18:56 schrieb Michel Dänzer:

Quoted 6 lines · Ben Crocker
Quoted 3 lines

One of my colleagues did discover a "Radeon HG 5450 PCI" from February 2010 which did, apparently, have a Cedar GPU and very definitely had a (plain old) PCI connector.

There must be a PCIe-to-PCI bridge on that board. The GPU itself is always PCIe, and treated accordingly by the driver.

Ben, just an educated guess but is this one the one which is failing to work correctly?

Cause the PCIe bus interface is pretty much identical over all generations of the last decade or so. Only the newest Vega10 generation is a bit different.

So I strongly thing that this isn't related to the device being a Cedar at all, but rather that you have a bridge above it which doesn't correctly handle 64bit transfers.

Can you please send and "lspci -t" of both the working and the problematic devices?

Thanks,
Christian.
_______________________________________________
amd-gfx mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/amd-gfx

#23 lore raw

Re: [PATCH] drm/radeon: insist on 32-bit DMA for Cedar on PPC64/PPC64LE

Hi Christian, Michel, Alex, et al.,

I mentioned the HD 5450 purely as a matter of archeological interest.

Back to the FirePro 2270 and Embedded Radeon E6465:

I've attached text from both "lspci -tv" and "lspci -v." Actually I'm attaching a couple of different "lspci -v" outputs, one with the FirePro 2270 in place and one with the E6465 in (the same) place.

I suspected, but couldn't prove, that the problem might have something to do with the bridge (IBM POWER8 Host Bridge (PHB3)).

But I want to reiterate:

- Cedar GPU -> problem (before patch, that is);
- Caicos GPU in the same slot -> no problem

-- Ben

P.S. Alex, thanks for applying the patch so expeditiously!

Quoted 23 lines · Christian König

Am 22.02.2018 um 18:56 schrieb Michel Dänzer:

Quoted 9 lines · Ben Crocker
Quoted 5 lines

One of my colleagues did discover a "Radeon HG 5450 PCI" from February 2010 which did, apparently, have a Cedar GPU and very definitely had a (plain old) PCI connector.

There must be a PCIe-to-PCI bridge on that board. The GPU itself is always PCIe, and treated accordingly by the driver.

Ben, just an educated guess but is this one the one which is failing to work correctly?

Cause the PCIe bus interface is pretty much identical over all generations of the last decade or so. Only the newest Vega10 generation is a bit different.

So I strongly thing that this isn't related to the device being a Cedar at all, but rather that you have a bridge above it which doesn't correctly handle 64bit transfers.

Quoted 6 lines

Can you please send and "lspci -t" of both the working and the problematic devices?

Thanks,
Christian.

-+-[0045:00]---00.0-[01]----00.0 Texas Instruments TUSB73x0 SuperSpeed USB 3.0 xHCI Host Controller

 +-[0044:00]---00.0-[01]--
 +-[0040:00]---00.0-[01]--
 +-[0005:00]---00.0-[01-0f]----00.0-[02-0f]--+-01.0-[03]----00.0  Texas Instruments TUSB73x0 SuperSpeed USB 3.0 xHCI Host Controller
 |                                           +-08.0-[04]----00.0  IBM PCI-E IPR SAS Adapter (ASIC)
 |                                           +-09.0-[05]--+-00.0  Broadcom Limited NetXtreme BCM5719 Gigabit Ethernet PCIe
 |                                           |            +-00.1  Broadcom Limited NetXtreme BCM5719 Gigabit Ethernet PCIe
 |                                           |            +-00.2  Broadcom Limited NetXtreme BCM5719 Gigabit Ethernet PCIe
 |                                           |            \-00.3  Broadcom Limited NetXtreme BCM5719 Gigabit Ethernet PCIe
 |                                           +-10.0-[06-0a]--
 |                                           \-11.0-[0b-0f]--
 +-[0004:00]---00.0-[01]--+-00.0  Advanced Micro Devices, Inc. [AMD/ATI] Cedar GL [FirePro 2270]
 |                        \-00.1  Advanced Micro Devices, Inc. [AMD/ATI] Cedar HDMI Audio [Radeon HD 5400/6300/7300 Series]
 +-[0001:00]---00.0-[01-0d]----00.0-[02-0d]--+-01.0-[03-07]--
 |                                           +-08.0-[08]----00.0  IBM PCI-E IPR SAS Adapter (ASIC)
 |                                           \-09.0-[09-0d]--

\-[0000:00]---00.0-[01]--

0000:00:00.0 PCI bridge: IBM POWER8 Host Bridge (PHB3) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, NUMA node 0
Bus: primary=00, secondary=01, subordinate=01, sec-latency=0 I/O behind bridge: None
Memory behind bridge: None
Prefetchable memory behind bridge: None
Capabilities: [40] Power Management version 3
Capabilities: [48] Express Root Port (Slot-), MSI 00
Capabilities: [100] Advanced Error Reporting
Capabilities: [148] #19
Kernel modules: shpchp

0001:00:00.0 PCI bridge: IBM POWER8 Host Bridge (PHB3) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, NUMA node 0
Bus: primary=00, secondary=01, subordinate=0d, sec-latency=0
I/O behind bridge: None
Memory behind bridge: 80000000-ffefffff [size=2047M]
Prefetchable memory behind bridge: 0000210000000000-000021fdffffffff [size=1016G]
Capabilities: [40] Power Management version 3
Capabilities: [48] Express Root Port (Slot-), MSI 00
Capabilities: [100] Advanced Error Reporting
Capabilities: [148] #19
Kernel modules: shpchp

0001:01:00.0 PCI bridge: PLX Technology, Inc. PEX 8732 32-lane, 8-Port PCI Express Gen 3 (8.0 GT/s) Switch (rev ca) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, IRQ 493, NUMA node 0
Memory at 3fe082800000 (32-bit, non-prefetchable) [size=256K]
Bus: primary=01, secondary=02, subordinate=0d, sec-latency=0
I/O behind bridge: None
Memory behind bridge: 80000000-ffefffff [size=2047M]
Prefetchable memory behind bridge: 0000210000000000-000021fdffffffff [size=1016G]
Capabilities: [40] Power Management version 3
Capabilities: [48] MSI: Enable- Count=1/8 Maskable+ 64bit+
Capabilities: [68] Express Upstream Port, MSI 00
Capabilities: [a4] Subsystem: PLX Technology, Inc. PEX 8732 32-lane, 8-Port PCI Express Gen 3 (8.0 GT/s) Switch
Capabilities: [100] Device Serial Number ca-87-00-10-07-08-28-15
Capabilities: [fb4] Advanced Error Reporting
Capabilities: [138] Power Budgeting <?>
Capabilities: [10c] #19
Capabilities: [148] Virtual Channel
Capabilities: [e00] #12
Capabilities: [b00] Latency Tolerance Reporting
Capabilities: [b70] Vendor Specific Information: ID=0001 Rev=0 Len=010 <?>
Kernel modules: shpchp

0001:02:01.0 PCI bridge: PLX Technology, Inc. PEX 8732 32-lane, 8-Port PCI Express Gen 3 (8.0 GT/s) Switch (rev ca) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, IRQ 494, NUMA node 0
Bus: primary=02, secondary=03, subordinate=07, sec-latency=0
I/O behind bridge: None
Memory behind bridge: 80000000-807fffff [size=8M]
Prefetchable memory behind bridge: 0000210000000000-00002100ffffffff [size=4G]
Capabilities: [40] Power Management version 3
Capabilities: [48] MSI: Enable- Count=1/8 Maskable+ 64bit+
Capabilities: [68] Express Downstream Port (Slot+), MSI 00
Capabilities: [a4] Subsystem: PLX Technology, Inc. PEX 8732 32-lane, 8-Port PCI Express Gen 3 (8.0 GT/s) Switch
Capabilities: [100] Device Serial Number ca-87-00-10-b5-df-0e-00
Capabilities: [fb4] Advanced Error Reporting
Capabilities: [138] Power Budgeting <?>
Capabilities: [10c] #19
Capabilities: [148] Virtual Channel
Capabilities: [e00] #12
Capabilities: [f24] Access Control Services
Capabilities: [b70] Vendor Specific Information: ID=0001 Rev=0 Len=010 <?>
Kernel modules: shpchp

0001:02:08.0 PCI bridge: PLX Technology, Inc. PEX 8732 32-lane, 8-Port PCI Express Gen 3 (8.0 GT/s) Switch (rev ca) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, IRQ 493, NUMA node 0
Bus: primary=02, secondary=08, subordinate=08, sec-latency=0
I/O behind bridge: None
Memory behind bridge: 80800000-80ffffff [size=8M]
Prefetchable memory behind bridge: 0000210100000000-00002101ffffffff [size=4G]
Capabilities: [40] Power Management version 3
Capabilities: [48] MSI: Enable- Count=1/8 Maskable+ 64bit+
Capabilities: [68] Express Downstream Port (Slot+), MSI 00
Capabilities: [a4] Subsystem: PLX Technology, Inc. PEX 8732 32-lane, 8-Port PCI Express Gen 3 (8.0 GT/s) Switch
Capabilities: [100] Device Serial Number ca-87-00-10-b5-df-0e-00
Capabilities: [fb4] Advanced Error Reporting
Capabilities: [138] Power Budgeting <?>
Capabilities: [10c] #19
Capabilities: [148] Virtual Channel
Capabilities: [e00] #12
Capabilities: [f24] Access Control Services
Capabilities: [b70] Vendor Specific Information: ID=0001 Rev=0 Len=010 <?>
Kernel modules: shpchp

0001:02:09.0 PCI bridge: PLX Technology, Inc. PEX 8732 32-lane, 8-Port PCI Express Gen 3 (8.0 GT/s) Switch (rev ca) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, IRQ 494, NUMA node 0
Bus: primary=02, secondary=09, subordinate=0d, sec-latency=0
I/O behind bridge: None
Memory behind bridge: 81000000-817fffff [size=8M]
Prefetchable memory behind bridge: 0000210200000000-00002102ffffffff [size=4G]
Capabilities: [40] Power Management version 3
Capabilities: [48] MSI: Enable- Count=1/8 Maskable+ 64bit+
Capabilities: [68] Express Downstream Port (Slot+), MSI 00
Capabilities: [a4] Subsystem: PLX Technology, Inc. PEX 8732 32-lane, 8-Port PCI Express Gen 3 (8.0 GT/s) Switch
Capabilities: [100] Device Serial Number ca-87-00-10-b5-df-0e-00
Capabilities: [fb4] Advanced Error Reporting
Capabilities: [138] Power Budgeting <?>
Capabilities: [10c] #19
Capabilities: [148] Virtual Channel
Capabilities: [e00] #12
Capabilities: [f24] Access Control Services
Capabilities: [b70] Vendor Specific Information: ID=0001 Rev=0 Len=010 <?>
Kernel modules: shpchp

0001:08:00.0 RAID bus controller: IBM PCI-E IPR SAS Adapter (ASIC) (rev 02)
Subsystem: IBM PCIe3 x8 Cache SAS RAID Internal Adapter 6Gb (57D8)
Flags: bus master, fast devsel, latency 0, NUMA node 0 Memory at 3fe080820000 (64-bit, non-prefetchable) [size=64K] Memory at 3fe080830000 (64-bit, non-prefetchable) [size=64K] [virtual] Expansion ROM at 3fe080800000 [disabled] [size=128K]
Capabilities: [40] Power Management version 3
Capabilities: [48] MSI: Enable- Count=1/1 Maskable+ 64bit+
Capabilities: [60] Express Endpoint, MSI 00
Capabilities: [a4] MSI-X: Enable+ Count=16 Masked-
Capabilities: [100] Advanced Error Reporting
Capabilities: [188] Alternative Routing-ID Interpretation (ARI)
Capabilities: [190] #19
Kernel driver in use: ipr
Kernel modules: ipr

0004:00:00.0 PCI bridge: IBM POWER8 Host Bridge (PHB3) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, NUMA node 1
Bus: primary=00, secondary=01, subordinate=01, sec-latency=0
I/O behind bridge: None
Memory behind bridge: 80000000-ffefffff [size=2047M]
Prefetchable memory behind bridge: 0000240000000000-000024fdffffffff [size=1016G]
Capabilities: [40] Power Management version 3
Capabilities: [48] Express Root Port (Slot-), MSI 00
Capabilities: [100] Advanced Error Reporting
Capabilities: [148] #19
Kernel modules: shpchp

0004:01:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Cedar GL [FirePro 2270] (prog-if 00 [VGA controller])
Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Device 0126
Flags: bus master, fast devsel, latency 0, IRQ 398, NUMA node 1
Memory at 240000000000 (64-bit, prefetchable) [size=256M]
Memory at 3fe200000000 (64-bit, non-prefetchable) [size=128K]
I/O ports at <unassigned> [disabled]
Expansion ROM at 3fe200020000 [disabled] [size=128K]
Capabilities: [50] Power Management version 3
Capabilities: [58] Express Legacy Endpoint, MSI 00
Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
Capabilities: [150] Advanced Error Reporting
Kernel driver in use: radeon
Kernel modules: radeon

0004:01:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Cedar HDMI Audio [Radeon HD 5400/6300/7300 Series]
Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Cedar HDMI Audio [Radeon HD 5400/6300/7300 Series]
Flags: fast devsel, IRQ 482, NUMA node 1
Memory at 3fe200040000 (64-bit, non-prefetchable) [disabled] [size=16K]
Capabilities: [50] Power Management version 3
Capabilities: [58] Express Legacy Endpoint, MSI 00
Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit+
Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
Capabilities: [150] Advanced Error Reporting

0005:00:00.0 PCI bridge: IBM POWER8 Host Bridge (PHB3) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, NUMA node 1
Bus: primary=00, secondary=01, subordinate=0f, sec-latency=0
I/O behind bridge: None
Memory behind bridge: 80000000-ffefffff [size=2047M]
Prefetchable memory behind bridge: 0000250000000000-000025fdffffffff [size=1016G]
Capabilities: [40] Power Management version 3
Capabilities: [48] Express Root Port (Slot-), MSI 00
Capabilities: [100] Advanced Error Reporting
Capabilities: [148] #19
Kernel modules: shpchp

0005:01:00.0 PCI bridge: PLX Technology, Inc. PEX 8748 48-Lane, 12-Port PCI Express Gen 3 (8 GT/s) Switch, 27 x 27mm FCBGA (rev ca) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, IRQ 477, NUMA node 1
Memory at 3fe283800000 (32-bit, non-prefetchable) [size=256K]
Bus: primary=01, secondary=02, subordinate=0f, sec-latency=0
I/O behind bridge: None
Memory behind bridge: 80000000-ffefffff [size=2047M]
Prefetchable memory behind bridge: 0000250000000000-000025fdffffffff [size=1016G]
Capabilities: [40] Power Management version 3
Capabilities: [48] MSI: Enable- Count=1/8 Maskable+ 64bit+
Capabilities: [68] Express Upstream Port, MSI 00
Capabilities: [a4] Subsystem: PLX Technology, Inc. PEX 8748 48-Lane, 12-Port PCI Express Gen 3 (8 GT/s) Switch, 27 x 27mm FCBGA
Capabilities: [100] Device Serial Number ca-87-00-10-07-08-28-15
Capabilities: [fb4] Advanced Error Reporting
Capabilities: [138] Power Budgeting <?>
Capabilities: [10c] #19
Capabilities: [148] Virtual Channel
Capabilities: [e00] #12
Capabilities: [b00] Latency Tolerance Reporting
Capabilities: [b70] Vendor Specific Information: ID=0001 Rev=0 Len=010 <?>
Kernel modules: shpchp

0005:02:01.0 PCI bridge: PLX Technology, Inc. PEX 8748 48-Lane, 12-Port PCI Express Gen 3 (8 GT/s) Switch, 27 x 27mm FCBGA (rev ca) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, IRQ 478, NUMA node 1
Bus: primary=02, secondary=03, subordinate=03, sec-latency=0
I/O behind bridge: None
Memory behind bridge: 80000000-807fffff [size=8M]
Prefetchable memory behind bridge: None
Capabilities: [40] Power Management version 3
Capabilities: [48] MSI: Enable- Count=1/8 Maskable+ 64bit+
Capabilities: [68] Express Downstream Port (Slot-), MSI 00
Capabilities: [a4] Subsystem: PLX Technology, Inc. PEX 8748 48-Lane, 12-Port PCI Express Gen 3 (8 GT/s) Switch, 27 x 27mm FCBGA
Capabilities: [100] Device Serial Number ca-87-00-10-b5-df-0e-00
Capabilities: [fb4] Advanced Error Reporting
Capabilities: [138] Power Budgeting <?>
Capabilities: [10c] #19
Capabilities: [148] Virtual Channel
Capabilities: [e00] #12
Capabilities: [f24] Access Control Services
Capabilities: [b70] Vendor Specific Information: ID=0001 Rev=0 Len=010 <?>
Kernel modules: shpchp

0005:02:08.0 PCI bridge: PLX Technology, Inc. PEX 8748 48-Lane, 12-Port PCI Express Gen 3 (8 GT/s) Switch, 27 x 27mm FCBGA (rev ca) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, IRQ 477, NUMA node 1
Bus: primary=02, secondary=04, subordinate=04, sec-latency=0
I/O behind bridge: None
Memory behind bridge: 80800000-80ffffff [size=8M]
Prefetchable memory behind bridge: 0000250000000000-00002500ffffffff [size=4G]
Capabilities: [40] Power Management version 3
Capabilities: [48] MSI: Enable- Count=1/8 Maskable+ 64bit+
Capabilities: [68] Express Downstream Port (Slot+), MSI 00
Capabilities: [a4] Subsystem: PLX Technology, Inc. PEX 8748 48-Lane, 12-Port PCI Express Gen 3 (8 GT/s) Switch, 27 x 27mm FCBGA
Capabilities: [100] Device Serial Number ca-87-00-10-b5-df-0e-00
Capabilities: [fb4] Advanced Error Reporting
Capabilities: [138] Power Budgeting <?>
Capabilities: [10c] #19
Capabilities: [148] Virtual Channel
Capabilities: [e00] #12
Capabilities: [f24] Access Control Services
Capabilities: [b70] Vendor Specific Information: ID=0001 Rev=0 Len=010 <?>
Kernel modules: shpchp

0005:02:09.0 PCI bridge: PLX Technology, Inc. PEX 8748 48-Lane, 12-Port PCI Express Gen 3 (8 GT/s) Switch, 27 x 27mm FCBGA (rev ca) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, IRQ 478, NUMA node 1
Bus: primary=02, secondary=05, subordinate=05, sec-latency=0
I/O behind bridge: None
Memory behind bridge: 81000000-817fffff [size=8M]
Prefetchable memory behind bridge: 0000250100000000-00002501ffffffff [size=4G]
Capabilities: [40] Power Management version 3
Capabilities: [48] MSI: Enable- Count=1/8 Maskable+ 64bit+
Capabilities: [68] Express Downstream Port (Slot+), MSI 00
Capabilities: [a4] Subsystem: PLX Technology, Inc. PEX 8748 48-Lane, 12-Port PCI Express Gen 3 (8 GT/s) Switch, 27 x 27mm FCBGA
Capabilities: [100] Device Serial Number ca-87-00-10-b5-df-0e-00
Capabilities: [fb4] Advanced Error Reporting
Capabilities: [138] Power Budgeting <?>
Capabilities: [10c] #19
Capabilities: [148] Virtual Channel
Capabilities: [e00] #12
Capabilities: [f24] Access Control Services
Capabilities: [b70] Vendor Specific Information: ID=0001 Rev=0 Len=010 <?>
Kernel modules: shpchp

0005:02:10.0 PCI bridge: PLX Technology, Inc. PEX 8748 48-Lane, 12-Port PCI Express Gen 3 (8 GT/s) Switch, 27 x 27mm FCBGA (rev ca) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, IRQ 477, NUMA node 1
Bus: primary=02, secondary=06, subordinate=0a, sec-latency=0
I/O behind bridge: None
Memory behind bridge: 81800000-81ffffff [size=8M]
Prefetchable memory behind bridge: 0000250200000000-00002502ffffffff [size=4G]
Capabilities: [40] Power Management version 3
Capabilities: [48] MSI: Enable- Count=1/8 Maskable+ 64bit+
Capabilities: [68] Express Downstream Port (Slot+), MSI 00
Capabilities: [a4] Subsystem: PLX Technology, Inc. PEX 8748 48-Lane, 12-Port PCI Express Gen 3 (8 GT/s) Switch, 27 x 27mm FCBGA
Capabilities: [100] Device Serial Number ca-87-00-10-b5-df-0e-00
Capabilities: [fb4] Advanced Error Reporting
Capabilities: [138] Power Budgeting <?>
Capabilities: [10c] #19
Capabilities: [148] Virtual Channel
Capabilities: [e00] #12
Capabilities: [f24] Access Control Services
Capabilities: [b70] Vendor Specific Information: ID=0001 Rev=0 Len=010 <?>
Kernel modules: shpchp

0005:02:11.0 PCI bridge: PLX Technology, Inc. PEX 8748 48-Lane, 12-Port PCI Express Gen 3 (8 GT/s) Switch, 27 x 27mm FCBGA (rev ca) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, IRQ 478, NUMA node 1
Bus: primary=02, secondary=0b, subordinate=0f, sec-latency=0
I/O behind bridge: None
Memory behind bridge: 82000000-827fffff [size=8M]
Prefetchable memory behind bridge: 0000250300000000-00002503ffffffff [size=4G]
Capabilities: [40] Power Management version 3
Capabilities: [48] MSI: Enable- Count=1/8 Maskable+ 64bit+
Capabilities: [68] Express Downstream Port (Slot+), MSI 00
Capabilities: [a4] Subsystem: PLX Technology, Inc. PEX 8748 48-Lane, 12-Port PCI Express Gen 3 (8 GT/s) Switch, 27 x 27mm FCBGA
Capabilities: [100] Device Serial Number ca-87-00-10-b5-df-0e-00
Capabilities: [fb4] Advanced Error Reporting
Capabilities: [138] Power Budgeting <?>
Capabilities: [10c] #19
Capabilities: [148] Virtual Channel
Capabilities: [e00] #12
Capabilities: [f24] Access Control Services
Capabilities: [b70] Vendor Specific Information: ID=0001 Rev=0 Len=010 <?>
Kernel modules: shpchp

0005:03:00.0 USB controller: Texas Instruments TUSB73x0 SuperSpeed USB 3.0 xHCI Host Controller (rev 02) (prog-if 30 [XHCI])
Subsystem: IBM S824 (8286-42A)
Flags: bus master, fast devsel, latency 0, IRQ 478, NUMA node 1
Memory at 3fe280000000 (64-bit, non-prefetchable) [size=64K]
Memory at 3fe280010000 (64-bit, non-prefetchable) [size=8K]
Capabilities: [40] Power Management version 3
Capabilities: [48] MSI: Enable- Count=1/8 Maskable- 64bit+
Capabilities: [70] Express Endpoint, MSI 00
Capabilities: [c0] MSI-X: Enable+ Count=8 Masked-
Capabilities: [100] Advanced Error Reporting
Capabilities: [150] Device Serial Number 08-00-28-00-00-20-00-00
Kernel driver in use: xhci_hcd

0005:04:00.0 RAID bus controller: IBM PCI-E IPR SAS Adapter (ASIC) (rev 02)
Subsystem: IBM PCIe3 x8 Cache SAS RAID Internal Adapter 6Gb (57D8)
Flags: bus master, fast devsel, latency 0, NUMA node 1 Memory at 3fe280820000 (64-bit, non-prefetchable) [size=64K] Memory at 3fe280830000 (64-bit, non-prefetchable) [size=64K] [virtual] Expansion ROM at 3fe280800000 [disabled] [size=128K]
Capabilities: [40] Power Management version 3
Capabilities: [48] MSI: Enable- Count=1/1 Maskable+ 64bit+
Capabilities: [60] Express Endpoint, MSI 00
Capabilities: [a4] MSI-X: Enable+ Count=16 Masked-
Capabilities: [100] Advanced Error Reporting
Capabilities: [188] Alternative Routing-ID Interpretation (ARI)
Capabilities: [190] #19
Kernel driver in use: ipr
Kernel modules: ipr

0005:05:00.0 Ethernet controller: Broadcom Limited NetXtreme BCM5719 Gigabit Ethernet PCIe (rev 01)
Subsystem: IBM FC 5260/5899 4-port 1 GbE Adapter for Power
Flags: bus master, fast devsel, latency 0, IRQ 478, NUMA node 1
Memory at 250100000000 (64-bit, prefetchable) [size=64K]
Memory at 250100010000 (64-bit, prefetchable) [size=64K]
Memory at 250100020000 (64-bit, prefetchable) [size=64K]
[virtual] Expansion ROM at 3fe281000000 [disabled] [size=512K]
Capabilities: [48] Power Management version 3
Capabilities: [50] Vital Product Data
Capabilities: [58] MSI: Enable- Count=1/8 Maskable- 64bit+
Capabilities: [a0] MSI-X: Enable+ Count=17 Masked-
Capabilities: [ac] Express Endpoint, MSI 00
Capabilities: [100] Advanced Error Reporting
Capabilities: [13c] Device Serial Number 00-00-40-f2-e9-5a-e6-5c
Capabilities: [150] Power Budgeting <?>
Capabilities: [160] Virtual Channel
Capabilities: [230] Transaction Processing Hints
Kernel driver in use: tg3
Kernel modules: tg3

0005:05:00.1 Ethernet controller: Broadcom Limited NetXtreme BCM5719 Gigabit Ethernet PCIe (rev 01)
Subsystem: IBM FC 5260/5899 4-port 1 GbE Adapter for Power
Flags: bus master, fast devsel, latency 0, IRQ 479, NUMA node 1
Memory at 250100030000 (64-bit, prefetchable) [size=64K]
Memory at 250100040000 (64-bit, prefetchable) [size=64K]
Memory at 250100050000 (64-bit, prefetchable) [size=64K]
[virtual] Expansion ROM at 3fe281080000 [disabled] [size=512K]
Capabilities: [48] Power Management version 3
Capabilities: [50] Vital Product Data
Capabilities: [58] MSI: Enable- Count=1/8 Maskable- 64bit+
Capabilities: [a0] MSI-X: Enable+ Count=17 Masked-
Capabilities: [ac] Express Endpoint, MSI 00
Capabilities: [100] Advanced Error Reporting
Capabilities: [13c] Device Serial Number 00-00-40-f2-e9-5a-e6-5d
Capabilities: [150] Power Budgeting <?>
Capabilities: [160] Virtual Channel
Capabilities: [230] Transaction Processing Hints
Kernel driver in use: tg3
Kernel modules: tg3

0005:05:00.2 Ethernet controller: Broadcom Limited NetXtreme BCM5719 Gigabit Ethernet PCIe (rev 01)
Subsystem: IBM FC 5260/5899 4-port 1 GbE Adapter for Power
Flags: bus master, fast devsel, latency 0, IRQ 478, NUMA node 1
Memory at 250100060000 (64-bit, prefetchable) [size=64K]
Memory at 250100070000 (64-bit, prefetchable) [size=64K]
Memory at 250100080000 (64-bit, prefetchable) [size=64K]
[virtual] Expansion ROM at 3fe281100000 [disabled] [size=512K]
Capabilities: [48] Power Management version 3
Capabilities: [50] Vital Product Data
Capabilities: [58] MSI: Enable- Count=1/8 Maskable- 64bit+
Capabilities: [a0] MSI-X: Enable+ Count=17 Masked-
Capabilities: [ac] Express Endpoint, MSI 00
Capabilities: [100] Advanced Error Reporting
Capabilities: [13c] Device Serial Number 00-00-40-f2-e9-5a-e6-5e
Capabilities: [150] Power Budgeting <?>
Capabilities: [160] Virtual Channel
Capabilities: [230] Transaction Processing Hints
Kernel driver in use: tg3
Kernel modules: tg3

0005:05:00.3 Ethernet controller: Broadcom Limited NetXtreme BCM5719 Gigabit Ethernet PCIe (rev 01)
Subsystem: IBM FC 5260/5899 4-port 1 GbE Adapter for Power
Flags: bus master, fast devsel, latency 0, IRQ 479, NUMA node 1
Memory at 250100090000 (64-bit, prefetchable) [size=64K]
Memory at 2501000a0000 (64-bit, prefetchable) [size=64K]
Memory at 2501000b0000 (64-bit, prefetchable) [size=64K]
[virtual] Expansion ROM at 3fe281180000 [disabled] [size=512K]
Capabilities: [48] Power Management version 3
Capabilities: [50] Vital Product Data
Capabilities: [58] MSI: Enable- Count=1/8 Maskable- 64bit+
Capabilities: [a0] MSI-X: Enable+ Count=17 Masked-
Capabilities: [ac] Express Endpoint, MSI 00
Capabilities: [100] Advanced Error Reporting
Capabilities: [13c] Device Serial Number 00-00-40-f2-e9-5a-e6-5f
Capabilities: [150] Power Budgeting <?>
Capabilities: [160] Virtual Channel
Capabilities: [230] Transaction Processing Hints
Kernel driver in use: tg3
Kernel modules: tg3

0040:00:00.0 PCI bridge: IBM POWER8 Host Bridge (PHB3) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, NUMA node 16
Bus: primary=00, secondary=01, subordinate=01, sec-latency=0 I/O behind bridge: None
Memory behind bridge: None
Prefetchable memory behind bridge: None
Capabilities: [40] Power Management version 3
Capabilities: [48] Express Root Port (Slot-), MSI 00
Capabilities: [100] Advanced Error Reporting
Capabilities: [148] #19
Kernel modules: shpchp

0044:00:00.0 PCI bridge: IBM POWER8 Host Bridge (PHB3) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, NUMA node 17
Bus: primary=00, secondary=01, subordinate=01, sec-latency=0 I/O behind bridge: None
Memory behind bridge: None
Prefetchable memory behind bridge: None
Capabilities: [40] Power Management version 3
Capabilities: [48] Express Root Port (Slot-), MSI 00
Capabilities: [100] Advanced Error Reporting
Capabilities: [148] #19
Kernel modules: shpchp

0045:00:00.0 PCI bridge: IBM POWER8 Host Bridge (PHB3) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, NUMA node 17
Bus: primary=00, secondary=01, subordinate=01, sec-latency=0 I/O behind bridge: None
Memory behind bridge: 80000000-ffefffff [size=2047M] Prefetchable memory behind bridge: None
Capabilities: [40] Power Management version 3
Capabilities: [48] Express Root Port (Slot-), MSI 00
Capabilities: [100] Advanced Error Reporting
Capabilities: [148] #19
Kernel modules: shpchp

0045:01:00.0 USB controller: Texas Instruments TUSB73x0 SuperSpeed USB 3.0 xHCI Host Controller (rev 02) (prog-if 30 [XHCI])
Subsystem: IBM Device 049e
Flags: bus master, fast devsel, latency 0, IRQ 221, NUMA node 17
Memory at 3ff280000000 (64-bit, non-prefetchable) [size=64K]
Memory at 3ff280010000 (64-bit, non-prefetchable) [size=8K]
Capabilities: [40] Power Management version 3
Capabilities: [48] MSI: Enable- Count=1/8 Maskable- 64bit+
Capabilities: [70] Express Endpoint, MSI 00
Capabilities: [c0] MSI-X: Enable+ Count=8 Masked-
Capabilities: [100] Advanced Error Reporting
Capabilities: [150] Device Serial Number 08-00-28-00-00-20-00-00
Kernel driver in use: xhci_hcd

0000:00:00.0 PCI bridge: IBM POWER8 Host Bridge (PHB3) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, NUMA node 0
Bus: primary=00, secondary=01, subordinate=01, sec-latency=0 I/O behind bridge: None
Memory behind bridge: None
Prefetchable memory behind bridge: None
Capabilities: [40] Power Management version 3
Capabilities: [48] Express Root Port (Slot-), MSI 00
Capabilities: [100] Advanced Error Reporting
Capabilities: [148] #19
Kernel modules: shpchp

0001:00:00.0 PCI bridge: IBM POWER8 Host Bridge (PHB3) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, NUMA node 0
Bus: primary=00, secondary=01, subordinate=0d, sec-latency=0
I/O behind bridge: None
Memory behind bridge: 80000000-ffefffff [size=2047M]
Prefetchable memory behind bridge: 0000210000000000-000021fdffffffff [size=1016G]
Capabilities: [40] Power Management version 3
Capabilities: [48] Express Root Port (Slot-), MSI 00
Capabilities: [100] Advanced Error Reporting
Capabilities: [148] #19
Kernel modules: shpchp

0001:01:00.0 PCI bridge: PLX Technology, Inc. PEX 8732 32-lane, 8-Port PCI Express Gen 3 (8.0 GT/s) Switch (rev ca) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, IRQ 493, NUMA node 0
Memory at 3fe082800000 (32-bit, non-prefetchable) [size=256K]
Bus: primary=01, secondary=02, subordinate=0d, sec-latency=0
I/O behind bridge: None
Memory behind bridge: 80000000-ffefffff [size=2047M]
Prefetchable memory behind bridge: 0000210000000000-000021fdffffffff [size=1016G]
Capabilities: [40] Power Management version 3
Capabilities: [48] MSI: Enable- Count=1/8 Maskable+ 64bit+
Capabilities: [68] Express Upstream Port, MSI 00
Capabilities: [a4] Subsystem: PLX Technology, Inc. PEX 8732 32-lane, 8-Port PCI Express Gen 3 (8.0 GT/s) Switch
Capabilities: [100] Device Serial Number ca-87-00-10-07-08-28-15
Capabilities: [fb4] Advanced Error Reporting
Capabilities: [138] Power Budgeting <?>
Capabilities: [10c] #19
Capabilities: [148] Virtual Channel
Capabilities: [e00] #12
Capabilities: [b00] Latency Tolerance Reporting
Capabilities: [b70] Vendor Specific Information: ID=0001 Rev=0 Len=010 <?>
Kernel modules: shpchp

0001:02:01.0 PCI bridge: PLX Technology, Inc. PEX 8732 32-lane, 8-Port PCI Express Gen 3 (8.0 GT/s) Switch (rev ca) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, IRQ 494, NUMA node 0
Bus: primary=02, secondary=03, subordinate=07, sec-latency=0
I/O behind bridge: None
Memory behind bridge: 80000000-807fffff [size=8M]
Prefetchable memory behind bridge: 0000210000000000-00002100ffffffff [size=4G]
Capabilities: [40] Power Management version 3
Capabilities: [48] MSI: Enable- Count=1/8 Maskable+ 64bit+
Capabilities: [68] Express Downstream Port (Slot+), MSI 00
Capabilities: [a4] Subsystem: PLX Technology, Inc. PEX 8732 32-lane, 8-Port PCI Express Gen 3 (8.0 GT/s) Switch
Capabilities: [100] Device Serial Number ca-87-00-10-b5-df-0e-00
Capabilities: [fb4] Advanced Error Reporting
Capabilities: [138] Power Budgeting <?>
Capabilities: [10c] #19
Capabilities: [148] Virtual Channel
Capabilities: [e00] #12
Capabilities: [f24] Access Control Services
Capabilities: [b70] Vendor Specific Information: ID=0001 Rev=0 Len=010 <?>
Kernel modules: shpchp

0001:02:08.0 PCI bridge: PLX Technology, Inc. PEX 8732 32-lane, 8-Port PCI Express Gen 3 (8.0 GT/s) Switch (rev ca) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, IRQ 493, NUMA node 0
Bus: primary=02, secondary=08, subordinate=08, sec-latency=0
I/O behind bridge: None
Memory behind bridge: 80800000-80ffffff [size=8M]
Prefetchable memory behind bridge: 0000210100000000-00002101ffffffff [size=4G]
Capabilities: [40] Power Management version 3
Capabilities: [48] MSI: Enable- Count=1/8 Maskable+ 64bit+
Capabilities: [68] Express Downstream Port (Slot+), MSI 00
Capabilities: [a4] Subsystem: PLX Technology, Inc. PEX 8732 32-lane, 8-Port PCI Express Gen 3 (8.0 GT/s) Switch
Capabilities: [100] Device Serial Number ca-87-00-10-b5-df-0e-00
Capabilities: [fb4] Advanced Error Reporting
Capabilities: [138] Power Budgeting <?>
Capabilities: [10c] #19
Capabilities: [148] Virtual Channel
Capabilities: [e00] #12
Capabilities: [f24] Access Control Services
Capabilities: [b70] Vendor Specific Information: ID=0001 Rev=0 Len=010 <?>
Kernel modules: shpchp

0001:02:09.0 PCI bridge: PLX Technology, Inc. PEX 8732 32-lane, 8-Port PCI Express Gen 3 (8.0 GT/s) Switch (rev ca) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, IRQ 494, NUMA node 0
Bus: primary=02, secondary=09, subordinate=0d, sec-latency=0
I/O behind bridge: None
Memory behind bridge: 81000000-817fffff [size=8M]
Prefetchable memory behind bridge: 0000210200000000-00002102ffffffff [size=4G]
Capabilities: [40] Power Management version 3
Capabilities: [48] MSI: Enable- Count=1/8 Maskable+ 64bit+
Capabilities: [68] Express Downstream Port (Slot+), MSI 00
Capabilities: [a4] Subsystem: PLX Technology, Inc. PEX 8732 32-lane, 8-Port PCI Express Gen 3 (8.0 GT/s) Switch
Capabilities: [100] Device Serial Number ca-87-00-10-b5-df-0e-00
Capabilities: [fb4] Advanced Error Reporting
Capabilities: [138] Power Budgeting <?>
Capabilities: [10c] #19
Capabilities: [148] Virtual Channel
Capabilities: [e00] #12
Capabilities: [f24] Access Control Services
Capabilities: [b70] Vendor Specific Information: ID=0001 Rev=0 Len=010 <?>
Kernel modules: shpchp

0001:08:00.0 RAID bus controller: IBM PCI-E IPR SAS Adapter (ASIC) (rev 02)
Subsystem: IBM PCIe3 x8 Cache SAS RAID Internal Adapter 6Gb (57D8)
Flags: bus master, fast devsel, latency 0, NUMA node 0 Memory at 3fe080820000 (64-bit, non-prefetchable) [size=64K] Memory at 3fe080830000 (64-bit, non-prefetchable) [size=64K] [virtual] Expansion ROM at 3fe080800000 [disabled] [size=128K]
Capabilities: [40] Power Management version 3
Capabilities: [48] MSI: Enable- Count=1/1 Maskable+ 64bit+
Capabilities: [60] Express Endpoint, MSI 00
Capabilities: [a4] MSI-X: Enable+ Count=16 Masked-
Capabilities: [100] Advanced Error Reporting
Capabilities: [188] Alternative Routing-ID Interpretation (ARI)
Capabilities: [190] #19
Kernel driver in use: ipr
Kernel modules: ipr

0004:00:00.0 PCI bridge: IBM POWER8 Host Bridge (PHB3) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, NUMA node 1
Bus: primary=00, secondary=01, subordinate=01, sec-latency=0
I/O behind bridge: None
Memory behind bridge: 80000000-ffefffff [size=2047M]
Prefetchable memory behind bridge: 0000240000000000-000024fdffffffff [size=1016G]
Capabilities: [40] Power Management version 3
Capabilities: [48] Express Root Port (Slot-), MSI 00
Capabilities: [100] Advanced Error Reporting
Capabilities: [148] #19
Kernel modules: shpchp

0004:01:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Caicos [Radeon HD 6450/7450/8450 / R5 230 OEM] (prog-if 00 [VGA controller])
Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Device 2120
Flags: bus master, fast devsel, latency 0, IRQ 398, NUMA node 1
Memory at 240000000000 (64-bit, prefetchable) [size=256M]
Memory at 3fe200000000 (64-bit, non-prefetchable) [size=128K]
I/O ports at <unassigned> [disabled]
Expansion ROM at 3fe200020000 [disabled] [size=128K]
Capabilities: [50] Power Management version 3
Capabilities: [58] Express Legacy Endpoint, MSI 00
Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
Capabilities: [150] Advanced Error Reporting
Kernel driver in use: radeon
Kernel modules: radeon

0004:01:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Caicos HDMI Audio [Radeon HD 6450 / 7450/8450/8490 OEM / R5 230/235/235X OEM]
Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Caicos HDMI Audio [Radeon HD 6450 / 7450/8450/8490 OEM / R5 230/235/235X OEM]
Flags: fast devsel, IRQ 482, NUMA node 1
Memory at 3fe200040000 (64-bit, non-prefetchable) [disabled] [size=16K]
Capabilities: [50] Power Management version 3
Capabilities: [58] Express Legacy Endpoint, MSI 00
Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit+
Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
Capabilities: [150] Advanced Error Reporting

0005:00:00.0 PCI bridge: IBM POWER8 Host Bridge (PHB3) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, NUMA node 1
Bus: primary=00, secondary=01, subordinate=0f, sec-latency=0
I/O behind bridge: None
Memory behind bridge: 80000000-ffefffff [size=2047M]
Prefetchable memory behind bridge: 0000250000000000-000025fdffffffff [size=1016G]
Capabilities: [40] Power Management version 3
Capabilities: [48] Express Root Port (Slot-), MSI 00
Capabilities: [100] Advanced Error Reporting
Capabilities: [148] #19
Kernel modules: shpchp

0005:01:00.0 PCI bridge: PLX Technology, Inc. PEX 8748 48-Lane, 12-Port PCI Express Gen 3 (8 GT/s) Switch, 27 x 27mm FCBGA (rev ca) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, IRQ 477, NUMA node 1
Memory at 3fe283800000 (32-bit, non-prefetchable) [size=256K]
Bus: primary=01, secondary=02, subordinate=0f, sec-latency=0
I/O behind bridge: None
Memory behind bridge: 80000000-ffefffff [size=2047M]
Prefetchable memory behind bridge: 0000250000000000-000025fdffffffff [size=1016G]
Capabilities: [40] Power Management version 3
Capabilities: [48] MSI: Enable- Count=1/8 Maskable+ 64bit+
Capabilities: [68] Express Upstream Port, MSI 00
Capabilities: [a4] Subsystem: PLX Technology, Inc. PEX 8748 48-Lane, 12-Port PCI Express Gen 3 (8 GT/s) Switch, 27 x 27mm FCBGA
Capabilities: [100] Device Serial Number ca-87-00-10-07-08-28-15
Capabilities: [fb4] Advanced Error Reporting
Capabilities: [138] Power Budgeting <?>
Capabilities: [10c] #19
Capabilities: [148] Virtual Channel
Capabilities: [e00] #12
Capabilities: [b00] Latency Tolerance Reporting
Capabilities: [b70] Vendor Specific Information: ID=0001 Rev=0 Len=010 <?>
Kernel modules: shpchp

0005:02:01.0 PCI bridge: PLX Technology, Inc. PEX 8748 48-Lane, 12-Port PCI Express Gen 3 (8 GT/s) Switch, 27 x 27mm FCBGA (rev ca) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, IRQ 478, NUMA node 1
Bus: primary=02, secondary=03, subordinate=03, sec-latency=0
I/O behind bridge: None
Memory behind bridge: 80000000-807fffff [size=8M]
Prefetchable memory behind bridge: None
Capabilities: [40] Power Management version 3
Capabilities: [48] MSI: Enable- Count=1/8 Maskable+ 64bit+
Capabilities: [68] Express Downstream Port (Slot-), MSI 00
Capabilities: [a4] Subsystem: PLX Technology, Inc. PEX 8748 48-Lane, 12-Port PCI Express Gen 3 (8 GT/s) Switch, 27 x 27mm FCBGA
Capabilities: [100] Device Serial Number ca-87-00-10-b5-df-0e-00
Capabilities: [fb4] Advanced Error Reporting
Capabilities: [138] Power Budgeting <?>
Capabilities: [10c] #19
Capabilities: [148] Virtual Channel
Capabilities: [e00] #12
Capabilities: [f24] Access Control Services
Capabilities: [b70] Vendor Specific Information: ID=0001 Rev=0 Len=010 <?>
Kernel modules: shpchp

0005:02:08.0 PCI bridge: PLX Technology, Inc. PEX 8748 48-Lane, 12-Port PCI Express Gen 3 (8 GT/s) Switch, 27 x 27mm FCBGA (rev ca) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, IRQ 477, NUMA node 1
Bus: primary=02, secondary=04, subordinate=04, sec-latency=0
I/O behind bridge: None
Memory behind bridge: 80800000-80ffffff [size=8M]
Prefetchable memory behind bridge: 0000250000000000-00002500ffffffff [size=4G]
Capabilities: [40] Power Management version 3
Capabilities: [48] MSI: Enable- Count=1/8 Maskable+ 64bit+
Capabilities: [68] Express Downstream Port (Slot+), MSI 00
Capabilities: [a4] Subsystem: PLX Technology, Inc. PEX 8748 48-Lane, 12-Port PCI Express Gen 3 (8 GT/s) Switch, 27 x 27mm FCBGA
Capabilities: [100] Device Serial Number ca-87-00-10-b5-df-0e-00
Capabilities: [fb4] Advanced Error Reporting
Capabilities: [138] Power Budgeting <?>
Capabilities: [10c] #19
Capabilities: [148] Virtual Channel
Capabilities: [e00] #12
Capabilities: [f24] Access Control Services
Capabilities: [b70] Vendor Specific Information: ID=0001 Rev=0 Len=010 <?>
Kernel modules: shpchp

0005:02:09.0 PCI bridge: PLX Technology, Inc. PEX 8748 48-Lane, 12-Port PCI Express Gen 3 (8 GT/s) Switch, 27 x 27mm FCBGA (rev ca) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, IRQ 478, NUMA node 1
Bus: primary=02, secondary=05, subordinate=05, sec-latency=0
I/O behind bridge: None
Memory behind bridge: 81000000-817fffff [size=8M]
Prefetchable memory behind bridge: 0000250100000000-00002501ffffffff [size=4G]
Capabilities: [40] Power Management version 3
Capabilities: [48] MSI: Enable- Count=1/8 Maskable+ 64bit+
Capabilities: [68] Express Downstream Port (Slot+), MSI 00
Capabilities: [a4] Subsystem: PLX Technology, Inc. PEX 8748 48-Lane, 12-Port PCI Express Gen 3 (8 GT/s) Switch, 27 x 27mm FCBGA
Capabilities: [100] Device Serial Number ca-87-00-10-b5-df-0e-00
Capabilities: [fb4] Advanced Error Reporting
Capabilities: [138] Power Budgeting <?>
Capabilities: [10c] #19
Capabilities: [148] Virtual Channel
Capabilities: [e00] #12
Capabilities: [f24] Access Control Services
Capabilities: [b70] Vendor Specific Information: ID=0001 Rev=0 Len=010 <?>
Kernel modules: shpchp

0005:02:10.0 PCI bridge: PLX Technology, Inc. PEX 8748 48-Lane, 12-Port PCI Express Gen 3 (8 GT/s) Switch, 27 x 27mm FCBGA (rev ca) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, IRQ 477, NUMA node 1
Bus: primary=02, secondary=06, subordinate=0a, sec-latency=0
I/O behind bridge: None
Memory behind bridge: 81800000-81ffffff [size=8M]
Prefetchable memory behind bridge: 0000250200000000-00002502ffffffff [size=4G]
Capabilities: [40] Power Management version 3
Capabilities: [48] MSI: Enable- Count=1/8 Maskable+ 64bit+
Capabilities: [68] Express Downstream Port (Slot+), MSI 00
Capabilities: [a4] Subsystem: PLX Technology, Inc. PEX 8748 48-Lane, 12-Port PCI Express Gen 3 (8 GT/s) Switch, 27 x 27mm FCBGA
Capabilities: [100] Device Serial Number ca-87-00-10-b5-df-0e-00
Capabilities: [fb4] Advanced Error Reporting
Capabilities: [138] Power Budgeting <?>
Capabilities: [10c] #19
Capabilities: [148] Virtual Channel
Capabilities: [e00] #12
Capabilities: [f24] Access Control Services
Capabilities: [b70] Vendor Specific Information: ID=0001 Rev=0 Len=010 <?>
Kernel modules: shpchp

0005:02:11.0 PCI bridge: PLX Technology, Inc. PEX 8748 48-Lane, 12-Port PCI Express Gen 3 (8 GT/s) Switch, 27 x 27mm FCBGA (rev ca) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, IRQ 478, NUMA node 1
Bus: primary=02, secondary=0b, subordinate=0f, sec-latency=0
I/O behind bridge: None
Memory behind bridge: 82000000-827fffff [size=8M]
Prefetchable memory behind bridge: 0000250300000000-00002503ffffffff [size=4G]
Capabilities: [40] Power Management version 3
Capabilities: [48] MSI: Enable- Count=1/8 Maskable+ 64bit+
Capabilities: [68] Express Downstream Port (Slot+), MSI 00
Capabilities: [a4] Subsystem: PLX Technology, Inc. PEX 8748 48-Lane, 12-Port PCI Express Gen 3 (8 GT/s) Switch, 27 x 27mm FCBGA
Capabilities: [100] Device Serial Number ca-87-00-10-b5-df-0e-00
Capabilities: [fb4] Advanced Error Reporting
Capabilities: [138] Power Budgeting <?>
Capabilities: [10c] #19
Capabilities: [148] Virtual Channel
Capabilities: [e00] #12
Capabilities: [f24] Access Control Services
Capabilities: [b70] Vendor Specific Information: ID=0001 Rev=0 Len=010 <?>
Kernel modules: shpchp

0005:03:00.0 USB controller: Texas Instruments TUSB73x0 SuperSpeed USB 3.0 xHCI Host Controller (rev 02) (prog-if 30 [XHCI])
Subsystem: IBM S824 (8286-42A)
Flags: bus master, fast devsel, latency 0, IRQ 478, NUMA node 1
Memory at 3fe280000000 (64-bit, non-prefetchable) [size=64K]
Memory at 3fe280010000 (64-bit, non-prefetchable) [size=8K]
Capabilities: [40] Power Management version 3
Capabilities: [48] MSI: Enable- Count=1/8 Maskable- 64bit+
Capabilities: [70] Express Endpoint, MSI 00
Capabilities: [c0] MSI-X: Enable+ Count=8 Masked-
Capabilities: [100] Advanced Error Reporting
Capabilities: [150] Device Serial Number 08-00-28-00-00-20-00-00
Kernel driver in use: xhci_hcd

0005:04:00.0 RAID bus controller: IBM PCI-E IPR SAS Adapter (ASIC) (rev 02)
Subsystem: IBM PCIe3 x8 Cache SAS RAID Internal Adapter 6Gb (57D8)
Flags: bus master, fast devsel, latency 0, NUMA node 1 Memory at 3fe280820000 (64-bit, non-prefetchable) [size=64K] Memory at 3fe280830000 (64-bit, non-prefetchable) [size=64K] [virtual] Expansion ROM at 3fe280800000 [disabled] [size=128K]
Capabilities: [40] Power Management version 3
Capabilities: [48] MSI: Enable- Count=1/1 Maskable+ 64bit+
Capabilities: [60] Express Endpoint, MSI 00
Capabilities: [a4] MSI-X: Enable+ Count=16 Masked-
Capabilities: [100] Advanced Error Reporting
Capabilities: [188] Alternative Routing-ID Interpretation (ARI)
Capabilities: [190] #19
Kernel driver in use: ipr
Kernel modules: ipr

0005:05:00.0 Ethernet controller: Broadcom Limited NetXtreme BCM5719 Gigabit Ethernet PCIe (rev 01)
Subsystem: IBM FC 5260/5899 4-port 1 GbE Adapter for Power
Flags: bus master, fast devsel, latency 0, IRQ 478, NUMA node 1
Memory at 250100000000 (64-bit, prefetchable) [size=64K]
Memory at 250100010000 (64-bit, prefetchable) [size=64K]
Memory at 250100020000 (64-bit, prefetchable) [size=64K]
[virtual] Expansion ROM at 3fe281000000 [disabled] [size=512K]
Capabilities: [48] Power Management version 3
Capabilities: [50] Vital Product Data
Capabilities: [58] MSI: Enable- Count=1/8 Maskable- 64bit+
Capabilities: [a0] MSI-X: Enable+ Count=17 Masked-
Capabilities: [ac] Express Endpoint, MSI 00
Capabilities: [100] Advanced Error Reporting
Capabilities: [13c] Device Serial Number 00-00-40-f2-e9-5a-e6-5c
Capabilities: [150] Power Budgeting <?>
Capabilities: [160] Virtual Channel
Capabilities: [230] Transaction Processing Hints
Kernel driver in use: tg3
Kernel modules: tg3

0005:05:00.1 Ethernet controller: Broadcom Limited NetXtreme BCM5719 Gigabit Ethernet PCIe (rev 01)
Subsystem: IBM FC 5260/5899 4-port 1 GbE Adapter for Power
Flags: bus master, fast devsel, latency 0, IRQ 479, NUMA node 1
Memory at 250100030000 (64-bit, prefetchable) [size=64K]
Memory at 250100040000 (64-bit, prefetchable) [size=64K]
Memory at 250100050000 (64-bit, prefetchable) [size=64K]
[virtual] Expansion ROM at 3fe281080000 [disabled] [size=512K]
Capabilities: [48] Power Management version 3
Capabilities: [50] Vital Product Data
Capabilities: [58] MSI: Enable- Count=1/8 Maskable- 64bit+
Capabilities: [a0] MSI-X: Enable+ Count=17 Masked-
Capabilities: [ac] Express Endpoint, MSI 00
Capabilities: [100] Advanced Error Reporting
Capabilities: [13c] Device Serial Number 00-00-40-f2-e9-5a-e6-5d
Capabilities: [150] Power Budgeting <?>
Capabilities: [160] Virtual Channel
Capabilities: [230] Transaction Processing Hints
Kernel driver in use: tg3
Kernel modules: tg3

0005:05:00.2 Ethernet controller: Broadcom Limited NetXtreme BCM5719 Gigabit Ethernet PCIe (rev 01)
Subsystem: IBM FC 5260/5899 4-port 1 GbE Adapter for Power
Flags: bus master, fast devsel, latency 0, IRQ 478, NUMA node 1
Memory at 250100060000 (64-bit, prefetchable) [size=64K]
Memory at 250100070000 (64-bit, prefetchable) [size=64K]
Memory at 250100080000 (64-bit, prefetchable) [size=64K]
[virtual] Expansion ROM at 3fe281100000 [disabled] [size=512K]
Capabilities: [48] Power Management version 3
Capabilities: [50] Vital Product Data
Capabilities: [58] MSI: Enable- Count=1/8 Maskable- 64bit+
Capabilities: [a0] MSI-X: Enable+ Count=17 Masked-
Capabilities: [ac] Express Endpoint, MSI 00
Capabilities: [100] Advanced Error Reporting
Capabilities: [13c] Device Serial Number 00-00-40-f2-e9-5a-e6-5e
Capabilities: [150] Power Budgeting <?>
Capabilities: [160] Virtual Channel
Capabilities: [230] Transaction Processing Hints
Kernel driver in use: tg3
Kernel modules: tg3

0005:05:00.3 Ethernet controller: Broadcom Limited NetXtreme BCM5719 Gigabit Ethernet PCIe (rev 01)
Subsystem: IBM FC 5260/5899 4-port 1 GbE Adapter for Power
Flags: bus master, fast devsel, latency 0, IRQ 479, NUMA node 1
Memory at 250100090000 (64-bit, prefetchable) [size=64K]
Memory at 2501000a0000 (64-bit, prefetchable) [size=64K]
Memory at 2501000b0000 (64-bit, prefetchable) [size=64K]
[virtual] Expansion ROM at 3fe281180000 [disabled] [size=512K]
Capabilities: [48] Power Management version 3
Capabilities: [50] Vital Product Data
Capabilities: [58] MSI: Enable- Count=1/8 Maskable- 64bit+
Capabilities: [a0] MSI-X: Enable+ Count=17 Masked-
Capabilities: [ac] Express Endpoint, MSI 00
Capabilities: [100] Advanced Error Reporting
Capabilities: [13c] Device Serial Number 00-00-40-f2-e9-5a-e6-5f
Capabilities: [150] Power Budgeting <?>
Capabilities: [160] Virtual Channel
Capabilities: [230] Transaction Processing Hints
Kernel driver in use: tg3
Kernel modules: tg3

0040:00:00.0 PCI bridge: IBM POWER8 Host Bridge (PHB3) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, NUMA node 16
Bus: primary=00, secondary=01, subordinate=01, sec-latency=0 I/O behind bridge: None
Memory behind bridge: None
Prefetchable memory behind bridge: None
Capabilities: [40] Power Management version 3
Capabilities: [48] Express Root Port (Slot-), MSI 00
Capabilities: [100] Advanced Error Reporting
Capabilities: [148] #19
Kernel modules: shpchp

0044:00:00.0 PCI bridge: IBM POWER8 Host Bridge (PHB3) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, NUMA node 17
Bus: primary=00, secondary=01, subordinate=01, sec-latency=0 I/O behind bridge: None
Memory behind bridge: None
Prefetchable memory behind bridge: None
Capabilities: [40] Power Management version 3
Capabilities: [48] Express Root Port (Slot-), MSI 00
Capabilities: [100] Advanced Error Reporting
Capabilities: [148] #19
Kernel modules: shpchp

0045:00:00.0 PCI bridge: IBM POWER8 Host Bridge (PHB3) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, NUMA node 17
Bus: primary=00, secondary=01, subordinate=01, sec-latency=0 I/O behind bridge: None
Memory behind bridge: 80000000-ffefffff [size=2047M] Prefetchable memory behind bridge: None
Capabilities: [40] Power Management version 3
Capabilities: [48] Express Root Port (Slot-), MSI 00
Capabilities: [100] Advanced Error Reporting
Capabilities: [148] #19
Kernel modules: shpchp

0045:01:00.0 USB controller: Texas Instruments TUSB73x0 SuperSpeed USB 3.0 xHCI Host Controller (rev 02) (prog-if 30 [XHCI])
Subsystem: IBM Device 049e
Flags: bus master, fast devsel, latency 0, IRQ 221, NUMA node 17
Memory at 3ff280000000 (64-bit, non-prefetchable) [size=64K]
Memory at 3ff280010000 (64-bit, non-prefetchable) [size=8K]
Capabilities: [40] Power Management version 3
Capabilities: [48] MSI: Enable- Count=1/8 Maskable- 64bit+
Capabilities: [70] Express Endpoint, MSI 00
Capabilities: [c0] MSI-X: Enable+ Count=8 Masked-
Capabilities: [100] Advanced Error Reporting
Capabilities: [150] Device Serial Number 08-00-28-00-00-20-00-00
Kernel driver in use: xhci_hcd

_______________________________________________
dri-devel mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/dri-devel

maintainer
#24 lore raw

Re: [PATCH] drm/radeon: insist on 32-bit DMA for Cedar on PPC64/PPC64LE

Hi Ben,

Quoted 1 line

I mentioned the HD 5450 purely as a matter of archeological interest.

Ok, in that case looking at the lspci -tv output doesn't tell us anything new.

Quoted 2 lines

I suspected, but couldn't prove, that the problem might have something to do with the bridge (IBM POWER8 Host Bridge (PHB3)).

In that case you would see the problem with the caicos as well.

Or are there issues random enough that there could actually be some problem with the caicos as well and we haven't noticed it so far?

See it is really really odd that this should only happen with the cedar. On the other hand if it works for now, I don't see much issue having this workaround.

Regards,
Christian.

Am 23.02.2018 um 17:02 schrieb Ben Crocker:

Quoted 52 lines

Hi Christian, Michel, Alex, et al.,

I mentioned the HD 5450 purely as a matter of archeological interest.

Back to the FirePro 2270 and Embedded Radeon E6465:

I've attached text from both "lspci -tv" and "lspci -v." Actually I'm attaching a couple of different "lspci -v" outputs, one with the FirePro 2270 in place and one with the E6465 in (the same) place.

I suspected, but couldn't prove, that the problem might have something to do with the bridge (IBM POWER8 Host Bridge (PHB3)).

But I want to reiterate:

* Cedar GPU -> problem (before patch, that is);
* Caicos GPU in the same slot -> no problem

-- Ben

P.S.  Alex, thanks for applying the patch so expeditiously!

On Fri, Feb 23, 2018 at 2:45 AM, Christian König <[email protected] <mailto:[email protected]>> wrote:

Am 22.02.2018 um 18:56 schrieb Michel Dänzer:

On 2018-02-22 06:37 PM, Ben Crocker wrote:

One of my colleagues did discover a "Radeon HG 5450 PCI" from February
2010 which did, apparently, have a Cedar GPU and very definitely had a
(plain old) PCI connector.

There must be a PCIe-to-PCI bridge on that board. The GPU itself is
always PCIe, and treated accordingly by the driver.

Ben, just an educated guess but is this one the one which is failing to work correctly?

Cause the PCIe bus interface is pretty much identical over all generations of the last decade or so. Only the newest Vega10 generation is a bit different.

So I strongly thing that this isn't related to the device being a Cedar at all, but rather that you have a bridge above it which doesn't correctly handle 64bit transfers.

Quoted 7 lines

Can you please send and "lspci -t" of both the working and the problematic devices?

Thanks,
Christian.

_______________________________________________
dri-devel mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/dri-devel