PCI legacy resource fix
PATCH 1/1 PCI legacy resource fix
Since commit 368c73d4f689dae0807d0a2aa74c61fd2b9b075f the kernel will try to update the non-writeable BAR registers 0..3 of PIIX4 IDE adapters if pci_assign_unassigned_resources() is used to do full resource assignment of the bus. This fails because in the PIIX4 these BAR registers have implicitly assumed values and read back as zero; it used to work because the kernel used to just write zero to that register the read back value did match what was written.
The fix is a new resource flag IORESOURCE_PCI_FIXED used to mark a resource as non-movable. This will also be useful to keep other import system resources from being moved around - for example system consoles on PCI busses.
drivers/pci/probe.c +7 -4
@@ -649,6 +649,9 @@ static void pci_read_irq(struct pci_dev* Returns 0 on success and -1 if unknown type of device (not normal, bridge * or CardBus). */ + +#define LEGACY_IO_RESOURCE (IORESOURCE_IO | IORESOURCE_PCI_FIXED) +static int pci_setup_device (struct pci_dev * dev) {u32 class;
@@ -692,18 +695,18 @@ static int pci_setup_device(struct pci_dif ((progif &1 ) ==0 ) { dev->resource[0 ].start =0x1F0 ; dev->resource[0 ].end =0x1F7 ; - dev->resource[0 ].flags =IORESOURCE_IO ; + dev->resource[0 ].flags =LEGACY_IO_RESOURCE ; dev->resource[1 ].start =0x3F6 ; dev->resource[1 ].end =0x3F6 ; - dev->resource[1 ].flags =IORESOURCE_IO ; + dev->resource[1 ].flags =LEGACY_IO_RESOURCE ; }if ((progif &4 ) ==0 ) { dev->resource[2 ].start =0x170 ; dev->resource[2 ].end =0x177 ; - dev->resource[2 ].flags =IORESOURCE_IO ; + dev->resource[2 ].flags =LEGACY_IO_RESOURCE ; dev->resource[3 ].start =0x376 ; dev->resource[3 ].end =0x376 ; - dev->resource[3 ].flags =IORESOURCE_IO ; + dev->resource[3 ].flags =LEGACY_IO_RESOURCE ; } }break ;
drivers/pci/setup-res.c +11 -0
@@ -38,6 +38,13 @@ pci_update_resource(struct pci_dev *dev,if (!res->flags)return ; +/* Ignore non-moveable resources. This might be legacy resources for +which no functional BAR register exists or another important +system resource we should better not move around in system address +space. */ +if (res->flags &IORESOURCE_PCI_FIXED ) +return ; +pcibios_resource_to_bus (dev, ®ion, res); pr_debug(" got res [%llx:%llx] bus [%lx:%lx] flags %lx for "
@@ -212,6 +219,10 @@ pdev_sort_resources(struct pci_dev *dev,resource_size_t r_align; r = &dev->resource[i]; + +if (r->flags &IORESOURCE_PCI_FIXED ) +continue ; + r_align = r->end - r->start;if (!(r->flags) || r->parent)
include/linux/ioport.h +3 -0
@@ -91,6 +91,9 @@ #define IORESOURCE_ROM_SHADOW (1<<1) /*#define IORESOURCE_ROM_COPY (1<<2)/* ROM is alloc'd copy, resource field overlaid */ #define IORESOURCE_ROM_BIOS_COPY (1<<3)/* ROM is BIOS copy, resource field overlaid */ +/* PCI control bits. Shares IORESOURCE_BITS with above PCI ROM. */ +#define IORESOURCE_PCI_FIXED (1<<4)/* Do not move resource */ +/* PC/ISA/whatever - the normal PC address spaces: IO and memory */ extern struct resource ioport_resource;extern struct resource iomem_resource;
Quoted 8 lines · On Wed, 6 Dec 2006 13:41:43 +0000 Ralf Baechle <[email protected]> wrote:
Since commit
368c73d4f689dae0807d0a2aa74c61fd2b9b075fthe kernel will try to update the non-writeable BAR registers 0..3 of PIIX4 IDE adapters ifpci_assign_unassigned_resources()is used to do full resource assignment of the bus. This fails because in the PIIX4 these BAR registers have implicitly assumed values and read back as zero; it used to work because the kernel used to just write zero to that register the read back value did match what was written.
Quoted 6 lines
The fix is a new resource flag
IORESOURCE_PCI_FIXEDused to mark a resource as non-movable. This will also be useful to keep other import system resources from being moved around - for example system consoles on PCI busses.Signed-off-by Ralf Baechle <[email protected]>
Quoted 8 lines · Ralf Baechle
Since commit
368c73d4f689dae0807d0a2aa74c61fd2b9b075fthe kernel will try to update the non-writeable BAR registers 0..3 of PIIX4 IDE adapters ifpci_assign_unassigned_resources()is used to do full resource assignment of the bus. This fails because in the PIIX4 these BAR registers have implicitly assumed values and read back as zero; it used to work because the kernel used to just write zero to that register the read back value did match what was written.
Quoted 4 lines
The fix is a new resource flag
IORESOURCE_PCI_FIXEDused to mark a resource as non-movable. This will also be useful to keep other import system resources from being moved around - for example system consoles on PCI busses.
I have a problem where an ich6 (SATA+PATA) is getting its port0 reserved by the pci quirk for libata so that it gets picked up by ata_piix. In current git, ata_piix complains:
[ 124.507570] PCI: Unable to reserve I/O region #1:8@1f0 for device 0000:00:1f.2
I bisected to the same commit, 368c73d4f689dae0807d0a2aa74c61fd2b9b075f, however, your patch doesn't fix my problem.
Quoted 14 lines · Ben Collins
Quoted 8 lines · Ralf Baechle
Since commit
368c73d4f689dae0807d0a2aa74c61fd2b9b075fthe kernel will try to update the non-writeable BAR registers 0..3 of PIIX4 IDE adapters ifpci_assign_unassigned_resources()is used to do full resource assignment of the bus. This fails because in the PIIX4 these BAR registers have implicitly assumed values and read back as zero; it used to work because the kernel used to just write zero to that register the read back value did match what was written.Quoted 4 lines
The fix is a new resource flag
IORESOURCE_PCI_FIXEDused to mark a resource as non-movable. This will also be useful to keep other import system resources from being moved around - for example system consoles on PCI busses.
Quoted 8 lines
I have a problem where an ich6 (SATA+PATA) is getting its port0 reserved by the pci quirk for libata so that it gets picked up by
ata_piix. In current git,ata_piixcomplains:[ 124.507570] PCI: Unable to reserve I/O region #1:8@1f0 for device 0000:00:1f.2I bisected to the same commit,
368c73d4f689dae0807d0a2aa74c61fd2b9b075f, however, your patch doesn't fix my problem.
Looks like a double reservation. My patch doesn't deal with reservations at all. I thought about resource reservations but decieded that should be dealt with elsewhere.
Ralf
Quoted 20 lines · Ralf Baechle
Quoted 18 lines · Ben Collins
Quoted 8 lines · Ralf Baechle
Since commit
368c73d4f689dae0807d0a2aa74c61fd2b9b075fthe kernel will try to update the non-writeable BAR registers 0..3 of PIIX4 IDE adapters ifpci_assign_unassigned_resources()is used to do full resource assignment of the bus. This fails because in the PIIX4 these BAR registers have implicitly assumed values and read back as zero; it used to work because the kernel used to just write zero to that register the read back value did match what was written.Quoted 4 lines
The fix is a new resource flag
IORESOURCE_PCI_FIXEDused to mark a resource as non-movable. This will also be useful to keep other import system resources from being moved around - for example system consoles on PCI busses.I have a problem where an ich6 (SATA+PATA) is getting its port0 reserved by the pci quirk for libata so that it gets picked up by
ata_piix. In current git,ata_piixcomplains:
Quoted 8 lines
Quoted 4 lines
[ 124.507570] PCI: Unable to reserve I/O region #1:8@1f0 for device 0000:00:1f.2I bisected to the same commit,
368c73d4f689dae0807d0a2aa74c61fd2b9b075f, however, your patch doesn't fix my problem.Looks like a double reservation. My patch doesn't deal with reservations at all. I thought about resource reservations but decieded that should be dealt with elsewhere.
Checking the patch, my problem is that the old way, all BAR's were being set at start = end = flags = 0. The patch makes it set all the BAR's to the normal values. This is what it looks like in lspci, pre this patch:
Region 0: I/O ports at <unassigned>
Region 1: I/O ports at <unassigned>
Region 2: I/O ports at <unassigned>
Region 3: I/O ports at <unassigned>
So my device is not running in compatibility mode, and should not have the BAR's set, as Alan's patch does.
Quoted 2 lines
Checking the patch, my problem is that the old way, all BAR's were being set at start = end = flags = 0. The patch makes it set all the BAR's to
Yes the old quirk used to blank the resources as the values on the chip are undefined and random. This gives you corrupt resource trees and needs hacks in the drivers as well
Quoted 6 lines
the normal values. This is what it looks like in lspci, pre this patch:
Region 0: I/O ports at <unassigned>
Region 1: I/O ports at <unassigned>
Region 2: I/O ports at <unassigned>
Region 3: I/O ports at <unassigned>
Then your device is in legacy mode, or was disabled
Quoted 1 line
So my device is not running in compatibility mode, and should not have
The paste you have their shows that it almost certainly is in legacy mode.
Quoted 1 line
the BAR's set, as Alan's patch does.
Dump the class code and other bits during boot check how your device is seen (native v legacy/compatibility) and whether the fixup logic triggers. It should only trigger for legacy devices.
Alan
Quoted 18 lines · Alan
Quoted 2 lines
Checking the patch, my problem is that the old way, all BAR's were being set at start = end = flags = 0. The patch makes it set all the BAR's to
Yes the old quirk used to blank the resources as the values on the chip are undefined and random. This gives you corrupt resource trees and needs hacks in the drivers as well
Quoted 6 lines
the normal values. This is what it looks like in lspci, pre this patch:
Region 0: I/O ports at <unassigned>
Region 1: I/O ports at <unassigned>
Region 2: I/O ports at <unassigned>
Region 3: I/O ports at <unassigned>Then your device is in legacy mode, or was disabled
Quoted 1 line
So my device is not running in compatibility mode, and should not have
Quoted 7 lines
The paste you have their shows that it almost certainly is in legacy mode.
Quoted 1 line
the BAR's set, as Alan's patch does.
Dump the class code and other bits during boot check how your device is seen (native v legacy/compatibility) and whether the fixup logic triggers. It should only trigger for legacy devices.
You're right, I was reading this backwards.
Thing is, if I disable the quirk, ata_piix works correctly.
So I think maybe the problem is the logic here. Having the PIIX quirk pre-reserve SATA ports that are on legacy BAR's just doesn't seem to make sense unless libata is going to recognize that. I think it's just an accident that it worked before.
Looking at ata_pci_init_one(), it does check for this:
if (legacy_mode) {
if (!request_region(ATA_PRIMARY_CMD, 8, "libata")) {
struct resource *conflict, res;
res.start = ATA_PRIMARY_CMD;
res.end = ATA_PRIMARY_CMD + 8 - 1;
conflict = ____request_resource(&ioport_resource, &res);
while (conflict->child)
conflict = ____request_resource(conflict, &res);
if (!strcmp(conflict->name, "libata"))
legacy_mode |= ATA_PORT_PRIMARY;My controller is in legacy mode, however, it never gets to here because of this call, just before this block of code:
rc = pci_request_regions(pdev, DRV_NAME);
if (rc) {
disable_dev_on_err = 0;
goto err_out;
}So, I wrote up this patch that made things work for me. It also should make ata_pci_init_one() work with mixed legacy/native ports on the same controller (if there are such things). My controller is port0=SATA, port1=PATA.
drivers/ata/libata-sff.c +85 -36
@@ -852,11 +852,14 @@ #ifdef CONFIG_PCIstruct ata_probe_ent *ata_pci_init_native_mode (struct pci_dev *pdev,struct ata_port_info **port,int ports) { -struct ata_probe_ent *probe_ent = -ata_probe_ent_alloc (pci_dev_to_dev (pdev), port[0 ]); +struct ata_probe_ent *probe_ent;int p =0 ;unsigned long bmdma; +if (!(ports & (ATA_PORT_PRIMARY |ATA_PORT_SECONDARY ))) +return NULL ; + + probe_ent =ata_probe_ent_alloc (pci_dev_to_dev (pdev), port[0 ]);if (!probe_ent)return NULL ;
@@ -906,6 +909,9 @@ static struct ata_probe_ent *ata_pci_inistruct ata_probe_ent *probe_ent;unsigned long bmdma =pci_resource_start (pdev,4 ); +if (!(port_mask & (ATA_PORT_PRIMARY |ATA_PORT_SECONDARY ))) +return NULL ; + probe_ent =ata_probe_ent_alloc (pci_dev_to_dev (pdev), port[0 ]);if (!probe_ent)return NULL ;
@@ -979,10 +985,10 @@ static struct ata_probe_ent *ata_pci_iniint ata_pci_init_one (struct pci_dev *pdev,struct ata_port_info **port_info,unsigned int n_ports) { -struct ata_probe_ent *probe_ent =NULL ; +struct ata_probe_ent *probe_ent_legacy =NULL ; +struct ata_probe_ent *probe_ent_native =NULL ;struct ata_port_info *port[2 ]; -u8 mask; -unsigned int legacy_mode =0 ; +unsigned int legacy_mode =0 , legacy_probe =0 , native_probe =0 ;int disable_dev_on_err =1 ;int rc;
@@ -1011,29 +1017,32 @@ int ata_pci_init_one (struct pci_dev *pdif ((pdev->class >>8 ) ==PCI_CLASS_STORAGE_IDE ) {u8 tmp8; -/* TODO: What if one channel is in native mode ... */ pci_read_config_byte (pdev,PCI_CLASS_PROG , &tmp8); - mask = (1 <<2 ) | (1 <<0 ); -if ((tmp8 & mask) != mask) - legacy_mode = (1 <<3 ); + +if ((tmp8 &ATA_PORT_PRIMARY_LEGACY ) ==0 ) + legacy_mode |=ATA_PORT_PRIMARY ; +if ((tmp8 &ATA_PORT_SECONDARY_LEGACY ) ==0 ) + legacy_mode |=ATA_PORT_SECONDARY ; +#if defined(CONFIG_NO_ATA_LEGACY )/* Some platforms with PCI limits cannot address compat port space. In that case we punt if their firmware has left a device in compatibility mode */ if (legacy_mode) { -printk (KERN_ERR "ata: Compatibility mode ATA is not supported on this platform, skipping.\n" ); +printk (KERN_ERR "ata: Compatibility mode ATA is not " \ +"supported on this platform, skipping.\n" );return -EOPNOTSUPP ; }#endif } - rc =pci_request_regions (pdev,DRV_NAME ); + rc =pci_request_region (pdev,4 ,DRV_NAME );if (rc) { disable_dev_on_err =0 ; goto err_out; } -if (legacy_mode) { +if (legacy_mode &ATA_PORT_PRIMARY ) {if (!request_region (ATA_PRIMARY_CMD ,8 ,"libata" )) {struct resource *conflict, res; res.start =ATA_PRIMARY_CMD ;
@@ -1042,7 +1051,7 @@ #endifwhile (conflict->child) conflict =____request_resource (conflict, &res);if (!strcmp (conflict->name,"libata" )) - legacy_mode |=ATA_PORT_PRIMARY ; + legacy_probe |=ATA_PORT_PRIMARY ;else { disable_dev_on_err =0 ; printk(KERN_WARNING "ata: 0x%0X IDE port busy\n" \
@@ -1051,8 +1060,19 @@ #endif conflict->name); } }else - legacy_mode |=ATA_PORT_PRIMARY ; + legacy_probe |=ATA_PORT_PRIMARY ; + }else { +if (!pci_request_region (pdev,0 ,DRV_NAME )) { +if (!pci_request_region (pdev,1 ,DRV_NAME )) + native_probe |=ATA_PORT_PRIMARY ; +else { + disable_dev_on_err =0 ; +pci_release_region (pdev,0 ); + } + } + } +if (legacy_mode &ATA_PORT_SECONDARY ) {if (!request_region (ATA_SECONDARY_CMD ,8 ,"libata" )) {struct resource *conflict, res; res.start =ATA_SECONDARY_CMD ;
@@ -1061,7 +1081,7 @@ #endifwhile (conflict->child) conflict =____request_resource (conflict, &res);if (!strcmp (conflict->name,"libata" )) - legacy_mode |=ATA_PORT_SECONDARY ; + legacy_probe |=ATA_PORT_SECONDARY ;else { disable_dev_on_err =0 ; printk(KERN_WARNING "ata: 0x%X IDE port busy\n" \
@@ -1070,11 +1090,20 @@ #endif conflict->name); } }else - legacy_mode |=ATA_PORT_SECONDARY ; - } + legacy_probe |=ATA_PORT_SECONDARY ; + }else if (n_ports >1 ) { +if (!pci_request_region (pdev,2 ,DRV_NAME )) { +if (!pci_request_region (pdev,3 ,DRV_NAME )) + native_probe =ATA_PORT_SECONDARY ; +else { + disable_dev_on_err =0 ; +pci_release_region (pdev,2 ); + } + } + } -/* we have legacy mode, but all ports are unavailable */ -if (legacy_mode == (1 <<3 )) { +/* Didn't enable any ports */ +if (!legacy_probe && !native_probe) { rc = -EBUSY ; goto err_out_regions; }
@@ -1087,38 +1116,58 @@ #endifif (rc) goto err_out_regions; -if (legacy_mode) { - probe_ent =ata_pci_init_legacy_port (pdev, port, legacy_mode); - }else { -if (n_ports ==2 ) - probe_ent =ata_pci_init_native_mode (pdev, port,ATA_PORT_PRIMARY |ATA_PORT_SECONDARY ); -else - probe_ent =ata_pci_init_native_mode (pdev, port,ATA_PORT_PRIMARY ); - } -if (!probe_ent) { + probe_ent_legacy =ata_pci_init_legacy_port (pdev, port, legacy_probe); + probe_ent_native =ata_pci_init_native_mode (pdev, port, native_probe); + +if (!probe_ent_legacy && !probe_ent_native) { rc = -ENOMEM ; goto err_out_regions; }pci_set_master (pdev); -if (!ata_device_add (probe_ent)) { +if (probe_ent_legacy) { +if (!ata_device_add (probe_ent_legacy)) { +printk (KERN_WARNING "ata: Failed to add legacy device(s)\n" ); +kfree (probe_ent_legacy); + probe_ent_legacy =NULL ; + } + } +if (probe_ent_native) { +if (!ata_device_add (probe_ent_native)) { +printk (KERN_WARNING "ata: Failed to add native device(s)\n" ); +kfree (probe_ent_native); + probe_ent_native =NULL ; + } + } + +/* Did both fail? If so, no devices to see here. */ +if (!probe_ent_native && !probe_ent_legacy) { rc = -ENODEV ; - goto err_out_ent; + goto err_out_regions; } -kfree (probe_ent); +kfree (probe_ent_legacy); +kfree (probe_ent_native);return 0 ; -err_out_ent: -kfree (probe_ent); err_out_regions: -if (legacy_mode &ATA_PORT_PRIMARY ) +if (legacy_probe &ATA_PORT_PRIMARY )release_region (ATA_PRIMARY_CMD ,8 ); -if (legacy_mode &ATA_PORT_SECONDARY ) +else if (native_probe &ATA_PORT_PRIMARY ) { +pci_release_region (pdev,0 ); +pci_release_region (pdev,1 ); + } + +if (legacy_probe &ATA_PORT_SECONDARY )release_region (ATA_SECONDARY_CMD ,8 ); -pci_release_regions (pdev); +else if (native_probe &ATA_PORT_SECONDARY ) { +pci_release_region (pdev,2 ); +pci_release_region (pdev,3 ); + } + +pci_release_region (pdev,4 ); err_out:if (disable_dev_on_err)pci_disable_device (pdev);
include/linux/libata.h +4 -0
@@ -260,6 +260,10 @@ enum {ATA_PORT_PRIMARY = (1 <<0 ),ATA_PORT_SECONDARY = (1 <<1 ), +/* masks for port legacy mode */ +ATA_PORT_PRIMARY_LEGACY = (1 <<0 ), +ATA_PORT_SECONDARY_LEGACY = (1 <<2 ), +/* ering size */ ATA_ERING_SIZE = 32,
Quoted 8 lines · On Sat, 09 Dec 2006 03:12:11 -0500 Ben Collins <[email protected]> wrote:
My controller is in legacy mode, however, it never gets to here because of this call, just before this block of code:
rc = pci_request_regions(pdev, DRV_NAME); if (rc) { disable_dev_on_err = 0; goto err_out; }
Then you don't have the fix applied that was posted. That code is not present in the form you pasted in the fixed version of the libata code. It is within an if (!legacy_mode)
Alan
On Sat, 09 Dec 2006 03:12:11 -0500
Ben Collins <[email protected]> wrote:
And NAK the patch because its about 500 times longer than the real fix that was posted.
Quoted 11 lines · Alan
Quoted 8 lines · On Sat, 09 Dec 2006 03:12:11 -0500 Ben Collins <[email protected]> wrote:
My controller is in legacy mode, however, it never gets to here because of this call, just before this block of code:
rc = pci_request_regions(pdev, DRV_NAME); if (rc) { disable_dev_on_err = 0; goto err_out; }
Quoted 3 lines
Then you don't have the fix applied that was posted. That code is not present in the form you pasted in the fixed version of the libata code. It is within an if (!legacy_mode)
I didn't see that patch until you mentioned it. Even still, there seems to be one thing missing. I suspect you still want to take the bmdma resource since both native and legacy use it. With the patch you mentioned, that resource wont be requested in legacy mode.
Also, I did my patch as detailed as it is because of this line:
/* TODO: What if one channel is in native mode ... */
If that's never going to be the case then the comment should go. If it is possible, then my patch makes this work. The way things are now, it will ignore a native mode port if it is sitting on the same controller as a legacy mode one.
Want to re-evaluate the patch based on this info?