sata_nv - ADMA issues with 2.6.20
I've just upgraded my home server to 2.6.20. It's got an Athlon64 on an ASUS nForce-4 motherboard running a 32 bit kernel. I've had to fall back to using sata_nv.adma=0 on the kernel command line. One of the NCQ capable drives repeatedly produced the following errors. There wasn't much disk IO going on at the time. It's perfectly happy now with ADMA disabled. Strange thing is the other identical drive ata8 showed no problems (they're both part of a software raid1)
Some clues follow.
Cheers
David
Quoted 5 lines
Quoted 5 lines
Feb 9 18:40:27 server kernel: ata7: EH in ADMA mode, notifier 0x0 notifier_error 0x0 gen_ctl 0x1501000 status 0x400 Feb 9 18:40:27 server kernel: ata7: CPB 0: ctl_flags 0x1f, resp_flags 0x0 Feb 9 18:40:27 server kernel: ata7: CPB 1: ctl_flags 0x1f, resp_flags 0x1 Feb 9 18:40:27 server kernel: ata7: CPB 2: ctl_flags 0x1f, resp_flags 0x1 Feb 9 18:40:27 server kernel: ata7: CPB 3: ctl_flags 0x1f, resp_flags 0x1
etc etc..
Quoted 8 lines
Quoted 8 lines
Feb 9 18:40:29 server kernel: ata7: CPB 27: ctl_flags 0x1f, resp_flags 0x1 Feb 9 18:40:29 server kernel: ata7: CPB 28: ctl_flags 0x1f, resp_flags 0x1 Feb 9 18:40:29 server kernel: ata7: CPB 29: ctl_flags 0x1f, resp_flags 0x1 Feb 9 18:40:29 server kernel: ata7: CPB 30: ctl_flags 0x1f, resp_flags 0x1 Feb 9 18:40:29 server kernel: ata7: Resetting port Feb 9 18:40:29 server kernel: ata7.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x2 frozen Feb 9 18:40:29 server kernel: ata7.00: cmd 61/08:00:1f:e4:50/00:00:09:00:00/40 tag 0 cdb 0x0 data 4096 out Feb 9 18:40:29 server kernel: res 40/00:00:00:00:00/00:00:00:00:00/00 Emask 0x4 (timeout)
Quoted 8 lines
Quoted 8 lines
Feb 9 18:40:29 server kernel: ata7: soft resetting port Feb 9 18:40:29 server kernel: ata7: SATA link up 1.5 Gbps (SStatus 113 SControl 300) Feb 9 18:40:29 server kernel: ata7.00: configured for UDMA/133 Feb 9 18:40:29 server kernel: ata7: EH complete Feb 9 18:40:29 server kernel: SCSI device sdg: 156301488 512-byte hdwr sectors (80026 MB) Feb 9 18:40:29 server kernel: sdg: Write Protect is off Feb 9 18:40:29 server kernel: sdg: Mode Sense: 00 3a 00 00 Feb 9 18:40:29 server kernel: SCSI device sdg: write cache: enabled, read cache: enabled, doesn't support DPO or FUA
eventually bringing the speed down
Quoted 4 lines
Quoted 3 lines
Feb 9 18:47:36 server kernel: ata7: EH in ADMA mode, notifier 0x0 notifier_error 0x0 gen_ctl 0x1501000 status 0x400 Feb 9 18:47:36 server kernel: ata7: CPB 0: ctl_flags 0x1f, resp_flags 0x0 Feb 9 18:47:36 server kernel: ata7: CPB 1: ctl_flags 0x1f, resp_flags 0x1....
Quoted 15 lines
Quoted 7 lines
Feb 9 18:47:36 server kernel: ata7: CPB 29: ctl_flags 0x1f, resp_flags 0x1 Feb 9 18:47:36 server kernel: ata7: CPB 30: ctl_flags 0x1f, resp_flags 0x1 Feb 9 18:47:36 server kernel: ata7: Resetting port Feb 9 18:47:36 server kernel: ata7.00: limiting speed to UDMA/100 Feb 9 18:47:36 server kernel: ata7.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x2 frozen Feb 9 18:47:36 server kernel: ata7.00: cmd 61/08:00:1f:e4:50/00:00:09:00:00/40 tag 0 cdb 0x0 data 4096 out Feb 9 18:47:36 server kernel: res 40/00:00:00:00:00/00:00:00:00:00/00 Emask 0x4 (timeout)Quoted 8 lines
Feb 9 18:47:36 server kernel: ata7: soft resetting port Feb 9 18:47:36 server kernel: ata7: SATA link up 1.5 Gbps (SStatus 113 SControl 300) Feb 9 18:47:36 server kernel: ata7.00: configured for UDMA/100 Feb 9 18:47:36 server kernel: ata7: EH complete Feb 9 18:47:36 server kernel: SCSI device sdg: 156301488 512-byte hdwr sectors (80026 MB) Feb 9 18:47:36 server kernel: sdg: Write Protect is off Feb 9 18:47:36 server kernel: sdg: Mode Sense: 00 3a 00 00 Feb 9 18:47:36 server kernel: SCSI device sdg: write cache: enabled, read cache: enabled, doesn't support DPO or FUA
All the way to UDMA/33
Quoted 4 lines
Quoted 4 lines
Feb 9 19:47:38 server kernel: ata7: Resetting port Feb 9 19:47:38 server kernel: ata7.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x2 frozen Feb 9 19:47:38 server kernel: ata7.00: cmd 61/08:00:1f:e4:50/00:00:09:00:00/40 tag 0 cdb 0x0 data 4096 out Feb 9 19:47:38 server kernel: res 40/00:00:00:00:00/00:00:00:00:00/00 Emask 0x4 (timeout)
Quoted 8 lines
Quoted 8 lines
Feb 9 19:47:38 server kernel: ata7: soft resetting port Feb 9 19:47:39 server kernel: ata7: SATA link up 1.5 Gbps (SStatus 113 SControl 300) Feb 9 19:47:39 server kernel: ata7.00: configured for UDMA/33 Feb 9 19:47:39 server kernel: ata7: EH complete Feb 9 19:47:39 server kernel: SCSI device sdg: 156301488 512-byte hdwr sectors (80026 MB) Feb 9 19:47:39 server kernel: sdg: Write Protect is off Feb 9 19:47:39 server kernel: sdg: Mode Sense: 00 3a 00 00 Feb 9 19:47:39 server kernel: SCSI device sdg: write cache: enabled, read cache: enabled, doesn't support DPO or FUA
relevant dmesg follows
Quoted 176 lines
Quoted 176 lines
<6>ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx <6>NFORCE-CK804: IDE controller at PCI slot 0000:00:06.0
<6>NFORCE-CK804: chipset revision 242
<6>NFORCE-CK804: not 100%% native mode: will probe irqs later <6>NFORCE-CK804: 0000:00:06.0 (rev f2) UDMA133 controller
<6> ide0: BM-DMA at 0xf000-0xf007, BIOS settings: hda:DMA, hdb:DMA
<6> ide1: BM-DMA at 0xf008-0xf00f, BIOS settings: hdc:DMA, hdd:DMA
<7>Probing IDE interface ide0...
<4>hda: PIONEER DVD-RW DVR-107D, ATAPI CD/DVD-ROM drive
<4>ide0 at 0x1f0-0x1f7,0x3f6 on irq 14
<7>Probing IDE interface ide1...
<7>Probing IDE interface ide1...
<6>hda: ATAPI 40X DVD-ROM DVD-R CD-R/RW drive, 2000kB Cache, UDMA(33) <6>Uniform CD-ROM driver Revision: 3.20
<6>megaraid cmm: 2.20.2.7 (Release Date: Sun Jul 16 00:01:03 EST 2006) <6>megaraid: 2.20.4.9 (Release Date: Sun Jul 16 12:27:22 EST 2006) <7>sata_sil 0000:05:0a.0: version 2.0
<6>ACPI: PCI Interrupt 0000:05:0a.0[A] -> Link [APC4] -> GSI 19 (level, low) -> IRQ 20 <6>sata_sil 0000:05:0a.0: ApplyingR_ERRon DMA activate FIS errata fix <6>ata1: SATA max UDMA/100 cmd0xF882E080ctl0xF882E08Abmdma0xF882E000irq 20 <6>ata2: SATA max UDMA/100 cmd0xF882E0C0ctl0xF882E0CAbmdma0xF882E008irq 20 <6>ata3: SATA max UDMA/100 cmd0xF882E280ctl0xF882E28Abmdma0xF882E200irq 20 <6>ata4: SATA max UDMA/100 cmd0xF882E2C0ctl0xF882E2CAbmdma0xF882E208irq 20 <6>scsi0 :sata_sil
<6>ata1: SATA link up 1.5 Gbps (SStatus 113 SControl 310)
<6>ata1.00: ATA-7, max UDMA/133, 586114704 sectors: LBA48 NCQ (depth 0/32) <6>ata1.00: ata1: dev 0 multi count 16
<6>ata1.00: configured for UDMA/100
<6>scsi1 :sata_sil
<6>ata2: SATA link up 1.5 Gbps (SStatus 113 SControl 310)
<6>ata2.00: ATA-7, max UDMA/133, 586072368 sectors: LBA48 NCQ (depth 0/32) <6>ata2.00: ata2: dev 0 multi count 16
<6>ata2.00: configured for UDMA/100
<6>scsi2 :sata_sil
<6>ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 310)
<6>ata3.00: ATA-7, max UDMA/133, 586072368 sectors: LBA48 NCQ (depth 0/32) <6>ata3.00: ata3: dev 0 multi count 16
<6>ata3.00: configured for UDMA/100
<6>scsi3 :sata_sil
<6>ata4: SATA link up 1.5 Gbps (SStatus 113 SControl 310)
<6>ata4.00: ATA-7, max UDMA/133, 586114704 sectors: LBA48 NCQ (depth 0/32) <6>ata4.00: ata4: dev 0 multi count 16
<6>ata4.00: configured for UDMA/100
<5>scsi 0:0:0:0: Direct-Access ATA Maxtor 6L300S0 BACE PQ: 0 ANSI: 5
<5>SCSI device sda: 586114704 512-byte hdwr sectors (300091 MB)
<5>sda: Write Protect is off
<7>sda: Mode Sense: 00 3a 00 00
<5>SCSI device sda: write cache: enabled, read cache: enabled, doesn't support DPO or FUA <5>SCSI device sda: 586114704 512-byte hdwr sectors (300091 MB)
<5>sda: Write Protect is off
<7>sda: Mode Sense: 00 3a 00 00
<5>SCSI device sda: write cache: enabled, read cache: enabled, doesn't support DPO or FUA <6> sda: sda1
<5>sd 0:0:0:0: Attached scsi disk sda
<5>sd 0:0:0:0: Attached scsi generic sg0 type 0
<5>scsi 1:0:0:0: Direct-Access ATA ST3300831AS 3.03 PQ: 0 ANSI: 5
<5>SCSI device sdb: 586072368 512-byte hdwr sectors (300069 MB)
<5>sdb: Write Protect is off
<7>sdb: Mode Sense: 00 3a 00 00
<5>SCSI device sdb: write cache: enabled, read cache: enabled, doesn't support DPO or FUA <5>SCSI device sdb: 586072368 512-byte hdwr sectors (300069 MB)
<5>sdb: Write Protect is off
<7>sdb: Mode Sense: 00 3a 00 00
<5>SCSI device sdb: write cache: enabled, read cache: enabled, doesn't support DPO or FUA <6> sdb: sdb1
<5>sd 1:0:0:0: Attached scsi disk sdb
<5>sd 1:0:0:0: Attached scsi generic sg1 type 0
<5>scsi 2:0:0:0: Direct-Access ATA ST3300831AS 3.03 PQ: 0 ANSI: 5
<5>SCSI device sdc: 586072368 512-byte hdwr sectors (300069 MB)
<5>sdc: Write Protect is off
<7>sdc: Mode Sense: 00 3a 00 00
<5>SCSI device sdc: write cache: enabled, read cache: enabled, doesn't support DPO or FUA <5>SCSI device sdc: 586072368 512-byte hdwr sectors (300069 MB)
<5>sdc: Write Protect is off
<7>sdc: Mode Sense: 00 3a 00 00
<5>SCSI device sdc: write cache: enabled, read cache: enabled, doesn't support DPO or FUA <6> sdc: sdc1
<5>sd 2:0:0:0: Attached scsi disk sdc
<5>sd 2:0:0:0: Attached scsi generic sg2 type 0
<5>scsi 3:0:0:0: Direct-Access ATA Maxtor 6L300S0 BACE PQ: 0 ANSI: 5
<5>SCSI device sdd: 586114704 512-byte hdwr sectors (300091 MB)
<5>sdd: Write Protect is off
<7>sdd: Mode Sense: 00 3a 00 00
<5>SCSI device sdd: write cache: enabled, read cache: enabled, doesn't support DPO or FUA <5>SCSI device sdd: 586114704 512-byte hdwr sectors (300091 MB)
<5>sdd: Write Protect is off
<7>sdd: Mode Sense: 00 3a 00 00
<5>SCSI device sdd: write cache: enabled, read cache: enabled, doesn't support DPO or FUA <6> sdd: sdd1
<5>sd 3:0:0:0: Attached scsi disk sdd
<5>sd 3:0:0:0: Attached scsi generic sg3 type 0
<7>sata_nv 0000:00:07.0: version 3.2
<4>ACPI: PCI Interrupt Link [APSI] enabled at IRQ 22
<6>ACPI: PCI Interrupt 0000:00:07.0[A] -> Link [APSI] -> GSI 22 (level, low) -> IRQ 21 <5>sata_nv 0000:00:07.0: Using ADMA mode
<7>PCI: Setting latency timer of device 0000:00:07.0 to 64
<6>ata5: SATA max UDMA/133 cmd0xF8836480ctl0xF88364A0bmdma0xD800irq 21 <6>ata6: SATA max UDMA/133 cmd0xF8836580ctl0xF88365A0bmdma0xD808irq 21 <6>scsi4 :sata_nv
<6>ata5: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
<6>ata5.00: ATA-7, max UDMA/133, 586114704 sectors: LBA48 NCQ (depth 31/32) <6>ata5.00: ata5: dev 0 multi count 1
<6>ata5.00: configured for UDMA/133
<6>scsi5 :sata_nv
<6>ata6: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
<6>ata6.00: ATA-6, max UDMA/100, 488397168 sectors: LBA48
<6>ata6.00: ata6: dev 0 multi count 1
<6>ata6.00: configured for UDMA/100
<5>scsi 4:0:0:0: Direct-Access ATA Maxtor 6L300S0 BACE PQ: 0 ANSI: 5
<6>ata5: bounce limit0xFFFFFFFFFFFFFFFF, segment boundary0xFFFFFFFF, hw segs 61 <5>SCSI device sde: 586114704 512-byte hdwr sectors (300091 MB)
<5>sde: Write Protect is off
<7>sde: Mode Sense: 00 3a 00 00
<5>SCSI device sde: write cache: enabled, read cache: enabled, doesn't support DPO or FUA <5>SCSI device sde: 586114704 512-byte hdwr sectors (300091 MB)
<5>sde: Write Protect is off
<7>sde: Mode Sense: 00 3a 00 00
<5>SCSI device sde: write cache: enabled, read cache: enabled, doesn't support DPO or FUA <6> sde: sde1
<5>sd 4:0:0:0: Attached scsi disk sde
<5>sd 4:0:0:0: Attached scsi generic sg4 type 0
<5>scsi 5:0:0:0: Direct-Access ATA HDS722525VLSA80 V36O PQ: 0 ANSI: 5
<6>ata6: bounce limit0xFFFFFFFFFFFFFFFF, segment boundary0xFFFFFFFF, hw segs 61 <5>SCSI device sdf: 488397168 512-byte hdwr sectors (250059 MB)
<5>sdf: Write Protect is off
<7>sdf: Mode Sense: 00 3a 00 00
<5>SCSI device sdf: write cache: enabled, read cache: enabled, doesn't support DPO or FUA <5>SCSI device sdf: 488397168 512-byte hdwr sectors (250059 MB)
<5>sdf: Write Protect is off
<7>sdf: Mode Sense: 00 3a 00 00
<5>SCSI device sdf: write cache: enabled, read cache: enabled, doesn't support DPO or FUA <6> sdf: sdf1
<5>sd 5:0:0:0: Attached scsi disk sdf
<5>sd 5:0:0:0: Attached scsi generic sg5 type 0
<4>ACPI: PCI Interrupt Link [APSJ] enabled at IRQ 21
<6>ACPI: PCI Interrupt 0000:00:08.0[A] -> Link [APSJ] -> GSI 21 (level, low) -> IRQ 22 <5>sata_nv 0000:00:08.0: Using ADMA mode
<7>PCI: Setting latency timer of device 0000:00:08.0 to 64
<6>ata7: SATA max UDMA/133 cmd0xF883E480ctl0xF883E4A0bmdma0xC400irq 22 <6>ata8: SATA max UDMA/133 cmd0xF883E580ctl0xF883E5A0bmdma0xC408irq 22 <6>scsi6 :sata_nv
<6>ata7: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
<6>ata7.00: ATA-6, max UDMA/133, 156301488 sectors: LBA48 NCQ (depth 31/32) <6>ata7.00: ata7: dev 0 multi count 1
<6>ata7.00: configured for UDMA/133
<6>scsi7 :sata_nv
<6>ata8: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
<6>ata8.00: ATA-6, max UDMA/133, 156301488 sectors: LBA48 NCQ (depth 31/32) <6>ata8.00: ata8: dev 0 multi count 1
<6>ata8.00: configured for UDMA/133
<5>scsi 6:0:0:0: Direct-Access ATA ST380817AS 3.42 PQ: 0 ANSI: 5
<6>ata7: bounce limit0xFFFFFFFFFFFFFFFF, segment boundary0xFFFFFFFF, hw segs 61 <5>SCSI device sdg: 156301488 512-byte hdwr sectors (80026 MB)
<5>sdg: Write Protect is off
<7>sdg: Mode Sense: 00 3a 00 00
<5>SCSI device sdg: write cache: enabled, read cache: enabled, doesn't support DPO or FUA <5>SCSI device sdg: 156301488 512-byte hdwr sectors (80026 MB)
<5>sdg: Write Protect is off
<7>sdg: Mode Sense: 00 3a 00 00
<5>SCSI device sdg: write cache: enabled, read cache: enabled, doesn't support DPO or FUA <6> sdg: sdg1 sdg2 sdg3
<5>sd 6:0:0:0: Attached scsi disk sdg
<5>sd 6:0:0:0: Attached scsi generic sg6 type 0
<5>scsi 7:0:0:0: Direct-Access ATA ST380817AS 3.42 PQ: 0 ANSI: 5
<6>ata8: bounce limit0xFFFFFFFFFFFFFFFF, segment boundary0xFFFFFFFF, hw segs 61 <5>SCSI device sdh: 156301488 512-byte hdwr sectors (80026 MB)
<5>sdh: Write Protect is off
<7>sdh: Mode Sense: 00 3a 00 00
<5>SCSI device sdh: write cache: enabled, read cache: enabled, doesn't support DPO or FUA <5>SCSI device sdh: 156301488 512-byte hdwr sectors (80026 MB)
<5>sdh: Write Protect is off
<7>sdh: Mode Sense: 00 3a 00 00
<5>SCSI device sdh: write cache: enabled, read cache: enabled, doesn't support DPO or FUA <6> sdh: sdh1 sdh2 sdh3
<5>sd 7:0:0:0: Attached scsi disk sdh
<5>sd 7:0:0:0: Attached scsi generic sg7 type 0