Working nforce2, was Re: Fixes for nforce2 hard lockup, apic, io-apic, udma133 covered
A message that is not in the archive (sent off-list or not yet received): [email protected]
udma133 with Award bios update and nforce2
APIC error on CPU0: 02(02)
what?? no crash though.
Quoted 5 lines · Ross Dickson
Hi Bob
Jesse has award bios, see attached
Ross.
Months ago I thought using a 3ware card might help with nforce2 crashes so I gave up on promise and sii hd cards after a lot of experiments(hdparm, no lapic, no acpi, apic off in bios) and put in a 3ware card but I flashed the bios at the same time so didn't know if the 3ware card helped with the nforce2 crashing or not, since the bios flash did the job.
With 3ware I couldn't use hdparm to see what udma settings the drives were set to. Now I can report.
Just now I took the 3ware card out and went back to promise cards(using 4 hd's either method, 2 cd's on mboard amd74xx, onboard sata disabled).
bob@where cat /proc/interrupts
CPU0
0: 3350153 IO-APIC-edge timer 1: 5775 IO-APIC-edge i8042 2: 0 XT-PIC cascade 8: 1 IO-APIC-edge rtc 9: 0 IO-APIC-level acpi 12: 5385 IO-APIC-edge i8042 14: 10 IO-APIC-edge ide0 15: 10 IO-APIC-edge ide1 16: 1717957 IO-APIC-level ide2, ide3, eth0 19: 472929 IO-APIC-level ide4, ide5 21: 0 IO-APIC-level NVidia nForce2 NMI: 822 LOC: 3350073 ERR: 35 MIS: 15818
cd's on amd74xx onboard, amd74xx onboard is always solid, 4 ide hd's on two promise cards. not many nmi ticks without the better patch there.
bonnie++ smooth, then hdparm up the settings, udma6, bonnie++ again, saw a few "APIC error on CPU0: 02(02)" but no lockup. not sure if data lost since it was a test. APIC error might be fixed by changing hdparm settings. This second test was with unmasked irq and udma6.
I have to patch to get ioapic edge timer on.
This 11/7/2003 updated award bios does not have a cpu disconnect option but it does eliminate the crashes with no patch and it is no longer impossible to use promise ide udma133 controller cards.
MSI K7N2 Delta MCP2-T mboard
I don't have the promise patch in yet, either, so the APIC error might be from that, or hdparm unmasked irq.
-Bob
Quoted 2 lines · Bob
APIC error on CPU0: 02(02)
what?? no crash though.
[...]
Quoted 17 lines
bob@where cat
/proc/interrupts
CPU00: 3350153 IO-APIC-edge timer 1: 5775 IO-APIC-edge i8042 2: 0 XT-PIC cascade 8: 1 IO-APIC-edge rtc 9: 0 IO-APIC-level acpi 12: 5385 IO-APIC-edge i8042 14: 10 IO-APIC-edge ide0 15: 10 IO-APIC-edge ide1 16: 1717957 IO-APIC-level ide2, ide3, eth0 19: 472929 IO-APIC-level ide4, ide5 21: 0 IO-APIC-level NVidia nForce2 NMI: 822 LOC: 3350073 ERR: 35 MIS: 15818
It looks like the infamous APIC delivery bug -- the "MIS" counter shows
how many level-triggered interrupts has been erronously delivered as edge-triggered ones. No wonder the system shows instability -- you have noise problems at the APIC bus.
Signature · 3 lines
+ Maciej W. Rozycki, Technical University of Gdansk, Poland + +--------------------------------------------------------------+ + e-mail: [email protected], PGP key available +
apic.c patch needs reload:%lu instead of %u ----------> printk("..APIC TIMER ack delay, reload:%lu, safe:%u\n",
amd xp3000+, 1:1 333mhz fsb to ram, 166mhz cpu bus clock x dual channel 2-512mb pc3200 tested cas2 sticks, 1:1 fsb to ram for 333mhz, Award bios with update that works for non-crashing but not for edge timer without patch. MSI K7N2 Delta MCP2-T mbo linux-2.6.0-test11
This was with 3ware controller and unpatched 2.6.0-test11 Note low MIS score but PIC timer and no nmi--
CPU0 0: 244393560 XT-PIC timer 1: 31963 IO-APIC-edge i8042 2: 0 XT-PIC cascade 8: 1 IO-APIC-edge rtc 9: 0 IO-APIC-level acpi 12: 251884 IO-APIC-edge i8042 14: 22 IO-APIC-edge ide0 15: 24 IO-APIC-edge ide1 16: 4290216 IO-APIC-level 3ware Storage Controller, yenta, yenta 17: 5929405 IO-APIC-level eth0 21: 0 IO-APIC-level NVidia nForce2 NMI: 0 LOC: 244378698 ERR: 0 MIS: 6
Next is with the first edge timer patch, nmi_watchdog=2 works but =1 does not, MIS really high("noisy bus"), replacing 3ware with promise cards and hdparm udma133 causes apic error logged to console during bonnie++ test--
Quoted 15 lines
Quoted 15 lines
APIC error on CPU0: 02(02)
what?? no crash though.bob@where cat
/proc/interrupts
CPU00: 3350153 IO-APIC-edge timer 1: 5775 IO-APIC-edge i8042 2: 0 XT-PIC cascade 8: 1 IO-APIC-edge rtc 9: 0 IO-APIC-level acpi 12: 5385 IO-APIC-edge i8042 14: 10 IO-APIC-edge ide0 15: 10 IO-APIC-edge ide1 16: 1717957 IO-APIC-level ide2, ide3, eth0
Quoted 8 lines
Quoted 8 lines
19: 472929 IO-APIC-level ide4, ide5 21: 0 IO-APIC-level NVidia nForce2 NMI: 822 LOC: 3350073 ERR: 35 MIS: 15818
now with promise controllers again, new edge timer patch permits nmi_watchdog=1 not =2, lots of nmi ticks, MIS count is only half with first timer patch, NMI ticks = LOC?
bob@where cat /proc/interrupts
CPU0
0: 46188571 IO-APIC-edge timer 1: 12396 IO-APIC-edge i8042 2: 0 XT-PIC cascade 8: 1 IO-APIC-edge rtc 9: 0 IO-APIC-level acpi 12: 147429 IO-APIC-edge i8042 14: 10 IO-APIC-edge ide0 15: 10 IO-APIC-edge ide1 16: 1413705 IO-APIC-level ide2, ide3, eth0 17: 0 IO-APIC-level yenta, yenta 19: 258804 IO-APIC-level ide4, ide5 21: 0 IO-APIC-level NVidia nForce2 NMI: 46188592 LOC: 46188482 ERR: 36 MIS: 6877
Now I'll try 800UL/100ndelay to see if it helps with MIS count(pseudo-sci masochism), be back in a while.
Oh, by the way, I set debug 1 in apic.h but I don't see anything, and I thought I saw a compile error flash by, so now I'll compile > logfile 2>&1 and might see why I don't see--
"..APIC TIMER ack delay, predelay count: 20769"
I don't see any of that debug stuff. Maybe the compile errors I found were it, see my previous message about "unsigned in format", maybe printk needs %lu(I don't know hardly nuffing yet). I'm going to boot 800UL/100ndelay now.
it needs reload:%lu instead of %u ----------> printk("..APIC TIMER ack delay, reload:%lu, safe:%u\n",
Ross: "Can you also advise if your bios setting of the "C1 disconnect" is set"
I can only guess by my 41C low load 48C high load temps exactly equal to range for "2.1Ghz 333mhz" of Ian Kumlien(his?) which is same speed as mine, that probably cpu disconnect is not on. I have no visible choice in setup for cpu disconnect. I'll try athcool to see how disconnect is set.
Ross:"I have heard lockups are not supposed to happen
at all if the fsb (host bus clock speed) matches the
ddr speed. One of my systems went about 4 hours (xp2500
333fsb, DDR333) without the apic delay patch on a phoenix bios before lockup"
A couple of months ago I was overly optimistic a couple of times before the bios update, and it seemed to work to use 1:1 and only amd74xx onboard hd controller, no hd cards, and pre-emptive, anticipatory sched not deadline, apic off in setup but on in linux, lapic off, acpi on. It was almost stable if using only one drive, but I really can't go without hd cards for software raid, so the first fsck on boot if using hd card, and crash. I could finesse stability by using options but never quite reach reliability without a bios update, and certain functions need patching, and I still have "MIS count, noisy bus" and agp8 crash(I can use the X nv driver and agpgart no problem, but not nvidia drivers for X and agp8).