Skip to contentSkip to conversation

Working nforce2, was Re: Fixes for nforce2 hard lockup, apic, io-apic, udma133 covered

DISCUSSION Bob 2 participants 3 messages Dec 13, 2003 – Dec 16, 2003 1 message not in the archive

lore
Share & tools
lore

Bob

author
#1 lore raw
In reply to a message not in the archive

udma133 with Award bios update and nforce2

APIC error on CPU0: 02(02)
what?? no crash though.

Quoted 5 lines · Ross Dickson

Hi Bob

Jesse has award bios, see attached
Ross.

Months ago I thought using a 3ware card might help with nforce2 crashes so I gave up on promise and sii hd cards after a lot of experiments(hdparm, no lapic, no acpi, apic off in bios) and put in a 3ware card but I flashed the bios at the same time so didn't know if the 3ware card helped with the nforce2 crashing or not, since the bios flash did the job.

With 3ware I couldn't use hdparm to see what udma settings the drives were set to. Now I can report.

Just now I took the 3ware card out and went back to promise cards(using 4 hd's either method, 2 cd's on mboard amd74xx, onboard sata disabled).

bob@where cat /proc/interrupts
CPU0

 0:    3350153    IO-APIC-edge  timer
 1:       5775    IO-APIC-edge  i8042
 2:          0          XT-PIC  cascade
 8:          1    IO-APIC-edge  rtc
 9:          0   IO-APIC-level  acpi
12:       5385    IO-APIC-edge  i8042
14:         10    IO-APIC-edge  ide0
15:         10    IO-APIC-edge  ide1
16:    1717957   IO-APIC-level  ide2, ide3, eth0
19:     472929   IO-APIC-level  ide4, ide5
21:          0   IO-APIC-level  NVidia nForce2
NMI:        822
LOC:    3350073
ERR:         35
MIS:      15818

cd's on amd74xx onboard, amd74xx onboard is always solid, 4 ide hd's on two promise cards. not many nmi ticks without the better patch there.

bonnie++ smooth, then hdparm up the settings, udma6, bonnie++ again, saw a few "APIC error on CPU0: 02(02)" but no lockup. not sure if data lost since it was a test. APIC error might be fixed by changing hdparm settings. This second test was with unmasked irq and udma6.

I have to patch to get ioapic edge timer on.

This 11/7/2003 updated award bios does not have a cpu disconnect option but it does eliminate the crashes with no patch and it is no longer impossible to use promise ide udma133 controller cards.

MSI K7N2 Delta MCP2-T mboard

I don't have the promise patch in yet, either, so the APIC error might be from that, or hdparm unmasked irq.

-Bob

#2 lore raw
Quoted 2 lines · Bob

APIC error on CPU0: 02(02)
what?? no crash though.

[...]

Quoted 17 lines

bob@where cat /proc/interrupts
CPU0

  0:    3350153    IO-APIC-edge  timer
  1:       5775    IO-APIC-edge  i8042
  2:          0          XT-PIC  cascade
  8:          1    IO-APIC-edge  rtc
  9:          0   IO-APIC-level  acpi
 12:       5385    IO-APIC-edge  i8042
 14:         10    IO-APIC-edge  ide0
 15:         10    IO-APIC-edge  ide1
 16:    1717957   IO-APIC-level  ide2, ide3, eth0
 19:     472929   IO-APIC-level  ide4, ide5
 21:          0   IO-APIC-level  NVidia nForce2
NMI:        822
LOC:    3350073
ERR:         35
MIS:      15818

It looks like the infamous APIC delivery bug -- the "MIS" counter shows
how many level-triggered interrupts has been erronously delivered as edge-triggered ones. No wonder the system shows instability -- you have noise problems at the APIC bus.

Signature · 3 lines
+  Maciej W. Rozycki, Technical University of Gdansk, Poland   +
+--------------------------------------------------------------+
+        e-mail: [email protected], PGP key available        +
author
#3 lore raw

apic.c patch needs reload:%lu instead of %u ----------> printk("..APIC TIMER ack delay, reload:%lu, safe:%u\n",

amd xp3000+, 1:1 333mhz fsb to ram, 166mhz cpu bus clock x dual channel 2-512mb pc3200 tested cas2 sticks, 1:1 fsb to ram for 333mhz, Award bios with update that works for non-crashing but not for edge timer without patch. MSI K7N2 Delta MCP2-T mbo linux-2.6.0-test11

This was with 3ware controller and unpatched 2.6.0-test11 Note low MIS score but PIC timer and no nmi--

         CPU0       0:  244393560          XT-PIC  timer
1:      31963    IO-APIC-edge  i8042
2:          0          XT-PIC  cascade
8:          1    IO-APIC-edge  rtc
9:          0   IO-APIC-level  acpi
12:     251884    IO-APIC-edge  i8042
14:         22    IO-APIC-edge  ide0
15:         24    IO-APIC-edge  ide1
16:    4290216   IO-APIC-level  3ware Storage Controller, yenta, yenta
17:    5929405   IO-APIC-level  eth0
21:          0   IO-APIC-level  NVidia nForce2
NMI:          0
LOC:  244378698
ERR:          0
MIS:          6

Next is with the first edge timer patch, nmi_watchdog=2 works but =1 does not, MIS really high("noisy bus"), replacing 3ware with promise cards and hdparm udma133 causes apic error logged to console during bonnie++ test--

Quoted 15 lines
Quoted 15 lines

APIC error on CPU0: 02(02)
what?? no crash though.

bob@where cat /proc/interrupts
CPU0

 0:    3350153    IO-APIC-edge  timer
 1:       5775    IO-APIC-edge  i8042
 2:          0          XT-PIC  cascade
 8:          1    IO-APIC-edge  rtc
 9:          0   IO-APIC-level  acpi
12:       5385    IO-APIC-edge  i8042
14:         10    IO-APIC-edge  ide0
15:         10    IO-APIC-edge  ide1
16:    1717957   IO-APIC-level  ide2, ide3, eth0
Quoted 8 lines
Quoted 8 lines
19:     472929   IO-APIC-level  ide4, ide5
21:          0   IO-APIC-level  NVidia nForce2
NMI:        822
LOC:    3350073
ERR:         35
MIS:      15818

now with promise controllers again, new edge timer patch permits nmi_watchdog=1 not =2, lots of nmi ticks, MIS count is only half with first timer patch, NMI ticks = LOC?

bob@where cat /proc/interrupts
CPU0

 0:   46188571    IO-APIC-edge  timer
 1:      12396    IO-APIC-edge  i8042
 2:          0          XT-PIC  cascade
 8:          1    IO-APIC-edge  rtc
 9:          0   IO-APIC-level  acpi
12:     147429    IO-APIC-edge  i8042
14:         10    IO-APIC-edge  ide0
15:         10    IO-APIC-edge  ide1
16:    1413705   IO-APIC-level  ide2, ide3, eth0
17:          0   IO-APIC-level  yenta, yenta
19:     258804   IO-APIC-level  ide4, ide5
21:          0   IO-APIC-level  NVidia nForce2
NMI:   46188592
LOC:   46188482
ERR:         36
MIS:       6877

Now I'll try 800UL/100ndelay to see if it helps with MIS count(pseudo-sci masochism), be back in a while.

Oh, by the way, I set debug 1 in apic.h but I don't see anything, and I thought I saw a compile error flash by, so now I'll compile > logfile 2>&1 and might see why I don't see--

"..APIC TIMER ack delay, predelay count: 20769"

I don't see any of that debug stuff. Maybe the compile errors I found were it, see my previous message about "unsigned in format", maybe printk needs %lu(I don't know hardly nuffing yet). I'm going to boot 800UL/100ndelay now.

it needs reload:%lu instead of %u ----------> printk("..APIC TIMER ack delay, reload:%lu, safe:%u\n",

Ross: "Can you also advise if your bios setting of the "C1 disconnect" is set"

I can only guess by my 41C low load 48C high load temps exactly equal to range for "2.1Ghz 333mhz" of Ian Kumlien(his?) which is same speed as mine, that probably cpu disconnect is not on. I have no visible choice in setup for cpu disconnect. I'll try athcool to see how disconnect is set.

Ross:"I have heard lockups are not supposed to happen
at all if the fsb (host bus clock speed) matches the
ddr speed. One of my systems went about 4 hours (xp2500
333fsb, DDR333) without the apic delay patch on a phoenix bios before lockup"

A couple of months ago I was overly optimistic a couple of times before the bios update, and it seemed to work to use 1:1 and only amd74xx onboard hd controller, no hd cards, and pre-emptive, anticipatory sched not deadline, apic off in setup but on in linux, lapic off, acpi on. It was almost stable if using only one drive, but I really can't go without hd cards for software raid, so the first fsck on boot if using hd card, and crash. I could finesse stability by using options but never quite reach reliability without a bios update, and certain functions need patching, and I still have "MIS count, noisy bus" and agp8 crash(I can use the X nv driver and agpgart no problem, but not nvidia drivers for X and agp8).