Skip to contentSkip to conversation

Shared interrupts sometimes lost

PATCH Robert Hancock 5 participants 8 messages Apr 8, 2006 – Apr 12, 2006 2 messages not in the archive

lore
Share & tools
lore

A message that is not in the archive (sent off-list or not yet received): [email protected]

#1 lore raw
Quoted 7 lines · Neil Brown

However there is room for a race here. If an event occurs between the read and the write, then this will NOT de-assert the IRQ line. It will remain asserted throughout.

Now if the IRQ is handled as an edge-triggered line (which I believe they are in Linux), then losing this race will mean that we don't see any more interrupts on this line.

PCI interrupts should always be level triggered, not edge triggered (except maybe in a few special cases - non-native-mode PCI IDE maybe? and in those cases I don't think the interrupt is considered sharable). With a level triggered interrupt the ISR will simply be triggered again and the event handled in this case so there is no race. I think this patch is going to double interrupt overhead and only covers up some other problem.

I think that in cases where the interrupt is edge triggered and is shared (for example on ISA cards that support it) the kernel already has such logic as you describe.

Signature · 3 lines
Robert Hancock      Saskatoon, SK, Canada
To email, remove "nospam" from [email protected]
Home Page: http://www.roberthancock.com/
#2 lore raw

How to correct ELCR? - was Re: [PATCH 2.6.16] Shared interrupts sometimes lost

Quoted 10 lines · On Saturday April 8, [email protected] wrote:
Quoted 7 lines · Neil Brown

However there is room for a race here. If an event occurs between the read and the write, then this will NOT de-assert the IRQ line. It will remain asserted throughout.

Now if the IRQ is handled as an edge-triggered line (which I believe they are in Linux), then losing this race will mean that we don't see any more interrupts on this line.

PCI interrupts should always be level triggered, not edge triggered

Ok... so I guess I jumped to the wrong conclusion. Thanks for straightening me out.
But it is behaving like edge-triggered..

So I have explored about the i8259 (wikipedia helped) and discovered the ELCR (Edge/Level Control Register). Apparently this is meant to be set up by the BIOS to the correct values. It seems that this isn't happening.

It seems to get the value 0x0800 which corresponds to IRQ11 being the only level-triggered interrupt. But I need IRQ10 to be level triggered. I hacked the code to set the 0x0400 bit, and it seems to work OK without my other patch.

Now I just need a way to set this correctly at boot time without a hack.

I currently have Linux compiled without ACPI support (as I don't really want that and being an oldish notebook I gather it has a good chance of causing problems) so that isn't fiddling with the ELCR.

So thank you for helping me a step further in understand, but now I have a new question:

How can I make sure the ELCR is set correctly?
and I guess,
What is the correct setting?

My /proc/interrupts is below.

Thanks.

NeilBrown

CPU0

  0:     505852          XT-PIC  timer
  1:         10          XT-PIC  i8042
  2:          0          XT-PIC  cascade
  4:         10          XT-PIC  serial
  8:          4          XT-PIC  rtc
 10:      16442          XT-PIC  yenta, yenta, ohci_hcd:usb1, ohci_hcd:usb2, ehci_hcd:usb4, eth0
 11:          0          XT-PIC  uhci_hcd:usb3
 12:        110          XT-PIC  i8042
 14:       5114          XT-PIC  ide0
 15:         38          XT-PIC  ide1
NMI:          0 
ERR:          0
#3 lore raw

Re: How to correct ELCR? - was Re: [PATCH 2.6.16] Shared interrupts sometimes lost

Neil Brown <[email protected]> :
[...]

Can you send an url for the exact rt2500 sources that you are actually using ?

Just curious :o)

Signature · 1 line
Ueimor
#4 lore raw

Re: How to correct ELCR? - was Re: [PATCH 2.6.16] Shared interrupts sometimes lost

Quoted 7 lines · On Sunday April 9, [email protected] wrote:

Neil Brown <[email protected]> :
[...]

Can you send an url for the exact rt2500 sources that you are actually using ?

Just curious :o)

http://rt2x00.serialmonkey.com/rt2500-cvs-daily.tar.gz

(though that may change from day to day... I just checked, and *now* it is the same as what I started with)

plus a bunch of printks, which I attach for your amusement :-)

NeilBrown

Only in /root/rt-latest/rt2500-cvs-2006040703/Module: .assoc.o.cmd Only in /root/rt-latest/rt2500-cvs-2006040703/Module: .auth.o.cmd Only in /root/rt-latest/rt2500-cvs-2006040703/Module: .auth_rsp.o.cmd Only in /root/rt-latest/rt2500-cvs-2006040703/Module: .connect.o.cmd Only in /root/rt-latest/rt2500-cvs-2006040703/Module: .eeprom.o.cmd Only in /root/rt-latest/rt2500-cvs-2006040703/Module: .md5.o.cmd Only in /root/rt-latest/rt2500-cvs-2006040703/Module: .mlme.o.cmd Only in /root/rt-latest/rt2500-cvs-2006040703/Module: .rt2500.ko.cmd Only in /root/rt-latest/rt2500-cvs-2006040703/Module: .rt2500.mod.o.cmd Only in /root/rt-latest/rt2500-cvs-2006040703/Module: .rt2500.o.cmd Only in /root/rt-latest/rt2500-cvs-2006040703/Module: .rtmp_data.o.cmd Only in /root/rt-latest/rt2500-cvs-2006040703/Module: .rtmp_info.o.cmd Only in /root/rt-latest/rt2500-cvs-2006040703/Module: .rtmp_init.o.cmd Only in /root/rt-latest/rt2500-cvs-2006040703/Module: .rtmp_main.o.cmd Only in /root/rt-latest/rt2500-cvs-2006040703/Module: .rtmp_tkip.o.cmd Only in /root/rt-latest/rt2500-cvs-2006040703/Module: .rtmp_wep.o.cmd Only in /root/rt-latest/rt2500-cvs-2006040703/Module: .sanity.o.cmd Only in /root/rt-latest/rt2500-cvs-2006040703/Module: .sync.o.cmd Only in /root/rt-latest/rt2500-cvs-2006040703/Module: .tmp_versions Only in /root/rt-latest/rt2500-cvs-2006040703/Module: .wpa.o.cmd Only in /root/rt-latest/rt2500-cvs-2006040703/Module: assoc.o Only in /root/rt-latest/rt2500-cvs-2006040703/Module: auth.o Only in /root/rt-latest/rt2500-cvs-2006040703/Module: auth_rsp.o Only in /root/rt-latest/rt2500-cvs-2006040703/Module: connect.o Only in /root/rt-latest/rt2500-cvs-2006040703/Module: eeprom.o Only in /root/rt-latest/rt2500-cvs-2006040703/Module: md5.o

root/rt-latest/rt2500-cvs-2006040703/Module/mlme.c renamed from Module/mlme.c +16 -1
diff -ur rt2500-cvs-2006040703/Module/mlme.c /root/rt-latest/rt2500-cvs-2006040703/Module/mlme.c
@@ -350,12 +350,19 @@
         This task guarantee only one MlmeHandler will run. 
     ==========================================================================
  */
+extern void dump_prio(PRTMP_ADAPTER A);
 VOID MlmeHandler(
     IN PRTMP_ADAPTER pAd) 
 {
     MLME_QUEUE_ELEM        *Elem = NULL;
     unsigned long flags;
-
+    int loops=0;
+    { int static done = 0;
+    if (!done) {
+	    done = 1;
+	    dump_prio(pAd);
+    }
+    }
     // Only accept MLME and Frame from peer side, no other (control/data) frame should
     // get into this state machine
 
@@ -411,6 +418,14 @@
         {
             printk(KERN_ERR DRV_NAME "ERROR: empty Elem in MlmeQueue\n");
         }
+	loops++;
+	if (loops > 10) {
+		static int done = 0;
+		if (done) break;
+		done=1;
+		dump_prio(pAd);
+		printk("BREAK\n"); break;
+	}
     }
 
     spin_lock_irqsave(&pAd->Mlme.TaskLock,flags);

Only in /root/rt-latest/rt2500-cvs-2006040703/Module: mlme.o Only in /root/rt-latest/rt2500-cvs-2006040703/Module: rt2500.ko Only in /root/rt-latest/rt2500-cvs-2006040703/Module: rt2500.mod.c Only in /root/rt-latest/rt2500-cvs-2006040703/Module: rt2500.mod.o Only in /root/rt-latest/rt2500-cvs-2006040703/Module: rt2500.o

root/rt-latest/rt2500-cvs-2006040703/Module/rt2560.h renamed from Module/rt2560.h +9 -0
diff -ur rt2500-cvs-2006040703/Module/rt2560.h /root/rt-latest/rt2500-cvs-2006040703/Module/rt2560.h
@@ -517,6 +517,15 @@
         ULONG		TwakeExpire:1;		// Wakeup timer expired interrupt
 		ULONG		TbcnExpire:1;		// Beacon timer expired interrupt
 #else
+/* 0x169
+ TbcnExpire
+ TxRingTxDone
+ PrioRingTxDone
+ RxDone
+ ExcryptionDone
+ fe14
+  1eb
+*/
         ULONG       TbcnExpire:1;       // Beacon timer expired interrupt
         ULONG       TwakeExpire:1;      // Wakeup timer expired interrupt
         ULONG       TatimwExpire:1;     // Timer of atim window expired interrupt

Only in /root/rt-latest/rt2500-cvs-2006040703/Module: rt2560.h.~1.4.~

root/rt-latest/rt2500-cvs-2006040703/Module/rtmp_data.c renamed from Module/rtmp_data.c +24 -2
diff -ur rt2500-cvs-2006040703/Module/rtmp_data.c /root/rt-latest/rt2500-cvs-2006040703/Module/rtmp_data.c
@@ -905,6 +905,25 @@
 	}
 }
 
+void dump_prio(PRTMP_ADAPTER A)
+{
+	int i;
+	u32 u;
+	PTXD_STRUC T;
+	printk("Prio: Index=%d Done=%d\n", A->CurPrioIndex, A->NextPrioDoneIndex);
+	for (i=0; i<PRIO_RING_SIZE; i++) {
+		T=(PTXD_STRUC)(A->PrioRing[i].va_addr);
+		printk("%3d: size=%d FT=%d own=%d vld=%d, rty=%d\n",
+		       i, A->PrioRing[i].size, A->PrioRing[i].FrameType,
+		       T->Owner, T->Valid, T->RetryCount);
+	}
+	printk("\n");
+	RTMP_IO_READ32(A, CSR7, &u);
+	printk("CSR7 is 0x%x\n", u);
+	RTMP_IO_READ32(A, CSR8, &u);
+	printk("CSR8 is 0x%x\n", u);
+}
+
 /*
 	========================================================================
 
@@ -947,10 +966,11 @@
         pTxD = &TxD;
         RTMPDescriptorEndianChange((PUCHAR)pTxD, TYPE_TXD);
 #endif
-
+	//printk("PrioDone for %d\n", pAdapter->NextPrioDoneIndex);
 		// Check for the descriptor ownership
 		if ((pTxD->Owner == DESC_OWN_NIC) || (pTxD->Valid == FALSE))
 		{
+			//printk("..no\n");
 #ifdef BIG_ENDIAN
             RTMPDescriptorEndianChange((PUCHAR)pTxD, TYPE_TXD);
             *pDestTxD = TxD;
@@ -2120,13 +2140,14 @@
     pTxD = &TxD;
     RTMPDescriptorEndianChange((PUCHAR)pTxD, TYPE_TXD);
 #endif
-		
+    printk("Queuing prio for %d\n", pAdapter->CurPrioIndex);
 	if (pTxD->Owner == DESC_OWN_NIC)
 	{
 		// Descriptor owned by NIC. No descriptor avaliable
 		// This should not happen since caller guaranteed.
 		// Make sure to release Prio ring resource
 		spin_unlock_irqrestore(&pAdapter->PrioRingLock, irqflag);
+		printk("...not mine\n");
 		return;
 	}
 	if (pTxD->Valid == TRUE)
@@ -2135,6 +2156,7 @@
 		// This should not happen since caller guaranteed.
 		// Make sure to release Prio ring resource
 		spin_unlock_irqrestore(&pAdapter->PrioRingLock, irqflag);
+		printk("...still valid\n");
 		return;
 	}
 	if (pBuffer == NULL)

Only in /root/rt-latest/rt2500-cvs-2006040703/Module: rtmp_data.c.~1.35.~ Only in /root/rt-latest/rt2500-cvs-2006040703/Module: rtmp_data.o Only in /root/rt-latest/rt2500-cvs-2006040703/Module: rtmp_info.o Only in /root/rt-latest/rt2500-cvs-2006040703/Module: rtmp_init.c.~1.27.~ Only in /root/rt-latest/rt2500-cvs-2006040703/Module: rtmp_init.o

root/rt-latest/rt2500-cvs-2006040703/Module/rtmp_main.c renamed from Module/rtmp_main.c +12 -3
diff -ur rt2500-cvs-2006040703/Module/rtmp_main.c /root/rt-latest/rt2500-cvs-2006040703/Module/rtmp_main.c
@@ -194,7 +194,7 @@
     // register_netdev() will call dev_alloc_name() for us
     // TODO: Remove the following line to keep the default eth%d name
     if (ifname == NULL)
-       strcpy(net_dev->name, "ra%d");
+       strcpy(net_dev->name, "eth%d");
     else
        strncpy(net_dev->name, ifname, IFNAMSIZ);
 
@@ -456,7 +456,7 @@
     int         ret = 0;
 
     DBGPRINT(RT_DEBUG_INFO, "====> RTMPHandleInterrupt\n");
-
+ again:
     // 1. Disable interrupt
 	if (RTMP_TEST_FLAG(pAdapter, fRTMP_ADAPTER_INTERRUPT_IN_USE) && RTMP_TEST_FLAG(pAdapter, fRTMP_ADAPTER_INTERRUPT_ACTIVE))
 	{
@@ -523,6 +523,7 @@
     if (IntSource.field.PrioRingTxDone)
     {
         DBGPRINT(RT_DEBUG_INFO, "====> RTMPHandlePrioRingTxDoneInterrupt\n");
+	printk("Word = %d\n", IntSource.word);
         RTMPHandlePrioRingTxDoneInterrupt(pAdapter);
         ret = 1;
     }
@@ -546,6 +547,7 @@
     if (RTMP_TEST_FLAG(pAdapter, fRTMP_ADAPTER_RESET_IN_PROGRESS))
     {
         ret = 1;
+	printk("Don't enable interrupt\n");
         goto out;
     }
 
@@ -554,12 +556,19 @@
     //
     NICEnableInterrupt(pAdapter);
 
+    RTMP_IO_READ32(pAdapter, CSR7, &IntSource.word);
+    if (IntSource.word & ~0xFE14) {
+	    /*printk("word now %x\n", IntSource.word); */
+	    // goto again;
+    }
     DBGPRINT(RT_DEBUG_INFO, "<==== RTMPHandleInterrupt\n");
 out:
 	if(ret)
 		return IRQ_RETVAL(IRQ_HANDLED);
-	else
+	else {
+//		printk("Nothing handled: %x\n", IntSource.word);
 		return IRQ_RETVAL(IRQ_NONE);
+	}
 }
 
 int rt2500_set_mac_address(struct net_device *net_dev, void *addr)

Only in /root/rt-latest/rt2500-cvs-2006040703/Module: rtmp_main.o Only in /root/rt-latest/rt2500-cvs-2006040703/Module: rtmp_tkip.o Only in /root/rt-latest/rt2500-cvs-2006040703/Module: rtmp_wep.o Only in /root/rt-latest/rt2500-cvs-2006040703/Module: sanity.o Only in /root/rt-latest/rt2500-cvs-2006040703/Module: sync.o Only in /root/rt-latest/rt2500-cvs-2006040703/Module: wpa.o

#5 lore raw

Re: How to correct ELCR? - was Re: [PATCH 2.6.16] Shared interrupts sometimes lost

In reply to Neil Brown

Hi!

Quoted 24 lines
Quoted 9 lines
Quoted 7 lines

However there is room for a race here. If an event occurs between the read and the write, then this will NOT de-assert the IRQ line. It will remain asserted throughout.

Now if the IRQ is handled as an edge-triggered line (which I believe they are in Linux), then losing this race will mean that we don't see any more interrupts on this line.

PCI interrupts should always be level triggered, not edge triggered

Ok... so I guess I jumped to the wrong conclusion. Thanks for straightening me out.
But it is behaving like edge-triggered..

So I have explored about the i8259 (wikipedia helped) and discovered the ELCR (Edge/Level Control Register). Apparently this is meant to be set up by the BIOS to the correct values. It seems that this isn't happening.

It seems to get the value 0x0800 which corresponds to IRQ11 being the only level-triggered interrupt. But I need IRQ10 to be level triggered. I hacked the code to set the 0x0400 bit, and it seems to work OK without my other patch.

Quoted 6 lines

Now I just need a way to set this correctly at boot time without a hack.

I currently have Linux compiled without ACPI support (as I don't really want that and being an oldish notebook I gather it has a good chance of causing problems) so that isn't fiddling with the ELCR.

Can you try to enable ACPI and/or APIC? Some machines are known to require APIC...
Pavel

Signature · 1 line
Thanks for all the (sleeping) penguins.
#6 lore raw

Re: How to correct ELCR? - was Re: [PATCH 2.6.16] Shared interrupts sometimes lost

Quoted 7 lines · On Tuesday April 11, [email protected] wrote:
Quoted 4 lines

I currently have Linux compiled without ACPI support (as I don't really want that and being an oldish notebook I gather it has a good chance of causing problems) so that isn't fiddling with the ELCR.

Can you try to enable ACPI and/or APIC? Some machines are known to require APIC...

Thanks for the suggestions.

I now have

CONFIG_X86_GOOD_APIC=y
CONFIG_X86_UP_APIC=y
CONFIG_X86_UP_IOAPIC=y
CONFIG_X86_LOCAL_APIC=y
CONFIG_X86_IO_APIC=y

in my .config, and it doesn't make any apparent difference. I haven't tried ACPI yet... maybe in a couple of days.

Thanks again,
NeilBrown

A message that is not in the archive (sent off-list or not yet received): [email protected]

#8 lore raw
Quoted 14 lines · Lee Revell
Quoted 12 lines · Neil Brown

To explain what I think is happening, let me start with a very simple case. A number of PCI devices (this one included) have a number of events which can trigger an interrupt. The events which are current are presented as bits in a register, and are ORed together (and possibly masked by another register) to make the IRQ line. When 1's are written to any bits in this register, it acknowledges the event and clears the bit.
A typical code fragment is
events = read_register(INTERRUPTS); write_register(INTERRUPTS, events);
... handle each 1 bits in events ....

Quoted 5 lines

Isn't a more typical IRQ handler:

while (events = read_register(INTERRUPTS) != 0) {
...handle each bit in events and ACK it...
}

That would be less efficient, it would read the register twice or more if any events have been set, and reading device registers can be expensive. In the unlikely event the event was set while inside the ISR the interrupt should be asserted again so there is no need to do this.

Signature · 3 lines
Robert Hancock      Saskatoon, SK, Canada
To email, remove "nospam" from [email protected]
Home Page: http://www.roberthancock.com/
#9 lore raw
Quoted 7 lines · Robert Hancock
Quoted 5 lines · Lee Revell

Isn't a more typical IRQ handler:

while (events = read_register(INTERRUPTS) != 0) {
...handle each bit in events and ACK it...
}

Quoted 5 lines

That would be less efficient, it would read the register twice or more if any events have been set, and reading device registers can be expensive. In the unlikely event the event was set while inside the ISR the interrupt should be asserted again so there is no need to do this.

OK. FWIW I am looking at the emu10k1 driver (though I've seen this in others). The OSS driver has this comment:

/*
** NOTE :
** We do a 'while loop' here cos on certain machines, with both ** playback and recording going on at the same time, IRQs will ** stop coming in after a while. Checking IPND indeed shows that ** there are interrupts pending but the PIC says no IRQs pending. ** I suspect that some boards need edge-triggered IRQs but are not ** getting that condition if we don't completely clear the IPND ** (make sure no more interrupts are pending).
** - Eric
*/

The ALSA driver preserves the while loop but omits the comment :-/

Lee