Skip to contentSkip to conversation

Should kirqd work on HT?

DISCUSSION Nigel Cunningham 5 participants 11 messages Feb 19, 2005 – Feb 20, 2005

lore
Share & tools
lore
#0 lore raw

Hi all.

I've noticed this problem for a while, but only now decided to ask. Interrupt balancing doesn't do anything on my system.

CPU0 CPU1

  0:   31931808          0    IO-APIC-edge  timer
  1:      76595          0    IO-APIC-edge  i8042
  8:          1          0    IO-APIC-edge  rtc
  9:          1          0   IO-APIC-level  acpi
 14:        122          1    IO-APIC-edge  ide0
 16:    4074456          0   IO-APIC-level  uhci_hcd, uhci_hcd, radeon@PCI:1:0:0
 17:    4295132          0   IO-APIC-level  Intel ICH5
 18:    2070933          0   IO-APIC-level  libata, uhci_hcd, eth0
 19:     887311          0   IO-APIC-level  uhci_hcd
 22:     572530          0   IO-APIC-level  ath0
NMI:   31931749   31931636 (I've since disabled the nmi_watchdog)
LOC:   31931252   31931251
ERR:          0
MIS:          0

I enabled the debugging and found that it doesn't think it's worth the effort. Is that correct? Not a complaint, just curious!

Regards,

Nigel

Signature · 5 lines
Nigel Cunningham
Software Engineer, Canberra, Australia
http://www.cyclades.com

Ph: +61 (2) 6292 8028      Mob: +61 (417) 100 574
#1 lore raw

My guess is that irqbalance is not running.

Quoted 29 lines · Nigel Cunningham

Hi all.

I've noticed this problem for a while, but only now decided to ask. Interrupt balancing doesn't do anything on my system.

CPU0 CPU1

 0:   31931808          0    IO-APIC-edge  timer
 1:      76595          0    IO-APIC-edge  i8042
 8:          1          0    IO-APIC-edge  rtc
 9:          1          0   IO-APIC-level  acpi
14:        122          1    IO-APIC-edge  ide0
16:    4074456          0   IO-APIC-level  uhci_hcd, uhci_hcd, radeon@PCI:1:0:0
17:    4295132          0   IO-APIC-level  Intel ICH5
18:    2070933          0   IO-APIC-level  libata, uhci_hcd, eth0
19:     887311          0   IO-APIC-level  uhci_hcd
22:     572530          0   IO-APIC-level  ath0
NMI:   31931749   31931636 (I've since disabled the nmi_watchdog)
LOC:   31931252   31931251
ERR:          0
MIS:          0

I enabled the debugging and found that it doesn't think it's worth the effort. Is that correct? Not a complaint, just curious!

Regards,

Nigel

#2 lore raw

Hi.

Quoted 1 line · Kwijibo

My guess is that irqbalance is not running.

No. It is.

USER       PID %CPU %MEM   VSZ  RSS TTY      STAT START   TIME COMMAND
root       301  0.0  0.0     0    0 ?        SW   16:52   0:00 [kirqd]

The debugging info reports that it doesn't think it's worth doing the balancing.

Regards,

Nigel

Signature · 5 lines
Nigel Cunningham
Software Engineer, Canberra, Australia
http://www.cyclades.com

Ph: +61 (2) 6292 8028      Mob: +61 (417) 100 574
#3 lore raw
Quoted 5 lines · Nigel Cunningham

Hi.

Quoted 1 line · Kwijibo

My guess is that irqbalance is not running.

Quoted 7 lines

No. It is.

USER       PID %CPU %MEM   VSZ  RSS TTY      STAT START   TIME COMMAND
root       301  0.0  0.0     0    0 ?        SW   16:52   0:00 [kirqd]

The debugging info reports that it doesn't think it's worth doing the balancing.

I guess the question was about the userspace irqbalance....

#4 lore raw
In reply to Nigel Cunningham
Quoted 21 lines · Nigel Cunningham

Hi all.

I've noticed this problem for a while, but only now decided to ask. Interrupt balancing doesn't do anything on my system.

CPU0 CPU1

  0:   31931808          0    IO-APIC-edge  timer
  1:      76595          0    IO-APIC-edge  i8042
  8:          1          0    IO-APIC-edge  rtc
  9:          1          0   IO-APIC-level  acpi
 14:        122          1    IO-APIC-edge  ide0
 16:    4074456          0   IO-APIC-level  uhci_hcd, uhci_hcd, radeon@PCI:1:0:0
 17:    4295132          0   IO-APIC-level  Intel ICH5
 18:    2070933          0   IO-APIC-level  libata, uhci_hcd, eth0
 19:     887311          0   IO-APIC-level  uhci_hcd
 22:     572530          0   IO-APIC-level  ath0
NMI:   31931749   31931636 (I've since disabled the nmi_watchdog)
LOC:   31931252   31931251
ERR:          0
MIS:          0
Quoted 2 lines

I enabled the debugging and found that it doesn't think it's worth the effort. Is that correct? Not a complaint, just curious!

What are the results of running irqbalanced?

Jeff

#5 lore raw

Hi Jeff.

Quoted 2 lines · Jeff Garzik

Nigel Cunningham wrote:
What are the results of running irqbalanced?

You mean the debugging output? I can reenable it and record the results if that's what you mean.

Quoted 1 line

From memory though, it got to not_worth_the_effort via this code:

        if (tmp_loaded == -1) {
         /* In the case of small number of heavy interrupt sources,
          * loading some of the cpus too much. We use Ingo's original
          * approach to rotate them around.
          */
                if (!first_attempt && imbalance >= useful_load_threshold) {
                        rotate_irqs_among_cpus(useful_load_threshold);
                        return;
                }
                goto not_worth_the_effort;
        }

(arch/i386/kernel/io_apic.c:449.

Regards,

Nigel

Signature · 5 lines
Nigel Cunningham
Software Engineer, Canberra, Australia
http://www.cyclades.com

Ph: +61 (2) 6292 8028      Mob: +61 (417) 100 574
#6 lore raw
Quoted 8 lines · Nigel Cunningham

Hi Jeff.

Quoted 2 lines · Jeff Garzik

Nigel Cunningham wrote:
What are the results of running irqbalanced?

You mean the debugging output? I can reenable it and record the results if that's what you mean.

no Jeff meant
http://people.redhat.com/arjanv/irqbalance/
that app most likely....

#7 lore raw

Hi,

Quoted 7 lines · Arjan van de Ven
Quoted 6 lines · Nigel Cunningham

Hi Jeff.

Quoted 2 lines · Jeff Garzik

Nigel Cunningham wrote:
What are the results of running irqbalanced?

Quoted 6 lines
Quoted 2 lines

You mean the debugging output? I can reenable it and record the results if that's what you mean.

no Jeff meant
http://people.redhat.com/arjanv/irqbalance/
that app most likely....

Oh... Ok. Never heard of it before.

I'll download it now, but I'm about to go to bed now so the answer will be a while.

Thanks for the reply.

Nigel

Signature · 5 lines
Nigel Cunningham
Software Engineer, Canberra, Australia
http://www.cyclades.com

Ph: +61 (2) 6292 8028      Mob: +61 (417) 100 574
#8 lore raw
In reply to Arjan van de Ven

Hi again.

Didn't realise it was going to take nothing to install, so I've done it. IRQs are running on cpu 1 now. Is there some documentation somewhere? I'm wondering whether I can compile kirqd out.

Thanks and regards,

Nigel

Quoted 14 lines · Arjan van de Ven
Quoted 8 lines · Nigel Cunningham

Hi Jeff.

Quoted 2 lines · Jeff Garzik

Nigel Cunningham wrote:
What are the results of running irqbalanced?

You mean the debugging output? I can reenable it and record the results if that's what you mean.

no Jeff meant
http://people.redhat.com/arjanv/irqbalance/
that app most likely....

Signature · 5 lines
Nigel Cunningham
Software Engineer, Canberra, Australia
http://www.cyclades.com

Ph: +61 (2) 6292 8028      Mob: +61 (417) 100 574
#9 lore raw
Quoted 5 lines · Nigel Cunningham

Hi again.

Didn't realise it was going to take nothing to install, so I've done it. IRQs are running on cpu 1 now. Is there some documentation somewhere? I'm wondering whether I can compile kirqd out.

with irqbalance running yes you can compile kirqd out..

#10 lore raw
In reply to Nigel Cunningham
Quoted 19 lines

I've noticed this problem for a while, but only now decided to ask. Interrupt balancing doesn't do anything on my system.

CPU0 CPU1

  0:   31931808          0    IO-APIC-edge  timer
  1:      76595          0    IO-APIC-edge  i8042
  8:          1          0    IO-APIC-edge  rtc
  9:          1          0   IO-APIC-level  acpi
 14:        122          1    IO-APIC-edge  ide0
 16:    4074456          0   IO-APIC-level  uhci_hcd, uhci_hcd, radeon@PCI:1:0:0
 17:    4295132          0   IO-APIC-level  Intel ICH5
 18:    2070933          0   IO-APIC-level  libata, uhci_hcd, eth0
 19:     887311          0   IO-APIC-level  uhci_hcd
 22:     572530          0   IO-APIC-level  ath0
NMI:   31931749   31931636 (I've since disabled the nmi_watchdog)
LOC:   31931252   31931251
ERR:          0
MIS:          0
Quoted 2 lines

I enabled the debugging and found that it doesn't think it's worth the effort. Is that correct? Not a complaint, just curious!

I think it's nothing to do with HT, just the rate you're sending intterrupts at isn't high enough to bother rotating.

M.