x86: Rework the vector management

Sorry for the large CC list, but this is a major surgery.

The vector management in x86 including the surrounding code is a conglomorate of ancient bits and pieces which have been subject to 'modernization' and featuritis over the years. The most obscure parts are the vector allocation mechanics, the cleanup vector handling and the cpu hotplug machinery. Replacing these pieces of art was on my todo list for a long time.

Recent attempts to 'solve' CPU offline / hibernation issues which are partially caused by the current vector management implementation made me look for real. Further information in this thread:

    http://lkml.kernel.org/r/[email protected]

Aside of drivers allocating gazillion of interrupts, there are quite some things which can be addressed in the x86 vector management and in the core code.

- Multi CPU affinities:

A dubious property which is not available on all machines and causes major complexity both in the allocator and the cleanup/hotplug management. See:

http://lkml.kernel.org/r/alpine.DEB.2.20.1709071045440.1827@nanos

- Priority level spreading:

An obscure and undocumented property which I think is sufficiently argued to be not required in:

http://lkml.kernel.org/r/alpine.DEB.2.20.1709071045440.1827@nanos

- Allocation of vectors when interrupt descriptors are allocated.

This is a historical implementation detail, which is not really required when the vector allocation is delayed up to the point when request_irq() is invoked. This might make request_irq() fail, when the vector space is exhausted, but drivers should handle request_irq() fails anyway.

The upside of changing this is that the active vector space becomes smaller especially on hibernation/cpu offline when drivers shut down queue interrupts of outgoing CPUs.

Some of this is already addressed with the managed interrupt facility, but that was bolted on top of the existing vector management because proper integration was not possible at that point. I take the blame for this, but the tradeoff of not doing it would have been more broken driver boiler plate code all over the place. So I went for the lesser of two evils.

- Allocation of vectors on the wrong place

Even for managed interrupts the vector allocation at descriptor allocation happens on the wrong place and gets fixed after the fact with a call to set_affinity(). In case of not remapped interrupts this results in at least one interrupt on the wrong CPU before it is migrated to the desired target.

- Lack of instrumentation

All of this is a black box which allows no insight into the actual vector usage.

The series addresses these points and converts the x86 vector management to a bitmap based allocator which provides proper reservation management for 'managed interrupts' and best effort reservation for regular interrupts. The latter allows overcommitment, which 'fixes' some of hotplug/hibernation problems in a clean way. It can't fix all of them depending on the driver involved.

This rework is no excuse for driver writers to do exhaustive vector allocations instead of utilizing the managed interrupt infrastructure, but it addresses long standing issues in this code with the side effect of mitigating some of the driver oddities. The proper solution for multi queue management are 'managed interrupts' which has been proven in the block-mq work as they solve issues which are worked around in other drivers in creative ways with lots of copied code and often enough broken attempts to handle interrupt affinity and CPU hotplug problems.

The new bitmap allocator and the x86 vector management code are instrumented with tracepoints and the irq domain debugfs files allow deep insight into the vector allocation and reservations.

The patches work on machines with and without interrupt remapping and inside of KVM guests of various flavours, though I have no idea what I broke on the way with other hypervisors, posted interrupts etc. So I kindly ask for your support in testing and review.

The series applies on top of Linus tree and is available as git branch:

git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip.git WIP.x86/apic

Note, that this branch is Linus tree plus scheduler and x86 fixes which I required to do proper testing. They have outstanding pull requests and might be merged already when you read this.

Thanks,

tglx

---
 arch/x86/include/asm/x2apic.h              |   49 -
 b/arch/x86/Kconfig                         |    1 
 b/arch/x86/include/asm/apic.h              |  255 +-----
 b/arch/x86/include/asm/desc.h              |    2 
 b/arch/x86/include/asm/hw_irq.h            |    6 
 b/arch/x86/include/asm/io_apic.h           |    2 
 b/arch/x86/include/asm/irq.h               |    4 
 b/arch/x86/include/asm/irq_vectors.h       |    8 
 b/arch/x86/include/asm/irqdomain.h         |    5 
 b/arch/x86/include/asm/kvm_host.h          |    2 
 b/arch/x86/include/asm/trace/irq_vectors.h |  244 ++++++
 b/arch/x86/kernel/apic/Makefile            |    2 
 b/arch/x86/kernel/apic/apic.c              |   38 -
 b/arch/x86/kernel/apic/apic_common.c       |   46 +
 b/arch/x86/kernel/apic/apic_flat_64.c      |   10 
 b/arch/x86/kernel/apic/apic_noop.c         |   25 
 b/arch/x86/kernel/apic/apic_numachip.c     |   12 
 b/arch/x86/kernel/apic/bigsmp_32.c         |    8 
 b/arch/x86/kernel/apic/htirq.c             |    5 
 b/arch/x86/kernel/apic/io_apic.c           |   94 --
 b/arch/x86/kernel/apic/msi.c               |    5 
 b/arch/x86/kernel/apic/probe_32.c          |   29 
 b/arch/x86/kernel/apic/vector.c            | 1090 +++++++++++++++++------------
 b/arch/x86/kernel/apic/x2apic.h            |    9 
 b/arch/x86/kernel/apic/x2apic_cluster.c    |  196 +----
 b/arch/x86/kernel/apic/x2apic_phys.c       |   44 +
 b/arch/x86/kernel/apic/x2apic_uv_x.c       |   17 
 b/arch/x86/kernel/i8259.c                  |    1 
 b/arch/x86/kernel/idt.c                    |   12 
 b/arch/x86/kernel/irq.c                    |  101 --
 b/arch/x86/kernel/irqinit.c                |    1 
 b/arch/x86/kernel/setup.c                  |   12 
 b/arch/x86/kernel/smpboot.c                |   14 
 b/arch/x86/kernel/traps.c                  |    2 
 b/arch/x86/kernel/vsmp_64.c                |   19 
 b/arch/x86/platform/uv/uv_irq.c            |    5 
 b/arch/x86/xen/apic.c                      |    6 
 b/drivers/gpio/gpio-xgene-sb.c             |    7 
 b/drivers/iommu/amd_iommu.c                |   44 -
 b/drivers/iommu/intel_irq_remapping.c      |   43 -
 b/drivers/irqchip/irq-gic-v3-its.c         |    5 
 b/drivers/pinctrl/stm32/pinctrl-stm32.c    |    5 
 b/include/linux/irq.h                      |   22 
 b/include/linux/irqdesc.h                  |    1 
 b/include/linux/irqdomain.h                |   14 
 b/include/linux/msi.h                      |    5 
 b/include/trace/events/irq_matrix.h        |  201 +++++
 b/kernel/irq/Kconfig                       |    3 
 b/kernel/irq/Makefile                      |    1 
 b/kernel/irq/autoprobe.c                   |    2 
 b/kernel/irq/chip.c                        |   37 
 b/kernel/irq/debugfs.c                     |   12 
 b/kernel/irq/internals.h                   |   19 
 b/kernel/irq/irqdesc.c                     |    3 
 b/kernel/irq/irqdomain.c                   |   43 -
 b/kernel/irq/manage.c                      |   18 
 b/kernel/irq/matrix.c                      |  443 +++++++++++
 b/kernel/irq/msi.c                         |   32 
 58 files changed, 2133 insertions(+), 1208 deletions(-)