Masked MSIs expectations
Hi folks !
Do we provide drivers any guarantee to what happen if an MSI is shot while masked with disable_irq() or while not yet request_irq()'ed ?
Do we guarantee delivery (latched while masked), non-delivery, or undefined ?
I'm bringing up a piece of HW where if it happened, it won't be automatically sent to the CPU and can block further MSIs unless I explicitly either ditch it or force a resend when unmasking (at the PCI Express controller PIC level).
I'm tempted to just ditch anything that happened while masked, it would make everything easier on my side, but maybe drivers have different expectations (and of course an LSI would still shoot, that's not an issue, only MSIs are in question here).
I have cases of devices continuing to shoot one or two MSIs after kexec and before the new kernel takes over, causing a "loss" of any subsequent one unless I deal with that case one way or another.
Cheers,
Ben.
(In case this topic is still relevant)
Quoted 5 lines · Benjamin Herrenschmidt
Do we provide drivers any guarantee to what happen if an MSI is shot while masked with
disable_irq()or while not yet request_irq()'ed ?Do we guarantee delivery (latched while masked), non-delivery, or undefined ?
I am not aware of any guarantees the kernel gives in this situation. I think it would just drop the IRQ and print a "nobody cared" message.
Quoted 5 lines
I'm bringing up a piece of HW where if it happened, it won't be automatically sent to the CPU and can block further MSIs unless I explicitly either ditch it or force a resend when unmasking (at the PCI Express controller PIC level).
Quoted 8 lines
I'm tempted to just ditch anything that happened while masked, it would make everything easier on my side, but maybe drivers have different expectations (and of course an LSI would still shoot, that's not an issue, only MSIs are in question here).
I have cases of devices continuing to shoot one or two MSIs after kexec and before the new kernel takes over, causing a "loss" of any subsequent one unless I deal with that case one way or another.
I would also just ditch such IRQs that happen in that kexec case and make sure that they will work again when the kexec-kernel device driver wants to initialize them.
Joerg
Quoted 11 lines · Joerg Roedel
(In case this topic is still relevant)
Quoted 5 lines · Benjamin Herrenschmidt
Do we provide drivers any guarantee to what happen if an MSI is shot while masked with
disable_irq()or while not yet request_irq()'ed ?Do we guarantee delivery (latched while masked), non-delivery, or undefined ?
I am not aware of any guarantees the kernel gives in this situation. I think it would just drop the IRQ and print a "nobody cared" message.
Well, I was not necessarily talking about the kernel reaction here, my statement was high level, it could be that the interrupt controller latches it and "shoots" it as soon as enabled for example in some cases, or drops it in others.
Also we wouldn't print a message in the kernel, we "lazy disable" edge interrupts, so we would just drop it.
Quoted 10 lines
Quoted 10 lines
I'm bringing up a piece of HW where if it happened, it won't be automatically sent to the CPU and can block further MSIs unless I explicitly either ditch it or force a resend when unmasking (at the PCI Express controller PIC level).
I'm tempted to just ditch anything that happened while masked, it would make everything easier on my side, but maybe drivers have different expectations (and of course an LSI would still shoot, that's not an issue, only MSIs are in question here).
Quoted 7 lines
Quoted 3 lines
I have cases of devices continuing to shoot one or two MSIs after kexec and before the new kernel takes over, causing a "loss" of any subsequent one unless I deal with that case one way or another.
I would also just ditch such IRQs that happen in that kexec case and make sure that they will work again when the kexec-kernel device driver wants to initialize them.
Yes, in the kexec case it sounds obvious to just ditch anything, but I wanted to make sure of the general idea, ie, if the driver temporarily does disable_irq()/enable_irq() I can potentially ditch them all too, rather than "latch" them.
Anyway, I've done that, so far so good.
Cheers,
Ben.
Quoted 2 lines
Joerg