Skip to contentSkip to conversation

VFIO-PCI stopped working on pc64le

DISCUSSION Timothy Pearson 1 participant 1 message Dec 26, 2022 KVM

lore
Share & tools
lore
#0 lore raw

When upgrading one of our ppc64el system (Talos II) from 5.18 to 5.19, we found that vfio-pci can no longer bind to the installed USB controller. This issue persists into at least kernel 6.0.

The procedure to bind is as follows:

echo "104c 8241" > /sys/bus/pci/drivers/vfio-pci/new_id echo 0003:01:00.0 > /sys/bus/pci/devices/0003\:01\:00.0/driver/unbind echo 0003:01:00.0 > /sys/bus/pci/drivers/vfio-pci/bind echo "104c 8241" > /sys/bus/pci/drivers/vfio-pci/remove_id

The result is:

[  220.792855] VFIO - User Level meta-driver version: 0.3
[  221.280523] xhci_hcd 0003:01:00.0: remove, state 4
[  221.280554] usb usb2: USB disconnect, device number 1
[  221.281115] xhci_hcd 0003:01:00.0: USB bus 2 deregistered
[  221.281134] xhci_hcd 0003:01:00.0: remove, state 1
[  221.281144] usb usb1: USB disconnect, device number 1
[  221.281148] usb 1-1: USB disconnect, device number 2
[  221.285611] usb 1-2: USB disconnect, device number 3
[  221.286197] usb 1-3: USB disconnect, device number 4
[  221.286203] usb 1-3.1: USB disconnect, device number 6
[  221.629920] usb 1-4: USB disconnect, device number 5
[  221.639087] xhci_hcd 0003:01:00.0: USB bus 1 deregistered
[  221.639343] vfio-pci: probe of 0003:01:00.0 failed with error -22

IOMMU groups are showing up correctly, the IOMMU is active and the only change was the kernel. Falling back to 5.15.85 reactivates the support.

Is this a known problem? Anything I can try to do to track it down?

Thanks!