Skip to contentSkip to conversation

New: KVM virtual machine using libvirtd crashes

Bug 121711 [email protected] 1 participant 6 messages Jul 8, 2016 – Jul 9, 2016 KVM

lore
Share & tools
lore

[email protected]

author
#0 lore raw

https://bugzilla.kernel.org/show_bug.cgi?id=121711

            Bug ID: 121711
           Summary: KVM virtual machine using libvirtd crashes
           Product: Virtualization
           Version: unspecified
    Kernel Version: 4.6.2-1
          Hardware: x86-64
                OS: Linux
              Tree: Mainline
            Status: NEW
          Severity: normal
          Priority: P1
         Component: kvm
          Assignee: [email protected]
          Reporter: [email protected]
        Regression: No

I'm running a qemu/kvm stack with one windows 10 vm running. The vm will eventually crash, though the crashes are random enough to happen anytime.

After a crash, I attempt to force shutdown the vm using virsh stop. I receive this output:

error: Disconnected from qemu:///system due to keepalive timeout
error: Failed to destroy domain win7
error: internal error: connection closed due to keepalive timeout

and all virsh commands fail after that.

I attempt to restart the host linux machine, but receive this message when shutting down:

------------[ cut here ]------------
kernel BUG at drivers/pci/msi.c:368!
invalid opcode: 0000 [#1] PREEMPT SMP 
Modules linked in: cdc_acm rfcomm xt_CHECKSUM ipt_MASQUERADE

nf_nat_masquerade_ipv4 tun xt_tcpudp ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ip_s
media snd_seq_device snd_hda_codec_realtek snd_hda_codec_generic nls_iso8859_1 nls_cp437 vfat fat iTCO_wdt iTCO_vendor_support nouveau intel_rapl x86_pkg_temp_thermal intel_powercla
tpm_tis i2c_designware_platform i2c_designware_core tpm 8250_dw spi_pxa2xx_platform acpi_pad processor button usbip_host usbip_core ip_tables x_tables ext4 crc16 jbd2 mbcache dm_mod

CPU: 2 PID: 629 Comm: libvirtd Tainted: G        W       4.6.2-1-ARCH #1
Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./Z97 Extreme6, BIOS
P2.50 10/06/2015
task: ffff8808188ed580 ti: ffff8802c6364000 task.ti: ffff8802c6364000
RIP: 0010:[<ffffffff8134842b>]  [<ffffffff8134842b>] free_msi_irqs+0x5b/0x1c0
RSP: 0018:ffff8802c6367a30  EFLAGS: 00010282
RAX: ffff88027e48ac00 RBX: 0000000000000000 RCX: 0000000000000000
RDX: 0000000000000000 RSI: 0000000000000026 RDI: ffff88081f400158
RBP: ffff8802c6367a60 R08: ffff88081f400000 R09: 0000000000000001
R10: 0000000000000000 R11: 0000000000000000 R12: ffff88081b9c0298
R13: ffff88081b9c0000 R14: ffff880818945120 R15: ffff88081a7a1440
FS:  00007fb7f2a5e700(0000) GS:ffff88083fa80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007facfd24f750 CR3: 0000000817908000 CR4: 00000000001406e0
Stack: 
ffff8802c6367a40 ffff88081b9c0000 0000000000000008 0000000000000008
0000000000000008 ffff88081a7a1440 ffff8802c6367ac8 ffffffff8134896a
ffff88081b9c0298 0000000000000008 ffff88081b9c0098 00000007a01948b7
Call Trace:
[<ffffffff8134896a>] pci_enable_msix+0x3da/0x450
[<ffffffff81348a0c>] pci_enable_msix_range+0x2c/0x60
[<ffffffffa0181b13>] xhci_run+0x183/0x740 [xhci_hcd]
[<ffffffffa00af112>] usb_add_hcd+0x332/0x9b0 [usbcore]
[<ffffffffa00c134f>] usb_hcd_pci_probe+0x1af/0x4a0 [usbcore]
[<ffffffffa01ee68c>] xhci_pci_probe+0x2c/0x220 [xhci_pci]
[<ffffffff8132e215>] local_pci_probe+0x45/0xa0
[<ffffffff8132e160>] ? pci_match_device+0xe0/0x110
[<ffffffff8132f419>] pci_device_probe+0x109/0x160
[<ffffffff814127dc>] driver_probe_device+0x22c/0x440
[<ffffffff81412b74>] __device_attach_driver+0x94/0x110
[<ffffffff81412ae0>] ? __driver_attach+0xf0/0xf0
[<ffffffff81410347>] bus_for_each_drv+0x67/0xb0
[<ffffffff8141243d>] __device_attach+0xdd/0x160
[<ffffffff814124d0>] device_attach+0x10/0x20
[<ffffffff81410d25>] bus_rescan_devices_helper+0x35/0x60
[<ffffffff81410dd2>] store_drivers_probe+0x32/0x60
[<ffffffff8140fe95>] bus_attr_store+0x25/0x30
[<ffffffff812749e7>] sysfs_kf_write+0x37/0x40
[<ffffffff81273f9c>] kernfs_fop_write+0x11c/0x170
[<ffffffff811f6397>] __vfs_write+0x37/0x100
[<ffffffff811f72a3>] vfs_write+0xa3/0x190
[<ffffffff811f8745>] SyS_write+0x55/0xc0
[<ffffffff815c7272>] entry_SYSCALL_64_fastpath+0x1a/0xa4
Code: 85 ff 74 29 41 8b 46 14 85 c0 74 21 31 db eb 0d 83 c3 01 41 39 5e 14 76

14 41 8b 7e 10 01 df e8 dc c9 d8 ff 48 83 78 70 00 74 e5 <0f> 0b 4d 8b 36 4d 39 f4 75 c7 49 8b bd 88 02
RIP [<ffffffff8134842b>] free_msi_irqs+0x5b/0x1c0
RSP <ffff8802c6367a30>

---[ end trace 0df29045d094c8f4 ]---
Signature · 2 lines
You are receiving this mail because:
You are watching the assignee of the bug.
author
#1 lore raw

[Bug 121711] KVM virtual machine using libvirtd crashes

https://bugzilla.kernel.org/show_bug.cgi?id=121711

Paolo Bonzini <[email protected]> changed:

What |Removed |Added
----------------------------------------------------------------------------
CC| |[email protected]

--- Comment #1 from Paolo Bonzini <[email protected]> --- Do you always get the same backtrace?

Signature · 2 lines
You are receiving this mail because:
You are watching the assignee of the bug.
author
#4 lore raw

[Bug 121711] KVM virtual machine using libvirtd crashes

In reply to [email protected]

https://bugzilla.kernel.org/show_bug.cgi?id=121711

--- Comment #4 from [email protected] --- <domain type='kvm'>
<name>win7</name> <uuid>2849ebd5-3a67-47ad-99a7-3f7ab9642030</uuid> <memory unit='KiB'>16896000</memory> <currentMemory unit='KiB'>16896000</currentMemory> <memoryBacking>
<hugepages/>
</memoryBacking>
<vcpu placement='static'>6</vcpu> <cputune>

    <vcpupin vcpu='0' cpuset='2'/>
    <vcpupin vcpu='1' cpuset='3'/>
    <vcpupin vcpu='2' cpuset='4'/>
    <vcpupin vcpu='3' cpuset='5'/>
    <vcpupin vcpu='4' cpuset='6'/>
    <vcpupin vcpu='5' cpuset='7'/>
  </cputune>
  <os>
    <type arch='x86_64' machine='pc-i440fx-2.4'>hvm</type>
    <loader readonly='yes'
type='pflash'>/usr/share/edk2.git/ovmf-x64/OVMF_CODE-pure-efi.fd</loader>
    <nvram>/var/lib/libvirt/qemu/nvram/win7_VARS.fd</nvram>
    <bootmenu enable='yes'/>
  </os>
  <features>
    <acpi/>
    <apic/>
    <kvm>
      <hidden state='on'/>
    </kvm>
    <vmport state='off'/>
  </features>
  <cpu mode='host-passthrough'>
    <topology sockets='1' cores='3' threads='2'/>
  </cpu>
  <clock offset='utc'>
    <timer name='rtc' tickpolicy='catchup'/>
    <timer name='pit' tickpolicy='delay'/>
    <timer name='hpet' present='no'/>
  </clock>
  <on_poweroff>destroy</on_poweroff>
  <on_reboot>restart</on_reboot>
  <on_crash>restart</on_crash>
  <pm>
    <suspend-to-mem enabled='no'/>
    <suspend-to-disk enabled='no'/>
  </pm>
  <devices>
    <emulator>/usr/sbin/qemu-system-x86_64</emulator>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw' cache='none' io='native'/>
      <source dev='/dev/sdb3'/>
      <target dev='vda' bus='virtio'/>
      <boot order='1'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x08'
function='0x0'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw' cache='none' io='native'/>
      <source dev='/dev/sdc1'/>
      <target dev='vdb' bus='virtio'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x0c'

function='0x0'/>
</disk>
<disk type='block' device='disk'>
<driver name='qemu' type='raw' cache='none' io='native'/>

      <source dev='/dev/sdc1'/>
      <target dev='vdb' bus='virtio'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x0c'
function='0x0'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw' cache='none' io='native'/>
      <source dev='/dev/sdd1'/>
      <target dev='vdc' bus='virtio'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x0e'
function='0x0'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw' cache='none' io='native'/>
      <source dev='/dev/sda2'/>
      <target dev='vdd' bus='virtio'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x10'
function='0x0'/>
    </disk>
    <disk type='file' device='cdrom'>
      <driver name='qemu' type='raw'/>
      <source file='/home/eric/Downloads/virtio-win-0.1.112.iso'/>
      <target dev='hda' bus='ide'/>
      <readonly/>
      <address type='drive' controller='0' bus='0' target='0' unit='0'/>
    </disk>
    <controller type='pci' index='0' model='pci-root'/>
    <controller type='ide' index='0'>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x01'
function='0x1'/>
    </controller>
    <controller type='sata' index='0'>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x06'

function='0x0'/>
</controller>
<controller type='virtio-serial' index='0'>
<address type='pci' domain='0x0000' bus='0x00' slot='0x07'
function='0x0'/>
</controller>
<controller type='virtio-serial' index='1'>
<address type='pci' domain='0x0000' bus='0x00' slot='0x02'
function='0x0'/>

    </controller>
    <controller type='usb' index='0' model='nec-xhci'>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x05'
function='0x0'/>
    </controller>
    <input type='mouse' bus='ps2'/>
    <input type='keyboard' bus='ps2'/>
    <hostdev mode='subsystem' type='pci' managed='yes'>
      <source>
        <address domain='0x0000' bus='0x01' slot='0x00' function='0x0'/>
      </source>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x0a'
function='0x0'/>
    </hostdev>
    <hostdev mode='subsystem' type='pci' managed='yes'>
      <source>
        <address domain='0x0000' bus='0x01' slot='0x00' function='0x1'/>
      </source>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x04'
function='0x0'/>
    </hostdev>
    <hostdev mode='subsystem' type='pci' managed='yes'>
      <source>
        <address domain='0x0000' bus='0x00' slot='0x1b' function='0x0'/>
      </source>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x03'

function='0x0'/>
</hostdev>
<hostdev mode='subsystem' type='pci' managed='yes'>
<source>
source>

        <address domain='0x0000' bus='0x03' slot='0x00' function='0x0'/>
      </source>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x0d'
function='0x0'/>
    </hostdev>
    <hostdev mode='subsystem' type='usb' managed='yes'>
      <source>
        <vendor id='0x0a12'/>
        <product id='0x0001'/>
      </source>
    </hostdev>
    <hostdev mode='subsystem' type='pci' managed='yes'>
      <source>
        <address domain='0x0000' bus='0x0a' slot='0x00' function='0x0'/>
      </source>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x0b'
function='0x0'/>
    </hostdev>
    <hostdev mode='subsystem' type='pci' managed='yes'>
      <source>
        <address domain='0x0000' bus='0x00' slot='0x1a' function='0x0'/>
      </source>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x0f'
function='0x0'/>
    </hostdev>
    <memballoon model='virtio'>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x09'

function='0x0'/>
</memballoon>
</devices>
</domain>

Signature · 2 lines
You are receiving this mail because:
You are watching the assignee of the bug.
author
#5 lore raw

[Bug 121711] BUG_ON during PCI bus rescan

In reply to [email protected]

https://bugzilla.kernel.org/show_bug.cgi?id=121711

Paolo Bonzini <[email protected]> changed:

What |Removed |Added
----------------------------------------------------------------------------

          Component|kvm                         |PCI
            Version|unspecified                 |2.5
           Assignee|virtualization_kvm@kernel-b |[email protected]
                   |ugs.osdl.org                |l.org
            Product|Virtualization              |Drivers
            Summary|KVM virtual machine using   |BUG_ON during PCI bus
                   |libvirtd crashes            |rescan
Signature · 2 lines
You are receiving this mail because:
You are watching the assignee of the bug.