New: PROBLEM: On KVM, Window 7 32bit guests sometimes run into blue screen(0x0000005c) during reboot

Bug 86161 [email protected] 3 participants 11 messages Oct 13, 2014 – Apr 5, 2016 KVM

Share & tools

[email protected]

author

2014-10-13 02:14 UTC #0 lore raw

https://bugzilla.kernel.org/show_bug.cgi?id=86161

            Bug ID: 86161
           Summary: PROBLEM: On KVM, Window 7 32bit guests sometimes run
                    into blue screen(0x0000005c) during reboot
           Product: Virtualization
           Version: unspecified
    Kernel Version: 3.10.0 and newer
          Hardware: x86-64
                OS: Linux
              Tree: Mainline
            Status: NEW
          Severity: high
          Priority: P1
         Component: kvm
          Assignee: [email protected]
          Reporter: [email protected]
        Regression: No

Created attachment 153371
--> https://bugzilla.kernel.org/attachment.cgi?id=153371&action=edit
The blue screen snapshot

When running Windows 7 32bit guests on qemu-kvm, sometimes the guests run into blue screen during reboot(Windows' reboot instead of qemu's).

Blue screen stop code:

    0x0000005c(0x0000010b,0x00000003,0x00000000,0x00000000)

Once the error happens to a guest, use qemu 'system_reset' command to restart it, the error can be reproduced.
Unfortunately, there is neither mini dump nor memory dump, only the above stop code.

Kernel versions:

    I have tested 3.10.0, 3.10.32, 3.10.57, 3.14.21. All of them are affected.
    3.9.11 and 3.8.13 are not affected.
    I guest the bug is introduced in 3.10.0, and exists in all 3.10 and newer

versions.
Guest OS:
Currently only Windows 7 32bit is affected. Windows xp 32bit and Windows 7 64 bit are not affected.
Host CPU:

    Intel(R) Xeon(R) CPU E5-2620 v2
Host OS:
    CentOS 6.5

Recreate steps:
This error can not be recreated every reboot.
With below scenario, it can be recreated within 30 minutes:
* Prepare a Windows 7 32bit image as base image. Put below content into a batch file(like auto_restart.bat):
shutdown /r /t 60
and put the batch file into the Windows startup folder, or anywhere so long
as it will be called after system startup.
This will make the Windows guests automatically restart after system startup
in 60 seconds.
* And create 30 child images as below:
qemu-img create -f qcow2 -o backing_file=win7_base,size=20G inst1.img
* Run all the guests:
nohup /usr/bin/qemu-system-x86_64 -name inst1 -machine
pc-i440fx-1.5,accel=kvm,usb=off -m 1024 -smp 1,sockets=1,cores=1,threads=1 -drive file=inst1.img,if=none,id=drive-ide0-0-0,format=qcow2,cache=writeback -device ide-hd,bus=ide.0,unit=0,drive=drive-ide0-0-0,id=ide0-0-0,bootindex=1 -vnc 0.0.0.0:6100 -vga qxl -global qxl-vga.ram_size=67108864 -global qxl-vga.vram_size=67108864 -chardev socket,id=charmonitor,path=/var/lib/libvirt/qemu/inst1.monitor,server,nowait -mon chardev=charmonitor,id=monitor,mode=readline -device piix3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2 -device usb-tablet,id=input0 2>&1

Quoted 1 line

/tmp/inst.out &

Remember to change the vnc port for each guest.
* After 30 minutes, check all the guests with vnc client, you will find some of the guests have run into blue screen.

Signature · 2 lines

You are receiving this mail because:
You are watching the assignee of the bug.

Nadav Amit

2014-10-13 07:48 UTC #1 lore raw

Paolo,

Can it be related to the MTRR issue I caused?
Did you push commit 0d234daf7e0a3290a3a20c8087eefbd6335a5bd4 ("Revert "KVM: x86: Increase the number of fixed MTRR regs to 10””) to stable?

Thanks,
Nadav

Quoted 81 lines · On Oct 13, 2014, at 5:14 AM, [email protected] wrote:

https://bugzilla.kernel.org/show_bug.cgi?id=86161
           Bug ID: 86161
          Summary: PROBLEM: On KVM, Window 7 32bit guests sometimes run
                   into blue screen(0x0000005c) during reboot
          Product: Virtualization
          Version: unspecified
   Kernel Version: 3.10.0 and newer
         Hardware: x86-64
               OS: Linux
             Tree: Mainline
           Status: NEW
         Severity: high
         Priority: P1
        Component: kvm
         Assignee: [email protected]
         Reporter: [email protected]
       Regression: No
Created attachment 153371
--> https://bugzilla.kernel.org/attachment.cgi?id=153371&action=edit
The blue screen snapshot
When running Windows 7 32bit guests on qemu-kvm, sometimes the guests run into blue screen during reboot(Windows' reboot instead of qemu's).
Blue screen stop code:
   0x0000005c(0x0000010b,0x00000003,0x00000000,0x00000000)
Once the error happens to a guest, use qemu 'system_reset' command to restart it, the error can be reproduced.
Unfortunately, there is neither mini dump nor memory dump, only the above stop code.
Kernel versions:
I have tested 3.10.0, 3.10.32, 3.10.57, 3.14.21. All of them are affected. 3.9.11 and 3.8.13 are not affected.
I guest the bug is introduced in 3.10.0, and exists in all 3.10 and newer
versions.
Guest OS:
Currently only Windows 7 32bit is affected.
Windows xp 32bit and Windows 7 64 bit are not affected.
Host CPU:
   Intel(R) Xeon(R) CPU E5-2620 v2
Host OS:
   CentOS 6.5
Recreate steps:
This error can not be recreated every reboot.
With below scenario, it can be recreated within 30 minutes:
* Prepare a Windows 7 32bit image as base image. Put below content into a batch file(like auto_restart.bat):
shutdown /r /t 60
and put the batch file into the Windows startup folder, or anywhere so long
as it will be called after system startup.
This will make the Windows guests automatically restart after system startup
in 60 seconds.
* And create 30 child images as below:
qemu-img create -f qcow2 -o backing_file=win7_base,size=20G inst1.img
* Run all the guests:
nohup /usr/bin/qemu-system-x86_64 -name inst1 -machine
pc-i440fx-1.5,accel=kvm,usb=off -m 1024 -smp 1,sockets=1,cores=1,threads=1
(quoted diff) +0 -3
-drive file=inst1.img,if=none,id=drive-ide0-0-0,format=qcow2,cache=writeback
-device ide-hd,bus=ide.0,unit=0,drive=drive-ide0-0-0,id=ide0-0-0,bootindex=1
-vnc 0.0.0.0:6100 -vga qxl -global qxl-vga.ram_size=67108864 -global
qxl-vga.vram_size=67108864 -chardev socket,id=charmonitor,path=/var/lib/libvirt/qemu/inst1.monitor,server,nowait -mon chardev=charmonitor,id=monitor,mode=readline -device piix3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2 -device usb-tablet,id=input0 2>&1
Quoted 1 line
/tmp/inst.out &
Remember to change the vnc port for each guest.
* After 30 minutes, check all the guests with vnc client, you will find some of the guests have run into blue screen.
Signature · 6 lines
You are receiving this mail because:
You are watching the assignee of the bug.
--
To unsubscribe from this list: send the line "unsubscribe kvm" in
the body of a message to [email protected]
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Paolo Bonzini

maintainer

2014-10-14 04:45 UTC #2 lore raw

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Il 13/10/2014 09:48, Nadav Amit ha scritto:

Quoted 3 lines

Can it be related to the MTRR issue I caused? Did you push commit 0d234daf7e0a3290a3a20c8087eefbd6335a5bd4 ("Revert "KVM: x86:
Increase the number of fixed MTRR regs to 10??) to stable?

Hmm, I typo-ed the stable@ address. I'll send it now.

Paolo
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2

iQEcBAEBAgAGBQJUPKpUAAoJEBRUblpOawnXxVEH/3GR0EGfPOyFpKpSCa8tg6Ts Etm0iMVxRIZ0mHLpqkBSXppY899WLnA9ic4YJ1XPHShA7MZO/BF2CsjohhXmSnmt 9CPeEOftoytgGKngVSCGkm8+ER+6jh0TDz8UV1BqdGOyGzRf9Cf+PEazzFBLDlEr rZDKiIJUmkaScnATaYADOzipGtUK5SL9jDfRW3wp5RKBVsb/B5pF/l8uY3y5zAwc 0+wkgxUqpxD2Wt8crbzT0YWdTMtnzoFML78EplSKDH4aZ6sXmPJNJ9Prn5QUZnWR 91IxD0gqFLwfrtt0u8+USy0+zreoMMjHpXslfHxQsNKXA0Ro7jqE2aYI+oeb5H4= =rKJH
-----END PGP SIGNATURE-----

[email protected]

author

2014-10-13 09:03 UTC #3 lore raw

[Bug 86161] PROBLEM: On KVM, Windows 7 32bit guests sometimes run into blue screen(0x0000005c) during reboot

In reply to [email protected]

https://bugzilla.kernel.org/show_bug.cgi?id=86161

GC Ngu <[email protected]> changed:

What |Removed |Added
----------------------------------------------------------------------------

            Summary|PROBLEM: On KVM, Window 7   |PROBLEM: On KVM, Windows 7
                   |32bit guests sometimes run  |32bit guests sometimes run
                   |into blue                   |into blue
                   |screen(0x0000005c) during   |screen(0x0000005c) during
                   |reboot                      |reboot

Signature · 2 lines

You are receiving this mail because:
You are watching the assignee of the bug.

[email protected]

author

2014-10-13 15:52 UTC #4 lore raw

[Bug 86161] PROBLEM: On KVM, Windows 7 32bit guests sometimes run into blue screen(0x0000005c) during reboot

In reply to [email protected]

https://bugzilla.kernel.org/show_bug.cgi?id=86161

--- Comment #1 from GC Ngu <[email protected]> ---
After long time bisection, I narrowed down the problem to the commit "5a71785dde307f6ac80e83c0ad3fd694912010a1".

But I have no idea why it happens sometimes instead of every time.

Could anyone make a fix for this? Thanks!

Signature · 2 lines

You are receiving this mail because:
You are watching the assignee of the bug.

[email protected]

author

2014-10-13 15:58 UTC #5 lore raw

[Bug 86161] PROBLEM: On KVM, Windows 7 32bit guests sometimes run into blue screen(0x0000005c) during reboot

In reply to [email protected]

https://bugzilla.kernel.org/show_bug.cgi?id=86161

--- Comment #2 from GC Ngu <[email protected]> ---
There is a simple to recreate the error:
* Send an nmi command to the guest through monitor. The guest will be halted.
* Then send 'system_reset' command. The guest will be reset. Let the system start normally, then the problem will show up.

Signature · 2 lines

You are receiving this mail because:
You are watching the assignee of the bug.

Nadav Amit

2014-10-13 16:36 UTC #6 lore raw

Re: [Bug 86161] PROBLEM: On KVM, Windows 7 32bit guests sometimes run into blue screen(0x0000005c) during reboot

I hope I don’t waste your time, but I think I encountered a similar scenario in a different environment. If you want, you can try this patch: https://lkml.org/lkml/2014/6/30/195

Nadav

Quoted 15 lines · On Oct 13, 2014, at 6:58 PM, [email protected] wrote:

https://bugzilla.kernel.org/show_bug.cgi?id=86161
--- Comment #2 from GC Ngu <[email protected]> ---
There is a simple to recreate the error:
* Send an nmi command to the guest through monitor. The guest will be halted.
* Then send 'system_reset' command. The guest will be reset. Let the system start normally, then the problem will show up.
Signature · 6 lines
You are receiving this mail because:
You are watching the assignee of the bug.
--
To unsubscribe from this list: send the line "unsubscribe kvm" in
the body of a message to [email protected]
More majordomo info at  http://vger.kernel.org/majordomo-info.html

[email protected]

author

2014-10-16 07:56 UTC #7 lore raw

[Bug 86161] On KVM, Windows 7 32bit guests sometimes run into blue screen(0x0000005c) during reboot

In reply to [email protected]

https://bugzilla.kernel.org/show_bug.cgi?id=86161

GC Ngu <[email protected]> changed:

What |Removed |Added
----------------------------------------------------------------------------

            Summary|PROBLEM: On KVM, Windows 7  |On KVM, Windows 7 32bit
                   |32bit guests sometimes run  |guests sometimes run into
                   |into blue                   |blue screen(0x0000005c)
                   |screen(0x0000005c) during   |during reboot
                   |reboot                      |

Signature · 2 lines

You are receiving this mail because:
You are watching the assignee of the bug.

[email protected]

author

2015-03-11 11:15 UTC #8 lore raw

[Bug 86161] On KVM, Windows 7 32bit guests sometimes run into blue screen(0x0000005c) during reboot

In reply to [email protected]

https://bugzilla.kernel.org/show_bug.cgi?id=86161

Timofey <[email protected]> changed:

What |Removed |Added
----------------------------------------------------------------------------
CC| |[email protected]

--- Comment #3 from Timofey <[email protected]> ---
I have the problem with guest Windows Server 2012 R2 (x64)
uname -rvmo
3.10.0-123.13.1.el7.x86_64 #1 SMP Tue Dec 9 23:06:09 UTC 2014 x86_64 GNU/Linux (Centos 7.0)

Signature · 2 lines

You are receiving this mail because:
You are watching the assignee of the bug.

[email protected]

author

2015-03-11 11:15 UTC #9 lore raw

[Bug 86161] On KVM, Windows 7 32bit guests sometimes run into blue screen(0x0000005c) during reboot

In reply to [email protected]

https://bugzilla.kernel.org/show_bug.cgi?id=86161

--- Comment #4 from Timofey <[email protected]> --- CPU:
Intel(R) Xeon(R) CPU E5-2620 v2 @ 2.10GHz

Signature · 2 lines

You are receiving this mail because:
You are watching the assignee of the bug.

[email protected]

author

2016-04-05 09:55 UTC #10 lore raw

[Bug 86161] On KVM, Windows 7 32bit guests sometimes run into blue screen(0x0000005c) during reboot

In reply to [email protected]

https://bugzilla.kernel.org/show_bug.cgi?id=86161

Benpao <[email protected]> changed:

What |Removed |Added
----------------------------------------------------------------------------
CC| |[email protected]

--- Comment #5 from Benpao <[email protected]> --- I have the problem with guest Windows 7 (x64)

Linux qemu 3.10.0-229.el7.x86_64 #1 SMP Fri Mar 6 11:36:42 UTC 2015 x86_64 x86_64 x86_64 GNU/Linux

Intel(R) Xeon(R) CPU E5-2640 v2 @ 2.00GHz

Signature · 2 lines

You are receiving this mail because:
You are watching the assignee of the bug.