From: Pasi =?iso-8859-1?Q?K=E4rkk=E4inen?= Subject: Re: pv 2.6.31 (kernel.org) and save/migrate fails, domU BUG Date: Tue, 10 Nov 2009 12:08:06 +0200 Message-ID: <20091110100806.GE16033@reaktio.net> References: <20091108154153.GM1434@reaktio.net> <693ea516-aa5b-4f82-ad48-1bd51cfa3480@default> <20091108172747.GR1434@reaktio.net> Mime-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable Return-path: Content-Disposition: inline In-Reply-To: <20091108172747.GR1434@reaktio.net> List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Sender: xen-devel-bounces@lists.xensource.com Errors-To: xen-devel-bounces@lists.xensource.com To: Dan Magenheimer Cc: Jeremy Fitzhardinge , "Xen-Devel (E-mail)" List-Id: xen-devel@lists.xenproject.org Hello, Jeremy: Here's summary about these save/restore problems using upstream Linux 2.6.31.5 PV guest. For me: - I can "xm save" + "xm restore" UP guest, but I get non-fatal BUG in the guest kernel, see [1]. - "xm save" fails for SMP guest with "failed to get the suspend evtchn p= ort", see [2]. For Dan: - "xm save" works for UP guest, but "xm restore" doesn't, giving infinite xen_sched_clock related dumps in the guest kernel, see [3]. - "xm save" for SMP guest fails, it never ends. I suspect this is the same problem I'm seeing. [1] non-fatal BUG on the guest kernel after "xm restore": http://pasik.reaktio.net/xen/debug/dmesg-2.6.31.5-122.fc12.x86_64-saveres= tore.txt [2] "xm log" contains: [2009-11-09 23:44:38 1353] DEBUG (XendCheckpoint:110) [xc_save]: /usr/lib= 64/xen/bin/xc_save 28 2 0 0 0 [2009-11-09 23:44:38 1353] INFO (XendCheckpoint:417) xc_save: failed to g= et the suspend evtchn port [3] See the attachment in this email: http://lists.xensource.com/archives/html/xen-devel/2009-11/msg00391.html Any tips how to debug these?=20 -- Pasi On Sun, Nov 08, 2009 at 07:27:47PM +0200, Pasi K=E4rkk=E4inen wrote: > On Sun, Nov 08, 2009 at 08:54:23AM -0800, Dan Magenheimer wrote: > > > > Ok, so it appears there is something problematic with > > > > saving an upstream kernel. It might be (partially) fixed > > > > in Fedora 12 or maybe there is some other environmental > > > > difference which makes save fail entirely on my system. > > > >=20 > > >=20 > > > Yeah, fedora kernel has some patches, but it should be pretty=20 > > > close to upstream kernel.. > > >=20 > > > btw was your guest UP or SMP? Mine was UP.. > >=20 > > Mine was SMP... switching to UP I can now save. BUT... > > restore doesn't seem to quite work. The restore completes > > but I get no response from the VNC console. When I > > use a tty console, after restore, I am getting > > an infinite dump of > >=20 > > WARNING: at arch/x86/time.c:180 xen_sched_clock+0x2b > >=20 > > (see attached). > >=20 > > Did you try restore on Fedora 12? > > =20 >=20 > Yeah. save+restore for UP F12 guest works for me=20 > (except I get that non-fatal BUG on the guest). >=20 > SMP guest doesn't work.. save crashes it. >=20 > > > > > > The results explain why I can get it to run on > > > > > > one machine (an older laptop) and not run on another > > > > > > machine (a Nehalem system)... looks like this is maybe > > > > > > related to the cpuid-extended-topology-leaf bug that Jeremy > > > > > > sent a fix for upstream recently. > > > > >=20 > > > > > Did you try with that patch applied?=20 > > > >=20 > > > > No, the patch wasn't posted, just a pull request to Linus, > > > > so I don't have the patch (and am not a git expert so > > > > am not sure how to get it). > > > >=20 > > > > http://lists.xensource.com/archives/html/xen-devel/2009-11/msg001= 82.html > > > > > > > > So I'll try it again when .6 or .7 is available. > > >=20 > > > See here for changelog: > > > http://git.kernel.org/?p=3Dlinux/kernel/git/jeremy/xen.git;a=3Dshor= tlog;h=3Dbugfix > > >=20 > > > You can get the diffs/patches from there using the links.. > >=20 > > Thanks. Yes, Jeremy's patch allows 2.6.31.5 (in a PV domain) > > to completely boot on my Nehalem box. >=20 > Ok. But I guess those doesn't help for the save+restore problem.. >=20 > -- Pasi >=20