Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from lists1p.gnu.org (lists1p.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id B3414CD5BD0 for ; Tue, 26 May 2026 11:34:50 +0000 (UTC) Received: from localhost ([::1] helo=lists1p.gnu.org) by lists1p.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1wRq2O-0007ts-06; Tue, 26 May 2026 07:33:32 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists1p.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1wRq2F-0007sF-01 for qemu-devel@nongnu.org; Tue, 26 May 2026 07:33:24 -0400 Received: from mail-wr1-x436.google.com ([2a00:1450:4864:20::436]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1wRq29-0002BN-12 for qemu-devel@nongnu.org; Tue, 26 May 2026 07:33:22 -0400 Received: by mail-wr1-x436.google.com with SMTP id ffacd0b85a97d-44a5174670eso5886303f8f.1 for ; Tue, 26 May 2026 04:33:12 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=mihalicyn.com; s=mihalicyn; t=1779795191; x=1780399991; darn=nongnu.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=SQ0ITkKkq7CNygDh4eSh4qF4WgeXLzNwg5O26NH6KOE=; b=FYNgOBUWUmp1p+yNRPezHHcw43r1WO+8F5qsJ+DpfIoLEtZL19RWzGcsQPF7FISv4J X7TsazIN1iSKan1FQzDdV2KL6Ouo5Doji9e8QYmeBiRoX5jp6zr7HrDLwN+5L22n8Lv6 nsopMWlrmOnf1g5dkR1KvHaADA4bQVB/M7irM= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20251104; t=1779795191; x=1780399991; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-gg:x-gm-message-state:from :to:cc:subject:date:message-id:reply-to; bh=SQ0ITkKkq7CNygDh4eSh4qF4WgeXLzNwg5O26NH6KOE=; b=Q6AGI9zdHDIwwX1Jq7FxHk1CWC/F2phYnsjvJJv9+U7UKtqFVzCSgDlUi38OsbR2go cskMQhoT6Cb5tfPCLyFIk8aVGTe3YWGrjZU5sXuhsiEWfJ+9hj5IBsj1GifOCsyK20bs /TAucZ3szjCunEICCt4b5QevE1E/2S13K7oGB0Qqi5Bu5KRsDuYmx1Op7eOwCtOnthIr Ca1tOMEAsW7Y/o6o3dMrfMJg22uOxttMxQQX8soepdZ8pg7YV95nc+TLTKvz2cGXy+DT s5Pl82soiMkKw9YvVZ2WBQt+tA9fDGsHWmgpqFkuXNy8HEfXIXupcpwIUFgkNYfoOJ2U 1YIQ== X-Gm-Message-State: AOJu0Yx3MyEmdHcFEF5a9hQwAEtlA9TVP6TfZ1xCJzQtZrGz7Swk6CkH bDF2jSqdA8Q1FIYGkNY3RvPaxVzDgcRifR0XKEcQHPy8oxUku33Iisheh2JZv471kZBCkEO6U4/ G7cQkHeA= X-Gm-Gg: Acq92OG2b3c3nK4YXAQATRc9XVh9u1XMlBFn9i5RGDPxFctkkXokaDt1BsmT43B+Kpj LWCo4hlASgfUfHJ085zAe2EwmagqXcNZitPZRenDsl6piSc7I5AtCSdttfvyaDrX4H1xaGM8u4a HudUnTw8mOG1p8shRk2b+ec4Onz4G7K4XXbCEcSdyPvbhvrDERiC2Mk6K1/als1RcMOZ0iz5zls Nth5Y5CdaSLkXXVfiQ89TwiL4eo0+cqclayjBdc89ZKoxekE56Oe0Uk9qgYNqf+a7idhO8NdDoV fuJJPU/IuayEKq8nS44dIGfvCpww8AymaQi8AsOmWr/BtfH+Rk/wpUu5KLfBa7WioB20p9dkfpb PDXFNEczbCB/7TpQja1Tj79uVaTtTHKvHmtZ10R3FaCFPkGTHaSXLa4qfL9T0j3ozs+iY1Lkmk0 YtC+8UmCePhqQviVfthmn1k0e9UJuu+BnPHjEOI0vxoNfSWnEqbhxAuLetuMdOZvUeHg7jlC3Ax qHgVPm6LUo3G3JAZ3cnuGQ= X-Received: by 2002:a05:6000:18ac:b0:45e:9431:ee3c with SMTP id ffacd0b85a97d-45eb36813b0mr29916908f8f.10.1779795190853; Tue, 26 May 2026 04:33:10 -0700 (PDT) Received: from alex-laptop.lan (p200300cf57228c00840292fb31d0d80a.dip0.t-ipconnect.de. [2003:cf:5722:8c00:8402:92fb:31d0:d80a]) by smtp.gmail.com with ESMTPSA id ffacd0b85a97d-45eb6d4ca0dsm34366870f8f.18.2026.05.26.04.33.09 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 26 May 2026 04:33:10 -0700 (PDT) From: Alexander Mikhalitsyn To: qemu-devel@nongnu.org Cc: Hanna Reitz , Stefan Hajnoczi , Keith Busch , Paolo Bonzini , =?UTF-8?q?Philippe=20Mathieu-Daud=C3=A9?= , Fabiano Rosas , qemu-block@nongnu.org, Klaus Jensen , Laurent Vivier , Jesper Devantier , Kevin Wolf , Fam Zheng , Zhao Liu , Alexander Mikhalitsyn , =?UTF-8?q?St=C3=A9phane=20Graber?= , Peter Xu , Alexander Mikhalitsyn Subject: [PATCH v8 7/8] tests/functional/x86_64: add migration test for NVMe device Date: Tue, 26 May 2026 13:33:00 +0200 Message-ID: <20260526113301.91492-8-alexander@mihalicyn.com> X-Mailer: git-send-email 2.47.3 In-Reply-To: <20260526113301.91492-1-alexander@mihalicyn.com> References: <20260526113301.91492-1-alexander@mihalicyn.com> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Received-SPF: pass client-ip=2a00:1450:4864:20::436; envelope-from=alexander@mihalicyn.com; helo=mail-wr1-x436.google.com X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=unavailable autolearn_force=no X-Spam_action: no action X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: qemu development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org Sender: qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org From: Alexander Mikhalitsyn Introduce a very simple test to ensure that NVMe device migration works fine. Test plan is simple: 1. prepare VM with NVMe device 2. run workload that produces relatively heavy IO on the device 3. migrate VM 4. ensure that workload is alive and finishes without errors Test can be run as simple as: $ meson test 'func-x86_64-nvme_migration' --setup thorough -C build In the future we can extend this approach, and introduce some fio-based tests. And probably, it makes sense to make this test to apply not only to NVMe device, but also virtio-{blk,scsi}, ide, sata and other migratable devices. Acked-by: Stefan Hajnoczi Signed-off-by: Alexander Mikhalitsyn --- tests/functional/x86_64/meson.build | 1 + .../functional/x86_64/test_nvme_migration.py | 159 ++++++++++++++++++ 2 files changed, 160 insertions(+) create mode 100755 tests/functional/x86_64/test_nvme_migration.py diff --git a/tests/functional/x86_64/meson.build b/tests/functional/x86_64/meson.build index 1ed10ad6c29..fd77f19d726 100644 --- a/tests/functional/x86_64/meson.build +++ b/tests/functional/x86_64/meson.build @@ -37,6 +37,7 @@ tests_x86_64_system_thorough = [ 'linux_initrd', 'multiprocess', 'netdev_ethtool', + 'nvme_migration', 'replay', 'reverse_debug', 'tuxrun', diff --git a/tests/functional/x86_64/test_nvme_migration.py b/tests/functional/x86_64/test_nvme_migration.py new file mode 100755 index 00000000000..3788a8e3473 --- /dev/null +++ b/tests/functional/x86_64/test_nvme_migration.py @@ -0,0 +1,159 @@ +#!/usr/bin/env python3 +# +# SPDX-License-Identifier: GPL-2.0-or-later +# +# x86_64 NVMe migration test + +from migration import MigrationTest +from qemu_test import QemuSystemTest, Asset +from qemu_test import wait_for_console_pattern +from qemu_test import exec_command, exec_command_and_wait_for_pattern + + +class X8664NVMeMigrationTest(MigrationTest): + ASSET_KERNEL = Asset( + ('https://archives.fedoraproject.org/pub/archive/fedora/linux/releases' + '/31/Server/x86_64/os/images/pxeboot/vmlinuz'), + 'd4738d03dbbe083ca610d0821d0a8f1488bebbdccef54ce33e3adb35fda00129') + + ASSET_INITRD = Asset( + ('https://archives.fedoraproject.org/pub/archive/fedora/linux/releases' + '/31/Server/x86_64/os/images/pxeboot/initrd.img'), + '277cd6c7adf77c7e63d73bbb2cded8ef9e2d3a2f100000e92ff1f8396513cd8b') + + ASSET_DISKIMAGE = Asset( + ('https://archives.fedoraproject.org/pub/archive/fedora/linux/releases' + '/31/Cloud/x86_64/images/Fedora-Cloud-Base-31-1.9.x86_64.qcow2'), + 'e3c1b309d9203604922d6e255c2c5d098a309c2d46215d8fc026954f3c5c27a0') + + DEFAULT_KERNEL_PARAMS = ('root=/dev/nvme0n1p1 console=ttyS0 net.ifnames=0 ' + 'rd.rescue quiet') + + def wait_for_console_pattern(self, success_message, vm): + wait_for_console_pattern( + self, + success_message, + failure_message="Kernel panic - not syncing", + vm=vm, + ) + + def exec_command_and_check(self, command, vm): + prompt = '# ' + exec_command_and_wait_for_pattern(self, + f"{command} && echo OK || echo FAIL", + 'FAIL', vm=vm) + # Note, that commands we send to the console are echo-ed back, so if we have a word "FAIL" + # in the command itself, we should expect to see it once. + wait_for_console_pattern(self, 'OK', failure_message="FAIL", vm=vm) + self.wait_for_console_pattern(prompt, vm) + + def configure_machine(self, vm): + kernel_path = self.ASSET_KERNEL.fetch() + initrd_path = self.ASSET_INITRD.fetch() + diskimage_path = self.ASSET_DISKIMAGE.fetch() + + vm.set_console() + vm.add_args("-cpu", "max") + vm.add_args("-m", "2G") + vm.add_args("-accel", "kvm") + + vm.add_args('-drive', + f'file={diskimage_path},if=none,id=drv0,snapshot=on') + vm.add_args('-device', 'nvme,bus=pcie.0,' + + 'drive=drv0,id=nvme-disk0,serial=nvmemigratetest,bootindex=1') + + vm.add_args( + "-kernel", + kernel_path, + "-initrd", + initrd_path, + "-append", + self.DEFAULT_KERNEL_PARAMS + ) + + def launch_source_vm(self, vm): + vm.launch() + + self.wait_for_console_pattern('Entering emergency mode.', vm) + prompt = '# ' + self.wait_for_console_pattern(prompt, vm) + + # Synchronize on NVMe driver creating the root device + exec_command_and_wait_for_pattern(self, + "while ! (dmesg -c | grep nvme0n1:) ; do sleep 1 ; done", + "nvme0n1", vm=vm) + self.wait_for_console_pattern(prompt, vm) + + # prepare system + exec_command_and_wait_for_pattern(self, 'mount /dev/nvme0n1p1 /sysroot', + prompt, vm=vm) + exec_command_and_wait_for_pattern(self, 'chroot /sysroot', + prompt, vm=vm) + exec_command_and_wait_for_pattern(self, 'mount -t proc proc /proc', + prompt, vm=vm) + exec_command_and_wait_for_pattern(self, 'mount -t sysfs sysfs /sys', + prompt, vm=vm) + + # Run workload before migration to check if it continues to run properly after migration + # + # Workload is simple: it continuously calculates checksums of all files in /usr/bin + # to generate some I/O load on the NVMe disk and at the same time it drops caches to + # make sure that we have some read I/O on the disk as well. + # If there are any issues with the migration of the NVMe device, we should see errors + # in dmesg and consequently in the workload log. + exec_command_and_wait_for_pattern(self, + "(while [ ! -f /tmp/test_nvme_migration_workload.stop ]; do \ + rm -f /tmp/test_nvme_migration_workload.iteration_finished; \ + echo 3 > /proc/sys/vm/drop_caches; \ + find /usr/bin -type f -exec cksum {} \\;; \ + touch /tmp/test_nvme_migration_workload.iteration_finished; \ + done) > /dev/null 2> /tmp/test_nvme_migration_workload.errors &", + prompt, vm=vm) + exec_command_and_wait_for_pattern(self, 'echo $! > /tmp/test_nvme_migration_workload.pid', + prompt, vm=vm) + + # check if process is alive and running + self.exec_command_and_check("kill -0 $(cat /tmp/test_nvme_migration_workload.pid)", vm) + + def assert_dest_vm(self, vm): + prompt = '# ' + + # check if process is alive and running after migration, if not - fail the test + self.exec_command_and_check("kill -0 $(cat /tmp/test_nvme_migration_workload.pid)", vm) + + # signal workload to stop + exec_command_and_wait_for_pattern(self, 'touch /tmp/test_nvme_migration_workload.stop', + prompt, vm=vm) + + # wait workload to finish, because we want to examine log to see if there are any errors + exec_command_and_wait_for_pattern(self, + "while [ ! -f /tmp/test_nvme_migration_workload.iteration_finished ]; do sleep 1; done;", + prompt, vm=vm) + + exec_command_and_wait_for_pattern(self, 'cat /tmp/test_nvme_migration_workload.errors', + prompt, vm=vm) + + # fail the test if non-empty + self.exec_command_and_check("[ ! -s /tmp/test_nvme_migration_workload.errors ]", vm) + + def test_migration_with_tcp_localhost(self): + self.set_machine('q35') + self.require_accelerator("kvm") + + self.migration_with_tcp_localhost() + + def test_migration_with_unix(self): + self.set_machine('q35') + self.require_accelerator("kvm") + + self.migration_with_unix() + + def test_migration_with_exec(self): + self.set_machine('q35') + self.require_accelerator("kvm") + + self.migration_with_exec() + + +if __name__ == '__main__': + MigrationTest.main() -- 2.47.3