Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id D2B55C6379F for ; Fri, 13 Jan 2023 20:43:50 +0000 (UTC) Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1pGQsp-0008RH-4R; Fri, 13 Jan 2023 15:42:39 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1pGQsm-0008Qv-Kk for qemu-devel@nongnu.org; Fri, 13 Jan 2023 15:42:36 -0500 Received: from us-smtp-delivery-124.mimecast.com ([170.10.133.124]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1pGQsl-00068W-1x for qemu-devel@nongnu.org; Fri, 13 Jan 2023 15:42:36 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1673642554; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version: content-transfer-encoding:content-transfer-encoding; bh=krzqcyLRmtd752lfh8T6mZ98nuVdFM5HNd+mnbBepRw=; b=X6FKKXpZ0EGp9oHCGooT0LHIGYQvv/U6BaMqA6zAL7v4rhmtlq6ND2b1uOBX/211ovGhw0 npeVvLl44aE4QGmVDerSp6QNZmrSzmJ+FZTSUONUEbRimYonlddfyvAO8V8X0caVZhGxdn A4fqjeqRoQmo+4bDJRmOrDom1FC7HCs= Received: from mimecast-mx02.redhat.com (mx3-rdu2.redhat.com [66.187.233.73]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id us-mta-178-WtyhBNQ_PuOSnYpZRdGrBQ-1; Fri, 13 Jan 2023 15:42:31 -0500 X-MC-Unique: WtyhBNQ_PuOSnYpZRdGrBQ-1 Received: from smtp.corp.redhat.com (int-mx04.intmail.prod.int.rdu2.redhat.com [10.11.54.4]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mimecast-mx02.redhat.com (Postfix) with ESMTPS id 04BBC1C02CBC; Fri, 13 Jan 2023 20:42:31 +0000 (UTC) Received: from merkur.redhat.com (unknown [10.39.195.6]) by smtp.corp.redhat.com (Postfix) with ESMTP id 9BBD72026D68; Fri, 13 Jan 2023 20:42:29 +0000 (UTC) From: Kevin Wolf To: qemu-block@nongnu.org Cc: kwolf@redhat.com, hreitz@redhat.com, eesposit@redhat.com, pbonzini@redhat.com, vsementsov@yandex-team.ru, qemu-devel@nongnu.org Subject: [PATCH v2 00/14] block: Move more functions to coroutines Date: Fri, 13 Jan 2023 21:41:58 +0100 Message-Id: <20230113204212.359076-1-kwolf@redhat.com> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Scanned-By: MIMEDefang 3.1 on 10.11.54.4 Received-SPF: pass client-ip=170.10.133.124; envelope-from=kwolf@redhat.com; helo=us-smtp-delivery-124.mimecast.com X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=unavailable autolearn_force=no X-Spam_action: no action X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org Sender: qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org This series converts some IO_CODE() functions to coroutine_fn because they access the graph and will need to hold the graph lock in the future. IO_CODE() functions can be called from iothreads, so taking the graph lock requires the function to run in coroutine context. Pretty much all of the changes in this series were posted by Emanuele before as part of "Protect the block layer with a rwlock: part 3". The major difference is that in the old version, the patches did two things at once: Converting functions to coroutine_fn, and adding the locking to them. This series does only the coroutine conversion. The locking part will be in another series which now comes with TSA annotations and makes the locking related changes big enough to have separate patches. v2: - In each patch converting a BlockDriver callback to be called in coroutine, also immediately rename it and its implementation to include co_ in its name, as well as mark the implementations coroutine_fn [Vladimir] - Moved bdrv_is_inserted() earlier in the series because raw_is_inserted() calls raw_getlength(), so it needs to be converted first to avoid calling a coroutine_fn from a non-coroutine_fn in an intermediate state. - The final patch only renames bdrv_load/save_vmstate() any more, which was already converted to coroutine_fn earlier. - Since pretty much every patch was touched in this, I refrained from picking up any Reviewed-by for v1 Emanuele Giuseppe Esposito (14): block-coroutine-wrapper: support void functions block: Convert bdrv_io_plug() to co_wrapper block: Convert bdrv_io_unplug() to co_wrapper block: Convert bdrv_is_inserted() to co_wrapper block: Rename refresh_total_sectors to bdrv_refresh_total_sectors block: Convert bdrv_refresh_total_sectors() to co_wrapper_mixed block-backend: use bdrv_getlength instead of blk_getlength block: use bdrv_co_refresh_total_sectors when possible block: Convert bdrv_get_allocated_file_size() to co_wrapper block: Convert bdrv_get_info() to co_wrapper_mixed block: Convert bdrv_eject() to co_wrapper block: Convert bdrv_lock_medium() to co_wrapper block: Convert bdrv_debug_event() to co_wrapper_mixed block: Rename bdrv_load/save_vmstate() to bdrv_co_load/save_vmstate() include/block/block-io.h | 36 +++++++--- include/block/block_int-common.h | 26 ++++--- include/block/block_int-io.h | 5 +- include/sysemu/block-backend-io.h | 31 +++++++-- block.c | 82 +++++++++++++--------- block/blkdebug.c | 11 +-- block/blkio.c | 15 ++-- block/blklogwrites.c | 6 +- block/blkreplay.c | 6 +- block/blkverify.c | 6 +- block/block-backend.c | 36 +++++----- block/commit.c | 4 +- block/copy-on-read.c | 18 ++--- block/crypto.c | 14 ++-- block/curl.c | 10 +-- block/file-posix.c | 107 ++++++++++++++--------------- block/file-win32.c | 18 +++-- block/filter-compress.c | 20 +++--- block/gluster.c | 23 ++++--- block/io.c | 76 ++++++++++---------- block/iscsi.c | 17 ++--- block/mirror.c | 6 +- block/nbd.c | 8 +-- block/nfs.c | 4 +- block/null.c | 13 ++-- block/nvme.c | 14 ++-- block/preallocate.c | 16 ++--- block/qcow.c | 5 +- block/qcow2-refcount.c | 2 +- block/qcow2.c | 17 ++--- block/qed.c | 11 +-- block/quorum.c | 8 +-- block/raw-format.c | 25 +++---- block/rbd.c | 9 +-- block/replication.c | 6 +- block/ssh.c | 4 +- block/throttle.c | 6 +- block/vdi.c | 7 +- block/vhdx.c | 5 +- block/vmdk.c | 14 ++-- block/vpc.c | 5 +- blockdev.c | 8 ++- hw/scsi/scsi-disk.c | 5 ++ tests/unit/test-block-iothread.c | 3 + scripts/block-coroutine-wrapper.py | 20 ++++-- block/meson.build | 1 + 46 files changed, 443 insertions(+), 346 deletions(-) -- 2.38.1