Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-11.6 required=3.0 tests=BAYES_00,DKIM_INVALID, DKIM_SIGNED,HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_PATCH,MAILING_LIST_MULTI, SPF_HELO_NONE,SPF_PASS,USER_AGENT_GIT autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 4670FC63798 for ; Thu, 26 Nov 2020 23:49:27 +0000 (UTC) Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id AD9AB21D91 for ; Thu, 26 Nov 2020 23:49:26 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org AD9AB21D91 Authentication-Results: mail.kernel.org; dmarc=none (p=none dis=none) header.from=irrelevant.dk Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org Received: from localhost ([::1]:48086 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kiR0v-0000mo-5j for qemu-devel@archiver.kernel.org; Thu, 26 Nov 2020 18:49:25 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:55748) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1kiQxq-0007Ol-EL; Thu, 26 Nov 2020 18:46:14 -0500 Received: from out3-smtp.messagingengine.com ([66.111.4.27]:56235) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1kiQxj-0003s4-C9; Thu, 26 Nov 2020 18:46:14 -0500 Received: from compute4.internal (compute4.nyi.internal [10.202.2.44]) by mailout.nyi.internal (Postfix) with ESMTP id 919BC5C01FE; Thu, 26 Nov 2020 18:46:05 -0500 (EST) Received: from mailfrontend2 ([10.202.2.163]) by compute4.internal (MEProxy); Thu, 26 Nov 2020 18:46:05 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=irrelevant.dk; h=from:to:cc:subject:date:message-id:content-type:mime-version :content-transfer-encoding; s=fm1; bh=RVwrI04kwWNF8+JObBC8exJRrx jwURAWhpAEP5Z9qqk=; b=V+wIZKn+le2vO02v71dsLuydOO+kR0CaUzJM5+qJkd cIYgxlLJRRMcez8Wu3gy3DJczkBxd26V0flDD2NiDJbBej34MlL1qFV3azurUlYr SCTf444AEiXutOPoJvEgjhCBJps3iieRaJL0f0DstSCRf2GQOvSJYhCiUfg8pJGc LtBjk+AqHamk9EDLVOgREEmKz329Hn0rgNsbEC3OyIBcH3mYsO/z1TihFeNCI09D hS+7kV7m4JdFiso8FMyWaSVJA4NJNcFSBuhqy2yPStf6n3oJRGFT/+Bc8NRyu0be xGnAcycozynHwQp+BR7OHCzIZA/pT0vap+bx244LX8Ig== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-transfer-encoding:content-type :date:from:message-id:mime-version:subject:to:x-me-proxy :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm1; bh=RVwrI0 4kwWNF8+JObBC8exJRrxjwURAWhpAEP5Z9qqk=; b=OIHRXj0RhofVR4PXCOR2Zu QSwqGbwgJxhszzyQtH9zZdMH9s+oBkYxbfcRbNj6S3DKwCYKZSJvY7q0RfzxTAPM 2dIM1kK8wCzn0wSsQcTD2P9CU9MFgOqhgZ0WCDQscspWvFEkbyhRS/SQ3wmyDhES wlyoIvJ+hxWwenHgxdTP8qnBXhJKKojmMVVum5Myl1wlEllcvjHASizklksqfPEi OPUXGmL7Olq1ohseNWmmXJisso4UNVsQl7p6B4MvvnkLjgdrbkLtlRbyrpwvoJzg 2mYf56URbnK3d1bqjFr/MHr0oM3vRnoeu57oG1IjYjgZeIgCWe8lcMZPAxQjaNgw == X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedujedrudehfedguddvucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucesvcftvggtihhpihgvnhhtshculddquddttddmne cujfgurhephffvufffkffotggggfesthhqredtredtjeenucfhrhhomhepmfhlrghushcu lfgvnhhsvghnuceoihhtshesihhrrhgvlhgvvhgrnhhtrdgukheqnecuggftrfgrthhtvg hrnhepheegheeukeetjeduvdefkedvudduhedtjedttedugeejgeevhfekvedtvdeuffel necuffhomhgrihhnpehirhhrvghlvghvrghnthdrughknecukfhppeektddrudeijedrle ekrdduledtnecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhho mhepihhtshesihhrrhgvlhgvvhgrnhhtrdgukh X-ME-Proxy: Received: from apples.local (80-167-98-190-cable.dk.customer.tdc.net [80.167.98.190]) by mail.messagingengine.com (Postfix) with ESMTPA id 3C85A3064AAE; Thu, 26 Nov 2020 18:46:03 -0500 (EST) From: Klaus Jensen To: qemu-devel@nongnu.org Subject: [PATCH v5 00/12] hw/block/nvme: zoned namespace command set Date: Fri, 27 Nov 2020 00:45:49 +0100 Message-Id: <20201126234601.689714-1-its@irrelevant.dk> X-Mailer: git-send-email 2.29.2 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Received-SPF: pass client-ip=66.111.4.27; envelope-from=its@irrelevant.dk; helo=out3-smtp.messagingengine.com X-Spam_score_int: -27 X-Spam_score: -2.8 X-Spam_bar: -- X-Spam_report: (-2.8 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Kevin Wolf , Fam Zheng , qemu-block@nongnu.org, Klaus Jensen , Max Reitz , Keith Busch , Stefan Hajnoczi , Klaus Jensen Errors-To: qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org Sender: "Qemu-devel" From: Klaus Jensen =0D Oi,=0D =0D Things seem to have slowed down a bit on the zoned front, so in the=0D interest of moving things forward and catalyzing the process, I'm=0D posting a v5 of my series (v4 never got posted, but it's in my repo for=0D posterity, see below). I picked some preparatory patches from Dmitry and=0D rebased on that.=0D =0D These patches apply on top of the "pmr/cmb coexist", "compare" and=0D "simple copy" series that I've posted previously.=0D =0D An applied version is available here:=0D =0D https://irrelevant.dk/g/pci-nvme.git/tag/?h=3Dzoned-v5=0D =0D Changed for v5=0D ~~~~~~~~~~~~~~=0D =0D * Rebased to work with the DULBE support, recently merged in=0D nvme-next.=0D =0D * "hw/block/nvme: Separate read and write handlers"=0D * "hw/block/nvme: Merge nvme_write_zeroes() with nvme_write()"=0D * "hw/block/nvme: Generate namespace UUIDs"=0D - Picked from Dmitry' series.=0D =0D * "hw/block/nvme: add commands supported and effects log page"=0D * "hw/block/nvme: support namespace types"=0D - Refactored and cribbed Keith's approach to CSE from the kb-zns=0D branch and getting rid of the ugly macro initializers.=0D =0D * "hw/block/nvme: add persistence for zone info"=0D - Marked RFC for obvious reasons.=0D =0D Changes for v4=0D ~~~~~~~~~~~~~~=0D =0D * "hw/block/nvme: add the zone management send command"=0D - Use a pwrite_zeroes for zone reset instead of a discard.=0D =0D Changes for v3=0D ~~~~~~~~~~~~~~=0D =0D * Rebased on nvme-next with "[PATCH v2] hw/block/nvme: add dulbe=0D support" applied.=0D =0D * "hw/block/nvme: add support for dulbe and block utilization tracking"=0D - Dropped from this series. This series instead builds on the=0D support for DULBE that I added in "[PATCH v2] hw/block/nvme: add=0D dulbe support", previously posted.=0D =0D * "hw/block/nvme: add the zone management send command"=0D - Use asynchronous discards.=0D =0D * "hw/block/nvme: add basic read/write for zoned namespaces"=0D * "hw/block/nvme: add the zone management receive command"=0D * "hw/block/nvme: add the zone management send command"=0D * "hw/block/nvme: add the zone append command"=0D * "hw/block/nvme: track and enforce zone resources"=0D * "hw/block/nvme: allow open to close zone transitions by controller"=0D - In compliance with the concensus I dropped zone persistence=0D support from all patches.=0D =0D Changes for v2=0D ~~~~~~~~~~~~~~=0D =0D * "hw/block/nvme: add support for dulbe and block utilization tracking"=0D - Factor out pstate init/load into separate functions.=0D =0D - Fixed a stupid off-by-1 bug that would trigger when resetting the=0D last zone.=0D =0D - I added a more formalized pstate file format that includes a=0D header. This is pretty similar to what is done in Dmitry's series,=0D but with fewer fields. The device parameters for nvme-ns are still=0D the "authoritative" ones, so if any parameters that influence LBA=0D size, number of zones, etc. do not match, an error indicating the=0D discrepancy will be produced. IIRC, Dmitry's version does the=0D same.=0D =0D It is set up such that newer versions can load pstate files from=0D older versions. The file format header is not unlike a standard=0D nvme datastructure with reserved areas. This means that when=0D adding new command sets that require persistent state, it is not=0D needed to bump the version number, unless the header has to change=0D dramatically. This is demonstrated when the zoned namespace=0D command set support is added in "hw/block/nvme: add basic=0D read/write for zoned namespaces".=0D =0D * "hw/block/nvme: add basic read/write for zoned namespaces"=0D - The device will now transition all opened zones to Closed on=0D "normal shutdown". You can force the "transition to Full" behavior=0D by killing QEMU from the monitor.=0D =0D * "hw/block/nvme: add the zone append command"=0D - Slightly reordered the logic so a LBA Out of Range error is=0D returned before Invalid Field in Command for normal read/write=0D commands.=0D =0D * "hw/block/nvme: support zone active excursions"=0D - Dropped. Optional and non-critical.=0D =0D * "hw/block/nvme: support reset/finish recommended limits"=0D - Dropped. Optional and non-critical.=0D =0D Dmitry Fomichev (3):=0D hw/block/nvme: Separate read and write handlers=0D hw/block/nvme: Merge nvme_write_zeroes() with nvme_write()=0D hw/block/nvme: Generate namespace UUIDs=0D =0D Gollu Appalanaidu (1):=0D hw/block/nvme: add commands supported and effects log page=0D =0D Klaus Jensen (8):=0D hw/block/nvme: support namespace types=0D hw/block/nvme: add basic read/write for zoned namespaces=0D hw/block/nvme: add the zone management receive command=0D hw/block/nvme: add the zone management send command=0D hw/block/nvme: add the zone append command=0D hw/block/nvme: track and enforce zone resources=0D hw/block/nvme: allow open to close zone transitions by controller=0D hw/block/nvme: add persistence for zone info=0D =0D docs/specs/nvme.txt | 32 +=0D hw/block/nvme-ns.h | 127 +++-=0D hw/block/nvme.h | 10 +=0D include/block/nvme.h | 218 +++++-=0D block/nvme.c | 4 +-=0D hw/block/nvme-ns.c | 341 ++++++++-=0D hw/block/nvme.c | 1613 ++++++++++++++++++++++++++++++++++++++---=0D hw/block/trace-events | 35 +-=0D 8 files changed, 2246 insertions(+), 134 deletions(-)=0D =0D -- =0D 2.29.2=0D =0D