NVMe 1.4 Identify Namespace Support
Subsystems (2)
v5 cover NVMe 1.4 Identify Namespace Support
Hi Christoph,
This patch series adds support for several of the new parameters introduced in the NVMe 1.4 Identify Namespace command. Please consider these patches for kernel version 5.3.
Thanks,
Bart.
Changes compared to v4:
- Left out the empty file I/O backend function nvmet_file_set_limits().
- Left out the reference to NVMe 1.4 in a nvmet_bdev_set_limits() comment.
- Moved the nvmet_file_set_limits() function into the nvmet.h header file.
- In the initiator code, only use the NAWUPF / AWUPF value if NABO == 0.
- Fixed an endianness issue in the initiator code.
Changes compared to v3:
- In the file backend code, do not set any of the namespace atomic properties.
Changes compared to v2:
- In the initiator, use AWUPF instead NAWUPF if NAWUPF == 0.
Changes compared to v1:
- Added a patch for the NVMe target code that exports these parameters.
- Limited the physical block size to the value of AWUPF/NAWUPF as appropriate.
Bart Van Assche (3):
nvme: Introduce NVMe 1.4 Identify Namespace fields in struct
nvme_id_ns
nvmet: Export NVMe namespace attributes
nvme: Set physical block size and optimal I/O size according to NVMe
1.4
Bart Van Assche (3):
nvme: Introduce NVMe 1.4 Identify Namespace fields in struct
nvme_id_ns
nvmet: Export NVMe namespace attributes
nvme: Set physical block size and optimal I/O size according to NVMe
1.4
drivers/nvme/host/core.c | 34 +++++++++++++++++++++++++-- drivers/nvme/host/nvme.h | 1 + drivers/nvme/target/admin-cmd.c | 3 +++ drivers/nvme/target/io-cmd-bdev.c | 39 +++++++++++++++++++++++++++++++ drivers/nvme/target/nvmet.h | 8 +++++++ include/linux/nvme.h | 12 +++++++--- 6 files changed, 92 insertions(+), 5 deletions(-)
Signature · 1 line
2.22.0.410.gd8fdbe21b5-goog
PATCH v5 1/3 nvme: Introduce NVMe 1.4 Identify Namespace fields in struct nvme_id_ns
Several new fields have been introduced in version 1.4 of the NVMe spec at offsets that were defined as reserved in version 1.3d of the NVMe spec. Update the definition of the nvme_id_ns data structure such that it is in sync with version 1.4 of the NVMe spec. This change preserves backwards compatibility.
--- include/linux/nvme.h | 12 +++++++++--- 1 file changed, 9 insertions(+), 3 deletions(-)
include/linux/nvme.h +9 -3
@@ -315,7 +315,7 @@ struct nvme_id_ns {__u8 nmic;__u8 rescap;__u8 fpi; -__u8 rsvd33; +__u8 dlfeat;__le16 nawun;__le16 nawupf;__le16 nacwu;
@@ -324,11 +324,17 @@ struct nvme_id_ns {__le16 nabspf;__le16 noiob;__u8 nvmcap[16 ]; -__u8 rsvd64[28 ]; +__le16 npwg; +__le16 npwa; +__le16 npdg; +__le16 npda; +__le16 nows; +__u8 rsvd74[18 ];__le32 anagrpid;__u8 rsvd96[3 ];__u8 nsattr; -__u8 rsvd100[4 ]; +__le16 nvmsetid; +__le16 endgid;__u8 nguid[16 ];__u8 eui64[8 ];struct nvme_lbaf lbaf[16 ];
Signature · 1 line
2.22.0.410.gd8fdbe21b5-goog
PATCH v5 1/3 nvme: Introduce NVMe 1.4 Identify Namespace fields in struct nvme_id_ns
Quoted 13 lines · Bart Van Assche
Several new fields have been introduced in version 1.4 of the NVMe spec at offsets that were defined as reserved in version 1.3d of the NVMe spec. Update the definition of the
nvme_id_nsdata structure such that it is in sync with version 1.4 of the NVMe spec. This change preserves backwards compatibility.Reviewed-by Chaitanya Kulkarni <chaitanya.kulkarni at wdc.com>Reviewed-by Martin K. Petersen <martin.petersen at oracle.com>Reviewed-by Keith Busch <kbusch at kernel.org>Reviewed-by Christoph Hellwig <hch at lst.de>Cc Sagi Grimberg <sagi at grimberg.me>Cc Hannes Reinecke <hare at suse.com>Signed-off-by Bart Van Assche <bvanassche at acm.org>
Quoted 4 lines
--- include/linux/nvme.h | 12 +++++++++--- 1 file changed, 9 insertions(+), 3 deletions(-)
Cheers,
Hannes
Signature · 5 lines
Dr. Hannes Reinecke Teamlead Storage & Networking hare at suse.de +49 911 74053 688 SUSE LINUX GmbH, Maxfeldstr. 5, 90409 N?rnberg GF: Felix Imend?rffer, Mary Higgins, Sri Rasiah HRB 21284 (AG N?rnberg)
PATCH v5 2/3 nvmet: Export NVMe namespace attributes
In reply to Bart Van AsscheMake the NVMe NAWUN, NAWUPF, NACWU, NPWG, NPWA, NPDG and NOWS attributes available to initator systems for the block backend.
--- drivers/nvme/target/admin-cmd.c | 3 +++ drivers/nvme/target/io-cmd-bdev.c | 39 +++++++++++++++++++++++++++++++ drivers/nvme/target/nvmet.h | 8 +++++++ 3 files changed, 50 insertions(+)
drivers/nvme/target/admin-cmd.c +3 -0
@@ -442,6 +442,9 @@ static void nvmet_execute_identify_ns(struct nvmet_req *req)break ; } +if (ns->bdev) +nvmet_bdev_set_limits (ns->bdev, id); +/* * We just provide a single LBA format that matches what the * underlying device reports.
drivers/nvme/target/io-cmd-bdev.c +39 -0
@@ -8,6 +8,45 @@#include <linux/module.h> #include "nvmet.h" +void nvmet_bdev_set_limits (struct block_device *bdev,struct nvme_id_ns *id) +{ +const struct queue_limits *ql = &bdev_get_queue (bdev)->limits; +/* Number of physical blocks per logical block. */ +const u32 ppl = ql->physical_block_size / ql->logical_block_size; +/* Physical blocks per logical block, 0's based. */ +const __le16 ppl0b =to0based (ppl); + +/* +* For NVMe 1.2 and later, bit 1 indicates that the fields NAWUN, +* NAWUPF, and NACWU are defined for this namespace and should be +* used by the host for this namespace instead of the AWUN, AWUPF, +* and ACWU fields in the Identify Controller data structure. If +* any of these fields are zero that means that the corresponding +* field from the identify controller data structure should be used. +*/ + id->nsfeat |=1 <<1 ; + id->nawun = ppl0b; + id->nawupf = ppl0b; + id->nacwu = ppl0b; + +/* +* Bit 4 indicates that the fields NPWG, NPWA, NPDG, NPDA, and +* NOWS are defined for this namespace and should be used by +* the host for I/O optimization. +*/ + id->nsfeat |=1 <<4 ; +/* NPWG = Namespace Preferred Write Granularity. 0's based */ + id->npwg = ppl0b; +/* NPWA = Namespace Preferred Write Alignment. 0's based */ + id->npwa = id->npwg; +/* NPDG = Namespace Preferred Deallocate Granularity. 0's based */ + id->npdg =to0based (ql->discard_granularity / ql->logical_block_size); +/* NPDG = Namespace Preferred Deallocate Alignment */ + id->npda = id->npdg; +/* NOWS = Namespace Optimal Write Size */ + id->nows =to0based (ql->io_opt / ql->logical_block_size); +} +int nvmet_bdev_ns_enable (struct nvmet_ns *ns) {int ret;
drivers/nvme/target/nvmet.h +8 -0
@@ -365,6 +365,7 @@ u16 nvmet_set_feat_async_event(struct nvmet_req *req, u32 mask);void nvmet_execute_async_event (struct nvmet_req *req);u16 nvmet_parse_connect_cmd (struct nvmet_req *req); +void nvmet_bdev_set_limits (struct block_device *bdev,struct nvme_id_ns *id);u16 nvmet_bdev_parse_io_cmd (struct nvmet_req *req);u16 nvmet_file_parse_io_cmd (struct nvmet_req *req);u16 nvmet_parse_admin_cmd (struct nvmet_req *req);
@@ -492,4 +493,11 @@ static inline u32 nvmet_rw_len(struct nvmet_req *req) }u16 errno_to_nvme_status (struct nvmet_req *req,int errno); + +/* Convert a 32-bit number to a 16-bit 0's based number */ +static inline __le16 to0based (u32 a) +{ +return cpu_to_le16 (max (1U ,min (1U <<16 , a)) -1 ); +} +#endif /* _NVMET_H */
Signature · 1 line
2.22.0.410.gd8fdbe21b5-goog
PATCH v5 2/3 nvmet: Export NVMe namespace attributes
Bart,
Quoted 2 lines
Make the NVMe NAWUN, NAWUPF, NACWU, NPWG, NPWA, NPDG and NOWS attributes available to initator systems for the block backend.
I'm OK with not opening the can of worms that is file backing.
Signature · 1 line
Martin K. Petersen Oracle Linux Engineering
PATCH v5 2/3 nvmet: Export NVMe namespace attributes
In reply to Bart Van AsscheQuoted 9 lines · Bart Van Assche
Make the NVMe NAWUN, NAWUPF, NACWU, NPWG, NPWA, NPDG and NOWS attributes available to initator systems for the block backend.
Cc Keith Busch <kbusch at kernel.org>Cc Sagi Grimberg <sagi at grimberg.me>Cc Martin K. Petersen <martin.petersen at oracle.com>Cc Hannes Reinecke <hare at suse.com>Cc Chaitanya Kulkarni <chaitanya.kulkarni at wdc.com>Signed-off-by Bart Van Assche <bvanassche at acm.org>
Quoted 6 lines
--- drivers/nvme/target/admin-cmd.c | 3 +++ drivers/nvme/target/io-cmd-bdev.c | 39 +++++++++++++++++++++++++++++++ drivers/nvme/target/nvmet.h | 8 +++++++ 3 files changed, 50 insertions(+)
Cheers,
Hannes
Signature · 5 lines
Dr. Hannes Reinecke Teamlead Storage & Networking hare at suse.de +49 911 74053 688 SUSE LINUX GmbH, Maxfeldstr. 5, 90409 N?rnberg GF: Felix Imend?rffer, Mary Higgins, Sri Rasiah HRB 21284 (AG N?rnberg)
PATCH v5 3/3 nvme: Set physical block size and optimal I/O size according to NVMe 1.4
In reply to Bart Van AsscheQuoted 1 line
From the NVMe 1.4 spec:
NSFEAT bit 4 if set to 1: indicates that the fields NPWG, NPWA, NPDG, NPDA, and NOWS are defined for this namespace and should be used by the host for I/O optimization;
[ ... ]
Namespace Preferred Write Granularity (NPWG): This field indicates the smallest recommended write granularity in logical blocks for this namespace. This is a 0's based value. The size indicated should be less than or equal to Maximum Data Transfer Size (MDTS) that is specified in units of minimum memory page size. The value of this field may change if the namespace is reformatted. The size should be a multiple of Namespace Preferred Write Alignment (NPWA). Refer to section 8.25 for how this field is utilized to improve performance and endurance.
[ ... ]
Each Write, Write Uncorrectable, or Write Zeroes commands should address a multiple of Namespace Preferred Write Granularity (NPWG) (refer to Figure
245) and Stream Write Size (SWS) (refer to Figure 515) logical blocks (as expressed in the NLB field), and the SLBA field of the command should be aligned to Namespace Preferred Write Alignment (NPWA) (refer to Figure 245) for best performance.
--- drivers/nvme/host/core.c | 34 ++++++++++++++++++++++++++++++++-- drivers/nvme/host/nvme.h | 1 + 2 files changed, 33 insertions(+), 2 deletions(-)
drivers/nvme/host/core.c +32 -2
@@ -1631,6 +1631,7 @@ static void nvme_update_disk_info(struct gendisk *disk, {sector_t capacity =le64_to_cpu (id->nsze) << (ns->lba_shift -9 );unsigned short bs =1 << ns->lba_shift; +u32 atomic_bs, phys_bs, io_opt;if (ns->lba_shift >PAGE_SHIFT ) {/* unsupported block size, set capacity to 0 later */
@@ -1639,9 +1640,37 @@ static void nvme_update_disk_info(struct gendisk *disk,blk_mq_freeze_queue (disk->queue);blk_integrity_unregister (disk); +if (id->nabo ==0 ) { +/* +* Bit 1 indicates whether NAWUPF is defined for this namespace +* and whether it should be used instead of AWUPF. If NAWUPF == +* 0 then AWUPF must be used instead. +*/ +if (id->nsfeat & (1 <<1 ) && id->nawupf) + atomic_bs = (1 +le16_to_cpu (id->nawupf)) * bs; +else + atomic_bs = (1 + ns->ctrl->subsys->awupf) * bs; + }else { + atomic_bs = bs; + } + phys_bs = bs; + io_opt = bs; +if (id->nsfeat & (1 <<4 )) { +/* NPWG = Namespace Preferred Write Granularity */ + phys_bs *=1 +le16_to_cpu (id->npwg); +/* NOWS = Namespace Optimal Write Size */ + io_opt *=1 +le16_to_cpu (id->nows); + } +blk_queue_logical_block_size (disk->queue, bs); -blk_queue_physical_block_size (disk->queue, bs); -blk_queue_io_min (disk->queue, bs); +/* +* Linux filesystems assume writing a single physical block is +* an atomic operation. Hence limit the physical block size to the +* value of the Atomic Write Unit Power Fail parameter. +*/ +blk_queue_physical_block_size (disk->queue,min (phys_bs, atomic_bs)); +blk_queue_io_min (disk->queue, phys_bs); +blk_queue_io_opt (disk->queue, io_opt);if (ns->ms && !ns->ext && (ns->ctrl->ops->flags &NVME_F_METADATA_SUPPORTED ))
@@ -2438,6 +2467,7 @@ static int nvme_init_subsystem(struct nvme_ctrl *ctrl, struct nvme_id_ctrl *id)memcpy (subsys->firmware_rev, id->fr,sizeof (subsys->firmware_rev)); subsys->vendor_id =le16_to_cpu (id->vid); subsys->cmic = id->cmic; + subsys->awupf =le16_to_cpu (id->awupf);#ifdef CONFIG_NVME_MULTIPATH subsys->iopolicy =NVME_IOPOLICY_NUMA ;#endif
drivers/nvme/host/nvme.h +1 -0
@@ -283,6 +283,7 @@ struct nvme_subsystem {char firmware_rev[8 ];u8 cmic;u16 vendor_id; +u16 awupf;/* 0's based awupf value. */ struct ida ns_ida;#ifdef CONFIG_NVME_MULTIPATH enum nvme_iopolicy iopolicy;
Signature · 1 line
2.22.0.410.gd8fdbe21b5-goog
PATCH v5 3/3 nvme: Set physical block size and optimal I/O size according to NVMe 1.4
Quoted 22 lines · Bart Van Assche
From the NVMe 1.4 spec:
NSFEAT bit 4 if set to 1: indicates that the fields NPWG, NPWA, NPDG, NPDA, and NOWS are defined for this namespace and should be used by the host for I/O optimization;
[ ... ]
Namespace Preferred Write Granularity (NPWG): This field indicates the smallest recommended write granularity in logical blocks for this namespace. This is a 0's based value. The size indicated should be less than or equal to Maximum Data Transfer Size (MDTS) that is specified in units of minimum memory page size. The value of this field may change if the namespace is reformatted. The size should be a multiple of Namespace Preferred Write Alignment (NPWA). Refer to section 8.25 for how this field is utilized to improve performance and endurance.
[ ... ]
Each Write, Write Uncorrectable, or Write Zeroes commands should address a multiple of Namespace Preferred Write Granularity (NPWG) (refer to Figure
245) and Stream Write Size (SWS) (refer to Figure 515) logical blocks (as expressed in the NLB field), and the SLBA field of the command should be aligned to Namespace Preferred Write Alignment (NPWA) (refer to Figure 245) for best performance.
Quoted 9 lines
Cc Keith Busch <kbusch at kernel.org>Cc Sagi Grimberg <sagi at grimberg.me>Cc Hannes Reinecke <hare at suse.com>Signed-off-by Bart Van Assche <bvanassche at acm.org>--- drivers/nvme/host/core.c | 34 ++++++++++++++++++++++++++++++++-- drivers/nvme/host/nvme.h | 1 + 2 files changed, 33 insertions(+), 2 deletions(-)
Cheers,
Hannes
Signature · 5 lines
Dr. Hannes Reinecke Teamlead Storage & Networking hare at suse.de +49 911 74053 688 SUSE LINUX GmbH, Maxfeldstr. 5, 90409 N?rnberg GF: Felix Imend?rffer, Mary Higgins, Sri Rasiah HRB 21284 (AG N?rnberg)
v5 cover NVMe 1.4 Identify Namespace Support
In reply to Bart Van AsscheThanks Bart,
applied to nvme-5.3.