nvme: implement the DEAC bit for the Write Zeroes command
Christoph Hellwig
maintainerPATCH 1/1 nvme: implement the DEAC bit for the Write Zeroes command
While the specification allows devices to either deallocate data or to actually write zeroes on any Write Zeroes command, many SSDs only do the sensible thing and deallocate data when the DEAC bit is specific. Set it when it is suppored and the caller doesn't explicitly opt out of deallocation.
---
BTW, I'm tempted to slap a
onto this. While it doesn't fix the Write Zeroes support per se, it should help us with a lot of the devices timing out on Write Zeroes.
drivers/nvme/host/core.c | 6 +++++- drivers/nvme/host/nvme.h | 1 + include/linux/nvme.h | 1 + 3 files changed, 7 insertions(+), 1 deletion(-)
drivers/nvme/host/core.c +5 -1
@@ -850,8 +850,11 @@ static inline blk_status_t nvme_setup_write_zeroes(struct nvme_ns *ns, cmnd->write_zeroes.length =cpu_to_le16 ((blk_rq_bytes (req) >> ns->lba_shift) -1 ); +if (!(req->cmd_flags &REQ_NOUNMAP ) && ns->dlfeat & (1 <<3 )) + cmnd->write_zeroes.control |=cpu_to_le16 (NVME_WZ_DEAC ); +if (nvme_ns_has_pi (ns)) { - cmnd->write_zeroes.control =cpu_to_le16 (NVME_RW_PRINFO_PRACT ); + cmnd->write_zeroes.control |=cpu_to_le16 (NVME_RW_PRINFO_PRACT );switch (ns->pi_type) {case NVME_NS_DPS_PI_TYPE1 :
@@ -2004,6 +2007,7 @@ static int nvme_update_ns_info_block(struct nvme_ns *ns, } } + ns->dlfeat = id->dlfeat;set_disk_ro (ns->disk,nvme_ns_is_readonly (ns, info));set_bit (NVME_NS_READY , &ns->flags);blk_mq_unfreeze_queue (ns->disk->queue);
drivers/nvme/host/nvme.h +1 -0
@@ -477,6 +477,7 @@ struct nvme_ns {u32 sws;u8 pi_type;u8 guard_type; +u8 dlfeat;#ifdef CONFIG_BLK_DEV_ZONED u64 zsze;#endif
include/linux/nvme.h +1 -0
@@ -963,6 +963,7 @@ enum {NVME_RW_PRINFO_PRCHK_GUARD =1 <<12 ,NVME_RW_PRINFO_PRACT =1 <<13 ,NVME_RW_DTYPE_STREAMS =1 <<4 , + NVME_WZ_DEAC = 1 << 9, }; struct nvme_dsm_cmd {
Signature · 1 line
2.30.2
Quoted 26 lines · Christoph Hellwig
While the specification allows devices to either deallocate data or to actually write zeroes on any Write Zeroes command, many SSDs only do the sensible thing and deallocate data when the DEAC bit is specific. Set it when it is suppored and the caller doesn't explicitly opt out of deallocation.
Signed-off-by Christoph Hellwig <[email protected]>---
BTW, I'm tempted to slap a
Fixes 6e02318eaea5 ("nvme: add support for the Write Zeroes command")onto this. While it doesn't fix the Write Zeroes support per se, it should help us with a lot of the devices timing out on Write Zeroes.
drivers/nvme/host/core.c | 6 +++++- drivers/nvme/host/nvme.h | 1 + include/linux/nvme.h | 1 + 3 files changed, 7 insertions(+), 1 deletion(-)drivers/nvme/host/core.c +0
-0
drivers/nvme/host/core.c static inline blk_status_t nvme_setup_write_zeroes(struct nvme_ns *ns, · line 853
Quoted 4 lines
drivers/nvme/host/core.c +1
-0@@ -850,8 +850,11 @@ static inline blk_status_t nvme_setup_write_zeroes(struct nvme_ns *ns, cmnd->write_zeroes.length =cpu_to_le16 ((blk_rq_bytes (req) >> ns->lba_shift) -1 ); +if (!(req->cmd_flags &REQ_NOUNMAP ) && ns->dlfeat & (1 <<3 ))
Maybe we can add a series of macros to make the code easier to read.
Best regards,
Guixin Liu
Quoted 40 lines
drivers/nvme/host/core.c +4
-1+ cmnd->write_zeroes.control |=cpu_to_le16 (NVME_WZ_DEAC ); +if (nvme_ns_has_pi (ns)) { - cmnd->write_zeroes.control =cpu_to_le16 (NVME_RW_PRINFO_PRACT ); + cmnd->write_zeroes.control |=cpu_to_le16 (NVME_RW_PRINFO_PRACT );switch (ns->pi_type) {case NVME_NS_DPS_PI_TYPE1 :@@ -2004,6 +2007,7 @@ static int nvme_update_ns_info_block(struct nvme_ns *ns, } } + ns->dlfeat = id->dlfeat;set_disk_ro (ns->disk,nvme_ns_is_readonly (ns, info));set_bit (NVME_NS_READY , &ns->flags);blk_mq_unfreeze_queue (ns->disk->queue);drivers/nvme/host/nvme.h +1
-0@@ -477,6 +477,7 @@ struct nvme_ns {u32 sws;u8 pi_type;u8 guard_type; +u8 dlfeat;#ifdef CONFIG_BLK_DEV_ZONED u64 zsze;#endif include/linux/nvme.h +1
-0@@ -963,6 +963,7 @@ enum {NVME_RW_PRINFO_PRCHK_GUARD =1 <<12 ,NVME_RW_PRINFO_PRACT =1 <<13 ,NVME_RW_DTYPE_STREAMS =1 <<4 , + NVME_WZ_DEAC = 1 << 9, }; struct nvme_dsm_cmd {
Quoted 7 lines · Christoph Hellwig
While the specification allows devices to either deallocate data or to actually write zeroes on any Write Zeroes command, many SSDs only do the sensible thing and deallocate data when the DEAC bit is specific. Set it when it is suppored and the caller doesn't explicitly opt out of deallocation.
Signed-off-by Christoph Hellwig <[email protected]>
Looks good,
Hi Christoph!
drivers/nvme/host/core.c static inline blk_status_t nvme_setup_write_zeroes(struct nvme_ns *ns, · line 854
Quoted 2 lines
drivers/nvme/host/core.c +2
-0+if (!(req->cmd_flags &REQ_NOUNMAP ) && ns->dlfeat & (1 <<3 )) + cmnd->write_zeroes.control |=cpu_to_le16 (NVME_WZ_DEAC );
Shouldn't we also verify that DLFEAT bits 2:0 are equal to 1 to ensure that deallocated blocks actually return zeroes?
Looks good otherwise.
Signature · 1 line
Martin K. Petersen Oracle Linux Engineering
Keith Busch
maintainerQuoted 8 lines · Martin K. Petersen
Hi Christoph!
drivers/nvme/host/core.c static inline blk_status_t nvme_setup_write_zeroes(struct nvme_ns *ns, · line 854
Quoted 2 lines
drivers/nvme/host/core.c +2
-0+if (!(req->cmd_flags &REQ_NOUNMAP ) && ns->dlfeat & (1 <<3 )) + cmnd->write_zeroes.control |=cpu_to_le16 (NVME_WZ_DEAC );Shouldn't we also verify that DLFEAT bits 2:0 are equal to 1 to ensure that deallocated blocks actually return zeroes?
The device must return all 0's for the range covered by a write zeroes command no matter what. The controller shall not deallocate the logical blocks if it can't guarantee reading deallocated blocks will return 0's, so I think it's okay to skip checking the lower dlfeat bits.
Minor nit on the patch: I think seeing the dlfeat value as an enum would help.
Keith,
Quoted 5 lines
The device must return all 0's for the range covered by a write zeroes command no matter what. The controller shall not deallocate the logical blocks if it can't guarantee reading deallocated blocks will return 0's, so I think it's okay to skip checking the lower dlfeat bits.
The spec is sufficiently vague for the does-not-return-zeroes case that I'm concerned about "shall not deallocate" being interpreted by vendors as "free to ignore" based on past ATA/SCSI experience.
But we can always quirk it. Devices that return all-Fs are rare.
Signature · 1 line
Martin K. Petersen Oracle Linux Engineering
Christoph Hellwig
maintainerQuoted 9 lines · Martin K. Petersen
Keith,
Quoted 5 lines
The device must return all 0's for the range covered by a write zeroes command no matter what. The controller shall not deallocate the logical blocks if it can't guarantee reading deallocated blocks will return 0's, so I think it's okay to skip checking the lower dlfeat bits.
Quoted 3 lines
The spec is sufficiently vague for the does-not-return-zeroes case that I'm concerned about "shall not deallocate" being interpreted by vendors as "free to ignore" based on past ATA/SCSI experience.
I think SCSI actually has the same semantics as NVMe here. WRITE SAME must always ensure reads return the data written using it, just like for Write Zeros in NVMe except that NVMe forces the 0s while SCSI is more flexible. UNMAP in SCSI and DSM Deallocate in NVMe can also return other values depending on the conditions.
Christoph,
Quoted 2 lines
I think SCSI actually has the same semantics as NVMe here. WRITE SAME must always ensure reads return the data written using it,
Yep, but many device vendors messed that up due to the initial ambiguity in the spec wrt. how to handle the UNMAP flag. Based on experience with the SCSI UNMAP command being able to ignore blocks and ATA DSM TRIM being non-deterministic, several vendors ended up not treating WRITE SAME with the UNMAP flag set as a data integrity operation.
I was just concerned that this practice would carry over to NVMe. Bits 2:0 being set to 1 is an indication that somebody at least thought about this scenario during device implementation. But again, devices that return non-zero blocks after deallocate are rare and we can always quirk them if there's a problem.
Anyway. Not a big issue as far as I'm concerned. Just tainted by the twisted heuristics I had to deal with in SCSI...
Signature · 1 line
Martin K. Petersen Oracle Linux Engineering
Christoph Hellwig
maintainerQuoted 5 lines · Martin K. Petersen
Yep, but many device vendors messed that up due to the initial ambiguity in the spec wrt. how to handle the UNMAP flag. Based on experience with the SCSI UNMAP command being able to ignore blocks and ATA DSM TRIM being non-deterministic, several vendors ended up not treating WRITE SAME with the UNMAP flag set as a data integrity operation.
Uh.
Quoted 5 lines
I was just concerned that this practice would carry over to NVMe. Bits 2:0 being set to 1 is an indication that somebody at least thought about this scenario during device implementation. But again, devices that return non-zero blocks after deallocate are rare and we can always quirk them if there's a problem.
I'm fine with adding the dlfeat check - it is trivial and if the bits aren't set, sending the DEAC bit would be pointless anyway. It'll just make the people asking for names for the unnamed bits even more unhappy..
Christoph Hellwig
maintainerQuoted 2 lines · Keith Busch
Minor nit on the patch: I think seeing the dlfeat value as an enum would help.
The issue here is that the bit doesn't have a name in the NVMe spec, so making up one would be a bit odd. But Mike is set out to eventually name all the bits, and if that happens I'd be glad to add a name.
That's also an argument against the check if the lower flfeat bits that Martin suggested, which shouldn't be needed but is otherwise
harmless: due to the lack of naming in dlfeat it would be really hard to read..
Quoted 4 lines · Christoph Hellwig
While the specification allows devices to either deallocate data or to actually write zeroes on any Write Zeroes command, many SSDs only do the sensible thing and deallocate data when the DEAC bit is specific. Set it when it is suppored and the caller doesn't
Nit: supported
Quoted 4 lines
explicitly opt out of deallocation.
Signed-off-by Christoph Hellwig <[email protected]>---
Quoted 4 lines · Christoph Hellwig
While the specification allows devices to either deallocate data or to actually write zeroes on any Write Zeroes command, many SSDs only do the sensible thing and deallocate data when the DEAC bit is specific. Set it when it is suppored and the caller doesn't
's/suppored/supported'
Quoted 12 lines
explicitly opt out of deallocation.
Signed-off-by Christoph Hellwig <[email protected]>---
BTW, I'm tempted to slap a
Fixes 6e02318eaea5 ("nvme: add support for the Write Zeroes command")onto this. While it doesn't fix the Write Zeroes support per se, it should help us with a lot of the devices timing out on Write Zeroes.
Indeed it doesn't fix 6e02318eaea5 but I think with appropriate description it should help.
-ck