brd: implement discard support
Subsystems (2)
PATCH 1/1 brd: implement discard support
From: Keith Busch <[email protected]>
The ramdisk memory utilization can only go up when data is written to new pages. Implement discard to provide the possibility to reduce memory usage for pages no longer in use. Aligned discards will free the associated pages, if any, and determinisitically return zeroed data until written again.
--- drivers/block/brd.c | 26 ++++++++++++++++++++++++++ 1 file changed, 26 insertions(+)
drivers/block/brd.c +26 -0
@@ -240,6 +240,23 @@ static int brd_do_bvec(struct brd_device *brd, struct page *page,return err; } +static void brd_do_discard (struct brd_device *brd,sector_t sector,u32 size) +{ +sector_t aligned_sector = (sector +PAGE_SECTORS ) & ~PAGE_SECTORS ; +struct page *page; + + size -= (aligned_sector - sector) *SECTOR_SIZE ; +xa_lock (&brd->brd_pages); +while (size >=PAGE_SIZE && aligned_sector < rd_size *2 ) { + page =__xa_erase (&brd->brd_pages, aligned_sector >>PAGE_SECTORS_SHIFT ); +if (page) +__free_page (page); + aligned_sector +=PAGE_SECTORS ; + size -=PAGE_SIZE ; + } +xa_unlock (&brd->brd_pages); +} +static void brd_submit_bio (struct bio *bio) {struct brd_device *brd = bio->bi_bdev->bd_disk->private_data;
@@ -247,6 +264,12 @@ static void brd_submit_bio(struct bio *bio)struct bio_vec bvec;struct bvec_iter iter; +if (unlikely (op_is_discard (bio->bi_opf))) { +brd_do_discard (brd, sector, bio->bi_iter.bi_size); +bio_endio (bio); +return ; + } +bio_for_each_segment (bvec, bio, iter) {unsigned int len = bvec.bv_len;int err;
@@ -327,6 +350,9 @@ static int brd_alloc(int i)* is harmless) */ .physical_block_size = PAGE_SIZE, + .max_hw_discard_sectors = UINT_MAX, + .max_discard_segments = 1, + .discard_granularity = PAGE_SIZE, };list_for_each_entry (brd, &brd_devices, brd_list)
Signature · 1 line
2.43.0
Quoted 20 lines · Keith Busch
From: Keith Busch <[email protected]>
The ramdisk memory utilization can only go up when data is written to new pages. Implement discard to provide the possibility to reduce memory usage for pages no longer in use. Aligned discards will free the associated pages, if any, and determinisitically return zeroed data until written again.
Signed-off-by Keith Busch <[email protected]>--- drivers/block/brd.c | 26 ++++++++++++++++++++++++++ 1 file changed, 26 insertions(+)drivers/block/brd.c +0
-0@@ -240,6 +240,23 @@ static int brd_do_bvec(struct brd_device *brd, struct page *page,return err; }
drivers/block/brd.c static int brd_do_bvec(struct brd_device *brd, struct page *page, · line 251
Quoted 10 lines
drivers/block/brd.c +9
-0+static void brd_do_discard (struct brd_device *brd,sector_t sector,u32 size) +{ +sector_t aligned_sector = (sector +PAGE_SECTORS ) & ~PAGE_SECTORS ; +struct page *page; + + size -= (aligned_sector - sector) *SECTOR_SIZE ; +xa_lock (&brd->brd_pages); +while (size >=PAGE_SIZE && aligned_sector < rd_size *2 ) { + page =__xa_erase (&brd->brd_pages, aligned_sector >>PAGE_SECTORS_SHIFT );
overly long line ?
Quoted 12 lines
drivers/block/brd.c +8
-0+if (page) +__free_page (page); + aligned_sector +=PAGE_SECTORS ; + size -=PAGE_SIZE ; + } +xa_unlock (&brd->brd_pages); +} +static void brd_submit_bio (struct bio *bio) {struct brd_device *brd = bio->bi_bdev->bd_disk->private_data;
drivers/block/brd.c static void brd_submit_bio(struct bio *bio) · line 267
Quoted 4 lines
drivers/block/brd.c +1
-0@@ -247,6 +264,12 @@ static void brd_submit_bio(struct bio *bio)struct bio_vec bvec;struct bvec_iter iter; +if (unlikely (op_is_discard (bio->bi_opf))) {
I've been told that unlikely should not be used with discard as it is bad for discard workloads, if that is still true, then can you please remove unlikely ?
Also, if you are doing this can you please also add support for write-zeroes for the sake of completeness ? unless that support is not desired for brd ...
-ck
Quoted 8 lines · Chaitanya Kulkarni
Quoted 7 lines · Keith Busch
static void brd_submit_bio(struct bio *bio) { struct brd_device *brd = bio->bi_bdev->bd_disk->private_data;drivers/block/brd.c +0
-0@@ -247,6 +264,12 @@ static void brd_submit_bio(struct bio *bio)struct bio_vec bvec;struct bvec_iter iter;
Quoted 5 lines
drivers/block/brd.c static void brd_submit_bio(struct bio *bio) · line 267
Quoted 1 line
drivers/block/brd.c +1
-0+if (unlikely (op_is_discard (bio->bi_opf))) {I've been told that unlikely should not be used with discard as it is bad for discard workloads, if that is still true, then can you please remove unlikely ?
I don't think discard workloads are likely on a ramdisk.
Quoted 3 lines
Also, if you are doing this can you please also add support for write-zeroes for the sake of completeness ? unless that support is not desired for brd ...
That is orthoganal to the goals here. I just need to temporarily reclaim memory for other purposes when the disk is temporarily not being use; I don't care about the zero'ing out part.
I found that previous attempts at supporting discard on brd didn't make it, supposedly because of some kind of writeback deadlock. I have no idea what that comment way back from 2.6.35 is referring to though: we allocate pages with NOIO or NOWAIT, so either brd can get a new page when its needed or it fails, and either is fine, but deadlock shouldn't happen.
Quoted 8 lines · Keith Busch
The ramdisk memory utilization can only go up when data is written to new pages. Implement discard to provide the possibility to reduce memory usage for pages no longer in use. Aligned discards will free the associated pages, if any, and determinisitically return zeroed data until written again.
[...]
Applied, thanks!
[1/1] brd: implement discard support
commit: 9ead7efc6f3f2b46c4ec68209bca4888cfbd4c19
Best regards,
Signature · 1 line
Jens Axboe