dm raid: fix stripe adding reshape size issues
cover dm raid: fix stripe adding reshape size issues
From: Heinz Mauelshagen <[email protected]>
Adding stripes to an existing RAID mapped device fails to set the grown capacity properly. The 2 patches move a needed function and add fix the sizing logic. See patch 2 header for issue details.
Heinz Mauelshagen (2):
dm raid: move _get_reshape_sectors() as prerequisite to fixing reshape size issues dm raid: fix stripes adding reshape size issues
drivers/md/dm-raid.c | 54 ++++++++++++++++++++++++++++---------------- 1 file changed, 34 insertions(+), 20 deletions(-)
Signature · 1 line
2.45.2
PATCH 1/2 dm raid: move _get_reshape_sectors() as prerequisite to fixing reshape size issues
From: Heinz Mauelshagen <[email protected]>
rs_set_dev_and_array_sectors() needs this function to calculate device and array size properly in case leg data devices have out-of-place reshape space allocated.
--- drivers/md/dm-raid.c | 34 +++++++++++++++++----------------- 1 file changed, 17 insertions(+), 17 deletions(-)
drivers/md/dm-raid.c +17 -17
@@ -1626,6 +1626,23 @@ static int _check_data_dev_sectors(struct raid_set *rs)return 0 ; } +/* Get reshape sectors from data_offsets or raid set */ +static sector_t _get_reshape_sectors (struct raid_set *rs) +{ +struct md_rdev *rdev; +sector_t reshape_sectors =0 ; + +rdev_for_each (rdev, &rs->md) +if (!test_bit (Journal, &rdev->flags)) { + reshape_sectors = (rdev->data_offset > rdev->new_data_offset) ? + rdev->data_offset - rdev->new_data_offset : + rdev->new_data_offset - rdev->data_offset; +break ; + } + +return max (reshape_sectors, (sector_t ) rs->data_offset); +} +/* Calculate the sectors per device and per array used for @rs */ static int rs_set_dev_and_array_sectors (struct raid_set *rs,sector_t sectors,bool use_mddev) {
@@ -2811,23 +2828,6 @@ static int rs_prepare_reshape(struct raid_set *rs)return 0 ; } -/* Get reshape sectors from data_offsets or raid set */ -static sector_t _get_reshape_sectors (struct raid_set *rs) -{ -struct md_rdev *rdev; -sector_t reshape_sectors =0 ; - -rdev_for_each (rdev, &rs->md) -if (!test_bit (Journal, &rdev->flags)) { - reshape_sectors = (rdev->data_offset > rdev->new_data_offset) ? - rdev->data_offset - rdev->new_data_offset : - rdev->new_data_offset - rdev->data_offset; -break ; - } - -return max (reshape_sectors, (sector_t ) rs->data_offset); -} -/* * Reshape: * - change raid layout
Signature · 1 line
2.45.2
PATCH 2/2 dm raid: fix stripes adding reshape size issues
In reply to [email protected]From: Heinz Mauelshagen <[email protected]>
Adding stripes to an existing raid4/5/6/10 mapped device grows its capacity though it'll be only made available _after_ the respective reshape finished as of MD kernel reshape semantics. Such reshaping involves moving a window forward starting at BOD reading content from previous lesser stripes and writing them back in the new layout with more stripes. Once that process finishes at end of previous data, the grown size may be announced and used. In order to avoid writing over any existing data in place, out-of-place space is added to the beginning of each data device by lvm2 before starting the reshape process. That reshape space wasn't taken into acount for data device size calculation.
Fixes resulting from above:
- correct event handling conditions in do_table_event() to set the device's capacity after the stripe adding reshape ended
- subtract mentioned out-of-place space doing data device and array size calculations
- conditionally set capacity as of superblock in preresume
Testing:
- passes all LVM2 RAID tests including new lvconvert-raid-reshape-size.sh one
--- drivers/md/dm-raid.c | 20 +++++++++++++++++--- 1 file changed, 17 insertions(+), 3 deletions(-)
drivers/md/dm-raid.c +17 -3
@@ -1673,7 +1673,7 @@ static int rs_set_dev_and_array_sectors(struct raid_set *rs, sector_t sectors, bif (sector_div (dev_sectors, data_stripes)) goto bad; - array_sectors = (data_stripes + delta_disks) * dev_sectors; + array_sectors = (data_stripes + delta_disks) * (dev_sectors -_get_reshape_sectors (rs));if (sector_div (array_sectors, rs->raid10_copies)) goto bad;
@@ -1682,7 +1682,7 @@ static int rs_set_dev_and_array_sectors(struct raid_set *rs, sector_t sectors, belse /* Striped layouts */ - array_sectors = (data_stripes + delta_disks) * dev_sectors; + array_sectors = (data_stripes + delta_disks) * (dev_sectors -_get_reshape_sectors (rs)); mddev->array_sectors = array_sectors; mddev->dev_sectors = dev_sectors;
@@ -1721,11 +1721,20 @@ static void do_table_event(struct work_struct *ws) struct raid_set *rs = container_of(ws, struct raid_set, md.event_work);smp_rmb ();/* Make sure we access most actual mddev properties */ -if (!rs_is_reshaping (rs)) { + +/* Only grow size resulting from added stripe(s) after reshape ended. */ +if (!rs_is_reshaping (rs) && + rs->array_sectors > rs->md.array_sectors && + !rs->md.delta_disks && + rs->md.raid_disks == rs->raid_disks) { +/* The raid10 personality doesn't provide proper device sizes -> correct. */ if (rs_is_raid10 (rs))rs_set_rdev_sectors (rs); + + rs->md.array_sectors = rs->array_sectors;rs_set_capacity (rs); } +dm_table_event (rs->ti->table); }
@@ -4023,6 +4032,11 @@ static int raid_preresume(struct dm_target *ti)if (test_and_set_bit (RT_FLAG_RS_PRERESUMED , &rs->runtime_flags))return 0 ; +/* If different and no explicit grow request, expose MD array size as of superblock. */ +if (!test_bit (RT_FLAG_RS_GROW , &rs->runtime_flags) && + rs->array_sectors != mddev->array_sectors) +rs_set_capacity (rs); +/* * The superblocks need to be updated on disk if the * array is new or new devices got added (thus zeroed
Signature · 1 line
2.45.2