RFC btrfs: new performance-based chunk allocation using device roles
Get series with b4
b4 am [email protected]Versions newest first
- v1 RFC Latest10 patches 14 repliesIn review
Patches in v1 No applies recorded yet
| # | Subject and files | Size | Replies | Applied |
|---|---|---|---|---|
| 1/10 | btrfs: fix thresh scope in should_alloc_chunk()fs/ | +4 | 0 replies | |
| 2/10 | btrfs: refactor should_alloc_chunk() arg typefs/ | +2 | 0 replies | |
| 3/10 | btrfs: introduce btrfs_split_sysfs_arg() for argument parsingfs/ | +24 | 0 replies | |
| 4/10 | btrfs: introduce device allocation methodfs/ fs/ | +19 | 0 replies | |
| 5/10 | btrfs: sysfs: show device allocation methodfs/ | +95 | 0 replies | |
| 6/10 | btrfs: skip device sorting when only one device is presentfs/ | +4 | 0 replies | |
| 7/10 | btrfs: refactor chunk allocation device handling to use list_headfs/ fs/ | +65 | 0 replies | |
| 8/10 | btrfs: introduce explicit device roles for block groupsfs/ fs/ | +41 | 0 replies | |
| 9/10 | btrfs: introduce ROLE_THEN_SPACE device allocation methodfs/ fs/ fs/ | +85 | 0 replies | |
| 10/10 | btrfs: pass device roles through device add ioctlfs/ fs/ fs/ | +29 | 0 replies |
Reviews trailers per patch
No Reviewed-by, Acked-by or Tested-by trailers for v1 yet.
Cover letter [PATCH RFC 00/10] btrfs: new performance-based chunk allocation using device roles
In host hardware, devices can have different speeds. Generally, faster devices come with lesser capacity while slower devices come with larger capacity. A typical configuration would expect that:
- A filesystem's read/write performance is evenly distributed on average across the entire filesystem. This is not achievable with the current allocation method because chunks are allocated based only on device free space.
- Typically, faster devices are assigned to metadata chunk allocations while slower devices are assigned to data chunk allocations.
Introducing Device Roles:
Here I define 5 device roles in a specific order for metadata and in the reverse order for data: metadata_only, metadata, none, data, data_only. One or more devices may have the same role.
The metadata and data roles indicate preference but not exclusivity for that role, whereas data_only and metadata_only are exclusive roles.
Introducing Role-then-Space allocation method:
Metadata allocation can happen on devices with the roles metadata_only, metadata, none, and data in that order. If multiple devices share a role, they are arranged based on device free space.
Similarly, data allocation can happen on devices with the roles data_only, data, none, and metadata in that order. If multiple devices share a role, they are arranged based on device free space.
Finding device speed automatically:
Measuring device read/write latency for the allocaiton is not good idea, as the historical readings and may be misleading, as they could include iostat data from periods with issues that have since been fixed. Testing to determine relative latency and arranging in ascending order for metadata and descending for data is possible, but is better handled by an external tool that can still set device roles.
On-Disk Format changes:
The following items are defined but are unused on-disk format:
btrfs_dev_item:: __le64 type; // unused __le64 start_offset; // unused __le32 dev_group; // unused __u8 seek_speed; // unused __u8 bandwidth; // unused
The device roles is using the dev_item::type 8-bit field to store each device's role.
Anand Jain (10):
btrfs: fix thresh scope in should_alloc_chunk()
btrfs: refactor should_alloc_chunk() arg type
btrfs: introduce btrfs_split_sysfs_arg() for argument parsing
btrfs: introduce device allocation method
btrfs: sysfs: show device allocation method
btrfs: skip device sorting when only one device is present
btrfs: refactor chunk allocation device handling to use list_head
btrfs: introduce explicit device roles for block groups
btrfs: introduce ROLE_THEN_SPACE device allocation method
btrfs: pass device roles through device add ioctl
fs/btrfs/block-group.c | 11 +- fs/btrfs/ioctl.c | 12 +- fs/btrfs/sysfs.c | 130 ++++++++++++++++++++-- fs/btrfs/volumes.c | 242 +++++++++++++++++++++++++++++++++-------- fs/btrfs/volumes.h | 35 +++++- 5 files changed, 366 insertions(+), 64 deletions(-)
Signature · 1 line
2.49.0