btrfs/282: use timed writes to make sure scrub has enough run time
PATCH v2 1/1 btrfs/282: use timed writes to make sure scrub has enough run time
[FAILURE]
Test case btrfs/282 still fails on some setup:
output mismatch (see /opt/xfstests/results//btrfs/282.out.bad)
--- tests/btrfs/282.out 2025-06-27 22:00:35.000000000 +0200
+++ /opt/xfstests/results//btrfs/282.out.bad 2025-07-08 20:40:50.042410321 +0200
@@ -1,3 +1,4 @@
QA output created by 282
wrote 2147483648/2147483648 bytes at offset 0
XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec)
+scrub speed 2152038400 Bytes/s is not properly throttled, target is 1076019200 Bytes/s
...
(Run diff -u /opt/xfstests/tests/btrfs/282.out /opt/xfstests/results//btrfs/282.out.bad to see the entire diff)[CAUSE]
Checking the full output, it shows the scrub is running too fast:
Starting scrub on devid 1
scrub done for c45c8821-4e55-4d29-8172-f1bf30b7182c
Scrub started: Tue Jul 8 20:40:47 2025 Status: finished Duration: 0:00:00 <<< Total to scrub: 2.00GiB Rate: 2.00GiB/s Error summary: no errors found Starting scrub on devid 1 scrub done for c45c8821-4e55-4d29-8172-f1bf30b7182c Scrub started: Tue Jul 8 20:40:48 2025 Status: finished Duration: 0:00:01 Total to scrub: 2.00GiB Rate: 2.00GiB/s Error summary: no errors found
The original run takes less than 1 seconds, making the scrub rate calculation very unreliable, no wonder the speed limit is not able to properly work.
[FIX]
Instead of using fixed 2GiB file size, let the test create a filler for 4 seconds with direct IO, this would more or less ensure the scrub will take 4 seconds to run.
With 4 seconds as run time, the scrub rate can be calculated more or less reliably.
Furthermore since btrfs-progs currently only reports scrub duration in seconds, to prevent problems due to 1 second difference, enlarge the tolerance to +/- 25%, to be extra safe.
On my testing VM, the result looks like this:
Starting scrub on devid 1
scrub done for b542bdfb-7be4-44b3-add0-ad3621927e2b
Scrub started: Fri Jul 11 09:13:31 2025 Status: finished Duration: 0:00:04 Total to scrub: 2.72GiB Rate: 696.62MiB/s Error summary: no errors found Starting scrub on devid 1 scrub done for b542bdfb-7be4-44b3-add0-ad3621927e2b Scrub started: Fri Jul 11 09:13:35 2025 Status: finished Duration: 0:00:08 Total to scrub: 2.72GiB Rate: 348.31MiB/s Error summary: no errors found
However this exposed a new failure mode, that if the storage is too fast, like the original report, that the initial 4 seconds write can fill the fs and exit early.
In that case we have no other solution but skipping the test case.
---
Changelog:
v2:
- Fix several typos
- Fix a copy-n-paste error in the cleanup function
- Unset the pid after the timed write is finished
- Remove an unnecessary sync after deleting the original filler
- Add the requirement for data checksum
--- tests/btrfs/282 | 60 +++++++++++++++++++++++++++++++++++++++------ tests/btrfs/282.out | 3 +-- 2 files changed, 53 insertions(+), 10 deletions(-)
tests/btrfs/282 +52 -8
@@ -9,13 +9,25 @@ . ./common/preamble _begin_fstest auto scrub +_cleanup() +{ + [ -n "$filler_pid" ] && kill "$filler_pid" &> /dev/null + wait +} + . ./common/filter _wants_kernel_commit eb3b50536642 \ "btrfs: scrub: per-device bandwidth control" -# We want at least 5G for the scratch device. -_require_scratch_size $(( 5 * 1024 * 1024)) +# For direct IO without falling back to buffered IO. +_require_odirect +_require_chattr C +# For data checksum verification during scrub +_require_btrfs_no_nodatasum + +# We want at least 10G for the scratch device. +_require_scratch_size $(( 10 * 1024 * 1024)) # Make sure we can create scrub progress data file if [ -e /var/lib/btrfs ]; then
@@ -36,9 +48,38 @@ if [ ! -f "${devinfo_dir}/scrub_speed_max" ]; then _notrun "No sysfs interface for scrub speed throttle" fi -# Create a 2G file for later scrub workload. -# The 2G size is chosen to fit even DUP on a 5G disk. -$XFS_IO_PROG -f -c "pwrite -i /dev/urandom 0 2G" $SCRATCH_MNT/file | _filter_xfs_io +# Create a NOCOW file and do direct IO for 4 seconds to measure the performance. +# +# The only way to reach real disk performance is direct IO without falling back +# to buffered IO, thus requiring NOCOW. +touch $SCRATCH_MNT/filler +chattr +C $SCRATCH_MNT/filler +$XFS_IO_PROG -d -c "pwrite -b 128K 0 1E" "$SCRATCH_MNT/filler" >> $seqres.full 2>&1 & +filler_pid=$! +sleep 4 +kill $filler_pid +wait +unset filler_pid + +# Make sure we still have some space left, if we hit ENOSPC, this means the +# storage is too fast and the filler didn't reach full 4 seconds write before +# hitting ENOSPC. In that case we have no reliable way to calculate scrub speed +# but skip the run. +_pwrite_byte 0x00 0 1M $SCRATCH_MNT/foobar >> $seqres.full 2>&1 +if [ $? -ne 0 ]; then + _notrun "Storage too fast, unreliable scrub speed" +fi + +# But above NOCOW file has no csum, thus it won't really cause much +# verification workload. Use the filesize of above run to re-create a file with data +# checksums. +size=$(_get_filesize $SCRATCH_MNT/filler) +rm $SCRATCH_MNT/filler + +# Recreate one with checksums. +touch $SCRATCH_MNT/filler +chattr -C $SCRATCH_MNT/filler +$XFS_IO_PROG -c "pwrite -i /dev/urandom 0 $size" $SCRATCH_MNT/filler >> $seqres.full # Writeback above data, as scrub only verify the committed data. sync
@@ -77,12 +118,15 @@ $BTRFS_UTIL_PROG scrub start -B $SCRATCH_MNT >> $seqres.full speed=$($BTRFS_UTIL_PROG scrub status --raw $SCRATCH_MNT | grep "Rate:" |\ $AWK_PROG '{print $2}' | cut -f1 -d\/) -# We gave a +- 10% tolerance for the throttle -if [ "$speed" -gt "$(( $target_speed * 11 / 10 ))" -o \ - "$speed" -lt "$(( $target_speed * 9 / 10))" ]; then +# The expected runtime should be 4 and 8 seconds, and since the runtime +# accuracy is only 1 second, give it a +/- 25% tolerance +if [ "$speed" -gt "$(( $target_speed * 5 / 4 ))" -o \ + "$speed" -lt "$(( $target_speed * 3 / 4 ))" ]; then echo "scrub speed $speed Bytes/s is not properly throttled, target is $target_speed Bytes/s" fi +echo "Silence is golden" + # success, all done status=0 exit
tests/btrfs/282.out +1 -2
@@ -1,3 +1,2 @@ QA output created by 282 -wrote 2147483648/2147483648 bytes at offset 0 -XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +Silence is golden
Signature · 1 line
2.50.0
Quoted 70 lines · Qu Wenruo
[FAILURE]
Test case btrfs/282 still fails on some setup:output mismatch (see /opt/xfstests/results//btrfs/282.out.bad) --- tests/btrfs/282.out 2025-06-27 22:00:35.000000000 +0200 +++ /opt/xfstests/results//btrfs/282.out.bad 2025-07-08 20:40:50.042410321 +0200 @@ -1,3 +1,4 @@ QA output created by 282 wrote 2147483648/2147483648 bytes at offset 0 XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +scrub speed 2152038400 Bytes/s is not properly throttled, target is 1076019200 Bytes/s ... (Run diff -u /opt/xfstests/tests/btrfs/282.out /opt/xfstests/results//btrfs/282.out.bad to see the entire diff)[CAUSE]
Checking the full output, it shows the scrub is running too fast:Starting scrub on devid 1
scrub done for c45c8821-4e55-4d29-8172-f1bf30b7182cScrub started: Tue Jul 8 20:40:47 2025 Status: finished Duration: 0:00:00 <<< Total to scrub: 2.00GiB Rate: 2.00GiB/s Error summary: no errors found Starting scrub on devid 1 scrub done for c45c8821-4e55-4d29-8172-f1bf30b7182c Scrub started: Tue Jul 8 20:40:48 2025 Status: finished Duration: 0:00:01 Total to scrub: 2.00GiB Rate: 2.00GiB/s Error summary: no errors foundThe original run takes less than 1 seconds, making the scrub rate calculation very unreliable, no wonder the speed limit is not able to properly work.
[FIX]
Instead of using fixed 2GiB file size, let the test create a filler for 4 seconds with direct IO, this would more or less ensure the scrub will take 4 seconds to run.With 4 seconds as run time, the scrub rate can be calculated more or less reliably.
Furthermore since btrfs-progs currently only reports scrub duration in seconds, to prevent problems due to 1 second difference, enlarge the tolerance to +/- 25%, to be extra safe.
On my testing VM, the result looks like this:
Starting scrub on devid 1
scrub done for b542bdfb-7be4-44b3-add0-ad3621927e2bScrub started: Fri Jul 11 09:13:31 2025 Status: finished Duration: 0:00:04 Total to scrub: 2.72GiB Rate: 696.62MiB/s Error summary: no errors found Starting scrub on devid 1 scrub done for b542bdfb-7be4-44b3-add0-ad3621927e2b Scrub started: Fri Jul 11 09:13:35 2025 Status: finished Duration: 0:00:08 Total to scrub: 2.72GiB Rate: 348.31MiB/s Error summary: no errors found
Quoted 7 lines
However this exposed a new failure mode, that if the storage is too fast, like the original report, that the initial 4 seconds write can fill the fs and exit early.
In that case we have no other solution but skipping the test case.
Signed-off-by Qu Wenruo <[email protected]>
Looks good, thanks.
Quoted 119 lines
---
Changelog:
v2:
- Fix several typos
- Fix a copy-n-paste error in the cleanup function
- Unset the pid after the timed write is finished
- Remove an unnecessary sync after deleting the original filler
- Add the requirement for data checksum--- tests/btrfs/282 | 60 +++++++++++++++++++++++++++++++++++++++------ tests/btrfs/282.out | 3 +-- 2 files changed, 53 insertions(+), 10 deletions(-)tests/btrfs/282 +52
-8@@ -9,13 +9,25 @@ . ./common/preamble _begin_fstest auto scrub +_cleanup() +{ + [ -n "$filler_pid" ] && kill "$filler_pid" &> /dev/null + wait +} + . ./common/filter _wants_kernel_commit eb3b50536642 \ "btrfs: scrub: per-device bandwidth control" -# We want at least 5G for the scratch device. -_require_scratch_size $(( 5 * 1024 * 1024)) +# For direct IO without falling back to buffered IO. +_require_odirect +_require_chattr C +# For data checksum verification during scrub +_require_btrfs_no_nodatasum + +# We want at least 10G for the scratch device. +_require_scratch_size $(( 10 * 1024 * 1024)) # Make sure we can create scrub progress data file if [ -e /var/lib/btrfs ]; then@@ -36,9 +48,38 @@ if [ ! -f "${devinfo_dir}/scrub_speed_max" ]; then _notrun "No sysfs interface for scrub speed throttle" fi -# Create a 2G file for later scrub workload. -# The 2G size is chosen to fit even DUP on a 5G disk. -$XFS_IO_PROG -f -c "pwrite -i /dev/urandom 0 2G" $SCRATCH_MNT/file | _filter_xfs_io +# Create a NOCOW file and do direct IO for 4 seconds to measure the performance. +# +# The only way to reach real disk performance is direct IO without falling back +# to buffered IO, thus requiring NOCOW. +touch $SCRATCH_MNT/filler +chattr +C $SCRATCH_MNT/filler +$XFS_IO_PROG -d -c "pwrite -b 128K 0 1E" "$SCRATCH_MNT/filler" >> $seqres.full 2>&1 & +filler_pid=$! +sleep 4 +kill $filler_pid +wait +unset filler_pid + +# Make sure we still have some space left, if we hit ENOSPC, this means the +# storage is too fast and the filler didn't reach full 4 seconds write before +# hitting ENOSPC. In that case we have no reliable way to calculate scrub speed +# but skip the run. +_pwrite_byte 0x00 0 1M $SCRATCH_MNT/foobar >> $seqres.full 2>&1 +if [ $? -ne 0 ]; then + _notrun "Storage too fast, unreliable scrub speed" +fi + +# But above NOCOW file has no csum, thus it won't really cause much +# verification workload. Use the filesize of above run to re-create a file with data +# checksums. +size=$(_get_filesize $SCRATCH_MNT/filler) +rm $SCRATCH_MNT/filler + +# Recreate one with checksums. +touch $SCRATCH_MNT/filler +chattr -C $SCRATCH_MNT/filler +$XFS_IO_PROG -c "pwrite -i /dev/urandom 0 $size" $SCRATCH_MNT/filler >> $seqres.full # Writeback above data, as scrub only verify the committed data. sync@@ -77,12 +118,15 @@ $BTRFS_UTIL_PROG scrub start -B $SCRATCH_MNT >> $seqres.full speed=$($BTRFS_UTIL_PROG scrub status --raw $SCRATCH_MNT | grep "Rate:" |\ $AWK_PROG '{print $2}' | cut -f1 -d\/) -# We gave a +- 10% tolerance for the throttle -if [ "$speed" -gt "$(( $target_speed * 11 / 10 ))" -o \ - "$speed" -lt "$(( $target_speed * 9 / 10))" ]; then +# The expected runtime should be 4 and 8 seconds, and since the runtime +# accuracy is only 1 second, give it a +/- 25% tolerance +if [ "$speed" -gt "$(( $target_speed * 5 / 4 ))" -o \ + "$speed" -lt "$(( $target_speed * 3 / 4 ))" ]; then echo "scrub speed $speed Bytes/s is not properly throttled, target is $target_speed Bytes/s" fi +echo "Silence is golden" + # success, all done status=0 exittests/btrfs/282.out +1
-3@@ -1,3 +1,2 @@ QA output created by 282 -wrote 2147483648/2147483648 bytes at offset 0 -XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +Silence is golden --2.50.0
Quoted 69 lines · Qu Wenruo
[FAILURE]
Test case btrfs/282 still fails on some setup:output mismatch (see /opt/xfstests/results//btrfs/282.out.bad) --- tests/btrfs/282.out 2025-06-27 22:00:35.000000000 +0200 +++ /opt/xfstests/results//btrfs/282.out.bad 2025-07-08 20:40:50.042410321 +0200 @@ -1,3 +1,4 @@ QA output created by 282 wrote 2147483648/2147483648 bytes at offset 0 XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +scrub speed 2152038400 Bytes/s is not properly throttled, target is 1076019200 Bytes/s ... (Run diff -u /opt/xfstests/tests/btrfs/282.out /opt/xfstests/results//btrfs/282.out.bad to see the entire diff)[CAUSE]
Checking the full output, it shows the scrub is running too fast:Starting scrub on devid 1
scrub done for c45c8821-4e55-4d29-8172-f1bf30b7182cScrub started: Tue Jul 8 20:40:47 2025 Status: finished Duration: 0:00:00 <<< Total to scrub: 2.00GiB Rate: 2.00GiB/s Error summary: no errors found Starting scrub on devid 1 scrub done for c45c8821-4e55-4d29-8172-f1bf30b7182c Scrub started: Tue Jul 8 20:40:48 2025 Status: finished Duration: 0:00:01 Total to scrub: 2.00GiB Rate: 2.00GiB/s Error summary: no errors foundThe original run takes less than 1 seconds, making the scrub rate calculation very unreliable, no wonder the speed limit is not able to properly work.
[FIX]
Instead of using fixed 2GiB file size, let the test create a filler for 4 seconds with direct IO, this would more or less ensure the scrub will take 4 seconds to run.With 4 seconds as run time, the scrub rate can be calculated more or less reliably.
Furthermore since btrfs-progs currently only reports scrub duration in seconds, to prevent problems due to 1 second difference, enlarge the tolerance to +/- 25%, to be extra safe.
On my testing VM, the result looks like this:
Starting scrub on devid 1
scrub done for b542bdfb-7be4-44b3-add0-ad3621927e2bScrub started: Fri Jul 11 09:13:31 2025 Status: finished Duration: 0:00:04 Total to scrub: 2.72GiB Rate: 696.62MiB/s Error summary: no errors found Starting scrub on devid 1 scrub done for b542bdfb-7be4-44b3-add0-ad3621927e2b Scrub started: Fri Jul 11 09:13:35 2025 Status: finished Duration: 0:00:08 Total to scrub: 2.72GiB Rate: 348.31MiB/s Error summary: no errors found
Quoted 5 lines
However this exposed a new failure mode, that if the storage is too fast, like the original report, that the initial 4 seconds write can fill the fs and exit early.
In that case we have no other solution but skipping the test case.
Hi Qu,
Thanks for tuning the test, we have also been facing intermittent failures on btrfs/282.
I was just wondering if for faster devices, would it make sense to use the io cgroup controller, eg:
echo "252:0 rbps=1048576 wbps=1048576" > /sys/fs/cgroup/io_limit/io.max
To limit the throughput so we have >= 4s scrub runs. Or does that also have some undesired effects like you mentioned for dm_delay here [1]
Regards,
Ojaswin
[1] https://lore.kernel.org/all/[email protected]/
Quoted 3 lines
Signed-off-by Qu Wenruo <[email protected]>---
Quoted 81 lines · Ojaswin Mujoo
Quoted 69 lines · Qu Wenruo
[FAILURE]
Test case btrfs/282 still fails on some setup:output mismatch (see /opt/xfstests/results//btrfs/282.out.bad) --- tests/btrfs/282.out 2025-06-27 22:00:35.000000000 +0200 +++ /opt/xfstests/results//btrfs/282.out.bad 2025-07-08 20:40:50.042410321 +0200 @@ -1,3 +1,4 @@ QA output created by 282 wrote 2147483648/2147483648 bytes at offset 0 XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +scrub speed 2152038400 Bytes/s is not properly throttled, target is 1076019200 Bytes/s ... (Run diff -u /opt/xfstests/tests/btrfs/282.out /opt/xfstests/results//btrfs/282.out.bad to see the entire diff)[CAUSE]
Checking the full output, it shows the scrub is running too fast:Starting scrub on devid 1
scrub done for c45c8821-4e55-4d29-8172-f1bf30b7182cScrub started: Tue Jul 8 20:40:47 2025 Status: finished Duration: 0:00:00 <<< Total to scrub: 2.00GiB Rate: 2.00GiB/s Error summary: no errors found Starting scrub on devid 1 scrub done for c45c8821-4e55-4d29-8172-f1bf30b7182c Scrub started: Tue Jul 8 20:40:48 2025 Status: finished Duration: 0:00:01 Total to scrub: 2.00GiB Rate: 2.00GiB/s Error summary: no errors foundThe original run takes less than 1 seconds, making the scrub rate calculation very unreliable, no wonder the speed limit is not able to properly work.
[FIX]
Instead of using fixed 2GiB file size, let the test create a filler for 4 seconds with direct IO, this would more or less ensure the scrub will take 4 seconds to run.With 4 seconds as run time, the scrub rate can be calculated more or less reliably.
Furthermore since btrfs-progs currently only reports scrub duration in seconds, to prevent problems due to 1 second difference, enlarge the tolerance to +/- 25%, to be extra safe.
On my testing VM, the result looks like this:
Starting scrub on devid 1
scrub done for b542bdfb-7be4-44b3-add0-ad3621927e2bScrub started: Fri Jul 11 09:13:31 2025 Status: finished Duration: 0:00:04 Total to scrub: 2.72GiB Rate: 696.62MiB/s Error summary: no errors found Starting scrub on devid 1 scrub done for b542bdfb-7be4-44b3-add0-ad3621927e2b Scrub started: Fri Jul 11 09:13:35 2025 Status: finished Duration: 0:00:08 Total to scrub: 2.72GiB Rate: 348.31MiB/s Error summary: no errors foundQuoted 5 lines
However this exposed a new failure mode, that if the storage is too fast, like the original report, that the initial 4 seconds write can fill the fs and exit early.
In that case we have no other solution but skipping the test case.
Hi Qu,
Thanks for tuning the test, we have also been facing intermittent failures on btrfs/282.
Quoted 7 lines
I was just wondering if for faster devices, would it make sense to use the io cgroup controller, eg:
echo "252:0 rbps=1048576 wbps=1048576" > /sys/fs/cgroup/io_limit/io.maxTo limit the throughput so we have >= 4s scrub runs. Or does that also have some undesired effects like you mentioned for
dm_delayhere [1]
If cgroup works, it will be the best solution, we can fix the throughput to 512MiB/s, and use a 2GiB file to ensure 4s of scrub runtime.
This will get rid of the speed test part.
The only problem is I'm not familiar with the cgroup infrastructure, if you can enhance the test case to use cgroup, it would be awesome.
Thanks,
Qu
Quoted 9 lines
Regards,
Ojaswin[1] https://lore.kernel.org/all/[email protected]/
Quoted 3 lines
Signed-off-by Qu Wenruo <[email protected]>---
Quoted 95 lines · Qu Wenruo
Quoted 81 lines · Ojaswin Mujoo
Quoted 69 lines · Qu Wenruo
[FAILURE]
Test case btrfs/282 still fails on some setup:output mismatch (see /opt/xfstests/results//btrfs/282.out.bad) --- tests/btrfs/282.out 2025-06-27 22:00:35.000000000 +0200 +++ /opt/xfstests/results//btrfs/282.out.bad 2025-07-08 20:40:50.042410321 +0200 @@ -1,3 +1,4 @@ QA output created by 282 wrote 2147483648/2147483648 bytes at offset 0 XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +scrub speed 2152038400 Bytes/s is not properly throttled, target is 1076019200 Bytes/s ... (Run diff -u /opt/xfstests/tests/btrfs/282.out /opt/xfstests/results//btrfs/282.out.bad to see the entire diff)[CAUSE]
Checking the full output, it shows the scrub is running too fast:Starting scrub on devid 1
scrub done for c45c8821-4e55-4d29-8172-f1bf30b7182cScrub started: Tue Jul 8 20:40:47 2025 Status: finished Duration: 0:00:00 <<< Total to scrub: 2.00GiB Rate: 2.00GiB/s Error summary: no errors found Starting scrub on devid 1 scrub done for c45c8821-4e55-4d29-8172-f1bf30b7182c Scrub started: Tue Jul 8 20:40:48 2025 Status: finished Duration: 0:00:01 Total to scrub: 2.00GiB Rate: 2.00GiB/s Error summary: no errors foundThe original run takes less than 1 seconds, making the scrub rate calculation very unreliable, no wonder the speed limit is not able to properly work.
[FIX]
Instead of using fixed 2GiB file size, let the test create a filler for 4 seconds with direct IO, this would more or less ensure the scrub will take 4 seconds to run.With 4 seconds as run time, the scrub rate can be calculated more or less reliably.
Furthermore since btrfs-progs currently only reports scrub duration in seconds, to prevent problems due to 1 second difference, enlarge the tolerance to +/- 25%, to be extra safe.
On my testing VM, the result looks like this:
Starting scrub on devid 1
scrub done for b542bdfb-7be4-44b3-add0-ad3621927e2bScrub started: Fri Jul 11 09:13:31 2025 Status: finished Duration: 0:00:04 Total to scrub: 2.72GiB Rate: 696.62MiB/s Error summary: no errors found Starting scrub on devid 1 scrub done for b542bdfb-7be4-44b3-add0-ad3621927e2b Scrub started: Fri Jul 11 09:13:35 2025 Status: finished Duration: 0:00:08 Total to scrub: 2.72GiB Rate: 348.31MiB/s Error summary: no errors foundQuoted 5 lines
However this exposed a new failure mode, that if the storage is too fast, like the original report, that the initial 4 seconds write can fill the fs and exit early.
In that case we have no other solution but skipping the test case.
Hi Qu,
Thanks for tuning the test, we have also been facing intermittent failures on btrfs/282.
Quoted 7 lines
I was just wondering if for faster devices, would it make sense to use the io cgroup controller, eg:
echo "252:0 rbps=1048576 wbps=1048576" > /sys/fs/cgroup/io_limit/io.maxTo limit the throughput so we have >= 4s scrub runs. Or does that also have some undesired effects like you mentioned for
dm_delayhere [1]If cgroup works, it will be the best solution, we can fix the throughput to 512MiB/s, and use a 2GiB file to ensure 4s of scrub runtime.
Quoted 7 lines
This will get rid of the speed test part.
The only problem is I'm not familiar with the cgroup infrastructure, if you can enhance the test case to use cgroup, it would be awesome.
Thanks,
Qu
Hi Qu,
So the command I pasted above did help me limit the dd throughput to 1MB/s so it does seem to be doing what it advertises :)
I don't know much about cgroups either but sure I can spend some time understanding the io controller better and try to incorporate it in the test. Will try to send a separate patch for it.
Thanks,
Ojaswin
Quoted 11 lines
Quoted 10 lines
Regards,
Ojaswin[1] https://lore.kernel.org/all/[email protected]/
Quoted 3 lines
Signed-off-by Qu Wenruo <[email protected]>---