Initial CephFS tests
v3 cover Initial CephFS tests
This is the first attempt to (finally!) add CephFS specific tests to fstests. Hopefully, more will follow once an initial set is accepted -- I do have a few more that could easily be added, and I'm sure that in the future more CephFS-specific tests can continue to be developed. This test suite has already proved to be quite useful in finding bugs in this filesystem; adding specific tests for it is just the next logic step.
For now, just two simple tests to do some basic checks on quotas features.
Cheers,
--
Luis
Changes since v2:
- Use 'local' variables in functions
- Use $seqres.full for logging output (and rm -f $seqres.full before test)
- Use _getfattr wrapper and filter TEST_DIR
Changes since v1 (RFC):
Both tests refactored:
- use 'workdir' instead of 'testdir' and initialize it to $seq
- don't remove $workdir on cleanup()
- use output to validate test results instead of _fail
Luis Henriques (2):
ceph: test basic ceph.quota.max_files quota
ceph: test basic ceph.quota.max_bytes quota
tests/ceph/001 | 88 ++++++++++++++++++++++++++++++ tests/ceph/001.out | 9 ++++ tests/ceph/002 | 127 ++++++++++++++++++++++++++++++++++++++++++++ tests/ceph/002.out | 64 ++++++++++++++++++++++ tests/ceph/Makefile | 20 +++++++ tests/ceph/group | 2 + 6 files changed, 310 insertions(+) create mode 100755 tests/ceph/001 create mode 100644 tests/ceph/001.out create mode 100755 tests/ceph/002 create mode 100644 tests/ceph/002.out create mode 100644 tests/ceph/Makefile create mode 100644 tests/ceph/group
PATCH v3 1/2 ceph: test basic ceph.quota.max_files quota
Simple set of checks for CephFS max_files directory quota implementation.
--- tests/ceph/001 | 88 +++++++++++++++++++++++++++++++++++++++++++++ tests/ceph/001.out | 9 +++++ tests/ceph/Makefile | 20 +++++++++++ tests/ceph/group | 1 + 4 files changed, 118 insertions(+) create mode 100755 tests/ceph/001 create mode 100644 tests/ceph/001.out create mode 100644 tests/ceph/Makefile create mode 100644 tests/ceph/group
tests/ceph/001 new file +88 -0
@@ -0,0 +1,88 @@ +#! /bin/bash +# SPDX-License-Identifier: GPL-2.0 +# Copyright (c) 2019 SUSE LLC. All Rights Reserved. +# +# FS QA Test No. 001 +# +# Test basic ceph.quota.max_files quota features. +# + +seq=`basename $0` +seqres=$RESULT_DIR/$seq +echo "QA output created by $seq" + +workdir=$TEST_DIR/$seq + +tmp=/tmp/$$ +status=1 # failure is the default! +trap "_cleanup; exit \$status" 0 1 2 3 15 + +_cleanup() +{ + cd / + rm -rf $tmp.* +} + +# get standard environment, filters and checks +. ./common/rc +. ./common/filter +. ./common/attr + +# real QA test starts here +_supported_os Linux +_supported_fs ceph + +_require_attrs + +set_quota() +{ + local val=$1 + local dir=$2 + $SETFATTR_PROG -n ceph.quota.max_files -v $val $dir >>$seqres.full 2>&1 +} +get_quota() +{ + local dir=$1 + _getfattr -n ceph.quota.max_files --absolute-names $dir \ + 2>>$seqres.full | _filter_test_dir +} + +rm -f $seqres.full +rm -rf $workdir +mkdir $workdir + +# test setting quota +set_quota 10 $workdir +get_quota $workdir + +# set quota to largest acceptable value (0x7FFFFFFFFFFFFFFF) +set_quota 9223372036854775807 $workdir +get_quota $workdir + +# test resetting quota +set_quota 0 $workdir +get_quota $workdir + +# set quota to invalid values (0x8000000000000000 and -1) +set_quota 9223372036854775808 $workdir +get_quota $workdir + +set_quota -1 $workdir +get_quota $workdir + +set_quota 5 $workdir +mkdir $workdir/0 +touch $workdir/0/1 +touch $workdir/0/2 +touch $workdir/3 + +touch $workdir/4 2>&1 | _filter_test_dir # should fail +mkdir $workdir/5 2>&1 | _filter_test_dir # should fail + +set_quota 0 $workdir +touch $workdir/4 # shouldn't fail +mkdir $workdir/5 # shouldn't fail + +# success, all done +status=0 +exit
tests/ceph/001.out new file +9 -0
@@ -0,0 +1,9 @@ +QA output created by 001 +# file: TEST_DIR/001 +ceph.quota.max_files="10" + +# file: TEST_DIR/001 +ceph.quota.max_files="9223372036854775807" + +touch: cannot touch 'TEST_DIR/001/4': Disk quota exceeded +mkdir: cannot create directory 'TEST_DIR/001/5': Disk quota exceeded
tests/ceph/Makefile new file +20 -0
@@ -0,0 +1,20 @@ +# +# Copyright (c) 2019 SUSE LLC. All Rights Reserved. +# + +TOPDIR = ../.. +include $(TOPDIR)/include/builddefs + +CEPHFS_DIR = cephfs +TARGET_DIR = $(PKG_LIB_DIR)/$(TESTS_DIR)/$(CEPHFS_DIR) + +include $(BUILDRULES) + +install: + $(INSTALL) -m 755 -d $(TARGET_DIR) + $(INSTALL) -m 755 $(TESTS) $(TARGET_DIR) + $(INSTALL) -m 644 group $(TARGET_DIR) + $(INSTALL) -m 644 $(OUTFILES) $(TARGET_DIR) + +# Nothing. +install-dev install-lib:
tests/ceph/group new file +1 -0
@@ -0,0 +1 @@ +001 auto quick quota
PATCH v3 2/2 ceph: test basic ceph.quota.max_bytes quota
In reply to Luis HenriquesSimple set of checks for CephFS max_bytes directory quota implementation.
--- tests/ceph/002 | 127 +++++++++++++++++++++++++++++++++++++++++++++ tests/ceph/002.out | 64 +++++++++++++++++++++++ tests/ceph/group | 1 + 3 files changed, 192 insertions(+) create mode 100755 tests/ceph/002 create mode 100644 tests/ceph/002.out
tests/ceph/002 new file +127 -0
@@ -0,0 +1,127 @@ +#! /bin/bash +# SPDX-License-Identifier: GPL-2.0 +# Copyright (c) 2019 SUSE LLC. All Rights Reserved. +# +# FS QA Test No. 002 +# +# This tests basic ceph.quota.max_bytes quota features. +# + +seq=`basename $0` +seqres=$RESULT_DIR/$seq +echo "QA output created by $seq" + +workdir=$TEST_DIR/$seq + +tmp=/tmp/$$ +status=1 # failure is the default! +trap "_cleanup; exit \$status" 0 1 2 3 15 + +_cleanup() +{ + cd / + rm -rf $tmp.* +} + +# get standard environment, filters and checks +. ./common/rc +. ./common/filter +. ./common/attr + +# real QA test starts here +_supported_os Linux +_supported_fs ceph + +_require_attrs + +set_quota() +{ + local val=$1 + local dir=$2 + $SETFATTR_PROG -n ceph.quota.max_bytes -v $val $dir >>$seqres.full 2>&1 +} + +get_quota() +{ + local dir=$1 + _getfattr -n ceph.quota.max_bytes --absolute-names $dir \ + 2>>$seqres.full | _filter_test_dir +} + +# function to write a file. We use a loop because quotas in CephFS is a +# "best-effort" implementation, i.e. a write may actually be allowed even if the +# quota is being exceeded. Using a loop reduces the chances of this to happen: +# the usage of fsync (-W in xfs_io) and the open/close of the file will make +# sure the file size is be updated in the MDSs. +# +# NOTE: 'size' parameter is in M +write_file() +{ + local file=$1 + local size=$2 # size in M + for (( i = 1; i < $size; i++ )); do + $XFS_IO_PROG -f -c "pwrite -W $((i * 1048576)) 1m" \ + $file | _filter_xfs_io + done +} + +rm -f $seqres.full +rm -rf $workdir +mkdir $workdir + +# test setting quota +set_quota 1000000 $workdir +get_quota $workdir + +# set quota to largest acceptable value (0x7FFFFFFFFFFFFFFF) +set_quota 9223372036854775807 $workdir +get_quota $workdir + +# test resetting quota +set_quota 0 $workdir +get_quota $workdir + +# set quota to invalid values (0x8000000000000000 and -1) +set_quota 9223372036854775808 $workdir +get_quota $workdir + +set_quota -1 $workdir +get_quota $workdir + +bigfile="$workdir/bigfile" + +# set quota to 10M +set_quota $((10 * 1048576)) $workdir + +# write 9M file +write_file $bigfile 9 +stat -c %s $bigfile +rm $bigfile + +# try to write 11M file +write_file $bigfile 11 # 11M +stat -c %s $bigfile +rm $bigfile + +# write 5 x 2M files +for (( j = 1; j < 6; j++ )); do + smallfile="$workdir/smallfile_$j" + write_file $smallfile 2 # 2M + stat -c %s $smallfile +done + +# try to write another 2M file, should fail +smallfile="$workdir/smallfile_fail" +write_file $smallfile 2 +stat -c %s $smallfile + +# reset quota +set_quota 0 $workdir + +# write 2M file +write_file $smallfile 2 +stat -c %s $smallfile + +# success, all done +status=0 +exit
tests/ceph/002.out new file +64 -0
64 lines not on this page · raw message
tests/ceph/group +1 -0
@@ -1 +1,2 @@ 001 auto quick quota +002 auto quick quota