Recent changes (master)
The following changes since commit 20f42c101f7876648705a4fb8a9e2a647dc936ce:
t/run-fio-tests: restrict t0031 to Linux only (2024-03-21 08:36:14 -0400)
are available in the Git repository at:
git://git.kernel.dk/fio.git master
for you to fetch changes up to 2b03792ceb7ed00bd50db5b59486fab902295df8:
Merge branch 'issue-1735' of https://github.com/yygcode/fio (2024-03-22 10:39:37 -0400)
----------------------------------------------------------------
Vincent Fu (4):
engines/fileoperations: remove extra blank lines engines/fileoperations: use local var for ioengine data
examples: fiograph plots for dir operation ioengines Merge branch 'issue-1735' of https://github.com/yygcode/fio
friendy-su (1):
ioengines: implement dircreate, dirstat, dirdelete engines to fileoperations.c
yonggang.yyg (1):
iolog: fix disk stats issue
HOWTO.rst | 15 +++++ engines/fileoperations.c | 119 ++++++++++++++++++++++++++++++++++++++-- examples/dircreate-ioengine.fio | 25 +++++++++ examples/dircreate-ioengine.png | Bin 0 -> 42659 bytes examples/dirdelete-ioengine.fio | 18 ++++++ examples/dirdelete-ioengine.png | Bin 0 -> 45530 bytes examples/dirstat-ioengine.fio | 18 ++++++ examples/dirstat-ioengine.png | Bin 0 -> 33597 bytes fio.1 | 15 +++++ iolog.c | 2 + 10 files changed, 206 insertions(+), 6 deletions(-) create mode 100644 examples/dircreate-ioengine.fio create mode 100644 examples/dircreate-ioengine.png create mode 100644 examples/dirdelete-ioengine.fio create mode 100644 examples/dirdelete-ioengine.png create mode 100644 examples/dirstat-ioengine.fio create mode 100644 examples/dirstat-ioengine.png
---
Diff of recent changes:
HOWTO.rst +15 -0
@@ -2192,6 +2192,21 @@ I/O engine and 'nrfiles', so that the files will be created. This engine is to measure file delete. + **dircreate** + Simply create the directories and do no I/O to them. You still need to + set `filesize` so that all the accounting still occurs, but no + actual I/O will be done other than creating the directories. + + **dirstat** + Simply do stat() and do no I/O to the directories. You need to set 'filesize' + and 'nrfiles', so that directories will be created. + This engine is to measure directory lookup and meta data access. + + **dirdelete** + Simply delete the directories by rmdir() and do no I/O to them. You need to set 'filesize' + and 'nrfiles', so that the directories will be created. + This engine is to measure directory delete. + **libpmem** Read and write using mmap I/O to a file on a filesystem mounted with DAX on a persistent memory device through the PMDK
engines/fileoperations.c +113 -6
194 lines not on this page · raw message
examples/dircreate-ioengine.fio new file +25 -0
@@ -0,0 +1,25 @@ +# Example dircreate job +# +# create_on_open is needed so that the open happens during the run and not the +# setup. +# +# openfiles needs to be set so that you do not exceed the maximum allowed open +# files. +# +# filesize needs to be set to a non zero value so fio will actually run, but the +# IO will not really be done and the write latency numbers will only reflect the +# open times. +[global] +create_on_open=1 +nrfiles=30 +ioengine=dircreate +fallocate=none +filesize=4k +openfiles=1 + +[t0] +[t1] +[t2] +[t3] +[t4] +[t5]
examples/dircreate-ioengine.png new file binary +0 -0
examples/dirdelete-ioengine.fio new file +18 -0
@@ -0,0 +1,18 @@ +# Example dirdelete job + +# 'filedelete' engine only do 'rmdir(dirname)'. +# 'filesize' must be set, then directories will be created at setup stage. +# 'unlink' is better set to 0, since the directory is deleted in measurement. +# the options disabled completion latency output such as 'disable_clat' and 'gtod_reduce' must not set. +[global] +ioengine=dirdelete +filesize=4k +nrfiles=200 +unlink=0 + +[t0] +[t1] +[t2] +[t3] +[t4] +[t5]
examples/dirdelete-ioengine.png new file binary +0 -0
examples/dirstat-ioengine.fio new file +18 -0
@@ -0,0 +1,18 @@ +# Example dirstat job + +# 'dirstat' engine only do 'stat(dirname)', file will not be open(). +# 'filesize' must be set, then files will be created at setup stage. + +[global] +ioengine=dirstat +numjobs=10 +filesize=4k +nrfiles=5 +thread + +[t0] +[t1] +[t2] +[t3] +[t4] +[t5]
examples/dirstat-ioengine.png new file binary +0 -0
fio.1 +15 -0
@@ -2004,6 +2004,21 @@ Simply delete files by unlink() and do no I/O to the file. You need to set 'file and 'nrfiles', so that files will be created. This engine is to measure file delete. .TP +.B dircreate +Simply create the directories and do no I/O to them. You still need to set +\fBfilesize\fR so that all the accounting still occurs, but no actual I/O will be +done other than creating the directories. +.TP +.B dirstat +Simply do stat() and do no I/O to the directory. You need to set 'filesize' +and 'nrfiles', so that directories will be created. +This engine is to measure directory lookup and meta data access. +.TP +.B dirdelete +Simply delete directories by unlink() and do no I/O to the directory. You need to set 'filesize' +and 'nrfiles', so that directories will be created. +This engine is to measure directory delete. +.TP .B libpmem Read and write using mmap I/O to a file on a filesystem mounted with DAX on a persistent memory device through the PMDK
iolog.c +2 -0
@@ -814,6 +814,8 @@ bool init_iolog(struct thread_data *td)if (!ret)td_verror (td,EINVAL ,"failed initializing iolog" ); +init_disk_util (td); +return ret; }