Extended I/O accounting
PATCH v3 1/21 xen_disk: Account for flush operations
In reply to Alberto GarciaCurrently both BLKIF_OP_WRITE and BLKIF_OP_FLUSH_DISKCACHE are being accounted as write operations.
--- hw/block/xen_disk.c | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-)
hw/block/xen_disk.c +3 -1
@@ -576,7 +576,9 @@ static int ioreq_runio_qemu_aio(struct ioreq *ioreq) }block_acct_start (blk_get_stats (blkdev->blk), &ioreq->acct, - ioreq->v.size,BLOCK_ACCT_WRITE ); + ioreq->v.size, + ioreq->req.operation ==BLKIF_OP_WRITE ? +BLOCK_ACCT_WRITE :BLOCK_ACCT_FLUSH ); ioreq->aio_inflight++; blk_aio_writev(blkdev->blk, ioreq->start / BLOCK_SIZE, &ioreq->v, ioreq->v.size / BLOCK_SIZE,
Signature · 1 line
2.6.1
PATCH v3 2/21 ide: Account for write operations correctly
In reply to Alberto Garcia--- hw/ide/core.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
hw/ide/core.c +1 -1
@@ -895,7 +895,7 @@ static void ide_sector_write(IDEState *s)qemu_iovec_init_external (&s->qiov, &s->iov,1 );block_acct_start (blk_get_stats (s->blk), &s->acct, - n *BDRV_SECTOR_SIZE ,BLOCK_ACCT_READ ); + n *BDRV_SECTOR_SIZE ,BLOCK_ACCT_WRITE ); s->pio_aiocb =blk_aio_writev (s->blk, sector_num, &s->qiov, n, ide_sector_write_cb, s); }
Signature · 1 line
2.6.1
PATCH v3 3/21 block: define 'clock_type' for the accounting code
In reply to Alberto GarciaIts value is still QEMU_CLOCK_REALTIME, but having it in a variable will allow us to change its value easily in the future when running in qtest mode.
--- block/accounting.c | 6 ++++-- 1 file changed, 4 insertions(+), 2 deletions(-)
block/accounting.c +4 -2
@@ -26,13 +26,15 @@#include "block/block_int.h" #include "qemu/timer.h" +static QEMUClockType clock_type =QEMU_CLOCK_REALTIME ; +void block_acct_start (BlockAcctStats *stats,BlockAcctCookie *cookie,int64_t bytes,enum BlockAcctType type) {assert (type <BLOCK_MAX_IOTYPE ); cookie->bytes = bytes; - cookie->start_time_ns =qemu_clock_get_ns (QEMU_CLOCK_REALTIME ); + cookie->start_time_ns =qemu_clock_get_ns (clock_type); cookie->type = type; }
@@ -43,7 +45,7 @@ void block_acct_done(BlockAcctStats *stats, BlockAcctCookie *cookie) stats->nr_bytes[cookie->type] += cookie->bytes; stats->nr_ops[cookie->type]++; stats->total_time_ns[cookie->type] += -qemu_clock_get_ns (QEMU_CLOCK_REALTIME ) - cookie->start_time_ns; +qemu_clock_get_ns (clock_type) - cookie->start_time_ns; }
Signature · 1 line
2.6.1
v3 cover Extended I/O accounting
Here's a new version of the extended I/O accounting patches.
This one is rebased on top of the current master, has a few minor documentation fixes and drops the 'supports_stats' field completely.
Regards,
Berto
v3:
- Rebased on top of the current master and on Max's BlockBackend series v7
- patch 4: minor documentation fixes
- patch 5: s/miliseconds/nanoseconds/
- patch 6: dropped, there's no "supports_stats" anymore
- patch 7 (now 6): explain why block_acct_invalid() does not update
total_time_ns[]
- patch 12 (now 11): don't initialize BlockAcctCookie to { 0 }, it's not needed
v2: https://lists.gnu.org/archive/html/qemu-block/2015-10/msg00161.html
- First complete implementation of the new statistics
v1: https://lists.gnu.org/archive/html/qemu-devel/2015-06/msg03321.html
- Initial series containing only the timed average infrastructure.
Alberto Garcia (21):
xen_disk: Account for flush operations
ide: Account for write operations correctly
block: define 'clock_type' for the accounting code
util: Infrastructure for computing recent averages
block: Add idle_time_ns to BlockDeviceStats
block: Add statistics for failed and invalid I/O operations
block: Allow configuring whether to account failed and invalid ops
block: Compute minimum, maximum and average I/O latencies
block: Add average I/O queue depth to BlockDeviceTimedStats
block: New option to define the intervals for collecting I/O
statistics
qemu-io: Account for failed, invalid and flush operations
block: Use QEMU_CLOCK_VIRTUAL for the accounting code in qtest mode
iotests: Add test for the block device statistics
nvme: Account for failed and invalid operations
virtio-blk: Account for failed and invalid operations
xen_disk: Account for failed and invalid operations
atapi: Account for failed and invalid operations
ide: Account for failed and invalid operations
macio: Account for failed operations
scsi-disk: Account for failed operations
block: Update copyright of the accounting code
block/accounting.c | 123 ++++++++++++++- block/block-backend.c | 1 + block/qapi.c | 51 +++++++ blockdev.c | 53 +++++++ hmp.c | 4 +- hw/block/nvme.c | 11 +- hw/block/virtio-blk.c | 4 +- hw/block/xen_disk.c | 27 +++- hw/ide/atapi.c | 31 ++-- hw/ide/core.c | 12 +- hw/ide/macio.c | 12 +- hw/scsi/scsi-disk.c | 46 ++++-- include/block/accounting.h | 28 ++++ include/qemu/timed-average.h | 64 ++++++++ qapi/block-core.json | 103 ++++++++++++- qemu-io-cmds.c | 9 ++ qmp-commands.hx | 80 +++++++++- tests/Makefile | 4 + tests/qemu-iotests/136 | 349 +++++++++++++++++++++++++++++++++++++++++++ tests/qemu-iotests/136.out | 5 + tests/qemu-iotests/group | 1 + tests/test-timed-average.c | 90 +++++++++++ util/Makefile.objs | 1 + util/timed-average.c | 227 ++++++++++++++++++++++++++++ 24 files changed, 1288 insertions(+), 48 deletions(-) create mode 100644 include/qemu/timed-average.h create mode 100644 tests/qemu-iotests/136 create mode 100644 tests/qemu-iotests/136.out create mode 100644 tests/test-timed-average.c create mode 100644 util/timed-average.c
Signature · 1 line
2.6.1
PATCH v3 5/21 block: Add idle_time_ns to BlockDeviceStats
This patch adds the new field 'idle_time_ns' to the BlockDeviceStats structure, indicating the time that has passed since the previous I/O operation.
It also adds the block_acct_idle_time_ns() call, to ensure that all references to the clock type used for accounting are in the same place. This will later allow us to use a different clock for iotests.
--- block/accounting.c | 12 ++++++++++-- block/qapi.c | 5 +++++ hmp.c | 4 +++- include/block/accounting.h | 2 ++ qapi/block-core.json | 6 +++++- qmp-commands.hx | 10 ++++++++-- 6 files changed, 33 insertions(+), 6 deletions(-)
block/accounting.c +10 -2
@@ -40,12 +40,15 @@ void block_acct_start(BlockAcctStats *stats, BlockAcctCookie *cookie,void block_acct_done (BlockAcctStats *stats,BlockAcctCookie *cookie) { +int64_t time_ns =qemu_clock_get_ns (clock_type); +int64_t latency_ns = time_ns - cookie->start_time_ns; +assert (cookie->type <BLOCK_MAX_IOTYPE ); stats->nr_bytes[cookie->type] += cookie->bytes; stats->nr_ops[cookie->type]++; - stats->total_time_ns[cookie->type] += -qemu_clock_get_ns (clock_type) - cookie->start_time_ns; + stats->total_time_ns[cookie->type] += latency_ns; + stats->last_access_time_ns = time_ns; }
@@ -55,3 +58,8 @@ void block_acct_merge_done(BlockAcctStats *stats, enum BlockAcctType type,assert (type <BLOCK_MAX_IOTYPE ); stats->merged[type] += num_requests; } + +int64_t block_acct_idle_time_ns (BlockAcctStats *stats) +{ +return qemu_clock_get_ns (clock_type) - stats->last_access_time_ns; +}
block/qapi.c +5 -0
@@ -357,6 +357,11 @@ static BlockStats *bdrv_query_stats(const BlockDriverState *bs, s->stats->wr_total_time_ns = stats->total_time_ns[BLOCK_ACCT_WRITE ]; s->stats->rd_total_time_ns = stats->total_time_ns[BLOCK_ACCT_READ ]; s->stats->flush_total_time_ns = stats->total_time_ns[BLOCK_ACCT_FLUSH ]; + + s->stats->has_idle_time_ns = stats->last_access_time_ns >0 ; +if (s->stats->has_idle_time_ns) { + s->stats->idle_time_ns =block_acct_idle_time_ns (stats); + } } s->stats->wr_highest_offset = bs->wr_highest_offset;
hmp.c +3 -1
@@ -522,6 +522,7 @@ void hmp_info_blockstats(Monitor *mon, const QDict *qdict)" flush_total_time_ns=%" PRId64" rd_merged=%" PRId64" wr_merged=%" PRId64 +" idle_time_ns=%" PRId64"\n" , stats->value->stats->rd_bytes, stats->value->stats->wr_bytes,
@@ -532,7 +533,8 @@ void hmp_info_blockstats(Monitor *mon, const QDict *qdict) stats->value->stats->rd_total_time_ns, stats->value->stats->flush_total_time_ns, stats->value->stats->rd_merged, - stats->value->stats->wr_merged); + stats->value->stats->wr_merged, + stats->value->stats->idle_time_ns); }qapi_free_BlockStatsList (stats_list);
include/block/accounting.h +2 -0
@@ -40,6 +40,7 @@ typedef struct BlockAcctStats {uint64_t nr_ops[BLOCK_MAX_IOTYPE ];uint64_t total_time_ns[BLOCK_MAX_IOTYPE ];uint64_t merged[BLOCK_MAX_IOTYPE ]; +int64_t last_access_time_ns; } BlockAcctStats; typedef struct BlockAcctCookie {
@@ -53,5 +54,6 @@ void block_acct_start(BlockAcctStats *stats, BlockAcctCookie *cookie,void block_acct_done (BlockAcctStats *stats,BlockAcctCookie *cookie);void block_acct_merge_done (BlockAcctStats *stats,enum BlockAcctType type,int num_requests); +int64_t block_acct_idle_time_ns (BlockAcctStats *stats);#endif
qapi/block-core.json +5 -1
@@ -448,6 +448,10 @@ # @wr_merged: Number of write requests that have been merged into another # request (Since 2.3). # +# @idle_time_ns: #optional Time since the last I/O operation, in +# nanoseconds. If the field is absent it means that +# there haven't been any operations yet (Since 2.5). +# # Since: 0.14.0 ## { 'struct': 'BlockDeviceStats',
@@ -455,7 +459,7 @@ 'wr_operations': 'int', 'flush_operations': 'int', 'flush_total_time_ns': 'int', 'wr_total_time_ns': 'int', 'rd_total_time_ns': 'int', 'wr_highest_offset': 'int', - 'rd_merged': 'int', 'wr_merged': 'int' } } + 'rd_merged': 'int', 'wr_merged': 'int', '*idle_time_ns': 'int' } } ## # @BlockStats:
qmp-commands.hx +8 -2
@@ -2526,6 +2526,10 @@ Each json-object contain the following: another request (json-int) - "wr_merged": number of write requests that have been merged into another request (json-int) + - "idle_time_ns": time since the last I/O operation, in + nanoseconds. If the field is absent it means + that there haven't been any operations yet + (json-int, optional) - "parent": Contains recursively the statistics of the underlying protocol (e.g. the host file for a qcow2 image). If there is no underlying protocol, this field is omitted
@@ -2550,7 +2554,8 @@ Example: "flush_total_times_ns":49653 "flush_operations":61, "rd_merged":0, - "wr_merged":0 + "wr_merged":0, + "idle_time_ns":2953431879 } }, "stats":{
@@ -2564,7 +2569,8 @@ Example: "rd_total_times_ns":3465673657 "flush_total_times_ns":49653, "rd_merged":0, - "wr_merged":0 + "wr_merged":0, + "idle_time_ns":2953431879 } }, {
Signature · 1 line
2.6.1
PATCH v3 6/21 block: Add statistics for failed and invalid I/O operations
In reply to Alberto GarciaThis patch adds the block_acct_failed() and block_acct_invalid() functions to allow keeping track of failed and invalid I/O operations.
The number of failed and invalid operations is exposed in BlockDeviceStats.
We don't keep track of the time spent on invalid operations because they are cancelled immediately when they are started.
--- block/accounting.c | 23 +++++++++++++++++++++++ block/qapi.c | 10 ++++++++++ include/block/accounting.h | 4 ++++ qapi/block-core.json | 23 ++++++++++++++++++++++- qmp-commands.hx | 12 ++++++++++++ 5 files changed, 71 insertions(+), 1 deletion(-)
block/accounting.c +23 -0
@@ -51,6 +51,29 @@ void block_acct_done(BlockAcctStats *stats, BlockAcctCookie *cookie) stats->last_access_time_ns = time_ns; } +void block_acct_failed (BlockAcctStats *stats,BlockAcctCookie *cookie) +{ +int64_t time_ns =qemu_clock_get_ns (clock_type); + +assert (cookie->type <BLOCK_MAX_IOTYPE ); + + stats->failed_ops[cookie->type]++; + stats->total_time_ns[cookie->type] += time_ns - cookie->start_time_ns; + stats->last_access_time_ns = time_ns; +} + +void block_acct_invalid (BlockAcctStats *stats,enum BlockAcctType type) +{ +assert (type <BLOCK_MAX_IOTYPE ); + +/* block_acct_done() and block_acct_failed() update +* total_time_ns[], but this one does not. The reason is that +* invalid requests are accounted during their submission, +* therefore there's no actual I/O involved. */ + + stats->invalid_ops[type]++; + stats->last_access_time_ns =qemu_clock_get_ns (clock_type); +}void block_acct_merge_done (BlockAcctStats *stats,enum BlockAcctType type,int num_requests)
block/qapi.c +10 -0
@@ -351,6 +351,16 @@ static BlockStats *bdrv_query_stats(const BlockDriverState *bs, s->stats->wr_bytes = stats->nr_bytes[BLOCK_ACCT_WRITE ]; s->stats->rd_operations = stats->nr_ops[BLOCK_ACCT_READ ]; s->stats->wr_operations = stats->nr_ops[BLOCK_ACCT_WRITE ]; + + s->stats->failed_rd_operations = stats->failed_ops[BLOCK_ACCT_READ ]; + s->stats->failed_wr_operations = stats->failed_ops[BLOCK_ACCT_WRITE ]; + s->stats->failed_flush_operations = stats->failed_ops[BLOCK_ACCT_FLUSH ]; + + s->stats->invalid_rd_operations = stats->invalid_ops[BLOCK_ACCT_READ ]; + s->stats->invalid_wr_operations = stats->invalid_ops[BLOCK_ACCT_WRITE ]; + s->stats->invalid_flush_operations = + stats->invalid_ops[BLOCK_ACCT_FLUSH ]; + s->stats->rd_merged = stats->merged[BLOCK_ACCT_READ ]; s->stats->wr_merged = stats->merged[BLOCK_ACCT_WRITE ]; s->stats->flush_operations = stats->nr_ops[BLOCK_ACCT_FLUSH ];
include/block/accounting.h +4 -0
@@ -38,6 +38,8 @@ enum BlockAcctType { typedef struct BlockAcctStats { uint64_t nr_bytes[BLOCK_MAX_IOTYPE]; uint64_t nr_ops[BLOCK_MAX_IOTYPE]; + uint64_t invalid_ops[BLOCK_MAX_IOTYPE]; + uint64_t failed_ops[BLOCK_MAX_IOTYPE]; uint64_t total_time_ns[BLOCK_MAX_IOTYPE]; uint64_t merged[BLOCK_MAX_IOTYPE]; int64_t last_access_time_ns;
@@ -52,6 +54,8 @@ typedef struct BlockAcctCookie {void block_acct_start (BlockAcctStats *stats,BlockAcctCookie *cookie,int64_t bytes,enum BlockAcctType type);void block_acct_done (BlockAcctStats *stats,BlockAcctCookie *cookie); +void block_acct_failed (BlockAcctStats *stats,BlockAcctCookie *cookie); +void block_acct_invalid (BlockAcctStats *stats,enum BlockAcctType type);void block_acct_merge_done (BlockAcctStats *stats,enum BlockAcctType type,int num_requests);int64_t block_acct_idle_time_ns (BlockAcctStats *stats);
qapi/block-core.json +22 -1
@@ -452,6 +452,24 @@ # nanoseconds. If the field is absent it means that # there haven't been any operations yet (Since 2.5). # +# @failed_rd_operations: The number of failed read operations +# performed by the device (Since 2.5) +# +# @failed_wr_operations: The number of failed write operations +# performed by the device (Since 2.5) +# +# @failed_flush_operations: The number of failed flush operations +# performed by the device (Since 2.5) +# +# @invalid_rd_operations: The number of invalid read operations +# performed by the device (Since 2.5) +# +# @invalid_wr_operations: The number of invalid write operations +# performed by the device (Since 2.5) +# +# @invalid_flush_operations: The number of invalid flush operations +# performed by the device (Since 2.5) +# # Since: 0.14.0 ## { 'struct': 'BlockDeviceStats',
@@ -459,7 +477,10 @@ 'wr_operations': 'int', 'flush_operations': 'int', 'flush_total_time_ns': 'int', 'wr_total_time_ns': 'int', 'rd_total_time_ns': 'int', 'wr_highest_offset': 'int', - 'rd_merged': 'int', 'wr_merged': 'int', '*idle_time_ns': 'int' } } + 'rd_merged': 'int', 'wr_merged': 'int', '*idle_time_ns': 'int', + 'failed_rd_operations': 'int', 'failed_wr_operations': 'int', + 'failed_flush_operations': 'int', 'invalid_rd_operations': 'int', + 'invalid_wr_operations': 'int', 'invalid_flush_operations': 'int' } } ## # @BlockStats:
qmp-commands.hx +12 -0
@@ -2530,6 +2530,18 @@ Each json-object contain the following: nanoseconds. If the field is absent it means that there haven't been any operations yet (json-int, optional) + - "failed_rd_operations": number of failed read operations + (json-int) + - "failed_wr_operations": number of failed write operations + (json-int) + - "failed_flush_operations": number of failed flush operations + (json-int) + - "invalid_rd_operations": number of invalid read operations + (json-int) + - "invalid_wr_operations": number of invalid write operations + (json-int) + - "invalid_flush_operations": number of invalid flush operations + (json-int) - "parent": Contains recursively the statistics of the underlying protocol (e.g. the host file for a qcow2 image). If there is no underlying protocol, this field is omitted
Signature · 1 line
2.6.1
PATCH v3 7/21 block: Allow configuring whether to account failed and invalid ops
In reply to Alberto GarciaThis patch adds two options, "stats-account-invalid" and "stats-account-failed", that can be used to decide whether invalid and failed I/O operations must be used when collecting statistics for latency and last access time.
--- block/accounting.c | 24 +++++++++++++++++++----- block/qapi.c | 3 +++ blockdev.c | 16 ++++++++++++++++ include/block/accounting.h | 5 +++++ qapi/block-core.json | 17 ++++++++++++++++- qmp-commands.hx | 25 ++++++++++++++++++++----- 6 files changed, 79 insertions(+), 11 deletions(-)
block/accounting.c +19 -5
@@ -28,6 +28,13 @@static QEMUClockType clock_type =QEMU_CLOCK_REALTIME ; +void block_acct_init (BlockAcctStats *stats,bool account_invalid, +bool account_failed) +{ + stats->account_invalid = account_invalid; + stats->account_failed = account_failed; +} +void block_acct_start (BlockAcctStats *stats,BlockAcctCookie *cookie,int64_t bytes,enum BlockAcctType type) {
@@ -53,13 +60,17 @@ void block_acct_done(BlockAcctStats *stats, BlockAcctCookie *cookie)void block_acct_failed (BlockAcctStats *stats,BlockAcctCookie *cookie) { -int64_t time_ns =qemu_clock_get_ns (clock_type); -assert (cookie->type <BLOCK_MAX_IOTYPE ); stats->failed_ops[cookie->type]++; - stats->total_time_ns[cookie->type] += time_ns - cookie->start_time_ns; - stats->last_access_time_ns = time_ns; + +if (stats->account_failed) { +int64_t time_ns =qemu_clock_get_ns (clock_type); +int64_t latency_ns = time_ns - cookie->start_time_ns; + + stats->total_time_ns[cookie->type] += latency_ns; + stats->last_access_time_ns = time_ns; + } }void block_acct_invalid (BlockAcctStats *stats,enum BlockAcctType type)
@@ -72,7 +83,10 @@ void block_acct_invalid(BlockAcctStats *stats, enum BlockAcctType type)* therefore there's no actual I/O involved. */ stats->invalid_ops[type]++; - stats->last_access_time_ns =qemu_clock_get_ns (clock_type); + +if (stats->account_invalid) { + stats->last_access_time_ns =qemu_clock_get_ns (clock_type); + } } void block_acct_merge_done(BlockAcctStats *stats, enum BlockAcctType type,
block/qapi.c +3 -0
@@ -372,6 +372,9 @@ static BlockStats *bdrv_query_stats(const BlockDriverState *bs,if (s->stats->has_idle_time_ns) { s->stats->idle_time_ns =block_acct_idle_time_ns (stats); } + + s->stats->account_invalid = stats->account_invalid; + s->stats->account_failed = stats->account_failed; } s->stats->wr_highest_offset = bs->wr_highest_offset;
blockdev.c +16 -0
@@ -467,6 +467,7 @@ static BlockBackend *blockdev_init(const char *file, QDict *bs_opts,const char *buf;int bdrv_flags =0 ;int on_read_error, on_write_error; +bool account_invalid, account_failed;BlockBackend *blk;BlockDriverState *bs;ThrottleConfig cfg;
@@ -503,6 +504,9 @@ static BlockBackend *blockdev_init(const char *file, QDict *bs_opts,/* extract parameters */ snapshot =qemu_opt_get_bool (opts,"snapshot" ,0 ); + account_invalid =qemu_opt_get_bool (opts,"stats-account-invalid" , true); + account_failed =qemu_opt_get_bool (opts,"stats-account-failed" , true); +extract_common_blockdev_options (opts, &bdrv_flags, &throttling_group, &cfg, &detect_zeroes, &error);if (error) {
@@ -599,6 +603,8 @@ static BlockBackend *blockdev_init(const char *file, QDict *bs_opts,if (bdrv_key_required (bs)) { autostart =0 ; } + +block_acct_init (blk_get_stats (blk), account_invalid, account_failed); }blk_set_on_error (blk, on_read_error, on_write_error);
@@ -3519,6 +3525,16 @@ QemuOptsList qemu_common_drive_opts = { .name = "detect-zeroes", .type = QEMU_OPT_STRING, .help = "try to optimize zero writes (off, on, unmap)", + },{ + .name = "stats-account-invalid", + .type = QEMU_OPT_BOOL, + .help = "whether to account for invalid I/O operations " + "in the statistics", + },{ + .name = "stats-account-failed", + .type = QEMU_OPT_BOOL, + .help = "whether to account for failed I/O operations " + "in the statistics", }, {/* end of list */ } },
include/block/accounting.h +5 -0
@@ -25,6 +25,7 @@#define BLOCK_ACCOUNTING_H #include <stdint.h> +#include <stdbool.h> #include "qemu/typedefs.h"
@@ -43,6 +44,8 @@ typedef struct BlockAcctStats {uint64_t total_time_ns[BLOCK_MAX_IOTYPE ];uint64_t merged[BLOCK_MAX_IOTYPE ];int64_t last_access_time_ns; +bool account_invalid; +bool account_failed; } BlockAcctStats; typedef struct BlockAcctCookie {
@@ -51,6 +54,8 @@ typedef struct BlockAcctCookie {enum BlockAcctType type; } BlockAcctCookie; +void block_acct_init (BlockAcctStats *stats,bool account_invalid, +bool account_failed);void block_acct_start (BlockAcctStats *stats,BlockAcctCookie *cookie,int64_t bytes,enum BlockAcctType type);void block_acct_done (BlockAcctStats *stats,BlockAcctCookie *cookie);
qapi/block-core.json +16 -1
@@ -470,6 +470,12 @@ # @invalid_flush_operations: The number of invalid flush operations # performed by the device (Since 2.5) # +# @account_invalid: Whether invalid operations are included in the +# last access statistics (Since 2.5) +# +# @account_failed: Whether failed operations are included in the +# latency and last access statistics (Since 2.5) +# # Since: 0.14.0 ## { 'struct': 'BlockDeviceStats',
@@ -480,7 +486,8 @@ 'rd_merged': 'int', 'wr_merged': 'int', '*idle_time_ns': 'int', 'failed_rd_operations': 'int', 'failed_wr_operations': 'int', 'failed_flush_operations': 'int', 'invalid_rd_operations': 'int', - 'invalid_wr_operations': 'int', 'invalid_flush_operations': 'int' } } + 'invalid_wr_operations': 'int', 'invalid_flush_operations': 'int', + 'account_invalid': 'bool', 'account_failed': 'bool' } } ## # @BlockStats:
@@ -1433,6 +1440,12 @@ # (default: enospc) # @read-only: #optional whether the block device should be read-only # (default: false) +# @stats-account-invalid: #optional whether to include invalid +# operations when computing last access statistics +# (default: true) (Since 2.5) +# @stats-account-failed: #optional whether to include failed +# operations when computing latency and last +# access statistics (default: true) (Since 2.5) # @detect-zeroes: #optional detect and optimize zero writes (Since 2.1) # (default: off) #
@@ -1448,6 +1461,8 @@ '*rerror': 'BlockdevOnError', '*werror': 'BlockdevOnError', '*read-only': 'bool', + '*stats-account-invalid': 'bool', + '*stats-account-failed': 'bool', '*detect-zeroes': 'BlockdevDetectZeroesOptions' } } ##
qmp-commands.hx +20 -5
@@ -2542,6 +2542,11 @@ Each json-object contain the following: (json-int) - "invalid_flush_operations": number of invalid flush operations (json-int) + - "account_invalid": whether invalid operations are included in + the last access statistics (json-bool) + - "account_failed": whether failed operations are included in the + latency and last access statistics + (json-bool) - "parent": Contains recursively the statistics of the underlying protocol (e.g. the host file for a qcow2 image). If there is no underlying protocol, this field is omitted
@@ -2567,7 +2572,9 @@ Example: "flush_operations":61, "rd_merged":0, "wr_merged":0, - "idle_time_ns":2953431879 + "idle_time_ns":2953431879, + "account_invalid":true, + "account_failed":false } }, "stats":{
@@ -2582,7 +2589,9 @@ Example: "flush_total_times_ns":49653, "rd_merged":0, "wr_merged":0, - "idle_time_ns":2953431879 + "idle_time_ns":2953431879, + "account_invalid":true, + "account_failed":false } }, {
@@ -2598,7 +2607,9 @@ Example: "rd_total_times_ns":0 "flush_total_times_ns":0, "rd_merged":0, - "wr_merged":0 + "wr_merged":0, + "account_invalid":false, + "account_failed":false } }, {
@@ -2614,7 +2625,9 @@ Example: "rd_total_times_ns":0 "flush_total_times_ns":0, "rd_merged":0, - "wr_merged":0 + "wr_merged":0, + "account_invalid":false, + "account_failed":false } }, {
@@ -2630,7 +2643,9 @@ Example: "rd_total_times_ns":0 "flush_total_times_ns":0, "rd_merged":0, - "wr_merged":0 + "wr_merged":0, + "account_invalid":false, + "account_failed":false } } ]
Signature · 1 line
2.6.1
PATCH v3 9/21 block: Add average I/O queue depth to BlockDeviceTimedStats
In reply to Alberto GarciaThis patch adds two new fields to BlockDeviceTimedStats that track the average number of pending read and write requests for a block device.
The values are calculated for the period of time defined for that interval.
--- block/accounting.c | 12 ++++++++++++ block/qapi.c | 5 +++++ include/block/accounting.h | 2 ++ include/qemu/timed-average.h | 1 + qapi/block-core.json | 9 ++++++++- qmp-commands.hx | 6 ++++++ util/timed-average.c | 17 +++++++++++++++++ 7 files changed, 51 insertions(+), 1 deletion(-)
block/accounting.c +12 -0
@@ -143,3 +143,15 @@ int64_t block_acct_idle_time_ns(BlockAcctStats *stats) {return qemu_clock_get_ns (clock_type) - stats->last_access_time_ns; } + +double block_acct_queue_depth (BlockAcctTimedStats *stats, +enum BlockAcctType type) +{ +uint64_t sum, elapsed; + +assert (type <BLOCK_MAX_IOTYPE ); + + sum =timed_average_sum (&stats->latency[type], &elapsed); + +return (double ) sum / elapsed; +}
block/qapi.c +5 -0
@@ -402,6 +402,11 @@ static BlockStats *bdrv_query_stats(const BlockDriverState *bs, dev_stats->min_flush_latency_ns =timed_average_min (fl); dev_stats->max_flush_latency_ns =timed_average_max (fl); dev_stats->avg_flush_latency_ns =timed_average_avg (fl); + + dev_stats->avg_rd_queue_depth = +block_acct_queue_depth (ts,BLOCK_ACCT_READ ); + dev_stats->avg_wr_queue_depth = +block_acct_queue_depth (ts,BLOCK_ACCT_WRITE ); } }
include/block/accounting.h +2 -0
@@ -78,5 +78,7 @@ void block_acct_invalid(BlockAcctStats *stats, enum BlockAcctType type);void block_acct_merge_done (BlockAcctStats *stats,enum BlockAcctType type,int num_requests);int64_t block_acct_idle_time_ns (BlockAcctStats *stats); +double block_acct_queue_depth (BlockAcctTimedStats *stats, +enum BlockAcctType type);#endif
include/qemu/timed-average.h +1 -0
@@ -59,5 +59,6 @@ void timed_average_account(TimedAverage *ta, uint64_t value);uint64_t timed_average_min (TimedAverage *ta);uint64_t timed_average_avg (TimedAverage *ta);uint64_t timed_average_max (TimedAverage *ta); +uint64_t timed_average_sum (TimedAverage *ta,uint64_t *elapsed);#endif
qapi/block-core.json +8 -1
@@ -450,6 +450,12 @@ # @avg_flush_latency_ns: Average latency of flush operations in the # defined interval, in nanoseconds. # +# @avg_rd_queue_depth: Average number of pending read operations +# in the defined interval. +# +# @avg_wr_queue_depth: Average number of pending write operations +# in the defined interval. +# # Since: 2.5 ##
@@ -458,7 +464,8 @@ 'max_rd_latency_ns': 'int', 'avg_rd_latency_ns': 'int', 'min_wr_latency_ns': 'int', 'max_wr_latency_ns': 'int', 'avg_wr_latency_ns': 'int', 'min_flush_latency_ns': 'int', - 'max_flush_latency_ns': 'int', 'avg_flush_latency_ns': 'int' } } + 'max_flush_latency_ns': 'int', 'avg_flush_latency_ns': 'int', + 'avg_rd_queue_depth': 'number', 'avg_wr_queue_depth': 'number' } } ## # @BlockDeviceStats:
qmp-commands.hx +6 -0
@@ -2578,6 +2578,12 @@ Each json-object contain the following: - "avg_flush_latency_ns": average latency of flush operations in the defined interval, in nanoseconds (json-int) + - "avg_rd_queue_depth": average number of pending read + operations in the defined interval + (json-number) + - "avg_wr_queue_depth": average number of pending write + operations in the defined interval + (json-number). - "parent": Contains recursively the statistics of the underlying protocol (e.g. the host file for a qcow2 image). If there is no underlying protocol, this field is omitted
util/timed-average.c +17 -0
@@ -208,3 +208,20 @@ uint64_t timed_average_max(TimedAverage *ta)check_expirations (ta);return current_window (ta)->max; } + +/* Get the sum of all accounted values +* @ta: the TimedAverage structure +* @elapsed: if non-NULL, the elapsed time (in ns) will be stored here +* @ret: the sum of all accounted values +*/ +uint64_t timed_average_sum (TimedAverage *ta,uint64_t *elapsed) +{ +TimedAverageWindow *w; +check_expirations (ta); + w =current_window (ta); +if (elapsed !=NULL ) { +int64_t remaining = w->expiration -qemu_clock_get_ns (ta->clock_type); + *elapsed = ta->period - remaining; + } +return w->sum; +}
Signature · 1 line
2.6.1
PATCH v3 8/21 block: Compute minimum, maximum and average I/O latencies
In reply to Alberto GarciaThis patch keeps track of the minimum, maximum and average latencies of I/O operations during a certain interval of time.
The values are exposed in the BlockDeviceTimedStats structure.
An option to define the intervals to collect these statistics will be added in a separate patch.
--- block/accounting.c | 43 ++++++++++++++++++++++++++++++++++++++ block/block-backend.c | 1 + block/qapi.c | 28 +++++++++++++++++++++++++ include/block/accounting.h | 14 +++++++++++++ qapi/block-core.json | 52 +++++++++++++++++++++++++++++++++++++++++++++- qmp-commands.hx | 31 +++++++++++++++++++++++++++ 6 files changed, 168 insertions(+), 1 deletion(-)
block/accounting.c +43 -0
@@ -35,6 +35,39 @@ void block_acct_init(BlockAcctStats *stats, bool account_invalid, stats->account_failed = account_failed; } +void block_acct_cleanup (BlockAcctStats *stats) +{ +BlockAcctTimedStats *s, *next; + QSLIST_FOREACH_SAFE(s, &stats->intervals, entries, next) { +g_free (s); + } +} + +void block_acct_add_interval (BlockAcctStats *stats,unsigned interval_length) +{ +BlockAcctTimedStats *s; +unsigned i; + + s =g_new0 (BlockAcctTimedStats,1 ); + s->interval_length = interval_length; +QSLIST_INSERT_HEAD (&stats->intervals, s, entries); + +for (i =0 ; i <BLOCK_MAX_IOTYPE ; i++) { +timed_average_init (&s->latency[i], clock_type, + (uint64_t ) interval_length *NANOSECONDS_PER_SECOND ); + } +} + +BlockAcctTimedStats *block_acct_interval_next (BlockAcctStats *stats, +BlockAcctTimedStats *s) +{ +if (s ==NULL ) { +return QSLIST_FIRST (&stats->intervals); + }else { +return QSLIST_NEXT (s, entries); + } +} +void block_acct_start (BlockAcctStats *stats,BlockAcctCookie *cookie,int64_t bytes,enum BlockAcctType type) {
@@ -47,6 +80,7 @@ void block_acct_start(BlockAcctStats *stats, BlockAcctCookie *cookie,void block_acct_done (BlockAcctStats *stats,BlockAcctCookie *cookie) { +BlockAcctTimedStats *s;int64_t time_ns =qemu_clock_get_ns (clock_type);int64_t latency_ns = time_ns - cookie->start_time_ns;
@@ -56,6 +90,10 @@ void block_acct_done(BlockAcctStats *stats, BlockAcctCookie *cookie) stats->nr_ops[cookie->type]++; stats->total_time_ns[cookie->type] += latency_ns; stats->last_access_time_ns = time_ns; + + QSLIST_FOREACH(s, &stats->intervals, entries) { +timed_average_account (&s->latency[cookie->type], latency_ns); + } }void block_acct_failed (BlockAcctStats *stats,BlockAcctCookie *cookie)
@@ -65,11 +103,16 @@ void block_acct_failed(BlockAcctStats *stats, BlockAcctCookie *cookie) stats->failed_ops[cookie->type]++;if (stats->account_failed) { +BlockAcctTimedStats *s;int64_t time_ns =qemu_clock_get_ns (clock_type);int64_t latency_ns = time_ns - cookie->start_time_ns; stats->total_time_ns[cookie->type] += latency_ns; stats->last_access_time_ns = time_ns; + + QSLIST_FOREACH(s, &stats->intervals, entries) { +timed_average_account (&s->latency[cookie->type], latency_ns); + } } }
block/block-backend.c +1 -0
@@ -176,6 +176,7 @@ static void blk_delete(BlockBackend *blk) }g_free (blk->name);drive_info_del (blk->legacy_dinfo); +block_acct_cleanup (&blk->stats);g_free (blk); }
block/qapi.c +28 -0
@@ -346,6 +346,7 @@ static BlockStats *bdrv_query_stats(const BlockDriverState *bs, s->stats =g_malloc0 (sizeof (*s->stats));if (bs->blk) {BlockAcctStats *stats =blk_get_stats (bs->blk); +BlockAcctTimedStats *ts =NULL ; s->stats->rd_bytes = stats->nr_bytes[BLOCK_ACCT_READ ]; s->stats->wr_bytes = stats->nr_bytes[BLOCK_ACCT_WRITE ];
@@ -375,6 +376,33 @@ static BlockStats *bdrv_query_stats(const BlockDriverState *bs, s->stats->account_invalid = stats->account_invalid; s->stats->account_failed = stats->account_failed; + +while ((ts =block_acct_interval_next (stats, ts))) { +BlockDeviceTimedStatsList *timed_stats = +g_malloc0 (sizeof (*timed_stats)); +BlockDeviceTimedStats *dev_stats =g_malloc0 (sizeof (*dev_stats)); + timed_stats->next = s->stats->timed_stats; + timed_stats->value = dev_stats; + s->stats->timed_stats = timed_stats; + +TimedAverage *rd = &ts->latency[BLOCK_ACCT_READ ]; +TimedAverage *wr = &ts->latency[BLOCK_ACCT_WRITE ]; +TimedAverage *fl = &ts->latency[BLOCK_ACCT_FLUSH ]; + + dev_stats->interval_length = ts->interval_length; + + dev_stats->min_rd_latency_ns =timed_average_min (rd); + dev_stats->max_rd_latency_ns =timed_average_max (rd); + dev_stats->avg_rd_latency_ns =timed_average_avg (rd); + + dev_stats->min_wr_latency_ns =timed_average_min (wr); + dev_stats->max_wr_latency_ns =timed_average_max (wr); + dev_stats->avg_wr_latency_ns =timed_average_avg (wr); + + dev_stats->min_flush_latency_ns =timed_average_min (fl); + dev_stats->max_flush_latency_ns =timed_average_max (fl); + dev_stats->avg_flush_latency_ns =timed_average_avg (fl); + } } s->stats->wr_highest_offset = bs->wr_highest_offset;
include/block/accounting.h +14 -0
@@ -28,6 +28,9 @@#include <stdbool.h> #include "qemu/typedefs.h" +#include "qemu/timed-average.h" + +typedef struct BlockAcctTimedStats BlockAcctTimedStats ;enum BlockAcctType {BLOCK_ACCT_READ ,
@@ -36,6 +39,12 @@ enum BlockAcctType { BLOCK_MAX_IOTYPE, }; +struct BlockAcctTimedStats { +TimedAverage latency[BLOCK_MAX_IOTYPE ]; +unsigned interval_length; +QSLIST_ENTRY (BlockAcctTimedStats) entries; +}; + typedef struct BlockAcctStats { uint64_t nr_bytes[BLOCK_MAX_IOTYPE]; uint64_t nr_ops[BLOCK_MAX_IOTYPE];
@@ -44,6 +53,7 @@ typedef struct BlockAcctStats {uint64_t total_time_ns[BLOCK_MAX_IOTYPE ];uint64_t merged[BLOCK_MAX_IOTYPE ];int64_t last_access_time_ns; + QSLIST_HEAD(, BlockAcctTimedStats) intervals;bool account_invalid;bool account_failed; } BlockAcctStats;
@@ -56,6 +66,10 @@ typedef struct BlockAcctCookie {void block_acct_init (BlockAcctStats *stats,bool account_invalid,bool account_failed); +void block_acct_cleanup (BlockAcctStats *stats); +void block_acct_add_interval (BlockAcctStats *stats,unsigned interval_length); +BlockAcctTimedStats *block_acct_interval_next (BlockAcctStats *stats, +BlockAcctTimedStats *s);void block_acct_start (BlockAcctStats *stats,BlockAcctCookie *cookie,int64_t bytes,enum BlockAcctType type);void block_acct_done (BlockAcctStats *stats,BlockAcctCookie *cookie);
qapi/block-core.json +51 -1
70 lines not on this page · raw message
qmp-commands.hx +31 -0
@@ -2547,6 +2547,37 @@ Each json-object contain the following: - "account_failed": whether failed operations are included in the latency and last access statistics (json-bool) + - "timed_stats": A json-array containing statistics collected in + specific intervals, with the following members: + - "interval_length": interval used for calculating the + statistics, in seconds (json-int) + - "min_rd_latency_ns": minimum latency of read operations in + the defined interval, in nanoseconds + (json-int) + - "min_wr_latency_ns": minimum latency of write operations in + the defined interval, in nanoseconds + (json-int) + - "min_flush_latency_ns": minimum latency of flush operations + in the defined interval, in + nanoseconds (json-int) + - "max_rd_latency_ns": maximum latency of read operations in + the defined interval, in nanoseconds + (json-int) + - "max_wr_latency_ns": maximum latency of write operations in + the defined interval, in nanoseconds + (json-int) + - "max_flush_latency_ns": maximum latency of flush operations + in the defined interval, in + nanoseconds (json-int) + - "avg_rd_latency_ns": average latency of read operations in + the defined interval, in nanoseconds + (json-int) + - "avg_wr_latency_ns": average latency of write operations in + the defined interval, in nanoseconds + (json-int) + - "avg_flush_latency_ns": average latency of flush operations + in the defined interval, in + nanoseconds (json-int) - "parent": Contains recursively the statistics of the underlying protocol (e.g. the host file for a qcow2 image). If there is no underlying protocol, this field is omitted
Signature · 1 line
2.6.1
PATCH v3 4/21 util: Infrastructure for computing recent averages
In reply to Alberto GarciaThis module computes the average of a set of values within a time window, keeping also track of the minimum and maximum values.
In order to produce more accurate results it works internally by creating two time windows of the same period, offsetted by half of that period. Values are accounted on both windows and the data is always returned from the oldest one.
--- include/qemu/timed-average.h | 63 +++++++++++++ tests/Makefile | 4 + tests/test-timed-average.c | 90 +++++++++++++++++++ util/Makefile.objs | 1 + util/timed-average.c | 210 +++++++++++++++++++++++++++++++++++++++++++ 5 files changed, 368 insertions(+) create mode 100644 include/qemu/timed-average.h create mode 100644 tests/test-timed-average.c create mode 100644 util/timed-average.c
include/qemu/timed-average.h new file +63 -0
@@ -0,0 +1,63 @@ +/* +* QEMU timed average computation +* +* Copyright (C) Nodalink, EURL. 2014 +* Copyright (C) Igalia, S.L. 2015 +* +* Authors: +* Benoît Canet <[email protected]> +* Alberto Garcia <[email protected]> +* +* This program is free software: you can redistribute it and/or modify +* it under the terms of the GNU General Public License as published by +* the Free Software Foundation, either version 2 of the License, or +* (at your option) version 3 or any later version. +* +* This program is distributed in the hope that it will be useful, +* but WITHOUT ANY WARRANTY; without even the implied warranty of +* MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +* GNU General Public License for more details. +* +* You should have received a copy of the GNU General Public License +* along with this program. If not, see <http://www.gnu.org/licenses/>. +*/ + +#ifndef TIMED_AVERAGE_H +#define TIMED_AVERAGE_H + +#include <stdint.h> + +#include "qemu/timer.h" + +typedef struct TimedAverageWindow TimedAverageWindow ; +typedef struct TimedAverage TimedAverage ; + +/* All fields of both structures are private */ + +struct TimedAverageWindow { +uint64_t min;/* minimum value accounted in the window */ +uint64_t max;/* maximum value accounted in the window */ +uint64_t sum;/* sum of all values */ +uint64_t count;/* number of values */ +int64_t expiration;/* the end of the current window in ns */ +}; + +struct TimedAverage { +uint64_t period;/* period in nanoseconds */ +TimedAverageWindow windows[2 ];/* two overlapping windows of with +* an offset of period / 2 between them */ +unsigned current;/* the current window index: it's also the +* oldest window index */ +QEMUClockType clock_type;/* the clock used */ +}; + +void timed_average_init (TimedAverage *ta,QEMUClockType clock_type, +uint64_t period); + +void timed_average_account (TimedAverage *ta,uint64_t value); + +uint64_t timed_average_min (TimedAverage *ta); +uint64_t timed_average_avg (TimedAverage *ta); +uint64_t timed_average_max (TimedAverage *ta); + +#endif
tests/Makefile +4 -0
@@ -81,6 +81,7 @@ check-unit-y += tests/test-crypto-cipher$(EXESUF) check-unit-$(CONFIG_GNUTLS) += tests/test-crypto-tlscredsx509$(EXESUF) check-unit-$(CONFIG_GNUTLS) += tests/test-crypto-tlssession$(EXESUF) check-unit-$(CONFIG_LINUX) += tests/test-qga$(EXESUF) +check-unit-y += tests/test-timed-average$(EXESUF) check-block-$(CONFIG_POSIX) += tests/qemu-iotests-quick.sh
@@ -403,6 +404,9 @@ tests/test-vmstate$(EXESUF): tests/test-vmstate.o \ migration/vmstate.o migration/qemu-file.o migration/qemu-file-buf.o \ migration/qemu-file-unix.o qjson.o \ $(test-qom-obj-y) +tests/test-timed-average$(EXESUF): tests/test-timed-average.o qemu-timer.o \ + libqemuutil.a stubs/clock-warp.o stubs/cpu-get-icount.o \ + stubs/notify-event.o tests/test-qapi-types.c tests/test-qapi-types.h :\ $(SRC_PATH)/tests/qapi-schema/qapi-schema-test.json $(SRC_PATH)/scripts/qapi-types.py $(qapi-py)
tests/test-timed-average.c new file +90 -0
90 lines not on this page · raw message
util/Makefile.objs +1 -0
@@ -18,3 +18,4 @@ util-obj-y += getauxval.o util-obj-y += readline.o util-obj-y += rfifolock.o util-obj-y += rcu.o +util-obj-y += timed-average.o
util/timed-average.c new file +210 -0
210 lines not on this page · raw message
Signature · 1 line
2.6.1
PATCH v3 21/21 block: Update copyright of the accounting code
In reply to Alberto Garcia--- block/accounting.c | 1 + include/block/accounting.h | 1 + 2 files changed, 2 insertions(+)
block/accounting.c +1 -0
@@ -2,6 +2,7 @@* QEMU System Emulator block accounting * * Copyright (c) 2011 Christoph Hellwig +* Copyright (c) 2015 Igalia, S.L. * * Permission is hereby granted, free of charge, to any person obtaining a copy * of this software and associated documentation files (the "Software"), to deal
include/block/accounting.h +1 -0
@@ -2,6 +2,7 @@* QEMU System Emulator block accounting * * Copyright (c) 2011 Christoph Hellwig +* Copyright (c) 2015 Igalia, S.L. * * Permission is hereby granted, free of charge, to any person obtaining a copy * of this software and associated documentation files (the "Software"), to deal
Signature · 1 line
2.6.1
PATCH v3 15/21 virtio-blk: Account for failed and invalid operations
In reply to Alberto Garcia--- hw/block/virtio-blk.c | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-)
hw/block/virtio-blk.c +3 -1
@@ -76,7 +76,7 @@ static int virtio_blk_handle_rw_error(VirtIOBlockReq *req, int error, s->rq = req; }else if (action ==BLOCK_ERROR_ACTION_REPORT ) {virtio_blk_req_complete (req,VIRTIO_BLK_S_IOERR ); -block_acct_done (blk_get_stats (s->blk), &req->acct); +block_acct_failed (blk_get_stats (s->blk), &req->acct);virtio_blk_free_request (req); }
@@ -536,6 +536,8 @@ void virtio_blk_handle_request(VirtIOBlockReq *req, MultiReqBuffer *mrb)if (!virtio_blk_sect_range_ok (req->dev, req->sector_num, req->qiov.size)) {virtio_blk_req_complete (req,VIRTIO_BLK_S_IOERR ); +block_acct_invalid (blk_get_stats (req->dev->blk), + is_write ?BLOCK_ACCT_WRITE :BLOCK_ACCT_READ );virtio_blk_free_request (req);return ; }
Signature · 1 line
2.6.1
PATCH v3 12/21 block: Use QEMU_CLOCK_VIRTUAL for the accounting code in qtest mode
In reply to Alberto GarciaThis patch switches to QEMU_CLOCK_VIRTUAL for the accounting code in qtest mode, and makes the latency of the operation constant. This way we can perform tests on the accounting code with reproducible results.
--- block/accounting.c | 14 ++++++++++++++ 1 file changed, 14 insertions(+)
block/accounting.c +14 -0
@@ -25,14 +25,20 @@#include "block/accounting.h" #include "block/block_int.h" #include "qemu/timer.h" +#include "sysemu/qtest.h" static QEMUClockType clock_type =QEMU_CLOCK_REALTIME ; +static const int qtest_latency_ns =NANOSECONDS_PER_SECOND /1000 ;void block_acct_init (BlockAcctStats *stats,bool account_invalid,bool account_failed) { stats->account_invalid = account_invalid; stats->account_failed = account_failed; + +if (qtest_enabled ()) { + clock_type =QEMU_CLOCK_VIRTUAL ; + } }void block_acct_cleanup (BlockAcctStats *stats)
@@ -84,6 +90,10 @@ void block_acct_done(BlockAcctStats *stats, BlockAcctCookie *cookie)int64_t time_ns =qemu_clock_get_ns (clock_type);int64_t latency_ns = time_ns - cookie->start_time_ns; +if (qtest_enabled ()) { + latency_ns = qtest_latency_ns; + } +assert (cookie->type <BLOCK_MAX_IOTYPE ); stats->nr_bytes[cookie->type] += cookie->bytes;
@@ -107,6 +117,10 @@ void block_acct_failed(BlockAcctStats *stats, BlockAcctCookie *cookie)int64_t time_ns =qemu_clock_get_ns (clock_type);int64_t latency_ns = time_ns - cookie->start_time_ns; +if (qtest_enabled ()) { + latency_ns = qtest_latency_ns; + } + stats->total_time_ns[cookie->type] += latency_ns; stats->last_access_time_ns = time_ns;
Signature · 1 line
2.6.1
PATCH v3 14/21 nvme: Account for failed and invalid operations
In reply to Alberto Garcia--- hw/block/nvme.c | 11 ++++++++--- 1 file changed, 8 insertions(+), 3 deletions(-)
hw/block/nvme.c +8 -3
@@ -201,10 +201,11 @@ static void nvme_rw_cb(void *opaque, int ret)NvmeCtrl *n = sq->ctrl;NvmeCQueue *cq = n->cq[sq->cqid]; -block_acct_done (blk_get_stats (n->conf.blk), &req->acct);if (!ret) { +block_acct_done (blk_get_stats (n->conf.blk), &req->acct); req->status =NVME_SUCCESS ; }else { +block_acct_failed (blk_get_stats (n->conf.blk), &req->acct); req->status =NVME_INTERNAL_DEV_ERROR ; }if (req->has_sg) {
@@ -238,18 +239,22 @@ static uint16_t nvme_rw(NvmeCtrl *n, NvmeNamespace *ns, NvmeCmd *cmd,uint64_t data_size = (uint64_t )nlb << data_shift;uint64_t aio_slba = slba << (data_shift -BDRV_SECTOR_BITS );int is_write = rw->opcode ==NVME_CMD_WRITE ?1 :0 ; +enum BlockAcctType acct = is_write ?BLOCK_ACCT_WRITE :BLOCK_ACCT_READ ;if ((slba + nlb) > ns->id_ns.nsze) { +block_acct_invalid (blk_get_stats (n->conf.blk), acct);return NVME_LBA_RANGE |NVME_DNR ; } +if (nvme_map_prp (&req->qsg, prp1, prp2, data_size, n)) { +block_acct_invalid (blk_get_stats (n->conf.blk), acct);return NVME_INVALID_FIELD |NVME_DNR ; } +assert ((nlb << data_shift) == req->qsg.size); req->has_sg = true; -dma_acct_start (n->conf.blk, &req->acct, &req->qsg, - is_write ?BLOCK_ACCT_WRITE :BLOCK_ACCT_READ ); +dma_acct_start (n->conf.blk, &req->acct, &req->qsg, acct); req->aiocb = is_write ?dma_blk_write (n->conf.blk, &req->qsg, aio_slba, nvme_rw_cb, req) :dma_blk_read (n->conf.blk, &req->qsg, aio_slba, nvme_rw_cb, req);
Signature · 1 line
2.6.1
PATCH v3 17/21 atapi: Account for failed and invalid operations
In reply to Alberto Garcia--- hw/ide/atapi.c | 31 +++++++++++++++++++------------ 1 file changed, 19 insertions(+), 12 deletions(-)
hw/ide/atapi.c +19 -12
@@ -108,27 +108,30 @@ static void cd_data_to_raw(uint8_t *buf, int lba)static int cd_read_sector (IDEState *s,int lba,uint8_t *buf,int sector_size) {int ret; +block_acct_start (blk_get_stats (s->blk), &s->acct, +4 *BDRV_SECTOR_SIZE ,BLOCK_ACCT_READ );switch (sector_size) {case 2048 : -block_acct_start (blk_get_stats (s->blk), &s->acct, -4 *BDRV_SECTOR_SIZE ,BLOCK_ACCT_READ ); ret =blk_read (s->blk, (int64_t )lba <<2 , buf,4 ); -block_acct_done (blk_get_stats (s->blk), &s->acct);break ;case 2352 : -block_acct_start (blk_get_stats (s->blk), &s->acct, -4 *BDRV_SECTOR_SIZE ,BLOCK_ACCT_READ ); ret =blk_read (s->blk, (int64_t )lba <<2 , buf +16 ,4 ); -block_acct_done (blk_get_stats (s->blk), &s->acct); -if (ret <0 ) -return ret; -cd_data_to_raw (buf, lba); +if (ret >=0 ) { +cd_data_to_raw (buf, lba); + }break ;default : - ret = -EIO ; -break ; +block_acct_invalid (blk_get_stats (s->blk),BLOCK_ACCT_READ ); +return -EIO ; } + +if (ret <0 ) { +block_acct_failed (blk_get_stats (s->blk), &s->acct); + }else { +block_acct_done (blk_get_stats (s->blk), &s->acct); + } +return ret; }
@@ -357,7 +360,11 @@ static void ide_atapi_cmd_read_dma_cb(void *opaque, int ret)return ; eot: -block_acct_done (blk_get_stats (s->blk), &s->acct); +if (ret <0 ) { +block_acct_failed (blk_get_stats (s->blk), &s->acct); + }else { +block_acct_done (blk_get_stats (s->blk), &s->acct); + }ide_set_inactive (s, false); }
Signature · 1 line
2.6.1
PATCH v3 18/21 ide: Account for failed and invalid operations
In reply to Alberto Garcia--- hw/ide/core.c | 10 ++++++++-- 1 file changed, 8 insertions(+), 2 deletions(-)
hw/ide/core.c +8 -2
@@ -574,7 +574,6 @@ static void ide_sector_read_cb(void *opaque, int ret)if (ret == -ECANCELED ) {return ; } -block_acct_done (blk_get_stats (s->blk), &s->acct);if (ret !=0 ) {if (ide_handle_rw_error (s, -ret,IDE_RETRY_PIO |IDE_RETRY_READ )) {
@@ -582,6 +581,8 @@ static void ide_sector_read_cb(void *opaque, int ret) } } +block_acct_done (blk_get_stats (s->blk), &s->acct); + n = s->nsector;if (n > s->req_nb_sectors) { n = s->req_nb_sectors;
@@ -621,6 +622,7 @@ static void ide_sector_read(IDEState *s)if (!ide_sect_range_ok (s, sector_num, n)) {ide_rw_error (s); +block_acct_invalid (blk_get_stats (s->blk),BLOCK_ACCT_READ );return ; }
@@ -672,6 +674,7 @@ static int ide_handle_rw_error(IDEState *s, int error, int op)assert (s->bus->retry_unit == s->unit); s->bus->error_status = op; }else if (action ==BLOCK_ERROR_ACTION_REPORT ) { +block_acct_failed (blk_get_stats (s->blk), &s->acct);if (op &IDE_RETRY_DMA ) {ide_dma_error (s); }else {
@@ -750,6 +753,7 @@ static void ide_dma_cb(void *opaque, int ret)if ((s->dma_cmd ==IDE_DMA_READ || s->dma_cmd ==IDE_DMA_WRITE ) && !ide_sect_range_ok (s, sector_num, n)) {ide_dma_error (s); +block_acct_invalid (blk_get_stats (s->blk), s->acct.type);return ; }
@@ -826,7 +830,6 @@ static void ide_sector_write_cb(void *opaque, int ret)if (ret == -ECANCELED ) {return ; } -block_acct_done (blk_get_stats (s->blk), &s->acct); s->pio_aiocb =NULL ; s->status &= ~BUSY_STAT ;
@@ -837,6 +840,8 @@ static void ide_sector_write_cb(void *opaque, int ret) } } +block_acct_done (blk_get_stats (s->blk), &s->acct); + n = s->nsector;if (n > s->req_nb_sectors) { n = s->req_nb_sectors;
@@ -887,6 +892,7 @@ static void ide_sector_write(IDEState *s)if (!ide_sect_range_ok (s, sector_num, n)) {ide_rw_error (s); +block_acct_invalid (blk_get_stats (s->blk),BLOCK_ACCT_WRITE );return ; }
Signature · 1 line
2.6.1
PATCH v3 19/21 macio: Account for failed operations
In reply to Alberto Garcia--- hw/ide/macio.c | 12 ++++++++++-- 1 file changed, 10 insertions(+), 2 deletions(-)
hw/ide/macio.c +10 -2
@@ -286,7 +286,11 @@ static void pmac_ide_atapi_transfer_cb(void *opaque, int ret)return ; done: -block_acct_done (blk_get_stats (s->blk), &s->acct); +if (ret <0 ) { +block_acct_failed (blk_get_stats (s->blk), &s->acct); + }else { +block_acct_done (blk_get_stats (s->blk), &s->acct); + } io->dma_end (opaque);return ;
@@ -348,7 +352,11 @@ static void pmac_ide_transfer_cb(void *opaque, int ret) done:if (s->dma_cmd ==IDE_DMA_READ || s->dma_cmd ==IDE_DMA_WRITE ) { -block_acct_done (blk_get_stats (s->blk), &s->acct); +if (ret <0 ) { +block_acct_failed (blk_get_stats (s->blk), &s->acct); + }else { +block_acct_done (blk_get_stats (s->blk), &s->acct); + } } io->dma_end (opaque); }
Signature · 1 line
2.6.1
PATCH v3 20/21 scsi-disk: Account for failed operations
In reply to Alberto Garcia--- hw/scsi/scsi-disk.c | 46 +++++++++++++++++++++++++++++++--------------- 1 file changed, 31 insertions(+), 15 deletions(-)
hw/scsi/scsi-disk.c +31 -15
@@ -90,7 +90,7 @@ struct SCSIDiskStatebool tray_locked; }; -static int scsi_handle_rw_error (SCSIDiskReq *r,int error); +static int scsi_handle_rw_error (SCSIDiskReq *r,int error,bool acct_failed);static void scsi_free_request (SCSIRequest *req) {
@@ -169,18 +169,18 @@ static void scsi_aio_complete(void *opaque, int ret)assert (r->req.aiocb !=NULL ); r->req.aiocb =NULL ; -block_acct_done (blk_get_stats (s->qdev.conf.blk), &r->acct);if (r->req.io_canceled) {scsi_req_cancel_complete (&r->req); goto done; }if (ret <0 ) { -if (scsi_handle_rw_error (r, -ret)) { +if (scsi_handle_rw_error (r, -ret, true)) { goto done; } } +block_acct_done (blk_get_stats (s->qdev.conf.blk), &r->acct);scsi_req_complete (&r->req,GOOD ); done:
@@ -247,7 +247,7 @@ static void scsi_dma_complete_noio(SCSIDiskReq *r, int ret) }if (ret <0 ) { -if (scsi_handle_rw_error (r, -ret)) { +if (scsi_handle_rw_error (r, -ret, false)) { goto done; } }
@@ -273,7 +273,11 @@ static void scsi_dma_complete(void *opaque, int ret)assert (r->req.aiocb !=NULL ); r->req.aiocb =NULL ; -block_acct_done (blk_get_stats (s->qdev.conf.blk), &r->acct); +if (ret <0 ) { +block_acct_failed (blk_get_stats (s->qdev.conf.blk), &r->acct); + }else { +block_acct_done (blk_get_stats (s->qdev.conf.blk), &r->acct); + }scsi_dma_complete_noio (r, ret); }
@@ -285,18 +289,18 @@ static void scsi_read_complete(void * opaque, int ret)assert (r->req.aiocb !=NULL ); r->req.aiocb =NULL ; -block_acct_done (blk_get_stats (s->qdev.conf.blk), &r->acct);if (r->req.io_canceled) {scsi_req_cancel_complete (&r->req); goto done; }if (ret <0 ) { -if (scsi_handle_rw_error (r, -ret)) { +if (scsi_handle_rw_error (r, -ret, true)) { goto done; } } +block_acct_done (blk_get_stats (s->qdev.conf.blk), &r->acct);DPRINTF ("Data ready tag=0x%x len=%zd\n" , r->req.tag, r->qiov.size); n = r->qiov.size /512 ;
@@ -322,7 +326,7 @@ static void scsi_do_read(SCSIDiskReq *r, int ret) }if (ret <0 ) { -if (scsi_handle_rw_error (r, -ret)) { +if (scsi_handle_rw_error (r, -ret, false)) { goto done; } }
@@ -355,7 +359,11 @@ static void scsi_do_read_cb(void *opaque, int ret)assert (r->req.aiocb !=NULL ); r->req.aiocb =NULL ; -block_acct_done (blk_get_stats (s->qdev.conf.blk), &r->acct); +if (ret <0 ) { +block_acct_failed (blk_get_stats (s->qdev.conf.blk), &r->acct); + }else { +block_acct_done (blk_get_stats (s->qdev.conf.blk), &r->acct); + }scsi_do_read (opaque, ret); }
@@ -407,7 +415,7 @@ static void scsi_read_data(SCSIRequest *req)* scsi_handle_rw_error always manages its reference counts, independent * of the return value. */ -static int scsi_handle_rw_error (SCSIDiskReq *r,int error) +static int scsi_handle_rw_error (SCSIDiskReq *r,int error,bool acct_failed) {bool is_read = (r->req.cmd.mode ==SCSI_XFER_FROM_DEV );SCSIDiskState *s =DO_UPCAST (SCSIDiskState, qdev, r->req.dev);
@@ -415,6 +423,9 @@ static int scsi_handle_rw_error(SCSIDiskReq *r, int error) is_read, error);if (action ==BLOCK_ERROR_ACTION_REPORT ) { +if (acct_failed) { +block_acct_failed (blk_get_stats (s->qdev.conf.blk), &r->acct); + }switch (error) {case ENOMEDIUM :scsi_check_condition (r,SENSE_CODE (NO_MEDIUM ));
@@ -452,7 +463,7 @@ static void scsi_write_complete_noio(SCSIDiskReq *r, int ret) }if (ret <0 ) { -if (scsi_handle_rw_error (r, -ret)) { +if (scsi_handle_rw_error (r, -ret, false)) { goto done; } }
@@ -481,7 +492,11 @@ static void scsi_write_complete(void * opaque, int ret)assert (r->req.aiocb !=NULL ); r->req.aiocb =NULL ; -block_acct_done (blk_get_stats (s->qdev.conf.blk), &r->acct); +if (ret <0 ) { +block_acct_failed (blk_get_stats (s->qdev.conf.blk), &r->acct); + }else { +block_acct_done (blk_get_stats (s->qdev.conf.blk), &r->acct); + }scsi_write_complete_noio (r, ret); }
@@ -1592,7 +1607,7 @@ static void scsi_unmap_complete_noio(UnmapCBData *data, int ret) }if (ret <0 ) { -if (scsi_handle_rw_error (r, -ret)) { +if (scsi_handle_rw_error (r, -ret, false)) { goto done; } }
@@ -1696,18 +1711,19 @@ static void scsi_write_same_complete(void *opaque, int ret)assert (r->req.aiocb !=NULL ); r->req.aiocb =NULL ; -block_acct_done (blk_get_stats (s->qdev.conf.blk), &r->acct);if (r->req.io_canceled) {scsi_req_cancel_complete (&r->req); goto done; }if (ret <0 ) { -if (scsi_handle_rw_error (r, -ret)) { +if (scsi_handle_rw_error (r, -ret, true)) { goto done; } } +block_acct_done (blk_get_stats (s->qdev.conf.blk), &r->acct); + data->nb_sectors -= data->iov.iov_len /512 ; data->sector += data->iov.iov_len /512 ; data->iov.iov_len =MIN (data->nb_sectors *512 , data->iov.iov_len);
Signature · 1 line
2.6.1
PATCH v3 11/21 qemu-io: Account for failed, invalid and flush operations
In reply to Alberto Garcia--- qemu-io-cmds.c | 9 +++++++++ 1 file changed, 9 insertions(+)
qemu-io-cmds.c +9 -0
@@ -1364,6 +1364,7 @@ static void aio_write_done(void *opaque, int ret)if (ret <0 ) {printf ("aio_write failed: %s\n" ,strerror (-ret)); +block_acct_failed (blk_get_stats (ctx->blk), &ctx->acct); goto out; }
@@ -1392,6 +1393,7 @@ static void aio_read_done(void *opaque, int ret)if (ret <0 ) {printf ("readv failed: %s\n" ,strerror (-ret)); +block_acct_failed (blk_get_stats (ctx->blk), &ctx->acct); goto out; }
@@ -1505,6 +1507,7 @@ static int aio_read_f(BlockBackend *blk, int argc, char **argv)if (ctx->offset &0x1ff ) {printf ("offset %" PRId64" is not sector aligned\n" , ctx->offset); +block_acct_invalid (blk_get_stats (blk),BLOCK_ACCT_READ );g_free (ctx);return 0 ; }
@@ -1512,6 +1515,7 @@ static int aio_read_f(BlockBackend *blk, int argc, char **argv) nr_iov = argc - optind; ctx->buf =create_iovec (blk, &ctx->qiov, &argv[optind], nr_iov,0xab );if (ctx->buf ==NULL ) { +block_acct_invalid (blk_get_stats (blk),BLOCK_ACCT_READ );g_free (ctx);return 0 ; }
@@ -1600,6 +1604,7 @@ static int aio_write_f(BlockBackend *blk, int argc, char **argv)if (ctx->offset &0x1ff ) {printf ("offset %" PRId64" is not sector aligned\n" , ctx->offset); +block_acct_invalid (blk_get_stats (blk),BLOCK_ACCT_WRITE );g_free (ctx);return 0 ; }
@@ -1607,6 +1612,7 @@ static int aio_write_f(BlockBackend *blk, int argc, char **argv) nr_iov = argc - optind; ctx->buf =create_iovec (blk, &ctx->qiov, &argv[optind], nr_iov, pattern);if (ctx->buf ==NULL ) { +block_acct_invalid (blk_get_stats (blk),BLOCK_ACCT_WRITE );g_free (ctx);return 0 ; }
@@ -1621,7 +1627,10 @@ static int aio_write_f(BlockBackend *blk, int argc, char **argv)static int aio_flush_f (BlockBackend *blk,int argc,char **argv) { +BlockAcctCookie cookie; +block_acct_start (blk_get_stats (blk), &cookie,0 ,BLOCK_ACCT_FLUSH );blk_drain_all (); +block_acct_done (blk_get_stats (blk), &cookie);return 0 ; }
Signature · 1 line
2.6.1
PATCH v3 13/21 iotests: Add test for the block device statistics
In reply to Alberto Garcia--- tests/qemu-iotests/136 | 349 +++++++++++++++++++++++++++++++++++++++++++++ tests/qemu-iotests/136.out | 5 + tests/qemu-iotests/group | 1 + 3 files changed, 355 insertions(+) create mode 100644 tests/qemu-iotests/136 create mode 100644 tests/qemu-iotests/136.out
tests/qemu-iotests/136 new file +349 -0
@@ -0,0 +1,349 @@ +#!/usr/bin/env python +# +# Tests for block device statistics +# +# Copyright (C) 2015 Igalia, S.L. +# Author: Alberto Garcia <[email protected]> +# +# This program is free software; you can redistribute it and/or modify +# it under the terms of the GNU General Public License as published by +# the Free Software Foundation; either version 2 of the License, or +# (at your option) any later version. +# +# This program is distributed in the hope that it will be useful, +# but WITHOUT ANY WARRANTY; without even the implied warranty of +# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +# GNU General Public License for more details. +# +# You should have received a copy of the GNU General Public License +# along with this program. If not, see <http://www.gnu.org/licenses/>. +# + +import iotests +import os + +interval_length = 10 +nsec_per_sec = 1000000000 +op_latency = nsec_per_sec / 1000 # See qtest_latency_ns in accounting.c +bad_sector = 8192 +bad_offset = bad_sector * 512 +blkdebug_file = os.path.join(iotests.test_dir, 'blkdebug.conf') + +class BlockDeviceStatsTestCase(iotests.QMPTestCase): + test_img = "null-aio://" + total_rd_bytes = 0 + total_rd_ops = 0 + total_wr_bytes = 0 + total_wr_ops = 0 + total_wr_merged = 0 + total_flush_ops = 0 + failed_rd_ops = 0 + failed_wr_ops = 0 + invalid_rd_ops = 0 + invalid_wr_ops = 0 + wr_highest_offset = 0 + account_invalid = False + account_failed = False + + def blockstats(self, device): + result = self.vm.qmp("query-blockstats") + for r in result['return']: + if r['device'] == device: + return r['stats'] + raise Exception("Device not found for blockstats: %s" % device) + + def create_blkdebug_file(self): + file = open(blkdebug_file, 'w') + file.write(''' +[inject-error] +event = "read_aio" +errno = "5" +sector = "%d" + +[inject-error] +event = "write_aio" +errno = "5" +sector = "%d" +''' % (bad_sector, bad_sector)) + file.close() + + def setUp(self): + drive_args = [] + drive_args.append("stats-intervals=%d" % interval_length) + drive_args.append("stats-account-invalid=%s" % + (self.account_invalid and "on" or "off")) + drive_args.append("stats-account-failed=%s" % + (self.account_failed and "on" or "off")) + self.create_blkdebug_file() + self.vm = iotests.VM().add_drive('blkdebug:%s:%s ' % + (blkdebug_file, self.test_img), + ','.join(drive_args)) + self.vm.launch() + # Set an initial value for the clock + self.vm.qtest("clock_step %d" % nsec_per_sec) + + def tearDown(self): + self.vm.shutdown() + os.remove(blkdebug_file) + + def accounted_ops(self, read = False, write = False, flush = False): + ops = 0 + if write: + ops += self.total_wr_ops + if self.account_failed: + ops += self.failed_wr_ops + if self.account_invalid: + ops += self.invalid_wr_ops + if read: + ops += self.total_rd_ops + if self.account_failed: + ops += self.failed_rd_ops + if self.account_invalid: + ops += self.invalid_rd_ops + if flush: + ops += self.total_flush_ops + return ops + + def accounted_latency(self, read = False, write = False, flush = False): + latency = 0 + if write: + latency += self.total_wr_ops * op_latency + if self.account_failed: + latency += self.failed_wr_ops * op_latency + if read: + latency += self.total_rd_ops * op_latency + if self.account_failed: + latency += self.failed_rd_ops * op_latency + if flush: + latency += self.total_flush_ops * op_latency + return latency + + def check_values(self): + stats = self.blockstats('drive0') + + # Check that the totals match with what we have calculated + self.assertEqual(self.total_rd_bytes, stats['rd_bytes']) + self.assertEqual(self.total_wr_bytes, stats['wr_bytes']) + self.assertEqual(self.total_rd_ops, stats['rd_operations']) + self.assertEqual(self.total_wr_ops, stats['wr_operations']) + self.assertEqual(self.total_flush_ops, stats['flush_operations']) + self.assertEqual(self.wr_highest_offset, stats['wr_highest_offset']) + self.assertEqual(self.failed_rd_ops, stats['failed_rd_operations']) + self.assertEqual(self.failed_wr_ops, stats['failed_wr_operations']) + self.assertEqual(self.invalid_rd_ops, stats['invalid_rd_operations']) + self.assertEqual(self.invalid_wr_ops, stats['invalid_wr_operations']) + self.assertEqual(self.account_invalid, stats['account_invalid']) + self.assertEqual(self.account_failed, stats['account_failed']) + self.assertEqual(self.total_wr_merged, stats['wr_merged']) + + # Check that there's exactly one interval with the length we defined + self.assertEqual(1, len(stats['timed_stats'])) + timed_stats = stats['timed_stats'][0] + self.assertEqual(interval_length, timed_stats['interval_length']) + + total_rd_latency = self.accounted_latency(read = True) + if (total_rd_latency != 0): + self.assertEqual(total_rd_latency, stats['rd_total_time_ns']) + self.assertEqual(op_latency, timed_stats['min_rd_latency_ns']) + self.assertEqual(op_latency, timed_stats['max_rd_latency_ns']) + self.assertEqual(op_latency, timed_stats['avg_rd_latency_ns']) + self.assertLess(0, timed_stats['avg_rd_queue_depth']) + else: + self.assertEqual(0, stats['rd_total_time_ns']) + self.assertEqual(0, timed_stats['min_rd_latency_ns']) + self.assertEqual(0, timed_stats['max_rd_latency_ns']) + self.assertEqual(0, timed_stats['avg_rd_latency_ns']) + self.assertEqual(0, timed_stats['avg_rd_queue_depth']) + + # min read latency <= avg read latency <= max read latency + self.assertLessEqual(timed_stats['min_rd_latency_ns'], + timed_stats['avg_rd_latency_ns']) + self.assertLessEqual(timed_stats['avg_rd_latency_ns'], + timed_stats['max_rd_latency_ns']) + + total_wr_latency = self.accounted_latency(write = True) + if (total_wr_latency != 0): + self.assertEqual(total_wr_latency, stats['wr_total_time_ns']) + self.assertEqual(op_latency, timed_stats['min_wr_latency_ns']) + self.assertEqual(op_latency, timed_stats['max_wr_latency_ns']) + self.assertEqual(op_latency, timed_stats['avg_wr_latency_ns']) + self.assertLess(0, timed_stats['avg_wr_queue_depth']) + else: + self.assertEqual(0, stats['wr_total_time_ns']) + self.assertEqual(0, timed_stats['min_wr_latency_ns']) + self.assertEqual(0, timed_stats['max_wr_latency_ns']) + self.assertEqual(0, timed_stats['avg_wr_latency_ns']) + self.assertEqual(0, timed_stats['avg_wr_queue_depth']) + + # min write latency <= avg write latency <= max write latency + self.assertLessEqual(timed_stats['min_wr_latency_ns'], + timed_stats['avg_wr_latency_ns']) + self.assertLessEqual(timed_stats['avg_wr_latency_ns'], + timed_stats['max_wr_latency_ns']) + + total_flush_latency = self.accounted_latency(flush = True) + if (total_flush_latency != 0): + self.assertEqual(total_flush_latency, stats['flush_total_time_ns']) + self.assertEqual(op_latency, timed_stats['min_flush_latency_ns']) + self.assertEqual(op_latency, timed_stats['max_flush_latency_ns']) + self.assertEqual(op_latency, timed_stats['avg_flush_latency_ns']) + else: + self.assertEqual(0, stats['flush_total_time_ns']) + self.assertEqual(0, timed_stats['min_flush_latency_ns']) + self.assertEqual(0, timed_stats['max_flush_latency_ns']) + self.assertEqual(0, timed_stats['avg_flush_latency_ns']) + + # min flush latency <= avg flush latency <= max flush latency + self.assertLessEqual(timed_stats['min_flush_latency_ns'], + timed_stats['avg_flush_latency_ns']) + self.assertLessEqual(timed_stats['avg_flush_latency_ns'], + timed_stats['max_flush_latency_ns']) + + # idle_time_ns must be > 0 if we have performed any operation + if (self.accounted_ops(read = True, write = True, flush = True) != 0): + self.assertLess(0, stats['idle_time_ns']) + else: + self.assertFalse(stats.has_key('idle_time_ns')) + + # This test does not alter these, so they must be all 0 + self.assertEqual(0, stats['rd_merged']) + self.assertEqual(0, stats['failed_flush_operations']) + self.assertEqual(0, stats['invalid_flush_operations']) + + def do_test_stats(self, rd_size = 0, rd_ops = 0, wr_size = 0, wr_ops = 0, + flush_ops = 0, invalid_rd_ops = 0, invalid_wr_ops = 0, + failed_rd_ops = 0, failed_wr_ops = 0, wr_merged = 0): + # The 'ops' list will contain all the requested I/O operations + ops = [] + for i in range(rd_ops): + ops.append("aio_read %d %d" % (i * rd_size, rd_size)) + + for i in range(wr_ops): + ops.append("aio_write %d %d" % (i * wr_size, wr_size)) + + for i in range(flush_ops): + ops.append("aio_flush") + + highest_offset = wr_ops * wr_size + + # Two types of invalid operations: unaligned length and unaligned offset + for i in range(invalid_rd_ops / 2): + ops.append("aio_read 0 511") + + for i in range(invalid_rd_ops / 2, invalid_rd_ops): + ops.append("aio_read 13 512") + + for i in range(invalid_wr_ops / 2): + ops.append("aio_write 0 511") + + for i in range(invalid_wr_ops / 2, invalid_wr_ops): + ops.append("aio_write 13 512") + + for i in range(failed_rd_ops): + ops.append("aio_read %d 512" % bad_offset) + + for i in range(failed_wr_ops): + ops.append("aio_write %d 512" % bad_offset) + + if failed_wr_ops > 0: + highest_offset = max(highest_offset, bad_offset + 512) + + for i in range(wr_merged): + first = i * wr_size * 2 + second = first + wr_size + ops.append("multiwrite %d %d ; %d %d" % + (first, wr_size, second, wr_size)) + + highest_offset = max(highest_offset, wr_merged * wr_size * 2) + + # Now perform all operations + for op in ops: + self.vm.hmp_qemu_io("drive0", op) + + # Update the expected totals + self.total_rd_bytes += rd_ops * rd_size + self.total_rd_ops += rd_ops + self.total_wr_bytes += wr_ops * wr_size + self.total_wr_ops += wr_ops + self.total_wr_merged += wr_merged + self.total_flush_ops += flush_ops + self.invalid_rd_ops += invalid_rd_ops + self.invalid_wr_ops += invalid_wr_ops + self.failed_rd_ops += failed_rd_ops + self.failed_wr_ops += failed_wr_ops + + self.wr_highest_offset = max(self.wr_highest_offset, highest_offset) + + # Advance the clock so idle_time_ns has a meaningful value + self.vm.qtest("clock_step %d" % nsec_per_sec) + + # And check that the actual statistics match the expected ones + self.check_values() + + def test_read_only(self): + test_values = [[512, 1], + [65536, 1], + [512, 12], + [65536, 12]] + for i in test_values: + self.do_test_stats(rd_size = i[0], rd_ops = i[1]) + + def test_write_only(self): + test_values = [[512, 1], + [65536, 1], + [512, 12], + [65536, 12]] + for i in test_values: + self.do_test_stats(wr_size = i[0], wr_ops = i[1]) + + def test_invalid(self): + self.do_test_stats(invalid_rd_ops = 7) + self.do_test_stats(invalid_wr_ops = 3) + self.do_test_stats(invalid_rd_ops = 4, invalid_wr_ops = 5) + + def test_failed(self): + self.do_test_stats(failed_rd_ops = 8) + self.do_test_stats(failed_wr_ops = 6) + self.do_test_stats(failed_rd_ops = 5, failed_wr_ops = 12) + + def test_flush(self): + self.do_test_stats(flush_ops = 8) + + def test_merged(self): + for i in range(5): + self.do_test_stats(wr_merged = i * 3) + + def test_all(self): + # rd_size, rd_ops, wr_size, wr_ops, flush_ops + # invalid_rd_ops, invalid_wr_ops, + # failed_rd_ops, failed_wr_ops + # wr_merged + test_values = [[512, 1, 512, 1, 1, 4, 7, 5, 2, 1], + [65536, 1, 2048, 12, 7, 7, 5, 2, 5, 5], + [32768, 9, 8192, 1, 4, 3, 2, 4, 6, 4], + [16384, 11, 3584, 16, 9, 8, 6, 7, 3, 4]] + for i in test_values: + self.do_test_stats(*i) + + def test_no_op(self): + # All values must be sane before doing any I/O + self.check_values() + + +class BlockDeviceStatsTestAccountInvalid(BlockDeviceStatsTestCase): + account_invalid = True + account_failed = False + +class BlockDeviceStatsTestAccountFailed(BlockDeviceStatsTestCase): + account_invalid = False + account_failed = True + +class BlockDeviceStatsTestAccountBoth(BlockDeviceStatsTestCase): + account_invalid = True + account_failed = True + +class BlockDeviceStatsTestCoroutine(BlockDeviceStatsTestCase): + test_img = "null-co://" + +if __name__ == '__main__': + iotests.main(supported_fmts=["raw"])
tests/qemu-iotests/136.out new file +5 -0
@@ -0,0 +1,5 @@ +........................................ +---------------------------------------------------------------------- +Ran 40 tests + +OK
tests/qemu-iotests/group +1 -0
@@ -136,5 +136,6 @@ 132 rw auto quick 134 rw auto quick 135 rw auto +136 rw auto 137 rw auto 138 rw auto quick
Signature · 1 line
2.6.1
PATCH v3 16/21 xen_disk: Account for failed and invalid operations
In reply to Alberto Garcia--- hw/block/xen_disk.c | 23 ++++++++++++++++++++++- 1 file changed, 22 insertions(+), 1 deletion(-)
hw/block/xen_disk.c +22 -1
@@ -537,7 +537,11 @@ static void qemu_aio_complete(void *opaque, int ret)break ; }case BLKIF_OP_READ : -block_acct_done (blk_get_stats (ioreq->blkdev->blk), &ioreq->acct); +if (ioreq->status ==BLKIF_RSP_OKAY ) { +block_acct_done (blk_get_stats (ioreq->blkdev->blk), &ioreq->acct); + }else { +block_acct_failed (blk_get_stats (ioreq->blkdev->blk), &ioreq->acct); + }break ;case BLKIF_OP_DISCARD :default :
@@ -722,6 +726,23 @@ static void blk_handle_requests(struct XenBlkDev *blkdev)/* parse them */ if (ioreq_parse (ioreq) !=0 ) { + +switch (ioreq->req.operation) { +case BLKIF_OP_READ : +block_acct_invalid (blk_get_stats (blkdev->blk), +BLOCK_ACCT_READ ); +break ; +case BLKIF_OP_WRITE : +block_acct_invalid (blk_get_stats (blkdev->blk), +BLOCK_ACCT_WRITE ); +break ; +case BLKIF_OP_FLUSH_DISKCACHE : +block_acct_invalid (blk_get_stats (blkdev->blk), +BLOCK_ACCT_FLUSH ); +default : +break ; + }; +if (blk_send_response_one (ioreq)) {xen_be_send_notify (&blkdev->xendev); }
Signature · 1 line
2.6.1
PATCH v3 10/21 block: New option to define the intervals for collecting I/O statistics
In reply to Alberto GarciaThe BlockAcctStats structure contains a list of BlockAcctTimedStats. Each one of these collects statistics about the minimum, maximum and average latencies of all I/O operations in a certain interval of time.
This patch adds a new "stats-intervals" option that allows defining these intervals.
--- blockdev.c | 37 +++++++++++++++++++++++++++++++++++++ qapi/block-core.json | 4 ++++ 2 files changed, 41 insertions(+)
blockdev.c +37 -0
@@ -468,6 +468,7 @@ static BlockBackend *blockdev_init(const char *file, QDict *bs_opts,int bdrv_flags =0 ;int on_read_error, on_write_error;bool account_invalid, account_failed; +const char *stats_intervals;BlockBackend *blk;BlockDriverState *bs;ThrottleConfig cfg;
@@ -507,6 +508,8 @@ static BlockBackend *blockdev_init(const char *file, QDict *bs_opts, account_invalid =qemu_opt_get_bool (opts,"stats-account-invalid" , true); account_failed =qemu_opt_get_bool (opts,"stats-account-failed" , true); + stats_intervals =qemu_opt_get (opts,"stats-intervals" ); +extract_common_blockdev_options (opts, &bdrv_flags, &throttling_group, &cfg, &detect_zeroes, &error);if (error) {
@@ -605,6 +608,35 @@ static BlockBackend *blockdev_init(const char *file, QDict *bs_opts, }block_acct_init (blk_get_stats (blk), account_invalid, account_failed); + +if (stats_intervals) { +char **intervals =g_strsplit (stats_intervals,":" ,0 ); +unsigned i; + +if (*stats_intervals =='\0' ) { +error_setg (&error,"stats-intervals can't have an empty value" ); + } + +for (i =0 ; !error && intervals[i] !=NULL ; i++) { +unsigned long long val; +if (parse_uint_full (intervals[i], &val,10 ) ==0 && + val >0 && val <=UINT_MAX ) { +block_acct_add_interval (blk_get_stats (blk), val); + }else { +error_setg (&error,"Invalid interval length: '%s'" , + intervals[i]); + } + } + +g_strfreev (intervals); + +if (error) { +error_propagate (errp, error); +blk_unref (blk); + blk =NULL ; + goto err_no_bs_opts; + } + } }blk_set_on_error (blk, on_read_error, on_write_error);
@@ -3535,6 +3567,11 @@ QemuOptsList qemu_common_drive_opts = { .type = QEMU_OPT_BOOL, .help = "whether to account for failed I/O operations " "in the statistics", + },{ + .name = "stats-intervals", + .type = QEMU_OPT_STRING, + .help = "colon-separated list of intervals " + "for collecting I/O statistics, in seconds", }, {/* end of list */ } },
qapi/block-core.json +4 -0
@@ -1503,6 +1503,9 @@ # @stats-account-failed: #optional whether to include failed # operations when computing latency and last # access statistics (default: true) (Since 2.5) +# @stats-intervals: #optional colon-separated list of intervals for +# collecting I/O statistics, in seconds (default: none) +# (Since 2.5) # @detect-zeroes: #optional detect and optimize zero writes (Since 2.1) # (default: off) #
@@ -1520,6 +1523,7 @@ '*read-only': 'bool', '*stats-account-invalid': 'bool', '*stats-account-failed': 'bool', + '*stats-intervals': 'str', '*detect-zeroes': 'BlockdevDetectZeroesOptions' } } ##
Signature · 1 line
2.6.1
Re: [Qemu-devel] [PATCH v3 08/21] block: Compute minimum, maximum and average I/O latencies
In reply to Alberto Garciainclude/block/accounting.h enum BlockAcctType { · line 44
Quoted 3 lines · Alberto Garcia
include/block/accounting.h +3
-0+struct BlockAcctTimedStats { +TimedAverage latency[BLOCK_MAX_IOTYPE ]; +unsigned interval_length;
/* in seconds */ would be nice here so the units are clear. Or even interval_length_secs.
Re: [Qemu-devel] [PATCH v3 09/21] block: Add average I/O queue depth to BlockDeviceTimedStats
In reply to Alberto Garciautil/timed-average.c uint64_t timed_average_max(TimedAverage *ta) · line 224
Quoted 13 lines · Alberto Garcia
util/timed-average.c +13
-0+/* Get the sum of all accounted values +* @ta: the TimedAverage structure +* @elapsed: if non-NULL, the elapsed time (in ns) will be stored here +* @ret: the sum of all accounted values +*/ +uint64_t timed_average_sum (TimedAverage *ta,uint64_t *elapsed) +{ +TimedAverageWindow *w; +check_expirations (ta); + w =current_window (ta); +if (elapsed !=NULL ) { +int64_t remaining = w->expiration -qemu_clock_get_ns (ta->clock_type); + *elapsed = ta->period - remaining;
There is no guarantee that qemu_clock_get_ns(ta->clock_type) executes quickly after check_expirations(ta). If the system is under heavy load and swapping, maybe significant amounts of time have passed. This race condition could result in bad elapsed values being calculated.
We need to be careful about elapsed <= 0 values, especially if the caller divides by elapsed and is exposed to Divide By 0 exceptions.
Either check_expirations() needs to integrate qemu_clock_get_ns() or we simply need to deal with bogus values here.
Re: [Qemu-devel] [PATCH v3 09/21] block: Add average I/O queue depth to BlockDeviceTimedStats
Quoted 14 lines · Stefan Hajnoczi
util/timed-average.c uint64_t timed_average_max(TimedAverage *ta) · line 224
Quoted 8 lines
util/timed-average.c +8
-0+uint64_t timed_average_sum (TimedAverage *ta,uint64_t *elapsed) +{ +TimedAverageWindow *w; +check_expirations (ta); + w =current_window (ta); +if (elapsed !=NULL ) { +int64_t remaining = w->expiration -qemu_clock_get_ns (ta->clock_type); + *elapsed = ta->period - remaining;There is no guarantee that
qemu_clock_get_ns(ta->clock_type)executes quickly aftercheck_expirations(ta). If the system is under heavy load and swapping, maybe significant amounts of time have passed. This race condition could result in bad elapsed values being calculated.
Quoted 5 lines
We need to be careful about elapsed <= 0 values, especially if the caller divides by elapsed and is exposed to Divide By 0 exceptions.
Either
check_expirations()needs to integrateqemu_clock_get_ns()or we simply need to deal with bogus values here.
Good catch, thanks!
I think having check_expirations() return the time is probably the best option.
Berto
Quoted 4 lines · Alberto Garcia
Here's a new version of the extended I/O accounting patches.
This one is rebased on top of the current master, has a few minor documentation fixes and drops the '
supports_stats' field completely.
Looks good overall. I posted comments on specific patches.
Stefan