Skip to contentSkip to conversation

block: make the io_ticks counter more accurate

PATCH In review Wen Yang 2 participants 3 messages Dec 26, 2019 Block layer

lore
Share & tools
lore

Wen Yang

author
#0 lore raw

PATCH v2 1/1 block: make the io_ticks counter more accurate

Instead of the jiffies, we should update the io_ticks counter with the passed in parameter 'now'.

---
v2->v1: Use the same clock source for io_ticks and other statistics in the diskstats

 block/blk-core.c | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)
block/blk-core.c +2 -2
index 379f6f5..da7de9f 100644
@@ -1365,7 +1365,7 @@ void blk_account_io_done(struct request *req, u64 now)
 		part_stat_lock();
 		part = req->part;
 
-		update_io_ticks(part, jiffies);
+		update_io_ticks(part, nsecs_to_jiffies(now));
 		part_stat_inc(part, ios[sgrp]);
 		part_stat_add(part, nsecs[sgrp], now - req->start_time_ns);
 		part_stat_add(part, time_in_queue, nsecs_to_jiffies64(now - req->start_time_ns));
@@ -1407,7 +1407,7 @@ void blk_account_io_start(struct request *rq, bool new_io)
 		rq->part = part;
 	}
 
-	update_io_ticks(part, jiffies);
+	update_io_ticks(part, nsecs_to_jiffies(ktime_get_ns()));
 
 	part_stat_unlock();
 }
Signature · 1 line
1.8.3.1
maintainer
#1 lore raw
Quoted 2 lines · Wen Yang

Instead of the jiffies, we should update the io_ticks counter with the passed in parameter 'now'.

I'm still missing some justification for this. What exactly is this patch trying to solve or improve? Your commit message says "we should", but why?

Signature · 1 line
Jens Axboe
author
#2 lore raw
Quoted 8 lines · Jens Axboe
Quoted 2 lines · Wen Yang

Instead of the jiffies, we should update the io_ticks counter with the passed in parameter 'now'.

I'm still missing some justification for this. What exactly is this patch trying to solve or improve? Your commit message says "we should", but why?

Hi Jens,

Thank you for your comments.
We observed in the document that:

io_ticks
========

This value counts the number of milliseconds during which the device has had I/O requests queued.

And the iostat command uses io_ticks count to calculate %util:
https://github.com/sysstat/sysstat/blob/master/rd_stats.c#L372

eg:
Device: rrqm/s wrqm/s r/s w/s rkB/s wkB/s avgrq-sz avgqu-sz await r_await w_await svctm %util

So we need to unify the time windows of these statistics(io_ticks, rd_tick, time_in_queue, etc). However, the current code uses jiffies to count io_ticks.
Jiffies is different from the passed in parameter 'now',
so these statistics will be inconsistent:

void blk_account_io_done(struct request *req, u64 now) {
…

    update_io_ticks(part, jiffies);
    part_stat_inc(part, ios[sgrp]);
    part_stat_add(part, nsecs[sgrp], now - req->start_time_ns);
    part_stat_add(part, time_in_queue, nsecs_to_jiffies64(now - 

req->start_time_ns));
…
}

In addition, we also found another issue:
the update_io_tick() function only adds one to io_ticks at a time, which will result in the calculated %util lower than the real one.

https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/tree/block/bio.c#n1713

We will try our best to improve it.
please kindly help with some suggestions.
Thanks.

Signature · 2 lines
Best Regards,
Wen