Skip to contentSkip to conversation

How to perform an random read test, with normal distribution

DISCUSSION [email protected] 2 participants 2 messages Nov 22, 2023

lore
Share & tools
lore
#0 lore raw

Hi!

I Want to perform a test scenario

I have a "huge" file in which I want to read out blocks of data randomly with some distribution. For example 20% od blocks in test file will get ~80% od total IO from the engine.

Placement of blocks within the file is not important
The only requirement is that some blocks are read out more frequently then others, and the distribution of reads is defined by some parameters

Test should simulate a VM image reads during VM startup (or runtime) where not all files are used, and some are used more often then others.

Is there a way to test such scenario using fio?

Best regards,
Bartosz Wieczorek

#1 lore raw
Quoted 9 lines · On 11/22/23 03:29, [email protected] wrote:

Hi!

I Want to perform a test scenario

I have a "huge" file in which I want to read out blocks of data randomly with some distribution. For example 20% od blocks in test file will get ~80% od total IO from the engine.

Placement of blocks within the file is not important
The only requirement is that some blocks are read out more frequently then others, and the distribution of reads is defined by some parameters

Quoted 7 lines

Test should simulate a VM image reads during VM startup (or runtime) where not all files are used, and some are used more often then others.

Is there a way to test such scenario using fio?

Best regards,
Bartosz Wieczorek

Fio has a random_distribution option that should meet your needs. Take a look at the documentation:

https://fio.readthedocs.io/en/latest/fio_doc.html#cmdoption-arg-random-distribution

Vincent