Skip to contentSkip to conversation

Benchmark results from resp1 trivial response time test

DISCUSSION Paolo Ciarrocchi 2 participants 2 messages Oct 14, 2002 – Oct 15, 2002

lore
Share & tools
lore
#0 lore raw

Hi Bill,
I'm back with the results of others tests, here all my results:

		Kernel version: 2.4.19

Starting 1 CPU run with 251 MB RAM, minimum 5 data points at 20 sec intervals

                       _____________ delay ms. ____________                  
           Test        low       high    median     average     S.D.    ratio
         noload    119.653    124.207    119.786    120.644    0.002    1.000
     smallwrite    121.051    190.696    144.469    152.062    0.031    1.260
     largewrite    117.412  11871.027   1113.563   3362.302    4.870   27.870
        cpuload    119.691    313.702    178.513    190.324    0.081    1.578
      spawnload    114.624    243.985    119.747    154.604    0.057    1.281
       8ctx-mem    652.737   7564.493   1234.938   2527.273    2.904   20.948
       2ctx-mem    126.914   8428.021    620.418   2941.043    3.890   24.378

		Kernel version: 2.5.41-mm2

Starting 1 CPU run with 250 MB RAM, minimum 5 data points at 20 sec intervals

                       _____________ delay ms. ____________                  
           Test        low       high    median     average     S.D.    ratio
         noload    113.676    114.413    113.713    113.856    0.000    1.000
     smallwrite    117.001    228.536    119.025    141.028    0.049    1.239
     largewrite    116.102   1681.086    216.776    499.422    0.667    4.386
        cpuload    105.461    160.513    105.834    116.661    0.025    1.025
      spawnload    108.506    166.367    108.863    120.305    0.026    1.057
       8ctx-mem   1789.834   9155.800   3790.198   4547.118    2.831   39.938
       2ctx-mem   2290.391  10661.156   4810.641   5040.725    3.358   44.273

		Kernel version: 2.5.41-mm2C

Starting 1 CPU run with 250 MB RAM, minimum 5 data points at 20 sec intervals

                       _____________ delay ms. ____________                  
           Test        low       high    median     average     S.D.    ratio
         noload    113.648    114.508    113.707    113.861    0.000    1.000
     smallwrite    116.054    180.420    117.924    130.525    0.028    1.146
     largewrite    114.019    179.770    120.451    134.021    0.028    1.177
        cpuload    106.590    162.893    107.075    118.080    0.025    1.037
      spawnload    106.574    164.898    107.490    118.671    0.026    1.042
       8ctx-mem   7767.843  16917.625   8994.265  10906.788    3.844   95.790
       2ctx-mem   6515.450  18273.101  10344.575  11217.755    4.822   98.521

		Kernel version: 2.5.41-mm2C@128MiB

Starting 1 CPU run with 123 MB RAM, minimum 5 data points at 20 sec intervals

                       _____________ delay ms. ____________                  
           Test        low       high    median     average     S.D.    ratio
         noload    113.550    114.451    113.763    113.857    0.000    1.000
     smallwrite    118.926    182.074    123.044    139.160    0.028    1.222
     largewrite    119.864    186.550    139.593    148.957    0.027    1.308
        cpuload    105.468    165.026    105.922    117.648    0.026    1.033
      spawnload    106.408    162.414    106.778    117.861    0.025    1.035
       8ctx-mem   7264.508  12232.155   8106.800   8836.428    1.965   77.610
       2ctx-mem   7447.326  23237.534  11601.912  13325.664    6.527  117.038

		Kernel version: 2.5.41

Starting 1 CPU run with 250 MB RAM, minimum 5 data points at 20 sec intervals

                       _____________ delay ms. ____________                  
           Test        low       high    median     average     S.D.    ratio
         noload    113.607    114.030    113.774    113.783    0.000    1.000
     smallwrite    117.882    526.275    121.038    208.868    0.178    1.836
     largewrite   1674.216  88428.871  14794.752  27750.852   34.851  243.892
        cpuload    104.225    158.400    104.478    115.269    0.024    1.013
      spawnload    105.933    166.818    106.682    118.452    0.027    1.041
       8ctx-mem    116.458   8893.645    120.670   1875.275    3.923   16.481
       2ctx-mem    116.847  10174.152    121.309   2130.303    4.497   18.722

		Kernel version: 2.5.42-mm2

Starting 1 CPU run with 250 MB RAM, minimum 5 data points at 20 sec intervals

                       _____________ delay ms. ____________                  
           Test        low       high    median     average     S.D.    ratio
         noload    113.658    114.500    113.737    113.866    0.000    1.000
     smallwrite    117.220    245.110    119.017    144.541    0.056    1.269
     largewrite    114.841    181.420    118.746    131.568    0.028    1.155
        cpuload    104.583    159.080    104.890    115.694    0.024    1.016
      spawnload    108.790    166.141    109.655    120.698    0.025    1.060
       8ctx-mem    114.430   8484.873    784.141   2066.476    3.604   18.148
       2ctx-mem    121.388   8453.018   1414.443   2383.773    3.459   20.935

		Kernel version: 2.5.42

Starting 1 CPU run with 250 MB RAM, minimum 5 data points at 20 sec intervals

                       _____________ delay ms. ____________                  
           Test        low       high    median     average     S.D.    ratio
         noload    113.676    113.948    113.737    113.774    0.000    1.000
     smallwrite    115.352    189.983    119.500    141.645    0.036    1.245
     largewrite  19012.080  45528.170  30311.890  31472.632    9.646  276.625
        cpuload    103.328   1267.116    103.971    336.462    0.520    2.957
      spawnload    105.196    167.400    105.787    117.983    0.028    1.037
       8ctx-mem    121.166   8616.232    126.489   1824.054    3.797   16.032
       2ctx-mem    115.162  10291.470    119.560   2152.930    4.550   18.923

I post the script I use to get this summary as well, do you think it is usefull ?

#!/bin/bash
out=(ls *.out|sort)
total=echo ${out[@]}|wc -w

# echo $total 
Quoted 1 line

summary.txt

for i in seq 0 1 $[total-1]
do
kernel_version=echo ${out[i]}|cut -d "." --fields=1-3
echo -e "\t\tKernel version: $kernel_version" >> summary.txt grep '^ ' ${out[i]} >> summary.txt
echo >> summary.txt
done;

Ciao,
Paolo

Signature · 4 lines
Get your free email from www.linuxmail.org 


Powered by Outblaze
#1 lore raw
Quoted 2 lines · Paolo Ciarrocchi

Hi Bill,
I'm back with the results of others tests, here all my results:

Thanks, I'll cip them in the response, but this test sure does make some kernels unhappy, doesn't it? And the sad truth is that this isn't artifact, if you get a similar "real load" on the machine the response will be really unusable in real life.

Quoted 2 lines

I post the script I use to get this summary as well, do you think it is usefull ?

Sure, it's very like the one I used to generate the results on the web site, other than I used "version=${filename%.out}" to avoid a cut or sed process, and I put my redirect after the "done" as "done >>summary.txt" so I didn't have to put it on every line. Matter of style, and I'm really lazy about typing anything I don't need to ;-)

Quoted 4 lines

#!/bin/bash
out=(ls *.out|sort)
total=echo ${out[@]}|wc -w

# echo $total 
Quoted 8 lines
Quoted 1 line

summary.txt

for i in seq 0 1 $[total-1]
do
kernel_version=echo ${out[i]}|cut -d "." --fields=1-3
echo -e "\t\tKernel version: $kernel_version" >> summary.txt grep '^ ' ${out[i]} >> summary.txt
echo >> summary.txt
done;

I'm going to replace S.D. with the ratio of the median values in the near future, I find that more useful, since one really bad response can skew the ratio of average. Of course the other values are there to avoid confusion, but t makes a nicer number for the "look at one value" folks.

Signature · 3 lines
bill davidsen <[email protected]>
  CTO, TMR Associates, Inc
Doing interesting things with little computers since 1979.