3Ware 9500S-12 RAID controller -- poor performance
You might be interested in trying a small tool I wrote to perform some parallel write tests on different linux filesystems.
http://marc.theaimsgroup.com/?l=linux-kernel&m=107661735307313&w=2
At the time that I wrote the tool, 18 months ago, both ext3 and reiserfsV3 performed fairly badly at handling concurrent writes and only JFS and XFS excelled. Since then I believe the ext3 performance has been greatly improved due to the block reservation scheme added in 2.6.10. AFAIK the reiserfs performance is only addressed in reiserfsV4.
The test code is fairly trivial and could be easily adapted to simulate other workloads (like a web server) to help to optimise your filesystem and driver performance.
tiobench provides another threaded IO test http://tiobench.sourceforge.net/
Jon
OK,
I now dumped RAID5 and am running all of my 12 disks separately each partitioned with XFS.
I did a very crude test of reading a single 1GB file from each of my disks in parallel by putting 12 dd processes into the background. Each file was read at approximately 35MB/s giving an aggragate of a little
over 400MB/s. According to 3Ware support, 400MB/s is
the "theoretical maximum" of this controller. I'm very happy with these results.
I want to run a killer test where 400 files are being read in parallel to see what the combined throughput
would be. Can anyone recommend a benchmark utility
that would help me do so? I tried using bonnie/iozone but they (to my limited understanding) won't do this.
Can anyone point me in the right direction?
Thank you
__________________________________
Yahoo! Mail - PC Magazine Editors' Choice 2005
http://mail.yahoo.com
Quoted 6 lines · * subbie subbie ([email protected]) wrote:
OK,
I now dumped RAID5 and am running all of my 12 disks separately each partitioned with XFS.
Quoted 7 lines
I did a very crude test of reading a single 1GB file from each of my disks in parallel by putting 12 dd processes into the background. Each file was read at approximately 35MB/s giving an aggragate of a little
over 400MB/s. According to 3Ware support, 400MB/s is
the "theoretical maximum" of this controller. I'm very happy with these results.
Nice. Have you tried Software RAID5 on top of that? I would be very interested to know how software RAID5 goes relative to the 3Ware hardware.
Dave
--
-----Open up your eyes, open up your mind, open up your code -------
/ Dr. David Alan Gilbert | Running GNU/Linux on Alpha,68K| Happy \ \ gro.gilbert @ treblig.org | MIPS,x86,ARM,SPARC,PPC & HPPA | In Hex / \ _________________________|_____ http://www.treblig.org |_______/
Quoted 1 line · Dr. David Alan Gilbert
Nice. Have you tried Software RAID5 on top of that? I would be very interested to know how software RAID5 goes relative to the 3Ware hardware.
There have been hundreds of email regarding this on the [email protected] list. Please look in the archives.
It's well known that 3ware hw raid is slow when writing, current theory is that this is due to the lack of buffering meaning that any write makes it read a lot as well, destroying performance. Generally, the performance numbers advertised by 3ware when writing is a dd to the drive itself (I got this number after doing a support request on it a few years back), without a filesystem. This goes very quickly, but writing files on a filesystem is usually very slow (10 megabyte/s or so). When doing SW raid the SW layer has access to the memory block cache and can thus avoid a lot of physical reads on the drives.
I never had any problems getting good read speeds on the HW raid.
My experience is with the 7500 series, the 9500 series has cache as well but this doesn't seem to have solved a lot of the performance problems seen with the 7500 series.
Signature · 1 line
Mikael Abrahamsson email: [email protected]
No. I'm running each disk with its own XFS partition.
Unfortunately I'm not in the position to experiment much on this system.
Which tool can I use to stress all 12 disks reading many many files in parallel?
Thanks
Quoted 5 lines
Nice. Have you tried Software RAID5 on top of that? I would be very interested to know how software RAID5
goes relative to the 3Ware hardware.
__________________________________
Yahoo! Music Unlimited
Access over 1 million songs. Try it free.
http://music.yahoo.com/unlimited/
Quoted 1 line · subbie subbie
Which tool can I use to stress all 12 disks reading many many files in parallel?
Start 400 dd:s ? You will find that you will destroy performance as the drive heads will be thrashing a lot.
Signature · 1 line
Mikael Abrahamsson email: [email protected]