Skip to contentSkip to conversation

Hardware versus Software

DISCUSSION [email protected] 5 participants 8 messages May 19, 2004 – May 21, 2004 MD RAID

lore
Share & tools
lore
#0 lore raw

I'm sure this has been discussed many times on the list but I was asked this question today and I'm not sure how to respond:

Under Linux (i.e., a distribution such as Mandrake 10 -- with an up-to-date 2.6 kernel), is a "true hardware RAID-5" created through a SATA card such as the 3ware 8506 or the new 3ware 9500 series any SAFER or MORE RELIABLE than a software RAID created with the same card?

In my benchmark comparisons between software and hardware RAID, I get significantly better performance using "software RAID". With eight 250 GB disks, I get about 175 MB/sec reading and about 150 MB/sec writing when my system is configured as software RAID. With hardware RAID the figures drop to about 125/100 MB/sec.

I'm only using my machines as file servers, so they aren't busy doing any other tasks besides sending data packets through Gigabit Ethernet and running disk I/O.

But the question still remains, is there any other safety and reliability advantage to using Hardware? Is the data on a Hardware RAID more likely to remain intact in the event of a computer crash or freeze?

Or in the event of an abrupt power failure (I have a UPS on the system, but that could fail, or the power cables could be pulled out of the computer or somebody could accidently shut it down). All of these power failure scenarios are very unlikely, but they COULD occur.

Would Hardware RAID survive better than Software? I can't see why, but maybe I'm missing something.

In my situation where the server isn't running any other software, the only advantage I can see to hardware RAID is that rebuilding in the event of a disk failure is a little easier for non-experts. But I'm writing a program to automate the software RAID rebuilding process so that non-experts can do it themselves.

Your informed comments would be appreciated.

Andy Liebman

#1 lore raw
Quoted 3 lines · On Wed, 19 May 2004 [email protected] wrote:

But the question still remains, is there any other safety and reliability advantage to using Hardware? Is the data on a Hardware RAID more likely to remain intact in the event of a computer crash or freeze?

The linux software RAID is good stuff. It *can* be difficult to repair an array in a few cases -- don't put the root FS in a non-mirrored array and they shouldn't be a problem.

As you don't care about CPU cycles used by the array, you're far better off using the software raid with normal drive controllers. (esp. true for SATA.) Hardware RAID cards generally offer better managability and stability -- the OS doesn't have to know if a drive fails, they're designed to hot-swap drives with little or no fuss, etc. But, they will be just a reliable as anything else.

For a system I never want to have to touch, I use hardware raid. For those systems sitting at my feet, that isn't as important.

--Ricky

#2 lore raw
Quoted 9 lines · Ricky Beam
Quoted 3 lines · On Wed, 19 May 2004 [email protected] wrote:

But the question still remains, is there any other safety and reliability advantage to using Hardware? Is the data on a Hardware RAID more likely to remain intact in the event of a computer crash or freeze?

The linux software RAID is good stuff. It *can* be difficult to repair an array in a few cases -- don't put the root FS in a non-mirrored array and they shouldn't be a problem.

Quoted 6 lines

As you don't care about CPU cycles used by the array, you're far better off using the software raid with normal drive controllers. (esp. true for SATA.) Hardware RAID cards generally offer better managability and stability -- the OS doesn't have to know if a drive fails, they're designed to hot-swap drives with little or no fuss, etc. But, they will be just a reliable as anything else.

is there any support from linux that can do this hot swappable a little easier?

Quoted 11 lines

For a system I never want to have to touch, I use hardware raid. For those systems sitting at my feet, that isn't as important.

--Ricky

-
To unsubscribe from this list: send the line "unsubscribe linux-raid" in the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html

Signature · 11 lines
 --------------------------------------------------
| Ming Zhang, PhD. Student
| Dept. of Electrical & Computer Engineering
| College of Engineering
| University of Rhode Island
| Kingston RI. 02881
| e-mail: mingz at ele.uri.edu
| Tel. (401) 874-2293 
| Fax. (401) 782-6422
| http://www.ele.uri.edu/~mingz/
 --------------------------------------------------
#3 lore raw
Quoted 2 lines · Ming Zhang

is there any support from linux that can do this hot swappable a little easier?

It's not the kernel's fault. Not entirely... SCSI will let you hot plug with little trouble. IDE is a different problem.

The real problem is the system hardware. Aside from SATA, I don't know of any MB that openly supports hot plugging of drives without some risk of Real Trouble (tm).

--Ricky

#5 lore raw
In reply to [email protected]
Quoted 10 lines · [email protected] wrote:

I'm sure this has been discussed many times on the list but I was asked this question today and I'm not sure how to respond:

Under Linux (i.e., a distribution such as Mandrake 10 -- with an up-to-date 2.6 kernel), is a "true hardware RAID-5" created through a SATA card such as the 3ware 8506 or the new 3ware 9500 series any SAFER or MORE RELIABLE than a software RAID created with the same card?

In my benchmark comparisons between software and hardware RAID, I get significantly better performance using "software RAID". With eight 250 GB disks, I get about 175 MB/sec reading and about 150 MB/sec writing when my system is configured as software RAID. With hardware RAID the figures drop to about 125/100 MB/sec.

I'm only using my machines as file servers, so they aren't busy doing any other tasks besides sending data packets through Gigabit Ethernet and running disk I/O.

But the question still remains, is there any other safety and reliability advantage to using Hardware? Is the data on a Hardware RAID more likely to remain intact in the event of a computer crash or freeze?

Quoted 9 lines

Or in the event of an abrupt power failure (I have a UPS on the system, but that could fail, or the power cables could be pulled out of the computer or somebody could accidently shut it down). All of these power failure scenarios are very unlikely, but they COULD occur.

Would Hardware RAID survive better than Software? I can't see why, but maybe I'm missing something.

In my situation where the server isn't running any other software, the only advantage I can see to hardware RAID is that rebuilding in the event of a disk failure is a little easier for non-experts. But I'm writing a program to automate the software RAID rebuilding process so that non-experts can do it themselves.

Your informed comments would be appreciated.

This is VERY interesting. Douse the doumentation for software raid say it is doing true Raid 5? I would be very suprised if software raid was faster and if it is I wold think the card is either broke or rubish (stop me at any time if me english gets too profesional). If what you say is the case you should circulate this in other palces (slashdot, debian-user etc.) as I am sure other would be very interested. This list douse not seem to be that active so not sure if you will get mutch response here. If you find anything out be sure to let the list know.

Ben

#4 lore raw
In reply to Ricky Beam

So the question here is that if I want to use software raid with SATA, is there any good hardware combination to support this hot plug? Thanks a lot.

Ming

Quoted 12 lines · Ricky Beam
Quoted 2 lines · Ming Zhang

is there any support from linux that can do this hot swappable a little easier?

It's not the kernel's fault. Not entirely... SCSI will let you hot plug with little trouble. IDE is a different problem.

The real problem is the system hardware. Aside from SATA, I don't know of any MB that openly supports hot plugging of drives without some risk of Real Trouble (tm).

--Ricky

Signature · 11 lines
 --------------------------------------------------
| Ming Zhang, PhD. Student
| Dept. of Electrical & Computer Engineering
| College of Engineering
| University of Rhode Island
| Kingston RI. 02881
| e-mail: mingz at ele.uri.edu
| Tel. (401) 874-2293 
| Fax. (401) 782-6422
| http://www.ele.uri.edu/~mingz/
 --------------------------------------------------
#7 lore raw
In reply to [email protected]
Quoted 2 lines · On Wed, 19 May 2004 [email protected] wrote:

Would Hardware RAID survive better than Software? I can't see why, but maybe I'm missing something.

there are reliability questions we can answer directly about software raid because we have the source code. for hardware raid we have to trust the vendors' claims.

i choose "the devil i know" -- sw raid. i've got a wishlist documenting problems i've encountered: <http://arctic.org/~dean/raid-wishlist.html>.

some of those features may exist in hw raids -- but it's hard to get answers on specifics like that.

-dean

#6 lore raw
In reply to Ben Edwards
Quoted 2 lines · Ben Edwards

... I would be very suprised if software raid was
faster and if it is I wold think the card is either broke or rubish

Negative. HW RAID cards may have specialized hardware for doing XOR calculations. However, no raid card currently on the market has a 3.2GHz xeon at it's core. Most are ARM (up to 750MHz?) or i960 (up to 66MHz) based. The system CPU can certainly out perform the tiny processors on the raid card. Of course, if it's doing raid calculations, it's not do general computational work which is one reason to use hw raids.

--Ricky