Skip to contentSkip to conversation

mdadm question

DISCUSSION Robert Minvielle 4 participants 4 messages Mar 3, 2010 1 message not in the archive MD RAID

lore
Share & tools
lore

A message that is not in the archive (sent off-list or not yet received): 1352887864.2731.1267578731820.JavaMail.root@mail1

#1 lore raw

I am trying to setup a new raid array on a debian box, and I have not run into this problem before. I could not find a mdadm list, so I will ask here. If this is totally off topic, please disregard.

I am attempting to setup a raid 6 array, but this is failing so I backing down to a no-frills raid 5 array. The system is Debian5, stock kernel, stock everything. The mdadm is the stock debian, pulled with apt-get, version 2.6.7.
The machine in question has one IDE drive for linux, and 45 SATA drives. Debian sees all of the drives, and I have fdisked all of them with one partition of type fd (Linux autodetect raid). fdisk -l /dev/sd[a-z] /dev/sdaa[a-s] shows them all with no problems.

The issue is that when I do a

mdadm --create /dev/md0 --level=5 --raid-devices=45 /dev/sd[a-z]1 /dev/sda[a-s]1

to create a raid array with no spares, all defaults, it returns with

invalid number of raid devices.

I have searched the web to no avail. --verbose does not increase verbosity. There are no debug switches (that I know of) to mdadm. log files show nothing. Leaving off --raid-devices=45 does nothing. Changing the number of devices just for fun does nothing. (45,44,43,2,whatever). I am not sure if this is a problem with this version in debian, the number of drives that I have, or the setup. I have done this before (with a few less drives) with no problems.

Any suggestions would be appreciated.

Thanks.

#2 lore raw
Quoted 4 lines · On Tue, 2 Mar 2010 19:15:04 -0600 (CST) Robert Minvielle <[email protected]>…

I am trying to setup a new raid array on a debian box, and I have not run into this problem before. I could not find a mdadm list, so I will ask here. If this is totally off topic, please disregard.

Perfectly on-topic.

Quoted 9 lines

I am attempting to setup a raid 6 array, but this is failing so I backing down to a no-frills raid 5 array. The system is Debian5, stock kernel, stock everything. The mdadm is the stock debian, pulled with apt-get, version 2.6.7.
The machine in question has one IDE drive for linux, and 45 SATA drives. Debian sees all of the drives, and I have fdisked all of them with one partition of type fd (Linux autodetect raid). fdisk -l /dev/sd[a-z] /dev/sdaa[a-s] shows them all with no problems.

Using old software on new hardware....
When using Debian, I would recommend the -testing version for new hardware.... (not that I am prepared to back-up that recommendation with support).

However I suspect Debian5 should be able to be made to work with your setup.

Quoted 8 lines

The issue is that when I do a

mdadm --create /dev/md0 --level=5 --raid-devices=45 /dev/sd[a-z]1 /dev/sda[a-s]1

to create a raid array with no spares, all defaults, it returns with

invalid number of raid devices.

The default metadata layout has a maximum of 28 devices. If you want more, add
--metadata=1.0

You won't be able to use in-kernel autodetect, but you shouldn't need to with Debian, even at that vintage.

Quoted 7 lines

I have searched the web to no avail. --verbose does not increase verbosity. There are no debug switches (that I know of) to mdadm. log files show nothing. Leaving off --raid-devices=45 does nothing. Changing the number of devices just for fun does nothing. (45,44,43,2,whatever). I am not sure if this is a problem with this version in debian, the number of drives that I have, or the setup. I have done this before (with a few less drives) with no problems.

I'm surprised it didn't work with '2', or did you mean "42" ?

NeilBrown

Quoted 12 lines

Any suggestions would be appreciated.

Thanks.

--
To unsubscribe from this list: send the line "unsubscribe linux-raid" in the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html

#3 lore raw
In reply to Robert Minvielle
Quoted 15 lines

-----Original Message-----
From: [email protected] [mailto:linux-raid- [email protected]] On Behalf Of Robert Minvielle
Sent: Tuesday, March 02, 2010 7:15 PM
To: [email protected]
Subject: mdadm question

I am trying to setup a new raid array on a debian box, and I have not run into
this problem before. I could not find a mdadm list, so I will ask here. If this
is totally off topic, please disregard.

Quoted 6 lines

I am attempting to setup a raid 6 array, but this is failing so I backing down
to a no-frills raid 5 array. The system is Debian5, stock kernel, stock everything.
The mdadm is the stock debian, pulled with apt-get, version 2.6.7. The machine in question has one IDE drive for linux, and 45 SATA drives.

I think that's your problem. The default for 2.6.7 is a version .90
superblock. The .90 superblock is limited to 28 devices in the array. Ise a version 1.x superblock, instead.

Quoted 11 lines

Debian
sees all of the drives, and I have fdisked all of them with one partition of type
fd (Linux autodetect raid). fdisk -l /dev/sd[a-z] /dev/sdaa[a-s] shows them all
with no problems.

The issue is that when I do a

mdadm --create /dev/md0 --level=5 --raid-devices=45 /dev/sd[a-z]1 /dev/sda[a-s]1

Make that:
mdadm --create /dev/md0 --level=5 --raid-devices=45 --metadata=1.x /dev/sd[a-z]1 /dev/sda[a-s]1

where x is 0, 1, or 2 and I think you'll be fine. See the man page.

Quoted 27 lines

to create a raid array with no spares, all defaults, it returns with

invalid number of raid devices.

I have searched the web to no avail. --verbose does not increase verbosity. There
are no debug switches (that I know of) to mdadm. log files show nothing. Leaving off
--raid-devices=45 does nothing. Changing the number of devices just for fun does
nothing. (45,44,43,2,whatever). I am not sure if this is a problem with this version
in debian, the number of drives that I have, or the setup. I have done this before
(with a few less drives) with no problems.

Any suggestions would be appreciated.

Thanks.

--
To unsubscribe from this list: send the line "unsubscribe linux-raid" in the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html

#4 lore raw
In reply to Robert Minvielle
Quoted 19 lines · Robert Minvielle

I am trying to setup a new raid array on a debian box, and I have not run into this problem before. I could not find a mdadm list, so I will ask here. If this is totally off topic, please disregard.

I am attempting to setup a raid 6 array, but this is failing so I backing down
to a no-frills raid 5 array. The system is Debian5, stock kernel, stock everything. The mdadm is the stock debian, pulled with apt-get, version 2.6.7. The machine in question has one IDE drive for linux, and 45 SATA drives. Debian sees all of the drives, and I have fdisked all of them with one partition of type
fd (Linux autodetect raid). fdisk -l /dev/sd[a-z] /dev/sdaa[a-s] shows them all
with no problems.

The issue is that when I do a

mdadm --create /dev/md0 --level=5 --raid-devices=45 /dev/sd[a-z]1 /dev/sda[a-s]1

to create a raid array with no spares, all defaults, it returns with

invalid number of raid devices.

Quoted 9 lines

I have searched the web to no avail. --verbose does not increase verbosity. There are no debug switches (that I know of) to mdadm. log files show nothing. Leaving off --raid-devices=45 does nothing. Changing the number of devices just for fun does nothing. (45,44,43,2,whatever). I am not sure if this is a problem with this version in debian, the number of drives that I have, or the setup. I have done this before (with a few less drives) with no problems.

Any suggestions would be appreciated.

You seem to have gotten your answer on number of drives, now you can go with raid-6 as desired. However, since the performance of raid-6 in degraded mode is pretty poor and gets worse with more drives, you may want to consider allocating at least one drive as a spare, or doing a raid-0 over three smaller raid-5 or raid-6 arrays to speed rebuild. You can also have shared spares to allow for fast rebuild of any of the smaller redundant arrays.

The price of many flexible options is many decisions.

Signature · 3 lines
Bill Davidsen <[email protected]>
 "We can't solve today's problems by using the same thinking we
  used in creating them." - Einstein