Skip to contentSkip to conversation

Maximum block dev size / filesystem size

DISCUSSION Aaron Peterson 3 participants 4 messages Oct 7, 2004 – Oct 11, 2004

lore
Share & tools
lore
#0 lore raw

I work for a company with a 15 TB SAN. All opinions about the disadvantages of creating really large filesystems aside, I'm trying to find out what is the maximum filesystem size we can allocate on our SAN that a linux box (x86) can really use.

I seem to be finding (from various posts on newsgroups and the kernel source itself) that block devices with 2.4 kernels cannot exceed 2 TB, so no matter what the filesystem can theoretically handle, 2 TB is the practical limit.

I've read that XFS filesystems can theoretically be created up to 18 million TB in size.

What I can't seem to find anywhere is whether the 2 TB block device limit has improved/grown with 2.6 kernels (on x86 hardware). Perhaps I've looked in the wrong places, but I haven't found anything.

If you have any helpful information, or can point me towards a better place to look I would be very appreciative.

I am not joined to this list, so if you can CC: me in the reply I would also be grateful.

Aaron

#1 lore raw
Quoted 4 lines · Aaron Peterson

I work for a company with a 15 TB SAN. All opinions about the disadvantages of creating really large filesystems aside, I'm trying to find out what is the maximum filesystem size we can allocate on our SAN that a linux box (x86) can really use.

For 2.4.x 1Tb (2Tb works for some devices but its a bit variable)

Quoted 3 lines

What I can't seem to find anywhere is whether the 2 TB block device limit has improved/grown with 2.6 kernels (on x86 hardware). Perhaps I've looked in the wrong places, but I haven't found anything.

2.6 fixed this problem although it appears not for some specialist cases. Last time I checked LVM logical volumes over 2Tb were reported problematic.

#2 lore raw
Quoted 8 lines · Alan Cox
Quoted 4 lines · Aaron Peterson

I work for a company with a 15 TB SAN. All opinions about the disadvantages of creating really large filesystems aside, I'm trying to find out what is the maximum filesystem size we can allocate on our SAN that a linux box (x86) can really use.

For 2.4.x 1Tb (2Tb works for some devices but its a bit variable)

Quoted 7 lines
Quoted 3 lines

What I can't seem to find anywhere is whether the 2 TB block device limit has improved/grown with 2.6 kernels (on x86 hardware). Perhaps I've looked in the wrong places, but I haven't found anything.

2.6 fixed this problem although it appears not for some specialist cases. Last time I checked LVM logical volumes over 2Tb were reported problematic.

I've read that the other main difficulty besides block device size limits is problems with the ext2 management tools themselves. So, how would you rate my chances of using a 2.6 kernel with XFS (and xfs management tools of course) with a 5 TB filesystem? Probably not a well tested scenerio to say the least...

Aaron

#3 lore raw
Quoted 17 lines · Aaron Peterson
Quoted 8 lines · Alan Cox
Quoted 4 lines · Aaron Peterson

I work for a company with a 15 TB SAN. All opinions about the disadvantages of creating really large filesystems aside, I'm trying to find out what is the maximum filesystem size we can allocate on our SAN that a linux box (x86) can really use.

For 2.4.x 1Tb (2Tb works for some devices but its a bit variable)

Quoted 7 lines
Quoted 3 lines

What I can't seem to find anywhere is whether the 2 TB block device limit has improved/grown with 2.6 kernels (on x86 hardware). Perhaps I've looked in the wrong places, but I haven't found anything.

2.6 fixed this problem although it appears not for some specialist cases. Last time I checked LVM logical volumes over 2Tb were reported problematic.

Quoted 5 lines

I've read that the other main difficulty besides block device size limits is problems with the ext2 management tools themselves. So, how would you rate my chances of using a 2.6 kernel with XFS (and xfs management tools of course) with a 5 TB filesystem? Probably not a well tested scenerio to say the least...

Assuming the device driver(s) you pick are happy with 64 bit sector numbers, you should expect this to work (iow, you should not have any trouble from XFS itself). SGI ships 2.4 product with specific supported drivers and the LBD patch (both 32 and 64 bit boxen) in order to use large devices.

cheers.

Signature · 1 line
Nathan