File System Limitations
Hi,
I need some basic info on File Size Limitations on filesystems such as ext2/3 and ntfs.
I have looked on various search enfines and help sites but cannot find a list for comparison.
I need to store several 60GB files containing images.
Thanks
Fred
In the ancient scrolls of Usenet, page <[email protected]>, "Fred" <[email protected]> spake thus:
Quoted 2 lines
I need some basic info on File Size Limitations on filesystems such as ext2/3 and ntfs.
ext2/4 use are 64bit these days. I guess signed so they'd have limit of 2TB per partition/file.
Tony
Signature · 4 lines
Microsoft - two out of three dead people who expressed a preference said their coffins preferred it. [email protected] http://www.nothing-on.tv
so why dos my filesystem have a 2 GB limit?
Must I specify a large block size or some such when i format?
i run 2.4.9 on redhat7.1 out of the box
Fred
_________________________________________________
Quoted 11 lines · Tony Hoyle
In the ancient scrolls of Usenet, page <[email protected]>, "Fred" <[email protected]>
spake thus:
Quoted 2 lines
I need some basic info on File Size Limitations on filesystems such as ext2/3 and ntfs.
ext2/4 use are 64bit these days. I guess signed so they'd have limit of 2TB per partition/file.
Tony
Quoted 5 lines · Fred
so why dos my filesystem have a 2 GB limit?
Must I specify a large block size or some such when i format?i run 2.4.9 on redhat7.1 out of the box
Does it? Unless RH are using a seriously old glibc (which I doubt) there's no 2GB limit any more.
Some older applications don't work with it AFAIK... anything bundled with a modern distro shouldn't have any problems.
Tony
glibc-2.2.2-10
dd if=/dev/zero of=./tgb count=4000 bs=1M
created file of 2147483647 bytes
[root@bits /a5]# dd if=/dev/zero of=./tgb count=4000 bs=1M File size limit exceeded (core dumped)
[root@bits /a5]#
is glibc part of gcc? where do i find glibc?
(I've recently compiled gcc-3.00, but won't install cause it breaks kernel compilations).
TIA
Fred
_________________________________________________
Quoted 19 lines · Tony Hoyle
Quoted 4 lines · Fred
so why dos my filesystem have a 2 GB limit?
Must I specify a large block size or some such when i format?i run 2.4.9 on redhat7.1 out of the box
Does it? Unless RH are using a seriously old glibc (which I doubt) there's no 2GB limit any more.
Some older applications don't work with it AFAIK... anything bundled with a modern distro shouldn't have any problems.
Tony
-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/
Quoted 1 line
glibc-2.2.2-10
Your C library is new enough
Quoted 2 lines
[root@bits /a5]# dd if=/dev/zero of=./tgb count=4000 bs=1M File size limit exceeded (core dumped)
But your dd program might not be
Alan
Quoted 10 lines · Fred
glibc-2.2.2-10
dd if=/dev/zero of=./tgb count=4000 bs=1M
created file of 2147483647 bytes
[root@bits /a5]# dd if=/dev/zero of=./tgb count=4000 bs=1M File size limit exceeded (core dumped)
[root@bits /a5]#
Quoted 8 lines
is glibc part of gcc? where do i find glibc?
(I've recently compiled gcc-3.00, but won't install cause it breaks kernel compilations).TIA
Fred
It looks as though dd has not been built with long file support. Most software on a stock Red Hat install hasn't.
Signature · 1 line
Ignacio Vazquez-Abrams <[email protected]>
Quoted 9 lines · Tony Hoyle
Quoted 5 lines · Fred
so why dos my filesystem have a 2 GB limit?
Must I specify a large block size or some such when i format? i run 2.4.9 on redhat7.1 out of the boxDoes it? Unless RH are using a seriously old glibc (which I doubt) there's no 2GB limit any more.
I just did:
[doug@abbadon workspace]$ dd if=/dev/zero of=foo bs=1024k count=3072 3072+0 records in
3072+0 records out
[doug@abbadon workspace]$ ls -l foo
-rw-rw-r-- 1 doug doug 3221225472 Aug 23 20:01 foo
[doug@abbadon workspace]$
-Doug
Signature · 4 lines
Free Dmitry Sklyarov! http://www.freesklyarov.org/ We will return to our regularly scheduled signature shortly.
Quoted 5 lines · Doug McNaught
Quoted 2 lines · Tony Hoyle
Does it? Unless RH are using a seriously old glibc (which I doubt) there's no 2GB limit any more.
Quoted 8 lines
I just did:
[doug@abbadon workspace]$ dd if=/dev/zero of=foo bs=1024k count=3072 3072+0 records in
3072+0 records out
[doug@abbadon workspace]$ ls -l foo
-rw-rw-r-- 1 doug doug 3221225472 Aug 23 20:01 foo
[doug@abbadon workspace]$
I meant to add that this is RH7.1, with updates applied, running 2.4.8-ac8.
-Doug
Signature · 4 lines
Free Dmitry Sklyarov! http://www.freesklyarov.org/ We will return to our regularly scheduled signature shortly.
Do you have a file size limit set in ulimit? The last RedHat I installed had most of the limits set.
-- Brian
Quoted 48 lines · Fred
glibc-2.2.2-10
dd if=/dev/zero of=./tgb count=4000 bs=1M
created file of 2147483647 bytes
[root@bits /a5]# dd if=/dev/zero of=./tgb count=4000 bs=1M File size limit exceeded (core dumped)
[root@bits /a5]#is glibc part of gcc? where do i find glibc?
(I've recently compiled gcc-3.00, but won't install cause it breaks kernel compilations).TIA
Fred
_________________________________________________
Quoted 12 lines · Tony Hoyle
Quoted 4 lines · Fred
so why dos my filesystem have a 2 GB limit?
Must I specify a large block size or some such when i format?i run 2.4.9 on redhat7.1 out of the box
Does it? Unless RH are using a seriously old glibc (which I doubt) there's no 2GB limit any more.
Some older applications don't work with it AFAIK... anything bundled with a modern distro shouldn't have any problems.
Quoted 7 lines
Tony
-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to [email protected] More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/
I tried dd (GNU fileutils) 4.0.36 (redhat 7.1)
and compiled and installed dd (fileutils) 4.1
still
[root@bits /a5]# /usr/fileutils/bin/dd if=/dev/zero of=./tgb count=4000 bs=1M File size limit exceeded (core dumped)
[root@bits /a5]# ls
total 2098436
8 drwxr-xr-x 7 root root 8192 Aug 23 22:07 . 1120 -rwxr-xr-x 1 root root 1146880 Aug 23 22:07 core 2097152 -rwxr-xr-x 1 root root 2147483647 Aug 23 22:07 tgb
no errors in /var/log/messages
some system info
amd k6-II 500
256 MB ram
Ali 1541/3 chipset
WD 20GB 7200 rpm and WD 13GB 540 rpm on one cable kernel-2.4.9
/a5 directory above is /dev/hda5 a vfat partition (is this the problem?)
TIA
Fred
_________________________________________________
Quoted 15 lines · Alan Cox
Quoted 1 line
glibc-2.2.2-10
Your C library is new enough
Quoted 2 lines
[root@bits /a5]# dd if=/dev/zero of=./tgb count=4000 bs=1M File size limit exceeded (core dumped)
But your dd program might not be
Alan
-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/
Quoted 2 lines · Fred
/a5 directory above is
/dev/hda5a vfat partition (is this the problem?)
that's exactly the problem, FAT32 doesn't support files over 2GB
Quoted 1 line · Fred
/a5 directory above is
/dev/hda5a vfat partition (is this the problem?)
Almost certainly.
Try it on ext2 (if you have the space) and it should work.
-Doug
Signature · 4 lines
Free Dmitry Sklyarov! http://www.freesklyarov.org/ We will return to our regularly scheduled signature shortly.
Quoted 24 lines · Fred
I tried dd (GNU fileutils) 4.0.36 (redhat 7.1)
and compiled and installed dd (fileutils) 4.1still
[root@bits /a5]#/usr/fileutils/bin/ddif=/dev/zero of=./tgb count=4000 bs=1M File size limit exceeded (core dumped)
[root@bits /a5]# ls
total 20984368 drwxr-xr-x 7 root root 8192 Aug 23 22:07 . 1120 -rwxr-xr-x 1 root root 1146880 Aug 23 22:07 core 2097152 -rwxr-xr-x 1 root root 2147483647 Aug 23 22:07 tgbno errors in
/var/log/messagessome system info
amd k6-II 500
256 MB ram
Ali 1541/3 chipset
WD 20GB 7200 rpm and WD 13GB 540 rpm on one cable kernel-2.4.9
/a5 directory above is/dev/hda5a vfat partition (is this the problem?)
Quoted 2 lines
TIA
Fred
The problem is that dd was not compiled with -D_FILE_OFFSET_BITS=64.
Signature · 1 line
Ignacio Vazquez-Abrams <[email protected]>
I am just curious,
did you compiled your glibc against a 2.2 or 2.4 kernel headers???
Luigi
Quoted 16 lines · Alan Cox
Quoted 1 line
glibc-2.2.2-10
Your C library is new enough
Quoted 2 lines
[root@bits /a5]# dd if=/dev/zero of=./tgb count=4000 bs=1M File size limit exceeded (core dumped)
But your dd program might not be
Alan
-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/
Quoted 8 lines · Fred
glibc-2.2.2-10
dd if=/dev/zero of=./tgb count=4000 bs=1M
created file of 2147483647 bytes
[root@bits /a5]# dd if=/dev/zero of=./tgb count=4000 bs=1M File size limit exceeded (core dumped)
core dump???
My old dd terminated with an error in this case.
Do you have a file size limit set (ulimit -a)?
Walter