LFS stopped working
Hey,
I've been running 2.4.14 for a few days now. I needed LFS support, so I recompiled glibc 2.1.3 with the new 2.4 headers, and after that I could create large files (e.g. using dd if=/dev/zero of=test bs=1M count=0 seek=3000) just fine.
However, as of yesterday, I couldn't create files bigger than 2GB anymore. I did not change kernels, nor did I mess with libc or anything else (I did some Debian package upgrades/installations/recompiles, but I don't think they should affect this) - I'm not quite sure what happened. Now commands such as the dd command I mentioned above will die with the message "File size limit exceeded", leaving a 2GB file behind. Rebooting didn't solve anything. My ulimits seem to be fine (file size = unlimited).
The last few lines of the strace on the dd command above shows the following:open("/dev/zero", O_RDONLY|0x8000) = 0
close(1) = 0open("test", O_RDWR|O_CREAT|0x8000, 0666) = 1 ftruncate64(0x1, 0xbb800000, 0, 0, 0x1) = 0
--- SIGXFSZ (File size limit exceeded) ---
+++ killed by SIGXFSZ +++
Also, cat'ing two 2GB files together into one big 4GB file (cat file1 file2
Quoted 1 line
file3) just dies after creating a 2GB file, whereas it used to work fine
(if I remember correctly). Doing an strace on it ends with the following lines:write(1, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 4096) = 4096read(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 4096) = 4096write(1, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 4096) = 4095write(1, "\0", 1) = -1 EFBIG (File too large)
--- SIGXFSZ (File size limit exceeded) ---
+++ killed by SIGXFSZ +++
I'm doing this on a ReiserFS filesystem, but trying it on an ext2 partition yields the same results.
Any suggestions?
Thanks,
Alex
Quoted 7 lines · Alex Adriaanse
Hey,
I've been running 2.4.14 for a few days now. I needed LFS support, so I recompiled glibc 2.1.3 with the new 2.4 headers, and after that I could create large files (e.g. using dd if=/dev/zero of=test bs=1M count=0 seek=3000) just fine.
Quoted 7 lines
However, as of yesterday, I couldn't create files bigger than 2GB anymore. I did not change kernels, nor did I mess with libc or anything else (I did some Debian package upgrades/installations/recompiles, but I don't think they should affect this) - I'm not quite sure what happened. Now commands such as the dd command I mentioned above will die with the message "File size limit exceeded", leaving a 2GB file behind. Rebooting didn't solve anything. My ulimits seem to be fine (file size = unlimited).
Actually it does affect it. Recompiling glibc isn't the end all to LFS support. In fact, 2.1.3 has less than adequate support for LFS, IIRC, so use 2.2.x. For Debian, that just means upgrading to woody(testing).
Your problem extends from programs also needing to be recompiled with LFS support. This involves some special LFS CFLAGS, and most common programs detect whether to do this using autoconf (fileutils, gzip and tar are perfect examples of programs that use this feature).
Ben
Signature · 4 lines
.----------=======-=-======-=========-----------=====------------=-=-----. / Ben Collins -- Debian GNU/Linux \ ` [email protected] -- [email protected] -- [email protected] ' `---=========------=======-------------=-=-----=-===-======-------=--=---'
I actually re-compiled fileutils 4.1-7 from woody, and it still didn't change anything. This is what ./configure said during the recompile by the way:
checking for special C compiler options needed for large files... no checking for _FILE_OFFSET_BITS value needed for large files... 64 checking for _LARGE_FILES value needed for large files... no I'm assuming that this is the way it's supposed to be.
What I don't get though is that dd and other programs USED to work fine - and I didn't update the kernel, glibc, or these programs (which I suppose are the only things that could break LFS for utilities such as dd) after they worked fine. I even reinstalled my new LFS-supporting glibc-2.1.3 to be on the safe side in case apt-get "upgraded" them (which it didn't, as I put it on hold).
Looking at the strace, it looks like these problems are actually coming from the kernel, since the system call actually seems to be causing the problem... but of course I could be wrong.
Thanks,
Alex
-----Original Message-----
From: Ben Collins [mailto:[email protected]]
Sent: Wednesday, November 14, 2001 6:58 PM
To: Alex Adriaanse
Cc: [email protected]
Subject: Re: LFS stopped working
Quoted 7 lines · Alex Adriaanse
Hey,
I've been running 2.4.14 for a few days now. I needed LFS support, so I recompiled glibc 2.1.3 with the new 2.4 headers, and after that I could create large files (e.g. using dd if=/dev/zero of=test bs=1M count=0 seek=3000) just fine.
Quoted 7 lines
However, as of yesterday, I couldn't create files bigger than 2GB anymore. I did not change kernels, nor did I mess with libc or anything else (I did some Debian package upgrades/installations/recompiles, but I don't think they should affect this) - I'm not quite sure what happened. Now commands such as the dd command I mentioned above will die with the message "File size limit exceeded", leaving a 2GB file behind. Rebooting didn't solve anything. My ulimits seem to be fine (file size = unlimited).
Actually it does affect it. Recompiling glibc isn't the end all to LFS support. In fact, 2.1.3 has less than adequate support for LFS, IIRC, so use 2.2.x. For Debian, that just means upgrading to woody(testing).
Your problem extends from programs also needing to be recompiled with LFS support. This involves some special LFS CFLAGS, and most common programs detect whether to do this using autoconf (fileutils, gzip and tar are perfect examples of programs that use this feature).
Ben
--
.----------=======-=-======-=========-----------=====------------=-=-----.
/ Ben Collins -- Debian GNU/Linux \
` [email protected] -- [email protected] -- [email protected] '
`---=========------=======-------------=-=-----=-===-======-------=--=---'
killed by SIGXFSZ +++
Quoted 23 lines · Alex Adriaanse
Hey,
I've been running 2.4.14 for a few days now. I needed LFS support, so I recompiled glibc 2.1.3 with the new 2.4 headers, and after that I could create large files (e.g. using dd if=/dev/zero of=test bs=1M count=0 seek=3000) just fine.
However, as of yesterday, I couldn't create files bigger than 2GB anymore. I did not change kernels, nor did I mess with libc or anything else (I did some Debian package upgrades/installations/recompiles, but I don't think they should affect this) - I'm not quite sure what happened. Now commands such as the dd command I mentioned above will die with the message "File size limit exceeded", leaving a 2GB file behind. Rebooting didn't solve anything. My ulimits seem to be fine (file size = unlimited).
The last few lines of the strace on the dd command above shows the following:
open("/dev/zero", O_RDONLY|0x8000)= 0
close(1) = 0open("test", O_RDWR|O_CREAT|0x8000, 0666)= 1ftruncate64(0x1, 0xbb800000, 0, 0, 0x1)= 0killed by SIGXFSZ +++ renamed from SIGXFSZ (File size limit exceeded) --- +0
-0
ulimit is hit. I strongly advise to upgrade to glibc 2.2 when using kernel 2.4,
Andreas
Signature · 4 lines
Andreas Jaeger SuSE Labs [email protected] private [email protected] http://www.suse.de/~aj
But ulimit shows that the file size is unlimited... would this be a bug? If that's the case, then how/why would it work before?
Thanks,
Alex
-----Original Message-----
From: [email protected] [mailto:[email protected]]
Sent: Thursday, November 15, 2001 1:38 AM
To: Alex Adriaanse
Cc: [email protected]
Subject: Re: LFS stopped working
killed by SIGXFSZ +++
Quoted 23 lines · Alex Adriaanse
Hey,
I've been running 2.4.14 for a few days now. I needed LFS support, so I recompiled glibc 2.1.3 with the new 2.4 headers, and after that I could create large files (e.g. using dd if=/dev/zero of=test bs=1M count=0 seek=3000) just fine.
However, as of yesterday, I couldn't create files bigger than 2GB anymore. I did not change kernels, nor did I mess with libc or anything else (I did some Debian package upgrades/installations/recompiles, but I don't think they should affect this) - I'm not quite sure what happened. Now commands such as the dd command I mentioned above will die with the message "File size limit exceeded", leaving a 2GB file behind. Rebooting didn't solve anything. My ulimits seem to be fine (file size = unlimited).
The last few lines of the strace on the dd command above shows the following:
open("/dev/zero", O_RDONLY|0x8000)= 0
close(1) = 0open("test", O_RDWR|O_CREAT|0x8000, 0666)= 1ftruncate64(0x1, 0xbb800000, 0, 0, 0x1)= 0killed by SIGXFSZ +++ renamed from SIGXFSZ (File size limit exceeded) --- +0
-0
ulimit is hit. I strongly advise to upgrade to glibc 2.2 when using kernel 2.4,
Andreas
--
Andreas Jaeger
SuSE Labs [email protected]
private [email protected]
http://www.suse.de/~aj
Quoted 2 lines · Alex Adriaanse
But ulimit shows that the file size is unlimited... would this be a bug? If that's the case, then how/why would it work before?
If you use an older distro, bash will not handle the changed getrlimit syscall in 2.4, for details check the Red Hat entry under:
http://www.suse.de/~aj/linux_lfs.html
Andreas
Signature · 4 lines
Andreas Jaeger SuSE Labs [email protected] private [email protected] http://www.suse.de/~aj
Well, I'm running Debian 2.2 (with a few recompiled newer packages, as well as a recompiled glibc 2.1.3 obviously), which comes with bash 2.03. Compiling & installing bash 2.05, and commenting out that line in /etc/pam.d/ssh that was mentioned in the web page you provided unfortunately didn't change anything - the ulimit for file size was still unlimited, and I still couldn't write >2GB files.
Alex
-----Original Message-----
From: [email protected] [mailto:[email protected]]
Sent: Thursday, November 15, 2001 2:43 AM
To: Alex Adriaanse
Cc: [email protected]
Subject: Re: LFS stopped working
Quoted 1 line · Alex Adriaanse
But ulimit shows that the file size is unlimited... would this be a bug?
If
Quoted 1 line
that's the case, then how/why would it work before?
If you use an older distro, bash will not handle the changed getrlimit syscall in 2.4, for details check the Red Hat entry under:
http://www.suse.de/~aj/linux_lfs.html
Andreas
--
Andreas Jaeger
SuSE Labs [email protected]
private [email protected]
http://www.suse.de/~aj