Skip to contentSkip to conversation

mkfs.btrfs broken

DISCUSSION Swâmi Petaramesh 6 participants 11 messages Mar 7, 2013 Btrfs file system

lore
Share & tools
lore
#0 lore raw

Hi,

mkfs.btrfs v0.20-rc1, as provided in the excellent "Parted Magic" tool, latest version dated 2013/02/28, is broken :

When trying to mkfs.btrfs - even on newly made, FS-free partition, it always spits an error that it cannot check partition mount status and fails.

There has always been such an issue with mkfs.btrfs AFAIR, but it can more or less work depending on the distribution etc...

In the past, some versions of mkfs.btrfs had a "-f" option that would force formatting even if this test failed, but alas this option seems to have disappeared...

PartedMagic being a "live CD", it might be easy to reproduce and check what, exactly, goes wrong ?

Kind regards.

Signature · 2 lines
Swâmi Petaramesh <[email protected]> http://petaramesh.org PGP 9076E32E
Ne cherchez pas : Je ne suis pas sur Facebook.
#1 lore raw
Quoted 4 lines · Swâmi Petaramesh

Hi,

mkfs.btrfs v0.20-rc1, as provided in the excellent "Parted Magic" tool, latest version dated 2013/02/28, is broken :

Unfortunately "v0.20-rc1" spans months of development, since btrfs-progs has no consistent release or versioning activity.

Quoted 2 lines

When trying to mkfs.btrfs - even on newly made, FS-free partition, it always spits an error that it cannot check partition mount status and fails.

What error messages does it emit, anything helpful?

Quoted 6 lines

There has always been such an issue with mkfs.btrfs AFAIR, but it can more or less work depending on the distribution etc...

In the past, some versions of mkfs.btrfs had a "-f" option that would force formatting even if this test failed, but alas this option seems to have disappeared...

The option is quite new, and still exists upstream. But it only forces overwrite of an existing filesystem, it has never affected the mount status check AFAIK.

Quoted 2 lines

PartedMagic being a "live CD", it might be easy to reproduce and check what, exactly, goes wrong ?

There are also steps you could take to investigate some more yourself:

Did earlier versions of the livecd work for you?
If so, when did it break?
Looking at the PartedMagic changelog, what were relevant changes? Can you reproduce this outside the PartedMagic CD?
Is it possibly a PartedMagic bug?
Can you capture an strace of the failing mkfs.btrfs?

-Eric

Quoted 2 lines

Kind regards.

#2 lore raw
Quoted 1 line · Eric Sandeen

What error messages does it emit, anything helpful?

root@partedmagic:~# file -s /dev/sda5
/dev/sda5: data
root@partedmagic:~# mkfs.btrfs /dev/sda5

WARNING! - Btrfs v0.20-rc1 IS EXPERIMENTAL WARNING! - see http://btrfs.wiki.kernel.org before using

error checking /dev/sda5 mount status

root@partedmagic:~# echo $?
1
Quoted 3 lines

The option is quite new, and still exists upstream. But it only forces overwrite of an existing filesystem, it has never affected the mount status check AFAIK.

I remember that, in the past, I was several time able to override this very error by using a -f switch...

Quoted 2 lines

There are also steps you could take to investigate some more yourself:
Did earlier versions of the livecd work for you? If so, when did it break?

It was broke first time I tried to use it more than a year ago ; I don't clearly remember if it has been fixed at some point in time... I'm positively sure that I saw the exact same error on other live distros (possibly Ubuntu but not sure...)

Quoted 1 line

Can you capture an strace of the failing mkfs.btrfs? -Eric

I don't know how to do this, I'm no developper myself...

Kind regards.

Signature · 2 lines
Swâmi Petaramesh <[email protected]> http://petaramesh.org PGP 9076E32E
Ne cherchez pas : Je ne suis pas sur Facebook.
#3 lore raw
Quoted 6 lines · Swâmi Petaramesh
Quoted 1 line · Eric Sandeen

What error messages does it emit, anything helpful?

root@partedmagic:~# file -s /dev/sda5
/dev/sda5: data
Quoted 6 lines
root@partedmagic:~# mkfs.btrfs /dev/sda5

WARNING! - Btrfs v0.20-rc1 IS EXPERIMENTAL WARNING! - see http://btrfs.wiki.kernel.org before using

error checking /dev/sda5 mount status

Ok, so that's unhelpful isn't it. :)

Quoted 10 lines
root@partedmagic:~# echo $?
1
Quoted 3 lines

The option is quite new, and still exists upstream. But it only forces overwrite of an existing filesystem, it has never affected the mount status check AFAIK.

I remember that, in the past, I was several time able to override this very error by using a -f switch...

maybe it was some non-upstream hack I'm not aware of.

Quoted 10 lines
Quoted 2 lines

There are also steps you could take to investigate some more yourself:
Did earlier versions of the livecd work for you? If so, when did it break?

It was broke first time I tried to use it more than a year ago ; I don't clearly remember if it has been fixed at some point in time... I'm positively sure that I saw the exact same error on other live distros (possibly Ubuntu but not sure...)

Quoted 1 line

Can you capture an strace of the failing mkfs.btrfs? -Eric

I don't know how to do this, I'm no developper myself...

# strace -o tracefile.txt mkfs.btrfs /dev/sda5

tracefile.txt will contain all syscalls made by the binary and their results, which might give us a clue what's gone wrong.

-Eric

Quoted 2 lines

Kind regards.

#4 lore raw
Quoted 3 lines · Eric Sandeen
# strace -o tracefile.txt mkfs.btrfs /dev/sda5 tracefile.txt will
contain all syscalls made by the binary and their results, which might
give us a clue what's gone wrong. -Eric

Here it goes !

execve("/sbin/mkfs.btrfs", ["mkfs.btrfs", "/dev/sda5"], [/* 28 vars */]) = 0
brk(0) = 0x9ee6000
mmap2(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1,
0) = 0xb76f0000
access("/etc/ld.so.preload", R_OK) = -1 ENOENT (No such file or
directory)
open("/etc/ld.so.cache", O_RDONLY|O_CLOEXEC) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=48297, ...}) = 0 mmap2(NULL, 48297, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb76e4000
close(3) = 0
open("/lib/libuuid.so.1", O_RDONLY|O_CLOEXEC) = 3
read(3, "\177ELF\1\1\1\0\0\0\0\0\0\0\0\0\3\0\3\0\1\0\0\0@\16\0\0004\0\0\0"...,
512) = 512
fstat64(3, {st_mode=S_IFREG|0755, st_size=11888, ...}) = 0 mmap2(NULL, 14712, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0xb76e0000
mmap2(0xb76e3000, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x2) = 0xb76e3000
close(3) = 0
open("/lib/libm.so.6", O_RDONLY|O_CLOEXEC) = 3
read(3, "\177ELF\1\1\1\0\0\0\0\0\0\0\0\0\3\0\3\0\1\0\0\0@D\0\0004\0\0\0"...,
512) = 512
fstat64(3, {st_mode=S_IFREG|0755, st_size=202934, ...}) = 0 mmap2(NULL, 176256, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3,
0) = 0xb76b4000
mmap2(0xb76de000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x29) = 0xb76de000
close(3) = 0
open("/lib/libc.so.6", O_RDONLY|O_CLOEXEC) = 3
read(3, "\177ELF\1\1\1\0\0\0\0\0\0\0\0\0\3\0\3\0\1\0\0\0\0\227\1\0004\0\0\0"...,
512) = 512
fstat64(3, {st_mode=S_IFREG|0755, st_size=1769964, ...}) = 0 mmap2(NULL, 1571356, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3,
0) = 0xb7534000
mmap2(0xb76ae000, 12288, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x179) = 0xb76ae000 mmap2(0xb76b1000, 10780, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0xb76b1000
close(3) = 0
mmap2(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1,
0) = 0xb7533000
mmap2(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1,
0) = 0xb7532000
set_thread_area({entry_number:-1 -> 6, base_addr:0xb7532700, limit:1048575, seg_32bit:1, contents:0, read_exec_only:0, limit_in_pages:1, seg_not_present:0, useable:1}) = 0

mprotect(0xb76ae000, 8192, PROT_READ)   = 0
mprotect(0xb76de000, 4096, PROT_READ)   = 0
mprotect(0xb7712000, 4096, PROT_READ)   = 0
munmap(0xb76e4000, 48297)               = 0

fstat64(1, {st_mode=S_IFCHR|0620, st_rdev=makedev(136, 1), ...}) = 0 mmap2(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1,
0) = 0xb76ef000
write(1, "\n", 1) = 1
write(1, "WARNING! - Btrfs v0.20-rc1 IS EX"..., 43) = 43 write(1, "WARNING! - see http://btrfs.wiki"..., 57) = 57
write(1, "\n", 1) = 1
open("/dev/sda5", O_RDONLY|O_LARGEFILE) = 3
brk(0) = 0x9ee6000
brk(0x9f08000) = 0x9f08000
pread64(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 3531, 65536) = 3531
pread64(3, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"..., 3531, 67108864) = 3531
pread64(3, "", 3531, 274877906944) = 0
brk(0x9f07000) = 0x9f07000
open("/proc/mounts", O_RDONLY|O_CLOEXEC) = 4
fstat64(4, {st_mode=S_IFREG|0444, st_size=0, ...}) = 0 mmap2(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1,
0) = 0xb76ee000
read(4, "rootfs / rootfs rw 0 0\nproc /pro"..., 1024) = 480
stat64("rootfs", 0xbff5b970) = -1 ENOENT (No such file or
directory)
stat64("proc", 0xbff5b970) = -1 ENOENT (No such file or
directory)
stat64("sysfs", 0xbff5b970) = -1 ENOENT (No such file or
directory)
stat64("devtmpfs", 0xbff5b970) = -1 ENOENT (No such file or
directory)
stat64("tmpfs", 0xbff5b970) = -1 ENOENT (No such file or
directory)
stat64("devpts", 0xbff5b970) = -1 ENOENT (No such file or
directory)
stat64("fusectl", 0xbff5b970) = -1 ENOENT (No such file or
directory)
stat64("/dev/loop2", {st_mode=S_IFBLK|0660, st_rdev=makedev(7, 2), ...}) = 0 stat64("/dev/sda5", {st_mode=S_IFBLK|0660, st_rdev=makedev(8, 5), ...}) = 0 stat64("/dev/loop2", {st_mode=S_IFBLK|0660, st_rdev=makedev(7, 2), ...}) = 0 open("/dev/loop2", O_RDONLY|O_LARGEFILE) = 5
ioctl(5, 0x4c03, 0xbff59904) = 0
close(5) = 0
lstat64("/dev", {st_mode=S_IFDIR|0755, st_size=10060, ...}) = 0 lstat64("/dev/sda5", {st_mode=S_IFBLK|0660, st_rdev=makedev(8, 5), ...}) = 0
lstat64("/sqfs_disk", 0xbff57820) = -1 ENOENT (No such file or
directory)

close(4)                                = 0
munmap(0xb76ee000, 4096)                = 0
close(3)                                = 0

write(2, "error checking /dev/sda5 mount s"..., 38) = 38
exit_group(1) = ?

Signature · 2 lines
Swâmi Petaramesh <[email protected]> http://petaramesh.org PGP 9076E32E
Ne cherchez pas : Je ne suis pas sur Facebook.
#5 lore raw
Quoted 6 lines · Swâmi Petaramesh
Quoted 3 lines · Eric Sandeen
# strace -o tracefile.txt mkfs.btrfs /dev/sda5 tracefile.txt will
contain all syscalls made by the binary and their results, which might
give us a clue what's gone wrong. -Eric

Here it goes !

Could you please send the contents of /proc/mounts

-chris

#6 lore raw
Quoted 1 line · Chris Mason

Could you please send the contents of /proc/mounts

Here it goes !

(Last line is the USB key I dropped in just for taking a copy of /proc/mounts ; it didn't exist at the time the errors occured...)

rootfs / rootfs rw 0 0
proc /proc proc rw,relatime 0 0
sysfs /sys sysfs rw,relatime 0 0
devtmpfs /dev devtmpfs
rw,relatime,size=990948k,nr_inodes=170721,mode=755 0 0
tmpfs /run tmpfs rw,relatime 0 0
devpts /dev/pts devpts rw,relatime,gid=5,mode=620,ptmxmode=000 0 0
fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0
/dev/loop2 /br_sqfs squashfs ro,relatime 0 0
aufs / aufs rw,relatime,si=6434ca9 0 0
tmpfs /tmp tmpfs rw,relatime 0 0
nfsd /proc/fs/nfsd nfsd rw,relatime 0 0
/dev/sdc1 /media/sdc1 vfat rw,relatime,fmask=0022,dmask=0022,codepage=cp437,iocharset=iso8859-1,shortname=mixed,utf8,errors=remount-ro 0 0

Signature · 2 lines
Swâmi Petaramesh <[email protected]> http://petaramesh.org PGP 9076E32E
Ne cherchez pas : Je ne suis pas sur Facebook.
#7 lore raw
In reply to Swâmi Petaramesh
Quoted 2 lines · Swâmi Petaramesh

lstat64("/sqfs_disk", 0xbff57820) = -1 ENOENT (No such file or
directory)

mkfs.btrfs tries to lookup loop devices by their filenames and fails if any loop device file is missing.

#8 lore raw
Quoted 2 lines · Jérôme Poulin

mkfs.btrfs tries to lookup loop devices by their filenames and fails if any loop device file is missing.

Hmm.... Why would mkfs.btrfs want to lookup anything else but the device we're trying to format, to check if it's mounted or not ?

Signature · 2 lines
Swâmi Petaramesh <[email protected]> http://petaramesh.org PGP 9076E32E
Ne cherchez pas : Je ne suis pas sur Facebook.
#9 lore raw
Quoted 7 lines · Swâmi Petaramesh
Quoted 2 lines · Jérôme Poulin

mkfs.btrfs tries to lookup loop devices by their filenames and fails if any loop device file is missing.

Hmm.... Why would mkfs.btrfs want to lookup anything else but the device we're trying to format, to check if it's mounted or not ?

At Sabayon, we pretty-much hacked our way around this with a "make-it-go" kind of patch.

Otherwise, our installation would break with btrfs on our Live-[CD/DVD/USB] media.

I know we should have taken the time to put together a proper solution, but I could never figure out the reasoning for needing to scan every device either.

utils.c +23 -16
@@ -708,6 +708,21 @@ int is_same_blk_file(const char* a, cons
 	return 0;
 }
 
+/* Checks if a file exists and is a block or regular file*/
+int is_existing_blk_or_reg_file(const char* filename)
+{
+	struct stat st_buf;
+
+	if(stat(filename, &st_buf) < 0) {
+		if(errno == ENOENT)
+			return 0;
+		else
+			return -errno;
+	}
+
+	return (S_ISBLK(st_buf.st_mode) || S_ISREG(st_buf.st_mode));
+}
+
 /* checks if a and b are identical or device
  * files associated with the same block device or
  * if one file is a loop device that uses the other
@@ -727,7 +742,10 @@ int is_same_loop_file(const char* a, con
 	} else if(ret) {
 		if((ret = resolve_loop_device(a, res_a, sizeof(res_a))) < 0)
 			return ret;
-
+		/* if the resolved path is not available, there is nothing
+		   we can do */
+		if((ret = is_existing_blk_or_reg_file(res_a)) == 0)
+			return ret;
 		final_a = res_a;
 	} else {
 		final_a = a;
@@ -739,6 +757,10 @@ int is_same_loop_file(const char* a, con
 	} else if(ret) {
 		if((ret = resolve_loop_device(b, res_b, sizeof(res_b))) < 0)
 			return ret;
+		/* if the resolved path is not available, there is nothing
+		   we can do */
+		if((ret = is_existing_blk_or_reg_file(res_b)) == 0)
+			return ret;
 
 		final_b = res_b;
 	} else {
@@ -748,21 +770,6 @@ int is_same_loop_file(const char* a, con
 	return is_same_blk_file(final_a, final_b);
 }
 
-/* Checks if a file exists and is a block or regular file*/
-int is_existing_blk_or_reg_file(const char* filename)
-{
-	struct stat st_buf;
-
-	if(stat(filename, &st_buf) < 0) {
-		if(errno == ENOENT)
-			return 0;
-		else
-			return -errno;
-	}
-
-	return (S_ISBLK(st_buf.st_mode) || S_ISREG(st_buf.st_mode));
-}
-
 /* Checks if a file is used (directly or indirectly via a loop device)
  * by a device in fs_devices
  */
#10 lore raw
In reply to Swâmi Petaramesh
Quoted 7 lines · Swâmi Petaramesh

Hi,

mkfs.btrfs v0.20-rc1, as provided in the excellent "Parted Magic" tool, latest version dated 2013/02/28, is broken :

When trying to mkfs.btrfs - even on newly made, FS-free partition, it always spits an error that it cannot check partition mount status and fails.

Can you share the command and error-output. Unless I know the actual error any suggestion/comments will just be a guess-work.

Quoted 2 lines

There has always been such an issue with mkfs.btrfs AFAIR, but it can more or less work depending on the distribution etc...

Yes. Most of these were printed as error without an impact. to have confirmation its better if you could share the command and its error-output.

regds, Anand

Quoted 8 lines

In the past, some versions of mkfs.btrfs had a "-f" option that would force formatting even if this test failed, but alas this option seems to have disappeared...

PartedMagic being a "live CD", it might be easy to reproduce and check what, exactly, goes wrong ?

Kind regards.