Can't create thin lv

linux-lvm Marc MERLIN 2 participants 6 messages Jul 26, 2018 – Jul 27, 2018

lore

Share & tools

lore

Marc MERLIN

author

2018-07-26 00:41 UTC #0 lore raw

Howdy,

Kernel 4.17, trying thin LV for the first time, and I'm getting this:

gargamel:~# lvcreate -L 14.50TiB -Zn -T vgds2/thinpool2 
  Using default stripesize 64.00 KiB.
  Thin pool volume with chunk size 8.00 MiB can address at most <1.98 PiB of data.
  /dev/mapper/vgds2-thinpool2_tmeta: open failed: No such file or directory
  Failed to activate new LV.

any idea what I should try next?

gargamel:~# vgdisplay
  --- Volume group ---
  VG Name               vgds2
  System ID             
  Format                lvm2
  Metadata Areas        1
  Metadata Sequence No  32
  VG Access             read/write
  VG Status             resizable
  MAX LV                0
  Cur LV                0
  Open LV               0
  Max PV                0
  Cur PV                1
  Act PV                1
  VG Size               14.55 TiB
  PE Size               4.00 MiB
  Total PE              3815316
  Alloc PE / Size       0 / 0   
  Free  PE / Size       3815316 / 14.55 TiB
  VG UUID               pc1cTH-kFo7-g0Kz-dELp-j51s-1yOO-v20WIV

gargamel:~# lvdisplay
gargamel:~#

Thanks,
Marc

Signature · 4 lines

"A mouse is a device used to point@the xterm you want to type in" - A.S.R.
Microsoft is to operating systems ....
                                      .... what McDonalds is to gourmet cooking
Home page: http://marc.merlins.org/                       | PGP 7F55D5F27AAF9D08

Marc MERLIN

author

2018-07-26 07:24 UTC #1 lore raw

Quoted 10 lines · Marc MERLIN

Howdy,

Kernel 4.17, trying thin LV for the first time, and I'm getting this:

gargamel:~# lvcreate -L 14.50TiB -Zn -T vgds2/thinpool2 
  Using default stripesize 64.00 KiB.
  Thin pool volume with chunk size 8.00 MiB can address at most <1.98 PiB of data.
  /dev/mapper/vgds2-thinpool2_tmeta: open failed: No such file or directory
  Failed to activate new LV.

any idea what I should try next?

Interestingly I got a different error, once:

gargamel:~# lvcreate -L 14.50TiB -Zn -T vgds2/thinpool2 
  Using default stripesize 64.00 KiB.
  Thin pool volume with chunk size 8.00 MiB can address at most <1.98 PiB of data.
  /dev/vgds2/lvol0: not found: device not cleared
  Aborting. Failed to wipe start of new LV.

gargamel:~# mkdir /dev/vgds2/
gargamel:~# l /dev/mapper/
total 0
drwxr-xr-x  2 root root     200 Jul 25 17:27 ./
drwxr-xr-x 20 root root    5280 Jul 26 00:15 ../
crw-------  1 root root 10, 236 Jul 25 17:25 control
lrwxrwxrwx  1 root root       7 Jul 23 08:57 cryptroot -> ../dm-0
lrwxrwxrwx  1 root root       7 Jul 25 06:40 dshelf1 -> ../dm-1
lrwxrwxrwx  1 root root       7 Jul 26 00:11 dshelf2 -> ../dm-2
lrwxrwxrwx  1 root root       7 Jul 25 06:40 eswap1 -> ../dm-3
lrwxrwxrwx  1 root root       7 Jul 25 06:40 raid0d1 -> ../dm-4
lrwxrwxrwx  1 root root       7 Jul 25 06:40 raid0d2 -> ../dm-5
lrwxrwxrwx  1 root root       7 Jul 25 06:40 varchange -> ../dm-6
gargamel:~# vgchange -ay
  0 logical volume(s) in volume group "vgds2" now active

gargamel:~# lvcreate -L 14.50TiB -Zn -T vgds2/thinpool2 
  Using default stripesize 64.00 KiB.
  Thin pool volume with chunk size 8.00 MiB can address at most <1.98 PiB of data.
  /dev/mapper/vgds2-thinpool2_tmeta: open failed: No such file or directory
  Failed to activate new LV.

gargamel:~# psg lvm
root      2378  0.0  0.0  31600   488 ?        Ss   Jul25   0:00 /sbin/lvmetad

gargamel:~# lvcreate --version
  LVM version:     2.02.176(2) (2017-11-03)
  Library version: 1.02.145 (2017-11-03)
  Driver version:  4.39.0
  Configuration:   ./configure --build=i686-linux-gnu --prefix=/usr --includedir=${prefix}/include --mandir=${prefix}/share/man --infodir=${prefix}/share/info --sysconfdir=/etc --localstatedir=/var --disable-silent-rules --libdir=${prefix}/lib/i386-linux-gnu --libexecdir=${prefix}/lib/i386-linux-gnu --runstatedir=/run --disable-maintainer-mode --disable-dependency-tracking --exec-prefix= --bindir=/bin --libdir=/lib/i386-linux-gnu --sbindir=/sbin --with-usrlibdir=/usr/lib/i386-linux-gnu --with-optimisation=-O2 --with-cache=internal --with-clvmd=corosync --with-cluster=internal --with-device-uid=0 --with-device-gid=6 --with-device-mode=0660 --with-default-pid-dir=/run --with-default-run-dir=/run/lvm --with-default-locking-dir=/run/lock/lvm --with-thin=internal --with-thin-check=/usr/sbin/thin_check --with-thin-dump=/usr/sbin/thin_dump --with-thin-repair=/usr/sbin/thin_repair --enable-applib --enable-blkid_wiping --enable-cmdlib --enable-cmirrord --enable-dmeventd --enable-dbus-service --enable-lvmetad --enable-lvmlockd-dlm --enable-lvmlockd-sanlock --enable-lvmpolld --enable-notify-dbus --enable-pkgconfig --enable-readline --enable-udev_rules --enable-udev_sync

strace shows:
openat(AT_FDCWD, "/dev/vgds2/lvol0", O_RDWR|O_DIRECT|O_LARGEFILE|O_NOATIME) = 7
openat(AT_FDCWD, "/proc/self/maps", O_RDONLY|O_LARGEFILE) = 7
openat(AT_FDCWD, "/dev/urandom", O_RDONLY|O_LARGEFILE) = 8
openat(AT_FDCWD, "/proc/self/maps", O_RDONLY|O_LARGEFILE) = 7
stat64("/dev/mapper/dshelf2", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 2), ...}) = 0 stat64("/dev/mapper/dshelf2", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 2), ...}) = 0
openat(AT_FDCWD, "/sys/dev/block/253:7/bdi/read_ahead_kb", O_RDONLY|O_LARGEFILE) = 7
openat(AT_FDCWD, "/sys/dev/block/253:7/bdi/read_ahead_kb", O_WRONLY|O_LARGEFILE) = 7
stat64("/dev/mapper/control", {st_mode=S_IFCHR|0600, st_rdev=makedev(10, 236), ...}) = 0
openat(AT_FDCWD, "/dev/mapper/control", O_RDWR|O_LARGEFILE) = 4
stat64("/dev/vgds2/thinpool2", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 7), ...}) = 0 lstat64("/dev/vgds2/thinpool2", {st_mode=S_IFLNK|0777, st_size=7, ...}) = 0
lstat64("/dev/vgds2/lvol0", 0xffe9462c) = -1 ENOENT (No such file or directory)
stat64("/dev/vgds2/thinpool2", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 7), ...}) = 0
openat(AT_FDCWD, "/dev/vgds2/thinpool2", O_RDWR|O_DIRECT|O_LARGEFILE|O_NOATIME) = 7
openat(AT_FDCWD, "/proc/self/maps", O_RDONLY|O_LARGEFILE) = 7
openat(AT_FDCWD, "/dev/urandom", O_RDONLY|O_LARGEFILE) = 8
openat(AT_FDCWD, "/dev/urandom", O_RDONLY|O_LARGEFILE) = 8
stat64("/sys//dev/block/253:2/queue/minimum_io_size", {st_mode=S_IFREG|0444, st_size=4096, ...}) = 0 openat(AT_FDCWD, "/sys//dev/block/253:2/queue/minimum_io_size", O_RDONLY|O_LARGEFILE) = 7
stat64("/etc/lvm/backup", {st_mode=S_IFDIR|0700, st_size=10, ...}) = 0
access("/etc/lvm/backup", R_OK|W_OK|X_OK) = 0
openat(AT_FDCWD, "/etc/lvm/backup/.lvm_gargamel.svh.merlins.org_19532_130993407", O_WRONLY|O_CREAT|O_EXCL|O_APPEND|O_LARGEFILE, 0666) = 7 rename("/etc/lvm/backup/.lvm_gargamel.svh.merlins.org_19532_130993407", "/etc/lvm/backup/vgds2.tmp") = 0 rename("/etc/lvm/backup/vgds2.tmp", "/etc/lvm/backup/vgds2") = 0
stat64("/etc/lvm/backup/vgds2.tmp", 0xffe96b7c) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, "/etc/lvm/backup", O_RDONLY|O_LARGEFILE) = 7
openat(AT_FDCWD, "/proc/self/maps", O_RDONLY|O_LARGEFILE) = 7

stat64("/dev/mapper/dshelf2", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 2), ...}) = 0
stat64("/dev/mapper/dshelf2", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 2), ...}) = 0
stat64("/dev/mapper/dshelf2", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 2), ...}) = 0
stat64("/dev/mapper/dshelf2", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 2), ...}) = 0
openat(AT_FDCWD, "/sys/dev/block/253:7/bdi/read_ahead_kb", O_RDONLY|O_LARGEFILE) = 8
openat(AT_FDCWD, "/sys/dev/block/253:7/bdi/read_ahead_kb", O_WRONLY|O_LARGEFILE) = 8
openat(AT_FDCWD, "/sys/dev/block/253:8/bdi/read_ahead_kb", O_RDONLY|O_LARGEFILE) = 8
openat(AT_FDCWD, "/sys/dev/block/253:8/bdi/read_ahead_kb", O_WRONLY|O_LARGEFILE) = 8

openat(AT_FDCWD, "/dev/mapper/vgds2-thinpool2_tmeta", O_RDONLY|O_LARGEFILE) = -1 ENOENT (No such file or directory)
/dev/mapper/vgds2-thinpool2_tmeta: open failed: No such file or directory
Failed to activate new LV.

gargamel:~# strace -etrace=file lvcreate -L 14.50TiB -Zn -T vgds2/thinpool2 2>&1 |grep thinpool2
execve("/sbin/lvcreate", ["lvcreate", "-L", "14.50TiB", "-Zn", "-T", "vgds2/thinpool2"], [/* 33 vars */]) = 0
stat64("/dev/vgds2/thinpool2", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 7), ...}) = 0
lstat64("/dev/vgds2/thinpool2", {st_mode=S_IFLNK|0777, st_size=7, ...}) = 0
stat64("/dev/vgds2/thinpool2", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 7), ...}) = 0
openat(AT_FDCWD, "/dev/vgds2/thinpool2", O_RDWR|O_DIRECT|O_LARGEFILE|O_NOATIME) = 7
openat(AT_FDCWD, "/dev/mapper/vgds2-thinpool2_tmeta", O_RDONLY|O_LARGEFILE) = -1 ENOENT (No such file or directory)
  /dev/mapper/vgds2-thinpool2_tmeta: open failed: No such file or directory

Any ideas?

Thanks,
Marc

Signature · 4 lines

"A mouse is a device used to point at the xterm you want to type in" - A.S.R.
Microsoft is to operating systems ....
                                      .... what McDonalds is to gourmet cooking
Home page: http://marc.merlins.org/                       | PGP 7F55D5F27AAF9D08

Zdenek Kabelac

2018-07-26 08:40 UTC #2 lore raw

Dne 26.7.2018 v 09:24 Marc MERLIN napsal(a):

Quoted 95 lines · Marc MERLIN

Quoted 10 lines
Howdy,
Kernel 4.17, trying thin LV for the first time, and I'm getting this:
gargamel:~# lvcreate -L 14.50TiB -Zn -T vgds2/thinpool2
   Using default stripesize 64.00 KiB.
   Thin pool volume with chunk size 8.00 MiB can address at most <1.98 PiB of data.
   /dev/mapper/vgds2-thinpool2_tmeta: open failed: No such file or directory
   Failed to activate new LV.
any idea what I should try next?
Interestingly I got a different error, once:
gargamel:~# lvcreate -L 14.50TiB -Zn -T vgds2/thinpool2
   Using default stripesize 64.00 KiB.
   Thin pool volume with chunk size 8.00 MiB can address at most <1.98 PiB of data.
   /dev/vgds2/lvol0: not found: device not cleared
   Aborting. Failed to wipe start of new LV.
gargamel:~# mkdir /dev/vgds2/
gargamel:~# l /dev/mapper/
total 0
drwxr-xr-x  2 root root     200 Jul 25 17:27 ./
drwxr-xr-x 20 root root    5280 Jul 26 00:15 ../
crw-------  1 root root 10, 236 Jul 25 17:25 control
lrwxrwxrwx  1 root root       7 Jul 23 08:57 cryptroot -> ../dm-0
lrwxrwxrwx  1 root root       7 Jul 25 06:40 dshelf1 -> ../dm-1
lrwxrwxrwx  1 root root       7 Jul 26 00:11 dshelf2 -> ../dm-2
lrwxrwxrwx  1 root root       7 Jul 25 06:40 eswap1 -> ../dm-3
lrwxrwxrwx  1 root root       7 Jul 25 06:40 raid0d1 -> ../dm-4
lrwxrwxrwx  1 root root       7 Jul 25 06:40 raid0d2 -> ../dm-5
lrwxrwxrwx  1 root root       7 Jul 25 06:40 varchange -> ../dm-6
gargamel:~# vgchange -ay
   0 logical volume(s) in volume group "vgds2" now active
gargamel:~# lvcreate -L 14.50TiB -Zn -T vgds2/thinpool2
   Using default stripesize 64.00 KiB.
   Thin pool volume with chunk size 8.00 MiB can address at most <1.98 PiB of data.
   /dev/mapper/vgds2-thinpool2_tmeta: open failed: No such file or directory
   Failed to activate new LV.
gargamel:~# psg lvm
root      2378  0.0  0.0  31600   488 ?        Ss   Jul25   0:00 /sbin/lvmetad
gargamel:~# lvcreate --version
   LVM version:     2.02.176(2) (2017-11-03)
   Library version: 1.02.145 (2017-11-03)
   Driver version:  4.39.0
   Configuration:   ./configure --build=i686-linux-gnu --prefix=/usr --includedir=${prefix}/include --mandir=${prefix}/share/man --infodir=${prefix}/share/info --sysconfdir=/etc --localstatedir=/var --disable-silent-rules --libdir=${prefix}/lib/i386-linux-gnu --libexecdir=${prefix}/lib/i386-linux-gnu --runstatedir=/run --disable-maintainer-mode --disable-dependency-tracking --exec-prefix= --bindir=/bin --libdir=/lib/i386-linux-gnu --sbindir=/sbin --with-usrlibdir=/usr/lib/i386-linux-gnu --with-optimisation=-O2 --with-cache=internal --with-clvmd=corosync --with-cluster=internal --with-device-uid=0 --with-device-gid=6 --with-device-mode=0660 --with-default-pid-dir=/run --with-default-run-dir=/run/lvm --with-default-locking-dir=/run/lock/lvm --with-thin=internal --with-thin-check=/usr/sbin/thi
  n_check --with-thin-dump=/usr/sbin/thin_dump --with-thin-repair=/usr/sbin/thin_repair --enable-applib --enable-blkid_wiping --enable-cmdlib --enable-cmirrord --enable-dmeventd --enable-dbus-service
  --enable-lvmetad --enable-lvmlockd-dlm --enable-lvmlockd-sanlock --enable-lvmpolld --enable-notify-dbus --enable-pkgconfig --enable-readline --enable-udev_rules --enable-udev_sync
strace shows:
openat(AT_FDCWD, "/dev/vgds2/lvol0", O_RDWR|O_DIRECT|O_LARGEFILE|O_NOATIME) = 7
openat(AT_FDCWD, "/proc/self/maps", O_RDONLY|O_LARGEFILE) = 7
openat(AT_FDCWD, "/dev/urandom", O_RDONLY|O_LARGEFILE) = 8
openat(AT_FDCWD, "/proc/self/maps", O_RDONLY|O_LARGEFILE) = 7
stat64("/dev/mapper/dshelf2", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 2), ...}) = 0 stat64("/dev/mapper/dshelf2", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 2), ...}) = 0
openat(AT_FDCWD, "/sys/dev/block/253:7/bdi/read_ahead_kb", O_RDONLY|O_LARGEFILE) = 7
openat(AT_FDCWD, "/sys/dev/block/253:7/bdi/read_ahead_kb", O_WRONLY|O_LARGEFILE) = 7
stat64("/dev/mapper/control", {st_mode=S_IFCHR|0600, st_rdev=makedev(10, 236), ...}) = 0
openat(AT_FDCWD, "/dev/mapper/control", O_RDWR|O_LARGEFILE) = 4
stat64("/dev/vgds2/thinpool2", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 7), ...}) = 0 lstat64("/dev/vgds2/thinpool2", {st_mode=S_IFLNK|0777, st_size=7, ...}) = 0
lstat64("/dev/vgds2/lvol0", 0xffe9462c) = -1 ENOENT (No such file or directory)
stat64("/dev/vgds2/thinpool2", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 7), ...}) = 0
openat(AT_FDCWD, "/dev/vgds2/thinpool2", O_RDWR|O_DIRECT|O_LARGEFILE|O_NOATIME) = 7
openat(AT_FDCWD, "/proc/self/maps", O_RDONLY|O_LARGEFILE) = 7
openat(AT_FDCWD, "/dev/urandom", O_RDONLY|O_LARGEFILE) = 8
openat(AT_FDCWD, "/dev/urandom", O_RDONLY|O_LARGEFILE) = 8
stat64("/sys//dev/block/253:2/queue/minimum_io_size", {st_mode=S_IFREG|0444, st_size=4096, ...}) = 0 openat(AT_FDCWD, "/sys//dev/block/253:2/queue/minimum_io_size", O_RDONLY|O_LARGEFILE) = 7
stat64("/etc/lvm/backup", {st_mode=S_IFDIR|0700, st_size=10, ...}) = 0
access("/etc/lvm/backup", R_OK|W_OK|X_OK) = 0
openat(AT_FDCWD, "/etc/lvm/backup/.lvm_gargamel.svh.merlins.org_19532_130993407", O_WRONLY|O_CREAT|O_EXCL|O_APPEND|O_LARGEFILE, 0666) = 7 rename("/etc/lvm/backup/.lvm_gargamel.svh.merlins.org_19532_130993407", "/etc/lvm/backup/vgds2.tmp") = 0 rename("/etc/lvm/backup/vgds2.tmp", "/etc/lvm/backup/vgds2") = 0
stat64("/etc/lvm/backup/vgds2.tmp", 0xffe96b7c) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, "/etc/lvm/backup", O_RDONLY|O_LARGEFILE) = 7
openat(AT_FDCWD, "/proc/self/maps", O_RDONLY|O_LARGEFILE) = 7
stat64("/dev/mapper/dshelf2", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 2), ...}) = 0
stat64("/dev/mapper/dshelf2", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 2), ...}) = 0
stat64("/dev/mapper/dshelf2", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 2), ...}) = 0
stat64("/dev/mapper/dshelf2", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 2), ...}) = 0
openat(AT_FDCWD, "/sys/dev/block/253:7/bdi/read_ahead_kb", O_RDONLY|O_LARGEFILE) = 8
openat(AT_FDCWD, "/sys/dev/block/253:7/bdi/read_ahead_kb", O_WRONLY|O_LARGEFILE) = 8
openat(AT_FDCWD, "/sys/dev/block/253:8/bdi/read_ahead_kb", O_RDONLY|O_LARGEFILE) = 8
openat(AT_FDCWD, "/sys/dev/block/253:8/bdi/read_ahead_kb", O_WRONLY|O_LARGEFILE) = 8
openat(AT_FDCWD, "/dev/mapper/vgds2-thinpool2_tmeta", O_RDONLY|O_LARGEFILE) = -1 ENOENT (No such file or directory)
/dev/mapper/vgds2-thinpool2_tmeta: open failed: No such file or directory
Failed to activate new LV.

Quoted 9 lines

gargamel:~# strace -etrace=file lvcreate -L 14.50TiB -Zn -T vgds2/thinpool2 2>&1 |grep thinpool2
execve("/sbin/lvcreate", ["lvcreate", "-L", "14.50TiB", "-Zn", "-T", "vgds2/thinpool2"], [/* 33 vars */]) = 0
stat64("/dev/vgds2/thinpool2", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 7), ...}) = 0
lstat64("/dev/vgds2/thinpool2", {st_mode=S_IFLNK|0777, st_size=7, ...}) = 0
stat64("/dev/vgds2/thinpool2", {st_mode=S_IFBLK|0660, st_rdev=makedev(253, 7), ...}) = 0
openat(AT_FDCWD, "/dev/vgds2/thinpool2", O_RDWR|O_DIRECT|O_LARGEFILE|O_NOATIME) = 7
openat(AT_FDCWD, "/dev/mapper/vgds2-thinpool2_tmeta", O_RDONLY|O_LARGEFILE) = -1 ENOENT (No such file or directory)
   /dev/mapper/vgds2-thinpool2_tmeta: open failed: No such file or directory

What are you trying to achieve with 'mkdir /dev/vgds2/' ?

You shall never ever touch /dev content - it's always under full control of udev - if you start to create there your own files and directories you will break whole usability of the system.

It's always udev having full control over all the symlinks there.

If you do not want to use udev - you need to compiled lvm2 without udev support - in this case lvm2 will fallback to creation of all devices itself.

However I can't image in which todays distribution you would want to use it..

Anyway - the best 'debugging' you will get with 'lvcreate -vvvv' it will always tell you what is failing.

Regards

Zdenek

Marc MERLIN

author

2018-07-26 15:49 UTC #3 lore raw

Quoted 5 lines · Zdenek Kabelac

What are you trying to achieve with 'mkdir /dev/vgds2/' ?
You shall never ever touch /dev content - it's always under full control of udev - if you start to create there your own files and directories you will break whole usability of the system.
It's always udev having full control over all the symlinks there.

Yes, I know udev manages it, but given that things weren't working, I randomly tried that (and yes I have udev)

Quoted 4 lines

However I can't image in which todays distribution you would want to use it..
Anyway - the best 'debugging' you will get with 'lvcreate -vvvv' it will always tell you what is failing.

Looks like my problem was that udev was too old, and there was no dependency for the newer package. I upgraded from udev 232 from 239

It's looking better now:

gargamel:~# lvcreate -L 14.50TiB -Zn -T vgds2/thinpool2 
  Using default stripesize 64.00 KiB.
  Thin pool volume with chunk size 8.00 MiB can address at most <1.98 PiB of data.
  semid 1376260: semop failed for cookie 0xd4d162f: incorrect semaphore state
  Failed to set a proper state for notification semaphore identified by cookie value 223155759 (0xd4d162f) to initialize waiting for incoming notifications.
  Logical volume "thinpool2" created.
  semid 1441796: semop failed for cookie 0xd4dad79: incorrect semaphore state
  Failed to set a proper state for notification semaphore identified by cookie value 223194489 (0xd4dad79) to initialize waiting for incoming notifications.
gargamel:~# lvdisplay
  --- Logical volume ---
  LV Name                thinpool2
  VG Name                vgds2
  LV UUID                rxJCsT-ImNv-ibvM-zOS0-Xzqv-O8AU-1STUH9
  LV Write Access        read/write
  LV Creation host, time gargamel.svh.merlins.org, 2018-07-26 08:42:51 -0700
  LV Pool metadata       thinpool2_tmeta
  LV Pool data           thinpool2_tdata
  LV Status              available
  # open                 0
  LV Size                14.50 TiB
  Allocated pool data    0.00%
  Allocated metadata     0.42%
  Current LE             3801088
  Segments               1
  Allocation             inherit
  Read ahead sectors     auto
  - currently set to     8192
  Block device           253:9

This is what -vvvv said before udev was upgraded.

#mm/memlock.c:373 Locked 20828160 bytes
#activate/dev_manager.c:2945 Creating ACTIVATE tree for vgds2/thinpool2.
#activate/dev_manager.c:696 Getting device info for vgds2-thinpool2 [LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVtagm8tt2DwYykD0jixmnUbYQIglsp3ce-pool].

#ioctl/libdm-iface.c:1848         dm info  LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVtagm8tt2DwYykD0jixmnUbYQIglsp3ce-pool [ opencount flush ]   [16384] (*1)
#ioctl/libdm-iface.c:1848         dm info  LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVtagm8tt2DwYykD0jixmnUbYQIglsp3ce [ opencount flush ]   [16384] (*1)

#activate/dev_manager.c:696 Getting device info for vgds2-thinpool2-real [LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVtagm8tt2DwYykD0jixmnUbYQIglsp3ce-real].
#ioctl/libdm-iface.c:1848 dm info LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVtagm8tt2DwYykD0jixmnUbYQIglsp3ce-real [ opencount flush ] [16384] (*1)
#activate/dev_manager.c:696 Getting device info for vgds2-thinpool2-cow [LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVtagm8tt2DwYykD0jixmnUbYQIglsp3ce-cow].
#ioctl/libdm-iface.c:1848 dm info LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVtagm8tt2DwYykD0jixmnUbYQIglsp3ce-cow [ opencount flush ] [16384] (*1)
#activate/dev_manager.c:696 Getting device info for vgds2-thinpool2-tpool [LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVtagm8tt2DwYykD0jixmnUbYQIglsp3ce-tpool].
#ioctl/libdm-iface.c:1848 dm info LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVtagm8tt2DwYykD0jixmnUbYQIglsp3ce-tpool [ opencount flush ] [16384] (*1)
#activate/dev_manager.c:696 Getting device info for vgds2-thinpool2_tmeta [LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVB3HuP3X42OjPM31JY4ScCSrRN2WoZWGx-tmeta].

#ioctl/libdm-iface.c:1848         dm info  LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVB3HuP3X42OjPM31JY4ScCSrRN2WoZWGx-tmeta [ opencount flush ]   [16384] (*1)
#ioctl/libdm-iface.c:1848         dm info  LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVB3HuP3X42OjPM31JY4ScCSrRN2WoZWGx [ opencount flush ]   [16384] (*1)

#activate/dev_manager.c:696 Getting device info for vgds2-thinpool2_tmeta-real [LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVB3HuP3X42OjPM31JY4ScCSrRN2WoZWGx-real].
#ioctl/libdm-iface.c:1848 dm info LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVB3HuP3X42OjPM31JY4ScCSrRN2WoZWGx-real [ opencount flush ] [16384] (*1)
#activate/dev_manager.c:696 Getting device info for vgds2-thinpool2_tmeta-cow [LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVB3HuP3X42OjPM31JY4ScCSrRN2WoZWGx-cow].
#ioctl/libdm-iface.c:1848 dm info LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVB3HuP3X42OjPM31JY4ScCSrRN2WoZWGx-cow [ opencount flush ] [16384] (*1)
#activate/dev_manager.c:696 Getting device info for vgds2-thinpool2_tdata [LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVj2xjlvzkpKsioFrUJdZAIDTzTm1Yhh8f-tdata].

#ioctl/libdm-iface.c:1848         dm info  LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVj2xjlvzkpKsioFrUJdZAIDTzTm1Yhh8f-tdata [ opencount flush ]   [16384] (*1)
#ioctl/libdm-iface.c:1848         dm info  LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVj2xjlvzkpKsioFrUJdZAIDTzTm1Yhh8f [ opencount flush ]   [16384] (*1)

#activate/dev_manager.c:696 Getting device info for vgds2-thinpool2_tdata-real [LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVj2xjlvzkpKsioFrUJdZAIDTzTm1Yhh8f-real].
#ioctl/libdm-iface.c:1848 dm info LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVj2xjlvzkpKsioFrUJdZAIDTzTm1Yhh8f-real [ opencount flush ] [16384] (*1)
#activate/dev_manager.c:696 Getting device info for vgds2-thinpool2_tdata-cow [LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVj2xjlvzkpKsioFrUJdZAIDTzTm1Yhh8f-cow].
#ioctl/libdm-iface.c:1848 dm info LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVj2xjlvzkpKsioFrUJdZAIDTzTm1Yhh8f-cow [ opencount flush ] [16384] (*1)
#activate/dev_manager.c:2591 Adding new LV vgds2/thinpool2 to dtree
#libdm-deptree.c:623 Not matched uuid LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVtagm8tt2DwYykD0jixmnUbYQIglsp3ce-tpool in deptree.
#libdm-deptree.c:623 Not matched uuid LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVtagm8tt2DwYykD0jixmnUbYQIglsp3ce-tpool in deptree.
#activate/dev_manager.c:2513 Checking kernel supports thin-pool segment type for vgds2/thinpool2-tpool
#activate/dev_manager.c:2591 Adding new LV vgds2/thinpool2_tmeta to dtree
#libdm-deptree.c:623 Not matched uuid LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVB3HuP3X42OjPM31JY4ScCSrRN2WoZWGx-tmeta in deptree.
#libdm-deptree.c:623 Not matched uuid LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVB3HuP3X42OjPM31JY4ScCSrRN2WoZWGx-tmeta in deptree.
#activate/dev_manager.c:2513 Checking kernel supports striped segment type for vgds2/thinpool2_tmeta
#ioctl/libdm-iface.c:1848 dm deps (253:2) [ opencount flush ] [16384] (*1)
#metadata/metadata.c:2171 Calculated readahead of LV thinpool2_tmeta is 8192
#activate/dev_manager.c:2591 Adding new LV vgds2/thinpool2_tdata to dtree
#libdm-deptree.c:623 Not matched uuid LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVj2xjlvzkpKsioFrUJdZAIDTzTm1Yhh8f-tdata in deptree.
#libdm-deptree.c:623 Not matched uuid LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVj2xjlvzkpKsioFrUJdZAIDTzTm1Yhh8f-tdata in deptree.
#activate/dev_manager.c:2513 Checking kernel supports striped segment type for vgds2/thinpool2_tdata
#metadata/metadata.c:2171 Calculated readahead of LV thinpool2_tdata is 8192
#libdm-config.c:997 Setting activation/thin_pool_autoextend_threshold to 100
#libdm-deptree.c:591 Matched uuid LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVB3HuP3X42OjPM31JY4ScCSrRN2WoZWGx-tmeta in deptree.
#libdm-deptree.c:591 Matched uuid LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVj2xjlvzkpKsioFrUJdZAIDTzTm1Yhh8f-tdata in deptree.
#metadata/metadata.c:2171 Calculated readahead of LV thinpool2 is 8192
#libdm-deptree.c:2004 Creating vgds2-thinpool2_tmeta
#ioctl/libdm-iface.c:1848 dm create vgds2-thinpool2_tmeta LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVB3HuP3X42OjPM31JY4ScCSrRN2WoZWGx-tmeta [ noopencount flush ] [16384] (*1)
#libdm-deptree.c:2859 Loading vgds2-thinpool2_tmeta table (253:7)
#libdm-deptree.c:2803 Adding target to (253:7): 0 237568 linear 253:2 31138752512
#ioctl/libdm-iface.c:1848 dm table (253:7) [ opencount flush ] [16384] (*1)
#ioctl/libdm-iface.c:1848 dm reload (253:7) [ noopencount flush ] [16384] (*1)
#libdm-deptree.c:2912 Table size changed from 0 to 237568 for vgds2-thinpool2_tmeta (253:7).
#libdm-deptree.c:1368 Resuming vgds2-thinpool2_tmeta (253:7)
#ioctl/libdm-iface.c:1848 dm resume (253:7) [ noopencount flush ] [16384] (*1)
#libdm-common.c:1475 vgds2-thinpool2_tmeta: Stacking NODE_ADD (253,7) 0:6 0660 [trust_udev]
#libdm-common.c:1485 vgds2-thinpool2_tmeta: Stacking NODE_READ_AHEAD 8192 (flags=1)
#libdm-deptree.c:2004 Creating vgds2-thinpool2_tdata
#ioctl/libdm-iface.c:1848 dm create vgds2-thinpool2_tdata LVM-pc1cTHkFo7g0KzdELpj51s1yOOv20WIVj2xjlvzkpKsioFrUJdZAIDTzTm1Yhh8f-tdata [ noopencount flush ] [16384] (*1)
#libdm-deptree.c:2859 Loading vgds2-thinpool2_tdata table (253:8)
#libdm-deptree.c:2803 Adding target to (253:8): 0 31138512896 linear 253:2 239616
#ioctl/libdm-iface.c:1848 dm table (253:8) [ opencount flush ] [16384] (*1)
#ioctl/libdm-iface.c:1848 dm reload (253:8) [ noopencount flush ] [16384] (*1)
#libdm-deptree.c:2912 Table size changed from 0 to 31138512896 for vgds2-thinpool2_tdata (253:8).
#libdm-deptree.c:1368 Resuming vgds2-thinpool2_tdata (253:8)
#ioctl/libdm-iface.c:1848 dm resume (253:8) [ noopencount flush ] [16384] (*1)

#libdm-common.c:1475         vgds2-thinpool2_tdata: Stacking NODE_ADD (253,8) 0:6 0660 [trust_udev]
#libdm-common.c:1485         vgds2-thinpool2_tdata: Stacking NODE_READ_AHEAD 8192 (flags=1)
#libdm-common.c:1478         vgds2-thinpool2: Skipping NODE_DEL [trust_udev]
#libdm-common.c:1475         vgds2-thinpool2_tmeta: Skipping NODE_ADD (253,7) 0:6 0660 [trust_udev]
#libdm-common.c:1485         vgds2-thinpool2_tmeta: Processing NODE_READ_AHEAD 8192 (flags=1)
#libdm-common.c:1239         vgds2-thinpool2_tmeta (253:7): read ahead is 256
#libdm-common.c:1289         vgds2-thinpool2_tmeta (253:7): Setting read ahead to 8192
#libdm-common.c:1475         vgds2-thinpool2_tdata: Skipping NODE_ADD (253,8) 0:6 0660 [trust_udev]
#libdm-common.c:1485         vgds2-thinpool2_tdata: Processing NODE_READ_AHEAD 8192 (flags=1)
#libdm-common.c:1239         vgds2-thinpool2_tdata (253:8): read ahead is 256
#libdm-common.c:1289         vgds2-thinpool2_tdata (253:8): Setting read ahead to 8192

#libdm-config.c:975 global/thin_check_executable not found in config: defaulting to /usr/sbin/thin_check
#config/config.c:1468 global/thin_check_options not found in config: defaulting to thin_check_options = [ "-q" ]
#activate/dev_manager.c:1832 /dev/mapper/vgds2-thinpool2_tmeta: open failed: No such file or directory
#libdm-deptree.c:2933 Reverting vgds2-thinpool2_tdata.
#libdm-deptree.c:1043 Removing vgds2-thinpool2_tdata (253:8)
#ioctl/libdm-iface.c:1848 dm remove (253:8) [ noopencount flush ] [16384] (*1)
#libdm-common.c:1478 vgds2-thinpool2_tdata: Stacking NODE_DEL [trust_udev]
#libdm-deptree.c:2933 Reverting vgds2-thinpool2_tmeta.
#libdm-deptree.c:1043 Removing vgds2-thinpool2_tmeta (253:7)
#ioctl/libdm-iface.c:1848 dm remove (253:7) [ noopencount flush ] [16384] (*1)
#libdm-common.c:1478 vgds2-thinpool2_tmeta: Stacking NODE_DEL [trust_udev]
#libdm-deptree.c:3087 <backtrace>

Thanks,
Marc

Signature · 4 lines

"A mouse is a device used to point at the xterm you want to type in" - A.S.R.
Microsoft is to operating systems ....
                                      .... what McDonalds is to gourmet cooking
Home page: http://marc.merlins.org/                       | PGP 7F55D5F27AAF9D08

Zdenek Kabelac

2018-07-27 12:43 UTC #4 lore raw

Dne 26.7.2018 v 17:49 Marc MERLIN napsal(a):

Quoted 19 lines · Zdenek Kabelac

Quoted 5 lines
What are you trying to achieve with 'mkdir /dev/vgds2/' ?
You shall never ever touch /dev content - it's always under full control of udev - if you start to create there your own files and directories you will break whole usability of the system.
It's always udev having full control over all the symlinks there.
Yes, I know udev manages it, but given that things weren't working, I randomly tried that (and yes I have udev)
Quoted 4 lines
However I can't image in which todays distribution you would want to use it..
Anyway - the best 'debugging' you will get with 'lvcreate -vvvv' it will always tell you what is failing.
Looks like my problem was that udev was too old, and there was no dependency for the newer package. I upgraded from udev 232 from 239
It's looking better now:

Quoted 8 lines

gargamel:~# lvcreate -L 14.50TiB -Zn -T vgds2/thinpool2
   Using default stripesize 64.00 KiB.
   Thin pool volume with chunk size 8.00 MiB can address at most <1.98 PiB of data.
   semid 1376260: semop failed for cookie 0xd4d162f: incorrect semaphore state
   Failed to set a proper state for notification semaphore identified by cookie value 223155759 (0xd4d162f) to initialize waiting for incoming notifications.
   Logical volume "thinpool2" created.
   semid 1441796: semop failed for cookie 0xd4dad79: incorrect semaphore state
   Failed to set a proper state for notification semaphore identified by cookie value 223194489 (0xd4dad79) to initialize waiting for incoming notifications.

These messages are informing you that your udev system and SysV semaphores support do not work properly together at all.

In practice lvm2 detected semaphores are useless on your system and fallback to actually ignore them to not stay blocked endlessly waiting on udev work to get finished.

So I'm unsure what are you trying to reach - are you building your own linux-from-scratch system - I doubt that any widely usable modern distro has such broken SysV support built-in in their mainstream kernel.

IMHO if you are trying to build your own linux system yourself and you do not need udev otherwise at all - you could probably better build lvm2 without udev_sync support - so you will not see those ugly error messages with every creation command you will run.

Zdenek

Marc MERLIN

author

2018-07-27 18:39 UTC #5 lore raw

Quoted 27 lines · Zdenek Kabelac

Quoted 16 lines
It's looking better now:
gargamel:~# lvcreate -L 14.50TiB -Zn -T vgds2/thinpool2
  Using default stripesize 64.00 KiB.
  Thin pool volume with chunk size 8.00 MiB can address at most <1.98 PiB 
  of data.
  semid 1376260: semop failed for cookie 0xd4d162f: incorrect semaphore 
  state
  Failed to set a proper state for notification semaphore identified by 
  cookie value 223155759 (0xd4d162f) to initialize waiting for incoming 
  notifications.
  Logical volume "thinpool2" created.
  semid 1441796: semop failed for cookie 0xd4dad79: incorrect semaphore 
  state
  Failed to set a proper state for notification semaphore identified by 
  cookie value 223194489 (0xd4dad79) to initialize waiting for incoming 
  notifications.
Hi
These messages are informing you that your udev system and SysV semaphores support do not work properly together at all.
In practice lvm2 detected semaphores are useless on your system and fallback to actually ignore them to not stay blocked endlessly waiting on udev work to get finished.

Quoted 8 lines

So I'm unsure what are you trying to reach - are you building your own linux-from-scratch system - I doubt that any widely usable modern distro has such broken SysV support built-in in their mainstream kernel.
IMHO if you are trying to build your own linux system yourself and you do not need udev otherwise at all - you could probably better build lvm2 without udev_sync support - so you will not see those ugly error messages with every creation command you will run.

I running debian/testing on a 32 bit server.
The only thing is that I don't run 'dist-upgrade" regularly due to the amount of stuff that changes and breaks for no reason, usually at times I don't have time to deal with it.

So, my udev was out of date for lvm2 and there was a missing package dependency on minimum version required. However, what I pasted above was with the latest udev version intesting, so there may be other missing dependencies or problems.
I don't have systemd on that system, still regular init.

I have sysvinit 2.88dsf-59.2 . Is that too old and causing issues too?

Thanks,
Marc

Signature · 4 lines

"A mouse is a device used to point at the xterm you want to type in" - A.S.R.
Microsoft is to operating systems ....
                                      .... what McDonalds is to gourmet cooking
Home page: http://marc.merlins.org/