Skip to contentSkip to conversation

2.6.16.20/dm: can't create more then one snapshot of an lv

DISCUSSION CaT 3 participants 8 messages Jun 19, 2006 – Jun 27, 2006 Device mapper

lore
Share & tools
lore

CaT

author
#0 lore raw

I am attempting to create multiple snapshots of an lv ontop of a raid-5 software raid device and ext3+dir_index and resize_inode for the fs. The kernel is a pure 64bit compile with Debian Sarge amd64 running on top of it. The kernel is monolithic and I'm using lvm2 2.01.03-5 with devmapper 1.01.

This works under 2.6.15.7. Under 2.6.16.20 I get this:

# lvcreate --snapshot --size 50G --name snap-12 --permission r --verbose /dev/backups/main
    Setting chunksize to 16 sectors.
    Finding volume group "backups"
    Creating logical volume snap-12
    Archiving volume group "backups" metadata.
    Creating volume group backup "/etc/lvm/backup/backups"
    Found volume group "backups"
    Loading backups-snap--12
    Zeroing start of logical volume "snap-12"
    Found volume group "backups"
    Removing backups-snap--12
    Found volume group "backups"
    Found volume group "backups"
    Found volume group "backups"
    Loading backups-main-real
    Loading backups-snap--12-cow
    Loading backups-snap--12
    Loading backups-main
    Creating volume group backup "/etc/lvm/backup/backups"
  Logical volume "snap-12" created
# lvcreate --snapshot --size 50G --name snap-13 --permission r --verbose /dev/backups/main
    Setting chunksize to 16 sectors.
    Finding volume group "backups"
    Creating logical volume snap-13
    Archiving volume group "backups" metadata.
    Creating volume group backup "/etc/lvm/backup/backups"
    Found volume group "backups"
    Loading backups-snap--13
    Zeroing start of logical volume "snap-13"
    Found volume group "backups"
    Removing backups-snap--13
    Found volume group "backups"
    Found volume group "backups"
    Found volume group "backups"
    Loading backups-main-real
    Loading backups-snap--12-cow
    Loading backups-snap--12
*freeze*
# ps auxww | grep lvcreate
root      1315  0.0  1.2 16000 13104 pts/2   D<L+ 11:44   0:00 lvcreate --snapshot --size 50G --name snap-13 --permission r --verbose /dev/backups/main

Nothing special in dmesg at time of lvcreate.

# lsof -n | grep 1315 | less
lvcreate  1315        root  cwd       DIR                9,0    1024       4017 /root
lvcreate  1315        root  rtd       DIR                9,0    1024          2 /
lvcreate  1315        root  txt       REG                9,0  465896     116659 /lib/lvm-200/lvm
lvcreate  1315        root  mem       REG                0,0                  0 [heap] (stat: No such file or directory)
lvcreate  1315        root  mem       REG                9,0   90288     116481 /lib/ld-2.3.2.so
lvcreate  1315        root  mem       REG                9,1  290512     458029 /usr/lib/locale/locale-archive
lvcreate  1315        root  mem       REG                9,0   34640     116657 /lib/libdevmapper.so.1.01
lvcreate  1315        root  mem       REG                9,0   12072     116489 /lib/libdl-2.3.2.so
lvcreate  1315        root  mem       REG                9,0 1295328     116487 /lib/libc-2.3.2.so
lvcreate  1315        root    0u      CHR              136,2                  4 /dev/pts/2
lvcreate  1315        root    1u      CHR              136,2                  4 /dev/pts/2
lvcreate  1315        root    2u      CHR              136,2                  4 /dev/pts/2
lvcreate  1315        root    3u      CHR              10,63              44265 /dev/mapper/control
lvcreate  1315        root    4uW     REG              253,2       0     147459 /var/lock/lvm/V_backups
lvcreate  1315        root    5u      BLK                9,0              33555 /dev/md0
lvcreate  1315        root    6u      BLK                9,1              33567 /dev/md1
lvcreate  1315        root    7u      BLK                9,2              33568 /dev/md2
lvcreate  1315        root    8u      BLK                9,3              33569 /dev/md3

MD section of .config:

#
# Multi-device support (RAID and LVM)
#
CONFIG_MD=y
CONFIG_BLK_DEV_MD=y
# CONFIG_MD_LINEAR is not set
# CONFIG_MD_RAID0 is not set
CONFIG_MD_RAID1=y
# CONFIG_MD_RAID10 is not set
CONFIG_MD_RAID5=y
# CONFIG_MD_RAID6 is not set
# CONFIG_MD_MULTIPATH is not set
# CONFIG_MD_FAULTY is not set
CONFIG_BLK_DEV_DM=y
CONFIG_DM_CRYPT=y
CONFIG_DM_SNAPSHOT=y
CONFIG_DM_MIRROR=y
CONFIG_DM_ZERO=y
# CONFIG_DM_MULTIPATH is not set

This server is not live yet so I can test patches if need be. I wont be able to in approx 1 weeks time though.

Signature · 3 lines
    "To the extent that we overreact, we proffer the terrorists the
    greatest tribute."
    	- High Court Judge Michael Kirby
author
#1 lore raw
Quoted 7 lines · CaT

I am attempting to create multiple snapshots of an lv ontop of a raid-5 software raid device and ext3+dir_index and resize_inode for the fs. The kernel is a pure 64bit compile with Debian Sarge amd64 running on top of it. The kernel is monolithic and I'm using lvm2 2.01.03-5 with devmapper 1.01.

This works under 2.6.15.7. Under 2.6.16.20 I get this:

2.6.17 also fails.

More info: The failing kernels can deal with multiple pre-created snapshots but the moment I try to create one it freezes as below. Mounting another snapshotted volume at the time this is frozen freezes mount.

After reboot the snapshot it froze on making is available to the system (though the reboot fails on shutdown as it cannot unmount anything).

Quoted 18 lines
# lvcreate --snapshot --size 50G --name snap-13 --permission r --verbose /dev/backups/main
    Setting chunksize to 16 sectors.
    Finding volume group "backups"
    Creating logical volume snap-13
    Archiving volume group "backups" metadata.
    Creating volume group backup "/etc/lvm/backup/backups"
    Found volume group "backups"
    Loading backups-snap--13
    Zeroing start of logical volume "snap-13"
    Found volume group "backups"
    Removing backups-snap--13
    Found volume group "backups"
    Found volume group "backups"
    Found volume group "backups"
    Loading backups-main-real
    Loading backups-snap--12-cow
    Loading backups-snap--12
*freeze*
Signature · 3 lines
    "To the extent that we overreact, we proffer the terrorists the
    greatest tribute."
    	- High Court Judge Michael Kirby
#2 lore raw

How many snapshots active at once ?
I guess this is a kcopyd scalability issue which needs addressing.

Regards,
Heinz -- The LVM Guy --

Quoted 28 lines · CaT
Quoted 7 lines · CaT

I am attempting to create multiple snapshots of an lv ontop of a raid-5 software raid device and ext3+dir_index and resize_inode for the fs. The kernel is a pure 64bit compile with Debian Sarge amd64 running on top of it. The kernel is monolithic and I'm using lvm2 2.01.03-5 with devmapper 1.01.

This works under 2.6.15.7. Under 2.6.16.20 I get this:

2.6.17 also fails.

More info: The failing kernels can deal with multiple pre-created snapshots but the moment I try to create one it freezes as below. Mounting another snapshotted volume at the time this is frozen freezes mount.

After reboot the snapshot it froze on making is available to the system (though the reboot fails on shutdown as it cannot unmount anything).

Quoted 10 lines
# lvcreate --snapshot --size 50G --name snap-13 --permission r --verbose /dev/backups/main
    Setting chunksize to 16 sectors.
    Finding volume group "backups"
    Creating logical volume snap-13
    Archiving volume group "backups" metadata.
    Creating volume group backup "/etc/lvm/backup/backups"
    Found volume group "backups"
    Loading backups-snap--13
    Zeroing start of logical volume "snap-13"
    Found volume group "backups"
Quoted 18 lines
Quoted 8 lines

Removing backups-snap--13
Found volume group "backups"
Found volume group "backups"
Found volume group "backups"
Loading backups-main-real
Loading backups-snap--12-cow
Loading backups-snap--12
*freeze*

Signature · 8 lines
    "To the extent that we overreact, we proffer the terrorists the
    greatest tribute."
    	- High Court Judge Michael Kirby
-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to [email protected]
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/

=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-

Heinz Mauelshagen                                 Red Hat GmbH
Consulting Development Engineer                   Am Sonnenhang 11
Storage Development                               56242 Marienrachdorf
                                                  Germany
[email protected]                            PHONE +49  171 7803392
                                                  FAX   +49 2626 924446

=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-

author
#3 lore raw
Quoted 1 line · Heinz Mauelshagen

How many snapshots active at once ?

1. I can start more then 1 premade snapshots just fine and use them but the moment I add another one a freeze occurs.

Quoted 1 line

I guess this is a kcopyd scalability issue which needs addressing.

Well in the end I'm hoping to get at least 7. Hopefully that's not insane. :)

Signature · 3 lines
    "To the extent that we overreact, we proffer the terrorists the
    greatest tribute."
    	- High Court Judge Michael Kirby
#4 lore raw
Quoted 5 lines · CaT
Quoted 1 line · Heinz Mauelshagen

How many snapshots active at once ?

1. I can start more then 1 premade snapshots just fine and use them but the moment I add another one a freeze occurs.

Well, that's fairly few ;)

Quoted 5 lines
Quoted 2 lines

I guess this is a kcopyd scalability issue which needs addressing.

Well in the end I'm hoping to get at least 7. Hopefully that's not insane. :)

No, I was assuming, you were trying to activate plenty.

FYI: the snapshot code in 2.6.17-rc has received a fair amount of fixes

     which might help this vs. 2.6.16.20.
Quoted 5 lines
Signature · 4 lines
-- 
    "To the extent that we overreact, we proffer the terrorists the
    greatest tribute."
    	- High Court Judge Michael Kirby
Signature · 15 lines
Regards,
Heinz    -- The LVM Guy --

*** Software bugs are stupid.
    Nevertheless it needs not so stupid people to solve them ***

=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-

Heinz Mauelshagen                                 Red Hat GmbH
Consulting Development Engineer                   Am Sonnenhang 11
Storage Development                               56242 Marienrachdorf
                                                  Germany
[email protected]                            PHONE +49  171 7803392
                                                  FAX   +49 2626 924446
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
author
#5 lore raw
Quoted 8 lines · Heinz Mauelshagen
Quoted 5 lines · CaT
Quoted 1 line · Heinz Mauelshagen

How many snapshots active at once ?

1. I can start more then 1 premade snapshots just fine and use them but the moment I add another one a freeze occurs.

Well, that's fairly few ;)

Yes. I thought so too. :)

Quoted 6 lines
Quoted 4 lines
Quoted 1 line

I guess this is a kcopyd scalability issue which needs addressing.

Well in the end I'm hoping to get at least 7. Hopefully that's not insane. :)

No, I was assuming, you were trying to activate plenty.

Not yet. Though as I said I plan to max out at 7 or so.

Quoted 2 lines

FYI: the snapshot code in 2.6.17-rc has received a fair amount of fixes

     which might help this vs. 2.6.16.20.

I tried 2.6.17 and I get the same issue. Any other kernel you want me to try? I can reboot this box at will at the moment and test.

Signature · 3 lines
    "To the extent that we overreact, we proffer the terrorists the
    greatest tribute."
    	- High Court Judge Michael Kirby
#6 lore raw
In reply to CaT
Quoted 6 lines · CaT

I am attempting to create multiple snapshots of an lv ontop of a raid-5 software raid device and ext3+dir_index and resize_inode for the fs. The kernel is a pure 64bit compile with Debian Sarge amd64 running on top of it. The kernel is monolithic and I'm using lvm2 2.01.03-5 with devmapper 1.01.
This works under 2.6.15.7. Under 2.6.16.20 I get this:

Update to lvm2 version 2.02.01 or later and device-mapper version 1.02.02 or later.

Alasdair

Signature · 1 line
[email protected]
author
#7 lore raw
Quoted 10 lines · Alasdair G Kergon
Quoted 6 lines · CaT

I am attempting to create multiple snapshots of an lv ontop of a raid-5 software raid device and ext3+dir_index and resize_inode for the fs. The kernel is a pure 64bit compile with Debian Sarge amd64 running on top of it. The kernel is monolithic and I'm using lvm2 2.01.03-5 with devmapper 1.01.
This works under 2.6.15.7. Under 2.6.16.20 I get this:

Update to lvm2 version 2.02.01 or later and device-mapper version 1.02.02 or later.

Done. It's all good under 2.6.16.20. Thanks for that. I'm wondering though. I checked the minimal requirements in the /usr/src/linux/Documentation/Changes file but nothing is mentioned for LVM there. Is this no longer the right place to check for what userspace utils are required for certain kernel functionality? (or was it never the right place?)

Signature · 3 lines
    "To the extent that we overreact, we proffer the terrorists the
    greatest tribute."
    	- High Court Judge Michael Kirby