problem after growing
Hi,
I face a strange and scary issue. I just grow a xfs filesystem (44To), and no way to mount it anymore :
XFS: device supports only 4096 byte sectors (not 512)
# xfs_check /dev/vg0/tomo-201111 ERROR: The filesystem has valuable metadata changes in a log which needs to be replayed. Mount the filesystem to replay the log, and unmount it before re-running xfs_check. If you are unable to mount the filesystem, then use the xfs_repair -L option to destroy the log and attempt a repair. Note that destroying the log may cause corruption -- please attempt a mount of the filesystem before doing this.
# xfs_repair -L /dev/vg0/tomo-201111 xfs_repair: warning - cannot set blocksize 512 on block device /dev/vg0/tomo-201111: Argument invalide Phase 1 - find and verify superblock... superblock read failed, offset 1099511623680, size 2048, ag 1, rval -1
fatal error -- Invalid argument
Conf is as follow :
LVM : 3pv - 1vg
the lv containing the xfs system is on several extents :
tomo-201111 vg0 -wi-ao 1 linear 15,34t /dev/sda:5276160-9298322 tomo-201111 vg0 -wi-ao 1 linear 18,66t /dev/sdb:0-4890732 tomo-201111 vg0 -wi-ao 1 linear 8,81t /dev/sdb:6987885-9298322 tomo-201111 vg0 -wi-ao 1 linear 1,19t /dev/sdc:2883584-3194585
before growing fs, I lvextend the vg, and a new extents on /dev/sdc was used. I cant think it caused this issue... I saw there can be problem with underlying device (an ARECA 1880). With xfs_db, I found this strange :
"logsectsize = 0"
# xfs_db -c "sb 0" -c "p" /dev/vg0/tomo-201111 magicnum = 0x58465342 blocksize = 4096 dblocks = 10468982745 rblocks = 0 rextents = 0 uuid = 09793bea-952b-44fa-be71-02f59e69b41b logstart = 1342177284 rootino = 128 rbmino = 129 rsumino = 130 rextsize = 1 agblocks = 268435455 agcount = 39 rbmblocks = 0 logblocks = 521728 versionnum = 0xb4b4 sectsize = 512 inodesize = 256 inopblock = 16 fname = "\000\000\000\000\000\000\000\000\000\000\000\000" blocklog = 12 sectlog = 9 inodelog = 8 inopblog = 4 agblklog = 28 rextslog = 0 inprogress = 0 imax_pct = 5 icount = 6233280 ifree = 26 fdblocks = 1218766953 frextents = 0 uquotino = 0 gquotino = 0 qflags = 0 flags = 0 shared_vn = 0 inoalignmt = 2 unit = 0 width = 0 dirblklog = 0 logsectlog = 0 logsectsize = 0 logsunit = 1 features2 = 0xa bad_features2 = 0xa
Any idea ?
Cheers,
rémi
Signature · 14 lines
Rémi Cailletaud - IE CNRS 3SR - Laboratoire Sols, Solides, Structures - Risques BP53, 38041 Grenoble CEDEX 0 FRANCE [email protected] Tél: +33 (0)4 76 82 52 78 Fax: +33 (0)4 76 82 70 43 _______________________________________________ xfs mailing list [email protected] http://oss.sgi.com/mailman/listinfo/xfs
Quoted 4 lines · Rémi Cailletaud
Hi,
I face a strange and scary issue. I just grow a xfs filesystem (44To), and no way to mount it anymore :
XFS: device supports only 4096 byte sectors (not 512)
Did you expand an LV made of 512-sector physical devices by adding 4k-sector physical devices?
that's probably not something we anticipate or check for....
What sector size(s) are the actual lowest level disks under all the lvm pieces?
-Eric
Quoted 78 lines
# xfs_check /dev/vg0/tomo-201111 ERROR: The filesystem has valuable metadata changes in a log which needs to be replayed. Mount the filesystem to replay the log, and unmount it before re-running xfs_check. If you are unable to mount the filesystem, then use the xfs_repair -L option to destroy the log and attempt a repair. Note that destroying the log may cause corruption -- please attempt a mount of the filesystem before doing this.# xfs_repair -L /dev/vg0/tomo-201111 xfs_repair: warning - cannot set blocksize 512 on block device /dev/vg0/tomo-201111: Argument invalide Phase 1 - find and verify superblock... superblock read failed, offset 1099511623680, size 2048, ag 1, rval -1fatal error -- Invalid argument
Conf is as follow :
LVM : 3pv - 1vg
the lv containing the xfs system is on several extents :
tomo-201111 vg0 -wi-ao 1 linear 15,34t /dev/sda:5276160-9298322 tomo-201111 vg0 -wi-ao 1 linear 18,66t /dev/sdb:0-4890732 tomo-201111 vg0 -wi-ao 1 linear 8,81t /dev/sdb:6987885-9298322 tomo-201111 vg0 -wi-ao 1 linear 1,19t /dev/sdc:2883584-3194585before growing fs, I lvextend the vg, and a new extents on
/dev/sdcwas used. I cant think it caused this issue... I saw there can be problem with underlying device (an ARECA 1880). Withxfs_db, I found this strange :
"logsectsize = 0"# xfs_db -c "sb 0" -c "p" /dev/vg0/tomo-201111 magicnum = 0x58465342 blocksize = 4096 dblocks = 10468982745 rblocks = 0 rextents = 0 uuid = 09793bea-952b-44fa-be71-02f59e69b41b logstart = 1342177284 rootino = 128 rbmino = 129 rsumino = 130 rextsize = 1 agblocks = 268435455 agcount = 39 rbmblocks = 0 logblocks = 521728 versionnum = 0xb4b4 sectsize = 512 inodesize = 256 inopblock = 16 fname = "\000\000\000\000\000\000\000\000\000\000\000\000" blocklog = 12 sectlog = 9 inodelog = 8 inopblog = 4 agblklog = 28 rextslog = 0 inprogress = 0 imax_pct = 5 icount = 6233280 ifree = 26 fdblocks = 1218766953 frextents = 0 uquotino = 0 gquotino = 0 qflags = 0 flags = 0 shared_vn = 0 inoalignmt = 2 unit = 0 width = 0 dirblklog = 0 logsectlog = 0 logsectsize = 0 logsunit = 1 features2 = 0xa bad_features2 = 0xa
Quoted 5 lines
Any idea ?
Cheers,
rémi
_______________________________________________
xfs mailing list
[email protected]
http://oss.sgi.com/mailman/listinfo/xfs
Quoted 6 lines · Eric Sandeen
Quoted 4 lines · Rémi Cailletaud
Hi,
I face a strange and scary issue. I just grow a xfs filesystem (44To), and no way to mount it anymore :
XFS: device supports only 4096 byte sectors (not 512)Did you expand an LV made of 512-sector physical devices by adding 4k-sector physical devices?
The three devices are ARECA 1880 card, but the last one was added later, and I never check for sector physical configuration on card configuration. But yes, running fdisk, it seems that sda and sdb are 512, and sdc is 4k... :(
Quoted 3 lines
that's probably not something we anticipate or check for....
What sector size(s) are the actual lowest level disks under all the lvm pieces?
What command to run to get this info ?
rémi
Quoted 91 lines
-Eric
Quoted 78 lines
# xfs_check /dev/vg0/tomo-201111 ERROR: The filesystem has valuable metadata changes in a log which needs to be replayed. Mount the filesystem to replay the log, and unmount it before re-running xfs_check. If you are unable to mount the filesystem, then use the xfs_repair -L option to destroy the log and attempt a repair. Note that destroying the log may cause corruption -- please attempt a mount of the filesystem before doing this.# xfs_repair -L /dev/vg0/tomo-201111 xfs_repair: warning - cannot set blocksize 512 on block device /dev/vg0/tomo-201111: Argument invalide Phase 1 - find and verify superblock... superblock read failed, offset 1099511623680, size 2048, ag 1, rval -1fatal error -- Invalid argument
Conf is as follow :
LVM : 3pv - 1vg
the lv containing the xfs system is on several extents :
tomo-201111 vg0 -wi-ao 1 linear 15,34t /dev/sda:5276160-9298322 tomo-201111 vg0 -wi-ao 1 linear 18,66t /dev/sdb:0-4890732 tomo-201111 vg0 -wi-ao 1 linear 8,81t /dev/sdb:6987885-9298322 tomo-201111 vg0 -wi-ao 1 linear 1,19t /dev/sdc:2883584-3194585before growing fs, I lvextend the vg, and a new extents on
/dev/sdcwas used. I cant think it caused this issue... I saw there can be problem with underlying device (an ARECA 1880). Withxfs_db, I found this strange :
"logsectsize = 0"# xfs_db -c "sb 0" -c "p" /dev/vg0/tomo-201111 magicnum = 0x58465342 blocksize = 4096 dblocks = 10468982745 rblocks = 0 rextents = 0 uuid = 09793bea-952b-44fa-be71-02f59e69b41b logstart = 1342177284 rootino = 128 rbmino = 129 rsumino = 130 rextsize = 1 agblocks = 268435455 agcount = 39 rbmblocks = 0 logblocks = 521728 versionnum = 0xb4b4 sectsize = 512 inodesize = 256 inopblock = 16 fname = "\000\000\000\000\000\000\000\000\000\000\000\000" blocklog = 12 sectlog = 9 inodelog = 8 inopblog = 4 agblklog = 28 rextslog = 0 inprogress = 0 imax_pct = 5 icount = 6233280 ifree = 26 fdblocks = 1218766953 frextents = 0 uquotino = 0 gquotino = 0 qflags = 0 flags = 0 shared_vn = 0 inoalignmt = 2 unit = 0 width = 0 dirblklog = 0 logsectlog = 0 logsectsize = 0 logsunit = 1 features2 = 0xa bad_features2 = 0xaQuoted 5 lines
Any idea ?
Cheers,
rémi_______________________________________________
xfs mailing list
[email protected]
http://oss.sgi.com/mailman/listinfo/xfs
Signature · 14 lines
Rémi Cailletaud - IE CNRS 3SR - Laboratoire Sols, Solides, Structures - Risques BP53, 38041 Grenoble CEDEX 0 FRANCE [email protected] Tél: +33 (0)4 76 82 52 78 Fax: +33 (0)4 76 82 70 43 _______________________________________________ xfs mailing list [email protected] http://oss.sgi.com/mailman/listinfo/xfs
Quoted 14 lines · Rémi Cailletaud
Quoted 6 lines · Eric Sandeen
Quoted 4 lines · Rémi Cailletaud
Hi,
I face a strange and scary issue. I just grow a xfs filesystem (44To), and no way to mount it anymore :
XFS: device supports only 4096 byte sectors (not 512)Did you expand an LV made of 512-sector physical devices by adding 4k-sector physical devices?
The three devices are ARECA 1880 card, but the last one was added later, and I never check for sector physical configuration on card configuration. But yes, running fdisk, it seems that sda and sdb are 512, and sdc is 4k... :(
Quoted 3 lines
that's probably not something we anticipate or check for....
What sector size(s) are the actual lowest level disks under all the lvm pieces?
(re-cc'ing xfs list)
Quoted 1 line
What command to run to get this info ?
IIRC,
# blockdev --getpbsz --getss /dev/sda
to print the physical & logical sector size
You can also look at i.e.:/sys/block/sda/queue/hw_sector_size/sys/block/sda/queue/physical_block_size/sys/block/sda/queue/logical_block_size
I wonder what the recovery steps would be here. I wouldn't do anything yet; I wish you hadn't already cleared the log, but oh well.
So you grew it, that all worked ok, you were able to copy new data into the new space, you unmounted it, but now it won't mount, correct?
-Eric
Quoted 96 lines
rémi
Quoted 91 lines
-Eric
Quoted 78 lines
# xfs_check /dev/vg0/tomo-201111 ERROR: The filesystem has valuable metadata changes in a log which needs to be replayed. Mount the filesystem to replay the log, and unmount it before re-running xfs_check. If you are unable to mount the filesystem, then use the xfs_repair -L option to destroy the log and attempt a repair. Note that destroying the log may cause corruption -- please attempt a mount of the filesystem before doing this.# xfs_repair -L /dev/vg0/tomo-201111 xfs_repair: warning - cannot set blocksize 512 on block device /dev/vg0/tomo-201111: Argument invalide Phase 1 - find and verify superblock... superblock read failed, offset 1099511623680, size 2048, ag 1, rval -1fatal error -- Invalid argument
Conf is as follow :
LVM : 3pv - 1vg
the lv containing the xfs system is on several extents :
tomo-201111 vg0 -wi-ao 1 linear 15,34t /dev/sda:5276160-9298322 tomo-201111 vg0 -wi-ao 1 linear 18,66t /dev/sdb:0-4890732 tomo-201111 vg0 -wi-ao 1 linear 8,81t /dev/sdb:6987885-9298322 tomo-201111 vg0 -wi-ao 1 linear 1,19t /dev/sdc:2883584-3194585before growing fs, I lvextend the vg, and a new extents on
/dev/sdcwas used. I cant think it caused this issue... I saw there can be problem with underlying device (an ARECA 1880). Withxfs_db, I found this strange :
"logsectsize = 0"# xfs_db -c "sb 0" -c "p" /dev/vg0/tomo-201111 magicnum = 0x58465342 blocksize = 4096 dblocks = 10468982745 rblocks = 0 rextents = 0 uuid = 09793bea-952b-44fa-be71-02f59e69b41b logstart = 1342177284 rootino = 128 rbmino = 129 rsumino = 130 rextsize = 1 agblocks = 268435455 agcount = 39 rbmblocks = 0 logblocks = 521728 versionnum = 0xb4b4 sectsize = 512 inodesize = 256 inopblock = 16 fname = "\000\000\000\000\000\000\000\000\000\000\000\000" blocklog = 12 sectlog = 9 inodelog = 8 inopblog = 4 agblklog = 28 rextslog = 0 inprogress = 0 imax_pct = 5 icount = 6233280 ifree = 26 fdblocks = 1218766953 frextents = 0 uquotino = 0 gquotino = 0 qflags = 0 flags = 0 shared_vn = 0 inoalignmt = 2 unit = 0 width = 0 dirblklog = 0 logsectlog = 0 logsectsize = 0 logsunit = 1 features2 = 0xa bad_features2 = 0xaQuoted 5 lines
Any idea ?
Cheers,
rémi_______________________________________________
xfs mailing list
[email protected]
http://oss.sgi.com/mailman/listinfo/xfs
_______________________________________________
xfs mailing list
[email protected]
http://oss.sgi.com/mailman/listinfo/xfs
Quoted 19 lines · Eric Sandeen
Quoted 13 lines · Rémi Cailletaud
Quoted 6 lines · Eric Sandeen
Quoted 4 lines · Rémi Cailletaud
Hi,
I face a strange and scary issue. I just grow a xfs filesystem (44To), and no way to mount it anymore :
XFS: device supports only 4096 byte sectors (not 512)Did you expand an LV made of 512-sector physical devices by adding 4k-sector physical devices?
The three devices are ARECA 1880 card, but the last one was added later, and I never check for sector physical configuration on card configuration. But yes, running fdisk, it seems that sda and sdb are 512, and sdc is 4k... :(
Quoted 3 lines
that's probably not something we anticipate or check for....
What sector size(s) are the actual lowest level disks under all the lvm pieces?
(re-cc'ing xfs list)
Quoted 1 line
What command to run to get this info ?
IIRC,
Quoted 8 lines
# blockdev --getpbsz --getss /dev/sdato print the physical& logical sector size
You can also look at i.e.:
/sys/block/sda/queue/hw_sector_size/sys/block/sda/queue/physical_block_size/sys/block/sda/queue/logical_block_size
ouch... nice guess :
# blockdev --getpbsz --getss /dev/sda
512
512
# blockdev --getpbsz --getss /dev/sdb
512
512
# blockdev --getpbsz --getss /dev/sdc
4096
4096
Quoted 1 line
I wonder what the recovery steps would be here. I wouldn't do anything yet; I wish you hadn't already cleared the log, but oh well.
I tried a xfs_repair -L (as mentionned by xfs_check), but it early failed as show on my first post...
Quoted 1 line
So you grew it, that all worked ok, you were able to copy new data into the new space, you unmounted it, but now it won't mount, correct?
I never was able to copy data to new space. I had an input/output error just after growing. may pmove-ing extents on 4k device on a 512k device be a solution ?
rémi
Quoted 103 lines
-Eric
Quoted 94 lines
rémi
Quoted 90 lines
-Eric
Quoted 78 lines
# xfs_check /dev/vg0/tomo-201111 ERROR: The filesystem has valuable metadata changes in a log which needs to be replayed. Mount the filesystem to replay the log, and unmount it before re-running xfs_check. If you are unable to mount the filesystem, then use the xfs_repair -L option to destroy the log and attempt a repair. Note that destroying the log may cause corruption -- please attempt a mount of the filesystem before doing this.# xfs_repair -L /dev/vg0/tomo-201111 xfs_repair: warning - cannot set blocksize 512 on block device /dev/vg0/tomo-201111: Argument invalide Phase 1 - find and verify superblock... superblock read failed, offset 1099511623680, size 2048, ag 1, rval -1fatal error -- Invalid argument
Conf is as follow :
LVM : 3pv - 1vg
the lv containing the xfs system is on several extents :
tomo-201111 vg0 -wi-ao 1 linear 15,34t /dev/sda:5276160-9298322 tomo-201111 vg0 -wi-ao 1 linear 18,66t /dev/sdb:0-4890732 tomo-201111 vg0 -wi-ao 1 linear 8,81t /dev/sdb:6987885-9298322 tomo-201111 vg0 -wi-ao 1 linear 1,19t /dev/sdc:2883584-3194585before growing fs, I lvextend the vg, and a new extents on
/dev/sdcwas used. I cant think it caused this issue... I saw there can be problem with underlying device (an ARECA 1880). Withxfs_db, I found this strange :
"logsectsize = 0"# xfs_db -c "sb 0" -c "p" /dev/vg0/tomo-201111 magicnum = 0x58465342 blocksize = 4096 dblocks = 10468982745 rblocks = 0 rextents = 0 uuid = 09793bea-952b-44fa-be71-02f59e69b41b logstart = 1342177284 rootino = 128 rbmino = 129 rsumino = 130 rextsize = 1 agblocks = 268435455 agcount = 39 rbmblocks = 0 logblocks = 521728 versionnum = 0xb4b4 sectsize = 512 inodesize = 256 inopblock = 16 fname = "\000\000\000\000\000\000\000\000\000\000\000\000" blocklog = 12 sectlog = 9 inodelog = 8 inopblog = 4 agblklog = 28 rextslog = 0 inprogress = 0 imax_pct = 5 icount = 6233280 ifree = 26 fdblocks = 1218766953 frextents = 0 uquotino = 0 gquotino = 0 qflags = 0 flags = 0 shared_vn = 0 inoalignmt = 2 unit = 0 width = 0 dirblklog = 0 logsectlog = 0 logsectsize = 0 logsunit = 1 features2 = 0xa bad_features2 = 0xaQuoted 5 lines
Any idea ?
Cheers,
rémi_______________________________________________
xfs mailing list
[email protected]
http://oss.sgi.com/mailman/listinfo/xfs_______________________________________________
xfs mailing list
[email protected]
http://oss.sgi.com/mailman/listinfo/xfs
Signature · 14 lines
Rémi Cailletaud - IE CNRS 3SR - Laboratoire Sols, Solides, Structures - Risques BP53, 38041 Grenoble CEDEX 0 FRANCE [email protected] Tél: +33 (0)4 76 82 52 78 Fax: +33 (0)4 76 82 70 43 _______________________________________________ xfs mailing list [email protected] http://oss.sgi.com/mailman/listinfo/xfs
Quoted 40 lines · Rémi Cailletaud
Quoted 19 lines · Eric Sandeen
Quoted 13 lines · Rémi Cailletaud
Quoted 6 lines · Eric Sandeen
Quoted 4 lines · Rémi Cailletaud
Hi,
I face a strange and scary issue. I just grow a xfs filesystem (44To), and no way to mount it anymore :
XFS: device supports only 4096 byte sectors (not 512)Did you expand an LV made of 512-sector physical devices by adding 4k-sector physical devices?
The three devices are ARECA 1880 card, but the last one was added later, and I never check for sector physical configuration on card configuration. But yes, running fdisk, it seems that sda and sdb are 512, and sdc is 4k... :(
Quoted 3 lines
that's probably not something we anticipate or check for....
What sector size(s) are the actual lowest level disks under all the lvm pieces?
(re-cc'ing xfs list)
Quoted 1 line
What command to run to get this info ?
IIRC,
Quoted 8 lines
# blockdev --getpbsz --getss /dev/sdato print the physical& logical sector size
You can also look at i.e.:
/sys/block/sda/queue/hw_sector_size/sys/block/sda/queue/physical_block_size/sys/block/sda/queue/logical_block_sizeouch... nice guess :
# blockdev --getpbsz --getss/dev/sda
512
512
# blockdev --getpbsz --getss/dev/sdb
512
512
# blockdev --getpbsz --getss/dev/sdc
4096
4096
Quoted 3 lines
Quoted 1 line
I wonder what the recovery steps would be here. I wouldn't do anything yet; I wish you hadn't already cleared the log, but oh well.
I tried a
xfs_repair-L (as mentionned byxfs_check), but it early failed as show on my first post...
Ah, right.
Quoted 3 lines
Quoted 1 line
So you grew it, that all worked ok, you were able to copy new data into the new space, you unmounted it, but now it won't mount, correct?
I never was able to copy data to new space. I had an input/output error just after growing. may pmove-ing extents on 4k device on a 512k device be a solution ?
Did the filesystem grow actually work?
# xfs_db -c "sb 0" -c "p" /dev/vg0/tomo-201111 magicnum = 0x58465342 blocksize = 4096 dblocks = 10468982745
That looks like it's (still?) a 38TiB/42TB filesystem, with:
sectsize = 512
512 sectors.
How big was it before you tried to grow it, and how much did you try to grow it by? Maybe the size never changed.
At mount time it tries to set the sector size of the device; its' a hard-4k device, so setting it to 512 fails.
This may be as much of an LVM issue as anything; how do you get the LVM device back to something with 512-byte logical sectors? I have no idea...
*if* the fs didn't actually grow, and if the new 4k-sector space is not used by the filesystem, and if you can somehow remove that new space from the device and set the LV back to 512 sectors, you might be in good shape.
Proceed with extreme caution here, I wouldn't start just trying random things unless you have some other way to get your data back (backups?). I'd check with LVM folks as well, and maybe see if dchinner or the sgi folks have other suggestions.
First let's find out if the filesystem actually thinks it's living on the new space.
-Eric
Quoted 1 line
rémi
_______________________________________________
xfs mailing list
[email protected]
http://oss.sgi.com/mailman/listinfo/xfs
Quoted 55 lines · Eric Sandeen
Quoted 40 lines · Rémi Cailletaud
Quoted 19 lines · Eric Sandeen
Quoted 13 lines · Rémi Cailletaud
Quoted 6 lines · Eric Sandeen
Quoted 4 lines · Rémi Cailletaud
Hi,
I face a strange and scary issue. I just grow a xfs filesystem (44To), and no way to mount it anymore :
XFS: device supports only 4096 byte sectors (not 512)Did you expand an LV made of 512-sector physical devices by adding 4k-sector physical devices?
The three devices are ARECA 1880 card, but the last one was added later, and I never check for sector physical configuration on card configuration. But yes, running fdisk, it seems that sda and sdb are 512, and sdc is 4k... :(
Quoted 3 lines
that's probably not something we anticipate or check for....
What sector size(s) are the actual lowest level disks under all the lvm pieces?
(re-cc'ing xfs list)
Quoted 1 line
What command to run to get this info ?
IIRC,
Quoted 8 lines
# blockdev --getpbsz --getss /dev/sdato print the physical& logical sector size
You can also look at i.e.:
/sys/block/sda/queue/hw_sector_size/sys/block/sda/queue/physical_block_size/sys/block/sda/queue/logical_block_sizeouch... nice guess :
# blockdev --getpbsz --getss/dev/sda
512
512
# blockdev --getpbsz --getss/dev/sdb
512
512
# blockdev --getpbsz --getss/dev/sdc
4096
4096Quoted 2 lines
Quoted 1 line
I wonder what the recovery steps would be here. I wouldn't do anything yet; I wish you hadn't already cleared the log, but oh well.
I tried a
xfs_repair-L (as mentionned byxfs_check), but it early failed as show on my first post...Ah, right.
Quoted 3 lines
Quoted 1 line
So you grew it, that all worked ok, you were able to copy new data into the new space, you unmounted it, but now it won't mount, correct?
I never was able to copy data to new space. I had an input/output error just after growing. may pmove-ing extents on 4k device on a 512k device be a solution ?
Did the filesystem grow actually work?
# xfs_db -c "sb 0" -c "p" /dev/vg0/tomo-201111 magicnum = 0x58465342 blocksize = 4096 dblocks = 10468982745
Quoted 7 lines
That looks like it's (still?) a 38TiB/42TB filesystem, with:
sectsize = 512
512 sectors.
How big was it before you tried to grow it, and how much did you try to grow it by? Maybe the size never changed.
Was 39, growing to 44. Testdisk says 48 TB / 44 TiB... There is some chance that it was never really growed.
Quoted 5 lines
At mount time it tries to set the sector size of the device; its' a hard-4k device, so setting it to 512 fails.
This may be as much of an LVM issue as anything; how do you get the LVM device back to something with 512-byte logical sectors? I have no idea...
*if* the fs didn't actually grow, and if the new 4k-sector space is not used by the filesystem, and if you can somehow remove that new space from the device and set the LV back to 512 sectors, you might be in good shape.
I dont either know how to see nor set LV sector size. It's 100% sure that anything was copied on 4k sector size, and pretty sure that the fs did not really grow.
Quoted 1 line
Proceed with extreme caution here, I wouldn't start just trying random things unless you have some other way to get your data back (backups?). I'd check with LVM folks as well, and maybe see if dchinner or the sgi folks have other suggestions.
Sigh... No backup (44To is too large for us...) ! I'm running a testdisk recover, but I'm not very confident about success... Thanks to deeper investigate this...
Quoted 1 line
First let's find out if the filesystem actually thinks it's living on the new space.
What is the way to make it talk about that ?
Thanks again for your help !
rémi
Quoted 9 lines
-Eric
Quoted 1 line
rémi
_______________________________________________
xfs mailing list
[email protected]
http://oss.sgi.com/mailman/listinfo/xfs
Signature · 14 lines
Rémi Cailletaud - IE CNRS 3SR - Laboratoire Sols, Solides, Structures - Risques BP53, 38041 Grenoble CEDEX 0 FRANCE [email protected] Tél: +33 (0)4 76 82 52 78 Fax: +33 (0)4 76 82 70 43 _______________________________________________ xfs mailing list [email protected] http://oss.sgi.com/mailman/listinfo/xfs
Quoted 1 line · Rémi Cailletaud
Le 13/02/2013 18:52, Eric Sandeen a écrit :
<snip>
Quoted 15 lines
Quoted 7 lines
Did the filesystem grow actually work?
# xfs_db -c "sb 0" -c "p" /dev/vg0/tomo-201111 magicnum = 0x58465342 blocksize = 4096 dblocks = 10468982745Quoted 7 lines
That looks like it's (still?) a 38TiB/42TB filesystem, with:
sectsize = 512
512 sectors.
How big was it before you tried to grow it, and how much did you try to grow it by? Maybe the size never changed.
Quoted 7 lines
Was 39, growing to 44. Testdisk says 48 TB / 44 TiB... There is some chance that it was never really growed.
Quoted 5 lines
At mount time it tries to set the sector size of the device; its' a hard-4k device, so setting it to 512 fails.
This may be as much of an LVM issue as anything; how do you get the LVM device back to something with 512-byte logical sectors? I have no idea...
*if* the fs didn't actually grow, and if the new 4k-sector space is not used by the filesystem, and if you can somehow remove that new space from the device and set the LV back to 512 sectors, you might be in good shape.
I dont either know how to see nor set LV sector size. It's 100% sure that anything was copied on 4k sector size, and pretty sure that the fs did not really grow.
I think the same blockdev command will tell you.
Quoted 5 lines
Quoted 1 line
Proceed with extreme caution here, I wouldn't start just trying random things unless you have some other way to get your data back (backups?). I'd check with LVM folks as well, and maybe see if dchinner or the sgi folks have other suggestions.
Sigh... No backup (44To is too large for us...) ! I'm running a testdisk recover, but I'm not very confident about success... Thanks to deeper investigate this...
Quoted 1 line
First let's find out if the filesystem actually thinks it's living on the new space.
What is the way to make it talk about that ?
well, you have 10468982745 4k blocks in your filesystem, so 42880953323520 bytes of xfs filesystem.
Look at your lvm layout, does that extend into the new disk space or is it confined to the original disk space?
-Eric
Quoted 15 lines
Thanks again for your help !
rémi
Quoted 9 lines
-Eric
Quoted 1 line
rémi
_______________________________________________
xfs mailing list
[email protected]
http://oss.sgi.com/mailman/listinfo/xfs
_______________________________________________
xfs mailing list
[email protected]
http://oss.sgi.com/mailman/listinfo/xfs
Quoted 32 lines · Eric Sandeen
Quoted 1 line · Rémi Cailletaud
Le 13/02/2013 18:52, Eric Sandeen a écrit :
<snip>
Quoted 15 lines
Quoted 7 lines
Did the filesystem grow actually work?
# xfs_db -c "sb 0" -c "p" /dev/vg0/tomo-201111 magicnum = 0x58465342 blocksize = 4096 dblocks = 10468982745Quoted 7 lines
That looks like it's (still?) a 38TiB/42TB filesystem, with:
sectsize = 512
512 sectors.
How big was it before you tried to grow it, and how much did you try to grow it by? Maybe the size never changed.
Quoted 7 lines
Was 39, growing to 44. Testdisk says 48 TB / 44 TiB... There is some chance that it was never really growed.
Quoted 5 lines
At mount time it tries to set the sector size of the device; its' a hard-4k device, so setting it to 512 fails.
This may be as much of an LVM issue as anything; how do you get the LVM device back to something with 512-byte logical sectors? I have no idea...
*if* the fs didn't actually grow, and if the new 4k-sector space is not used by the filesystem, and if you can somehow remove that new space from the device and set the LV back to 512 sectors, you might be in good shape.
I dont either know how to see nor set LV sector size. It's 100% sure that anything was copied on 4k sector size, and pretty sure that the fs did not really grow.
I think the same blockdev command will tell you.
Quoted 1 line
Quoted 1 line
Proceed with extreme caution here, I wouldn't start just trying random things unless you have some other way to get your data back (backups?). I'd check with LVM folks as well, and maybe see if dchinner or the sgi folks have other suggestions.
Quoted 8 lines
Quoted 4 lines
Sigh... No backup (44To is too large for us...) ! I'm running a testdisk recover, but I'm not very confident about success... Thanks to deeper investigate this...
Quoted 1 line
First let's find out if the filesystem actually thinks it's living on the new space.
What is the way to make it talk about that ?
well, you have 10468982745 4k blocks in your filesystem, so 42880953323520 bytes of xfs filesystem.
Look at your lvm layout, does that extend into the new disk space or is it confined to the original disk space?
lvm folks I talk to say that if you remove the 4k device from the lvm volume it should switch back to 512 sectors.
so if you can can convince yourself that 42880953323520 bytes does not cross into the newly added disk space, just remove it again, and everything should be happy.
Unless your rash decision to start running "testdisk" made things worse ;)
-Eric
Quoted 9 lines
-Eric
Quoted 7 lines
Thanks again for your help !
rémi
Quoted 3 lines
-Eric
Quoted 1 line
rémi
_______________________________________________
xfs mailing list
[email protected]
http://oss.sgi.com/mailman/listinfo/xfs
Eric Sandeen <[email protected]> a écrit :
Quoted 57 lines · Eric Sandeen
Quoted 12 lines · Rémi Cailletaud
Quoted 1 line · Eric Sandeen
<snip>
Quoted 7 lines
Quoted 7 lines
Did the filesystem grow actually work?
# xfs_db -c "sb 0" -c "p" /dev/vg0/tomo-201111 magicnum = 0x58465342 blocksize = 4096 dblocks = 10468982745Quoted 7 lines
Quoted 7 lines
Quoted 7 lines
That looks like it's (still?) a 38TiB/42TB filesystem, with:
sectsize = 512
512 sectors.
How big was it before you tried to grow it, and how much did you
try to grow it by? Maybe the size never changed.
Quoted 2 lines
Quoted 2 lines
Was 39, growing to 44. Testdisk says 48 TB / 44 TiB... There is some
chance that it was never really growed.
Quoted 1 line
Quoted 1 line
Quoted 1 line
At mount time it tries to set the sector size of the device; its' a
hard-4k device, so setting it to 512 fails.
Quoted 2 lines
Quoted 2 lines
Quoted 2 lines
This may be as much of an LVM issue as anything; how do you get the
LVM device back to something with 512-byte logical sectors? I have no idea...
Quoted 2 lines
Quoted 2 lines
Quoted 2 lines
*if* the fs didn't actually grow, and if the new 4k-sector space is
not used by the filesystem, and if you can somehow remove that new space from the device and set the LV back to 512 sectors, you might be in good shape.
Quoted 1 line
Quoted 1 line
I dont either know how to see nor set LV sector size. It's 100%
sure that anything was copied on 4k sector size, and pretty sure that the fs did not really grow.
Quoted 5 lines
I think the same blockdev command will tell you.
Quoted 1 line
Quoted 1 line
Proceed with extreme caution here, I wouldn't start just trying
random things unless you have some other way to get your data back (backups?). I'd check with LVM folks as well, and maybe see if dchinner or the sgi folks have other suggestions.
Quoted 1 line
Quoted 1 line
Sigh... No backup (44To is too large for us...) ! I'm running a
testdisk recover, but I'm not very confident about success...
Quoted 2 lines
Quoted 2 lines
Thanks to deeper investigate this...
Quoted 1 line
First let's find out if the filesystem actually thinks it's living
on the new space.
Quoted 3 lines
Quoted 1 line
What is the way to make it talk about that ?
well, you have 10468982745 4k blocks in your filesystem, so
42880953323520 bytes of xfs filesystem.
Quoted 2 lines
Look at your lvm layout, does that extend into the new disk space or
Quoted 9 lines
is it confined to the original disk space?
lvm folks I talk to say that if you remove the 4k device from the lvm volume it should switch back to 512 sectors.
so if you can can convince yourself that 42880953323520 bytes does not cross into the newly added disk space, just remove it again, and everything should be happy.
Ok, I'll check that tomorrow and try to remove added space if my fs does not live on...
Quoted 2 lines
Unless your rash decision to start running "testdisk" made things worse ;)
It's only analyse, it does not modify anything... it should not have any effect...
Thx again,
rémi
Quoted 16 lines
-Eric
Quoted 9 lines
-Eric
Quoted 7 lines
Thanks again for your help !
rémi
Quoted 3 lines
-Eric
Quoted 1 line
rémi
_______________________________________________
xfs mailing list
[email protected]
http://oss.sgi.com/mailman/listinfo/xfs
Signature · 6 lines
Envoyé de mon téléphone Android avec K-9 Mail. Excusez la brièveté. _______________________________________________ xfs mailing list [email protected] http://oss.sgi.com/mailman/listinfo/xfs
Quoted 40 lines · Eric Sandeen
Quoted 39 lines · Eric Sandeen
Quoted 1 line · Rémi Cailletaud
Le 13/02/2013 18:52, Eric Sandeen a écrit :
<snip>
Quoted 15 lines
Quoted 7 lines
Did the filesystem grow actually work?
# xfs_db -c "sb 0" -c "p" /dev/vg0/tomo-201111 magicnum = 0x58465342 blocksize = 4096 dblocks = 10468982745Quoted 7 lines
That looks like it's (still?) a 38TiB/42TB filesystem, with:
sectsize = 512
512 sectors.
How big was it before you tried to grow it, and how much did you try to grow it by? Maybe the size never changed.
Quoted 7 lines
Was 39, growing to 44. Testdisk says 48 TB / 44 TiB... There is some chance that it was never really growed.
Quoted 5 lines
At mount time it tries to set the sector size of the device; its' a hard-4k device, so setting it to 512 fails.
This may be as much of an LVM issue as anything; how do you get the LVM device back to something with 512-byte logical sectors? I have no idea...
*if* the fs didn't actually grow, and if the new 4k-sector space is not used by the filesystem, and if you can somehow remove that new space from the device and set the LV back to 512 sectors, you might be in good shape.
I dont either know how to see nor set LV sector size. It's 100% sure that anything was copied on 4k sector size, and pretty sure that the fs did not really grow.
I think the same blockdev command will tell you.
Quoted 5 lines
Quoted 1 line
Proceed with extreme caution here, I wouldn't start just trying random things unless you have some other way to get your data back (backups?). I'd check with LVM folks as well, and maybe see if dchinner or the sgi folks have other suggestions.
Sigh... No backup (44To is too large for us...) ! I'm running a testdisk recover, but I'm not very confident about success... Thanks to deeper investigate this...
Quoted 1 line
First let's find out if the filesystem actually thinks it's living on the new space.
What is the way to make it talk about that ?
well, you have 10468982745 4k blocks in your filesystem, so 42880953323520 bytes of xfs filesystem.
Quoted 7 lines
Quoted 1 line
Look at your lvm layout, does that extend into the new disk space or is it confined to the original disk space?
lvm folks I talk to say that if you remove the 4k device from the lvm volume it should switch back to 512 sectors.
so if you can can convince yourself that 42880953323520 bytes does not cross into the newly added disk space, just remove it again, and everything should be happy.
Unless your rash decision to start running "testdisk" made things worse ;)
I tested this. I had a PV on a normal 512 device, then used scsi_debug to create a 4k device.
I created an LV on the 512 device & mounted it, then added the 4k device as you did. growfs failed immediately, and the device won't remount due to the sector size change.
I verified that removing the 4k device from the LV changes the LV back to a 512 sector size.
However, I'm not 100% sure how to remove just the 4K PV; when I did it, I did something wrong and it reduced the size of my LV to the point where it corrupted the filesystem. :) Perhaps you are a better lvm admin than I am.
But in any case - if you know how to safely remove ONLY the 4k device from the LV, you should be in good shape again.
-Eric
_______________________________________________
xfs mailing list
[email protected]
http://oss.sgi.com/mailman/listinfo/xfs
Quoted 30 lines · Eric Sandeen
Quoted 29 lines · Eric Sandeen
Quoted 28 lines · Eric Sandeen
Quoted 1 line · Rémi Cailletaud
Le 13/02/2013 18:52, Eric Sandeen a écrit :
<snip>
Quoted 13 lines
Quoted 13 lines
Did the filesystem grow actually work?
# xfs_db -c "sb 0" -c "p" /dev/vg0/tomo-201111 magicnum = 0x58465342 blocksize = 4096 dblocks = 10468982745That looks like it's (still?) a 38TiB/42TB filesystem, with:
sectsize = 512
512 sectors.
Quoted 8 lines
Quoted 1 line
How big was it before you tried to grow it, and how much did you try to grow it by? Maybe the size never changed.
Was 39, growing to 44. Testdisk says 48 TB / 44 TiB... There is some chance that it was never really growed.
Quoted 5 lines
At mount time it tries to set the sector size of the device; its' a hard-4k device, so setting it to 512 fails.
This may be as much of an LVM issue as anything; how do you get the LVM device back to something with 512-byte logical sectors? I have no idea...
*if* the fs didn't actually grow, and if the new 4k-sector space is not used by the filesystem, and if you can somehow remove that new space from the device and set the LV back to 512 sectors, you might be in good shape.
I dont either know how to see nor set LV sector size. It's 100% sure that anything was copied on 4k sector size, and pretty sure that the fs did not really grow.
I think the same blockdev command will tell you.
Quoted 8 lines
Quoted 8 lines
Quoted 8 lines
Quoted 5 lines
Quoted 1 line
Proceed with extreme caution here, I wouldn't start just trying random things unless you have some other way to get your data back (backups?). I'd check with LVM folks as well, and maybe see if dchinner or the sgi folks have other suggestions.
Sigh... No backup (44To is too large for us...) ! I'm running a testdisk recover, but I'm not very confident about success... Thanks to deeper investigate this...
Quoted 1 line
First let's find out if the filesystem actually thinks it's living on the new space.
What is the way to make it talk about that ?
well, you have 10468982745 4k blocks in your filesystem, so 42880953323520 bytes of xfs filesystem.
Look at your lvm layout, does that extend into the new disk space or is it confined to the original disk space?
Seems it does not : lvm map shows 48378494844928 bytes, 1304432738304 on the 4K device.
Quoted 4 lines
Quoted 4 lines
lvm folks I talk to say that if you remove the 4k device from the lvm volume it should switch back to 512 sectors.
so if you can can convince yourself that 42880953323520 bytes does not cross into the newly added disk space, just remove it again, and everything should be happy.
Quoted 8 lines
Quoted 1 line
Unless your rash decision to start running "testdisk" made things worse ;)
I tested this. I had a PV on a normal 512 device, then used
scsi_debugto create a 4k device.I created an LV on the 512 device& mounted it, then added the 4k device as you did. growfs failed immediately, and the device won't remount due to the sector size change.
I verified that removing the 4k device from the LV changes the LV back to a 512 sector size.
However, I'm not 100% sure how to remove just the 4K PV; when I did it, I did something wrong and it reduced the size of my LV to the point where it corrupted the filesystem. :) Perhaps you are a better lvm admin than I am.
How did you remove the pv ? I would tend to use vgreduce, but I'm a bit (a lot, in fact) scary about fs corruption. That's why I was wondering about pvmove'ing extents on a 512K device
rémi
Quoted 6 lines
But in any case - if you know how to safely remove ONLY the 4k device from the LV, you should be in good shape again.
-Eric
Signature · 14 lines
Rémi Cailletaud - IE CNRS 3SR - Laboratoire Sols, Solides, Structures - Risques BP53, 38041 Grenoble CEDEX 0 FRANCE [email protected] Tél: +33 (0)4 76 82 52 78 Fax: +33 (0)4 76 82 70 43 _______________________________________________ xfs mailing list [email protected] http://oss.sgi.com/mailman/listinfo/xfs
Quoted 46 lines · Rémi Cailletaud
Quoted 30 lines · Eric Sandeen
Quoted 29 lines · Eric Sandeen
Quoted 28 lines · Eric Sandeen
Quoted 1 line · Rémi Cailletaud
Le 13/02/2013 18:52, Eric Sandeen a écrit :
<snip>
Quoted 13 lines
Quoted 13 lines
Did the filesystem grow actually work?
# xfs_db -c "sb 0" -c "p" /dev/vg0/tomo-201111 magicnum = 0x58465342 blocksize = 4096 dblocks = 10468982745That looks like it's (still?) a 38TiB/42TB filesystem, with:
sectsize = 512
512 sectors.
Quoted 8 lines
Quoted 1 line
How big was it before you tried to grow it, and how much did you try to grow it by? Maybe the size never changed.
Was 39, growing to 44. Testdisk says 48 TB / 44 TiB... There is some chance that it was never really growed.
Quoted 5 lines
At mount time it tries to set the sector size of the device; its' a hard-4k device, so setting it to 512 fails.
This may be as much of an LVM issue as anything; how do you get the LVM device back to something with 512-byte logical sectors? I have no idea...
*if* the fs didn't actually grow, and if the new 4k-sector space is not used by the filesystem, and if you can somehow remove that new space from the device and set the LV back to 512 sectors, you might be in good shape.
I dont either know how to see nor set LV sector size. It's 100% sure that anything was copied on 4k sector size, and pretty sure that the fs did not really grow.
I think the same blockdev command will tell you.
Quoted 8 lines
Quoted 8 lines
Quoted 8 lines
Quoted 5 lines
Quoted 1 line
Proceed with extreme caution here, I wouldn't start just trying random things unless you have some other way to get your data back (backups?). I'd check with LVM folks as well, and maybe see if dchinner or the sgi folks have other suggestions.
Sigh... No backup (44To is too large for us...) ! I'm running a testdisk recover, but I'm not very confident about success... Thanks to deeper investigate this...
Quoted 1 line
First let's find out if the filesystem actually thinks it's living on the new space.
What is the way to make it talk about that ?
well, you have 10468982745 4k blocks in your filesystem, so 42880953323520 bytes of xfs filesystem.
Look at your lvm layout, does that extend into the new disk space or is it confined to the original disk space?
Seems it does not : lvm map shows 48378494844928 bytes, 1304432738304 on the 4K device.
Quoted 5 lines
Quoted 5 lines
lvm folks I talk to say that if you remove the 4k device from the lvm volume it should switch back to 512 sectors.
so if you can can convince yourself that 42880953323520 bytes does not cross into the newly added disk space, just remove it again, and everything should be happy.
Unless your rash decision to start running "testdisk" made things worse ;)
Quoted 8 lines
Quoted 7 lines
I tested this. I had a PV on a normal 512 device, then used
scsi_debugto create a 4k device.I created an LV on the 512 device& mounted it, then added the 4k device as you did. growfs failed immediately, and the device won't remount due to the sector size change.
I verified that removing the 4k device from the LV changes the LV back to a 512 sector size.
However, I'm not 100% sure how to remove just the 4K PV; when I did it, I did something wrong and it reduced the size of my LV to the point where it corrupted the filesystem. :) Perhaps you are a better lvm admin than I am.
How did you remove the pv ? I would tend to use vgreduce, but I'm a bit (a lot, in fact) scary about fs corruption. That's why I was wondering about pvmove'ing extents on a 512K device
Or may a vgcfgrestore be safer ? Should I ask lvm folks ?
rémi
Quoted 11 lines
rémi
Quoted 6 lines
But in any case - if you know how to safely remove ONLY the 4k device from the LV, you should be in good shape again.
-Eric
Signature · 14 lines
Rémi Cailletaud - IE CNRS 3SR - Laboratoire Sols, Solides, Structures - Risques BP53, 38041 Grenoble CEDEX 0 FRANCE [email protected] Tél: +33 (0)4 76 82 52 78 Fax: +33 (0)4 76 82 70 43 _______________________________________________ xfs mailing list [email protected] http://oss.sgi.com/mailman/listinfo/xfs
A message that is not in the archive (sent off-list or not yet received): [email protected]
A message that is not in the archive (sent off-list or not yet received): [email protected]
Quoted 57 lines · Eric Sandeen
Quoted 56 lines · Rémi Cailletaud
Quoted 55 lines · Rémi Cailletaud
Quoted 54 lines · Rémi Cailletaud
Quoted 30 lines · Eric Sandeen
Quoted 29 lines · Eric Sandeen
Quoted 28 lines · Eric Sandeen
Quoted 1 line · Rémi Cailletaud
Le 13/02/2013 18:52, Eric Sandeen a écrit :
<snip>
Quoted 13 lines
Quoted 13 lines
Did the filesystem grow actually work?
# xfs_db -c "sb 0" -c "p" /dev/vg0/tomo-201111 magicnum = 0x58465342 blocksize = 4096 dblocks = 10468982745That looks like it's (still?) a 38TiB/42TB filesystem, with:
sectsize = 512
512 sectors.
Quoted 8 lines
Quoted 1 line
How big was it before you tried to grow it, and how much did you try to grow it by? Maybe the size never changed.
Was 39, growing to 44. Testdisk says 48 TB / 44 TiB... There is some chance that it was never really growed.
Quoted 5 lines
At mount time it tries to set the sector size of the device; its' a hard-4k device, so setting it to 512 fails.
This may be as much of an LVM issue as anything; how do you get the LVM device back to something with 512-byte logical sectors? I have no idea...
*if* the fs didn't actually grow, and if the new 4k-sector space is not used by the filesystem, and if you can somehow remove that new space from the device and set the LV back to 512 sectors, you might be in good shape.
I dont either know how to see nor set LV sector size. It's 100% sure that anything was copied on 4k sector size, and pretty sure that the fs did not really grow.
I think the same blockdev command will tell you.
Quoted 8 lines
Quoted 8 lines
Quoted 8 lines
Quoted 5 lines
Quoted 1 line
Proceed with extreme caution here, I wouldn't start just trying random things unless you have some other way to get your data back (backups?). I'd check with LVM folks as well, and maybe see if dchinner or the sgi folks have other suggestions.
Sigh... No backup (44To is too large for us...) ! I'm running a testdisk recover, but I'm not very confident about success... Thanks to deeper investigate this...
Quoted 1 line
First let's find out if the filesystem actually thinks it's living on the new space.
What is the way to make it talk about that ?
well, you have 10468982745 4k blocks in your filesystem, so 42880953323520 bytes of xfs filesystem.
Look at your lvm layout, does that extend into the new disk space or is it confined to the original disk space?
Seems it does not : lvm map shows 48378494844928 bytes, 1304432738304 on the 4K device.
Quoted 4 lines
Quoted 4 lines
lvm folks I talk to say that if you remove the 4k device from the lvm volume it should switch back to 512 sectors.
so if you can can convince yourself that 42880953323520 bytes does not cross into the newly added disk space, just remove it again, and everything should be happy.
Quoted 8 lines
Quoted 1 line
Unless your rash decision to start running "testdisk" made things worse ;)
I tested this. I had a PV on a normal 512 device, then used
scsi_debugto create a 4k device.I created an LV on the 512 device& mounted it, then added the 4k device as you did. growfs failed immediately, and the device won't remount due to the sector size change.
I verified that removing the 4k device from the LV changes the LV back to a 512 sector size.
However, I'm not 100% sure how to remove just the 4K PV; when I did it, I did something wrong and it reduced the size of my LV to the point where it corrupted the filesystem. :) Perhaps you are a better lvm admin than I am.
How did you remove the pv ? I would tend to use vgreduce, but I'm a bit (a lot, in fact) scary about fs corruption. That's why I was wondering about pvmove'ing extents on a 512K device
Quoted 8 lines
Quoted 7 lines
Quoted 1 line
Or may a vgcfgrestore be safer ? Should I ask lvm folks ?
I tried a test as you suggest using
scsi_debug.2 PV, one 512 and one 4096 bytes sector.
after adding the 4K device, growfs fail, and partition wont remount. I tried a vgcfgrestore and vgreduce, but it does not mount : same error... XFS (dm-5): device supports 4096 byte sectors (not 512)
In that case I think you must not have actually (completely?) removed the 4k device.
That's it! After vgchange-ing un/available, lv mounts !
Following steps reproduce the "bug", considering we already have one pv on /dev/sdc (512 sectors device) :
- create a virtual 4k scsi device and create a pv on it :
# modprobe scsi_debug sector_size=4096 dev_size_mb=256 # pvcreate /dev/sdd
- create a vg with both pv, and create an lv on sdc (I specified exact extents count of sdc) :
# vgcreate vgtest /dev/sdc /dev/sdd # lvcreate -n lvtest -l 3759 vgtest
- mkfs, mount :
# mkfs.xfs /dev/vgtest/lvtest # mount /dev/vgtest/lvtest /mnt/tmp
- the bad thing : lvextend and growfs (should not lvm or xfs check this sector size stuff ?):
# lvextend -l+40 /dev/vgtest/lvtest # xfs_growfs /mnt/tmp (fail with xfs_growfs: XFS_IOC_FSGROWFSDATA xfsctl failed)
- the scary part :
# umount /mnt/tmp # mount /dev/vgtest/lvtest /mnt/tmp mount: function not implemented # tail -1 /var/log/messages Feb 14 16:41:52 hamaika kernel: [ 481.055422] XFS (dm-5): device supports 4096 byte sectors (not 512)
- the huge relief (restoring *before* lvextend) :
# vgcfgrestore -f /etc/lvm/archive/vgtest_00029-84595486.vg vgtest # vgchange -a n vgtest # vgchange -a y vgtest # mount /dev/vgtest/lvtest /mnt/tmp
yippee, my datas are back !!
Should I submit a bug report ? On LVM, XFS, both ?
However, a great thanks for your help... I learned some stuff about lvm and xfs today ;) Cheers,
rémi
Quoted 6 lines
I think you'll need to seek help from LVM people in order to proceed... I'm sure it's possible to safely and completely remove the newly added space, but I don't know how.
-Eric
Signature · 14 lines
Rémi Cailletaud - IE CNRS 3SR - Laboratoire Sols, Solides, Structures - Risques BP53, 38041 Grenoble CEDEX 0 FRANCE [email protected] Tél: +33 (0)4 76 82 52 78 Fax: +33 (0)4 76 82 70 43 _______________________________________________ xfs mailing list [email protected] http://oss.sgi.com/mailman/listinfo/xfs
Quoted 1 line · Rémi Cailletaud
Le 14/02/2013 16:03, Eric Sandeen a écrit :
<big snip>
Quoted 13 lines
Quoted 3 lines
Quoted 2 lines
after adding the 4K device, growfs fail, and partition wont remount. I tried a vgcfgrestore and vgreduce, but it does not mount : same error... XFS (dm-5): device supports 4096 byte sectors (not 512)
In that case I think you must not have actually (completely?) removed the 4k device.
That's it! After vgchange-ing un/available, lv mounts !
Following steps reproduce the "bug", considering we already have one pv on
/dev/sdc(512 sectors device) :- create a virtual 4k scsi device and create a pv on it :
# modprobe scsi_debug sector_size=4096 dev_size_mb=256 # pvcreate /dev/sdd- create a vg with both pv, and create an lv on sdc (I specified exact extents count of sdc) :
Quoted 8 lines
# vgcreate vgtest /dev/sdc /dev/sdd # lvcreate -n lvtest -l 3759 vgtest- mkfs, mount :
# mkfs.xfs /dev/vgtest/lvtest # mount /dev/vgtest/lvtest /mnt/tmp- the bad thing : lvextend and growfs (should not lvm or xfs check this sector size stuff ?):
xfs does check, to some degree:
Quoted 3 lines
# lvextend -l+40 /dev/vgtest/lvtest # xfs_growfs /mnt/tmp (fail with xfs_growfs: XFS_IOC_FSGROWFSDATA xfsctl failed)
^^^ see? ;) It could maybe be more explicit, but xfs is already in trouble by this point (before growfs, it still won't be remountable). There is no opportunity for xfs to catch this damage before it's done.
Yes, I think lvm should check before allowing the change.
Quoted 8 lines
- the scary part :
# umount /mnt/tmp # mount /dev/vgtest/lvtest /mnt/tmp mount: function not implemented # tail -1 /var/log/messages Feb 14 16:41:52 hamaika kernel: [ 481.055422] XFS (dm-5): device supports 4096 byte sectors (not 512)
Quoted 7 lines
- the huge relief (restoring *before* lvextend) :
# vgcfgrestore -f /etc/lvm/archive/vgtest_00029-84595486.vg vgtest # vgchange -a n vgtest # vgchange -a y vgtest # mount /dev/vgtest/lvtest /mnt/tmpyippee, my datas are back !!
cool.
Quoted 2 lines
Should I submit a bug report ? On LVM, XFS, both ?
I don't know what xfs could have done here. Even if you didn't growfs, by the time you did lvextend xfs wouldn't have been able to remount. I think it's up to lvm to protect the user from this, personally, so a bug report there seems warranted.
Quoted 1 line
However, a great thanks for your help... I learned some stuff about lvm and xfs today ;)
You're welcome, very glad you got it back.
Thank my employer Red Hat for paying me to work on this stuff, too ;)
-Eric
Quoted 12 lines
Cheers,
rémi
Quoted 6 lines
I think you'll need to seek help from LVM people in order to proceed... I'm sure it's possible to safely and completely remove the newly added space, but I don't know how.
-Eric
_______________________________________________
xfs mailing list
[email protected]
http://oss.sgi.com/mailman/listinfo/xfs