Skip to contentSkip to conversation

xfs_fsr: extra debugging info

PATCH In review Eric Sandeen 3 participants 7 messages Mar 30, 2012 – Oct 10, 2013

lore
Share & tools
lore
#0 lore raw

PATCH 1/2 xfs_fsr: extra debugging info

Provide 2 new pieces of information when -d is specified to xfs_fsr:

* If we needed to grow the forkoffset and couldn't
* If we were unable to match the fork offset

---

fsr/xfs_fsr.c +7 -1
index 2db2224..d83bdc9 100644
@@ -1021,6 +1021,7 @@ fsr_setup_attr_fork(
 {
 	struct stat64	tstatbuf;
 	int		i;
+	int		diff = 0;
 	int		last_forkoff = 0;
 	int		no_change_cnt = 0;
 	int		ret;
@@ -1056,7 +1057,6 @@ fsr_setup_attr_fork(
 		xfs_bstat_t	tbstat;
 		xfs_ino_t	ino;
 		char		name[64];
-		int		diff;
 
 		/*
 		 * bulkstat the temp inode  to see what the forkoff is. Use
@@ -1122,6 +1122,8 @@ fsr_setup_attr_fork(
 			 * non-contiguous offsets.
 			 */
 			/* XXX: unimplemented! */
+			if (dflag)
+				printf(_("data fork growth unimplemented\n"));
 			goto out;
 		}
 
@@ -1137,6 +1139,10 @@ fsr_setup_attr_fork(
 out:
 	if (dflag)
 		fsrprintf(_("set temp attr\n"));
+	/* We failed to resolve the fork difference */
+	if (dflag && diff)
+		fsrprintf(_("failed to match fork offset\n"));;
+
 	return 0;
 }
 

_______________________________________________
xfs mailing list
[email protected]
http://oss.sgi.com/mailman/listinfo/xfs

#1 lore raw

PATCH 2/2 xfs_fsr: create extent-based attr to grow forkoff

In some cases the target file may have a non-local attribute, but the temp file gets assigned a local attribute on creation, due to selinux, for example.

In this case, the large-ish selinux attr will create a forkoff in the temp file smaller than the forkoff in the target file, because the FMT_EXTENTS attr takes up less space. There is no mechanism to grow the forkoff to match, so we can end up failing to swap these 2 inodes if the result is not enough data space in the temp inode as a result.

After testing the target file for a non-local extent, and checking to see if the forkoff needs to be grown on the first pass, we can add a large attr to knock all attributes of the temp file out of local format, and grow the fork offset.

This passes xfstest 227, and also resolves issues seen on a metadata image provided by Gabriel.

---

fsr/xfs_fsr.c +23 -1
index d83bdc9..e8ab028 100644
@@ -1022,6 +1022,8 @@ fsr_setup_attr_fork(
 	struct stat64	tstatbuf;
 	int		i;
 	int		diff = 0;
+	struct fsxattr	fsx;
+	int		target_attr_local = 0;
 	int		last_forkoff = 0;
 	int		no_change_cnt = 0;
 	int		ret;
@@ -1052,6 +1054,11 @@ fsr_setup_attr_fork(
 		return -1;
 	}
 
+	memset(&fsx, 0, sizeof(fsx));
+	ioctl(fd, XFS_IOC_FSGETXATTR, &fsx);
+	if (fsx.fsx_nextents == 0)
+		target_attr_local = 1;
+
 	i = 0;
 	do {
 		xfs_bstat_t	tbstat;
@@ -1072,6 +1079,7 @@ fsr_setup_attr_fork(
 		if (dflag)
 			fsrprintf(_("orig forkoff %d, temp forkoff %d\n"),
 					bstatp->bs_forkoff, tbstat.bs_forkoff);
+		diff = tbstat.bs_forkoff - bstatp->bs_forkoff;
 
 		snprintf(name, sizeof(name), "user.%d", i);
 
@@ -1086,6 +1094,21 @@ fsr_setup_attr_fork(
 				return -1;
 			}
 			continue;
+		} else if (i == 0 && diff < 0 && target_attr_local == 0) {
+			/*
+			 * A small attr may exist from eg selinux but, if the
+			 * target is not local, write a big attr to tempfile
+			 * to knock it out of local format to match target.
+			 * This should actually increase the temp forkoffset.
+			 */
+			char val[2048];
+			memset(val, 'X', 2048);
+			ret = fsetxattr(tfd, name, val, 2048, XATTR_CREATE);
+			if (ret) {
+				fsrprintf(_("could not set large ATTR\n"));
+				return -1;
+			}
+			continue;
 		}
 
 		/*
@@ -1100,7 +1123,6 @@ fsr_setup_attr_fork(
 		last_forkoff = tbstat.bs_forkoff;
 
 		/* work out which way to grow the fork */
-		diff = tbstat.bs_forkoff - bstatp->bs_forkoff;
 		if (abs(diff) > fsgeom.inodesize - sizeof(struct xfs_dinode)) {
 			fsrprintf(_("forkoff diff %d too large!\n"), diff);
 			return -1;

_______________________________________________
xfs mailing list
[email protected]
http://oss.sgi.com/mailman/listinfo/xfs

#2 lore raw

Re: [PATCH 2/2] xfs_fsr: create extent-based attr to grow forkoff

Quoted 4 lines · Eric Sandeen

In some cases the target file may have a non-local attribute, but the temp file gets assigned a local attribute on creation, due to selinux, for example.

Quoted 8 lines

In this case, the large-ish selinux attr will create a forkoff in the temp file smaller than the forkoff in the target file, because the FMT_EXTENTS attr takes up less space. There is no mechanism to grow the forkoff to match, so we can end up failing to swap these 2 inodes if the result is not enough data space in the temp inode as a result.

After testing the target file for a non-local extent, and

sorry that should read "non-local attribute."

Quoted 75 lines

checking to see if the forkoff needs to be grown on the first pass, we can add a large attr to knock all attributes of the temp file out of local format, and grow the fork offset.

This passes xfstest 227, and also resolves issues seen on a metadata image provided by Gabriel.

---

fsr/xfs_fsr.c +23 -1
index d83bdc9..e8ab028 100644
@@ -1022,6 +1022,8 @@ fsr_setup_attr_fork(
 	struct stat64	tstatbuf;
 	int		i;
 	int		diff = 0;
+	struct fsxattr	fsx;
+	int		target_attr_local = 0;
 	int		last_forkoff = 0;
 	int		no_change_cnt = 0;
 	int		ret;
@@ -1052,6 +1054,11 @@ fsr_setup_attr_fork(
 		return -1;
 	}
 
+	memset(&fsx, 0, sizeof(fsx));
+	ioctl(fd, XFS_IOC_FSGETXATTR, &fsx);
+	if (fsx.fsx_nextents == 0)
+		target_attr_local = 1;
+
 	i = 0;
 	do {
 		xfs_bstat_t	tbstat;
@@ -1072,6 +1079,7 @@ fsr_setup_attr_fork(
 		if (dflag)
 			fsrprintf(_("orig forkoff %d, temp forkoff %d\n"),
 					bstatp->bs_forkoff, tbstat.bs_forkoff);
+		diff = tbstat.bs_forkoff - bstatp->bs_forkoff;
 
 		snprintf(name, sizeof(name), "user.%d", i);
 
@@ -1086,6 +1094,21 @@ fsr_setup_attr_fork(
 				return -1;
 			}
 			continue;
+		} else if (i == 0 && diff < 0 && target_attr_local == 0) {
+			/*
+			 * A small attr may exist from eg selinux but, if the
+			 * target is not local, write a big attr to tempfile
+			 * to knock it out of local format to match target.
+			 * This should actually increase the temp forkoffset.
+			 */
+			char val[2048];
+			memset(val, 'X', 2048);
+			ret = fsetxattr(tfd, name, val, 2048, XATTR_CREATE);
+			if (ret) {
+				fsrprintf(_("could not set large ATTR\n"));
+				return -1;
+			}
+			continue;
 		}
 
 		/*
@@ -1100,7 +1123,6 @@ fsr_setup_attr_fork(
 		last_forkoff = tbstat.bs_forkoff;
 
 		/* work out which way to grow the fork */
-		diff = tbstat.bs_forkoff - bstatp->bs_forkoff;
 		if (abs(diff) > fsgeom.inodesize - sizeof(struct xfs_dinode)) {
 			fsrprintf(_("forkoff diff %d too large!\n"), diff);
 			return -1;
Quoted 5 lines

_______________________________________________
xfs mailing list
[email protected]
http://oss.sgi.com/mailman/listinfo/xfs

_______________________________________________
xfs mailing list
[email protected]
http://oss.sgi.com/mailman/listinfo/xfs

#3 lore raw

Re: [PATCH 2/2] xfs_fsr: create extent-based attr to grow forkoff

In reply to Eric Sandeen
Quoted 11 lines · Eric Sandeen

In some cases the target file may have a non-local attribute, but the temp file gets assigned a local attribute on creation, due to selinux, for example.

In this case, the large-ish selinux attr will create a forkoff in the temp file smaller than the forkoff in the target file, because the FMT_EXTENTS attr takes up less space. There is no mechanism to grow the forkoff to match, so we can end up failing to swap these 2 inodes if the result is not enough data space in the temp inode as a result.

Quoted 7 lines

After testing the target file for a non-local extent, and checking to see if the forkoff needs to be grown on the first pass, we can add a large attr to knock all attributes of the temp file out of local format, and grow the fork offset.

This passes xfstest 227, and also resolves issues seen on a metadata image provided by Gabriel.

Ping on this one? Would be nice to push it out.

-Eric

Quoted 68 lines

---

fsr/xfs_fsr.c +23 -1
index d83bdc9..e8ab028 100644
@@ -1022,6 +1022,8 @@ fsr_setup_attr_fork(
 	struct stat64	tstatbuf;
 	int		i;
 	int		diff = 0;
+	struct fsxattr	fsx;
+	int		target_attr_local = 0;
 	int		last_forkoff = 0;
 	int		no_change_cnt = 0;
 	int		ret;
@@ -1052,6 +1054,11 @@ fsr_setup_attr_fork(
 		return -1;
 	}
 
+	memset(&fsx, 0, sizeof(fsx));
+	ioctl(fd, XFS_IOC_FSGETXATTR, &fsx);
+	if (fsx.fsx_nextents == 0)
+		target_attr_local = 1;
+
 	i = 0;
 	do {
 		xfs_bstat_t	tbstat;
@@ -1072,6 +1079,7 @@ fsr_setup_attr_fork(
 		if (dflag)
 			fsrprintf(_("orig forkoff %d, temp forkoff %d\n"),
 					bstatp->bs_forkoff, tbstat.bs_forkoff);
+		diff = tbstat.bs_forkoff - bstatp->bs_forkoff;
 
 		snprintf(name, sizeof(name), "user.%d", i);
 
@@ -1086,6 +1094,21 @@ fsr_setup_attr_fork(
 				return -1;
 			}
 			continue;
+		} else if (i == 0 && diff < 0 && target_attr_local == 0) {
+			/*
+			 * A small attr may exist from eg selinux but, if the
+			 * target is not local, write a big attr to tempfile
+			 * to knock it out of local format to match target.
+			 * This should actually increase the temp forkoffset.
+			 */
+			char val[2048];
+			memset(val, 'X', 2048);
+			ret = fsetxattr(tfd, name, val, 2048, XATTR_CREATE);
+			if (ret) {
+				fsrprintf(_("could not set large ATTR\n"));
+				return -1;
+			}
+			continue;
 		}
 
 		/*
@@ -1100,7 +1123,6 @@ fsr_setup_attr_fork(
 		last_forkoff = tbstat.bs_forkoff;
 
 		/* work out which way to grow the fork */
-		diff = tbstat.bs_forkoff - bstatp->bs_forkoff;
 		if (abs(diff) > fsgeom.inodesize - sizeof(struct xfs_dinode)) {
 			fsrprintf(_("forkoff diff %d too large!\n"), diff);
 			return -1;
Quoted 5 lines

_______________________________________________
xfs mailing list
[email protected]
http://oss.sgi.com/mailman/listinfo/xfs

_______________________________________________
xfs mailing list
[email protected]
http://oss.sgi.com/mailman/listinfo/xfs

#4 lore raw

Re: [PATCH 2/2] xfs_fsr: create extent-based attr to grow forkoff

In reply to Eric Sandeen
Quoted 16 lines · Eric Sandeen

In some cases the target file may have a non-local attribute, but the temp file gets assigned a local attribute on creation, due to selinux, for example.

In this case, the large-ish selinux attr will create a forkoff in the temp file smaller than the forkoff in the target file, because the FMT_EXTENTS attr takes up less space. There is no mechanism to grow the forkoff to match, so we can end up failing to swap these 2 inodes if the result is not enough data space in the temp inode as a result.

After testing the target file for a non-local extent, and checking to see if the forkoff needs to be grown on the first pass, we can add a large attr to knock all attributes of the temp file out of local format, and grow the fork offset.

Quoted 6 lines

This passes xfstest 227, and also resolves issues seen on a metadata image provided by Gabriel.

---

Ping #2? This was a real bug once, IIRC. Probably still is...

Patch 1/2 helped identify the problem, so ping on that too I guess.

-Eric

Quoted 64 lines
fsr/xfs_fsr.c +23 -1
index d83bdc9..e8ab028 100644
@@ -1022,6 +1022,8 @@ fsr_setup_attr_fork(
 	struct stat64	tstatbuf;
 	int		i;
 	int		diff = 0;
+	struct fsxattr	fsx;
+	int		target_attr_local = 0;
 	int		last_forkoff = 0;
 	int		no_change_cnt = 0;
 	int		ret;
@@ -1052,6 +1054,11 @@ fsr_setup_attr_fork(
 		return -1;
 	}
 
+	memset(&fsx, 0, sizeof(fsx));
+	ioctl(fd, XFS_IOC_FSGETXATTR, &fsx);
+	if (fsx.fsx_nextents == 0)
+		target_attr_local = 1;
+
 	i = 0;
 	do {
 		xfs_bstat_t	tbstat;
@@ -1072,6 +1079,7 @@ fsr_setup_attr_fork(
 		if (dflag)
 			fsrprintf(_("orig forkoff %d, temp forkoff %d\n"),
 					bstatp->bs_forkoff, tbstat.bs_forkoff);
+		diff = tbstat.bs_forkoff - bstatp->bs_forkoff;
 
 		snprintf(name, sizeof(name), "user.%d", i);
 
@@ -1086,6 +1094,21 @@ fsr_setup_attr_fork(
 				return -1;
 			}
 			continue;
+		} else if (i == 0 && diff < 0 && target_attr_local == 0) {
+			/*
+			 * A small attr may exist from eg selinux but, if the
+			 * target is not local, write a big attr to tempfile
+			 * to knock it out of local format to match target.
+			 * This should actually increase the temp forkoffset.
+			 */
+			char val[2048];
+			memset(val, 'X', 2048);
+			ret = fsetxattr(tfd, name, val, 2048, XATTR_CREATE);
+			if (ret) {
+				fsrprintf(_("could not set large ATTR\n"));
+				return -1;
+			}
+			continue;
 		}
 
 		/*
@@ -1100,7 +1123,6 @@ fsr_setup_attr_fork(
 		last_forkoff = tbstat.bs_forkoff;
 
 		/* work out which way to grow the fork */
-		diff = tbstat.bs_forkoff - bstatp->bs_forkoff;
 		if (abs(diff) > fsgeom.inodesize - sizeof(struct xfs_dinode)) {
 			fsrprintf(_("forkoff diff %d too large!\n"), diff);
 			return -1;
Quoted 5 lines

_______________________________________________
xfs mailing list
[email protected]
http://oss.sgi.com/mailman/listinfo/xfs

_______________________________________________
xfs mailing list
[email protected]
http://oss.sgi.com/mailman/listinfo/xfs

#5 lore raw

Re: [PATCH 2/2] xfs_fsr: create extent-based attr to grow forkoff

Quoted 20 lines · Eric Sandeen
Quoted 19 lines · Eric Sandeen

In some cases the target file may have a non-local attribute, but the temp file gets assigned a local attribute on creation, due to selinux, for example.

In this case, the large-ish selinux attr will create a forkoff in the temp file smaller than the forkoff in the target file, because the FMT_EXTENTS attr takes up less space. There is no mechanism to grow the forkoff to match, so we can end up failing to swap these 2 inodes if the result is not enough data space in the temp inode as a result.

After testing the target file for a non-local extent, and checking to see if the forkoff needs to be grown on the first pass, we can add a large attr to knock all attributes of the temp file out of local format, and grow the fork offset.

This passes xfstest 227, and also resolves issues seen on a metadata image provided by Gabriel.

Quoted 7 lines
Quoted 3 lines

---

Ping #2? This was a real bug once, IIRC. Probably still is...

Patch 1/2 helped identify the problem, so ping on that too I guess.

Can you repost all these old patches as a new series to make it easy to apply and test them?

Cheers,

Dave.

Signature · 7 lines
Dave Chinner
[email protected]

_______________________________________________
xfs mailing list
[email protected]
http://oss.sgi.com/mailman/listinfo/xfs
#6 lore raw

Re: [PATCH 2/2] xfs_fsr: create extent-based attr to grow forkoff

Quoted 26 lines · Dave Chinner
Quoted 26 lines · Eric Sandeen
Quoted 23 lines · Eric Sandeen

In some cases the target file may have a non-local attribute, but the temp file gets assigned a local attribute on creation, due to selinux, for example.

In this case, the large-ish selinux attr will create a forkoff in the temp file smaller than the forkoff in the target file, because the FMT_EXTENTS attr takes up less space. There is no mechanism to grow the forkoff to match, so we can end up failing to swap these 2 inodes if the result is not enough data space in the temp inode as a result.

After testing the target file for a non-local extent, and checking to see if the forkoff needs to be grown on the first pass, we can add a large attr to knock all attributes of the temp file out of local format, and grow the fork offset.

This passes xfstest 227, and also resolves issues seen on a metadata image provided by Gabriel.

---

Quoted 7 lines
Quoted 3 lines

Ping #2? This was a real bug once, IIRC. Probably still is...

Patch 1/2 helped identify the problem, so ping on that too I guess.

Can you repost all these old patches as a new series to make it easy to apply and test them?

Ok, good idea.

Eric

Quoted 7 lines

Cheers,

Dave.

Signature · 2 lines
Dave Chinner
[email protected]

_______________________________________________
xfs mailing list
[email protected]
http://oss.sgi.com/mailman/listinfo/xfs