xfs: a couple of small fixes
cover xfs: a couple of small fixes
Hi folks,
These are fixes for the problems that Nathan Scott brought to our attention earlier this afternoon on #xfs. Many thanks to Nathan for finding these issues.
Cheers,
Dave.
PATCH 1/2 xfs: stats expose padding value at end of qm line
From: Dave Chinner <[email protected]>
There are 8 quota stats exposed, but:
$ grep qm /proc/fs/xfs/stat qm 0 0 0 1889 308893 0 0 0 0 $
There are 9 values exposed. Code inspection reveals that the struct xfsstats has a hole in the structure where the values change from 32 bit counters to 64 bit counters. pahole output:
....
uint32_t xs_qm_dquot; /* 748 4 */ uint32_t xs_qm_dquot_unused; /* 752 4 */
/* XXX 4 bytes hole, try to pack */
uint64_t xs_xstrat_bytes; /* 760 8 */
....
Fix this by defining an "end of 32 bit variables" variable that we then use to define the end of the quota line. This will then ensure that we print the correct number of values regardless of structure layout.
However, ABI requirements for userspace parsers mean we cannot remove the output that results from this hole, so we also need to explicitly define this unused value until such time that we actually add a new stat that makes the output meaningful.
And now we have a defined end of 32bit variables, update the stats union to be sized to match all the 32 bit variables correctly.
Output with this patch:
$ grep qm /proc/fs/xfs/stat qm 0 0 0 326 1802 0 6 3 0 $
--- fs/xfs/xfs_stats.c | 2 +- fs/xfs/xfs_stats.h | 15 +++++++++++++-- 2 files changed, 14 insertions(+), 3 deletions(-)
fs/xfs/xfs_stats.c +1 -1
@@ -51,7 +51,7 @@ int xfs_stats_format(struct xfsstats __percpu *stats, char *buf) { "rmapbt", xfsstats_offset(xs_refcbt_2) }, { "refcntbt", xfsstats_offset(xs_qm_dqreclaims)},/* we print both series of quota information together */ - { "qm", xfsstats_offset(xs_xstrat_bytes)}, + { "qm", xfsstats_offset(xs_end_of_32bit_counts)}, };/* Loop over all stats groups */
fs/xfs/xfs_stats.h +13 -2
@@ -133,6 +133,17 @@ struct __xfsstats {uint32_t xs_qm_dqwants;uint32_t xs_qm_dquot;uint32_t xs_qm_dquot_unused; +uint32_t xs_qm_zero_until_next_stat_is_added; + +/* +* Define the end of 32 bit counters as a 32 bit variable so that we don't +* end up exposing an implicit structure padding hole due to the next counters +* being 64bit values. If the number of coutners is odd, this fills the hole. If +* the number of coutners is even the hole is after this variable and the stats +* line will terminate printing at this offset and not print the hole. +*/ +uint32_t xs_end_of_32bit_counts; +/* Extra precision counters */ uint64_t xs_xstrat_bytes;uint64_t xs_write_bytes;
@@ -143,8 +154,8 @@ struct __xfsstats {struct xfsstats {union { -struct __xfsstats s; -uint32_t a[xfsstats_offset (xs_qm_dquot)]; +struct __xfsstats s; +uint32_t a[xfsstats_offset (xs_end_of_32bit_counts)]; }; };
Signature · 1 line
2.28.0
Re: [PATCH 1/2] xfs: stats expose padding value at end of qm line
Quoted 12 lines · Dave Chinner
From: Dave Chinner <[email protected]>
There are 8 quota stats exposed, but:
$ grep qm /proc/fs/xfs/stat qm 0 0 0 1889 308893 0 0 0 0 $There are 9 values exposed. Code inspection reveals that the struct xfsstats has a hole in the structure where the values change from 32 bit counters to 64 bit counters. pahole output:
Quoted 7 lines
....
uint32_t xs_qm_dquot; /* 748 4 */ uint32_t xs_qm_dquot_unused; /* 752 4 *//* XXX 4 bytes hole, try to pack */
uint64_txs_xstrat_bytes; /* 760 8 */
Any chance we could use BUILD_BUG_ON(offsetof(xs_xstrat_bytes) % 8 == 0) to catch this kind of thing on 64-bit machines in the future? Or maybe we shift the u64 values to the start of the structure to avoid padding holes?
Also, does 32-bit XFS have this 9th value?
--D
Quoted 77 lines
....
Fix this by defining an "end of 32 bit variables" variable that we then use to define the end of the quota line. This will then ensure that we print the correct number of values regardless of structure layout.
However, ABI requirements for userspace parsers mean we cannot remove the output that results from this hole, so we also need to explicitly define this unused value until such time that we actually add a new stat that makes the output meaningful.
And now we have a defined end of 32bit variables, update the stats union to be sized to match all the 32 bit variables correctly.
Output with this patch:
$ grep qm /proc/fs/xfs/stat qm 0 0 0 326 1802 0 6 3 0 $Reported-by Nathan Scott <[email protected]>Signed-off-by Dave Chinner <[email protected]>--- fs/xfs/xfs_stats.c | 2 +- fs/xfs/xfs_stats.h | 15 +++++++++++++-- 2 files changed, 14 insertions(+), 3 deletions(-)fs/xfs/xfs_stats.c +1
-1@@ -51,7 +51,7 @@ int xfs_stats_format(struct xfsstats __percpu *stats, char *buf) { "rmapbt", xfsstats_offset(xs_refcbt_2) }, { "refcntbt", xfsstats_offset(xs_qm_dqreclaims)},/* we print both series of quota information together */ - { "qm", xfsstats_offset(xs_xstrat_bytes)}, + { "qm", xfsstats_offset(xs_end_of_32bit_counts)}, };/* Loop over all stats groups */ fs/xfs/xfs_stats.h +13
-2@@ -133,6 +133,17 @@ struct __xfsstats {uint32_t xs_qm_dqwants;uint32_t xs_qm_dquot;uint32_t xs_qm_dquot_unused; +uint32_t xs_qm_zero_until_next_stat_is_added; + +/* +* Define the end of 32 bit counters as a 32 bit variable so that we don't +* end up exposing an implicit structure padding hole due to the next counters +* being 64bit values. If the number of coutners is odd, this fills the hole. If +* the number of coutners is even the hole is after this variable and the stats +* line will terminate printing at this offset and not print the hole. +*/ +uint32_t xs_end_of_32bit_counts; +/* Extra precision counters */ uint64_t xs_xstrat_bytes;uint64_t xs_write_bytes;@@ -143,8 +154,8 @@ struct __xfsstats {struct xfsstats {union { -struct __xfsstats s; -uint32_t a[xfsstats_offset (xs_qm_dquot)]; +struct __xfsstats s; +uint32_t a[xfsstats_offset (xs_end_of_32bit_counts)]; }; };Signature · 1 line
2.28.0
Re: [PATCH 1/2] xfs: stats expose padding value at end of qm line
Quoted 17 lines · Darrick J. Wong
Quoted 16 lines · Dave Chinner
From: Dave Chinner <[email protected]>
There are 8 quota stats exposed, but:
$ grep qm /proc/fs/xfs/stat qm 0 0 0 1889 308893 0 0 0 0 $There are 9 values exposed. Code inspection reveals that the struct xfsstats has a hole in the structure where the values change from 32 bit counters to 64 bit counters. pahole output:
....
uint32_t xs_qm_dquot; /* 748 4 */ uint32_t xs_qm_dquot_unused; /* 752 4 */
Quoted 8 lines
Quoted 3 lines
/* XXX 4 bytes hole, try to pack */
uint64_txs_xstrat_bytes; /* 760 8 */Any chance we could use
BUILD_BUG_ON(offsetof(xs_xstrat_bytes) % 8 == 0)to catch this kind of thing on 64-bit machines in the future? Or maybe we shift the u64 values to the start of the structure to avoid padding holes?
Hmm seems like another case of "add more nice things?" killed off the bugfix.
Quoted 1 line
Also, does 32-bit XFS have this 9th value?
on my pi it does ;)
# grep qm /proc/fs/xfs/stat qm 0 0 0 0 0 0 0 0 0
Quoted 80 lines
--D
Quoted 77 lines
....
Fix this by defining an "end of 32 bit variables" variable that we then use to define the end of the quota line. This will then ensure that we print the correct number of values regardless of structure layout.
However, ABI requirements for userspace parsers mean we cannot remove the output that results from this hole, so we also need to explicitly define this unused value until such time that we actually add a new stat that makes the output meaningful.
And now we have a defined end of 32bit variables, update the stats union to be sized to match all the 32 bit variables correctly.
Output with this patch:
$ grep qm /proc/fs/xfs/stat qm 0 0 0 326 1802 0 6 3 0 $Reported-by Nathan Scott <[email protected]>Signed-off-by Dave Chinner <[email protected]>--- fs/xfs/xfs_stats.c | 2 +- fs/xfs/xfs_stats.h | 15 +++++++++++++-- 2 files changed, 14 insertions(+), 3 deletions(-)fs/xfs/xfs_stats.c +1
-1@@ -51,7 +51,7 @@ int xfs_stats_format(struct xfsstats __percpu *stats, char *buf) { "rmapbt", xfsstats_offset(xs_refcbt_2) }, { "refcntbt", xfsstats_offset(xs_qm_dqreclaims)},/* we print both series of quota information together */ - { "qm", xfsstats_offset(xs_xstrat_bytes)}, + { "qm", xfsstats_offset(xs_end_of_32bit_counts)}, };/* Loop over all stats groups */ fs/xfs/xfs_stats.h +13
-2@@ -133,6 +133,17 @@ struct __xfsstats {uint32_t xs_qm_dqwants;uint32_t xs_qm_dquot;uint32_t xs_qm_dquot_unused; +uint32_t xs_qm_zero_until_next_stat_is_added; + +/* +* Define the end of 32 bit counters as a 32 bit variable so that we don't +* end up exposing an implicit structure padding hole due to the next counters +* being 64bit values. If the number of coutners is odd, this fills the hole. If +* the number of coutners is even the hole is after this variable and the stats +* line will terminate printing at this offset and not print the hole. +*/ +uint32_t xs_end_of_32bit_counts; +/* Extra precision counters */ uint64_t xs_xstrat_bytes;uint64_t xs_write_bytes;@@ -143,8 +154,8 @@ struct __xfsstats {struct xfsstats {union { -struct __xfsstats s; -uint32_t a[xfsstats_offset (xs_qm_dquot)]; +struct __xfsstats s; +uint32_t a[xfsstats_offset (xs_end_of_32bit_counts)]; }; };Signature · 1 line
2.28.0
Re: [PATCH 1/2] xfs: stats expose padding value at end of qm line
In reply to Dave ChinnerQuoted 34 lines · Dave Chinner
From: Dave Chinner <[email protected]>
There are 8 quota stats exposed, but:
$ grep qm /proc/fs/xfs/stat qm 0 0 0 1889 308893 0 0 0 0 $There are 9 values exposed. Code inspection reveals that the struct xfsstats has a hole in the structure where the values change from 32 bit counters to 64 bit counters. pahole output:
....
uint32_t xs_qm_dquot; /* 748 4 */ uint32_t xs_qm_dquot_unused; /* 752 4 *//* XXX 4 bytes hole, try to pack */
uint64_txs_xstrat_bytes; /* 760 8 */
....Fix this by defining an "end of 32 bit variables" variable that we then use to define the end of the quota line. This will then ensure that we print the correct number of values regardless of structure layout.
However, ABI requirements for userspace parsers mean we cannot remove the output that results from this hole, so we also need to explicitly define this unused value until such time that we actually add a new stat that makes the output meaningful.
And now we have a defined end of 32bit variables, update the stats union to be sized to match all the 32 bit variables correctly.
Quoted 8 lines
Output with this patch:
$ grep qm /proc/fs/xfs/stat qm 0 0 0 326 1802 0 6 3 0 $Reported-by Nathan Scott <[email protected]>Signed-off-by Dave Chinner <[email protected]>
This makes sense, and fixes a real bug, so seems like it could get merged:
Now, I could bikeshed by suggesting that we avoid holes by doing something like:
static const struct xstats_entry {
char *desc;
int last;
} xstats[] = {
{ "extent_alloc", xfsstats_last(xs_freeb) },
{ "abt", xfsstats_last(xs_abt_insrec) },...
#define xfsstats_last(f) ((offsetof(struct __xfsstats, f)+sizeof(f))/sizeof(uint32_t))
etc, so that we point to the last group item, instead of pointing to the next group's first item, possibly exposing a hole in between.
but maybe that's just rearranging deck chairs, and I don't have a very strong opinion on this.
-Eric
Quoted 52 lines
--- fs/xfs/xfs_stats.c | 2 +- fs/xfs/xfs_stats.h | 15 +++++++++++++-- 2 files changed, 14 insertions(+), 3 deletions(-)fs/xfs/xfs_stats.c +1
-1@@ -51,7 +51,7 @@ int xfs_stats_format(struct xfsstats __percpu *stats, char *buf) { "rmapbt", xfsstats_offset(xs_refcbt_2) }, { "refcntbt", xfsstats_offset(xs_qm_dqreclaims)},/* we print both series of quota information together */ - { "qm", xfsstats_offset(xs_xstrat_bytes)}, + { "qm", xfsstats_offset(xs_end_of_32bit_counts)}, };/* Loop over all stats groups */ fs/xfs/xfs_stats.h +13
-2@@ -133,6 +133,17 @@ struct __xfsstats {uint32_t xs_qm_dqwants;uint32_t xs_qm_dquot;uint32_t xs_qm_dquot_unused; +uint32_t xs_qm_zero_until_next_stat_is_added; + +/* +* Define the end of 32 bit counters as a 32 bit variable so that we don't +* end up exposing an implicit structure padding hole due to the next counters +* being 64bit values. If the number of coutners is odd, this fills the hole. If +* the number of coutners is even the hole is after this variable and the stats +* line will terminate printing at this offset and not print the hole. +*/ +uint32_t xs_end_of_32bit_counts; +/* Extra precision counters */ uint64_t xs_xstrat_bytes;uint64_t xs_write_bytes;@@ -143,8 +154,8 @@ struct __xfsstats {struct xfsstats {union { -struct __xfsstats s; -uint32_t a[xfsstats_offset (xs_qm_dquot)]; +struct __xfsstats s; +uint32_t a[xfsstats_offset (xs_end_of_32bit_counts)]; }; };
PATCH 2/2 xfs: fix finobt btree block recovery ordering
In reply to Dave ChinnerFrom: Dave Chinner <[email protected]>
Nathan popped up on #xfs and pointed out that we fail to handle finobt btree blocks in xlog_recover_get_buf_lsn(). This means they always fall through the entire magic number matching code to "recover immediately". Whilst most of the time this is the correct behaviour, occasionally it will be incorrect and could potentially overwrite more recent metadata because we don't check the LSN in the on disk metadata at all.
This bug has been present since the finobt was first introduced, and is a potential cause of the occasional xfs_iget_check_free_state() failures we see that indicate that the inode btree state does not match the on disk inode state.
--- fs/xfs/xfs_buf_item_recover.c | 2 ++ 1 file changed, 2 insertions(+)
fs/xfs/xfs_buf_item_recover.c +2 -0
@@ -719,6 +719,8 @@ xlog_recover_get_buf_lsn(case XFS_ABTC_MAGIC :case XFS_RMAP_CRC_MAGIC :case XFS_REFC_CRC_MAGIC : +case XFS_FIBT_CRC_MAGIC : +case XFS_FIBT_MAGIC :case XFS_IBT_CRC_MAGIC :case XFS_IBT_MAGIC : {struct xfs_btree_block *btb = blk;
Signature · 1 line
2.28.0
Re: [PATCH 2/2] xfs: fix finobt btree block recovery ordering
Quoted 10 lines · Dave Chinner
From: Dave Chinner <[email protected]>
Nathan popped up on #xfs and pointed out that we fail to handle finobt btree blocks in
xlog_recover_get_buf_lsn(). This means they always fall through the entire magic number matching code to "recover immediately". Whilst most of the time this is the correct behaviour, occasionally it will be incorrect and could potentially overwrite more recent metadata because we don't check the LSN in the on disk metadata at all.
Quoted 8 lines
This bug has been present since the finobt was first introduced, and is a potential cause of the occasional
xfs_iget_check_free_state()failures we see that indicate that the inode btree state does not match the on disk inode state.Fixes aafc3c246529 ("xfs: support the XFS_BTNUM_FINOBT free inode btree type")Reported-by Nathan Scott <[email protected]>Signed-off-by Dave Chinner <[email protected]>
Aha, I saw that once...
Hmmm, zooming out a bit, what kinds of buffers get logged that don't have magics? Realtime bitmap and summary? Can anyone else think of something? ;)
--D
Quoted 20 lines
--- fs/xfs/xfs_buf_item_recover.c | 2 ++ 1 file changed, 2 insertions(+)fs/xfs/xfs_buf_item_recover.c +2
-0@@ -719,6 +719,8 @@ xlog_recover_get_buf_lsn(case XFS_ABTC_MAGIC :case XFS_RMAP_CRC_MAGIC :case XFS_REFC_CRC_MAGIC : +case XFS_FIBT_CRC_MAGIC : +case XFS_FIBT_MAGIC :case XFS_IBT_CRC_MAGIC :case XFS_IBT_MAGIC : {struct xfs_btree_block *btb = blk;Signature · 1 line
2.28.0
Re: [PATCH 2/2] xfs: fix finobt btree block recovery ordering
In reply to Dave ChinnerQuoted 15 lines · Dave Chinner
From: Dave Chinner <[email protected]>
Nathan popped up on #xfs and pointed out that we fail to handle finobt btree blocks in
xlog_recover_get_buf_lsn(). This means they always fall through the entire magic number matching code to "recover immediately". Whilst most of the time this is the correct behaviour, occasionally it will be incorrect and could potentially overwrite more recent metadata because we don't check the LSN in the on disk metadata at all.This bug has been present since the finobt was first introduced, and is a potential cause of the occasional
xfs_iget_check_free_state()failures we see that indicate that the inode btree state does not match the on disk inode state.
Quoted 4 lines
Fixes aafc3c246529 ("xfs: support the XFS_BTNUM_FINOBT free inode btree type")Reported-by Nathan Scott <[email protected]>Signed-off-by Dave Chinner <[email protected]>---
Quoted 19 lines
fs/xfs/xfs_buf_item_recover.c | 2 ++ 1 file changed, 2 insertions(+)fs/xfs/xfs_buf_item_recover.c +2
-0@@ -719,6 +719,8 @@ xlog_recover_get_buf_lsn(case XFS_ABTC_MAGIC :case XFS_RMAP_CRC_MAGIC :case XFS_REFC_CRC_MAGIC : +case XFS_FIBT_CRC_MAGIC : +case XFS_FIBT_MAGIC :case XFS_IBT_CRC_MAGIC :case XFS_IBT_MAGIC : {struct xfs_btree_block *btb = blk;Signature · 1 line
2.28.0