xfs: online fsck patches for 6.10
Subsystems (3)
PATCH v30 1/1 xfs: online fsck patches for 6.10
Hi everyone,
Now that 6.9-rc1 is out, here's v30 of the remaining patches in part one of online repair. Of the 68 patches I'm sending, these are the only ones that are not yet reviewed:
Patchset 1:
[PATCH 1/1] xfs: fix potential AGI <-> ILOCK ABBA deadlock in
Patchset 3:
[PATCH 5/7] xfs: hoist multi-fsb allocation unit detection to a
Patchset 4:
[PATCH 02/15] xfs: introduce new file range exchange ioctl [PATCH 14/15] xfs: introduce new file range commit ioctls
Patchset 5:
[PATCH 1/4] xfs: hide private inodes from bulkstat and handle
Patchset 7:
[PATCH 03/10] xfs: reduce indenting in xfs_attr_node_list
Patchset 8:
[PATCH 7/7] xfs: create an xattr iteration function for scrub
Patchset 10:
[PATCH 5/5] xfs: ask the dentry cache if it knows the parent of a
Patchset 12:
[PATCH 1/1] xfs: online repair of symbolic links
Patchset 15:
[PATCH 1/1] xfs: fix severe performance problems when fstrimming a
--D
PATCH 1/15 xfs: bug fixes for 6.9
Hi all,
Bug fixes for XFS for 6.9.
If you're going to start using this code, I strongly recommend pulling from my git trees, which are linked below.
This has been running on the djcloud for months with no problems. Enjoy! Comments and questions are, as always, welcome.
--D
kernel git tree:
https://git.kernel.org/cgit/linux/kernel/git/djwong/xfs-linux.git/log/?h=xfs-6.9-fixes
---
Commits in this patchset:
* xfs: fix potential AGI <-> ILOCK ABBA deadlock in xrep_dinode_findmode_walk_directory
--- fs/xfs/scrub/inode_repair.c | 48 ++++++++++++++++++++++++++++++++++++++++++- 1 file changed, 47 insertions(+), 1 deletion(-)
PATCH 1/1 xfs: fix potential AGI <-> ILOCK ABBA deadlock in xrep_dinode_findmode_walk_directory
From: Darrick J. Wong <[email protected]>
xfs/399 found the following deadlock when fuzzing core.mode = ones:
/proc/20506/task/20558/stack :
[<0>] xfs_ilock+0xa0/0x240 [xfs] [<0>] xfs_ilock_data_map_shared+0x1b/0x20 [xfs] [<0>] xrep_dinode_findmode_walk_directory+0x69/0xe0 [xfs] [<0>] xrep_dinode_find_mode+0x103/0x2a0 [xfs] [<0>] xrep_dinode_mode+0x7c/0x120 [xfs] [<0>] xrep_dinode_core+0xed/0x2b0 [xfs] [<0>] xrep_dinode_problems+0x10/0x80 [xfs] [<0>] xrep_inode+0x6c/0xc0 [xfs] [<0>] xrep_attempt+0x64/0x1d0 [xfs] [<0>] xfs_scrub_metadata+0x365/0x840 [xfs] [<0>] xfs_scrubv_metadata+0x282/0x430 [xfs] [<0>] xfs_ioc_scrubv_metadata+0x149/0x1a0 [xfs] [<0>] xfs_file_ioctl+0xc68/0x1780 [xfs] /proc/20506/task/20559/stack : [<0>] xfs_buf_lock+0x3b/0x110 [xfs] [<0>] xfs_buf_find_lock+0x66/0x1c0 [xfs] [<0>] xfs_buf_get_map+0x208/0xc00 [xfs] [<0>] xfs_buf_read_map+0x5d/0x2c0 [xfs] [<0>] xfs_trans_read_buf_map+0x1b0/0x4c0 [xfs] [<0>] xfs_read_agi+0xbd/0x190 [xfs] [<0>] xfs_ialloc_read_agi+0x47/0x160 [xfs] [<0>] xfs_imap_lookup+0x69/0x1f0 [xfs] [<0>] xfs_imap+0x1fc/0x3d0 [xfs] [<0>] xfs_iget+0x357/0xd50 [xfs] [<0>] xchk_dir_actor+0x16e/0x330 [xfs] [<0>] xchk_dir_walk_block+0x164/0x1e0 [xfs] [<0>] xchk_dir_walk+0x13a/0x190 [xfs] [<0>] xchk_directory+0x1a2/0x2b0 [xfs] [<0>] xfs_scrub_metadata+0x2f4/0x840 [xfs] [<0>] xfs_scrubv_metadata+0x282/0x430 [xfs] [<0>] xfs_ioc_scrubv_metadata+0x149/0x1a0 [xfs] [<0>] xfs_file_ioctl+0xc68/0x1780 [xfs]
Thread 20558 holds an AGI buffer and is trying to grab the ILOCK of the root directory. Thread 20559 holds the root directory ILOCK and is trying to grab the AGI of an inode that is one of the root directory's children. The AGI held by 20558 is the same buffer that 20559 is trying to acquire. In other words, this is an ABBA deadlock.
In general, the lock order is ILOCK and then AGI -- rename does this while preparing for an operation involving whiteouts or renaming files out of existence; and unlink does this when moving an inode to the unlinked list. The only place where we do it in the opposite order is on the child during an icreate, but at that point the child is marked INEW and is not visible to other threads.
Work around this deadlock by replacing the blocking ilock attempt with a nonblocking loop that aborts after 30 seconds. Relax for a jiffy after a failed lock attempt.
--- fs/xfs/scrub/inode_repair.c | 48 ++++++++++++++++++++++++++++++++++++++++++- 1 file changed, 47 insertions(+), 1 deletion(-)
fs/xfs/scrub/inode_repair.c +47 -1
@@ -282,6 +282,50 @@ xrep_dinode_findmode_dirent(return 0 ; } +/* Try to lock a directory, or wait a jiffy. */ +static inline int +xrep_dinode_ilock_nowait ( +struct xfs_inode *dp, +unsigned int lock_mode) +{ +if (xfs_ilock_nowait (dp, lock_mode)) +return true; + +schedule_timeout_killable (1 ); +return false; +} + +/* +* Try to lock a directory to look for ftype hints. Since we already hold the +* AGI buffer, we cannot block waiting for the ILOCK because rename can take +* the ILOCK and then try to lock AGIs. +*/ +STATIC int +xrep_dinode_trylock_directory ( +struct xrep_inode *ri, +struct xfs_inode *dp, +unsigned int *lock_modep) +{ +unsigned long deadline = jiffies +msecs_to_jiffies (30000 ); +unsigned int lock_mode; +int error =0 ; + +do { +if (xchk_should_terminate (ri->sc, &error)) +return error; +if (time_is_before_jiffies (deadline)) +return -EBUSY ; + +if (xfs_need_iread_extents (&dp->i_df)) + lock_mode =XFS_ILOCK_EXCL ; +else + lock_mode =XFS_ILOCK_SHARED ; + }while (!xrep_dinode_ilock_nowait (dp, lock_mode)); + + *lock_modep = lock_mode; +return 0 ; +} +/* * If this is a directory, walk the dirents looking for any that point to the * scrub target inode.
@@ -299,7 +343,9 @@ xrep_dinode_findmode_walk_directory(* Scan the directory to see if there it contains an entry pointing to * the directory that we are repairing. */ - lock_mode =xfs_ilock_data_map_shared (dp); + error =xrep_dinode_trylock_directory (ri, dp, &lock_mode); +if (error) +return error;/* * If this directory is known to be sick, we cannot scan it reliably
Re: [PATCH 1/1] xfs: fix potential AGI <-> ILOCK ABBA deadlock in xrep_dinode_findmode_walk_directory
Quoted 13 lines
Thread 20558 holds an AGI buffer and is trying to grab the ILOCK of the root directory. Thread 20559 holds the root directory ILOCK and is trying to grab the AGI of an inode that is one of the root directory's children. The AGI held by 20558 is the same buffer that 20559 is trying to acquire. In other words, this is an ABBA deadlock.
In general, the lock order is ILOCK and then AGI -- rename does this while preparing for an operation involving whiteouts or renaming files out of existence; and unlink does this when moving an inode to the unlinked list. The only place where we do it in the opposite order is on the child during an icreate, but at that point the child is marked INEW and is not visible to other threads.
Quoted 3 lines
Work around this deadlock by replacing the blocking ilock attempt with a nonblocking loop that aborts after 30 seconds. Relax for a jiffy after a failed lock attempt.
Trylock and wait schemes are sketchy as hell. Why do we need to hold the AGI lock when walking the directory?
Re: [PATCH 1/1] xfs: fix potential AGI <-> ILOCK ABBA deadlock in xrep_dinode_findmode_walk_directory
Quoted 13 lines · Christoph Hellwig
Quoted 13 lines
Thread 20558 holds an AGI buffer and is trying to grab the ILOCK of the root directory. Thread 20559 holds the root directory ILOCK and is trying to grab the AGI of an inode that is one of the root directory's children. The AGI held by 20558 is the same buffer that 20559 is trying to acquire. In other words, this is an ABBA deadlock.
In general, the lock order is ILOCK and then AGI -- rename does this while preparing for an operation involving whiteouts or renaming files out of existence; and unlink does this when moving an inode to the unlinked list. The only place where we do it in the opposite order is on the child during an icreate, but at that point the child is marked INEW and is not visible to other threads.
Quoted 6 lines
Quoted 3 lines
Work around this deadlock by replacing the blocking ilock attempt with a nonblocking loop that aborts after 30 seconds. Relax for a jiffy after a failed lock attempt.
Trylock and wait schemes are sketchy as hell. Why do we need to hold the AGI lock when walking the directory?
The short answer is that we're holding the AGI to quiesce inode cache activity in the AG containing the inode that xrep_dinode* is trying to fix. The goal of xrep_dinode* functions is to get the ondisk inode into good enough shape that we can iget the inode and continue repairs with the cached inode and all the functionality that you get with a cached inode.
Longer answer:
When the xchk_setup_inode function fails to iget an inode, it grabs the AGI buffer, computes the xfs_imap of the affected inode, and hands things over to repair. At this point, we've prevented any other threads from trying to allocate or free an inode in that AG.
Repair uses the xfs_imap to read the inode cluster buffer, so now it holds the top and the bottom of the inode structure. One of two things can happen:
1) If xrep_dinode_mode decides it doesn't need to do anything, we continue correcting problems in the rest of the xfs_dinode, commit the cluster buffer, and retry the untrusted iget. Repair still holds the AGI and the icluster buffer, so we know that nobody else could have started a walk. Therefore, we cannot deadlock with another thread calling iget.
2) If xrep_dinode_mode does decide to scan the filesystem to try to recover i_mode from ftypes, now we need to do untrusted igets of every directory in the filesystem. However, we still need to hold the AGI and the cluster buffer.
Oh. The xchk_iscan_iter in xrep_dinode_find_mode does a blocking acquisition of every AGI in the filesystem. If the busted inode is in a high AGI, we'll end up taking AGIs in the wrong order. Ok, I need to fix that too.
--D
PATCH 1/1 xfs: bug fixes for 6.9
In reply to Darrick J. WongHi all,
Bug fixes for XFS for 6.9.
If you're going to start using this code, I strongly recommend pulling from my git trees, which are linked below.
This has been running on the djcloud for months with no problems. Enjoy! Comments and questions are, as always, welcome.
--D
kernel git tree:
https://git.kernel.org/cgit/linux/kernel/git/djwong/xfs-linux.git/log/?h=xfs-6.9-fixes
---
Commits in this patchset:
* xfs: pass xfs_buf lookup flags to xfs_*read_agi
* xfs: fix an AGI lock acquisition ordering problem in xrep_dinode_findmode
* xfs: fix potential AGI <-> ILOCK ABBA deadlock in xrep_dinode_findmode_walk_directory
--- fs/xfs/libxfs/xfs_ag.c | 8 +++--- fs/xfs/libxfs/xfs_ialloc.c | 16 ++++++++---- fs/xfs/libxfs/xfs_ialloc.h | 5 ++-- fs/xfs/libxfs/xfs_ialloc_btree.c | 4 ++- fs/xfs/scrub/common.c | 4 ++- fs/xfs/scrub/fscounters.c | 2 +- fs/xfs/scrub/inode_repair.c | 50 +++++++++++++++++++++++++++++++++++++- fs/xfs/scrub/iscan.c | 36 +++++++++++++++++++++++++++ fs/xfs/scrub/iscan.h | 15 +++++++++++ fs/xfs/scrub/repair.c | 6 ++--- fs/xfs/scrub/trace.h | 10 ++++++-- fs/xfs/xfs_inode.c | 8 +++--- fs/xfs/xfs_iwalk.c | 4 ++- fs/xfs/xfs_log_recover.c | 4 ++- 14 files changed, 140 insertions(+), 32 deletions(-)
PATCH 1/3 xfs: pass xfs_buf lookup flags to xfs_*read_agi
From: Darrick J. Wong <[email protected]>
Allow callers to pass buffer lookup flags to xfs_read_agi and xfs_ialloc_read_agi. This will be used in the next patch to fix a deadlock in the online fsck inode scanner.
--- fs/xfs/libxfs/xfs_ag.c | 8 ++++---- fs/xfs/libxfs/xfs_ialloc.c | 16 ++++++++++------ fs/xfs/libxfs/xfs_ialloc.h | 5 +++-- fs/xfs/libxfs/xfs_ialloc_btree.c | 4 ++-- fs/xfs/scrub/common.c | 4 ++-- fs/xfs/scrub/fscounters.c | 2 +- fs/xfs/scrub/iscan.c | 2 +- fs/xfs/scrub/repair.c | 6 +++--- fs/xfs/xfs_inode.c | 8 ++++---- fs/xfs/xfs_iwalk.c | 4 ++-- fs/xfs/xfs_log_recover.c | 4 ++-- 11 files changed, 34 insertions(+), 29 deletions(-)
fs/xfs/libxfs/xfs_ag.c +4 -4
@@ -194,7 +194,7 @@ xfs_initialize_perag_data( pag =xfs_perag_get (mp, index); error =xfs_alloc_read_agf (pag,NULL ,0 ,NULL );if (!error) - error =xfs_ialloc_read_agi (pag,NULL ,NULL ); + error =xfs_ialloc_read_agi (pag,NULL ,0 ,NULL );if (error) {xfs_perag_put (pag);return error;
@@ -931,7 +931,7 @@ xfs_ag_shrink_space(int error, err2;ASSERT (pag->pag_agno == mp->m_sb.sb_agcount -1 ); - error =xfs_ialloc_read_agi (pag, *tpp, &agibp); + error =xfs_ialloc_read_agi (pag, *tpp,0 , &agibp);if (error)return error;
@@ -1062,7 +1062,7 @@ xfs_ag_extend_space(ASSERT (pag->pag_agno == pag->pag_mount->m_sb.sb_agcount -1 ); - error =xfs_ialloc_read_agi (pag, tp, &bp); + error =xfs_ialloc_read_agi (pag, tp,0 , &bp);if (error)return error;
@@ -1119,7 +1119,7 @@ xfs_ag_get_geometry(int error;/* Lock the AG headers. */ - error =xfs_ialloc_read_agi (pag,NULL , &agi_bp); + error =xfs_ialloc_read_agi (pag,NULL ,0 , &agi_bp);if (error)return error; error =xfs_alloc_read_agf (pag,NULL ,0 , &agf_bp);
fs/xfs/libxfs/xfs_ialloc.c +10 -6
@@ -1699,7 +1699,7 @@ xfs_dialloc_good_ag(return false;if (!xfs_perag_initialised_agi (pag)) { - error =xfs_ialloc_read_agi (pag, tp,NULL ); + error =xfs_ialloc_read_agi (pag, tp,0 ,NULL );if (error)return false; }
@@ -1768,7 +1768,7 @@ xfs_dialloc_try_ag(* Then read in the AGI buffer and recheck with the AGI buffer * lock held. */ - error =xfs_ialloc_read_agi (pag, *tpp, &agbp); + error =xfs_ialloc_read_agi (pag, *tpp,0 , &agbp);if (error)return error;
@@ -2286,7 +2286,7 @@ xfs_difree(/* * Get the allocation group header. */ - error =xfs_ialloc_read_agi (pag, tp, &agbp); + error =xfs_ialloc_read_agi (pag, tp,0 , &agbp);if (error) {xfs_warn (mp,"%s: xfs_ialloc_read_agi() returned error %d." , __func__, error);
@@ -2332,7 +2332,7 @@ xfs_imap_lookup(int error;int i; - error =xfs_ialloc_read_agi (pag, tp, &agbp); + error =xfs_ialloc_read_agi (pag, tp,0 , &agbp);if (error) { xfs_alert(mp, "%s: xfs_ialloc_read_agi() returned error %d, agno %d",
@@ -2675,6 +2675,7 @@ intxfs_read_agi ( struct xfs_perag *pag, struct xfs_trans *tp, + xfs_buf_flags_t flags, struct xfs_buf **agibpp) { struct xfs_mount *mp = pag->pag_mount;
@@ -2684,7 +2685,7 @@ xfs_read_agi( error =xfs_trans_read_buf (mp, tp, mp->m_ddev_targp,XFS_AG_DADDR (mp, pag->pag_agno,XFS_AGI_DADDR (mp)), -XFS_FSS_TO_BB (mp,1 ),0 , agibpp, &xfs_agi_buf_ops); +XFS_FSS_TO_BB (mp,1 ), flags, agibpp, &xfs_agi_buf_ops);if (xfs_metadata_is_sick (error))xfs_ag_mark_sick (pag,XFS_SICK_AG_AGI );if (error)
@@ -2704,6 +2705,7 @@ intxfs_ialloc_read_agi ( struct xfs_perag *pag, struct xfs_trans *tp, + int flags, struct xfs_buf **agibpp) { struct xfs_buf *agibp;
@@ -2712,7 +2714,9 @@ xfs_ialloc_read_agi(trace_xfs_ialloc_read_agi (pag->pag_mount, pag->pag_agno); - error =xfs_read_agi (pag, tp, &agibp); + error =xfs_read_agi (pag, tp, + (flags &XFS_IALLOC_FLAG_TRYLOCK ) ?XBF_TRYLOCK :0 , + &agibp);if (error)return error;
fs/xfs/libxfs/xfs_ialloc.h +3 -2
@@ -63,10 +63,11 @@ xfs_ialloc_log_agi(struct xfs_buf *bp,/* allocation group header buffer */ uint32_t fields); /* bitmask of fields to log */ -int xfs_read_agi (struct xfs_perag *pag,struct xfs_trans *tp, +int xfs_read_agi (struct xfs_perag *pag,struct xfs_trans *tp,xfs_buf_flags_t flags,struct xfs_buf **agibpp);int xfs_ialloc_read_agi (struct xfs_perag *pag,struct xfs_trans *tp, -struct xfs_buf **agibpp); +int flags,struct xfs_buf **agibpp); +#define XFS_IALLOC_FLAG_TRYLOCK (1U << 0)/* use trylock for buffer locking */ /* * Lookup a record by ino in the btree given by cur.
fs/xfs/libxfs/xfs_ialloc_btree.c +2 -2
@@ -745,7 +745,7 @@ xfs_finobt_count_blocks(struct xfs_btree_cur *cur;int error; - error =xfs_ialloc_read_agi (pag, tp, &agbp); + error =xfs_ialloc_read_agi (pag, tp,0 , &agbp);if (error)return error;
@@ -768,7 +768,7 @@ xfs_finobt_read_blocks(struct xfs_agi *agi;int error; - error =xfs_ialloc_read_agi (pag, tp, &agbp); + error =xfs_ialloc_read_agi (pag, tp,0 , &agbp);if (error)return error;
fs/xfs/scrub/common.c +2 -2
@@ -445,7 +445,7 @@ xchk_perag_read_headers( {int error; - error =xfs_ialloc_read_agi (sa->pag, sc->tp, &sa->agi_bp); + error =xfs_ialloc_read_agi (sa->pag, sc->tp,0 , &sa->agi_bp);if (error &&want_ag_read_header_failure (sc,XFS_SCRUB_TYPE_AGI ))return error;
@@ -827,7 +827,7 @@ xchk_iget_agi(* in the iget cache miss path. */ pag =xfs_perag_get (mp,XFS_INO_TO_AGNO (mp, inum)); - error =xfs_ialloc_read_agi (pag, tp, agi_bpp); + error =xfs_ialloc_read_agi (pag, tp,0 , agi_bpp);xfs_perag_put (pag);if (error)return error;
fs/xfs/scrub/fscounters.c +1 -1
@@ -85,7 +85,7 @@ xchk_fscount_warmup(continue ;/* Lock both AG headers. */ - error =xfs_ialloc_read_agi (pag, sc->tp, &agi_bp); + error =xfs_ialloc_read_agi (pag, sc->tp,0 , &agi_bp);if (error)break ; error =xfs_alloc_read_agf (pag, sc->tp,0 , &agf_bp);
fs/xfs/scrub/iscan.c +1 -1
@@ -281,7 +281,7 @@ xchk_iscan_advance(if (!pag)return -ECANCELED ; - ret =xfs_ialloc_read_agi (pag, sc->tp, &agi_bp); + ret =xfs_ialloc_read_agi (pag, sc->tp,0 , &agi_bp);if (ret) goto out_pag;
fs/xfs/scrub/repair.c +3 -3
@@ -290,7 +290,7 @@ xrep_calc_ag_resblks( icount = pag->pagi_count; }else {/* Try to get the actual counters from disk. */ - error =xfs_ialloc_read_agi (pag,NULL , &bp); + error =xfs_ialloc_read_agi (pag,NULL ,0 , &bp);if (!error) { icount = pag->pagi_count;xfs_buf_relse (bp);
@@ -908,7 +908,7 @@ xrep_reinit_pagi(ASSERT (xfs_perag_initialised_agi (pag));clear_bit (XFS_AGSTATE_AGI_INIT , &pag->pag_opstate); - error =xfs_ialloc_read_agi (pag, sc->tp, &bp); + error =xfs_ialloc_read_agi (pag, sc->tp,0 , &bp);if (error)return error;
@@ -934,7 +934,7 @@ xrep_ag_init(ASSERT (!sa->pag); - error =xfs_ialloc_read_agi (pag, sc->tp, &sa->agi_bp); + error =xfs_ialloc_read_agi (pag, sc->tp,0 , &sa->agi_bp);if (error)return error;
fs/xfs/xfs_inode.c +4 -4
@@ -2156,7 +2156,7 @@ xfs_iunlink( pag =xfs_perag_get (mp,XFS_INO_TO_AGNO (mp, ip->i_ino));/* Get the agi buffer first. It ensures lock ordering on the list. */ - error =xfs_read_agi (pag, tp, &agibp); + error =xfs_read_agi (pag, tp,0 , &agibp);if (error) goto out;
@@ -2253,7 +2253,7 @@ xfs_iunlink_remove(trace_xfs_iunlink_remove (ip);/* Get the agi buffer first. It ensures lock ordering on the list. */ - error =xfs_read_agi (pag, tp, &agibp); + error =xfs_read_agi (pag, tp,0 , &agibp);if (error)return error;
@@ -3131,7 +3131,7 @@ xfs_rename( pag =xfs_perag_get (mp,XFS_INO_TO_AGNO (mp, inodes[i]->i_ino)); - error =xfs_read_agi (pag, tp, &bp); + error =xfs_read_agi (pag, tp,0 , &bp);xfs_perag_put (pag);if (error) goto out_trans_cancel;
@@ -3803,7 +3803,7 @@ xfs_inode_reload_unlinked_bucket(/* Grab the first inode in the list */ pag =xfs_perag_get (mp, agno); - error =xfs_ialloc_read_agi (pag, tp, &agibp); + error =xfs_ialloc_read_agi (pag, tp,0 , &agibp);xfs_perag_put (pag);if (error)return error;
fs/xfs/xfs_iwalk.c +2 -2
@@ -268,7 +268,7 @@ xfs_iwalk_ag_start(/* Set up a fresh cursor and empty the inobt cache. */ iwag->nr_recs =0 ; - error =xfs_ialloc_read_agi (pag, tp, agi_bpp); + error =xfs_ialloc_read_agi (pag, tp,0 , agi_bpp);if (error)return error; *curpp =xfs_inobt_init_cursor (pag, tp, *agi_bpp);
@@ -386,7 +386,7 @@ xfs_iwalk_run_callbacks( }/* ...and recreate the cursor just past where we left off. */ - error =xfs_ialloc_read_agi (iwag->pag, iwag->tp, agi_bpp); + error =xfs_ialloc_read_agi (iwag->pag, iwag->tp,0 , agi_bpp);if (error)return error; *curpp =xfs_inobt_init_cursor (iwag->pag, iwag->tp, *agi_bpp);
fs/xfs/xfs_log_recover.c +2 -2
@@ -2656,7 +2656,7 @@ xlog_recover_clear_agi_bucket(if (error) goto out_error; - error =xfs_read_agi (pag, tp, &agibp); + error =xfs_read_agi (pag, tp,0 , &agibp);if (error) goto out_abort;
@@ -2772,7 +2772,7 @@ xlog_recover_iunlink_ag(int bucket;int error; - error =xfs_read_agi (pag,NULL , &agibp); + error =xfs_read_agi (pag,NULL ,0 , &agibp);if (error) {/* * AGI is b0rked. Don't process it.
Re: [PATCH 1/3] xfs: pass xfs_buf lookup flags to xfs_*read_agi
Looks good:
PATCH 2/3 xfs: fix an AGI lock acquisition ordering problem in xrep_dinode_findmode
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
While reviewing the next patch which fixes an ABBA deadlock between the AGI and a directory ILOCK, someone asked a question about why we're holding the AGI in the first place. The reason for that is to quiesce the inode structures for that AG while we do a repair.
I then realized that the xrep_dinode_findmode invokes xchk_iscan_iter, which walks the inobts (and hence the AGIs) to find all the inodes. This itself is also an ABBA vector, since the damaged inode could be in AG 5, which we hold while we scan AG 0 for directories. 5 -> 0 is not allowed.
To address this, modify the iscan to allow trylock of the AGI buffer using the flags argument to xfs_ialloc_read_agi that the previous patch added.
--- fs/xfs/scrub/inode_repair.c | 1 + fs/xfs/scrub/iscan.c | 36 +++++++++++++++++++++++++++++++++++- fs/xfs/scrub/iscan.h | 15 +++++++++++++++ fs/xfs/scrub/trace.h | 10 ++++++++-- 4 files changed, 59 insertions(+), 3 deletions(-)
fs/xfs/scrub/inode_repair.c +1 -0
@@ -356,6 +356,7 @@ xrep_dinode_find_mode(* so there's a real possibility that _iscan_iter can return EBUSY. */ xchk_iscan_start (sc,5000 ,100 , &ri->ftype_iscan); +xchk_iscan_set_agi_trylock (&ri->ftype_iscan); ri->ftype_iscan.skip_ino = sc->sm->sm_ino; ri->alleged_ftype =XFS_DIR3_FT_UNKNOWN ;while ((error =xchk_iscan_iter (&ri->ftype_iscan, &dp)) ==1 ) {
fs/xfs/scrub/iscan.c +35 -1
@@ -243,6 +243,40 @@ xchk_iscan_finish(mutex_unlock (&iscan->lock); } +/* +* Grab the AGI to advance the inode scan. Returns 0 if *agi_bpp is now set, +* -ECANCELED if the live scan aborted, -EBUSY if the AGI could not be grabbed, +* or the usual negative errno. +*/ +STATIC int +xchk_iscan_read_agi ( +struct xchk_iscan *iscan, +struct xfs_perag *pag, +struct xfs_buf **agi_bpp) +{ +struct xfs_scrub *sc = iscan->sc; +unsigned long relax; +int ret; + +if (!xchk_iscan_agi_trylock (iscan)) +return xfs_ialloc_read_agi (pag, sc->tp,0 , agi_bpp); + + relax =msecs_to_jiffies (iscan->iget_retry_delay); +do { + ret =xfs_ialloc_read_agi (pag, sc->tp,XFS_IALLOC_FLAG_TRYLOCK , + agi_bpp); +if (ret != -EAGAIN ) +return ret; +if (!iscan->iget_timeout || +time_is_before_jiffies (iscan->__iget_deadline)) +return -EBUSY ; + +trace_xchk_iscan_agi_retry_wait (iscan); + }while (!schedule_timeout_killable (relax) && + !xchk_iscan_aborted (iscan)); +return -ECANCELED ; +} +/* * Advance ino to the next inode that the inobt thinks is allocated, being * careful to jump to the next AG if we've reached the right end of this AG's
@@ -281,7 +315,7 @@ xchk_iscan_advance(if (!pag)return -ECANCELED ; - ret =xfs_ialloc_read_agi (pag, sc->tp,0 , &agi_bp); + ret =xchk_iscan_read_agi (iscan, pag, &agi_bp);if (ret) goto out_pag;
fs/xfs/scrub/iscan.h +15 -0
@@ -59,6 +59,9 @@ struct xchk_iscan {/* Set if the scan has been aborted due to some event in the fs. */ #define XCHK_ISCAN_OPSTATE_ABORTED (1) +/* Use trylock to acquire the AGI */ +#define XCHK_ISCAN_OPSTATE_TRYLOCK_AGI (2) +static inline bool xchk_iscan_aborted (const struct xchk_iscan *iscan) {
@@ -71,6 +74,18 @@ xchk_iscan_abort(struct xchk_iscan *iscan)set_bit (XCHK_ISCAN_OPSTATE_ABORTED , &iscan->__opstate); } +static inline bool +xchk_iscan_agi_trylock (const struct xchk_iscan *iscan) +{ +return test_bit (XCHK_ISCAN_OPSTATE_TRYLOCK_AGI , &iscan->__opstate); +} + +static inline void +xchk_iscan_set_agi_trylock (struct xchk_iscan *iscan) +{ +set_bit (XCHK_ISCAN_OPSTATE_TRYLOCK_AGI , &iscan->__opstate); +} +void xchk_iscan_start (struct xfs_scrub *sc,unsigned int iget_timeout,unsigned int iget_retry_delay,struct xchk_iscan *iscan);void xchk_iscan_teardown (struct xchk_iscan *iscan);
fs/xfs/scrub/trace.h +8 -2
@@ -1300,7 +1300,7 @@ TRACE_EVENT(xchk_iscan_iget_batch, __entry->unavail) ); -TRACE_EVENT(xchk_iscan_iget_retry_wait, +DECLARE_EVENT_CLASS(xchk_iscan_retry_wait_class, TP_PROTO(struct xchk_iscan *iscan), TP_ARGS(iscan), TP_STRUCT__entry(
@@ -1326,7 +1326,13 @@ TRACE_EVENT(xchk_iscan_iget_retry_wait, __entry->remaining, __entry->iget_timeout, __entry->retry_delay) -); +) +#define DEFINE_ISCAN_RETRY_WAIT_EVENT (name) \ +DEFINE_EVENT(xchk_iscan_retry_wait_class, name, \ + TP_PROTO(struct xchk_iscan *iscan), \ + TP_ARGS(iscan)) +DEFINE_ISCAN_RETRY_WAIT_EVENT (xchk_iscan_iget_retry_wait); +DEFINE_ISCAN_RETRY_WAIT_EVENT (xchk_iscan_agi_retry_wait); TRACE_EVENT(xchk_nlinks_collect_dirent, TP_PROTO(struct xfs_mount *mp, struct xfs_inode *dp,
Re: [PATCH 2/3] xfs: fix an AGI lock acquisition ordering problem in xrep_dinode_findmode
Quoted 13 lines · Darrick J. Wong
From: Darrick J. Wong <[email protected]>
While reviewing the next patch which fixes an ABBA deadlock between the AGI and a directory ILOCK, someone asked a question about why we're holding the AGI in the first place. The reason for that is to quiesce the inode structures for that AG while we do a repair.
I then realized that the
xrep_dinode_findmodeinvokesxchk_iscan_iter, which walks the inobts (and hence the AGIs) to find all the inodes. This itself is also an ABBA vector, since the damaged inode could be in AG 5, which we hold while we scan AG 0 for directories. 5 -> 0 is not allowed.
Quoted 3 lines
To address this, modify the iscan to allow trylock of the AGI buffer using the flags argument to
xfs_ialloc_read_agithat the previous patch added.
Well, I guess we need this as a quick fix, but any scheme based on trylock and return is just fundamentally broken.
Same for the next one.
Christoph Hellwig
Reviewed-byRe: [PATCH 2/3] xfs: fix an AGI lock acquisition ordering problem in xrep_dinode_findmode
Quoted 9 lines · Christoph Hellwig
Quoted 4 lines
To address this, modify the iscan to allow trylock of the AGI buffer using the flags argument to
xfs_ialloc_read_agithat the previous patch added.Well, I guess we need this as a quick fix, but any scheme based on trylock and return is just fundamentally broken.
Same for the next one.
And if this just sounded a little frustrated it with, but it should be counted as a grudging:
for this and the next patch.
Re: [PATCH 2/3] xfs: fix an AGI lock acquisition ordering problem in xrep_dinode_findmode
In reply to Darrick J. WongQuoted 58 lines · Darrick J. Wong
From: Darrick J. Wong <[email protected]>
While reviewing the next patch which fixes an ABBA deadlock between the AGI and a directory ILOCK, someone asked a question about why we're holding the AGI in the first place. The reason for that is to quiesce the inode structures for that AG while we do a repair.
I then realized that the
xrep_dinode_findmodeinvokesxchk_iscan_iter, which walks the inobts (and hence the AGIs) to find all the inodes. This itself is also an ABBA vector, since the damaged inode could be in AG 5, which we hold while we scan AG 0 for directories. 5 -> 0 is not allowed.To address this, modify the iscan to allow trylock of the AGI buffer using the flags argument to
xfs_ialloc_read_agithat the previous patch added.Signed-off-by Darrick J. Wong <[email protected]>--- fs/xfs/scrub/inode_repair.c | 1 + fs/xfs/scrub/iscan.c | 36 +++++++++++++++++++++++++++++++++++- fs/xfs/scrub/iscan.h | 15 +++++++++++++++ fs/xfs/scrub/trace.h | 10 ++++++++-- 4 files changed, 59 insertions(+), 3 deletions(-)fs/xfs/scrub/inode_repair.c +1
-0@@ -356,6 +356,7 @@ xrep_dinode_find_mode(* so there's a real possibility that _iscan_iter can return EBUSY. */ xchk_iscan_start (sc,5000 ,100 , &ri->ftype_iscan); +xchk_iscan_set_agi_trylock (&ri->ftype_iscan); ri->ftype_iscan.skip_ino = sc->sm->sm_ino; ri->alleged_ftype =XFS_DIR3_FT_UNKNOWN ;while ((error =xchk_iscan_iter (&ri->ftype_iscan, &dp)) ==1 ) {fs/xfs/scrub/iscan.c +12
-0@@ -243,6 +243,40 @@ xchk_iscan_finish(mutex_unlock (&iscan->lock); } +/* +* Grab the AGI to advance the inode scan. Returns 0 if *agi_bpp is now set, +* -ECANCELED if the live scan aborted, -EBUSY if the AGI could not be grabbed, +* or the usual negative errno. +*/ +STATIC int +xchk_iscan_read_agi ( +struct xchk_iscan *iscan, +struct xfs_perag *pag, +struct xfs_buf **agi_bpp) +{ +struct xfs_scrub *sc = iscan->sc;
fs/xfs/scrub/iscan.c xchk_iscan_finish( · line 267
Quoted 10 lines
fs/xfs/scrub/iscan.c +10
-0+unsigned long relax; +int ret; + +if (!xchk_iscan_agi_trylock (iscan)) +return xfs_ialloc_read_agi (pag, sc->tp,0 , agi_bpp); + + relax =msecs_to_jiffies (iscan->iget_retry_delay); + do { + ret = xfs_ialloc_read_agi(pag, sc->tp, XFS_IALLOC_FLAG_TRYLOCK, + agi_bpp);
Why is this using xfs_ialloc_read_agi() and not xfs_read_agi()? How do we get here without the perag AGI state not already initialised?
i.e. if you just use xfs_read_agi(), all the code that has to plumb flags into xfs_ialloc_read_agi() goes away and this change because a lot less intrusive....
Quoted 39 lines
fs/xfs/scrub/iscan.c +13
-1+if (ret != -EAGAIN ) +return ret; +if (!iscan->iget_timeout || +time_is_before_jiffies (iscan->__iget_deadline)) +return -EBUSY ; + +trace_xchk_iscan_agi_retry_wait (iscan); + }while (!schedule_timeout_killable (relax) && + !xchk_iscan_aborted (iscan)); +return -ECANCELED ; +} +/* * Advance ino to the next inode that the inobt thinks is allocated, being * careful to jump to the next AG if we've reached the right end of this AG's @@ -281,7 +315,7 @@ xchk_iscan_advance(if (!pag)return -ECANCELED ; - ret =xfs_ialloc_read_agi (pag, sc->tp,0 , &agi_bp); + ret =xchk_iscan_read_agi (iscan, pag, &agi_bp);if (ret) goto out_pag;fs/xfs/scrub/iscan.h +3
-0@@ -59,6 +59,9 @@ struct xchk_iscan {/* Set if the scan has been aborted due to some event in the fs. */ #define XCHK_ISCAN_OPSTATE_ABORTED (1) +/* Use trylock to acquire the AGI */ +#define XCHK_ISCAN_OPSTATE_TRYLOCK_AGI (2) +static inline bool xchk_iscan_aborted (const struct xchk_iscan *iscan) {
fs/xfs/scrub/iscan.h xchk_iscan_abort(struct xchk_iscan *iscan) · line 81
Quoted 8 lines
fs/xfs/scrub/iscan.h +5
-0@@ -71,6 +74,18 @@ xchk_iscan_abort(struct xchk_iscan *iscan)set_bit (XCHK_ISCAN_OPSTATE_ABORTED , &iscan->__opstate); } +static inline bool +xchk_iscan_agi_trylock (const struct xchk_iscan *iscan) +{ +return test_bit (XCHK_ISCAN_OPSTATE_TRYLOCK_AGI , &iscan->__opstate); +}
Function does not actually do any locking, but the name implies it is actually doing a trylock operation. Perhaps xchk_iscan_agi_needs_trylock()?
-Dave.
Signature · 2 lines
Dave Chinner [email protected]
Re: [PATCH 2/3] xfs: fix an AGI lock acquisition ordering problem in xrep_dinode_findmode
Quoted 65 lines · Dave Chinner
Quoted 64 lines · Darrick J. Wong
From: Darrick J. Wong <[email protected]>
While reviewing the next patch which fixes an ABBA deadlock between the AGI and a directory ILOCK, someone asked a question about why we're holding the AGI in the first place. The reason for that is to quiesce the inode structures for that AG while we do a repair.
I then realized that the
xrep_dinode_findmodeinvokesxchk_iscan_iter, which walks the inobts (and hence the AGIs) to find all the inodes. This itself is also an ABBA vector, since the damaged inode could be in AG 5, which we hold while we scan AG 0 for directories. 5 -> 0 is not allowed.To address this, modify the iscan to allow trylock of the AGI buffer using the flags argument to
xfs_ialloc_read_agithat the previous patch added.Signed-off-by Darrick J. Wong <[email protected]>--- fs/xfs/scrub/inode_repair.c | 1 + fs/xfs/scrub/iscan.c | 36 +++++++++++++++++++++++++++++++++++- fs/xfs/scrub/iscan.h | 15 +++++++++++++++ fs/xfs/scrub/trace.h | 10 ++++++++-- 4 files changed, 59 insertions(+), 3 deletions(-)fs/xfs/scrub/inode_repair.c +1
-0@@ -356,6 +356,7 @@ xrep_dinode_find_mode(* so there's a real possibility that _iscan_iter can return EBUSY. */ xchk_iscan_start (sc,5000 ,100 , &ri->ftype_iscan); +xchk_iscan_set_agi_trylock (&ri->ftype_iscan); ri->ftype_iscan.skip_ino = sc->sm->sm_ino; ri->alleged_ftype =XFS_DIR3_FT_UNKNOWN ;while ((error =xchk_iscan_iter (&ri->ftype_iscan, &dp)) ==1 ) {fs/xfs/scrub/iscan.c +18
-0@@ -243,6 +243,40 @@ xchk_iscan_finish(mutex_unlock (&iscan->lock); } +/* +* Grab the AGI to advance the inode scan. Returns 0 if *agi_bpp is now set, +* -ECANCELED if the live scan aborted, -EBUSY if the AGI could not be grabbed, +* or the usual negative errno. +*/ +STATIC int +xchk_iscan_read_agi ( +struct xchk_iscan *iscan, +struct xfs_perag *pag, +struct xfs_buf **agi_bpp) +{ +struct xfs_scrub *sc = iscan->sc; +unsigned long relax; +int ret; + +if (!xchk_iscan_agi_trylock (iscan)) +return xfs_ialloc_read_agi (pag, sc->tp,0 , agi_bpp); +
Quoted 8 lines
fs/xfs/scrub/iscan.c xchk_iscan_finish( · line 267
Quoted 4 lines
fs/xfs/scrub/iscan.c +4
-0+ relax =msecs_to_jiffies (iscan->iget_retry_delay); + do { + ret = xfs_ialloc_read_agi(pag, sc->tp, XFS_IALLOC_FLAG_TRYLOCK, + agi_bpp);Why is this using
xfs_ialloc_read_agi()and notxfs_read_agi()? How do we get here without the perag AGI state not already initialised?
!finobt filesystems won't have called xfs_ialloc_read_agi to initialize the incore per-ag reservation during mount. That's a bit of a corner case since there shouldn't be /so/ many filesystems without finobt these days, but it's theoretically possible.
Quoted 46 lines
i.e. if you just use
xfs_read_agi(), all the code that has to plumb flags intoxfs_ialloc_read_agi()goes away and this change because a lot less intrusive....Quoted 42 lines
fs/xfs/scrub/iscan.c +13
-1+if (ret != -EAGAIN ) +return ret; +if (!iscan->iget_timeout || +time_is_before_jiffies (iscan->__iget_deadline)) +return -EBUSY ; + +trace_xchk_iscan_agi_retry_wait (iscan); + }while (!schedule_timeout_killable (relax) && + !xchk_iscan_aborted (iscan)); +return -ECANCELED ; +} +/* * Advance ino to the next inode that the inobt thinks is allocated, being * careful to jump to the next AG if we've reached the right end of this AG's @@ -281,7 +315,7 @@ xchk_iscan_advance(if (!pag)return -ECANCELED ; - ret =xfs_ialloc_read_agi (pag, sc->tp,0 , &agi_bp); + ret =xchk_iscan_read_agi (iscan, pag, &agi_bp);if (ret) goto out_pag;fs/xfs/scrub/iscan.h +3
-0@@ -59,6 +59,9 @@ struct xchk_iscan {/* Set if the scan has been aborted due to some event in the fs. */ #define XCHK_ISCAN_OPSTATE_ABORTED (1) +/* Use trylock to acquire the AGI */ +#define XCHK_ISCAN_OPSTATE_TRYLOCK_AGI (2) +static inline bool xchk_iscan_aborted (const struct xchk_iscan *iscan) {@@ -71,6 +74,18 @@ xchk_iscan_abort(struct xchk_iscan *iscan)set_bit (XCHK_ISCAN_OPSTATE_ABORTED , &iscan->__opstate); }
Quoted 9 lines
fs/xfs/scrub/iscan.h xchk_iscan_abort(struct xchk_iscan *iscan) · line 81
Quoted 5 lines
fs/xfs/scrub/iscan.h +5
-0+static inline bool +xchk_iscan_agi_trylock (const struct xchk_iscan *iscan) +{ +return test_bit (XCHK_ISCAN_OPSTATE_TRYLOCK_AGI , &iscan->__opstate); +}Function does not actually do any locking, but the name implies it is actually doing a trylock operation. Perhaps
xchk_iscan_agi_needs_trylock()?
Ok. I apologize for the rage of the last few days. I need a loooooooong vacation.
--D
Quoted 6 lines
-Dave.
Signature · 2 lines
Dave Chinner [email protected]
PATCH 3/3 xfs: fix potential AGI <-> ILOCK ABBA deadlock in xrep_dinode_findmode_walk_directory
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
xfs/399 found the following deadlock when fuzzing core.mode = ones:
/proc/20506/task/20558/stack :
[<0>] xfs_ilock+0xa0/0x240 [xfs] [<0>] xfs_ilock_data_map_shared+0x1b/0x20 [xfs] [<0>] xrep_dinode_findmode_walk_directory+0x69/0xe0 [xfs] [<0>] xrep_dinode_find_mode+0x103/0x2a0 [xfs] [<0>] xrep_dinode_mode+0x7c/0x120 [xfs] [<0>] xrep_dinode_core+0xed/0x2b0 [xfs] [<0>] xrep_dinode_problems+0x10/0x80 [xfs] [<0>] xrep_inode+0x6c/0xc0 [xfs] [<0>] xrep_attempt+0x64/0x1d0 [xfs] [<0>] xfs_scrub_metadata+0x365/0x840 [xfs] [<0>] xfs_scrubv_metadata+0x282/0x430 [xfs] [<0>] xfs_ioc_scrubv_metadata+0x149/0x1a0 [xfs] [<0>] xfs_file_ioctl+0xc68/0x1780 [xfs] /proc/20506/task/20559/stack : [<0>] xfs_buf_lock+0x3b/0x110 [xfs] [<0>] xfs_buf_find_lock+0x66/0x1c0 [xfs] [<0>] xfs_buf_get_map+0x208/0xc00 [xfs] [<0>] xfs_buf_read_map+0x5d/0x2c0 [xfs] [<0>] xfs_trans_read_buf_map+0x1b0/0x4c0 [xfs] [<0>] xfs_read_agi+0xbd/0x190 [xfs] [<0>] xfs_ialloc_read_agi+0x47/0x160 [xfs] [<0>] xfs_imap_lookup+0x69/0x1f0 [xfs] [<0>] xfs_imap+0x1fc/0x3d0 [xfs] [<0>] xfs_iget+0x357/0xd50 [xfs] [<0>] xchk_dir_actor+0x16e/0x330 [xfs] [<0>] xchk_dir_walk_block+0x164/0x1e0 [xfs] [<0>] xchk_dir_walk+0x13a/0x190 [xfs] [<0>] xchk_directory+0x1a2/0x2b0 [xfs] [<0>] xfs_scrub_metadata+0x2f4/0x840 [xfs] [<0>] xfs_scrubv_metadata+0x282/0x430 [xfs] [<0>] xfs_ioc_scrubv_metadata+0x149/0x1a0 [xfs] [<0>] xfs_file_ioctl+0xc68/0x1780 [xfs]
Thread 20558 holds an AGI buffer and is trying to grab the ILOCK of the root directory. Thread 20559 holds the root directory ILOCK and is trying to grab the AGI of an inode that is one of the root directory's children. The AGI held by 20558 is the same buffer that 20559 is trying to acquire. In other words, this is an ABBA deadlock.
In general, the lock order is ILOCK and then AGI -- rename does this while preparing for an operation involving whiteouts or renaming files out of existence; and unlink does this when moving an inode to the unlinked list. The only place where we do it in the opposite order is on the child during an icreate, but at that point the child is marked INEW and is not visible to other threads.
Work around this deadlock by replacing the blocking ilock attempt with a nonblocking loop that aborts after 30 seconds. Relax for a jiffy after a failed lock attempt.
--- fs/xfs/scrub/inode_repair.c | 49 ++++++++++++++++++++++++++++++++++++++++++- 1 file changed, 48 insertions(+), 1 deletion(-)
fs/xfs/scrub/inode_repair.c +48 -1
@@ -282,6 +282,51 @@ xrep_dinode_findmode_dirent(return 0 ; } +/* Try to lock a directory, or wait a jiffy. */ +static inline int +xrep_dinode_ilock_nowait ( +struct xfs_inode *dp, +unsigned int lock_mode) +{ +if (xfs_ilock_nowait (dp, lock_mode)) +return true; + +schedule_timeout_killable (1 ); +return false; +} + +/* +* Try to lock a directory to look for ftype hints. Since we already hold the +* AGI buffer, we cannot block waiting for the ILOCK because rename can take +* the ILOCK and then try to lock AGIs. +*/ +STATIC int +xrep_dinode_trylock_directory ( +struct xrep_inode *ri, +struct xfs_inode *dp, +unsigned int *lock_modep) +{ +unsigned long deadline = jiffies +msecs_to_jiffies (30000 ); +unsigned int lock_mode; +int error =0 ; + +do { +if (xchk_should_terminate (ri->sc, &error)) +return error; + +if (xfs_need_iread_extents (&dp->i_df)) + lock_mode =XFS_ILOCK_EXCL ; +else + lock_mode =XFS_ILOCK_SHARED ; + +if (xrep_dinode_ilock_nowait (dp, lock_mode)) { + *lock_modep = lock_mode; +return 0 ; + } + }while (!time_is_before_jiffies (deadline)); +return -EBUSY ; +} +/* * If this is a directory, walk the dirents looking for any that point to the * scrub target inode.
@@ -299,7 +344,9 @@ xrep_dinode_findmode_walk_directory(* Scan the directory to see if there it contains an entry pointing to * the directory that we are repairing. */ - lock_mode =xfs_ilock_data_map_shared (dp); + error =xrep_dinode_trylock_directory (ri, dp, &lock_mode); +if (error) +return error;/* * If this directory is known to be sick, we cannot scan it reliably
[PATCH 4/3] xfs: fix error bailout in xrep_abt_build_new_trees
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
Dan Carpenter reports:
"Commit 4bdfd7d15747 ("xfs: repair free space btrees") from Dec 15, 2023 (linux-next), leads to the following Smatch static checker warning:
fs/xfs/scrub/alloc_repair.c:781 xrep_abt_build_new_trees()
warn: missing unwind goto?"
That's a bug, so let's fix it.
--- fs/xfs/scrub/alloc_repair.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
fs/xfs/scrub/alloc_repair.c +1 -1
@@ -778,7 +778,7 @@ xrep_abt_build_new_trees( error =xrep_bnobt_sort_records (ra);if (error) -return error; + goto err_levels;/* Load the free space by block number tree. */ ra->array_cur =XFARRAY_CURSOR_INIT ;
Christoph Hellwig
Reviewed-byRe: [PATCH 4/3] xfs: fix error bailout in xrep_abt_build_new_trees
Looks good:
PATCH 2/15 xfs: improve log incompat feature handling
In reply to Darrick J. WongHi all,
This patchset improves the performance of log incompat feature bit handling by making a few changes to how the filesystem handles them. First, we now only clear the bits during a clean unmount to reduce calls to the (expensive) upgrade function to once per bit per mount. Second, we now only allow incompat feature upgrades for sysadmins or if the sysadmin explicitly allows it via mount option. Currently the only log incompat user is logged xattrs, which requires CONFIG_XFS_DEBUG=y, so there should be no user visible impact to this change.
If you're going to start using this code, I strongly recommend pulling from my git trees, which are linked below.
This has been running on the djcloud for months with no problems. Enjoy! Comments and questions are, as always, welcome.
--D
kernel git tree:
https://git.kernel.org/cgit/linux/kernel/git/djwong/xfs-linux.git/log/?h=log-incompat-permissions
---
Commits in this patchset:
* xfs: only clear log incompat flags at clean unmount
* xfs: only add log incompat features with explicit permission
--- Documentation/admin-guide/xfs.rst | 7 +++ .../filesystems/xfs/xfs-online-fsck-design.rst | 3 - fs/xfs/xfs_log.c | 28 ------------- fs/xfs/xfs_log.h | 2 - fs/xfs/xfs_log_priv.h | 3 - fs/xfs/xfs_log_recover.c | 15 ------- fs/xfs/xfs_mount.c | 34 ++++++++++++++++ fs/xfs/xfs_mount.h | 9 ++++ fs/xfs/xfs_super.c | 12 +++++- fs/xfs/xfs_xattr.c | 42 +++----------------- 10 files changed, 66 insertions(+), 89 deletions(-)
PATCH 1/2 xfs: only clear log incompat flags at clean unmount
From: Darrick J. Wong <[email protected]>
While reviewing the online fsck patchset, someone spied the xfs_swapext_can_use_without_log_assistance function and wondered why we go through this inverted-bitmask dance to avoid setting the XFS_SB_FEAT_INCOMPAT_LOG_SWAPEXT feature.
(The same principles apply to the logged extended attribute update feature bit in the since-merged LARP series.)
The reason for this dance is that xfs_add_incompat_log_feature is an expensive operation -- it forces the log, pushes the AIL, and then if nobody's beaten us to it, sets the feature bit and issues a synchronous write of the primary superblock. That could be a one-time cost amortized over the life of the filesystem, but the log quiesce and cover operations call xfs_clear_incompat_log_features to remove feature bits opportunistically. On a moderately loaded filesystem this leads to us cycling those bits on and off over and over, which hurts performance.
Why do we clear the log incompat bits? Back in ~2020 I think Dave and I had a conversation on IRC[2] about what the log incompat bits represent. IIRC in that conversation we decided that the log incompat bits protect unrecovered log items so that old kernels won't try to recover them and barf. Since a clean log has no protected log items, we could clear the bits at cover/quiesce time.
As Dave Chinner pointed out in the thread, clearing log incompat bits at unmount time has positive effects for golden root disk image generator setups, since the generator could be running a newer kernel than what gets written to the golden image -- if there are log incompat fields set in the golden image that was generated by a newer kernel/OS image builder then the provisioning host cannot mount the filesystem even though the log is clean and recovery is unnecessary to mount the filesystem.
Given that it's expensive to set log incompat bits, we really only want to do that once per bit per mount. Therefore, I propose that we only clear log incompat bits as part of writing a clean unmount record. Do this by adding an operational state flag to the xfs mount that guards whether or not the feature bit clearing can actually take place.
This eliminates the l_incompat_users rwsem that we use to protect a log cleaning operation from clearing a feature bit that a frontend thread is trying to set -- this lock adds another way to fail w.r.t. locking. For the swapext series, I shard that into multiple locks just to work around the lockdep complaints, and that's fugly.
--- .../filesystems/xfs/xfs-online-fsck-design.rst | 3 - fs/xfs/xfs_log.c | 28 ------------- fs/xfs/xfs_log.h | 2 - fs/xfs/xfs_log_priv.h | 3 - fs/xfs/xfs_log_recover.c | 15 ------- fs/xfs/xfs_mount.c | 8 +++- fs/xfs/xfs_mount.h | 6 ++- fs/xfs/xfs_xattr.c | 42 +++----------------- 8 files changed, 19 insertions(+), 88 deletions(-)
Documentation/filesystems/xfs/xfs-online-fsck-design.rst +0 -3
@@ -4047,9 +4047,6 @@ series. | one ``struct rw_semaphore`` for each feature. | | The log cleaning code tries to take this rwsem in exclusive mode to | | clear the bit; if the lock attempt fails, the feature bit remains set. | -| Filesystem code signals its intention to use a log incompat feature in a | -| transaction by calling ``xlog_use_incompat_feat``, which takes the rwsem | -| in shared mode. | | The code supporting a log incompat feature should create wrapper | | functions to obtain the log feature and call | | ``xfs_add_incompat_log_feature`` to set the feature bits in the primary |
fs/xfs/xfs_log.c +1 -27
@@ -1448,7 +1448,7 @@ xfs_log_work_queue(* Clear the log incompat flags if we have the opportunity. * * This only happens if we're about to log the second dummy transaction as part -* of covering the log and we can get the log incompat feature usage lock. +* of covering the log. */ static inline void xlog_clear_incompat(
@@ -1463,11 +1463,7 @@ xlog_clear_incompat(if (log->l_covered_state !=XLOG_STATE_COVER_DONE2 )return ; -if (!down_write_trylock (&log->l_incompat_users)) -return ; -xfs_clear_incompat_log_features (mp); -up_write (&log->l_incompat_users); }/*
@@ -1585,8 +1581,6 @@ xlog_alloc_log( } log->l_sectBBsize =1 << log2_size; -init_rwsem (&log->l_incompat_users); -xlog_get_iclog_buffer_size (mp, log);spin_lock_init (&log->l_icloglock);
@@ -3871,23 +3865,3 @@ xfs_log_check_lsn(return valid; } - -/* -* Notify the log that we're about to start using a feature that is protected -* by a log incompat feature flag. This will prevent log covering from -* clearing those flags. -*/ -void -xlog_use_incompat_feat ( -struct xlog *log) -{ -down_read (&log->l_incompat_users); -} - -/* Notify the log that we've finished using log incompat features. */ -void -xlog_drop_incompat_feat ( -struct xlog *log) -{ -up_read (&log->l_incompat_users); -}
fs/xfs/xfs_log.h +0 -2
@@ -159,8 +159,6 @@ bool xfs_log_check_lsn(struct xfs_mount *, xfs_lsn_t);xfs_lsn_t xlog_grant_push_threshold (struct xlog *log,int need_bytes);bool xlog_force_shutdown (struct xlog *log,uint32_t shutdown_flags); -void xlog_use_incompat_feat (struct xlog *log); -void xlog_drop_incompat_feat (struct xlog *log);int xfs_attr_use_log_assist (struct xfs_mount *mp);#endif /* __XFS_LOG_H__ */
fs/xfs/xfs_log_priv.h +0 -3
@@ -450,9 +450,6 @@ struct xlog {xfs_lsn_t l_recovery_lsn;uint32_t l_iclog_roundoff;/* padding roundoff */ - -/* Users of log incompat features should take a read lock. */ -struct rw_semaphore l_incompat_users; };/*
fs/xfs/xfs_log_recover.c +0 -15
@@ -3496,21 +3496,6 @@ xlog_recover_finish(*/ xfs_log_force (log->l_mp,XFS_LOG_SYNC ); -/* -* Now that we've recovered the log and all the intents, we can clear -* the log incompat feature bits in the superblock because there's no -* longer anything to protect. We rely on the AIL push to write out the -* updated superblock after everything else. -*/ -if (xfs_clear_incompat_log_features (log->l_mp)) { - error =xfs_sync_sb (log->l_mp, false); -if (error <0 ) { -xfs_alert (log->l_mp, -"Failed to clear log incompat features on recovery" ); - goto out_error; - } - } -xlog_recover_process_iunlinks (log);/*
fs/xfs/xfs_mount.c +7 -1
@@ -1095,6 +1095,11 @@ xfs_unmountfs( "Freespace may not be correct on next mount.");xfs_unmount_check (mp); +/* +* Indicate that it's ok to clear log incompat bits before cleaning +* the log and writing the unmount record. +*/ +xfs_set_done_with_log_incompat (mp);xfs_log_unmount (mp);xfs_da_unmount (mp);xfs_uuid_unmount (mp);
@@ -1364,7 +1369,8 @@ xfs_clear_incompat_log_features(if (!xfs_has_crc (mp) || !xfs_sb_has_incompat_log_feature (&mp->m_sb,XFS_SB_FEAT_INCOMPAT_LOG_ALL ) || -xfs_is_shutdown (mp)) +xfs_is_shutdown (mp) || + !xfs_is_done_with_log_incompat (mp))return false;/*
fs/xfs/xfs_mount.h +5 -1
@@ -412,6 +412,8 @@ __XFS_HAS_FEAT(nouuid, NOUUID)#define XFS_OPSTATE_WARNED_LARP 9/* Mount time quotacheck is running */ #define XFS_OPSTATE_QUOTACHECK_RUNNING 10 +/* Do we want to clear log incompat flags? */ +#define XFS_OPSTATE_UNSET_LOG_INCOMPAT 11#define __XFS_IS_OPSTATE (name,NAME ) \ static inline bool xfs_is_ ## name (struct xfs_mount *mp) \
@@ -439,6 +441,7 @@ __XFS_IS_OPSTATE(quotacheck_running, QUOTACHECK_RUNNING)#else # define xfs_is_quotacheck_running (mp) (false)#endif +__XFS_IS_OPSTATE(done_with_log_incompat, UNSET_LOG_INCOMPAT)static inline bool xfs_should_warn (struct xfs_mount *mp,long nr)
@@ -457,7 +460,8 @@ xfs_should_warn(struct xfs_mount *mp, long nr) { (1UL << XFS_OPSTATE_WARNED_SCRUB), "wscrub" }, \ { (1UL << XFS_OPSTATE_WARNED_SHRINK), "wshrink" }, \ { (1UL << XFS_OPSTATE_WARNED_LARP), "wlarp" }, \ - { (1UL << XFS_OPSTATE_QUOTACHECK_RUNNING), "quotacheck" } + { (1UL << XFS_OPSTATE_QUOTACHECK_RUNNING), "quotacheck" }, \ + { (1UL << XFS_OPSTATE_UNSET_LOG_INCOMPAT), "unset_log_incompat" }/* * Max and min values for mount-option defined I/O
fs/xfs/xfs_xattr.c +6 -36
84 lines not on this page · raw message
Re: [PATCH 1/2] xfs: only clear log incompat flags at clean unmount
Quoted 50 lines · Darrick J. Wong
From: Darrick J. Wong <[email protected]>
While reviewing the online fsck patchset, someone spied the
xfs_swapext_can_use_without_log_assistancefunction and wondered why we go through this inverted-bitmask dance to avoid setting theXFS_SB_FEAT_INCOMPAT_LOG_SWAPEXTfeature.(The same principles apply to the logged extended attribute update feature bit in the since-merged LARP series.)
The reason for this dance is that
xfs_add_incompat_log_featureis an expensive operation -- it forces the log, pushes the AIL, and then if nobody's beaten us to it, sets the feature bit and issues a synchronous write of the primary superblock. That could be a one-time cost amortized over the life of the filesystem, but the log quiesce and cover operations callxfs_clear_incompat_log_featuresto remove feature bits opportunistically. On a moderately loaded filesystem this leads to us cycling those bits on and off over and over, which hurts performance.Why do we clear the log incompat bits? Back in ~2020 I think Dave and I had a conversation on IRC[2] about what the log incompat bits represent. IIRC in that conversation we decided that the log incompat bits protect unrecovered log items so that old kernels won't try to recover them and barf. Since a clean log has no protected log items, we could clear the bits at cover/quiesce time.
As Dave Chinner pointed out in the thread, clearing log incompat bits at unmount time has positive effects for golden root disk image generator setups, since the generator could be running a newer kernel than what gets written to the golden image -- if there are log incompat fields set in the golden image that was generated by a newer kernel/OS image builder then the provisioning host cannot mount the filesystem even though the log is clean and recovery is unnecessary to mount the filesystem.
Given that it's expensive to set log incompat bits, we really only want to do that once per bit per mount. Therefore, I propose that we only clear log incompat bits as part of writing a clean unmount record. Do this by adding an operational state flag to the xfs mount that guards whether or not the feature bit clearing can actually take place.
This eliminates the
l_incompat_usersrwsem that we use to protect a log cleaning operation from clearing a feature bit that a frontend thread is trying to set -- this lock adds another way to fail w.r.t. locking. For the swapext series, I shard that into multiple locks just to work around the lockdep complaints, and that's fugly.
Quoted 10 lines
--- .../filesystems/xfs/xfs-online-fsck-design.rst | 3 - fs/xfs/xfs_log.c | 28 ------------- fs/xfs/xfs_log.h | 2 - fs/xfs/xfs_log_priv.h | 3 - fs/xfs/xfs_log_recover.c | 15 ------- fs/xfs/xfs_mount.c | 8 +++- fs/xfs/xfs_mount.h | 6 ++- fs/xfs/xfs_xattr.c | 42 +++----------------- 8 files changed, 19 insertions(+), 88 deletions(-)
Looks fine.
Signature · 2 lines
Dave Chinner [email protected]
PATCH 2/2 xfs: only add log incompat features with explicit permission
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
Only allow the addition of new log incompat features to the primary superblock if the sysadmin provides explicit consent via a mount option or if the process has administrative privileges. This should prevent surprises when trying to recover dirty logs on old kernels.
--- Documentation/admin-guide/xfs.rst | 7 +++++++ fs/xfs/xfs_mount.c | 26 ++++++++++++++++++++++++++ fs/xfs/xfs_mount.h | 3 +++ fs/xfs/xfs_super.c | 12 +++++++++++- 4 files changed, 47 insertions(+), 1 deletion(-)
Documentation/admin-guide/xfs.rst +7 -0
@@ -21,6 +21,13 @@ Mount Options When mounting an XFS filesystem, the following options are accepted. + add_log_feat/noadd_log_feat + Permit unprivileged userspace to use functionality that requires + the addition of log incompat feature bits to the superblock. + The feature bits will be cleared during a clean unmount. + Old kernels cannot recover dirty logs if they do not recognize + all log incompat feature bits. + allocsize=size Sets the buffered I/O end-of-file preallocation size when doing delayed allocation writeout (default size is 64KiB).
fs/xfs/xfs_mount.c +26 -0
@@ -1281,6 +1281,27 @@ xfs_force_summary_recalc(xfs_fs_mark_sick (mp,XFS_SICK_FS_COUNTERS ); } +/* +* Allow the log feature upgrade only if the sysadmin permits it via mount +* option; or the caller is the administrator. If the @want_audit parameter +* is true, then a denial due to insufficient privileges will be logged. +*/ +bool +xfs_can_add_incompat_log_features ( +struct xfs_mount *mp, +bool want_audit) +{ +/* Always allowed if the mount option is set */ +if (mp->m_features &XFS_FEAT_ADD_LOG_FEAT ) +return true; + +/* Allowed for administrators */ +if (want_audit) +return capable (CAP_SYS_ADMIN ); + +return has_capability_noaudit (current,CAP_SYS_ADMIN ); +} +/* * Enable a log incompat feature flag in the primary superblock. The caller * cannot have any other transactions in progress.
@@ -1322,6 +1343,11 @@ xfs_add_incompat_log_feature(if (xfs_sb_has_incompat_log_feature (&mp->m_sb, feature)) goto rele; +if (!xfs_can_add_incompat_log_features (mp, true)) { + error = -EOPNOTSUPP ; + goto rele; + } +/* * Write the primary superblock to disk immediately, because we need * the log_incompat bit to be set in the primary super now to protect
fs/xfs/xfs_mount.h +3 -0
@@ -294,6 +294,7 @@ typedef struct xfs_mount {#define XFS_FEAT_NREXT64 (1ULL << 26)/* large extent counters */ /* Mount features */ +#define XFS_FEAT_ADD_LOG_FEAT (1ULL << 47)/* can add log incompat features */ #define XFS_FEAT_NOATTR2 (1ULL << 48)/* disable attr2 creation */ #define XFS_FEAT_NOALIGN (1ULL << 49)/* ignore alignment */ #define XFS_FEAT_ALLOCSIZE (1ULL << 50)/* user specified allocation size */
@@ -356,6 +357,8 @@ __XFS_HAS_FEAT(bigtime, BIGTIME) __XFS_HAS_FEAT(needsrepair, NEEDSREPAIR) __XFS_HAS_FEAT(large_extent_counts, NREXT64) +bool xfs_can_add_incompat_log_features (struct xfs_mount *mp,bool want_audit); +/* * Mount features *
fs/xfs/xfs_super.c +11 -1
@@ -103,7 +103,8 @@ enum { Opt_filestreams, Opt_quota, Opt_noquota, Opt_usrquota, Opt_grpquota, Opt_prjquota, Opt_uquota, Opt_gquota, Opt_pquota, Opt_uqnoenforce, Opt_gqnoenforce, Opt_pqnoenforce, Opt_qnoenforce, - Opt_discard, Opt_nodiscard, Opt_dax, Opt_dax_enum, + Opt_discard, Opt_nodiscard, Opt_dax, Opt_dax_enum, Opt_add_log_feat, + Opt_noadd_log_feat, }; static const struct fs_parameter_spec xfs_fs_parameters[] = {
@@ -148,6 +149,8 @@ static const struct fs_parameter_spec xfs_fs_parameters[] = {fsparam_flag ("nodiscard" , Opt_nodiscard),fsparam_flag ("dax" , Opt_dax),fsparam_enum ("dax" , Opt_dax_enum, dax_param_enums), +fsparam_flag ("add_log_feat" , Opt_add_log_feat), + fsparam_flag("noadd_log_feat", Opt_noadd_log_feat), {} };
@@ -176,6 +179,7 @@ xfs_fs_show_options( { XFS_FEAT_LARGE_IOSIZE, ",largeio" }, { XFS_FEAT_DAX_ALWAYS, ",dax=always" }, { XFS_FEAT_DAX_NEVER, ",dax=never" }, + { XFS_FEAT_ADD_LOG_FEAT, ",add_log_feat" }, { 0, NULL } };struct xfs_mount *mp =XFS_M (root->d_sb);
@@ -1368,6 +1372,12 @@ xfs_fs_parse_param(xfs_mount_set_dax_mode (parsing_mp, result.uint_32);return 0 ;#endif +case Opt_add_log_feat: + parsing_mp->m_features |=XFS_FEAT_ADD_LOG_FEAT ; +return 0 ; +case Opt_noadd_log_feat: + parsing_mp->m_features &= ~XFS_FEAT_ADD_LOG_FEAT ; +return 0 ;/* Following mount options will be removed in September 2025 */ case Opt_ikeep:xfs_fs_warn_deprecated (fc, param,XFS_FEAT_IKEEP , true);
Re: [PATCH 2/2] xfs: only add log incompat features with explicit permission
Quoted 9 lines · Darrick J. Wong
From: Darrick J. Wong <[email protected]>
Only allow the addition of new log incompat features to the primary superblock if the sysadmin provides explicit consent via a mount option or if the process has administrative privileges. This should prevent surprises when trying to recover dirty logs on old kernels.
Signed-off-by Darrick J. Wong <[email protected]>Reviewed-by Christoph Hellwig <[email protected]>
As I said originally when this was proposed, the logic needs to default to allow log incompat features to be added rather than disallow.
Essentially, having the default as "not allowed" means in future every single XFS mount on every single system is going to have to add this mount option to allow new log format features to used.
This "default = disallow" means our regression test systems will not be exercising features based on this code without explicitly expanding every independent test configuration matrix by another dimension. This essentially means there will be almost no test coverage for these dynamic features..
So, yeah, I think this needs to default to "allow", not "disallow".
Quoted 37 lines
--- Documentation/admin-guide/xfs.rst | 7 +++++++ fs/xfs/xfs_mount.c | 26 ++++++++++++++++++++++++++ fs/xfs/xfs_mount.h | 3 +++ fs/xfs/xfs_super.c | 12 +++++++++++- 4 files changed, 47 insertions(+), 1 deletion(-)Documentation/admin-guide/xfs.rst +7
-0@@ -21,6 +21,13 @@ Mount Options When mounting an XFS filesystem, the following options are accepted. + add_log_feat/noadd_log_feat + Permit unprivileged userspace to use functionality that requires + the addition of log incompat feature bits to the superblock. + The feature bits will be cleared during a clean unmount. + Old kernels cannot recover dirty logs if they do not recognize + all log incompat feature bits. + allocsize=size Sets the buffered I/O end-of-file preallocation size when doing delayed allocation writeout (default size is 64KiB).fs/xfs/xfs_mount.c +3
-0@@ -1281,6 +1281,27 @@ xfs_force_summary_recalc(xfs_fs_mark_sick (mp,XFS_SICK_FS_COUNTERS ); } +/* +* Allow the log feature upgrade only if the sysadmin permits it via mount +* option; or the caller is the administrator. If the @want_audit parameter
fs/xfs/xfs_mount.c xfs_force_summary_recalc( · line 1296
Quoted 10 lines
fs/xfs/xfs_mount.c +10
-0+* is true, then a denial due to insufficient privileges will be logged. +*/ +bool +xfs_can_add_incompat_log_features ( +struct xfs_mount *mp, +bool want_audit) +{ +/* Always allowed if the mount option is set */ +if (mp->m_features &XFS_FEAT_ADD_LOG_FEAT ) +return true;
Please define a __XFS_HAS_FEAT() macro for this feature bit and use xfs_has_log_features_enabled() wrapper for it.
-Dave.
Signature · 2 lines
Dave Chinner [email protected]
Re: [PATCH 2/2] xfs: only add log incompat features with explicit permission
Quoted 19 lines · Dave Chinner
Quoted 9 lines · Darrick J. Wong
From: Darrick J. Wong <[email protected]>
Only allow the addition of new log incompat features to the primary superblock if the sysadmin provides explicit consent via a mount option or if the process has administrative privileges. This should prevent surprises when trying to recover dirty logs on old kernels.
Signed-off-by Darrick J. Wong <[email protected]>Reviewed-by Christoph Hellwig <[email protected]>As I said originally when this was proposed, the logic needs to default to allow log incompat features to be added rather than disallow.
Essentially, having the default as "not allowed" means in future every single XFS mount on every single system is going to have to add this mount option to allow new log format features to used.
Quoted 7 lines
This "default = disallow" means our regression test systems will not be exercising features based on this code without explicitly expanding every independent test configuration matrix by another dimension. This essentially means there will be almost no test coverage for these dynamic features..
So, yeah, I think this needs to default to "allow", not "disallow".
This is moot -- I changed exchangerange to use a permanent incompat feature so that we can guarantee to users that if the xfs_info output says it's enabled then it's 100% ready to go. Hence I no longer care what happens to log incompat bits and this patch no longer needs to exist.
--D
Quoted 57 lines
Quoted 38 lines
--- Documentation/admin-guide/xfs.rst | 7 +++++++ fs/xfs/xfs_mount.c | 26 ++++++++++++++++++++++++++ fs/xfs/xfs_mount.h | 3 +++ fs/xfs/xfs_super.c | 12 +++++++++++- 4 files changed, 47 insertions(+), 1 deletion(-)Documentation/admin-guide/xfs.rst +7
-0@@ -21,6 +21,13 @@ Mount Options When mounting an XFS filesystem, the following options are accepted. + add_log_feat/noadd_log_feat + Permit unprivileged userspace to use functionality that requires + the addition of log incompat feature bits to the superblock. + The feature bits will be cleared during a clean unmount. + Old kernels cannot recover dirty logs if they do not recognize + all log incompat feature bits. + allocsize=size Sets the buffered I/O end-of-file preallocation size when doing delayed allocation writeout (default size is 64KiB).fs/xfs/xfs_mount.c +3
-0@@ -1281,6 +1281,27 @@ xfs_force_summary_recalc(xfs_fs_mark_sick (mp,XFS_SICK_FS_COUNTERS ); } +/* +* Allow the log feature upgrade only if the sysadmin permits it via mount +* option; or the caller is the administrator. If the @want_audit parameter fs/xfs/xfs_mount.c xfs_force_summary_recalc( · line 1296
Quoted 10 lines
fs/xfs/xfs_mount.c +10
-0+* is true, then a denial due to insufficient privileges will be logged. +*/ +bool +xfs_can_add_incompat_log_features ( +struct xfs_mount *mp, +bool want_audit) +{ +/* Always allowed if the mount option is set */ +if (mp->m_features &XFS_FEAT_ADD_LOG_FEAT ) +return true;Please define a
__XFS_HAS_FEAT()macro for this feature bit and usexfs_has_log_features_enabled()wrapper for it.-Dave.
Signature · 2 lines
Dave Chinner [email protected]
PATCH 3/15 xfs: refactorings for atomic file content exchanges
In reply to Darrick J. WongHi all,
This series applies various cleanups and refactorings to file IO handling code ahead of the main series to implement atomic file content exchanges.
If you're going to start using this code, I strongly recommend pulling from my git trees, which are linked below.
This has been running on the djcloud for months with no problems. Enjoy! Comments and questions are, as always, welcome.
--D
kernel git tree:
https://git.kernel.org/cgit/linux/kernel/git/djwong/xfs-linux.git/log/?h=file-exchange-refactorings
xfsprogs git tree:
https://git.kernel.org/cgit/linux/kernel/git/djwong/xfsprogs-dev.git/log/?h=file-exchange-refactorings
---
Commits in this patchset:
* xfs: move inode lease breaking functions to xfs_inode.c
* xfs: move xfs_iops.c declarations out of xfs_inode.h
* xfs: declare xfs_file.c symbols in xfs_file.h
* xfs: create a new helper to return a file's allocation unit
* xfs: hoist multi-fsb allocation unit detection to a helper
* xfs: refactor non-power-of-two alignment checks
* xfs: constify xfs_bmap_is_written_extent
--- fs/xfs/libxfs/xfs_bmap.h | 2 + fs/xfs/xfs_bmap_util.c | 4 +- fs/xfs/xfs_file.c | 88 ++++------------------------------------------ fs/xfs/xfs_file.h | 15 ++++++++ fs/xfs/xfs_inode.c | 75 +++++++++++++++++++++++++++++++++++++++ fs/xfs/xfs_inode.h | 16 +++++--- fs/xfs/xfs_ioctl.c | 1 + fs/xfs/xfs_iops.c | 1 + fs/xfs/xfs_iops.h | 7 ++-- fs/xfs/xfs_linux.h | 5 +++ 10 files changed, 121 insertions(+), 93 deletions(-) create mode 100644 fs/xfs/xfs_file.h
PATCH 1/7 xfs: move inode lease breaking functions to xfs_inode.c
From: Darrick J. Wong <[email protected]>
The lease breaking functions operate at the scope of the entire VFS inode, not subranges of a file. Move them to xfs_inode.c since they're already declared in xfs_inode.h. This cleanup moves us closer to having xfs_FOO.h declare only the symbols in xfs_FOO.c.
--- fs/xfs/xfs_file.c | 61 --------------------------------------------------- fs/xfs/xfs_inode.c | 62 ++++++++++++++++++++++++++++++++++++++++++++++++++++ fs/xfs/xfs_inode.h | 1 - 3 files changed, 62 insertions(+), 62 deletions(-)
fs/xfs/xfs_file.c +0 -61
@@ -861,67 +861,6 @@ xfs_file_write_iter(return xfs_file_buffered_write (iocb, from); } -static void -xfs_wait_dax_page ( -struct inode *inode) -{ -struct xfs_inode *ip =XFS_I (inode); - -xfs_iunlock (ip,XFS_MMAPLOCK_EXCL ); -schedule (); -xfs_ilock (ip,XFS_MMAPLOCK_EXCL ); -} - -int -xfs_break_dax_layouts ( -struct inode *inode, -bool *retry) -{ -struct page *page; - -xfs_assert_ilocked (XFS_I (inode),XFS_MMAPLOCK_EXCL ); - - page =dax_layout_busy_page (inode->i_mapping); -if (!page) -return 0 ; - - *retry = true; -return ___wait_var_event (&page->_refcount, -atomic_read (&page->_refcount) ==1 ,TASK_INTERRUPTIBLE , -0 ,0 ,xfs_wait_dax_page (inode)); -} - -int -xfs_break_layouts ( -struct inode *inode, -uint *iolock, -enum layout_break_reason reason) -{ -bool retry; -int error; - -xfs_assert_ilocked (XFS_I (inode),XFS_IOLOCK_SHARED |XFS_IOLOCK_EXCL ); - -do { - retry = false; -switch (reason) { -case BREAK_UNMAP : - error =xfs_break_dax_layouts (inode, &retry); -if (error || retry) -break ; - fallthrough; -case BREAK_WRITE : - error =xfs_break_leased_layouts (inode, iolock, &retry); -break ; -default : -WARN_ON_ONCE (1 ); - error = -EINVAL ; - } - }while (error ==0 && retry); - -return error; -} -/* Does this file, inode, or mount want synchronous writes? */ static inline bool xfs_file_sync_writes (struct file *filp) {
fs/xfs/xfs_inode.c +62 -0
71 lines not on this page · raw message
fs/xfs/xfs_inode.h +0 -1
@@ -565,7 +565,6 @@ xfs_itruncate_extents(return xfs_itruncate_extents_flags (tpp, ip, whichfork, new_size,0 ); } -/* from xfs_file.c */ int xfs_break_dax_layouts (struct inode *inode,bool *retry);int xfs_break_layouts (struct inode *inode,uint *iolock,enum layout_break_reason reason);
PATCH 2/7 xfs: move xfs_iops.c declarations out of xfs_inode.h
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
Similarly, move declarations of public symbols of xfs_iops.c from xfs_inode.h to xfs_iops.h.
--- fs/xfs/xfs_inode.h | 5 ----- fs/xfs/xfs_iops.h | 4 ++++ 2 files changed, 4 insertions(+), 5 deletions(-)
fs/xfs/xfs_inode.h +0 -5
@@ -569,11 +569,6 @@ int xfs_break_dax_layouts(struct inode *inode, bool *retry);int xfs_break_layouts (struct inode *inode,uint *iolock,enum layout_break_reason reason); -/* from xfs_iops.c */ -extern void xfs_setup_inode (struct xfs_inode *ip); -extern void xfs_setup_iops (struct xfs_inode *ip); -extern void xfs_diflags_to_iflags (struct xfs_inode *ip,bool init); -static inline void xfs_update_stable_writes (struct xfs_inode *ip) {if (bdev_stable_writes (xfs_inode_buftarg (ip)->bt_bdev))
fs/xfs/xfs_iops.h +4 -0
@@ -19,4 +19,8 @@ int xfs_vn_setattr_size(struct mnt_idmap *idmap,int xfs_inode_init_security (struct inode *inode,struct inode *dir,const struct qstr *qstr); +extern void xfs_setup_inode (struct xfs_inode *ip); +extern void xfs_setup_iops (struct xfs_inode *ip); +extern void xfs_diflags_to_iflags (struct xfs_inode *ip,bool init); +#endif /* __XFS_IOPS_H__ */
PATCH 3/7 xfs: declare xfs_file.c symbols in xfs_file.h
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
Move the two public symbols in xfs_file.c to xfs_file.h. We're about to add more public symbols in that source file, so let's finally create the header file.
--- fs/xfs/xfs_file.c | 1 + fs/xfs/xfs_file.h | 12 ++++++++++++ fs/xfs/xfs_ioctl.c | 1 + fs/xfs/xfs_iops.c | 1 + fs/xfs/xfs_iops.h | 3 --- 5 files changed, 15 insertions(+), 3 deletions(-) create mode 100644 fs/xfs/xfs_file.h
fs/xfs/xfs_file.c +1 -0
@@ -24,6 +24,7 @@#include "xfs_pnfs.h" #include "xfs_iomap.h" #include "xfs_reflink.h" +#include "xfs_file.h" #include <linux/dax.h> #include <linux/falloc.h>
fs/xfs/xfs_file.h new file +12 -0
@@ -0,0 +1,12 @@ +// SPDX-License-Identifier: GPL-2.0 +/* +* Copyright (c) 2000-2005 Silicon Graphics, Inc. +* All Rights Reserved. +*/ +#ifndef __XFS_FILE_H__ +#define __XFS_FILE_H__ + +extern const struct file_operations xfs_file_operations; +extern const struct file_operations xfs_dir_file_operations; + +#endif /* __XFS_FILE_H__ */
fs/xfs/xfs_ioctl.c +1 -0
@@ -39,6 +39,7 @@#include "xfs_ioctl.h" #include "xfs_xattr.h" #include "xfs_rtbitmap.h" +#include "xfs_file.h" #include <linux/mount.h> #include <linux/namei.h>
fs/xfs/xfs_iops.c +1 -0
@@ -25,6 +25,7 @@#include "xfs_error.h" #include "xfs_ioctl.h" #include "xfs_xattr.h" +#include "xfs_file.h" #include <linux/posix_acl.h> #include <linux/security.h>
fs/xfs/xfs_iops.h +0 -3
@@ -8,9 +8,6 @@struct xfs_inode ; -extern const struct file_operations xfs_file_operations; -extern const struct file_operations xfs_dir_file_operations; -extern ssize_t xfs_vn_listxattr (struct dentry *,char *data,size_t size); int xfs_vn_setattr_size(struct mnt_idmap *idmap,
PATCH 4/7 xfs: create a new helper to return a file's allocation unit
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
Create a new helper function to calculate the fundamental allocation unit (i.e. the smallest unit of space we can allocate) of a file. Things are going to get hairy with range-exchange on the realtime device, so prepare for this now.
Remove the static attribute from xfs_is_falloc_aligned since the next patch will need it.
--- fs/xfs/xfs_file.c | 28 ++++++++++------------------ fs/xfs/xfs_file.h | 3 +++ fs/xfs/xfs_inode.c | 13 +++++++++++++ fs/xfs/xfs_inode.h | 1 + 4 files changed, 27 insertions(+), 18 deletions(-)
fs/xfs/xfs_file.c +10 -18
@@ -39,33 +39,25 @@ static const struct vm_operations_struct xfs_file_vm_ops;* Decide if the given file range is aligned to the size of the fundamental * allocation unit for the file. */ -static bool +bool xfs_is_falloc_aligned (struct xfs_inode *ip,loff_t pos,long long int len) { -struct xfs_mount *mp = ip->i_mount; -uint64_t mask; +unsigned int alloc_unit =xfs_inode_alloc_unitsize (ip); -if (XFS_IS_REALTIME_INODE (ip)) { -if (!is_power_of_2 (mp->m_sb.sb_rextsize)) { -u64 rextbytes; -u32 mod; +if (!is_power_of_2 (alloc_unit)) { +u32 mod; - rextbytes =XFS_FSB_TO_B (mp, mp->m_sb.sb_rextsize); -div_u64_rem (pos, rextbytes, &mod); -if (mod) -return false; -div_u64_rem (len, rextbytes, &mod); -return mod ==0 ; - } - mask =XFS_FSB_TO_B (mp, mp->m_sb.sb_rextsize) -1 ; - }else { - mask = mp->m_sb.sb_blocksize -1 ; +div_u64_rem (pos, alloc_unit, &mod); +if (mod) +return false; +div_u64_rem (len, alloc_unit, &mod); +return mod ==0 ; } -return !((pos | len) & mask); +return !((pos | len) & (alloc_unit -1 )); }/*
fs/xfs/xfs_file.h +3 -0
@@ -9,4 +9,7 @@extern const struct file_operations xfs_file_operations;extern const struct file_operations xfs_dir_file_operations; +bool xfs_is_falloc_aligned (struct xfs_inode *ip,loff_t pos, +long long int len); +#endif /* __XFS_FILE_H__ */
fs/xfs/xfs_inode.c +13 -0
@@ -3997,3 +3997,16 @@ xfs_break_layouts(return error; } + +/* Returns the size of fundamental allocation unit for a file, in bytes. */ +unsigned int +xfs_inode_alloc_unitsize ( +struct xfs_inode *ip) +{ +unsigned int blocks =1 ; + +if (XFS_IS_REALTIME_INODE (ip)) + blocks = ip->i_mount->m_sb.sb_rextsize; + +return XFS_FSB_TO_B (ip->i_mount, blocks); +}
fs/xfs/xfs_inode.h +1 -0
@@ -625,6 +625,7 @@ int xfs_inode_reload_unlinked(struct xfs_inode *ip);bool xfs_ifork_zapped (const struct xfs_inode *ip,int whichfork);void xfs_inode_count_blocks (struct xfs_trans *tp,struct xfs_inode *ip,xfs_filblks_t *dblocks,xfs_filblks_t *rblocks); +unsigned int xfs_inode_alloc_unitsize (struct xfs_inode *ip);struct xfs_dir_update_params {const struct xfs_inode *dp;
PATCH 5/7 xfs: hoist multi-fsb allocation unit detection to a helper
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
Replace the open-coded logic to decide if a file has a multi-fsb allocation unit to a helper to make the code easier to read.
--- fs/xfs/xfs_bmap_util.c | 4 ++-- fs/xfs/xfs_inode.h | 9 +++++++++ 2 files changed, 11 insertions(+), 2 deletions(-)
fs/xfs/xfs_bmap_util.c +2 -2
@@ -542,7 +542,7 @@ xfs_can_free_eofblocks(* forever. */ end_fsb =XFS_B_TO_FSB (mp, (xfs_ufsize_t )XFS_ISIZE (ip)); -if (XFS_IS_REALTIME_INODE (ip) && mp->m_sb.sb_rextsize >1 ) +if (xfs_inode_has_bigallocunit (ip)) end_fsb =xfs_rtb_roundup_rtx (mp, end_fsb); last_fsb =XFS_B_TO_FSB (mp, mp->m_super->s_maxbytes);if (last_fsb <= end_fsb)
@@ -843,7 +843,7 @@ xfs_free_file_space( endoffset_fsb =XFS_B_TO_FSBT (mp, offset + len);/* We can only free complete realtime extents. */ -if (XFS_IS_REALTIME_INODE (ip) && mp->m_sb.sb_rextsize >1 ) { +if (xfs_inode_has_bigallocunit (ip)) { startoffset_fsb =xfs_rtb_roundup_rtx (mp, startoffset_fsb); endoffset_fsb =xfs_rtb_rounddown_rtx (mp, endoffset_fsb); }
fs/xfs/xfs_inode.h +9 -0
@@ -311,6 +311,15 @@ static inline bool xfs_inode_has_large_extent_counts(struct xfs_inode *ip)return ip->i_diflags2 &XFS_DIFLAG2_NREXT64 ; } +/* +* Decide if the file data allocation unit for this file is larger than +* a single filesystem block. +*/ +static inline bool xfs_inode_has_bigallocunit (struct xfs_inode *ip) +{ +return XFS_IS_REALTIME_INODE (ip) && ip->i_mount->m_sb.sb_rextsize >1 ; +} +/* * Return the buftarg used for data allocations on a given inode. */
Re: [PATCH 5/7] xfs: hoist multi-fsb allocation unit detection to a helper
Looks good:
Re: [PATCH 5/7] xfs: hoist multi-fsb allocation unit detection to a helper
In reply to Darrick J. WongQuoted 17 lines · Darrick J. Wong
From: Darrick J. Wong <[email protected]>
Replace the open-coded logic to decide if a file has a multi-fsb allocation unit to a helper to make the code easier to read.
Signed-off-by Darrick J. Wong <[email protected]>--- fs/xfs/xfs_bmap_util.c | 4 ++-- fs/xfs/xfs_inode.h | 9 +++++++++ 2 files changed, 11 insertions(+), 2 deletions(-)fs/xfs/xfs_bmap_util.c +0
-0
fs/xfs/xfs_bmap_util.c xfs_can_free_eofblocks( · line 546
Quoted 6 lines
fs/xfs/xfs_bmap_util.c +1
-1@@ -542,7 +542,7 @@ xfs_can_free_eofblocks(* forever. */ end_fsb =XFS_B_TO_FSB (mp, (xfs_ufsize_t )XFS_ISIZE (ip)); -if (XFS_IS_REALTIME_INODE (ip) && mp->m_sb.sb_rextsize >1 ) +if (xfs_inode_has_bigallocunit (ip)) end_fsb =xfs_rtb_roundup_rtx (mp, end_fsb);
This makes no sense with the upcoming forced alignment changes to this code.
That essentially brings "big alloc unit" to the data device based on extent size hints, and it will need to do different rounding calculations depending on whether it is a RT inode or not. Hence I don't think hiding the RT specific allocation/truncation setup like this is compatible with those changes - it will simply have to be undone before it can be reworked....
-Dave.
Signature · 2 lines
Dave Chinner [email protected]
Re: [PATCH 5/7] xfs: hoist multi-fsb allocation unit detection to a helper
Quoted 28 lines · Dave Chinner
Quoted 17 lines · Darrick J. Wong
From: Darrick J. Wong <[email protected]>
Replace the open-coded logic to decide if a file has a multi-fsb allocation unit to a helper to make the code easier to read.
Signed-off-by Darrick J. Wong <[email protected]>--- fs/xfs/xfs_bmap_util.c | 4 ++-- fs/xfs/xfs_inode.h | 9 +++++++++ 2 files changed, 11 insertions(+), 2 deletions(-)fs/xfs/xfs_bmap_util.c +0
-0fs/xfs/xfs_bmap_util.c xfs_can_free_eofblocks( · line 546
Quoted 6 lines
fs/xfs/xfs_bmap_util.c +1
-1@@ -542,7 +542,7 @@ xfs_can_free_eofblocks(* forever. */ end_fsb =XFS_B_TO_FSB (mp, (xfs_ufsize_t )XFS_ISIZE (ip)); -if (XFS_IS_REALTIME_INODE (ip) && mp->m_sb.sb_rextsize >1 ) +if (xfs_inode_has_bigallocunit (ip)) end_fsb =xfs_rtb_roundup_rtx (mp, end_fsb);This makes no sense with the upcoming forced alignment changes to this code.
Quoted 6 lines
That essentially brings "big alloc unit" to the data device based on extent size hints, and it will need to do different rounding calculations depending on whether it is a RT inode or not. Hence I don't think hiding the RT specific allocation/truncation setup like this is compatible with those changes - it will simply have to be undone before it can be reworked....
So undo it when you and John and Catherine have a full patchset implementing forced alignment.
--D
Quoted 5 lines
-Dave.
Signature · 2 lines
Dave Chinner [email protected]
PATCH 6/7 xfs: refactor non-power-of-two alignment checks
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
Create a helper function that can compute if a 64-bit number is an integer multiple of a 32-bit number, where the 32-bit number is not required to be an even power of two. This is needed for some new code for the realtime device, where we can set 37k allocation units and then have to remap them.
--- fs/xfs/xfs_file.c | 12 +++--------- fs/xfs/xfs_linux.h | 5 +++++ 2 files changed, 8 insertions(+), 9 deletions(-)
fs/xfs/xfs_file.c +3 -9
@@ -47,15 +47,9 @@ xfs_is_falloc_aligned( {unsigned int alloc_unit =xfs_inode_alloc_unitsize (ip); -if (!is_power_of_2 (alloc_unit)) { -u32 mod; - -div_u64_rem (pos, alloc_unit, &mod); -if (mod) -return false; -div_u64_rem (len, alloc_unit, &mod); -return mod ==0 ; - } +if (!is_power_of_2 (alloc_unit)) +return isaligned_64 (pos, alloc_unit) && +isaligned_64 (len, alloc_unit);return !((pos | len) & (alloc_unit -1 )); }
fs/xfs/xfs_linux.h +5 -0
@@ -198,6 +198,11 @@ static inline uint64_t howmany_64(uint64_t x, uint32_t y)return x; } +static inline bool isaligned_64 (uint64_t x,uint32_t y) +{ +return do_div (x, y) ==0 ; +} +/* If @b is a power of 2, return log2(b). Else return -1. */ static inline int8_t log2_if_power2 (unsigned long b) {
PATCH 7/7 xfs: constify xfs_bmap_is_written_extent
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
This predicate doesn't modify the structure that's being passed in, so we can mark it const.
--- fs/xfs/libxfs/xfs_bmap.h | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
fs/xfs/libxfs/xfs_bmap.h +1 -1
@@ -158,7 +158,7 @@ static inline bool xfs_bmap_is_real_extent(const struct xfs_bmbt_irec *irec)* Return true if the extent is a real, allocated extent, or false if it is a * delayed allocation, and unwritten extent or a hole. */ -static inline bool xfs_bmap_is_written_extent (struct xfs_bmbt_irec *irec) +static inline bool xfs_bmap_is_written_extent (const struct xfs_bmbt_irec *irec) {return xfs_bmap_is_real_extent (irec) && irec->br_state !=XFS_EXT_UNWRITTEN ;
PATCH 4/15 xfs: atomic file content exchanges
In reply to Darrick J. WongHi all,
This series creates a new XFS_IOC_EXCHANGE_RANGE ioctl to exchange ranges of bytes between two files atomically, and later adds XFS_IOC_START_COMMIT and XFS_IOC_COMMIT_RANGE ioctls to perform the exchange only if the target file has not been changed since a given sampling point.
This new functionality enables data storage programs to stage and commit file updates such that reader programs will see either the old contents or the new contents in their entirety, with no chance of torn writes. A successful call completion guarantees that the new contents will be seen even if the system fails.
The ability to exchange file fork mappings between files in this manner is critical to supporting online filesystem repair, which is built upon the strategy of constructing a clean copy of a damaged structure and committing the new structure into the metadata file atomically. The ioctls exist to facilitate testing of the new functionality and to enable future application program designs.
User programs will be able to update files atomically by opening an O_TMPFILE, reflinking the source file to it, making whatever updates they want to make, and exchange the relevant ranges of the temp file with the original file. If the updates are aligned with the file block size, a new (since v2) flag provides for exchanging only the written areas.
This mechanism solves the clunkiness of two existing atomic file update
mechanisms: for O_TRUNC + rewrite, this eliminates the brief period where other programs can see an empty file. For create tempfile + rename, the need to copy file attributes and extended attributes for each file update is eliminated.
However, this method introduces its own awkwardness -- any program initiating an exchange now needs to have a way to signal to other programs that the file contents have changed. For file access mediated via read and write, fanotify or inotify are probably sufficient. For mmaped files, that may not be fast enough.
Here are the proposed manual pages:
IOCTL-XFS-EXCHANGE-RANGE(2System Calls ManuIOCTL-XFS-EXCHANGE-RANGE(2)
NAME
ioctl_xfs_exchange_range - exchange the contents of parts of two files
SYNOPSIS
#include <sys/ioctl.h>
#include <xfs/xfs_fs_staging.h>
int ioctl(int file2_fd, XFS_IOC_EXCHANGE_RANGE, struct xfs_ex‐
change_range *arg);DESCRIPTION
Given a range of bytes in a first file file1_fd and a second range of bytes in a second file file2_fd, this ioctl(2) ex‐ changes the contents of the two ranges.
Exchanges are atomic with regards to concurrent file opera‐ tions. Implementations must guarantee that readers see either the old contents or the new contents in their entirety, even if the system fails.
The system call parameters are conveyed in structures of the following form:
struct xfs_exchange_range {
__s32 file1_fd;
__u32 pad;
__u64 file1_offset;
__u64 file2_offset;
__u64 length;
__u64 flags;
};
The field pad must be zero.
The fields file1_fd, file1_offset, and length define the first range of bytes to be exchanged.
The fields file2_fd, file2_offset, and length define the second range of bytes to be exchanged.
Both files must be from the same filesystem mount. If the two file descriptors represent the same file, the byte ranges must
not overlap. Most disk-based filesystems require that the
starts of both ranges must be aligned to the file block size. If this is the case, the ends of the ranges must also be so aligned unless the XFS_EXCHANGE_RANGE_TO_EOF flag is set.
The field flags control the behavior of the exchange operation.
XFS_EXCHANGE_RANGE_TO_EOF
Ignore the length parameter. All bytes in file1_fd from file1_offset to EOF are moved to file2_fd, and file2's size is set to (file2_offset+(file1_length-
file1_offset)). Meanwhile, all bytes in file2 from
file2_offset to EOF are moved to file1 and file1's
size is set to (file1_offset+(file2_length-
file2_offset)).
XFS_EXCHANGE_RANGE_DSYNC
Ensure that all modified in-core data in both file ranges and all metadata updates pertaining to the exchange operation are flushed to persistent storage before the call returns. Opening either file de‐ scriptor with O_SYNC or O_DSYNC will have the same effect.
XFS_EXCHANGE_RANGE_FILE1_WRITTEN
Only exchange sub-ranges of file1_fd that are known to contain data written by application software. Each sub-range may be expanded (both upwards and downwards) to align with the file allocation unit. For files on the data device, this is one filesystem block. For files on the realtime device, this is the realtime extent size. This facility can be used to implement fast atomic scatter-gather writes of any complexity for software-defined storage targets if all writes are aligned to the file allocation unit.
XFS_EXCHANGE_RANGE_DRY_RUN
Check the parameters and the feasibility of the op‐ eration, but do not change anything.
RETURN VALUE
On error, -1 is returned, and errno is set to indicate the er‐ ror.
ERRORS
Error codes can be one of, but are not limited to, the follow‐ ing:
EBADF file1_fd is not open for reading and writing or is open
for append-only writes; or file2_fd is not open for reading and writing or is open for append-only writes.
EINVAL The parameters are not correct for these files. This
error can also appear if either file descriptor repre‐ sents a device, FIFO, or socket. Disk filesystems gen‐ erally require the offset and length arguments to be aligned to the fundamental block sizes of both files.
EIO An I/O error occurred.
EISDIR One of the files is a directory.
ENOMEM The kernel was unable to allocate sufficient memory to
perform the operation.
ENOSPC There is not enough free space in the filesystem ex‐
change the contents safely.
EOPNOTSUPP
The filesystem does not support exchanging bytes between the two files.
EPERM file1_fd or file2_fd are immutable.
ETXTBSY
One of the files is a swap file.
EUCLEAN
The filesystem is corrupt.
EXDEV file1_fd and file2_fd are not on the same mounted
filesystem.
CONFORMING TO
This API is XFS-specific.
USE CASES
Several use cases are imagined for this system call. In all
cases, application software must coordinate updates to the file
because the exchange is performed unconditionally.
The first is a data storage program that wants to commit non-
contiguous updates to a file atomically and coordinates write
access to that file. This can be done by creating a temporary
file, calling FICLONE(2) to share the contents, and staging the
updates into the temporary file. The FULL_FILES flag is recom‐
mended for this purpose. The temporary file can be deleted or
punched out afterwards.
An example program might look like this:
int fd = open("/some/file", O_RDWR);
int temp_fd = open("/some", O_TMPFILE | O_RDWR);
ioctl(temp_fd, FICLONE, fd);
/* append 1MB of records */
lseek(temp_fd, 0, SEEK_END);
write(temp_fd, data1, 1000000);
/* update record index */
pwrite(temp_fd, data1, 600, 98765);
pwrite(temp_fd, data2, 320, 54321);
pwrite(temp_fd, data2, 15, 0);
/* commit the entire update */
struct xfs_exchange_range args = {
.file1_fd = temp_fd,
.flags = XFS_EXCHANGE_RANGE_TO_EOF,
};
ioctl(fd, XFS_IOC_EXCHANGE_RANGE, &args);
The second is a software-defined storage host (e.g. a disk
jukebox) which implements an atomic scatter-gather write com‐
mand. Provided the exported disk's logical block size matches
the file's allocation unit size, this can be done by creating a
temporary file and writing the data at the appropriate offsets.
It is recommended that the temporary file be truncated to the
size of the regular file before any writes are staged to the
temporary file to avoid issues with zeroing during EOF exten‐
sion. Use this call with the FILE1_WRITTEN flag to exchange
only the file allocation units involved in the emulated de‐
vice's write command. The temporary file should be truncated
or punched out completely before being reused to stage another
write.
An example program might look like this:
int fd = open("/some/file", O_RDWR);
int temp_fd = open("/some", O_TMPFILE | O_RDWR);
struct stat sb;
int blksz;
fstat(fd, &sb);
blksz = sb.st_blksize;
/* land scatter gather writes between 100fsb and 500fsb */
pwrite(temp_fd, data1, blksz * 2, blksz * 100);
pwrite(temp_fd, data2, blksz * 20, blksz * 480);
pwrite(temp_fd, data3, blksz * 7, blksz * 257);
/* commit the entire update */
struct xfs_exchange_range args = {
.file1_fd = temp_fd,
.file1_offset = blksz * 100,
.file2_offset = blksz * 100,
.length = blksz * 400,
.flags = XFS_EXCHANGE_RANGE_FILE1_WRITTEN |
XFS_EXCHANGE_RANGE_FILE1_DSYNC,
};
ioctl(fd, XFS_IOC_EXCHANGE_RANGE, &args);NOTES
Some filesystems may limit the amount of data or the number of extents that can be exchanged in a single call.
SEE ALSO
ioctl(2)
XFS 2024-02-10 IOCTL-XFS-EXCHANGE-RANGE(2)
IOCTL-XFS-COMMIT-RANGE(2) System Calls ManualIOCTL-XFS-COMMIT-RANGE(2)
NAME
ioctl_xfs_start_commit - prepare to exchange the contents of two files ioctl_xfs_commit_range - conditionally exchange the contents of parts of two files
SYNOPSIS
#include <sys/ioctl.h>
#include <xfs/xfs_fs.h>
int ioctl(int file2_fd, XFS_IOC_START_COMMIT, struct xfs_com‐
mit_range *arg);
int ioctl(int file2_fd, XFS_IOC_COMMIT_RANGE, struct xfs_com‐
mit_range *arg);DESCRIPTION
Given a range of bytes in a first file file1_fd and a second range of bytes in a second file file2_fd, this ioctl(2) ex‐ changes the contents of the two ranges if file2_fd passes cer‐ tain freshness criteria.
Before exchanging the contents, the program must call the
XFS_IOC_START_COMMIT ioctl to sample freshness data for
file2_fd. If the sampled metadata does not match the file metadata at commit time, XFS_IOC_COMMIT_RANGE will return EBUSY.
Exchanges are atomic with regards to concurrent file opera‐
tions. Implementations must guarantee that readers see either
the old contents or the new contents in their entirety, even if the system fails.
The system call parameters are conveyed in structures of the following form:
struct xfs_commit_range {
__s32 file1_fd;
__u32 pad;
__u64 file1_offset;
__u64 file2_offset;
__u64 length;
__u64 flags;
__u64 file2_freshness[5];
};
The field pad must be zero.
The fields file1_fd, file1_offset, and length define the first range of bytes to be exchanged.
The fields file2_fd, file2_offset, and length define the second range of bytes to be exchanged.
The field file2_freshness is an opaque field whose contents are determined by the kernel. These file attributes are used to confirm that file2_fd has not changed by another thread since the current thread began staging its own update.
Both files must be from the same filesystem mount. If the two file descriptors represent the same file, the byte ranges must
not overlap. Most disk-based filesystems require that the
starts of both ranges must be aligned to the file block size. If this is the case, the ends of the ranges must also be so aligned unless the XFS_EXCHANGE_RANGE_TO_EOF flag is set.
The field flags control the behavior of the exchange operation.
XFS_EXCHANGE_RANGE_TO_EOF
Ignore the length parameter. All bytes in file1_fd from file1_offset to EOF are moved to file2_fd, and file2's size is set to (file2_offset+(file1_length-
file1_offset)). Meanwhile, all bytes in file2 from
file2_offset to EOF are moved to file1 and file1's
size is set to (file1_offset+(file2_length-
file2_offset)).
XFS_EXCHANGE_RANGE_DSYNC
Ensure that all modified in-core data in both file ranges and all metadata updates pertaining to the exchange operation are flushed to persistent storage before the call returns. Opening either file de‐ scriptor with O_SYNC or O_DSYNC will have the same effect.
XFS_EXCHANGE_RANGE_FILE1_WRITTEN
Only exchange sub-ranges of file1_fd that are known to contain data written by application software. Each sub-range may be expanded (both upwards and downwards) to align with the file allocation unit. For files on the data device, this is one filesystem block. For files on the realtime device, this is the realtime extent size. This facility can be used to implement fast atomic scatter-gather writes of any complexity for software-defined storage targets if all writes are aligned to the file allocation unit.
XFS_EXCHANGE_RANGE_DRY_RUN
Check the parameters and the feasibility of the op‐ eration, but do not change anything.
RETURN VALUE
On error, -1 is returned, and errno is set to indicate the er‐ ror.
ERRORS
Error codes can be one of, but are not limited to, the follow‐ ing:
EBADF file1_fd is not open for reading and writing or is open
for append-only writes; or file2_fd is not open for reading and writing or is open for append-only writes.
EBUSY The file2 inode number and timestamps supplied do not
match file2_fd.
EINVAL The parameters are not correct for these files. This
error can also appear if either file descriptor repre‐ sents a device, FIFO, or socket. Disk filesystems gen‐ erally require the offset and length arguments to be aligned to the fundamental block sizes of both files.
EIO An I/O error occurred.
EISDIR One of the files is a directory.
ENOMEM The kernel was unable to allocate sufficient memory to
perform the operation.
ENOSPC There is not enough free space in the filesystem ex‐
change the contents safely.
EOPNOTSUPP
The filesystem does not support exchanging bytes between the two files.
EPERM file1_fd or file2_fd are immutable.
ETXTBSY
One of the files is a swap file.
EUCLEAN
The filesystem is corrupt.
EXDEV file1_fd and file2_fd are not on the same mounted
filesystem.
CONFORMING TO
This API is XFS-specific.
USE CASES
Several use cases are imagined for this system call. Coordina‐
tion between multiple threads is performed by the kernel.
The first is a filesystem defragmenter, which copies the con‐
tents of a file into another file and wishes to exchange the
space mappings of the two files, provided that the original
file has not changed.
An example program might look like this:
int fd = open("/some/file", O_RDWR);
int temp_fd = open("/some", O_TMPFILE | O_RDWR);
struct stat sb;
struct xfs_commit_range args = {
.flags = XFS_EXCHANGE_RANGE_TO_EOF,
};
/* gather file2's freshness information */
ioctl(fd, XFS_IOC_START_COMMIT, &args);
fstat(fd, &sb);
/* make a fresh copy of the file with terrible alignment to avoid reflink */
clone_file_range(fd, NULL, temp_fd, NULL, 1, 0);
clone_file_range(fd, NULL, temp_fd, NULL, sb.st_size - 1, 0);
/* commit the entire update */
args.file1_fd = temp_fd;
ret = ioctl(fd, XFS_IOC_COMMIT_RANGE, &args);
if (ret && errno == EBUSY)
printf("file changed while defrag was underway");
The second is a data storage program that wants to commit non-
contiguous updates to a file atomically. This program cannot
coordinate updates to the file and therefore relies on the ker‐
nel to reject the COMMIT_RANGE command if the file has been up‐
dated by someone else. This can be done by creating a tempo‐
rary file, calling FICLONE(2) to share the contents, and stag‐
ing the updates into the temporary file. The FULL_FILES flag
is recommended for this purpose. The temporary file can be
deleted or punched out afterwards.
An example program might look like this:
int fd = open("/some/file", O_RDWR);
int temp_fd = open("/some", O_TMPFILE | O_RDWR);
struct xfs_commit_range args = {
.flags = XFS_EXCHANGE_RANGE_TO_EOF,
};
/* gather file2's freshness information */
ioctl(fd, XFS_IOC_START_COMMIT, &args);
ioctl(temp_fd, FICLONE, fd);
/* append 1MB of records */
lseek(temp_fd, 0, SEEK_END);
write(temp_fd, data1, 1000000);
/* update record index */
pwrite(temp_fd, data1, 600, 98765);
pwrite(temp_fd, data2, 320, 54321);
pwrite(temp_fd, data2, 15, 0);
/* commit the entire update */
args.file1_fd = temp_fd;
ret = ioctl(fd, XFS_IOC_COMMIT_RANGE, &args);
if (ret && errno == EBUSY)
printf("file changed before commit; will roll back");
NOTES
Some filesystems may limit the amount of data or the number of extents that can be exchanged in a single call.
SEE ALSO
ioctl(2)
XFS 2024-02-18 IOCTL-XFS-COMMIT-RANGE(2)
The reference implementation in XFS creates a new log incompat feature and log intent items to track high level progress of swapping ranges of two files and finish interrupted work if the system goes down. Sample code can be found in the corresponding changes to xfs_io to exercise the use case mentioned above.
Note that this function is /not/ the O_DIRECT atomic untorn file writes concept that has also been floating around for years. It is also not the RWF_ATOMIC patchset that has been shared. This RFC is constructed entirely in software, which means that there are no limitations other than the general filesystem limits.
As a side note, the original motivation behind the kernel functionality is online repair of file-based metadata. The atomic file content exchange is implemented as an atomic exchange of file fork mappings, which means that we can implement online reconstruction of extended attributes and directories by building a new one in another inode and exchanging the contents.
Subsequent patchsets adapt the online filesystem repair code to use atomic file exchanges. This enables repair functions to construct a clean copy of a directory, xattr information, symbolic links, realtime bitmaps, and realtime summary information in a temporary inode. If this completes successfully, the new contents can be committed atomically into the inode being repaired. This is essential to avoid making corruption problems worse if the system goes down in the middle of running repair.
For userspace, this series also includes the userspace pieces needed to test the new functionality, and a sample implementation of atomic file updates.
If you're going to start using this code, I strongly recommend pulling from my git trees, which are linked below.
This has been running on the djcloud for months with no problems. Enjoy! Comments and questions are, as always, welcome.
--D
kernel git tree:
https://git.kernel.org/cgit/linux/kernel/git/djwong/xfs-linux.git/log/?h=atomic-file-updates
xfsprogs git tree:
https://git.kernel.org/cgit/linux/kernel/git/djwong/xfsprogs-dev.git/log/?h=atomic-file-updates
fstests git tree:
https://git.kernel.org/cgit/linux/kernel/git/djwong/xfstests-dev.git/log/?h=atomic-file-updates
xfsdocs git tree:
https://git.kernel.org/cgit/linux/kernel/git/djwong/xfs-documentation.git/log/?h=atomic-file-updates
---
Commits in this patchset:
* vfs: export remap and write check helpers
* xfs: introduce new file range exchange ioctl
* xfs: create a log incompat flag for atomic file mapping exchanges
* xfs: introduce a file mapping exchange log intent item
* xfs: create deferred log items for file mapping exchanges
* xfs: bind together the front and back ends of the file range exchange code
* xfs: add error injection to test file mapping exchange recovery
* xfs: condense extended attributes after a mapping exchange operation
* xfs: condense directories after a mapping exchange operation
* xfs: condense symbolic links after a mapping exchange operation
* xfs: make file range exchange support realtime files
* xfs: support non-power-of-two rtextsize with exchange-range
* docs: update swapext -> exchmaps language
* xfs: introduce new file range commit ioctls
* xfs: enable logged file mapping exchange feature
--- .../filesystems/xfs/xfs-online-fsck-design.rst | 259 ++-- fs/read_write.c | 1 fs/remap_range.c | 4 fs/xfs/Makefile | 3 fs/xfs/libxfs/xfs_defer.c | 6 fs/xfs/libxfs/xfs_defer.h | 2 fs/xfs/libxfs/xfs_errortag.h | 4 fs/xfs/libxfs/xfs_exchmaps.c | 1237 ++++++++++++++++++++ fs/xfs/libxfs/xfs_exchmaps.h | 123 ++ fs/xfs/libxfs/xfs_format.h | 16 fs/xfs/libxfs/xfs_fs.h | 70 + fs/xfs/libxfs/xfs_log_format.h | 64 + fs/xfs/libxfs/xfs_log_recover.h | 2 fs/xfs/libxfs/xfs_sb.c | 3 fs/xfs/libxfs/xfs_symlink_remote.c | 47 + fs/xfs/libxfs/xfs_symlink_remote.h | 1 fs/xfs/libxfs/xfs_trans_space.h | 4 fs/xfs/xfs_error.c | 3 fs/xfs/xfs_exchmaps_item.c | 599 ++++++++++ fs/xfs/xfs_exchmaps_item.h | 64 + fs/xfs/xfs_exchrange.c | 882 ++++++++++++++ fs/xfs/xfs_exchrange.h | 50 + fs/xfs/xfs_ioctl.c | 126 ++ fs/xfs/xfs_log_recover.c | 2 fs/xfs/xfs_mount.h | 5 fs/xfs/xfs_super.c | 19 fs/xfs/xfs_symlink.c | 49 - fs/xfs/xfs_trace.c | 2 fs/xfs/xfs_trace.h | 382 ++++++ include/linux/fs.h | 1 30 files changed, 3855 insertions(+), 175 deletions(-) create mode 100644 fs/xfs/libxfs/xfs_exchmaps.c create mode 100644 fs/xfs/libxfs/xfs_exchmaps.h create mode 100644 fs/xfs/xfs_exchmaps_item.c create mode 100644 fs/xfs/xfs_exchmaps_item.h create mode 100644 fs/xfs/xfs_exchrange.c create mode 100644 fs/xfs/xfs_exchrange.h
PATCH 1/15 vfs: export remap and write check helpers
From: Darrick J. Wong <[email protected]>
Export these functions so that the next patch can use them to check the file ranges being passed to the XFS_IOC_EXCHANGE_RANGE operation.
--- fs/read_write.c | 1 + fs/remap_range.c | 4 ++-- include/linux/fs.h | 1 + 3 files changed, 4 insertions(+), 2 deletions(-)
fs/read_write.c +1 -0
@@ -1667,6 +1667,7 @@ int generic_write_check_limits(struct file *file, loff_t pos, loff_t *count)return 0 ; } +EXPORT_SYMBOL_GPL (generic_write_check_limits);/* Like generic_write_checks(), but takes size of write instead of iter. */ int generic_write_checks_count (struct kiocb *iocb,loff_t *count)
fs/remap_range.c +2 -2
@@ -99,8 +99,7 @@ static int generic_remap_checks(struct file *file_in, loff_t pos_in,return 0 ; } -static int remap_verify_area (struct file *file,loff_t pos,loff_t len, -bool write) +int remap_verify_area (struct file *file,loff_t pos,loff_t len,bool write) {int mask = write ?MAY_WRITE :MAY_READ ;loff_t tmp;
@@ -118,6 +117,7 @@ static int remap_verify_area(struct file *file, loff_t pos, loff_t len,return fsnotify_file_area_perm (file, mask, &pos, len); } +EXPORT_SYMBOL_GPL (remap_verify_area);/* * Ensure that we don't remap a partial EOF block in the middle of something
include/linux/fs.h +1 -0
@@ -2117,6 +2117,7 @@ extern ssize_t vfs_read(struct file *, char __user *, size_t, loff_t *);extern ssize_t vfs_write (struct file *,const char __user *,size_t ,loff_t *);extern ssize_t vfs_copy_file_range (struct file *,loff_t ,struct file *,loff_t ,size_t ,unsigned int ); +int remap_verify_area (struct file *file,loff_t pos,loff_t len,bool write); int __generic_remap_file_range_prep(struct file *file_in, loff_t pos_in, struct file *file_out, loff_t pos_out, loff_t *len, unsigned int remap_flags,
Re: [PATCH 01/15] vfs: export remap and write check helpers
Seems like this is the only patch Cc'ed to the fsdevel list. Which makes it really hard for anyone not on the XFS list to actually review this properly as they won't see the caller.
Re: [PATCH 01/15] vfs: export remap and write check helpers
Quoted 4 lines · Christoph Hellwig
Seems like this is the only patch Cc'ed to the fsdevel list. Which makes it really hard for anyone not on the XFS list to actually review this properly as they won't see the caller.
Oops, I forgot to add fsdevel to the cc list for this series. I'll resend the series.
--D
PATCH 2/15 xfs: introduce new file range exchange ioctl
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
Introduce a new ioctl to handle exchanging ranges of bytes between files. The goal here is to perform the exchange atomically with respect to applications -- either they see the file contents before the exchange or they see that A-B is now B-A, even if the kernel crashes.
My original goal with all this code was to make it so that online repair can build a replacement directory or xattr structure in a temporary file and commit the repair by atomically exchanging all the data blocks between the two files. However, I needed a way to test this mechanism thoroughly, so I've been evolving an ioctl interface since then.
--- fs/xfs/Makefile | 1 fs/xfs/libxfs/xfs_fs.h | 41 ++++++ fs/xfs/xfs_exchrange.c | 304 ++++++++++++++++++++++++++++++++++++++++++++++++ fs/xfs/xfs_exchrange.h | 34 +++++ fs/xfs/xfs_ioctl.c | 38 ++++++ 5 files changed, 418 insertions(+) create mode 100644 fs/xfs/xfs_exchrange.c create mode 100644 fs/xfs/xfs_exchrange.h
fs/xfs/Makefile +1 -0
@@ -67,6 +67,7 @@ xfs-y += xfs_aops.o \ xfs_dir2_readdir.o \ xfs_discard.o \ xfs_error.o \ + xfs_exchrange.o \ xfs_export.o \ xfs_extent_busy.o \ xfs_file.o \
fs/xfs/libxfs/xfs_fs.h +41 -0
53 lines not on this page · raw message
fs/xfs/xfs_exchrange.c new file +304 -0
304 lines not on this page · raw message
fs/xfs/xfs_exchrange.h new file +34 -0
@@ -0,0 +1,34 @@ +/* SPDX-License-Identifier: GPL-2.0-or-later */ +/* +* Copyright (c) 2020-2024 Oracle. All Rights Reserved. +* Author: Darrick J. Wong <[email protected]> +*/ +#ifndef __XFS_EXCHRANGE_H__ +#define __XFS_EXCHRANGE_H__ + +/* Update the mtime/cmtime of file1 and file2 */ +#define __XFS_EXCHANGE_RANGE_UPD_CMTIME1 (1ULL << 63) +#define __XFS_EXCHANGE_RANGE_UPD_CMTIME2 (1ULL << 62) + +#define XFS_EXCHANGE_RANGE_PRIV_FLAGS (__XFS_EXCHANGE_RANGE_UPD_CMTIME1 | \ + __XFS_EXCHANGE_RANGE_UPD_CMTIME2) + +struct xfs_exchrange { +struct file *file1; +struct file *file2; + +loff_t file1_offset; +loff_t file2_offset; +u64 length; + +u64 flags;/* XFS_EXCHANGE_RANGE flags */ + +/* file2 metadata for freshness checks if file1_ino != 0 */ +u64 file2_ino; +struct timespec64 file2_mtime; +struct timespec64 file2_ctime; +}; + +int xfs_exchange_range (struct xfs_exchrange *fxr); + +#endif /* __XFS_EXCHRANGE_H__ */
fs/xfs/xfs_ioctl.c +38 -0
@@ -40,6 +40,7 @@#include "xfs_xattr.h" #include "xfs_rtbitmap.h" #include "xfs_file.h" +#include "xfs_exchrange.h" #include <linux/mount.h> #include <linux/namei.h>
@@ -1930,6 +1931,40 @@ xfs_ioctl_fs_counts(return 0 ; } +static long +xfs_ioc_exchange_range ( +struct file *file, +struct xfs_exchange_range __user *argp) +{ +struct xfs_exchrange fxr = { + .file2 = file, + }; +struct xfs_exchange_range args; +struct fd file1; +int error; + +if (copy_from_user (&args, argp,sizeof (args))) +return -EFAULT ; +if (memchr_inv (&args.pad,0 ,sizeof (args.pad))) +return -EINVAL ; +if (args.flags & ~XFS_EXCHANGE_RANGE_ALL_FLAGS ) +return -EINVAL ; + + fxr.file1_offset = args.file1_offset; + fxr.file2_offset = args.file2_offset; + fxr.length = args.length; + fxr.flags = args.flags; + + file1 =fdget (args.file1_fd); +if (!file1.file) +return -EBADF ; + fxr.file1 = file1.file; + + error =xfs_exchange_range (&fxr); +fdput (file1); +return error; +} +/* * These long-unused ioctls were removed from the official ioctl API in 5.17, * but retain these definitions so that we can log warnings about them.
@@ -2170,6 +2205,9 @@ xfs_file_ioctl(return error; } +case XFS_IOC_EXCHANGE_RANGE : +return xfs_ioc_exchange_range (filp, arg); +default :return -ENOTTY ; }
Re: [PATCH 02/15] xfs: introduce new file range exchange ioctl
Looks good:
PATCH 3/15 xfs: create a log incompat flag for atomic file mapping exchanges
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
Create a log incompat flag so that we only attempt to process file mapping exchange log items if the filesystem supports it, and a geometry flag to advertise support if it's present or could be present.
--- fs/xfs/libxfs/xfs_format.h | 13 +++++++++++++ fs/xfs/libxfs/xfs_fs.h | 3 +++ fs/xfs/libxfs/xfs_sb.c | 3 +++ fs/xfs/xfs_exchrange.c | 31 +++++++++++++++++++++++++++++++ fs/xfs/xfs_exchrange.h | 2 ++ 5 files changed, 52 insertions(+)
fs/xfs/libxfs/xfs_format.h +13 -0
@@ -391,6 +391,12 @@ xfs_sb_has_incompat_feature( }#define XFS_SB_FEAT_INCOMPAT_LOG_XATTRS (1 << 0)/* Delayed Attributes */ + +/* +* Log contains file mapping exchange log intent items which are not otherwise +* protected by an INCOMPAT/RO_COMPAT feature flag. +*/ +#define XFS_SB_FEAT_INCOMPAT_LOG_EXCHMAPS (1 << 1)#define XFS_SB_FEAT_INCOMPAT_LOG_ALL \ (XFS_SB_FEAT_INCOMPAT_LOG_XATTRS)#define XFS_SB_FEAT_INCOMPAT_LOG_UNKNOWN ~XFS_SB_FEAT_INCOMPAT_LOG_ALL
@@ -423,6 +429,13 @@ static inline bool xfs_sb_version_haslogxattrs(struct xfs_sb *sbp) XFS_SB_FEAT_INCOMPAT_LOG_XATTRS); } +static inline bool xfs_sb_version_haslogexchmaps (struct xfs_sb *sbp) +{ +return xfs_sb_is_v5 (sbp) && + (sbp->sb_features_log_incompat & +XFS_SB_FEAT_INCOMPAT_LOG_EXCHMAPS ); +} +static inline bool xfs_is_quota_inode (struct xfs_sb *sbp,xfs_ino_t ino) {
fs/xfs/libxfs/xfs_fs.h +3 -0
@@ -240,6 +240,9 @@ typedef struct xfs_fsop_resblks {#define XFS_FSOP_GEOM_FLAGS_INOBTCNT (1 << 22)/* inobt btree counter */ #define XFS_FSOP_GEOM_FLAGS_NREXT64 (1 << 23)/* large extent counters */ +/* file range exchange available to userspace */ +#define XFS_FSOP_GEOM_FLAGS_EXCHANGE_RANGE (1 << 24) +/* * Minimum and maximum sizes need for growth checks. *
fs/xfs/libxfs/xfs_sb.c +3 -0
@@ -26,6 +26,7 @@#include "xfs_health.h" #include "xfs_ag.h" #include "xfs_rtbitmap.h" +#include "xfs_exchrange.h" /* * Physical superblock buffer manipulations. Shared with libxfs in userspace.
@@ -1258,6 +1259,8 @@ xfs_fs_geometry( }if (xfs_has_large_extent_counts (mp)) geo->flags |=XFS_FSOP_GEOM_FLAGS_NREXT64 ; +if (xfs_exchrange_possible (mp)) + geo->flags |=XFS_FSOP_GEOM_FLAGS_EXCHANGE_RANGE ; geo->rtsectsize = sbp->sb_blocksize; geo->dirblocksize =xfs_dir2_dirblock_bytes (sbp);
fs/xfs/xfs_exchrange.c +31 -0
@@ -15,6 +15,37 @@#include "xfs_exchrange.h" #include <linux/fsnotify.h> +/* +* If the filesystem has relatively new features enabled, we're willing to +* upgrade the filesystem to have the EXCHMAPS log incompat feature. +* Technically we could do this with any V5 filesystem, but let's not deal +* with really old kernels. +*/ +static inline bool +xfs_exchrange_upgradeable ( +struct xfs_mount *mp) +{ +return xfs_has_bigtime (mp) ||xfs_has_large_extent_counts (mp); +} + +/* +* Decide if we should advertise to userspace the potential for using file +* range exchanges on this filesystem. This does not say anything about the +* actual readiness to start such an operation. +*/ +bool +xfs_exchrange_possible ( +struct xfs_mount *mp) +{ +/* Always possible when mapping exchange log intent items are enabled */ +if (xfs_sb_version_haslogexchmaps (&mp->m_sb)) +return true; + +/* Can we upgrade the fs to have the log intent item? */ +return xfs_exchrange_upgradeable (mp) && +xfs_can_add_incompat_log_features (mp, false); +} +/* * Generic code for exchanging ranges of two files via XFS_IOC_EXCHANGE_RANGE. * This part deals with struct file objects and byte ranges and does not deal
fs/xfs/xfs_exchrange.h +2 -0
@@ -6,6 +6,8 @@#ifndef __XFS_EXCHRANGE_H__#define __XFS_EXCHRANGE_H__ +bool xfs_exchrange_possible (struct xfs_mount *mp); +/* Update the mtime/cmtime of file1 and file2 */ #define __XFS_EXCHANGE_RANGE_UPD_CMTIME1 (1ULL << 63)#define __XFS_EXCHANGE_RANGE_UPD_CMTIME2 (1ULL << 62)
Re: [PATCH 03/15] xfs: create a log incompat flag for atomic file mapping exchanges
Quoted 88 lines · Darrick J. Wong
From: Darrick J. Wong <[email protected]>
Create a log incompat flag so that we only attempt to process file mapping exchange log items if the filesystem supports it, and a geometry flag to advertise support if it's present or could be present.
Signed-off-by Darrick J. Wong <[email protected]>Reviewed-by Christoph Hellwig <[email protected]>--- fs/xfs/libxfs/xfs_format.h | 13 +++++++++++++ fs/xfs/libxfs/xfs_fs.h | 3 +++ fs/xfs/libxfs/xfs_sb.c | 3 +++ fs/xfs/xfs_exchrange.c | 31 +++++++++++++++++++++++++++++++ fs/xfs/xfs_exchrange.h | 2 ++ 5 files changed, 52 insertions(+)fs/xfs/libxfs/xfs_format.h +13
-0@@ -391,6 +391,12 @@ xfs_sb_has_incompat_feature( }#define XFS_SB_FEAT_INCOMPAT_LOG_XATTRS (1 << 0)/* Delayed Attributes */ + +/* +* Log contains file mapping exchange log intent items which are not otherwise +* protected by an INCOMPAT/RO_COMPAT feature flag. +*/ +#define XFS_SB_FEAT_INCOMPAT_LOG_EXCHMAPS (1 << 1)#define XFS_SB_FEAT_INCOMPAT_LOG_ALL \ (XFS_SB_FEAT_INCOMPAT_LOG_XATTRS)#define XFS_SB_FEAT_INCOMPAT_LOG_UNKNOWN ~XFS_SB_FEAT_INCOMPAT_LOG_ALL@@ -423,6 +429,13 @@ static inline bool xfs_sb_version_haslogxattrs(struct xfs_sb *sbp) XFS_SB_FEAT_INCOMPAT_LOG_XATTRS); } +static inline bool xfs_sb_version_haslogexchmaps (struct xfs_sb *sbp) +{ +return xfs_sb_is_v5 (sbp) && + (sbp->sb_features_log_incompat & +XFS_SB_FEAT_INCOMPAT_LOG_EXCHMAPS ); +} +static inline bool xfs_is_quota_inode (struct xfs_sb *sbp,xfs_ino_t ino) {fs/xfs/libxfs/xfs_fs.h +3
-0@@ -240,6 +240,9 @@ typedef struct xfs_fsop_resblks {#define XFS_FSOP_GEOM_FLAGS_INOBTCNT (1 << 22)/* inobt btree counter */ #define XFS_FSOP_GEOM_FLAGS_NREXT64 (1 << 23)/* large extent counters */ +/* file range exchange available to userspace */ +#define XFS_FSOP_GEOM_FLAGS_EXCHANGE_RANGE (1 << 24) +/* * Minimum and maximum sizes need for growth checks. * fs/xfs/libxfs/xfs_sb.c +3
-0@@ -26,6 +26,7 @@#include "xfs_health.h" #include "xfs_ag.h" #include "xfs_rtbitmap.h" +#include "xfs_exchrange.h" /* * Physical superblock buffer manipulations. Shared with libxfs in userspace. @@ -1258,6 +1259,8 @@ xfs_fs_geometry( }if (xfs_has_large_extent_counts (mp)) geo->flags |=XFS_FSOP_GEOM_FLAGS_NREXT64 ; +if (xfs_exchrange_possible (mp)) + geo->flags |=XFS_FSOP_GEOM_FLAGS_EXCHANGE_RANGE ; geo->rtsectsize = sbp->sb_blocksize; geo->dirblocksize =xfs_dir2_dirblock_bytes (sbp);fs/xfs/xfs_exchrange.c +0
-0
fs/xfs/xfs_exchrange.c line 23
Quoted 9 lines
fs/xfs/xfs_exchrange.c +6
-0@@ -15,6 +15,37 @@#include "xfs_exchrange.h" #include <linux/fsnotify.h> +/* +* If the filesystem has relatively new features enabled, we're willing to +* upgrade the filesystem to have the EXCHMAPS log incompat feature. +* Technically we could do this with any V5 filesystem, but let's not deal +* with really old kernels. +*/
Please document tnis in the commit message - this decision needs to be seen by anyone reading the commit history rather than the code...
-Dave.
Signature · 2 lines
Dave Chinner [email protected]
Re: [PATCH 03/15] xfs: create a log incompat flag for atomic file mapping exchanges
Quoted 92 lines · Dave Chinner
Quoted 91 lines · Darrick J. Wong
From: Darrick J. Wong <[email protected]>
Create a log incompat flag so that we only attempt to process file mapping exchange log items if the filesystem supports it, and a geometry flag to advertise support if it's present or could be present.
Signed-off-by Darrick J. Wong <[email protected]>Reviewed-by Christoph Hellwig <[email protected]>--- fs/xfs/libxfs/xfs_format.h | 13 +++++++++++++ fs/xfs/libxfs/xfs_fs.h | 3 +++ fs/xfs/libxfs/xfs_sb.c | 3 +++ fs/xfs/xfs_exchrange.c | 31 +++++++++++++++++++++++++++++++ fs/xfs/xfs_exchrange.h | 2 ++ 5 files changed, 52 insertions(+)fs/xfs/libxfs/xfs_format.h +13
-0@@ -391,6 +391,12 @@ xfs_sb_has_incompat_feature( }#define XFS_SB_FEAT_INCOMPAT_LOG_XATTRS (1 << 0)/* Delayed Attributes */ + +/* +* Log contains file mapping exchange log intent items which are not otherwise +* protected by an INCOMPAT/RO_COMPAT feature flag. +*/ +#define XFS_SB_FEAT_INCOMPAT_LOG_EXCHMAPS (1 << 1)#define XFS_SB_FEAT_INCOMPAT_LOG_ALL \ (XFS_SB_FEAT_INCOMPAT_LOG_XATTRS)#define XFS_SB_FEAT_INCOMPAT_LOG_UNKNOWN ~XFS_SB_FEAT_INCOMPAT_LOG_ALL@@ -423,6 +429,13 @@ static inline bool xfs_sb_version_haslogxattrs(struct xfs_sb *sbp) XFS_SB_FEAT_INCOMPAT_LOG_XATTRS); } +static inline bool xfs_sb_version_haslogexchmaps (struct xfs_sb *sbp) +{ +return xfs_sb_is_v5 (sbp) && + (sbp->sb_features_log_incompat & +XFS_SB_FEAT_INCOMPAT_LOG_EXCHMAPS ); +} +static inline bool xfs_is_quota_inode (struct xfs_sb *sbp,xfs_ino_t ino) {fs/xfs/libxfs/xfs_fs.h +3
-0@@ -240,6 +240,9 @@ typedef struct xfs_fsop_resblks {#define XFS_FSOP_GEOM_FLAGS_INOBTCNT (1 << 22)/* inobt btree counter */ #define XFS_FSOP_GEOM_FLAGS_NREXT64 (1 << 23)/* large extent counters */ +/* file range exchange available to userspace */ +#define XFS_FSOP_GEOM_FLAGS_EXCHANGE_RANGE (1 << 24) +/* * Minimum and maximum sizes need for growth checks. * fs/xfs/libxfs/xfs_sb.c +3
-0@@ -26,6 +26,7 @@#include "xfs_health.h" #include "xfs_ag.h" #include "xfs_rtbitmap.h" +#include "xfs_exchrange.h" /* * Physical superblock buffer manipulations. Shared with libxfs in userspace. @@ -1258,6 +1259,8 @@ xfs_fs_geometry( }if (xfs_has_large_extent_counts (mp)) geo->flags |=XFS_FSOP_GEOM_FLAGS_NREXT64 ; +if (xfs_exchrange_possible (mp)) + geo->flags |=XFS_FSOP_GEOM_FLAGS_EXCHANGE_RANGE ; geo->rtsectsize = sbp->sb_blocksize; geo->dirblocksize =xfs_dir2_dirblock_bytes (sbp);fs/xfs/xfs_exchrange.c +0
-0@@ -15,6 +15,37 @@#include "xfs_exchrange.h" #include <linux/fsnotify.h>
Quoted 9 lines
fs/xfs/xfs_exchrange.c line 23
Quoted 6 lines
fs/xfs/xfs_exchrange.c +6
-0+/* +* If the filesystem has relatively new features enabled, we're willing to +* upgrade the filesystem to have the EXCHMAPS log incompat feature. +* Technically we could do this with any V5 filesystem, but let's not deal +* with really old kernels. +*/ Please document tnis in the commit message - this decision needs to be seen by anyone reading the commit history rather than the code...
This is irrelevant seeing as this whole patchset now uses a regular incompat bit, but who actually reads *only* the commit history and ignores the code?
--D
Quoted 5 lines
-Dave.
Signature · 2 lines
Dave Chinner [email protected]
PATCH 4/15 xfs: introduce a file mapping exchange log intent item
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
Introduce a new intent log item to handle exchanging mappings between the forks of two files.
--- fs/xfs/Makefile | 1 fs/xfs/libxfs/xfs_log_format.h | 42 ++++++- fs/xfs/libxfs/xfs_log_recover.h | 2 fs/xfs/xfs_exchmaps_item.c | 235 +++++++++++++++++++++++++++++++++++++++ fs/xfs/xfs_exchmaps_item.h | 59 ++++++++++ fs/xfs/xfs_log_recover.c | 2 fs/xfs/xfs_super.c | 19 +++ 7 files changed, 357 insertions(+), 3 deletions(-) create mode 100644 fs/xfs/xfs_exchmaps_item.c create mode 100644 fs/xfs/xfs_exchmaps_item.h
fs/xfs/Makefile +1 -0
@@ -102,6 +102,7 @@ xfs-y += xfs_log.o \ xfs_buf_item.o \ xfs_buf_item_recover.o \ xfs_dquot_item_recover.o \ + xfs_exchmaps_item.o \ xfs_extfree_item.o \ xfs_attr_item.o \ xfs_icreate_item.o \
fs/xfs/libxfs/xfs_log_format.h +39 -3
66 lines not on this page · raw message
fs/xfs/libxfs/xfs_log_recover.h +2 -0
@@ -75,6 +75,8 @@ extern const struct xlog_recover_item_ops xlog_cui_item_ops;extern const struct xlog_recover_item_ops xlog_cud_item_ops;extern const struct xlog_recover_item_ops xlog_attri_item_ops;extern const struct xlog_recover_item_ops xlog_attrd_item_ops; +extern const struct xlog_recover_item_ops xlog_xmi_item_ops; +extern const struct xlog_recover_item_ops xlog_xmd_item_ops;/* * Macros, structures, prototypes for internal log manager use.
fs/xfs/xfs_exchmaps_item.c new file +235 -0
235 lines not on this page · raw message
fs/xfs/xfs_exchmaps_item.h new file +59 -0
59 lines not on this page · raw message
fs/xfs/xfs_log_recover.c +2 -0
@@ -1789,6 +1789,8 @@ static const struct xlog_recover_item_ops *xlog_recover_item_ops[] = { &xlog_bud_item_ops, &xlog_attri_item_ops, &xlog_attrd_item_ops, + &xlog_xmi_item_ops, + &xlog_xmd_item_ops, }; static const struct xlog_recover_item_ops *
fs/xfs/xfs_super.c +19 -0
@@ -43,6 +43,7 @@#include "xfs_iunlink_item.h" #include "xfs_dahash_test.h" #include "xfs_rtbitmap.h" +#include "xfs_exchmaps_item.h" #include "scrub/stats.h" #include "scrub/rcbag_btree.h"
@@ -2195,8 +2196,24 @@ xfs_init_caches(void)if (!xfs_iunlink_cache) goto out_destroy_attri_cache; + xfs_xmd_cache =kmem_cache_create ("xfs_xmd_item" , +sizeof (struct xfs_xmd_log_item ), +0 ,0 ,NULL ); +if (!xfs_xmd_cache) + goto out_destroy_iul_cache; + + xfs_xmi_cache =kmem_cache_create ("xfs_xmi_item" , +sizeof (struct xfs_xmi_log_item ), +0 ,0 ,NULL ); +if (!xfs_xmi_cache) + goto out_destroy_xmd_cache; +return 0 ; + out_destroy_xmd_cache: +kmem_cache_destroy (xfs_xmd_cache); + out_destroy_iul_cache: +kmem_cache_destroy (xfs_iunlink_cache); out_destroy_attri_cache:kmem_cache_destroy (xfs_attri_cache); out_destroy_attrd_cache:
@@ -2253,6 +2270,8 @@ xfs_destroy_caches(void)* destroy caches. */ rcu_barrier (); +kmem_cache_destroy (xfs_xmd_cache); +kmem_cache_destroy (xfs_xmi_cache);kmem_cache_destroy (xfs_iunlink_cache);kmem_cache_destroy (xfs_attri_cache);kmem_cache_destroy (xfs_attrd_cache);
Re: [PATCH 04/15] xfs: introduce a file mapping exchange log intent item
Quoted 72 lines · Darrick J. Wong
From: Darrick J. Wong <[email protected]>
Introduce a new intent log item to handle exchanging mappings between the forks of two files.
Signed-off-by Darrick J. Wong <[email protected]>Reviewed-by Christoph Hellwig <[email protected]>--- fs/xfs/Makefile | 1 fs/xfs/libxfs/xfs_log_format.h | 42 ++++++- fs/xfs/libxfs/xfs_log_recover.h | 2 fs/xfs/xfs_exchmaps_item.c | 235 +++++++++++++++++++++++++++++++++++++++ fs/xfs/xfs_exchmaps_item.h | 59 ++++++++++ fs/xfs/xfs_log_recover.c | 2 fs/xfs/xfs_super.c | 19 +++ 7 files changed, 357 insertions(+), 3 deletions(-) create mode 100644 fs/xfs/xfs_exchmaps_item.c create mode 100644 fs/xfs/xfs_exchmaps_item.hfs/xfs/Makefile +1
-0@@ -102,6 +102,7 @@ xfs-y += xfs_log.o \ xfs_buf_item.o \ xfs_buf_item_recover.o \ xfs_dquot_item_recover.o \ + xfs_exchmaps_item.o \ xfs_extfree_item.o \ xfs_attr_item.o \ xfs_icreate_item.o \fs/xfs/libxfs/xfs_log_format.h +8
-3@@ -117,8 +117,9 @@ struct xfs_unmount_log_format {#define XLOG_REG_TYPE_ATTRD_FORMAT 28#define XLOG_REG_TYPE_ATTR_NAME 29#define XLOG_REG_TYPE_ATTR_VALUE 30 -#define XLOG_REG_TYPE_MAX 30 - +#define XLOG_REG_TYPE_XMI_FORMAT 31 +#define XLOG_REG_TYPE_XMD_FORMAT 32 +#define XLOG_REG_TYPE_MAX 32/* * Flags to log operation header @@ -243,6 +244,8 @@ typedef struct xfs_trans_header {#define XFS_LI_BUD 0x1245#define XFS_LI_ATTRI 0x1246/* attr set/remove intent*/ #define XFS_LI_ATTRD 0x1247/* attr set/remove done */ +#define XFS_LI_XMI 0x1248/* mapping exchange intent */ +#define XFS_LI_XMD 0x1249/* mapping exchange done */ #define XFS_LI_TYPE_DESC \ { XFS_LI_EFI, "XFS_LI_EFI" }, \@@ -260,7 +263,9 @@ typedef struct xfs_trans_header { { XFS_LI_BUI, "XFS_LI_BUI" }, \ { XFS_LI_BUD, "XFS_LI_BUD" }, \ { XFS_LI_ATTRI, "XFS_LI_ATTRI" }, \ - { XFS_LI_ATTRD, "XFS_LI_ATTRD" } + { XFS_LI_ATTRD, "XFS_LI_ATTRD" }, \ + { XFS_LI_XMI, "XFS_LI_XMI" }, \ + { XFS_LI_XMD, "XFS_LI_XMD" }/* * Inode Log Item Format definitions. @@ -878,6 +883,37 @@ struct xfs_bud_log_format {uint64_t bud_bui_id;/* id of corresponding bui */ };
fs/xfs/libxfs/xfs_log_format.h struct xfs_bud_log_format { · line 895
Quoted 10 lines
fs/xfs/libxfs/xfs_log_format.h +10
-0+/* +* XMI/XMD (file mapping exchange) log format definitions +*/ + +/* This is the structure used to lay out an mapping exchange log item. */ +struct xfs_xmi_log_format { +uint16_t xmi_type;/* xmi log item type */ +uint16_t xmi_size;/* size of this item */ +uint32_t __pad;/* must be zero */ +uint64_t xmi_id;/* xmi identifier */
Why does this ID need to be a 64 bit ID? If it is 32 bit, then there's no need for any padding, and it doesn't seem likely to me that we'd have millions of exchanges in flight at once.
(Edit: I see why later - I address it there....)
fs/xfs/libxfs/xfs_log_format.h struct xfs_bud_log_format { · line 898
Quoted 3 lines
fs/xfs/libxfs/xfs_log_format.h +3
-0+ +uint64_t xmi_inode1;/* inumber of first file */ +uint64_t xmi_inode2;/* inumber of second file */
Inode numbers are not unique identifiers. Intents get replayed after everything else has been replayed, including inode unlink and reallocation.
Without a generation number, there is no way to determine if the inode number in the intent is actually pointing at the correct inode when we go to replay the intent.
Yes, I know it's unlikely that this might occur, but I'd much prefer that we fully identify inodes in the on-disk metadata so we can check it at recovery time than leaving it out and just hoping we are operating on the correct inode life-cycle...
fs/xfs/libxfs/xfs_log_format.h struct xfs_bud_log_format { · line 904
Quoted 6 lines
fs/xfs/libxfs/xfs_log_format.h +6
-0+uint64_t xmi_startoff1;/* block offset into file1 */ +uint64_t xmi_startoff2;/* block offset into file2 */ +uint64_t xmi_blockcount;/* number of blocks */ +uint64_t xmi_flags;/* XFS_EXCHMAPS_* */ +uint64_t xmi_isize1;/* intended file1 size */ +uint64_t xmi_isize2;/* intended file2 size */
How do these inode sizes differ from xmi_startoff{1,2} + xmi_blockcount?
fs/xfs/libxfs/xfs_log_format.h struct xfs_bud_log_format { · line 916
Quoted 12 lines
fs/xfs/libxfs/xfs_log_format.h +12
-0+/* Allocate and initialize an xmi item. */ +STATIC struct xfs_xmi_log_item * +xfs_xmi_init ( +struct xfs_mount *mp) + +{ +struct xfs_xmi_log_item *xmi_lip; + + xmi_lip =kmem_cache_zalloc (xfs_xmi_cache,GFP_KERNEL | __GFP_NOFAIL); + +xfs_log_item_init (mp, &xmi_lip->xmi_item,XFS_LI_XMI , &xfs_xmi_item_ops); + xmi_lip->xmi_format.xmi_id = (uintptr_t )(void *)xmi_lip;
OK. Encoding the pointer as the ID is a mistake we made with EFIs and we should stop repeating it in all new intents. There is no guarantee that the pointer is a unique identifier because these are allocated out of a slab cache. Hence we can allocate an xmi, log it, finish the xmds, free the xmi, then run another exchange and get exactly the same XMI pointer returned to us for the new exchange intent. Now we potentially have multiple exchange items in the journal with the same ID.
Can we use a u32 and get_random_u32() for the ID here, please? We already do this for checkpoint discrimination in the log (i.e. to identify what checkpoint an ophdr belongs to), so we really should be doing the same for all ids we use in the journal for matching items.
Longer term, We probably should move all the intent/done identifiers to a psuedo random identifier mechanism, but that's outside the scope of this change....
Quoted 22 lines
fs/xfs/libxfs/xfs_log_format.h +22
-0+/* +* This routine is called to create an in-core file mapping exchange item from +* the xmi format structure which was logged on disk. It allocates an in-core +* xmi, copies the exchange information from the format structure into it, and +* adds the xmi to the AIL with the given LSN. +*/ +STATIC int +xlog_recover_xmi_commit_pass2 ( +struct xlog *log, +struct list_head *buffer_list, +struct xlog_recover_item *item, +xfs_lsn_t lsn) +{ +struct xfs_mount *mp = log->l_mp; +struct xfs_xmi_log_item *xmi_lip; +struct xfs_xmi_log_format *xmi_formatp; +size_t len; + + len =sizeof (struct xfs_xmi_log_format ); +if (item->ri_buf[0 ].i_len != len) { +XFS_ERROR_REPORT (__func__,XFS_ERRLEVEL_LOW , log->l_mp); +return -EFSCORRUPTED ;
fs/xfs/libxfs/xfs_log_format.h struct xfs_bud_log_format {
Quoted 10 lines
fs/xfs/libxfs/xfs_log_format.h +10
-0+ } + + xmi_formatp = item->ri_buf[0 ].i_addr; +if (xmi_formatp->__pad !=0 ) { +XFS_ERROR_REPORT (__func__,XFS_ERRLEVEL_LOW , log->l_mp); +return -EFSCORRUPTED ; + } + + xmi_lip =xfs_xmi_init (mp); +memcpy (&xmi_lip->xmi_format, xmi_formatp, len);
Should this be validating that the structure contents are within valid ranges?
-Dave.
Signature · 2 lines
Dave Chinner [email protected]
Re: [PATCH 04/15] xfs: introduce a file mapping exchange log intent item
Quoted 98 lines · Dave Chinner
Quoted 72 lines · Darrick J. Wong
From: Darrick J. Wong <[email protected]>
Introduce a new intent log item to handle exchanging mappings between the forks of two files.
Signed-off-by Darrick J. Wong <[email protected]>Reviewed-by Christoph Hellwig <[email protected]>--- fs/xfs/Makefile | 1 fs/xfs/libxfs/xfs_log_format.h | 42 ++++++- fs/xfs/libxfs/xfs_log_recover.h | 2 fs/xfs/xfs_exchmaps_item.c | 235 +++++++++++++++++++++++++++++++++++++++ fs/xfs/xfs_exchmaps_item.h | 59 ++++++++++ fs/xfs/xfs_log_recover.c | 2 fs/xfs/xfs_super.c | 19 +++ 7 files changed, 357 insertions(+), 3 deletions(-) create mode 100644 fs/xfs/xfs_exchmaps_item.c create mode 100644 fs/xfs/xfs_exchmaps_item.hfs/xfs/Makefile +1
-0@@ -102,6 +102,7 @@ xfs-y += xfs_log.o \ xfs_buf_item.o \ xfs_buf_item_recover.o \ xfs_dquot_item_recover.o \ + xfs_exchmaps_item.o \ xfs_extfree_item.o \ xfs_attr_item.o \ xfs_icreate_item.o \fs/xfs/libxfs/xfs_log_format.h +8
-3@@ -117,8 +117,9 @@ struct xfs_unmount_log_format {#define XLOG_REG_TYPE_ATTRD_FORMAT 28#define XLOG_REG_TYPE_ATTR_NAME 29#define XLOG_REG_TYPE_ATTR_VALUE 30 -#define XLOG_REG_TYPE_MAX 30 - +#define XLOG_REG_TYPE_XMI_FORMAT 31 +#define XLOG_REG_TYPE_XMD_FORMAT 32 +#define XLOG_REG_TYPE_MAX 32/* * Flags to log operation header @@ -243,6 +244,8 @@ typedef struct xfs_trans_header {#define XFS_LI_BUD 0x1245#define XFS_LI_ATTRI 0x1246/* attr set/remove intent*/ #define XFS_LI_ATTRD 0x1247/* attr set/remove done */ +#define XFS_LI_XMI 0x1248/* mapping exchange intent */ +#define XFS_LI_XMD 0x1249/* mapping exchange done */ #define XFS_LI_TYPE_DESC \ { XFS_LI_EFI, "XFS_LI_EFI" }, \@@ -260,7 +263,9 @@ typedef struct xfs_trans_header { { XFS_LI_BUI, "XFS_LI_BUI" }, \ { XFS_LI_BUD, "XFS_LI_BUD" }, \ { XFS_LI_ATTRI, "XFS_LI_ATTRI" }, \ - { XFS_LI_ATTRD, "XFS_LI_ATTRD" } + { XFS_LI_ATTRD, "XFS_LI_ATTRD" }, \ + { XFS_LI_XMI, "XFS_LI_XMI" }, \ + { XFS_LI_XMD, "XFS_LI_XMD" }/* * Inode Log Item Format definitions. @@ -878,6 +883,37 @@ struct xfs_bud_log_format {uint64_t bud_bui_id;/* id of corresponding bui */ };fs/xfs/libxfs/xfs_log_format.h struct xfs_bud_log_format { · line 895
Quoted 10 lines
fs/xfs/libxfs/xfs_log_format.h +10
-0+/* +* XMI/XMD (file mapping exchange) log format definitions +*/ + +/* This is the structure used to lay out an mapping exchange log item. */ +struct xfs_xmi_log_format { +uint16_t xmi_type;/* xmi log item type */ +uint16_t xmi_size;/* size of this item */ +uint32_t __pad;/* must be zero */ +uint64_t xmi_id;/* xmi identifier */ Why does this ID need to be a 64 bit ID? If it is 32 bit, then there's no need for any padding, and it doesn't seem likely to me that we'd have millions of exchanges in flight at once.
(Edit: I see why later - I address it there....)
fs/xfs/libxfs/xfs_log_format.h struct xfs_bud_log_format { · line 898
Quoted 3 lines
fs/xfs/libxfs/xfs_log_format.h +3
-0+ +uint64_t xmi_inode1;/* inumber of first file */ +uint64_t xmi_inode2;/* inumber of second file */ Inode numbers are not unique identifiers. Intents get replayed after everything else has been replayed, including inode unlink and reallocation.
Quoted 8 lines
Without a generation number, there is no way to determine if the inode number in the intent is actually pointing at the correct inode when we go to replay the intent.
Yes, I know it's unlikely that this might occur, but I'd much prefer that we fully identify inodes in the on-disk metadata so we can check it at recovery time than leaving it out and just hoping we are operating on the correct inode life-cycle...
I suppose I don't mind encoding the generation number, but I'm not thrilled that you're suggesting this after I finally got someone to complete the review of this patchset after 3 years.
I probably ought to use the u32 pad in the attri log format to do the same for parent pointers, seeing as parent pointers have their own attri log opcodes now anyway.
Quoted 10 lines
fs/xfs/libxfs/xfs_log_format.h struct xfs_bud_log_format { · line 904
Quoted 7 lines
fs/xfs/libxfs/xfs_log_format.h +6
-0+uint64_t xmi_startoff1;/* block offset into file1 */ +uint64_t xmi_startoff2;/* block offset into file2 */ +uint64_t xmi_blockcount;/* number of blocks */ +uint64_t xmi_flags;/* XFS_EXCHMAPS_* */ +uint64_t xmi_isize1;/* intended file1 size */ +uint64_t xmi_isize2;/* intended file2 size */ How do these inode sizes differ from xmi_startoff{1,2} +
xmi_blockcount?
If the caller specifies XFS_EXCHANGE_RANGE_TO_EOF then we need to exchange the file sizes too so that we preserve a mid-fsblock EOF.
Quoted 29 lines
fs/xfs/libxfs/xfs_log_format.h struct xfs_bud_log_format { · line 916
Quoted 13 lines
fs/xfs/libxfs/xfs_log_format.h +12
-0+/* Allocate and initialize an xmi item. */ +STATIC struct xfs_xmi_log_item * +xfs_xmi_init ( +struct xfs_mount *mp) + +{ +struct xfs_xmi_log_item *xmi_lip; + + xmi_lip =kmem_cache_zalloc (xfs_xmi_cache,GFP_KERNEL | __GFP_NOFAIL); + +xfs_log_item_init (mp, &xmi_lip->xmi_item,XFS_LI_XMI , &xfs_xmi_item_ops); + xmi_lip->xmi_format.xmi_id = (uintptr_t )(void *)xmi_lip;OK. Encoding the pointer as the ID is a mistake we made with EFIs and we should stop repeating it in all new intents. There is no guarantee that the pointer is a unique identifier because these are allocated out of a slab cache. Hence we can allocate an xmi, log it, finish the xmds, free the xmi, then run another exchange and get exactly the same XMI pointer returned to us for the new exchange intent. Now we potentially have multiple exchange items in the journal with the same ID.
Can we use a u32 and
get_random_u32()for the ID here, please? We already do this for checkpoint discrimination in the log (i.e. to identify what checkpoint an ophdr belongs to), so we really should be doing the same for all ids we use in the journal for matching items.
Quoted 3 lines
Longer term, We probably should move all the intent/done identifiers to a psuedo random identifier mechanism, but that's outside the scope of this change....
Agreed. I don't think it's appropriate to gate acceptance of this patchset on this kind of general change.
Quoted 28 lines
Quoted 28 lines
fs/xfs/libxfs/xfs_log_format.h +27
-0+/* +* This routine is called to create an in-core file mapping exchange item from +* the xmi format structure which was logged on disk. It allocates an in-core +* xmi, copies the exchange information from the format structure into it, and +* adds the xmi to the AIL with the given LSN. +*/ +STATIC int +xlog_recover_xmi_commit_pass2 ( +struct xlog *log, +struct list_head *buffer_list, +struct xlog_recover_item *item, +xfs_lsn_t lsn) +{ +struct xfs_mount *mp = log->l_mp; +struct xfs_xmi_log_item *xmi_lip; +struct xfs_xmi_log_format *xmi_formatp; +size_t len; + + len =sizeof (struct xfs_xmi_log_format ); +if (item->ri_buf[0 ].i_len != len) { +XFS_ERROR_REPORT (__func__,XFS_ERRLEVEL_LOW , log->l_mp); +return -EFSCORRUPTED ; + } + + xmi_formatp = item->ri_buf[0 ].i_addr; +if (xmi_formatp->__pad !=0 ) { +XFS_ERROR_REPORT (__func__,XFS_ERRLEVEL_LOW , log->l_mp);
Quoted 8 lines
fs/xfs/libxfs/xfs_log_format.h
Quoted 5 lines
fs/xfs/libxfs/xfs_log_format.h +5
-0+return -EFSCORRUPTED ; + } + + xmi_lip =xfs_xmi_init (mp); +memcpy (&xmi_lip->xmi_format, xmi_formatp, len);Should this be validating that the structure contents are within valid ranges?
That's done within _recover_work, like all the other intent items. If you want to clean that up then I'll review those patches, but I am not going to prepend more generic cleanups.
--D
Quoted 5 lines
-Dave.
Signature · 2 lines
Dave Chinner [email protected]
Re: [PATCH 04/15] xfs: introduce a file mapping exchange log intent item
Quoted 108 lines · Darrick J. Wong
Quoted 98 lines · Dave Chinner
Quoted 72 lines · Darrick J. Wong
From: Darrick J. Wong <[email protected]>
Introduce a new intent log item to handle exchanging mappings between the forks of two files.
Signed-off-by Darrick J. Wong <[email protected]>Reviewed-by Christoph Hellwig <[email protected]>--- fs/xfs/Makefile | 1 fs/xfs/libxfs/xfs_log_format.h | 42 ++++++- fs/xfs/libxfs/xfs_log_recover.h | 2 fs/xfs/xfs_exchmaps_item.c | 235 +++++++++++++++++++++++++++++++++++++++ fs/xfs/xfs_exchmaps_item.h | 59 ++++++++++ fs/xfs/xfs_log_recover.c | 2 fs/xfs/xfs_super.c | 19 +++ 7 files changed, 357 insertions(+), 3 deletions(-) create mode 100644 fs/xfs/xfs_exchmaps_item.c create mode 100644 fs/xfs/xfs_exchmaps_item.hfs/xfs/Makefile +1
-0@@ -102,6 +102,7 @@ xfs-y += xfs_log.o \ xfs_buf_item.o \ xfs_buf_item_recover.o \ xfs_dquot_item_recover.o \ + xfs_exchmaps_item.o \ xfs_extfree_item.o \ xfs_attr_item.o \ xfs_icreate_item.o \fs/xfs/libxfs/xfs_log_format.h +8
-3@@ -117,8 +117,9 @@ struct xfs_unmount_log_format {#define XLOG_REG_TYPE_ATTRD_FORMAT 28#define XLOG_REG_TYPE_ATTR_NAME 29#define XLOG_REG_TYPE_ATTR_VALUE 30 -#define XLOG_REG_TYPE_MAX 30 - +#define XLOG_REG_TYPE_XMI_FORMAT 31 +#define XLOG_REG_TYPE_XMD_FORMAT 32 +#define XLOG_REG_TYPE_MAX 32/* * Flags to log operation header @@ -243,6 +244,8 @@ typedef struct xfs_trans_header {#define XFS_LI_BUD 0x1245#define XFS_LI_ATTRI 0x1246/* attr set/remove intent*/ #define XFS_LI_ATTRD 0x1247/* attr set/remove done */ +#define XFS_LI_XMI 0x1248/* mapping exchange intent */ +#define XFS_LI_XMD 0x1249/* mapping exchange done */ #define XFS_LI_TYPE_DESC \ { XFS_LI_EFI, "XFS_LI_EFI" }, \@@ -260,7 +263,9 @@ typedef struct xfs_trans_header { { XFS_LI_BUI, "XFS_LI_BUI" }, \ { XFS_LI_BUD, "XFS_LI_BUD" }, \ { XFS_LI_ATTRI, "XFS_LI_ATTRI" }, \ - { XFS_LI_ATTRD, "XFS_LI_ATTRD" } + { XFS_LI_ATTRD, "XFS_LI_ATTRD" }, \ + { XFS_LI_XMI, "XFS_LI_XMI" }, \ + { XFS_LI_XMD, "XFS_LI_XMD" }/* * Inode Log Item Format definitions. @@ -878,6 +883,37 @@ struct xfs_bud_log_format {uint64_t bud_bui_id;/* id of corresponding bui */ };fs/xfs/libxfs/xfs_log_format.h struct xfs_bud_log_format { · line 895
Quoted 10 lines
fs/xfs/libxfs/xfs_log_format.h +10
-0+/* +* XMI/XMD (file mapping exchange) log format definitions +*/ + +/* This is the structure used to lay out an mapping exchange log item. */ +struct xfs_xmi_log_format { +uint16_t xmi_type;/* xmi log item type */ +uint16_t xmi_size;/* size of this item */ +uint32_t __pad;/* must be zero */ +uint64_t xmi_id;/* xmi identifier */ Why does this ID need to be a 64 bit ID? If it is 32 bit, then there's no need for any padding, and it doesn't seem likely to me that we'd have millions of exchanges in flight at once.
(Edit: I see why later - I address it there....)
fs/xfs/libxfs/xfs_log_format.h struct xfs_bud_log_format { · line 898
Quoted 3 lines
fs/xfs/libxfs/xfs_log_format.h +3
-0+ +uint64_t xmi_inode1;/* inumber of first file */ +uint64_t xmi_inode2;/* inumber of second file */ Inode numbers are not unique identifiers. Intents get replayed after everything else has been replayed, including inode unlink and reallocation.
Quoted 8 lines
Without a generation number, there is no way to determine if the inode number in the intent is actually pointing at the correct inode when we go to replay the intent.
Yes, I know it's unlikely that this might occur, but I'd much prefer that we fully identify inodes in the on-disk metadata so we can check it at recovery time than leaving it out and just hoping we are operating on the correct inode life-cycle...
Quoted 7 lines
I suppose I don't mind encoding the generation number, but I'm not thrilled that you're suggesting this after I finally got someone to complete the review of this patchset after 3 years.
I probably ought to use the u32 pad in the attri log format to do the same for parent pointers, seeing as parent pointers have their own attri log opcodes now anyway.
Actually, no. This is the wrong thing to do.
Adding i_generation to log items is something that we should apply systematically to all the log items that target files -- BUIs, ATTRIs, and XMIs. I don't know why I indulged this, but I looked into how to squeeze in i_generation: I can't do BUIs without revving the xfs_map_extents ondisk format to include a new u32 field. I can't do ATTRIs without expanding the size of those by u32 because there's no space left after parent pointers used up the padding field.
Dave, I've spent years working on this code. I've gotten it to work. I'm not interested in yet another refactoring of this now old code, and I'm tired of not being able to merge patches just because you had some random idea "let's expand the scope to fix these other code smells too!" I want to move on with merging my dev branch, because there are 200 more patches to go to finish online repair.
Andrey wants to get fsverity moving, and I can't help him do that because I'm stuck on this. Christoph wants to use some of realtime modernization patches, and I can't help him do that because I'm stuck on this. John wants to get forcealign and untorn writes moving and I can't help him do that because I'm stuck on this. Catherine wants to learn more about the codebase and I can't help her do that because I'm stuck on this.
As I keep saying, I want to get online repair to the point where I can send it out for wider testing with real users to find out how it really works. The customers who want the feature also want this, but I can't help them do that because I'm stuck on review.
Do you get the picture? Many projects are stalled on ME, and I don't like that. I don't get the sense that everyone else is enjoying this stat of affairs either.
I'm very worn down by this XFS mentality of "we have to clean up all the smells as a gatekeeping condition of merging someone else's work". No, we don't have to do that. I don't want to have to think about how to engineer some unrelated ondisk format cleanup into a giant pile of code and make /that/ work seamlessly too.
That is not a reasonable thing to ask for, and I'm not going to do it.
--D
Quoted 99 lines
Quoted 10 lines
fs/xfs/libxfs/xfs_log_format.h struct xfs_bud_log_format { · line 904
Quoted 7 lines
fs/xfs/libxfs/xfs_log_format.h +6
-0+uint64_t xmi_startoff1;/* block offset into file1 */ +uint64_t xmi_startoff2;/* block offset into file2 */ +uint64_t xmi_blockcount;/* number of blocks */ +uint64_t xmi_flags;/* XFS_EXCHMAPS_* */ +uint64_t xmi_isize1;/* intended file1 size */ +uint64_t xmi_isize2;/* intended file2 size */ How do these inode sizes differ from xmi_startoff{1,2} +
xmi_blockcount?If the caller specifies
XFS_EXCHANGE_RANGE_TO_EOFthen we need to exchange the file sizes too so that we preserve a mid-fsblock EOF.Quoted 29 lines
fs/xfs/libxfs/xfs_log_format.h struct xfs_bud_log_format { · line 916
Quoted 13 lines
fs/xfs/libxfs/xfs_log_format.h +12
-0+/* Allocate and initialize an xmi item. */ +STATIC struct xfs_xmi_log_item * +xfs_xmi_init ( +struct xfs_mount *mp) + +{ +struct xfs_xmi_log_item *xmi_lip; + + xmi_lip =kmem_cache_zalloc (xfs_xmi_cache,GFP_KERNEL | __GFP_NOFAIL); + +xfs_log_item_init (mp, &xmi_lip->xmi_item,XFS_LI_XMI , &xfs_xmi_item_ops); + xmi_lip->xmi_format.xmi_id = (uintptr_t )(void *)xmi_lip;OK. Encoding the pointer as the ID is a mistake we made with EFIs and we should stop repeating it in all new intents. There is no guarantee that the pointer is a unique identifier because these are allocated out of a slab cache. Hence we can allocate an xmi, log it, finish the xmds, free the xmi, then run another exchange and get exactly the same XMI pointer returned to us for the new exchange intent. Now we potentially have multiple exchange items in the journal with the same ID.
Can we use a u32 and
get_random_u32()for the ID here, please? We already do this for checkpoint discrimination in the log (i.e. to identify what checkpoint an ophdr belongs to), so we really should be doing the same for all ids we use in the journal for matching items.Quoted 3 lines
Longer term, We probably should move all the intent/done identifiers to a psuedo random identifier mechanism, but that's outside the scope of this change....
Agreed. I don't think it's appropriate to gate acceptance of this patchset on this kind of general change.
Quoted 28 lines
Quoted 28 lines
fs/xfs/libxfs/xfs_log_format.h +27
-0+/* +* This routine is called to create an in-core file mapping exchange item from +* the xmi format structure which was logged on disk. It allocates an in-core +* xmi, copies the exchange information from the format structure into it, and +* adds the xmi to the AIL with the given LSN. +*/ +STATIC int +xlog_recover_xmi_commit_pass2 ( +struct xlog *log, +struct list_head *buffer_list, +struct xlog_recover_item *item, +xfs_lsn_t lsn) +{ +struct xfs_mount *mp = log->l_mp; +struct xfs_xmi_log_item *xmi_lip; +struct xfs_xmi_log_format *xmi_formatp; +size_t len; + + len =sizeof (struct xfs_xmi_log_format ); +if (item->ri_buf[0 ].i_len != len) { +XFS_ERROR_REPORT (__func__,XFS_ERRLEVEL_LOW , log->l_mp); +return -EFSCORRUPTED ; + } + + xmi_formatp = item->ri_buf[0 ].i_addr; +if (xmi_formatp->__pad !=0 ) { +XFS_ERROR_REPORT (__func__,XFS_ERRLEVEL_LOW , log->l_mp);Quoted 8 lines
fs/xfs/libxfs/xfs_log_format.h
Quoted 5 lines
fs/xfs/libxfs/xfs_log_format.h +5
-0+return -EFSCORRUPTED ; + } + + xmi_lip =xfs_xmi_init (mp); +memcpy (&xmi_lip->xmi_format, xmi_formatp, len);Should this be validating that the structure contents are within valid ranges?
That's done within
_recover_work, like all the other intent items. If you want to clean that up then I'll review those patches, but I am not going to prepend more generic cleanups.--D
Quoted 5 lines
-Dave.
Signature · 2 lines
Dave Chinner [email protected]
PATCH 5/15 xfs: create deferred log items for file mapping exchanges
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
Now that we've created the skeleton of a log intent item to track and restart file mapping exchange operations, add the upper level logic to commit intent items and turn them into concrete work recorded in the log. This builds on the existing bmap update intent items that have been around for a while now.
--- fs/xfs/Makefile | 1 fs/xfs/libxfs/xfs_defer.c | 6 fs/xfs/libxfs/xfs_defer.h | 2 fs/xfs/libxfs/xfs_exchmaps.c | 1045 +++++++++++++++++++++++++++++++++++++++ fs/xfs/libxfs/xfs_exchmaps.h | 118 ++++ fs/xfs/libxfs/xfs_log_format.h | 24 + fs/xfs/libxfs/xfs_trans_space.h | 4 fs/xfs/xfs_exchmaps_item.c | 368 ++++++++++++++ fs/xfs/xfs_exchmaps_item.h | 5 fs/xfs/xfs_exchrange.c | 49 ++ fs/xfs/xfs_exchrange.h | 8 fs/xfs/xfs_trace.c | 1 fs/xfs/xfs_trace.h | 217 ++++++++ 13 files changed, 1844 insertions(+), 4 deletions(-) create mode 100644 fs/xfs/libxfs/xfs_exchmaps.c create mode 100644 fs/xfs/libxfs/xfs_exchmaps.h
fs/xfs/Makefile +1 -0
@@ -34,6 +34,7 @@ xfs-y += $(addprefix libxfs/, \ xfs_dir2_node.o \ xfs_dir2_sf.o \ xfs_dquot_buf.o \ + xfs_exchmaps.o \ xfs_ialloc.o \ xfs_ialloc_btree.o \ xfs_iext_tree.o \
fs/xfs/libxfs/xfs_defer.c +6 -0
@@ -27,6 +27,7 @@#include "xfs_da_btree.h" #include "xfs_attr.h" #include "xfs_trans_priv.h" +#include "xfs_exchmaps.h" static struct kmem_cache *xfs_defer_pending_cache;
@@ -1176,6 +1177,10 @@ xfs_defer_init_item_caches(void) error =xfs_attr_intent_init_cache ();if (error) goto err; + error =xfs_exchmaps_intent_init_cache (); +if (error) + goto err; +return 0 ; err:xfs_defer_destroy_item_caches ();
@@ -1186,6 +1191,7 @@ xfs_defer_init_item_caches(void)void xfs_defer_destroy_item_caches (void ) { +xfs_exchmaps_intent_destroy_cache ();xfs_attr_intent_destroy_cache ();xfs_extfree_intent_destroy_cache ();xfs_bmap_intent_destroy_cache ();
fs/xfs/libxfs/xfs_defer.h +1 -1
@@ -72,7 +72,7 @@ extern const struct xfs_defer_op_type xfs_rmap_update_defer_type;extern const struct xfs_defer_op_type xfs_extent_free_defer_type;extern const struct xfs_defer_op_type xfs_agfl_free_defer_type;extern const struct xfs_defer_op_type xfs_attr_defer_type; - +extern const struct xfs_defer_op_type xfs_exchmaps_defer_type;/* * Deferred operation item relogging limits.
fs/xfs/libxfs/xfs_exchmaps.c new file +1045 -0
1,045 lines not on this page · raw message
fs/xfs/libxfs/xfs_exchmaps.h new file +118 -0
118 lines not on this page · raw message
fs/xfs/libxfs/xfs_log_format.h +23 -1
@@ -904,7 +904,29 @@ struct xfs_xmi_log_format {uint64_t xmi_isize2;/* intended file2 size */ }; -#define XFS_EXCHMAPS_LOGGED_FLAGS (0) +/* Exchange mappings between extended attribute forks instead of data forks. */ +#define XFS_EXCHMAPS_ATTR_FORK (1ULL << 0) + +/* Set the file sizes when finished. */ +#define XFS_EXCHMAPS_SET_SIZES (1ULL << 1) + +/* +* Exchange the mappings of the two files only if the file allocation units +* mapped to file1's range have been written. +*/ +#define XFS_EXCHMAPS_INO1_WRITTEN (1ULL << 2) + +/* Clear the reflink flag from inode1 after the operation. */ +#define XFS_EXCHMAPS_CLEAR_INO1_REFLINK (1ULL << 3) + +/* Clear the reflink flag from inode2 after the operation. */ +#define XFS_EXCHMAPS_CLEAR_INO2_REFLINK (1ULL << 4) + +#define XFS_EXCHMAPS_LOGGED_FLAGS (XFS_EXCHMAPS_ATTR_FORK | \ + XFS_EXCHMAPS_SET_SIZES | \ + XFS_EXCHMAPS_INO1_WRITTEN | \ + XFS_EXCHMAPS_CLEAR_INO1_REFLINK | \ + XFS_EXCHMAPS_CLEAR_INO2_REFLINK)/* This is the structure used to lay out an mapping exchange done log item. */ struct xfs_xmd_log_format {
fs/xfs/libxfs/xfs_trans_space.h +4 -0
@@ -10,6 +10,10 @@* Components of space reservations. */ +/* Worst case number of bmaps that can be held in a block. */ +#define XFS_MAX_CONTIG_BMAPS_PER_BLOCK (mp) \ + (((mp)->m_bmap_dmxr[0]) - ((mp)->m_bmap_dmnr[0])) +/* Worst case number of rmaps that can be held in a block. */ #define XFS_MAX_CONTIG_RMAPS_PER_BLOCK (mp) \ (((mp)->m_rmap_mxr[0]) - ((mp)->m_rmap_mnr[0]))
fs/xfs/xfs_exchmaps_item.c +366 -2
393 lines not on this page · raw message
fs/xfs/xfs_exchmaps_item.h +5 -0
@@ -56,4 +56,9 @@ struct xfs_xmd_log_item {extern struct kmem_cache *xfs_xmi_cache;extern struct kmem_cache *xfs_xmd_cache; +struct xfs_exchmaps_intent ; + +void xfs_exchmaps_defer_add (struct xfs_trans *tp, +struct xfs_exchmaps_intent *xmi); +#endif /* __XFS_EXCHMAPS_ITEM_H__ */
fs/xfs/xfs_exchrange.c +49 -0
61 lines not on this page · raw message
fs/xfs/xfs_exchrange.h +8 -0
@@ -33,4 +33,12 @@ struct xfs_exchrange {int xfs_exchange_range (struct xfs_exchrange *fxr); +struct xfs_exchmaps_req ; + +void xfs_exchrange_ilock (struct xfs_trans *tp,struct xfs_inode *ip1, +struct xfs_inode *ip2); +void xfs_exchrange_iunlock (struct xfs_inode *ip1,struct xfs_inode *ip2); + +int xfs_exchrange_estimate (struct xfs_exchmaps_req *req); +#endif /* __XFS_EXCHRANGE_H__ */
fs/xfs/xfs_trace.c +1 -0
@@ -39,6 +39,7 @@#include "xfs_buf_mem.h" #include "xfs_btree_mem.h" #include "xfs_bmap.h" +#include "xfs_exchmaps.h" /* * We include this last to have the helpers above available for the trace
fs/xfs/xfs_trace.h +217 -0
229 lines not on this page · raw message
PATCH 6/15 xfs: bind together the front and back ends of the file range exchange code
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
So far, we've constructed the front end of the file range exchange code that does all the checking; and the back end of the file mapping exchange code that actually does the work. Glue these two pieces together so that we can turn on the functionality.
--- fs/xfs/xfs_exchrange.c | 364 ++++++++++++++++++++++++++++++++++++++++++++++++ fs/xfs/xfs_exchrange.h | 1 fs/xfs/xfs_mount.h | 5 + fs/xfs/xfs_trace.c | 1 fs/xfs/xfs_trace.h | 163 +++++++++++++++++++++ 5 files changed, 532 insertions(+), 2 deletions(-)
fs/xfs/xfs_exchrange.c +363 -1
@@ -12,8 +12,15 @@#include "xfs_defer.h" #include "xfs_inode.h" #include "xfs_trans.h" +#include "xfs_quota.h" +#include "xfs_bmap_util.h" +#include "xfs_reflink.h" +#include "xfs_trace.h" #include "xfs_exchrange.h" #include "xfs_exchmaps.h" +#include "xfs_sb.h" +#include "xfs_icache.h" +#include "xfs_log.h" #include <linux/fsnotify.h> /*
@@ -47,6 +54,34 @@ xfs_exchrange_possible(xfs_can_add_incompat_log_features (mp, false); } +/* +* Get permission to use log-assisted atomic exchange of file mappings. +* Callers must not be running any transactions or hold any ILOCKs. +*/ +int +xfs_exchrange_enable ( +struct xfs_mount *mp) +{ +int error =0 ; + +/* Mapping exchange log intent items are already enabled */ +if (xfs_sb_version_haslogexchmaps (&mp->m_sb)) +return 0 ; + +if (!xfs_exchrange_upgradeable (mp)) +return -EOPNOTSUPP ; + + error =xfs_add_incompat_log_feature (mp, +XFS_SB_FEAT_INCOMPAT_LOG_EXCHMAPS ); +if (error) +return error; + +xfs_warn_mount (mp,XFS_OPSTATE_WARNED_EXCHMAPS , +"EXPERIMENTAL atomic file range exchange feature in use. Use at your own risk!" ); + +return 0 ; +} +/* Lock (and optionally join) two inodes for a file range exchange. */ void xfs_exchrange_ilock(
@@ -95,6 +130,207 @@ xfs_exchrange_estimate(return error; } +#define QRETRY_IP1 (0x1) +#define QRETRY_IP2 (0x2) + +/* +* Obtain a quota reservation to make sure we don't hit EDQUOT. We can skip +* this if quota enforcement is disabled or if both inodes' dquots are the +* same. The qretry structure must be initialized to zeroes before the first +* call to this function. +*/ +STATIC int +xfs_exchrange_reserve_quota ( +struct xfs_trans *tp, +const struct xfs_exchmaps_req *req, +unsigned int *qretry) +{ +int64_t ddelta, rdelta; +int ip1_error =0 ; +int error; + +/* +* Don't bother with a quota reservation if we're not enforcing them +* or the two inodes have the same dquots. +*/ +if (!XFS_IS_QUOTA_ON (tp->t_mountp) || req->ip1 == req->ip2 || + (req->ip1->i_udquot == req->ip2->i_udquot && + req->ip1->i_gdquot == req->ip2->i_gdquot && + req->ip1->i_pdquot == req->ip2->i_pdquot)) +return 0 ; + + *qretry =0 ; + +/* +* For each file, compute the net gain in the number of regular blocks +* that will be mapped into that file and reserve that much quota. The +* quota counts must be able to absorb at least that much space. +*/ + ddelta = req->ip2_bcount - req->ip1_bcount; + rdelta = req->ip2_rtbcount - req->ip1_rtbcount; +if (ddelta >0 || rdelta >0 ) { + error =xfs_trans_reserve_quota_nblks (tp, req->ip1, + ddelta >0 ? ddelta :0 , + rdelta >0 ? rdelta :0 , + false); +if (error == -EDQUOT || error == -ENOSPC ) { +/* +* Save this error and see what happens if we try to +* reserve quota for ip2. Then report both. +*/ + *qretry |=QRETRY_IP1 ; + ip1_error = error; + error =0 ; + } +if (error) +return error; + } +if (ddelta <0 || rdelta <0 ) { + error =xfs_trans_reserve_quota_nblks (tp, req->ip2, + ddelta <0 ? -ddelta :0 , + rdelta <0 ? -rdelta :0 , + false); +if (error == -EDQUOT || error == -ENOSPC ) + *qretry |=QRETRY_IP2 ; +if (error) +return error; + } +if (ip1_error) +return ip1_error; + +/* +* For each file, forcibly reserve the gross gain in mapped blocks so +* that we don't trip over any quota block reservation assertions. +* We must reserve the gross gain because the quota code subtracts from +* bcount the number of blocks that we unmap; it does not add that +* quantity back to the quota block reservation. +*/ + error =xfs_trans_reserve_quota_nblks (tp, req->ip1, req->ip1_bcount, + req->ip1_rtbcount, true); +if (error) +return error; + +return xfs_trans_reserve_quota_nblks (tp, req->ip2, req->ip2_bcount, + req->ip2_rtbcount, true); +} + +/* Exchange the mappings (and hence the contents) of two files' forks. */ +STATIC int +xfs_exchrange_mappings ( +const struct xfs_exchrange *fxr, +struct xfs_inode *ip1, +struct xfs_inode *ip2) +{ +struct xfs_mount *mp = ip1->i_mount; +struct xfs_exchmaps_req req = { + .ip1 = ip1, + .ip2 = ip2, + .startoff1 =XFS_B_TO_FSBT (mp, fxr->file1_offset), + .startoff2 =XFS_B_TO_FSBT (mp, fxr->file2_offset), + .blockcount =XFS_B_TO_FSB (mp, fxr->length), + }; +struct xfs_trans *tp; +unsigned int qretry; +bool retried = false; +int error; + +trace_xfs_exchrange_mappings (fxr, ip1, ip2); + +if (fxr->flags &XFS_EXCHANGE_RANGE_TO_EOF ) + req.flags |=XFS_EXCHMAPS_SET_SIZES ; +if (fxr->flags &XFS_EXCHANGE_RANGE_FILE1_WRITTEN ) + req.flags |=XFS_EXCHMAPS_INO1_WRITTEN ; + + error =xfs_exchrange_estimate (&req); +if (error) +return error; + +retry: +/* Allocate the transaction, lock the inodes, and join them. */ + error =xfs_trans_alloc (mp, &M_RES (mp)->tr_write, req.resblks,0 , +XFS_TRANS_RES_FDBLKS , &tp); +if (error) +return error; + +xfs_exchrange_ilock (tp, ip1, ip2); + +trace_xfs_exchrange_before (ip2,2 ); +trace_xfs_exchrange_before (ip1,1 ); + + error =xfs_exchmaps_check_forks (mp, &req); +if (error) + goto out_trans_cancel; + +/* +* Reserve ourselves some quota if any of them are in enforcing mode. +* In theory we only need enough to satisfy the change in the number +* of blocks between the two ranges being remapped. +*/ + error =xfs_exchrange_reserve_quota (tp, &req, &qretry); +if ((error == -EDQUOT || error == -ENOSPC ) && !retried) { +xfs_trans_cancel (tp); +xfs_exchrange_iunlock (ip1, ip2); +if (qretry &QRETRY_IP1 ) +xfs_blockgc_free_quota (ip1,0 ); +if (qretry &QRETRY_IP2 ) +xfs_blockgc_free_quota (ip2,0 ); + retried = true; + goto retry; + } +if (error) + goto out_trans_cancel; + +/* If we got this far on a dry run, all parameters are ok. */ +if (fxr->flags &XFS_EXCHANGE_RANGE_DRY_RUN ) + goto out_trans_cancel; + +/* Update the mtime and ctime of both files. */ +if (fxr->flags & __XFS_EXCHANGE_RANGE_UPD_CMTIME1) +xfs_trans_ichgtime (tp, ip1,XFS_ICHGTIME_MOD |XFS_ICHGTIME_CHG ); +if (fxr->flags & __XFS_EXCHANGE_RANGE_UPD_CMTIME2) +xfs_trans_ichgtime (tp, ip2,XFS_ICHGTIME_MOD |XFS_ICHGTIME_CHG ); + +xfs_exchange_mappings (tp, &req); + +/* +* Force the log to persist metadata updates if the caller or the +* administrator requires this. The generic prep function already +* flushed the relevant parts of the page cache. +*/ +if (xfs_has_wsync (mp) || (fxr->flags &XFS_EXCHANGE_RANGE_DSYNC )) +xfs_trans_set_sync (tp); + + error =xfs_trans_commit (tp); + +trace_xfs_exchrange_after (ip2,2 ); +trace_xfs_exchrange_after (ip1,1 ); + +if (error) + goto out_unlock; + +/* +* If the caller wanted us to exchange the contents of two complete +* files of unequal length, exchange the incore sizes now. This should +* be safe because we flushed both files' page caches, exchanged all +* the mappings, and updated the ondisk sizes. +*/ +if (fxr->flags &XFS_EXCHANGE_RANGE_TO_EOF ) { +loff_t temp; + + temp =i_size_read (VFS_I (ip2)); +i_size_write (VFS_I (ip2),i_size_read (VFS_I (ip1))); +i_size_write (VFS_I (ip1), temp); + } + +out_unlock: +xfs_exchrange_iunlock (ip1, ip2); +return error; + +out_trans_cancel: +xfs_trans_cancel (tp); + goto out_unlock; +} +/* * Generic code for exchanging ranges of two files via XFS_IOC_EXCHANGE_RANGE. * This part deals with struct file objects and byte ranges and does not deal
@@ -318,6 +554,132 @@ xfs_exchange_range_finish(return file_remove_privs (fxr->file2); } +/* Prepare two files to have their data exchanged. */ +STATIC int +xfs_exchrange_prep ( +struct xfs_exchrange *fxr, +struct xfs_inode *ip1, +struct xfs_inode *ip2) +{ +unsigned int alloc_unit =xfs_inode_alloc_unitsize (ip2); +int error; + +trace_xfs_exchrange_prep (fxr, ip1, ip2); + +/* Verify both files are either real-time or non-realtime */ +if (XFS_IS_REALTIME_INODE (ip1) !=XFS_IS_REALTIME_INODE (ip2)) +return -EINVAL ; + +/* +* The alignment checks in the generic helpers cannot deal with +* allocation units that are not powers of 2. This can happen with the +* realtime volume if the extent size is set. +*/ +if (!is_power_of_2 (alloc_unit)) +return -EOPNOTSUPP ; + + error =xfs_exchange_range_prep (fxr, alloc_unit); +if (error || fxr->length ==0 ) +return error; + +/* Attach dquots to both inodes before changing block maps. */ + error =xfs_qm_dqattach (ip2); +if (error) +return error; + error =xfs_qm_dqattach (ip1); +if (error) +return error; + +trace_xfs_exchrange_flush (fxr, ip1, ip2); + +/* Flush the relevant ranges of both files. */ + error =xfs_flush_unmap_range (ip2, fxr->file2_offset, fxr->length); +if (error) +return error; + error =xfs_flush_unmap_range (ip1, fxr->file1_offset, fxr->length); +if (error) +return error; + +/* +* Cancel CoW fork preallocations for the ranges of both files. The +* prep function should have flushed all the dirty data, so the only +* CoW mappings remaining should be speculative. +*/ +if (xfs_inode_has_cow_data (ip1)) { + error =xfs_reflink_cancel_cow_range (ip1, fxr->file1_offset, + fxr->length, true); +if (error) +return error; + } + +if (xfs_inode_has_cow_data (ip2)) { + error =xfs_reflink_cancel_cow_range (ip2, fxr->file2_offset, + fxr->length, true); +if (error) +return error; + } + +return 0 ; +} + +/* +* Exchange contents of files. This is the binding between the generic +* file-level concepts and the XFS inode-specific implementation. +*/ +STATIC int +xfs_exchrange_contents ( +struct xfs_exchrange *fxr) +{ +struct inode *inode1 =file_inode (fxr->file1); +struct inode *inode2 =file_inode (fxr->file2); +struct xfs_inode *ip1 =XFS_I (inode1); +struct xfs_inode *ip2 =XFS_I (inode2); +struct xfs_mount *mp = ip1->i_mount; +int error; + +if (fxr->flags & ~(XFS_EXCHANGE_RANGE_ALL_FLAGS | +XFS_EXCHANGE_RANGE_PRIV_FLAGS )) +return -EINVAL ; + +if (xfs_is_shutdown (mp)) +return -EIO ; + +/* Lock both files against IO */ + error =xfs_ilock2_io_mmap (ip1, ip2); +if (error) + goto out_err; + +/* Get permission to use log-assisted file mapping exchanges. */ + error =xfs_exchrange_enable (mp); +if (error) + goto out_unlock; + +/* Prepare and then exchange file contents. */ + error =xfs_exchrange_prep (fxr, ip1, ip2); +if (error) + goto out_unlock; + + error =xfs_exchrange_mappings (fxr, ip1, ip2); +if (error) + goto out_unlock; + +/* +* Finish the exchange by removing special file privileges like any +* other file write would do. This may involve turning on support for +* logged xattrs if either file has security capabilities. +*/ + error =xfs_exchange_range_finish (fxr); +if (error) + goto out_unlock; + +out_unlock: +xfs_iunlock2_io_mmap (ip1, ip2); +out_err: +if (error) +trace_xfs_exchrange_error (ip2, error, _RET_IP_); +return error; +} +/* Exchange parts of two files. */ int xfs_exchange_range(
@@ -372,7 +734,7 @@ xfs_exchange_range( fxr->flags |= __XFS_EXCHANGE_RANGE_UPD_CMTIME2;file_start_write (fxr->file2); - ret = -EOPNOTSUPP ;/* XXX call out to lower level code */ + ret =xfs_exchrange_contents (fxr);file_end_write (fxr->file2);if (ret)return ret;
fs/xfs/xfs_exchrange.h +1 -0
@@ -7,6 +7,7 @@#define __XFS_EXCHRANGE_H__bool xfs_exchrange_possible (struct xfs_mount *mp); +int xfs_exchrange_enable (struct xfs_mount *mp);/* Update the mtime/cmtime of file1 and file2 */ #define __XFS_EXCHANGE_RANGE_UPD_CMTIME1 (1ULL << 63)
fs/xfs/xfs_mount.h +4 -1
@@ -417,6 +417,8 @@ __XFS_HAS_FEAT(nouuid, NOUUID)#define XFS_OPSTATE_QUOTACHECK_RUNNING 10/* Do we want to clear log incompat flags? */ #define XFS_OPSTATE_UNSET_LOG_INCOMPAT 11 +/* Kernel has logged a warning about logged file mapping exchanges being used. */ +#define XFS_OPSTATE_WARNED_EXCHMAPS 12#define __XFS_IS_OPSTATE (name,NAME ) \ static inline bool xfs_is_ ## name (struct xfs_mount *mp) \
@@ -464,7 +466,8 @@ xfs_should_warn(struct xfs_mount *mp, long nr) { (1UL << XFS_OPSTATE_WARNED_SHRINK), "wshrink" }, \ { (1UL << XFS_OPSTATE_WARNED_LARP), "wlarp" }, \ { (1UL << XFS_OPSTATE_QUOTACHECK_RUNNING), "quotacheck" }, \ - { (1UL << XFS_OPSTATE_UNSET_LOG_INCOMPAT), "unset_log_incompat" } + { (1UL << XFS_OPSTATE_UNSET_LOG_INCOMPAT), "unset_log_incompat" }, \ + { (1UL << XFS_OPSTATE_WARNED_EXCHMAPS), "wexchmaps" }/* * Max and min values for mount-option defined I/O
fs/xfs/xfs_trace.c +1 -0
@@ -40,6 +40,7 @@#include "xfs_btree_mem.h" #include "xfs_bmap.h" #include "xfs_exchmaps.h" +#include "xfs_exchrange.h" /* * We include this last to have the helpers above available for the trace
fs/xfs/xfs_trace.h +163 -0
175 lines not on this page · raw message
Re: [PATCH 06/15] xfs: bind together the front and back ends of the file range exchange code
Quoted 45 lines · Darrick J. Wong
From: Darrick J. Wong <[email protected]>
So far, we've constructed the front end of the file range exchange code that does all the checking; and the back end of the file mapping exchange code that actually does the work. Glue these two pieces together so that we can turn on the functionality.
Signed-off-by Darrick J. Wong <[email protected]>Reviewed-by Christoph Hellwig <[email protected]>--- fs/xfs/xfs_exchrange.c | 364 ++++++++++++++++++++++++++++++++++++++++++++++++ fs/xfs/xfs_exchrange.h | 1 fs/xfs/xfs_mount.h | 5 + fs/xfs/xfs_trace.c | 1 fs/xfs/xfs_trace.h | 163 +++++++++++++++++++++ 5 files changed, 532 insertions(+), 2 deletions(-)fs/xfs/xfs_exchrange.c +10
-0@@ -12,8 +12,15 @@#include "xfs_defer.h" #include "xfs_inode.h" #include "xfs_trans.h" +#include "xfs_quota.h" +#include "xfs_bmap_util.h" +#include "xfs_reflink.h" +#include "xfs_trace.h" #include "xfs_exchrange.h" #include "xfs_exchmaps.h" +#include "xfs_sb.h" +#include "xfs_icache.h" +#include "xfs_log.h" #include <linux/fsnotify.h> /* @@ -47,6 +54,34 @@ xfs_exchrange_possible(xfs_can_add_incompat_log_features (mp, false); } +/* +* Get permission to use log-assisted atomic exchange of file mappings. +* Callers must not be running any transactions or hold any ILOCKs.
fs/xfs/xfs_exchrange.c xfs_exchrange_possible( · line 69
Quoted 10 lines
fs/xfs/xfs_exchrange.c +10
-0+*/ +int +xfs_exchrange_enable ( +struct xfs_mount *mp) +{ +int error =0 ; + +/* Mapping exchange log intent items are already enabled */ +if (xfs_sb_version_haslogexchmaps (&mp->m_sb)) +return 0 ;
I must have missed this earlier. We don't do "sb_version" checks on the superblock anymore - that wrapper should be removed from whatever patch introduced it. Enabled features set a feature bit on the xfs_mount when the feature is set/detected and the code runs xfs_has_foo(mp) against the mount, not the superblock.
i.e. Please define a XFS_FEAT_EXCHMAPS field and set that appropriately when enabling the feature and check it here...
fs/xfs/xfs_exchrange.c xfs_exchrange_possible( · line 80
Quoted 11 lines
fs/xfs/xfs_exchrange.c +11
-0+ +if (!xfs_exchrange_upgradeable (mp)) +return -EOPNOTSUPP ; + + error =xfs_add_incompat_log_feature (mp, +XFS_SB_FEAT_INCOMPAT_LOG_EXCHMAPS ); +if (error) +return error; + +xfs_warn_mount (mp,XFS_OPSTATE_WARNED_EXCHMAPS , +"EXPERIMENTAL atomic file range exchange feature in use. Use at your own risk!" );
This doesn't need to use xfs_warn_mount() because we can only turn the feature on once per mount now. Hence the opstate bit can go away and it can just use xfs_warn()....
-Dave.
Signature · 2 lines
Dave Chinner [email protected]
PATCH 7/15 xfs: add error injection to test file mapping exchange recovery
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
Add an errortag so that we can test recovery of exchmaps log items.
--- fs/xfs/libxfs/xfs_errortag.h | 4 +++- fs/xfs/libxfs/xfs_exchmaps.c | 3 +++ fs/xfs/xfs_error.c | 3 +++ 3 files changed, 9 insertions(+), 1 deletion(-)
fs/xfs/libxfs/xfs_errortag.h +3 -1
@@ -63,7 +63,8 @@#define XFS_ERRTAG_ATTR_LEAF_TO_NODE 41#define XFS_ERRTAG_WB_DELAY_MS 42#define XFS_ERRTAG_WRITE_DELAY_MS 43 -#define XFS_ERRTAG_MAX 44 +#define XFS_ERRTAG_EXCHMAPS_FINISH_ONE 44 +#define XFS_ERRTAG_MAX 45/* * Random factors for above tags, 1 means always, 2 means 1/2 time, etc.
@@ -111,5 +112,6 @@#define XFS_RANDOM_ATTR_LEAF_TO_NODE 1#define XFS_RANDOM_WB_DELAY_MS 3000#define XFS_RANDOM_WRITE_DELAY_MS 3000 +#define XFS_RANDOM_EXCHMAPS_FINISH_ONE 1#endif /* __XFS_ERRORTAG_H_ */
fs/xfs/libxfs/xfs_exchmaps.c +3 -0
@@ -437,6 +437,9 @@ xfs_exchmaps_finish_one(return error; } +if (XFS_TEST_ERROR (false, tp->t_mountp,XFS_ERRTAG_EXCHMAPS_FINISH_ONE )) +return -EIO ; +/* If we still have work to do, ask for a new transaction. */ if (xmi_has_more_exchange_work (xmi) ||xmi_has_postop_work (xmi)) {trace_xfs_exchmaps_defer (tp->t_mountp, xmi);
fs/xfs/xfs_error.c +3 -0
@@ -62,6 +62,7 @@ static unsigned int xfs_errortag_random_default[] = {XFS_RANDOM_ATTR_LEAF_TO_NODE ,XFS_RANDOM_WB_DELAY_MS ,XFS_RANDOM_WRITE_DELAY_MS , + XFS_RANDOM_EXCHMAPS_FINISH_ONE, }; struct xfs_errortag_attr {
@@ -179,6 +180,7 @@ XFS_ERRORTAG_ATTR_RW(da_leaf_split, XFS_ERRTAG_DA_LEAF_SPLIT);XFS_ERRORTAG_ATTR_RW (attr_leaf_to_node,XFS_ERRTAG_ATTR_LEAF_TO_NODE );XFS_ERRORTAG_ATTR_RW (wb_delay_ms,XFS_ERRTAG_WB_DELAY_MS );XFS_ERRORTAG_ATTR_RW (write_delay_ms,XFS_ERRTAG_WRITE_DELAY_MS ); +XFS_ERRORTAG_ATTR_RW (exchmaps_finish_one,XFS_ERRTAG_EXCHMAPS_FINISH_ONE );static struct attribute *xfs_errortag_attrs[] = {XFS_ERRORTAG_ATTR_LIST (noerror),
@@ -224,6 +226,7 @@ static struct attribute *xfs_errortag_attrs[] = {XFS_ERRORTAG_ATTR_LIST (attr_leaf_to_node),XFS_ERRORTAG_ATTR_LIST (wb_delay_ms),XFS_ERRORTAG_ATTR_LIST (write_delay_ms), +XFS_ERRORTAG_ATTR_LIST (exchmaps_finish_one),NULL , };ATTRIBUTE_GROUPS (xfs_errortag);
PATCH 8/15 xfs: condense extended attributes after a mapping exchange operation
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
Add a new file mapping exchange flag that enables us to perform post-exchange processing on file2 once we're done exchanging the extent mappings. If we were swapping mappings between extended attribute forks, we want to be able to convert file2's attr fork from block to inline format.
(This implies that all fork contents are exchanged.)
This isn't used anywhere right now, but we need to have the basic ondisk flags in place so that a future online xattr repair feature can create salvaged attrs in a temporary file and exchange the attr fork mappings when ready. If one file is in extents format and the other is inline, we will have to promote both to extents format to perform the exchange. After the exchange, we can try to condense the fixed file's attr fork back down to inline format if possible.
--- fs/xfs/libxfs/xfs_exchmaps.c | 53 ++++++++++++++++++++++++++++++++++++++++-- fs/xfs/libxfs/xfs_exchmaps.h | 5 ++++ fs/xfs/xfs_trace.h | 3 ++ 3 files changed, 58 insertions(+), 3 deletions(-)
fs/xfs/libxfs/xfs_exchmaps.c +51 -2
@@ -24,6 +24,10 @@#include "xfs_errortag.h" #include "xfs_health.h" #include "xfs_exchmaps_item.h" +#include "xfs_da_format.h" +#include "xfs_da_btree.h" +#include "xfs_attr_leaf.h" +#include "xfs_attr.h" struct kmem_cache *xfs_exchmaps_intent_cache;
@@ -121,7 +125,8 @@ static inline bool xmi_has_postop_work(const struct xfs_exchmaps_intent *xmi) {return xmi->xmi_flags & (XFS_EXCHMAPS_CLEAR_INO1_REFLINK | -XFS_EXCHMAPS_CLEAR_INO2_REFLINK ); +XFS_EXCHMAPS_CLEAR_INO2_REFLINK | + __XFS_EXCHMAPS_INO2_SHORTFORM); }/* Check all mappings to make sure we can actually exchange them. */
@@ -360,6 +365,36 @@ xfs_exchmaps_one_step(xmi_advance (xmi, irec1); } +/* Convert inode2's leaf attr fork back to shortform, if possible.. */ +STATIC int +xfs_exchmaps_attr_to_sf ( +struct xfs_trans *tp, +struct xfs_exchmaps_intent *xmi) +{ +struct xfs_da_args args = { + .dp = xmi->xmi_ip2, + .geo = tp->t_mountp->m_attr_geo, + .whichfork =XFS_ATTR_FORK , + .trans = tp, + }; +struct xfs_buf *bp; +int forkoff; +int error; + +if (!xfs_attr_is_leaf (xmi->xmi_ip2)) +return 0 ; + + error =xfs_attr3_leaf_read (tp, xmi->xmi_ip2,0 , &bp); +if (error) +return error; + + forkoff =xfs_attr_shortform_allfit (bp, xmi->xmi_ip2); +if (forkoff ==0 ) +return 0 ; + +return xfs_attr3_leaf_to_shortform (bp, &args, forkoff); +} +/* Clear the reflink flag after an exchange. */ static inline void xfs_exchmaps_clear_reflink(
@@ -378,6 +413,16 @@ xfs_exchmaps_do_postop_work( struct xfs_trans *tp, struct xfs_exchmaps_intent *xmi) { +if (xmi->xmi_flags & __XFS_EXCHMAPS_INO2_SHORTFORM) { +int error =0 ; + +if (xmi->xmi_flags &XFS_EXCHMAPS_ATTR_FORK ) + error =xfs_exchmaps_attr_to_sf (tp, xmi); + xmi->xmi_flags &= ~__XFS_EXCHMAPS_INO2_SHORTFORM; +if (error) +return error; + } +if (xmi->xmi_flags &XFS_EXCHMAPS_CLEAR_INO1_REFLINK ) {xfs_exchmaps_clear_reflink (tp, xmi->xmi_ip1); xmi->xmi_flags &= ~XFS_EXCHMAPS_CLEAR_INO1_REFLINK ;
@@ -809,8 +854,10 @@ xfs_exchmaps_init_intent( xmi->xmi_isize1 = xmi->xmi_isize2 =-1 ; xmi->xmi_flags = req->flags &XFS_EXCHMAPS_PARAMS ; -if (xfs_exchmaps_whichfork (xmi) ==XFS_ATTR_FORK ) +if (xfs_exchmaps_whichfork (xmi) ==XFS_ATTR_FORK ) { + xmi->xmi_flags |= __XFS_EXCHMAPS_INO2_SHORTFORM;return xmi; + }if (req->flags &XFS_EXCHMAPS_SET_SIZES ) { xmi->xmi_flags |=XFS_EXCHMAPS_SET_SIZES ;
@@ -1031,6 +1078,8 @@ xfs_exchange_mappings( {struct xfs_exchmaps_intent *xmi; +BUILD_BUG_ON (XFS_EXCHMAPS_INTERNAL_FLAGS &XFS_EXCHMAPS_LOGGED_FLAGS ); +xfs_assert_ilocked (req->ip1,XFS_ILOCK_EXCL );xfs_assert_ilocked (req->ip2,XFS_ILOCK_EXCL );ASSERT (!(req->flags & ~XFS_EXCHMAPS_LOGGED_FLAGS ));
fs/xfs/libxfs/xfs_exchmaps.h +5 -0
@@ -27,6 +27,11 @@ struct xfs_exchmaps_intent {uint64_t xmi_flags;/* XFS_EXCHMAPS_* flags */ }; +/* Try to convert inode2 from block to short format at the end, if possible. */ +#define __XFS_EXCHMAPS_INO2_SHORTFORM (1ULL << 63) + +#define XFS_EXCHMAPS_INTERNAL_FLAGS (__XFS_EXCHMAPS_INO2_SHORTFORM) +/* flags that can be passed to xfs_exchmaps_{estimate,mappings} */ #define XFS_EXCHMAPS_PARAMS (XFS_EXCHMAPS_ATTR_FORK | \ XFS_EXCHMAPS_SET_SIZES | \
fs/xfs/xfs_trace.h +2 -1
@@ -4779,7 +4779,8 @@ DEFINE_XFBTREE_FREESP_EVENT(xfbtree_free_block); { XFS_EXCHMAPS_SET_SIZES, "SETSIZES" }, \ { XFS_EXCHMAPS_INO1_WRITTEN, "INO1_WRITTEN" }, \ { XFS_EXCHMAPS_CLEAR_INO1_REFLINK, "CLEAR_INO1_REFLINK" }, \ - { XFS_EXCHMAPS_CLEAR_INO2_REFLINK, "CLEAR_INO2_REFLINK" } + { XFS_EXCHMAPS_CLEAR_INO2_REFLINK, "CLEAR_INO2_REFLINK" }, \ + { __XFS_EXCHMAPS_INO2_SHORTFORM, "INO2_SF" }DEFINE_INODE_IREC_EVENT (xfs_exchmaps_mapping1_skip);DEFINE_INODE_IREC_EVENT (xfs_exchmaps_mapping1);
PATCH 9/15 xfs: condense directories after a mapping exchange operation
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
The previous commit added a new file mapping exchange flag that enables us to perform post-swap processing on file2 once we're done exchanging extent mappings. Now add this ability for directories.
This isn't used anywhere right now, but we need to have the basic ondisk flags in place so that a future online directory repair feature can create salvaged dirents in a temporary directory and exchange the data fork mappings when ready. If one file is in extents format and the other is inline, we will have to promote both to extents format to perform the exchange. After the exchange, we can try to condense the fixed directory down to inline format if possible.
--- fs/xfs/libxfs/xfs_exchmaps.c | 43 ++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 43 insertions(+)
fs/xfs/libxfs/xfs_exchmaps.c +43 -0
@@ -28,6 +28,8 @@#include "xfs_da_btree.h" #include "xfs_attr_leaf.h" #include "xfs_attr.h" +#include "xfs_dir2_priv.h" +#include "xfs_dir2.h" struct kmem_cache *xfs_exchmaps_intent_cache;
@@ -395,6 +397,42 @@ xfs_exchmaps_attr_to_sf(return xfs_attr3_leaf_to_shortform (bp, &args, forkoff); } +/* Convert inode2's block dir fork back to shortform, if possible.. */ +STATIC int +xfs_exchmaps_dir_to_sf ( +struct xfs_trans *tp, +struct xfs_exchmaps_intent *xmi) +{ +struct xfs_da_args args = { + .dp = xmi->xmi_ip2, + .geo = tp->t_mountp->m_dir_geo, + .whichfork =XFS_DATA_FORK , + .trans = tp, + }; +struct xfs_dir2_sf_hdr sfh; +struct xfs_buf *bp; +bool isblock; +int size; +int error; + + error =xfs_dir2_isblock (&args, &isblock); +if (error) +return error; + +if (!isblock) +return 0 ; + + error =xfs_dir3_block_read (tp, xmi->xmi_ip2, &bp); +if (error) +return error; + + size =xfs_dir2_block_sfsize (xmi->xmi_ip2, bp->b_addr, &sfh); +if (size >xfs_inode_data_fork_size (xmi->xmi_ip2)) +return 0 ; + +return xfs_dir2_block_to_sf (&args, bp, size, &sfh); +} +/* Clear the reflink flag after an exchange. */ static inline void xfs_exchmaps_clear_reflink(
@@ -418,6 +456,8 @@ xfs_exchmaps_do_postop_work(if (xmi->xmi_flags &XFS_EXCHMAPS_ATTR_FORK ) error =xfs_exchmaps_attr_to_sf (tp, xmi); +else if (S_ISDIR (VFS_I (xmi->xmi_ip2)->i_mode)) + error =xfs_exchmaps_dir_to_sf (tp, xmi); xmi->xmi_flags &= ~__XFS_EXCHMAPS_INO2_SHORTFORM;if (error)return error;
@@ -882,6 +922,9 @@ xfs_exchmaps_init_intent( xmi->xmi_flags |=XFS_EXCHMAPS_CLEAR_INO2_REFLINK ; } +if (S_ISDIR (VFS_I (xmi->xmi_ip2)->i_mode)) + xmi->xmi_flags |= __XFS_EXCHMAPS_INO2_SHORTFORM; +return xmi; }
PATCH 10/15 xfs: condense symbolic links after a mapping exchange operation
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
The previous commit added a new file mapping exchange flag that enables us to perform post-exchange processing on file2 once we're done exchanging the extent mappings. Now add this ability for symlinks.
This isn't used anywhere right now, but we need to have the basic ondisk flags in place so that a future online symlink repair feature can salvage the remote target in a temporary link and exchange the data fork mappings when ready. If one file is in extents format and the other is inline, we will have to promote both to extents format to perform the exchange. After the exchange, we can try to condense the fixed symlink down to inline format if possible.
--- fs/xfs/libxfs/xfs_exchmaps.c | 49 +++++++++++++++++++++++++++++++++++- fs/xfs/libxfs/xfs_symlink_remote.c | 47 +++++++++++++++++++++++++++++++++++ fs/xfs/libxfs/xfs_symlink_remote.h | 1 + fs/xfs/xfs_symlink.c | 49 ++++-------------------------------- 4 files changed, 102 insertions(+), 44 deletions(-)
fs/xfs/libxfs/xfs_exchmaps.c +48 -1
@@ -30,6 +30,7 @@#include "xfs_attr.h" #include "xfs_dir2_priv.h" #include "xfs_dir2.h" +#include "xfs_symlink_remote.h" struct kmem_cache *xfs_exchmaps_intent_cache;
@@ -433,6 +434,49 @@ xfs_exchmaps_dir_to_sf(return xfs_dir2_block_to_sf (&args, bp, size, &sfh); } +/* Convert inode2's remote symlink target back to shortform, if possible. */ +STATIC int +xfs_exchmaps_link_to_sf ( +struct xfs_trans *tp, +struct xfs_exchmaps_intent *xmi) +{ +struct xfs_inode *ip = xmi->xmi_ip2; +struct xfs_ifork *ifp =xfs_ifork_ptr (ip,XFS_DATA_FORK ); +char *buf; +int error; + +if (ifp->if_format ==XFS_DINODE_FMT_LOCAL || + ip->i_disk_size >xfs_inode_data_fork_size (ip)) +return 0 ; + +/* Read the current symlink target into a buffer. */ + buf =kmalloc (ip->i_disk_size +1 , +GFP_KERNEL | __GFP_NOLOCKDEP | __GFP_NOFAIL); +if (!buf) { +ASSERT (0 ); +return -ENOMEM ; + } + + error =xfs_symlink_remote_read (ip, buf); +if (error) + goto free; + +/* Remove the blocks. */ + error =xfs_symlink_remote_truncate (tp, ip); +if (error) + goto free; + +/* Convert fork to local format and log our changes. */ +xfs_idestroy_fork (ifp); + ifp->if_bytes =0 ; + ifp->if_format =XFS_DINODE_FMT_LOCAL ; +xfs_init_local_fork (ip,XFS_DATA_FORK , buf, ip->i_disk_size); +xfs_trans_log_inode (tp, ip,XFS_ILOG_DDATA |XFS_ILOG_CORE ); +free: +kfree (buf); +return error; +} +/* Clear the reflink flag after an exchange. */ static inline void xfs_exchmaps_clear_reflink(
@@ -458,6 +502,8 @@ xfs_exchmaps_do_postop_work( error =xfs_exchmaps_attr_to_sf (tp, xmi); else if (S_ISDIR(VFS_I(xmi->xmi_ip2)->i_mode)) error =xfs_exchmaps_dir_to_sf (tp, xmi); + else if (S_ISLNK(VFS_I(xmi->xmi_ip2)->i_mode)) + error =xfs_exchmaps_link_to_sf (tp, xmi); xmi->xmi_flags &= ~__XFS_EXCHMAPS_INO2_SHORTFORM;if (error)return error;
@@ -922,7 +968,8 @@ xfs_exchmaps_init_intent( xmi->xmi_flags |=XFS_EXCHMAPS_CLEAR_INO2_REFLINK ; } -if (S_ISDIR (VFS_I (xmi->xmi_ip2)->i_mode)) +if (S_ISDIR (VFS_I (xmi->xmi_ip2)->i_mode) || +S_ISLNK (VFS_I (xmi->xmi_ip2)->i_mode)) xmi->xmi_flags |= __XFS_EXCHMAPS_INO2_SHORTFORM;return xmi;
fs/xfs/libxfs/xfs_symlink_remote.c +47 -0
50 lines not on this page · raw message
fs/xfs/libxfs/xfs_symlink_remote.h +1 -0
@@ -22,5 +22,6 @@ int xfs_symlink_remote_read(struct xfs_inode *ip, char *link);int xfs_symlink_write_target (struct xfs_trans *tp,struct xfs_inode *ip,const char *target_path,int pathlen,xfs_fsblock_t fs_blocks,uint resblks); +int xfs_symlink_remote_truncate (struct xfs_trans *tp,struct xfs_inode *ip);#endif /* __XFS_SYMLINK_REMOTE_H */
fs/xfs/xfs_symlink.c +6 -43
69 lines not on this page · raw message
PATCH 11/15 xfs: make file range exchange support realtime files
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
Now that bmap items support the realtime device, we can add the necessary pieces to the file range exchange code to support exchanging mappings. All we really need to do here is adjust the blockcount upwards to the end of the rt extent and remove the inode checks.
--- fs/xfs/libxfs/xfs_exchmaps.c | 70 ++++++++++++++++++++++++++++++++++++------ fs/xfs/xfs_exchrange.c | 9 +++++ 2 files changed, 69 insertions(+), 10 deletions(-)
fs/xfs/libxfs/xfs_exchmaps.c +60 -10
@@ -152,12 +152,7 @@ xfs_exchmaps_check_forks( ifp2->if_format == XFS_DINODE_FMT_LOCAL)return -EINVAL ; -/* We don't support realtime data forks yet. */ -if (!XFS_IS_REALTIME_INODE (req->ip1)) -return 0 ; -if (whichfork ==XFS_ATTR_FORK ) -return 0 ; -return -EINVAL ; +return 0 ; }#ifdef CONFIG_XFS_QUOTA
@@ -198,6 +193,8 @@ xfs_exchmaps_can_skip_mapping(struct xfs_exchmaps_intent *xmi, struct xfs_bmbt_irec *irec) { + struct xfs_mount *mp = xmi->xmi_ip1->i_mount; +/* Do not skip this mapping if the caller did not tell us to. */ if (!(xmi->xmi_flags &XFS_EXCHMAPS_INO1_WRITTEN ))return false;
@@ -209,11 +206,64 @@ xfs_exchmaps_can_skip_mapping(/* * The mapping is unwritten or a hole. It cannot be a delalloc * reservation because we already excluded those. It cannot be an -* unwritten mapping with dirty page cache because we flushed the page -* cache. We don't support realtime files yet, so we needn't (yet) -* deal with them. +* unwritten extent with dirty page cache because we flushed the page +* cache. For files where the allocation unit is 1FSB (files on the +* data dev, rt files if the extent size is 1FSB), we can safely +* skip this mapping. */ -return true; +if (!xfs_inode_has_bigallocunit (xmi->xmi_ip1)) +return true; + +/* +* For a realtime file with a multi-fsb allocation unit, the decision +* is trickier because we can only swap full allocation units. +* Unwritten mappings can appear in the middle of an rtx if the rtx is +* partially written, but they can also appear for preallocations. +* +* If the mapping is a hole, skip it entirely. Holes should align with +* rtx boundaries. +*/ +if (!xfs_bmap_is_real_extent (irec)) +return true; + +/* +* All mappings below this point are unwritten. +* +* - If the beginning is not aligned to an rtx, trim the end of the +* mapping so that it does not cross an rtx boundary, and swap it. +* +* - If both ends are aligned to an rtx, skip the entire mapping. +*/ +if (!isaligned_64 (irec->br_startoff, mp->m_sb.sb_rextsize)) { +xfs_fileoff_t new_end; + + new_end =roundup_64 (irec->br_startoff, mp->m_sb.sb_rextsize); + irec->br_blockcount =min (irec->br_blockcount, + new_end - irec->br_startoff); +return false; + } +if (isaligned_64 (irec->br_blockcount, mp->m_sb.sb_rextsize)) +return true; + +/* +* All mappings below this point are unwritten, start on an rtx +* boundary, and do not end on an rtx boundary. +* +* - If the mapping is longer than one rtx, trim the end of the mapping +* down to an rtx boundary and skip it. +* +* - The mapping is shorter than one rtx. Swap it. +*/ +if (irec->br_blockcount > mp->m_sb.sb_rextsize) { +xfs_fileoff_t new_end; + + new_end =rounddown_64 (irec->br_startoff + irec->br_blockcount, + mp->m_sb.sb_rextsize); + irec->br_blockcount = new_end - irec->br_startoff; +return true; + } + +return false; }/*
fs/xfs/xfs_exchrange.c +9 -0
@@ -21,6 +21,7 @@#include "xfs_sb.h" #include "xfs_icache.h" #include "xfs_log.h" +#include "xfs_rtbitmap.h" #include <linux/fsnotify.h> /*
@@ -241,6 +242,14 @@ xfs_exchrange_mappings(if (fxr->flags &XFS_EXCHANGE_RANGE_FILE1_WRITTEN ) req.flags |=XFS_EXCHMAPS_INO1_WRITTEN ; +/* +* Round the request length up to the nearest file allocation unit. +* The prep function already checked that the request offsets and +* length in @fxr are safe to round up. +*/ +if (xfs_inode_has_bigallocunit (ip2)) + req.blockcount =xfs_rtb_roundup_rtx (mp, req.blockcount); + error =xfs_exchrange_estimate (&req);if (error)return error;
PATCH 12/15 xfs: support non-power-of-two rtextsize with exchange-range
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
The generic exchange-range alignment checks use (fast) bitmasking operations to perform block alignment checks on the exchange parameters. Unfortunately, bitmasks require that the alignment size be a power of two. This isn't true for realtime devices with a non-power-of-two extent size, so we have to copy-pasta the generic checks using long division for this to work properly.
--- fs/xfs/xfs_exchrange.c | 89 ++++++++++++++++++++++++++++++++++++++++++++---- 1 file changed, 82 insertions(+), 7 deletions(-)
fs/xfs/xfs_exchrange.c +82 -7
@@ -563,6 +563,75 @@ xfs_exchange_range_finish(return file_remove_privs (fxr->file2); } +/* +* Check the alignment of an exchange request when the allocation unit size +* isn't a power of two. The generic file-level helpers use (fast) +* bitmask-based alignment checks, but here we have to use slow long division. +*/ +static int +xfs_exchrange_check_rtalign ( +const struct xfs_exchrange *fxr, +struct xfs_inode *ip1, +struct xfs_inode *ip2, +unsigned int alloc_unit) +{ +uint64_t length = fxr->length; +uint64_t blen; +loff_t size1, size2; + + size1 =i_size_read (VFS_I (ip1)); + size2 =i_size_read (VFS_I (ip2)); + +/* The start of both ranges must be aligned to a rt extent. */ +if (!isaligned_64 (fxr->file1_offset, alloc_unit) || + !isaligned_64 (fxr->file2_offset, alloc_unit)) +return -EINVAL ; + +if (fxr->flags &XFS_EXCHANGE_RANGE_TO_EOF ) + length =max_t (int64_t, size1 - fxr->file1_offset, + size2 - fxr->file2_offset); + +/* +* If the user wanted us to exchange up to the infile's EOF, round up +* to the next rt extent boundary for this check. Do the same for the +* outfile. +* +* Otherwise, reject the range length if it's not rt extent aligned. +* We already confirmed the starting offsets' rt extent block +* alignment. +*/ +if (fxr->file1_offset + length == size1) + blen =roundup_64 (size1, alloc_unit) - fxr->file1_offset; +else if (fxr->file2_offset + length == size2) + blen =roundup_64 (size2, alloc_unit) - fxr->file2_offset; +else if (!isaligned_64 (length, alloc_unit)) +return -EINVAL ; +else + blen = length; + +/* Don't allow overlapped exchanges within the same file. */ +if (ip1 == ip2 && + fxr->file2_offset + blen > fxr->file1_offset && + fxr->file1_offset + blen > fxr->file2_offset) +return -EINVAL ; + +/* +* Ensure that we don't exchange a partial EOF rt extent into the +* middle of another file. +*/ +if (isaligned_64 (length, alloc_unit)) +return 0 ; + + blen = length; +if (fxr->file2_offset + length < size2) + blen =rounddown_64 (blen, alloc_unit); + +if (fxr->file1_offset + blen < size1) + blen =rounddown_64 (blen, alloc_unit); + +return blen == length ?0 : -EINVAL ; +} +/* Prepare two files to have their data exchanged. */ STATIC int xfs_exchrange_prep(
@@ -570,6 +639,7 @@ xfs_exchrange_prep(struct xfs_inode *ip1, struct xfs_inode *ip2) { + struct xfs_mount *mp = ip2->i_mount;unsigned int alloc_unit =xfs_inode_alloc_unitsize (ip2);int error;
@@ -579,13 +649,18 @@ xfs_exchrange_prep(if (XFS_IS_REALTIME_INODE (ip1) !=XFS_IS_REALTIME_INODE (ip2))return -EINVAL ; -/* -* The alignment checks in the generic helpers cannot deal with -* allocation units that are not powers of 2. This can happen with the -* realtime volume if the extent size is set. -*/ -if (!is_power_of_2 (alloc_unit)) -return -EOPNOTSUPP ; +/* Check non-power of two alignment issues, if necessary. */ +if (!is_power_of_2 (alloc_unit)) { + error =xfs_exchrange_check_rtalign (fxr, ip1, ip2, alloc_unit); +if (error) +return error; + +/* +* Do the generic file-level checks with the regular block +* alignment. +*/ + alloc_unit = mp->m_sb.sb_blocksize; + } error =xfs_exchange_range_prep (fxr, alloc_unit);if (error || fxr->length ==0 )
PATCH 13/15 docs: update swapext -> exchmaps language
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
Start reworking the atomic swapext design documentation to refer to its new file contents/mapping exchange name.
--- .../filesystems/xfs/xfs-online-fsck-design.rst | 259 +++++++++++--------- 1 file changed, 136 insertions(+), 123 deletions(-)
Documentation/filesystems/xfs/xfs-online-fsck-design.rst +136 -123
@@ -2167,7 +2167,7 @@ The ``xfblob_free`` function frees a specific blob, and the ``xfblob_truncate`` function frees them all because compaction is not needed. The details of repairing directories and extended attributes will be discussed -in a subsequent section about atomic extent swapping. +in a subsequent section about atomic file content exchanges. However, it should be noted that these repair functions only use blob storage to cache a small number of entries before adding them to a temporary ondisk file, which is why compaction is not required.
@@ -2802,7 +2802,8 @@ follows this format: Repairs for file-based metadata such as extended attributes, directories, symbolic links, quota files and realtime bitmaps are performed by building a -new structure attached to a temporary file and swapping the forks. +new structure attached to a temporary file and exchanging all mappings in the +file forks. Afterward, the mappings in the old file fork are the candidate blocks for disposal.
@@ -3851,8 +3852,8 @@ Because file forks can consume as much space as the entire filesystem, repairs cannot be staged in memory, even when a paging scheme is available. Therefore, online repair of file-based metadata createas a temporary file in the XFS filesystem, writes a new structure at the correct offsets into the -temporary file, and atomically swaps the fork mappings (and hence the fork -contents) to commit the repair. +temporary file, and atomically exchanges all file fork mappings (and hence the +fork contents) to commit the repair. Once the repair is complete, the old fork can be reaped as necessary; if the system goes down during the reap, the iunlink code will delete the blocks during log recovery.
@@ -3862,10 +3863,11 @@ consistent to use a temporary file safely! This dependency is the reason why online repair can only use pageable kernel memory to stage ondisk space usage information. -Swapping metadata extents with a temporary file requires the owner field of the -block headers to match the file being repaired and not the temporary file. The -directory, extended attribute, and symbolic link functions were all modified to -allow callers to specify owner numbers explicitly. +Exchanging metadata file mappings with a temporary file requires the owner +field of the block headers to match the file being repaired and not the +temporary file. +The directory, extended attribute, and symbolic link functions were all +modified to allow callers to specify owner numbers explicitly. There is a downside to the reaping process -- if the system crashes during the reap phase and the fork extents are crosslinked, the iunlink processing will
@@ -3974,8 +3976,8 @@ The proposed patches are in the <https://git.kernel.org/pub/scm/linux/kernel/git/djwong/xfs-linux.git/log/?h=repair-tempfiles>`_ series. -Atomic Extent Swapping ----------------------- +Logged File Content Exchanges +----------------------------- Once repair builds a temporary file with a new data structure written into it, it must commit the new changes into the existing file.
@@ -4010,17 +4012,21 @@ e. Old blocks in the file may be cross-linked with another structure and must These problems are overcome by creating a new deferred operation and a new type of log intent item to track the progress of an operation to exchange two file ranges. -The new deferred operation type chains together the same transactions used by -the reverse-mapping extent swap code. +The new exchange operation type chains together the same transactions used by +the reverse-mapping extent swap code, but records intermedia progress in the +log so that operations can be restarted after a crash. +This new functionality is called the file contents exchange (xfs_exchrange) +code. +The underlying implementation exchanges file fork mappings (xfs_exchmaps). The new log item records the progress of the exchange to ensure that once an exchange begins, it will always run to completion, even there are interruptions. -The new ``XFS_SB_FEAT_INCOMPAT_LOG_ATOMIC_SWAP`` log-incompatible feature flag +The new ``XFS_SB_FEAT_INCOMPAT_LOG_EXCHMAPS`` log-incompatible feature flag in the superblock protects these new log item records from being replayed on old kernels. The proposed patchset is the -`atomic extent swap +`file contents exchange <https://git.kernel.org/pub/scm/linux/kernel/git/djwong/xfs-linux.git/log/?h=atomic-file-updates>`_ series.
@@ -4061,72 +4067,73 @@ series. | The feature bit will not be cleared from the superblock until the log | | becomes clean. | | | -| Log-assisted extended attribute updates and atomic extent swaps both use | -| log incompat features and provide convenience wrappers around the | +| Log-assisted extended attribute updates and file content exchanges bothe | +| use log incompat features and provide convenience wrappers around the | | functionality. | +--------------------------------------------------------------------------+ -Mechanics of an Atomic Extent Swap -`````````````````````````````````` +Mechanics of a Logged File Content Exchange +``````````````````````````````````````````` -Swapping entire file forks is a complex task. +Exchanging contents between file forks is a complex task. The goal is to exchange all file fork mappings between two file fork offset ranges. There are likely to be many extent mappings in each fork, and the edges of the mappings aren't necessarily aligned. -Furthermore, there may be other updates that need to happen after the swap, +Furthermore, there may be other updates that need to happen after the exchange, such as exchanging file sizes, inode flags, or conversion of fork data to local format. -This is roughly the format of the new deferred extent swap work item: +This is roughly the format of the new deferred exchange-mapping work item: .. code-block:: c - struct xfs_swapext_intent { + struct xfs_exchmaps_intent { /* Inodes participating in the operation. */ - struct xfs_inode *sxi_ip1; - struct xfs_inode *sxi_ip2; + struct xfs_inode *xmi_ip1; + struct xfs_inode *xmi_ip2; /* File offset range information. */ - xfs_fileoff_t sxi_startoff1; - xfs_fileoff_t sxi_startoff2; - xfs_filblks_t sxi_blockcount; + xfs_fileoff_t xmi_startoff1; + xfs_fileoff_t xmi_startoff2; + xfs_filblks_t xmi_blockcount; /* Set these file sizes after the operation, unless negative. */ - xfs_fsize_t sxi_isize1; - xfs_fsize_t sxi_isize2; + xfs_fsize_t xmi_isize1; + xfs_fsize_t xmi_isize2; - /* XFS_SWAP_EXT_* log operation flags */ - uint64_t sxi_flags; + /* XFS_EXCHMAPS_* log operation flags */ + uint64_t xmi_flags; }; The new log intent item contains enough information to track two logical fork offset ranges: ``(inode1, startoff1, blockcount)`` and ``(inode2, startoff2, blockcount)``. -Each step of a swap operation exchanges the largest file range mapping possible -from one file to the other. -After each step in the swap operation, the two startoff fields are incremented -and the blockcount field is decremented to reflect the progress made. -The flags field captures behavioral parameters such as swapping the attr fork -instead of the data fork and other work to be done after the extent swap. -The two isize fields are used to swap the file size at the end of the operation -if the file data fork is the target of the swap operation. +Each step of an exchange operation exchanges the largest file range mapping +possible from one file to the other. +After each step in the exchange operation, the two startoff fields are +incremented and the blockcount field is decremented to reflect the progress +made. +The flags field captures behavioral parameters such as exchanging attr fork +mappings instead of the data fork and other work to be done after the exchange. +The two isize fields are used to exchange the file sizes at the end of the +operation if the file data fork is the target of the operation. -When the extent swap is initiated, the sequence of operations is as follows: +When the exchange is initiated, the sequence of operations is as follows: -1. Create a deferred work item for the extent swap. - At the start, it should contain the entirety of the file ranges to be - swapped. +1. Create a deferred work item for the file mapping exchange. + At the start, it should contain the entirety of the file block ranges to be + exchanged. 2. Call ``xfs_defer_finish`` to process the exchange. - This is encapsulated in ``xrep_tempswap_contents`` for scrub operations. + This is encapsulated in ``xrep_tempexch_contents`` for scrub operations. This will log an extent swap intent item to the transaction for the deferred - extent swap work item. + mapping exchange work item. -3. Until ``sxi_blockcount`` of the deferred extent swap work item is zero, +3. Until ``xmi_blockcount`` of the deferred mapping exchange work item is zero, - a. Read the block maps of both file ranges starting at ``sxi_startoff1`` and - ``sxi_startoff2``, respectively, and compute the longest extent that can - be swapped in a single step. + a. Read the block maps of both file ranges starting at ``xmi_startoff1`` and + ``xmi_startoff2``, respectively, and compute the longest extent that can + be exchanged in a single step. This is the minimum of the two ``br_blockcount`` s in the mappings. Keep advancing through the file forks until at least one of the mappings contains written blocks.
@@ -4148,20 +4155,20 @@ When the extent swap is initiated, the sequence of operations is as follows: g. Extend the ondisk size of either file if necessary. - h. Log an extent swap done log item for the extent swap intent log item - that was read at the start of step 3. + h. Log a mapping exchange done log item for th mapping exchange intent log + item that was read at the start of step 3. i. Compute the amount of file range that has just been covered. This quantity is ``(map1.br_startoff + map1.br_blockcount - - sxi_startoff1)``, because step 3a could have skipped holes. + xmi_startoff1)``, because step 3a could have skipped holes. - j. Increase the starting offsets of ``sxi_startoff1`` and ``sxi_startoff2`` + j. Increase the starting offsets of ``xmi_startoff1`` and ``xmi_startoff2`` by the number of blocks computed in the previous step, and decrease - ``sxi_blockcount`` by the same quantity. + ``xmi_blockcount`` by the same quantity. This advances the cursor. - k. Log a new extent swap intent log item reflecting the advanced state of - the work item. + k. Log a new mapping exchange intent log item reflecting the advanced state + of the work item. l. Return the proper error code (EAGAIN) to the deferred operation manager to inform it that there is more work to be done.
@@ -4172,22 +4179,23 @@ When the extent swap is initiated, the sequence of operations is as follows: This will be discussed in more detail in subsequent sections. If the filesystem goes down in the middle of an operation, log recovery will -find the most recent unfinished extent swap log intent item and restart from -there. -This is how extent swapping guarantees that an outside observer will either see -the old broken structure or the new one, and never a mismash of both. +find the most recent unfinished maping exchange log intent item and restart +from there. +This is how atomic file mapping exchanges guarantees that an outside observer +will either see the old broken structure or the new one, and never a mismash of +both. -Preparation for Extent Swapping -``````````````````````````````` +Preparation for File Content Exchanges +`````````````````````````````````````` There are a few things that need to be taken care of before initiating an -atomic extent swap operation. +atomic file mapping exchange operation. First, regular files require the page cache to be flushed to disk before the operation begins, and directio writes to be quiesced. -Like any filesystem operation, extent swapping must determine the maximum -amount of disk space and quota that can be consumed on behalf of both files in -the operation, and reserve that quantity of resources to avoid an unrecoverable -out of space failure once it starts dirtying metadata. +Like any filesystem operation, file mapping exchanges must determine the +maximum amount of disk space and quota that can be consumed on behalf of both +files in the operation, and reserve that quantity of resources to avoid an +unrecoverable out of space failure once it starts dirtying metadata. The preparation step scans the ranges of both files to estimate: - Data device blocks needed to handle the repeated updates to the fork
@@ -4201,56 +4209,59 @@ The preparation step scans the ranges of both files to estimate: to different extents on the realtime volume, which could happen if the operation fails to run to completion. -The need for precise estimation increases the run time of the swap operation, -but it is very important to maintain correct accounting. -The filesystem must not run completely out of free space, nor can the extent -swap ever add more extent mappings to a fork than it can support. +The need for precise estimation increases the run time of the exchange +operation, but it is very important to maintain correct accounting. +The filesystem must not run completely out of free space, nor can the mapping +exchange ever add more extent mappings to a fork than it can support. Regular users are required to abide the quota limits, though metadata repairs may exceed quota to resolve inconsistent metadata elsewhere. -Special Features for Swapping Metadata File Extents -``````````````````````````````````````````````````` +Special Features for Exchanging Metadata File Contents +`````````````````````````````````````````````````````` Extended attributes, symbolic links, and directories can set the fork format to "local" and treat the fork as a literal area for data storage. Metadata repairs must take extra steps to support these cases: - If both forks are in local format and the fork areas are large enough, the - swap is performed by copying the incore fork contents, logging both forks, - and committing. - The atomic extent swap mechanism is not necessary, since this can be done - with a single transaction. + exchange is performed by copying the incore fork contents, logging both + forks, and committing. + The atomic file mapping exchange mechanism is not necessary, since this can + be done with a single transaction. -- If both forks map blocks, then the regular atomic extent swap is used. +- If both forks map blocks, then the regular atomic file mapping exchange is + used. - Otherwise, only one fork is in local format. The contents of the local format fork are converted to a block to perform the - swap. + exchange. The conversion to block format must be done in the same transaction that - logs the initial extent swap intent log item. - The regular atomic extent swap is used to exchange the mappings. - Special flags are set on the swap operation so that the transaction can be - rolled one more time to convert the second file's fork back to local format - so that the second file will be ready to go as soon as the ILOCK is dropped. + logs the initial mapping exchange intent log item. + The regular atomic mapping exchange is used to exchange the metadata file + mappings. + Special flags are set on the exchange operation so that the transaction can + be rolled one more time to convert the second file's fork back to local + format so that the second file will be ready to go as soon as the ILOCK is + dropped. Extended attributes and directories stamp the owning inode into every block, but the buffer verifiers do not actually check the inode number! Although there is no verification, it is still important to maintain -referential integrity, so prior to performing the extent swap, online repair -builds every block in the new data structure with the owner field of the file -being repaired. +referential integrity, so prior to performing the mapping exchange, online +repair builds every block in the new data structure with the owner field of the +file being repaired. -After a successful swap operation, the repair operation must reap the old fork -blocks by processing each fork mapping through the standard :ref:`file extent -reaping <reaping>` mechanism that is done post-repair. +After a successful exchange operation, the repair operation must reap the old +fork blocks by processing each fork mapping through the standard :ref:`file +extent reaping <reaping>` mechanism that is done post-repair. If the filesystem should go down during the reap part of the repair, the iunlink processing at the end of recovery will free both the temporary file and whatever blocks were not reaped. However, this iunlink processing omits the cross-link detection of online repair, and is not completely foolproof. -Swapping Temporary File Extents -``````````````````````````````` +Exchanging Temporary File Contents +`````````````````````````````````` To repair a metadata file, online repair proceeds as follows:
@@ -4260,14 +4271,14 @@ To repair a metadata file, online repair proceeds as follows: file. The same fork must be written to as is being repaired. -3. Commit the scrub transaction, since the swap estimation step must be - completed before transaction reservations are made. +3. Commit the scrub transaction, since the exchange resource estimation step + must be completed before transaction reservations are made. -4. Call ``xrep_tempswap_trans_alloc`` to allocate a new scrub transaction with +4. Call ``xrep_tempexch_trans_alloc`` to allocate a new scrub transaction with the appropriate resource reservations, locks, and fill out a ``struct - xfs_swapext_req`` with the details of the swap operation. + xfs_exchmaps_req`` with the details of the exchange operation. -5. Call ``xrep_tempswap_contents`` to swap the contents. +5. Call ``xrep_tempexch_contents`` to exchange the contents. 6. Commit the transaction to complete the repair.
@@ -4309,7 +4320,7 @@ To check the summary file against the bitmap: 3. Compare the contents of the xfile against the ondisk file. To repair the summary file, write the xfile contents into the temporary file -and use atomic extent swap to commit the new contents. +and use atomic mapping exchange to commit the new contents. The temporary file is then reaped. The proposed patchset is the
@@ -4352,8 +4363,8 @@ Salvaging extended attributes is done as follows: memory or there are no more attr fork blocks to examine, unlock the file and add the staged extended attributes to the temporary file. -3. Use atomic extent swapping to exchange the new and old extended attribute - structures. +3. Use atomic file mapping exchange to exchange the new and old extended + attribute structures. The old attribute blocks are now attached to the temporary file. 4. Reap the temporary file.
@@ -4410,7 +4421,8 @@ salvaging directories is straightforward: directory and add the staged dirents into the temporary directory. Truncate the staging files. -4. Use atomic extent swapping to exchange the new and old directory structures. +4. Use atomic file mapping exchange to exchange the new and old directory + structures. The old directory blocks are now attached to the temporary file. 5. Reap the temporary file.
@@ -4542,7 +4554,7 @@ a :ref:`directory entry live update hook <liveupdate>` as follows: Instead, we stash updates in the xfarray and rely on the scanner thread to apply the stashed updates to the temporary directory. -5. When the scan is complete, atomically swap the contents of the temporary +5. When the scan is complete, atomically exchange the contents of the temporary directory and the directory being repaired. The temporary directory now contains the damaged directory structure.
@@ -4629,8 +4641,8 @@ directory reconstruction: 5. Copy all non-parent pointer extended attributes to the temporary file. -6. When the scan is complete, atomically swap the attribute fork of the - temporary file and the file being repaired. +6. When the scan is complete, atomically exchange the mappings of the attribute + forks of the temporary file and the file being repaired. The temporary file now contains the damaged extended attribute structure. 7. Reap the temporary file.
@@ -5105,18 +5117,18 @@ make it easier for code readers to understand what has been built, for whom it has been built, and why. Please feel free to contact the XFS mailing list with questions. -FIEXCHANGE_RANGE ----------------- +XFS_IOC_EXCHANGE_RANGE +---------------------- -As discussed earlier, a second frontend to the atomic extent swap mechanism is -a new ioctl call that userspace programs can use to commit updates to files -atomically. +As discussed earlier, a second frontend to the atomic file mapping exchange +mechanism is a new ioctl call that userspace programs can use to commit updates +to files atomically. This frontend has been out for review for several years now, though the necessary refinements to online repair and lack of customer demand mean that the proposal has not been pushed very hard. -Extent Swapping with Regular User Files -``````````````````````````````````````` +File Content Exchanges with Regular User Files +`````````````````````````````````````````````` As mentioned earlier, XFS has long had the ability to swap extents between files, which is used almost exclusively by ``xfs_fsr`` to defragment files.
@@ -5131,12 +5143,12 @@ the consistency of the fork mappings with the reverse mapping index was to develop an iterative mechanism that used deferred bmap and rmap operations to swap mappings one at a time. This mechanism is identical to steps 2-3 from the procedure above except for -the new tracking items, because the atomic extent swap mechanism is an -iteration of an existing mechanism and not something totally novel. +the new tracking items, because the atomic file mapping exchange mechanism is +an iteration of an existing mechanism and not something totally novel. For the narrow case of file defragmentation, the file contents must be identical, so the recovery guarantees are not much of a gain. -Atomic extent swapping is much more flexible than the existing swapext +Atomic file content exchanges are much more flexible than the existing swapext implementations because it can guarantee that the caller never sees a mix of old and new contents even after a crash, and it can operate on two arbitrary file fork ranges.
@@ -5147,11 +5159,11 @@ The extra flexibility enables several new use cases: Next, it opens a temporary file and calls the file clone operation to reflink the first file's contents into the temporary file. Writes to the original file should instead be written to the temporary file. - Finally, the process calls the atomic extent swap system call - (``FIEXCHANGE_RANGE``) to exchange the file contents, thereby committing all - of the updates to the original file, or none of them. + Finally, the process calls the atomic file mapping exchange system call + (``XFS_IOC_EXCHANGE_RANGE``) to exchange the file contents, thereby + committing all of the updates to the original file, or none of them. -.. _swapext_if_unchanged: +.. _exchrange_if_unchanged: - **Transactional file updates**: The same mechanism as above, but the caller only wants the commit to occur if the original file's contents have not
@@ -5160,16 +5172,17 @@ The extra flexibility enables several new use cases: change timestamps of the original file before reflinking its data to the temporary file. When the program is ready to commit the changes, it passes the timestamps - into the kernel as arguments to the atomic extent swap system call. + into the kernel as arguments to the atomic file mapping exchange system call. The kernel only commits the changes if the provided timestamps match the original file. + A new ioctl (``XFS_IOC_COMMIT_RANGE``) is provided to perform this. - **Emulation of atomic block device writes**: Export a block device with a logical sector size matching the filesystem block size to force all writes to be aligned to the filesystem block size. Stage all writes to a temporary file, and when that is complete, call the - atomic extent swap system call with a flag to indicate that holes in the - temporary file should be ignored. + atomic file mapping exchange system call with a flag to indicate that holes + in the temporary file should be ignored. This emulates an atomic device write in software, and can support arbitrary scattered writes.
@@ -5251,8 +5264,8 @@ of the file to try to share the physical space with a dummy file. Cloning the extent means that the original owners cannot overwrite the contents; any changes will be written somewhere else via copy-on-write. Clearspace makes its own copy of the frozen extent in an area that is not being -cleared, and uses ``FIEDEUPRANGE`` (or the :ref:`atomic extent swap -<swapext_if_unchanged>` feature) to change the target file's data extent +cleared, and uses ``FIEDEUPRANGE`` (or the :ref:`atomic file content exchanges +<exchrange_if_unchanged>` feature) to change the target file's data extent mapping away from the area being cleared. When all other mappings have been moved, clearspace reflinks the space into the space collector file so that it becomes unavailable.
PATCH 14/15 xfs: introduce new file range commit ioctls
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
This patch introduces two more new ioctls to manage atomic updates to file contents -- XFS_IOC_START_COMMIT and XFS_IOC_COMMIT_RANGE. The commit mechanism here is exactly the same as what XFS_IOC_EXCHANGE_RANGE does, but with the additional requirement that file2 cannot have changed since some sampling point. The start-commit ioctl performs the sampling of file attributes.
--- fs/xfs/libxfs/xfs_fs.h | 26 ++++++++++++++ fs/xfs/xfs_exchrange.c | 54 +++++++++++++++++++++++++++++ fs/xfs/xfs_exchrange.h | 7 +++- fs/xfs/xfs_ioctl.c | 88 ++++++++++++++++++++++++++++++++++++++++++++++++ fs/xfs/xfs_trace.h | 3 +- 5 files changed, 175 insertions(+), 3 deletions(-)
fs/xfs/libxfs/xfs_fs.h +26 -0
@@ -790,6 +790,30 @@ struct xfs_exchange_range {__u64 flags;/* see XFS_EXCHANGE_RANGE_* below */ }; +/* +* Using the same definition of file2 as struct xfs_exchange_range, commit the +* contents of file1 into file2 if file2 has the same inode number, mtime, and +* ctime as the arguments provided to the call. The old contents of file2 will +* be moved to file1. +* +* Returns -EBUSY if there isn't an exact match for the file2 fields. +* +* Filesystems must be able to restart and complete the operation even after +* the system goes down. +*/ +struct xfs_commit_range { +__s32 file1_fd; +__u32 pad;/* must be zeroes */ +__u64 file1_offset;/* file1 offset, bytes */ +__u64 file2_offset;/* file2 offset, bytes */ +__u64 length;/* bytes to exchange */ + +__u64 flags;/* see XFS_EXCHANGE_RANGE_* below */ + +/* opaque file2 metadata for freshness checks */ +__u64 file2_freshness[5 ]; +}; +/* * Exchange file data all the way to the ends of both files, and then exchange * the file sizes. This flag can be used to replace a file's contents with a
@@ -887,6 +911,8 @@ struct xfs_exchange_range {#define XFS_IOC_BULKSTAT _IOR ('X', 127, struct xfs_bulkstat_req)#define XFS_IOC_INUMBERS _IOR ('X', 128, struct xfs_inumbers_req)#define XFS_IOC_EXCHANGE_RANGE _IOWR('X', 129, struct xfs_exchange_range) +#define XFS_IOC_START_COMMIT _IOWR('X', 130, struct xfs_commit_range) +#define XFS_IOC_COMMIT_RANGE _IOWR('X', 131, struct xfs_commit_range)/* XFS_IOC_GETFSUUID ---------- deprecated 140 */
fs/xfs/xfs_exchrange.c +53 -1
75 lines not on this page · raw message
fs/xfs/xfs_exchrange.h +6 -1
@@ -13,8 +13,12 @@ int xfs_exchrange_enable(struct xfs_mount *mp);#define __XFS_EXCHANGE_RANGE_UPD_CMTIME1 (1ULL << 63)#define __XFS_EXCHANGE_RANGE_UPD_CMTIME2 (1ULL << 62) +/* Freshness check required */ +#define __XFS_EXCHANGE_RANGE_CHECK_FRESH2 (1ULL << 61) +#define XFS_EXCHANGE_RANGE_PRIV_FLAGS (__XFS_EXCHANGE_RANGE_UPD_CMTIME1 | \ - __XFS_EXCHANGE_RANGE_UPD_CMTIME2) + __XFS_EXCHANGE_RANGE_UPD_CMTIME2 | \ + __XFS_EXCHANGE_RANGE_CHECK_FRESH2)struct xfs_exchrange {struct file *file1;
@@ -32,6 +36,7 @@ struct xfs_exchrange {struct timespec64 file2_ctime; }; +void xfs_exchrange_freshness (struct xfs_exchrange *fxr);int xfs_exchange_range (struct xfs_exchrange *fxr);struct xfs_exchmaps_req ;
fs/xfs/xfs_ioctl.c +88 -0
100 lines not on this page · raw message
fs/xfs/xfs_trace.h +2 -1
@@ -4835,7 +4835,8 @@ DEFINE_INODE_ERROR_EVENT(xfs_exchrange_error); { XFS_EXCHANGE_RANGE_DRY_RUN, "DRY_RUN" }, \ { XFS_EXCHANGE_RANGE_FILE1_WRITTEN, "F1_WRITTEN" }, \ { __XFS_EXCHANGE_RANGE_UPD_CMTIME1, "CMTIME1" }, \ - { __XFS_EXCHANGE_RANGE_UPD_CMTIME2, "CMTIME2" } + { __XFS_EXCHANGE_RANGE_UPD_CMTIME2, "CMTIME2" }, \ + { __XFS_EXCHANGE_RANGE_CHECK_FRESH2, "FRESH2" }/* file exchange-range tracepoint class */ DECLARE_EVENT_CLASS(xfs_exchrange_class,
Re: [PATCH 14/15] xfs: introduce new file range commit ioctls
Quoted 8 lines · Darrick J. Wong
From: Darrick J. Wong <[email protected]>
This patch introduces two more new ioctls to manage atomic updates to file contents --
XFS_IOC_START_COMMITandXFS_IOC_COMMIT_RANGE. The commit mechanism here is exactly the same as whatXFS_IOC_EXCHANGE_RANGEdoes, but with the additional requirement that file2 cannot have changed since some sampling point. The start-commit ioctl performs the sampling of file attributes.
Unless we actually have a good use case for this right now I'd still prefer to skip it.
Re: [PATCH 14/15] xfs: introduce new file range commit ioctls
Quoted 10 lines · Christoph Hellwig
Quoted 8 lines · Darrick J. Wong
From: Darrick J. Wong <[email protected]>
This patch introduces two more new ioctls to manage atomic updates to file contents --
XFS_IOC_START_COMMITandXFS_IOC_COMMIT_RANGE. The commit mechanism here is exactly the same as whatXFS_IOC_EXCHANGE_RANGEdoes, but with the additional requirement that file2 cannot have changed since some sampling point. The start-commit ioctl performs the sampling of file attributes.
Quoted 2 lines
Unless we actually have a good use case for this right now I'd still prefer to skip it.
<nod> I'll leave this in djwong-wtf for review, but eventually I'll turn it into a separate branch that can be picked up or not.
--D
PATCH 15/15 xfs: enable logged file mapping exchange feature
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
Add the XFS_SB_FEAT_INCOMPAT_LOG_EXCHMAPS feature to the set of features that we will permit when mounting a filesystem. This turns on support for the file range exchange feature.
--- fs/xfs/libxfs/xfs_format.h | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-)
fs/xfs/libxfs/xfs_format.h +2 -1
@@ -398,7 +398,8 @@ xfs_sb_has_incompat_feature(*/ #define XFS_SB_FEAT_INCOMPAT_LOG_EXCHMAPS (1 << 1)#define XFS_SB_FEAT_INCOMPAT_LOG_ALL \ - (XFS_SB_FEAT_INCOMPAT_LOG_XATTRS) + (XFS_SB_FEAT_INCOMPAT_LOG_XATTRS | \ + XFS_SB_FEAT_INCOMPAT_LOG_EXCHMAPS)#define XFS_SB_FEAT_INCOMPAT_LOG_UNKNOWN ~XFS_SB_FEAT_INCOMPAT_LOG_ALLstatic inline bool xfs_sb_has_incompat_log_feature(
PATCH 5/15 xfs: create temporary files for online repair
In reply to Darrick J. WongHi all,
As mentioned earlier, the repair strategy for file-based metadata is to build a new copy in a temporary file and swap the file fork mappings with the metadata inode. We've built the atomic extent swap facility, so now we need to build a facility for handling private temporary files.
The first step is to teach the filesystem to ignore the temporary files. We'll mark them as PRIVATE in the VFS so that the kernel security modules will leave it alone. The second step is to add the online repair code the ability to create a temporary file and reap extents from the temporary file after the extent swap.
If you're going to start using this code, I strongly recommend pulling from my git trees, which are linked below.
This has been running on the djcloud for months with no problems. Enjoy! Comments and questions are, as always, welcome.
--D
kernel git tree:
https://git.kernel.org/cgit/linux/kernel/git/djwong/xfs-linux.git/log/?h=repair-tempfiles
---
Commits in this patchset:
* xfs: hide private inodes from bulkstat and handle functions
* xfs: create temporary files and directories for online repair
* xfs: refactor live buffer invalidation for repairs
* xfs: add the ability to reap entire inode forks
--- fs/xfs/Makefile | 1 fs/xfs/scrub/parent.c | 2 fs/xfs/scrub/reap.c | 445 +++++++++++++++++++++++++++++++++++++++++++++-- fs/xfs/scrub/reap.h | 21 ++ fs/xfs/scrub/scrub.c | 3 fs/xfs/scrub/scrub.h | 4 fs/xfs/scrub/tempfile.c | 251 +++++++++++++++++++++++++++ fs/xfs/scrub/tempfile.h | 28 +++ fs/xfs/scrub/trace.h | 96 ++++++++++ fs/xfs/xfs_export.c | 2 fs/xfs/xfs_inode.c | 3 fs/xfs/xfs_inode.h | 2 fs/xfs/xfs_iops.c | 3 fs/xfs/xfs_itable.c | 8 + 14 files changed, 843 insertions(+), 26 deletions(-) create mode 100644 fs/xfs/scrub/tempfile.c create mode 100644 fs/xfs/scrub/tempfile.h
PATCH 1/4 xfs: hide private inodes from bulkstat and handle functions
From: Darrick J. Wong <[email protected]>
We're about to start adding functionality that uses internal inodes that are private to XFS. What this means is that userspace should never be able to access any information about these files, and should not be able to open these files by handle.
To prevent users from ever finding the file or mis-interactions with the security apparatus, set S_PRIVATE on the inode. Don't allow bulkstat, open-by-handle, or linking of S_PRIVATE files into the directory tree. This should keep private inodes actually private.
--- fs/xfs/xfs_export.c | 2 +- fs/xfs/xfs_iops.c | 3 +++ fs/xfs/xfs_itable.c | 8 ++++++++ 3 files changed, 12 insertions(+), 1 deletion(-)
fs/xfs/xfs_export.c +1 -1
@@ -160,7 +160,7 @@ xfs_nfs_get_inode( } } -if (VFS_I (ip)->i_generation != generation) { +if (VFS_I (ip)->i_generation != generation ||IS_PRIVATE (VFS_I (ip))) {xfs_irele (ip);return ERR_PTR (-ESTALE ); }
fs/xfs/xfs_iops.c +3 -0
@@ -365,6 +365,9 @@ xfs_vn_link(if (unlikely (error))return error; +if (IS_PRIVATE (inode)) +return -EPERM ; + error =xfs_link (XFS_I (dir),XFS_I (inode), &name);if (unlikely (error))return error;
fs/xfs/xfs_itable.c +8 -0
@@ -97,6 +97,14 @@ xfs_bulkstat_one_int( vfsuid =i_uid_into_vfsuid (idmap, inode); vfsgid =i_gid_into_vfsgid (idmap, inode); +/* If this is a private inode, don't leak its details to userspace. */ +if (IS_PRIVATE (inode)) { +xfs_iunlock (ip,XFS_ILOCK_SHARED ); +xfs_irele (ip); + error = -EINVAL ; + goto out_advance; + } +/* xfs_iget returns the following without needing * further change. */
Re: [PATCH 1/4] xfs: hide private inodes from bulkstat and handle functions
Looks good:
PATCH 2/4 xfs: create temporary files and directories for online repair
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
Teach the online repair code how to create temporary files or directories. These temporary files can be used to stage reconstructed information until we're ready to perform an atomic extent swap to commit the new metadata.
--- fs/xfs/Makefile | 1 fs/xfs/scrub/parent.c | 2 fs/xfs/scrub/scrub.c | 3 + fs/xfs/scrub/scrub.h | 4 + fs/xfs/scrub/tempfile.c | 251 +++++++++++++++++++++++++++++++++++++++++++++++ fs/xfs/scrub/tempfile.h | 28 +++++ fs/xfs/scrub/trace.h | 33 ++++++ fs/xfs/xfs_inode.c | 3 - fs/xfs/xfs_inode.h | 2 9 files changed, 324 insertions(+), 3 deletions(-) create mode 100644 fs/xfs/scrub/tempfile.c create mode 100644 fs/xfs/scrub/tempfile.h
fs/xfs/Makefile +1 -0
@@ -207,6 +207,7 @@ xfs-y += $(addprefix scrub/, \ refcount_repair.o \ repair.o \ rmap_repair.o \ + tempfile.o \ ) xfs-$(CONFIG_XFS_RT) += $(addprefix scrub/, \
fs/xfs/scrub/parent.c +1 -1
@@ -143,7 +143,7 @@ xchk_parent_validate( }if (!xchk_fblock_xref_process_error (sc,XFS_DATA_FORK ,0 , &error))return error; -if (dp == sc->ip || !S_ISDIR (VFS_I (dp)->i_mode)) { +if (dp == sc->ip || dp == sc->tempip || !S_ISDIR (VFS_I (dp)->i_mode)) {xchk_fblock_set_corrupt (sc,XFS_DATA_FORK ,0 ); goto out_rele; }
fs/xfs/scrub/scrub.c +3 -0
@@ -17,6 +17,7 @@#include "xfs_scrub.h" #include "xfs_buf_mem.h" #include "xfs_rmap.h" +#include "xfs_exchrange.h" #include "scrub/scrub.h" #include "scrub/common.h" #include "scrub/trace.h"
@@ -24,6 +25,7 @@#include "scrub/health.h" #include "scrub/stats.h" #include "scrub/xfile.h" +#include "scrub/tempfile.h" /* * Online Scrub and Repair
@@ -211,6 +213,7 @@ xchk_teardown( sc->buf =NULL ; } +xrep_tempfile_rele (sc);xchk_fsgates_disable (sc);return error; }
fs/xfs/scrub/scrub.h +4 -0
@@ -105,6 +105,10 @@ struct xfs_scrub {/* Lock flags for @ip. */ uint ilock_flags; +/* A temporary file on this filesystem, for staging new metadata. */ +struct xfs_inode *tempip; +uint temp_ilock_flags; +/* See the XCHK/XREP state flags below. */ unsigned int flags;
fs/xfs/scrub/tempfile.c new file +251 -0
251 lines not on this page · raw message
fs/xfs/scrub/tempfile.h new file +28 -0
@@ -0,0 +1,28 @@ +// SPDX-License-Identifier: GPL-2.0-or-later +/* +* Copyright (c) 2021-2024 Oracle. All Rights Reserved. +* Author: Darrick J. Wong <[email protected]> +*/ +#ifndef __XFS_SCRUB_TEMPFILE_H__ +#define __XFS_SCRUB_TEMPFILE_H__ + +#ifdef CONFIG_XFS_ONLINE_REPAIR +int xrep_tempfile_create (struct xfs_scrub *sc,uint16_t mode); +void xrep_tempfile_rele (struct xfs_scrub *sc); + +bool xrep_tempfile_iolock_nowait (struct xfs_scrub *sc); +int xrep_tempfile_iolock_polled (struct xfs_scrub *sc); +void xrep_tempfile_iounlock (struct xfs_scrub *sc); + +void xrep_tempfile_ilock (struct xfs_scrub *sc); +bool xrep_tempfile_ilock_nowait (struct xfs_scrub *sc); +void xrep_tempfile_iunlock (struct xfs_scrub *sc); +#else +static inline void xrep_tempfile_iolock_both (struct xfs_scrub *sc) +{ +xchk_ilock (sc,XFS_IOLOCK_EXCL ); +} +# define xrep_tempfile_rele (sc) +#endif /* CONFIG_XFS_ONLINE_REPAIR */ + +#endif /* __XFS_SCRUB_TEMPFILE_H__ */
fs/xfs/scrub/trace.h +33 -0
@@ -2273,6 +2273,39 @@ TRACE_EVENT(xrep_rmap_live_update, __entry->flags) ); +TRACE_EVENT (xrep_tempfile_create, + TP_PROTO(struct xfs_scrub *sc), +TP_ARGS (sc), +TP_STRUCT__entry ( + __field(dev_t, dev) + __field(xfs_ino_t, ino) + __field(unsigned int, type) + __field(xfs_agnumber_t, agno) + __field(xfs_ino_t, inum) + __field(unsigned int, gen) + __field(unsigned int, flags) +__field (xfs_ino_t, temp_inum) + ), +TP_fast_assign ( + __entry->dev = sc->mp->m_super->s_dev; + __entry->ino = sc->file ? XFS_I(file_inode(sc->file))->i_ino : 0; + __entry->type = sc->sm->sm_type; + __entry->agno = sc->sm->sm_agno; + __entry->inum = sc->sm->sm_ino; + __entry->gen = sc->sm->sm_gen; + __entry->flags = sc->sm->sm_flags; + __entry->temp_inum = sc->tempip->i_ino; + ), +TP_printk ("dev %d:%d ino 0x%llx type %s inum 0x%llx gen 0x%x flags 0x%x temp_inum 0x%llx" , +MAJOR (__entry->dev),MINOR (__entry->dev), + __entry->ino, +__print_symbolic (__entry->type,XFS_SCRUB_TYPE_STRINGS ), + __entry->inum, + __entry->gen, + __entry->flags, + __entry->temp_inum) +); +#endif /* IS_ENABLED(CONFIG_XFS_ONLINE_REPAIR) */ #endif /* _TRACE_XFS_SCRUB_TRACE_H */
fs/xfs/xfs_inode.c +1 -2
@@ -42,7 +42,6 @@struct kmem_cache *xfs_inode_cache; -STATIC int xfs_iunlink(struct xfs_trans *, struct xfs_inode *); STATIC int xfs_iunlink_remove(struct xfs_trans *tp, struct xfs_perag *pag,struct xfs_inode *);
@@ -2140,7 +2139,7 @@ xfs_iunlink_insert_inode(* We place the on-disk inode on a list in the AGI. It will be pulled from this * list when the inode is freed. */ -STATIC int +int xfs_iunlink (struct xfs_trans *tp,struct xfs_inode *ip)
fs/xfs/xfs_inode.h +2 -0
@@ -616,6 +616,8 @@ extern struct kmem_cache *xfs_inode_cache;bool xfs_inode_needs_inactive (struct xfs_inode *ip); +int xfs_iunlink (struct xfs_trans *tp,struct xfs_inode *ip); +void xfs_end_io (struct work_struct *work);int xfs_ilock2_io_mmap (struct xfs_inode *ip1,struct xfs_inode *ip2);
PATCH 3/4 xfs: refactor live buffer invalidation for repairs
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
In an upcoming patch, we will need to be able to look for xfs_buf objects caching file-based metadata blocks without needing to walk the (possibly corrupt) structures to find all the buffers. Repair already has most of the code needed to scan the buffer cache, so hoist these utility functions.
--- fs/xfs/scrub/reap.c | 73 ++++++++++++++++++++++++++++++++++++--------------- fs/xfs/scrub/reap.h | 20 ++++++++++++++ 2 files changed, 71 insertions(+), 22 deletions(-)
fs/xfs/scrub/reap.c +51 -22
@@ -211,6 +211,48 @@ static inline void xreap_defer_finish_reset(struct xreap_state *rs) rs->force_roll = false; } +/* +* Compute the maximum length of a buffer cache scan (in units of sectors), +* given a quantity of fs blocks. +*/ +xfs_daddr_t +xrep_bufscan_max_sectors ( +struct xfs_mount *mp, +xfs_extlen_t fsblocks) +{ +int max_fsbs; + +/* Remote xattr values are the largest buffers that we support. */ + max_fsbs =xfs_attr3_rmt_blocks (mp,XFS_XATTR_SIZE_MAX ); + +return XFS_FSB_TO_BB (mp,min_t (xfs_extlen_t, fsblocks, max_fsbs)); +} + +/* +* Return an incore buffer from a sector scan, or NULL if there are no buffers +* left to return. +*/ +struct xfs_buf * +xrep_bufscan_advance ( +struct xfs_mount *mp, +struct xrep_bufscan *scan) +{ + scan->__sector_count += scan->daddr_step; +while (scan->__sector_count <= scan->max_sectors) { +struct xfs_buf *bp =NULL ; +int error; + + error =xfs_buf_incore (mp->m_ddev_targp, scan->daddr, + scan->__sector_count,XBF_LIVESCAN , &bp); +if (!error) +return bp; + + scan->__sector_count += scan->daddr_step; + } + +return NULL ; +} +/* Try to invalidate the incore buffers for an extent that we're freeing. */ STATIC void xreap_agextent_binval(
@@ -241,28 +283,15 @@ xreap_agextent_binval(* of any plausible size. */ while (bno < agbno_next) { -xfs_agblock_t fsbcount; -xfs_agblock_t max_fsbs; - -/* -* Max buffer size is the max remote xattr buffer size, which -* is one fs block larger than 64k. -*/ - max_fsbs =min_t (xfs_agblock_t, agbno_next - bno, -xfs_attr3_rmt_blocks (mp,XFS_XATTR_SIZE_MAX )); - -for (fsbcount =1 ; fsbcount <= max_fsbs; fsbcount++) { -struct xfs_buf *bp =NULL ; -xfs_daddr_t daddr; -int error; - - daddr =XFS_AGB_TO_DADDR (mp, agno, bno); - error =xfs_buf_incore (mp->m_ddev_targp, daddr, -XFS_FSB_TO_BB (mp, fsbcount), -XBF_LIVESCAN , &bp); -if (error) -continue ; - +struct xrep_bufscan scan = { + .daddr =XFS_AGB_TO_DADDR (mp, agno, bno), + .max_sectors =xrep_bufscan_max_sectors (mp, + agbno_next - bno), + .daddr_step =XFS_FSB_TO_BB (mp,1 ), + }; +struct xfs_buf *bp; + +while ((bp =xrep_bufscan_advance (mp, &scan)) !=NULL ) {xfs_trans_bjoin (sc->tp, bp);xfs_trans_binval (sc->tp, bp); rs->invalidated++;
fs/xfs/scrub/reap.h +20 -0
@@ -14,4 +14,24 @@ int xrep_reap_agblocks(struct xfs_scrub *sc, struct xagb_bitmap *bitmap,int xrep_reap_fsblocks (struct xfs_scrub *sc,struct xfsb_bitmap *bitmap,const struct xfs_owner_info *oinfo); +/* Buffer cache scan context. */ +struct xrep_bufscan { +/* Disk address for the buffers we want to scan. */ +xfs_daddr_t daddr; + +/* Maximum number of sectors to scan. */ +xfs_daddr_t max_sectors; + +/* Each round, increment the search length by this number of sectors. */ +xfs_daddr_t daddr_step; + +/* Internal scan state; initialize to zero. */ +xfs_daddr_t __sector_count; +}; + +xfs_daddr_t xrep_bufscan_max_sectors (struct xfs_mount *mp, +xfs_extlen_t fsblocks); +struct xfs_buf *xrep_bufscan_advance (struct xfs_mount *mp, +struct xrep_bufscan *scan); +#endif /* __XFS_SCRUB_REAP_H__ */
PATCH 4/4 xfs: add the ability to reap entire inode forks
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
In preparation for supporting repair of indexed file-based metadata (such as realtime bitmaps, directories, and extended attribute data), add a function to reap the old blocks after a metadata repair finishes. IOWs, this is an elaborate bunmapi call that deals with crosslinked blocks by unmapping them without freeing them, and also scans for incore buffers to invalidate.
--- fs/xfs/scrub/reap.c | 372 ++++++++++++++++++++++++++++++++++++++++++++++++++ fs/xfs/scrub/reap.h | 1 fs/xfs/scrub/trace.h | 63 ++++++++ 3 files changed, 436 insertions(+)
fs/xfs/scrub/reap.c +372 -0
@@ -675,3 +675,375 @@ xrep_reap_fsblocks(return 0 ; } + +/* +* Metadata files are not supposed to share blocks with anything else. +* If blocks are shared, we remove the reverse mapping (thus reducing the +* crosslink factor); if blocks are not shared, we also need to free them. +* +* This first step determines the longest subset of the passed-in imap +* (starting at its beginning) that is either crosslinked or not crosslinked. +* The blockcount will be adjust down as needed. +*/ +STATIC int +xreap_bmapi_select ( +struct xfs_scrub *sc, +struct xfs_inode *ip, +int whichfork, +struct xfs_bmbt_irec *imap, +bool *crosslinked) +{ +struct xfs_owner_info oinfo; +struct xfs_btree_cur *cur; +xfs_filblks_t len =1 ; +xfs_agblock_t bno; +xfs_agblock_t agbno; +xfs_agblock_t agbno_next; +int error; + + agbno =XFS_FSB_TO_AGBNO (sc->mp, imap->br_startblock); + agbno_next = agbno + imap->br_blockcount; + + cur =xfs_rmapbt_init_cursor (sc->mp, sc->tp, sc->sa.agf_bp, + sc->sa.pag); + +xfs_rmap_ino_owner (&oinfo, ip->i_ino, whichfork, imap->br_startoff); + error =xfs_rmap_has_other_keys (cur, agbno,1 , &oinfo, crosslinked); +if (error) + goto out_cur; + + bno = agbno +1 ; +while (bno < agbno_next) { +bool also_crosslinked; + + oinfo.oi_offset++; + error =xfs_rmap_has_other_keys (cur, bno,1 , &oinfo, + &also_crosslinked); +if (error) + goto out_cur; + +if (also_crosslinked != *crosslinked) +break ; + + len++; + bno++; + } + + imap->br_blockcount = len; +trace_xreap_bmapi_select (sc->sa.pag, agbno, len, *crosslinked); +out_cur: +xfs_btree_del_cursor (cur, error); +return error; +} + +/* +* Decide if this buffer can be joined to a transaction. This is true for most +* buffers, but there are two cases that we want to catch: large remote xattr +* value buffers are not logged and can overflow the buffer log item dirty +* bitmap size; and oversized cached buffers if things have really gone +* haywire. +*/ +static inline bool +xreap_buf_loggable ( +const struct xfs_buf *bp) +{ +int i; + +for (i =0 ; i < bp->b_map_count; i++) { +int chunks; +int map_size; + + chunks =DIV_ROUND_UP (BBTOB (bp->b_maps[i].bm_len), +XFS_BLF_CHUNK ); + map_size =DIV_ROUND_UP (chunks,NBWORD ); +if (map_size >XFS_BLF_DATAMAP_SIZE ) +return false; + } + +return true; +} + +/* +* Invalidate any buffers for this file mapping. The @imap blockcount may be +* adjusted downward if we need to roll the transaction. +*/ +STATIC int +xreap_bmapi_binval ( +struct xfs_scrub *sc, +struct xfs_inode *ip, +int whichfork, +struct xfs_bmbt_irec *imap) +{ +struct xfs_mount *mp = sc->mp; +struct xfs_perag *pag = sc->sa.pag; +int bmap_flags =xfs_bmapi_aflag (whichfork); +xfs_fileoff_t off; +xfs_fileoff_t max_off; +xfs_extlen_t scan_blocks; +xfs_agnumber_t agno = sc->sa.pag->pag_agno; +xfs_agblock_t bno; +xfs_agblock_t agbno; +xfs_agblock_t agbno_next; +unsigned int invalidated =0 ; +int error; + +/* +* Avoid invalidating AG headers and post-EOFS blocks because we never +* own those. +*/ + agbno = bno =XFS_FSB_TO_AGBNO (sc->mp, imap->br_startblock); + agbno_next = agbno + imap->br_blockcount; +if (!xfs_verify_agbno (pag, agbno) || + !xfs_verify_agbno (pag, agbno_next -1 )) +return 0 ; + +/* +* Buffers for file blocks can span multiple contiguous mappings. This +* means that for each block in the mapping, there could exist an +* xfs_buf indexed by that block with any length up to the maximum +* buffer size (remote xattr values) or to the next hole in the fork. +* To set up our binval scan, first we need to figure out the location +* of the next hole. +*/ + off = imap->br_startoff + imap->br_blockcount; + max_off = off +xfs_attr3_rmt_blocks (mp,XFS_XATTR_SIZE_MAX ); +while (off < max_off) { +struct xfs_bmbt_irec hmap; +int nhmaps =1 ; + + error =xfs_bmapi_read (ip, off, max_off - off, &hmap, + &nhmaps, bmap_flags); +if (error) +return error; +if (nhmaps !=1 || hmap.br_startblock ==DELAYSTARTBLOCK ) { +ASSERT (0 ); +return -EFSCORRUPTED ; + } + +if (!xfs_bmap_is_real_extent (&hmap)) +break ; + + off = hmap.br_startoff + hmap.br_blockcount; + } + scan_blocks = off - imap->br_startoff; + +trace_xreap_bmapi_binval_scan (sc, imap, scan_blocks); + +/* +* If there are incore buffers for these blocks, invalidate them. If +* we can't (try)lock the buffer we assume it's owned by someone else +* and leave it alone. The buffer cache cannot detect aliasing, so +* employ nested loops to detect incore buffers of any plausible size. +*/ +while (bno < agbno_next) { +struct xrep_bufscan scan = { + .daddr =XFS_AGB_TO_DADDR (mp, agno, bno), + .max_sectors =xrep_bufscan_max_sectors (mp, + scan_blocks), + .daddr_step =XFS_FSB_TO_BB (mp,1 ), + }; +struct xfs_buf *bp; + +while ((bp =xrep_bufscan_advance (mp, &scan)) !=NULL ) { +if (xreap_buf_loggable (bp)) { +xfs_trans_bjoin (sc->tp, bp); +xfs_trans_binval (sc->tp, bp); + }else { +xfs_buf_stale (bp); +xfs_buf_relse (bp); + } + invalidated++; + +/* +* Stop invalidating if we've hit the limit; we should +* still have enough reservation left to free however +* much of the mapping we've seen so far. +*/ +if (invalidated >XREAP_MAX_BINVAL ) { + imap->br_blockcount = agbno_next - bno; + goto out; + } + } + + bno++; + scan_blocks--; + } + +out: +trace_xreap_bmapi_binval (sc->sa.pag, agbno, imap->br_blockcount); +return 0 ; +} + +/* +* Dispose of as much of the beginning of this file fork mapping as possible. +* The number of blocks disposed of is returned in @imap->br_blockcount. +*/ +STATIC int +xrep_reap_bmapi_iter ( +struct xfs_scrub *sc, +struct xfs_inode *ip, +int whichfork, +struct xfs_bmbt_irec *imap, +bool crosslinked) +{ +int error; + +if (crosslinked) { +/* +* If there are other rmappings, this block is cross linked and +* must not be freed. Remove the reverse mapping, leave the +* buffer cache in its possibly confused state, and move on. +* We don't want to risk discarding valid data buffers from +* anybody else who thinks they own the block, even though that +* runs the risk of stale buffer warnings in the future. +*/ +trace_xreap_dispose_unmap_extent (sc->sa.pag, +XFS_FSB_TO_AGBNO (sc->mp, imap->br_startblock), + imap->br_blockcount); + +/* +* Schedule removal of the mapping from the fork. We use +* deferred log intents in this function to control the exact +* sequence of metadata updates. +*/ +xfs_bmap_unmap_extent (sc->tp, ip, whichfork, imap); +xfs_trans_mod_dquot_byino (sc->tp, ip,XFS_TRANS_DQ_BCOUNT , + -(int64_t )imap->br_blockcount); +xfs_rmap_unmap_extent (sc->tp, ip, whichfork, imap); +return 0 ; + } + +/* +* If the block is not crosslinked, we can invalidate all the incore +* buffers for the extent, and then free the extent. This is a bit of +* a mess since we don't detect discontiguous buffers that are indexed +* by a block starting before the first block of the extent but overlap +* anyway. +*/ +trace_xreap_dispose_free_extent (sc->sa.pag, +XFS_FSB_TO_AGBNO (sc->mp, imap->br_startblock), + imap->br_blockcount); + +/* +* Invalidate as many buffers as we can, starting at the beginning of +* this mapping. If this function sets blockcount to zero, the +* transaction is full of logged buffer invalidations, so we need to +* return early so that we can roll and retry. +*/ + error =xreap_bmapi_binval (sc, ip, whichfork, imap); +if (error || imap->br_blockcount ==0 ) +return error; + +/* +* Schedule removal of the mapping from the fork. We use deferred log +* intents in this function to control the exact sequence of metadata +* updates. +*/ +xfs_bmap_unmap_extent (sc->tp, ip, whichfork, imap); +xfs_trans_mod_dquot_byino (sc->tp, ip,XFS_TRANS_DQ_BCOUNT , + -(int64_t )imap->br_blockcount); +return xfs_free_extent_later (sc->tp, imap->br_startblock, + imap->br_blockcount,NULL ,XFS_AG_RESV_NONE , true); +} + +/* +* Dispose of as much of this file extent as we can. Upon successful return, +* the imap will reflect the mapping that was removed from the fork. +*/ +STATIC int +xreap_ifork_extent ( +struct xfs_scrub *sc, +struct xfs_inode *ip, +int whichfork, +struct xfs_bmbt_irec *imap) +{ +xfs_agnumber_t agno; +bool crosslinked; +int error; + +ASSERT (sc->sa.pag ==NULL ); + +trace_xreap_ifork_extent (sc, ip, whichfork, imap); + + agno =XFS_FSB_TO_AGNO (sc->mp, imap->br_startblock); + sc->sa.pag =xfs_perag_get (sc->mp, agno); +if (!sc->sa.pag) +return -EFSCORRUPTED ; + + error =xfs_alloc_read_agf (sc->sa.pag, sc->tp,0 , &sc->sa.agf_bp); +if (error) + goto out_pag; + +/* +* Decide the fate of the blocks at the beginning of the mapping, then +* update the mapping to use it with the unmap calls. +*/ + error =xreap_bmapi_select (sc, ip, whichfork, imap, &crosslinked); +if (error) + goto out_agf; + + error =xrep_reap_bmapi_iter (sc, ip, whichfork, imap, crosslinked); +if (error) + goto out_agf; + +out_agf: +xfs_trans_brelse (sc->tp, sc->sa.agf_bp); + sc->sa.agf_bp =NULL ; +out_pag: +xfs_perag_put (sc->sa.pag); + sc->sa.pag =NULL ; +return error; +} + +/* +* Dispose of each block mapped to the given fork of the given file. Callers +* must hold ILOCK_EXCL, and ip can only be sc->ip or sc->tempip. The fork +* must not have any delalloc reservations. +*/ +int +xrep_reap_ifork ( +struct xfs_scrub *sc, +struct xfs_inode *ip, +int whichfork) +{ +xfs_fileoff_t off =0 ; +int bmap_flags =xfs_bmapi_aflag (whichfork); +int error; + +ASSERT (xfs_has_rmapbt (sc->mp)); +ASSERT (ip == sc->ip || ip == sc->tempip); +ASSERT (whichfork ==XFS_ATTR_FORK || !XFS_IS_REALTIME_INODE (ip)); + +while (off <XFS_MAX_FILEOFF ) { +struct xfs_bmbt_irec imap; +int nimaps =1 ; + +/* Read the next extent, skip past holes and delalloc. */ + error =xfs_bmapi_read (ip, off,XFS_MAX_FILEOFF - off, &imap, + &nimaps, bmap_flags); +if (error) +return error; +if (nimaps !=1 || imap.br_startblock ==DELAYSTARTBLOCK ) { +ASSERT (0 ); +return -EFSCORRUPTED ; + } + +/* +* If this is a real space mapping, reap as much of it as we +* can in a single transaction. +*/ +if (xfs_bmap_is_real_extent (&imap)) { + error =xreap_ifork_extent (sc, ip, whichfork, &imap); +if (error) +return error; + + error =xfs_defer_finish (&sc->tp); +if (error) +return error; + } + + off = imap.br_startoff + imap.br_blockcount; + } + +return 0 ; +}
fs/xfs/scrub/reap.h +1 -0
@@ -13,6 +13,7 @@ int xrep_reap_agblocks(struct xfs_scrub *sc, struct xagb_bitmap *bitmap, const struct xfs_owner_info *oinfo, enum xfs_ag_resv_type type);int xrep_reap_fsblocks (struct xfs_scrub *sc,struct xfsb_bitmap *bitmap,const struct xfs_owner_info *oinfo); +int xrep_reap_ifork (struct xfs_scrub *sc,struct xfs_inode *ip,int whichfork);/* Buffer cache scan context. */ struct xrep_bufscan {
fs/xfs/scrub/trace.h +63 -0
81 lines not on this page · raw message
PATCH 6/15 xfs: online repair of realtime summaries
In reply to Darrick J. WongHi all,
We now have all the infrastructure we need to repair file metadata. We'll begin with the realtime summary file, because it is the least complex data structure. To support this we need to add three more pieces to the temporary file code from the previous patchset -- preallocating space in the temp file, formatting metadata into that space and writing the blocks to disk, and swapping the fork mappings atomically.
After that, the actual reconstruction of the realtime summary information is pretty simple, since we can simply write the incore copy computed by the rtsummary scrubber to the temporary file, swap the contents, and reap the old blocks.
If you're going to start using this code, I strongly recommend pulling from my git trees, which are linked below.
This has been running on the djcloud for months with no problems. Enjoy! Comments and questions are, as always, welcome.
--D
kernel git tree:
https://git.kernel.org/cgit/linux/kernel/git/djwong/xfs-linux.git/log/?h=repair-rtsummary
xfsprogs git tree:
https://git.kernel.org/cgit/linux/kernel/git/djwong/xfsprogs-dev.git/log/?h=repair-rtsummary
fstests git tree:
https://git.kernel.org/cgit/linux/kernel/git/djwong/xfstests-dev.git/log/?h=repair-rtsummary
---
Commits in this patchset:
* xfs: support preallocating and copying content into temporary files
* xfs: teach the tempfile to set up atomic file content exchanges
* xfs: online repair of realtime summaries
--- fs/xfs/Makefile | 1 fs/xfs/scrub/common.c | 1 fs/xfs/scrub/repair.h | 3 fs/xfs/scrub/rtsummary.c | 33 ++- fs/xfs/scrub/rtsummary.h | 37 ++++ fs/xfs/scrub/rtsummary_repair.c | 177 ++++++++++++++++++ fs/xfs/scrub/scrub.c | 11 + fs/xfs/scrub/scrub.h | 7 + fs/xfs/scrub/tempexch.h | 21 ++ fs/xfs/scrub/tempfile.c | 391 +++++++++++++++++++++++++++++++++++++++ fs/xfs/scrub/tempfile.h | 15 + fs/xfs/scrub/trace.h | 40 ++++ 12 files changed, 718 insertions(+), 19 deletions(-) create mode 100644 fs/xfs/scrub/rtsummary.h create mode 100644 fs/xfs/scrub/rtsummary_repair.c create mode 100644 fs/xfs/scrub/tempexch.h
PATCH 1/3 xfs: support preallocating and copying content into temporary files
From: Darrick J. Wong <[email protected]>
Create the routines we need to preallocate space in a temporary ondisk file and then copy the contents of an xfile into the tempfile. The upcoming rtsummary repair feature will construct the contents of a realtime summary file in memory, after which it will want to copy all that into the ondisk temporary file before atomically committing the new rtsummary contents.
--- fs/xfs/scrub/tempfile.c | 197 +++++++++++++++++++++++++++++++++++++++++++++++ fs/xfs/scrub/tempfile.h | 15 ++++ fs/xfs/scrub/trace.h | 39 +++++++++ 3 files changed, 251 insertions(+)
fs/xfs/scrub/tempfile.c +197 -0
@@ -14,14 +14,18 @@#include "xfs_inode.h" #include "xfs_ialloc.h" #include "xfs_quota.h" +#include "xfs_bmap.h" #include "xfs_bmap_btree.h" #include "xfs_trans_space.h" #include "xfs_dir2.h" #include "xfs_exchrange.h" +#include "xfs_defer.h" #include "scrub/scrub.h" #include "scrub/common.h" +#include "scrub/repair.h" #include "scrub/trace.h" #include "scrub/tempfile.h" +#include "scrub/xfile.h" /* * Create a temporary file for reconstructing metadata, with the intention of
@@ -249,3 +253,196 @@ xrep_tempfile_rele(xchk_irele (sc, sc->tempip); sc->tempip =NULL ; } + +/* +* Make sure that the given range of the data fork of the temporary file is +* mapped to written blocks. The caller must ensure that both inodes are +* joined to the transaction. +*/ +int +xrep_tempfile_prealloc ( +struct xfs_scrub *sc, +xfs_fileoff_t off, +xfs_filblks_t len) +{ +struct xfs_bmbt_irec map; +xfs_fileoff_t end = off + len; +int error; + +ASSERT (sc->tempip !=NULL ); +ASSERT (!XFS_NOT_DQATTACHED (sc->mp, sc->tempip)); + +for (; off < end; off = map.br_startoff + map.br_blockcount) { +int nmaps =1 ; + +/* +* If we have a real extent mapping this block then we're +* in ok shape. +*/ + error =xfs_bmapi_read (sc->tempip, off, end - off, &map, &nmaps, +XFS_DATA_FORK ); +if (error) +return error; +if (nmaps ==0 ) { +ASSERT (nmaps !=0 ); +return -EFSCORRUPTED ; + } + +if (xfs_bmap_is_written_extent (&map)) +continue ; + +/* +* If we find a delalloc reservation then something is very +* very wrong. Bail out. +*/ +if (map.br_startblock ==DELAYSTARTBLOCK ) +return -EFSCORRUPTED ; + +/* +* Make sure this block has a real zeroed extent allocated to +* it. +*/ + nmaps =1 ; + error =xfs_bmapi_write (sc->tp, sc->tempip, off, end - off, +XFS_BMAPI_CONVERT |XFS_BMAPI_ZERO ,0 , &map, + &nmaps); +if (error) +return error; +if (nmaps !=1 ) +return -EFSCORRUPTED ; + +trace_xrep_tempfile_prealloc (sc,XFS_DATA_FORK , &map); + +/* Commit new extent and all deferred work. */ + error =xfs_defer_finish (&sc->tp); +if (error) +return error; + } + +return 0 ; +} + +/* +* Write data to each block of a file. The given range of the tempfile's data +* fork must already be populated with written extents. +*/ +int +xrep_tempfile_copyin ( +struct xfs_scrub *sc, +xfs_fileoff_t off, +xfs_filblks_t len, +xrep_tempfile_copyin_fn prep_fn, +void *data) +{ +LIST_HEAD (buffers_list); +struct xfs_mount *mp = sc->mp; +struct xfs_buf *bp; +xfs_fileoff_t flush_mask; +xfs_fileoff_t end = off + len; +loff_t pos =XFS_FSB_TO_B (mp, off); +int error =0 ; + +ASSERT (S_ISREG (VFS_I (sc->tempip)->i_mode)); + +/* Flush buffers to disk every 512K */ + flush_mask =XFS_B_TO_FSBT (mp, (1U <<19 )) -1 ; + +for (; off < end; off++, pos += mp->m_sb.sb_blocksize) { +struct xfs_bmbt_irec map; +int nmaps =1 ; + +/* Read block mapping for this file block. */ + error =xfs_bmapi_read (sc->tempip, off,1 , &map, &nmaps,0 ); +if (error) + goto out_err; +if (nmaps ==0 || !xfs_bmap_is_written_extent (&map)) { + error = -EFSCORRUPTED ; + goto out_err; + } + +/* Get the metadata buffer for this offset in the file. */ + error =xfs_trans_get_buf (sc->tp, mp->m_ddev_targp, +XFS_FSB_TO_DADDR (mp, map.br_startblock), + mp->m_bsize,0 , &bp); +if (error) + goto out_err; + +trace_xrep_tempfile_copyin (sc,XFS_DATA_FORK , &map); + +/* Read in a block's worth of data from the xfile. */ + error =prep_fn (sc, bp, data); +if (error) { +xfs_trans_brelse (sc->tp, bp); + goto out_err; + } + +/* Queue buffer, and flush if we have too much dirty data. */ +xfs_buf_delwri_queue_here (bp, &buffers_list); +xfs_trans_brelse (sc->tp, bp); + +if (!(off & flush_mask)) { + error =xfs_buf_delwri_submit (&buffers_list); +if (error) + goto out_err; + } + } + +/* +* Write the new blocks to disk. If the ordered list isn't empty after +* that, then something went wrong and we have to fail. This should +* never happen, but we'll check anyway. +*/ + error =xfs_buf_delwri_submit (&buffers_list); +if (error) + goto out_err; + +if (!list_empty (&buffers_list)) { +ASSERT (list_empty (&buffers_list)); + error = -EIO ; + goto out_err; + } + +return 0 ; + +out_err: +xfs_buf_delwri_cancel (&buffers_list); +return error; +} + +/* +* Set the temporary file's size. Caller must join the tempfile to the scrub +* transaction and is responsible for adjusting block mappings as needed. +*/ +int +xrep_tempfile_set_isize ( +struct xfs_scrub *sc, +unsigned long long isize) +{ +if (sc->tempip->i_disk_size == isize) +return 0 ; + + sc->tempip->i_disk_size = isize; +i_size_write (VFS_I (sc->tempip), isize); +return xrep_tempfile_roll_trans (sc); +} + +/* +* Roll a repair transaction involving the temporary file. Caller must join +* both the temporary file and the file being scrubbed to the transaction. +* This function return with both inodes joined to a new scrub transaction, +* or the usual negative errno. +*/ +int +xrep_tempfile_roll_trans ( +struct xfs_scrub *sc) +{ +int error; + +xfs_trans_log_inode (sc->tp, sc->tempip,XFS_ILOG_CORE ); + error =xrep_roll_trans (sc); +if (error) +return error; + +xfs_trans_ijoin (sc->tp, sc->tempip,0 ); +return 0 ; +}
fs/xfs/scrub/tempfile.h +15 -0
@@ -17,6 +17,21 @@ void xrep_tempfile_iounlock(struct xfs_scrub *sc);void xrep_tempfile_ilock (struct xfs_scrub *sc);bool xrep_tempfile_ilock_nowait (struct xfs_scrub *sc);void xrep_tempfile_iunlock (struct xfs_scrub *sc); + +int xrep_tempfile_prealloc (struct xfs_scrub *sc,xfs_fileoff_t off, +xfs_filblks_t len); + +enum xfs_blft ; + +typedef int (*xrep_tempfile_copyin_fn )(struct xfs_scrub *sc, +struct xfs_buf *bp,void *data); + +int xrep_tempfile_copyin (struct xfs_scrub *sc,xfs_fileoff_t off, +xfs_filblks_t len,xrep_tempfile_copyin_fn fn,void *data); + +int xrep_tempfile_set_isize (struct xfs_scrub *sc,unsigned long long isize); + +int xrep_tempfile_roll_trans (struct xfs_scrub *sc);#else static inline void xrep_tempfile_iolock_both (struct xfs_scrub *sc) {
fs/xfs/scrub/trace.h +39 -0
@@ -2308,6 +2308,45 @@ TRACE_EVENT(xrep_tempfile_create, __entry->temp_inum) ); +DECLARE_EVENT_CLASS (xrep_tempfile_class, + TP_PROTO(struct xfs_scrub *sc, int whichfork, + struct xfs_bmbt_irec *irec), +TP_ARGS (sc, whichfork, irec), +TP_STRUCT__entry ( + __field(dev_t, dev) + __field(xfs_ino_t, ino) + __field(int, whichfork) + __field(xfs_fileoff_t, lblk) + __field(xfs_filblks_t, len) + __field(xfs_fsblock_t, pblk) +__field (int, state) + ), +TP_fast_assign ( + __entry->dev = sc->mp->m_super->s_dev; + __entry->ino = sc->tempip->i_ino; + __entry->whichfork = whichfork; + __entry->lblk = irec->br_startoff; + __entry->len = irec->br_blockcount; + __entry->pblk = irec->br_startblock; + __entry->state = irec->br_state; + ), +TP_printk ("dev %d:%d ino 0x%llx whichfork %s fileoff 0x%llx fsbcount 0x%llx startblock 0x%llx state %d" , +MAJOR (__entry->dev),MINOR (__entry->dev), + __entry->ino, +__print_symbolic (__entry->whichfork,XFS_WHICHFORK_STRINGS ), + __entry->lblk, + __entry->len, + __entry->pblk, + __entry->state) +); +#define DEFINE_XREP_TEMPFILE_EVENT (name) \ +DEFINE_EVENT(xrep_tempfile_class, name, \ + TP_PROTO(struct xfs_scrub *sc, int whichfork, \ + struct xfs_bmbt_irec *irec), \ + TP_ARGS(sc, whichfork, irec)) +DEFINE_XREP_TEMPFILE_EVENT (xrep_tempfile_prealloc); +DEFINE_XREP_TEMPFILE_EVENT (xrep_tempfile_copyin); + TRACE_EVENT(xreap_ifork_extent, TP_PROTO(struct xfs_scrub *sc, struct xfs_inode *ip, int whichfork, const struct xfs_bmbt_irec *irec),
PATCH 2/3 xfs: teach the tempfile to set up atomic file content exchanges
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
Create some new routines to exchange the contents of a temporary file created to stage a repair with another ondisk file. This will be used by the realtime summary repair function to commit atomically the new rtsummary data, which will be staged in the tempfile.
The rest of XFS coordinates access to the realtime metadata inodes solely through the ILOCK. For repair to hold its exclusive access to the realtime summary file, it has to allocate a single large transaction and roll it repeatedly throughout the repair while holding the ILOCK. In turn, this means that for now there's only a partial file mapping exchange implementation for the temporary file because we can only work within an existing transaction.
For now, the only tempswap functions needed here are to estimate the resource requirements of the exchange, reserve more space/quota to an existing transaction, and kick off the actual exchange. The rest will be added in a later patch in preparation for repairing xattrs and directories.
--- fs/xfs/scrub/scrub.c | 8 +- fs/xfs/scrub/scrub.h | 7 ++ fs/xfs/scrub/tempexch.h | 21 +++++ fs/xfs/scrub/tempfile.c | 194 +++++++++++++++++++++++++++++++++++++++++++++++ fs/xfs/scrub/trace.h | 1 5 files changed, 228 insertions(+), 3 deletions(-) create mode 100644 fs/xfs/scrub/tempexch.h
fs/xfs/scrub/scrub.c +5 -3
@@ -149,14 +149,15 @@ xchk_probe(/* Scrub setup and teardown */ +#define FSGATES_MASK (XCHK_FSGATES_ALL | XREP_FSGATES_ALL)static inline void xchk_fsgates_disable (struct xfs_scrub *sc) { -if (!(sc->flags &XCHK_FSGATES_ALL )) +if (!(sc->flags &FSGATES_MASK ))return ; -trace_xchk_fsgates_disable (sc, sc->flags &XCHK_FSGATES_ALL ); +trace_xchk_fsgates_disable (sc, sc->flags &FSGATES_MASK );if (sc->flags &XCHK_FSGATES_DRAIN )xfs_drain_wait_disable ();
@@ -170,8 +171,9 @@ xchk_fsgates_disable(if (sc->flags &XCHK_FSGATES_RMAP )xfs_rmap_hook_disable (); - sc->flags &= ~XCHK_FSGATES_ALL ; + sc->flags &= ~FSGATES_MASK ; } +#undef FSGATES_MASK/* Free all the resources and finish the transactions. */ STATIC int
fs/xfs/scrub/scrub.h +7 -0
@@ -131,6 +131,7 @@ struct xfs_scrub {#define XCHK_FSGATES_QUOTA (1U << 4)/* quota live update enabled */ #define XCHK_FSGATES_DIRENTS (1U << 5)/* directory live update enabled */ #define XCHK_FSGATES_RMAP (1U << 6)/* rmapbt live update enabled */ +#define XREP_FSGATES_EXCHMAPS (1U << 29)/* uses atomic file content exchange */ #define XREP_RESET_PERAG_RESV (1U << 30)/* must reset AG space reservation */ #define XREP_ALREADY_FIXED (1U << 31)/* checking our repair work */
@@ -145,6 +146,12 @@ struct xfs_scrub { XCHK_FSGATES_DIRENTS | \ XCHK_FSGATES_RMAP) +/* +* The sole XREP_FSGATES* flag reflects a log intent item that is protected +* by a log-incompat feature flag. No code patching in use here. +*/ +#define XREP_FSGATES_ALL (XREP_FSGATES_EXCHMAPS) +/* Metadata scrubbers */ int xchk_tester (struct xfs_scrub *sc);int xchk_superblock (struct xfs_scrub *sc);
fs/xfs/scrub/tempexch.h new file +21 -0
@@ -0,0 +1,21 @@ +// SPDX-License-Identifier: GPL-2.0-or-later +/* +* Copyright (c) 2022-2024 Oracle. All Rights Reserved. +* Author: Darrick J. Wong <[email protected]> +*/ +#ifndef __XFS_SCRUB_TEMPEXCH_H__ +#define __XFS_SCRUB_TEMPEXCH_H__ + +#ifdef CONFIG_XFS_ONLINE_REPAIR +struct xrep_tempexch { +struct xfs_exchmaps_req req; +}; + +int xrep_tempexch_enable (struct xfs_scrub *sc); +int xrep_tempexch_trans_reserve (struct xfs_scrub *sc,int whichfork, +struct xrep_tempexch *ti); + +int xrep_tempexch_contents (struct xfs_scrub *sc,struct xrep_tempexch *ti); +#endif /* CONFIG_XFS_ONLINE_REPAIR */ + +#endif /* __XFS_SCRUB_TEMPEXCH_H__ */
fs/xfs/scrub/tempfile.c +194 -0
209 lines not on this page · raw message
fs/xfs/scrub/trace.h +1 -0
@@ -114,6 +114,7 @@ TRACE_DEFINE_ENUM(XFS_SCRUB_TYPE_HEALTHY); { XCHK_FSGATES_QUOTA, "fsgates_quota" }, \ { XCHK_FSGATES_DIRENTS, "fsgates_dirents" }, \ { XCHK_FSGATES_RMAP, "fsgates_rmap" }, \ + { XREP_FSGATES_EXCHMAPS, "fsgates_exchmaps" }, \ { XREP_RESET_PERAG_RESV, "reset_perag_resv" }, \ { XREP_ALREADY_FIXED, "already_fixed" }
PATCH 3/3 xfs: online repair of realtime summaries
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
Repair the realtime summary data by constructing a new rtsummary file in the scrub temporary file, then atomically swapping the contents.
--- fs/xfs/Makefile | 1 fs/xfs/scrub/common.c | 1 fs/xfs/scrub/repair.h | 3 + fs/xfs/scrub/rtsummary.c | 33 ++++--- fs/xfs/scrub/rtsummary.h | 37 ++++++++ fs/xfs/scrub/rtsummary_repair.c | 177 +++++++++++++++++++++++++++++++++++++++ fs/xfs/scrub/scrub.c | 3 - 7 files changed, 239 insertions(+), 16 deletions(-) create mode 100644 fs/xfs/scrub/rtsummary.h create mode 100644 fs/xfs/scrub/rtsummary_repair.c
fs/xfs/Makefile +1 -0
@@ -212,6 +212,7 @@ xfs-y += $(addprefix scrub/, \ xfs-$(CONFIG_XFS_RT) += $(addprefix scrub/, \ rtbitmap_repair.o \ + rtsummary_repair.o \ ) xfs-$(CONFIG_XFS_QUOTA) += $(addprefix scrub/, \
fs/xfs/scrub/common.c +1 -0
@@ -31,6 +31,7 @@#include "xfs_ag.h" #include "xfs_error.h" #include "xfs_quota.h" +#include "xfs_exchmaps.h" #include "scrub/scrub.h" #include "scrub/common.h" #include "scrub/trace.h"
fs/xfs/scrub/repair.h +3 -0
@@ -126,8 +126,10 @@ int xrep_fscounters(struct xfs_scrub *sc);#ifdef CONFIG_XFS_RT int xrep_rtbitmap (struct xfs_scrub *sc); +int xrep_rtsummary (struct xfs_scrub *sc);#else # define xrep_rtbitmap xrep_notsupported +# define xrep_rtsummary xrep_notsupported#endif /* CONFIG_XFS_RT */ #ifdef CONFIG_XFS_QUOTA
@@ -212,6 +214,7 @@ xrep_setup_nothing(#define xrep_quotacheck xrep_notsupported#define xrep_nlinks xrep_notsupported#define xrep_fscounters xrep_notsupported +#define xrep_rtsummary xrep_notsupported#endif /* CONFIG_XFS_ONLINE_REPAIR */
fs/xfs/scrub/rtsummary.c +18 -15
@@ -17,10 +17,14 @@#include "xfs_bit.h" #include "xfs_bmap.h" #include "xfs_sb.h" +#include "xfs_exchmaps.h" #include "scrub/scrub.h" #include "scrub/common.h" #include "scrub/trace.h" #include "scrub/xfile.h" +#include "scrub/repair.h" +#include "scrub/tempexch.h" +#include "scrub/rtsummary.h" /* * Realtime Summary
@@ -32,18 +36,6 @@* (potentially large) amount of data in pageable memory. */ -struct xchk_rtsummary { -struct xfs_rtalloc_args args; - -uint64_t rextents; -uint64_t rbmblocks; -uint64_t rsumsize; -unsigned int rsumlevels; - -/* Memory buffer for the summary comparison. */ -union xfs_suminfo_raw words[]; -}; -/* Set us up to check the rtsummary file. */ int xchk_setup_rtsummary(
@@ -60,6 +52,12 @@ xchk_setup_rtsummary(return -ENOMEM ; sc->buf = rts; +if (xchk_could_repair (sc)) { + error =xrep_setup_rtsummary (sc, rts); +if (error) +return error; + } +/* * Create an xfile to construct a new rtsummary file. The xfile allows * us to avoid pinning kernel memory for this purpose.
@@ -70,7 +68,7 @@ xchk_setup_rtsummary(if (error)return error; - error =xchk_trans_alloc (sc,0 ); + error =xchk_trans_alloc (sc, rts->resblks);if (error)return error;
@@ -135,7 +133,7 @@ xfsum_store( sumoff << XFS_WORDLOG); } -static inline int +inline int xfsum_copyout( struct xfs_scrub *sc, xfs_rtsumoff_t sumoff,
@@ -362,7 +360,12 @@ xchk_rtsummary( error =xchk_rtsum_compare (sc); out_rbm: -/* Unlock the rtbitmap since we're done with it. */ +/* +* Unlock the rtbitmap since we're done with it. All other writers of +* the rt free space metadata grab the bitmap and summary ILOCKs in +* that order, so we're still protected against allocation activities +* even if we continue on to the repair function. +*/ xfs_iunlock (mp->m_rbmip,XFS_ILOCK_SHARED |XFS_ILOCK_RTBITMAP );return error; }
fs/xfs/scrub/rtsummary.h new file +37 -0
@@ -0,0 +1,37 @@ +// SPDX-License-Identifier: GPL-2.0-or-later +/* +* Copyright (c) 2020-2024 Oracle. All Rights Reserved. +* Author: Darrick J. Wong <[email protected]> +*/ +#ifndef __XFS_SCRUB_RTSUMMARY_H__ +#define __XFS_SCRUB_RTSUMMARY_H__ + +struct xchk_rtsummary { +#ifdef CONFIG_XFS_ONLINE_REPAIR +struct xrep_tempexch tempexch; +#endif +struct xfs_rtalloc_args args; + +uint64_t rextents; +uint64_t rbmblocks; +uint64_t rsumsize; +unsigned int rsumlevels; +unsigned int resblks; + +/* suminfo position of xfile as we write buffers to disk. */ +xfs_rtsumoff_t prep_wordoff; + +/* Memory buffer for the summary comparison. */ +union xfs_suminfo_raw words[]; +}; + +int xfsum_copyout (struct xfs_scrub *sc,xfs_rtsumoff_t sumoff, +union xfs_suminfo_raw *rawinfo,unsigned int nr_words); + +#ifdef CONFIG_XFS_ONLINE_REPAIR +int xrep_setup_rtsummary (struct xfs_scrub *sc,struct xchk_rtsummary *rts); +#else +# define xrep_setup_rtsummary (sc, rts) (0) +#endif /* CONFIG_XFS_ONLINE_REPAIR */ + +#endif /* __XFS_SCRUB_RTSUMMARY_H__ */
fs/xfs/scrub/rtsummary_repair.c new file +177 -0
177 lines not on this page · raw message
fs/xfs/scrub/scrub.c +2 -1
@@ -18,6 +18,7 @@#include "xfs_buf_mem.h" #include "xfs_rmap.h" #include "xfs_exchrange.h" +#include "xfs_exchmaps.h" #include "scrub/scrub.h" #include "scrub/common.h" #include "scrub/trace.h"
@@ -354,7 +355,7 @@ static const struct xchk_meta_ops meta_scrub_ops[] = { .type = ST_FS, .setup = xchk_setup_rtsummary, .scrub = xchk_rtsummary, - .repair = xrep_notsupported, + .repair = xrep_rtsummary, }, [XFS_SCRUB_TYPE_UQUOTA] = { /* user quota */ .type = ST_FS,
PATCH 7/15 xfs: set and validate dir/attr block owners
In reply to Darrick J. WongHi all,
There are a couple of significant changes that need to be made to the directory and xattr code before we can support online repairs of those data structures.
The first change is because online repair is designed to use libxfs to create a replacement dir/xattr structure in a temporary file, and use atomic extent swapping to commit the corrected structure. To avoid the performance hit of walking every block of the new structure to rewrite the owner number before the swap, we instead change libxfs to allow callers of the dir and xattr code the ability to set an explicit owner number to be written into the header fields of any new blocks that are created. For regular operation this will be the directory inode number.
The second change is to update the dir/xattr code to actually *check* the owner number in each block that is read off the disk, since we don't currently do that.
If you're going to start using this code, I strongly recommend pulling from my git trees, which are linked below.
This has been running on the djcloud for months with no problems. Enjoy! Comments and questions are, as always, welcome.
--D
kernel git tree:
https://git.kernel.org/cgit/linux/kernel/git/djwong/xfs-linux.git/log/?h=dirattr-validate-owners
xfsprogs git tree:
https://git.kernel.org/cgit/linux/kernel/git/djwong/xfsprogs-dev.git/log/?h=dirattr-validate-owners
---
Commits in this patchset:
* xfs: add an explicit owner field to xfs_da_args
* xfs: use the xfs_da_args owner field to set new dir/attr block owner
* xfs: reduce indenting in xfs_attr_node_list
* xfs: validate attr leaf buffer owners
* xfs: validate attr remote value buffer owners
* xfs: validate dabtree node buffer owners
* xfs: validate directory leaf buffer owners
* xfs: validate explicit directory data buffer owners
* xfs: validate explicit directory block buffer owners
* xfs: validate explicit directory free block owners
--- fs/xfs/libxfs/xfs_attr.c | 14 ++- fs/xfs/libxfs/xfs_attr_leaf.c | 59 +++++++++++--- fs/xfs/libxfs/xfs_attr_leaf.h | 4 + fs/xfs/libxfs/xfs_attr_remote.c | 13 +-- fs/xfs/libxfs/xfs_bmap.c | 1 fs/xfs/libxfs/xfs_da_btree.c | 168 +++++++++++++++++++++++++++++++++++++++ fs/xfs/libxfs/xfs_da_btree.h | 3 + fs/xfs/libxfs/xfs_dir2.c | 5 + fs/xfs/libxfs/xfs_dir2.h | 4 + fs/xfs/libxfs/xfs_dir2_block.c | 44 ++++++---- fs/xfs/libxfs/xfs_dir2_data.c | 17 ++-- fs/xfs/libxfs/xfs_dir2_leaf.c | 99 ++++++++++++++++++----- fs/xfs/libxfs/xfs_dir2_node.c | 44 ++++++---- fs/xfs/libxfs/xfs_dir2_priv.h | 15 ++- fs/xfs/libxfs/xfs_exchmaps.c | 7 +- fs/xfs/scrub/attr.c | 1 fs/xfs/scrub/dabtree.c | 8 ++ fs/xfs/scrub/dir.c | 23 +++-- fs/xfs/scrub/readdir.c | 6 + fs/xfs/xfs_attr_item.c | 1 fs/xfs/xfs_attr_list.c | 89 ++++++++++++++------- fs/xfs/xfs_dir2_readdir.c | 6 + fs/xfs/xfs_trace.h | 7 +- 23 files changed, 490 insertions(+), 148 deletions(-)
PATCH 1/10 xfs: add an explicit owner field to xfs_da_args
From: Darrick J. Wong <[email protected]>
Add an explicit owner field to xfs_da_args, which will make it easier for online fsck to set the owner field of the temporary directory and xattr structures that it builds to repair damaged metadata.
Note: I hopefully found all the xfs_da_args definitions by looking for automatic stack variable declarations and xfs_da_args.dp assignments:
git grep -E '(args.*dp =|struct xfs_da_args[[:space:]]*[a-z0-9][a-z0-9]*)'
Note that callers of xfs_attr_{get,set,change} can set the owner to zero (or leave it unset) to have the default set to args->dp.
--- fs/xfs/libxfs/xfs_attr.c | 4 ++++ fs/xfs/libxfs/xfs_attr_leaf.c | 2 ++ fs/xfs/libxfs/xfs_bmap.c | 1 + fs/xfs/libxfs/xfs_da_btree.h | 1 + fs/xfs/libxfs/xfs_dir2.c | 5 +++++ fs/xfs/libxfs/xfs_exchmaps.c | 2 ++ fs/xfs/scrub/attr.c | 1 + fs/xfs/scrub/dabtree.c | 1 + fs/xfs/scrub/dir.c | 3 ++- fs/xfs/scrub/readdir.c | 2 ++ fs/xfs/xfs_attr_item.c | 1 + fs/xfs/xfs_dir2_readdir.c | 1 + fs/xfs/xfs_trace.h | 7 +++++-- 13 files changed, 28 insertions(+), 3 deletions(-)
fs/xfs/libxfs/xfs_attr.c +4 -0
@@ -264,6 +264,8 @@ xfs_attr_get(if (xfs_is_shutdown (args->dp->i_mount))return -EIO ; +if (!args->owner) + args->owner = args->dp->i_ino; args->geo = args->dp->i_mount->m_attr_geo; args->whichfork =XFS_ATTR_FORK ; args->hashval =xfs_da_hashname (args->name, args->namelen);
@@ -937,6 +939,8 @@ xfs_attr_set(if (error)return error; +if (!args->owner) + args->owner = args->dp->i_ino; args->geo = mp->m_attr_geo; args->whichfork =XFS_ATTR_FORK ; args->hashval =xfs_da_hashname (args->name, args->namelen);
fs/xfs/libxfs/xfs_attr_leaf.c +2 -0
@@ -904,6 +904,7 @@ xfs_attr_shortform_to_leaf( nargs.whichfork =XFS_ATTR_FORK ; nargs.trans = args->trans; nargs.op_flags =XFS_DA_OP_OKNOENT ; + nargs.owner = args->owner; sfe =xfs_attr_sf_firstentry (sf);for (i =0 ; i < sf->count; i++) {
@@ -1106,6 +1107,7 @@ xfs_attr3_leaf_to_shortform( nargs.whichfork =XFS_ATTR_FORK ; nargs.trans = args->trans; nargs.op_flags =XFS_DA_OP_OKNOENT ; + nargs.owner = args->owner;for (i =0 ; i < ichdr.count; entry++, i++) {if (entry->flags &XFS_ATTR_INCOMPLETE )
fs/xfs/libxfs/xfs_bmap.c +1 -0
@@ -976,6 +976,7 @@ xfs_bmap_add_attrfork_local( dargs.total = dargs.geo->fsbcount; dargs.whichfork =XFS_DATA_FORK ; dargs.trans = tp; + dargs.owner = ip->i_ino;return xfs_dir2_sf_to_block (&dargs); }
fs/xfs/libxfs/xfs_da_btree.h +1 -0
@@ -79,6 +79,7 @@ typedef struct xfs_da_args {int rmtvaluelen2;/* remote attr value length in bytes */ uint32_t op_flags;/* operation flags */ enum xfs_dacmp cmpresult;/* name compare result for lookups */ +xfs_ino_t owner;/* inode that owns the dir/attr data */ } xfs_da_args_t;/*
fs/xfs/libxfs/xfs_dir2.c +5 -0
@@ -250,6 +250,7 @@ xfs_dir_init( args->geo = dp->i_mount->m_dir_geo; args->dp = dp; args->trans = tp; + args->owner = dp->i_ino; error =xfs_dir2_sf_create (args, pdp->i_ino);kfree (args);return error;
@@ -295,6 +296,7 @@ xfs_dir_createname( args->whichfork =XFS_DATA_FORK ; args->trans = tp; args->op_flags =XFS_DA_OP_ADDNAME |XFS_DA_OP_OKNOENT ; + args->owner = dp->i_ino;if (!inum) args->op_flags |=XFS_DA_OP_JUSTCHECK ;
@@ -383,6 +385,7 @@ xfs_dir_lookup( args->whichfork =XFS_DATA_FORK ; args->trans = tp; args->op_flags =XFS_DA_OP_OKNOENT ; + args->owner = dp->i_ino;if (ci_name) args->op_flags |=XFS_DA_OP_CILOOKUP ;
@@ -456,6 +459,7 @@ xfs_dir_removename( args->total = total; args->whichfork =XFS_DATA_FORK ; args->trans = tp; + args->owner = dp->i_ino;if (dp->i_df.if_format ==XFS_DINODE_FMT_LOCAL ) { rval =xfs_dir2_sf_removename (args);
@@ -517,6 +521,7 @@ xfs_dir_replace( args->total = total; args->whichfork =XFS_DATA_FORK ; args->trans = tp; + args->owner = dp->i_ino;if (dp->i_df.if_format ==XFS_DINODE_FMT_LOCAL ) { rval =xfs_dir2_sf_replace (args);
fs/xfs/libxfs/xfs_exchmaps.c +2 -0
@@ -429,6 +429,7 @@ xfs_exchmaps_attr_to_sf( .geo = tp->t_mountp->m_attr_geo, .whichfork = XFS_ATTR_FORK, .trans = tp, + .owner = xmi->xmi_ip2->i_ino, };struct xfs_buf *bp;int forkoff;
@@ -459,6 +460,7 @@ xfs_exchmaps_dir_to_sf( .geo = tp->t_mountp->m_dir_geo, .whichfork = XFS_DATA_FORK, .trans = tp, + .owner = xmi->xmi_ip2->i_ino, };struct xfs_dir2_sf_hdr sfh;struct xfs_buf *bp;
fs/xfs/scrub/attr.c +1 -0
@@ -169,6 +169,7 @@ xchk_xattr_listent( .hashval = xfs_da_hashname(name, namelen), .trans = context->tp, .valuelen = valuelen, + .owner = context->dp->i_ino, };struct xchk_xattr_buf *ab;struct xchk_xattr *sx;
fs/xfs/scrub/dabtree.c +1 -0
@@ -494,6 +494,7 @@ xchk_da_btree( ds->dargs.whichfork = whichfork; ds->dargs.trans = sc->tp; ds->dargs.op_flags =XFS_DA_OP_OKNOENT ; + ds->dargs.owner = sc->ip->i_ino; ds->state =xfs_da_state_alloc (&ds->dargs); ds->sc = sc; ds->private = private;
fs/xfs/scrub/dir.c +2 -1
@@ -621,10 +621,11 @@ xchk_directory_blocks( {struct xfs_bmbt_irec got;struct xfs_da_args args = { - .dp = sc ->ip, + .dp = sc->ip, .whichfork =XFS_DATA_FORK , .geo = sc->mp->m_dir_geo, .trans = sc->tp, + .owner = sc->ip->i_ino, };struct xfs_ifork *ifp =xfs_ifork_ptr (sc->ip,XFS_DATA_FORK );struct xfs_mount *mp = sc->mp;
fs/xfs/scrub/readdir.c +2 -0
@@ -273,6 +273,7 @@ xchk_dir_walk( .dp = dp, .geo = dp->i_mount->m_dir_geo, .trans = sc->tp, + .owner = dp->i_ino, };bool isblock;int error;
@@ -324,6 +325,7 @@ xchk_dir_lookup( .hashval = xfs_dir2_hashname(dp->i_mount, name), .whichfork = XFS_DATA_FORK, .op_flags = XFS_DA_OP_OKNOENT, + .owner = dp->i_ino, };bool isblock, isleaf;int error;
fs/xfs/xfs_attr_item.c +1 -0
@@ -540,6 +540,7 @@ xfs_attri_recover_work( args->attr_filter = attrp->alfi_attr_filter &XFS_ATTRI_FILTER_MASK ; args->op_flags =XFS_DA_OP_RECOVERY |XFS_DA_OP_OKNOENT |XFS_DA_OP_LOGGED ; + args->owner = args->dp->i_ino;ASSERT (xfs_sb_version_haslogxattrs (&mp->m_sb));
fs/xfs/xfs_dir2_readdir.c +1 -0
@@ -532,6 +532,7 @@ xfs_readdir( args.dp = dp; args.geo = dp->i_mount->m_dir_geo; args.trans = tp; + args.owner = dp->i_ino;if (dp->i_df.if_format ==XFS_DINODE_FMT_LOCAL )return xfs_dir2_sf_getdents (&args, ctx);
fs/xfs/xfs_trace.h +5 -2
@@ -1931,6 +1931,7 @@ DECLARE_EVENT_CLASS(xfs_da_class, __field(xfs_dahash_t, hashval) __field(xfs_ino_t, inumber) __field(uint32_t, op_flags) +__field (xfs_ino_t, owner) ),TP_fast_assign ( __entry->dev = VFS_I(args->dp)->i_sb->s_dev;
@@ -1941,9 +1942,10 @@ DECLARE_EVENT_CLASS(xfs_da_class, __entry->hashval = args->hashval; __entry->inumber = args->inumber; __entry->op_flags = args->op_flags; + __entry->owner = args->owner; ), TP_printk("dev %d:%d ino 0x%llx name %.*s namelen %d hashval 0x%x " - "inumber 0x%llx op_flags %s", + "inumber 0x%llx op_flags %s owner 0x%llx", MAJOR(__entry->dev), MINOR(__entry->dev), __entry->ino, __entry->namelen,
@@ -1951,7 +1953,8 @@ DECLARE_EVENT_CLASS(xfs_da_class, __entry->namelen, __entry->hashval, __entry->inumber, - __print_flags(__entry->op_flags, "|", XFS_DA_OP_FLAGS)) + __print_flags(__entry->op_flags, "|", XFS_DA_OP_FLAGS), + __entry->owner) )#define DEFINE_DIR2_EVENT (name) \
PATCH 2/10 xfs: use the xfs_da_args owner field to set new dir/attr block owner
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
When we're creating leaf, data, freespace, or dabtree blocks for directories and xattrs, use the explicit owner field (instead of the xfs_inode) to set the owner field. This will enable online repair to construct replacement data structures in a temporary file without having to change the owner fields prior to swapping the new and old structures.
--- fs/xfs/libxfs/xfs_attr_leaf.c | 2 +- fs/xfs/libxfs/xfs_attr_remote.c | 4 ++-- fs/xfs/libxfs/xfs_da_btree.c | 2 +- fs/xfs/libxfs/xfs_dir2_block.c | 19 ++++++++++--------- fs/xfs/libxfs/xfs_dir2_data.c | 2 +- fs/xfs/libxfs/xfs_dir2_leaf.c | 11 +++++------ fs/xfs/libxfs/xfs_dir2_node.c | 2 +- 7 files changed, 21 insertions(+), 21 deletions(-)
fs/xfs/libxfs/xfs_attr_leaf.c +1 -1
@@ -1239,7 +1239,7 @@ xfs_attr3_leaf_create( ichdr.magic =XFS_ATTR3_LEAF_MAGIC ; hdr3->blkno =cpu_to_be64 (xfs_buf_daddr (bp)); - hdr3->owner =cpu_to_be64 (dp->i_ino); + hdr3->owner =cpu_to_be64 (args->owner);uuid_copy (&hdr3->uuid, &mp->m_sb.sb_meta_uuid); ichdr.freemap[0 ].base =sizeof (struct xfs_attr3_leaf_hdr );
fs/xfs/libxfs/xfs_attr_remote.c +2 -2
@@ -522,8 +522,8 @@ xfs_attr_rmtval_set_value(return error; bp->b_ops = &xfs_attr3_rmt_buf_ops; -xfs_attr_rmtval_copyin (mp, bp, args->dp->i_ino, &offset, - &valuelen, &src); +xfs_attr_rmtval_copyin (mp, bp, args->owner, &offset, &valuelen, + &src); error =xfs_bwrite (bp);/* GROT: NOTE: synchronous write */ xfs_buf_relse (bp);
fs/xfs/libxfs/xfs_da_btree.c +1 -1
@@ -486,7 +486,7 @@ xfs_da3_node_create(memset (hdr3,0 ,sizeof (struct xfs_da3_node_hdr )); ichdr.magic =XFS_DA3_NODE_MAGIC ; hdr3->info.blkno =cpu_to_be64 (xfs_buf_daddr (bp)); - hdr3->info.owner =cpu_to_be64 (args->dp->i_ino); + hdr3->info.owner =cpu_to_be64 (args->owner);uuid_copy (&hdr3->info.uuid, &mp->m_sb.sb_meta_uuid); }else { ichdr.magic =XFS_DA_NODE_MAGIC ;
fs/xfs/libxfs/xfs_dir2_block.c +10 -9
@@ -163,12 +163,13 @@ xfs_dir3_block_read(static void xfs_dir3_block_init ( -struct xfs_mount *mp, -struct xfs_trans *tp, -struct xfs_buf *bp, -struct xfs_inode *dp) +struct xfs_da_args *args, +struct xfs_buf *bp) { -struct xfs_dir3_blk_hdr *hdr3 = bp->b_addr; +struct xfs_trans *tp = args->trans; +struct xfs_inode *dp = args->dp; +struct xfs_mount *mp = dp->i_mount; +struct xfs_dir3_blk_hdr *hdr3 = bp->b_addr; bp->b_ops = &xfs_dir3_block_buf_ops;xfs_trans_buf_set_type (tp, bp,XFS_BLFT_DIR_BLOCK_BUF );
@@ -177,7 +178,7 @@ xfs_dir3_block_init(memset (hdr3,0 ,sizeof (*hdr3)); hdr3->magic =cpu_to_be32 (XFS_DIR3_BLOCK_MAGIC ); hdr3->blkno =cpu_to_be64 (xfs_buf_daddr (bp)); - hdr3->owner =cpu_to_be64 (dp->i_ino); + hdr3->owner =cpu_to_be64 (args->owner);uuid_copy (&hdr3->uuid, &mp->m_sb.sb_meta_uuid);return ;
@@ -1009,7 +1010,7 @@ xfs_dir2_leaf_to_block(/* * Start converting it to block form. */ -xfs_dir3_block_init (mp, tp, dbp, dp); +xfs_dir3_block_init (args, dbp); needlog =1 ; needscan =0 ;
@@ -1129,7 +1130,7 @@ xfs_dir2_sf_to_block( error =xfs_dir3_data_init (args, blkno, &bp);if (error) goto out_free; -xfs_dir3_block_init (mp, tp, bp, dp); +xfs_dir3_block_init (args, bp); hdr = bp->b_addr;/*
@@ -1169,7 +1170,7 @@ xfs_dir2_sf_to_block(* Create entry for . */ dep = bp->b_addr + offset; - dep->inumber =cpu_to_be64 (dp->i_ino); + dep->inumber =cpu_to_be64 (args->owner); dep->namelen =1 ; dep->name[0 ] ='.' ;xfs_dir2_data_put_ftype (mp, dep,XFS_DIR3_FT_DIR );
fs/xfs/libxfs/xfs_dir2_data.c +1 -1
@@ -725,7 +725,7 @@ xfs_dir3_data_init(memset (hdr3,0 ,sizeof (*hdr3)); hdr3->magic =cpu_to_be32 (XFS_DIR3_DATA_MAGIC ); hdr3->blkno =cpu_to_be64 (xfs_buf_daddr (bp)); - hdr3->owner =cpu_to_be64 (dp->i_ino); + hdr3->owner =cpu_to_be64 (args->owner);uuid_copy (&hdr3->uuid, &mp->m_sb.sb_meta_uuid); }else
fs/xfs/libxfs/xfs_dir2_leaf.c +5 -6
@@ -304,12 +304,12 @@ xfs_dir3_leafn_read(*/ static void xfs_dir3_leaf_init ( -struct xfs_mount *mp, -struct xfs_trans *tp, +struct xfs_da_args *args,struct xfs_buf *bp, -xfs_ino_t owner,uint16_t type) { +struct xfs_mount *mp = args->dp->i_mount; +struct xfs_trans *tp = args->trans;struct xfs_dir2_leaf *leaf = bp->b_addr;ASSERT (type ==XFS_DIR2_LEAF1_MAGIC || type ==XFS_DIR2_LEAFN_MAGIC );
@@ -323,7 +323,7 @@ xfs_dir3_leaf_init( ?cpu_to_be16 (XFS_DIR3_LEAF1_MAGIC ) :cpu_to_be16 (XFS_DIR3_LEAFN_MAGIC ); leaf3->info.blkno =cpu_to_be64 (xfs_buf_daddr (bp)); - leaf3->info.owner =cpu_to_be64 (owner); + leaf3->info.owner =cpu_to_be64 (args->owner);uuid_copy (&leaf3->info.uuid, &mp->m_sb.sb_meta_uuid); }else {memset (leaf,0 ,sizeof (*leaf));
@@ -356,7 +356,6 @@ xfs_dir3_leaf_get_buf( {struct xfs_inode *dp = args->dp;struct xfs_trans *tp = args->trans; -struct xfs_mount *mp = dp->i_mount;struct xfs_buf *bp;int error;
@@ -369,7 +368,7 @@ xfs_dir3_leaf_get_buf(if (error)return error; -xfs_dir3_leaf_init (mp, tp, bp, dp->i_ino, magic); +xfs_dir3_leaf_init (args, bp, magic);xfs_dir3_leaf_log_header (args, bp);if (magic ==XFS_DIR2_LEAF1_MAGIC )xfs_dir3_leaf_log_tail (args, bp);
fs/xfs/libxfs/xfs_dir2_node.c +1 -1
@@ -349,7 +349,7 @@ xfs_dir3_free_get_buf( hdr.magic =XFS_DIR3_FREE_MAGIC ; hdr3->hdr.blkno =cpu_to_be64 (xfs_buf_daddr (bp)); - hdr3->hdr.owner =cpu_to_be64 (dp->i_ino); + hdr3->hdr.owner =cpu_to_be64 (args->owner);uuid_copy (&hdr3->hdr.uuid, &mp->m_sb.sb_meta_uuid); }else hdr.magic =XFS_DIR2_FREE_MAGIC ;
PATCH 3/10 xfs: reduce indenting in xfs_attr_node_list
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
Reduce the indenting here so that we can add some things in the next patch without going over the column limits.
--- fs/xfs/xfs_attr_list.c | 56 +++++++++++++++++++++++++----------------------- 1 file changed, 29 insertions(+), 27 deletions(-)
fs/xfs/xfs_attr_list.c +29 -27
@@ -310,46 +310,47 @@ xfs_attr_node_list(*/ bp =NULL ;if (cursor->blkno >0 ) { +struct xfs_attr_leaf_entry *entries; + error =xfs_da3_node_read (context->tp, dp, cursor->blkno, &bp,XFS_ATTR_FORK );if (xfs_metadata_is_sick (error))xfs_dirattr_mark_sick (dp,XFS_ATTR_FORK ); -if ((error !=0 ) && (error != -EFSCORRUPTED )) +if (error !=0 && error != -EFSCORRUPTED )return error; -if (bp) { -struct xfs_attr_leaf_entry *entries; +if (!bp) + goto need_lookup; - node = bp->b_addr; -switch (be16_to_cpu (node->hdr.info.magic)) { -case XFS_DA_NODE_MAGIC : -case XFS_DA3_NODE_MAGIC : + node = bp->b_addr; +switch (be16_to_cpu (node->hdr.info.magic)) { +case XFS_DA_NODE_MAGIC : +case XFS_DA3_NODE_MAGIC : +trace_xfs_attr_list_wrong_blk (context); +xfs_trans_brelse (context->tp, bp); + bp =NULL ; +break ; +case XFS_ATTR_LEAF_MAGIC : +case XFS_ATTR3_LEAF_MAGIC : + leaf = bp->b_addr; +xfs_attr3_leaf_hdr_from_disk (mp->m_attr_geo, + &leafhdr, leaf); + entries =xfs_attr3_leaf_entryp (leaf); +if (cursor->hashval >be32_to_cpu ( + entries[leafhdr.count -1 ].hashval)) {trace_xfs_attr_list_wrong_blk (context);xfs_trans_brelse (context->tp, bp); bp =NULL ; -break ; -case XFS_ATTR_LEAF_MAGIC : -case XFS_ATTR3_LEAF_MAGIC : - leaf = bp->b_addr; -xfs_attr3_leaf_hdr_from_disk (mp->m_attr_geo, - &leafhdr, leaf); - entries =xfs_attr3_leaf_entryp (leaf); -if (cursor->hashval >be32_to_cpu ( - entries[leafhdr.count -1 ].hashval)) { -trace_xfs_attr_list_wrong_blk (context); -xfs_trans_brelse (context->tp, bp); - bp =NULL ; - }else if (cursor->hashval <=be32_to_cpu ( - entries[0 ].hashval)) { -trace_xfs_attr_list_wrong_blk (context); -xfs_trans_brelse (context->tp, bp); - bp =NULL ; - } -break ; -default : + }else if (cursor->hashval <=be32_to_cpu ( + entries[0 ].hashval)) {trace_xfs_attr_list_wrong_blk (context);xfs_trans_brelse (context->tp, bp); bp =NULL ; } +break ; +default : +trace_xfs_attr_list_wrong_blk (context); +xfs_trans_brelse (context->tp, bp); + bp =NULL ; } }
@@ -359,6 +360,7 @@ xfs_attr_node_list(* Note that start of node block is same as start of leaf block. */ if (bp ==NULL ) { +need_lookup: error =xfs_attr_node_list_lookup (context, cursor, &bp);if (error || !bp)return error;
Re: [PATCH 03/10] xfs: reduce indenting in xfs_attr_node_list
Quoted 4 lines · Darrick J. Wong
From: Darrick J. Wong <[email protected]>
Reduce the indenting here so that we can add some things in the next patch without going over the column limits.
Wouldn't you normal say 'reduce indentation' and not 'reduce indenting'?
Either way the change looks good:
Re: [PATCH 03/10] xfs: reduce indenting in xfs_attr_node_list
Quoted 7 lines · Christoph Hellwig
Quoted 4 lines · Darrick J. Wong
From: Darrick J. Wong <[email protected]>
Reduce the indenting here so that we can add some things in the next patch without going over the column limits.
Wouldn't you normal say 'reduce indentation' and not 'reduce indenting'?
Err... yes. I'll fix that up. :)
Quoted 3 lines
Either way the change looks good:
Reviewed-by Christoph Hellwig <[email protected]>
Thanks!
--D
PATCH 4/10 xfs: validate attr leaf buffer owners
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
Create a leaf block header checking function to validate the owner field of xattr leaf blocks.
--- fs/xfs/libxfs/xfs_attr.c | 10 ++++--- fs/xfs/libxfs/xfs_attr_leaf.c | 55 ++++++++++++++++++++++++++++++++++------- fs/xfs/libxfs/xfs_attr_leaf.h | 4 ++- fs/xfs/libxfs/xfs_da_btree.c | 42 +++++++++++++++++++++++++++++++ fs/xfs/libxfs/xfs_da_btree.h | 1 + fs/xfs/libxfs/xfs_exchmaps.c | 3 +- fs/xfs/scrub/dabtree.c | 7 +++++ fs/xfs/xfs_attr_list.c | 24 ++++++++++++++++-- 8 files changed, 127 insertions(+), 19 deletions(-)
fs/xfs/libxfs/xfs_attr.c +5 -5
@@ -649,8 +649,8 @@ xfs_attr_leaf_remove_attr(int forkoff;int error; - error =xfs_attr3_leaf_read (args->trans, args->dp, args->blkno, - &bp); + error =xfs_attr3_leaf_read (args->trans, args->dp, args->owner, + args->blkno, &bp);if (error)return error;
@@ -681,7 +681,7 @@ xfs_attr_leaf_shrink(if (!xfs_attr_is_leaf (dp))return 0 ; - error =xfs_attr3_leaf_read (args->trans, args->dp,0 , &bp); + error =xfs_attr3_leaf_read (args->trans, args->dp, args->owner,0 , &bp);if (error)return error;
@@ -1158,7 +1158,7 @@ xfs_attr_leaf_try_add(struct xfs_buf *bp;int error; - error =xfs_attr3_leaf_read (args->trans, args->dp,0 , &bp); + error =xfs_attr3_leaf_read (args->trans, args->dp, args->owner,0 , &bp);if (error)return error;
@@ -1206,7 +1206,7 @@ xfs_attr_leaf_hasname( {int error =0 ; - error =xfs_attr3_leaf_read (args->trans, args->dp,0 , bp); + error =xfs_attr3_leaf_read (args->trans, args->dp, args->owner,0 , bp);if (error)return error;
fs/xfs/libxfs/xfs_attr_leaf.c +46 -9
111 lines not on this page · raw message
fs/xfs/libxfs/xfs_attr_leaf.h +3 -1
@@ -98,12 +98,14 @@ int xfs_attr_leaf_order(struct xfs_buf *leaf1_bp, struct xfs_buf *leaf2_bp);int xfs_attr_leaf_newentsize (struct xfs_da_args *args,int *local);int xfs_attr3_leaf_read (struct xfs_trans *tp,struct xfs_inode *dp, -xfs_dablk_t bno,struct xfs_buf **bpp); +xfs_ino_t owner,xfs_dablk_t bno,struct xfs_buf **bpp);void xfs_attr3_leaf_hdr_from_disk (struct xfs_da_geometry *geo,struct xfs_attr3_icleaf_hdr *to,struct xfs_attr_leafblock *from);void xfs_attr3_leaf_hdr_to_disk (struct xfs_da_geometry *geo,struct xfs_attr_leafblock *to,struct xfs_attr3_icleaf_hdr *from); +xfs_failaddr_t xfs_attr3_leaf_header_check (struct xfs_buf *bp, +xfs_ino_t owner);#endif /* __XFS_ATTR_LEAF_H__ */
fs/xfs/libxfs/xfs_da_btree.c +42 -0
84 lines not on this page · raw message
fs/xfs/libxfs/xfs_da_btree.h +1 -0
@@ -236,6 +236,7 @@ void xfs_da3_node_hdr_from_disk(struct xfs_mount *mp, struct xfs_da3_icnode_hdr *to, struct xfs_da_intnode *from);void xfs_da3_node_hdr_to_disk (struct xfs_mount *mp,struct xfs_da_intnode *to,struct xfs_da3_icnode_hdr *from); +xfs_failaddr_t xfs_da3_header_check (struct xfs_buf *bp,xfs_ino_t owner);extern struct kmem_cache *xfs_da_state_cache;
fs/xfs/libxfs/xfs_exchmaps.c +2 -1
@@ -438,7 +438,8 @@ xfs_exchmaps_attr_to_sf(if (!xfs_attr_is_leaf (xmi->xmi_ip2))return 0 ; - error =xfs_attr3_leaf_read (tp, xmi->xmi_ip2,0 , &bp); + error =xfs_attr3_leaf_read (tp, xmi->xmi_ip2, xmi->xmi_ip2->i_ino,0 , + &bp);if (error)return error;
fs/xfs/scrub/dabtree.c +7 -0
@@ -320,6 +320,7 @@ xchk_da_btree_block(struct xfs_da3_blkinfo *hdr3;struct xfs_da_args *dargs = &ds->dargs;struct xfs_inode *ip = ds->dargs.dp; +xfs_failaddr_t fa;xfs_ino_t owner;int *pmaxrecs;struct xfs_da3_icnode_hdr nodehdr;
@@ -442,6 +443,12 @@ xchk_da_btree_block( goto out_freebp; } + fa =xfs_da3_header_check (blk->bp, dargs->owner); +if (fa) { +xchk_da_set_corrupt (ds, level); + goto out_freebp; + } +/* * If we've been handed a block that is below the dabtree root, does * its hashval match what the parent block expected to see?
fs/xfs/xfs_attr_list.c +21 -3
@@ -214,6 +214,7 @@ xfs_attr_node_list_lookup(struct xfs_mount *mp = dp->i_mount;struct xfs_trans *tp = context->tp;struct xfs_buf *bp; +xfs_failaddr_t fa;int i;int error =0 ;unsigned int expected_level =0 ;
@@ -273,6 +274,12 @@ xfs_attr_node_list_lookup( } } + fa =xfs_attr3_leaf_header_check (bp, dp->i_ino); +if (fa) { +__xfs_buf_mark_corrupt (bp, fa); + goto out_releasebuf; + } +if (expected_level !=0 ) goto out_corruptbuf;
@@ -281,6 +288,7 @@ xfs_attr_node_list_lookup( out_corruptbuf:xfs_buf_mark_corrupt (bp); +out_releasebuf:xfs_trans_brelse (tp, bp);xfs_dirattr_mark_sick (dp,XFS_ATTR_FORK );return -EFSCORRUPTED ;
@@ -297,6 +305,7 @@ xfs_attr_node_list(struct xfs_buf *bp;struct xfs_inode *dp = context->dp;struct xfs_mount *mp = dp->i_mount; +xfs_failaddr_t fa;int error =0 ;trace_xfs_attr_node_list (context);
@@ -332,6 +341,14 @@ xfs_attr_node_list(case XFS_ATTR_LEAF_MAGIC :case XFS_ATTR3_LEAF_MAGIC : leaf = bp->b_addr; + fa =xfs_attr3_leaf_header_check (bp, dp->i_ino); +if (fa) { +__xfs_buf_mark_corrupt (bp, fa); +xfs_trans_brelse (context->tp, bp); +xfs_dirattr_mark_sick (dp,XFS_ATTR_FORK ); + bp =NULL ; +break ; + }xfs_attr3_leaf_hdr_from_disk (mp->m_attr_geo, &leafhdr, leaf); entries =xfs_attr3_leaf_entryp (leaf);
@@ -382,8 +399,8 @@ xfs_attr_node_list(break ; cursor->blkno = leafhdr.forw;xfs_trans_brelse (context->tp, bp); - error =xfs_attr3_leaf_read (context->tp, dp, cursor->blkno, - &bp); + error =xfs_attr3_leaf_read (context->tp, dp, dp->i_ino, + cursor->blkno, &bp);if (error)return error; }
@@ -503,7 +520,8 @@ xfs_attr_leaf_list(trace_xfs_attr_leaf_list (context); context->cursor.blkno =0 ; - error =xfs_attr3_leaf_read (context->tp, context->dp,0 , &bp); + error =xfs_attr3_leaf_read (context->tp, context->dp, + context->dp->i_ino,0 , &bp);if (error)return error;
PATCH 5/10 xfs: validate attr remote value buffer owners
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
Check the owner field of xattr remote value blocks.
--- fs/xfs/libxfs/xfs_attr_remote.c | 9 ++++----- 1 file changed, 4 insertions(+), 5 deletions(-)
fs/xfs/libxfs/xfs_attr_remote.c +4 -5
@@ -280,12 +280,12 @@ xfs_attr_rmtval_copyout(struct xfs_mount *mp, struct xfs_buf *bp, struct xfs_inode *dp, + xfs_ino_t owner, int *offset, int *valuelen, uint8_t **dst) { char *src = bp->b_addr; -xfs_ino_t ino = dp->i_ino;xfs_daddr_t bno =xfs_buf_daddr (bp);int len =BBTOB (bp->b_length);int blksize = mp->m_attr_geo->blksize;
@@ -299,11 +299,11 @@ xfs_attr_rmtval_copyout( byte_cnt =min (*valuelen, byte_cnt);if (xfs_has_crc (mp)) { -if (xfs_attr3_rmt_hdr_ok (src, ino, *offset, +if (xfs_attr3_rmt_hdr_ok (src, owner, *offset, byte_cnt, bno)) {xfs_alert (mp,"remote attribute header mismatch bno/off/len/owner (0x%llx/0x%x/Ox%x/0x%llx)" , - bno, *offset, byte_cnt, ino); + bno, *offset, byte_cnt, owner);xfs_dirattr_mark_sick (dp,XFS_ATTR_FORK );return -EFSCORRUPTED ; }
@@ -427,8 +427,7 @@ xfs_attr_rmtval_get(return error; error =xfs_attr_rmtval_copyout (mp, bp, args->dp, - &offset, &valuelen, - &dst); + args->owner, &offset, &valuelen, &dst);xfs_buf_relse (bp);if (error)return error;
PATCH 6/10 xfs: validate dabtree node buffer owners
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
Check the owner field of dabtree node blocks.
--- fs/xfs/libxfs/xfs_da_btree.c | 108 ++++++++++++++++++++++++++++++++++++++++++ fs/xfs/libxfs/xfs_da_btree.h | 1 fs/xfs/xfs_attr_list.c | 9 ++++ 3 files changed, 118 insertions(+)
fs/xfs/libxfs/xfs_da_btree.c +108 -0
@@ -252,6 +252,25 @@ xfs_da3_node_verify(return NULL ; } +xfs_failaddr_t +xfs_da3_node_header_check ( +struct xfs_buf *bp, +xfs_ino_t owner) +{ +struct xfs_mount *mp = bp->b_mount; + +if (xfs_has_crc (mp)) { +struct xfs_da3_blkinfo *hdr3 = bp->b_addr; + +ASSERT (hdr3->hdr.magic ==cpu_to_be16 (XFS_DA3_NODE_MAGIC )); + +if (be64_to_cpu (hdr3->owner) != owner) +return __this_address; + } + +return NULL ; +} + xfs_failaddr_t xfs_da3_header_check( struct xfs_buf *bp,
@@ -266,6 +285,8 @@ xfs_da3_header_check(switch (hdr->magic) {case cpu_to_be16 (XFS_ATTR3_LEAF_MAGIC ):return xfs_attr3_leaf_header_check (bp, owner); +case cpu_to_be16 (XFS_DA3_NODE_MAGIC ): +return xfs_da3_node_header_check (bp, owner); }return NULL ;
@@ -1218,6 +1239,7 @@ xfs_da3_root_join(struct xfs_da3_icnode_hdr oldroothdr;int error;struct xfs_inode *dp = state->args->dp; +xfs_failaddr_t fa;trace_xfs_da_root_join (state->args);
@@ -1244,6 +1266,13 @@ xfs_da3_root_join( error =xfs_da3_node_read (args->trans, dp, child, &bp, args->whichfork);if (error)return error; + fa =xfs_da3_header_check (bp, args->owner); +if (fa) { +__xfs_buf_mark_corrupt (bp, fa); +xfs_trans_brelse (args->trans, bp); +xfs_da_mark_sick (args); +return -EFSCORRUPTED ; + }xfs_da_blkinfo_onlychild_validate (bp->b_addr, oldroothdr.level);/*
@@ -1278,6 +1307,7 @@ xfs_da3_node_toosmall(struct xfs_da_blkinfo *info;xfs_dablk_t blkno;struct xfs_buf *bp; +xfs_failaddr_t fa;struct xfs_da3_icnode_hdr nodehdr;int count;int forward;
@@ -1352,6 +1382,13 @@ xfs_da3_node_toosmall( state->args->whichfork);if (error)return error; + fa =xfs_da3_node_header_check (bp, state->args->owner); +if (fa) { +__xfs_buf_mark_corrupt (bp, fa); +xfs_trans_brelse (state->args->trans, bp); +xfs_da_mark_sick (state->args); +return -EFSCORRUPTED ; + } node = bp->b_addr;xfs_da3_node_hdr_from_disk (dp->i_mount, &thdr, node);
@@ -1674,6 +1711,13 @@ xfs_da3_node_lookup_int(return -EFSCORRUPTED ; } + fa =xfs_da3_node_header_check (blk->bp, args->owner); +if (fa) { +__xfs_buf_mark_corrupt (blk->bp, fa); +xfs_da_mark_sick (args); +return -EFSCORRUPTED ; + } + blk->magic =XFS_DA_NODE_MAGIC ;/*
@@ -1846,6 +1890,7 @@ xfs_da3_blk_link(struct xfs_da_blkinfo *tmp_info;struct xfs_da_args *args;struct xfs_buf *bp; +xfs_failaddr_t fa;int before =0 ;int error;struct xfs_inode *dp = state->args->dp;
@@ -1889,6 +1934,13 @@ xfs_da3_blk_link( &bp, args->whichfork);if (error)return error; + fa =xfs_da3_header_check (bp, args->owner); +if (fa) { +__xfs_buf_mark_corrupt (bp, fa); +xfs_trans_brelse (args->trans, bp); +xfs_da_mark_sick (args); +return -EFSCORRUPTED ; + }ASSERT (bp !=NULL ); tmp_info = bp->b_addr;ASSERT (tmp_info->magic == old_info->magic);
@@ -1910,6 +1962,13 @@ xfs_da3_blk_link( &bp, args->whichfork);if (error)return error; + fa =xfs_da3_header_check (bp, args->owner); +if (fa) { +__xfs_buf_mark_corrupt (bp, fa); +xfs_trans_brelse (args->trans, bp); +xfs_da_mark_sick (args); +return -EFSCORRUPTED ; + }ASSERT (bp !=NULL ); tmp_info = bp->b_addr;ASSERT (tmp_info->magic == old_info->magic);
@@ -1939,6 +1998,7 @@ xfs_da3_blk_unlink(struct xfs_da_blkinfo *tmp_info;struct xfs_da_args *args;struct xfs_buf *bp; +xfs_failaddr_t fa;int error;/*
@@ -1969,6 +2029,13 @@ xfs_da3_blk_unlink( &bp, args->whichfork);if (error)return error; + fa =xfs_da3_header_check (bp, args->owner); +if (fa) { +__xfs_buf_mark_corrupt (bp, fa); +xfs_trans_brelse (args->trans, bp); +xfs_da_mark_sick (args); +return -EFSCORRUPTED ; + }ASSERT (bp !=NULL ); tmp_info = bp->b_addr;ASSERT (tmp_info->magic == save_info->magic);
@@ -1986,6 +2053,13 @@ xfs_da3_blk_unlink( &bp, args->whichfork);if (error)return error; + fa =xfs_da3_header_check (bp, args->owner); +if (fa) { +__xfs_buf_mark_corrupt (bp, fa); +xfs_trans_brelse (args->trans, bp); +xfs_da_mark_sick (args); +return -EFSCORRUPTED ; + }ASSERT (bp !=NULL ); tmp_info = bp->b_addr;ASSERT (tmp_info->magic == save_info->magic);
@@ -2101,6 +2175,12 @@ xfs_da3_path_shift(switch (be16_to_cpu (info->magic)) {case XFS_DA_NODE_MAGIC :case XFS_DA3_NODE_MAGIC : + fa =xfs_da3_node_header_check (blk->bp, args->owner); +if (fa) { +__xfs_buf_mark_corrupt (blk->bp, fa); +xfs_da_mark_sick (args); +return -EFSCORRUPTED ; + } blk->magic =XFS_DA_NODE_MAGIC ;xfs_da3_node_hdr_from_disk (dp->i_mount, &nodehdr, bp->b_addr);
@@ -2406,6 +2486,13 @@ xfs_da3_swap_lastblock( error =xfs_da3_node_read (tp, dp, sib_blkno, &sib_buf, w);if (error) goto done; + fa =xfs_da3_header_check (sib_buf, args->owner); +if (fa) { +__xfs_buf_mark_corrupt (sib_buf, fa); +xfs_da_mark_sick (args); + error = -EFSCORRUPTED ; + goto done; + } sib_info = sib_buf->b_addr; if (XFS_IS_CORRUPT(mp, be32_to_cpu(sib_info->forw) != last_blkno ||
@@ -2427,6 +2514,13 @@ xfs_da3_swap_lastblock( error =xfs_da3_node_read (tp, dp, sib_blkno, &sib_buf, w);if (error) goto done; + fa =xfs_da3_header_check (sib_buf, args->owner); +if (fa) { +__xfs_buf_mark_corrupt (sib_buf, fa); +xfs_da_mark_sick (args); + error = -EFSCORRUPTED ; + goto done; + } sib_info = sib_buf->b_addr; if (XFS_IS_CORRUPT(mp, be32_to_cpu(sib_info->back) != last_blkno ||
@@ -2450,6 +2544,13 @@ xfs_da3_swap_lastblock( error =xfs_da3_node_read (tp, dp, par_blkno, &par_buf, w);if (error) goto done; + fa =xfs_da3_node_header_check (par_buf, args->owner); +if (fa) { +__xfs_buf_mark_corrupt (par_buf, fa); +xfs_da_mark_sick (args); + error = -EFSCORRUPTED ; + goto done; + } par_node = par_buf->b_addr;xfs_da3_node_hdr_from_disk (dp->i_mount, &par_hdr, par_node); if (XFS_IS_CORRUPT(mp,
@@ -2499,6 +2600,13 @@ xfs_da3_swap_lastblock( error =xfs_da3_node_read (tp, dp, par_blkno, &par_buf, w);if (error) goto done; + fa =xfs_da3_node_header_check (par_buf, args->owner); +if (fa) { +__xfs_buf_mark_corrupt (par_buf, fa); +xfs_da_mark_sick (args); + error = -EFSCORRUPTED ; + goto done; + } par_node = par_buf->b_addr;xfs_da3_node_hdr_from_disk (dp->i_mount, &par_hdr, par_node);if (XFS_IS_CORRUPT (mp, par_hdr.level != level)) {
fs/xfs/libxfs/xfs_da_btree.h +1 -0
@@ -237,6 +237,7 @@ void xfs_da3_node_hdr_from_disk(struct xfs_mount *mp,void xfs_da3_node_hdr_to_disk (struct xfs_mount *mp,struct xfs_da_intnode *to,struct xfs_da3_icnode_hdr *from);xfs_failaddr_t xfs_da3_header_check (struct xfs_buf *bp,xfs_ino_t owner); +xfs_failaddr_t xfs_da3_node_header_check (struct xfs_buf *bp,xfs_ino_t owner);extern struct kmem_cache *xfs_da_state_cache;
fs/xfs/xfs_attr_list.c +9 -0
@@ -239,6 +239,10 @@ xfs_attr_node_list_lookup( goto out_corruptbuf; } + fa =xfs_da3_node_header_check (bp, dp->i_ino); +if (fa) + goto out_corruptbuf; +xfs_da3_node_hdr_from_disk (mp, &nodehdr, node);/* Tree taller than we can handle; bail out! */
@@ -335,6 +339,11 @@ xfs_attr_node_list(case XFS_DA_NODE_MAGIC :case XFS_DA3_NODE_MAGIC :trace_xfs_attr_list_wrong_blk (context); + fa =xfs_da3_node_header_check (bp, dp->i_ino); +if (fa) { +__xfs_buf_mark_corrupt (bp, fa); +xfs_dirattr_mark_sick (dp,XFS_ATTR_FORK ); + }xfs_trans_brelse (context->tp, bp); bp =NULL ;break ;
PATCH 7/10 xfs: validate directory leaf buffer owners
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
Check the owner field of directory leaf blocks.
--- fs/xfs/libxfs/xfs_da_btree.c | 16 ++++++++++ fs/xfs/libxfs/xfs_dir2.h | 2 + fs/xfs/libxfs/xfs_dir2_leaf.c | 64 +++++++++++++++++++++++++++++++++++++---- fs/xfs/libxfs/xfs_dir2_node.c | 3 +- fs/xfs/libxfs/xfs_dir2_priv.h | 4 +-- fs/xfs/scrub/dir.c | 2 + 6 files changed, 81 insertions(+), 10 deletions(-)
fs/xfs/libxfs/xfs_da_btree.c +16 -0
@@ -287,8 +287,12 @@ xfs_da3_header_check(return xfs_attr3_leaf_header_check (bp, owner);case cpu_to_be16 (XFS_DA3_NODE_MAGIC ):return xfs_da3_node_header_check (bp, owner); +case cpu_to_be16 (XFS_DIR3_LEAF1_MAGIC ): +case cpu_to_be16 (XFS_DIR3_LEAFN_MAGIC ): +return xfs_dir3_leaf_header_check (bp, owner); } +ASSERT (0 );return NULL ; }
@@ -1699,6 +1703,12 @@ xfs_da3_node_lookup_int(if (magic ==XFS_DIR2_LEAFN_MAGIC || magic ==XFS_DIR3_LEAFN_MAGIC ) { + fa =xfs_dir3_leaf_header_check (blk->bp, args->owner); +if (fa) { +__xfs_buf_mark_corrupt (blk->bp, fa); +xfs_da_mark_sick (args); +return -EFSCORRUPTED ; + } blk->magic =XFS_DIR2_LEAFN_MAGIC ; blk->hashval =xfs_dir2_leaf_lasthash (args->dp, blk->bp,NULL );
@@ -2207,6 +2217,12 @@ xfs_da3_path_shift(break ;case XFS_DIR2_LEAFN_MAGIC :case XFS_DIR3_LEAFN_MAGIC : + fa =xfs_dir3_leaf_header_check (blk->bp, args->owner); +if (fa) { +__xfs_buf_mark_corrupt (blk->bp, fa); +xfs_da_mark_sick (args); +return -EFSCORRUPTED ; + } blk->magic =XFS_DIR2_LEAFN_MAGIC ;ASSERT (level == path->active-1 ); blk->index =0 ;
fs/xfs/libxfs/xfs_dir2.h +2 -0
@@ -101,6 +101,8 @@ extern struct xfs_dir2_data_free *xfs_dir2_data_freefind(extern int xfs_dir_ino_validate (struct xfs_mount *mp,xfs_ino_t ino); +xfs_failaddr_t xfs_dir3_leaf_header_check (struct xfs_buf *bp,xfs_ino_t owner); +extern const struct xfs_buf_ops xfs_dir3_block_buf_ops;extern const struct xfs_buf_ops xfs_dir3_leafn_buf_ops;extern const struct xfs_buf_ops xfs_dir3_leaf1_buf_ops;
fs/xfs/libxfs/xfs_dir2_leaf.c +58 -6
110 lines not on this page · raw message
fs/xfs/libxfs/xfs_dir2_node.c +2 -1
@@ -1562,7 +1562,8 @@ xfs_dir2_leafn_toosmall(/* * Read the sibling leaf block. */ - error =xfs_dir3_leafn_read (state->args->trans, dp, blkno, &bp); + error =xfs_dir3_leafn_read (state->args->trans, dp, + state->args->owner, blkno, &bp);if (error)return error;
fs/xfs/libxfs/xfs_dir2_priv.h +2 -2
@@ -95,9 +95,9 @@ void xfs_dir2_leaf_hdr_from_disk(struct xfs_mount *mp,void xfs_dir2_leaf_hdr_to_disk (struct xfs_mount *mp,struct xfs_dir2_leaf *to,struct xfs_dir3_icleaf_hdr *from);int xfs_dir3_leaf_read (struct xfs_trans *tp,struct xfs_inode *dp, -xfs_dablk_t fbno,struct xfs_buf **bpp); +xfs_ino_t owner,xfs_dablk_t fbno,struct xfs_buf **bpp);int xfs_dir3_leafn_read (struct xfs_trans *tp,struct xfs_inode *dp, -xfs_dablk_t fbno,struct xfs_buf **bpp); +xfs_ino_t owner,xfs_dablk_t fbno,struct xfs_buf **bpp);extern int xfs_dir2_block_to_leaf (struct xfs_da_args *args,struct xfs_buf *dbp);extern int xfs_dir2_leaf_addname (struct xfs_da_args *args);
fs/xfs/scrub/dir.c +1 -1
@@ -470,7 +470,7 @@ xchk_directory_leaf1_bestfree(int error;/* Read the free space block. */ - error =xfs_dir3_leaf_read (sc->tp, sc->ip, lblk, &bp); + error =xfs_dir3_leaf_read (sc->tp, sc->ip, sc->ip->i_ino, lblk, &bp);if (!xchk_fblock_process_error (sc,XFS_DATA_FORK , lblk, &error))return error;xchk_buffer_recheck (sc, bp);
PATCH 8/10 xfs: validate explicit directory data buffer owners
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
Port the existing directory data header checking function to accept an owner number instead of an xfs_inode, then update the callsites to use xfs_da_args.owner when possible.
--- fs/xfs/libxfs/xfs_dir2.h | 1 + fs/xfs/libxfs/xfs_dir2_block.c | 3 ++- fs/xfs/libxfs/xfs_dir2_data.c | 15 +++++++++------ fs/xfs/libxfs/xfs_dir2_leaf.c | 21 +++++++++++---------- fs/xfs/libxfs/xfs_dir2_node.c | 7 +++---- fs/xfs/libxfs/xfs_dir2_priv.h | 3 ++- fs/xfs/scrub/dir.c | 14 +++++++------- fs/xfs/scrub/readdir.c | 2 +- fs/xfs/xfs_dir2_readdir.c | 3 ++- 9 files changed, 38 insertions(+), 31 deletions(-)
fs/xfs/libxfs/xfs_dir2.h +1 -0
@@ -102,6 +102,7 @@ extern struct xfs_dir2_data_free *xfs_dir2_data_freefind(extern int xfs_dir_ino_validate (struct xfs_mount *mp,xfs_ino_t ino);xfs_failaddr_t xfs_dir3_leaf_header_check (struct xfs_buf *bp,xfs_ino_t owner); +xfs_failaddr_t xfs_dir3_data_header_check (struct xfs_buf *bp,xfs_ino_t owner);extern const struct xfs_buf_ops xfs_dir3_block_buf_ops;extern const struct xfs_buf_ops xfs_dir3_leafn_buf_ops;
fs/xfs/libxfs/xfs_dir2_block.c +2 -1
@@ -982,7 +982,8 @@ xfs_dir2_leaf_to_block(* Read the data block if we don't already have it, give up if it fails. */ if (!dbp) { - error =xfs_dir3_data_read (tp, dp, args->geo->datablk,0 , &dbp); + error =xfs_dir3_data_read (tp, dp, args->owner, + args->geo->datablk,0 , &dbp);if (error)return error; }
fs/xfs/libxfs/xfs_dir2_data.c +9 -6
@@ -395,17 +395,19 @@ static const struct xfs_buf_ops xfs_dir3_data_reada_buf_ops = { .verify_write = xfs_dir3_data_write_verify, }; -static xfs_failaddr_t +xfs_failaddr_t xfs_dir3_data_header_check ( -struct xfs_inode *dp, -struct xfs_buf *bp) +struct xfs_buf *bp, +xfs_ino_t owner) { -struct xfs_mount *mp = dp->i_mount; +struct xfs_mount *mp = bp->b_mount;if (xfs_has_crc (mp)) {struct xfs_dir3_data_hdr *hdr3 = bp->b_addr; -if (be64_to_cpu (hdr3->hdr.owner) != dp->i_ino) +ASSERT (hdr3->hdr.magic ==cpu_to_be32 (XFS_DIR3_DATA_MAGIC )); + +if (be64_to_cpu (hdr3->hdr.owner) != owner)return __this_address; }
@@ -416,6 +418,7 @@ intxfs_dir3_data_read ( struct xfs_trans *tp, struct xfs_inode *dp, + xfs_ino_t owner, xfs_dablk_t bno, unsigned int flags, struct xfs_buf **bpp)
@@ -429,7 +432,7 @@ xfs_dir3_data_read(return err;/* Check things that we can't do in the verifier. */ - fa =xfs_dir3_data_header_check (dp, *bpp); + fa =xfs_dir3_data_header_check (*bpp, owner);if (fa) {__xfs_buf_mark_corrupt (*bpp, fa);xfs_trans_brelse (tp, *bpp);
fs/xfs/libxfs/xfs_dir2_leaf.c +11 -10
@@ -884,9 +884,9 @@ xfs_dir2_leaf_addname(* Already had space in some data block. * Just read that one in. */ - error =xfs_dir3_data_read (tp, dp, -xfs_dir2_db_to_da (args->geo, use_block), -0 , &dbp); + error =xfs_dir3_data_read (tp, dp, args->owner, +xfs_dir2_db_to_da (args->geo, use_block),0 , + &dbp);if (error) {xfs_trans_brelse (tp, lbp);return error;
@@ -1327,9 +1327,9 @@ xfs_dir2_leaf_lookup_int(if (newdb != curdb) {if (dbp)xfs_trans_brelse (tp, dbp); - error =xfs_dir3_data_read (tp, dp, -xfs_dir2_db_to_da (args->geo, newdb), -0 , &dbp); + error =xfs_dir3_data_read (tp, dp, args->owner, +xfs_dir2_db_to_da (args->geo, newdb),0 , + &dbp);if (error) {xfs_trans_brelse (tp, lbp);return error;
@@ -1369,9 +1369,9 @@ xfs_dir2_leaf_lookup_int(ASSERT (cidb !=-1 );if (cidb != curdb) {xfs_trans_brelse (tp, dbp); - error =xfs_dir3_data_read (tp, dp, -xfs_dir2_db_to_da (args->geo, cidb), -0 , &dbp); + error =xfs_dir3_data_read (tp, dp, args->owner, +xfs_dir2_db_to_da (args->geo, cidb),0 , + &dbp);if (error) {xfs_trans_brelse (tp, lbp);return error;
@@ -1665,7 +1665,8 @@ xfs_dir2_leaf_trim_data(/* * Read the offending data block. We need its buffer. */ - error =xfs_dir3_data_read (tp, dp,xfs_dir2_db_to_da (geo, db),0 , &dbp); + error =xfs_dir3_data_read (tp, dp, args->owner, +xfs_dir2_db_to_da (geo, db),0 , &dbp);if (error)return error;
fs/xfs/libxfs/xfs_dir2_node.c +3 -4
@@ -863,7 +863,7 @@ xfs_dir2_leafn_lookup_for_entry(ASSERT (state->extravalid); curbp = state->extrablk.bp; }else { - error =xfs_dir3_data_read (tp, dp, + error =xfs_dir3_data_read (tp, dp, args->owner,xfs_dir2_db_to_da (args->geo, newdb),0 , &curbp);
@@ -1949,9 +1949,8 @@ xfs_dir2_node_addname_int( &freehdr, &findex); }else {/* Read the data block in. */ - error =xfs_dir3_data_read (tp, dp, -xfs_dir2_db_to_da (args->geo, dbno), -0 , &dbp); + error =xfs_dir3_data_read (tp, dp, args->owner, +xfs_dir2_db_to_da (args->geo, dbno),0 , &dbp); }if (error)return error;
fs/xfs/libxfs/xfs_dir2_priv.h +2 -1
@@ -78,7 +78,8 @@ extern void xfs_dir3_data_check(struct xfs_inode *dp, struct xfs_buf *bp);extern xfs_failaddr_t __xfs_dir3_data_check (struct xfs_inode *dp,struct xfs_buf *bp);int xfs_dir3_data_read (struct xfs_trans *tp,struct xfs_inode *dp, -xfs_dablk_t bno,unsigned int flags,struct xfs_buf **bpp); +xfs_ino_t owner,xfs_dablk_t bno,unsigned int flags, +struct xfs_buf **bpp);int xfs_dir3_data_readahead (struct xfs_inode *dp,xfs_dablk_t bno,unsigned int flags);
fs/xfs/scrub/dir.c +7 -7
@@ -196,8 +196,8 @@ xchk_dir_rec(xchk_da_set_corrupt (ds, level); goto out; } - error =xfs_dir3_data_read (ds->dargs.trans, dp, rec_bno, -XFS_DABUF_MAP_HOLE_OK , &bp); + error =xfs_dir3_data_read (ds->dargs.trans, dp, ds->dargs.owner, + rec_bno,XFS_DABUF_MAP_HOLE_OK , &bp);if (!xchk_fblock_process_error (ds->sc,XFS_DATA_FORK , rec_bno, &error)) goto out;
@@ -318,7 +318,8 @@ xchk_directory_data_bestfree( error =xfs_dir3_block_read (sc->tp, sc->ip, &bp); }else {/* dir data format */ - error =xfs_dir3_data_read (sc->tp, sc->ip, lblk,0 , &bp); + error =xfs_dir3_data_read (sc->tp, sc->ip, sc->ip->i_ino, lblk, +0 , &bp); }if (!xchk_fblock_process_error (sc,XFS_DATA_FORK , lblk, &error)) goto out;
@@ -531,10 +532,9 @@ xchk_directory_leaf1_bestfree(/* Check all the bestfree entries. */ for (i =0 ; i < bestcount; i++, bestp++) { best =be16_to_cpu (*bestp); - error =xfs_dir3_data_read (sc->tp, sc->ip, + error =xfs_dir3_data_read (sc->tp, sc->ip, args->owner,xfs_dir2_db_to_da (args->geo, i), -XFS_DABUF_MAP_HOLE_OK , - &dbp); +XFS_DABUF_MAP_HOLE_OK , &dbp);if (!xchk_fblock_process_error (sc,XFS_DATA_FORK , lblk, &error))break ;
@@ -597,7 +597,7 @@ xchk_directory_free_bestfree( stale++;continue ; } - error =xfs_dir3_data_read (sc->tp, sc->ip, + error =xfs_dir3_data_read (sc->tp, sc->ip, args->owner, (freehdr.firstdb + i) * args->geo->fsbcount,0 , &dbp); if (!xchk_fblock_process_error(sc, XFS_DATA_FORK, lblk,
fs/xfs/scrub/readdir.c +1 -1
@@ -175,7 +175,7 @@ xchk_read_leaf_dir_buf(if (new_off > *curoff) *curoff = new_off; -return xfs_dir3_data_read (tp, dp, map.br_startoff,0 , bpp); +return xfs_dir3_data_read (tp, dp, dp->i_ino, map.br_startoff,0 , bpp); }/* Call a function for every entry in a leaf directory. */
fs/xfs/xfs_dir2_readdir.c +2 -1
@@ -282,7 +282,8 @@ xfs_dir2_leaf_readbuf( new_off =xfs_dir2_da_to_byte (geo, map.br_startoff);if (new_off > *cur_off) *cur_off = new_off; - error =xfs_dir3_data_read (args->trans, dp, map.br_startoff,0 , &bp); + error =xfs_dir3_data_read (args->trans, dp, args->owner, + map.br_startoff,0 , &bp);if (error) goto out;
PATCH 9/10 xfs: validate explicit directory block buffer owners
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
Port the existing directory block header checking function to accept an owner number instead of an xfs_inode, then update the callsites to use xfs_da_args.owner when possible.
--- fs/xfs/libxfs/xfs_dir2.h | 1 + fs/xfs/libxfs/xfs_dir2_block.c | 22 ++++++++++++++-------- fs/xfs/libxfs/xfs_dir2_priv.h | 4 ++-- fs/xfs/libxfs/xfs_exchmaps.c | 2 +- fs/xfs/scrub/dir.c | 2 +- fs/xfs/scrub/readdir.c | 2 +- fs/xfs/xfs_dir2_readdir.c | 2 +- 7 files changed, 21 insertions(+), 14 deletions(-)
fs/xfs/libxfs/xfs_dir2.h +1 -0
@@ -103,6 +103,7 @@ extern int xfs_dir_ino_validate(struct xfs_mount *mp, xfs_ino_t ino);xfs_failaddr_t xfs_dir3_leaf_header_check (struct xfs_buf *bp,xfs_ino_t owner);xfs_failaddr_t xfs_dir3_data_header_check (struct xfs_buf *bp,xfs_ino_t owner); +xfs_failaddr_t xfs_dir3_block_header_check (struct xfs_buf *bp,xfs_ino_t owner);extern const struct xfs_buf_ops xfs_dir3_block_buf_ops;extern const struct xfs_buf_ops xfs_dir3_leafn_buf_ops;
fs/xfs/libxfs/xfs_dir2_block.c +14 -8
@@ -115,18 +115,23 @@ const struct xfs_buf_ops xfs_dir3_block_buf_ops = { .verify_struct = xfs_dir3_block_verify, }; -static xfs_failaddr_t +xfs_failaddr_t xfs_dir3_block_header_check ( -struct xfs_inode *dp, -struct xfs_buf *bp) +struct xfs_buf *bp, +xfs_ino_t owner) { -struct xfs_mount *mp = dp->i_mount; +struct xfs_mount *mp = bp->b_mount;if (xfs_has_crc (mp)) {struct xfs_dir3_blk_hdr *hdr3 = bp->b_addr; -if (be64_to_cpu (hdr3->owner) != dp->i_ino) +ASSERT (hdr3->magic ==cpu_to_be32 (XFS_DIR3_BLOCK_MAGIC )); + +if (be64_to_cpu (hdr3->owner) != owner) { +xfs_err (NULL ,"dir block owner 0x%llx doesnt match block 0x%llx" , owner,be64_to_cpu (hdr3->owner)); +dump_stack ();return __this_address; + } }return NULL ;
@@ -136,6 +141,7 @@ intxfs_dir3_block_read ( struct xfs_trans *tp, struct xfs_inode *dp, + xfs_ino_t owner, struct xfs_buf **bpp) { struct xfs_mount *mp = dp->i_mount;
@@ -148,7 +154,7 @@ xfs_dir3_block_read(return err;/* Check things that we can't do in the verifier. */ - fa =xfs_dir3_block_header_check (dp, *bpp); + fa =xfs_dir3_block_header_check (*bpp, owner);if (fa) {__xfs_buf_mark_corrupt (*bpp, fa);xfs_trans_brelse (tp, *bpp);
@@ -383,7 +389,7 @@ xfs_dir2_block_addname( tp = args->trans;/* Read the (one and only) directory block into bp. */ - error =xfs_dir3_block_read (tp, dp, &bp); + error =xfs_dir3_block_read (tp, dp, args->owner, &bp);if (error)return error;
@@ -698,7 +704,7 @@ xfs_dir2_block_lookup_int( dp = args->dp; tp = args->trans; - error =xfs_dir3_block_read (tp, dp, &bp); + error =xfs_dir3_block_read (tp, dp, args->owner, &bp);if (error)return error;
fs/xfs/libxfs/xfs_dir2_priv.h +2 -2
@@ -50,8 +50,8 @@ extern int xfs_dir_cilookup_result(struct xfs_da_args *args,/* xfs_dir2_block.c */ -extern int xfs_dir3_block_read (struct xfs_trans *tp,struct xfs_inode *dp, -struct xfs_buf **bpp); +int xfs_dir3_block_read (struct xfs_trans *tp,struct xfs_inode *dp, +xfs_ino_t owner,struct xfs_buf **bpp);extern int xfs_dir2_block_addname (struct xfs_da_args *args);extern int xfs_dir2_block_lookup (struct xfs_da_args *args);extern int xfs_dir2_block_removename (struct xfs_da_args *args);
fs/xfs/libxfs/xfs_exchmaps.c +1 -1
@@ -476,7 +476,7 @@ xfs_exchmaps_dir_to_sf(if (!isblock)return 0 ; - error =xfs_dir3_block_read (tp, xmi->xmi_ip2, &bp); + error =xfs_dir3_block_read (tp, xmi->xmi_ip2, xmi->xmi_ip2->i_ino, &bp);if (error)return error;
fs/xfs/scrub/dir.c +1 -1
@@ -315,7 +315,7 @@ xchk_directory_data_bestfree(/* dir block format */ if (lblk !=XFS_B_TO_FSBT (mp,XFS_DIR2_DATA_OFFSET ))xchk_fblock_set_corrupt (sc,XFS_DATA_FORK , lblk); - error =xfs_dir3_block_read (sc->tp, sc->ip, &bp); + error =xfs_dir3_block_read (sc->tp, sc->ip, sc->ip->i_ino, &bp); }else {/* dir data format */ error = xfs_dir3_data_read(sc->tp, sc->ip, sc->ip->i_ino, lblk,
fs/xfs/scrub/readdir.c +1 -1
@@ -99,7 +99,7 @@ xchk_dir_walk_block(unsigned int off, next_off, end;int error; - error =xfs_dir3_block_read (sc->tp, dp, &bp); + error =xfs_dir3_block_read (sc->tp, dp, dp->i_ino, &bp);if (error)return error;
fs/xfs/xfs_dir2_readdir.c +1 -1
@@ -157,7 +157,7 @@ xfs_dir2_block_getdents(if (xfs_dir2_dataptr_to_db (geo, ctx->pos) > geo->datablk)return 0 ; - error =xfs_dir3_block_read (args->trans, dp, &bp); + error =xfs_dir3_block_read (args->trans, dp, args->owner, &bp);if (error)return error;
PATCH 10/10 xfs: validate explicit directory free block owners
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
Port the existing directory freespace block header checking function to accept an owner number instead of an xfs_inode, then update the callsites to use xfs_da_args.owner when possible.
--- fs/xfs/libxfs/xfs_dir2_leaf.c | 3 ++- fs/xfs/libxfs/xfs_dir2_node.c | 32 ++++++++++++++++++-------------- fs/xfs/libxfs/xfs_dir2_priv.h | 4 ++-- fs/xfs/scrub/dir.c | 2 +- 4 files changed, 23 insertions(+), 18 deletions(-)
fs/xfs/libxfs/xfs_dir2_leaf.c +2 -1
@@ -1805,7 +1805,8 @@ xfs_dir2_node_to_leaf(/* * Read the freespace block. */ - error =xfs_dir2_free_read (tp, dp, args->geo->freeblk, &fbp); + error =xfs_dir2_free_read (tp, dp, args->owner, args->geo->freeblk, + &fbp);if (error)return error;xfs_dir2_free_hdr_from_disk (mp, &freehdr, fbp->b_addr);
fs/xfs/libxfs/xfs_dir2_node.c +18 -14
@@ -175,11 +175,11 @@ const struct xfs_buf_ops xfs_dir3_free_buf_ops = {/* Everything ok in the free block header? */ static xfs_failaddr_t xfs_dir3_free_header_check ( -struct xfs_inode *dp, -xfs_dablk_t fbno, -struct xfs_buf *bp) +struct xfs_buf *bp, +xfs_ino_t owner, +xfs_dablk_t fbno) { -struct xfs_mount *mp = dp->i_mount; +struct xfs_mount *mp = bp->b_mount;int maxbests = mp->m_dir_geo->free_max_bests;unsigned int firstdb;
@@ -195,7 +195,7 @@ xfs_dir3_free_header_check(return __this_address;if (be32_to_cpu (hdr3->nvalid) <be32_to_cpu (hdr3->nused))return __this_address; -if (be64_to_cpu (hdr3->hdr.owner) != dp->i_ino) +if (be64_to_cpu (hdr3->hdr.owner) != owner)return __this_address; }else {struct xfs_dir2_free_hdr *hdr = bp->b_addr;
@@ -214,6 +214,7 @@ static int__xfs_dir3_free_read ( struct xfs_trans *tp, struct xfs_inode *dp, + xfs_ino_t owner, xfs_dablk_t fbno, unsigned int flags, struct xfs_buf **bpp)
@@ -227,7 +228,7 @@ __xfs_dir3_free_read(return err;/* Check things that we can't do in the verifier. */ - fa =xfs_dir3_free_header_check (dp, fbno, *bpp); + fa =xfs_dir3_free_header_check (*bpp, owner, fbno);if (fa) {__xfs_buf_mark_corrupt (*bpp, fa);xfs_trans_brelse (tp, *bpp);
@@ -299,20 +300,23 @@ intxfs_dir2_free_read ( struct xfs_trans *tp, struct xfs_inode *dp, + xfs_ino_t owner, xfs_dablk_t fbno, struct xfs_buf **bpp) { - return __xfs_dir3_free_read(tp, dp, fbno, 0, bpp); + return __xfs_dir3_free_read(tp, dp, owner, fbno, 0, bpp); }static int xfs_dir2_free_try_read (struct xfs_trans *tp,struct xfs_inode *dp, +xfs_ino_t owner,xfs_dablk_t fbno,struct xfs_buf **bpp) { -return __xfs_dir3_free_read (tp, dp, fbno,XFS_DABUF_MAP_HOLE_OK , bpp); +return __xfs_dir3_free_read (tp, dp, owner, fbno,XFS_DABUF_MAP_HOLE_OK , + bpp); } static int
@@ -717,7 +721,7 @@ xfs_dir2_leafn_lookup_for_addname(if (curbp)xfs_trans_brelse (tp, curbp); - error =xfs_dir2_free_read (tp, dp, + error =xfs_dir2_free_read (tp, dp, args->owner,xfs_dir2_db_to_da (args->geo, newfdb), &curbp);
@@ -1356,8 +1360,8 @@ xfs_dir2_leafn_remove(* read in the free block. */ fdb =xfs_dir2_db_to_fdb (geo, db); - error =xfs_dir2_free_read (tp, dp,xfs_dir2_db_to_da (geo, fdb), - &fbp); + error =xfs_dir2_free_read (tp, dp, args->owner, +xfs_dir2_db_to_da (geo, fdb), &fbp);if (error)return error; free = fbp->b_addr;
@@ -1716,7 +1720,7 @@ xfs_dir2_node_add_datablk(* that was just allocated. */ fbno =xfs_dir2_db_to_fdb (args->geo, *dbno); - error =xfs_dir2_free_try_read (tp, dp, + error =xfs_dir2_free_try_read (tp, dp, args->owner,xfs_dir2_db_to_da (args->geo, fbno), &fbp);if (error)return error;
@@ -1863,7 +1867,7 @@ xfs_dir2_node_find_freeblk(* so this might not succeed. This should be really rare, so * there's no reason to avoid it. */ - error =xfs_dir2_free_try_read (tp, dp, + error =xfs_dir2_free_try_read (tp, dp, args->owner,xfs_dir2_db_to_da (args->geo, fbno), &fbp);if (error)
@@ -2302,7 +2306,7 @@ xfs_dir2_node_trim_free(/* * Read the freespace block. */ - error =xfs_dir2_free_try_read (tp, dp, fo, &bp); + error =xfs_dir2_free_try_read (tp, dp, args->owner, fo, &bp);if (error)return error;/*
fs/xfs/libxfs/xfs_dir2_priv.h +2 -2
@@ -155,8 +155,8 @@ extern int xfs_dir2_node_removename(struct xfs_da_args *args);extern int xfs_dir2_node_replace (struct xfs_da_args *args);extern int xfs_dir2_node_trim_free (struct xfs_da_args *args,xfs_fileoff_t fo,int *rvalp); -extern int xfs_dir2_free_read (struct xfs_trans *tp,struct xfs_inode *dp, -xfs_dablk_t fbno,struct xfs_buf **bpp); +int xfs_dir2_free_read (struct xfs_trans *tp,struct xfs_inode *dp, +xfs_ino_t owner,xfs_dablk_t fbno,struct xfs_buf **bpp);/* xfs_dir2_sf.c */ xfs_ino_t xfs_dir2_sf_get_ino(struct xfs_mount *mp, struct xfs_dir2_sf_hdr *hdr,
fs/xfs/scrub/dir.c +1 -1
@@ -577,7 +577,7 @@ xchk_directory_free_bestfree(int error;/* Read the free space block */ - error =xfs_dir2_free_read (sc->tp, sc->ip, lblk, &bp); + error =xfs_dir2_free_read (sc->tp, sc->ip, sc->ip->i_ino, lblk, &bp);if (!xchk_fblock_process_error (sc,XFS_DATA_FORK , lblk, &error))return error;xchk_buffer_recheck (sc, bp);
PATCH 8/15 xfs: online repair of extended attributes
In reply to Darrick J. WongHi all,
This series employs atomic extent swapping to enable safe reconstruction of extended attribute data attached to a file. Because xattrs do not have any redundant information to draw off of, we can at best salvage as much data as we can and build a new structure.
Rebuilding an extended attribute structure consists of these three steps:
First, we walk the existing attributes to salvage as many of them as we can, by adding them as new attributes attached to the repair tempfile. We need to add a new xfile-based data structure to hold blobs of arbitrary length to stage the xattr names and values.
Second, we write the salvaged attributes to a temporary file, and use atomic extent swaps to exchange the entire attribute fork between the two files.
Finally, we reap the old xattr blocks (which are now in the temporary file) as carefully as we can.
If you're going to start using this code, I strongly recommend pulling from my git trees, which are linked below.
This has been running on the djcloud for months with no problems. Enjoy! Comments and questions are, as always, welcome.
--D
kernel git tree:
https://git.kernel.org/cgit/linux/kernel/git/djwong/xfs-linux.git/log/?h=repair-xattrs
xfsprogs git tree:
https://git.kernel.org/cgit/linux/kernel/git/djwong/xfsprogs-dev.git/log/?h=repair-xattrs
fstests git tree:
https://git.kernel.org/cgit/linux/kernel/git/djwong/xfstests-dev.git/log/?h=repair-xattrs
---
Commits in this patchset:
* xfs: enable discarding of folios backing an xfile
* xfs: create a blob array data structure
* xfs: use atomic extent swapping to fix user file fork data
* xfs: repair extended attributes
* xfs: scrub should set preen if attr leaf has holes
* xfs: flag empty xattr leaf blocks for optimization
* xfs: create an xattr iteration function for scrub
--- fs/xfs/Makefile | 3 fs/xfs/libxfs/xfs_attr.c | 2 fs/xfs/libxfs/xfs_attr.h | 2 fs/xfs/libxfs/xfs_da_format.h | 5 fs/xfs/libxfs/xfs_exchmaps.c | 2 fs/xfs/libxfs/xfs_exchmaps.h | 1 fs/xfs/scrub/attr.c | 158 +++-- fs/xfs/scrub/attr.h | 7 fs/xfs/scrub/attr_repair.c | 1206 +++++++++++++++++++++++++++++++++++++++++ fs/xfs/scrub/attr_repair.h | 11 fs/xfs/scrub/dab_bitmap.h | 37 + fs/xfs/scrub/dabtree.c | 16 + fs/xfs/scrub/dabtree.h | 3 fs/xfs/scrub/listxattr.c | 312 +++++++++++ fs/xfs/scrub/listxattr.h | 17 + fs/xfs/scrub/repair.c | 46 ++ fs/xfs/scrub/repair.h | 6 fs/xfs/scrub/scrub.c | 2 fs/xfs/scrub/tempexch.h | 2 fs/xfs/scrub/tempfile.c | 204 +++++++ fs/xfs/scrub/tempfile.h | 3 fs/xfs/scrub/trace.h | 85 +++ fs/xfs/scrub/xfarray.c | 17 + fs/xfs/scrub/xfarray.h | 2 fs/xfs/scrub/xfblob.c | 168 ++++++ fs/xfs/scrub/xfblob.h | 26 + fs/xfs/scrub/xfile.c | 12 fs/xfs/scrub/xfile.h | 6 fs/xfs/xfs_buf.c | 3 fs/xfs/xfs_trace.h | 2 30 files changed, 2283 insertions(+), 83 deletions(-) create mode 100644 fs/xfs/scrub/attr_repair.c create mode 100644 fs/xfs/scrub/attr_repair.h create mode 100644 fs/xfs/scrub/dab_bitmap.h create mode 100644 fs/xfs/scrub/listxattr.c create mode 100644 fs/xfs/scrub/listxattr.h create mode 100644 fs/xfs/scrub/xfblob.c create mode 100644 fs/xfs/scrub/xfblob.h
PATCH 1/7 xfs: enable discarding of folios backing an xfile
From: Darrick J. Wong <[email protected]>
Create a new xfile function to discard the page cache that's backing part of an xfile. The next patch wil use this to drop parts of an xfile that aren't needed anymore.
--- fs/xfs/scrub/trace.h | 1 + fs/xfs/scrub/xfile.c | 12 ++++++++++++ fs/xfs/scrub/xfile.h | 1 + 3 files changed, 14 insertions(+)
fs/xfs/scrub/trace.h +1 -0
@@ -948,6 +948,7 @@ DEFINE_XFILE_EVENT(xfile_store);DEFINE_XFILE_EVENT (xfile_seek_data);DEFINE_XFILE_EVENT (xfile_get_folio);DEFINE_XFILE_EVENT (xfile_put_folio); +DEFINE_XFILE_EVENT (xfile_discard); TRACE_EVENT(xfarray_create, TP_PROTO(struct xfarray *xfa, unsigned long long required_capacity),
fs/xfs/scrub/xfile.c +12 -0
@@ -310,3 +310,15 @@ xfile_put_folio(folio_unlock (folio);folio_put (folio); } + +/* Discard the page cache that's backing a range of the xfile. */ +void +xfile_discard ( +struct xfile *xf, +loff_t pos, +u64 count) +{ +trace_xfile_discard (xf, pos, count); + +shmem_truncate_range (file_inode (xf->file), pos, pos + count -1 ); +}
fs/xfs/scrub/xfile.h +1 -0
@@ -17,6 +17,7 @@ int xfile_load(struct xfile *xf, void *buf, size_t count, loff_t pos);int xfile_store (struct xfile *xf,const void *buf,size_t count,loff_t pos); +void xfile_discard (struct xfile *xf,loff_t pos,u64 count);loff_t xfile_seek_data (struct xfile *xf,loff_t pos);#define XFILE_MAX_FOLIO_SIZE (PAGE_SIZE << MAX_PAGECACHE_ORDER)
PATCH 2/7 xfs: create a blob array data structure
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
Create a simple 'blob array' data structure for storage of arbitrarily sized metadata objects that will be used to reconstruct metadata. For the intended usage (temporarily storing extended attribute names and values) we only have to support storing objects and retrieving them. Use the xfile abstraction to store the attribute information in memory that can be swapped out.
--- fs/xfs/Makefile | 1 fs/xfs/scrub/xfblob.c | 151 +++++++++++++++++++++++++++++++++++++++++++++++++ fs/xfs/scrub/xfblob.h | 24 ++++++++ 3 files changed, 176 insertions(+) create mode 100644 fs/xfs/scrub/xfblob.c create mode 100644 fs/xfs/scrub/xfblob.h
fs/xfs/Makefile +1 -0
@@ -208,6 +208,7 @@ xfs-y += $(addprefix scrub/, \ repair.o \ rmap_repair.o \ tempfile.o \ + xfblob.o \ ) xfs-$(CONFIG_XFS_RT) += $(addprefix scrub/, \
fs/xfs/scrub/xfblob.c new file +151 -0
151 lines not on this page · raw message
fs/xfs/scrub/xfblob.h new file +24 -0
@@ -0,0 +1,24 @@ +/* SPDX-License-Identifier: GPL-2.0-or-later */ +/* +* Copyright (c) 2021-2024 Oracle. All Rights Reserved. +* Author: Darrick J. Wong <[email protected]> +*/ +#ifndef __XFS_SCRUB_XFBLOB_H__ +#define __XFS_SCRUB_XFBLOB_H__ + +struct xfblob { +struct xfile *xfile; +loff_t last_offset; +}; + +typedef loff_t xfblob_cookie ; + +int xfblob_create (const char *descr,struct xfblob **blobp); +void xfblob_destroy (struct xfblob *blob); +int xfblob_load (struct xfblob *blob,xfblob_cookie cookie,void *ptr, +uint32_t size); +int xfblob_store (struct xfblob *blob,xfblob_cookie *cookie,const void *ptr, +uint32_t size); +int xfblob_free (struct xfblob *blob,xfblob_cookie cookie); + +#endif /* __XFS_SCRUB_XFBLOB_H__ */
PATCH 3/7 xfs: use atomic extent swapping to fix user file fork data
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
Build on the code that was recently added to the temporary repair file code so that we can atomically switch the contents of any file fork, even if the fork is in local format. The upcoming functions to repair xattrs, directories, and symlinks will need that capability.
Repair can lock out access to these user files by holding IOLOCK_EXCL on these user files. Therefore, it is safe to drop the ILOCK of both the file being repaired and the tempfile being used for staging, and cancel the scrub transaction. We do this so that we can reuse the resource estimation and transaction allocation functions used by a regular file exchange operation.
--- fs/xfs/libxfs/xfs_exchmaps.c | 2 fs/xfs/libxfs/xfs_exchmaps.h | 1 fs/xfs/scrub/tempexch.h | 2 fs/xfs/scrub/tempfile.c | 204 ++++++++++++++++++++++++++++++++++++++++++ fs/xfs/scrub/tempfile.h | 3 + 5 files changed, 211 insertions(+), 1 deletion(-)
fs/xfs/libxfs/xfs_exchmaps.c +1 -1
@@ -675,7 +675,7 @@ xfs_exchmaps_rmapbt_blocks( }/* Estimate the bmbt and rmapbt overhead required to exchange mappings. */ -static int +int xfs_exchmaps_estimate_overhead (struct xfs_exchmaps_req *req) {
fs/xfs/libxfs/xfs_exchmaps.h +1 -0
@@ -97,6 +97,7 @@ xfs_exchmaps_reqfork(const struct xfs_exchmaps_req *req)return XFS_DATA_FORK ; } +int xfs_exchmaps_estimate_overhead (struct xfs_exchmaps_req *req);int xfs_exchmaps_estimate (struct xfs_exchmaps_req *req);extern struct kmem_cache *xfs_exchmaps_intent_cache;
fs/xfs/scrub/tempexch.h +2 -0
@@ -14,6 +14,8 @@ struct xrep_tempexch {int xrep_tempexch_enable (struct xfs_scrub *sc);int xrep_tempexch_trans_reserve (struct xfs_scrub *sc,int whichfork,struct xrep_tempexch *ti); +int xrep_tempexch_trans_alloc (struct xfs_scrub *sc,int whichfork, +struct xrep_tempexch *ti);int xrep_tempexch_contents (struct xfs_scrub *sc,struct xrep_tempexch *ti);#endif /* CONFIG_XFS_ONLINE_REPAIR */
fs/xfs/scrub/tempfile.c +204 -0
225 lines not on this page · raw message
fs/xfs/scrub/tempfile.h +3 -0
@@ -17,6 +17,8 @@ void xrep_tempfile_iounlock(struct xfs_scrub *sc);void xrep_tempfile_ilock (struct xfs_scrub *sc);bool xrep_tempfile_ilock_nowait (struct xfs_scrub *sc);void xrep_tempfile_iunlock (struct xfs_scrub *sc); +void xrep_tempfile_iunlock_both (struct xfs_scrub *sc); +void xrep_tempfile_ilock_both (struct xfs_scrub *sc);int xrep_tempfile_prealloc (struct xfs_scrub *sc,xfs_fileoff_t off,xfs_filblks_t len);
@@ -32,6 +34,7 @@ int xrep_tempfile_copyin(struct xfs_scrub *sc, xfs_fileoff_t off,int xrep_tempfile_set_isize (struct xfs_scrub *sc,unsigned long long isize);int xrep_tempfile_roll_trans (struct xfs_scrub *sc); +void xrep_tempfile_copyout_local (struct xfs_scrub *sc,int whichfork);#else static inline void xrep_tempfile_iolock_both (struct xfs_scrub *sc) {
PATCH 4/7 xfs: repair extended attributes
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
If the extended attributes look bad, try to sift through the rubble to find whatever keys/values we can, stage a new attribute structure in a temporary file and use the atomic extent swapping mechanism to commit the results in bulk.
--- fs/xfs/Makefile | 1 fs/xfs/libxfs/xfs_attr.c | 2 fs/xfs/libxfs/xfs_attr.h | 2 fs/xfs/libxfs/xfs_da_format.h | 5 fs/xfs/scrub/attr.c | 20 + fs/xfs/scrub/attr.h | 7 fs/xfs/scrub/attr_repair.c | 1206 +++++++++++++++++++++++++++++++++++++++++ fs/xfs/scrub/attr_repair.h | 11 fs/xfs/scrub/repair.c | 46 ++ fs/xfs/scrub/repair.h | 6 fs/xfs/scrub/scrub.c | 2 fs/xfs/scrub/trace.h | 83 +++ fs/xfs/scrub/xfarray.c | 17 + fs/xfs/scrub/xfarray.h | 2 fs/xfs/scrub/xfblob.c | 17 + fs/xfs/scrub/xfblob.h | 2 fs/xfs/scrub/xfile.h | 5 fs/xfs/xfs_buf.c | 3 fs/xfs/xfs_trace.h | 2 19 files changed, 1435 insertions(+), 4 deletions(-) create mode 100644 fs/xfs/scrub/attr_repair.c create mode 100644 fs/xfs/scrub/attr_repair.h
fs/xfs/Makefile +1 -0
@@ -194,6 +194,7 @@ ifeq ($(CONFIG_XFS_ONLINE_REPAIR),y) xfs-y += $(addprefix scrub/, \ agheader_repair.o \ alloc_repair.o \ + attr_repair.o \ bmap_repair.o \ cow_repair.o \ fscounters_repair.o \
fs/xfs/libxfs/xfs_attr.c +1 -1
@@ -1055,7 +1055,7 @@ xfs_attr_set(* External routines when attribute list is inside the inode *========================================================================*/ -static inline int xfs_attr_sf_totsize (struct xfs_inode *dp) +int xfs_attr_sf_totsize (struct xfs_inode *dp) {struct xfs_attr_sf_hdr *sf = dp->i_af.if_data;
fs/xfs/libxfs/xfs_attr.h +2 -0
@@ -618,4 +618,6 @@ extern struct kmem_cache *xfs_attr_intent_cache;int __init xfs_attr_intent_init_cache (void );void xfs_attr_intent_destroy_cache (void ); +int xfs_attr_sf_totsize (struct xfs_inode *dp); +#endif /* __XFS_ATTR_H__ */
fs/xfs/libxfs/xfs_da_format.h +5 -0
@@ -721,6 +721,11 @@ struct xfs_attr3_leafblock {#define XFS_ATTR_INCOMPLETE (1u << XFS_ATTR_INCOMPLETE_BIT)#define XFS_ATTR_NSP_ONDISK_MASK (XFS_ATTR_ROOT | XFS_ATTR_SECURE) +#define XFS_ATTR_NAMESPACE_STR \ + { XFS_ATTR_LOCAL, "local" }, \ + { XFS_ATTR_ROOT, "root" }, \ + { XFS_ATTR_SECURE, "secure" } +/* * Alignment for namelist and valuelist entries (since they are mixed * there can be only one alignment value)
fs/xfs/scrub/attr.c +18 -2
@@ -10,6 +10,7 @@#include "xfs_trans_resv.h" #include "xfs_mount.h" #include "xfs_log_format.h" +#include "xfs_trans.h" #include "xfs_inode.h" #include "xfs_da_format.h" #include "xfs_da_btree.h"
@@ -20,6 +21,7 @@#include "scrub/common.h" #include "scrub/dabtree.h" #include "scrub/attr.h" +#include "scrub/repair.h" /* Free the buffers linked from the xattr buffer. */ static void
@@ -35,6 +37,8 @@ xchk_xattr_buf_cleanup(kvfree (ab->value); ab->value =NULL ; ab->value_sz =0 ; +kvfree (ab->name); + ab->name =NULL ; }/*
@@ -65,7 +69,7 @@ xchk_xattr_want_freemap(* reallocating the buffer if necessary. Buffer contents are not preserved * across a reallocation. */ -static int +int xchk_setup_xattr_buf (struct xfs_scrub *sc,size_t value_size)
@@ -95,6 +99,12 @@ xchk_setup_xattr_buf(return -ENOMEM ; } +if (xchk_could_repair (sc)) { + ab->name =kvmalloc (XATTR_NAME_MAX +1 ,XCHK_GFP_FLAGS ); +if (!ab->name) +return -ENOMEM ; + } + resize_value:if (ab->value_sz >= value_size)return 0 ;
@@ -121,6 +131,12 @@ xchk_setup_xattr( {int error; +if (xchk_could_repair (sc)) { + error =xrep_setup_xattr (sc); +if (error) +return error; + } +/* * We failed to get memory while checking attrs, so this time try to * get all the memory we're ever going to need. Allocate the buffer
@@ -247,7 +263,7 @@ xchk_xattr_listent(* Within a char, the lowest bit of the char represents the byte with * the smallest address */ -STATIC bool +bool xchk_xattr_set_map( struct xfs_scrub *sc, unsigned long *map,
fs/xfs/scrub/attr.h +7 -0
@@ -16,9 +16,16 @@ struct xchk_xattr_buf {/* Bitmap of free space in xattr leaf blocks. */ unsigned long *freemap; +/* Memory buffer used to hold salvaged xattr names. */ +unsigned char *name; +/* Memory buffer used to extract xattr values. */ void *value; size_t value_sz; }; +bool xchk_xattr_set_map (struct xfs_scrub *sc,unsigned long *map, +unsigned int start,unsigned int len); +int xchk_setup_xattr_buf (struct xfs_scrub *sc,size_t value_size); +#endif /* __XFS_SCRUB_ATTR_H__ */
fs/xfs/scrub/attr_repair.c new file +1206 -0
1,206 lines not on this page · raw message
fs/xfs/scrub/attr_repair.h new file +11 -0
@@ -0,0 +1,11 @@ +// SPDX-License-Identifier: GPL-2.0-or-later +/* +* Copyright (c) 2018-2024 Oracle. All Rights Reserved. +* Author: Darrick J. Wong <[email protected]> +*/ +#ifndef __XFS_SCRUB_ATTR_REPAIR_H__ +#define __XFS_SCRUB_ATTR_REPAIR_H__ + +int xrep_xattr_reset_fork (struct xfs_scrub *sc); + +#endif /* __XFS_SCRUB_ATTR_REPAIR_H__ */
fs/xfs/scrub/repair.c +46 -0
67 lines not on this page · raw message
fs/xfs/scrub/repair.h +6 -0
@@ -90,6 +90,7 @@ int xrep_bmap(struct xfs_scrub *sc, int whichfork, bool allow_unwritten);int xrep_metadata_inode_forks (struct xfs_scrub *sc);int xrep_setup_ag_rmapbt (struct xfs_scrub *sc);int xrep_setup_ag_refcountbt (struct xfs_scrub *sc); +int xrep_setup_xattr (struct xfs_scrub *sc);/* Repair setup functions */ int xrep_setup_ag_allocbt (struct xfs_scrub *sc);
@@ -123,6 +124,7 @@ int xrep_bmap_attr(struct xfs_scrub *sc);int xrep_bmap_cow (struct xfs_scrub *sc);int xrep_nlinks (struct xfs_scrub *sc);int xrep_fscounters (struct xfs_scrub *sc); +int xrep_xattr (struct xfs_scrub *sc);#ifdef CONFIG_XFS_RT int xrep_rtbitmap (struct xfs_scrub *sc);
@@ -147,6 +149,8 @@ int xrep_trans_alloc_hook_dummy(struct xfs_mount *mp, void **cookiep, struct xfs_trans **tpp);void xrep_trans_cancel_hook_dummy (void **cookiep,struct xfs_trans *tp); +bool xrep_buf_verify_struct (struct xfs_buf *bp,const struct xfs_buf_ops *ops); +#else #define xrep_ino_dqattach (sc) (0)
@@ -190,6 +194,7 @@ xrep_setup_nothing(#define xrep_setup_ag_allocbt xrep_setup_nothing#define xrep_setup_ag_rmapbt xrep_setup_nothing#define xrep_setup_ag_refcountbt xrep_setup_nothing +#define xrep_setup_xattr xrep_setup_nothing#define xrep_setup_inode (sc, imap) ((void)0)
@@ -215,6 +220,7 @@ xrep_setup_nothing(#define xrep_nlinks xrep_notsupported#define xrep_fscounters xrep_notsupported#define xrep_rtsummary xrep_notsupported +#define xrep_xattr xrep_notsupported#endif /* CONFIG_XFS_ONLINE_REPAIR */
fs/xfs/scrub/scrub.c +1 -1
@@ -331,7 +331,7 @@ static const struct xchk_meta_ops meta_scrub_ops[] = { .type = ST_INODE, .setup = xchk_setup_xattr, .scrub = xchk_xattr, - .repair = xrep_notsupported, + .repair = xrep_xattr, }, [XFS_SCRUB_TYPE_SYMLINK] = { /* symbolic link */ .type = ST_INODE,
fs/xfs/scrub/trace.h +83 -0
89 lines not on this page · raw message
fs/xfs/scrub/xfarray.c +17 -0
@@ -1051,3 +1051,20 @@ xfarray_sort(kvfree (si);return error; } + +/* How many bytes is this array consuming? */ +unsigned long long +xfarray_bytes ( +struct xfarray *array) +{ +return xfile_bytes (array->xfile); +} + +/* Empty the entire array. */ +void +xfarray_truncate ( +struct xfarray *array) +{ +xfile_discard (array->xfile,0 ,MAX_LFS_FILESIZE ); + array->nr =0 ; +}
fs/xfs/scrub/xfarray.h +2 -0
@@ -44,6 +44,8 @@ int xfarray_unset(struct xfarray *array, xfarray_idx_t idx);int xfarray_store (struct xfarray *array,xfarray_idx_t idx,const void *ptr);int xfarray_store_anywhere (struct xfarray *array,const void *ptr);bool xfarray_element_is_null (struct xfarray *array,const void *ptr); +void xfarray_truncate (struct xfarray *array); +unsigned long long xfarray_bytes (struct xfarray *array);/* * Load an array element, but zero the buffer if there's no data because we
fs/xfs/scrub/xfblob.c +17 -0
@@ -149,3 +149,20 @@ xfblob_free(xfile_discard (blob->xfile, cookie,sizeof (key) + key.xb_size);return 0 ; } + +/* How many bytes is this blob storage object consuming? */ +unsigned long long +xfblob_bytes ( +struct xfblob *blob) +{ +return xfile_bytes (blob->xfile); +} + +/* Drop all the blobs. */ +void +xfblob_truncate ( +struct xfblob *blob) +{ +xfile_discard (blob->xfile,PAGE_SIZE ,MAX_LFS_FILESIZE -PAGE_SIZE ); + blob->last_offset =PAGE_SIZE ; +}
fs/xfs/scrub/xfblob.h +2 -0
@@ -20,5 +20,7 @@ int xfblob_load(struct xfblob *blob, xfblob_cookie cookie, void *ptr,int xfblob_store (struct xfblob *blob,xfblob_cookie *cookie,const void *ptr,uint32_t size);int xfblob_free (struct xfblob *blob,xfblob_cookie cookie); +unsigned long long xfblob_bytes (struct xfblob *blob); +void xfblob_truncate (struct xfblob *blob);#endif /* __XFS_SCRUB_XFBLOB_H__ */
fs/xfs/scrub/xfile.h +5 -0
@@ -27,4 +27,9 @@ struct folio *xfile_get_folio(struct xfile *xf, loff_t offset, size_t len, unsigned int flags);void xfile_put_folio (struct xfile *xf,struct folio *folio); +static inline unsigned long long xfile_bytes (struct xfile *xf) +{ +return file_inode (xf->file)->i_blocks <<SECTOR_SHIFT ; +} +#endif /* __XFS_SCRUB_XFILE_H__ */
fs/xfs/xfs_buf.c +3 -0
@@ -494,6 +494,9 @@ _xfs_buf_obj_cmp(* it stale has not yet committed. i.e. we are * reallocating a busy extent. Skip this buffer and * continue searching for an exact match. +* +* Note: If we're scanning for incore buffers to stale, don't +* complain if we find non-stale buffers. */ if (!(map->bm_flags &XBM_LIVESCAN ))ASSERT (bp->b_flags &XBF_STALE );
fs/xfs/xfs_trace.h +2 -0
@@ -31,6 +31,8 @@* pos: file offset, in bytes * bytecount: number of bytes * +* dablk: directory or xattr block offset, in filesystem blocks +* * disize: ondisk file size, in bytes * isize: incore file size, in bytes *
PATCH 5/7 xfs: scrub should set preen if attr leaf has holes
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
If an attr block indicates that it could use compaction, set the preen flag to have the attr fork rebuilt, since the attr fork rebuilder can take care of that for us.
--- fs/xfs/scrub/attr.c | 2 ++ fs/xfs/scrub/dabtree.c | 16 ++++++++++++++++ fs/xfs/scrub/dabtree.h | 1 + fs/xfs/scrub/trace.h | 1 + 4 files changed, 20 insertions(+)
fs/xfs/scrub/attr.c +2 -0
@@ -428,6 +428,8 @@ xchk_xattr_block(xchk_da_set_corrupt (ds, level);if (!xchk_xattr_set_map (ds->sc, ab->usedmap,0 , hdrsize))xchk_da_set_corrupt (ds, level); +if (leafhdr.holes) +xchk_da_set_preen (ds, level);if (ds->sc->sm->sm_flags &XFS_SCRUB_OFLAG_CORRUPT ) goto out;
fs/xfs/scrub/dabtree.c +16 -0
@@ -78,6 +78,22 @@ xchk_da_set_corrupt( __return_address); } +/* Flag a da btree node in need of optimization. */ +void +xchk_da_set_preen ( +struct xchk_da_btree *ds, +int level) +{ +struct xfs_scrub *sc = ds->sc; + + sc->sm->sm_flags |=XFS_SCRUB_OFLAG_PREEN ; +trace_xchk_fblock_preen (sc, ds->dargs.whichfork, +xfs_dir2_da_to_db (ds->dargs.geo, + ds->state->path.blk[level].blkno), + __return_address); +} + +/* Find an entry at a certain level in a da btree. */ static struct xfs_da_node_entry * xchk_da_btree_node_entry( struct xchk_da_btree *ds,
fs/xfs/scrub/dabtree.h +1 -0
@@ -35,6 +35,7 @@ bool xchk_da_process_error(struct xchk_da_btree *ds, int level, int *error);/* Check for da btree corruption. */ void xchk_da_set_corrupt (struct xchk_da_btree *ds,int level); +void xchk_da_set_preen (struct xchk_da_btree *ds,int level);int xchk_da_btree_hash (struct xchk_da_btree *ds,int level,__be32 *hashp); int xchk_da_btree(struct xfs_scrub *sc, int whichfork,
fs/xfs/scrub/trace.h +1 -0
@@ -365,6 +365,7 @@ DEFINE_EVENT(xchk_fblock_error_class, name, \DEFINE_SCRUB_FBLOCK_ERROR_EVENT (xchk_fblock_error);DEFINE_SCRUB_FBLOCK_ERROR_EVENT (xchk_fblock_warning); +DEFINE_SCRUB_FBLOCK_ERROR_EVENT (xchk_fblock_preen);#ifdef CONFIG_XFS_QUOTA DECLARE_EVENT_CLASS(xchk_dqiter_class,
PATCH 6/7 xfs: flag empty xattr leaf blocks for optimization
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
Empty xattr leaf blocks at offset zero are a waste of space but otherwise harmless. If we encounter one, flag it as an opportunity for optimization.
If we encounter empty attr leaf blocks anywhere else in the attr fork, that's corruption.
--- fs/xfs/scrub/attr.c | 11 +++++++++++ fs/xfs/scrub/dabtree.h | 2 ++ 2 files changed, 13 insertions(+)
fs/xfs/scrub/attr.c +11 -0
@@ -420,6 +420,17 @@ xchk_xattr_block(xfs_attr3_leaf_hdr_from_disk (mp->m_attr_geo, &leafhdr, leaf); hdrsize =xfs_attr3_leaf_hdr_size (leaf); +/* +* Empty xattr leaf blocks mapped at block 0 are probably a byproduct +* of a race between setxattr and a log shutdown. Anywhere else in the +* attr fork is a corruption. +*/ +if (leafhdr.count ==0 ) { +if (blk->blkno ==0 ) +xchk_da_set_preen (ds, level); +else +xchk_da_set_corrupt (ds, level); + }if (leafhdr.usedbytes > mp->m_attr_geo->blksize)xchk_da_set_corrupt (ds, level);if (leafhdr.firstused > mp->m_attr_geo->blksize)
fs/xfs/scrub/dabtree.h +2 -0
@@ -37,6 +37,8 @@ bool xchk_da_process_error(struct xchk_da_btree *ds, int level, int *error);void xchk_da_set_corrupt (struct xchk_da_btree *ds,int level);void xchk_da_set_preen (struct xchk_da_btree *ds,int level); +void xchk_da_set_preen (struct xchk_da_btree *ds,int level); +int xchk_da_btree_hash (struct xchk_da_btree *ds,int level,__be32 *hashp);int xchk_da_btree (struct xfs_scrub *sc,int whichfork,xchk_da_btree_rec_fn scrub_fn,void *private);
PATCH 7/7 xfs: create an xattr iteration function for scrub
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
Create a streamlined function to walk a file's xattrs, without all the cursor management stuff in the regular listxattr.
--- fs/xfs/Makefile | 1 fs/xfs/scrub/attr.c | 125 +++++++----------- fs/xfs/scrub/dab_bitmap.h | 37 +++++ fs/xfs/scrub/listxattr.c | 312 +++++++++++++++++++++++++++++++++++++++++++++ fs/xfs/scrub/listxattr.h | 17 ++ 5 files changed, 414 insertions(+), 78 deletions(-) create mode 100644 fs/xfs/scrub/dab_bitmap.h create mode 100644 fs/xfs/scrub/listxattr.c create mode 100644 fs/xfs/scrub/listxattr.h
fs/xfs/Makefile +1 -0
@@ -165,6 +165,7 @@ xfs-y += $(addprefix scrub/, \ ialloc.o \ inode.o \ iscan.o \ + listxattr.o \ nlinks.o \ parent.o \ readdir.o \
fs/xfs/scrub/attr.c +47 -78
200 lines not on this page · raw message
fs/xfs/scrub/dab_bitmap.h new file +37 -0
@@ -0,0 +1,37 @@ +// SPDX-License-Identifier: GPL-2.0-or-later +/* +* Copyright (c) 2022-2024 Oracle. All Rights Reserved. +* Author: Darrick J. Wong <[email protected]> +*/ +#ifndef __XFS_SCRUB_DAB_BITMAP_H__ +#define __XFS_SCRUB_DAB_BITMAP_H__ + +/* Bitmaps, but for type-checked for xfs_dablk_t */ + +struct xdab_bitmap { +struct xbitmap32 dabitmap; +}; + +static inline void xdab_bitmap_init (struct xdab_bitmap *bitmap) +{ +xbitmap32_init (&bitmap->dabitmap); +} + +static inline void xdab_bitmap_destroy (struct xdab_bitmap *bitmap) +{ +xbitmap32_destroy (&bitmap->dabitmap); +} + +static inline int xdab_bitmap_set (struct xdab_bitmap *bitmap, +xfs_dablk_t dabno,xfs_extlen_t len) +{ +return xbitmap32_set (&bitmap->dabitmap, dabno, len); +} + +static inline bool xdab_bitmap_test (struct xdab_bitmap *bitmap, +xfs_dablk_t dabno,xfs_extlen_t *len) +{ +return xbitmap32_test (&bitmap->dabitmap, dabno, len); +} + +#endif /* __XFS_SCRUB_DAB_BITMAP_H__ */
fs/xfs/scrub/listxattr.c new file +312 -0
312 lines not on this page · raw message
fs/xfs/scrub/listxattr.h new file +17 -0
@@ -0,0 +1,17 @@ +/* SPDX-License-Identifier: GPL-2.0-or-later */ +/* +* Copyright (c) 2022-2024 Oracle. All Rights Reserved. +* Author: Darrick J. Wong <[email protected]> +*/ +#ifndef __XFS_SCRUB_LISTXATTR_H__ +#define __XFS_SCRUB_LISTXATTR_H__ + +typedef int (*xchk_xattr_fn )(struct xfs_scrub *sc,struct xfs_inode *ip, +unsigned int attr_flags,const unsigned char *name, +unsigned int namelen,const void *value,unsigned int valuelen, +void *priv); + +int xchk_xattr_walk (struct xfs_scrub *sc,struct xfs_inode *ip, +xchk_xattr_fn attr_fn,void *priv); + +#endif /* __XFS_SCRUB_LISTXATTR_H__ */
Re: [PATCH 7/7] xfs: create an xattr iteration function for scrub
Looks good:
PATCH 9/15 xfs: online repair of inode unlinked state
In reply to Darrick J. WongHi all,
This series adds some logic to the inode scrubbers so that they can detect and deal with consistency errors between the link count and the per-inode unlinked list state. The helpers needed to do this are presented here because they are a prequisite for rebuildng directories, since we need to get a rebuilt non-empty directory off the unlinked list.
Note that this patchset does not provide comprehensive reconstruction of the AGI unlinked list; that is coming in a subsequent patchset.
If you're going to start using this code, I strongly recommend pulling from my git trees, which are linked below.
This has been running on the djcloud for months with no problems. Enjoy! Comments and questions are, as always, welcome.
--D
kernel git tree:
https://git.kernel.org/cgit/linux/kernel/git/djwong/xfs-linux.git/log/?h=repair-unlinked-inode-state
---
Commits in this patchset:
* xfs: ensure unlinked list state is consistent with nlink during scrub
* xfs: update the unlinked list when repairing link counts
--- fs/xfs/scrub/inode.c | 19 ++++++++++++++++++ fs/xfs/scrub/inode_repair.c | 45 ++++++++++++++++++++++++++++++++++++++++++ fs/xfs/scrub/nlinks_repair.c | 42 +++++++++++++++++++++++++++++++-------- fs/xfs/xfs_inode.c | 5 +---- fs/xfs/xfs_inode.h | 2 ++ 5 files changed, 100 insertions(+), 13 deletions(-)
PATCH 1/2 xfs: ensure unlinked list state is consistent with nlink during scrub
From: Darrick J. Wong <[email protected]>
Now that we have the means to tell if an inode is on an unlinked inode list or not, we can check that an inode with zero link count is on the unlinked list; and an inode that has nonzero link count is not on that list. Make repair clean things up too.
--- fs/xfs/scrub/inode.c | 19 ++++++++++++++++++ fs/xfs/scrub/inode_repair.c | 45 +++++++++++++++++++++++++++++++++++++++++++ fs/xfs/xfs_inode.c | 5 +---- fs/xfs/xfs_inode.h | 2 ++ 4 files changed, 67 insertions(+), 4 deletions(-)
fs/xfs/scrub/inode.c +19 -0
@@ -739,6 +739,23 @@ xchk_inode_check_reflink_iflag(xchk_ino_set_corrupt (sc, ino); } +/* +* If this inode has zero link count, it must be on the unlinked list. If +* it has nonzero link count, it must not be on the unlinked list. +*/ +STATIC void +xchk_inode_check_unlinked ( +struct xfs_scrub *sc) +{ +if (VFS_I (sc->ip)->i_nlink ==0 ) { +if (!xfs_inode_on_unlinked_list (sc->ip)) +xchk_ino_set_corrupt (sc, sc->ip->i_ino); + }else { +if (xfs_inode_on_unlinked_list (sc->ip)) +xchk_ino_set_corrupt (sc, sc->ip->i_ino); + } +} +/* Scrub an inode. */ int xchk_inode(
@@ -771,6 +788,8 @@ xchk_inode(if (S_ISREG (VFS_I (sc->ip)->i_mode))xchk_inode_check_reflink_iflag (sc, sc->ip->i_ino); +xchk_inode_check_unlinked (sc); +xchk_inode_xref (sc, sc->ip->i_ino, &di); out:return error;
fs/xfs/scrub/inode_repair.c +45 -0
56 lines not on this page · raw message
fs/xfs/xfs_inode.c +1 -4
@@ -42,9 +42,6 @@struct kmem_cache *xfs_inode_cache; -STATIC int xfs_iunlink_remove(struct xfs_trans *tp, struct xfs_perag *pag, -struct xfs_inode *); -/* * helper function to extract extent size hint from inode */
@@ -2241,7 +2238,7 @@ xfs_iunlink_remove_inode(/* * Pull the on-disk inode from the AGI unlinked list. */ -STATIC int +int xfs_iunlink_remove( struct xfs_trans *tp, struct xfs_perag *pag,
fs/xfs/xfs_inode.h +2 -0
@@ -617,6 +617,8 @@ extern struct kmem_cache *xfs_inode_cache;bool xfs_inode_needs_inactive (struct xfs_inode *ip);int xfs_iunlink (struct xfs_trans *tp,struct xfs_inode *ip); +int xfs_iunlink_remove (struct xfs_trans *tp,struct xfs_perag *pag, +struct xfs_inode *ip);void xfs_end_io (struct work_struct *work);
PATCH 2/2 xfs: update the unlinked list when repairing link counts
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
When we're repairing the link counts of a file, we must ensure either that the file has zero link count and is on the unlinked list; or that it has nonzero link count and is not on the unlinked list.
--- fs/xfs/scrub/nlinks_repair.c | 42 +++++++++++++++++++++++++++++++++--------- 1 file changed, 33 insertions(+), 9 deletions(-)
fs/xfs/scrub/nlinks_repair.c +33 -9
@@ -17,6 +17,7 @@#include "xfs_iwalk.h" #include "xfs_ialloc.h" #include "xfs_sb.h" +#include "xfs_ag.h" #include "scrub/scrub.h" #include "scrub/common.h" #include "scrub/repair.h"
@@ -36,6 +37,20 @@* inode is locked. */ +/* Remove an inode from the unlinked list. */ +STATIC int +xrep_nlinks_iunlink_remove ( +struct xfs_scrub *sc) +{ +struct xfs_perag *pag; +int error; + + pag =xfs_perag_get (sc->mp,XFS_INO_TO_AGNO (sc->mp, sc->ip->i_ino)); + error =xfs_iunlink_remove (sc->tp, pag, sc->ip); +xfs_perag_put (pag); +return error; +} +/* * Correct the link count of the given inode. Because we have to grab locks * and resources in a certain order, it's possible that this will be a no-op.
@@ -99,16 +114,25 @@ xrep_nlinks_repair_inode( }/* -* We did not find any links to this inode. If the inode agrees, we -* have nothing further to do. If not, the inode has a nonzero link -* count and we don't have anywhere to graft the child onto. Dropping -* a live inode's link count to zero can cause unexpected shutdowns in -* inactivation, so leave it alone. +* If this inode is linked from the directory tree and on the unlinked +* list, remove it from the unlinked list. */ -if (total_links ==0 ) { -if (actual_nlink !=0 ) -trace_xrep_nlinks_unfixable_inode (mp, ip, &obs); - goto out_trans; +if (total_links >0 &&xfs_inode_on_unlinked_list (ip)) { + error =xrep_nlinks_iunlink_remove (sc); +if (error) + goto out_trans; + dirty = true; + } + +/* +* If this inode is not linked from the directory tree yet not on the +* unlinked list, put it on the unlinked list. +*/ +if (total_links ==0 && !xfs_inode_on_unlinked_list (ip)) { + error =xfs_iunlink (sc->tp, ip); +if (error) + goto out_trans; + dirty = true; }/* Commit the new link count if it changed. */
PATCH 10/15 xfs: online repair of directories
In reply to Darrick J. WongHi all,
This series employs atomic extent swapping to enable safe reconstruction of directory data. For now, XFS does not support reverse directory links (aka parent pointers), so we can only salvage the dirents of a directory and construct a new structure.
Directory repair therefore consists of five main parts:
First, we walk the existing directory to salvage as many entries as we can, by adding them as new directory entries to the repair temp dir.
Second, we validate the parent pointer found in the directory. If one was not found, we scan the entire filesystem looking for a potential parent.
Third, we use atomic extent swaps to exchange the entire data fork between the two directories.
Fourth, we reap the old directory blocks as carefully as we can.
To wrap up the directory repair code, we need to add to the regular filesystem the ability to free all the data fork blocks in a directory. This does not change anything with normal directories, since they must still unlink and shrink one entry at a time. However, this will facilitate freeing of partially-inactivated temporary directories during log recovery.
The second half of this patchset implements repairs for the dotdot entries of directories. For now there is only rudimentary support for this, because there are no directory parent pointers, so the best we can do is scanning the filesystem and the VFS dcache for answers.
If you're going to start using this code, I strongly recommend pulling from my git trees, which are linked below.
This has been running on the djcloud for months with no problems. Enjoy! Comments and questions are, as always, welcome.
--D
kernel git tree:
https://git.kernel.org/cgit/linux/kernel/git/djwong/xfs-linux.git/log/?h=repair-dirs
xfsprogs git tree:
https://git.kernel.org/cgit/linux/kernel/git/djwong/xfsprogs-dev.git/log/?h=repair-dirs
fstests git tree:
https://git.kernel.org/cgit/linux/kernel/git/djwong/xfstests-dev.git/log/?h=repair-dirs
---
Commits in this patchset:
* xfs: inactivate directory data blocks
* xfs: online repair of directories
* xfs: scan the filesystem to repair a directory dotdot entry
* xfs: online repair of parent pointers
* xfs: ask the dentry cache if it knows the parent of a directory
--- fs/xfs/Makefile | 3 fs/xfs/scrub/dir.c | 9 fs/xfs/scrub/dir_repair.c | 1404 ++++++++++++++++++++++++++++++++++++++++++ fs/xfs/scrub/findparent.c | 448 +++++++++++++ fs/xfs/scrub/findparent.h | 50 + fs/xfs/scrub/inode_repair.c | 5 fs/xfs/scrub/iscan.c | 18 + fs/xfs/scrub/iscan.h | 1 fs/xfs/scrub/nlinks.c | 23 + fs/xfs/scrub/nlinks_repair.c | 9 fs/xfs/scrub/parent.c | 14 fs/xfs/scrub/parent_repair.c | 234 +++++++ fs/xfs/scrub/readdir.c | 7 fs/xfs/scrub/repair.c | 1 fs/xfs/scrub/repair.h | 8 fs/xfs/scrub/scrub.c | 4 fs/xfs/scrub/tempfile.c | 13 fs/xfs/scrub/tempfile.h | 2 fs/xfs/scrub/trace.h | 115 +++ fs/xfs/xfs_inode.c | 51 ++ 20 files changed, 2415 insertions(+), 4 deletions(-) create mode 100644 fs/xfs/scrub/dir_repair.c create mode 100644 fs/xfs/scrub/findparent.c create mode 100644 fs/xfs/scrub/findparent.h create mode 100644 fs/xfs/scrub/parent_repair.c
PATCH 1/5 xfs: inactivate directory data blocks
From: Darrick J. Wong <[email protected]>
Teach inode inactivation to delete all the incore buffers backing a directory. In normal runtime this should never happen because the VFS forbids rmdir on a non-empty directory.
In the next patch, online directory repair stands up a new directory, exchanges it with the broken directory, and then drops the private temporary directory. If we cancel the repair just prior to exchanging the directory contents, the new directory will need to be torn down.
Note: If we commit the repair, reaping will take care of all the ondisk space allocations and incore buffers for the old corrupt directory.
--- fs/xfs/xfs_inode.c | 51 +++++++++++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 51 insertions(+)
fs/xfs/xfs_inode.c +51 -0
@@ -16,6 +16,7 @@#include "xfs_inode.h" #include "xfs_dir2.h" #include "xfs_attr.h" +#include "xfs_bit.h" #include "xfs_trans_space.h" #include "xfs_trans.h" #include "xfs_buf_item.h"
@@ -1540,6 +1541,51 @@ xfs_release(return error; } +/* +* Mark all the buffers attached to this directory stale. In theory we should +* never be freeing a directory with any blocks at all, but this covers the +* case where we've recovered a directory swap with a "temporary" directory +* created by online repair and now need to dump it. +*/ +STATIC void +xfs_inactive_dir ( +struct xfs_inode *dp) +{ +struct xfs_iext_cursor icur; +struct xfs_bmbt_irec got; +struct xfs_mount *mp = dp->i_mount; +struct xfs_da_geometry *geo = mp->m_dir_geo; +struct xfs_ifork *ifp =xfs_ifork_ptr (dp,XFS_DATA_FORK ); +xfs_fileoff_t off; + +/* +* Invalidate each directory block. All directory blocks are of +* fsbcount length and alignment, so we only need to walk those same +* offsets. We hold the only reference to this inode, so we must wait +* for the buffer locks. +*/ +for_each_xfs_iext (ifp, &icur, &got) { +for (off =round_up (got.br_startoff, geo->fsbcount); + off < got.br_startoff + got.br_blockcount; + off += geo->fsbcount) { +struct xfs_buf *bp =NULL ; +xfs_fsblock_t fsbno; +int error; + + fsbno = (off - got.br_startoff) + got.br_startblock; + error =xfs_buf_incore (mp->m_ddev_targp, +XFS_FSB_TO_DADDR (mp, fsbno), +XFS_FSB_TO_BB (mp, geo->fsbcount), +XBF_LIVESCAN , &bp); +if (error) +continue ; + +xfs_buf_stale (bp); +xfs_buf_relse (bp); + } + } +} +/* * xfs_inactive_truncate *
@@ -1850,6 +1896,11 @@ xfs_inactive( goto out; } +if (S_ISDIR (VFS_I (ip)->i_mode) && ip->i_df.if_nextents >0 ) { +xfs_inactive_dir (ip); + truncate =1 ; + } +if (S_ISLNK (VFS_I (ip)->i_mode)) error =xfs_inactive_symlink (ip);else if (truncate)
PATCH 2/5 xfs: online repair of directories
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
If a directory looks like it's in bad shape, try to sift through the rubble to find whatever directory entries we can, scan the directory tree for the parent (if needed), stage the new directory contents in a temporary file and use the atomic extent swapping mechanism to commit the results in bulk.
--- fs/xfs/Makefile | 1 fs/xfs/scrub/dir.c | 9 fs/xfs/scrub/dir_repair.c | 1351 ++++++++++++++++++++++++++++++++++++++++++ fs/xfs/scrub/inode_repair.c | 5 fs/xfs/scrub/nlinks.c | 23 + fs/xfs/scrub/nlinks_repair.c | 9 fs/xfs/scrub/parent.c | 4 fs/xfs/scrub/readdir.c | 7 fs/xfs/scrub/repair.c | 1 fs/xfs/scrub/repair.h | 4 fs/xfs/scrub/scrub.c | 2 fs/xfs/scrub/tempfile.c | 13 fs/xfs/scrub/tempfile.h | 2 fs/xfs/scrub/trace.h | 112 +++ 14 files changed, 1541 insertions(+), 2 deletions(-) create mode 100644 fs/xfs/scrub/dir_repair.c
fs/xfs/Makefile +1 -0
@@ -198,6 +198,7 @@ xfs-y += $(addprefix scrub/, \ attr_repair.o \ bmap_repair.o \ cow_repair.o \ + dir_repair.o \ fscounters_repair.o \ ialloc_repair.o \ inode_repair.o \
fs/xfs/scrub/dir.c +9 -0
@@ -21,12 +21,21 @@#include "scrub/dabtree.h" #include "scrub/readdir.h" #include "scrub/health.h" +#include "scrub/repair.h" /* Set us up to scrub directories. */ int xchk_setup_directory (struct xfs_scrub *sc) { +int error; + +if (xchk_could_repair (sc)) { + error =xrep_setup_directory (sc); +if (error) +return error; + } +return xchk_setup_inode_contents (sc,0 ); }
fs/xfs/scrub/dir_repair.c new file +1351 -0
1,351 lines not on this page · raw message
fs/xfs/scrub/inode_repair.c +5 -0
@@ -46,6 +46,7 @@#include "scrub/repair.h" #include "scrub/iscan.h" #include "scrub/readdir.h" +#include "scrub/tempfile.h" /* * Inode Record Repair
@@ -339,6 +340,10 @@ xrep_dinode_findmode_walk_directory(unsigned int lock_mode;int error =0 ; +/* Ignore temporary repair directories. */ +if (xrep_is_tempfile (dp)) +return 0 ; +/* * Scan the directory to see if there it contains an entry pointing to * the directory that we are repairing.
fs/xfs/scrub/nlinks.c +23 -0
@@ -27,6 +27,7 @@#include "scrub/nlinks.h" #include "scrub/trace.h" #include "scrub/readdir.h" +#include "scrub/tempfile.h" /* * Live Inode Link Count Checking
@@ -152,6 +153,13 @@ xchk_nlinks_live_update( xnc = container_of(nb, struct xchk_nlink_ctrs, dhook.dirent_hook.nb); +/* +* Ignore temporary directories being used to stage dir repairs, since +* we don't bump the link counts of the children. +*/ +if (xrep_is_tempfile (p->dp)) +return NOTIFY_DONE ; +trace_xchk_nlinks_live_update (xnc->sc->mp, p->dp, action, p->ip->i_ino, p->delta, p->name->name, p->name->len);
@@ -303,6 +311,13 @@ xchk_nlinks_collect_dir(unsigned int lock_mode;int error =0 ; +/* +* Ignore temporary directories being used to stage dir repairs, since +* we don't bump the link counts of the children. +*/ +if (xrep_is_tempfile (dp)) +return 0 ; +/* Prevent anyone from changing this directory while we walk it. */ xfs_ilock (dp,XFS_IOLOCK_SHARED ); lock_mode =xfs_ilock_data_map_shared (dp);
@@ -537,6 +552,14 @@ xchk_nlinks_compare_inode(unsigned int actual_nlink;int error; +/* +* Ignore temporary files being used to stage repairs, since we assume +* they're correct for non-directories, and the directory repair code +* doesn't bump the link counts for the children. +*/ +if (xrep_is_tempfile (ip)) +return 0 ; +xfs_ilock (ip,XFS_ILOCK_SHARED );mutex_lock (&xnc->lock);
fs/xfs/scrub/nlinks_repair.c +9 -0
@@ -26,6 +26,7 @@#include "scrub/iscan.h" #include "scrub/nlinks.h" #include "scrub/trace.h" +#include "scrub/tempfile.h" /* * Live Inode Link Count Repair
@@ -68,6 +69,14 @@ xrep_nlinks_repair_inode(bool dirty = false;int error; +/* +* Ignore temporary files being used to stage repairs, since we assume +* they're correct for non-directories, and the directory repair code +* doesn't bump the link counts for the children. +*/ +if (xrep_is_tempfile (ip)) +return 0 ; +xchk_ilock (sc,XFS_IOLOCK_EXCL ); error =xfs_trans_alloc (mp, &M_RES (mp)->tr_link,0 ,0 ,0 , &sc->tp);
fs/xfs/scrub/parent.c +3 -1
@@ -17,6 +17,7 @@#include "scrub/scrub.h" #include "scrub/common.h" #include "scrub/readdir.h" +#include "scrub/tempfile.h" /* Set us up to scrub parents. */ int
@@ -143,7 +144,8 @@ xchk_parent_validate( }if (!xchk_fblock_xref_process_error (sc,XFS_DATA_FORK ,0 , &error))return error; -if (dp == sc->ip || dp == sc->tempip || !S_ISDIR (VFS_I (dp)->i_mode)) { +if (dp == sc->ip ||xrep_is_tempfile (dp) || + !S_ISDIR (VFS_I (dp)->i_mode)) {xchk_fblock_set_corrupt (sc,XFS_DATA_FORK ,0 ); goto out_rele; }
fs/xfs/scrub/readdir.c +7 -0
@@ -333,6 +333,13 @@ xchk_dir_lookup(if (xfs_is_shutdown (dp->i_mount))return -EIO ; +/* +* A temporary directory's block headers are written with the owner +* set to sc->ip, so we must switch the owner here for the lookup. +*/ +if (dp == sc->tempip) + args.owner = sc->ip->i_ino; +ASSERT (S_ISDIR (VFS_I (dp)->i_mode));xfs_assert_ilocked (dp,XFS_ILOCK_SHARED |XFS_ILOCK_EXCL );
fs/xfs/scrub/repair.c +1 -0
@@ -35,6 +35,7 @@#include "xfs_da_format.h" #include "xfs_da_btree.h" #include "xfs_attr.h" +#include "xfs_dir2.h" #include "scrub/scrub.h" #include "scrub/common.h" #include "scrub/trace.h"
fs/xfs/scrub/repair.h +4 -0
@@ -91,6 +91,7 @@ int xrep_metadata_inode_forks(struct xfs_scrub *sc);int xrep_setup_ag_rmapbt (struct xfs_scrub *sc);int xrep_setup_ag_refcountbt (struct xfs_scrub *sc);int xrep_setup_xattr (struct xfs_scrub *sc); +int xrep_setup_directory (struct xfs_scrub *sc);/* Repair setup functions */ int xrep_setup_ag_allocbt (struct xfs_scrub *sc);
@@ -125,6 +126,7 @@ int xrep_bmap_cow(struct xfs_scrub *sc);int xrep_nlinks (struct xfs_scrub *sc);int xrep_fscounters (struct xfs_scrub *sc);int xrep_xattr (struct xfs_scrub *sc); +int xrep_directory (struct xfs_scrub *sc);#ifdef CONFIG_XFS_RT int xrep_rtbitmap (struct xfs_scrub *sc);
@@ -195,6 +197,7 @@ xrep_setup_nothing(#define xrep_setup_ag_rmapbt xrep_setup_nothing#define xrep_setup_ag_refcountbt xrep_setup_nothing#define xrep_setup_xattr xrep_setup_nothing +#define xrep_setup_directory xrep_setup_nothing#define xrep_setup_inode (sc, imap) ((void)0)
@@ -221,6 +224,7 @@ xrep_setup_nothing(#define xrep_fscounters xrep_notsupported#define xrep_rtsummary xrep_notsupported#define xrep_xattr xrep_notsupported +#define xrep_directory xrep_notsupported#endif /* CONFIG_XFS_ONLINE_REPAIR */
fs/xfs/scrub/scrub.c +1 -1
@@ -325,7 +325,7 @@ static const struct xchk_meta_ops meta_scrub_ops[] = { .type = ST_INODE, .setup = xchk_setup_directory, .scrub = xchk_directory, - .repair = xrep_notsupported, + .repair = xrep_directory, }, [XFS_SCRUB_TYPE_XATTR] = { /* extended attributes */ .type = ST_INODE,
fs/xfs/scrub/tempfile.c +13 -0
@@ -844,3 +844,16 @@ xrep_tempfile_copyout_local( ilog_flags |=xfs_ilog_fdata (whichfork);xfs_trans_log_inode (sc->tp, sc->ip, ilog_flags); } + +/* Decide if a given XFS inode is a temporary file for a repair. */ +bool +xrep_is_tempfile ( +const struct xfs_inode *ip) +{ +const struct inode *inode = &ip->i_vnode; + +if (IS_PRIVATE (inode) && !(inode->i_opflags &IOP_XATTR )) +return true; + +return false; +}
fs/xfs/scrub/tempfile.h +2 -0
@@ -35,11 +35,13 @@ int xrep_tempfile_set_isize(struct xfs_scrub *sc, unsigned long long isize);int xrep_tempfile_roll_trans (struct xfs_scrub *sc);void xrep_tempfile_copyout_local (struct xfs_scrub *sc,int whichfork); +bool xrep_is_tempfile (const struct xfs_inode *ip);#else static inline void xrep_tempfile_iolock_both (struct xfs_scrub *sc) {xchk_ilock (sc,XFS_IOLOCK_EXCL ); } +# define xrep_is_tempfile (ip) (false)# define xrep_tempfile_rele (sc)#endif /* CONFIG_XFS_ONLINE_REPAIR */
fs/xfs/scrub/trace.h +112 -0
118 lines not on this page · raw message
PATCH 3/5 xfs: scan the filesystem to repair a directory dotdot entry
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
Teach the online directory repair code to scan the filesystem so that we can set the dotdot entry when we're rebuilding a directory. This involves dropping ILOCK on the directory that we're repairing, which means that the VFS can sneak in and tell us to update dotdot at any time. Deal with these races by using a dirent hook to absorb dotdot updates, and be careful not to check the scan results until after we've retaken the ILOCK.
--- fs/xfs/Makefile | 1 fs/xfs/scrub/dir_repair.c | 70 +++++--- fs/xfs/scrub/findparent.c | 412 +++++++++++++++++++++++++++++++++++++++++++++ fs/xfs/scrub/findparent.h | 49 +++++ fs/xfs/scrub/iscan.c | 18 ++ fs/xfs/scrub/iscan.h | 1 fs/xfs/scrub/trace.h | 1 7 files changed, 528 insertions(+), 24 deletions(-) create mode 100644 fs/xfs/scrub/findparent.c create mode 100644 fs/xfs/scrub/findparent.h
fs/xfs/Makefile +1 -0
@@ -199,6 +199,7 @@ xfs-y += $(addprefix scrub/, \ bmap_repair.o \ cow_repair.o \ dir_repair.o \ + findparent.o \ fscounters_repair.o \ ialloc_repair.o \ inode_repair.o \
fs/xfs/scrub/dir_repair.c +47 -23
166 lines not on this page · raw message
fs/xfs/scrub/findparent.c new file +412 -0
412 lines not on this page · raw message
fs/xfs/scrub/findparent.h new file +49 -0
49 lines not on this page · raw message
fs/xfs/scrub/iscan.c +17 -1
@@ -243,6 +243,17 @@ xchk_iscan_finish(mutex_unlock (&iscan->lock); } +/* Mark an inode scan finished before we actually scan anything. */ +void +xchk_iscan_finish_early ( +struct xchk_iscan *iscan) +{ +ASSERT (iscan->cursor_ino == iscan->scan_start_ino); +ASSERT (iscan->__visited_ino == iscan->scan_start_ino); + +xchk_iscan_finish (iscan); +} +/* * Advance ino to the next inode that the inobt thinks is allocated, being * careful to jump to the next AG if we've reached the right end of this AG's
@@ -402,8 +413,13 @@ xchk_iscan_iget(* It's possible that this inode has lost all of its links but * hasn't yet been inactivated. If we don't have a transaction * or it's not writable, flush the inodegc workers and wait. +* If we have a non-empty transaction, we must not block on +* inodegc, which allocates its own transactions. */ -xfs_inodegc_flush (mp); +if (sc->tp && !(sc->tp->t_flags &XFS_TRANS_NO_WRITECOUNT )) +xfs_inodegc_push (mp); +else +xfs_inodegc_flush (mp);return xchk_iscan_iget_retry (iscan, true); }
fs/xfs/scrub/iscan.h +1 -0
@@ -73,6 +73,7 @@ xchk_iscan_abort(struct xchk_iscan *iscan)void xchk_iscan_start (struct xfs_scrub *sc,unsigned int iget_timeout,unsigned int iget_retry_delay,struct xchk_iscan *iscan); +void xchk_iscan_finish_early (struct xchk_iscan *iscan);void xchk_iscan_teardown (struct xchk_iscan *iscan);int xchk_iscan_iter (struct xchk_iscan *iscan,struct xfs_inode **ipp);
fs/xfs/scrub/trace.h +1 -0
@@ -2605,6 +2605,7 @@ DEFINE_EVENT(xrep_parent_salvage_class, name, \ TP_PROTO(struct xfs_inode *dp, xfs_ino_t ino), \ TP_ARGS(dp, ino)) DEFINE_XREP_PARENT_SALVAGE_EVENT(xrep_dir_salvaged_parent); +DEFINE_XREP_PARENT_SALVAGE_EVENT (xrep_findparent_dirent);#endif /* IS_ENABLED(CONFIG_XFS_ONLINE_REPAIR) */
PATCH 4/5 xfs: online repair of parent pointers
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
Teach the online repair code to fix parent pointers for directories. For now, this means correcting the dotdot entry of an existing directory that is otherwise consistent.
--- fs/xfs/Makefile | 1 fs/xfs/scrub/parent.c | 10 ++ fs/xfs/scrub/parent_repair.c | 221 ++++++++++++++++++++++++++++++++++++++++++ fs/xfs/scrub/repair.h | 4 + fs/xfs/scrub/scrub.c | 2 fs/xfs/scrub/trace.h | 1 6 files changed, 238 insertions(+), 1 deletion(-) create mode 100644 fs/xfs/scrub/parent_repair.c
fs/xfs/Makefile +1 -0
@@ -205,6 +205,7 @@ xfs-y += $(addprefix scrub/, \ inode_repair.o \ newbt.o \ nlinks_repair.o \ + parent_repair.o \ rcbag_btree.o \ rcbag.o \ reap.o \
fs/xfs/scrub/parent.c +10 -0
@@ -10,6 +10,7 @@#include "xfs_trans_resv.h" #include "xfs_mount.h" #include "xfs_log_format.h" +#include "xfs_trans.h" #include "xfs_inode.h" #include "xfs_icache.h" #include "xfs_dir2.h"
@@ -18,12 +19,21 @@#include "scrub/common.h" #include "scrub/readdir.h" #include "scrub/tempfile.h" +#include "scrub/repair.h" /* Set us up to scrub parents. */ int xchk_setup_parent (struct xfs_scrub *sc) { +int error; + +if (xchk_could_repair (sc)) { + error =xrep_setup_parent (sc); +if (error) +return error; + } +return xchk_setup_inode_contents (sc,0 ); }
fs/xfs/scrub/parent_repair.c new file +221 -0
221 lines not on this page · raw message
fs/xfs/scrub/repair.h +4 -0
@@ -92,6 +92,7 @@ int xrep_setup_ag_rmapbt(struct xfs_scrub *sc);int xrep_setup_ag_refcountbt (struct xfs_scrub *sc);int xrep_setup_xattr (struct xfs_scrub *sc);int xrep_setup_directory (struct xfs_scrub *sc); +int xrep_setup_parent (struct xfs_scrub *sc);/* Repair setup functions */ int xrep_setup_ag_allocbt (struct xfs_scrub *sc);
@@ -127,6 +128,7 @@ int xrep_nlinks(struct xfs_scrub *sc);int xrep_fscounters (struct xfs_scrub *sc);int xrep_xattr (struct xfs_scrub *sc);int xrep_directory (struct xfs_scrub *sc); +int xrep_parent (struct xfs_scrub *sc);#ifdef CONFIG_XFS_RT int xrep_rtbitmap (struct xfs_scrub *sc);
@@ -198,6 +200,7 @@ xrep_setup_nothing(#define xrep_setup_ag_refcountbt xrep_setup_nothing#define xrep_setup_xattr xrep_setup_nothing#define xrep_setup_directory xrep_setup_nothing +#define xrep_setup_parent xrep_setup_nothing#define xrep_setup_inode (sc, imap) ((void)0)
@@ -225,6 +228,7 @@ xrep_setup_nothing(#define xrep_rtsummary xrep_notsupported#define xrep_xattr xrep_notsupported#define xrep_directory xrep_notsupported +#define xrep_parent xrep_notsupported#endif /* CONFIG_XFS_ONLINE_REPAIR */
fs/xfs/scrub/scrub.c +1 -1
@@ -343,7 +343,7 @@ static const struct xchk_meta_ops meta_scrub_ops[] = { .type = ST_INODE, .setup = xchk_setup_parent, .scrub = xchk_parent, - .repair = xrep_notsupported, + .repair = xrep_parent, }, [XFS_SCRUB_TYPE_RTBITMAP] = { /* realtime bitmap */ .type = ST_FS,
fs/xfs/scrub/trace.h +1 -0
@@ -2544,6 +2544,7 @@ DEFINE_EVENT(xrep_dir_class, name, \ TP_ARGS(dp, parent_ino))DEFINE_XREP_DIR_EVENT (xrep_dir_rebuild_tree);DEFINE_XREP_DIR_EVENT (xrep_dir_reset_fork); +DEFINE_XREP_DIR_EVENT (xrep_parent_reset_dotdot); DECLARE_EVENT_CLASS(xrep_dirent_class, TP_PROTO(struct xfs_inode *dp, const struct xfs_name *name,
PATCH 5/5 xfs: ask the dentry cache if it knows the parent of a directory
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
It's possible that the dentry cache can tell us the parent of a directory. Therefore, when repairing directory dot dot entries, query the dcache as a last resort before scanning the entire filesystem.
--- fs/xfs/scrub/dir_repair.c | 29 +++++++++++++++++++++++++++++ fs/xfs/scrub/findparent.c | 38 +++++++++++++++++++++++++++++++++++++- fs/xfs/scrub/findparent.h | 1 + fs/xfs/scrub/parent_repair.c | 13 +++++++++++++ fs/xfs/scrub/trace.h | 1 + 5 files changed, 81 insertions(+), 1 deletion(-)
fs/xfs/scrub/dir_repair.c +29 -0
@@ -206,6 +206,29 @@ xrep_dir_lookup_parent(return ino; } +/* +* Look up '..' in the dentry cache and confirm that it's really the parent. +* Returns NULLFSINO if the dcache misses or if the hit is implausible. +*/ +static inline xfs_ino_t +xrep_dir_dcache_parent ( +struct xrep_dir *rd) +{ +struct xfs_scrub *sc = rd->sc; +xfs_ino_t parent_ino; +int error; + + parent_ino =xrep_findparent_from_dcache (sc); +if (parent_ino ==NULLFSINO ) +return parent_ino; + + error =xrep_findparent_confirm (sc, &parent_ino); +if (error) +return NULLFSINO ; + +return parent_ino; +} +/* Try to find the parent of the directory being repaired. */ STATIC int xrep_dir_find_parent(
@@ -219,6 +242,12 @@ xrep_dir_find_parent(return 0 ; } + ino =xrep_dir_dcache_parent (rd); +if (ino !=NULLFSINO ) { +xrep_findparent_scan_finish_early (&rd->pscan, ino); +return 0 ; + } + ino =xrep_dir_lookup_parent (rd);if (ino !=NULLFSINO ) {xrep_findparent_scan_finish_early (&rd->pscan, ino);
fs/xfs/scrub/findparent.c +37 -1
@@ -53,7 +53,8 @@* must not read the scan results without re-taking @sc->ip's ILOCK. * * There are a few shortcuts that we can take to avoid scanning the entire -* filesystem, such as noticing directory tree roots. +* filesystem, such as noticing directory tree roots and querying the dentry +* cache for parent information. */ struct xrep_findparent_info {
@@ -410,3 +411,38 @@ xrep_findparent_self_reference(return NULLFSINO ; } + +/* Check the dentry cache to see if knows of a parent for the scrub target. */ +xfs_ino_t +xrep_findparent_from_dcache ( +struct xfs_scrub *sc) +{ +struct inode *pip =NULL ; +struct dentry *dentry, *parent; +xfs_ino_t ret =NULLFSINO ; + + dentry =d_find_alias (VFS_I (sc->ip)); +if (!dentry) + goto out; + + parent =dget_parent (dentry); +if (!parent) + goto out_dput; + +ASSERT (parent->d_sb == sc->ip->i_mount->m_super); + + pip =igrab (d_inode (parent)); +dput (parent); + +if (S_ISDIR (pip->i_mode)) { +trace_xrep_findparent_from_dcache (sc->ip,XFS_I (pip)->i_ino); + ret =XFS_I (pip)->i_ino; + } + +xchk_irele (sc,XFS_I (pip)); + +out_dput: +dput (dentry); +out: +return ret; +}
fs/xfs/scrub/findparent.h +1 -0
@@ -45,5 +45,6 @@ void xrep_findparent_scan_finish_early(struct xrep_parent_scan_info *pscan,int xrep_findparent_confirm (struct xfs_scrub *sc,xfs_ino_t *parent_ino);xfs_ino_t xrep_findparent_self_reference (struct xfs_scrub *sc); +xfs_ino_t xrep_findparent_from_dcache (struct xfs_scrub *sc);#endif /* __XFS_SCRUB_FINDPARENT_H__ */
fs/xfs/scrub/parent_repair.c +13 -0
@@ -118,7 +118,20 @@ xrep_parent_find_dotdot(* then retake the ILOCK so that we can salvage directory entries. */ xchk_iunlock (sc,XFS_ILOCK_EXCL ); + +/* Does the VFS dcache have an answer for us? */ + ino =xrep_findparent_from_dcache (sc); +if (ino !=NULLFSINO ) { + error =xrep_findparent_confirm (sc, &ino); +if (!error && ino !=NULLFSINO ) { +xrep_findparent_scan_finish_early (&rp->pscan, ino); + goto out_relock; + } + } + +/* Scan the entire filesystem for a parent. */ error =xrep_findparent_scan (&rp->pscan); +out_relock:xchk_ilock (sc,XFS_ILOCK_EXCL );return error;
fs/xfs/scrub/trace.h +1 -0
@@ -2607,6 +2607,7 @@ DEFINE_EVENT(xrep_parent_salvage_class, name, \ TP_ARGS(dp, ino))DEFINE_XREP_PARENT_SALVAGE_EVENT (xrep_dir_salvaged_parent);DEFINE_XREP_PARENT_SALVAGE_EVENT (xrep_findparent_dirent); +DEFINE_XREP_PARENT_SALVAGE_EVENT (xrep_findparent_from_dcache);#endif /* IS_ENABLED(CONFIG_XFS_ONLINE_REPAIR) */
Re: [PATCH 5/5] xfs: ask the dentry cache if it knows the parent of a directory
Quoted 5 lines · Darrick J. Wong
From: Darrick J. Wong <[email protected]>
It's possible that the dentry cache can tell us the parent of a directory. Therefore, when repairing directory dot dot entries, query the dcache as a last resort before scanning the entire filesystem.
The code looks fine, but how high is the chance that we actually have a valid dcache entry for a file in a corrupted directory?
Re: [PATCH 5/5] xfs: ask the dentry cache if it knows the parent of a directory
Quoted 9 lines · Christoph Hellwig
Quoted 5 lines · Darrick J. Wong
From: Darrick J. Wong <[email protected]>
It's possible that the dentry cache can tell us the parent of a directory. Therefore, when repairing directory dot dot entries, query the dcache as a last resort before scanning the entire filesystem.
The code looks fine, but how high is the chance that we actually have a valid dcache entry for a file in a corrupted directory?
Decent. Say you have a 1000-block directory foo, and block 980 gets corrupted. Let's further suppose that block 0 has an entry for ".." and "bar". If someone accesses /mnt/foo/bar, won't that cause the dcache to create a dentry from /mnt to /mnt/foo whose d_parent points back to /mnt? If you then want to rebuild the directory, we can obtain the parent from the dcache without needing to wander into parent pointers or scan the filesystem to find /mnt's connection to foo.
--D
PATCH 5/5 xfs: ask the dentry cache if it knows the parent of a directory
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
It's possible that the dentry cache can tell us the parent of a directory. Therefore, when repairing directory dot dot entries, query the dcache as a last resort before scanning the entire filesystem.
A reviewer asks:
"How high is the chance that we actually have a valid dcache entry for a file in a corrupted directory?"
There's a decent chance of this actually working. Say you have a 1000-block directory foo, and block 980 gets corrupted. Let's further suppose that block 0 has a correct entry for ".." and "bar". If someone accesses /mnt/foo/bar, that will cause the dcache to create a dentry from /mnt to /mnt/foo whose d_parent points back to /mnt. If you then want to rebuild the directory, XFS can obtain the parent from the dcache without needing to wander into parent pointers or scan the filesystem to find /mnt's connection to foo.
--- fs/xfs/scrub/dir_repair.c | 29 +++++++++++++++++++++++++++++ fs/xfs/scrub/findparent.c | 38 +++++++++++++++++++++++++++++++++++++- fs/xfs/scrub/findparent.h | 1 + fs/xfs/scrub/parent_repair.c | 13 +++++++++++++ fs/xfs/scrub/trace.h | 1 + 5 files changed, 81 insertions(+), 1 deletion(-)
fs/xfs/scrub/dir_repair.c +29 -0
@@ -208,6 +208,29 @@ xrep_dir_lookup_parent(return ino; } +/* +* Look up '..' in the dentry cache and confirm that it's really the parent. +* Returns NULLFSINO if the dcache misses or if the hit is implausible. +*/ +static inline xfs_ino_t +xrep_dir_dcache_parent ( +struct xrep_dir *rd) +{ +struct xfs_scrub *sc = rd->sc; +xfs_ino_t parent_ino; +int error; + + parent_ino =xrep_findparent_from_dcache (sc); +if (parent_ino ==NULLFSINO ) +return parent_ino; + + error =xrep_findparent_confirm (sc, &parent_ino); +if (error) +return NULLFSINO ; + +return parent_ino; +} +/* Try to find the parent of the directory being repaired. */ STATIC int xrep_dir_find_parent(
@@ -221,6 +244,12 @@ xrep_dir_find_parent(return 0 ; } + ino =xrep_dir_dcache_parent (rd); +if (ino !=NULLFSINO ) { +xrep_findparent_scan_finish_early (&rd->pscan, ino); +return 0 ; + } + ino =xrep_dir_lookup_parent (rd);if (ino !=NULLFSINO ) {xrep_findparent_scan_finish_early (&rd->pscan, ino);
fs/xfs/scrub/findparent.c +37 -1
@@ -53,7 +53,8 @@* must not read the scan results without re-taking @sc->ip's ILOCK. * * There are a few shortcuts that we can take to avoid scanning the entire -* filesystem, such as noticing directory tree roots. +* filesystem, such as noticing directory tree roots and querying the dentry +* cache for parent information. */ struct xrep_findparent_info {
@@ -410,3 +411,38 @@ xrep_findparent_self_reference(return NULLFSINO ; } + +/* Check the dentry cache to see if knows of a parent for the scrub target. */ +xfs_ino_t +xrep_findparent_from_dcache ( +struct xfs_scrub *sc) +{ +struct inode *pip =NULL ; +struct dentry *dentry, *parent; +xfs_ino_t ret =NULLFSINO ; + + dentry =d_find_alias (VFS_I (sc->ip)); +if (!dentry) + goto out; + + parent =dget_parent (dentry); +if (!parent) + goto out_dput; + +ASSERT (parent->d_sb == sc->ip->i_mount->m_super); + + pip =igrab (d_inode (parent)); +dput (parent); + +if (S_ISDIR (pip->i_mode)) { +trace_xrep_findparent_from_dcache (sc->ip,XFS_I (pip)->i_ino); + ret =XFS_I (pip)->i_ino; + } + +xchk_irele (sc,XFS_I (pip)); + +out_dput: +dput (dentry); +out: +return ret; +}
fs/xfs/scrub/findparent.h +1 -0
@@ -45,5 +45,6 @@ void xrep_findparent_scan_finish_early(struct xrep_parent_scan_info *pscan,int xrep_findparent_confirm (struct xfs_scrub *sc,xfs_ino_t *parent_ino);xfs_ino_t xrep_findparent_self_reference (struct xfs_scrub *sc); +xfs_ino_t xrep_findparent_from_dcache (struct xfs_scrub *sc);#endif /* __XFS_SCRUB_FINDPARENT_H__ */
fs/xfs/scrub/parent_repair.c +13 -0
@@ -118,7 +118,20 @@ xrep_parent_find_dotdot(* then retake the ILOCK so that we can salvage directory entries. */ xchk_iunlock (sc,XFS_ILOCK_EXCL ); + +/* Does the VFS dcache have an answer for us? */ + ino =xrep_findparent_from_dcache (sc); +if (ino !=NULLFSINO ) { + error =xrep_findparent_confirm (sc, &ino); +if (!error && ino !=NULLFSINO ) { +xrep_findparent_scan_finish_early (&rp->pscan, ino); + goto out_relock; + } + } + +/* Scan the entire filesystem for a parent. */ error =xrep_findparent_scan (&rp->pscan); +out_relock:xchk_ilock (sc,XFS_ILOCK_EXCL );return error;
fs/xfs/scrub/trace.h +1 -0
@@ -2613,6 +2613,7 @@ DEFINE_EVENT(xrep_parent_salvage_class, name, \ TP_ARGS(dp, ino))DEFINE_XREP_PARENT_SALVAGE_EVENT (xrep_dir_salvaged_parent);DEFINE_XREP_PARENT_SALVAGE_EVENT (xrep_findparent_dirent); +DEFINE_XREP_PARENT_SALVAGE_EVENT (xrep_findparent_from_dcache);#endif /* IS_ENABLED(CONFIG_XFS_ONLINE_REPAIR) */
Re: [PATCH v30.2 5/5] xfs: ask the dentry cache if it knows the parent of a directory
Looks good:
PATCH 11/15 xfs: move orphan files to lost and found
In reply to Darrick J. WongHi all,
Orphaned files are defined to be files with nonzero ondisk link count but no observable parent directory. This series enables online repair to reparent orphaned files into the filesystem directory tree, and wires up this reparenting ability into the directory, file link count, and parent pointer repair functions. This is how we fix files with positive link count that are not reachable through the directory tree.
This patch will also create the orphanage directory (lost+found) if it is not present. In contrast to xfs_repair, we follow e2fsck in creating the lost+found without group or other-owner access to avoid accidental disclosure of files that were previously hidden by an 0700 directory. That's silly security, but people have been known to do it.
If you're going to start using this code, I strongly recommend pulling from my git trees, which are linked below.
This has been running on the djcloud for months with no problems. Enjoy! Comments and questions are, as always, welcome.
--D
kernel git tree:
https://git.kernel.org/cgit/linux/kernel/git/djwong/xfs-linux.git/log/?h=repair-orphanage
---
Commits in this patchset:
* xfs: move orphan files to the orphanage
* xfs: move files to orphanage instead of letting nlinks drop to zero
* xfs: ensure dentry consistency when the orphanage adopts a file
--- .../filesystems/xfs/xfs-online-fsck-design.rst | 20 - fs/xfs/Makefile | 1 fs/xfs/scrub/dir_repair.c | 130 ++++ fs/xfs/scrub/nlinks.c | 11 fs/xfs/scrub/nlinks.h | 6 fs/xfs/scrub/nlinks_repair.c | 124 ++++ fs/xfs/scrub/orphanage.c | 587 ++++++++++++++++++++ fs/xfs/scrub/orphanage.h | 75 +++ fs/xfs/scrub/parent_repair.c | 98 +++ fs/xfs/scrub/repair.h | 2 fs/xfs/scrub/scrub.c | 2 fs/xfs/scrub/scrub.h | 4 fs/xfs/scrub/trace.c | 1 fs/xfs/scrub/trace.h | 96 +++ fs/xfs/xfs_inode.c | 6 fs/xfs/xfs_inode.h | 1 16 files changed, 1130 insertions(+), 34 deletions(-) create mode 100644 fs/xfs/scrub/orphanage.c create mode 100644 fs/xfs/scrub/orphanage.h
PATCH 1/3 xfs: move orphan files to the orphanage
From: Darrick J. Wong <[email protected]>
When we're repairing a directory structure or fixing the dotdot entry of a subdirectory, it's possible that we won't ever find a parent for the subdirectory. When this is the case, move it to the orphanage, aka /lost+found.
--- .../filesystems/xfs/xfs-online-fsck-design.rst | 19 + fs/xfs/Makefile | 1 fs/xfs/scrub/dir_repair.c | 130 +++++ fs/xfs/scrub/orphanage.c | 499 ++++++++++++++++++++ fs/xfs/scrub/orphanage.h | 75 +++ fs/xfs/scrub/parent_repair.c | 98 ++++ fs/xfs/scrub/scrub.c | 2 fs/xfs/scrub/scrub.h | 4 fs/xfs/scrub/trace.h | 28 + fs/xfs/xfs_inode.c | 6 fs/xfs/xfs_inode.h | 1 11 files changed, 843 insertions(+), 20 deletions(-) create mode 100644 fs/xfs/scrub/orphanage.c create mode 100644 fs/xfs/scrub/orphanage.h
Documentation/filesystems/xfs/xfs-online-fsck-design.rst +13 -6
@@ -4778,14 +4778,21 @@ Orphaned files are adopted by the orphanage as follows: The ``xrep_orphanage_iolock_two`` function follows the inode locking strategy discussed earlier. -3. Call ``xrep_orphanage_compute_blkres`` and ``xrep_orphanage_compute_name`` - to compute the new name in the orphanage and the block reservation required. - -4. Use ``xrep_orphanage_adoption_prep`` to reserve resources to the repair +3. Use ``xrep_adoption_trans_alloc`` to reserve resources to the repair transaction. -5. Call ``xrep_orphanage_adopt`` to reparent the orphaned file into the lost - and found, and update the kernel dentry cache. +4. Call ``xrep_orphanage_compute_name`` to compute the new name in the + orphanage. + +5. If the adoption is going to happen, call ``xrep_adoption_reparent`` to + reparent the orphaned file into the lost and found and invalidate the dentry + cache. + +6. Call ``xrep_adoption_finish`` to commit any filesystem updates, release the + orphanage ILOCK, and clean the scrub transaction. + +7. If a runtime error happens, call ``xrep_adoption_cancel`` to release all + resources. The proposed patches are in the `orphanage adoption
fs/xfs/Makefile +1 -0
@@ -205,6 +205,7 @@ xfs-y += $(addprefix scrub/, \ inode_repair.o \ newbt.o \ nlinks_repair.o \ + orphanage.o \ parent_repair.o \ rcbag_btree.o \ rcbag.o \
fs/xfs/scrub/dir_repair.c +121 -9
192 lines not on this page · raw message
fs/xfs/scrub/orphanage.c new file +499 -0
499 lines not on this page · raw message
fs/xfs/scrub/orphanage.h new file +75 -0
75 lines not on this page · raw message
fs/xfs/scrub/parent_repair.c +96 -2
128 lines not on this page · raw message
fs/xfs/scrub/scrub.c +2 -0
@@ -27,6 +27,7 @@#include "scrub/stats.h" #include "scrub/xfile.h" #include "scrub/tempfile.h" +#include "scrub/orphanage.h" /* * Online Scrub and Repair
@@ -217,6 +218,7 @@ xchk_teardown( }xrep_tempfile_rele (sc); +xrep_orphanage_rele (sc);xchk_fsgates_disable (sc);return error; }
fs/xfs/scrub/scrub.h +4 -0
@@ -105,6 +105,10 @@ struct xfs_scrub {/* Lock flags for @ip. */ uint ilock_flags; +/* The orphanage, for stashing files that have lost their parent. */ +uint orphanage_ilock_flags; +struct xfs_inode *orphanage; +/* A temporary file on this filesystem, for staging new metadata. */ struct xfs_inode *tempip;uint temp_ilock_flags;
fs/xfs/scrub/trace.h +28 -0
@@ -2582,6 +2582,34 @@ DEFINE_EVENT(xrep_dirent_class, name, \DEFINE_XREP_DIRENT_EVENT (xrep_dir_salvage_entry);DEFINE_XREP_DIRENT_EVENT (xrep_dir_stash_createname);DEFINE_XREP_DIRENT_EVENT (xrep_dir_replay_createname); +DEFINE_XREP_DIRENT_EVENT (xrep_adoption_reparent); + +DECLARE_EVENT_CLASS (xrep_adoption_class, + TP_PROTO(struct xfs_inode *dp, struct xfs_inode *ip, bool moved), +TP_ARGS (dp, ip, moved), +TP_STRUCT__entry ( + __field(dev_t, dev) + __field(xfs_ino_t, dir_ino) + __field(xfs_ino_t, child_ino) +__field (bool, moved) + ), +TP_fast_assign ( + __entry->dev = dp->i_mount->m_super->s_dev; + __entry->dir_ino = dp->i_ino; + __entry->child_ino = ip->i_ino; + __entry->moved = moved; + ), +TP_printk ("dev %d:%d dir 0x%llx child 0x%llx moved? %d" , +MAJOR (__entry->dev),MINOR (__entry->dev), + __entry->dir_ino, + __entry->child_ino, + __entry->moved) +); +#define DEFINE_XREP_ADOPTION_EVENT (name) \ +DEFINE_EVENT(xrep_adoption_class, name, \ + TP_PROTO(struct xfs_inode *dp, struct xfs_inode *ip, bool moved), \ + TP_ARGS(dp, ip, moved)) +DEFINE_XREP_ADOPTION_EVENT (xrep_adoption_trans_roll); DECLARE_EVENT_CLASS(xrep_parent_salvage_class, TP_PROTO(struct xfs_inode *dp, xfs_ino_t ino),
fs/xfs/xfs_inode.c +3 -3
@@ -914,10 +914,10 @@ xfs_droplink(/* * Increment the link count on an inode & log the change. */ -static void +void xfs_bumplink ( -xfs_trans_t *tp, -xfs_inode_t *ip) +struct xfs_trans *tp, +struct xfs_inode *ip) {xfs_trans_ichgtime (tp, ip,XFS_ICHGTIME_CHG );
fs/xfs/xfs_inode.h +1 -0
@@ -625,6 +625,7 @@ void xfs_end_io(struct work_struct *work);int xfs_ilock2_io_mmap (struct xfs_inode *ip1,struct xfs_inode *ip2);void xfs_iunlock2_io_mmap (struct xfs_inode *ip1,struct xfs_inode *ip2);void xfs_iunlock2_remapping (struct xfs_inode *ip1,struct xfs_inode *ip2); +void xfs_bumplink (struct xfs_trans *tp,struct xfs_inode *ip);static inline bool xfs_inode_unlinked_incomplete(
PATCH 2/3 xfs: move files to orphanage instead of letting nlinks drop to zero
In reply to Darrick J. WongFrom: Darrick J. Wong <[email protected]>
If we encounter an inode with a nonzero link count but zero observed links, move it to the orphanage.
--- .../filesystems/xfs/xfs-online-fsck-design.rst | 3 fs/xfs/scrub/nlinks.c | 11 ++ fs/xfs/scrub/nlinks.h | 6 + fs/xfs/scrub/nlinks_repair.c | 124 ++++++++++++++++++-- fs/xfs/scrub/repair.h | 2 fs/xfs/scrub/trace.c | 1 fs/xfs/scrub/trace.h | 26 ++++ 7 files changed, 158 insertions(+), 15 deletions(-)
Documentation/filesystems/xfs/xfs-online-fsck-design.rst +2 -1
@@ -4789,7 +4789,8 @@ Orphaned files are adopted by the orphanage as follows: cache. 6. Call ``xrep_adoption_finish`` to commit any filesystem updates, release the - orphanage ILOCK, and clean the scrub transaction. + orphanage ILOCK, and clean the scrub transaction. Call + ``xrep_adoption_commit`` to commit the updates and the scrub transaction. 7. If a runtime error happens, call ``xrep_adoption_cancel`` to release all resources.
fs/xfs/scrub/nlinks.c +10 -1
@@ -24,6 +24,7 @@#include "scrub/xfile.h" #include "scrub/xfarray.h" #include "scrub/iscan.h" +#include "scrub/orphanage.h" #include "scrub/nlinks.h" #include "scrub/trace.h" #include "scrub/readdir.h"
@@ -44,9 +45,17 @@ intxchk_setup_nlinks ( struct xfs_scrub *sc) { +int error; +xchk_fsgates_enable (sc,XCHK_FSGATES_DIRENTS ); - sc->buf =kzalloc (sizeof (struct xchk_nlink_ctrs ),XCHK_GFP_FLAGS ); +if (xchk_could_repair (sc)) { + error =xrep_setup_nlinks (sc); +if (error) +return error; + } + + sc->buf =kvzalloc (sizeof (struct xchk_nlink_ctrs ),XCHK_GFP_FLAGS );if (!sc->buf)return -ENOMEM ;
fs/xfs/scrub/nlinks.h +6 -0
@@ -28,6 +28,12 @@ struct xchk_nlink_ctrs {* from other writer threads. */ struct xfs_dir_hook dhook; + +/* Orphanage reparenting request. */ +struct xrep_adoption adoption; + +/* Directory entry name, plus the trailing null. */ +char namebuf[MAXNAMELEN ]; };/*
fs/xfs/scrub/nlinks_repair.c +111 -13
173 lines not on this page · raw message
fs/xfs/scrub/repair.h +2 -0
@@ -93,6 +93,7 @@ int xrep_setup_ag_refcountbt(struct xfs_scrub *sc);int xrep_setup_xattr (struct xfs_scrub *sc);int xrep_setup_directory (struct xfs_scrub *sc);int xrep_setup_parent (struct xfs_scrub *sc); +int xrep_setup_nlinks (struct xfs_scrub *sc);/* Repair setup functions */ int xrep_setup_ag_allocbt (struct xfs_scrub *sc);
@@ -201,6 +202,7 @@ xrep_setup_nothing(#define xrep_setup_xattr xrep_setup_nothing#define xrep_setup_directory xrep_setup_nothing#define xrep_setup_parent xrep_setup_nothing +#define xrep_setup_nlinks xrep_setup_nothing#define xrep_setup_inode (sc, imap) ((void)0)
fs/xfs/scrub/trace.c +1 -0
@@ -24,6 +24,7 @@#include "scrub/xfarray.h" #include "scrub/quota.h" #include "scrub/iscan.h" +#include "scrub/orphanage.h" #include "scrub/nlinks.h" #include "scrub/fscounters.h"
fs/xfs/scrub/trace.h +26 -0
@@ -2637,6 +2637,32 @@ DEFINE_XREP_PARENT_SALVAGE_EVENT(xrep_dir_salvaged_parent);DEFINE_XREP_PARENT_SALVAGE_EVENT (xrep_findparent_dirent);DEFINE_XREP_PARENT_SALVAGE_EVENT (xrep_findparent_from_dcache); +TRACE_EVENT (xrep_nlinks_set_record, + TP_PROTO(struct xfs_mount *mp, xfs_ino_t ino, + const struct xchk_nlink *obs), +TP_ARGS (mp, ino, obs), +TP_STRUCT__entry ( + __field(dev_t, dev) + __field(xfs_ino_t, ino) + __field(xfs_nlink_t, parents) + __field(xfs_nlink_t, backrefs) +__field (xfs_nlink_t, children) + ), +TP_fast_assign ( + __entry->dev = mp->m_super->s_dev; + __entry->ino = ino; + __entry->parents = obs->parents; + __entry->backrefs = obs->backrefs; + __entry->children = obs->children; + ), +TP_printk ("dev %d:%d ino 0x%llx parents %u backrefs %u children %u" , +MAJOR (__entry->dev),MINOR (__entry->dev), + __entry->ino, + __entry->parents, + __entry->backrefs, + __entry->children) +); +#endif /* IS_ENABLED(CONFIG_XFS_ONLINE_REPAIR) */ #endif /* _TRACE_XFS_SCRUB_TRACE_H */