xfsprogs: everything I have for 6.12
PATCH v3 1/1 xfsprogs: everything I have for 6.12
Hi Andrey,
Please pull these patchsets for xfsprogs 6.12.
--D
[GIT PULL 1/7] libxfs: new code for 6.12
Hi Andrey,
Please pull this branch with changes for xfsprogs for 6.11-rc1.
As usual, I did a test-merge with the main upstream branch as of a few minutes ago, and didn't see any conflicts. Please let me know if you encounter any problems.
The following changes since commit 42523142959ddebd127a87e98879f9110da0cc7d:
xfsprogs: update gitignore (2024-10-08 14:31:31 +0200)
are available in the Git repository at:
https://git.kernel.org/pub/scm/linux/kernel/git/djwong/xfsprogs-dev.git tags/libxfs-sync-6.12_2024-10-31
for you to fetch changes up to 6611215e3d441a5e6d9d6a2f85c5ea1bf573a8d0:
xfs: update the pag for the last AG at recovery time (2024-10-31 15:45:04 -0700)
----------------------------------------------------------------
libxfs: new code for 6.12 [1/7]
New code for 6.12.
----------------------------------------------------------------
Andrey Albershteyn (1):
xfsprogs: Release v6.11.0
Christoph Hellwig (30):
libfrog: add xarray emulation
xfs: remove xfs_validate_rtextents
xfs: factor out a xfs_validate_rt_geometry helper
xfs: remove the limit argument to xfs_rtfind_back
xfs: assert a valid limit in xfs_rtfind_forw
xfs: add bounds checking to xfs_rt{bitmap,summary}_read_buf
xfs: factor out rtbitmap/summary initialization helpers
xfs: push transaction join out of xfs_rtbitmap_lock and xfs_rtgroup_lock
xfs: ensure rtx mask/shift are correct after growfs
xfs: remove xfs_rtb_to_rtxrem
xfs: simplify xfs_rtalloc_query_range
xfs: clean up the ISVALID macro in xfs_bmap_adjacent
xfs: remove xfs_{rtbitmap,rtsummary}_wordcount
xfs: replace m_rsumsize with m_rsumblocks
xfs: use kfree_rcu_mightsleep to free the perag structures
xfs: move the tagged perag lookup helpers to xfs_icache.c
xfs: convert perag lookup to xarray
xfs: ensure st_blocks never goes to zero during COW writes
xfs: merge xfs_attr_leaf_try_add into xfs_attr_leaf_addname
xfs: return bool from xfs_attr3_leaf_add
xfs: distinguish extra split from real ENOSPC from xfs_attr3_leaf_split
xfs: distinguish extra split from real ENOSPC from xfs_attr_node_try_addname
xfs: fold xfs_bmap_alloc_userdata into xfs_bmapi_allocate
xfs: don't ifdef around the exact minlen allocations
xfs: call xfs_bmap_exact_minlen_extent_alloc from xfs_bmap_btalloc
xfs: support lowmode allocations in xfs_bmap_exact_minlen_extent_alloc
xfs: pass the exact range to initialize to xfs_initialize_perag
xfs: merge the perag freeing helpers
xfs: don't use __GFP_RETRY_MAYFAIL in xfs_initialize_perag
xfs: update the pag for the last AG at recovery time
Dan Carpenter (1):
xfs: remove unnecessary check
Darrick J. Wong (8):
libxfs: require -std=gnu11 for compilation by default
libxfs: test compiling public headers with a C++ compiler
libxfs: port IS_ENABLED from the kernel
xfs: introduce new file range commit ioctls
xfs: pass the icreate args object to xfs_dialloc
xfs: fix a sloppy memory handling bug in xfs_iroot_realloc
xfs: replace shouty XFS_BM{BT,DR} macros
xfs: standardize the btree maxrecs function parameters
Dave Chinner (1):
xfs: use kvmalloc for xattr buffers
Pankaj Raghav (1):
xfs: enable block size larger than page size support
VERSION | 4 +- configure.ac | 15 ++- db/bmap.c | 10 +- db/bmap_inflate.c | 2 +- db/bmroot.c | 8 +- db/btheight.c | 18 +-- db/check.c | 11 +- db/frag.c | 8 +- db/iunlink.c | 2 +- db/metadump.c | 16 +-- debian/changelog | 6 + doc/CHANGES | 5 + include/builddefs.in | 8 ++ include/kmem.h | 11 ++ include/libxfs.h | 6 +- include/platform_defs.h | 63 ++++++++++ include/xfs_mount.h | 4 +- libfrog/radix-tree.h | 35 ++++++ libxfs/Makefile | 31 ++++- libxfs/defer_item.c | 14 +++ libxfs/init.c | 17 +-- libxfs/ioctl_c_dummy.c | 11 ++ libxfs/ioctl_cxx_dummy.cpp | 13 +++ libxfs/libxfs_api_defs.h | 2 +- libxfs/libxfs_priv.h | 6 +- libxfs/xfs_ag.c | 165 ++++++-------------------- libxfs/xfs_ag.h | 25 +--- libxfs/xfs_alloc.c | 7 +- libxfs/xfs_alloc.h | 4 +- libxfs/xfs_alloc_btree.c | 6 +- libxfs/xfs_alloc_btree.h | 3 +- libxfs/xfs_attr.c | 190 +++++++++++++----------------- libxfs/xfs_attr_leaf.c | 63 +++++----- libxfs/xfs_attr_leaf.h | 2 +- libxfs/xfs_bmap.c | 243 ++++++++++++++++----------------------- libxfs/xfs_bmap_btree.c | 24 ++-- libxfs/xfs_bmap_btree.h | 207 ++++++++++++++++++++++----------- libxfs/xfs_da_btree.c | 5 +- libxfs/xfs_fs.h | 26 +++++ libxfs/xfs_ialloc.c | 14 ++- libxfs/xfs_ialloc.h | 4 +- libxfs/xfs_ialloc_btree.c | 6 +- libxfs/xfs_ialloc_btree.h | 3 +- libxfs/xfs_inode_fork.c | 40 +++---- libxfs/xfs_inode_util.c | 2 +- libxfs/xfs_refcount_btree.c | 5 +- libxfs/xfs_refcount_btree.h | 3 +- libxfs/xfs_rmap_btree.c | 7 +- libxfs/xfs_rmap_btree.h | 3 +- libxfs/xfs_rtbitmap.c | 274 +++++++++++++++++++++++++++++++------------- libxfs/xfs_rtbitmap.h | 61 ++-------- libxfs/xfs_sb.c | 92 ++++++++------- libxfs/xfs_sb.h | 3 + libxfs/xfs_shared.h | 3 + libxfs/xfs_trans_resv.c | 4 +- libxfs/xfs_types.h | 12 -- m4/package_utilies.m4 | 5 + mkfs/proto.c | 17 ++- repair/bmap_repair.c | 2 +- repair/dinode.c | 17 +-- repair/phase5.c | 16 +-- repair/phase6.c | 18 ++- repair/prefetch.c | 8 +- repair/rt.c | 7 +- repair/scan.c | 6 +- 65 files changed, 1076 insertions(+), 852 deletions(-)
create mode 100644 libxfs/ioctl_c_dummy.c
create mode 100644 libxfs/ioctl_cxx_dummy.cpp
[GIT PULL 2/7] xfsprogs: atomic file content commits
In reply to Darrick J. WongHi Andrey,
Please pull this branch with changes for xfsprogs for 6.11-rc1.
As usual, I did a test-merge with the main upstream branch as of a few minutes ago, and didn't see any conflicts. Please let me know if you encounter any problems.
The following changes since commit 6611215e3d441a5e6d9d6a2f85c5ea1bf573a8d0:
xfs: update the pag for the last AG at recovery time (2024-10-31 15:45:04 -0700)
are available in the Git repository at:
https://git.kernel.org/pub/scm/linux/kernel/git/djwong/xfsprogs-dev.git tags/atomic-file-commits-6.12_2024-10-31
for you to fetch changes up to 1cf7afbc0c8bcb450ebc3acab7616c9da49087de:
xfs_io: add atomic file update commands to exercise file commit range (2024-10-31 15:45:04 -0700)
----------------------------------------------------------------
xfsprogs: atomic file content commits [v31.3 2/7]
This series creates XFS_IOC_START_COMMIT and XFS_IOC_COMMIT_RANGE ioctls to perform the exchange only if the target file has not been changed since a given sampling point.
This new functionality uses the mechanism underlying EXCHANGE_RANGE to stage and commit file updates such that reader programs will see either the old contents or the new contents in their entirety, with no chance of torn writes. A successful call completion guarantees that the new contents will be seen even if the system fails. The pair of ioctls allows userspace to perform what amounts to a compare and exchange operation on entire file contents.
Note that there are ongoing arguments in the community about how best to implement some sort of file data write counter that nfsd could also use to signal invalidations to clients. Until such a thing is implemented, this patch will rely on ctime/mtime updates.
----------------------------------------------------------------
Darrick J. Wong (7):
man: document file range commit ioctls
libfrog: add support for commit range ioctl family
libxfs: remove unused xfs_inode fields
libxfs: validate inumber in xfs_igetxfs_fsr: port to new file exchange library functionxfs_io: add a commitrange option to the exchangerange commandxfs_io: add atomic file update commands to exercise file commit range
fsr/xfs_fsr.c | 74 ++++---- include/xfs_inode.h | 4 - io/exchrange.c | 390 +++++++++++++++++++++++++++++++++++++- io/io.h | 4 + io/open.c | 27 ++- libfrog/file_exchange.c | 194 +++++++++++++++++++ libfrog/file_exchange.h | 10 + libxfs/inode.c | 2 +- man/man2/ioctl_xfs_commit_range.2 | 296 +++++++++++++++++++++++++++++ man/man2/ioctl_xfs_fsgeometry.2 | 2 +- man/man2/ioctl_xfs_start_commit.2 | 1 + man/man8/xfs_io.8 | 35 +++- 12 files changed, 983 insertions(+), 56 deletions(-)
create mode 100644 man/man2/ioctl_xfs_commit_range.2 create mode 100644 man/man2/ioctl_xfs_start_commit.2
[GIT PULL 3/7] xfs_db: debug realtime geometry
In reply to Darrick J. WongHi Andrey,
Please pull this branch with changes for xfsprogs for 6.11-rc1.
As usual, I did a test-merge with the main upstream branch as of a few minutes ago, and didn't see any conflicts. Please let me know if you encounter any problems.
The following changes since commit 1cf7afbc0c8bcb450ebc3acab7616c9da49087de:
xfs_io: add atomic file update commands to exercise file commit range (2024-10-31 15:45:04 -0700)
are available in the Git repository at:
https://git.kernel.org/pub/scm/linux/kernel/git/djwong/xfsprogs-dev.git tags/debug-realtime-geometry-6.12_2024-10-31
for you to fetch changes up to 5f10590bae67d7698191a1392b6b1d3ce4d11a0c:
xfs_db: convert rtsummary geometry (2024-10-31 15:45:05 -0700)
----------------------------------------------------------------xfs_db: debug realtime geometry [v5.3 3/7]
Before we start modernizing the realtime device, let's first make a few improvements to the XFS debugger to make our lives easier. First up is making it so that users can point the debugger at the block device containing the realtime section, and augmenting the io cursor code to be able to read blocks from the rt device. Next, we add a new geometry conversion command (rtconvert) to make it easier to go back and forth between rt blocks, rt extents, and the corresponding locations within the rt bitmap and summary files.
----------------------------------------------------------------
Darrick J. Wong (8):xfs_db: support passing the realtime device to the debuggerxfs_db: report the realtime device when associated with each io cursorxfs_db: make the daddr command target the realtime devicexfs_db: access realtime file blocksxfs_db: access arbitrary realtime blocks and extentsxfs_db: enable conversion of rt space unitsxfs_db: convert rtbitmap geometryxfs_db: convert rtsummary geometry
db/block.c | 171 ++++++++++++++++++++- db/block.h | 20 +++ db/convert.c | 438 +++++++++++++++++++++++++++++++++++++++++++++++++++--- db/faddr.c | 5 +- db/init.c | 7 +- db/io.c | 39 ++++- db/io.h | 3 + db/xfs_admin.sh | 4 +- man/man8/xfs_db.8 | 131 +++++++++++++++- 9 files changed, 778 insertions(+), 40 deletions(-)
[GIT PULL 4/7] xfs_metadump: support external devices
In reply to Darrick J. WongHi Andrey,
Please pull this branch with changes for xfsprogs for 6.11-rc1.
As usual, I did a test-merge with the main upstream branch as of a few minutes ago, and didn't see any conflicts. Please let me know if you encounter any problems.
The following changes since commit 5f10590bae67d7698191a1392b6b1d3ce4d11a0c:
xfs_db: convert rtsummary geometry (2024-10-31 15:45:05 -0700)
are available in the Git repository at:
https://git.kernel.org/pub/scm/linux/kernel/git/djwong/xfsprogs-dev.git tags/metadump-external-devices-6.12_2024-10-31
for you to fetch changes up to 5e8139658b798d931079404660273840432bcd9f:
xfs_db: allow setting current address to log blocks (2024-10-31 15:45:05 -0700)
----------------------------------------------------------------xfs_metadump: support external devices [v5.3 4/7]
This series augments the xfs_metadump and xfs_mdrestore utilities to capture the contents of an external log in a metadump, and restore it on the other end. This will enable better debugging analysis of broken filesystems, since it will now be possible to capture external log data. This is a prequisite for the rt groups feature, since we'll also need to capture the rt superblocks written to the rt device.
This also means we can capture the contents of external logs for better analysis by support staff.
----------------------------------------------------------------
Darrick J. Wong (1):xfs_db: allow setting current address to log blocks
db/block.c | 103 +++++++++++++++++++++++++++++++++++++++++++++++++++++-
man/man8/xfs_db.8 | 17 +++++++++
2 files changed, 119 insertions(+), 1 deletion(-)
[GIT PULL 5/7] mkfs/repair: use new rtbitmap helpers
In reply to Darrick J. WongHi Andrey,
Please pull this branch with changes for xfsprogs for 6.11-rc1.
As usual, I did a test-merge with the main upstream branch as of a few minutes ago, and didn't see any conflicts. Please let me know if you encounter any problems.
The following changes since commit 5e8139658b798d931079404660273840432bcd9f:
xfs_db: allow setting current address to log blocks (2024-10-31 15:45:05 -0700)
are available in the Git repository at:
https://git.kernel.org/pub/scm/linux/kernel/git/djwong/xfsprogs-dev.git tags/misc-use-rtbitmap-helpers-6.12_2024-10-31
for you to fetch changes up to 07c09d46665cfac48256f6faf829897554ec74bf:
xfs_repair: stop preallocating blocks in mk_rbmino and mk_rsumino (2024-10-31 15:45:05 -0700)
----------------------------------------------------------------
mkfs/repair: use new rtbitmap helpers [v5.3 5/7]
Use the new rtfile helpers to create the rt bitmap and summary files instead of duplicating the logic that the in-kernel growfs already had.
----------------------------------------------------------------
Christoph Hellwig (5):xfs_repair: use xfs_validate_rt_geometry
mkfs: remove a pointless rtfreesp_init forward declaration
mkfs: use xfs_rtfile_initialize_blocksxfs_repair: use libxfs_rtfile_initialize_blocksxfs_repair: stop preallocating blocks in mk_rbmino and mk_rsumino
Darrick J. Wong (1):xfs_repair: checking rt free space metadata must happen during phase 4
libxfs/libxfs_api_defs.h | 2 + mkfs/proto.c | 107 +++--------------- repair/phase4.c | 7 ++ repair/phase5.c | 6 - repair/phase6.c | 284 ++++++++--------------------------------------- repair/sb.c | 40 +------ repair/xfs_repair.c | 3 - 7 files changed, 73 insertions(+), 376 deletions(-)
[GIT PULL 6/7] xfs_scrub_all: bug fix for 6.12
In reply to Darrick J. WongHi Andrey,
Please pull this branch with changes for xfsprogs for 6.11-rc1.
As usual, I did a test-merge with the main upstream branch as of a few minutes ago, and didn't see any conflicts. Please let me know if you encounter any problems.
The following changes since commit 07c09d46665cfac48256f6faf829897554ec74bf:
xfs_repair: stop preallocating blocks in mk_rbmino and mk_rsumino (2024-10-31 15:45:05 -0700)
are available in the Git repository at:
https://git.kernel.org/pub/scm/linux/kernel/git/djwong/xfsprogs-dev.git tags/scrub-fixes-6.12_2024-10-31
for you to fetch changes up to 024f91c02f22a6f1f1256a5b09323bc3b104f839:
xfs_scrub_all: wait for services to start activating (2024-10-31 15:45:05 -0700)
----------------------------------------------------------------xfs_scrub_all: bug fix for 6.12 [v31.3 6/7]
Fix a problem with xfs_scrub_all mistakenly thinking that a service finished before it really did.
----------------------------------------------------------------
Darrick J. Wong (1):xfs_scrub_all: wait for services to start activating
scrub/xfs_scrub_all.in | 52 ++++++++++++++++++++++++++++++++++++++++++++++++++
1 file changed, 52 insertions(+)
[GIT PULL 7/7] mkfs: new config file for 6.12 LTS
In reply to Darrick J. WongHi Andrey,
Please pull this branch with changes for xfsprogs for 6.11-rc1.
As usual, I did a test-merge with the main upstream branch as of a few minutes ago, and didn't see any conflicts. Please let me know if you encounter any problems.
The following changes since commit 024f91c02f22a6f1f1256a5b09323bc3b104f839:
xfs_scrub_all: wait for services to start activating (2024-10-31 15:45:05 -0700)
are available in the Git repository at:
https://git.kernel.org/pub/scm/linux/kernel/git/djwong/xfsprogs-dev.git tags/mkfs-configs-6.12_2024-10-31
for you to fetch changes up to d19c5581b03e236de3737a35e53c99529ac8e912:
mkfs: add a config file for 6.12 LTS kernels (2024-10-31 15:45:05 -0700)
----------------------------------------------------------------
mkfs: new config file for 6.12 LTS [7/7]
New mkfs config file for 6.12 LTS.
----------------------------------------------------------------
Darrick J. Wong (1):
mkfs: add a config file for 6.12 LTS kernels
mkfs/Makefile | 3 ++-mkfs/lts_6.12.conf | 19 +++++++++++++++++++
2 files changed, 21 insertions(+), 1 deletion(-)
create mode 100644 mkfs/lts_6.12.conf