Skip to content

xfs: scalability patchset for 2.6.38

Dave Chinner linux-xfs 1 version In review

Get series with b4
b4 am [email protected]

Versions newest first

  1. v1 Latest33 of 34 patches 18 repliesIn review

33 of 34 patches are in this archive. The cover letter announces 34.

Patches in v1 No applies recorded yet

#Subject and filesSizeRepliesApplied
1/34xfs: provide a inode iolock lockdep classfs/xfs/linux-2.6/xfs_super.c fs/xfs/xfs_iget.c fs/xfs/xfs_inode.h+23 -01 reply
2/34xfs: use KM_NOFS for allocations during attribute list operationsfs/xfs/xfs_attr_leaf.c+2 -21 reply
3/34lib: percpu counter add unless less than functionalityinclude/linux/percpu_counter.h lib/percpu_counter.c+106 -02 replies
4/34xfs: use generic per-cpu counter infrastructurefs/xfs/linux-2.6/xfs_linux.h fs/xfs/linux-2.6/xfs_super.c fs/xfs/xfs_fsops.c +2 more+171 -7230 replies
5/34xfs: demultiplex xfs_icsb_modify_counters()fs/xfs/xfs_bmap.c fs/xfs/xfs_fsops.c fs/xfs/xfs_mount.c +2 more+102 -1230 replies
6/34xfs: dynamic speculative EOF preallocationfs/xfs/xfs_fsops.c fs/xfs/xfs_iomap.c fs/xfs/xfs_mount.c +1 more+110 -108 replies
7/34xfs: don't truncate prealloc from frequently accessed inodesfs/xfs/xfs_inode.h fs/xfs/xfs_vnodeops.c+47 -271 reply
8/34xfs: rcu free inodesfs/xfs/xfs_iget.c+13 -10 replies
9/34xfs: convert inode cache lookups to use RCU lockingfs/xfs/linux-2.6/xfs_sync.c fs/xfs/xfs_iget.c fs/xfs/xfs_inode.c+141 -420 replies
10/34xfs: convert pag_ici_lock to a spin lockfs/xfs/linux-2.6/xfs_sync.c fs/xfs/xfs_ag.h fs/xfs/xfs_iget.c +1 more+11 -110 replies
11/34xfs: convert xfsbud shrinker to a per-buftarg shrinker.fs/xfs/linux-2.6/xfs_buf.c fs/xfs/linux-2.6/xfs_buf.h+27 -660 replies
12/34xfs: add a lru to the XFS buffer cachefs/xfs/linux-2.6/xfs_buf.c fs/xfs/linux-2.6/xfs_buf.h+150 -220 replies
13/34xfs: connect up buffer reclaim priority hooksfs/xfs/linux-2.6/xfs_buf.h fs/xfs/xfs_btree.c fs/xfs/xfs_inode.c +1 more+14 -90 replies
14/34xfs: fix EFI transaction cancellation.fs/xfs/xfs_extfree_item.c fs/xfs/xfs_extfree_item.h+9 -120 replies
15/34xfs: Pull EFI/EFD handling out from under the AIL lockfs/xfs/xfs_extfree_item.c fs/xfs/xfs_extfree_item.h fs/xfs/xfs_log_recover.c +1 more+59 -490 replies
16/34xfs: clean up xfs_ail_delete()fs/xfs/xfs_trans_ail.c+7 -200 replies
17/34xfs: bulk AIL insertion during transaction commitfs/xfs/xfs_log_cil.c fs/xfs/xfs_trans.c fs/xfs/xfs_trans_ail.c +1 more+195 -120 replies
18/34xfs: reduce the number of AIL push wakeupsfs/xfs/linux-2.6/xfs_super.c+16 -40 replies
19/34xfs: consume iodone callback items on buffers as they are processedfs/xfs/xfs_buf_item.c+21 -110 replies
20/34xfs: remove all the inodes on a buffer from the AIL in bulkfs/xfs/xfs_inode_item.c fs/xfs/xfs_trans_ail.c fs/xfs/xfs_trans_priv.h+151 -162 replies
22/34xfs: use AIL bulk delete function to implement single deletefs/xfs/xfs_trans_ail.c fs/xfs/xfs_trans_priv.h+11 -720 replies
23/34xfs: convert log grant ticket queues to list headsfs/xfs/linux-2.6/xfs_trace.h fs/xfs/xfs_log.c fs/xfs/xfs_log_priv.h+53 -970 replies
24/34xfs: fact out common grant head/log tail verification codefs/xfs/xfs_log.c+22 -290 replies
25/34xfs: rework log grant space calculationsfs/xfs/xfs_log.c+48 -470 replies
26/34xfs: combine grant heads into a single 64 bit integerfs/xfs/linux-2.6/xfs_trace.h fs/xfs/xfs_log.c fs/xfs/xfs_log_priv.h +1 more+119 -910 replies
27/34xfs: use wait queues directly for the log wait queuesfs/xfs/linux-2.6/sv.h fs/xfs/linux-2.6/xfs_linux.h fs/xfs/quota/xfs_dquot.c +3 more+52 -1060 replies
28/34xfs: make AIL tail pushing independent of the grant lockfs/xfs/xfs_log.c+54 -570 replies
29/34xfs: convert l_last_sync_lsn to an atomic variablefs/xfs/xfs_log.c fs/xfs/xfs_log_priv.h fs/xfs/xfs_log_recover.c+36 -340 replies
30/34xfs: convert l_tail_lsn to an atomic variable.fs/xfs/linux-2.6/xfs_trace.h fs/xfs/xfs_log.c fs/xfs/xfs_log_priv.h +1 more+63 -462 replies
31/34xfs: convert log grant heads to atomic variablesfs/xfs/xfs_log.c fs/xfs/xfs_log_priv.h+10 -100 replies
32/34xfs: introduce new locks for the log grant ticket wait queuesfs/xfs/linux-2.6/xfs_trace.h fs/xfs/xfs_log.c fs/xfs/xfs_log_priv.h+97 -600 replies
33/34xfs: convert grant head manipulations to lockless algorithmfs/xfs/xfs_log.c fs/xfs/xfs_log_priv.h+49 -770 replies
34/34xfs: kill useless spinlock_destroy macrofs/xfs/linux-2.6/xfs_linux.h fs/xfs/xfs_log.c+0 -40 replies

Reviews trailers per patch

32 of 33 patches have a Reviewed-by or Acked-by.

PatchChristoph HellwigAlex ElderPaul E. McKenney
1/34R-b
2/34R-b
3/34
4/34R-b
5/34R-b
6/34R-b R-b R-b R-b
7/34R-b
8/34R-b
9/34R-b
10/34R-b R-b
11/34R-b R-b
12/34R-b
13/34R-b
14/34R-b
15/34R-b
16/34R-b
17/34R-b
18/34R-b
19/34R-b
20/34R-b
22/34R-b
23/34R-b
24/34R-b
25/34R-b
26/34R-b
27/34R-b
28/34R-b
29/34R-b
30/34R-b
31/34R-b
32/34R-b
33/34R-b
34/34R-b

Trailers given in replies are filled; those carried in the patches from earlier versions are outlined with dashes. Scroll the table sideways for all 3 reviewers.

Read the v1 thread

Cover letter [PATCH 00/34] xfs: scalability patchset for 2.6.38

Folks,

I'm sending the entire series of scalability patches in a single patchbomb because I'm tired and it's too much like hard work to send it out in multiple patchsets (i.e. I'm being lazy). Overall there are relatively few changes:

- new patch for iolock lockdep annotations
- new patch for allocations under ilock

rcu inode freeing and lookup:
- reworked reclaim to use rcu read locking
- removed synchronise_rcu() from lookup failure
- cleaned up validity checks, added comments and rcu_read_lock_held annotations

AIL locking
- fixed aild sleep to use TASK_INTERRUPTABLE

Log grant scaling
- made reserveq/writeq tracing just indicate if there are queued tickets.
- cleaned up some minor formatting nitpicks suggested by Christoph
- split xlog_space_left() into __xlog_space_left() for AIl tail pushing to work off a single tail lsn value.

I'm mainly concerned with getting reviews for the few remaining patches that don't currently have reviewed-by tags. Christoph, I think I've fixed all the things your last round of comments covered, so there should be relatively little remaining to be fixed up.

The series is in the following git tree which is based on the current OSS xfs tree. Alex, once I get the remaining reviews complete I'll update the branch and send you a pull request.

The following changes since commit 489a150f6454e2cd93d9e0ee6d7c5a361844f62a:

xfs: factor duplicate code in xfs_alloc_ag_vextent_near into a helper (2010-12-16 16:06:15 -0600)

are available in the git repository at:
git://git.kernel.org/pub/scm/linux/dgc/xfsdev.git xfs-for-2.6.38

Dave Chinner (34):
xfs: provide a inode iolock lockdep class
xfs: use KM_NOFS for allocations during attribute list operations
lib: percpu counter add unless less than functionality
xfs: use generic per-cpu counter infrastructure
xfs: demultiplex xfs_icsb_modify_counters()
xfs: dynamic speculative EOF preallocation
xfs: don't truncate prealloc from frequently accessed inodes
xfs: rcu free inodes
xfs: convert inode cache lookups to use RCU locking
xfs: convert pag_ici_lock to a spin lock
xfs: convert xfsbud shrinker to a per-buftarg shrinker.
xfs: add a lru to the XFS buffer cache
xfs: connect up buffer reclaim priority hooks
xfs: fix EFI transaction cancellation.
xfs: Pull EFI/EFD handling out from under the AIL lock
xfs: clean up xfs_ail_delete()
xfs: bulk AIL insertion during transaction commit
xfs: reduce the number of AIL push wakeups
xfs: consume iodone callback items on buffers as they are processed
xfs: remove all the inodes on a buffer from the AIL in bulk
xfs: use AIL bulk update function to implement single updates
xfs: use AIL bulk delete function to implement single delete
xfs: convert log grant ticket queues to list heads
xfs: fact out common grant head/log tail verification code
xfs: rework log grant space calculations
xfs: combine grant heads into a single 64 bit integer
xfs: use wait queues directly for the log wait queues
xfs: make AIL tail pushing independent of the grant lock
xfs: convert l_last_sync_lsn to an atomic variable
xfs: convert l_tail_lsn to an atomic variable.
xfs: convert log grant heads to atomic variables
xfs: introduce new locks for the log grant ticket wait queues
xfs: convert grant head manipulations to lockless algorithm
xfs: kill useless spinlock_destroy macro

 fs/xfs/linux-2.6/sv.h          |   59 ---
 fs/xfs/linux-2.6/xfs_buf.c     |  235 ++++++++----
 fs/xfs/linux-2.6/xfs_buf.h     |   22 +-
 fs/xfs/linux-2.6/xfs_linux.h   |   12 -
 fs/xfs/linux-2.6/xfs_super.c   |   26 +-
 fs/xfs/linux-2.6/xfs_sync.c    |   92 ++++-
 fs/xfs/linux-2.6/xfs_trace.h   |   30 +-
 fs/xfs/quota/xfs_dquot.c       |    1 -
 fs/xfs/xfs_ag.h                |    2 +-
 fs/xfs/xfs_attr_leaf.c         |    4 +-
 fs/xfs/xfs_bmap.c              |   34 +-
 fs/xfs/xfs_btree.c             |    9 +-
 fs/xfs/xfs_buf_item.c          |   32 +-
 fs/xfs/xfs_extfree_item.c      |   97 +++---
 fs/xfs/xfs_extfree_item.h      |   11 +-
 fs/xfs/xfs_fsops.c             |    8 +-
 fs/xfs/xfs_iget.c              |   90 ++++-
 fs/xfs/xfs_inode.c             |   54 ++-
 fs/xfs/xfs_inode.h             |   15 +-
 fs/xfs/xfs_inode_item.c        |   92 ++++-
 fs/xfs/xfs_iomap.c             |   84 ++++-
 fs/xfs/xfs_log.c               |  741 ++++++++++++++++--------------------
 fs/xfs/xfs_log_cil.c           |   17 +-
 fs/xfs/xfs_log_priv.h          |  121 +++++-
 fs/xfs/xfs_log_recover.c       |   35 +-
 fs/xfs/xfs_mount.c             |  821 ++++++++--------------------------------
 fs/xfs/xfs_mount.h             |   90 ++---
 fs/xfs/xfs_trans.c             |  102 +++++-
 fs/xfs/xfs_trans.h             |    2 +-
 fs/xfs/xfs_trans_ail.c         |  232 ++++++------
 fs/xfs/xfs_trans_extfree.c     |    8 +-
 fs/xfs/xfs_trans_priv.h        |   35 ++-
 fs/xfs/xfs_vnodeops.c          |   61 ++-
 include/linux/percpu_counter.h |   27 ++
 lib/percpu_counter.c           |   79 ++++
 35 files changed, 1698 insertions(+), 1682 deletions(-)
 delete mode 100644 fs/xfs/linux-2.6/sv.h

_______________________________________________
xfs mailing list
[email protected]
http://oss.sgi.com/mailman/listinfo/xfs