Skip to content

THP support for PPC64

Aneesh Kumar K.V linux-mm linuxppc-dev 1 version In review

Get series with b4
b4 am 1361865914-13911-1-git-send-email-aneesh.kumar@linux.vnet.ibm.com

Versions newest first

  1. v1 Latest24 patches 20 repliesIn review

Changes from RFC V2 from the cover letter

* Address review comments
* More code cleanup and patch split

Patches in v1 No applies recorded yet

#Subject and filesSizeRepliesApplied
1/24powerpc: Use signed formatting when printing errorarch/powerpc/platforms/pseries/lpar.c+1 -10 replies
2/24powerpc: Save DAR and DSISR in pt_regs on MCEarch/powerpc/kernel/exceptions-64s.S arch/powerpc/xmon/xmon.c+10 -10 replies
3/24powerpc: Don't hard code the size of pte pagearch/powerpc/include/asm/pgtable.h arch/powerpc/mm/hash_low_64.S+8 -21 reply
4/24powerpc: Reduce the PTE_INDEX_SIZEarch/powerpc/include/asm/pgtable-ppc64-64k.h+2 -20 replies
5/24powerpc: Move the pte free routines from common headerarch/powerpc/include/asm/pgalloc-32.h arch/powerpc/include/asm/pgalloc-64.h arch/powerpc/include/asm/pgalloc.h+92 -451 reply
6/24powerpc: Reduce PTE table memory wastagearch/powerpc/include/asm/mmu-book3e.h arch/powerpc/include/asm/mmu-hash64.h arch/powerpc/include/asm/page.h +4 more+314 -427 replies
7/24powerpc: Add size argument to pgtable_cache_addarch/powerpc/include/asm/pgtable-ppc64.h arch/powerpc/mm/init_64.c+14 -94 replies
8/24powerpc: Use encode avpn where we need only avpn valuesarch/powerpc/mm/hash_native_64.c arch/powerpc/platforms/cell/beat_htab.c arch/powerpc/platforms/ps3/htab.c+10 -101 reply
9/24powerpc: Decode the pte-lp-encoding bits correctly.arch/powerpc/include/asm/machdep.h arch/powerpc/include/asm/mmu-hash64.h arch/powerpc/kvm/book3s_hv.c +7 more+169 -1046 replies
10/24powerpc: Return all the valid pte ecndoing in KVM_PPC_GET_SMMU_INFO ioctlarch/powerpc/kvm/book3s_hv.c+9 -20 replies
11/24powerpc: Update tlbie/tlbiel as per ISA docarch/powerpc/mm/hash_native_64.c+40 -120 replies
12/24powerpc: print both base and actual page size on hash failurearch/powerpc/include/asm/mmu-hash64.h arch/powerpc/mm/hash_utils_64.c arch/powerpc/mm/hugetlbpage-hash64.c+10 -70 replies
13/24powerpc: Print page size info during bootarch/powerpc/mm/hash_utils_64.c+5 -50 replies
14/24powerpc: Fix hpte_decode to use the correct decoding for page sizesarch/powerpc/mm/hash_native_64.c+17 -100 replies
15/24mm/THP: HPAGE_SHIFT is not a #define on some archinclude/linux/huge_mm.h mm/huge_memory.c+6 -60 replies
16/24mm/THP: Add pmd args to pgtable deposit and withdraw APIsarch/s390/include/asm/pgtable.h arch/s390/mm/pgtable.c arch/sparc/include/asm/pgtable_64.h +4 more+27 -210 replies
17/24mm/THP: withdraw the pgtable after pmdp related operationsmm/huge_memory.c+2 -10 replies
18/24powerpc/THP: Implement transparent huge pages for ppc64arch/powerpc/include/asm/page.h arch/powerpc/include/asm/pgtable-ppc64-64k.h arch/powerpc/include/asm/pgtable-ppc64.h +5 more+597 -30 replies
19/24powerpc/THP: Differentiate THP PMD entries from HUGETLB PMD entriesarch/powerpc/include/asm/pgtable.h arch/powerpc/mm/pgtable.c arch/powerpc/mm/pgtable_64.c+17 -50 replies
20/24powerpc/THP: Add code to handle HPTE faults for large pagesarch/powerpc/include/asm/kvm_book3s_64.h arch/powerpc/include/asm/mmu-hash64.h arch/powerpc/include/asm/pgtable-ppc64.h +11 more+283 -420 replies
21/24powerpc: Handle huge page in perf callchainarch/powerpc/perf/callchain.c+21 -110 replies
22/24powerpc/THP: hypervisor require few WIMG bit setarch/powerpc/mm/hugepage-hash64.c+2 -00 replies
23/24powerpc/THP: get_user_pages_fast changesarch/powerpc/mm/gup.c+82 -20 replies
24/24powerpc/THP: Enable THP on PPC64arch/powerpc/include/asm/pgtable.h+28 -20 replies

Reviews trailers per patch

6 of 24 patches have a Reviewed-by or Acked-by.

PatchPaul Mackerras
1/24A-b
2/24A-b
3/24A-b
4/24A-b
5/24A-b
6/24
7/24
8/24A-b
9/24
10/24
11/24
12/24
13/24
14/24
15/24
16/24
17/24
18/24
19/24
20/24
21/24
22/24
23/24
24/24

Trailers given in replies are filled; those carried in the patches from earlier versions are outlined with dashes.

Read the v1 thread

Cover letter [PATCH -V1 00/24] THP support for PPC64

Hi,

This patchset adds transparent huge page support for PPC64.

I am marking the series to linux-mm because the PPC64 implementation required few interface changes to core THP code.

TODO:
* ppc64 KVM related changes
* batch support for hpte invalidate
* powernv still doesn't boot
* hash preload support in update_mmu_cache_pmd

Some numbers:

The latency measurements code from Anton found at
http://ozlabs.org/~anton/junkcode/latency2001.c

THP disabled 64K page size
------------------------
[root@llmp24l02 ~]# ./latency2001 8G
8589934592 731.73 cycles 205.77 ns
[root@llmp24l02 ~]# ./latency2001 8G
8589934592 743.39 cycles 209.05 ns
[root@llmp24l02 ~]#

THP disabled large page via hugetlbfs
-------------------------------------
[root@llmp24l02 ~]# ./latency2001 -l 8G
8589934592 416.09 cycles 117.01 ns
[root@llmp24l02 ~]# ./latency2001 -l 8G
8589934592 415.74 cycles 116.91 ns

THP enabled 64K page size.
----------------
[root@llmp24l02 ~]# ./latency2001 8G
8589934592 405.07 cycles 113.91 ns
[root@llmp24l02 ~]# ./latency2001 8G
8589934592 411.82 cycles 115.81 ns
[root@llmp24l02 ~]#

We are close to hugetlbfs in latency and we can achieve this with zero config/page reservation. Most of the allocations above are fault allocated. I haven't really measured the collapse alloc impact.

Another test that does 50000000 random access over 1GB area goes from 2.65 seconds to 1.07 seconds with this patchset.

Changes from RFC V2:
* Address review comments
* More code cleanup and patch split

Changes from RFC V1:
* HugeTLB fs now works
* Compile issues fixed
* rebased to v3.8
* Patch series reorded so that ppc64 cleanups and MM THP changes are moved early in the series. This should help in picking those patches early.

Thanks,
-aneesh

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to [email protected]. For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"[email protected]"> [email protected] </a>