THP support for PPC64
Get series with b4
b4 am 1363340407-22619-1-git-send-email-aneesh.kumar@linux.vnet.ibm.comVersions newest first
- v1 Latest25 patches 0 repliesNew
Change from V2 from the cover letter
* Change patch "powerpc: Reduce PTE table memory wastage" to use much simpler approach for PTE page sharing.
* Changes to handle huge pages in KVM code.
* Address other review comments
Patches in v1 No applies recorded yet
| # | Subject and files | Size | Replies | Applied |
|---|---|---|---|---|
| 1/25 | powerpc: Use signed formatting when printing errorarch/ | +1 | 0 replies | |
| 2/25 | powerpc: Save DAR and DSISR in pt_regs on MCEarch/ arch/ | +10 | 0 replies | |
| 3/25 | powerpc: Don't hard code the size of pte pagearch/ arch/ | +8 | 0 replies | |
| 4/25 | powerpc: Reduce the PTE_INDEX_SIZEarch/ | +2 | 0 replies | |
| 5/25 | powerpc: Move the pte free routines from common headerarch/ arch/ arch/ | +189 | 0 replies | |
| 6/25 | powerpc: Reduce PTE table memory wastagearch/ arch/ arch/ +4 more | +209 | 0 replies | |
| 7/25 | powerpc: Use encode avpn where we need only avpn valuesarch/ arch/ arch/ | +10 | 0 replies | |
| 8/25 | powerpc: Decode the pte-lp-encoding bits correctly.arch/ arch/ arch/ +7 more | +214 | 0 replies | |
| 9/25 | powerpc: Fix hpte_decode to use the correct decoding for page sizesarch/ | +24 | 0 replies | |
| 10/25 | powerpc: Return all the valid pte ecndoing in KVM_PPC_GET_SMMU_INFO ioctlarch/ | +12 | 0 replies | |
| 11/25 | powerpc: Update tlbie/tlbiel as per ISA docarch/ | +30 | 0 replies | |
| 12/25 | powerpc: print both base and actual page size on hash failurearch/ arch/ arch/ | +10 | 0 replies | |
| 13/25 | powerpc: Print page size info during bootarch/ | +5 | 0 replies | |
| 14/25 | mm/THP: HPAGE_SHIFT is not a #define on some archinclude/ mm/ | +6 | 0 replies | |
| 15/25 | mm/THP: Add pmd args to pgtable deposit and withdraw APIsarch/ arch/ arch/ +4 more | +27 | 0 replies | |
| 16/25 | mm/THP: withdraw the pgtable after pmdp related operationsmm/ | +2 | 0 replies | |
| 17/25 | powerpc/THP: Implement transparent hugepages for ppc64arch/ arch/ arch/ +4 more | +572 | 0 replies | |
| 18/25 | powerpc/THP: Double the PMD table size for THParch/ arch/ arch/ | +14 | 0 replies | |
| 19/25 | powerpc/THP: Differentiate THP PMD entries from HUGETLB PMD entriesarch/ arch/ arch/ | +18 | 0 replies | |
| 20/25 | powerpc/THP: Add code to handle HPTE faults for large pagesarch/ arch/ arch/ +10 more | +286 | 0 replies | |
| 21/25 | powerpc: Handle hugepage in perf callchainarch/ | +21 | 0 replies | |
| 22/25 | powerpc/THP: get_user_pages_fast changesarch/ | +82 | 0 replies | |
| 23/25 | powerpc/THP: Enable THP on PPC64arch/ | +29 | 0 replies | |
| 24/25 | powerpc: Optimize hugepage invalidatearch/ arch/ arch/ +1 more | +210 | 0 replies | |
| 25/25 | powerpc: Handle hugepages in kvmarch/ arch/ arch/ | +97 | 0 replies |
Reviews trailers per patch
7 of 25 patches have a Reviewed-by or Acked-by.
| Patch | Paul Mackerras |
|---|---|
| 1/25 | A-b |
| 2/25 | A-b |
| 3/25 | A-b |
| 4/25 | A-b |
| 5/25 | A-b |
| 6/25 | |
| 7/25 | A-b |
| 8/25 | |
| 9/25 | A-b |
| 10/25 | |
| 11/25 | |
| 12/25 | |
| 13/25 | |
| 14/25 | |
| 15/25 | |
| 16/25 | |
| 17/25 | |
| 18/25 | |
| 19/25 | |
| 20/25 | |
| 21/25 | |
| 22/25 | |
| 23/25 | |
| 24/25 | |
| 25/25 |
Trailers given in replies are filled; those carried in the patches from earlier versions are outlined with dashes.
Cover letter [PATCH -V3 00/25] THP support for PPC64
Hi,
This patchset adds transparent hugepage support for PPC64.
TODO:
* powernv still doesn't boot
* hash preload support in update_mmu_cache_pmd
Some numbers:
The latency measurements code from Anton found at
http://ozlabs.org/~anton/junkcode/latency2001.c
THP disabled 64K page size
------------------------
[root@llmp24l02 ~]# ./latency2001 8G
8589934592 731.73 cycles 205.77 ns
[root@llmp24l02 ~]# ./latency2001 8G
8589934592 743.39 cycles 209.05 ns
[root@llmp24l02 ~]#
THP disabled large page via hugetlbfs
-------------------------------------
[root@llmp24l02 ~]# ./latency2001 -l 8G
8589934592 416.09 cycles 117.01 ns
[root@llmp24l02 ~]# ./latency2001 -l 8G
8589934592 415.74 cycles 116.91 ns
THP enabled 64K page size.
----------------
[root@llmp24l02 ~]# ./latency2001 8G
8589934592 405.07 cycles 113.91 ns
[root@llmp24l02 ~]# ./latency2001 8G
8589934592 411.82 cycles 115.81 ns
[root@llmp24l02 ~]#
We are close to hugetlbfs in latency and we can achieve this with zero config/page reservation. Most of the allocations above are fault allocated. I haven't really measured the collapse alloc impact.
Another test that does 50000000 random access over 1GB area goes from 2.65 seconds to 1.07 seconds with this patchset.
Change from V2:
* Change patch "powerpc: Reduce PTE table memory wastage" to use much simpler approach for PTE page sharing.
* Changes to handle huge pages in KVM code.
* Address other review comments
Changes from V1
* Address review comments
* More patch split
* Add batch hpte invalidate for hugepages.
Changes from RFC V2:
* Address review comments
* More code cleanup and patch split
Changes from RFC V1:
* HugeTLB fs now works
* Compile issues fixed
* rebased to v3.8
* Patch series reorded so that ppc64 cleanups and MM THP changes are moved early in the series. This should help in picking those patches early.
Thanks,
-aneesh