Packaging performance improvements, round 2
Get series with b4
b4 am [email protected]Versions newest first
- v1 Latest22 patches 4 repliesIn review
Patches in v1 No applies recorded yet
| # | Subject and files | Size | Replies | Applied |
|---|---|---|---|---|
| 1/22 | package.bbclass: Multithread per file dependency generation codemeta/ meta/ meta/ +1 more | +85 | 0 replies | |
| 2/22 | package: Don't export PATHmeta/ | +5 | 0 replies | |
| 3/22 | package: Process package stripping in parallelmeta/ meta/ | +58 | 1 reply | |
| 4/22 | insane.bbclass: Add pkgvarcheck to check for suboptimal usages of variablesmeta/ | +9 | 0 replies | |
| 5/22 | insane.bbclass: Add documentation headers for logical code blocksmeta/ | +17 | 0 replies | |
| 6/22 | staging/insane.bbclass: Move legacy do_stage check iinto insane.bbclassmeta/ meta/ | +3 | 0 replies | |
| 7/22 | staging.bbclass: Drop unused/legacy functionmeta/ | +0 | 0 replies | |
| 8/22 | update-rc.d: Drop OVERRIDES codemeta/ | +6 | 0 replies | |
| 9/22 | qemu: Set RDEPENDS on the specific package that needs itmeta/ | +1 | 0 replies | |
| 10/22 | gdb-cross-canadian: Set RDEPENDS on the specific package that needs itmeta/ | +2 | 0 replies | |
| 11/22 | initramfs-live-boot: Set RDEPENDS on the specific package that needs itmeta/ | +1 | 0 replies | |
| 12/22 | package.bbclass: Fix up bb.mkdirhier/bb.copyfile usagemeta/ | +7 | 0 replies | |
| 13/22 | package.bbclass: Rewrite split_and_strip_filesmeta/ | +97 | 2 replies | |
| 14/22 | kernel.bbclass: Improve populate_packages_prependmeta/ | +21 | 0 replies | |
| 15/22 | package.bbclass: Make use of cleandirs and dirs function flagsmeta/ | +3 | 0 replies | |
| 16/22 | package.bbclass: Various minor performance tweaksmeta/ | +6 | 0 replies | |
| 17/22 | package.bbclass: Simplify empty directory removalmeta/ | +1 | 0 replies | |
| 18/22 | package.bbclass: Add PACKAGESPLITFUNCS variablemeta/ meta/ meta/ +1 more | +15 | 0 replies | |
| 19/22 | sstate/path.py: Add copyhardlinktree() function and use for performance optimisationmeta/ meta/ | +6 | 0 replies | |
| 20/22 | package.bbclass: Better document the different phases of operationmeta/ | +16 | 0 replies | |
| 21/22 | package.bbclass: Pre-expand some variables to save timemeta/ | +14 | 0 replies | |
| 22/22 | classes: Drop none package specific packaging variable accessesmeta/ meta/ meta/ +4 more | +23 | 0 replies |
Reviews trailers per patch
No Reviewed-by, Acked-by or Tested-by trailers for v1 yet.
Cover letter [PATCH 00/22] Packaging performance improvements, round 2
The following patch series contains various performance improvements for do_package.
It also includes changes to the sanity testing to start giving warnings about packaging variables used without packages being specified, eg:
RDEPENDS = "x"
instead of
RDEPENDS_${PN} = "x"
The final patch in the series stops the packaging code using the non-package versions in many cases. I'm not planning to merge that one right away, its just included for illustration and benchmarking purposes now.
There were three cases I found using bad syntax in OE-Core and the series includes patches to fix them.
There is also a useful performance improvement to sstate manipulations to use hardlinks instead of file copies which should be universally helpful to build performance of tasks.
The following changes are available in the git repository at:
git://git.openembedded.org/openembedded-core master-next
http://cgit.openembedded.org/cgit.cgi/openembedded-core/log/?h=master-next
Richard Purdie (22):
package.bbclass: Multithread per file dependency generation code
package: Don't export PATH
package: Process package stripping in parallel insane.bbclass: Add pkgvarcheck to check for suboptimal usages of
variables
insane.bbclass: Add documentation headers for logical code blocks staging/insane.bbclass: Move legacy do_stage check iinto
insane.bbclass
staging.bbclass: Drop unused/legacy function
update-rc.d: Drop OVERRIDES code
qemu: Set RDEPENDS on the specific package that needs it
gdb-cross-canadian: Set RDEPENDS on the specific package that needs
it
initramfs-live-boot: Set RDEPENDS on the specific package that needs
it
package.bbclass: Fix up bb.mkdirhier/bb.copyfile usage package.bbclass: Rewrite split_and_strip_files kernel.bbclass: Improve populate_packages_prepend package.bbclass: Make use of cleandirs and dirs function flags package.bbclass: Various minor performance tweaks package.bbclass: Simplify empty directory removal package.bbclass: Add PACKAGESPLITFUNCS variable sstate/path.py: Add copyhardlinktree() function and use for
performance optimisation
package.bbclass: Better document the different phases of operation package.bbclass: Pre-expand some variables to save time
classes: Drop none package specific packaging variable accesses
meta/classes/base.bbclass | 2 +- meta/classes/gconf.bbclass | 9 +- meta/classes/gtk-icon-cache.bbclass | 4 +- meta/classes/gtk-immodules-cache.bbclass | 4 +- meta/classes/insane.bbclass | 30 +- meta/classes/kernel.bbclass | 52 +-- meta/classes/mime.bbclass | 8 +- meta/classes/package.bbclass | 460 +++++++++----------- meta/classes/sstate.bbclass | 4 +- meta/classes/staging.bbclass | 9 - meta/classes/update-alternatives.bbclass | 10 +- meta/classes/update-rc.d_real.bbclass | 21 +- meta/lib/oe/package.py | 96 ++++ meta/lib/oe/path.py | 4 + .../initrdscripts/initramfs-live-boot_1.0.bb | 2 +- meta/recipes-devtools/gdb/gdb-cross-canadian.inc | 4 +- meta/recipes-devtools/qemu/qemu.inc | 2 +- 17 files changed, 390 insertions(+), 331 deletions(-) create mode 100644 meta/lib/oe/package.py
Signature · 1 line
1.7.10.4