Skip to content

Various performance improvements to parsing

Richard Purdie bitbake-devel 1 version New

Get series with b4
b4 am 1379368625.32201.89.camel@ted

Versions newest first

  1. v1 Latest0 of 16 patches 0 repliesNew

Patches in v1 No applies recorded yet

None of the 16 patches the cover letter announces are in this archive.

Reviews trailers per patch

No Reviewed-by, Acked-by or Tested-by trailers for v1 yet.

Read the v1 thread

Cover letter [PATCH 00/16] Various performance improvements to parsing

This patch series fixes up profiling of the parsing processes and then uses that to find some performance improvements in parsing speed. What follows is a quick overview of what each patch is worth using "time". The data was confirmed in the actual profiles through a reduction in function calls, this is really just an interesting side by side comparison of the significance of each change:

real 0m31.700s
user 1m49.140s
sys 0m2.272s

#### Baseline ####

real 0m31.498s
user 1m48.448s
sys 0m2.380s

#### data: Be explicit in data_db check

real 0m31.079s
user 1m47.420s
sys 0m2.400s

#### siggen: Use lookup cache exclusively

real 0m30.890s
user 1m46.684s
sys 0m2.492s

#### data_smart: Improve variable expansion regexp

real 0m30.547s
user 1m44.124s
sys 0m2.292s

#### data_smart: use the expand_cache in VariableParse

real 0m29.750s
user 1m41.240s
sys 0m2.536s

#### data: Use direct iteration, not keys()

real 0m28.610s
user 1m38.096s
sys 0m2.304s

#### data: Cache an list of export variables

real 0m28.718s
user 1m38.080s
sys 0m2.344s

### data_smart: Add explict None checks

real 0m28.726s
user 1m37.924s
sys 0m2.568s

### data_smart: Allow expansion of flags in getVarFlags

real 0m28.947s
user 1m38.564s
sys 0m2.644s

### data_smart: Allow flags to use the expand cache

real 0m29.135s
user 1m38.816s
sys 0m2.280s

### data_smart: Cache the fact a variable accesses another even if its unset

real 0m28.250s
user 1m36.132s
sys 0m2.340s

### data: Optimise flag exclusion list handling

real 0m28.584s
user 1m36.116s
sys 0m2.376s

### data: Optimise flag lookup in build_dependencies

real 0m26.662s
user 1m28.952s
sys 0m2.296s

### data: Optimise build_dependencies a little

Cheers,

Richard