Skip to content

bug fix and performance improve

Robert Yang yocto 1 version In review

Get series with b4
b4 am [email protected]

Versions newest first

  1. v1 Latest4 patches 9 repliesIn review

Patches in v1 No applies recorded yet

#Subject and filesSizeRepliesApplied
1/4fixup! update: don't stop on unsatisfied layer dependencieslayerindex/update.py+2 -20 replies
2/4update.py: add an option --timeout for lockfilelayerindex/update.py layerindex/utils.py+15 -40 replies
3/4update.py: print failed layers summary in the endlayerindex/update.py+9 -00 replies
4/4update_layer.py: move layer validation to update.py (Performance improve)layerindex/update.py layerindex/update_layer.py+82 -367 replies

Reviews trailers per patch

No Reviewed-by, Acked-by or Tested-by trailers for v1 yet.

Read the v1 thread

Cover letter [PATCH 0/4][layerindex-web] bug fix and performance improve

Hi Paul,

The patch 4 can improve a lot on update.py (up to 98%), here is the testing data, please feel free to give your comments.

$ time update.py -b master --nofetch [--fullreload]
                   Before    Now       Reduced
No update:         276s      3.6s      98%
Partial update:    312s      87s       72%
Full repload:      1016s     980s      3%

Note:
* All of the testing are based on --nofetch

* "No update" means all layers on the branch is up-to-date, for example, when we run it twice, there is no update in the second run, so we only need about 3s now, which is the most common case when we use cron to run it per half an hour.

* "Partly update" means part of the layers have been updated.

* "Fullreload" means all of the layers have been updated.

// Robert

The following changes since commit 611c96883c35240d3c291951146154d828745774:

requirements.txt: use the most recent Django 1.8 version (2018-03-26 08:29:27 +1300)

are available in the git repository at:

git://git.pokylinux.org/poky-contrib rbt/layerindex
http://git.pokylinux.org/cgit.cgi//log/?h=rbt/layerindex

Robert Yang (4):
fixup! update: don't stop on unsatisfied layer dependencies update.py: add an option --timeout for lockfile update.py: print failed layers summary in the end update_layer.py: move layer validation to update.py (Performance
improve)

 layerindex/update.py       | 97 ++++++++++++++++++++++++++++++++++++++++++++--
 layerindex/update_layer.py | 39 ++-----------------
 layerindex/utils.py        | 14 +++++--
 3 files changed, 108 insertions(+), 42 deletions(-)
Signature · 1 line
2.7.4