Skip to contentSkip to conversation

GitLab CI: Split the world build into 4 jobs

PATCH New Tom Rini 1 participant 4 messages Jul 18, 2019 – Jul 19, 2019

lore
Share & tools
lore

Tom Rini

author
#0 lore raw

PATCH 1/2 GitLab CI: Split the world build into 4 jobs

To better allow for parallelization of the world build job split things into 32bit ARM (687 boards), 64bit ARM (215), PowerPC (311 boards) and everything else (167 boards).

While the 32bit ARM job is heavier than I would like, there is not a natural split that would reduce it in half or so without requiring the sort of hard to maintain splits we have to do in Travis CI.

---
 .gitlab-ci.yml | 37 +++++++++++++++++++++++++++++++++++--
 1 file changed, 35 insertions(+), 2 deletions(-)
.gitlab-ci.yml +35 -2
index da27caeef688..c24a7eaa628f 100644
@@ -68,12 +68,45 @@ stages:
         fi;
       fi;
 
-build all plaforms:
+build all 32bit ARM plaforms:
   tags: [ 'all' ]
   stage: world build
   script:
     - ret=0;
-     ./tools/buildman/buildman -P -E || ret=$?;
+     ./tools/buildman/buildman -P -E arm -x aarch64 || ret=$?;
+     if [[ $ret -ne 0 && $ret -ne 129 ]]; then
+       ./tools/buildman/buildman -sdeP;
+       exit $ret;
+     fi;
+
+build all 64bit ARM plaforms:
+  tags: [ 'all' ]
+  stage: world build
+  script:
+    - ret=0;
+     ./tools/buildman/buildman -P -E aarch64 || ret=$?;
+     if [[ $ret -ne 0 && $ret -ne 129 ]]; then
+       ./tools/buildman/buildman -sdeP;
+       exit $ret;
+     fi;
+
+build all PowerPC plaforms:
+  tags: [ 'all' ]
+  stage: world build
+  script:
+    - ret=0;
+     ./tools/buildman/buildman -P -E powerpc || ret=$?;
+     if [[ $ret -ne 0 && $ret -ne 129 ]]; then
+       ./tools/buildman/buildman -sdeP;
+       exit $ret;
+     fi;
+
+build all other plaforms:
+  tags: [ 'all' ]
+  stage: world build
+  script:
+    - ret=0;
+     ./tools/buildman/buildman -P -E -x arm,powerpc || ret=$?;
      if [[ $ret -ne 0 && $ret -ne 129 ]]; then
        ./tools/buildman/buildman -sdeP;
        exit $ret;
Signature · 1 line
2.7.4
author
#1 lore raw

PATCH 1/2 GitLab CI: Split the world build into 4 jobs

Quoted 9 lines · Tom Rini

To better allow for parallelization of the world build job split things into 32bit ARM (687 boards), 64bit ARM (215), PowerPC (311 boards) and everything else (167 boards).

While the 32bit ARM job is heavier than I would like, there is not a natural split that would reduce it in half or so without requiring the sort of hard to maintain splits we have to do in Travis CI.

Applied to u-boot/master, thanks!

Signature · 8 lines
Tom
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 819 bytes
Desc: not available
URL: <http://lists.denx.de/pipermail/u-boot/attachments/20190718/eca6b130/attachment.sig>
author
#2 lore raw

PATCH 2/2 gitlab-ci: Move the pyelfutils section

In reply to Tom Rini

We need this for building some 64bit ARM platforms, not for test.py runs.

---
 .gitlab-ci.yml | 4 +++-
 1 file changed, 3 insertions(+), 1 deletion(-)
.gitlab-ci.yml +3 -1
index c24a7eaa628f..e27d86f96281 100644
@@ -22,7 +22,6 @@ stages:
     - . /tmp/venv/bin/activate
     - pip install pytest==2.8.7
     - pip install python-subunit
-    - pip install pyelftools
     - grub-mkimage -o ~/grub_x86.efi -O i386-efi normal  echo lsefimmap lsefi lsefisystab efinet tftp minicmd
     - grub-mkimage -o ~/grub_x64.efi -O x86_64-efi normal  echo lsefimmap lsefi lsefisystab efinet tftp minicmd
     - mkdir ~/grub2-arm
@@ -83,6 +82,9 @@ build all 64bit ARM plaforms:
   tags: [ 'all' ]
   stage: world build
   script:
+    - virtualenv /tmp/venv
+    - . /tmp/venv/bin/activate
+    - pip install pyelftools
     - ret=0;
      ./tools/buildman/buildman -P -E aarch64 || ret=$?;
      if [[ $ret -ne 0 && $ret -ne 129 ]]; then
Signature · 1 line
2.7.4
author
#3 lore raw

PATCH 2/2 gitlab-ci: Move the pyelfutils section

Quoted 4 lines · Tom Rini

We need this for building some 64bit ARM platforms, not for test.py runs.

Applied to u-boot/master, thanks!

Signature · 8 lines
Tom
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 819 bytes
Desc: not available
URL: <http://lists.denx.de/pipermail/u-boot/attachments/20190718/b147d426/attachment.sig>