Skip to contentSkip to conversation

Sharing sstate

DISCUSSION Gary Thomas 2 participants 3 messages Sep 27, 2011 – Sep 28, 2011

lore
Share & tools
lore
#0 lore raw

I'd really like to be able to share sstate effectively. One problem I have with it is the size - for a build of my system (something similar to core-image-sato on BeagleBoard), the sstate cache for a build-from-scratch is nearly 5GB! Not exactly simple to share across sites.

It seems to me that maybe I don't need to share everything. For example, the webkit-gtk package:

$ ls -l sstate-cache/*webkit-gtk*
-rw-rw-r-- 1 gary gary 331221793 Sep 23 16:21 sstate-cache/sstate-webkit-gtk-armv7a-vfp-neon-amltd-linux-gnueabi-1.5.1+svnr90727-r0-armv7a-vfp-neon-2-4a04fc210c0a565767a2ad9bb11d8322_deploy-ipk.tgz
-rw-rw-r-- 1 gary gary     12740 Sep 23 16:21 sstate-cache/sstate-webkit-gtk-armv7a-vfp-neon-amltd-linux-gnueabi-1.5.1+svnr90727-r0-armv7a-vfp-neon-2-4a04fc210c0a565767a2ad9bb11d8322_deploy-ipk.tgz.siginfo
-rw-r--r-- 1 gary gary 326376172 Sep 23 16:15 sstate-cache/sstate-webkit-gtk-armv7a-vfp-neon-amltd-linux-gnueabi-1.5.1+svnr90727-r0-armv7a-vfp-neon-2-67b4ac238844551dd48eed3255ea33d0_populate-sysroot.tgz
-rw-r--r-- 1 gary gary     21652 Sep 23 16:15 sstate-cache/sstate-webkit-gtk-armv7a-vfp-neon-amltd-linux-gnueabi-1.5.1+svnr90727-r0-armv7a-vfp-neon-2-67b4ac238844551dd48eed3255ea33d0_populate-sysroot.tgz.siginfo
-rw-r--r-- 1 gary gary 665832323 Sep 23 16:19 sstate-cache/sstate-webkit-gtk-armv7a-vfp-neon-amltd-linux-gnueabi-1.5.1+svnr90727-r0-armv7a-vfp-neon-2-726c31c08826bf24e6db77fdf5f4408b_package.tgz
-rw-r--r-- 1 gary gary     98746 Sep 23 16:19 sstate-cache/sstate-webkit-gtk-armv7a-vfp-neon-amltd-linux-gnueabi-1.5.1+svnr90727-r0-armv7a-vfp-neon-2-726c31c08826bf24e6db77fdf5f4408b_package.tgz.siginfo
-rw-rw-r-- 1 gary gary      3117 Sep 23 15:38 sstate-cache/sstate-webkit-gtk-armv7a-vfp-neon-amltd-linux-gnueabi-1.5.1+svnr90727-r0-armv7a-vfp-neon-2-f9267d59a61b218bd6ab76ed55f12e8e_populate-lic.tgz
-rw-rw-r-- 1 gary gary      8359 Sep 23 15:38 sstate-cache/sstate-webkit-gtk-armv7a-vfp-neon-amltd-linux-gnueabi-1.5.1+svnr90727-r0-armv7a-vfp-neon-2-f9267d59a61b218bd6ab76ed55f12e8e_populate-lic.tgz.siginfo

Would it be possible to only share part of this, maybe the "package" file? It seems to me that this could make the needed (shared) cache much smaller...

Signature · 4 lines
------------------------------------------------------------
Gary Thomas                 |  Consulting for the
MLB Associates              |    Embedded world
------------------------------------------------------------
#1 lore raw
Quoted 26 lines · Gary Thomas

I'd really like to be able to share sstate effectively. One problem I have with it is the size - for a build of my system (something similar to core-image-sato on BeagleBoard), the sstate cache for a build-from-scratch is nearly 5GB! Not exactly simple to share across sites.

It seems to me that maybe I don't need to share everything. For example, the webkit-gtk package:

$ ls -l sstate-cache/*webkit-gtk*
-rw-rw-r-- 1 gary gary 331221793 Sep 23 16:21 
sstate-cache/sstate-webkit-gtk-armv7a-vfp-neon-amltd-linux-gnueabi-1.5.1+svnr90727-r0-armv7a-vfp-neon-2-4a04fc210c0a565767a2ad9bb11d8322_deploy-ipk.tgz
-rw-rw-r-- 1 gary gary     12740 Sep 23 16:21 
sstate-cache/sstate-webkit-gtk-armv7a-vfp-neon-amltd-linux-gnueabi-1.5.1+svnr90727-r0-armv7a-vfp-neon-2-4a04fc210c0a565767a2ad9bb11d8322_deploy-ipk.tgz.siginfo
-rw-r--r-- 1 gary gary 326376172 Sep 23 16:15 
sstate-cache/sstate-webkit-gtk-armv7a-vfp-neon-amltd-linux-gnueabi-1.5.1+svnr90727-r0-armv7a-vfp-neon-2-67b4ac238844551dd48eed3255ea33d0_populate-sysroot.tgz
-rw-r--r-- 1 gary gary     21652 Sep 23 16:15 
sstate-cache/sstate-webkit-gtk-armv7a-vfp-neon-amltd-linux-gnueabi-1.5.1+svnr90727-r0-armv7a-vfp-neon-2-67b4ac238844551dd48eed3255ea33d0_populate-sysroot.tgz.siginfo
-rw-r--r-- 1 gary gary 665832323 Sep 23 16:19 
sstate-cache/sstate-webkit-gtk-armv7a-vfp-neon-amltd-linux-gnueabi-1.5.1+svnr90727-r0-armv7a-vfp-neon-2-726c31c08826bf24e6db77fdf5f4408b_package.tgz
-rw-r--r-- 1 gary gary     98746 Sep 23 16:19 
sstate-cache/sstate-webkit-gtk-armv7a-vfp-neon-amltd-linux-gnueabi-1.5.1+svnr90727-r0-armv7a-vfp-neon-2-726c31c08826bf24e6db77fdf5f4408b_package.tgz.siginfo
-rw-rw-r-- 1 gary gary      3117 Sep 23 15:38 
sstate-cache/sstate-webkit-gtk-armv7a-vfp-neon-amltd-linux-gnueabi-1.5.1+svnr90727-r0-armv7a-vfp-neon-2-f9267d59a61b218bd6ab76ed55f12e8e_populate-lic.tgz
-rw-rw-r-- 1 gary gary      8359 Sep 23 15:38 
sstate-cache/sstate-webkit-gtk-armv7a-vfp-neon-amltd-linux-gnueabi-1.5.1+svnr90727-r0-armv7a-vfp-neon-2-f9267d59a61b218bd6ab76ed55f12e8e_populate-lic.tgz.siginfo
Quoted 2 lines

Would it be possible to only share part of this, maybe the "package" file? It seems to me that this could make the needed (shared) cache much smaller...

The build will only use the pieces it needs. If your build only needs the deploy-ipk pieces and doesn't need to write new packages files it can survive without the package part. If it doesn't need to compile something against webkit, it won't use the populate-sysroot file.

So what I'm saying is you likely could get away with not sharing the *_package files at least. The only downside is if you turn on rpm packaging it would have to rebuild.

Cheers,

Richard

#2 lore raw
Quoted 35 lines · Richard Purdie
Quoted 26 lines · Gary Thomas

I'd really like to be able to share sstate effectively. One problem I have with it is the size - for a build of my system (something similar to core-image-sato on BeagleBoard), the sstate cache for a build-from-scratch is nearly 5GB! Not exactly simple to share across sites.

It seems to me that maybe I don't need to share everything. For example, the webkit-gtk package:

$ ls -l sstate-cache/*webkit-gtk*
-rw-rw-r-- 1 gary gary 331221793 Sep 23 16:21
sstate-cache/sstate-webkit-gtk-armv7a-vfp-neon-amltd-linux-gnueabi-1.5.1+svnr90727-r0-armv7a-vfp-neon-2-4a04fc210c0a565767a2ad9bb11d8322_deploy-ipk.tgz
-rw-rw-r-- 1 gary gary     12740 Sep 23 16:21
sstate-cache/sstate-webkit-gtk-armv7a-vfp-neon-amltd-linux-gnueabi-1.5.1+svnr90727-r0-armv7a-vfp-neon-2-4a04fc210c0a565767a2ad9bb11d8322_deploy-ipk.tgz.siginfo
-rw-r--r-- 1 gary gary 326376172 Sep 23 16:15
sstate-cache/sstate-webkit-gtk-armv7a-vfp-neon-amltd-linux-gnueabi-1.5.1+svnr90727-r0-armv7a-vfp-neon-2-67b4ac238844551dd48eed3255ea33d0_populate-sysroot.tgz
-rw-r--r-- 1 gary gary     21652 Sep 23 16:15
sstate-cache/sstate-webkit-gtk-armv7a-vfp-neon-amltd-linux-gnueabi-1.5.1+svnr90727-r0-armv7a-vfp-neon-2-67b4ac238844551dd48eed3255ea33d0_populate-sysroot.tgz.siginfo
-rw-r--r-- 1 gary gary 665832323 Sep 23 16:19
sstate-cache/sstate-webkit-gtk-armv7a-vfp-neon-amltd-linux-gnueabi-1.5.1+svnr90727-r0-armv7a-vfp-neon-2-726c31c08826bf24e6db77fdf5f4408b_package.tgz
-rw-r--r-- 1 gary gary     98746 Sep 23 16:19
sstate-cache/sstate-webkit-gtk-armv7a-vfp-neon-amltd-linux-gnueabi-1.5.1+svnr90727-r0-armv7a-vfp-neon-2-726c31c08826bf24e6db77fdf5f4408b_package.tgz.siginfo
-rw-rw-r-- 1 gary gary      3117 Sep 23 15:38
sstate-cache/sstate-webkit-gtk-armv7a-vfp-neon-amltd-linux-gnueabi-1.5.1+svnr90727-r0-armv7a-vfp-neon-2-f9267d59a61b218bd6ab76ed55f12e8e_populate-lic.tgz
-rw-rw-r-- 1 gary gary      8359 Sep 23 15:38
sstate-cache/sstate-webkit-gtk-armv7a-vfp-neon-amltd-linux-gnueabi-1.5.1+svnr90727-r0-armv7a-vfp-neon-2-f9267d59a61b218bd6ab76ed55f12e8e_populate-lic.tgz.siginfo
Quoted 2 lines

Would it be possible to only share part of this, maybe the "package" file? It seems to me that this could make the needed (shared) cache much smaller...

The build will only use the pieces it needs. If your build only needs the deploy-ipk pieces and doesn't need to write new packages files it can survive without the package part. If it doesn't need to compile something against webkit, it won't use the populate-sysroot file.

Quoted 3 lines

So what I'm saying is you likely could get away with not sharing the *_package files at least. The only downside is if you turn on rpm packaging it would have to rebuild.

I tried removing the *package* files and the build ended up rebuilding most things, in particular the toolchain bits. That's the part I really want to be able to package the sstate for :-(

So then I tried having just a small subset of packages in the sstate cache, but including all the pieces of each, like this:

rsync -auv sstate-cache/*eglibc-locale* \
sstate-cache/*autoconf-native* \
sstate-cache/*automake-native* \
sstate-cache/*bzip2-native* \
sstate-cache/*gettext-native* \
sstate-cache/*gnu-config-native* \
sstate-cache/*help2man-native* \
sstate-cache/*libtool-native* \
sstate-cache/*libxml2-native* \
sstate-cache/*m4-native* \
sstate-cache/*ncurses-native* \
sstate-cache/*openssl-native* \
sstate-cache/*pkgconfig-native* \
sstate-cache/*pseudo-native* \
sstate-cache/*python-native* \
sstate-cache/*quilt-native* \
sstate-cache/*readline-native* \
sstate-cache/*sqlite3-native* \
sstate-cache/*tar-replacement-native* \
sstate-cache/*zlib-native* \
sstate-cache/*gcc* \
sstate-cache/*binutils* \
sstate-cache/*eglibc* \
/tmp/sstate-test

This also fails, but differently:

ERROR: Task 756 (/home/local/poky-multi/meta/recipes-devtools/libtool/libtool-cross_2.4.bb, do_configure) failed with exit code '1'

looking at the config.log:

/home/local/p60_sstate_test/tmp/sysroots/i686-linux/usr/bin/armv7a-vfp-neon-amltd-linux-gnueabi/../../libexec/armv7a-vfp -neon-amltd-linux-gnueabi/gcc/arm-amltd-linux-gnueabi/4.6.1/cc1: error while loading shared libraries: libmpc.so.2: cann ot open shared object file: No such file or directory

Filed as http://bugzilla.pokylinux.org/show_bug.cgi?id=1536

Signature · 4 lines
------------------------------------------------------------
Gary Thomas                 |  Consulting for the
MLB Associates              |    Embedded world
------------------------------------------------------------