Sharing sstate
I'd really like to be able to share sstate effectively. One problem I have with it is the size - for a build of my system (something similar to core-image-sato on BeagleBoard), the sstate cache for a build-from-scratch is nearly 5GB! Not exactly simple to share across sites.
It seems to me that maybe I don't need to share everything. For example, the webkit-gtk package:
$ ls -l sstate-cache/*webkit-gtk* -rw-rw-r-- 1 gary gary 331221793 Sep 23 16:21 sstate-cache/sstate-webkit-gtk-armv7a-vfp-neon-amltd-linux-gnueabi-1.5.1+svnr90727-r0-armv7a-vfp-neon-2-4a04fc210c0a565767a2ad9bb11d8322_deploy-ipk.tgz -rw-rw-r-- 1 gary gary 12740 Sep 23 16:21 sstate-cache/sstate-webkit-gtk-armv7a-vfp-neon-amltd-linux-gnueabi-1.5.1+svnr90727-r0-armv7a-vfp-neon-2-4a04fc210c0a565767a2ad9bb11d8322_deploy-ipk.tgz.siginfo -rw-r--r-- 1 gary gary 326376172 Sep 23 16:15 sstate-cache/sstate-webkit-gtk-armv7a-vfp-neon-amltd-linux-gnueabi-1.5.1+svnr90727-r0-armv7a-vfp-neon-2-67b4ac238844551dd48eed3255ea33d0_populate-sysroot.tgz -rw-r--r-- 1 gary gary 21652 Sep 23 16:15 sstate-cache/sstate-webkit-gtk-armv7a-vfp-neon-amltd-linux-gnueabi-1.5.1+svnr90727-r0-armv7a-vfp-neon-2-67b4ac238844551dd48eed3255ea33d0_populate-sysroot.tgz.siginfo -rw-r--r-- 1 gary gary 665832323 Sep 23 16:19 sstate-cache/sstate-webkit-gtk-armv7a-vfp-neon-amltd-linux-gnueabi-1.5.1+svnr90727-r0-armv7a-vfp-neon-2-726c31c08826bf24e6db77fdf5f4408b_package.tgz -rw-r--r-- 1 gary gary 98746 Sep 23 16:19 sstate-cache/sstate-webkit-gtk-armv7a-vfp-neon-amltd-linux-gnueabi-1.5.1+svnr90727-r0-armv7a-vfp-neon-2-726c31c08826bf24e6db77fdf5f4408b_package.tgz.siginfo -rw-rw-r-- 1 gary gary 3117 Sep 23 15:38 sstate-cache/sstate-webkit-gtk-armv7a-vfp-neon-amltd-linux-gnueabi-1.5.1+svnr90727-r0-armv7a-vfp-neon-2-f9267d59a61b218bd6ab76ed55f12e8e_populate-lic.tgz -rw-rw-r-- 1 gary gary 8359 Sep 23 15:38 sstate-cache/sstate-webkit-gtk-armv7a-vfp-neon-amltd-linux-gnueabi-1.5.1+svnr90727-r0-armv7a-vfp-neon-2-f9267d59a61b218bd6ab76ed55f12e8e_populate-lic.tgz.siginfo
Would it be possible to only share part of this, maybe the "package" file? It seems to me that this could make the needed (shared) cache much smaller...
Signature · 4 lines
------------------------------------------------------------ Gary Thomas | Consulting for the MLB Associates | Embedded world ------------------------------------------------------------
Quoted 26 lines · Gary Thomas
I'd really like to be able to share sstate effectively. One problem I have with it is the size - for a build of my system (something similar to core-image-sato on BeagleBoard), the sstate cache for a build-from-scratch is nearly 5GB! Not exactly simple to share across sites.
It seems to me that maybe I don't need to share everything. For example, the webkit-gtk package:
$ ls -l sstate-cache/*webkit-gtk* -rw-rw-r-- 1 gary gary 331221793 Sep 23 16:21 sstate-cache/sstate-webkit-gtk-armv7a-vfp-neon-amltd-linux-gnueabi-1.5.1+svnr90727-r0-armv7a-vfp-neon-2-4a04fc210c0a565767a2ad9bb11d8322_deploy-ipk.tgz -rw-rw-r-- 1 gary gary 12740 Sep 23 16:21 sstate-cache/sstate-webkit-gtk-armv7a-vfp-neon-amltd-linux-gnueabi-1.5.1+svnr90727-r0-armv7a-vfp-neon-2-4a04fc210c0a565767a2ad9bb11d8322_deploy-ipk.tgz.siginfo -rw-r--r-- 1 gary gary 326376172 Sep 23 16:15 sstate-cache/sstate-webkit-gtk-armv7a-vfp-neon-amltd-linux-gnueabi-1.5.1+svnr90727-r0-armv7a-vfp-neon-2-67b4ac238844551dd48eed3255ea33d0_populate-sysroot.tgz -rw-r--r-- 1 gary gary 21652 Sep 23 16:15 sstate-cache/sstate-webkit-gtk-armv7a-vfp-neon-amltd-linux-gnueabi-1.5.1+svnr90727-r0-armv7a-vfp-neon-2-67b4ac238844551dd48eed3255ea33d0_populate-sysroot.tgz.siginfo -rw-r--r-- 1 gary gary 665832323 Sep 23 16:19 sstate-cache/sstate-webkit-gtk-armv7a-vfp-neon-amltd-linux-gnueabi-1.5.1+svnr90727-r0-armv7a-vfp-neon-2-726c31c08826bf24e6db77fdf5f4408b_package.tgz -rw-r--r-- 1 gary gary 98746 Sep 23 16:19 sstate-cache/sstate-webkit-gtk-armv7a-vfp-neon-amltd-linux-gnueabi-1.5.1+svnr90727-r0-armv7a-vfp-neon-2-726c31c08826bf24e6db77fdf5f4408b_package.tgz.siginfo -rw-rw-r-- 1 gary gary 3117 Sep 23 15:38 sstate-cache/sstate-webkit-gtk-armv7a-vfp-neon-amltd-linux-gnueabi-1.5.1+svnr90727-r0-armv7a-vfp-neon-2-f9267d59a61b218bd6ab76ed55f12e8e_populate-lic.tgz -rw-rw-r-- 1 gary gary 8359 Sep 23 15:38 sstate-cache/sstate-webkit-gtk-armv7a-vfp-neon-amltd-linux-gnueabi-1.5.1+svnr90727-r0-armv7a-vfp-neon-2-f9267d59a61b218bd6ab76ed55f12e8e_populate-lic.tgz.siginfo
Quoted 2 lines
Would it be possible to only share part of this, maybe the "package" file? It seems to me that this could make the needed (shared) cache much smaller...
The build will only use the pieces it needs. If your build only needs the deploy-ipk pieces and doesn't need to write new packages files it can survive without the package part. If it doesn't need to compile something against webkit, it won't use the populate-sysroot file.
So what I'm saying is you likely could get away with not sharing the *_package files at least. The only downside is if you turn on rpm packaging it would have to rebuild.
Cheers,
Richard
Quoted 35 lines · Richard Purdie
Quoted 26 lines · Gary Thomas
I'd really like to be able to share sstate effectively. One problem I have with it is the size - for a build of my system (something similar to core-image-sato on BeagleBoard), the sstate cache for a build-from-scratch is nearly 5GB! Not exactly simple to share across sites.
It seems to me that maybe I don't need to share everything. For example, the webkit-gtk package:
$ ls -l sstate-cache/*webkit-gtk* -rw-rw-r-- 1 gary gary 331221793 Sep 23 16:21 sstate-cache/sstate-webkit-gtk-armv7a-vfp-neon-amltd-linux-gnueabi-1.5.1+svnr90727-r0-armv7a-vfp-neon-2-4a04fc210c0a565767a2ad9bb11d8322_deploy-ipk.tgz -rw-rw-r-- 1 gary gary 12740 Sep 23 16:21 sstate-cache/sstate-webkit-gtk-armv7a-vfp-neon-amltd-linux-gnueabi-1.5.1+svnr90727-r0-armv7a-vfp-neon-2-4a04fc210c0a565767a2ad9bb11d8322_deploy-ipk.tgz.siginfo -rw-r--r-- 1 gary gary 326376172 Sep 23 16:15 sstate-cache/sstate-webkit-gtk-armv7a-vfp-neon-amltd-linux-gnueabi-1.5.1+svnr90727-r0-armv7a-vfp-neon-2-67b4ac238844551dd48eed3255ea33d0_populate-sysroot.tgz -rw-r--r-- 1 gary gary 21652 Sep 23 16:15 sstate-cache/sstate-webkit-gtk-armv7a-vfp-neon-amltd-linux-gnueabi-1.5.1+svnr90727-r0-armv7a-vfp-neon-2-67b4ac238844551dd48eed3255ea33d0_populate-sysroot.tgz.siginfo -rw-r--r-- 1 gary gary 665832323 Sep 23 16:19 sstate-cache/sstate-webkit-gtk-armv7a-vfp-neon-amltd-linux-gnueabi-1.5.1+svnr90727-r0-armv7a-vfp-neon-2-726c31c08826bf24e6db77fdf5f4408b_package.tgz -rw-r--r-- 1 gary gary 98746 Sep 23 16:19 sstate-cache/sstate-webkit-gtk-armv7a-vfp-neon-amltd-linux-gnueabi-1.5.1+svnr90727-r0-armv7a-vfp-neon-2-726c31c08826bf24e6db77fdf5f4408b_package.tgz.siginfo -rw-rw-r-- 1 gary gary 3117 Sep 23 15:38 sstate-cache/sstate-webkit-gtk-armv7a-vfp-neon-amltd-linux-gnueabi-1.5.1+svnr90727-r0-armv7a-vfp-neon-2-f9267d59a61b218bd6ab76ed55f12e8e_populate-lic.tgz -rw-rw-r-- 1 gary gary 8359 Sep 23 15:38 sstate-cache/sstate-webkit-gtk-armv7a-vfp-neon-amltd-linux-gnueabi-1.5.1+svnr90727-r0-armv7a-vfp-neon-2-f9267d59a61b218bd6ab76ed55f12e8e_populate-lic.tgz.siginfoQuoted 2 lines
Would it be possible to only share part of this, maybe the "package" file? It seems to me that this could make the needed (shared) cache much smaller...
The build will only use the pieces it needs. If your build only needs the deploy-ipk pieces and doesn't need to write new packages files it can survive without the package part. If it doesn't need to compile something against webkit, it won't use the populate-sysroot file.
Quoted 3 lines
So what I'm saying is you likely could get away with not sharing the
*_packagefiles at least. The only downside is if you turn on rpm packaging it would have to rebuild.
I tried removing the *package* files and the build ended up rebuilding most things, in particular the toolchain bits. That's the part I really want to be able to package the sstate for :-(
So then I tried having just a small subset of packages in the sstate cache, but including all the pieces of each, like this:
rsync -auv sstate-cache/*eglibc-locale* \
sstate-cache/*autoconf-native* \
sstate-cache/*automake-native* \
sstate-cache/*bzip2-native* \
sstate-cache/*gettext-native* \
sstate-cache/*gnu-config-native* \
sstate-cache/*help2man-native* \
sstate-cache/*libtool-native* \
sstate-cache/*libxml2-native* \
sstate-cache/*m4-native* \
sstate-cache/*ncurses-native* \
sstate-cache/*openssl-native* \
sstate-cache/*pkgconfig-native* \
sstate-cache/*pseudo-native* \
sstate-cache/*python-native* \
sstate-cache/*quilt-native* \
sstate-cache/*readline-native* \
sstate-cache/*sqlite3-native* \
sstate-cache/*tar-replacement-native* \
sstate-cache/*zlib-native* \
sstate-cache/*gcc* \
sstate-cache/*binutils* \
sstate-cache/*eglibc* \
/tmp/sstate-test
This also fails, but differently:
ERROR: Task 756 (/home/local/poky-multi/meta/recipes-devtools/libtool/libtool-cross_2.4.bb, do_configure) failed with exit code '1'
looking at the config.log:
/home/local/p60_sstate_test/tmp/sysroots/i686-linux/usr/bin/armv7a-vfp-neon-amltd-linux-gnueabi/../../libexec/armv7a-vfp -neon-amltd-linux-gnueabi/gcc/arm-amltd-linux-gnueabi/4.6.1/cc1: error while loading shared libraries: libmpc.so.2: cann ot open shared object file: No such file or directory
Filed as http://bugzilla.pokylinux.org/show_bug.cgi?id=1536
Signature · 4 lines
------------------------------------------------------------ Gary Thomas | Consulting for the MLB Associates | Embedded world ------------------------------------------------------------