Trying to re-use sstate.

Hello,

I'm trying to re-use the sstate from one build directory and move it to another. It's not working - bitbake is rebuilding *everything*.

My hunch is the reason for this is because bblayers.conf must differ between the two build directories, because it uses full paths to the layer directories.

By default, when you source oe-init-build-env for the first time, it generates a bblayers.conf file with full paths to the default layers, meta and meta-yocto.

I thought the point of sstate was that I could copy it between build directories - or even different hosts - and save myself the effort of rebuilding everything if the remaining metadata was the same?

Scott

Scott Garman
Embedded Linux Engineer - Yocto Project
Intel Open Source Technology Center

We have the same issue,

I tried to setup a buildbot to warm up sstate caches over night, and let developers use this common sstate to speed up build times. Epic fail, since paths usually are not consistent.
And it seems you can't even fake an "identical path" with symlinks either, bitbake detects the symlink and rebuilds everything.

The sstate cache needs improvement.
Would this issue be considered a bug or a feature request ?, Are there any requests on how this should be solved ?

Br,
David

Afaik your BBLAYERS should not be in your signatures at all, unless something in the metadata is accessing it. For what it's worth, I reuse sstate every day, but don't use the poky/oe-core scripts (oe-init-build-env).

Christopher Larson

As a follow-up to this thread, I spent a bit of time today trying to reproduce/isolate the issue, and I could not do so. Changing the paths to layers correctly rebuilt from sstate, and adding an empty layer also didn't trigger a rebuild. So I'm not sure what I saw previously, but unfortunately my original example of this is no longer available for me to work with.

I apologize for causing any confusion, but it's still quite possible we have some issues - I'll definitely use bitbake-diffsig to dig deeper the next time I see it.

Scott

Scott Garman
Embedded Linux Engineer - Yocto Project
Intel Open Source Technology Center

The paths issue your are speculating on was fixed by myself and Richard last November.

I would suggest running bitbake-diffsig to determine the actual sstate differences.

-M

On Feb 3, 2012 10:51 PM, "Scott Garman" <[email protected]<mailto:[email protected]>> wrote:
Hello,

I'm trying to re-use the sstate from one build directory and move it to another. It's not working - bitbake is rebuilding *everything*.

My hunch is the reason for this is because bblayers.conf must differ between the two build directories, because it uses full paths to the layer directories.

By default, when you source oe-init-build-env for the first time, it generates a bblayers.conf file with full paths to the default layers, meta and meta-yocto.

I thought the point of sstate was that I could copy it between build directories - or even different hosts - and save myself the effort of rebuilding everything if the remaining metadata was the same?

Scott

--
Scott Garman
Embedded Linux Engineer - Yocto Project
Intel Open Source Technology Center
_______________________________________________
yocto mailing list [email protected]<mailto:[email protected]>
https://lists.yoctoproject.org/listinfo/yocto

Usually I'm complaining that sstate cache is not used enough, but today I got pretty decent percentage of reuse while building from scratch 2 similar machines (nokia900 and om-gta04) but also few wrong sysroot references which slipped in (I thought those were fixed).

First I've built my image for nokia900, then for om-gta04 (with rm_work disabled to reuse sstate).

OE @ ~/shr-core/tmp-eglibc/sysroots/om-gta04 $ grep -R nokia900 . 2>/dev/null >nokia900.log

$ wc -l nokia900.log
1673 nokia900.log

now lot's of binaries have some reference to nokia900 sysroot, grep shows e.g. "Binary file ./lib/ld-2.15.so matches"

$ grep "^Binary file " nokia900.log | wc -l
1637

which is maybe fine..

An then there is few crossscripts and headers some are already in SSTATE_SCAN_FILES some are missing I guess:

$ grep -v "^Binary file " nokia900.log | wc -l
36
$ grep -v "^Binary file " nokia900.log | sed 's/:.*//g' | sort -u
./usr/bin/crossscripts/arm-oe-linux-gnueabi-libtool
./usr/bin/crossscripts/curl-config
./usr/bin/crossscripts/libgcrypt-config
./usr/bin/crossscripts/libtoolize
./usr/include/gmp.h
./usr/lib/gcc/arm-oe-linux-gnueabi/4.6.3/plugin/include/configargs.h
./usr/lib/python2.7/config/Makefile

Complete output attached

Martin 'JaMa' Jansa     jabber: [email protected]

./usr/bin/crossscripts/libgcrypt-config:gpg_error_libs="-L/OE/shr-core/tmp-eglibc/sysroots/nokia900/usr/lib -lgpg-error"
./usr/bin/crossscripts/libgcrypt-config:gpg_error_cflags="-I/OE/shr-core/tmp-eglibc/sysroots/nokia900/usr/include"
./usr/bin/crossscripts/arm-oe-linux-gnueabi-libtool:LTCC="arm-oe-linux-gnueabi-gcc -march=armv7-a -fno-tree-vectorize -mthumb-interwork -mfloat-abi=softfp -mfpu=neon -mtune=cortex-a8 --sysroot=/OE/shr-core/tmp-eglibc/sysroots/nokia900"
./usr/bin/crossscripts/arm-oe-linux-gnueabi-libtool:lt_sysroot=/OE/shr-core/tmp-eglibc/sysroots/nokia900
./usr/bin/crossscripts/arm-oe-linux-gnueabi-libtool:sys_lib_search_path_spec="/OE/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/lib/armv7a-vfp-neon-oe-linux-gnueabi/gcc/arm-oe-linux-gnueabi/4.6.3 /OE/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/arm-oe-linux-gnueabi/lib /OE/shr-core/tmp-eglibc/sysroots/nokia900/lib /OE/shr-core/tmp-eglibc/sysroots/nokia900/usr/lib/arm-oe-linux-gnueabi/4.6.3 /OE/shr-core/tmp-eglibc/sysroots/nokia900/usr/lib " ./usr/bin/crossscripts/arm-oe-linux-gnueabi-libtool:LD="arm-oe-linux-gnueabi-ld --sysroot=/OE/shr-core/tmp-eglibc/sysroots/nokia900"
./usr/bin/crossscripts/arm-oe-linux-gnueabi-libtool:CC="arm-oe-linux-gnueabi-gcc -march=armv7-a -fno-tree-vectorize -mthumb-interwork -mfloat-abi=softfp -mfpu=neon -mtune=cortex-a8 --sysroot=/OE/shr-core/tmp-eglibc/sysroots/nokia900"
./usr/bin/crossscripts/arm-oe-linux-gnueabi-libtool:LD="arm-oe-linux-gnueabi-ld --sysroot=/OE/shr-core/tmp-eglibc/sysroots/nokia900"
./usr/bin/crossscripts/arm-oe-linux-gnueabi-libtool:CC="arm-oe-linux-gnueabi-g++ -march=armv7-a -fno-tree-vectorize -mthumb-interwork -mfloat-abi=softfp -mfpu=neon -mtune=cortex-a8 --sysroot=/OE/shr-core/tmp-eglibc/sysroots/nokia900"
./usr/bin/crossscripts/arm-oe-linux-gnueabi-libtool:compiler_lib_search_dirs="/OE/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/lib/armv7a-vfp-neon-oe-linux-gnueabi/gcc/arm-oe-linux-gnueabi/4.6.3 /OE/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/lib/armv7a-vfp-neon-oe-linux-gnueabi/gcc/arm-oe-linux-gnueabi/4.6.3/../../../../../arm-oe-linux-gnueabi/lib /OE/shr-core/tmp-eglibc/sysroots/nokia900/lib /OE/shr-core/tmp-eglibc/sysroots/nokia900/usr/lib/arm-oe-linux-gnueabi/4.6.3 /OE/shr-core/tmp-eglibc/sysroots/nokia900/usr/lib" ./usr/bin/crossscripts/arm-oe-linux-gnueabi-libtool:predep_objects="/OE/shr-core/tmp-eglibc/sysroots/nokia900/usr/lib/crti.o /OE/shr-core/tmp-eglibc/sysroots/nokia900/usr/lib/arm-oe-linux-gnueabi/4.6.3/crtbeginS.o"
./usr/bin/crossscripts/arm-oe-linux-gnueabi-libtool:postdep_objects="/OE/shr-core/tmp-eglibc/sysroots/nokia900/usr/lib/arm-oe-linux-gnueabi/4.6.3/crtendS.o /OE/shr-core/tmp-eglibc/sysroots/nokia900/usr/lib/crtn.o"
./usr/bin/crossscripts/arm-oe-linux-gnueabi-libtool:compiler_lib_search_path="-L/OE/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/lib/armv7a-vfp-neon-oe-linux-gnueabi/gcc/arm-oe-linux-gnueabi/4.6.3 -L/OE/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/lib/armv7a-vfp-neon-oe-linux-gnueabi/gcc/arm-oe-linux-gnueabi/4.6.3/../../../../../arm-oe-linux-gnueabi/lib -L/OE/shr-core/tmp-eglibc/sysroots/nokia900/lib -L/OE/shr-core/tmp-eglibc/sysroots/nokia900/usr/lib/arm-oe-linux-gnueabi/4.6.3 -L/OE/shr-core/tmp-eglibc/sysroots/nokia900/usr/lib" ./usr/bin/crossscripts/arm-oe-linux-gnueabi-libtool:LD="arm-oe-linux-gnueabi-ld --sysroot=/OE/shr-core/tmp-eglibc/sysroots/nokia900"
./usr/bin/crossscripts/arm-oe-linux-gnueabi-libtool:CC="arm-oe-linux-gnueabi-g77 -march=armv7-a -fno-tree-vectorize -mthumb-interwork -mfloat-abi=softfp -mfpu=neon -mtune=cortex-a8 --sysroot=/OE/shr-core/tmp-eglibc/sysroots/nokia900"
./usr/bin/crossscripts/arm-oe-linux-gnueabi-libtool:LD="arm-oe-linux-gnueabi-ld --sysroot=/OE/shr-core/tmp-eglibc/sysroots/nokia900"
./usr/bin/crossscripts/arm-oe-linux-gnueabi-libtool:LD="arm-oe-linux-gnueabi-ld --sysroot=/OE/shr-core/tmp-eglibc/sysroots/nokia900"
./usr/bin/crossscripts/arm-oe-linux-gnueabi-libtool:LD="arm-oe-linux-gnueabi-ld --sysroot=/OE/shr-core/tmp-eglibc/sysroots/nokia900"
./usr/bin/crossscripts/curl-config: echo "arm-oe-linux-gnueabi-gcc -march=armv7-a -fno-tree-vectorize -mthumb-interwork -mfloat-abi=softfp -mfpu=neon -mtune=cortex-a8 --sysroot=/OE/shr-core/tmp-eglibc/sysroots/nokia900"
./usr/bin/crossscripts/curl-config: echo ${CURLLIBDIR}-lcurl -Wl,-O1 -Wl,--hash-style=gnu -Wl,--as-needed -L/OE/shr-core/tmp-eglibc/sysroots/nokia900/usr/lib/..//lib -L/OE/shr-core/tmp-eglibc/sysroots/nokia900/usr/lib/..//lib -lgcrypt -lrt -lz -lgnutls
./usr/bin/crossscripts/curl-config: echo ${CURLLIBDIR}-lcurl -Wl,-O1 -Wl,--hash-style=gnu -Wl,--as-needed -L/OE/shr-core/tmp-eglibc/sysroots/nokia900/usr/lib/..//lib -L/OE/shr-core/tmp-eglibc/sysroots/nokia900/usr/lib/..//lib
./usr/bin/crossscripts/curl-config: echo /usr/lib/libcurl.a -Wl,-O1 -Wl,--hash-style=gnu -Wl,--as-needed -L/OE/shr-core/tmp-eglibc/sysroots/nokia900/usr/lib/..//lib -L/OE/shr-core/tmp-eglibc/sysroots/nokia900/usr/lib/..//lib -lgcrypt -lrt -lz -lgnutls
./usr/bin/crossscripts/curl-config: echo " '--build=x86_64-linux' '--host=arm-oe-linux-gnueabi' '--target=arm-oe-linux-gnueabi' '--prefix=/usr' '--exec_prefix=/usr' '--bindir=/OE/shr-core/tmp-eglibc/sysroots/om-gta04/usr/bin' '--sbindir=/OE/shr-core/tmp-eglibc/sysroots/om-gta04/usr/sbin' '--libexecdir=/OE/shr-core/tmp-eglibc/sysroots/om-gta04/usr/libexec' '--datadir=/OE/shr-core/tmp-eglibc/sysroots/om-gta04/usr/share' '--sysconfdir=/etc' '--sharedstatedir=/com' '--localstatedir=/var' '--libdir=/usr/lib' '--includedir=/OE/shr-core/tmp-eglibc/sysroots/om-gta04/usr/include' '--oldincludedir=/usr/include' '--infodir=/usr/share/info' '--mandir=/usr/share/man' '--disable-silent-rules' '--disable-dependency-tracking' '--with-libtool-sysroot=/OE/shr-core/tmp-eglibc/sysroots/nokia900' '--with-zlib=/OE/shr-core/tmp-eglibc/sysroots/nokia900/usr/lib/../' '--without-ssl' '--without-libssh2' '--with-random=/dev/urandom' '--without-libidn' '--enable-crypto-auth' '--with-gnutls=/OE/shr-core/tmp-eglibc/sysroots/nokia900/usr/lib/../' 'build_alias=x86_64-linux' 'host_alias=arm-oe-linux-gnueabi' 'target_alias=arm-oe-linux-gnueabi' 'CC=arm-oe-linux-gnueabi-gcc -march=armv7-a -fno-tree-vectorize -mthumb-interwork -mfloat-abi=softfp -mfpu=neon -mtune=cortex-a8 --sysroot=/OE/shr-core/tmp-eglibc/sysroots/nokia900' 'CFLAGS=-O2 -pipe -g -feliminate-unused-debug-types' 'LDFLAGS=-Wl,-O1 -Wl,--hash-style=gnu -Wl,--as-needed' 'CPPFLAGS=' 'CPP=arm-oe-linux-gnueabi-gcc -E --sysroot=/OE/shr-core/tmp-eglibc/sysroots/nokia900 -march=armv7-a -fno-tree-vectorize -mthumb-interwork -mfloat-abi=softfp -mfpu=neon -mtune=cortex-a8'"

./usr/bin/crossscripts/libtoolize:  datadir=/OE/shr-core/tmp-eglibc/sysroots/nokia900/usr/share
./usr/bin/crossscripts/libtoolize:  pkgdatadir=/OE/shr-core/tmp-eglibc/sysroots/nokia900/usr/share/libtool
./usr/bin/crossscripts/libtoolize:  pkgltdldir=/OE/shr-core/tmp-eglibc/sysroots/nokia900/usr/share/libtool
./usr/bin/crossscripts/libtoolize:  aclocaldir=/OE/shr-core/tmp-eglibc/sysroots/nokia900/usr/share/aclocal

./usr/lib/python2.7/config/Makefile:CC= arm-oe-linux-gnueabi-gcc -march=armv7-a -fno-tree-vectorize -mthumb-interwork -mfloat-abi=softfp -mfpu=neon -mtune=cortex-a8 -D__SOFTFP__ --sysroot=/OE/shr-core/tmp-eglibc/sysroots/nokia900
./usr/lib/python2.7/config/Makefile:CXX= arm-oe-linux-gnueabi-g++ -march=armv7-a -fno-tree-vectorize -mthumb-interwork -mfloat-abi=softfp -mfpu=neon -mtune=cortex-a8 -D__SOFTFP__ --sysroot=/OE/shr-core/tmp-eglibc/sysroots/nokia900
./usr/lib/python2.7/config/Makefile:LDFLAGS=-L. -L/OE/shr-core/tmp-eglibc/sysroots/nokia900/usr/lib -Wl,-O1 -Wl,--hash-style=gnu -Wl,--as-needed
./usr/lib/python2.7/config/Makefile:LIBDIR= /OE/shr-core/tmp-eglibc/sysroots/nokia900/usr/lib
./usr/lib/python2.7/config/Makefile:INCLUDEDIR= /OE/shr-core/tmp-eglibc/sysroots/nokia900/usr/include
./usr/lib/python2.7/config/Makefile:CONFIG_ARGS= '--build=x86_64-linux' '--host=arm-oe-linux-gnueabi' '--target=arm-oe-linux-gnueabi' '--prefix=/usr' '--exec_prefix=/usr' '--bindir=/usr/bin' '--sbindir=/usr/sbin' '--libexecdir=/OE/shr-core/tmp-eglibc/sysroots/nokia900/usr/libexec' '--datadir=/usr/share' '--sysconfdir=/etc' '--sharedstatedir=/com' '--localstatedir=/var' '--libdir=/usr/lib' '--includedir=/OE/shr-core/tmp-eglibc/sysroots/nokia900/usr/include' '--oldincludedir=/usr/include' '--infodir=/usr/share/info' '--mandir=/usr/share/man' '--disable-silent-rules' '--disable-dependency-tracking' '--with-libtool-sysroot=/OE/shr-core/tmp-eglibc/sysroots/nokia900' '--with-threads' '--with-pymalloc' '--with-cyclic-gc' '--without-cxx' '--with-signal-module' '--with-wctype-functions' '--enable-shared' 'build_alias=x86_64-linux' 'host_alias=arm-oe-linux-gnueabi' 'target_alias=arm-oe-linux-gnueabi' 'CC=arm-oe-linux-gnueabi-gcc -march=armv7-a -fno-tree-vectorize -mthumb-interwork -mfloat-abi=softfp -mfpu=neon -mtune=cortex-a8 -D__SOFTFP__ --sysroot=/OE/shr-core/tmp-eglibc/sysroots/nokia900' 'CFLAGS=-O2 -pipe -g -feliminate-unused-debug-types' 'LDFLAGS=-L. -L/OE/shr-core/tmp-eglibc/sysroots/nokia900/usr/lib-Wl,-O1 -Wl,--hash-style=gnu -Wl,--as-needed' 'CPPFLAGS=' 'CPP=arm-oe-linux-gnueabi-gcc -E --sysroot=/OE/shr-core/tmp-eglibc/sysroots/nokia900 -march=armv7-a -fno-tree-vectorize -mthumb-interwork -mfloat-abi=softfp -mfpu=neon -mtune=cortex-a8 -D__SOFTFP__'
./usr/lib/python2.7/config/Makefile: $(RUNSHARED) /OE/shr-core/tmp-eglibc/sysroots/nokia900/usr/libexec/oah/translate ./$(BUILDPYTHON) -E -tt $(TESTPROG) -uall $(TESTOPTS)
./usr/lib/gcc/arm-oe-linux-gnueabi/4.6.3/plugin/include/configargs.h:static const char configuration_arguments[] = "/OE/shr-core/tmp-eglibc/work-shared/gcc-4.6.2+svnr181430-r27/gcc-4_6-branch/configure --build=x86_64-linux --host=arm-oe-linux-gnueabi --target=arm-oe-linux-gnueabi --prefix=/usr --exec_prefix=/usr --bindir=/usr/bin --sbindir=/usr/sbin --libexecdir=/usr/libexec --datadir=/usr/share --sysconfdir=/etc --sharedstatedir=/com --localstatedir=/var --libdir=/usr/lib --includedir=/usr/include --oldincludedir=/usr/include --infodir=/usr/share/info --mandir=/usr/share/man --disable-silent-rules --disable-dependency-tracking --with-libtool-sysroot=/OE/shr-core/tmp-eglibc/sysroots/nokia900 --with-gnu-ld --enable-shared --enable-languages=c,c++ --enable-threads=posix --disable-multilib --enable-c99 --enable-long-long --enable-symvers=gnu --enable-libstdcxx-pch --program-prefix=arm-oe-linux-gnueabi- --enable-target-optspace --enable-lto --enable-libssp --disable-bootstrap --disable-libgomp --disable-libmudflap --with-system-zlib --with-linker-hash-style=gnu --enable-cheaders=c_global --with-local-prefix=/OE/shr-core/tmp-eglibc/sysroots/nokia900/usr --with-gxx-include-dir=/usr/include/c++/ --enable-nls --enable-__cxa_atexit";
./usr/include/gmp.h:#define __GMP_CC "arm-oe-linux-gnueabi-gcc -march=armv7-a -fno-tree-vectorize -mthumb-interwork -mfloat-abi=softfp -mfpu=neon -mtune=cortex-a8 --sysroot=/OE/shr-core/tmp-eglibc/sysroots/nokia900 -std=gnu99"

and there is more

./usr/bin/crossscripts/apu-1-config:INCLUDES="-I/OE/shr-core/tmp-eglibc/sysroots/nokia900/usr/include" ./usr/bin/crossscripts/apu-1-config:LDFLAGS="-L/OE/shr-core/tmp-eglibc/sysroots/nokia900/usr/lib"

./usr/bin/crossscripts/gdlib-config: echo -L/OE/shr-core/tmp-eglibc/sysroots/nokia900/usr/lib -Wl,-O1 -Wl,--hash-style=gnu -Wl,--as-needed -L/OE/shr-core/tmp-eglibc/sysroots/nokia900/usr/lib/../lib
./usr/bin/crossscripts/gdlib-config: echo "ldflags: -L/OE/shr-core/tmp-eglibc/sysroots/nokia900/usr/lib -Wl,-O1 -Wl,--hash-style=gnu -Wl,--as-needed -L/OE/shr-core/tmp-eglibc/sysroots/nokia900/usr/lib/../lib"

./usr/bin/crossscripts/apr-1-config:CC="arm-oe-linux-gnueabi-gcc -march=armv7-a -fno-tree-vectorize -mthumb-interwork -mfloat-abi=softfp -mfpu=neon -mtune=cortex-a8 --sysroot=/OE/shr-core/tmp-eglibc/sysroots/nokia900"
./usr/bin/crossscripts/apr-1-config:CPP="arm-oe-linux-gnueabi-gcc -E --sysroot=/OE/shr-core/tmp-eglibc/sysroots/nokia900 -march=armv7-a -fno-tree-vectorize -mthumb-interwork -mfloat-abi=softfp -mfpu=neon -mtune=cortex-a8"

./usr/lib/postgresql/pgxs/src/Makefile.global:CPP = arm-oe-linux-gnueabi-gcc -E --sysroot=/OE/shr-core/tmp-eglibc/sysroots/nokia900 -march=armv7-a -fno-tree-vectorize -mthumb-interwork -mfloat-abi=softfp -mfpu=neon -mtune=cortex-a8
./usr/lib/postgresql/pgxs/src/Makefile.global:CC = arm-oe-linux-gnueabi-gcc -march=armv7-a -fno-tree-vectorize -mthumb-interwork -mfloat-abi=softfp -mfpu=neon -mtune=cortex-a8 --sysroot=/OE/shr-core/tmp-eglibc/sysroots/nokia900
./usr/lib/postgresql/pgxs/src/Makefile.global:LD = arm-oe-linux-gnueabi-ld --sysroot=/OE/shr-core/tmp-eglibc/sysroots/nokia900

./usr/share/apr/apr_rules.mk:CC=arm-oe-linux-gnueabi-gcc -march=armv7-a -fno-tree-vectorize -mthumb-interwork -mfloat-abi=softfp -mfpu=neon -mtune=cortex-a8 --sysroot=/OE/shr-core/tmp-eglibc/sysroots/nokia900

./usr/share/build-1/apr_rules.mk:CC=arm-oe-linux-gnueabi-gcc -march=armv7-a -fno-tree-vectorize -mthumb-interwork -mfloat-abi=softfp -mfpu=neon -mtune=cortex-a8 --sysroot=/OE/shr-core/tmp-eglibc/sysroots/nokia900

Cheers,