Skip to content

testimage/oeqa: Add ability to export tests to decouple them from the build system

Stefan Stanacar openembedded-core 1 version New

Get series with b4
b4 am [email protected]

Versions newest first

  1. v1 Latest3 patches 0 repliesNew

Patches in v1 No applies recorded yet

#Subject and filesSizeRepliesApplied
1/3testimage: add ability to export testsmeta/classes/testimage.bbclass meta/lib/oeqa/oetest.py+98 -260 replies
2/3lib/oeqa: add module for running tests outside of the build systemmeta/lib/oeqa/runexported.py+140 -00 replies
3/3oeqa/utils: targetbuild: don't use bb.fetch anymoremeta/lib/oeqa/utils/targetbuild.py+8 -190 replies

Reviews trailers per patch

No Reviewed-by, Acked-by or Tested-by trailers for v1 yet.

Read the v1 thread

Cover letter [PATCH 0/3] testimage/oeqa: Add ability to export tests to decouple them from the build system

Hello,

These patches add the ability to export and run tests outside of the build.
As tests used to query values from the data storage this exports parts of d
and makes them avaiable in a json file, so tests don't need to change to
make them exportable. Tests exported are the ones defined in TEST_SUITES regardless of layer.
Starting the target (in the default case qemu) is still handled by the build system, as before, so keep that in mind.

Simplest way to test this is with a qemu image that you manually start. For an already build image use this in local.conf:
TEST_EXPORT_ONLY = "1"
TEST_TARGET = "simpleremote"
TEST_TARGET_IP = "192.168.7.2"
TEST_SERVER_IP = "192.168.7.1"
Export the tests: bitbake core-image-sato -c testimage
Then: runqemu core-image-sato
And: cd tmp/testimage/core-image-sato && ./runexported.py testdata.json

In the default case (TEST_EXPORT_ONLY = "0") nothing really changes so no tests should start failing because of this.

Cheers,
Stefan

The following changes since commit 76f52a81f600fe7dfee0987db361e973b9ab71f8:

insane: Fix python function whitespace changes (2014-02-03 16:16:30 +0000)

are available in the git repository at:

git://git.yoctoproject.org/poky-contrib stefans/export
http://git.yoctoproject.org/cgit.cgi/poky-contrib/log/?h=stefans/export

Stefan Stanacar (3):
testimage: add ability to export tests
lib/oeqa: add module for running tests outside of the build system oeqa/utils: targetbuild: don't use bb.fetch anymore

 meta/classes/testimage.bbclass     | 107 ++++++++++++++++++++++++----
 meta/lib/oeqa/oetest.py            |  17 ++---
 meta/lib/oeqa/runexported.py       | 140 +++++++++++++++++++++++++++++++++++++
 meta/lib/oeqa/utils/targetbuild.py |  27 +++----
 4 files changed, 246 insertions(+), 45 deletions(-)
 create mode 100755 meta/lib/oeqa/runexported.py
Signature · 1 line
1.8.5.3