00/15] Add support for generate bitbake/oe-selftest error reports
PATCH v2 1/1 00/15] Add support for generate bitbake/oe-selftest error reports
This v2 adds support for generate also oe-selftest reports this is almost the previous version with changes requested in review [1], the next patches starts from patch,
autobuilder/lib/{ABtools,builsteps}.py: Create save_error_report func
Also the changes could be reviewed at [2].
[1] https://lists.yoctoproject.org/pipermail/yocto/2016-June/030515.html
[2] http://git.yoctoproject.org/cgit/cgit.cgi/yocto-autobuilder/log/?h=contrib/alimon/devel
Aníbal Limón (15):
lib/buildsteps.py: Add BitbakeShellCommand class lib/buildsteps.py: Add BitbakeLogLineObserver for
BitbakeShellCommands.
lib/buildsteps: BitbakeShellCommand add support for create error
reports
lib/ABTools: Add functions for get errordir path in controller and
worker
buildbot: Add support for DirectoryDownload transfer step autobuilder/buildsteps: Add DownloadBitbakeErrorReports step
buiidsets: Add DownloadBitbakeErrorReport step lib/buildsteps.py: BitbakeShellCommand add support for error_type autobuilder/lib/buildsteps.py: BitbakeShellCommand update error report
types.
autobuilder/lib/{ABtools,builsteps}.py: Create save_error_report func autobuilder/lib/ABTools.py: Add get_lsb_distro function buildsteps/RunOeSelftest.py: Add support for create/save error reports nightly-oe-selftest.conf: Add steps for Download and Send error
report.
autobuilder/buildsteps: Rename DownloadBitbakeErrorReports to
DownloadErrorReports
buildset-config: Update references from DownloadBitbakeErrorReports to
DownloadErrorReports
buildset-config.controller/build-appliance.conf | 1 + buildset-config.controller/buildtools.conf | 1 + buildset-config.controller/nightly-arm-lsb.conf | 1 + buildset-config.controller/nightly-arm.conf | 1 + buildset-config.controller/nightly-arm64.conf | 1 + .../nightly-deb-non-deb.conf | 1 + buildset-config.controller/nightly-deb.conf | 1 + buildset-config.controller/nightly-ipk.conf | 1 + buildset-config.controller/nightly-mips-lsb.conf | 1 + buildset-config.controller/nightly-mips.conf | 1 + buildset-config.controller/nightly-mips64.conf | 1 + buildset-config.controller/nightly-multilib.conf | 1 + buildset-config.controller/nightly-musl.conf | 1 + buildset-config.controller/nightly-no-x11.conf | 1 + buildset-config.controller/nightly-non-gpl3.conf | 1 + .../nightly-oe-selftest.conf | 5 +- buildset-config.controller/nightly-oecore.conf | 1 + buildset-config.controller/nightly-ppc-lsb.conf | 1 + buildset-config.controller/nightly-ppc.conf | 1 + buildset-config.controller/nightly-qa-extras.conf | 1 + .../nightly-qa-logrotate.conf | 1 + buildset-config.controller/nightly-qa-pam.conf | 1 + .../nightly-qa-skeleton.conf | 1 + buildset-config.controller/nightly-qa-systemd.conf | 1 + .../nightly-qa-targetbuilds.conf | 1 + .../nightly-rpm-non-rpm.conf | 1 + buildset-config.controller/nightly-rpm.conf | 1 + buildset-config.controller/nightly-uclibc.conf | 1 + buildset-config.controller/nightly-world-lsb.conf | 1 + buildset-config.controller/nightly-world.conf | 1 + buildset-config.controller/nightly-x32.conf | 1 + buildset-config.controller/nightly-x86-64-lsb.conf | 1 + buildset-config.controller/nightly-x86-64.conf | 1 + buildset-config.controller/nightly-x86-lsb.conf | 1 + buildset-config.controller/nightly-x86.conf | 1 + buildset-config.controller/nightly.conf | 1 + buildset-config.controller/poky-tiny.conf | 1 + buildset-config.examples/awesomefirmware.conf | 1 + buildset-config.freescale/nightly-fsl-arm-lsb.conf | 1 + buildset-config.freescale/nightly-fsl-arm.conf | 1 + buildset-config.freescale/nightly-fsl-ppc-lsb.conf | 1 + buildset-config.freescale/nightly-fsl-ppc.conf | 1 + buildset-config.iot-devkit/iot-devkit.conf | 1 + buildset-config.kernel/kernel-arm-lsb.conf | 1 + buildset-config.kernel/kernel-arm.conf | 1 + buildset-config.kernel/kernel-arm64.conf | 1 + buildset-config.kernel/kernel-mips-lsb.conf | 1 + buildset-config.kernel/kernel-mips.conf | 1 + buildset-config.kernel/kernel-ppc-lsb.conf | 1 + buildset-config.kernel/kernel-ppc.conf | 1 + buildset-config.kernel/kernel-x86-64-lsb.conf | 1 + buildset-config.kernel/kernel-x86-64.conf | 1 + buildset-config.kernel/kernel-x86-lsb.conf | 1 + buildset-config.kernel/kernel-x86.conf | 1 + buildset-config.kernel/nightly-kernel.conf | 1 + buildset-config.tizen/nightly-tizen-ivi.conf | 1 + buildset-config.tizen/nightly-tizen.conf | 1 + buildset-config.tizen/nightly.conf | 1 + .../autobuilder/buildsteps/BuildImages.py | 7 +- .../autobuilder/buildsteps/BuildToolchainImages.py | 7 +- .../autobuilder/buildsteps/DownloadErrorReports.py | 42 +++++++++ .../autobuilder/buildsteps/GetBitbakeVersion.py | 6 +- .../autobuilder/buildsteps/RunESDKSanityTests.py | 6 +- .../autobuilder/buildsteps/RunOeSelftest.py | 46 +++++++++ .../autobuilder/buildsteps/RunSDKSanityTests.py | 6 +- .../autobuilder/buildsteps/RunSanityTests.py | 6 +- .../autobuilder/buildsteps/SendErrorReport.py | 16 ++-- .../site-packages/autobuilder/lib/ABTools.py | 59 ++++++++++++ .../site-packages/autobuilder/lib/buildsteps.py | 104 +++++++++++++++++++++ .../buildbot/steps/transfer.py | 86 ++++++++++++++++- .../buildslave/commands/registry.py | 1 + .../buildslave/commands/transfer.py | 79 ++++++++++++++++ 72 files changed, 509 insertions(+), 24 deletions(-) create mode 100644 lib/python2.7/site-packages/autobuilder/buildsteps/DownloadErrorReports.py
Signature · 1 line
2.1.4
PATCH v2 1/1 01/15] lib/buildsteps.py: Add BitbakeShellCommand class
The BitbakeShellCommand is a new class for store common methods when is aim to run bitbake inside an step.
Also don't call directly the ShellCommand constructur use super to be able for call the parent constructor no matter what is this enables to call BitbakeShellCommand constructor.
--- lib/python2.7/site-packages/autobuilder/buildsteps/BuildImages.py | 7 +++++-- .../site-packages/autobuilder/buildsteps/BuildToolchainImages.py | 7 +++++-- .../site-packages/autobuilder/buildsteps/GetBitbakeVersion.py | 6 ++++-- .../site-packages/autobuilder/buildsteps/RunESDKSanityTests.py | 6 ++++-- .../site-packages/autobuilder/buildsteps/RunSDKSanityTests.py | 6 ++++-- .../site-packages/autobuilder/buildsteps/RunSanityTests.py | 6 ++++-- lib/python2.7/site-packages/autobuilder/lib/buildsteps.py | 5 +++++ 7 files changed, 31 insertions(+), 12 deletions(-)
lib/python2.7/site-packages/autobuilder/buildsteps/BuildImages.py +5 -2
@@ -17,7 +17,9 @@ from distutils.version import StrictVersion from buildbot.status.results import SUCCESS, SKIPPED import os -class BuildImages(ShellCommand): +from lib.buildsteps import BitbakeShellCommand + +class BuildImages(BitbakeShellCommand): haltOnFailure = False flunkOnFailure = True name = "BuildImages"
@@ -32,7 +34,8 @@ class BuildImages(ShellCommand): # Timeout needs to be passed to LoggingBuildStep as a kwarg self.timeout = 100000 kwargs['timeout']=self.timeout - ShellCommand.__init__(self, **kwargs) + super(BuildImages, self).__init__(factory, argdict=None, + **kwargs) def start(self): self.localconf = self.getProperty("LOCALCONF")
lib/python2.7/site-packages/autobuilder/buildsteps/BuildToolchainImages.py +5 -2
@@ -15,7 +15,9 @@ from buildbot.steps.shell import ShellCommand from buildbot.process.buildstep import LogLineObserver import os -class BuildToolchainImages(ShellCommand): +from lib.buildsteps import BitbakeShellCommand + +class BuildToolchainImages(BitbakeShellCommand): haltOnFailure = False flunkOnFailure = True name = "Building Toolchain Images"
@@ -29,7 +31,8 @@ class BuildToolchainImages(ShellCommand): # Timeout needs to be passed to LoggingBuildStep as a kwarg self.timeout = 100000 kwargs['timeout']=self.timeout - ShellCommand.__init__(self, **kwargs) + super(BuildToolchainImages, self).__init__(factory, argdict=None, + **kwargs) def start(self): layerversion = self.getProperty("layerversion_core")
lib/python2.7/site-packages/autobuilder/buildsteps/GetBitbakeVersion.py +4 -2
@@ -16,7 +16,9 @@ from buildbot.process.properties import WithProperties from twisted.python import log from autobuilder.config import * -class GetBitbakeVersion(ShellCommand): +from lib.buildsteps import BitbakeShellCommand + +class GetBitbakeVersion(BitbakeShellCommand): haltOnFailure = False flunkOnFailure = False name = "GetBitbakeVersion"
@@ -27,7 +29,7 @@ class GetBitbakeVersion(ShellCommand): self.workerworkdir=os.path.join(os.path.join(YOCTO_ABBASE, "yocto-worker")) for k, v in argdict.iteritems(): setattr(self, k, v) - ShellCommand.__init__(self, **kwargs) + super(GetBitbakeVersion, self).__init__(factory, argdict=None, **kwargs) def start(self): buildername=self.getProperty("buildername")
lib/python2.7/site-packages/autobuilder/buildsteps/RunESDKSanityTests.py +4 -2
@@ -16,7 +16,9 @@ from buildbot.status.results import SUCCESS, FAILURE from twisted.python import log as tlog import os, re -class RunESDKSanityTests(ShellCommand): +from lib.buildsteps import BitbakeShellCommand + +class RunESDKSanityTests(BitbakeShellCommand): haltOnFailure = False flunkOnFailure = True
@@ -39,7 +41,7 @@ class RunESDKSanityTests(ShellCommand): setattr(self, k, v) self.description = "Running SDK Sanity Tests" kwargs['timeout']=self.timeout - ShellCommand.__init__(self, **kwargs) + super(RunESDKSanityTests, self).__init__(factory, argdict=None, **kwargs) def start(self): layerversion = self.getProperty("layerversion_core")
lib/python2.7/site-packages/autobuilder/buildsteps/RunSDKSanityTests.py +4 -2
@@ -16,7 +16,9 @@ from buildbot.status.results import SUCCESS, FAILURE from twisted.python import log as tlog import os, re -class RunSDKSanityTests(ShellCommand): +from lib.buildsteps import BitbakeShellCommand + +class RunSDKSanityTests(BitbakeShellCommand): haltOnFailure = False flunkOnFailure = True
@@ -39,7 +41,7 @@ class RunSDKSanityTests(ShellCommand): setattr(self, k, v) self.description = "Running SDK Sanity Tests" kwargs['timeout']=self.timeout - ShellCommand.__init__(self, **kwargs) + super(RunSDKSanityTests, self).__init__(factory, argdict=None, **kwargs) def start(self): layerversion = self.getProperty("layerversion_core")
lib/python2.7/site-packages/autobuilder/buildsteps/RunSanityTests.py +4 -2
@@ -16,7 +16,9 @@ from buildbot.status.results import SUCCESS, FAILURE from twisted.python import log as tlog import os, re -class RunSanityTests(ShellCommand): +from lib.buildsteps import BitbakeShellCommand + +class RunSanityTests(BitbakeShellCommand): haltOnFailure = False flunkOnFailure = True
@@ -39,7 +41,7 @@ class RunSanityTests(ShellCommand): setattr(self, k, v) self.description = "Running Sanity Tests" kwargs['timeout']=self.timeout - ShellCommand.__init__(self, **kwargs) + super(RunSanityTests, self).__init__(factory, argdict=None, **kwargs) def start(self): layerversion = self.getProperty("layerversion_core")
lib/python2.7/site-packages/autobuilder/lib/buildsteps.py +5 -0
@@ -11,6 +11,7 @@ __email__ = "[email protected]" ''' import os + from buildbot.steps.shell import ShellCommand DEFAULT_SHELL = 'bash'
@@ -40,3 +41,7 @@ class ShellCommandCleanEnv(ShellCommand): pe_cmd += "%s=\"$%s\" " % (pe, pe) return "env -i %s %s -c " % (pe_cmd, shell) + +class BitbakeShellCommand(ShellCommand): + def __init__(self, factory, argdict=None, **kwargs): + super(BitbakeShellCommand, self).__init__(**kwargs)
Signature · 1 line
2.1.4
PATCH v2 1/1 02/15] lib/buildsteps.py: Add BitbakeLogLineObserver for BitbakeShellCommands.
In reply to Aníbal LimónThe BitbakeLogLineObserver look into stdio output of bitbake process and identify for exception/errors into log,
--- .../site-packages/autobuilder/lib/buildsteps.py | 51 ++++++++++++++++++++++ 1 file changed, 51 insertions(+)
lib/python2.7/site-packages/autobuilder/lib/buildsteps.py +51 -0
@@ -11,8 +11,10 @@ __email__ = "[email protected]" ''' import os +import re from buildbot.steps.shell import ShellCommand +from buildbot.process.buildstep import LogLineObserver DEFAULT_SHELL = 'bash'
@@ -42,6 +44,55 @@ class ShellCommandCleanEnv(ShellCommand): return "env -i %s %s -c " % (pe_cmd, shell) +class BitbakeLogLineObserver(LogLineObserver): + """ + Search in the stdio bitbake log for exception/errors, identify + if the error is a recipe/task one if not turn on the flag of + bitbake error/exception and save the log. + """ + + rexp_error = re.compile("^ERROR: .*$") + + # recipe task errors regex'es + rexp_pnpv_error = re.compile("^ERROR: (?P<pnpv>.*) do_(?P<task>.*):.*$") + rexp_task_error = re.compile("^ERROR: Task .*$") + rexp_log_error = re.compile("^ERROR: Logfile of failure stored in: "\ + "(?P<path>.*)$") + + def _handleError(self, line): + if not hasattr(self.step, 'errors'): + self.step.errors = {} + self.step.errors['bitbake'] = False + self.step.errors['log'] = [] + + # save all the log for be able to get report variables like + # machine, target, distro, etc + self.step.errors['log'].append(line) + + # discard line that are not errors and line that + # is recipe task errors + if (not self.rexp_error.match(line)) or \ + self.rexp_pnpv_error.match(line) or \ + self.rexp_task_error.match(line) or \ + self.rexp_log_error.match(line): + return + + # if not match recipe task type is a bitbake exception/error + self.step.errors['bitbake'] = True + + def outLineReceived(self, line): + self._handleError(line) + + def errLineReceived(self, line): + self._handleError(line) + class BitbakeShellCommand(ShellCommand): def __init__(self, factory, argdict=None, **kwargs): super(BitbakeShellCommand, self).__init__(**kwargs) + + self.stdio_observer = BitbakeLogLineObserver() + self.addLogObserver('stdio', self.stdio_observer) + + def commandComplete(self, cmd): + if cmd.didFail(): + pass
Signature · 1 line
2.1.4
PATCH v2 1/1 03/15] lib/buildsteps: BitbakeShellCommand add support for create error reports
In reply to Aníbal LimónWhen bitbake command fails and isn't a recipe task failure then create an error report and store into yocto-controller folder for be able to transfer to the worker in order to send to the Error report web.
--- .../site-packages/autobuilder/lib/buildsteps.py | 63 +++++++++++++++++++++- 1 file changed, 62 insertions(+), 1 deletion(-)
lib/python2.7/site-packages/autobuilder/lib/buildsteps.py +62 -1
@@ -13,9 +13,15 @@ __email__ = "[email protected]" import os import re +import time +import json +import codecs + from buildbot.steps.shell import ShellCommand from buildbot.process.buildstep import LogLineObserver +from autobuilder.config import YOCTO_ABBASE + DEFAULT_SHELL = 'bash' class ShellCommandCleanEnv(ShellCommand):
@@ -86,6 +92,12 @@ class BitbakeLogLineObserver(LogLineObserver): def errLineReceived(self, line): self._handleError(line) +def get_error_report_bitbake_dir(buildername, buildnumber): + errordir_base = os.path.join(YOCTO_ABBASE, 'yocto-controller', buildername, + 'error-report') + errordir = os.path.join(errordir_base, str(buildnumber)) + return errordir + class BitbakeShellCommand(ShellCommand): def __init__(self, factory, argdict=None, **kwargs): super(BitbakeShellCommand, self).__init__(**kwargs)
@@ -93,6 +105,55 @@ class BitbakeShellCommand(ShellCommand): self.stdio_observer = BitbakeLogLineObserver() self.addLogObserver('stdio', self.stdio_observer) + def _get_variables(self, log): + vrs = {} + + rexp = re.compile("^(.*)=.*\"(.*)\"$") + for line in log: + m = rexp.match(line) + if m: + vrs[m.group(1).rstrip()] = m.group(2) + + return vrs + + def _createBitbakeErrorReport(self, log): + vrs = self._get_variables(log) + + report = {} + report['machine'] = vrs['MACHINE'] + report['build_sys'] = vrs['BUILD_SYS'] + report['nativelsb'] = vrs['NATIVELSBSTRING'] + report['distro'] = vrs['DISTRO'] + report['target_sys'] = vrs['TARGET_SYS'] + + report['component'] = 'bitbake' + report['branch_commit'] = self.getProperty('branch') + ': ' + \ + self.getProperty('got_revision') + + failure = {} + failure['package'] = "bitbake-%s" % vrs['BB_VERSION'] + failure['task'] = self.command + failure['log'] = "\n".join(log) + + report['failures'] = [failure] + + return report + + def _saveBitbakeErrorReport(self, report): + buildername = self.getProperty('buildername') + buildnumber = self.getProperty('buildnumber') + + errordir = get_error_report_bitbake_dir(buildername, buildnumber) + if not os.path.exists(errordir): + os.makedirs(errordir) + + filename = os.path.join(errordir, "error_report_bitbake_%d.txt" % \ + int(time.time())) + with codecs.open(filename, 'w', 'utf-8') as f: + json.dump(report, f, indent=4, sort_keys=True) + def commandComplete(self, cmd): if cmd.didFail(): - pass + if self.errors['bitbake']: + report = self._createBitbakeErrorReport(self.errors['log']) + self._saveBitbakeErrorReport(report)
Signature · 1 line
2.1.4
PATCH v2 1/1 04/15] lib/ABTools: Add functions for get errordir path in controller and worker
In reply to Aníbal Limónget_error_report_controller_dir: Returns controller error report dir where bitbake exception/errors are stored.
get_error_report_worker_dir: Returns controller error report dir where recipe task failures are stored.
Also update the current sources to use that functions.
--- .../autobuilder/buildsteps/SendErrorReport.py | 16 +++++++--------- lib/python2.7/site-packages/autobuilder/lib/ABTools.py | 17 +++++++++++++++++ .../site-packages/autobuilder/lib/buildsteps.py | 10 ++-------- 3 files changed, 26 insertions(+), 17 deletions(-)
lib/python2.7/site-packages/autobuilder/buildsteps/SendErrorReport.py +7 -9
@@ -9,8 +9,12 @@ __version__ = "2.0" __maintainer__ = "Elizabeth Flanagan" __email__ = "[email protected]" ''' + +import os + from buildbot.steps.shell import ShellCommand -from autobuilder.config import * + +from lib.ABTools import get_error_report_worker_dir class SendErrorReport(ShellCommand): haltOnFailure = False
@@ -18,7 +22,6 @@ class SendErrorReport(ShellCommand): name = "SendErrorReport" def __init__(self, factory, argdict=None, **kwargs): self.factory = factory - self.workerdir=os.path.join(os.path.join(YOCTO_ABBASE, "yocto-worker")) for k, v in argdict.iteritems(): setattr(self, k, v) # Timeout needs to be passed to LoggingBuildStep as a kwarg
@@ -27,17 +30,12 @@ class SendErrorReport(ShellCommand): ShellCommand.__init__(self, **kwargs) def start(self): - self.workerdir=os.path.join(os.path.join(YOCTO_ABBASE, "yocto-worker")) self.buildername=self.getProperty("buildername") self.buildnumber=self.getProperty("buildnumber") + self.errordir = get_error_report_worker_dir(self.buildername) self.layerversion_core = self.getProperty("layerversion_core") self.command="" - if os.environ.get('ERROR_REPORT_DIR') is None: - self.errordir=os.path.join(os.path.join( - self.workerdir, self.buildername), - "build/build/tmp/log/error-report/") - else: - self.errordir=os.environ.get('ERROR_REPORT_DIR') + if int(self.layerversion_core) < 4: self.command = "echo 'Skipping Step.'" else:
lib/python2.7/site-packages/autobuilder/lib/ABTools.py +17 -0
@@ -10,7 +10,9 @@ __maintainer__ = "Elizabeth Flanagan" __email__ = "[email protected]" ''' +import os +from autobuilder.config import YOCTO_ABBASE def capitalize(word): return ' '.join([s[0].upper() + s[1:] for s in word.split(' ')])
@@ -18,3 +20,18 @@ def capitalize(word): def stringToBool(v): return v.lower() in ("true", "t", "1") +def get_error_report_controller_dir(buildername, buildnumber): + errordir_base = os.path.join(YOCTO_ABBASE, 'yocto-controller', buildername, + 'error-report') + errordir = os.path.join(errordir_base, str(buildnumber)) + return errordir + +def get_error_report_worker_dir(buildername): + if os.environ.get('ERROR_REPORT_DIR') is None: + workerdir = os.path.join(YOCTO_ABBASE, 'yocto-worker') + errordir = os.path.join(workerdir, buildername, + 'build/build/tmp/log/error-report/') + else: + errordir = os.environ.get('ERROR_REPORT_DIR') + + return errordir
lib/python2.7/site-packages/autobuilder/lib/buildsteps.py +2 -8
@@ -20,7 +20,7 @@ import codecs from buildbot.steps.shell import ShellCommand from buildbot.process.buildstep import LogLineObserver -from autobuilder.config import YOCTO_ABBASE +from lib.ABTools import get_error_report_controller_dir DEFAULT_SHELL = 'bash'
@@ -92,12 +92,6 @@ class BitbakeLogLineObserver(LogLineObserver): def errLineReceived(self, line): self._handleError(line) -def get_error_report_bitbake_dir(buildername, buildnumber): - errordir_base = os.path.join(YOCTO_ABBASE, 'yocto-controller', buildername, - 'error-report') - errordir = os.path.join(errordir_base, str(buildnumber)) - return errordir - class BitbakeShellCommand(ShellCommand): def __init__(self, factory, argdict=None, **kwargs): super(BitbakeShellCommand, self).__init__(**kwargs)
@@ -143,7 +137,7 @@ class BitbakeShellCommand(ShellCommand): buildername = self.getProperty('buildername') buildnumber = self.getProperty('buildnumber') - errordir = get_error_report_bitbake_dir(buildername, buildnumber) + errordir = get_error_report_controller_dir(buildername, buildnumber) if not os.path.exists(errordir): os.makedirs(errordir)
Signature · 1 line
2.1.4
PATCH v2 1/1 05/15] buildbot: Add support for DirectoryDownload transfer step
In reply to Aníbal LimónThe new DirectoryDownload transfer step provides support for download a directory from master to slave in specific location.
The current implementation extends FileDownload step but it creates a tar file (may be compressed) and download it from master to slave, finally slave decompress the tarfile into specific directory.
--- .../buildbot/steps/transfer.py | 86 +++++++++++++++++++++- .../buildslave/commands/registry.py | 1 + .../buildslave/commands/transfer.py | 79 ++++++++++++++++++++ 3 files changed, 164 insertions(+), 2 deletions(-)
lib/python2.7/site-packages/buildbot-0.8.8-py2.7.egg/buildbot/steps/transfer.py +84 -2
@@ -170,7 +170,6 @@ class _DirectoryWriter(_FileWriter): archive.close() os.remove(self.tarname) - def makeStatusRemoteCommand(step, remote_command, args): self = buildstep.RemoteCommand(remote_command, args, decodeRC={None:SUCCESS, 0:SUCCESS}) callback = lambda arg: step.step_status.addLog('stdio')
@@ -365,7 +364,6 @@ class DirectoryUpload(_TransferBuildStep): return BuildStep.finished(self, FAILURE) return BuildStep.finished(self, SUCCESS) - class _FileReader(pb.Referenceable): """ Helper class that acts as a file-object with read access
@@ -463,6 +461,90 @@ class FileDownload(_TransferBuildStep): d = self.runCommand(self.cmd) d.addCallback(self.finished).addErrback(self.failed) +class DirectoryDownload(_TransferBuildStep): + + name = 'download' + + renderables = [ 'mastersrc', 'slavedest' ] + + def __init__(self, mastersrc, slavedest, + workdir=None, maxsize=None, blocksize=16*1024, + compress=None, mode=None, **buildstep_kwargs): + BuildStep.__init__(self, **buildstep_kwargs) + + self.mastersrc = mastersrc + self.slavedest = slavedest + self.workdir = workdir + self.maxsize = maxsize + self.blocksize = blocksize + if compress not in (None, 'gz', 'bz2'): + config.error( + "'compress' must be one of None, 'gz', or 'bz2'") + self.compress = compress + self.mode = mode + + def start(self): + version = self.slaveVersion("downloadDirectory") + + if not version: + m = "slave is too old, does not know about uploadDirectory" + raise BuildSlaveTooOldError(m) + + # we rely upon the fact that the buildmaster runs chdir'ed into its + # basedir to make sure that relative paths in mastersrc are expanded + # properly. TODO: maybe pass the master's basedir all the way down + # into the BuildStep so we can do this better. + source = os.path.expanduser(self.mastersrc) + + slavedest = self.slavedest + + log.msg("DirectoryDownload started, from master %r to slave %r" + % (source, slavedest)) + + self.step_status.setText(['downloading', "to", slavedest]) + + # setup structures for reading the file + try: + fd, self.tarname = tempfile.mkstemp() + fileobj = os.fdopen(fd, 'w') + if self.compress == 'bz2': + mode='w|bz2' + elif self.compress == 'gz': + mode='w|gz' + else: + mode = 'w' + archive = tarfile.open(name=self.tarname, mode=mode, fileobj=fileobj) + archive.add(source, '') + archive.close() + fileobj.close() + + fp = open(self.tarname, 'rb') + except IOError: + # if file does not exist, bail out with an error + self.addCompleteLog('stderr', + 'Directory %r not available at master' % source) + # TODO: once BuildStep.start() gets rewritten to use + # maybeDeferred, just re-raise the exception here. + eventually(BuildStep.finished, self, FAILURE) + return + + fileReader = _FileReader(fp) + + # default arguments + args = { + 'slavedest': slavedest, + 'maxsize': self.maxsize, + 'reader': fileReader, + 'blocksize': self.blocksize, + 'workdir': self._getWorkdir(), + 'mode': self.mode, + 'compress': self.compress, + } + + self.cmd = makeStatusRemoteCommand(self, 'downloadDirectory', args) + d = self.runCommand(self.cmd) + d.addCallback(self.finished).addErrback(self.failed) + class StringDownload(_TransferBuildStep): name = 'string_download'
lib/python2.7/site-packages/buildbot_slave-0.8.8-py2.7.egg/buildslave/commands/registry.py +1 -0
@@ -21,6 +21,7 @@ commandRegistry = { "uploadFile" : "buildslave.commands.transfer.SlaveFileUploadCommand", "uploadDirectory" : "buildslave.commands.transfer.SlaveDirectoryUploadCommand", "downloadFile" : "buildslave.commands.transfer.SlaveFileDownloadCommand", + "downloadDirectory" : "buildslave.commands.transfer.SlaveDirectoryDownloadCommand", "svn" : "buildslave.commands.svn.SVN", "bk" : "buildslave.commands.bk.BK", "cvs" : "buildslave.commands.cvs.CVS",
lib/python2.7/site-packages/buildbot_slave-0.8.8-py2.7.egg/buildslave/commands/transfer.py +79 -0
82 lines not on this page · raw message
Signature · 1 line
2.1.4
PATCH v2 1/1 06/15] autobuilder/buildsteps: Add DownloadBitbakeErrorReports step
In reply to Aníbal LimónNow the worker is responsible of sending error reports to ERW so in order to don't duplicate functionality add this step for download bitbake error reports generated in master AB.
--- .../buildsteps/DownloadBitbakeErrorReports.py | 42 ++++++++++++++++++++++ 1 file changed, 42 insertions(+) create mode 100644 lib/python2.7/site-packages/autobuilder/buildsteps/DownloadBitbakeErrorReports.py
lib/python2.7/site-packages/autobuilder/buildsteps/DownloadBitbakeErrorReports.py new file +42 -0
@@ -0,0 +1,42 @@ +''' +Created on Jan 1, 2016 + +__author__ = "Anibal (alimon) Limon" +__copyright__ = "Copyright 2016, Intel Corp." +__credits__ = ["Anibal Limon"] +__license__ = "GPL" +__version__ = "2.0" +__maintainer__ = "Anibal Limon" +__email__ = "[email protected]" +''' + +import os +from buildbot.steps.transfer import DirectoryDownload +from buildbot.process.buildstep import SKIPPED + +from lib.ABTools import get_error_report_worker_dir, \ + get_error_report_controller_dir + +class DownloadBitbakeErrorReports(DirectoryDownload): + """ + Transfer from master to slave the error reports when bitbake + fails. + """ + name = "DownloadBitbakeErrorReports" + + def __init__(self, factory, argdict=None, **kwargs): + super(DownloadBitbakeErrorReports, self).__init__( + "", "") + + def start(self): + buildername = self.getProperty('buildername') + buildnumber = self.getProperty('buildnumber') + + self.mastersrc = get_error_report_controller_dir(buildername, + buildnumber) + self.slavedest = get_error_report_worker_dir(buildername) + + if not os.path.exists(self.mastersrc): + return SKIPPED + + super(DownloadBitbakeErrorReports, self).start()
Signature · 1 line
2.1.4
PATCH v2 1/1 09/15] autobuilder/lib/buildsteps.py: BitbakeShellCommand update error report types.
In reply to Aníbal LimónThe error report type values changed so update it to match the new ones.
--- lib/python2.7/site-packages/autobuilder/lib/buildsteps.py | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-)
lib/python2.7/site-packages/autobuilder/lib/buildsteps.py +2 -2
@@ -127,10 +127,10 @@ class BitbakeShellCommand(ShellCommand): failure = {} failure['package'] = "bitbake-%s" % vrs['BB_VERSION'] if 'bitbake-selftest' in self.command: - report['error_type'] = 'B' + report['error_type'] = 'bitbake-selftest' failure['task'] = self.command[self.command.find('bitbake-selftest'):] else: - report['error_type'] = 'C' + report['error_type'] = 'core' failure['task'] = self.command[self.command.find('bitbake'):] failure['log'] = "\n".join(log)
Signature · 1 line
2.1.4
PATCH v2 1/1 08/15] lib/buildsteps.py: BitbakeShellCommand add support for error_type
In reply to Aníbal LimónWhen generate bitbake error reports two type of errors could be happen a bitbake generic one or when is running bitbake-selftest.
Also split the command removing environment only leave the bitbake command and it's arguments.
--- lib/python2.7/site-packages/autobuilder/lib/buildsteps.py | 8 +++++++- 1 file changed, 7 insertions(+), 1 deletion(-)
lib/python2.7/site-packages/autobuilder/lib/buildsteps.py +7 -1
@@ -126,7 +126,13 @@ class BitbakeShellCommand(ShellCommand): failure = {} failure['package'] = "bitbake-%s" % vrs['BB_VERSION'] - failure['task'] = self.command + if 'bitbake-selftest' in self.command: + report['error_type'] = 'B' + failure['task'] = self.command[self.command.find('bitbake-selftest'):] + else: + report['error_type'] = 'C' + failure['task'] = self.command[self.command.find('bitbake'):] + failure['log'] = "\n".join(log) report['failures'] = [failure]
Signature · 1 line
2.1.4
PATCH v2 1/1 07/15] buiidsets: Add DownloadBitbakeErrorReport step
In reply to Aníbal LimónAdd DownloadBitbakeErrorReport step to buildsets that uses bitbake, this step is responsable to download bitbake error reports (if bitbake fails) to slave in order to send it to Error report web.
--- buildset-config.controller/build-appliance.conf | 1 + buildset-config.controller/buildtools.conf | 1 + buildset-config.controller/nightly-arm-lsb.conf | 1 + buildset-config.controller/nightly-arm.conf | 1 + buildset-config.controller/nightly-arm64.conf | 1 + buildset-config.controller/nightly-deb-non-deb.conf | 1 + buildset-config.controller/nightly-deb.conf | 1 + buildset-config.controller/nightly-ipk.conf | 1 + buildset-config.controller/nightly-mips-lsb.conf | 1 + buildset-config.controller/nightly-mips.conf | 1 + buildset-config.controller/nightly-mips64.conf | 1 + buildset-config.controller/nightly-multilib.conf | 1 + buildset-config.controller/nightly-musl.conf | 1 + buildset-config.controller/nightly-no-x11.conf | 1 + buildset-config.controller/nightly-non-gpl3.conf | 1 + buildset-config.controller/nightly-oecore.conf | 1 + buildset-config.controller/nightly-ppc-lsb.conf | 1 + buildset-config.controller/nightly-ppc.conf | 1 + buildset-config.controller/nightly-qa-extras.conf | 1 + buildset-config.controller/nightly-qa-logrotate.conf | 1 + buildset-config.controller/nightly-qa-pam.conf | 1 + buildset-config.controller/nightly-qa-skeleton.conf | 1 + buildset-config.controller/nightly-qa-systemd.conf | 1 + buildset-config.controller/nightly-qa-targetbuilds.conf | 1 + buildset-config.controller/nightly-rpm-non-rpm.conf | 1 + buildset-config.controller/nightly-rpm.conf | 1 + buildset-config.controller/nightly-uclibc.conf | 1 + buildset-config.controller/nightly-world-lsb.conf | 1 + buildset-config.controller/nightly-world.conf | 1 + buildset-config.controller/nightly-x32.conf | 1 + buildset-config.controller/nightly-x86-64-lsb.conf | 1 + buildset-config.controller/nightly-x86-64.conf | 1 + buildset-config.controller/nightly-x86-lsb.conf | 1 + buildset-config.controller/nightly-x86.conf | 1 + buildset-config.controller/nightly.conf | 1 + buildset-config.controller/poky-tiny.conf | 1 + buildset-config.examples/awesomefirmware.conf | 1 + buildset-config.freescale/nightly-fsl-arm-lsb.conf | 1 + buildset-config.freescale/nightly-fsl-arm.conf | 1 + buildset-config.freescale/nightly-fsl-ppc-lsb.conf | 1 + buildset-config.freescale/nightly-fsl-ppc.conf | 1 + buildset-config.iot-devkit/iot-devkit.conf | 1 + buildset-config.kernel/kernel-arm-lsb.conf | 1 + buildset-config.kernel/kernel-arm.conf | 1 + buildset-config.kernel/kernel-arm64.conf | 1 + buildset-config.kernel/kernel-mips-lsb.conf | 1 + buildset-config.kernel/kernel-mips.conf | 1 + buildset-config.kernel/kernel-ppc-lsb.conf | 1 + buildset-config.kernel/kernel-ppc.conf | 1 + buildset-config.kernel/kernel-x86-64-lsb.conf | 1 + buildset-config.kernel/kernel-x86-64.conf | 1 + buildset-config.kernel/kernel-x86-lsb.conf | 1 + buildset-config.kernel/kernel-x86.conf | 1 + buildset-config.kernel/nightly-kernel.conf | 1 + buildset-config.tizen/nightly-tizen-ivi.conf | 1 + buildset-config.tizen/nightly-tizen.conf | 1 + buildset-config.tizen/nightly.conf | 1 + 57 files changed, 57 insertions(+)
buildset-config.controller/build-appliance.conf +1 -0
@@ -19,6 +19,7 @@ steps: [{'SetDest':{}}, {'CreateBBLayersConf': {'buildprovider' : 'yocto'}}, {'BuildImages': {'images': 'universe -c fetch'}}, {'BuildImages': {'images': 'build-appliance-image'}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}, {'PublishLayerTarballs':{}}, {'PublishArtifacts': {'artifacts': ['build-appliance', 'md5sums']}}]
buildset-config.controller/buildtools.conf +1 -0
@@ -15,5 +15,6 @@ steps: [{'SetDest':{}}, {'CreateAutoConf': {'machine': 'qemux86-64', 'SDKMACHINE' : 'i686', 'distro': 'poky', 'buildapp': True}}, {'BuildImages': {'images': 'uninative-tarball'}}, {'PublishLayerTarballs':{}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}, {'PublishArtifacts': {'artifacts': ['buildtools-tarball', 'uninative', 'md5sums']}}]
buildset-config.controller/nightly-arm-lsb.conf +1 -0
@@ -25,6 +25,7 @@ steps: [{'SetDest':{}}, {'BuildImages': {'images': 'core-image-lsb core-image-lsb-sdk'}}, {'SyncPersistDB' : {'commit' : True, 'distro':'poky-lsb'}}, {'PublishLayerTarballs':{}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}, {'UploadToasterEventlog': {}}, {'PublishArtifacts': {'artifacts': ['qemuarm', 'beagleboard', 'md5sums']}}]
buildset-config.controller/nightly-arm.conf +1 -0
@@ -25,6 +25,7 @@ steps: [{'SetDest':{}}, {'RunESDKSanityTests': {'images': 'core-image-minimal core-image-sato'}}, {'SyncPersistDB' : {'commit' : True, 'distro':'poky'}}, {'PublishLayerTarballs':{}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}, {'UploadToasterEventlog': {}}, {'PublishArtifacts': {'artifacts': ['qemuarm', 'beagleboard', 'ipk', 'rpm', 'deb', 'toolchain', 'md5sums']}}]
buildset-config.controller/nightly-arm64.conf +1 -0
@@ -23,6 +23,7 @@ steps: [{'SetDest':{}}, {'RunSDKSanityTests': {'images': 'core-image-sato'}}, {'SyncPersistDB' : {'commit' : True, 'distro':'poky'}}, {'PublishLayerTarballs':{}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}, {'UploadToasterEventlog': {}}, {'PublishArtifacts': {'artifacts': ['qemuarm64', 'ipk', 'rpm', 'deb', 'toolchain', 'md5sums']}}]
buildset-config.controller/nightly-deb-non-deb.conf +1 -0
@@ -12,4 +12,5 @@ steps: [{'SetDest':{}}, {'CreateBBLayersConf': {'buildprovider' : 'yocto'}}, {'BuildImages': {'images': 'core-image-sato core-image-sato-dev core-image-sato-sdk core-image-minimal core-image-minimal-dev'}}, {'RunSanityTests': {'images': 'core-image-minimal core-image-sato core-image-sato-sdk'}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}]
buildset-config.controller/nightly-deb.conf +1 -0
@@ -12,4 +12,5 @@ steps: [{'SetDest':{}}, {'CreateBBLayersConf': {'buildprovider' : 'yocto'}}, {'BuildImages': {'images': 'core-image-sato core-image-sato-dev core-image-sato-sdk core-image-minimal core-image-minimal-dev'}}, {'RunSanityTests': {'images': 'core-image-minimal core-image-sato core-image-sato-sdk'}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}]
buildset-config.controller/nightly-ipk.conf +1 -0
@@ -12,4 +12,5 @@ steps: [{'SetDest':{}}, {'CreateBBLayersConf': {'buildprovider' : 'yocto'}}, {'BuildImages': {'images': 'core-image-sato core-image-sato-dev core-image-sato-sdk core-image-minimal core-image-minimal-dev'}}, {'RunSanityTests': {'images' : 'core-image-minimal core-image-sato core-image-sato-sdk'}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}]
buildset-config.controller/nightly-mips-lsb.conf +1 -0
@@ -26,6 +26,7 @@ steps: [{'SetDest':{}}, {'BuildImages': {'images': 'core-image-lsb core-image-lsb-sdk'}}, {'SyncPersistDB' : {'commit' : True, 'distro':'poky-lsb'}}, {'PublishLayerTarballs':{}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}, {'UploadToasterEventlog': {}}, {'PublishArtifacts': {'artifacts': ['qemumips', 'routerstationpro', 'md5sums']}}]
buildset-config.controller/nightly-mips.conf +1 -0
@@ -29,6 +29,7 @@ steps: [{'SetDest':{}}, {'RunESDKSanityTests': {'images': 'core-image-minimal core-image-sato'}}, {'SyncPersistDB' : {'commit' : True, 'distro':'poky'}}, {'PublishLayerTarballs':{}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}, {'UploadToasterEventlog': {}}, {'PublishArtifacts': {'artifacts': ['qemumips', 'routerstationpro', 'ipk', 'rpm', 'deb', 'toolchain', 'md5sums']}}]
buildset-config.controller/nightly-mips64.conf +1 -0
@@ -23,6 +23,7 @@ steps: [{'SetDest':{}}, {'RunSDKSanityTests': {'images': 'core-image-sato'}}, {'SyncPersistDB' : {'commit' : True, 'distro':'poky'}}, {'PublishLayerTarballs':{}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}, {'UploadToasterEventlog': {}}, {'PublishArtifacts': {'artifacts': ['qemumips64', 'ipk', 'rpm', 'deb', 'toolchain', 'md5sums']}}]
buildset-config.controller/nightly-multilib.conf +1 -0
@@ -37,4 +37,5 @@ steps: [{'SetDest':{}}, 'buildhistory' : False, 'multilib': 'lib64', 'distro': 'poky'}}, {'BuildImages': {'images': 'lib64-core-image-sato lib64-core-image-sato-sdk'}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}]
buildset-config.controller/nightly-musl.conf +1 -0
@@ -13,5 +13,6 @@ steps: [{'SetDest':{}}, 'atextappend' : '\nTCLIBC="musl"\n' }}, {'CreateBBLayersConf': {'buildprovider' : 'yocto'}}, {'BuildImages': {'images': 'core-image-minimal core-image-full-cmdline core-image-sato'}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}]
buildset-config.controller/nightly-no-x11.conf +1 -0
@@ -15,5 +15,6 @@ steps: [{'SetDest':{}}, {'SyncPersistDB' : {'distro' : 'poky'}}, {'GetBitbakeVersion': {}}, {'BuildImages': {'images': 'world'}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}, {'UploadToasterEventlog': {}}]
buildset-config.controller/nightly-non-gpl3.conf +1 -0
@@ -14,4 +14,5 @@ steps: [{'SetDest':{}}, {'CreateBBLayersConf': {'buildprovider' : 'yocto'}}, {'BuildImages': {'images': 'core-image-minimal core-image-basic'}}, {'CheckForGPLv3':{}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}]
buildset-config.controller/nightly-oecore.conf +1 -0
@@ -24,6 +24,7 @@ steps: [{'SetDest':{}}, 'distro': 'oecore', 'buildhistory' : False}}, {'BuildToolchainImages': {}}, {'BuildImages': {'images': '-c populate_sdk_ext core-image-minimal'}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}} ]
buildset-config.controller/nightly-ppc-lsb.conf +1 -0
@@ -26,6 +26,7 @@ steps: [{'SetDest':{}}, {'BuildImages': {'images': 'core-image-lsb core-image-lsb-sdk'}}, {'SyncPersistDB' : {'commit' : True, 'distro':'poky-lsb'}}, {'PublishLayerTarballs':{}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}, {'UploadToasterEventlog': {}}, {'PublishArtifacts': {'artifacts': ['qemuppc', 'mpc8315e-rdb', 'md5sums']}}]
buildset-config.controller/nightly-ppc.conf +1 -0
@@ -28,6 +28,7 @@ steps: [{'SetDest':{}}, {'RunESDKSanityTests': {'images': 'core-image-minimal core-image-sato'}}, {'SyncPersistDB' : {'commit' : True, 'distro':'poky'}}, {'PublishLayerTarballs':{}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}, {'UploadToasterEventlog': {}}, {'PublishArtifacts': {'artifacts': ['qemuppc', 'mpc8315e-rdb', 'ipk', 'rpm', 'deb', 'toolchain', 'md5sums']}}]
buildset-config.controller/nightly-qa-extras.conf +1 -0
@@ -18,5 +18,6 @@ steps: [{'SetDest':{}}, 'distro': 'poky', 'buildhistory' : False, 'atextappend' : '\nROOT_HOME = "/root"\n'}}, {'BuildImages': {'images': 'core-image-minimal'}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}, {'RunSanityTests': {'images': 'core-image-minimal'}}]
buildset-config.controller/nightly-qa-logrotate.conf +1 -0
@@ -13,6 +13,7 @@ steps: [{'SetDest':{}}, 'atextappend' : '\nIMAGE_INSTALL_append = " logrotate"\n'}}, {'CreateBBLayersConf': {'buildprovider' : 'yocto'}}, {'BuildImages': {'images': 'core-image-sato'}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}, {'RunSanityTests': {'images': 'core-image-sato', 'suitesappend' : 'logrotate'}}]
buildset-config.controller/nightly-qa-pam.conf +1 -0
@@ -14,5 +14,6 @@ steps: [{'SetDest':{}}, {'CreateBBLayersConf': {'buildprovider' : 'yocto'}}, {'BuildImages': {'images': 'core-image-sato'}}, {'SendErrorReport': {}}, + {'DownloadBitbakeErrorReports': {}}, {'RunSanityTests': {'images': 'core-image-sato', 'suitesappend' : 'pam'}}]
buildset-config.controller/nightly-qa-skeleton.conf +1 -0
@@ -13,6 +13,7 @@ steps: [{'SetDest':{}}, 'atextappend' : '\nIMAGE_INSTALL_append = " service hello-mod"\n'}}, {'CreateBBLayersConf': {'buildprovider' : 'yocto', 'layerdirs': ['meta-skeleton']}}, {'BuildImages': {'images': 'core-image-sato'}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}, {'RunSanityTests': {'images': 'core-image-sato', 'suitesappend' : 'skeletoninit'}}]
buildset-config.controller/nightly-qa-systemd.conf +1 -0
@@ -23,5 +23,6 @@ steps: [{'SetDest':{}}, 'buildhistory' : False, 'distro': 'poky', 'initmgr' : 'systemd'}}, {'BuildImages': {'images': 'core-image-sato'}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}, {'RunSanityTests': {'images': 'core-image-sato', 'suitesappend' : 'systemd'}}]
buildset-config.controller/nightly-qa-targetbuilds.conf +1 -0
@@ -27,6 +27,7 @@ steps: [{'SetDest':{}}, {'CreateAutoConf': {'machine': 'qemuppc', 'SDKMACHINE' : 'x86_64', 'buildhistory' : False, 'distro': 'poky'}}, {'BuildImages': {'images': 'core-image-sato-sdk'}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}, {'RunSanityTests': {'images': 'core-image-sato-sdk', 'suites' : 'ping ssh buildsudoku buildcvs buildiptables'}}]
buildset-config.controller/nightly-rpm-non-rpm.conf +1 -0
@@ -13,5 +13,6 @@ steps: [{'SetDest':{}}, 'packages': 'rpm'}}, {'CreateBBLayersConf': {'buildprovider' : 'yocto'}}, {'BuildImages': {'images' : 'core-image-sato core-image-sato-dev core-image-sato-sdk core-image-minimal core-image-minimal-dev'}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}, {'RunSanityTests': {'images' : 'core-image-minimal core-image-sato core-image-sato-sdk'}}]
buildset-config.controller/nightly-rpm.conf +1 -0
@@ -13,5 +13,6 @@ steps: [{'SetDest':{}}, 'packages': 'rpm'}}, {'CreateBBLayersConf': {'buildprovider' : 'yocto'}}, {'BuildImages': {'images' : 'core-image-sato core-image-sato-dev core-image-sato-sdk core-image-minimal core-image-minimal-dev'}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}, {'RunSanityTests': {'images' : 'core-image-minimal core-image-sato core-image-sato-sdk'}}]
buildset-config.controller/nightly-uclibc.conf +1 -0
@@ -13,5 +13,6 @@ steps: [{'SetDest':{}}, 'atextappend' : '\nTCLIBC="uclibc"\n' }}, {'CreateBBLayersConf': {'buildprovider' : 'yocto'}}, {'BuildImages': {'images': 'core-image-minimal'}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}]
buildset-config.controller/nightly-world-lsb.conf +1 -0
@@ -21,6 +21,7 @@ steps: [{'SetDest':{}}, 'distro': 'poky-lsb'}}, {'CreateBBLayersConf': {'buildprovider' : 'yocto'}}, {'BuildImages': {'images': 'world'}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}, {'PublishArtifacts': {'artifacts': ['ipk', 'rpm', 'deb']}}]
buildset-config.controller/nightly-world.conf +1 -0
@@ -13,6 +13,7 @@ steps: [{'SetDest':{}}, 'distro': 'poky'}}, {'CreateBBLayersConf': {'buildprovider' : 'yocto'}}, {'BuildImages': {'images': 'world'}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}, {'PublishArtifacts': {'artifacts': ['ipk', 'rpm', 'deb']}}]
buildset-config.controller/nightly-x32.conf +1 -0
@@ -20,6 +20,7 @@ steps: [{'SetDest':{}}, 'buildhistory' : False, 'x32': True, 'distro': 'poky'}}, {'RunSanityTests': {'images': 'core-image-sato', 'suitesappend' : 'x32lib'}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}, {'UploadToasterEventlog': {}}, {'PublishArtifacts': {'artifacts': ['md5sums']}}]
buildset-config.controller/nightly-x86-64-lsb.conf +1 -0
@@ -26,6 +26,7 @@ steps: [{'SetDest':{}}, {'BuildImages': {'images': 'core-image-lsb core-image-lsb-sdk'}}, {'SyncPersistDB' : {'commit' : True, 'distro':'poky-lsb'}}, {'PublishLayerTarballs':{}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}, {'UploadToasterEventlog': {}}, {'PublishArtifacts': {'artifacts': ['qemux86-64', 'genericx86-64', 'md5sums']}}]
buildset-config.controller/nightly-x86-64.conf +1 -0
@@ -30,6 +30,7 @@ steps: [{'SetDest':{}}, {'RunESDKSanityTests': {'images': 'core-image-minimal core-image-sato'}}, {'SyncPersistDB' : {'commit' : True, 'distro':'poky'}}, {'PublishLayerTarballs':{}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}, {'UploadToasterEventlog': {}}, {'PublishArtifacts': {'artifacts': ['qemux86-64', 'genericx86-64', 'ipk', 'rpm', 'deb', 'toolchain', 'md5sums']}}]
buildset-config.controller/nightly-x86-lsb.conf +1 -0
@@ -26,6 +26,7 @@ steps: [{'SetDest':{}}, {'BuildImages': {'images': 'core-image-lsb core-image-lsb-sdk'}}, {'SyncPersistDB' : {'commit' : True, 'distro':'poky-lsb'}}, {'PublishLayerTarballs':{}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}, {'UploadToasterEventlog': {}}, {'PublishArtifacts': {'artifacts': ['qemux86', 'genericx86', 'md5sums']}}]
buildset-config.controller/nightly-x86.conf +1 -0
@@ -30,6 +30,7 @@ steps: [{'SetDest':{}}, {'RunESDKSanityTests': {'images': 'core-image-minimal core-image-sato'}}, {'SyncPersistDB' : {'commit' : True, 'distro':'poky'}}, {'PublishLayerTarballs':{}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}, {'UploadToasterEventlog': {}}, {'PublishArtifacts': {'artifacts': ['qemux86', 'genericx86', 'ipk', 'rpm', 'deb', 'toolchain', 'md5sums']}}]
buildset-config.controller/nightly.conf +1 -0
@@ -152,6 +152,7 @@ steps: [{'SetDest':{}}, {'BuildImages': {'images': 'adt-installer'}}, {'PublishArtifacts': {'artifacts': ['adt-installer-QA', 'adtrepo-dev']}}, {'BitbakeSelftest': {}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}, {'TriggerBuilds': {'schedulerName': 'buildhistory', 'waitForFinish': 'False',
buildset-config.controller/poky-tiny.conf +1 -0
@@ -12,6 +12,7 @@ steps: [{'SetDest':{}}, {'CreateBBLayersConf': {'buildprovider' : 'yocto'}}, {'BuildImages': {'images': 'core-image-minimal'}}, {'PublishLayerTarballs':{}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}, {'PublishArtifacts': {'artifacts': ['tiny', 'md5sums']}}]
buildset-config.examples/awesomefirmware.conf +1 -0
@@ -29,6 +29,7 @@ steps: [{'SetDest':{}}, {'BuildImages': {'images': 'core-image-minimal'}}, {'CreateGPLTarball': {}}, {'PublishArtifacts': {'artifacts': ['genericx86-64']}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}, {'UploadToasterEventlog': {}}, {'SendQAEmail': {}},
buildset-config.freescale/nightly-fsl-arm-lsb.conf +1 -0
@@ -35,6 +35,7 @@ steps: [{'SetDest':{}}, 'devkernel' : False}}, {'BuildImages': {'images': 'core-image-lsb core-image-lsb-dev core-image-lsb-sdk LSB-QT-IMAGES'}}, {'PublishLayerTarballs':{}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}, {'UploadToasterEventlog': {}}, {'PublishArtifacts': {'artifacts': ['imx53qsb', 'imx6qsabresd', 'imx28evk', 'md5sums']}}]
buildset-config.freescale/nightly-fsl-arm.conf +1 -0
@@ -40,6 +40,7 @@ steps: [{'SetDest':{}}, 'devkernel' : False}}, {'BuildImages': {'images': 'core-image-sato core-image-sato-dev core-image-sato-sdk core-image-minimal core-image-minimal-dev'}}, {'PublishLayerTarballs':{}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}, {'UploadToasterEventlog': {}}, {'PublishArtifacts': {'artifacts': ['imx53qsb', 'imx6qsabresd', 'imx28evk', 'ipk', 'toolchain', 'md5sums']}}]
buildset-config.freescale/nightly-fsl-ppc-lsb.conf +1 -0
@@ -25,6 +25,7 @@ steps: [{'SetDest':{}}, {'GetBitbakeVersion': {}}, {'BuildImages': {'images': 'core-image-lsb core-image-lsb-dev core-image-lsb-sdk LSB-QT-IMAGES'}}, {'PublishLayerTarballs':{}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}, {'UploadToasterEventlog': {}}, {'PublishArtifacts': {'artifacts': ['p1022ds', 'md5sums']}}]
buildset-config.freescale/nightly-fsl-ppc.conf +1 -0
@@ -26,6 +26,7 @@ steps: [{'SetDest':{}}, {'BuildToolchainImages': {}}, {'BuildImages': {'images': '-c populate_sdk_ext core-image-minimal'}}, {'PublishLayerTarballs':{}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}, {'UploadToasterEventlog': {}}, {'PublishArtifacts': {'artifacts': ['p1022ds', 'ipk', 'toolchain', 'md5sums']}}]
buildset-config.iot-devkit/iot-devkit.conf +1 -0
@@ -29,5 +29,6 @@ steps: [{'SetDest':{}}, 'meta-openembedded/meta-filesystems']}}, {'BuildImages': {'images': 'iot-devkit-image iot-devkit-prof-image iot-devkit-prof-dev-image'}}, {'PublishLayerTarballs':{}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}, {'PublishArtifacts': {'artifacts': ['quark', 'ipk', 'md5sums']}}]
buildset-config.kernel/kernel-arm-lsb.conf +1 -0
@@ -55,5 +55,6 @@ steps: [{'SetDest':{}}, {'SyncPersistDB' : {'distro' : 'poky'}}, {'BuildImages': {'images': 'core-image-kernel-dev'}}, {'RunSanityTests': {'images': 'core-image-kernel-dev'}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}]
buildset-config.kernel/kernel-arm.conf +1 -0
@@ -49,5 +49,6 @@ steps: [{'SetDest':{}}, {'SyncPersistDB' : {'distro' : 'poky'}}, {'BuildImages': {'images': 'core-image-kernel-dev'}}, {'RunSanityTests': {'images': 'core-image-kernel-dev'}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}]
buildset-config.kernel/kernel-arm64.conf +1 -0
@@ -49,5 +49,6 @@ steps: [{'SetDest':{}}, {'SyncPersistDB' : {'distro' : 'poky'}}, {'BuildImages': {'images': 'core-image-kernel-dev'}}, {'RunSanityTests': {'images': 'core-image-kernel-dev'}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}]
buildset-config.kernel/kernel-mips-lsb.conf +1 -0
@@ -55,4 +55,5 @@ steps: [{'SetDest':{}}, {'SyncPersistDB' : {'distro' : 'poky'}}, {'BuildImages': {'images': 'core-image-kernel-dev'}}, {'RunSanityTests': {'images': 'core-image-kernel-dev'}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}]
buildset-config.kernel/kernel-mips.conf +1 -0
@@ -49,4 +49,5 @@ steps: [{'SetDest':{}}, {'SyncPersistDB' : {'distro' : 'poky'}}, {'BuildImages': {'images': 'core-image-kernel-dev'}}, {'RunSanityTests': {'images': 'core-image-kernel-dev'}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}]
buildset-config.kernel/kernel-ppc-lsb.conf +1 -0
@@ -55,4 +55,5 @@ steps: [{'SetDest':{}}, {'SyncPersistDB' : {'distro' : 'poky'}}, {'BuildImages': {'images': 'core-image-kernel-dev'}}, {'RunSanityTests': {'images': 'core-image-kernel-dev'}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}]
buildset-config.kernel/kernel-ppc.conf +1 -0
@@ -49,4 +49,5 @@ steps: [{'SetDest':{}}, {'SyncPersistDB' : {'distro' : 'poky'}}, {'BuildImages': {'images': 'core-image-kernel-dev'}}, {'RunSanityTests': {'images': 'core-image-kernel-dev'}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}]
buildset-config.kernel/kernel-x86-64-lsb.conf +1 -0
@@ -55,4 +55,5 @@ steps: [{'SetDest':{}}, {'SyncPersistDB' : {'distro' : 'poky'}}, {'BuildImages': {'images': 'core-image-kernel-dev'}}, {'RunSanityTests': {'images': 'core-image-kernel-dev'}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}]
buildset-config.kernel/kernel-x86-64.conf +1 -0
@@ -49,4 +49,5 @@ steps: [{'SetDest':{}}, {'SyncPersistDB' : {'distro' : 'poky'}}, {'BuildImages': {'images': 'core-image-kernel-dev'}}, {'RunSanityTests': {'images': 'core-image-kernel-dev'}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}]
buildset-config.kernel/kernel-x86-lsb.conf +1 -0
@@ -55,4 +55,5 @@ steps: [{'SetDest':{}}, {'SyncPersistDB' : {'distro' : 'poky'}}, {'BuildImages': {'images': 'core-image-kernel-dev'}}, {'RunSanityTests': {'images': 'core-image-kernel-dev'}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}]
buildset-config.kernel/kernel-x86.conf +1 -0
@@ -49,4 +49,5 @@ steps: [{'SetDest':{}}, {'SyncPersistDB' : {'distro' : 'poky'}}, {'BuildImages': {'images': 'core-image-kernel-dev'}}, {'RunSanityTests': {'images': 'core-image-kernel-dev'}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}]
buildset-config.kernel/nightly-kernel.conf +1 -0
@@ -58,5 +58,6 @@ steps: [{'SetDest':{}}, 'kernel-x86-64': {}, 'kernel-x86-64-lsb': {}, 'kernel-x86': {}, 'kernel-x86-lsb': {}, 'kernel-arm64': {}}, 'schedulerNames_nowait' : {}}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}, {'SendQAEmail': {}}]
buildset-config.tizen/nightly-tizen-ivi.conf +1 -0
@@ -19,5 +19,6 @@ steps: [{'SetDest':{}}, 'meta-tizen/meta-tizen-common-share', 'meta-tizen/meta-tizen-common-devtools', \ 'meta-tizen/meta-tizen-common-demo', 'meta-tizen/meta-tizen-ivi']}}, {'BuildImages': {'images': 'tizen-ivi-Modello-image'}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}} ]
buildset-config.tizen/nightly-tizen.conf +1 -0
@@ -18,6 +18,7 @@ steps: [{'SetDest':{}}, 'meta-tizen/meta-tizen-common-share', 'meta-tizen/meta-tizen-common-devtools', \ 'meta-tizen/meta-tizen-common-demo']}}, {'BuildImages': {'images': 'tizen-common-core-image-crosswalk-dev'}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}} ]
buildset-config.tizen/nightly.conf +1 -0
@@ -42,6 +42,7 @@ steps: [{'SetDest':{}}, {'TriggerBuilds': {'schedulerName': 'main-build', 'waitForFinish': 'True', 'schedulerNames': {'nightly-tizen-ivi': {}, 'nightly-tizen': {}}, 'schedulerNames_nowait' : {}}}, + {'DownloadBitbakeErrorReports': {}}, {'SendErrorReport': {}}, {'TriggerBuilds': {'schedulerName': 'buildhistory', 'waitForFinish': 'False',
Signature · 1 line
2.1.4
PATCH v2 1/1 10/15] autobuilder/lib/{ABtools, builsteps}.py: Create save_error_report func
In reply to Aníbal LimónCreate new generic function save_error_report based on _saveBitbakeErrorReport in order to use the same function on OESelftest error reports.
--- .../site-packages/autobuilder/lib/ABTools.py | 13 ++++++++++++ .../site-packages/autobuilder/lib/buildsteps.py | 23 +++++----------------- 2 files changed, 18 insertions(+), 18 deletions(-)
lib/python2.7/site-packages/autobuilder/lib/ABTools.py +13 -0
@@ -11,6 +11,9 @@ __email__ = "[email protected]" ''' import os +import time +import json +import codecs from autobuilder.config import YOCTO_ABBASE
@@ -35,3 +38,13 @@ def get_error_report_worker_dir(buildername): errordir = os.environ.get('ERROR_REPORT_DIR') return errordir + +def save_error_report(buildername, buildnumber, report, report_type): + errordir = get_error_report_controller_dir(buildername, buildnumber) + if not os.path.exists(errordir): + os.makedirs(errordir) + + filename = os.path.join(errordir, "error_report_%s_%d.txt" % \ + (report_type, int(time.time()))) + with codecs.open(filename, 'w', 'utf-8') as f: + json.dump(report, f, indent=4, sort_keys=True)
lib/python2.7/site-packages/autobuilder/lib/buildsteps.py +5 -18
@@ -13,14 +13,11 @@ __email__ = "[email protected]" import os import re -import time -import json -import codecs from buildbot.steps.shell import ShellCommand from buildbot.process.buildstep import LogLineObserver -from lib.ABTools import get_error_report_controller_dir +from lib.ABTools import save_error_report DEFAULT_SHELL = 'bash'
@@ -139,21 +136,11 @@ class BitbakeShellCommand(ShellCommand): return report - def _saveBitbakeErrorReport(self, report): - buildername = self.getProperty('buildername') - buildnumber = self.getProperty('buildnumber') - - errordir = get_error_report_controller_dir(buildername, buildnumber) - if not os.path.exists(errordir): - os.makedirs(errordir) - - filename = os.path.join(errordir, "error_report_bitbake_%d.txt" % \ - int(time.time())) - with codecs.open(filename, 'w', 'utf-8') as f: - json.dump(report, f, indent=4, sort_keys=True) - def commandComplete(self, cmd): if cmd.didFail(): if self.errors['bitbake']: + buildername = self.getProperty('buildername') + buildnumber = self.getProperty('buildnumber') + report = self._createBitbakeErrorReport(self.errors['log']) - self._saveBitbakeErrorReport(report) + save_error_report(buildername, buildnumber, report, 'bitbake')
Signature · 1 line
2.1.4
PATCH v2 1/1 11/15] autobuilder/lib/ABTools.py: Add get_lsb_distro function
In reply to Aníbal LimónTry to get Linux distribution ID using lsb_release if lsb_release isn't installed use information provided by linux_distribution() method in platform returns "DISTRONAME-VERSION".
--- .../site-packages/autobuilder/lib/ABTools.py | 29 ++++++++++++++++++++++ 1 file changed, 29 insertions(+)
lib/python2.7/site-packages/autobuilder/lib/ABTools.py +29 -0
@@ -15,6 +15,9 @@ import time import json import codecs +import subprocess +import platform + from autobuilder.config import YOCTO_ABBASE def capitalize(word):
@@ -48,3 +51,29 @@ def save_error_report(buildername, buildnumber, report, report_type): (report_type, int(time.time()))) with codecs.open(filename, 'w', 'utf-8') as f: json.dump(report, f, indent=4, sort_keys=True) + +def get_lsb_distro(): + """ + Try to get Linux distribution ID using lsb_release if lsb_release + isn't installed use information provided by linux_distribution() + method in platform returns "DISTRONAME-VERSION". + """ + + lsb_distro = None + + try: + output = subprocess.check_output("lsb_release -ir", shell=True) + + lines = output.splitlines() + + # Output example: + # Distributor ID:\tDebian + # Release:\t8.4 + distro_name = lines[0].split(':')[1].strip() + version = lines[1].split(':')[1].strip() + + lsb_distro = "%s-%s" % (distro_name, version) + except Exception as e: + lsb_distro = "%s-%s" % platform.linux_distribution()[0:2] + + return lsb_distro
Signature · 1 line
2.1.4
PATCH v2 1/1 12/15] buildsteps/RunOeSelftest.py: Add support for create/save error reports
In reply to Aníbal LimónNow when oe-selftest fails the error report for send to the Error report web are created and saved in the controller.
Since oe-selftest is intended to do a build system testing the values for MACHINE, TARGET_SYS and DISTRO are provided so use universal value instead.
--- .../autobuilder/buildsteps/RunOeSelftest.py | 46 ++++++++++++++++++++++ 1 file changed, 46 insertions(+)
lib/python2.7/site-packages/autobuilder/buildsteps/RunOeSelftest.py +46 -0
@@ -8,9 +8,12 @@ __maintainer__ = "Stefan Stanacar" __email__ = "[email protected]" ''' +import platform from buildbot.steps.shell import ShellCommand +from lib.ABTools import save_error_report, get_lsb_distro + class RunOeSelftest(ShellCommand): haltOnFailure = False flunkOnFailure = True
@@ -35,3 +38,46 @@ class RunOeSelftest(ShellCommand): else: self.command += "if [ -d ../meta-selftest ]; then export DISPLAY=:1; oe-selftest " + self.tests + "; else echo 'Skipping step - no meta-selftest layer here'; fi" ShellCommand.start(self) + + def _createOESelftestErrorReport(self, log): + """ + Create a oe-selftest error report since oe-selftest + is intended to test the build system no information + about machine, distro and target_sys are provided so + use universal value. + """ + + report = {} + + report['machine'] = 'universal' + report['build_sys'] = "%s-%s" % (platform.machine(), + platform.system().lower()) + report['nativelsb'] = get_lsb_distro() or 'universal' + report['distro'] = 'universal' + report['target_sys'] = 'universal' + + report['component'] = 'oe-selftest' + report['branch_commit'] = self.getProperty('branch') + ': ' + \ + self.getProperty('got_revision') + + report['error_type'] = 'oe-selftest' + + failure = {} + failure['package'] = 'oe-selftest' + failure['task'] = self.command[self.command.find('oe-selftest'):] + failure['log'] = log + + report['failures'] = [failure] + + return report + + def commandComplete(self, cmd): + if cmd.didFail(): + buildername = self.getProperty('buildername') + buildnumber = self.getProperty('buildnumber') + + log = cmd.logs['stdio'].getText() + + report = self._createOESelftestErrorReport(log) + save_error_report(buildername, buildnumber, report, 'oe_selftest') +
Signature · 1 line
2.1.4
PATCH v2 1/1 13/15] nightly-oe-selftest.conf: Add steps for Download and Send error report.
In reply to Aníbal LimónThese steps are needed for enable sending of Oe selftest error reports to the Error report WEB.
--- buildset-config.controller/nightly-oe-selftest.conf | 5 ++++- 1 file changed, 4 insertions(+), 1 deletion(-)
buildset-config.controller/nightly-oe-selftest.conf +4 -1
@@ -14,4 +14,7 @@ steps: [{'SetDest':{}}, {'CreateBBLayersConf': {'buildprovider' : 'yocto'}}, {'BuildImages': {'images': 'core-image-minimal'}}, {'CreateBBLayersConf': {'buildprovider' : 'yocto', 'layerdirs': ['meta-selftest']}}, - {'RunOeSelftest': {}}] + {'RunOeSelftest': {}}, + {'DownloadBitbakeErrorReports': {}}, + {'SendErrorReport': {}}, + ]
Signature · 1 line
2.1.4
PATCH v2 1/1 14/15] autobuilder/buildsteps: Rename DownloadBitbakeErrorReports to DownloadErrorReports
In reply to Aníbal LimónSince DownloadBitbakeErrorReports is also downloading reports generated by RunOESelftest it don't make sense to have a hard reference of bitbake in the buildstep.
--- .../buildsteps/DownloadBitbakeErrorReports.py | 42 ---------------------- .../autobuilder/buildsteps/DownloadErrorReports.py | 42 ++++++++++++++++++++++ 2 files changed, 42 insertions(+), 42 deletions(-) delete mode 100644 lib/python2.7/site-packages/autobuilder/buildsteps/DownloadBitbakeErrorReports.py create mode 100644 lib/python2.7/site-packages/autobuilder/buildsteps/DownloadErrorReports.py
lib/python2.7/site-packages/autobuilder/buildsteps/DownloadBitbakeErrorReports.py deleted +0 -42
@@ -1,42 +0,0 @@ -''' -Created on Jan 1, 2016 - -__author__ = "Anibal (alimon) Limon" -__copyright__ = "Copyright 2016, Intel Corp." -__credits__ = ["Anibal Limon"] -__license__ = "GPL" -__version__ = "2.0" -__maintainer__ = "Anibal Limon" -__email__ = "[email protected]" -''' - -import os -from buildbot.steps.transfer import DirectoryDownload -from buildbot.process.buildstep import SKIPPED - -from lib.ABTools import get_error_report_worker_dir, \ - get_error_report_controller_dir - -class DownloadBitbakeErrorReports(DirectoryDownload): - """ - Transfer from master to slave the error reports when bitbake - fails. - """ - name = "DownloadBitbakeErrorReports" - - def __init__(self, factory, argdict=None, **kwargs): - super(DownloadBitbakeErrorReports, self).__init__( - "", "") - - def start(self): - buildername = self.getProperty('buildername') - buildnumber = self.getProperty('buildnumber') - - self.mastersrc = get_error_report_controller_dir(buildername, - buildnumber) - self.slavedest = get_error_report_worker_dir(buildername) - - if not os.path.exists(self.mastersrc): - return SKIPPED - - super(DownloadBitbakeErrorReports, self).start()
lib/python2.7/site-packages/autobuilder/buildsteps/DownloadErrorReports.py new file +42 -0
42 lines not on this page · raw message
Signature · 1 line
2.1.4
PATCH v2 1/1 15/15] buildset-config: Update references from DownloadBitbakeErrorReports to DownloadErrorReports
In reply to Aníbal LimónSince DownloadBitbakeErrorReports is also downloading reports generated by RunOESelftest it don't make sense to have a hard reference of bitbake in the buildstep.
--- buildset-config.controller/build-appliance.conf | 2 +- buildset-config.controller/buildtools.conf | 2 +- buildset-config.controller/nightly-arm-lsb.conf | 2 +- buildset-config.controller/nightly-arm.conf | 2 +- buildset-config.controller/nightly-arm64.conf | 2 +- buildset-config.controller/nightly-deb-non-deb.conf | 2 +- buildset-config.controller/nightly-deb.conf | 2 +- buildset-config.controller/nightly-ipk.conf | 2 +- buildset-config.controller/nightly-mips-lsb.conf | 2 +- buildset-config.controller/nightly-mips.conf | 2 +- buildset-config.controller/nightly-mips64.conf | 2 +- buildset-config.controller/nightly-multilib.conf | 2 +- buildset-config.controller/nightly-musl.conf | 2 +- buildset-config.controller/nightly-no-x11.conf | 2 +- buildset-config.controller/nightly-non-gpl3.conf | 2 +- buildset-config.controller/nightly-oe-selftest.conf | 2 +- buildset-config.controller/nightly-oecore.conf | 2 +- buildset-config.controller/nightly-ppc-lsb.conf | 2 +- buildset-config.controller/nightly-ppc.conf | 2 +- buildset-config.controller/nightly-qa-extras.conf | 2 +- buildset-config.controller/nightly-qa-logrotate.conf | 2 +- buildset-config.controller/nightly-qa-pam.conf | 2 +- buildset-config.controller/nightly-qa-skeleton.conf | 2 +- buildset-config.controller/nightly-qa-systemd.conf | 2 +- buildset-config.controller/nightly-qa-targetbuilds.conf | 2 +- buildset-config.controller/nightly-rpm-non-rpm.conf | 2 +- buildset-config.controller/nightly-rpm.conf | 2 +- buildset-config.controller/nightly-uclibc.conf | 2 +- buildset-config.controller/nightly-world-lsb.conf | 2 +- buildset-config.controller/nightly-world.conf | 2 +- buildset-config.controller/nightly-x32.conf | 2 +- buildset-config.controller/nightly-x86-64-lsb.conf | 2 +- buildset-config.controller/nightly-x86-64.conf | 2 +- buildset-config.controller/nightly-x86-lsb.conf | 2 +- buildset-config.controller/nightly-x86.conf | 2 +- buildset-config.controller/nightly.conf | 2 +- buildset-config.controller/poky-tiny.conf | 2 +- buildset-config.examples/awesomefirmware.conf | 2 +- buildset-config.freescale/nightly-fsl-arm-lsb.conf | 2 +- buildset-config.freescale/nightly-fsl-arm.conf | 2 +- buildset-config.freescale/nightly-fsl-ppc-lsb.conf | 2 +- buildset-config.freescale/nightly-fsl-ppc.conf | 2 +- buildset-config.iot-devkit/iot-devkit.conf | 2 +- buildset-config.kernel/kernel-arm-lsb.conf | 2 +- buildset-config.kernel/kernel-arm.conf | 2 +- buildset-config.kernel/kernel-arm64.conf | 2 +- buildset-config.kernel/kernel-mips-lsb.conf | 2 +- buildset-config.kernel/kernel-mips.conf | 2 +- buildset-config.kernel/kernel-ppc-lsb.conf | 2 +- buildset-config.kernel/kernel-ppc.conf | 2 +- buildset-config.kernel/kernel-x86-64-lsb.conf | 2 +- buildset-config.kernel/kernel-x86-64.conf | 2 +- buildset-config.kernel/kernel-x86-lsb.conf | 2 +- buildset-config.kernel/kernel-x86.conf | 2 +- buildset-config.kernel/nightly-kernel.conf | 2 +- buildset-config.tizen/nightly-tizen-ivi.conf | 2 +- buildset-config.tizen/nightly-tizen.conf | 2 +- buildset-config.tizen/nightly.conf | 2 +- 58 files changed, 58 insertions(+), 58 deletions(-)
buildset-config.controller/build-appliance.conf +1 -1
@@ -19,7 +19,7 @@ steps: [{'SetDest':{}}, {'CreateBBLayersConf': {'buildprovider' : 'yocto'}}, {'BuildImages': {'images': 'universe -c fetch'}}, {'BuildImages': {'images': 'build-appliance-image'}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}, {'PublishLayerTarballs':{}}, {'PublishArtifacts': {'artifacts': ['build-appliance', 'md5sums']}}]
buildset-config.controller/buildtools.conf +1 -1
@@ -15,6 +15,6 @@ steps: [{'SetDest':{}}, {'CreateAutoConf': {'machine': 'qemux86-64', 'SDKMACHINE' : 'i686', 'distro': 'poky', 'buildapp': True}}, {'BuildImages': {'images': 'uninative-tarball'}}, {'PublishLayerTarballs':{}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}, {'PublishArtifacts': {'artifacts': ['buildtools-tarball', 'uninative', 'md5sums']}}]
buildset-config.controller/nightly-arm-lsb.conf +1 -1
@@ -25,7 +25,7 @@ steps: [{'SetDest':{}}, {'BuildImages': {'images': 'core-image-lsb core-image-lsb-sdk'}}, {'SyncPersistDB' : {'commit' : True, 'distro':'poky-lsb'}}, {'PublishLayerTarballs':{}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}, {'UploadToasterEventlog': {}}, {'PublishArtifacts': {'artifacts': ['qemuarm', 'beagleboard', 'md5sums']}}]
buildset-config.controller/nightly-arm.conf +1 -1
@@ -25,7 +25,7 @@ steps: [{'SetDest':{}}, {'RunESDKSanityTests': {'images': 'core-image-minimal core-image-sato'}}, {'SyncPersistDB' : {'commit' : True, 'distro':'poky'}}, {'PublishLayerTarballs':{}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}, {'UploadToasterEventlog': {}}, {'PublishArtifacts': {'artifacts': ['qemuarm', 'beagleboard', 'ipk', 'rpm', 'deb', 'toolchain', 'md5sums']}}]
buildset-config.controller/nightly-arm64.conf +1 -1
@@ -23,7 +23,7 @@ steps: [{'SetDest':{}}, {'RunSDKSanityTests': {'images': 'core-image-sato'}}, {'SyncPersistDB' : {'commit' : True, 'distro':'poky'}}, {'PublishLayerTarballs':{}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}, {'UploadToasterEventlog': {}}, {'PublishArtifacts': {'artifacts': ['qemuarm64', 'ipk', 'rpm', 'deb', 'toolchain', 'md5sums']}}]
buildset-config.controller/nightly-deb-non-deb.conf +1 -1
@@ -12,5 +12,5 @@ steps: [{'SetDest':{}}, {'CreateBBLayersConf': {'buildprovider' : 'yocto'}}, {'BuildImages': {'images': 'core-image-sato core-image-sato-dev core-image-sato-sdk core-image-minimal core-image-minimal-dev'}}, {'RunSanityTests': {'images': 'core-image-minimal core-image-sato core-image-sato-sdk'}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}]
buildset-config.controller/nightly-deb.conf +1 -1
@@ -12,5 +12,5 @@ steps: [{'SetDest':{}}, {'CreateBBLayersConf': {'buildprovider' : 'yocto'}}, {'BuildImages': {'images': 'core-image-sato core-image-sato-dev core-image-sato-sdk core-image-minimal core-image-minimal-dev'}}, {'RunSanityTests': {'images': 'core-image-minimal core-image-sato core-image-sato-sdk'}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}]
buildset-config.controller/nightly-ipk.conf +1 -1
@@ -12,5 +12,5 @@ steps: [{'SetDest':{}}, {'CreateBBLayersConf': {'buildprovider' : 'yocto'}}, {'BuildImages': {'images': 'core-image-sato core-image-sato-dev core-image-sato-sdk core-image-minimal core-image-minimal-dev'}}, {'RunSanityTests': {'images' : 'core-image-minimal core-image-sato core-image-sato-sdk'}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}]
buildset-config.controller/nightly-mips-lsb.conf +1 -1
@@ -26,7 +26,7 @@ steps: [{'SetDest':{}}, {'BuildImages': {'images': 'core-image-lsb core-image-lsb-sdk'}}, {'SyncPersistDB' : {'commit' : True, 'distro':'poky-lsb'}}, {'PublishLayerTarballs':{}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}, {'UploadToasterEventlog': {}}, {'PublishArtifacts': {'artifacts': ['qemumips', 'routerstationpro', 'md5sums']}}]
buildset-config.controller/nightly-mips.conf +1 -1
@@ -29,7 +29,7 @@ steps: [{'SetDest':{}}, {'RunESDKSanityTests': {'images': 'core-image-minimal core-image-sato'}}, {'SyncPersistDB' : {'commit' : True, 'distro':'poky'}}, {'PublishLayerTarballs':{}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}, {'UploadToasterEventlog': {}}, {'PublishArtifacts': {'artifacts': ['qemumips', 'routerstationpro', 'ipk', 'rpm', 'deb', 'toolchain', 'md5sums']}}]
buildset-config.controller/nightly-mips64.conf +1 -1
@@ -23,7 +23,7 @@ steps: [{'SetDest':{}}, {'RunSDKSanityTests': {'images': 'core-image-sato'}}, {'SyncPersistDB' : {'commit' : True, 'distro':'poky'}}, {'PublishLayerTarballs':{}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}, {'UploadToasterEventlog': {}}, {'PublishArtifacts': {'artifacts': ['qemumips64', 'ipk', 'rpm', 'deb', 'toolchain', 'md5sums']}}]
buildset-config.controller/nightly-multilib.conf +1 -1
@@ -37,5 +37,5 @@ steps: [{'SetDest':{}}, 'buildhistory' : False, 'multilib': 'lib64', 'distro': 'poky'}}, {'BuildImages': {'images': 'lib64-core-image-sato lib64-core-image-sato-sdk'}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}]
buildset-config.controller/nightly-musl.conf +1 -1
@@ -13,6 +13,6 @@ steps: [{'SetDest':{}}, 'atextappend' : '\nTCLIBC="musl"\n' }}, {'CreateBBLayersConf': {'buildprovider' : 'yocto'}}, {'BuildImages': {'images': 'core-image-minimal core-image-full-cmdline core-image-sato'}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}]
buildset-config.controller/nightly-no-x11.conf +1 -1
@@ -15,6 +15,6 @@ steps: [{'SetDest':{}}, {'SyncPersistDB' : {'distro' : 'poky'}}, {'GetBitbakeVersion': {}}, {'BuildImages': {'images': 'world'}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}, {'UploadToasterEventlog': {}}]
buildset-config.controller/nightly-non-gpl3.conf +1 -1
@@ -14,5 +14,5 @@ steps: [{'SetDest':{}}, {'CreateBBLayersConf': {'buildprovider' : 'yocto'}}, {'BuildImages': {'images': 'core-image-minimal core-image-basic'}}, {'CheckForGPLv3':{}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}]
buildset-config.controller/nightly-oe-selftest.conf +1 -1
@@ -15,6 +15,6 @@ steps: [{'SetDest':{}}, {'BuildImages': {'images': 'core-image-minimal'}}, {'CreateBBLayersConf': {'buildprovider' : 'yocto', 'layerdirs': ['meta-selftest']}}, {'RunOeSelftest': {}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}, ]
buildset-config.controller/nightly-oecore.conf +1 -1
@@ -24,7 +24,7 @@ steps: [{'SetDest':{}}, 'distro': 'oecore', 'buildhistory' : False}}, {'BuildToolchainImages': {}}, {'BuildImages': {'images': '-c populate_sdk_ext core-image-minimal'}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}} ]
buildset-config.controller/nightly-ppc-lsb.conf +1 -1
@@ -26,7 +26,7 @@ steps: [{'SetDest':{}}, {'BuildImages': {'images': 'core-image-lsb core-image-lsb-sdk'}}, {'SyncPersistDB' : {'commit' : True, 'distro':'poky-lsb'}}, {'PublishLayerTarballs':{}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}, {'UploadToasterEventlog': {}}, {'PublishArtifacts': {'artifacts': ['qemuppc', 'mpc8315e-rdb', 'md5sums']}}]
buildset-config.controller/nightly-ppc.conf +1 -1
@@ -28,7 +28,7 @@ steps: [{'SetDest':{}}, {'RunESDKSanityTests': {'images': 'core-image-minimal core-image-sato'}}, {'SyncPersistDB' : {'commit' : True, 'distro':'poky'}}, {'PublishLayerTarballs':{}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}, {'UploadToasterEventlog': {}}, {'PublishArtifacts': {'artifacts': ['qemuppc', 'mpc8315e-rdb', 'ipk', 'rpm', 'deb', 'toolchain', 'md5sums']}}]
buildset-config.controller/nightly-qa-extras.conf +1 -1
@@ -18,6 +18,6 @@ steps: [{'SetDest':{}}, 'distro': 'poky', 'buildhistory' : False, 'atextappend' : '\nROOT_HOME = "/root"\n'}}, {'BuildImages': {'images': 'core-image-minimal'}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}, {'RunSanityTests': {'images': 'core-image-minimal'}}]
buildset-config.controller/nightly-qa-logrotate.conf +1 -1
@@ -13,7 +13,7 @@ steps: [{'SetDest':{}}, 'atextappend' : '\nIMAGE_INSTALL_append = " logrotate"\n'}}, {'CreateBBLayersConf': {'buildprovider' : 'yocto'}}, {'BuildImages': {'images': 'core-image-sato'}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}, {'RunSanityTests': {'images': 'core-image-sato', 'suitesappend' : 'logrotate'}}]
buildset-config.controller/nightly-qa-pam.conf +1 -1
@@ -14,6 +14,6 @@ steps: [{'SetDest':{}}, {'CreateBBLayersConf': {'buildprovider' : 'yocto'}}, {'BuildImages': {'images': 'core-image-sato'}}, {'SendErrorReport': {}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'RunSanityTests': {'images': 'core-image-sato', 'suitesappend' : 'pam'}}]
buildset-config.controller/nightly-qa-skeleton.conf +1 -1
@@ -13,7 +13,7 @@ steps: [{'SetDest':{}}, 'atextappend' : '\nIMAGE_INSTALL_append = " service hello-mod"\n'}}, {'CreateBBLayersConf': {'buildprovider' : 'yocto', 'layerdirs': ['meta-skeleton']}}, {'BuildImages': {'images': 'core-image-sato'}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}, {'RunSanityTests': {'images': 'core-image-sato', 'suitesappend' : 'skeletoninit'}}]
buildset-config.controller/nightly-qa-systemd.conf +1 -1
@@ -23,6 +23,6 @@ steps: [{'SetDest':{}}, 'buildhistory' : False, 'distro': 'poky', 'initmgr' : 'systemd'}}, {'BuildImages': {'images': 'core-image-sato'}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}, {'RunSanityTests': {'images': 'core-image-sato', 'suitesappend' : 'systemd'}}]
buildset-config.controller/nightly-qa-targetbuilds.conf +1 -1
@@ -27,7 +27,7 @@ steps: [{'SetDest':{}}, {'CreateAutoConf': {'machine': 'qemuppc', 'SDKMACHINE' : 'x86_64', 'buildhistory' : False, 'distro': 'poky'}}, {'BuildImages': {'images': 'core-image-sato-sdk'}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}, {'RunSanityTests': {'images': 'core-image-sato-sdk', 'suites' : 'ping ssh buildsudoku buildcvs buildiptables'}}]
buildset-config.controller/nightly-rpm-non-rpm.conf +1 -1
@@ -13,6 +13,6 @@ steps: [{'SetDest':{}}, 'packages': 'rpm'}}, {'CreateBBLayersConf': {'buildprovider' : 'yocto'}}, {'BuildImages': {'images' : 'core-image-sato core-image-sato-dev core-image-sato-sdk core-image-minimal core-image-minimal-dev'}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}, {'RunSanityTests': {'images' : 'core-image-minimal core-image-sato core-image-sato-sdk'}}]
buildset-config.controller/nightly-rpm.conf +1 -1
@@ -13,6 +13,6 @@ steps: [{'SetDest':{}}, 'packages': 'rpm'}}, {'CreateBBLayersConf': {'buildprovider' : 'yocto'}}, {'BuildImages': {'images' : 'core-image-sato core-image-sato-dev core-image-sato-sdk core-image-minimal core-image-minimal-dev'}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}, {'RunSanityTests': {'images' : 'core-image-minimal core-image-sato core-image-sato-sdk'}}]
buildset-config.controller/nightly-uclibc.conf +1 -1
@@ -13,6 +13,6 @@ steps: [{'SetDest':{}}, 'atextappend' : '\nTCLIBC="uclibc"\n' }}, {'CreateBBLayersConf': {'buildprovider' : 'yocto'}}, {'BuildImages': {'images': 'core-image-minimal'}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}]
buildset-config.controller/nightly-world-lsb.conf +1 -1
@@ -21,7 +21,7 @@ steps: [{'SetDest':{}}, 'distro': 'poky-lsb'}}, {'CreateBBLayersConf': {'buildprovider' : 'yocto'}}, {'BuildImages': {'images': 'world'}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}, {'PublishArtifacts': {'artifacts': ['ipk', 'rpm', 'deb']}}]
buildset-config.controller/nightly-world.conf +1 -1
@@ -13,7 +13,7 @@ steps: [{'SetDest':{}}, 'distro': 'poky'}}, {'CreateBBLayersConf': {'buildprovider' : 'yocto'}}, {'BuildImages': {'images': 'world'}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}, {'PublishArtifacts': {'artifacts': ['ipk', 'rpm', 'deb']}}]
buildset-config.controller/nightly-x32.conf +1 -1
@@ -20,7 +20,7 @@ steps: [{'SetDest':{}}, 'buildhistory' : False, 'x32': True, 'distro': 'poky'}}, {'RunSanityTests': {'images': 'core-image-sato', 'suitesappend' : 'x32lib'}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}, {'UploadToasterEventlog': {}}, {'PublishArtifacts': {'artifacts': ['md5sums']}}]
buildset-config.controller/nightly-x86-64-lsb.conf +1 -1
@@ -26,7 +26,7 @@ steps: [{'SetDest':{}}, {'BuildImages': {'images': 'core-image-lsb core-image-lsb-sdk'}}, {'SyncPersistDB' : {'commit' : True, 'distro':'poky-lsb'}}, {'PublishLayerTarballs':{}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}, {'UploadToasterEventlog': {}}, {'PublishArtifacts': {'artifacts': ['qemux86-64', 'genericx86-64', 'md5sums']}}]
buildset-config.controller/nightly-x86-64.conf +1 -1
@@ -30,7 +30,7 @@ steps: [{'SetDest':{}}, {'RunESDKSanityTests': {'images': 'core-image-minimal core-image-sato'}}, {'SyncPersistDB' : {'commit' : True, 'distro':'poky'}}, {'PublishLayerTarballs':{}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}, {'UploadToasterEventlog': {}}, {'PublishArtifacts': {'artifacts': ['qemux86-64', 'genericx86-64', 'ipk', 'rpm', 'deb', 'toolchain', 'md5sums']}}]
buildset-config.controller/nightly-x86-lsb.conf +1 -1
@@ -26,7 +26,7 @@ steps: [{'SetDest':{}}, {'BuildImages': {'images': 'core-image-lsb core-image-lsb-sdk'}}, {'SyncPersistDB' : {'commit' : True, 'distro':'poky-lsb'}}, {'PublishLayerTarballs':{}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}, {'UploadToasterEventlog': {}}, {'PublishArtifacts': {'artifacts': ['qemux86', 'genericx86', 'md5sums']}}]
buildset-config.controller/nightly-x86.conf +1 -1
@@ -30,7 +30,7 @@ steps: [{'SetDest':{}}, {'RunESDKSanityTests': {'images': 'core-image-minimal core-image-sato'}}, {'SyncPersistDB' : {'commit' : True, 'distro':'poky'}}, {'PublishLayerTarballs':{}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}, {'UploadToasterEventlog': {}}, {'PublishArtifacts': {'artifacts': ['qemux86', 'genericx86', 'ipk', 'rpm', 'deb', 'toolchain', 'md5sums']}}]
buildset-config.controller/nightly.conf +1 -1
@@ -152,7 +152,7 @@ steps: [{'SetDest':{}}, {'BuildImages': {'images': 'adt-installer'}}, {'PublishArtifacts': {'artifacts': ['adt-installer-QA', 'adtrepo-dev']}}, {'BitbakeSelftest': {}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}, {'TriggerBuilds': {'schedulerName': 'buildhistory', 'waitForFinish': 'False',
buildset-config.controller/poky-tiny.conf +1 -1
@@ -12,7 +12,7 @@ steps: [{'SetDest':{}}, {'CreateBBLayersConf': {'buildprovider' : 'yocto'}}, {'BuildImages': {'images': 'core-image-minimal'}}, {'PublishLayerTarballs':{}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}, {'PublishArtifacts': {'artifacts': ['tiny', 'md5sums']}}]
buildset-config.examples/awesomefirmware.conf +1 -1
@@ -29,7 +29,7 @@ steps: [{'SetDest':{}}, {'BuildImages': {'images': 'core-image-minimal'}}, {'CreateGPLTarball': {}}, {'PublishArtifacts': {'artifacts': ['genericx86-64']}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}, {'UploadToasterEventlog': {}}, {'SendQAEmail': {}},
buildset-config.freescale/nightly-fsl-arm-lsb.conf +1 -1
@@ -35,7 +35,7 @@ steps: [{'SetDest':{}}, 'devkernel' : False}}, {'BuildImages': {'images': 'core-image-lsb core-image-lsb-dev core-image-lsb-sdk LSB-QT-IMAGES'}}, {'PublishLayerTarballs':{}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}, {'UploadToasterEventlog': {}}, {'PublishArtifacts': {'artifacts': ['imx53qsb', 'imx6qsabresd', 'imx28evk', 'md5sums']}}]
buildset-config.freescale/nightly-fsl-arm.conf +1 -1
@@ -40,7 +40,7 @@ steps: [{'SetDest':{}}, 'devkernel' : False}}, {'BuildImages': {'images': 'core-image-sato core-image-sato-dev core-image-sato-sdk core-image-minimal core-image-minimal-dev'}}, {'PublishLayerTarballs':{}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}, {'UploadToasterEventlog': {}}, {'PublishArtifacts': {'artifacts': ['imx53qsb', 'imx6qsabresd', 'imx28evk', 'ipk', 'toolchain', 'md5sums']}}]
buildset-config.freescale/nightly-fsl-ppc-lsb.conf +1 -1
@@ -25,7 +25,7 @@ steps: [{'SetDest':{}}, {'GetBitbakeVersion': {}}, {'BuildImages': {'images': 'core-image-lsb core-image-lsb-dev core-image-lsb-sdk LSB-QT-IMAGES'}}, {'PublishLayerTarballs':{}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}, {'UploadToasterEventlog': {}}, {'PublishArtifacts': {'artifacts': ['p1022ds', 'md5sums']}}]
buildset-config.freescale/nightly-fsl-ppc.conf +1 -1
@@ -26,7 +26,7 @@ steps: [{'SetDest':{}}, {'BuildToolchainImages': {}}, {'BuildImages': {'images': '-c populate_sdk_ext core-image-minimal'}}, {'PublishLayerTarballs':{}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}, {'UploadToasterEventlog': {}}, {'PublishArtifacts': {'artifacts': ['p1022ds', 'ipk', 'toolchain', 'md5sums']}}]
buildset-config.iot-devkit/iot-devkit.conf +1 -1
@@ -29,6 +29,6 @@ steps: [{'SetDest':{}}, 'meta-openembedded/meta-filesystems']}}, {'BuildImages': {'images': 'iot-devkit-image iot-devkit-prof-image iot-devkit-prof-dev-image'}}, {'PublishLayerTarballs':{}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}, {'PublishArtifacts': {'artifacts': ['quark', 'ipk', 'md5sums']}}]
buildset-config.kernel/kernel-arm-lsb.conf +1 -1
@@ -55,6 +55,6 @@ steps: [{'SetDest':{}}, {'SyncPersistDB' : {'distro' : 'poky'}}, {'BuildImages': {'images': 'core-image-kernel-dev'}}, {'RunSanityTests': {'images': 'core-image-kernel-dev'}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}]
buildset-config.kernel/kernel-arm.conf +1 -1
@@ -49,6 +49,6 @@ steps: [{'SetDest':{}}, {'SyncPersistDB' : {'distro' : 'poky'}}, {'BuildImages': {'images': 'core-image-kernel-dev'}}, {'RunSanityTests': {'images': 'core-image-kernel-dev'}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}]
buildset-config.kernel/kernel-arm64.conf +1 -1
@@ -49,6 +49,6 @@ steps: [{'SetDest':{}}, {'SyncPersistDB' : {'distro' : 'poky'}}, {'BuildImages': {'images': 'core-image-kernel-dev'}}, {'RunSanityTests': {'images': 'core-image-kernel-dev'}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}]
buildset-config.kernel/kernel-mips-lsb.conf +1 -1
@@ -55,5 +55,5 @@ steps: [{'SetDest':{}}, {'SyncPersistDB' : {'distro' : 'poky'}}, {'BuildImages': {'images': 'core-image-kernel-dev'}}, {'RunSanityTests': {'images': 'core-image-kernel-dev'}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}]
buildset-config.kernel/kernel-mips.conf +1 -1
@@ -49,5 +49,5 @@ steps: [{'SetDest':{}}, {'SyncPersistDB' : {'distro' : 'poky'}}, {'BuildImages': {'images': 'core-image-kernel-dev'}}, {'RunSanityTests': {'images': 'core-image-kernel-dev'}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}]
buildset-config.kernel/kernel-ppc-lsb.conf +1 -1
@@ -55,5 +55,5 @@ steps: [{'SetDest':{}}, {'SyncPersistDB' : {'distro' : 'poky'}}, {'BuildImages': {'images': 'core-image-kernel-dev'}}, {'RunSanityTests': {'images': 'core-image-kernel-dev'}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}]
buildset-config.kernel/kernel-ppc.conf +1 -1
@@ -49,5 +49,5 @@ steps: [{'SetDest':{}}, {'SyncPersistDB' : {'distro' : 'poky'}}, {'BuildImages': {'images': 'core-image-kernel-dev'}}, {'RunSanityTests': {'images': 'core-image-kernel-dev'}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}]
buildset-config.kernel/kernel-x86-64-lsb.conf +1 -1
@@ -55,5 +55,5 @@ steps: [{'SetDest':{}}, {'SyncPersistDB' : {'distro' : 'poky'}}, {'BuildImages': {'images': 'core-image-kernel-dev'}}, {'RunSanityTests': {'images': 'core-image-kernel-dev'}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}]
buildset-config.kernel/kernel-x86-64.conf +1 -1
@@ -49,5 +49,5 @@ steps: [{'SetDest':{}}, {'SyncPersistDB' : {'distro' : 'poky'}}, {'BuildImages': {'images': 'core-image-kernel-dev'}}, {'RunSanityTests': {'images': 'core-image-kernel-dev'}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}]
buildset-config.kernel/kernel-x86-lsb.conf +1 -1
@@ -55,5 +55,5 @@ steps: [{'SetDest':{}}, {'SyncPersistDB' : {'distro' : 'poky'}}, {'BuildImages': {'images': 'core-image-kernel-dev'}}, {'RunSanityTests': {'images': 'core-image-kernel-dev'}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}]
buildset-config.kernel/kernel-x86.conf +1 -1
@@ -49,5 +49,5 @@ steps: [{'SetDest':{}}, {'SyncPersistDB' : {'distro' : 'poky'}}, {'BuildImages': {'images': 'core-image-kernel-dev'}}, {'RunSanityTests': {'images': 'core-image-kernel-dev'}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}]
buildset-config.kernel/nightly-kernel.conf +1 -1
@@ -58,6 +58,6 @@ steps: [{'SetDest':{}}, 'kernel-x86-64': {}, 'kernel-x86-64-lsb': {}, 'kernel-x86': {}, 'kernel-x86-lsb': {}, 'kernel-arm64': {}}, 'schedulerNames_nowait' : {}}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}, {'SendQAEmail': {}}]
buildset-config.tizen/nightly-tizen-ivi.conf +1 -1
@@ -19,6 +19,6 @@ steps: [{'SetDest':{}}, 'meta-tizen/meta-tizen-common-share', 'meta-tizen/meta-tizen-common-devtools', \ 'meta-tizen/meta-tizen-common-demo', 'meta-tizen/meta-tizen-ivi']}}, {'BuildImages': {'images': 'tizen-ivi-Modello-image'}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}} ]
buildset-config.tizen/nightly-tizen.conf +1 -1
@@ -18,7 +18,7 @@ steps: [{'SetDest':{}}, 'meta-tizen/meta-tizen-common-share', 'meta-tizen/meta-tizen-common-devtools', \ 'meta-tizen/meta-tizen-common-demo']}}, {'BuildImages': {'images': 'tizen-common-core-image-crosswalk-dev'}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}} ]
buildset-config.tizen/nightly.conf +1 -1
@@ -42,7 +42,7 @@ steps: [{'SetDest':{}}, {'TriggerBuilds': {'schedulerName': 'main-build', 'waitForFinish': 'True', 'schedulerNames': {'nightly-tizen-ivi': {}, 'nightly-tizen': {}}, 'schedulerNames_nowait' : {}}}, - {'DownloadBitbakeErrorReports': {}}, + {'DownloadErrorReports': {}}, {'SendErrorReport': {}}, {'TriggerBuilds': {'schedulerName': 'buildhistory', 'waitForFinish': 'False',
Signature · 1 line
2.1.4
Quoted 8 lines · Aníbal Limón
This v2 adds support for generate also oe-selftest reports this is almost
the previous version with changes requested in review [1], the next patches
starts from patch,
autobuilder/lib/{ABtools,builsteps}.py: Createsave_error_reportfunc
A few comments.
- Please rebase the last two commits. They can be merged into prior commits.
Example: 0eb495d93eefa9ead8f4b1242f251f1a2288db68 should be squashed into 83b6707622128436b4ece9d4c2a89311b000c209
We shouldn't need rename commits for a pull request that created the original thing we're renaming.
- Please fix the title for 83b6707622128436b4ece9d4c2a89311b000c209 's/buiidsets/buildsets/'
-b
Signature · 2 lines
Beth 'pidge' Flanagan <[email protected]> toganlabs.com
Quoted 116 lines
Also the changes could be reviewed at [2].
[1] https://lists.yoctoproject.org/pipermail/yocto/2016-June/030515.h
tml
[2] http://git.yoctoproject.org/cgit/cgit.cgi/yocto-autobuilder/log/?
h=contrib/alimon/develAníbal Limón (15):
lib/buildsteps.py: Add BitbakeShellCommand classlib/buildsteps.py: Add BitbakeLogLineObserver for BitbakeShellCommands.
lib/buildsteps: BitbakeShellCommand add support for create error reports
lib/ABTools: Add functions for get errordir path in controller and worker
buildbot: Add support for DirectoryDownload transfer step autobuilder/buildsteps: Add DownloadBitbakeErrorReports step
buiidsets: Add DownloadBitbakeErrorReport steplib/buildsteps.py: BitbakeShellCommand add support forerror_typeautobuilder/lib/buildsteps.py: BitbakeShellCommand update error report
types.
autobuilder/lib/{ABtools,builsteps}.py: Createsave_error_reportfunc
autobuilder/lib/ABTools.py: Addget_lsb_distrofunctionbuildsteps/RunOeSelftest.py: Add support for create/save error reports
nightly-oe-selftest.conf: Add steps for Download and Send error report.
autobuilder/buildsteps: Rename DownloadBitbakeErrorReports to DownloadErrorReports
buildset-config: Update references from DownloadBitbakeErrorReports to
DownloadErrorReportsbuildset-config.controller/build-appliance.conf | 1 + buildset-config.controller/buildtools.conf | 1 + buildset-config.controller/nightly-arm-lsb.conf | 1 + buildset-config.controller/nightly-arm.conf | 1 + buildset-config.controller/nightly-arm64.conf | 1 + .../nightly-deb-non-deb.conf | 1 + buildset-config.controller/nightly-deb.conf | 1 + buildset-config.controller/nightly-ipk.conf | 1 + buildset-config.controller/nightly-mips-lsb.conf | 1 + buildset-config.controller/nightly-mips.conf | 1 + buildset-config.controller/nightly-mips64.conf | 1 + buildset-config.controller/nightly-multilib.conf | 1 + buildset-config.controller/nightly-musl.conf | 1 + buildset-config.controller/nightly-no-x11.conf | 1 + buildset-config.controller/nightly-non-gpl3.conf | 1 + .../nightly-oe-selftest.conf | 5 +- buildset-config.controller/nightly-oecore.conf | 1 + buildset-config.controller/nightly-ppc-lsb.conf | 1 + buildset-config.controller/nightly-ppc.conf | 1 + buildset-config.controller/nightly-qa-extras.conf | 1 + .../nightly-qa-logrotate.conf | 1 + buildset-config.controller/nightly-qa-pam.conf | 1 + .../nightly-qa-skeleton.conf | 1 +
buildset-config.controller/nightly-qa-systemd.conf| 1 + .../nightly-qa-targetbuilds.conf | 1 + .../nightly-rpm-non-rpm.conf | 1 + buildset-config.controller/nightly-rpm.conf | 1 + buildset-config.controller/nightly-uclibc.conf | 1 + buildset-config.controller/nightly-world-lsb.conf | 1 + buildset-config.controller/nightly-world.conf | 1 + buildset-config.controller/nightly-x32.conf | 1 +buildset-config.controller/nightly-x86-64-lsb.conf| 1 + buildset-config.controller/nightly-x86-64.conf | 1 + buildset-config.controller/nightly-x86-lsb.conf | 1 + buildset-config.controller/nightly-x86.conf | 1 + buildset-config.controller/nightly.conf | 1 + buildset-config.controller/poky-tiny.conf | 1 + buildset-config.examples/awesomefirmware.conf | 1 +buildset-config.freescale/nightly-fsl-arm-lsb.conf| 1 + buildset-config.freescale/nightly-fsl-arm.conf | 1 +buildset-config.freescale/nightly-fsl-ppc-lsb.conf| 1 + buildset-config.freescale/nightly-fsl-ppc.conf | 1 + buildset-config.iot-devkit/iot-devkit.conf | 1 + buildset-config.kernel/kernel-arm-lsb.conf | 1 + buildset-config.kernel/kernel-arm.conf | 1 + buildset-config.kernel/kernel-arm64.conf | 1 + buildset-config.kernel/kernel-mips-lsb.conf | 1 + buildset-config.kernel/kernel-mips.conf | 1 + buildset-config.kernel/kernel-ppc-lsb.conf | 1 + buildset-config.kernel/kernel-ppc.conf | 1 + buildset-config.kernel/kernel-x86-64-lsb.conf | 1 + buildset-config.kernel/kernel-x86-64.conf | 1 + buildset-config.kernel/kernel-x86-lsb.conf | 1 + buildset-config.kernel/kernel-x86.conf | 1 + buildset-config.kernel/nightly-kernel.conf | 1 + buildset-config.tizen/nightly-tizen-ivi.conf | 1 + buildset-config.tizen/nightly-tizen.conf | 1 + buildset-config.tizen/nightly.conf | 1 + .../autobuilder/buildsteps/BuildImages.py | 7 +-.../autobuilder/buildsteps/BuildToolchainImages.py| 7 +-.../autobuilder/buildsteps/DownloadErrorReports.py| 42 +++++++++ .../autobuilder/buildsteps/GetBitbakeVersion.py | 6 +- .../autobuilder/buildsteps/RunESDKSanityTests.py | 6 +- .../autobuilder/buildsteps/RunOeSelftest.py | 46 +++++++++ .../autobuilder/buildsteps/RunSDKSanityTests.py | 6 +- .../autobuilder/buildsteps/RunSanityTests.py | 6 +- .../autobuilder/buildsteps/SendErrorReport.py | 16 ++-- .../site-packages/autobuilder/lib/ABTools.py | 59
++++++++++++
.../site-packages/autobuilder/lib/buildsteps.py | 104
+++++++++++++++++++++
.../buildbot/steps/transfer.py | 86
++++++++++++++++-
.../buildslave/commands/registry.py | 1 + .../buildslave/commands/transfer.py | 79
++++++++++++++++72 files changed, 509 insertions(+), 24 deletions(-)create mode 100644
lib/python2.7/site-packages/autobuilder/buildsteps/DownloadErrorReports.py
Quoted 15 lines · Beth 'pidge' Flanagan
Quoted 8 lines · Aníbal Limón
This v2 adds support for generate also oe-selftest reports this is almost
the previous version with changes requested in review [1], the next patches
starts from patch,
autobuilder/lib/{ABtools,builsteps}.py: Createsave_error_reportfuncA few comments.
- Please rebase the last two commits. They can be merged into prior commits.
Quoted 8 lines
Example:
0eb495d93eefa9ead8f4b1242f251f1a2288db68should be squashed into83b6707622128436b4ece9d4c2a89311b000c209We shouldn't need rename commits for a pull request that created the original thing we're renaming.
- Please fix the title for
83b6707622128436b4ece9d4c2a89311b000c209's/buiidsets/buildsets/'
I squashed the changes now at,
http://git.yoctoproject.org/cgit/cgit.cgi/yocto-autobuilder/log/?h=contrib/alimon/devel2
alimon
Quoted 4 lines
-b
Quoted 24 lines · Aníbal Limón
Quoted 21 lines · Beth 'pidge' Flanagan
Quoted 8 lines · Aníbal Limón
This v2 adds support for generate also oe-selftest reports this is almost
the previous version with changes requested in review [1], the next patches
starts from patch,
autobuilder/lib/{ABtools,builsteps}.py: Createsave_error_reportfuncA few comments.
- Please rebase the last two commits. They can be merged into prior commits.
Example:
0eb495d93eefa9ead8f4b1242f251f1a2288db68should be squashed into83b6707622128436b4ece9d4c2a89311b000c209We shouldn't need rename commits for a pull request that created the original thing we're renaming.
Quoted 8 lines
Quoted 2 lines
- Please fix the title for
83b6707622128436b4ece9d4c2a89311b000c209's/buiidsets/buildsets/'I squashed the changes now at,
http://git.yoctoproject.org/cgit/cgit.cgi/yocto-autobuilder/log/?h=contrib/alimon/devel2
alimon
Hi,
The Error report web needed changes are now integrated [1], if you ack'ed the changes we could proceed to integrate/deploy these changes to enable send Bitbake/OE-seltest errors to ERW.
[1] https://bugzilla.yoctoproject.org/show_bug.cgi?id=7583#c14
Cheers,
alimon
Quoted 5 lines
Quoted 4 lines
-b
Quoted 49 lines · Aníbal Limón
Quoted 34 lines · Aníbal Limón
Quoted 23 lines · Beth 'pidge' Flanagan
Quoted 11 lines · Aníbal Limón
This v2 adds support for generate also oe-selftest reports this is
almost
the previous version with changes requested in review [1], the next
patches
starts from patch,
autobuilder/lib/{ABtools,builsteps}.py: Createsave_error_reportfuncA few comments.
- Please rebase the last two commits. They can be merged into prior
commits.Example:
0eb495d93eefa9ead8f4b1242f251f1a2288db68should be squashed
into83b6707622128436b4ece9d4c2a89311b000c209Quoted 7 lines
We shouldn't need rename commits for a pull request that created the
original thing we're renaming.- Please fix the title for
83b6707622128436b4ece9d4c2a89311b000c209
's/buiidsets/buildsets/'Quoted 6 lines
I squashed the changes now at,
http://git.yoctoproject.org/cgit/cgit.cgi/yocto-autobuilder/log/?h=
contrib/alimon/devel2alimon
Hi,
The Error report web needed changes are now integrated [1], if you ack'ed the changes we could proceed to integrate/deploy these changes to
enable send Bitbake/OE-seltest errors to ERW.
Quoted 4 lines
[1] https://bugzilla.yoctoproject.org/show_bug.cgi?id=7583#c14
Cheers,
alimon
Let me review them tonight and if they're ok, I'll pull them into master.
-b
Quoted 7 lines
Quoted 7 lines
Quoted 7 lines
-b
Pulled into master, thanks!
-b
Quoted 124 lines · Aníbal Limón
This v2 adds support for generate also oe-selftest reports this is almost
the previous version with changes requested in review [1], the next patches
starts from patch,
autobuilder/lib/{ABtools,builsteps}.py: Createsave_error_reportfuncAlso the changes could be reviewed at [2].
[1] https://lists.yoctoproject.org/pipermail/yocto/2016-June/030515.h
tml
[2] http://git.yoctoproject.org/cgit/cgit.cgi/yocto-autobuilder/log/?
h=contrib/alimon/develAníbal Limón (15):
lib/buildsteps.py: Add BitbakeShellCommand classlib/buildsteps.py: Add BitbakeLogLineObserver for BitbakeShellCommands.
lib/buildsteps: BitbakeShellCommand add support for create error reports
lib/ABTools: Add functions for get errordir path in controller and worker
buildbot: Add support for DirectoryDownload transfer step autobuilder/buildsteps: Add DownloadBitbakeErrorReports step
buiidsets: Add DownloadBitbakeErrorReport steplib/buildsteps.py: BitbakeShellCommand add support forerror_typeautobuilder/lib/buildsteps.py: BitbakeShellCommand update error report
types.
autobuilder/lib/{ABtools,builsteps}.py: Createsave_error_reportfunc
autobuilder/lib/ABTools.py: Addget_lsb_distrofunctionbuildsteps/RunOeSelftest.py: Add support for create/save error reports
nightly-oe-selftest.conf: Add steps for Download and Send error report.
autobuilder/buildsteps: Rename DownloadBitbakeErrorReports to DownloadErrorReports
buildset-config: Update references from DownloadBitbakeErrorReports to
DownloadErrorReportsbuildset-config.controller/build-appliance.conf | 1 + buildset-config.controller/buildtools.conf | 1 + buildset-config.controller/nightly-arm-lsb.conf | 1 + buildset-config.controller/nightly-arm.conf | 1 + buildset-config.controller/nightly-arm64.conf | 1 + .../nightly-deb-non-deb.conf | 1 + buildset-config.controller/nightly-deb.conf | 1 + buildset-config.controller/nightly-ipk.conf | 1 + buildset-config.controller/nightly-mips-lsb.conf | 1 + buildset-config.controller/nightly-mips.conf | 1 + buildset-config.controller/nightly-mips64.conf | 1 + buildset-config.controller/nightly-multilib.conf | 1 + buildset-config.controller/nightly-musl.conf | 1 + buildset-config.controller/nightly-no-x11.conf | 1 + buildset-config.controller/nightly-non-gpl3.conf | 1 + .../nightly-oe-selftest.conf | 5 +- buildset-config.controller/nightly-oecore.conf | 1 + buildset-config.controller/nightly-ppc-lsb.conf | 1 + buildset-config.controller/nightly-ppc.conf | 1 + buildset-config.controller/nightly-qa-extras.conf | 1 + .../nightly-qa-logrotate.conf | 1 + buildset-config.controller/nightly-qa-pam.conf | 1 + .../nightly-qa-skeleton.conf | 1 +
buildset-config.controller/nightly-qa-systemd.conf| 1 + .../nightly-qa-targetbuilds.conf | 1 + .../nightly-rpm-non-rpm.conf | 1 + buildset-config.controller/nightly-rpm.conf | 1 + buildset-config.controller/nightly-uclibc.conf | 1 + buildset-config.controller/nightly-world-lsb.conf | 1 + buildset-config.controller/nightly-world.conf | 1 + buildset-config.controller/nightly-x32.conf | 1 +buildset-config.controller/nightly-x86-64-lsb.conf| 1 + buildset-config.controller/nightly-x86-64.conf | 1 + buildset-config.controller/nightly-x86-lsb.conf | 1 + buildset-config.controller/nightly-x86.conf | 1 + buildset-config.controller/nightly.conf | 1 + buildset-config.controller/poky-tiny.conf | 1 + buildset-config.examples/awesomefirmware.conf | 1 +buildset-config.freescale/nightly-fsl-arm-lsb.conf| 1 + buildset-config.freescale/nightly-fsl-arm.conf | 1 +buildset-config.freescale/nightly-fsl-ppc-lsb.conf| 1 + buildset-config.freescale/nightly-fsl-ppc.conf | 1 + buildset-config.iot-devkit/iot-devkit.conf | 1 + buildset-config.kernel/kernel-arm-lsb.conf | 1 + buildset-config.kernel/kernel-arm.conf | 1 + buildset-config.kernel/kernel-arm64.conf | 1 + buildset-config.kernel/kernel-mips-lsb.conf | 1 + buildset-config.kernel/kernel-mips.conf | 1 + buildset-config.kernel/kernel-ppc-lsb.conf | 1 + buildset-config.kernel/kernel-ppc.conf | 1 + buildset-config.kernel/kernel-x86-64-lsb.conf | 1 + buildset-config.kernel/kernel-x86-64.conf | 1 + buildset-config.kernel/kernel-x86-lsb.conf | 1 + buildset-config.kernel/kernel-x86.conf | 1 + buildset-config.kernel/nightly-kernel.conf | 1 + buildset-config.tizen/nightly-tizen-ivi.conf | 1 + buildset-config.tizen/nightly-tizen.conf | 1 + buildset-config.tizen/nightly.conf | 1 + .../autobuilder/buildsteps/BuildImages.py | 7 +-.../autobuilder/buildsteps/BuildToolchainImages.py| 7 +-.../autobuilder/buildsteps/DownloadErrorReports.py| 42 +++++++++ .../autobuilder/buildsteps/GetBitbakeVersion.py | 6 +- .../autobuilder/buildsteps/RunESDKSanityTests.py | 6 +- .../autobuilder/buildsteps/RunOeSelftest.py | 46 +++++++++ .../autobuilder/buildsteps/RunSDKSanityTests.py | 6 +- .../autobuilder/buildsteps/RunSanityTests.py | 6 +- .../autobuilder/buildsteps/SendErrorReport.py | 16 ++-- .../site-packages/autobuilder/lib/ABTools.py | 59
++++++++++++
.../site-packages/autobuilder/lib/buildsteps.py | 104
+++++++++++++++++++++
.../buildbot/steps/transfer.py | 86
++++++++++++++++-
.../buildslave/commands/registry.py | 1 + .../buildslave/commands/transfer.py | 79
++++++++++++++++72 files changed, 509 insertions(+), 24 deletions(-)create mode 100644
lib/python2.7/site-packages/autobuilder/buildsteps/DownloadErrorReports.py
Signature · 2 lines
Beth 'pidge' Flanagan <[email protected]> toganlabs.com
Quoted 1 line · Beth 'pidge' Flanagan
Pulled into master, thanks!
Thanks, when i was reviewing the integration i noticed that i miss to update the buildstep reference (DownloadBitbakeErrorReports -> DownloadErrorReports) into nightly-world-lsb.conf.
Sorry about that, i sent another patch for fix it,
https://lists.yoctoproject.org/pipermail/yocto/2016-June/030860.html
alimon
Quoted 129 lines
-b
Quoted 124 lines · Aníbal Limón
This v2 adds support for generate also oe-selftest reports this is almost
the previous version with changes requested in review [1], the next patches
starts from patch,
autobuilder/lib/{ABtools,builsteps}.py: Createsave_error_reportfuncAlso the changes could be reviewed at [2].
[1] https://lists.yoctoproject.org/pipermail/yocto/2016-June/030515.h
tml
[2] http://git.yoctoproject.org/cgit/cgit.cgi/yocto-autobuilder/log/?
h=contrib/alimon/develAníbal Limón (15):
lib/buildsteps.py: Add BitbakeShellCommand classlib/buildsteps.py: Add BitbakeLogLineObserver for
BitbakeShellCommands.
lib/buildsteps: BitbakeShellCommand add support for create error
reports
lib/ABTools: Add functions for get errordir path in controller and
worker
buildbot: Add support for DirectoryDownload transfer step autobuilder/buildsteps: Add DownloadBitbakeErrorReports step
buiidsets: Add DownloadBitbakeErrorReport steplib/buildsteps.py: BitbakeShellCommand add support forerror_typeautobuilder/lib/buildsteps.py: BitbakeShellCommand update error
report
types.
autobuilder/lib/{ABtools,builsteps}.py: Createsave_error_report
func
autobuilder/lib/ABTools.py: Addget_lsb_distrofunctionbuildsteps/RunOeSelftest.py: Add support for create/save error
reports
nightly-oe-selftest.conf: Add steps for Download and Send error
report.
autobuilder/buildsteps: Rename DownloadBitbakeErrorReports to
DownloadErrorReports
buildset-config: Update references from DownloadBitbakeErrorReports
to
DownloadErrorReportsbuildset-config.controller/build-appliance.conf | 1 + buildset-config.controller/buildtools.conf | 1 + buildset-config.controller/nightly-arm-lsb.conf | 1 + buildset-config.controller/nightly-arm.conf | 1 + buildset-config.controller/nightly-arm64.conf | 1 + .../nightly-deb-non-deb.conf | 1 + buildset-config.controller/nightly-deb.conf | 1 + buildset-config.controller/nightly-ipk.conf | 1 + buildset-config.controller/nightly-mips-lsb.conf | 1 + buildset-config.controller/nightly-mips.conf | 1 + buildset-config.controller/nightly-mips64.conf | 1 + buildset-config.controller/nightly-multilib.conf | 1 + buildset-config.controller/nightly-musl.conf | 1 + buildset-config.controller/nightly-no-x11.conf | 1 + buildset-config.controller/nightly-non-gpl3.conf | 1 + .../nightly-oe-selftest.conf | 5 +- buildset-config.controller/nightly-oecore.conf | 1 + buildset-config.controller/nightly-ppc-lsb.conf | 1 + buildset-config.controller/nightly-ppc.conf | 1 + buildset-config.controller/nightly-qa-extras.conf | 1 + .../nightly-qa-logrotate.conf | 1 + buildset-config.controller/nightly-qa-pam.conf | 1 + .../nightly-qa-skeleton.conf | 1 + buildset-config.controller/nightly-qa-systemd.conf | 1 + .../nightly-qa-targetbuilds.conf | 1 + .../nightly-rpm-non-rpm.conf | 1 + buildset-config.controller/nightly-rpm.conf | 1 + buildset-config.controller/nightly-uclibc.conf | 1 + buildset-config.controller/nightly-world-lsb.conf | 1 + buildset-config.controller/nightly-world.conf | 1 + buildset-config.controller/nightly-x32.conf | 1 + buildset-config.controller/nightly-x86-64-lsb.conf | 1 + buildset-config.controller/nightly-x86-64.conf | 1 + buildset-config.controller/nightly-x86-lsb.conf | 1 + buildset-config.controller/nightly-x86.conf | 1 + buildset-config.controller/nightly.conf | 1 + buildset-config.controller/poky-tiny.conf | 1 + buildset-config.examples/awesomefirmware.conf | 1 + buildset-config.freescale/nightly-fsl-arm-lsb.conf | 1 + buildset-config.freescale/nightly-fsl-arm.conf | 1 + buildset-config.freescale/nightly-fsl-ppc-lsb.conf | 1 + buildset-config.freescale/nightly-fsl-ppc.conf | 1 + buildset-config.iot-devkit/iot-devkit.conf | 1 + buildset-config.kernel/kernel-arm-lsb.conf | 1 + buildset-config.kernel/kernel-arm.conf | 1 + buildset-config.kernel/kernel-arm64.conf | 1 + buildset-config.kernel/kernel-mips-lsb.conf | 1 + buildset-config.kernel/kernel-mips.conf | 1 + buildset-config.kernel/kernel-ppc-lsb.conf | 1 + buildset-config.kernel/kernel-ppc.conf | 1 + buildset-config.kernel/kernel-x86-64-lsb.conf | 1 + buildset-config.kernel/kernel-x86-64.conf | 1 + buildset-config.kernel/kernel-x86-lsb.conf | 1 + buildset-config.kernel/kernel-x86.conf | 1 + buildset-config.kernel/nightly-kernel.conf | 1 + buildset-config.tizen/nightly-tizen-ivi.conf | 1 + buildset-config.tizen/nightly-tizen.conf | 1 + buildset-config.tizen/nightly.conf | 1 + .../autobuilder/buildsteps/BuildImages.py | 7 +- .../autobuilder/buildsteps/BuildToolchainImages.py | 7 +- .../autobuilder/buildsteps/DownloadErrorReports.py | 42 +++++++++ .../autobuilder/buildsteps/GetBitbakeVersion.py | 6 +- .../autobuilder/buildsteps/RunESDKSanityTests.py | 6 +- .../autobuilder/buildsteps/RunOeSelftest.py | 46 +++++++++ .../autobuilder/buildsteps/RunSDKSanityTests.py | 6 +- .../autobuilder/buildsteps/RunSanityTests.py | 6 +- .../autobuilder/buildsteps/SendErrorReport.py | 16 ++-- .../site-packages/autobuilder/lib/ABTools.py | 59 ++++++++++++ .../site-packages/autobuilder/lib/buildsteps.py | 104 +++++++++++++++++++++ .../buildbot/steps/transfer.py | 86 ++++++++++++++++- .../buildslave/commands/registry.py | 1 + .../buildslave/commands/transfer.py | 79 ++++++++++++++++ 72 files changed, 509 insertions(+), 24 deletions(-) create mode 100644 lib/python2.7/site-
packages/autobuilder/buildsteps/DownloadErrorReports.py