Skip to contentSkip to conversation

Yocto 1.7_M4.rc3 Full Pass report

DISCUSSION Georgescu, Alexandru C 1 participant 2 messages Oct 9, 2014 1 message not in the archive

lore
Share & tools
lore

A message that is not in the archive (sent off-list or not yet received): D05C4666.BBCC%[email protected]

#1 lore raw

Hello,
Here is the Full Pass test report for Yocto 1.7_M4.rc3 build.

Status summary:

  *   #6810<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6810> - Mouse does not work in X window for all QEMU images.
  *   #6815<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6815> – On Ubuntu Host, X doesn’t show up for QEMUPPC
  *   #6793<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6793> - Configure fail using adt-installer on sudoku-savant because of wrong SDKTARGETSYSROOT
  *   #6613<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6613> - C++ compiler does not work for ppce500v2 cross toolchain was reopened. #6766 was fixed but still remains for ppce500v2
  *   All buildsets were built successfully on Distro testing, with #6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811> and #<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>6812<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6812> sanity tests failed (new dmesg errors found)
  *   On Build performance side<https://wiki.yoctoproject.org/charts/perf_milestone/performance_test.html>, building kernel takes by 20 seconds longer on average for both hosts, very possible a result of the kernel upgrade to 3.17. The rootfs build time remained the same around 4:18 and 4:14 for Fedora and Ubuntu hosts. Building a sato image (with rmwork enabled) improved by 40 seconds on Fedora machine (1:10:57) and decreased by 15 seconds on Ubuntu machine (1:09:01) on average.

Issue summary can be found below and as reference, the full pass report is available here: https://wiki.yoctoproject.org/wiki/WW40_-_2014-10-02_-_Full_Pass_-_1.7_M4.rc3.

Testing data

Test type: Full Pass Release Test
Branch: master
Build name: 1.7_M4.rc3
poky commit: 5367855fe56db0c09b8fa7bb423b9de18d11eecc
Eclipse Plugin commit Kepler: 4a167fd662262ebdaa3cf0d332ac0debb52d7904 Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/releases/yocto-1.7.rc3/
Distributions tested: Ubuntu 14.04 64bit, Fedora 20 64bit, Opensuse 13.1 64bit, CentOS 6.5 64 bit

Summary Report
Testing Summary Report

Test Run Test Plan Environment Passed Other issues Failed Failing bugs Blocked Blocking bugs Complete
2976<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2976> 2975<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2975> ADT: master branch Fedora 20 x86_64 72.0% 6793<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6793> 6.8% 6613<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6613> 21.2% 6793<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6793> 100.0%

2979<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2979>     BSP/QEMU: master branch Beaglebone Black        100.0%  none    0.0%    none    0.0%    none    100.0%
2978<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2978>     BSP/QEMU: master branch EdgeRouter      97.6%   none    2.4%    6820<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6820>    0.0%    none    100.0%
2971<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2971>     BSP/QEMU: master branch generic-x86 on Atom N2600       100.0%  none    0.0%    none    0.0%    none    100.0%
2967<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2967>     BSP/QEMU: master branch generic-x86 on AtomPC   97.4%   none    2.6%    6814<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6814>    0.0%    none    100.0%
2970<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2970>     BSP/QEMU: master branch genericx86-64 on NUC    97.7%   none    2.3%    6583<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6583>    0.0%    none    100.0%
2939<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2939> 2962<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2962> BSP/QEMU: master branch qemu-x86        96.7%   none    3.3%    6810<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6810> 6812<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6812>       0.0%    none    100.0%
2941<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2941> 2964<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2964> BSP/QEMU: master branch qemuarm 98.4%   none    1.6%    6810<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6810>    0.0%    none    100.0%
2942<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2942> 2961<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2961> BSP/QEMU: master branch qemumips        96.7%   none    3.3%    6810<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6810> 6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>       0.0%    none    100.0%
2943<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2943> 2965<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2965>2974<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2974>      BSP/QEMU: master branch qemuppc 77.9%   none    2.6%    6810<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6810> 6815<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6815>       19.5%   6815<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6815>    100.0%
2940<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2940> 2963<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2963> BSP/QEMU: master branch qemux86-64      96.7%   none    3.3%    6810<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6810> 6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>       0.0%    none    100.0%
2977<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2977>     Eclipse Plugin: master branch   Fedora 20 x86_64        87.9%   none    0.0%    none    12.1%   6766<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6766>    100.0%
2946<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2946> 2947<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2947> Meta-yocto: master branch       Ubuntu 14.04 x86_64     100.0%  6162<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6162>    0.0%    none    0.0%    none    100.0%
2944<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2944> 2952<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2952> Hob: master branch      Ubuntu 14.04 x86_64     97.8%   none    0.0%    none    2.2%    none    100.0%
2972<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2972>     Toaster: master branch  Fedora 20 x86_64        96.7%   none    3.3%    6684<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6684>    0.0%    none    100.0%
2960<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2960>     Toaster: master branch  Ubuntu 14.04 LTS x86_64 81.0%   none    19.0%   5187<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5187> 6681<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6681> 6800<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6800> 6799<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6799> 6802<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6802>5844<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5844> 6801<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6801> 6688<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6688>  0.0%    none    100.0%
2953<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2953> 2954<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2954> OE-Core: master branch  Ubuntu 14.04 x86_64     93.1%   none    6.9%    6804<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6804>    0.0%    none    100.0%
2948<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2948> 2949<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2949> BitBake: master branch  Ubuntu 14.04 x86_64     91.9%   6752<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6752>    5.4%    6752<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6752>    2.7%    none    100.0%
2968<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2968>     Runtime: master branch  Multiple Environments   100.0%  none    0.0%    none    0.0%    none    100.0%
2973<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2973>     Build Appliance: master branch  VMWare Player on Fedora 20 64bit        100.0%  none    0.0%    none    0.0%    none    100.0%

Total: 20

Test Case Status Report

Status Count
BLOCKED 46

FAILED  33
PASSED  826
PAUSED  3
Total: 908
        [http://chart.apis.google.com/chart?cht=p3&chs=432x120&chd=t:&chd=t:46,33,826,3&chco=FFFF66|FF9933|00FF00|3366FF&chl=BLOCKED(46)+5%|FAILED(33)+4%|PASSED(826)+91%|PAUSED(3)+0%]

Bug Status Report

[Bug Status]

ID[?]<https://wiki.yoctoproject.org/wiki/WW40_-_2014-10-02_-_Full_Pass_-_1.7_M4.rc3#> Priority[?]<https://wiki.yoctoproject.org/wiki/WW40_-_2014-10-02_-_Full_Pass_-_1.7_M4.rc3#> Status[?]<https://wiki.yoctoproject.org/wiki/WW40_-_2014-10-02_-_Full_Pass_-_1.7_M4.rc3#> Resolution[?]<https://wiki.yoctoproject.org/wiki/WW40_-_2014-10-02_-_Full_Pass_-_1.7_M4.rc3#> Test Runs[?]<https://wiki.yoctoproject.org/wiki/WW40_-_2014-10-02_-_Full_Pass_-_1.7_M4.rc3#> Description[?]<https://wiki.yoctoproject.org/wiki/WW40_-_2014-10-02_-_Full_Pass_-_1.7_M4.rc3#> Version[?]<https://wiki.yoctoproject.org/wiki/WW40_-_2014-10-02_-_Full_Pass_-_1.7_M4.rc3#> Target Milestone[?]<https://wiki.yoctoproject.org/wiki/WW40_-_2014-10-02_-_Full_Pass_-_1.7_M4.rc3#> Age (days)[?]<https://wiki.yoctoproject.org/wiki/WW40_-_2014-10-02_-_Full_Pass_-_1.7_M4.rc3#>

5187<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5187>    Medium  ACCEPTED                2960<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2960>     same cooker log file name used for several builds       unspecified     1.8     384
5844<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5844>    Medium  ACCEPTED                2960<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2960>     Wrong script_type when task is not executed.    unspecified     1.7 M4  226
6162<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6162>    Medium+ REOPENED                2947<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2947>     linux-yocto failed to do_patch after add a patch by yocto-kernel tool   1.6     1.7     170
6583<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6583>    Medium  IN PROGRESS REVIEW              2970<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2970>     [Test Case 972] Xorg log: Failed to load module "present"       1.7     1.7 M4  66
6613<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6613>    Medium  REOPENED                2976<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2976>     C++ compiler does not work for ppce500v2 cross toolchain        1.7     1.7     57
6681<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6681>    Medium  NEW             2960<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2960>     Check if the number of errors from Build table matches the number of level entries with value 2 from LogMessage table.  1.7     1.7 M4  28
6684<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6684>    Medium  NEW             2972<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2972>     The content of the license column shouldn't be 4.0k.    1.7     1.7 M4  27
6688<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6688>    Medium  NEW             2960<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2960>     Build image using managed mode - Toaster web interface tries to load from address http://0.0.0.0:8000   1.7     1.8     27
6752<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6752>    Medium  NEW             2948<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2948>     bitbake-prserv-tool has issues when it comes to exporting the PR database       1.7     1.7 M4  9
6766<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6766>    High    RESOLVED        FIXED   2977<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2977>     adt installed toolchain compilation error under ALL ARCHs with build yocto_1.7.rc1      1.7     1.7 M4  6 (Recent)
6793<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6793>    Medium+ RESOLVED        FIXED   2976<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2976>     configure fail using adt-installer on sudoku-savant because of wrong SDKTARGETSYSROOT   1.7     1.7 M4  NEW
6799<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6799>    Undecided       NEW             2960<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2960>     cpu_usage value 0 for tasks with outcome=0      1.7     ---     NEW
6800<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6800>    Undecided       NEW             2960<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2960>     elapsed_time value null for tasks with outcome=0        1.7     ---     NEW
6801<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6801>    Undecided       RESOLVED        NOTABUG 2960<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2960>     Toaster UI - create project doesn't work        1.7     ---     NEW
6802<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6802>    Undecided       NEW             2960<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2960>     Lots of empty fields in the database.   1.7     ---     NEW
6804<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6804>    Undecided       NEW             2954<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2954>     do_rootfs fails for btrfs image build   1.7     ---     NEW
6810<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6810>    High    IN PROGRESS IMPLEMENTATION              2942<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2942> 2940<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2940> 2943<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2943> 2941<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2941>2939<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2939>      Mouse does not work in X window 1.7     1.7 M4  NEW
6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>    Undecided       NEW             2961<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2961> 2963<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2963> usbhid: probe of 1-1:1.0 failed with error -32  1.7     ---     NEW
6812<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6812>    Undecided       NEW             2962<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2962>     uvesafb errors in dmesg for qemux86     1.7     ---     NEW
6814<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6814>    Undecided       NEW             2967<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2967>     rpm log file size stays the same no matter what 1.7     ---     NEW
6815<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6815>    Undecided       NEW             2974<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2974>     Yocto image qemuppc do not boot and OS not load 1.7     ---     NEW
6820<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6820>    Undecided       NEW             2978<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2978>     dmesg err in BeagleBone Black   unspecified     ---     NEW

Total: 22

Distro Testing

Distro Testing is intended to catch bugs that are distribution specific using the yocto-autobuilder. The tests are all run on identical hardware and with all OS-es updated. The distributions used will be Fedora, Ubuntu, CentOS, OpenSuse with their latest update. More details on the coverage for the Distro testing is available here at Distribution_Support#Distro_Testing<https://wiki.yoctoproject.org/wiki/Distribution_Support#Distro_Testing> wiki.

Summary

At this point all buildsets are fine, exepting the dmesg errors in qemu found by the sanity tests: [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>] and [6812<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]

Distro Results
BRANCH master
COMMIT Poky: 5367855fe56db0c09b8fa7bb423b9de18d11eecc RELEASE 1.7_M4.rc3
Ubuntu 14.04 LTS
• nighlty-world PASS
• buildtools PASS
• nightly-arm PASS
• nightly-multilib PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]
• nightly-qa-systemd PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]
• nightly-x86 PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]
• nightly-x86-64 PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]
• nightly-x86-64-lsb PASS

Fedora 20
• nighlty-world PASS
• buildtools PASS
• nightly-arm PASS
• nightly-multilib PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]
• nightly-qa-systemd PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]
• nightly-x86 PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]
• nightly-x86-64 PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]
• nightly-x86-64-lsb PASS

CentOS 6.5
• nighlty-world PASS
• buildtools PASS
• nightly-arm PASS
• nightly-multilib PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]
• nightly-qa-systemd PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]
• nightly-x86 PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]
• nightly-x86-64 PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]
• nightly-x86-64-lsb PASS

OpenSuse 13.1
• nighlty-world PASS
• buildtools PASS
• nightly-arm PASS
• nightly-multilib PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]
• nightly-qa-systemd PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]
• nightly-x86 PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]
• nightly-x86-64 PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>] - [6812<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]
• nightly-x86-64-lsb PASS

Build Performance Test

Detailed description on how performance test are run can be found on Performance Test<https://wiki.yoctoproject.org/wiki/Performance_Test> wiki. The below charts are displaying the build performance trend for 1.7 by milestone starting 1.6 on Master. The charts by Milestone can be accessed at this link<https://wiki.yoctoproject.org/charts/perf_milestone/performance_test.html> where you can view more detailed information or by clicking on the images which will open a new window with the interactive chart.

As a status, building kernel takes by 20 seconds longer on average for both hosts, very possible a result of the kernel upgrade to 3.17. The rootfs build time remained the same around 4:18 and 4:14 for Fedora and Ubuntu hosts. Building a sato image (with rmwork enabled) improved by 40 seconds on Fedora machine (1:10:57) and decreased by 15 seconds on Ubuntu machine (1:09:01) on average.

As a QA point of view, for the latter there is no great change in the build performance results to be a concern for the release candidate.

Performance Charts

For Bitbake core-image-sato with rm_work

[Ww40 - rmwork.png]<https://wiki.yoctoproject.org/charts/perf_milestone/bitbake-core-image-sato-rmwork.html>

Building the Virtual kernel

[Ww40 - kernel.png]<https://wiki.yoctoproject.org/charts/perf_milestone/bitbake-virtual-kernel.html>

Building the rootfs

[Ww40 - rootfs.png]<https://wiki.yoctoproject.org/charts/perf_milestone/bitbake-core-image-sato-rootfs.html>

Regards,
--
Alexandru Georgescu
Yocto QA Engineer
SSG/SSD Open Source Technology Center Romania

#2 lore raw
In reply to a message not in the archive

The formatting gone wild so resending ...

Status summary:

  *   #6810<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6810> - Mouse does not work in X window for all QEMU images.
  *   #6815<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6815> - On Ubuntu Host, X doesn't show up for QEMUPPC
  *   #6793<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6793> - Configure fail using adt-installer on sudoku-savant because of wrong SDKTARGETSYSROOT
  *   #6613<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6613> - C++ compiler does not work for ppce500v2 cross toolchain was reopened. #6766 was fixed but still remains for ppce500v2
  *   All buildsets were built successfully on Distro testing, with #6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811> and #6812<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6812> sanity tests failed (new dmesg errors found)
  *   On Build performance side<https://wiki.yoctoproject.org/charts/perf_milestone/performance_test.html>, building kernel takes by 20 seconds longer on average for both hosts, very possible a result of the kernel upgrade to 3.17. The rootfs build time remained the same around 4:18 and 4:14 for Fedora and Ubuntu hosts. Building a sato image (with rmwork enabled) improved by 40 seconds on Fedora machine (1:10:57) and decreased by 15 seconds on Ubuntu machine (1:09:01) on average.

Issue summary can be found below and as reference, the full pass report is available here: https://wiki.yoctoproject.org/wiki/WW40_-_2014-10-02_-_Full_Pass_-_1.7_M4.rc3.

Testing data

Test type: Full Pass Release Test

Branch: master

Build name: 1.7_M4.rc3

poky commit: 5367855fe56db0c09b8fa7bb423b9de18d11eecc

Eclipse Plugin commit Kepler: 4a167fd662262ebdaa3cf0d332ac0debb52d7904

Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/releases/yocto-1.7.rc3/

Distributions tested: Ubuntu 14.04 64bit, Fedora 20 64bit, Opensuse 13.1 64bit, CentOS 6.5 64 bit

Summary Report
Testing Summary Report

Test Run

Test Plan

Environment

Passed

Other issues

Failed

Failing bugs

Blocked

Blocking bugs

Complete

2976<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2976> 2975<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2975>

ADT: master branch

Fedora 20 x86_64

72.0%

6793<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6793>

6.8%

6613<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6613>

21.2%

6793<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6793>

100.0%

2979<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2979>

BSP/QEMU: master branch

Beaglebone Black

100.0%

none

0.0%

none

0.0%

none

100.0%

2978<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2978>

BSP/QEMU: master branch

EdgeRouter

97.6%

none

2.4%

6820<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6820>

0.0%

none

100.0%

2971<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2971>

BSP/QEMU: master branch

generic-x86 on Atom N2600

100.0%

none

0.0%

none

0.0%

none

100.0%

2967<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2967>

BSP/QEMU: master branch

generic-x86 on AtomPC

97.4%

none

2.6%

6814<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6814>

0.0%

none

100.0%

2970<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2970>

BSP/QEMU: master branch

genericx86-64 on NUC

97.7%

none

2.3%

6583<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6583>

0.0%

none

100.0%

2939<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2939> 2962<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2962>

BSP/QEMU: master branch

qemu-x86

96.7%

none

3.3%

6810<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6810> 6812<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6812>

0.0%

none

100.0%

2941<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2941> 2964<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2964>

BSP/QEMU: master branch

qemuarm

98.4%

none

1.6%

6810<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6810>

0.0%

none

100.0%

2942<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2942> 2961<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2961>

BSP/QEMU: master branch

qemumips

96.7%

none

3.3%

6810<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6810> 6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>

0.0%

none

100.0%

2943<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2943> 2965<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2965>2974<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2974>

BSP/QEMU: master branch

qemuppc

77.9%

none

2.6%

6810<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6810> 6815<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6815>

19.5%

6815<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6815>

100.0%

2940<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2940> 2963<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2963>

BSP/QEMU: master branch

qemux86-64

96.7%

none

3.3%

6810<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6810> 6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>

0.0%

none

100.0%

2977<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2977>

Eclipse Plugin: master branch

Fedora 20 x86_64

87.9%

none

0.0%

none

12.1%

6766<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6766>

100.0%

2946<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2946> 2947<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2947>

Meta-yocto: master branch

Ubuntu 14.04 x86_64

100.0%

6162<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6162>

0.0%

none

0.0%

none

100.0%

2944<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2944> 2952<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2952>

Hob: master branch

Ubuntu 14.04 x86_64

97.8%

none

0.0%

none

2.2%

none

100.0%

2972<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2972>

Toaster: master branch

Fedora 20 x86_64

96.7%

none

3.3%

6684<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6684>

0.0%

none

100.0%

2960<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2960>

Toaster: master branch

Ubuntu 14.04 LTS x86_64

81.0%

none

19.0%

5187<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5187> 6681<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6681> 6800<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6800> 6799<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6799> 6802<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6802>5844<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5844> 6801<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6801> 6688<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6688>

0.0%

none

100.0%

2953<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2953> 2954<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2954>

OE-Core: master branch

Ubuntu 14.04 x86_64

93.1%

none

6.9%

6804<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6804>

0.0%

none

100.0%

2948<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2948> 2949<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2949>

BitBake: master branch

Ubuntu 14.04 x86_64

91.9%

6752<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6752>

5.4%

6752<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6752>

2.7%

none

100.0%

2968<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2968>

Runtime: master branch

Multiple Environments

100.0%

none

0.0%

none

0.0%

none

100.0%

2973<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2973>

Build Appliance: master branch

VMWare Player on Fedora 20 64bit

100.0%

none

0.0%

none

0.0%

none

100.0%

Total: 20

Test Case Status Report

Status

Count

BLOCKED

46

FAILED

33

PASSED

826

PAUSED

3

Total: 908

[http://chart.apis.google.com/chart?cht=p3&chs=432x120&chd=t:&chd=t:46,33,826,3&chco=FFFF66|FF9933|00FF00|3366FF&chl=BLOCKED(46)+5%25|FAILED(33)+4%25|PASSED(826)+91%25|PAUSED(3)+0%25]

Bug Status Report

[Bug Status]

ID[?]<https://wiki.yoctoproject.org/wiki/WW40_-_2014-10-02_-_Full_Pass_-_1.7_M4.rc3>

Priority[?]<https://wiki.yoctoproject.org/wiki/WW40_-_2014-10-02_-_Full_Pass_-_1.7_M4.rc3>

Status[?]<https://wiki.yoctoproject.org/wiki/WW40_-_2014-10-02_-_Full_Pass_-_1.7_M4.rc3>

Resolution[?]<https://wiki.yoctoproject.org/wiki/WW40_-_2014-10-02_-_Full_Pass_-_1.7_M4.rc3>

Test Runs[?]<https://wiki.yoctoproject.org/wiki/WW40_-_2014-10-02_-_Full_Pass_-_1.7_M4.rc3>

Description[?]<https://wiki.yoctoproject.org/wiki/WW40_-_2014-10-02_-_Full_Pass_-_1.7_M4.rc3>

Version[?]<https://wiki.yoctoproject.org/wiki/WW40_-_2014-10-02_-_Full_Pass_-_1.7_M4.rc3>

Target Milestone[?]<https://wiki.yoctoproject.org/wiki/WW40_-_2014-10-02_-_Full_Pass_-_1.7_M4.rc3>

Age (days)[?]<https://wiki.yoctoproject.org/wiki/WW40_-_2014-10-02_-_Full_Pass_-_1.7_M4.rc3>

5187<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5187>

Medium

ACCEPTED

2960<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2960>

same cooker log file name used for several builds

unspecified

1.8

384

5844<https://bugzilla.yoctoproject.org/show_bug.cgi?id=5844>

Medium

ACCEPTED

2960<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2960>

Wrong script_type when task is not executed.

unspecified

1.7 M4

226

6162<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6162>

Medium+

REOPENED

2947<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2947>

linux-yocto failed to do_patch after add a patch by yocto-kernel tool

1.6

1.7

170

6583<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6583>

Medium

IN PROGRESS REVIEW

2970<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2970>

[Test Case 972] Xorg log: Failed to load module "present"

1.7

1.7 M4

66

6613<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6613>

Medium

REOPENED

2976<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2976>

C++ compiler does not work for ppce500v2 cross toolchain

1.7

1.7

57

6681<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6681>

Medium

NEW

2960<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2960>

Check if the number of errors from Build table matches the number of level entries with value 2 from LogMessage table.

1.7

1.7 M4

28

6684<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6684>

Medium

NEW

2972<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2972>

The content of the license column shouldn't be 4.0k.

1.7

1.7 M4

27

6688<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6688>

Medium

NEW

2960<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2960>

Build image using managed mode - Toaster web interface tries to load from address http://0.0.0.0:8000

1.7

1.8

27

6752<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6752>

Medium

NEW

2948<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2948>

bitbake-prserv-tool has issues when it comes to exporting the PR database

1.7

1.7 M4

9

6766<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6766>

High

RESOLVED

FIXED

2977<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2977>

adt installed toolchain compilation error under ALL ARCHs with build yocto_1.7.rc1

1.7

1.7 M4

6 (Recent)

6793<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6793>

Medium+

RESOLVED

FIXED

2976<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2976>

configure fail using adt-installer on sudoku-savant because of wrong SDKTARGETSYSROOT

1.7

1.7 M4

NEW

6799<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6799>

Undecided

NEW

2960<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2960>

cpu_usage value 0 for tasks with outcome=0

1.7

---

NEW

6800<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6800>

Undecided

NEW

2960<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2960>

elapsed_time value null for tasks with outcome=0

1.7

---

NEW

6801<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6801>

Undecided

RESOLVED

NOTABUG

2960<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2960>

Toaster UI - create project doesn't work

1.7

---

NEW

6802<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6802>

Undecided

NEW

2960<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2960>

Lots of empty fields in the database.

1.7

---

NEW

6804<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6804>

Undecided

NEW

2954<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2954>

do_rootfs fails for btrfs image build

1.7

---

NEW

6810<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6810>

High

IN PROGRESS IMPLEMENTATION

2942<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2942> 2940<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2940> 2943<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2943> 2941<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2941>2939<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2939>

Mouse does not work in X window

1.7

1.7 M4

NEW

6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>

Undecided

NEW

2961<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2961> 2963<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2963>

usbhid: probe of 1-1:1.0 failed with error -32

1.7

---

NEW

6812<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6812>

Undecided

NEW

2962<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2962>

uvesafb errors in dmesg for qemux86

1.7

---

NEW

6814<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6814>

Undecided

NEW

2967<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2967>

rpm log file size stays the same no matter what

1.7

---

NEW

6815<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6815>

Undecided

NEW

2974<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2974>

Yocto image qemuppc do not boot and OS not load

1.7

---

NEW

6820<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6820>

Undecided

NEW

2978<https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=2978>

dmesg err in BeagleBone Black

unspecified

---

NEW

Total: 22

Distro Testing

Distro Testing is intended to catch bugs that are distribution specific using the yocto-autobuilder. The tests are all run on identical hardware and with all OS-es updated. The distributions used will be Fedora, Ubuntu, CentOS, OpenSuse with their latest update. More details on the coverage for the Distro testing is available here at Distribution_Support#Distro_Testing<https://wiki.yoctoproject.org/wiki/Distribution_Support#Distro_Testing> wiki.

Summary

At this point all buildsets are fine, exepting the dmesg errors in qemu found by the sanity tests: [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>] and [6812<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]

Distro Results
BRANCH

master

COMMIT

Poky: 5367855fe56db0c09b8fa7bb423b9de18d11eecc

RELEASE

1.7_M4.rc3

Ubuntu 14.04 LTS

* nighlty-world

PASS

* buildtools

PASS

* nightly-arm

PASS

* nightly-multilib

PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]

* nightly-qa-systemd

PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]

* nightly-x86

PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]

* nightly-x86-64

PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]

* nightly-x86-64-lsb

PASS

Fedora 20

* nighlty-world

PASS

* buildtools

PASS

* nightly-arm

PASS

* nightly-multilib

PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]

* nightly-qa-systemd

PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]

* nightly-x86

PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]

* nightly-x86-64

PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]

* nightly-x86-64-lsb

PASS

CentOS 6.5

* nighlty-world

PASS

* buildtools

PASS

* nightly-arm

PASS

* nightly-multilib

PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]

* nightly-qa-systemd

PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]

* nightly-x86

PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]

* nightly-x86-64

PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]

* nightly-x86-64-lsb

PASS

OpenSuse 13.1

* nighlty-world

PASS

* buildtools

PASS

* nightly-arm

PASS

* nightly-multilib

PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]

* nightly-qa-systemd

PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]

* nightly-x86

PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]

* nightly-x86-64

PASS - [6811<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>] - [6812<https://bugzilla.yoctoproject.org/show_bug.cgi?id=6811>]

* nightly-x86-64-lsb

PASS

Build Performance Test

Detailed description on how performance test are run can be found on Performance Test<https://wiki.yoctoproject.org/wiki/Performance_Test> wiki. The below charts are displaying the build performance trend for 1.7 by milestone starting 1.6 on Master. The charts by Milestone can be accessed at this link<https://wiki.yoctoproject.org/charts/perf_milestone/performance_test.html> where you can view more detailed information or by clicking on the images which will open a new window with the interactive chart.

As a status, building kernel takes by 20 seconds longer on average for both hosts, very possible a result of the kernel upgrade to 3.17. The rootfs build time remained the same around 4:18 and 4:14 for Fedora and Ubuntu hosts. Building a sato image (with rmwork enabled) improved by 40 seconds on Fedora machine (1:10:57) and decreased by 15 seconds on Ubuntu machine (1:09:01) on average.

As a QA point of view, for the latter there is no great change in the build performance results to be a concern for the release candidate.

Performance Charts

For Bitbake core-image-sato with rm_work

[Ww40 - rmwork.png]<https://wiki.yoctoproject.org/charts/perf_milestone/bitbake-core-image-sato-rmwork.html>

Building the Virtual kernel

[Ww40 - kernel.png]<https://wiki.yoctoproject.org/charts/perf_milestone/bitbake-virtual-kernel.html>

Building the rootfs

[Ww40 - rootfs.png]<https://wiki.yoctoproject.org/charts/perf_milestone/bitbake-core-image-sato-rootfs.html>

Regards,
--
Alexandru Georgescu
Yocto QA Engineer
SSG/SSD Open Source Technology Center Romania