Skip to contentSkip to conversation

The Linux Test Project has been released for JANUARY 2020

ANNOUNCE Cyril Hrubis 1 participant 1 message Jan 20, 2020

lore
Share & tools
lore
#0 lore raw

Good news everyone,

the Linux Test Project test suite stable release for *January 2020* has been released.

Since the last release 195 patches by 31 authors were merged.

NOTABLE CHANGES
===============

* New tests
- vmsplice03 (splicing pipe to user memory)
- prctl08, prctl09 (PR_{SET,GET}_TIMERSLACK)

* New regression tests
- bpf_prog03

* Increased coverage
- quotactl tests were rewritten and coverage was increased

* Additional 19 tests were converted to the new test library

* Removed tests
- TI-RPC authdes related tests (authdes is disabled by default since libtirpc 1.2.5)
- openposix/pi_test*
- ext4 features tests
(the interesting bits are being moved to xfstests
https://patchwork.kernel.org/patch/11290345/)

* Our Travis now includes native ppc64le and s390x builds

* Improved musl support, build with musl in Travis CI using Alpine Linux (broken tests are documented in Travis build script travis/alpine.sh)

* Regression tests now print possibly missing kernel commits:

    --------------------------------------------------------------------------
    snd_timer01.c:134: FAIL: kernel seems vulnerable

    HINT: You _MAY_ be missing kernel fixes, see:

    https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=d11662f4f798
    https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=ba3021b2c79b

    HINT: You _MAY_ be vulnerable to CVE(s), see:

    https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2017-1000380

    Summary:
    passed   0
    failed   1
    skipped  0
    warnings 0
    --------------------------------------------------------------------------

+ The usual amount of fixes and cleanups.

METADATA EXTRACTION & TEST CATALOGUE
====================================

There is an ongoing experiment that attempts to extract metadata[1] from the testcases, we also have a proof of concept web page that renders the json metadata into a browseable test documentation[2]. There is not much there yet, but we are hoping, among other things, to build a nice, searchable and browseable test catalogue based on these efforts.

[1] https://github.com/metan-ucw/ltp/tree/master/docparse
[2] http://metan.ucw.cz/outgoing/metadata.html
http://metan.ucw.cz/outgoing/metadata.html?test=abort01
http://metan.ucw.cz/outgoing/metadata.html?test=pcrypt_aead01

NOTABLE CHANGES IN NETWORK TESTS
================================
brought to you by Petr Vorel

* iptables: add new test for iptables-translate and nft, add IPv6 support
* route: rewrite route change destination, gateway and interface tests into new API

DOWNLOAD AND LINKS
==================

The latest version of the test-suite contains 3000+ tests for the Linux and can be downloaded at:

https://github.com/linux-test-project/ltp/releases/tag/20190930

The project pages as well as GIT repository are hosted on GitHub:

https://github.com/linux-test-project/ltp
http://linux-test-project.github.io/

If you ever wondered how to write a LTP testcase, don't miss our developer documentation at:

https://github.com/linux-test-project/ltp/wiki/C-Test-Case-Tutorial
https://github.com/linux-test-project/ltp/wiki/Test-Writing-Guidelines
https://github.com/linux-test-project/ltp/wiki/BuildSystem

Patches, new tests, bugs, comments or questions should go to to our mailing list at [email protected].

CREDITS
=======

Many thanks to the people contributing to this release:

git shortlog -s -e -n 20190930..

    45  Petr Vorel <[email protected]>
    22  Jan Stancek <[email protected]>
    22  Yang Xu <[email protected]>
    13  Cyril Hrubis <[email protected]>
    13  Petr Vorel <[email protected]>
    11  Li Wang <[email protected]>
    10  Joerg Vehlow <[email protected]>
    10  Martin Doucha <[email protected]>
     7  Alexey Kodanev <[email protected]>
     6  Clemens Famulla-Conrad <[email protected]>
     5  Xiao Yang <[email protected]>
     3  Feiyu Zhu <[email protected]>
     2  Jorik Cronenberg <[email protected]>
     2  Pengfei Xu <[email protected]>
     2  Ping Fang <[email protected]>
     2  Richard Palethorpe <[email protected]>
     1  Cai Zhenglong <[email protected]>
     1  Dylan Chung <[email protected]>
     1  Eric Lin <[email protected]>
     1  Fabrice Fontaine <[email protected]>
     1  He Zhe <[email protected]>
     1  Ivan Hu <[email protected]>
     1  Ma Feng <[email protected]>
     1  Mathias Fiedler <[email protected]>
     1  Rachel Sibley <[email protected]>
     1  Song Jian <[email protected]>
     1  Sultan Alsawaf <[email protected]>
     1  Xiang Li <[email protected]>
     1  Yi Zhao <[email protected]>
     1  Yongxin Liu <[email protected]>
     1  Zou Wei <[email protected]>

And also thanks to patch reviewers:

git log 20190930.. | grep -Ei '(reviewed|acked)-by:' | sed 's/.*by: //' | sort | uniq -c | sort -n -r
76 Cyril Hrubis <[email protected]>
46 Petr Vorel <[email protected]>
28 Li Wang <[email protected]>
19 Jan Stancek <[email protected]>
9 Alexey Kodanev <[email protected]>
5 Clemens Famulla-Conrad <[email protected]>
4 Richard Palethorpe <[email protected]>
3 Yang Xu <[email protected]>
1 Thadeu Lima de Souza Cascardo <[email protected]>
1 Sumit Garg <[email protected]>
1 Steve Dickson <[email protected]>
1 Petr Vorel <[email protected]>
1 Joerg Vehlow <[email protected]>
1 Amir Goldstein <[email protected]>

Signature · 2 lines
Cyril Hrubis
[email protected]