The Linux Test Project has been released for SEPTEMBER 2024
Good news everyone,
the Linux Test Project test suite stable release for *September 2024* has been released.
Since the last release 266 patches by 47 authors were merged.
Patch review is what most of the projects struggle with and LTP is no different. If you can spare some effort helping with the patch review is more than welcomed.
NOTABLE CHANGES
===============
* New tests
- chown09 regression test for 5d1f903f75a8 ("attr: block mode changes of symlinks")
- request_key06 Negative tests for request_key() syscall
- signalfd02 Negative tests for signalfd() syscall
- mseal02 Negative tests for mseal() syscall
- hugeshmget06 A hugepage shm test
- landlock07 Landlock Houdini reproducer aka CVE-2024-42318
- getcpu02 Negative tests for getcpu() syscall
- landlock06 Tests for LANDLOCK_ACCESS_FS_IOCTL_DEV
- landlock05 Tests for LONDLOCK_ACCESS_FS_REFER
- landlock04 Tests that syscalls are enabled/disable accordingly to the ruleset
- landlock03 Negative tests for landlock_restrict_self() syscall
- landlock02 Negative tests for landlock_add_rule() syscall
- landlock01 Negative tests for landlock_create_ruleset() syscall
- mseal01 Tests that memory is protected from being changed after it's sealed
- fchmodat2_02 Negative tests for fchmodat2()
- fchmodat2_01 Tests for AT_SYMLINK_NOFOLLOW for fchmodat2()
- cachestat04 Checks that cachestat() syscall either reports EBADF or zeroed statistics on all kinds of unsupported fds
- cachestat03 Negative tests for cachestat() syscall
- cachestat02 Basic cachestat tests with fd pointing to shared memory
- cachestat01 Basic cachestat tests for regular files
- shutdown01 Basic shutdown tests
- shutdown02 Negative tests for shutdown() sycall
* The symlink01 mess is being split into separate testcases
- open15 A test that open() syscall works correctly with symlinks
- lstat03 A basic lstat() test.
- rename15 Tests that rename works correctly with symlinks
- chmod08 Tests that chmod() works correctly with symlinks
* Increased coverage
- readdir and getdents tests were enabled to run on all supported filesystems after we found that bcachefs had sublty broken implementation
- gedent02 Adds more negative tests
- timer_settime01 Now checks for premature timer expiration as well
- pkey01 Now includes tests for PKEY_DISABLE_EXECUTE
- request_key01 Added more negative tests
- acct02 Added more negative tests
- prctl04 has been renamed to seccomp01 and now covers also the seccomp() syscall along with the older prctl(PR_SET_SECCOMP) calls
- msync04 now uses direct I/O to verify that data have been written to disk
* Rewritten tests
- fork05 was rewritten and correctly reports TCONF on non i386 hardware
- fcnt14 a file locking test was rewriten to generate subtests at runtime
- sched_starvation now autocallibrates expected runtime based on CPU speed
- sched_footbal was rewritten and is now executed as part of the sched runtest file
* The test library now supports specifying mkfs and mount options per a filesystem
* Bunch of checks for kernels older than 4.4 were removed from the tests since the currently minimal kernel version LTP supports is 4.4
* We have a new shell test library that:
- makes shell code seamlessly interoperable with C
- reuses most of the C test library
- makes use shared memory to report test results
- there are currently no tests using this library, we will start rewriting existing tests after the release
* 3 testcases were converted to the new test library
+ The usual amount of fixes and cleanups
REMOVED SCRIPTS AND FILES
=========================
- Removed old and outdated man pages.
- Removed ltpmenu an legacy script that was unmaintained for a decade.
NOTABLE CHANGES IN NETWORK TESTS
================================
brought to you by Petr Vorel
- nfsstat02.sh new test for per-NS NFS client statistics
(checks that /proc/net/rpc/nfs exists in nested network namespaces)
- nfsstat01.sh read client stats from netns rhost
(fix for kernel 6.9, backported up to 5.10 so far)
- nfs02.sh Added subtest for O_DIRECT
KIRK
====
- Kirk has been update to 1.4
- Kirk can now be installed from pypi
DOWNLOAD AND LINKS
==================
The latest version of the test-suite contains 3000+ tests for the Linux and can be downloaded at:
https://github.com/linux-test-project/ltp/releases/tag/20240930
The project pages as well as GIT repository are hosted on GitHub:
https://github.com/linux-test-project/ltp
If you ever wondered how to write a LTP testcase, don't miss our developer documentation at:
https://linux-test-project.readthedocs.io/en/latest/developers/test_case_tutorial.html
And our library API documentation at:
https://linux-test-project.readthedocs.io/en/latest/developers/api_c_tests.html
Patches, new tests, bugs, comments or questions should go to to our mailing list at [email protected].
CREDITS
=======
Many thanks to the people contributing to this release:
git shortlog -s -e -n 20240129..
233 Petr Vorel <[email protected]>
74 Andrea Cervesato <[email protected]>
39 Martin Doucha <[email protected]>
36 Li Wang <[email protected]>
25 Cyril Hrubis <[email protected]>
25 Yang Xu <[email protected]>
22 Xinjian Ma (Fujitsu) <[email protected]>
21 Wei Gao <[email protected]>
15 Andrea Manzini <[email protected]>
6 Avinesh Kumar <[email protected]>
6 Edward Liaw <[email protected]>
6 John Stultz <[email protected]>
4 Hui Min Mina Chou <[email protected]>
4 Jan Stancek <[email protected]>
3 Andreas Schwab <[email protected]>
3 Xiao Yang <[email protected]>
3 lufei <[email protected]>
2 Dennis Brendel <[email protected]>
2 Jiwei Sun <[email protected]>
2 Po-Hsu Lin <[email protected]>
1 Ajay Kaher <[email protected]>
1 Amir Goldstein <[email protected]>
1 Chen Haonan <[email protected]>
1 Chuck Lever <[email protected]>
1 Detlef Riekenberg via ltp <[email protected]>
1 Filippo Storniolo <[email protected]>
1 Haifeng Xu <[email protected]>
1 Jingyi Song <[email protected]>
1 Khem Raj <[email protected]>
1 Kuan-Ying Lee <[email protected]>
1 Li Xiaosong <[email protected]>
1 Madadi Vineeth Reddy <[email protected]>
1 Mete Durlu <[email protected]>
1 Murphy Zhou <[email protected]>
1 Nirjhar Roy <[email protected]>
1 Remi Peuvergne <[email protected]>
1 Sachin P Bappalige <[email protected]>
1 Samasth Norway Ananda <[email protected]>
1 Sebastian Chlad <[email protected]>
1 Sergey Ulanov via ltp <[email protected]>
1 Shiyang Ruan <[email protected]>
1 Shizhao Chen <[email protected]>
1 Wenjie Xu <[email protected]>
1 Xiangyu Chen <[email protected]>
1 Yiwei Lin <[email protected]>
1 Zizhi Wo <[email protected]>
1 yangfeng <[email protected]>
And also thanks to patch reviewers:
git log 20240129.. | grep -Ei '(reviewed|acked)-by:' | sed 's/.*by: //' | sort | uniq -c | sort -n -r
212 Petr Vorel <[email protected]>
181 Cyril Hrubis <[email protected]>
108 Li Wang <[email protected]>
39 Avinesh Kumar <[email protected]>
28 Andrea Cervesato <[email protected]> 16 Martin Doucha <[email protected]>
10 Jan Stancek <[email protected]>
6 Jan Kara <[email protected]>
4 Wei Gao <[email protected]>
4 Richard Palethorpe <[email protected]> 3 Marius Kittler <[email protected]>
3 Amir Goldstein <[email protected]> 2 Adrian Huang <[email protected]>
1 Vlastimil Babka <[email protected]>
1 Po-Hsu Lin <[email protected]> 1 Matt Bobrowski <[email protected]> 1 Kent Overstreet <[email protected]> 1 Joerg Vehlow <[email protected]>
Signature · 2 lines
Cyril Hrubis [email protected]
Quoted 148 lines · Cyril Hrubis
Good news everyone,
the Linux Test Project test suite stable release for *September 2024* has been
released.Since the last release 266 patches by 47 authors were merged.
Patch review is what most of the projects struggle with and LTP is no different. If you can spare some effort helping with the patch review is more
than welcomed.NOTABLE CHANGES
===============* New tests
- chown09 regression test for
5d1f903f75a8("attr: block mode changes of
symlinks")
-request_key06Negative tests forrequest_key()syscall
- signalfd02 Negative tests forsignalfd()syscall
- mseal02 Negative tests formseal()syscall
- hugeshmget06 A hugepage shm test
- landlock07 Landlock Houdini reproducer aka CVE-2024-42318
- getcpu02 Negative tests forgetcpu()syscall
- landlock06 Tests forLANDLOCK_ACCESS_FS_IOCTL_DEV
- landlock05 Tests forLONDLOCK_ACCESS_FS_REFER
- landlock04 Tests that syscalls are enabled/disable accordingly to the
ruleset
- landlock03 Negative tests forlandlock_restrict_self()syscall
- landlock02 Negative tests forlandlock_add_rule()syscall
- landlock01 Negative tests forlandlock_create_ruleset()syscall
- mseal01 Tests that memory is protected from being changed after it's
sealed
-fchmodat2_02Negative tests forfchmodat2()
-fchmodat2_01Tests forAT_SYMLINK_NOFOLLOWforfchmodat2()
- cachestat04 Checks thatcachestat()syscall either reports EBADF or
zeroed
statistics on all kinds of unsupported fds
- cachestat03 Negative tests forcachestat()syscall
- cachestat02 Basic cachestat tests with fd pointing to shared memory
- cachestat01 Basic cachestat tests for regular files
- shutdown01 Basic shutdown tests
- shutdown02 Negative tests forshutdown()sycall* The symlink01 mess is being split into separate testcases
- open15 A test that
open()syscall works correctly with symlinks
- lstat03 A basiclstat()test.
- rename15 Tests that rename works correctly with symlinks
- chmod08 Tests thatchmod()works correctly with symlinks* Increased coverage
- readdir and getdents tests were enabled to run on all supported
filesystems
after we found that bcachefs had sublty broken implementation
- gedent02 Adds more negative tests
-timer_settime01Now checks for premature timer expiration as well
- pkey01 Now includes tests forPKEY_DISABLE_EXECUTE
-request_key01Added more negative tests
- acct02 Added more negative tests
- prctl04 has been renamed to seccomp01 and now covers also theseccomp()syscall along with the olderprctl(PR_SET_SECCOMP)calls
- msync04 now uses direct I/O to verify that data have been written to
disk* Rewritten tests
- fork05 was rewritten and correctly reports TCONF on non i386 hardware
- fcnt14 a file locking test was rewriten to generate subtests at runtime
-sched_starvationnow autocallibrates expected runtime based on CPU
speed
-sched_footbalwas rewritten and is now executed as part of the sched runtest file* The test library now supports specifying mkfs and mount options per a filesystem
* Bunch of checks for kernels older than 4.4 were removed from the tests since
the currently minimal kernel version LTP supports is 4.4* We have a new shell test library that:
- makes shell code seamlessly interoperable with C
- reuses most of the C test library
- makes use shared memory to report test results
- there are currently no tests using this library, we will start
rewriting
existing tests after the release* 3 testcases were converted to the new test library
+ The usual amount of fixes and cleanups
REMOVED SCRIPTS AND FILES
=========================- Removed old and outdated man pages.
- Removed ltpmenu an legacy script that was unmaintained for a decade.
NOTABLE CHANGES IN NETWORK TESTS
================================
brought to you by Petr Vorel-
nfsstat02.shnew test for per-NS NFS client statistics (checks that/proc/net/rpc/nfsexists in nested network
namespaces)-
nfsstat01.shread client stats from netns rhost
(fix for kernel 6.9, backported up to 5.10 so far)-
nfs02.shAdded subtest forO_DIRECTKIRK
====- Kirk has been update to 1.4
- Kirk can now be installed from pypiDOWNLOAD AND LINKS
==================The latest version of the test-suite contains 3000+ tests for the Linux and can be downloaded at:
https://github.com/linux-test-project/ltp/releases/tag/20240930
The project pages as well as GIT repository are hosted on GitHub:
https://github.com/linux-test-project/ltp
If you ever wondered how to write a LTP testcase, don't miss our developer documentation at:
https://linux-test-project.readthedocs.io/en/latest/developers/test_case_tutorial.html
And our library API documentation at:
https://linux-test-project.readthedocs.io/en/latest/developers/api_c_tests.html
Patches, new tests, bugs, comments or questions should go to to our mailing list at [email protected].
Quoted 7 lines
CREDITS
=======Many thanks to the people contributing to this release:
git shortlog -s -e -n 20240129..
This should be compared with 20240524.
But anyway it's not a big deal.
Quoted 49 lines
233 Petr Vorel <[email protected]> 74 Andrea Cervesato <[email protected]> 39 Martin Doucha <[email protected]> 36 Li Wang <[email protected]> 25 Cyril Hrubis <[email protected]> 25 Yang Xu <[email protected]> 22 Xinjian Ma (Fujitsu) <[email protected]> 21 Wei Gao <[email protected]> 15 Andrea Manzini <[email protected]> 6 Avinesh Kumar <[email protected]> 6 Edward Liaw <[email protected]> 6 John Stultz <[email protected]> 4 Hui Min Mina Chou <[email protected]> 4 Jan Stancek <[email protected]> 3 Andreas Schwab <[email protected]> 3 Xiao Yang <[email protected]> 3 lufei <[email protected]> 2 Dennis Brendel <[email protected]> 2 Jiwei Sun <[email protected]> 2 Po-Hsu Lin <[email protected]> 1 Ajay Kaher <[email protected]> 1 Amir Goldstein <[email protected]> 1 Chen Haonan <[email protected]> 1 Chuck Lever <[email protected]> 1 Detlef Riekenberg via ltp <[email protected]> 1 Filippo Storniolo <[email protected]> 1 Haifeng Xu <[email protected]> 1 Jingyi Song <[email protected]> 1 Khem Raj <[email protected]> 1 Kuan-Ying Lee <[email protected]> 1 Li Xiaosong <[email protected]> 1 Madadi Vineeth Reddy <[email protected]> 1 Mete Durlu <[email protected]> 1 Murphy Zhou <[email protected]> 1 Nirjhar Roy <[email protected]> 1 Remi Peuvergne <[email protected]> 1 Sachin P Bappalige <[email protected]> 1 Samasth Norway Ananda <[email protected]> 1 Sebastian Chlad <[email protected]> 1 Sergey Ulanov via ltp <[email protected]> 1 Shiyang Ruan <[email protected]> 1 Shizhao Chen <[email protected]> 1 Wenjie Xu <[email protected]> 1 Xiangyu Chen <[email protected]> 1 Yiwei Lin <[email protected]> 1 Zizhi Wo <[email protected]> 1 yangfeng <[email protected]>
Quoted 5 lines
And also thanks to patch reviewers:
git log 20240129.. | grep -Ei '(reviewed|acked)-by:' | sed 's/.*by: //' | sort | uniq -c | sort -n -r
and here ^
Quoted 24 lines
212 Petr Vorel <[email protected]>
181 Cyril Hrubis <[email protected]>
108 Li Wang <[email protected]>
39 Avinesh Kumar <[email protected]>
28 Andrea Cervesato <[email protected]> 16 Martin Doucha <[email protected]>
10 Jan Stancek <[email protected]>
6 Jan Kara <[email protected]>
4 Wei Gao <[email protected]>
4 Richard Palethorpe <[email protected]> 3 Marius Kittler <[email protected]>
3 Amir Goldstein <[email protected]> 2 Adrian Huang <[email protected]>
1 Vlastimil Babka <[email protected]>
1 Po-Hsu Lin <[email protected]> 1 Matt Bobrowski <[email protected]> 1 Kent Overstreet <[email protected]> 1 Joerg Vehlow <[email protected]>--
Cyril Hrubis
[email protected]
Signature · 5 lines
Regards, Li Wang -- Mailing list info: https://lists.linux.it/listinfo/ltp
Hi!
Quoted 5 lines
Quoted 2 lines
git shortlog -s -e -n 20240129..
This should be compared with 20240524.
But anyway it's not a big deal.
Ah, sorry, I haven't noticed even though the statistics are obviously doubled, here are the correct data:
git shortlog -s -e -n 20240524..
93 Petr Vorel <[email protected]> 58 Andrea Cervesato <[email protected]> 22 Xinjian Ma (Fujitsu) <[email protected]> 17 Martin Doucha <[email protected]> 15 Cyril Hrubis <[email protected]> 15 Li Wang <[email protected]> 7 Wei Gao <[email protected]> 6 John Stultz <[email protected]> 3 Andreas Schwab <[email protected]> 3 Edward Liaw <[email protected]> 3 Jan Stancek <[email protected]> 3 Xiao Yang <[email protected]> 2 Jiwei Sun <[email protected]> 2 Po-Hsu Lin <[email protected]> 1 Ajay Kaher <[email protected]> 1 Avinesh Kumar <[email protected]> 1 Chen Haonan <[email protected]> 1 Chuck Lever <[email protected]> 1 Haifeng Xu <[email protected]> 1 Jingyi Song <[email protected]> 1 Kuan-Ying Lee <[email protected]> 1 Li Xiaosong <[email protected]> 1 Madadi Vineeth Reddy <[email protected]> 1 Nirjhar Roy <[email protected]> 1 Remi Peuvergne <[email protected]> 1 Sachin P Bappalige <[email protected]> 1 Shizhao Chen <[email protected]> 1 Yiwei Lin <[email protected]> 1 Zizhi Wo <[email protected]> 1 lufei <[email protected]>
git log 20240524.. | grep -Ei '(reviewed|acked)-by:' | sed 's/.*by: //' | sort | uniq -c | sort -n -r
87 Petr Vorel <[email protected]>
87 Cyril Hrubis <[email protected]>
77 Li Wang <[email protected]>
28 Avinesh Kumar <[email protected]>
13 Andrea Cervesato <[email protected]>
4 Martin Doucha <[email protected]>
3 Wei Gao <[email protected]>
3 Richard Palethorpe <[email protected]> 3 Jan Stancek <[email protected]>
3 Jan Kara <[email protected]>
2 Adrian Huang <[email protected]>
1 Po-Hsu Lin <[email protected]> 1 Amir Goldstein <[email protected]>
Signature · 5 lines
Cyril Hrubis [email protected] -- Mailing list info: https://lists.linux.it/listinfo/ltp