Skip to contentSkip to conversation

❌ FAIL: Test report for kernel 5.14.0-rc7 (mainline.kernel.org-clang, 77dd1143)

DISCUSSION CKI Project 1 participant 1 message Aug 28, 2021

lore
Share & tools
lore
#0 lore raw

Hello,

We ran automated tests on a recent commit from this kernel tree:

Kernel repo: https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git
Commit: 77dd11439b86 - Merge tag 'drm-fixes-2021-08-27' of git://anongit.freedesktop.org/drm/drm

The results of these automated tests are provided below.

Overall result: FAILED (see details below)
Merge: OK
Compile: OK
Selftests compile: FAILED
Tests: FAILED

All kernel binaries, config files, and logs are available for download here:

https://arr-cki-prod-datawarehouse-public.s3.amazonaws.com/index.html?prefix=datawarehouse-public/2021/08/27/360423498

One or more kernel tests failed:

aarch64:
πŸ’₯ stress: stress-ng
❌ LTP

x86_64:
❌ Storage blktests

We hope that these logs can help you find the problem quickly. For the full detail on our testing procedures, please scroll to the bottom of this message.

Please reply to this email if you have any questions about the tests that we ran or if you have any suggestions on how to make future tests more effective.

        ,-.   ,-.
       ( C ) ( K )  Continuous
        `-',-.`-'   Kernel
          ( I )     Integration
           `-'

______________________________________________________________________________

Compile testing
---------------

We compiled the kernel for 4 architectures:

aarch64:
make options: make LLVM=1 -j24 INSTALL_MOD_STRIP=1 targz-pkg

ppc64le:
make options: make CC=clang -j24 INSTALL_MOD_STRIP=1 targz-pkg

s390x:
make options: make CC=clang -j24 INSTALL_MOD_STRIP=1 targz-pkg

x86_64:
make options: make LLVM=1 -j24 INSTALL_MOD_STRIP=1 targz-pkg

We built the following selftests:

x86_64:
net: OK
bpf: fail
install and packaging: OK

You can find the full log (build-selftests.log) in the artifact storage above.

Hardware testing
----------------
We booted each kernel and ran the following tests:

aarch64:
Host 1:

⚑ Internal infrastructure issues prevented one or more tests (marked with ⚑⚑⚑) from running on this architecture.
This is not the fault of the kernel that was tested.

βœ… Boot test
βœ… Reboot test
βœ… ACPI table test
βœ… ACPI enabled test
βœ… LTP
βœ… CIFS Connectathon
βœ… POSIX pjd-fstest suites
βœ… Loopdev Sanity
⚑⚑⚑ jvm - jcstress tests
βœ… Memory: fork_mem
βœ… Memory function: memfd_create
βœ… AMTU (Abstract Machine Test Utility) βœ… Networking bridge: sanity
βœ… Ethernet drivers sanity
βœ… Networking socket: fuzz
βœ… Networking: igmp conformance test
βœ… Networking route: pmtu
βœ… Networking route_func - local
βœ… Networking route_func - forward
βœ… Networking TCP: keepalive test
βœ… Networking UDP: socket
βœ… Networking cki netfilter test
βœ… Networking tunnel: geneve basic test βœ… Networking tunnel: gre basic
βœ… L2TP basic test
βœ… Networking tunnel: vxlan basic
βœ… Networking ipsec: basic netns - transport βœ… Networking ipsec: basic netns - tunnel βœ… Libkcapi AF_ALG test
βœ… pciutils: update pci ids test
βœ… ALSA PCM loopback test
βœ… ALSA Control (mixer) Userspace Element test βœ… storage: SCSI VPD
βœ… trace: ftrace/tracer
βœ… kdump - kexec_boot
🚧 βœ… xarray-idr-radixtree-test
🚧 βœ… i2c: i2cdetect sanity
🚧 ❌ Firmware test suite
🚧 βœ… Memory function: kaslr
🚧 βœ… audit: audit testsuite test
🚧 βœ… lvm cache test
🚧 βœ… lvm snapper test

Host 2:
βœ… Boot test
βœ… Reboot test
βœ… xfstests - ext4
βœ… xfstests - xfs
βœ… Storage blktests
βœ… storage: software RAID testing
βœ… Storage: swraid mdadm raid_module test 🚧 ❌ Podman system integration test - as root 🚧 βœ… Podman system integration test - as user 🚧 βœ… xfstests - btrfs
🚧 βœ… IPMI driver test
🚧 βœ… IPMItool loop stress test
🚧 ❌ selinux-policy: serge-testsuite 🚧 βœ… Storage block - filesystem fio test 🚧 βœ… Storage block - queue scheduler test 🚧 ❌ Storage nvme - tcp
🚧 πŸ’₯ stress: stress-ng

Host 3:

⚑ Internal infrastructure issues prevented one or more tests (marked with ⚑⚑⚑) from running on this architecture.
This is not the fault of the kernel that was tested.

βœ… Boot test
βœ… Reboot test
βœ… ACPI table test
βœ… ACPI enabled test
❌ LTP
βœ… CIFS Connectathon
βœ… POSIX pjd-fstest suites
βœ… Loopdev Sanity
⚑⚑⚑ jvm - jcstress tests
βœ… Memory: fork_mem
βœ… Memory function: memfd_create
βœ… AMTU (Abstract Machine Test Utility) βœ… Networking bridge: sanity
βœ… Ethernet drivers sanity
βœ… Networking socket: fuzz
βœ… Networking: igmp conformance test
βœ… Networking route: pmtu
βœ… Networking route_func - local
βœ… Networking route_func - forward
βœ… Networking TCP: keepalive test
βœ… Networking UDP: socket
βœ… Networking cki netfilter test
βœ… Networking tunnel: geneve basic test βœ… Networking tunnel: gre basic
βœ… L2TP basic test
βœ… Networking tunnel: vxlan basic
βœ… Networking ipsec: basic netns - transport βœ… Networking ipsec: basic netns - tunnel βœ… Libkcapi AF_ALG test
βœ… pciutils: update pci ids test
βœ… ALSA PCM loopback test
βœ… ALSA Control (mixer) Userspace Element test βœ… storage: SCSI VPD
βœ… trace: ftrace/tracer
βœ… kdump - kexec_boot
🚧 βœ… xarray-idr-radixtree-test
🚧 βœ… i2c: i2cdetect sanity
🚧 ❌ Firmware test suite
🚧 βœ… Memory function: kaslr
🚧 βœ… audit: audit testsuite test
🚧 βœ… lvm cache test
🚧 βœ… lvm snapper test

ppc64le:
Host 1:

⚑ Internal infrastructure issues prevented one or more tests (marked with ⚑⚑⚑) from running on this architecture.
This is not the fault of the kernel that was tested.

βœ… Boot test
βœ… Reboot test
⚑⚑⚑ LTP
⚑⚑⚑ CIFS Connectathon
⚑⚑⚑ POSIX pjd-fstest suites
⚑⚑⚑ Loopdev Sanity
⚑⚑⚑ jvm - jcstress tests
⚑⚑⚑ Memory: fork_mem
⚑⚑⚑ Memory function: memfd_create
⚑⚑⚑ AMTU (Abstract Machine Test Utility) ⚑⚑⚑ Networking bridge: sanity
⚑⚑⚑ Ethernet drivers sanity
⚑⚑⚑ Networking socket: fuzz
⚑⚑⚑ Networking route: pmtu
⚑⚑⚑ Networking route_func - local
⚑⚑⚑ Networking route_func - forward ⚑⚑⚑ Networking TCP: keepalive test
⚑⚑⚑ Networking UDP: socket
⚑⚑⚑ Networking cki netfilter test
⚑⚑⚑ Networking tunnel: geneve basic test ⚑⚑⚑ Networking tunnel: gre basic
⚑⚑⚑ L2TP basic test
⚑⚑⚑ Networking tunnel: vxlan basic
⚑⚑⚑ Networking ipsec: basic netns - tunnel ⚑⚑⚑ Libkcapi AF_ALG test
⚑⚑⚑ pciutils: update pci ids test
⚑⚑⚑ ALSA PCM loopback test
⚑⚑⚑ ALSA Control (mixer) Userspace Element test ⚑⚑⚑ trace: ftrace/tracer
🚧 ⚑⚑⚑ xarray-idr-radixtree-test
🚧 ⚑⚑⚑ Memory function: kaslr
🚧 ⚑⚑⚑ audit: audit testsuite test
🚧 ⚑⚑⚑ lvm cache test
🚧 ⚑⚑⚑ lvm snapper test

Host 2:
βœ… Boot test
βœ… Reboot test
🚧 βœ… Storage: lvm device-mapper test - upstream

Host 3:

⚑ Internal infrastructure issues prevented one or more tests (marked with ⚑⚑⚑) from running on this architecture.
This is not the fault of the kernel that was tested.

βœ… Boot test
βœ… Reboot test
⚑⚑⚑ LTP
⚑⚑⚑ CIFS Connectathon
⚑⚑⚑ POSIX pjd-fstest suites
⚑⚑⚑ Loopdev Sanity
⚑⚑⚑ jvm - jcstress tests
⚑⚑⚑ Memory: fork_mem
⚑⚑⚑ Memory function: memfd_create
⚑⚑⚑ AMTU (Abstract Machine Test Utility) ⚑⚑⚑ Networking bridge: sanity
⚑⚑⚑ Ethernet drivers sanity
⚑⚑⚑ Networking socket: fuzz
⚑⚑⚑ Networking route: pmtu
⚑⚑⚑ Networking route_func - local
⚑⚑⚑ Networking route_func - forward ⚑⚑⚑ Networking TCP: keepalive test
⚑⚑⚑ Networking UDP: socket
⚑⚑⚑ Networking cki netfilter test
⚑⚑⚑ Networking tunnel: geneve basic test ⚑⚑⚑ Networking tunnel: gre basic
⚑⚑⚑ L2TP basic test
⚑⚑⚑ Networking tunnel: vxlan basic
⚑⚑⚑ Networking ipsec: basic netns - tunnel ⚑⚑⚑ Libkcapi AF_ALG test
⚑⚑⚑ pciutils: update pci ids test
⚑⚑⚑ ALSA PCM loopback test
⚑⚑⚑ ALSA Control (mixer) Userspace Element test ⚑⚑⚑ trace: ftrace/tracer
🚧 ⚑⚑⚑ xarray-idr-radixtree-test
🚧 ⚑⚑⚑ Memory function: kaslr
🚧 ⚑⚑⚑ audit: audit testsuite test
🚧 ⚑⚑⚑ lvm cache test
🚧 ⚑⚑⚑ lvm snapper test

Host 4:

⚑ Internal infrastructure issues prevented one or more tests (marked with ⚑⚑⚑) from running on this architecture.
This is not the fault of the kernel that was tested.

βœ… Boot test
βœ… Reboot test
⚑⚑⚑ LTP
⚑⚑⚑ CIFS Connectathon
⚑⚑⚑ POSIX pjd-fstest suites
⚑⚑⚑ Loopdev Sanity
⚑⚑⚑ jvm - jcstress tests
⚑⚑⚑ Memory: fork_mem
⚑⚑⚑ Memory function: memfd_create
⚑⚑⚑ AMTU (Abstract Machine Test Utility) ⚑⚑⚑ Networking bridge: sanity
⚑⚑⚑ Ethernet drivers sanity
⚑⚑⚑ Networking socket: fuzz
⚑⚑⚑ Networking route: pmtu
⚑⚑⚑ Networking route_func - local
⚑⚑⚑ Networking route_func - forward ⚑⚑⚑ Networking TCP: keepalive test
⚑⚑⚑ Networking UDP: socket
⚑⚑⚑ Networking cki netfilter test
⚑⚑⚑ Networking tunnel: geneve basic test ⚑⚑⚑ Networking tunnel: gre basic
⚑⚑⚑ L2TP basic test
⚑⚑⚑ Networking tunnel: vxlan basic
⚑⚑⚑ Networking ipsec: basic netns - tunnel ⚑⚑⚑ Libkcapi AF_ALG test
⚑⚑⚑ pciutils: update pci ids test
⚑⚑⚑ ALSA PCM loopback test
⚑⚑⚑ ALSA Control (mixer) Userspace Element test ⚑⚑⚑ trace: ftrace/tracer
🚧 ⚑⚑⚑ xarray-idr-radixtree-test
🚧 ⚑⚑⚑ Memory function: kaslr
🚧 ⚑⚑⚑ audit: audit testsuite test
🚧 ⚑⚑⚑ lvm cache test
🚧 ⚑⚑⚑ lvm snapper test

s390x:
Host 1:

⚑ Internal infrastructure issues prevented one or more tests (marked with ⚑⚑⚑) from running on this architecture.
This is not the fault of the kernel that was tested.

⚑⚑⚑ Boot test
⚑⚑⚑ Reboot test
⚑⚑⚑ LTP
⚑⚑⚑ CIFS Connectathon
⚑⚑⚑ POSIX pjd-fstest suites
⚑⚑⚑ Loopdev Sanity
⚑⚑⚑ jvm - jcstress tests
⚑⚑⚑ Memory: fork_mem
⚑⚑⚑ Memory function: memfd_create
⚑⚑⚑ AMTU (Abstract Machine Test Utility) ⚑⚑⚑ Networking bridge: sanity
⚑⚑⚑ Ethernet drivers sanity
⚑⚑⚑ Networking route: pmtu
⚑⚑⚑ Networking route_func - local
⚑⚑⚑ Networking route_func - forward ⚑⚑⚑ Networking TCP: keepalive test ⚑⚑⚑ Networking UDP: socket
⚑⚑⚑ Networking cki netfilter test
⚑⚑⚑ Networking tunnel: geneve basic test ⚑⚑⚑ Networking tunnel: gre basic
⚑⚑⚑ L2TP basic test
⚑⚑⚑ Networking tunnel: vxlan basic ⚑⚑⚑ Networking ipsec: basic netns - transport ⚑⚑⚑ Networking ipsec: basic netns - tunnel ⚑⚑⚑ Libkcapi AF_ALG test
⚑⚑⚑ trace: ftrace/tracer
⚑⚑⚑ kdump - kexec_boot
🚧 ⚑⚑⚑ xarray-idr-radixtree-test
🚧 ⚑⚑⚑ Memory function: kaslr
🚧 ⚑⚑⚑ audit: audit testsuite test
🚧 ⚑⚑⚑ lvm cache test
🚧 ⚑⚑⚑ lvm snapper test

Host 2:

⚑ Internal infrastructure issues prevented one or more tests (marked with ⚑⚑⚑) from running on this architecture.
This is not the fault of the kernel that was tested.

⚑⚑⚑ Boot test
⚑⚑⚑ Reboot test
⚑⚑⚑ Storage blktests
⚑⚑⚑ Storage: swraid mdadm raid_module test 🚧 ⚑⚑⚑ Podman system integration test - as root 🚧 ⚑⚑⚑ Podman system integration test - as user 🚧 ⚑⚑⚑ selinux-policy: serge-testsuite 🚧 ⚑⚑⚑ Storage nvme - tcp
🚧 ⚑⚑⚑ stress: stress-ng

Host 3:

⚑ Internal infrastructure issues prevented one or more tests (marked with ⚑⚑⚑) from running on this architecture.
This is not the fault of the kernel that was tested.

⚑⚑⚑ Boot test
⚑⚑⚑ Reboot test
⚑⚑⚑ kdump - sysrq-c
⚑⚑⚑ kdump - file-load

Host 4:

⚑ Internal infrastructure issues prevented one or more tests (marked with ⚑⚑⚑) from running on this architecture.
This is not the fault of the kernel that was tested.

⚑⚑⚑ Boot test
⚑⚑⚑ Reboot test
⚑⚑⚑ LTP
⚑⚑⚑ CIFS Connectathon
⚑⚑⚑ POSIX pjd-fstest suites
⚑⚑⚑ Loopdev Sanity
⚑⚑⚑ jvm - jcstress tests
⚑⚑⚑ Memory: fork_mem
⚑⚑⚑ Memory function: memfd_create
⚑⚑⚑ AMTU (Abstract Machine Test Utility) ⚑⚑⚑ Networking bridge: sanity
⚑⚑⚑ Ethernet drivers sanity
⚑⚑⚑ Networking route: pmtu
⚑⚑⚑ Networking route_func - local
⚑⚑⚑ Networking route_func - forward ⚑⚑⚑ Networking TCP: keepalive test ⚑⚑⚑ Networking UDP: socket
⚑⚑⚑ Networking cki netfilter test
⚑⚑⚑ Networking tunnel: geneve basic test ⚑⚑⚑ Networking tunnel: gre basic
⚑⚑⚑ L2TP basic test
⚑⚑⚑ Networking tunnel: vxlan basic ⚑⚑⚑ Networking ipsec: basic netns - transport ⚑⚑⚑ Networking ipsec: basic netns - tunnel ⚑⚑⚑ Libkcapi AF_ALG test
⚑⚑⚑ trace: ftrace/tracer
⚑⚑⚑ kdump - kexec_boot
🚧 ⚑⚑⚑ xarray-idr-radixtree-test
🚧 ⚑⚑⚑ Memory function: kaslr
🚧 ⚑⚑⚑ audit: audit testsuite test
🚧 ⚑⚑⚑ lvm cache test
🚧 ⚑⚑⚑ lvm snapper test

Host 5:

⚑ Internal infrastructure issues prevented one or more tests (marked with ⚑⚑⚑) from running on this architecture.
This is not the fault of the kernel that was tested.

⚑⚑⚑ Boot test
⚑⚑⚑ Reboot test
⚑⚑⚑ Storage blktests
⚑⚑⚑ Storage: swraid mdadm raid_module test 🚧 ⚑⚑⚑ Podman system integration test - as root 🚧 ⚑⚑⚑ Podman system integration test - as user 🚧 ⚑⚑⚑ selinux-policy: serge-testsuite 🚧 ⚑⚑⚑ Storage nvme - tcp
🚧 ⚑⚑⚑ stress: stress-ng

x86_64:
Host 1:
βœ… Boot test
βœ… Reboot test
βœ… kdump - file-load
🚧 βœ… kdump - sysrq-c

Host 2:

⚑ Internal infrastructure issues prevented one or more tests (marked with ⚑⚑⚑) from running on this architecture.
This is not the fault of the kernel that was tested.

βœ… Boot test
βœ… Reboot test
βœ… xfstests - ext4
βœ… xfstests - xfs
βœ… xfstests - nfsv4.2
❌ Storage blktests
βœ… storage: software RAID testing
βœ… Storage: swraid mdadm raid_module test 🚧 ❌ Podman system integration test - as root 🚧 ❌ Podman system integration test - as user 🚧 βœ… CPU: Idle Test
🚧 βœ… xfstests - btrfs
🚧 βœ… xfstests - cifsv3.11
🚧 βœ… IPMI driver test
🚧 βœ… IPMItool loop stress test
🚧 ❌ selinux-policy: serge-testsuite
🚧 βœ… Storage block - filesystem fio test 🚧 βœ… Storage block - queue scheduler test 🚧 ❌ Storage nvme - tcp
🚧 ⚑⚑⚑ Storage nvdimm ndctl test suite 🚧 βœ… Storage: lvm device-mapper test - upstream 🚧 βœ… stress: stress-ng

Host 3:

⚑ Internal infrastructure issues prevented one or more tests (marked with ⚑⚑⚑) from running on this architecture.
This is not the fault of the kernel that was tested.

βœ… Boot test
βœ… Reboot test
βœ… ACPI table test
βœ… LTP
βœ… CIFS Connectathon
βœ… POSIX pjd-fstest suites
βœ… Loopdev Sanity
⚑⚑⚑ jvm - jcstress tests
βœ… Memory: fork_mem
βœ… Memory function: memfd_create
βœ… AMTU (Abstract Machine Test Utility) βœ… Networking bridge: sanity
βœ… Ethernet drivers sanity
βœ… Networking socket: fuzz
βœ… Networking: igmp conformance test
βœ… Networking route: pmtu
βœ… Networking route_func - local
βœ… Networking route_func - forward
βœ… Networking TCP: keepalive test
βœ… Networking UDP: socket
βœ… Networking cki netfilter test
βœ… Networking tunnel: geneve basic test βœ… Networking tunnel: gre basic
βœ… L2TP basic test
βœ… Networking tunnel: vxlan basic
βœ… Networking ipsec: basic netns - transport βœ… Networking ipsec: basic netns - tunnel βœ… Libkcapi AF_ALG test
βœ… pciutils: sanity smoke test
βœ… pciutils: update pci ids test
βœ… ALSA PCM loopback test
βœ… ALSA Control (mixer) Userspace Element test βœ… storage: SCSI VPD
βœ… trace: ftrace/tracer
βœ… kdump - kexec_boot
🚧 βœ… xarray-idr-radixtree-test
🚧 βœ… i2c: i2cdetect sanity
🚧 ❌ Firmware test suite
🚧 βœ… Memory function: kaslr
🚧 βœ… audit: audit testsuite test
🚧 βœ… lvm cache test
🚧 βœ… lvm snapper test

Host 4:

⚑ Internal infrastructure issues prevented one or more tests (marked with ⚑⚑⚑) from running on this architecture.
This is not the fault of the kernel that was tested.

βœ… Boot test
βœ… Reboot test
βœ… ACPI table test
βœ… LTP
βœ… CIFS Connectathon
βœ… POSIX pjd-fstest suites
βœ… Loopdev Sanity
⚑⚑⚑ jvm - jcstress tests
βœ… Memory: fork_mem
βœ… Memory function: memfd_create
βœ… AMTU (Abstract Machine Test Utility) βœ… Networking bridge: sanity
βœ… Ethernet drivers sanity
βœ… Networking socket: fuzz
βœ… Networking: igmp conformance test
βœ… Networking route: pmtu
βœ… Networking route_func - local
βœ… Networking route_func - forward
βœ… Networking TCP: keepalive test
βœ… Networking UDP: socket
βœ… Networking cki netfilter test
βœ… Networking tunnel: geneve basic test βœ… Networking tunnel: gre basic
βœ… L2TP basic test
βœ… Networking tunnel: vxlan basic
βœ… Networking ipsec: basic netns - transport βœ… Networking ipsec: basic netns - tunnel βœ… Libkcapi AF_ALG test
βœ… pciutils: sanity smoke test
βœ… pciutils: update pci ids test
βœ… ALSA PCM loopback test
βœ… ALSA Control (mixer) Userspace Element test βœ… storage: SCSI VPD
βœ… trace: ftrace/tracer
βœ… kdump - kexec_boot
🚧 βœ… xarray-idr-radixtree-test
🚧 βœ… i2c: i2cdetect sanity
🚧 ❌ Firmware test suite
🚧 βœ… Memory function: kaslr
🚧 βœ… audit: audit testsuite test
🚧 βœ… lvm cache test
🚧 βœ… lvm snapper test

Host 5:

⚑ Internal infrastructure issues prevented one or more tests (marked with ⚑⚑⚑) from running on this architecture.
This is not the fault of the kernel that was tested.

βœ… Boot test
βœ… Reboot test
βœ… ACPI table test
βœ… LTP
βœ… CIFS Connectathon
βœ… POSIX pjd-fstest suites
βœ… Loopdev Sanity
⚑⚑⚑ jvm - jcstress tests
βœ… Memory: fork_mem
βœ… Memory function: memfd_create
βœ… AMTU (Abstract Machine Test Utility) βœ… Networking bridge: sanity
βœ… Ethernet drivers sanity
βœ… Networking socket: fuzz
βœ… Networking: igmp conformance test
βœ… Networking route: pmtu
βœ… Networking route_func - local
βœ… Networking route_func - forward
βœ… Networking TCP: keepalive test
βœ… Networking UDP: socket
βœ… Networking cki netfilter test
βœ… Networking tunnel: geneve basic test βœ… Networking tunnel: gre basic
βœ… L2TP basic test
βœ… Networking tunnel: vxlan basic
βœ… Networking ipsec: basic netns - transport βœ… Networking ipsec: basic netns - tunnel βœ… Libkcapi AF_ALG test
βœ… pciutils: sanity smoke test
βœ… pciutils: update pci ids test
βœ… ALSA PCM loopback test
βœ… ALSA Control (mixer) Userspace Element test βœ… storage: SCSI VPD
βœ… trace: ftrace/tracer
βœ… kdump - kexec_boot
🚧 βœ… xarray-idr-radixtree-test
🚧 βœ… i2c: i2cdetect sanity
🚧 ❌ Firmware test suite
🚧 βœ… Memory function: kaslr
🚧 βœ… audit: audit testsuite test
🚧 βœ… lvm cache test
🚧 βœ… lvm snapper test

Test sources: https://gitlab.com/cki-project/kernel-tests
πŸ’š Pull requests are welcome for new tests or improvements to existing tests!

Aborted tests
-------------
Tests that didn't complete running successfully are marked with ⚑⚑⚑. If this was caused by an infrastructure issue, we try to mark that explicitly in the report.

Waived tests
------------
If the test run included waived tests, they are marked with 🚧. Such tests are executed but their results are not taken into account. Tests are waived when their results are not reliable enough, e.g. when they're just introduced or are being fixed.

Testing timeout
---------------
We aim to provide a report within reasonable timeframe. Tests that haven't finished running yet are marked with ⏱.