Skip to contentSkip to conversation

curl: Skip tests marked flaky

PATCH In review [email protected] 2 participants 2 messages Sep 28, 2023

lore
Share & tools
lore
#0 lore raw

PATCH 1/1 curl: Skip tests marked flaky

From: Robert Joslyn <[email protected]>

Some tests can fail intermittently and upstream has marked these as flaky so they can easily be skipped. At present there are 12 tests marked flaky with 10 of them running in the default recipe configuration. Skip them to avoid the failures.

---
 meta/recipes-support/curl/curl/run-ptest | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
meta/recipes-support/curl/curl/run-ptest +1 -1
index 95af2bd7b3..8f9c20f34d 100644
@@ -1,6 +1,6 @@
 #!/bin/sh
 cd tests
-{ ./runtests.pl -a -n -s -j4 || echo "FAIL: curl" ; } | sed \
+{ ./runtests.pl -a -n -s -j4 !flaky || echo "FAIL: curl" ; } | sed \
      -e 's|\([^ ]* *\) \([^ ]* *\)...OK|PASS: \1 \2|' \
      -e 's|\([^ ]* *\) \([^ ]* *\)...FAILED|FAIL: \1 \2|' \
      -e 's/Warning: test[0-9]\+ not present in tests\/data\/Makefile.inc//'
Signature · 1 line
2.41.0
#1 lore raw

Thanks, I suspect many of those were enabled to begin with when I recently changed the packaging to include all the tests.

Alex

Quoted 37 lines · Robert Joslyn via lists.openembedded.org

From: Robert Joslyn <[email protected]>

Some tests can fail intermittently and upstream has marked these as flaky so they can easily be skipped. At present there are 12 tests marked flaky with 10 of them running in the default recipe configuration. Skip them to avoid the failures.

---
 meta/recipes-support/curl/curl/run-ptest | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
meta/recipes-support/curl/curl/run-ptest +1 -2
index 95af2bd7b3..8f9c20f34d 100644
@@ -1,6 +1,6 @@
 #!/bin/sh
 cd tests
-{ ./runtests.pl -a -n -s -j4 || echo "FAIL: curl" ; } | sed \
+{ ./runtests.pl -a -n -s -j4 !flaky || echo "FAIL: curl" ; } | sed \
      -e 's|\([^ ]* *\) \([^ ]* *\)...OK|PASS: \1 \2|' \
      -e 's|\([^ ]* *\) \([^ ]* *\)...FAILED|FAIL: \1 \2|' \
      -e 's/Warning: test[0-9]\+ not present in tests\/data\/Makefile.inc//'
--

2.41.0

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#188349): https://lists.openembedded.org/g/openembedded-core/message/188349
Mute This Topic: https://lists.openembedded.org/mt/101630676/1686489
Group Owner: [email protected]
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [[email protected]]
-=-=-=-=-=-=-=-=-=-=-=-