Tests run on CIP-LAVA platform
Hi Team,
I could able to see there are few tests are running in the CIP LAVA platform. I am showing the list below what all LAVA tests are running in the CIP LAVA platform.
Test-case
CIP LAVA job link
Status
Comments
i) spectre-meltdown-checker-test
https://lava.ciplatform.org/scheduler/job/686074
Not run
Reason of failure
./spectre-meltdown-checker.sh: Permission denied.
ii) hackbench
https://lava.ciplatform.org/results/634343
PASS
iii) cyclictest
https://lava.ciplatform.org/results/634097
SKIP
Reason of failure
$ ./cyclictest.sh -D 2m -p 98 -i 1000 -t 1 -a 0 -h '' -w '' this command is giving "/usr/bin/cyclictest: unrecognized option" error
iv) cyclicdeadline
https://lava.ciplatform.org/results/633692
Not run
Reason of failure
while executing cyclicdeadline.sh getting an error like
/usr/bin/cyclicdeadline: invalid option -- 'q'
Is there any specific reason why few test-cases are running through LAVA ?
Regards
Sarath P T
Hello Sarath,
Some of those test jobs you linked to are very old.
Looking at more recent jobs the smc issue you reported is no longer there.
However the RT tests are having issues completing the test due to “/usr/bin/env: 'python': No such file or directory”. The tests seem to get run, but the final step is a python script that parses the results.
We’ll have to get that fixed.
Kind regards, Chris
From: [email protected] <[email protected]> On Behalf Of P T, Sarath via lists.cip-project.org
Sent: 17 October 2022 08:04
To: [email protected]
Subject: [cip-dev] Tests run on CIP-LAVA platform
Hi Team,
I could able to see there are few tests are running in the CIP LAVA platform. I am showing the list below what all LAVA tests are running in the CIP LAVA platform.
Test-case
CIP LAVA job link
Status
Comments
i) spectre-meltdown-checker-test
https://lava.ciplatform.org/scheduler/job/686074<https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flava.ciplatform.org%2Fscheduler%2Fjob%2F686074&data=05%7C01%7Cchris.paterson2%40renesas.com%7C73512d15391248f0e28f08dab00dc6a7%7C53d82571da1947e49cb4625a166a4a2a%7C0%7C0%7C638015870466469681%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=s6LI32yl%2BAq2kMacyP1plIr7bu9DFfaCHGw5ez6E9tY%3D&reserved=0>
Not run
Reason of failure
./spectre-meltdown-checker.sh: Permission denied.
ii) hackbench
https://lava.ciplatform.org/results/634343<https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flava.ciplatform.org%2Fresults%2F634343&data=05%7C01%7Cchris.paterson2%40renesas.com%7C73512d15391248f0e28f08dab00dc6a7%7C53d82571da1947e49cb4625a166a4a2a%7C0%7C0%7C638015870466469681%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=4ajRpqUrsZX0CSIbsFRUWpNJ6cyRoAHXGM2NDzhWlII%3D&reserved=0>
PASS
iii) cyclictest
https://lava.ciplatform.org/results/634097<https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flava.ciplatform.org%2Fresults%2F634097&data=05%7C01%7Cchris.paterson2%40renesas.com%7C73512d15391248f0e28f08dab00dc6a7%7C53d82571da1947e49cb4625a166a4a2a%7C0%7C0%7C638015870466469681%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=m0f%2FygYtt4U4%2Fm7qJ1wHviYPItQxh46wrjXd7iWJSXY%3D&reserved=0>
SKIP
Reason of failure
$ ./cyclictest.sh -D 2m -p 98 -i 1000 -t 1 -a 0 -h '' -w '' this command is giving “/usr/bin/cyclictest: unrecognized option” error
iv) cyclicdeadline
https://lava.ciplatform.org/results/633692<https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flava.ciplatform.org%2Fresults%2F633692&data=05%7C01%7Cchris.paterson2%40renesas.com%7C73512d15391248f0e28f08dab00dc6a7%7C53d82571da1947e49cb4625a166a4a2a%7C0%7C0%7C638015870466625902%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=Q3ixEoBSW8Ld28zwN2bqCjMPqd1UzIPELHdnbTD72Yk%3D&reserved=0>
Not run
Reason of failure
while executing cyclicdeadline.sh getting an error like
/usr/bin/cyclicdeadline: invalid option -- 'q'
Is there any specific reason why few test-cases are running through LAVA ?
Regards
Sarath P T
Hi Chris,
I can see in Linaro/test-definitions (https://github.com/Linaro/test-definitions/tree/master/automated/linux) there are 123 test-suites are present but only 4 test-suites are running on cip lava ?
Few more queries I am having regarding this.
i) Is CIP running the full QA of Linaro/test-definitions test-suites in any other platform ?
ii) All of the tests which has been run in the LAVA CIP platform is 2mins duration. Is there a particular reason for choosing these much duration of tests ?
Regards
Sarath P T
From: [email protected] [mailto:[email protected]] On Behalf Of Chris Paterson
Sent: 18 October 2022 17:38
To: [email protected]
Subject: Re: [cip-dev] Tests run on CIP-LAVA platform
Hello Sarath,
Some of those test jobs you linked to are very old.
Looking at more recent jobs the smc issue you reported is no longer there.
However the RT tests are having issues completing the test due to “/usr/bin/env: 'python': No such file or directory”. The tests seem to get run, but the final step is a python script that parses the results.
We’ll have to get that fixed.
Kind regards, Chris
From: [email protected]<mailto:[email protected]> <[email protected]<mailto:[email protected]>> On Behalf Of P T, Sarath via lists.cip-project.org
Sent: 17 October 2022 08:04
To: [email protected]<mailto:[email protected]>
Subject: [cip-dev] Tests run on CIP-LAVA platform
Hi Team,
I could able to see there are few tests are running in the CIP LAVA platform. I am showing the list below what all LAVA tests are running in the CIP LAVA platform.
Test-case
CIP LAVA job link
Status
Comments
i) spectre-meltdown-checker-test
https://lava.ciplatform.org/scheduler/job/686074<https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flava.ciplatform.org%2Fscheduler%2Fjob%2F686074&data=05%7C01%7Cchris.paterson2%40renesas.com%7C73512d15391248f0e28f08dab00dc6a7%7C53d82571da1947e49cb4625a166a4a2a%7C0%7C0%7C638015870466469681%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=s6LI32yl%2BAq2kMacyP1plIr7bu9DFfaCHGw5ez6E9tY%3D&reserved=0>
Not run
Reason of failure
./spectre-meltdown-checker.sh: Permission denied.
ii) hackbench
https://lava.ciplatform.org/results/634343<https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flava.ciplatform.org%2Fresults%2F634343&data=05%7C01%7Cchris.paterson2%40renesas.com%7C73512d15391248f0e28f08dab00dc6a7%7C53d82571da1947e49cb4625a166a4a2a%7C0%7C0%7C638015870466469681%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=4ajRpqUrsZX0CSIbsFRUWpNJ6cyRoAHXGM2NDzhWlII%3D&reserved=0>
PASS
iii) cyclictest
https://lava.ciplatform.org/results/634097<https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flava.ciplatform.org%2Fresults%2F634097&data=05%7C01%7Cchris.paterson2%40renesas.com%7C73512d15391248f0e28f08dab00dc6a7%7C53d82571da1947e49cb4625a166a4a2a%7C0%7C0%7C638015870466469681%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=m0f%2FygYtt4U4%2Fm7qJ1wHviYPItQxh46wrjXd7iWJSXY%3D&reserved=0>
SKIP
Reason of failure
$ ./cyclictest.sh -D 2m -p 98 -i 1000 -t 1 -a 0 -h '' -w '' this command is giving “/usr/bin/cyclictest: unrecognized option” error
iv) cyclicdeadline
https://lava.ciplatform.org/results/633692<https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flava.ciplatform.org%2Fresults%2F633692&data=05%7C01%7Cchris.paterson2%40renesas.com%7C73512d15391248f0e28f08dab00dc6a7%7C53d82571da1947e49cb4625a166a4a2a%7C0%7C0%7C638015870466625902%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=Q3ixEoBSW8Ld28zwN2bqCjMPqd1UzIPELHdnbTD72Yk%3D&reserved=0>
Not run
Reason of failure
while executing cyclicdeadline.sh getting an error like
/usr/bin/cyclicdeadline: invalid option -- 'q'
Is there any specific reason why few test-cases are running through LAVA ?
Regards
Sarath P T