Skip to contentSkip to conversation

Tests run on CIP-LAVA platform

DISCUSSION P T, Sarath 2 participants 3 messages Oct 17, 2022 – Oct 18, 2022

lore
Share & tools
lore
#0 lore raw

Hi Team,

I could able to see there are few tests are running in the CIP LAVA platform. I am showing the list below what all LAVA tests are running in the CIP LAVA platform.

Test-case

CIP LAVA job link

Status

Comments

i) spectre-meltdown-checker-test

https://lava.ciplatform.org/scheduler/job/686074

Not run

Reason of failure

./spectre-meltdown-checker.sh: Permission denied.

ii) hackbench

https://lava.ciplatform.org/results/634343

PASS

iii) cyclictest

https://lava.ciplatform.org/results/634097

SKIP

Reason of failure

$ ./cyclictest.sh -D 2m -p 98 -i 1000 -t 1 -a 0 -h '' -w '' this command is giving "/usr/bin/cyclictest: unrecognized option" error

iv) cyclicdeadline

https://lava.ciplatform.org/results/633692

Not run

Reason of failure

while executing cyclicdeadline.sh getting an error like

/usr/bin/cyclicdeadline: invalid option -- 'q'

Is there any specific reason why few test-cases are running through LAVA ?

Regards

Sarath P T

#1 lore raw

Hello Sarath,

Some of those test jobs you linked to are very old.

Looking at more recent jobs the smc issue you reported is no longer there.

However the RT tests are having issues completing the test due to “/usr/bin/env: 'python': No such file or directory”. The tests seem to get run, but the final step is a python script that parses the results.
We’ll have to get that fixed.

Kind regards, Chris

From: [email protected] <[email protected]> On Behalf Of P T, Sarath via lists.cip-project.org
Sent: 17 October 2022 08:04
To: [email protected]
Subject: [cip-dev] Tests run on CIP-LAVA platform

Hi Team,

I could able to see there are few tests are running in the CIP LAVA platform. I am showing the list below what all LAVA tests are running in the CIP LAVA platform.

Test-case
CIP LAVA job link
Status
Comments

i) spectre-meltdown-checker-test
https://lava.ciplatform.org/scheduler/job/686074<https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flava.ciplatform.org%2Fscheduler%2Fjob%2F686074&data=05%7C01%7Cchris.paterson2%40renesas.com%7C73512d15391248f0e28f08dab00dc6a7%7C53d82571da1947e49cb4625a166a4a2a%7C0%7C0%7C638015870466469681%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=s6LI32yl%2BAq2kMacyP1plIr7bu9DFfaCHGw5ez6E9tY%3D&reserved=0>
Not run
Reason of failure

./spectre-meltdown-checker.sh: Permission denied.

ii) hackbench
https://lava.ciplatform.org/results/634343<https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flava.ciplatform.org%2Fresults%2F634343&data=05%7C01%7Cchris.paterson2%40renesas.com%7C73512d15391248f0e28f08dab00dc6a7%7C53d82571da1947e49cb4625a166a4a2a%7C0%7C0%7C638015870466469681%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=4ajRpqUrsZX0CSIbsFRUWpNJ6cyRoAHXGM2NDzhWlII%3D&reserved=0>
PASS

iii) cyclictest
https://lava.ciplatform.org/results/634097<https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flava.ciplatform.org%2Fresults%2F634097&data=05%7C01%7Cchris.paterson2%40renesas.com%7C73512d15391248f0e28f08dab00dc6a7%7C53d82571da1947e49cb4625a166a4a2a%7C0%7C0%7C638015870466469681%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=m0f%2FygYtt4U4%2Fm7qJ1wHviYPItQxh46wrjXd7iWJSXY%3D&reserved=0>
SKIP
Reason of failure

$ ./cyclictest.sh -D 2m -p 98 -i 1000 -t 1 -a 0 -h '' -w '' this command is giving “/usr/bin/cyclictest: unrecognized option” error

iv) cyclicdeadline
https://lava.ciplatform.org/results/633692<https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flava.ciplatform.org%2Fresults%2F633692&data=05%7C01%7Cchris.paterson2%40renesas.com%7C73512d15391248f0e28f08dab00dc6a7%7C53d82571da1947e49cb4625a166a4a2a%7C0%7C0%7C638015870466625902%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=Q3ixEoBSW8Ld28zwN2bqCjMPqd1UzIPELHdnbTD72Yk%3D&reserved=0>
Not run
Reason of failure

while executing cyclicdeadline.sh getting an error like

/usr/bin/cyclicdeadline: invalid option -- 'q'

Is there any specific reason why few test-cases are running through LAVA ?

Regards

Sarath P T

#2 lore raw

Hi Chris, ​

I can see in Linaro/test-definitions (https://github.com/Linaro/test-definitions/tree/master/automated/linux) there are 123 test-suites are present but only 4 test-suites are running on cip lava ?

Few more queries I am having regarding this.
i) Is CIP running the full QA of Linaro/test-definitions test-suites in any other platform ?
ii) All of the tests which has been run in the LAVA CIP platform is 2mins duration. Is there a particular reason for choosing these much duration of tests ?

Regards
Sarath P T

From: [email protected] [mailto:[email protected]] On Behalf Of Chris Paterson
Sent: 18 October 2022 17:38
To: [email protected]
Subject: Re: [cip-dev] Tests run on CIP-LAVA platform

Hello Sarath,

Some of those test jobs you linked to are very old.

Looking at more recent jobs the smc issue you reported is no longer there.

However the RT tests are having issues completing the test due to “/usr/bin/env: 'python': No such file or directory”. The tests seem to get run, but the final step is a python script that parses the results.
We’ll have to get that fixed.

Kind regards, Chris

From: [email protected]<mailto:[email protected]> <[email protected]<mailto:[email protected]>> On Behalf Of P T, Sarath via lists.cip-project.org
Sent: 17 October 2022 08:04
To: [email protected]<mailto:[email protected]>
Subject: [cip-dev] Tests run on CIP-LAVA platform

Hi Team,

I could able to see there are few tests are running in the CIP LAVA platform. I am showing the list below what all LAVA tests are running in the CIP LAVA platform.

Test-case

CIP LAVA job link

Status

Comments

i) spectre-meltdown-checker-test

https://lava.ciplatform.org/scheduler/job/686074<https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flava.ciplatform.org%2Fscheduler%2Fjob%2F686074&data=05%7C01%7Cchris.paterson2%40renesas.com%7C73512d15391248f0e28f08dab00dc6a7%7C53d82571da1947e49cb4625a166a4a2a%7C0%7C0%7C638015870466469681%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=s6LI32yl%2BAq2kMacyP1plIr7bu9DFfaCHGw5ez6E9tY%3D&reserved=0>

Not run

Reason of failure

./spectre-meltdown-checker.sh: Permission denied.

ii) hackbench

https://lava.ciplatform.org/results/634343<https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flava.ciplatform.org%2Fresults%2F634343&data=05%7C01%7Cchris.paterson2%40renesas.com%7C73512d15391248f0e28f08dab00dc6a7%7C53d82571da1947e49cb4625a166a4a2a%7C0%7C0%7C638015870466469681%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=4ajRpqUrsZX0CSIbsFRUWpNJ6cyRoAHXGM2NDzhWlII%3D&reserved=0>

PASS

iii) cyclictest

https://lava.ciplatform.org/results/634097<https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flava.ciplatform.org%2Fresults%2F634097&data=05%7C01%7Cchris.paterson2%40renesas.com%7C73512d15391248f0e28f08dab00dc6a7%7C53d82571da1947e49cb4625a166a4a2a%7C0%7C0%7C638015870466469681%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=m0f%2FygYtt4U4%2Fm7qJ1wHviYPItQxh46wrjXd7iWJSXY%3D&reserved=0>

SKIP

Reason of failure

$ ./cyclictest.sh -D 2m -p 98 -i 1000 -t 1 -a 0 -h '' -w '' this command is giving “/usr/bin/cyclictest: unrecognized option” error

iv) cyclicdeadline

https://lava.ciplatform.org/results/633692<https://jpn01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flava.ciplatform.org%2Fresults%2F633692&data=05%7C01%7Cchris.paterson2%40renesas.com%7C73512d15391248f0e28f08dab00dc6a7%7C53d82571da1947e49cb4625a166a4a2a%7C0%7C0%7C638015870466625902%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=Q3ixEoBSW8Ld28zwN2bqCjMPqd1UzIPELHdnbTD72Yk%3D&reserved=0>

Not run

Reason of failure

while executing cyclicdeadline.sh getting an error like

/usr/bin/cyclicdeadline: invalid option -- 'q'

Is there any specific reason why few test-cases are running through LAVA ?

Regards

Sarath P T