ltp (syscall) failed test in CIP Security image with isar-cip-core v1.6 on M-COM

Hi Chris,

Hope you are doing great.

Do you have any update on testing kernel images built with cip-merged-defconfig<https://gitlab.com/cip-project/cip-kernel/cip-kernel-config/-/blob/master/6.1.y-cip/x86/cip_merged_defconfig?ref_type=heads> in LAVA instead of x86 device specific kernel configurations ?
For IEC 62443-4-2 assessment, CIP needs to provide kernel test reports (LTP) to BV and if it is done through LAVA then well-defined test reports can be provided. Any failed & broken test cases encountered can be easily referenced from LAVA job summary which helps to discuss with CIP members.

Thanks and regards,
Sai Ashrith

________________________________
From: [email protected] <[email protected]> on behalf of [email protected] <[email protected]>
Sent: Friday, December 20, 2024 7:42 PM
To: [email protected] <[email protected]>; [email protected] <[email protected]>
Cc: hayashi kazuhiro(林 和宏 ＤＭＥ ○ＤＩＧ□ＭＰＳ○ＭＰ４) <[email protected]>; dinesh kumar(ＴＳＩＰ TMIEC ODG Porting) <[email protected]>; [email protected] <[email protected]>; [email protected] <[email protected]>
Subject: [cip-dev] ltp (syscall) failed test in CIP Security image with isar-cip-core v1.6 on M-COM

Hello Chris,

Hope you are doing great.

SWG locally executed LTP tests on M-COM x86 device booted with CIP security image. The kernel used in this image is built with cip x86 merged defconfig<https://gitlab.com/cip-project/cip-kernel/cip-kernel-config/-/blob/master/6.1.y-cip/x86/cip_merged_defconfig?ref_type=heads>. After generating the results, we found some failed tests in the syscalls suite.

We wanted to compare them with kernel test results in LAVA and noticed that cip x86 merged defconfig<https://gitlab.com/cip-project/cip-kernel/cip-kernel-config/-/blob/master/6.1.y-cip/x86/cip_merged_defconfig?ref_type=heads> is not being used to run LTP tests on x86 targets. Can you please look into that ?

I am attaching a document with the results summary of LTP tests when run on M-COM x86 device with v1.6 security image. Please have a look at it. I am also attaching the failed test cases in syscalls suite.

We need opinion from members if we need to hold back from sharing the v1.6 x86 generic isar-cip-core evaluation to BV members in case those LTP test failures are effective.

Thanks and regards,
Sai Ashrith