Preparing test evidences for CIP Core packages for IEC 62443-4-x assessment
A message that is not in the archive (sent off-list or not yet received): [email protected]
Hello Iwamatsu-san,
Sorry to bother you again.
Just wanted to follow up on the previous mail regarding the test evidences for CIP Core packages.
Would like to know if you have any suggestions on which other distributions to look into for packages that do not have tests defined in Debian Salsa or upstream.
Thanks and Regards,
Adithya Balakumar
From: [email protected] <[email protected]> On Behalf Of Adithya Balakumar
Sent: Thursday, May 16, 2024 5:10 PM
To: iwamatsu nobuhiro(岩松 信洋 ○ＤＩＴＣ□ＤＩＴ○ＯＳＴ) <[email protected]>
Cc: [email protected]
Subject: [cip-dev] Preparing test evidences for CIP Core packages for IEC 62443-4-x assessment
Hello Iwamatsu-san,
Hope this message finds you well.
We at the CIP Security Workgroup have been working to collect test evidences for CIP Core packages included in CIP Security image as part of IEC 62443-4-x assessment.
To summarize the work done by CIP SWG so far, CIP SWG investigated the number of packages in CIP Security image and tried to understand the number of packages that have test results available in debian and number of packages for which we have to run the tests ourselves and provide the results. I am including the summary of the packages below:
* Total packages in CIP Security image - 242
* Custom CIP packages (from isar-cip-core recipes) - 13
o These packages are created by recipes in isar-cip-core or isar that are deployed into image as a .deb file.
* Packages with Debian CI autopkgtest - 140
o 97 packages with functional tests, 41 packages with non-functional tests, 2 packages with no tests running in debian CI
* Packages without tests in Debian CI - 89
o 70 packages have tests available either in debian salsa or upstream.
* Packages without tests in upstream as well - 19
There are a few packages that do not have tests defined in either debian salsa or upstream. I am listing the packages that do not have tests defined in either debian salsa or upstream below:
Binary Package name
Source package name
Are there Debian CI results ?
Are upstream tests available
Remarks
base-files
base-files
NO
NO
base-passwd
base-passwd
NO
NO
hostname
hostname
NO
NO
libmnl0
libmnl
NO
NO
libnsl2
libnsl
NO
NO
libpam-passwdqc
passwdqc
NO
NO
libpam-pkcs11
pam-pkcs11
NO
NO
libpasswdqc1
passwdqc
NO
NO
libpython3-stdlib
python3-defaults
NO
NO
libreadline8
readline
NO
NO
librtmp1
rtmpdump
NO
NO
linux-base
linux-base
NO
NO
media-types
media-types
NO
NO
net-tools
net-tools
NO
NO
Few functional tests in ubuntu: https://git.launchpad.net/ubuntu/+source/net-tools/tree/debian/tests
Autopkgtest running in Ubuntu CI https://autopkgtest.ubuntu.com/packages/net-tools<https://git.launchpad.net/ubuntu/+source/net-tools/tree/debian/tests>
python3
python3-defaults
NO
NO
python3-minimal
python3-defaults
NO
NO
readline-common
readline
NO
NO
sysvinit-utils
sysvinit
NO
NO
tpm-udev
tpm-udev
NO
NO
As suggested by you in the previous TSC meeting, we are looking for any tests available for the above packages in other distributions as well. So far, we have checked ubuntu, where we found a test suite for the net-tools package. The rest of the packages do not have tests defined in ubuntu as well.
We would like to understand your opinion on the next steps to take or other distributions to target for tests for the above listed packages.
Thanks and Regards,
Adithya Balakumar
Hi,
Quoted 3 lines
As suggested by you in the previous TSC meeting, we are looking for any tests available for the above packages in other distributions as well. So far, we have checked ubuntu, where we found a test suite for the net-tools package. The rest of the packages do not have tests defined in ubuntu as well.
We would like to understand your opinion on the next steps to take or other distributions to target for tests for the above listed packages.
First, we need to think about what kind of testing is needed for each package. The base-files package provides Debian suite information and others, and we need to think about how it needs to be tested.
Next, check the Debian BTS. There may already be a bug report for autopkgtests. If the bug has not been reported to the BTS, create an autopkgtest and report it with the BTS.
For example, the net-tools package is in ubuntu, so we can file a bug requesting that it be included. BTS, there do not seem to be any bug reports for this package.
https://bugs.debian.org/cgi-bin/pkgreport.cgi?repeatmerged=no&src=net-tools
Best regards,
Nobuhiro
Quoted 319 lines
-----Original Message-----
From: balakumar adithya(ＴＳＩＰ TEUR) <[email protected]>
Sent: Sunday, June 2, 2024 11:27 PM
To: iwamatsu nobuhiro(岩松 信洋 ○ＤＩＴＣ□ＤＩＴ○ＯＳＴ) <[email protected]>
Cc: [email protected]
Subject: RE: Preparing test evidences for CIP Core packages for IEC 62443-4-x assessmentHello Iwamatsu-san,
Sorry to bother you again.
Just wanted to follow up on the previous mail regarding the test evidences for CIP Core packages.
Would like to know if you have any suggestions on which other distributions to look into for packages that do not have tests defined in Debian Salsa or upstream.
Thanks and Regards,
Adithya Balakumar
From: [email protected] <[email protected]> On Behalf Of Adithya Balakumar
Sent: Thursday, May 16, 2024 5:10 PM
To: iwamatsu nobuhiro(岩松 信洋 ○ＤＩＴＣ□ＤＩＴ○ＯＳＴ) <[email protected]>
Cc: [email protected]
Subject: [cip-dev] Preparing test evidences for CIP Core packages for IEC 62443-4-x assessmentHello Iwamatsu-san,
Hope this message finds you well.
We at the CIP Security Workgroup have been working to collect test evidences for CIP Core packages included in CIP Security image as part of IEC 62443-4-x assessment.
To summarize the work done by CIP SWG so far, CIP SWG investigated the number of packages in CIP Security image and tried to understand the number of packages that have test results available in debian and number of packages for which we have to run the tests ourselves and provide the results. I am including the summary of the packages below:
* Total packages in CIP Security image - 242
* Custom CIP packages (from isar-cip-core recipes) ? 13
o These packages are created by recipes in isar-cip-core or isar that are
deployed into image as a .deb file.* Packages with Debian CI autopkgtest - 140
o 97 packages with functional tests, 41 packages with non-functional tests,
2 packages with no tests running in debian CI* Packages without tests in Debian CI ? 89
o 70 packages have tests available either in debian salsa or upstream.
* Packages without tests in upstream as well ? 19
There are a few packages that do not have tests defined in either debian salsa or upstream. I am listing the packages that do not have tests defined in either debian salsa or upstream below:
Binary Package name
Source package name
Are there Debian CI results ?
Are upstream tests available
Remarks
base-files
base-files
NO
NO
base-passwd
base-passwd
NO
NO
hostname
hostname
NO
NO
libmnl0
libmnl
NO
NO
libnsl2
libnsl
NO
NO
libpam-passwdqc
passwdqc
NO
NO
libpam-pkcs11
pam-pkcs11
NO
NO
libpasswdqc1
passwdqc
NO
NO
libpython3-stdlib
python3-defaults
NO
NO
libreadline8
readline
NO
NO
librtmp1
rtmpdump
NO
NO
linux-base
linux-base
NO
NO
media-types
media-types
NO
NO
net-tools
net-tools
NO
NO
Few functional tests in ubuntu:
https://git.launchpad.net/ubuntu/+source/net-tools/tree/debian/tests
Autopkgtest running in Ubuntu CI
https://autopkgtest.ubuntu.com/packages/net-tools
<https://git.launchpad.net/ubuntu/+source/net-tools/tree/debian/tests>python3
python3-defaults
NO
NO
python3-minimal
python3-defaults
NO
NO
readline-common
readline
NO
NO
sysvinit-utils
sysvinit
NO
NO
tpm-udev
tpm-udev
NO
NO
As suggested by you in the previous TSC meeting, we are looking for any tests available for the above packages in other distributions as well. So far, we have checked ubuntu, where we found a test suite for the net-tools package. The rest of the packages do not have tests defined in ubuntu as well.
We would like to understand your opinion on the next steps to take or other distributions to target for tests for the above listed packages.
Thanks and Regards,
Adithya Balakumar