Skip to contentSkip to conversation

oeqa/selftest/reproducibile: Include rust packages

PATCH In review Pgowda 3 participants 5 messages Oct 8, 2021 – Oct 14, 2021

lore
Share & tools
lore

Pgowda

author
#0 lore raw

PATCH 1/1 oeqa/selftest/reproducibile: Include rust packages

rust-llvm-liblto and rust-llvm-staticdev have been tested and generates same ipk, rpm and deb files for reproducibleA and reproducibleB in debain environment.

---
 meta/lib/oeqa/selftest/cases/reproducible.py | 4 ----
 1 file changed, 4 deletions(-)
meta/lib/oeqa/selftest/cases/reproducible.py +0 -4
index e4582cb82a..a147e933cc 100644
@@ -27,8 +27,6 @@ import datetime
 
 # ruby-ri-docs, meson:
 #https://autobuilder.yocto.io/pub/repro-fail/oe-reproducible-20210215-0_td9la2/packages/diff-html/
-# rust-llvm:
-#https://autobuilder.yocto.io/pub/repro-fail/oe-reproducible-20210825-kaihham6/
 exclude_packages = [
 	'glide',
 	'go-helloworld',
@@ -36,8 +34,6 @@ exclude_packages = [
 	'go_',
 	'go-',
 	'ruby-ri-docs',
-	'rust-llvm-liblto',
-	'rust-llvm-staticdev'
 	]
 
 def is_excluded(package):
Signature · 1 line
2.31.1
#1 lore raw
Quoted 23 lines · Pgowda

rust-llvm-liblto and rust-llvm-staticdev have been tested and generates same ipk, rpm and deb files for reproducibleA and reproducibleB in debain environment.

---
 meta/lib/oeqa/selftest/cases/reproducible.py | 4 ----
 1 file changed, 4 deletions(-)
meta/lib/oeqa/selftest/cases/reproducible.py +0 -2
index e4582cb82a..a147e933cc 100644
@@ -27,8 +27,6 @@ import datetime
 
 # ruby-ri-docs, meson:
 #https://autobuilder.yocto.io/pub/repro-fail/oe-reproducible-20210215-0_td9la2/packages/diff-html/
-# rust-llvm:
-#https://autobuilder.yocto.io/pub/repro-fail/oe-reproducible-20210825-kaihham6/
 exclude_packages = [
 	'glide',
 	'go-helloworld',

meta/lib/oeqa/selftest/cases/reproducible.py exclude_packages = [ · line 39

Quoted 8 lines
meta/lib/oeqa/selftest/cases/reproducible.py +0 -2
@@ -36,8 +34,6 @@ exclude_packages = [
 	'go_',
 	'go-',
 	'ruby-ri-docs',
-	'rust-llvm-liblto',
-	'rust-llvm-staticdev'
 	]
 
 def is_excluded(package):

Not sure how you checked this but here is a build where they were not:

https://autobuilder.yoctoproject.org/typhoon/#/builders/118/builds/764

Note the lines:

2021-10-08 04:36:27,176 - oe-selftest - INFO - Reproducibility summary for rpm: same=8819 different=0 different_excluded=11 missing=0 total=8830

unused_exclusions=['go-runtime', 'go_', 'ruby-ri-docs']

i.e. it used the rust exclusions.

Cheers,

Richard

author
#2 lore raw

Hi Richard,

Quoted 1 line
Quoted 1 line

https://autobuilder.yoctoproject.org/typhoon/#/builders/118/builds/764

Thanks very much for sharing your inputs and comments on the issue.

I could see some more builds where rust exclusions were unused:- Some of the example builds are:-
https://autobuilder.yoctoproject.org/typhoon/#/builders/118/builds/757
https://autobuilder.yoctoproject.org/typhoon/#/builders/118/builds/755
https://autobuilder.yoctoproject.org/typhoon/#/builders/118/builds/751

Can you please let me know about this inconsistent behavior? I will try to check the issue based on your inputs.

I tried to build the reproducible with and without rust exclusions on many poky sources.
Could not see this error on any sources ranging over the past two months. More details on the issue are shared at:-
https://bugzilla.yoctoproject.org/show_bug.cgi?id=14525

Thanks,
pgowda

#3 lore raw
Quoted 6 lines · pgowda cve

Hi Richard,

Quoted 1 line
Quoted 1 line

https://autobuilder.yoctoproject.org/typhoon/#/builders/118/builds/764

Thanks very much for sharing your inputs and comments on the issue.

Quoted 7 lines

I could see some more builds where rust exclusions were unused:- Some of the example builds are:-
https://autobuilder.yoctoproject.org/typhoon/#/builders/118/builds/757
https://autobuilder.yoctoproject.org/typhoon/#/builders/118/builds/755
https://autobuilder.yoctoproject.org/typhoon/#/builders/118/builds/751

Can you please let me know about this inconsistent behavior?

The reproducible test runs on different hosts and has two builds it compares. The first build can come from sstate. The second build is built on the specific worker the builds runs on.

We can see from my link above that the build that shows reproducibility issues ran on fedora33 so it is probably something specific to that distro.

The most likely way to reproduce the issue is therefore to build on something like an ubuntu system and compare the packages with those built on a fedora33 system.

Quoted 7 lines

I will try to check the issue based on your inputs.

I tried to build the reproducible with and without rust exclusions on many poky sources.
Could not see this error on any sources ranging over the past two months. More details on the issue are shared at:-
https://bugzilla.yoctoproject.org/show_bug.cgi?id=14525

It sounds like you're only testing on debian whilst the autobuilder has multiple different hosts which is the difference.

Cheers,

Richard

#4 lore raw

Hi Pgowda,

Quoted 40 lines · Richard Purdie
Quoted 6 lines · pgowda cve

Hi Richard,

Quoted 1 line
Quoted 1 line

https://autobuilder.yoctoproject.org/typhoon/#/builders/118/builds/764

Thanks very much for sharing your inputs and comments on the issue.

Quoted 7 lines

I could see some more builds where rust exclusions were unused:- Some of the example builds are:-
https://autobuilder.yoctoproject.org/typhoon/#/builders/118/builds/757
https://autobuilder.yoctoproject.org/typhoon/#/builders/118/builds/755
https://autobuilder.yoctoproject.org/typhoon/#/builders/118/builds/751

Can you please let me know about this inconsistent behavior?

The reproducible test runs on different hosts and has two builds it compares.
The first build can come from sstate. The second build is built on the specific
worker the builds runs on.

We can see from my link above that the build that shows reproducibility issues
ran on fedora33 so it is probably something specific to that distro.

The most likely way to reproduce the issue is therefore to build on something
like an ubuntu system and compare the packages with those built on a fedora33
system.

Quoted 8 lines

I will try to check the issue based on your inputs.

I tried to build the reproducible with and without rust exclusions on many poky sources.
Could not see this error on any sources ranging over the past two months.
More details on the issue are shared at:-
https://bugzilla.yoctoproject.org/show_bug.cgi?id=14525

Quoted 8 lines

It sounds like you're only testing on debian whilst the autobuilder has multiple
different hosts which is the difference.

Cheers,

Richard

There is a new occurrence of the reproducibility issue on Fedora 33 :
https://autobuilder.yoctoproject.org/typhoon/#/builders/118/builds/782/steps/12/logs/stdio

Best regards,
Thomas

Quoted 12 lines

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group. View/Reply Online (#156782):
https://lists.openembedded.org/g/openembedded-core/message/156782
Mute This Topic: https://lists.openembedded.org/mt/86165875/5443093
Group Owner: [email protected] Unsubscribe:
https://lists.openembedded.org/g/openembedded-core/unsub [[email protected]
]
-=-=-=-=-=-=-=-=-=-=-=-

Signature · 3 lines
Thomas Perrot, Bootlin
Embedded Linux and kernel engineering
https://bootlin.com