Skip to contentSkip to conversation

python3: upgrading to 3.9.1 FAILED

AUH [email protected] 1 participant 1 message Dec 15, 2020

lore
Share & tools
lore
#0 lore raw

Hello,

this email is a notification from the Auto Upgrade Helper
that the automatic attempt to upgrade the recipe *python3* to *3.9.1* has Failed(do_compile).

Detailed error information:

do_compile failed

Next steps:
- apply the patch: git am 0001-python3-upgrade-3.9.0-3.9.1.patch
- check the changes to upstream patches and summarize them in the commit message,
- compile an image that contains the package
- perform some basic sanity tests
- amend the patch and sign it off: git commit -s --reset-author --amend
- send it to the appropriate mailing list

Alternatively, if you believe the recipe should not be upgraded at this time, you can fill RECIPE_NO_UPDATE_REASON in respective recipe file so that automatic upgrades would no longer be attempted.

Please review the attached files for further information and build/update failures.
Any problem please file a bug at https://bugzilla.yoctoproject.org/enter_bug.cgi?product=Automated%20Update%20Handler

Regards,
The Upgrade Helper

From 083b549662efbd1a44214cf3fd7f3023684320cd Mon Sep 17 00:00:00 2001
From: Upgrade Helper <[email protected]>
Date: Tue, 15 Dec 2020 07:22:07 +0000
Subject: [PATCH] python3: upgrade 3.9.0 -> 3.9.1

---
 ...-search-system-for-headers-libraries.patch |    6 +-
 ...fig-append-STAGING_LIBDIR-python-sys.patch |   10 +-
 ...tutils-prefix-is-inside-staging-area.patch |    8 +-
 .../python/python3/CVE-2020-27619.patch       |   51 +-
 .../python3/check_build_completeness.py       |   17 -
 .../python/python3/create_manifest3.py        |  433 ------
 .../python/python3/get_module_deps3.py        |  162 ---
 .../python/python3/python3-manifest.json      | 1236 -----------------
 .../python/python3/reformat_sysconfig.py      |   21 -
 .../recipes-devtools/python/python3/run-ptest |    3 -
 .../{python3_3.9.0.bb => python3_3.9.1.bb}    |   11 +-
 11 files changed, 19 insertions(+), 1939 deletions(-)
 delete mode 100755 meta/recipes-devtools/python/python3/check_build_completeness.py
 delete mode 100644 meta/recipes-devtools/python/python3/create_manifest3.py
 delete mode 100644 meta/recipes-devtools/python/python3/get_module_deps3.py
 delete mode 100644 meta/recipes-devtools/python/python3/python3-manifest.json
 delete mode 100644 meta/recipes-devtools/python/python3/reformat_sysconfig.py
 delete mode 100644 meta/recipes-devtools/python/python3/run-ptest
 rename meta/recipes-devtools/python/{python3_3.9.0.bb => python3_3.9.1.bb} (97%)
meta/recipes-devtools/python/python3/0001-Don-t-search-system-for-headers-libraries.patch +3 -3
index a94fa0a5a9..d6f2408157 100644
@@ -1,4 +1,4 @@
-From 9da913bf5f39c6fe737219af7419170574d6fbfb Mon Sep 17 00:00:00 2001
+From 251cdecde6e7e48c233f1c22c3e2a77cd610548d Mon Sep 17 00:00:00 2001
 From: Jeremy Puhlman <[email protected]>
 Date: Wed, 4 Mar 2020 00:06:42 +0000
 Subject: [PATCH] Don't search system for headers/libraries
@@ -11,10 +11,10 @@ Signed-off-by: Jeremy Puhlman <[email protected]>
  1 file changed, 2 insertions(+), 2 deletions(-)
 
 diff --git a/setup.py b/setup.py
-index a0bf9ea..da099bf 100644
+index 7767744..cd3bd36 100644
 --- a/setup.py
 +++ b/setup.py
-@@ -674,8 +674,8 @@ class PyBuildExt(build_ext):
+@@ -769,8 +769,8 @@ class PyBuildExt(build_ext):
              add_dir_to_list(self.compiler.include_dirs,
                              sysconfig.get_config_var("INCLUDEDIR"))
  
meta/recipes-devtools/python/python3/0001-distutils-sysconfig-append-STAGING_LIBDIR-python-sys.patch +5 -5
index b982691b36..9e7a179f06 100644
@@ -1,4 +1,4 @@
-From e65bfe22c858872b08366aff49119d4145a77f40 Mon Sep 17 00:00:00 2001
+From cdfa30a62dceb7cfbde06d57eee26a5f0095a5f2 Mon Sep 17 00:00:00 2001
 From: Alexander Kanavin <[email protected]>
 Date: Thu, 31 Jan 2019 16:46:30 +0100
 Subject: [PATCH] distutils/sysconfig: append
@@ -15,10 +15,10 @@ Signed-off-by: Alexander Kanavin <[email protected]>
  2 files changed, 4 insertions(+)
 
 diff --git a/Lib/distutils/sysconfig.py b/Lib/distutils/sysconfig.py
-index b51629e..2df348c 100644
+index 37feae5..4774e12 100644
 --- a/Lib/distutils/sysconfig.py
 +++ b/Lib/distutils/sysconfig.py
-@@ -438,6 +438,8 @@ def _init_posix():
+@@ -444,6 +444,8 @@ def _init_posix():
          platform=sys.platform,
          multiarch=getattr(sys.implementation, '_multiarch', ''),
      ))
@@ -28,10 +28,10 @@ index b51629e..2df348c 100644
      build_time_vars = _temp.build_time_vars
      global _config_vars
 diff --git a/Lib/sysconfig.py b/Lib/sysconfig.py
-index b2d790b..405273c 100644
+index ed0462b..17ce642 100644
 --- a/Lib/sysconfig.py
 +++ b/Lib/sysconfig.py
-@@ -419,6 +419,8 @@ def _init_posix(vars):
+@@ -417,6 +417,8 @@ def _init_posix(vars):
      """Initialize the module as appropriate for POSIX systems."""
      # _sysconfigdata is generated at build time, see _generate_posix_vars()
      name = _get_sysconfigdata_name()
meta/recipes-devtools/python/python3/12-distutils-prefix-is-inside-staging-area.patch +3 -5
index 5a39cf8933..e5aa3055bb 100644
@@ -1,7 +1,7 @@
-From c52fa7948ef109db1132fdc1aee0b68f8d767b4e Mon Sep 17 00:00:00 2001
+From ffae950c7b5849a3e8340b03e35b44f8b5f153a9 Mon Sep 17 00:00:00 2001
 From: Khem Raj <[email protected]>
 Date: Tue, 14 May 2013 15:00:26 -0700
-Subject: [PATCH 1/2] python3: Add target and native recipes
+Subject: [PATCH] python3: Add target and native recipes
 
 Upstream-Status: Inappropriate [embedded specific]
 
@@ -12,6 +12,7 @@ Signed-Off: Michael 'Mickey' Lauer <[email protected]>
 Signed-off-by: Phil Blundell <[email protected]>
 Signed-off-by: Khem Raj <[email protected]>
 Signed-off-by: Alejandro Hernandez <[email protected]>
+
 ---
  Lib/distutils/sysconfig.py | 14 +++++++++++---
  1 file changed, 11 insertions(+), 3 deletions(-)
@@ -55,6 +56,3 @@ index 4774e12..ccf7d58 100644
                                   "python" + get_python_version())
          if standard_lib:
              return libpython
--- 
-2.24.0
-
meta/recipes-devtools/python/python3/CVE-2020-27619.patch +4 -47

64 lines not on this page · raw message

meta/recipes-devtools/python/python3/check_build_completeness.py deleted +0 -17
deleted file mode 100755
index a1eace3f57..0000000000
@@ -1,17 +0,0 @@
-#!/usr/bin/env python3
-import sys
-logfile = open(sys.argv[1]).read()
-
-necessary_bits = logfile.find("The necessary bits to build these optional modules were not found")
-to_find_bits = logfile.find("To find the necessary bits, look in setup.py in detect_modules() for the module's name.")
-if necessary_bits != -1:
-    print("%s" %(logfile[necessary_bits:to_find_bits]))
-
-failed_to_build = logfile.find("Failed to build these modules:")
-if failed_to_build != -1:
-    failed_to_build_end = logfile.find("\n\n", failed_to_build)
-    print("%s" %(logfile[failed_to_build:failed_to_build_end]))
-
-if necessary_bits != -1 or failed_to_build != -1:
-    sys.exit(1)
-
meta/recipes-devtools/python/python3/create_manifest3.py deleted +0 -433

433 lines not on this page · raw message

meta/recipes-devtools/python/python3/get_module_deps3.py deleted +0 -162

162 lines not on this page · raw message

meta/recipes-devtools/python/python3/python3-manifest.json deleted +0 -1236

1,236 lines not on this page · raw message

meta/recipes-devtools/python/python3/reformat_sysconfig.py deleted +0 -21
deleted file mode 100644
index c4164313e8..0000000000
@@ -1,21 +0,0 @@
-#! /usr/bin/env python3
-#
-# SPDX-License-Identifier: MIT
-#
-# Copyright 2019 by Garmin Ltd. or its subsidiaries
-#
-# A script to reformat python sysconfig
-
-import sys
-import pprint
-l = {}
-g = {}
-with open(sys.argv[1], 'r') as f:
-    exec(f.read(), g, l)
-
-with open(sys.argv[1], 'w') as f:
-    for k in sorted(l.keys()):
-        f.write('%s = ' % k)
-        pprint.pprint(l[k], stream=f, width=sys.maxsize)
-        f.write('\n')
-
meta/recipes-devtools/python/python3/run-ptest deleted +0 -3
deleted file mode 100644
index 405b07f495..0000000000
@@ -1,3 +0,0 @@
-#!/bin/sh
-
-python3 -m test -v | sed -u -e '/\.\.\. ok/ s/^/PASS: /g' -r -e '/\.\.\. (ERROR|FAIL)/ s/^/FAIL: /g' -e '/\.\.\. skipped/ s/^/SKIP: /g' -e 's/ \.\.\. ok//g' -e 's/ \.\.\. ERROR//g' -e 's/ \.\.\. FAIL//g' -e 's/ \.\.\. skipped//g'
meta/recipes-devtools/python/python3_3.9.1.bb renamed from meta/recipes-devtools/python/python3_3.9.0.bb +4 -7
similarity index 97%
rename from meta/recipes-devtools/python/python3_3.9.0.bb
rename to meta/recipes-devtools/python/python3_3.9.1.bb
index 19a8950f15..c98c84fec7 100644
@@ -6,12 +6,6 @@ SECTION = "devel/python"
 LIC_FILES_CHKSUM = "file://LICENSE;md5=33223c9ef60c31e3f0e866cb09b65e83"
 
 SRC_URI = "http://www.python.org/ftp/python/${PV}/Python-${PV}.tar.xz \
-           file://run-ptest \
-           file://create_manifest3.py \
-           file://get_module_deps3.py \
-           file://python3-manifest.json \
-           file://check_build_completeness.py \
-           file://reformat_sysconfig.py \
            file://cgi_py.patch \
            file://0001-Do-not-add-usr-lib-termcap-to-linker-flags-to-avoid-.patch \
            ${@bb.utils.contains('PACKAGECONFIG', 'tk', '', 'file://avoid_warning_about_tkinter.patch', d)} \
@@ -30,6 +24,9 @@ SRC_URI = "http://www.python.org/ftp/python/${PV}/Python-${PV}.tar.xz \
            file://0020-configure.ac-setup.py-do-not-add-a-curses-include-pa.patch \
            file://0001-Lib-sysconfig.py-use-libdir-values-from-configuratio.patch \
            file://CVE-2020-27619.patch \
+           file://0001-distutils-sysconfig-append-STAGING_LIBDIR-python-sys.patch \
+           file://12-distutils-prefix-is-inside-staging-area.patch \
+           file://0001-Don-t-search-system-for-headers-libraries.patch \
            "
 
 SRC_URI_append_class-native = " \
@@ -38,7 +35,7 @@ SRC_URI_append_class-native = " \
            file://0001-Don-t-search-system-for-headers-libraries.patch \
            "
 
-SRC_URI[sha256sum] = "9c73e63c99855709b9be0b3cc9e5b072cb60f37311e8c4e50f15576a0bf82854"
+SRC_URI[sha256sum] = "991c3f8ac97992f3d308fefeb03a64db462574eadbff34ce8bc5bb583d9903ff"
 
 # exclude pre-releases for both python 2.x and 3.x
 UPSTREAM_CHECK_REGEX = "[Pp]ython-(?P<pver>\d+(\.\d+)+).tar"
Signature · 1 line
2.17.1

Loading cache...done.
Loaded 1439 entries from dependency cache.
Parsing recipes...ERROR: /home/pokybuild/yocto-worker/auh/build/build/poky/meta/recipes-devtools/python/python3_3.9.1.bb: Error executing a python function in <code>:

The stack trace of python calls that resulted in this exception/failure was:
File: '<code>', lineno: 15, function: <module>

     0011:__anon_20__home_pokybuild_yocto_worker_auh_build_build_poky_meta_classes_blacklist_bbclass(d)
     0012:__anon_177__home_pokybuild_yocto_worker_auh_build_build_poky_meta_classes_siteinfo_bbclass(d)
     0013:__anon_119__home_pokybuild_yocto_worker_auh_build_build_poky_meta_classes_ptest_bbclass(d)
     0014:__anon_114__home_pokybuild_yocto_worker_auh_build_build_poky_meta_classes_update_alternatives_bbclass(d)
 *** 0015:__anon_297__home_pokybuild_yocto_worker_auh_build_build_poky_meta_recipes_devtools_python_python3_3_9_1_bb(d)
File: '/home/pokybuild/yocto-worker/auh/build/build/poky/meta/recipes-devtools/python/python3_3.9.1.bb', lineno: 232, function: __anon_297__home_pokybuild_yocto_worker_auh_build_build_poky_meta_recipes_devtools_python_python3_3_9_1_bb
     0228:    # This python changes the datastore based on the contents of a file, so mark
     0229:    # that dependency.
     0230:    bb.parse.mark_dependency(d, filename)
     0231:
 *** 0232:    with open(filename) as manifest_file:
     0233:        manifest_str =  manifest_file.read()
     0234:        json_start = manifest_str.find('# EOC') + 6
     0235:        manifest_file.seek(json_start)
     0236:        manifest_str = manifest_file.read()

Exception: FileNotFoundError: [Errno 2] No such file or directory: '/home/pokybuild/yocto-worker/auh/build/build/poky/meta/recipes-devtools/python/python3/python3-manifest.json'

ERROR: Failed to parse recipe: /home/pokybuild/yocto-worker/auh/build/build/poky/meta/recipes-devtools/python/python3_3.9.1.bb

Summary: There were 2 ERROR messages shown, returning a non-zero exit code.