Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id 36DAACDB465 for ; Mon, 16 Oct 2023 15:37:31 +0000 (UTC) Received: from gate.crashing.org (gate.crashing.org [63.228.1.57]) by mx.groups.io with SMTP id smtpd.web10.129942.1697470644506381769 for ; Mon, 16 Oct 2023 08:37:24 -0700 Authentication-Results: mx.groups.io; dkim=none (message not signed); spf=pass (domain: kernel.crashing.org, ip: 63.228.1.57, mailfrom: mark.hatle@kernel.crashing.org) Received: from [192.168.2.236] ([70.99.78.137]) by gate.crashing.org (8.14.1/8.14.1) with ESMTP id 39GFbN6a025185 for ; Mon, 16 Oct 2023 10:37:23 -0500 Message-ID: Date: Mon, 16 Oct 2023 10:37:22 -0500 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:102.0) Gecko/20100101 Thunderbird/102.15.1 Subject: Re: [OE-core] Recent failures on master depmodwrapper-cross To: openembedded-core@lists.openembedded.org References: Content-Language: en-US From: Mark Hatle In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: quoted-printable X-MIME-Autoconverted: from 8bit to quoted-printable by gate.crashing.org id 39GFbN6a025185 List-Id: X-Webhook-Received: from li982-79.members.linode.com [45.33.32.79] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Mon, 16 Oct 2023 15:37:31 -0000 X-Groupsio-URL: https://lists.openembedded.org/g/openembedded-core/message/189299 On 10/16/23 7:17=E2=80=AFAM, Yoann Congal wrote: > Hi Mark, >=20 > Le lun. 16 oct. 2023 =C3=A0 02:40, Mark Hatle via lists.openembedded.or= g > a =C3=A9crit : >> Running a number of builds recently, a small number of them failed. N= ote we ran about 20 builds and only 3 failed like this, the others comple= ted. I'm wondering if maybe there is a race condition with the new code? >=20 > FYI, RP did point me to this thread (that I did miss sorry) and I > (co-author of the "new code") will send two patches to prevent the > error the happen again. > RP's hypothesis is that this is linked to S=3DWORKDIR recipes. Did all > your crashed build happened on "depmodwrapper-cross" (Which is > S=3DWORKDIR) ? Yes, they all failed on depmodwrapper-cross. Happy to test changes for you. --Mark > Thanks! >=20 >> Error: >> >> ERROR: depmodwrapper-cross-1.0-r0 do_patch: Error executing a python f= unction in exec_func_python() autogenerated: >> >> The stack trace of python calls that resulted in this exception/failur= e was: >> File: 'exec_func_python() autogenerated', lineno: 2, function: >> 0001: >> *** 0002:do_qa_patch(d) >> 0003: >> File: '/scratch/jenkins-BUILDS-eSDK-dev_eSDK-eSDK-master-next-pipeline= -8_ZynqMpDrFull/sources/poky/meta/classes-global/insane.bbclass', lineno:= 1379, function: do_qa_patch >> 1375: elif os.path.exists(os.path.join(srcdir, "t")) and any(filena= me.endswith('.t') for filename in os.listdir(os.path.join(srcdir, 't'))): >> 1376: oe.qa.handle_error("unimplemented-ptest", "%s: perl Test:= : based tests detected" % d.getVar('PN'), d) >> 1377: >> 1378: # Detect pytest-based tests >> *** 1379: elif match_line_in_files(srcdir, "**/*.py", r'\s*(?:impor= t\s*pytest|from\s*pytest)'): >> 1380: oe.qa.handle_error("unimplemented-ptest", "%s: pytest-bas= ed tests detected" % d.getVar('PN'), d) >> 1381: >> 1382: # Detect meson-based tests >> 1383: elif os.path.exists(os.path.join(srcdir, "meson.build")) and = match_line_in_files(srcdir, "**/meson.build", r'\s*test\s*\('): >> File: '/scratch/jenkins-BUILDS-eSDK-dev_eSDK-eSDK-master-next-pipeline= -8_ZynqMpDrFull/sources/poky/meta/classes-global/insane.bbclass', lineno:= 1357, function: match_line_in_files >> 1353: #############################################################= ############## >> 1354: def match_line_in_files(toplevel, filename_glob, line_regex): >> 1355: import pathlib >> 1356: toppath =3D pathlib.Path(toplevel) >> *** 1357: for entry in toppath.glob(filename_glob): >> 1358: try: >> 1359: with open(entry, 'r', encoding=3D'utf-8', errors=3D= 'ignore') as f: >> 1360: for line in f.readlines(): >> 1361: if re.match(line_regex, line): >> File: '/usr/lib/python3.10/pathlib.py', lineno: 1034, function: glob >> 1030: drv, root, pattern_parts =3D self._flavour.parse_parts((p= attern,)) >> 1031: if drv or root: >> 1032: raise NotImplementedError("Non-relative patterns are = unsupported") >> 1033: selector =3D _make_selector(tuple(pattern_parts), self._f= lavour) >> *** 1034: for p in selector.select_from(self): >> 1035: yield p >> 1036: >> 1037: def rglob(self, pattern): >> 1038: """Recursively yield all existing files (of any kind, inc= luding >> File: '/usr/lib/python3.10/pathlib.py', lineno: 493, function: _select= _from >> 0489: yielded =3D set() >> 0490: try: >> 0491: successor_select =3D self.successor._select_from >> 0492: for starting_point in self._iterate_directories(p= arent_path, is_dir, scandir): >> *** 0493: for p in successor_select(starting_point,= is_dir, exists, scandir): >> 0494: if p not in yielded: >> 0495: yield p >> 0496: yielded.add(p) >> 0497: finally: >> File: '/usr/lib/python3.10/pathlib.py', lineno: 440, function: _select= _from >> 0436: _Selector.__init__(self, child_parts, flavour) >> 0437: >> 0438: def _select_from(self, parent_path, is_dir, exists, scandir): >> 0439: try: >> *** 0440: with scandir(parent_path) as scandir_it: >> 0441: entries =3D list(scandir_it) >> 0442: for entry in entries: >> 0443: if self.dironly: >> 0444: try: >> Exception: FileNotFoundError: [Errno 2] No such file or directory: '/s= cratch/jenkins-BUILDS-eSDK-dev_eSDK-eSDK-master-next-pipeline-8_ZynqMpDrF= ull/build/tmp/work/zynqmp_generic-xilinx-linux/depmodwrapper-cross/1.0/ss= tate-build-create_spdx' >> >> ERROR: Logfile of failure stored in: /scratch/jenkins-BUILDS-eSDK-dev_= eSDK-eSDK-master-next-pipeline-8_ZynqMpDrFull/build/tmp/work/zynqmp_gener= ic-xilinx-linux/depmodwrapper-cross/1.0/temp/log.do_patch.1966488 >> >> >> >> >> >> -=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D- >> Links: You receive all messages sent to this group. >> View/Reply Online (#189290): https://lists.openembedded.org/g/openembe= dded-core/message/189290 >> Mute This Topic: https://lists.openembedded.org/mt/101987519/3616948 >> Group Owner: openembedded-core+owner@lists.openembedded.org >> Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub = [mark.hatle@kernel.crashing.org] >> -=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D-=3D- >>