Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from picard.linux.it (picard.linux.it [213.254.12.146]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id 72852C369BA for ; Wed, 16 Apr 2025 09:04:38 +0000 (UTC) Received: from picard.linux.it (localhost [IPv6:::1]) by picard.linux.it (Postfix) with ESMTP id E4DEB3CB976 for ; Wed, 16 Apr 2025 11:04:36 +0200 (CEST) Received: from in-6.smtp.seeweb.it (in-6.smtp.seeweb.it [IPv6:2001:4b78:1:20::6]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (secp384r1)) (No client certificate requested) by picard.linux.it (Postfix) with ESMTPS id 2C2543CA59D for ; Wed, 16 Apr 2025 11:04:01 +0200 (CEST) Authentication-Results: in-6.smtp.seeweb.it; spf=pass (sender SPF authorized) smtp.mailfrom=suse.de (client-ip=2a07:de40:b251:101:10:150:64:1; helo=smtp-out1.suse.de; envelope-from=andrea.cervesato@suse.de; receiver=lists.linux.it) Received: from smtp-out1.suse.de (smtp-out1.suse.de [IPv6:2a07:de40:b251:101:10:150:64:1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by in-6.smtp.seeweb.it (Postfix) with ESMTPS id D2EB91400B93 for ; Wed, 16 Apr 2025 11:04:00 +0200 (CEST) Received: from imap1.dmz-prg2.suse.org (unknown [10.150.64.97]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by smtp-out1.suse.de (Postfix) with ESMTPS id 56C4A21192; Wed, 16 Apr 2025 09:03:59 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=suse.de; s=susede2_rsa; t=1744794239; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=NMPKQ0OTaiV3ScanpB6AjgdWs/3fLdif0iTi3l2f7Ts=; b=qcN1oQtq8BP6eRgj4DINlOA0iWtgMWrYuyNLc9d5qaxnzGEJTU8aXaNw/VhJ9AOB+DPj12 IrXxtW4ElG4mIaRo1yNK5UonVhd96LA/iBIL3BkLDtcFnXeQ2CWlUstbBJwrwv20sC/Wlh Vb3p8z7ntqyhIYjZ5Yv3d2GIhzZ5IuY= DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/relaxed; d=suse.de; s=susede2_ed25519; t=1744794239; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=NMPKQ0OTaiV3ScanpB6AjgdWs/3fLdif0iTi3l2f7Ts=; b=8vIqQ6xqrFE/QPCKqu7ECWjHTlHjKmnUdf6NEo4LEcCoxeVTfcjHC6mOlIVZ7Wl0vt6tQY qYNDeOTUBdNCiCAw== Authentication-Results: smtp-out1.suse.de; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=suse.de; s=susede2_rsa; t=1744794239; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=NMPKQ0OTaiV3ScanpB6AjgdWs/3fLdif0iTi3l2f7Ts=; b=qcN1oQtq8BP6eRgj4DINlOA0iWtgMWrYuyNLc9d5qaxnzGEJTU8aXaNw/VhJ9AOB+DPj12 IrXxtW4ElG4mIaRo1yNK5UonVhd96LA/iBIL3BkLDtcFnXeQ2CWlUstbBJwrwv20sC/Wlh Vb3p8z7ntqyhIYjZ5Yv3d2GIhzZ5IuY= DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/relaxed; d=suse.de; s=susede2_ed25519; t=1744794239; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=NMPKQ0OTaiV3ScanpB6AjgdWs/3fLdif0iTi3l2f7Ts=; b=8vIqQ6xqrFE/QPCKqu7ECWjHTlHjKmnUdf6NEo4LEcCoxeVTfcjHC6mOlIVZ7Wl0vt6tQY qYNDeOTUBdNCiCAw== Received: from imap1.dmz-prg2.suse.org (localhost [127.0.0.1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by imap1.dmz-prg2.suse.org (Postfix) with ESMTPS id 2972813976; Wed, 16 Apr 2025 09:03:59 +0000 (UTC) Received: from dovecot-director2.suse.de ([2a07:de40:b281:106:10:150:64:167]) by imap1.dmz-prg2.suse.org with ESMTPSA id b2bdB39y/2foagAAD6G6ig (envelope-from ); Wed, 16 Apr 2025 09:03:59 +0000 From: Andrea Cervesato Date: Wed, 16 Apr 2025 11:03:57 +0200 Message-Id: <20250416-patchwork_ci-v8-0-503a29526f0a@suse.com> MIME-Version: 1.0 X-B4-Tracking: v=1; b=H4sIAH1y/2cC/33NzWoDIRSG4VsJrmtQx9+ueh8lFD0eO1KaCZpOG sLce0xWg5BZfgee99xIxZKxkvfdjRScc83TsQ37tiMw+uM30hzbJoIJxSRn9OTPMF6m8vMFmZo I0iMTIFkkjZwKpvz/zH0e2h5zPU/l+qzP/HF9EZo5ZTRissoKlaT2H/Wv4h6mX/LozGLLimaFt UkGtINKqbPD2vLODs2CC8Ex0E7z0Fm5ZWWzJg2gghfOet5Zvbaqs7pZy1FHya30SXXWbFnTbAA WnI/gnVn/XZblDhUR/d3TAQAA X-Change-ID: 20250410-patchwork_ci-7dc4ae02c40d To: ltp@lists.linux.it X-Mailer: b4 0.14.2 X-Developer-Signature: v=1; a=ed25519-sha256; t=1744794239; l=4008; i=andrea.cervesato@suse.com; s=20240812; h=from:subject:message-id; bh=EDJbIZBkwnCsBbSyd43k2t+23DvroyZ5QCzKII3hgmg=; b=vAWtMpX+rd41bQO0dGzxezWF24LbRNcTN+tNv0GrlTAw6ywOMp0sdA710ASQd1Y62co8Ghz4o 8t0Z1EOFG0mBbDtzYmbOBl2ARIvxEAXIGca6jQW1SPmYUUOr4BGSJ0L X-Developer-Key: i=andrea.cervesato@suse.com; a=ed25519; pk=RG/nLJ5snb1tLKGwSORQXBJ5XA4juT0WF2Pc/lq9meo= X-Spamd-Result: default: False [-4.30 / 50.00]; BAYES_HAM(-3.00)[100.00%]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.20)[-1.000]; MIME_GOOD(-0.10)[text/plain]; RCVD_VIA_SMTP_AUTH(0.00)[]; MIME_TRACE(0.00)[0:+]; ARC_NA(0.00)[]; TO_DN_SOME(0.00)[]; RCVD_TLS_ALL(0.00)[]; DKIM_SIGNED(0.00)[suse.de:s=susede2_rsa,suse.de:s=susede2_ed25519]; FUZZY_BLOCKED(0.00)[rspamd.com]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; FROM_EQ_ENVFROM(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; DBL_BLOCKED_OPENRESOLVER(0.00)[suse.com:mid, suse.com:email, imap1.dmz-prg2.suse.org:helo] X-Virus-Scanned: clamav-milter 1.0.3 at in-6.smtp.seeweb.it X-Virus-Status: Clean Subject: [LTP] [PATCH v8 0/4] Support for Patchwork CI X-BeenThere: ltp@lists.linux.it X-Mailman-Version: 2.1.29 Precedence: list List-Id: Linux Test Project List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Errors-To: ltp-bounces+ltp=archiver.kernel.org@lists.linux.it Sender: "ltp" Add support for patch-series validation in the patchwork ML. We use Github to schedule a trigger every 30 minutes, checking for new patche-series in parchwork which has not been tested yet. The way we decide if a patch-series has been tested in patchwork, is by looking at its status (in particular, if it's "Needs Review / ACK"), as well as checking if test report has been uploaded to any of the series patches. All communication to Patchwrok is done via REST API, using curl and js tools. First, we create a script called patchwork-ci.sh that provides all the commands to read new untested patch-series, set their status and testing report. Then, we create a scheduled workflow in Gitlab, checking every 30 minutes if there are new untested patch-series. At the end, we trigger the main build workflow, used to validate LTP commits in our Github mainline. All the times we trigger the build workflow, we also provide the patch-series ID, that will be fetched and applied on the current branch before running the tests. Signed-off-by: Andrea Cervesato --- Changes in v8: - patchwork.sh: avoid masking curl stdout with local - Link to v7: https://lore.kernel.org/r/20250415-patchwork_ci-v7-0-bc0b9adca971@suse.com Changes in v7: - patchwork.sh: fix bashism == - patchwork.sh: fix return code check for curl - patchwork.sh: remove IFS= from loops - patchwork.sh: local cmd in command_exists - fix message for trigger scripts commit - Link to v6: https://lore.kernel.org/r/20250415-patchwork_ci-v6-0-81e6d4184af5@suse.com Changes in v6: - patchwork.sh: use more "[ $stuff ] || do_something" syntax - patchwork.sh: remove set -ex - patchwork.sh: variables default setup - patchwork.sh: move file creation in tmp folder - patchwork.sh: check multiple commands exist in once - trigger workflow now triggers only on linux-test-project/ltp repo - Link to v5: https://patchwork.ozlabs.org/project/ltp/list/?series=452320 Changes in v5: - patchwork is now a utility that can be used separately - Link to v4: https://lore.kernel.org/r/20250411-patchwork_ci-v4-0-7f3c5ba298a1@suse.com Changes in v4: - make use of secrets to apply patches in order to set state to needs-review-ack - check for curl failures and eventually exit 1 - use a different format for stored file in 'patchwork-ci.sh verify' command - define PATCHWORK_CI_FILE - some symbols like . are not supported by patchwork checks, so slurmify the string before sending checks context - Link to v3: https://lore.kernel.org/r/20250411-patchwork_ci-v3-0-c9bb90c6961b@suse.com Changes in v3: - secrets are not supported by if: statement, so we remove it - Link to v2: https://lore.kernel.org/r/20250410-patchwork_ci-v2-0-288f4be835ff@suse.com Changes in v2: - check for secrets.PATCHWORK_TOKEN before sending tests results - v2 to re-trigger lore after missing 3/4 patch - Link to v1: https://lore.kernel.org/r/20250410-patchwork_ci-v1-0-def85825f46a@suse.com --- Andrea Cervesato (4): ci: install dependences for patchwork-ci script ci: add patchwork communication script ci: add ci-patchwork-trigger workflow ci: apply patchwork series in ci-docker-build workflow .github/workflows/ci-docker-build.yml | 39 ++++++- .github/workflows/ci-patchwork-trigger.yml | 65 +++++++++++ ci/alpine-runtime.sh | 2 + ci/alpine.sh | 2 + ci/debian.i386.sh | 2 + ci/debian.sh | 2 + ci/fedora.sh | 2 + ci/tools/patchwork.sh | 179 +++++++++++++++++++++++++++++ ci/tumbleweed.sh | 2 + 9 files changed, 294 insertions(+), 1 deletion(-) --- base-commit: 40c559787d15b2167ba657b3ba431e3299969d98 change-id: 20250410-patchwork_ci-7dc4ae02c40d Best regards, -- Andrea Cervesato -- Mailing list info: https://lists.linux.it/listinfo/ltp