gitlab: add jobs for checking paches
cover gitlab: add jobs for checking paches
This introduces two new jobs to GitLab. The first runs "checkpatch.pl" across all patches, while the second is a dedicated DCO signoff check.
While checkpatch.pl does validate DCO signoff, it is sub-optimal as we need to allow the checkpatch.pl job to fail as there are always patches which intentionally violate some rules, and we've no mechanism for marking permitted exceptions in code. Thus the checkpatch.pl jobs needs to be non-fatal allowing failure.
By having a separate DCO job, we can make that particular job mandatory.
Checking patches themselves in GitLab CI is a little difficult, as the CI job receives no indication of what the base ancestor was for the branch being tested. To work around this, we add the master QEMU git repo as a new remote and ask git to find the common ancestor vs the branch being tested.
An example pipeline showing failure of these two jobs is here:
https://gitlab.com/berrange/qemu/-/pipelines/191219666
The checkpatch.pl job failure output:
https://gitlab.com/berrange/qemu/-/jobs/743439455
And the DCO signoff job failure output:
https://gitlab.com/berrange/qemu/-/jobs/743439456
I think the latter shows the benefit of having a dedicated DCO signoff job checker, as the info presented to the user is much clearer about what they did wrong and how & why they must address it.
_+# base: master
Daniel P. Berrangé (3):
gitlab: add a CI job for running checkpatch.pl
gitlab: add a CI job to validate the DCO sign off
gitlab: assign python helper files to GitLab maintainers section
.gitlab-ci.d/check-dco.py | 94 +++++++++++++++++++++++++++++++++++++ .gitlab-ci.d/check-patch.py | 48 +++++++++++++++++++ .gitlab-ci.yml | 22 +++++++++ MAINTAINERS | 1 + 4 files changed, 165 insertions(+) create mode 100755 .gitlab-ci.d/check-dco.py create mode 100755 .gitlab-ci.d/check-patch.py
Signature · 1 line
2.26.2
PATCH 1/3 gitlab: add a CI job for running checkpatch.pl
This job is advisory since it is expected that certain patches will fail the style checks and checkpatch.pl provides no way to mark exceptions to the rules.
--- .gitlab-ci.d/check-patch.py | 48 +++++++++++++++++++++++++++++++++++++ .gitlab-ci.yml | 12 ++++++++++ 2 files changed, 60 insertions(+) create mode 100755 .gitlab-ci.d/check-patch.py
.gitlab-ci.d/check-patch.py new file +48 -0
@@ -0,0 +1,48 @@ +#!/usr/bin/env python3 +# +# check-patch.py: run checkpatch.pl across all commits in a branch +# +# Copyright (C) 2020 Red Hat, Inc. +# +# SPDX-License-Identifier: GPL-2.0-or-later + +import os +import os.path +import sys +import subprocess + +namespace = "qemu-project" +if len(sys.argv) >= 2: + namespace = sys.argv[1] + +cwd = os.getcwd() +reponame = os.path.basename(cwd) +repourl = "https://gitlab.com/%s/%s.git" % (namespace, reponame) + +# GitLab CI environment does not give us any direct info about the +# base for the user's branch. We thus need to figure out a common +# ancestor between the user's branch and current git master. +subprocess.check_call(["git", "remote", "add", "check-patch", repourl]) +subprocess.check_call(["git", "fetch", "check-patch", "master"], + stdout=subprocess.DEVNULL, + stderr=subprocess.DEVNULL) + +ancestor = subprocess.check_output(["git", "merge-base", + "check-patch/master", "HEAD"], + universal_newlines=True) + +ancestor = ancestor.strip() + +subprocess.check_call(["git", "remote", "rm", "check-patch"]) + +errors = False + +print("\nChecking all commits since %s...\n" % ancestor) + +ret = subprocess.run(["scripts/checkpatch.pl", ancestor + "..."]) + +if ret.returncode != 0: + print(" ❌ FAIL one or more commits failed scripts/checkpatch.pl") + sys.exit(1) + +sys.exit(0)
.gitlab-ci.yml +12 -0
@@ -369,3 +369,15 @@ check-crypto-only-gnutls: variables: IMAGE: centos7 MAKE_CHECK_ARGS: check + + +check-patch: + stage: test + image: $CI_REGISTRY_IMAGE/qemu/centos8:latest + script: .gitlab-ci.d/check-patch.py + except: + variables: + - $CI_PROJECT_NAMESPACE == 'qemu-project' && $CI_COMMIT_BRANCH == 'master' + variables: + GIT_DEPTH: 1000 + allow_failure: true
Signature · 1 line
2.26.2
Re: [PATCH 1/3] gitlab: add a CI job for running checkpatch.pl
Quoted 55 lines · Daniel P. Berrangé
This job is advisory since it is expected that certain patches will fail the style checks and checkpatch.pl provides no way to mark exceptions to the rules.
Signed-off-by Daniel P. Berrangé <[email protected]>--- .gitlab-ci.d/check-patch.py | 48 +++++++++++++++++++++++++++++++++++++ .gitlab-ci.yml | 12 ++++++++++ 2 files changed, 60 insertions(+) create mode 100755 .gitlab-ci.d/check-patch.py.gitlab-ci.d/check-patch.py new file +38
-0@@ -0,0 +1,48 @@ +#!/usr/bin/env python3 +# +# check-patch.py: run checkpatch.pl across all commits in a branch +# +# Copyright (C) 2020 Red Hat, Inc. +# +# SPDX-License-Identifier: GPL-2.0-or-later + +import os +import os.path +import sys +import subprocess + +namespace = "qemu-project" +if len(sys.argv) >= 2: + namespace = sys.argv[1] + +cwd = os.getcwd() +reponame = os.path.basename(cwd) +repourl = "https://gitlab.com/%s/%s.git" % (namespace, reponame) + +# GitLab CI environment does not give us any direct info about the +# base for the user's branch. We thus need to figure out a common +# ancestor between the user's branch and current git master. +subprocess.check_call(["git", "remote", "add", "check-patch", repourl]) +subprocess.check_call(["git", "fetch", "check-patch", "master"], + stdout=subprocess.DEVNULL, + stderr=subprocess.DEVNULL) + +ancestor = subprocess.check_output(["git", "merge-base", + "check-patch/master", "HEAD"], + universal_newlines=True) + +ancestor = ancestor.strip() + +subprocess.check_call(["git", "remote", "rm", "check-patch"]) + +errors = False
.gitlab-ci.d/check-patch.py line 48
Quoted 10 lines
.gitlab-ci.d/check-patch.py new file +10
-0+ +print("\nChecking all commits since %s...\n" % ancestor) + +ret = subprocess.run(["scripts/checkpatch.pl", ancestor + "..."]) + +if ret.returncode != 0: + print(" ❌ FAIL one or more commits failed scripts/checkpatch.pl") + sys.exit(1) + +sys.exit(0)
Hmm I'm very tempted to add various check I've been reluctant to add to checkpatch.pl here, and use check-patch.py instead...
Re: [PATCH 1/3] gitlab: add a CI job for running checkpatch.pl
In reply to Daniel P. BerrangéQuoted 10 lines · Daniel P. Berrangé
This job is advisory since it is expected that certain patches will fail the style checks and checkpatch.pl provides no way to mark exceptions to the rules.
Signed-off-by Daniel P. Berrangé <[email protected]>--- .gitlab-ci.d/check-patch.py | 48 +++++++++++++++++++++++++++++++++++++ .gitlab-ci.yml | 12 ++++++++++ 2 files changed, 60 insertions(+) create mode 100755 .gitlab-ci.d/check-patch.py
[...]
.gitlab-ci.yml check-crypto-only-gnutls: · line 375
Quoted 12 lines
.gitlab-ci.yml +4
-0@@ -369,3 +369,15 @@ check-crypto-only-gnutls: variables: IMAGE: centos7 MAKE_CHECK_ARGS: check + + +check-patch: + stage: test
Would it be ok to move this to the "build" stage, so that the job does not have to wait for all the slow build jobs to finish?
(same question applies for the next patch, too)
If you agree, I can do the change when picking up the patches, no need to resend just because of this.
Thomas
Re: [PATCH 1/3] gitlab: add a CI job for running checkpatch.pl
Quoted 29 lines · Thomas Huth
Quoted 10 lines · Daniel P. Berrangé
This job is advisory since it is expected that certain patches will fail the style checks and checkpatch.pl provides no way to mark exceptions to the rules.
Signed-off-by Daniel P. Berrangé <[email protected]>--- .gitlab-ci.d/check-patch.py | 48 +++++++++++++++++++++++++++++++++++++ .gitlab-ci.yml | 12 ++++++++++ 2 files changed, 60 insertions(+) create mode 100755 .gitlab-ci.d/check-patch.py[...]
.gitlab-ci.yml check-crypto-only-gnutls: · line 375
Quoted 12 lines
.gitlab-ci.yml +4
-0@@ -369,3 +369,15 @@ check-crypto-only-gnutls: variables: IMAGE: centos7 MAKE_CHECK_ARGS: check + + +check-patch: + stage: testWould it be ok to move this to the "build" stage, so that the job does not have to wait for all the slow build jobs to finish?
(same question applies for the next patch, too)
Quoted 2 lines
If you agree, I can do the change when picking up the patches, no need to resend just because of this.
Sure, fine with me.
Regards,
Daniel
Signature · 3 lines
|: https://berrange.com -o- https://www.flickr.com/photos/dberrange :| |: https://libvirt.org -o- https://fstop138.berrange.com :| |: https://entangle-photo.org -o- https://www.instagram.com/dberrange :|
PATCH 2/3 gitlab: add a CI job to validate the DCO sign off
In reply to Daniel P. BerrangéWhile checkpatch.pl can validate DCO sign off that job must always be advisory only since it is expected that certain patches will fail some code style rules.
We require the DCO sign off to be mandatory for all commits though, so it benefits from being validated in a standalone job.
--- .gitlab-ci.d/check-dco.py | 94 +++++++++++++++++++++++++++++++++++++++ .gitlab-ci.yml | 10 +++++ 2 files changed, 104 insertions(+) create mode 100755 .gitlab-ci.d/check-dco.py
.gitlab-ci.d/check-dco.py new file +94 -0
@@ -0,0 +1,94 @@ +#!/usr/bin/env python3 +# +# check-dco.py: validate all commits are signed off +# +# Copyright (C) 2020 Red Hat, Inc. +# +# SPDX-License-Identifier: GPL-2.0-or-later + +import os +import os.path +import sys +import subprocess + +namespace = "qemu-project" +if len(sys.argv) >= 2: + namespace = sys.argv[1] + +cwd = os.getcwd() +reponame = os.path.basename(cwd) +repourl = "https://gitlab.com/%s/%s.git" % (namespace, reponame) + +subprocess.check_call(["git", "remote", "add", "check-dco", repourl]) +subprocess.check_call(["git", "fetch", "check-dco", "master"], + stdout=subprocess.DEVNULL, + stderr=subprocess.DEVNULL) + +ancestor = subprocess.check_output(["git", "merge-base", + "check-dco/master", "HEAD"], + universal_newlines=True) + +ancestor = ancestor.strip() + +subprocess.check_call(["git", "remote", "rm", "check-dco"]) + +errors = False + +print("\nChecking for 'Signed-off-by: NAME <EMAIL>' " + + "on all commits since %s...\n" % ancestor) + +log = subprocess.check_output(["git", "log", "--format=%H %s", + ancestor + "..."], + universal_newlines=True) + +if log == "": + commits = [] +else: + commits = [[c[0:40], c[41:]] for c in log.strip().split("\n")] + +for sha, subject in commits: + + msg = subprocess.check_output(["git", "show", "-s", sha], + universal_newlines=True) + lines = msg.strip().split("\n") + + print("🔍 %s %s" % (sha, subject)) + sob = False + for line in lines: + if "Signed-off-by:" in line: + sob = True + if "localhost" in line: + print(" ❌ FAIL: bad email in %s" % line) + errors = True + + if not sob: + print(" ❌ FAIL missing Signed-off-by tag") + errors = True + +if errors: + print(""" + +❌ ERROR: One or more commits are missing a valid Signed-off-By tag. + + +This project requires all contributors to assert that their contributions +are provided in compliance with the terms of the Developer's Certificate +of Origin 1.1 (DCO): + + https://developercertificate.org/ + +To indicate acceptance of the DCO every commit must have a tag + + Signed-off-by: REAL NAME <EMAIL> + +This can be achieved by passing the "-s" flag to the "git commit" command. + +To bulk update all commits on current branch "git rebase" can be used: + + git rebase -i master -x 'git commit --amend --no-edit -s' + +""") + + sys.exit(1) + +sys.exit(0)
.gitlab-ci.yml +10 -0
@@ -381,3 +381,13 @@ check-patch: variables: GIT_DEPTH: 1000 allow_failure: true + +check-dco: + stage: test + image: $CI_REGISTRY_IMAGE/qemu/centos8:latest + script: .gitlab-ci.d/check-dco.py + except: + variables: + - $CI_PROJECT_NAMESPACE == 'qemu-project' && $CI_COMMIT_BRANCH == 'master' + variables: + GIT_DEPTH: 1000
Signature · 1 line
2.26.2
PATCH 3/3 gitlab: assign python helper files to GitLab maintainers section
In reply to Daniel P. Berrangé--- MAINTAINERS | 1 + 1 file changed, 1 insertion(+)
MAINTAINERS +1 -0
@@ -3097,6 +3097,7 @@ R: Wainer dos Santos Moschetta <[email protected]> S: Maintained F: .gitlab-ci.yml F: .gitlab-ci.d/crossbuilds.yml +F: .gitlab-ci.d/*py Guest Test Compilation Support M: Alex Bennée <[email protected]>
Signature · 1 line
2.26.2
Re: [PATCH 3/3] gitlab: assign python helper files to GitLab maintainers section
Quoted 10 lines · Daniel P. Berrangé
Signed-off-by Daniel P. Berrangé <[email protected]>--- MAINTAINERS | 1 + 1 file changed, 1 insertion(+)MAINTAINERS +0
-0
MAINTAINERS R: Wainer dos Santos Moschetta <[email protected]> · line 3100
Quoted 4 lines
MAINTAINERS +1
-0@@ -3097,6 +3097,7 @@ R: Wainer dos Santos Moschetta <[email protected]> S: Maintained F: .gitlab-ci.yml F: .gitlab-ci.d/crossbuilds.yml +F: .gitlab-ci.d/*py
Squash in 1st patch?
Regardless:
Patchew URL: https://patchew.org/QEMU/[email protected]/
Patchew URL: https://patchew.org/QEMU/[email protected]/
Hi,
This series failed build test on FreeBSD host. Please find the details below.
The full log is available at
http://patchew.org/logs/[email protected]/testing.FreeBSD/?type=message.
---
Email generated automatically by Patchew [https://patchew.org/].
Please send your feedback to [email protected]
Patchew URL: https://patchew.org/QEMU/[email protected]/
Patchew URL: https://patchew.org/QEMU/[email protected]/
Hi,
This series failed build test on FreeBSD host. Please find the details below.
The full log is available at
http://patchew.org/logs/[email protected]/testing.FreeBSD/?type=message.
---
Email generated automatically by Patchew [https://patchew.org/].
Please send your feedback to [email protected]
Quoted 2 lines · Daniel P. Berrangé
This introduces two new jobs to GitLab. The first runs "checkpatch.pl" across all patches, while the second is a dedicated DCO signoff check.
This feels quite redundant since we're checking the patches with Patchew already ... or are there plans to get rid of this check in Patchew?
Thomas
Quoted 6 lines · Thomas Huth
Quoted 2 lines · Daniel P. Berrangé
This introduces two new jobs to GitLab. The first runs "checkpatch.pl" across all patches, while the second is a dedicated DCO signoff check.
This feels quite redundant since we're checking the patches with Patchew already ... or are there plans to get rid of this check in Patchew?
The plan is to use GitLab-CI gating :)
Also this free patchew community resources and use the user's resources instead. From a patchew sysadmin PoV this is a win IMO.
Quoted 3 lines
Thomas
Quoted 6 lines · Thomas Huth
Quoted 2 lines · Daniel P. Berrangé
This introduces two new jobs to GitLab. The first runs "checkpatch.pl" across all patches, while the second is a dedicated DCO signoff check.
This feels quite redundant since we're checking the patches with Patchew already ... or are there plans to get rid of this check in Patchew?
patchew only runs once the contributor has sent their patches to the mailing list, whci his too late.
We want contributors to test their series in GitLab CI ahead of sending it, so that patchew never has to report any failure, because the code is already perfect once on the list (except if git master has moved and causes conflicts of course).
Regards,
Daniel
Signature · 3 lines
|: https://berrange.com -o- https://www.flickr.com/photos/dberrange :| |: https://libvirt.org -o- https://fstop138.berrange.com :| |: https://entangle-photo.org -o- https://www.instagram.com/dberrange :|
Quoted 17 lines · Daniel P. Berrangé
Quoted 6 lines · Thomas Huth
Quoted 2 lines · Daniel P. Berrangé
This introduces two new jobs to GitLab. The first runs "checkpatch.pl" across all patches, while the second is a dedicated DCO signoff check.
This feels quite redundant since we're checking the patches with Patchew already ... or are there plans to get rid of this check in Patchew?
patchew only runs once the contributor has sent their patches to the mailing list, whci his too late.
We want contributors to test their series in GitLab CI ahead of sending it, so that patchew never has to report any failure, because the code is already perfect once on the list (except if git master has moved and causes conflicts of course).
Quoted 4 lines
Regards,
Daniel
--
|: https://berrange.com -o-
https://www.flickr.com/photos/dberrange :|
Quoted 1 line
|: https://libvirt.org -o-
https://fstop138.berrange.com :|
Quoted 1 line
|: https://entangle-photo.org -o-
https://www.instagram.com/dberrange :|
Quoted 2 lines
agreed, and ineed patchew are broken now.
--
此致
礼
罗勇刚
Yours
sincerely,
Yonggang Luo
Patchew URL: https://patchew.org/QEMU/[email protected]/
Patchew URL: https://patchew.org/QEMU/[email protected]/
Hi,
This series failed the docker-quick@centos7 build test. Please find the testing commands and their output below. If you have Docker installed, you can probably reproduce it locally.
The full log is available at
http://patchew.org/logs/[email protected]/testing.docker-quick@centos7/?type=message.
---
Email generated automatically by Patchew [https://patchew.org/].
Please send your feedback to [email protected]