Fix potential segfault on cloning invalid tag
PATCH 1/1 Fix potential segfault on cloning invalid tag
From: Sohom Datta <[email protected]>
Git allows users to create tags pointing to object hashes that may or may not be commits. When a tag that doesn't point to a commit is used with the -b (--branch) parameter of git clone, git segfaults as it assumes that the tag will always reference a commit.
Add a check to make sure that lookup_commit_reference returns a commit before detaching HEAD.
---
Fix potential segfault on cloning invalid tag
The bug can be reproduced by running git tag 1.4.0 $(git rev-parse :filename) on the parent repository and then cloning the repo using git clone --branch 1.4.0 file://path/to/repo. The output should be something along the lines of:
Cloning into '<path/to/repo>'...
remote: Enumerating objects: 8, done.
remote: Counting objects: 100% (8/8), done.
remote: Compressing objects: 100% (5/5), done.
remote: Total 8 (delta 1), reused 0 (delta 0), pack-reused 0 Receiving objects: 100% (8/8), done.
Resolving deltas: 100% (1/1), done.
error: object d670460b4b4aece5915caf5c68d12f560a9fe3e4 is a blob, not a commit
zsh: segmentation fault (core dumped)
Published-As: https://github.com/gitgitgadget/git/releases/tag/pr-git-906%2Fsohomdatta1%2Fsegfault-while-cloning-invalid-tag-v1
Fetch-It-Via: git fetch https://github.com/gitgitgadget/git pr-git-906/sohomdatta1/segfault-while-cloning-invalid-tag-v1
Pull-Request: https://github.com/git/git/pull/906
builtin/clone.c | 2 ++ t/t5610-clone-detached.sh | 5 +++++ 2 files changed, 7 insertions(+)
builtin/clone.c +2 -0
@@ -727,6 +727,8 @@ static void update_head(const struct ref *our, const struct ref *remote, }else if (our) {struct commit *c =lookup_commit_reference (the_repository, &our->old_oid); +if ( !c ) +die (_ ("%s does not point to a commit." ), our->name);/* --branch specifies a non-branch (i.e. tags), detach HEAD */ update_ref (msg,"HEAD" , &c->object.oid,NULL ,REF_NO_DEREF ,UPDATE_REFS_DIE_ON_ERR );
t/t5610-clone-detached.sh +5 -0
@@ -15,6 +15,7 @@ test_expect_success 'setup' ' echo two >file && git commit -a -m two && git tag two && + git tag four $(git rev-parse :file) && echo three >file && git commit -a -m three '
@@ -72,5 +73,9 @@ test_expect_success 'cloned HEAD matches' ' test_expect_success 'cloned HEAD is detached' ' head_is_detached detached-orphan ' +test_expect_success 'cloning invalid tag' ' + test_must_fail git clone "file://$PWD" -b four 2>err && + test_i18ngrep "does not point to a commit." err +' test_done
base-commit: ad27df6a5cff694add500ab8c7f97234feb4a91f
Signature · 1 line
gitgitgadget
Quoted 10 lines · Sohom Datta via GitGitGadget
From: Sohom Datta <[email protected]>
Git allows users to create tags pointing to object hashes that may or may not be commits. When a tag that doesn't point to a commit is used with the -b (--branch) parameter of git clone, git segfaults as it assumes that the tag will always reference a commit.
Add a check to make sure that
lookup_commit_referencereturns a commit before detaching HEAD.
This seemed eerily familiar, so I dug up these threads:
- https://lore.kernel.org/git/[email protected]/
- https://lore.kernel.org/git/[email protected]/
The interesting things are:
- there are some other cases where we might see a non-commit, which are also worth covering
- it would be friendlier to the user to put in a fallback value for HEAD. We already transferred the whole history, so deleting it is a bit less friendly than leaving it in a state the user can recover from locally
I think the patches there were moving in a good direction, but it looks like they just got stalled.
-Peff
PATCH v2 1/1 Avoid segfault and provide fallback when cloning invalid branch/tag
In reply to Sohom Datta via GitGitGadgetFrom: Sohom Datta <[email protected]>
The Git command to clone a specific branch of a git repository always assumes that the commit pointed to by the branch are going to valid. It thus segfaults and crashes whenever a tag or a branch with a invalid commit is specified.
Aborting the operation is not desirable since the user is left with no usable git folder to work with despite git having done most of the work in setting everything up.
This commit is based of David Berardi's commit at
https://lore.kernel.org/git/[email protected]/
Make git fallback on creating a unborn master branch when encountering a invalid commit.
---
Fix potential segfault on cloning invalid tag
Changes since v1:
* Reworked the patch to use the fallback approach based on feedback from Jeff King.
Published-As: https://github.com/gitgitgadget/git/releases/tag/pr-git-906%2Fsohomdatta1%2Fsegfault-while-cloning-invalid-tag-v2
Fetch-It-Via: git fetch https://github.com/gitgitgadget/git pr-git-906/sohomdatta1/segfault-while-cloning-invalid-tag-v2
Pull-Request: https://github.com/git/git/pull/906
Range-diff vs v1:
1: 576b6049b2 < -: ---------- Fix potential segfault on cloning invalid tag -: ---------- > 1: 02b50572ff Avoid segfault and provide fallback when cloning invalid branch/tag
builtin/clone.c | 69 ++++++++++++++++++++++++++++++++++++++--- t/t5609-clone-branch.sh | 15 +++++++++ 2 files changed, 79 insertions(+), 5 deletions(-)
builtin/clone.c +64 -5
@@ -711,10 +711,63 @@ static void update_remote_refs(const struct ref *refs, } } -static void update_head (const struct ref *our,const struct ref *remote, +static struct commit *commit_lookup_helper (const struct ref *our, +const struct ref *remote, +const char *msg, +int *err) +{ +const struct object_id *tip =NULL ; +struct commit *tip_commit =NULL ; + +if (our) + tip = &our->old_oid; +else if (remote) + tip = &remote->old_oid; +else { +/* +* We have no local branch requested with "-b", and the +* remote HEAD is unborn. There's nothing to update HEAD +* to, but this state is not an error. +*/ +return NULL ; + } + +if ( !lookup_object (the_repository, tip)) { +/** +* We have a object id associated with the tip of the branch +* but the object id doesn't resolve to a object. This will be +* handled downstream in update_ref(). +*/ +return NULL ; + } + + tip_commit =lookup_commit_reference_gently (the_repository, tip,1 ); +if (!tip_commit) { +/* +* The given non-commit cannot be checked out, +* so have a 'master' branch and leave it unborn. +*/ +error (_ ("non-commit branch cannot be checked out." )); +create_symref ("HEAD" ,"refs/heads/master" ,msg); + *err =-1 ; +return NULL ; + } + +return tip_commit; +} + +static int update_head (const struct ref *our, +const struct ref *remote,const char *msg) {const char *head; +int err =0 ; +const struct commit * c; + c =commit_lookup_helper (our, remote, msg, &err); +if (err <0 ) { +return -1 ; + } +if (our &&skip_prefix (our->name,"refs/heads/" , &head)) {/* Local default branch link */ if (create_symref ("HEAD" , our->name,NULL ) <0 )
@@ -725,8 +778,6 @@ static void update_head(const struct ref *our, const struct ref *remote,install_branch_config (0 , head, remote_name, our->name); } }else if (our) { -struct commit *c =lookup_commit_reference (the_repository, - &our->old_oid);/* --branch specifies a non-branch (i.e. tags), detach HEAD */ update_ref (msg,"HEAD" , &c->object.oid,NULL ,REF_NO_DEREF ,UPDATE_REFS_DIE_ON_ERR );
@@ -739,6 +790,8 @@ static void update_head(const struct ref *our, const struct ref *remote,update_ref (msg,"HEAD" , &remote->old_oid,NULL ,REF_NO_DEREF ,UPDATE_REFS_DIE_ON_ERR ); } + +return 0 ; }static int git_sparse_checkout_init (const char *repo)
@@ -1346,7 +1399,7 @@ int cmd_clone(int argc, const char **argv, const char *prefix) branch_top.buf, reflog_msg.buf, transport, !is_local); -update_head (our_head_points_at, remote_head, reflog_msg.buf); + err =update_head (our_head_points_at, remote_head, reflog_msg.buf);/* * We want to show progress for recursive submodule clones iff
@@ -1365,7 +1418,13 @@ int cmd_clone(int argc, const char **argv, const char *prefix) } junk_mode =JUNK_LEAVE_REPO ; - err =checkout (submodule_progress); +if ( err ==0 ) { +/* +* Only try to checkout if we successfully updated HEAD; otherwise +* HEAD isn't pointing to the thing the user wanted. +*/ + err =checkout (submodule_progress); + }free (remote_name);strbuf_release (&reflog_msg);
t/t5609-clone-branch.sh +15 -0
@@ -20,6 +20,9 @@ test_expect_success 'setup' ' echo one >file && git add file && git commit -m one && git checkout -b two && echo two >file && git add file && git commit -m two && + blob=$(git rev-parse HEAD:file) && + echo $blob > .git/refs/heads/broken-tag && + echo $blob > .git/refs/heads/broken-head && git checkout master) && mkdir empty && (cd empty && git init)
@@ -67,4 +70,16 @@ test_expect_success 'clone -b not allowed with empty repos' ' test_must_fail git clone -b branch empty clone-branch-empty ' +test_expect_success 'cloning -b for invalid tag must fail and fallback on remote head' ' + test_must_fail git clone -b broken-tag parent broken-tag 2>error && + test_i18ngrep "non-commit branch cannot be checked out." error && + (cd broken-tag && check_HEAD master) +' + +test_expect_success 'cloning -b for broken head must fail and fallback on remote head' ' + test_must_fail git clone -b broken-head parent broken-head && + test_i18ngrep "non-commit branch cannot be checked out." error && + (cd broken-head && check_HEAD master) +' + test_done
base-commit: 7f7ebe054af6d831b999d6c2241b9227c4e4e08d
Signature · 1 line
gitgitgadget
Re: [PATCH v2] Avoid segfault and provide fallback when cloning invalid branch/tag
Quoted 3 lines · Sohom Datta via GitGitGadget
From: Sohom Datta <[email protected]>
Subject: Re: [PATCH v2] Avoid segfault and provide fallback when cloning invalid branch/tag
cf. https://git-scm.com/docs/SubmittingPatches#describe-changes
e.g. Subject: [PATCH v2] clone: do not put a non-commit on branch head
or something like that?
Quoted 3 lines
The Git command to clone a specific branch of a git repository always assumes that the commit pointed to by the branch are going to valid. It
s/are going to valid/is going to be valid/, or just "is valid". Probably the latter is preferable.
Quoted 5 lines
thus segfaults and crashes whenever a tag or a branch with a invalid commit is specified.
Aborting the operation is not desirable since the user is left with no usable git folder to work with despite git having done most of the work
s/folder/repository/; not everything is Windows ;-)
Insert a comma after "work with" before "despite".
Quoted 1 line
in setting everything up.
The above description is not wrong per-se, but the most expensive part of discarding the result at this poihnt would be the copying of contents from the other side, not just setting things up locally, no?
Quoted 6 lines
This commit is based of David Berardi's commit at
https://lore.kernel.org/git/[email protected]/Make git fallback on creating a unborn master branch when encountering a invalid commit.
Quoted 8 lines
Signed-off-by Sohom Datta <[email protected]>---
Fix potential segfault on cloning invalid tagChanges since v1:
* Reworked the patch to use the fallback approach based on feedback from Jeff King.
Thanks. Other than the nit pointed out above, the log message looks readable. Let's take a look at the code.
builtin/clone.c static void update_remote_refs(const struct ref *refs, · line 717
Quoted 13 lines
builtin/clone.c +4
-1@@ -711,10 +711,63 @@ static void update_remote_refs(const struct ref *refs, } } -static void update_head(const struct ref *our, const struct ref *remote, +static struct commit *commit_lookup_helper (const struct ref *our, +const struct ref *remote, +const char *msg, +int *err)
Style. Remove SP around commit_lookup_helper on both sides.
foo_helper() is not particularly a meaningful name. Let's read on and see if we can come up with a better name.
builtin/clone.c static void update_remote_refs(const struct ref *refs, · line 719
Quoted 2 lines
builtin/clone.c +2
-0+{ +const struct object_id *tip =NULL ;
This initialization is not strictly needed, no? I'd rather see us leave it uninitialized.
builtin/clone.c static void update_remote_refs(const struct ref *refs, · line 720
Quoted 1 line
builtin/clone.c +1
-0+struct commit *tip_commit =NULL ;
Excess SP before NULL.
builtin/clone.c static void update_remote_refs(const struct ref *refs, · line 733
Quoted 12 lines
builtin/clone.c +12
-0+if (our) + tip = &our->old_oid; +else if (remote) + tip = &remote->old_oid; +else { +/* +* We have no local branch requested with "-b", and the +* remote HEAD is unborn. There's nothing to update HEAD +* to, but this state is not an error. +*/ +return NULL ; + }
OK, so tip points at the location that has the object name of the object that is planned to be at the tip of the branch that is checked out to the working tree.
builtin/clone.c static void update_remote_refs(const struct ref *refs, · line 735
Quoted 1 line
builtin/clone.c +1
-0+if ( !lookup_object (the_repository, tip)) {
Style. No SP after '(' before the condition.
builtin/clone.c static void update_remote_refs(const struct ref *refs, · line 736
Quoted 1 line
builtin/clone.c +1
-0+/**
Why double asterisk here, unlike the early return we saw earlier? Let's lose the extra one.
builtin/clone.c static void update_remote_refs(const struct ref *refs, · line 737
Quoted 1 line
builtin/clone.c +1
-0+* We have a object id associated with the tip of the branch
s/a object id/an object name/;
builtin/clone.c static void update_remote_refs(const struct ref *refs, · line 740
Quoted 3 lines
builtin/clone.c +3
-0+* but the object id doesn't resolve to a object. This will be +* handled downstream in update_ref(). +*/
The design to punt on a non-existing object at this point in the callflow may be sound, but is !lookup_object() a reliable indication that the object name refers to a non-existing object?
In other words, I do not see what guarantees that we have already saw and parsed the named object and placed it in the hashtable the_repository->parsed_objects->obj_hash[].
Is there a reason we should avoid using parse_object() here instead?
builtin/clone.c static void update_remote_refs(const struct ref *refs, · line 749
Quoted 9 lines
builtin/clone.c +9
-0+return NULL ; + } + + tip_commit =lookup_commit_reference_gently (the_repository, tip,1 ); +if (!tip_commit) { +/* +* The given non-commit cannot be checked out, +* so have a 'master' branch and leave it unborn. +*/
OK, the reasoning here is that we checked if tip refers to non-existing object before we tried lookup_commit_reference_gently(), so a failure to find a commit here must mean the object does exist but is not a committish. And in such a case, we decided to abort the calling update_head() and create an unborn branch ourselves.
Perhaps makes sense, I need to think about it a bit more to be certain, though.
builtin/clone.c static void update_remote_refs(const struct ref *refs, · line 751
Quoted 2 lines
builtin/clone.c +2
-0+error (_ ("non-commit branch cannot be checked out." )); +create_symref ("HEAD" ,"refs/heads/master" ,msg);
Style. Wrong placement of a comma before 'msg'.
Post v2.29 codebase should ask what our default first branch name should be.
builtin/clone.c static void update_remote_refs(const struct ref *refs, · line 753
Quoted 2 lines
builtin/clone.c +2
-0+ *err =-1 ; +return NULL ;
It is customary to use the returned value from error(), like so
*status = error(_("..."));that would save you one line. Taking all the nits above together, perhaps
if (!tip_commit) {
char *ref = xstrfmt("refs/heads/%s", git_default_branch_name());
create_symref("HEAD", ref, msg);
*err = error(_("..."));
free(ref);
return NULL;
}HOWEVER, I think it is much cleaner to lose the "we first check if the object exists" part and directly see if tip points at a committish first. Only when the tip does not point at a committish, we need to tell the two cases apart. So after figuring out into which ref the variable "tip" should point, we'd do something like:
tip_commit = lookup_commit_refernece_gently(... tip, 1); if (tip_commit) return tip_commit; /* * Now, "tip" is not a committish. Does it even exist? */ if (!lookup_object(... tip)) /* let update_ref() handle this error condition */ return NULL; /* * Give an error, but leave the default initial branch * unborn, instead of failing the whole operation to cause * the directory removed. */ ... do the create_symref() thing ... return NULL;
Wouldn't it be cleaner?
builtin/clone.c static void update_remote_refs(const struct ref *refs, · line 760
Quoted 7 lines
builtin/clone.c +7
-0+ } + +return tip_commit; +} + +static int update_head(const struct ref *our, + const struct ref *remote,
If you did not do unnecessary rewrapping, the patch noise in the function definition here would have been avoided, no?
builtin/clone.c static void update_remote_refs(const struct ref *refs, · line 765
Quoted 5 lines
builtin/clone.c +2
-0const char *msg) {const char *head; +int err =0 ; +const struct commit * c;
Style. Lose SP between asterisk and c; in our codebase the asterisk sticks to the identifier (not type).
Have a blank line here, between the end of decl and the first stmt in the block.
builtin/clone.c static void update_remote_refs(const struct ref *refs, · line 769
Quoted 4 lines
builtin/clone.c +4
-0+ c =commit_lookup_helper (our, remote, msg, &err); +if (err <0 ) { +return -1 ; + }
Style. No {} around a single stmt.
More importantly, without a name that is more meaningful than "commit_lookup_helper()" and without any comment near its definition to describe what the function is supposed to compute and what it considers an error, the reader of this callsite cannot tell what we are calling the "helper" for, and under what condition we are told by the helper to return an error to our callers.
With the analysis and rewrite of that _helper() function, I think a more descriptive name for the helper should contain words like "check/ensure" and "commit" in it. And the "err" variables, both in the caller and in the helper function, are somewhat misnamed. It is a signal from the callee to the caller that updating the branch head has already been done by the callee, so the caller does not have to do anything further. Perhaps
int skip_update_ref = 0; const struct commit *c; c = check_tip_commit(our, remote, msg, &skip_update_ref); if (skip_update_ref) return -1; /* left a fallback unborn branch */ ... and then "c" is a commit (already peeled) usable for ... pointing HEAD to at this point.
I'd suggest giving the "c" variable, whose lifespan is now much longer than in the original code, a more meaningful name, though.
Quoted 13 lines
builtin/clone.c +0
-2if (our &&skip_prefix (our->name,"refs/heads/" , &head)) {/* Local default branch link */ if (create_symref ("HEAD" , our->name,NULL ) <0 )@@ -725,8 +778,6 @@ static void update_head(const struct ref *our, const struct ref *remote,install_branch_config (0 , head, remote_name, our->name); } }else if (our) { -struct commit *c =lookup_commit_reference (the_repository, - &our->old_oid);/* --branch specifies a non-branch (i.e. tags), detach HEAD */ update_ref (msg,"HEAD" , &c->object.oid,NULL ,REF_NO_DEREF ,UPDATE_REFS_DIE_ON_ERR );
builtin/clone.c static void update_head(const struct ref *our, const struct ref *remote, · line 791
Quoted 2 lines
builtin/clone.c +0
-0@@ -739,6 +790,8 @@ static void update_head(const struct ref *our, const struct ref *remote,update_ref (msg,"HEAD" , &remote->old_oid,NULL ,REF_NO_DEREF ,UPDATE_REFS_DIE_ON_ERR );
Can't this cause discrepancy when the helper picked remote->old_oid as the "tip" there? We called lookup_commit_reference_gently() on that oid, and decided to check out the resulting commit and point HEAD at it, so we are certain that your "c" is a commit object, but remote->old_oid may name an annotated tag that points at the commit object. Don't we want to use &c->object.old here as well?
If that is the case (you need to think about it yourself---I didn't spend more than 5 minutes on this particular point myself and the above might be total nonsense), this part would become
if (our && our is in our local branch namespace) {
... do the local thing ...
} else if (our || remote) {
update_ref(msg, "HEAD", &c->object.oid, NULL, ...);
}as the body for 'our' and 'remote' are the same.
Quoted 17 lines
builtin/clone.c +3
-1} + +return 0 ; }static int git_sparse_checkout_init (const char *repo)@@ -1346,7 +1399,7 @@ int cmd_clone(int argc, const char **argv, const char *prefix) branch_top.buf, reflog_msg.buf, transport, !is_local); -update_head (our_head_points_at, remote_head, reflog_msg.buf); + err =update_head (our_head_points_at, remote_head, reflog_msg.buf);/* * We want to show progress for recursive submodule clones iff @@ -1365,7 +1418,13 @@ int cmd_clone(int argc, const char **argv, const char *prefix) }
builtin/clone.c int cmd_clone(int argc, const char **argv, const char *prefix) · line 1427
Quoted 10 lines
builtin/clone.c +7
-1junk_mode =JUNK_LEAVE_REPO ; - err =checkout (submodule_progress); +if ( err ==0 ) { +/* +* Only try to checkout if we successfully updated HEAD; otherwise +* HEAD isn't pointing to the thing the user wanted. +*/ + err =checkout (submodule_progress); + }
The logic looks OK. We avoid checking out an unborn if we left HEAD unborn because there is no better choice. And by not calling checkout() and overwriting the err variable, we make sure that the entire command still reports a failure.
I am not absolutely sure if reusing 'err' like the above two hunks is the best thing to do, or the code becomes easier to follow if we introduced another variable to receive the returned value from update_head(). Perhaps what we have above is good enough. I dunno.
t/t5609-clone-branch.sh test_expect_success 'setup' ' · line 25
Quoted 11 lines
t/t5609-clone-branch.sh +3
-0@@ -20,6 +20,9 @@ test_expect_success 'setup' ' echo one >file && git add file && git commit -m one && git checkout -b two && echo two >file && git add file && git commit -m two && + blob=$(git rev-parse HEAD:file) && + echo $blob > .git/refs/heads/broken-tag && + echo $blob > .git/refs/heads/broken-head &&
Style. Do not leave SP between redirection operator and its target, i.e.
echo $blob >.git/refs/heads/...
Didn't you mean to use refs/tags/broken-tag for the first one, though? Otherwise, I do not see how anybody would expect the two tests check different things.
Thanks.
Quoted 15 lines
t/t5609-clone-branch.sh +12
-0+test_expect_success 'cloning -b for invalid tag must fail and fallback on remote head' ' + test_must_fail git clone -b broken-tag parent broken-tag 2>error && + test_i18ngrep "non-commit branch cannot be checked out." error && + (cd broken-tag && check_HEAD master) +' + +test_expect_success 'cloning -b for broken head must fail and fallback on remote head' ' + test_must_fail git clone -b broken-head parent broken-head && + test_i18ngrep "non-commit branch cannot be checked out." error && + (cd broken-head && check_HEAD master) +' + test_donebase-commit:
7f7ebe054af6d831b999d6c2241b9227c4e4e08d