Skip to contentSkip to conversation

clone: add remote.cloneDefault config option

PATCH In review Sean Barag via GitGitGadget 4 participants 7 messages Aug 26, 2020 – Aug 27, 2020 Documentation

lore
Share & tools
lore
#0 lore raw

PATCH 1/1 clone: add remote.cloneDefault config option

From: Sean Barag <[email protected]>

While the default remote name of origin can be overridden both pre-clone (with git clone --origin foo) and post-clone (with git remote rename origin foo), it'd be handy to have a configurable system-wide default for clones! This commit implements remote.cloneDefault as a parallel to remote.pushDefault, with prioritized name resolution:

1. (Highest priority) git clone's -o option
2. git config's remote.cloneDefault value
3. origin

There should be no impact for existing users, as it's pretty unlikely that anyone's already configured remote.cloneDefault and the porcelain hasn't changed (as best I can tell at least!).

---
clone: add remote.cloneDefault config option

While the default remote name of origin can be overridden both pre-clone (with git clone --origin foo) and post-clone (with git remote rename origin foo), it'd be handy to have a configurable system-wide default for clones! This implementsremote.cloneDefault as a parallel to remote.pushDefault, with prioritized name resolution:

1. (Highest priority) git clone's -o option
2. git config's remote.cloneDefault value
3. origin

There should be no impact for existing users, as it's pretty unlikely that anyone's already configured remote.cloneDefault and the porcelain hasn't changed (as best I can tell at least!).

Published-As: https://github.com/gitgitgadget/git/releases/tag/pr-710%2Fsjbarag%2Fadd-remote.cloneDefault-config-v1
Fetch-It-Via: git fetch https://github.com/gitgitgadget/git pr-710/sjbarag/add-remote.cloneDefault-config-v1
Pull-Request: https://github.com/gitgitgadget/git/pull/710

 Documentation/config/remote.txt |  4 ++++
 Documentation/git-clone.txt     |  5 +++--
 builtin/clone.c                 | 34 +++++++++++++++++++++++++++++++--
 t/t5606-clone-options.sh        | 14 ++++++++++++++
 4 files changed, 53 insertions(+), 4 deletions(-)
Documentation/config/remote.txt +4 -0
index a8e6437a90..debb21ecbf 100644
@@ -3,6 +3,10 @@ remote.pushDefault::
 	`branch.<name>.remote` for all branches, and is overridden by
 	`branch.<name>.pushRemote` for specific branches.
 
+remote.cloneDefault::
+	The name of the remote to create during `git clone <url>`.
+	Defaults to "origin".
+
 remote.<name>.url::
 	The URL of a remote repository.  See linkgit:git-fetch[1] or
 	linkgit:git-push[1].
Documentation/git-clone.txt +3 -2
index c898310099..2e101ba4f4 100644
@@ -183,8 +183,9 @@ objects from the source repository into a pack in the cloned repository.
 
 -o <name>::
 --origin <name>::
-	Instead of using the remote name `origin` to keep track
-	of the upstream repository, use `<name>`.
+	The remote name used to keep track of the upstream repository.
+	Overrides `remote.cloneDefault` from the config, and defaults
+	to `origin`.
 
 -b <name>::
 --branch <name>::
builtin/clone.c +32 -2
index b087ee40c2..b0dbb848c6 100644
@@ -941,6 +941,29 @@ static int path_exists(const char *path)
 	return !stat(path, &sb);
 }
 
+struct clone_default_info
+{
+	enum config_scope scope;
+	struct strbuf remote_name;
+	int linenr;
+};
+
+static int config_read_clone_default(const char *key, const char *value,
+	void *cb)
+{
+	struct clone_default_info* info = cb;
+	if (strcmp(key, "remote.clonedefault") || !value) {
+		return 0;
+	}
+
+	info->scope = current_config_scope();
+	strbuf_reset(&info->remote_name);
+	strbuf_addstr(&info->remote_name, value);
+	info->linenr = current_config_line();
+
+	return 0;
+}
+
 int cmd_clone(int argc, const char **argv, const char *prefix)
 {
 	int is_bundle = 0, is_local;
@@ -992,8 +1015,15 @@ int cmd_clone(int argc, const char **argv, const char *prefix)
 		option_no_checkout = 1;
 	}
 
-	if (!option_origin)
-		option_origin = "origin";
+	if (!option_origin) {
+		struct clone_default_info clone_default = { CONFIG_SCOPE_UNKNOWN, STRBUF_INIT, -1 };
+		git_config(config_read_clone_default, &clone_default);
+		if (strcmp("", (const char*) clone_default.remote_name.buf))
+			option_origin = clone_default.remote_name.buf;
+		else
+			option_origin = "origin";
+	}
+
 
 	repo_name = argv[0];
 
t/t5606-clone-options.sh +14 -0
index e69427f881..8aac67b385 100755
@@ -19,6 +19,20 @@ test_expect_success 'clone -o' '
 
 '
 
+test_expect_success 'clone respects remote.cloneDefault' '
+
+	git -c remote.cloneDefault=bar clone parent clone-config &&
+	(cd clone-config && git rev-parse --verify refs/remotes/bar/master)
+
+'
+
+test_expect_success 'clone chooses correct remote name' '
+
+	git -c remote.cloneDefault=bar clone -o foo parent clone-o-and-config &&
+	(cd clone-o-and-config && git rev-parse --verify refs/remotes/foo/master)
+
+'
+
 test_expect_success 'redirected clone does not show progress' '
 
 	git clone "file://$(pwd)/parent" clone-redirected >out 2>err &&

base-commit: e9b77c84a0a0df029f2a3a8114e9f22186e7da24

Signature · 1 line
gitgitgadget
#1 lore raw
Quoted 6 lines · Sean Barag via GitGitGadget

From: Sean Barag <[email protected]>

While the default remote name of origin can be overridden both pre-clone (with git clone --origin foo) and post-clone (with git remote rename origin foo), it'd be handy to have a configurable system-wide default for clones!

I doubt it is handy enough to deserve an explamation point. Replace it with a plain-vanilla full-stop instead.

I however tend to agree that, even evidenced by the manual page description of "git clone", i.e.

-o <name>::
--origin <name>::
Instead of using the remote name origin to keep track of the upstream repository, use <name>.

that it is understandable if many users and projects wish to call it "upstream".

Quoted 3 lines

This commit implements
remote.cloneDefault as a parallel to remote.pushDefault, with prioritized name resolution:

I highly doubt that .cloneDefault is a good name. After reading only the title of the patch e-mail, i.e. when the only available information on the change available to me was the name of the configuration variable and the fact that it pertains to the command "git clone", I thought it is to specify a URL, from which "git clone" without the URL would clone from that single repository.

And the name will cause the same misunderstanding to normal users, not just to reviewers of your patch, after this change hits a future Git release.

Taking a parallel from init.defaultBranchName, I would probably call it clone.defaultUpstreamName if I were writing this feature.

Quoted 20 lines
builtin/clone.c +12 -0
index b087ee40c2..b0dbb848c6 100644
@@ -941,6 +941,29 @@ static int path_exists(const char *path)
 	return !stat(path, &sb);
 }
 
+struct clone_default_info
+{
+	enum config_scope scope;
+	struct strbuf remote_name;
+	int linenr;
+};
+
+static int config_read_clone_default(const char *key, const char *value,
+	void *cb)
+{
+	struct clone_default_info* info = cb;
+	if (strcmp(key, "remote.clonedefault") || !value) {

builtin/clone.c static int path_exists(const char *path) · line 965

Quoted 10 lines
builtin/clone.c +10 -0
+		return 0;
+	}
+
+	info->scope = current_config_scope();
+	strbuf_reset(&info->remote_name);
+	strbuf_addstr(&info->remote_name, value);
+	info->linenr = current_config_line();
+
+	return 0;
+}

This feels way overkill and insufficient at the same time. It does not need scope, it does not need linenr, and we already have a place to store end-user specified name for the upstream in the form of the variable option_origin. And the code is not diagnosing any error.

static int git_clone_config(const char *k, const char *v, void *cb)

{
	if (option_origin)
		return 0; /* ignore -- the user gave us an option */

	if (!strcmp(k, "clone.defaultupstreamname")) {
		if (!v)
			return config_error_nonbool(k);
		if (strchr(v, '/') || check_refname_format(v, REFNAME_ALLOW_ONELEVEL))
                	return error(_("invalid upstream name '%s'"), v);
		option_origin = xstrdup(v);
		return 0;
	}
	return 0;
}

would be sufficient, and at the same time makes sure it rejects names like 'o..ri..gin', 'o/ri/gin', etc.

Quoted 5 lines
builtin/clone.c +0 -1
@@ -992,8 +1015,15 @@ int cmd_clone(int argc, const char **argv, const char *prefix)
 		option_no_checkout = 1;
 	}
 
-	if (!option_origin)

builtin/clone.c int cmd_clone(int argc, const char **argv, const char *prefix) · line 1026

Quoted 10 lines
builtin/clone.c +9 -1
-		option_origin = "origin";
+	if (!option_origin) {
+		struct clone_default_info clone_default = { CONFIG_SCOPE_UNKNOWN, STRBUF_INIT, -1 };
+		git_config(config_read_clone_default, &clone_default);
+		if (strcmp("", (const char*) clone_default.remote_name.buf))
+			option_origin = clone_default.remote_name.buf;
+		else
+			option_origin = "origin";
+	}
+

It is somewhat sad that we have the git_config(git_default_config) call so late in the control flow. I wonder if we can update the start-up sequence to match the usual flow, e.g. these things happen in the following order in a normal program.

- variables are given their default value.

- call git_config(git_commandspecific_config, ...) early in the program.

- git_commandspecific_config() interprets the command specific variables and passes everything else to git_default_config()

variables like option_origin are given values of configuration variable at this point.

- call parse_options() next, which may override the variables from the value on the command line.

- main control flow uses the variable. "Command-line wins over configuration which wins over the default" falls out naturally.

One oddity "git clone" has is that it wants to delay the reading of configuration files (they are read only once, and second and subsequent git_config() calls will reuse what was read before [*]) so that it can read what clone.c::write_config() wrote, so if we were to "fix" the start-up sequence to match the usual flow, we need to satisfy what that odd arrangement wanted to achieve in some other way (e.g. feed what is in option_config to git_default_config ourselves, without using git_config(), as part of the "main control flow uses the variable" part), but it should be doable.

[*Side note*]. The above means that this patch, even when the configuration variable does not give upstream name, may break the option_config feature by breaking the second call to git_config(). We need to have a test for that.

Quoted 11 lines
t/t5606-clone-options.sh +3 -0
index e69427f881..8aac67b385 100755
@@ -19,6 +19,20 @@ test_expect_success 'clone -o' '
 
 '
 
+test_expect_success 'clone respects remote.cloneDefault' '
+
+	git -c remote.cloneDefault=bar clone parent clone-config &&

t/t5606-clone-options.sh test_expect_success 'clone -o' ' · line 34

Quoted 10 lines
t/t5606-clone-options.sh +10 -0
+	(cd clone-config && git rev-parse --verify refs/remotes/bar/master)
+
+'
+
+test_expect_success 'clone chooses correct remote name' '
+
+	git -c remote.cloneDefault=bar clone -o foo parent clone-o-and-config &&
+	(cd clone-o-and-config && git rev-parse --verify refs/remotes/foo/master)
+
+'

These two are "showing off my shiny new toy" tests, which are needed, but we also need negative tests where the shiny new toy does not kick in when it should not. For example

git -c remote.cloneDefault="bad.../...name" clone parent

should fail, no?

Thanks.

#2 lore raw
Quoted 12 lines · Junio C Hamano
Quoted 3 lines · Sean Barag via GitGitGadget

This commit implements
remote.cloneDefault as a parallel to remote.pushDefault, with prioritized name resolution:

I highly doubt that .cloneDefault is a good name. After reading only the title of the patch e-mail, i.e. when the only available information on the change available to me was the name of the configuration variable and the fact that it pertains to the command "git clone", I thought it is to specify a URL, from which "git clone" without the URL would clone from that single repository.

Quoted 6 lines

And the name will cause the same misunderstanding to normal users, not just to reviewers of your patch, after this change hits a future Git release.

Taking a parallel from init.defaultBranchName, I would probably call it clone.defaultUpstreamName if I were writing this feature.

I was thinking "clone.defaultRemoteName" makes it clear we are naming the remote for the provided <url> in the command. Having

clone.defaultUpstreamName = upstream

may look a bit confusing, while

clone.defaultRemoteName = upstream

makes it a bit clearer that we will set

remote.upstream.url = <url>

Quoted 26 lines
Quoted 11 lines
t/t5606-clone-options.sh +3 -0
index e69427f881..8aac67b385 100755
@@ -19,6 +19,20 @@ test_expect_success 'clone -o' '
 
 '
 
+test_expect_success 'clone respects remote.cloneDefault' '
+
+	git -c remote.cloneDefault=bar clone parent clone-config &&

t/t5606-clone-options.sh test_expect_success 'clone -o' ' · line 34

Quoted 10 lines
t/t5606-clone-options.sh +10 -0
+	(cd clone-config && git rev-parse --verify refs/remotes/bar/master)
+
+'
+
+test_expect_success 'clone chooses correct remote name' '
+
+	git -c remote.cloneDefault=bar clone -o foo parent clone-o-and-config &&
+	(cd clone-o-and-config && git rev-parse --verify refs/remotes/foo/master)
+
+'

These two are "showing off my shiny new toy" tests, which are needed, but we also need negative tests where the shiny new toy does not kick in when it should not. For example

Quoted 3 lines

git -c remote.cloneDefault="bad.../...name" clone parent

should fail, no?

This is an important suggestion.

Thanks,
-Stolee

#3 lore raw
Quoted 17 lines · Derrick Stolee
Quoted 16 lines · Junio C Hamano
Quoted 3 lines · Sean Barag via GitGitGadget

This commit implements
remote.cloneDefault as a parallel to remote.pushDefault, with prioritized name resolution:

I highly doubt that .cloneDefault is a good name. After reading only the title of the patch e-mail, i.e. when the only available information on the change available to me was the name of the configuration variable and the fact that it pertains to the command "git clone", I thought it is to specify a URL, from which "git clone" without the URL would clone from that single repository.

And the name will cause the same misunderstanding to normal users, not just to reviewers of your patch, after this change hits a future Git release.

Quoted 5 lines
Quoted 2 lines

Taking a parallel from init.defaultBranchName, I would probably call it clone.defaultUpstreamName if I were writing this feature.

I was thinking "clone.defaultRemoteName" makes it clear we are naming the remote for the provided <url> in the command.

I 100% agree that defaultremotename is much better.

Quoted 7 lines
Quoted 5 lines

... For example

git -c remote.cloneDefault="bad.../...name" clone parent

should fail, no?

This is an important suggestion.

To be fair, the current code does not handle the "--origin" command line option not so carefully.

Back when the command was scripted, e.g. 47874d6d (revamp git-clone (take #2)., 2006-03-21), had both ref-format check and */* multi-level check, and these checks been retained throughout its life until 8434c2f1 (Build in clone, 2008-04-27) rewrote the whole thing while discarding these checks for --origin=bad.../...name

It would make an excellent #leftoverbits or #microproject.

Thanks.

#4 lore raw
Quoted 19 lines
Quoted 17 lines · Derrick Stolee
Quoted 16 lines · Junio C Hamano
Quoted 3 lines · Sean Barag via GitGitGadget

This commit implements
remote.cloneDefault as a parallel to remote.pushDefault, with prioritized name resolution:

I highly doubt that .cloneDefault is a good name. After reading only the title of the patch e-mail, i.e. when the only available information on the change available to me was the name of the configuration variable and the fact that it pertains to the command "git clone", I thought it is to specify a URL, from which "git clone" without the URL would clone from that single repository.

And the name will cause the same misunderstanding to normal users, not just to reviewers of your patch, after this change hits a future Git release.

Quoted 7 lines
Quoted 5 lines
Quoted 2 lines

Taking a parallel from init.defaultBranchName, I would probably call it clone.defaultUpstreamName if I were writing this feature.

I was thinking "clone.defaultRemoteName" makes it clear we are naming the remote for the provided <url> in the command.

I 100% agree that defaultremotename is much better.

Perfect, I'll move forward with clone.defaultRemoteName. Thanks for the recommendation. This would be the first config variable inside the a "clone" subsection -- is there anything special that needs to happen when a new subsection is added?

Quoted 10 lines
Quoted 7 lines
Quoted 5 lines
Quoted 1 line

... For example

git -c remote.cloneDefault="bad.../...name" clone parent

should fail, no?

This is an important suggestion.

To be fair, the current code does not handle the "--origin" command line option not so carefully.

Agreed - I'm sorry for not including those tests. They'll be present in v2. I'll be sure to include some validation for clone.defaultRemoteName within git_config as well.

Quoted 5 lines

It is somewhat sad that we have the git_config(git_default_config) call so late in the control flow. I wonder if we can update the start-up sequence to match the usual flow
...
One oddity "git clone" has is that it wants to delay the reading of

Quoted 8 lines

configuration files (they are read only once, and second and subsequent git_config() calls will reuse what was read before [*]) so that it can read what clone.c::write_config() wrote, so if we were to "fix" the start-up sequence to match the usual flow, we need to satisfy what that odd arrangement wanted to achieve in some other way (e.g. feed what is in option_config to git_default_config ourselves, without using git_config(), as part of the "main control flow uses the variable" part), but it should be doable.

Sounds like a pretty big change! I'm willing to take a crack at it, but given that this is my first patch I'm frankly a bit intimidated :) How would you feel about that being a separate patch?

Thanks for all the guidance, folks.
Sean

#5 lore raw
Quoted 14 lines · Sean Barag
Quoted 5 lines

It is somewhat sad that we have the git_config(git_default_config) call so late in the control flow. I wonder if we can update the start-up sequence to match the usual flow
...
One oddity "git clone" has is that it wants to delay the reading of

Quoted 8 lines

configuration files (they are read only once, and second and subsequent git_config() calls will reuse what was read before [*]) so that it can read what clone.c::write_config() wrote, so if we were to "fix" the start-up sequence to match the usual flow, we need to satisfy what that odd arrangement wanted to achieve in some other way (e.g. feed what is in option_config to git_default_config ourselves, without using git_config(), as part of the "main control flow uses the variable" part), but it should be doable.

Quoted 3 lines

Sounds like a pretty big change! I'm willing to take a crack at it, but given that this is my first patch I'm frankly a bit intimidated :) How would you feel about that being a separate patch?

It definitely needs to be a separate patch.

In order to realize any new feature that needs to read the existing (i.e. per-machine or per-user) configuration files to affect the behaviour of "git clone", whether it is the "give default to --origin option" or any other thing, first needs to fix the start-up sequence so that the configuration is read once before we process command line options, which is the norm. Only after that is done, we can build the clone.defaultRemoteName and other features that would be affected by the settings of clone.* variables on top, and it is not wise to mix the foundation with a new feature that uses the foundation. So I would imagine it would at least be 3-patch series:

- [1/3] would be to whip the start-up sequence into the normal order. This may be the most tricky part. I identified that the handling of option_config might need adjustment, but there may be others. This may not need any new tests, but if the existing tests for "clone -c var=val" do not catch breakage when we naively move the git_config(git_default_config) call early without doing any other adjustment, we might need to add more tests to cover the option. If we find things other than option_config needs adjustment, they also need test coverage.

- [2/3] would be to tighten the error checking of option_origin that was lost when the command was reimplemented in C (already discussed). This would need new tests to see "--origin $bogus" command line option is flagged as an error.

- [3/3] would be to read option_origin from the configuration file. The start-up sequence fixed by [1/3] would allow us to write the config callback in a more natural way, compared to what you wrote and what I suggested to rewrite. Error checking code in [2/3] would directly be reusable in the code added in this step. We'd need tests similar to we add in [2/3] for the configuration, and combination of configuration and command line (you already wrote most of these).

Thanks.

#6 lore raw
Quoted 10 lines

In order to realize any new feature that needs to read the existing (i.e. per-machine or per-user) configuration files to affect the behaviour of "git clone", whether it is the "give default to --origin option" or any other thing, first needs to fix the start-up sequence so that the configuration is read once before we process command line options, which is the norm. Only after that is done, we can build the clone.defaultRemoteName and other features that would be affected by the settings of clone.* variables on top, and it is not wise to mix the foundation with a new feature that uses the foundation.

Makes sense! Thanks for all your help -- I _really_ appreciate it. I'll give it a try over the next few days.