Skip to contentSkip to conversation

shallow: extract a header file

PATCH Superseded Taylor Blau 4 participants 22 messages Apr 29, 2020 – Apr 30, 2020

v1 of 2 Superseded Latest is v2 →

lore
Share & tools
lore
#0 lore raw

cover shallow: extract a header file

Hi,

These few patches are based on a suggestion in [1] from Jonathan Nieder and in [2] Junio. The gist of this series is to do the following three things:

1. Extract a new 'shallow.h' header to collect all of the functions that are related to shallow-ness, but defined in 'commit.h'.

2. Add some documentation from the previous series where it could have benefited from it.

3. Finally, introduce a thin wrapper type 'struct shallow_lock' which makes it a type-level error to unlock a non-shallow lock with '{commit,rollback}_shallow_file'.

The remainder of suggestions in [1] about the structure of t5537 I decided to not address in this series, since I anticipate there is more work there than I want to take on in this series alone.

Thanks in advance for your review!

[1]: https://lore.kernel.org/git/[email protected]/
[2]: https://lore.kernel.org/git/[email protected]/

Taylor Blau (5):
commit: make 'commit_graft_pos' non-static
shallow: extract a header file for shallow-related functions
commit: move 'unregister_shallow' to 'shallow.h' shallow.h: document '{commit,rollback}_shallow_file'
shallow: use struct 'shallow_lock' for additional safety

 builtin.h              |  1 +
 builtin/receive-pack.c |  2 +-
 commit.c               | 16 ++-------
 commit.h               | 49 +-------------------------
 fetch-pack.c           |  3 +-
 send-pack.c            |  1 +
 shallow.c              | 36 +++++++++++++------
 shallow.h              | 78 ++++++++++++++++++++++++++++++++++++++++++
 upload-pack.c          |  1 +
 9 files changed, 112 insertions(+), 75 deletions(-)
 create mode 100644 shallow.h

--
2.26.0.113.ge9739cdccc

#1 lore raw

PATCH 1/5 commit: make 'commit_graft_pos' non-static

In the next patch, some functions will be moved from 'commit.c' to have prototypes in a new 'shallow.h' and their implementations in 'shallow.c'.

Three functions in 'commit.c' use 'commit_graft_pos()' (they are 'register_commit_graft()', 'lookup_commit_graft()', and 'unregister_shallow()'). The first two of these will stay in 'commit.c', but the latter will move to 'shallow.c', and thus needs 'commit_graft_pos' to be non-static.

Prepare for that by making 'commit_graft_pos' non-static so that it can be called from both 'commit.c' and 'shallow.c'.

---
 commit.c | 2 +-
 commit.h | 1 +
 2 files changed, 2 insertions(+), 1 deletion(-)
commit.c +1 -1
index c7099daeac..b76f7d72be 100644
@@ -110,7 +110,7 @@ static const unsigned char *commit_graft_sha1_access(size_t index, void *table)
 	return commit_graft_table[index]->oid.hash;
 }
 
-static int commit_graft_pos(struct repository *r, const unsigned char *sha1)
+int commit_graft_pos(struct repository *r, const unsigned char *sha1)
 {
 	return sha1_pos(sha1, r->parsed_objects->grafts,
 			r->parsed_objects->grafts_nr,
commit.h +1 -0
index ab91d21131..eb42e8b6d2 100644
@@ -236,6 +236,7 @@ struct commit_graft {
 typedef int (*each_commit_graft_fn)(const struct commit_graft *, void *);
 
 struct commit_graft *read_graft_line(struct strbuf *line);
+int commit_graft_pos(struct repository *r, const unsigned char *sha1);
 int register_commit_graft(struct repository *r, struct commit_graft *, int);
 void prepare_commit_graft(struct repository *r);
 struct commit_graft *lookup_commit_graft(struct repository *r, const struct object_id *oid);
Signature · 1 line
2.26.0.113.ge9739cdccc
#2 lore raw

Re: [PATCH 1/5] commit: make 'commit_graft_pos' non-static

Hi,

Quoted 14 lines · Taylor Blau

[...] by making 'commit_graft_pos' non-static so that it can
be called from both 'commit.c' and 'shallow.c'.

---
 commit.c | 2 +-
 commit.h | 1 +
 2 files changed, 2 insertions(+), 1 deletion(-)
commit.h +0 -0
index ab91d21131..eb42e8b6d2 100644

commit.h struct commit_graft { · line 239

Quoted 4 lines
commit.h +1 -0
@@ -236,6 +236,7 @@ struct commit_graft {
 typedef int (*each_commit_graft_fn)(const struct commit_graft *, void *);
 
 struct commit_graft *read_graft_line(struct strbuf *line);
+int commit_graft_pos(struct repository *r, const unsigned char *sha1);

Now that this function isn't file-local, its name becomes more significant. What array does this represent a position in? What does it return if the graft isn't found? From a call site it's not necessarily obvious.

Ideas:

- could include a comment saying that it's an index into r->parsed_objects->grafts

- I'm usually loathe to suggest unnecessary duplication of code, but it might make sense to duplicate the function into shallow.c. Or even to inline it there (in the single call site, that ends up being pretty readable).

Thoughts?

Thanks,
Jonathan

#3 lore raw

Re: [PATCH 1/5] commit: make 'commit_graft_pos' non-static

Quoted 29 lines · Jonathan Nieder

Hi,

Quoted 14 lines · Taylor Blau

[...] by making 'commit_graft_pos' non-static so that it can
be called from both 'commit.c' and 'shallow.c'.

---
 commit.c | 2 +-
 commit.h | 1 +
 2 files changed, 2 insertions(+), 1 deletion(-)
commit.h +0 -0
index ab91d21131..eb42e8b6d2 100644

commit.h struct commit_graft { · line 239

Quoted 4 lines
commit.h +1 -0
@@ -236,6 +236,7 @@ struct commit_graft {
 typedef int (*each_commit_graft_fn)(const struct commit_graft *, void *);
 
 struct commit_graft *read_graft_line(struct strbuf *line);
+int commit_graft_pos(struct repository *r, const unsigned char *sha1);

Now that this function isn't file-local, its name becomes more significant. What array does this represent a position in? What does it return if the graft isn't found? From a call site it's not necessarily obvious.

Quoted 4 lines

Ideas:

- could include a comment saying that it's an index into r->parsed_objects->grafts

This and the below are both good ideas to me. I prefer this one, since we'd have to duplicate yet another static function ('commit_graft_sha1_access()' directly above) that is called by this one.

Quoted 4 lines

- I'm usually loathe to suggest unnecessary duplication of code, but it might make sense to duplicate the function into shallow.c. Or even to inline it there (in the single call site, that ends up being pretty readable).

I am not at all offended by duplication of code where it makes sense to do so, but having to duplicate two functions seems like we'd be better off simply documenting the function in commit.h.

Quoted 4 lines

Thoughts?

Thanks,
Jonathan

Thanks,
Taylor

#4 lore raw

PATCH 2/5 shallow: extract a header file for shallow-related functions

In reply to Taylor Blau

There are many functions in commit.h that are more related to shallow repositories than they are to any sort of generic commit machinery. Likely this began when there were only a few shallow-related functions, and commit.h seemed a reasonable enough place to put them.

But, now there are a good number of shallow-related functions, and placing them all in 'commit.h' doesn't make sense.

This patch extracts a 'shallow.h', which takes all of the headers from 'commit.h' for functions which already exist in 'shallow.c'. We will bring the remaining shallow-related functions defined in 'commit.c' in a subsequent patch.

For now, move only the ones that already are implemented in 'shallow.c', and update the necessary includes.

---
 builtin.h     |  1 +
 commit.c      |  1 +
 commit.h      | 48 ---------------------------------------
 fetch-pack.c  |  1 +
 send-pack.c   |  1 +
 shallow.c     |  1 +
 shallow.h     | 63 +++++++++++++++++++++++++++++++++++++++++++++++++++
 upload-pack.c |  1 +
 8 files changed, 69 insertions(+), 48 deletions(-)
 create mode 100644 shallow.h
builtin.h +1 -0
index 2b25a80cde..2e701a023c 100644
@@ -5,6 +5,7 @@
 #include "strbuf.h"
 #include "cache.h"
 #include "commit.h"
+#include "shallow.h"
 
 /*
  * builtin API
commit.c +1 -0
index b76f7d72be..eebfbeb45d 100644
@@ -20,6 +20,7 @@
 #include "refs.h"
 #include "commit-reach.h"
 #include "run-command.h"
+#include "shallow.h"
 
 static struct commit_extra_header *read_commit_extra_header_lines(const char *buf, size_t len, const char **);
 
commit.h +0 -48

55 lines not on this page · raw message

fetch-pack.c +1 -0
index a618f3b029..401d028e41 100644
@@ -22,6 +22,7 @@
 #include "connected.h"
 #include "fetch-negotiator.h"
 #include "fsck.h"
+#include "shallow.h"
 
 static int transfer_unpack_limit = -1;
 static int fetch_unpack_limit = -1;
send-pack.c +1 -0
index 0407841ae8..e0ccfef75a 100644
@@ -15,6 +15,7 @@
 #include "sha1-array.h"
 #include "gpg-interface.h"
 #include "cache.h"
+#include "shallow.h"
 
 int option_parse_push_signed(const struct option *opt,
 			     const char *arg, int unset)
shallow.c +1 -0
index 5010a6c732..d0191c7609 100644
@@ -14,6 +14,7 @@
 #include "commit-slab.h"
 #include "list-objects.h"
 #include "commit-reach.h"
+#include "shallow.h"
 
 void set_alternate_shallow_file(struct repository *r, const char *path, int override)
 {
shallow.h new file +63 -0

63 lines not on this page · raw message

upload-pack.c +1 -0
index c53249cac1..e71b068291 100644
@@ -26,6 +26,7 @@
 #include "serve.h"
 #include "commit-graph.h"
 #include "commit-reach.h"
+#include "shallow.h"
 
 /* Remember to update object flag allocation in object.h */
 #define THEY_HAVE	(1u << 11)
Signature · 1 line
2.26.0.113.ge9739cdccc
#5 lore raw

Re: [PATCH 2/5] shallow: extract a header file for shallow-related functions

Quoted 9 lines · Taylor Blau

There are many functions in commit.h that are more related to shallow repositories than they are to any sort of generic commit machinery. Likely this began when there were only a few shallow-related functions, and commit.h seemed a reasonable enough place to put them.

But, now there are a good number of shallow-related functions, and placing them all in 'commit.h' doesn't make sense.

This patch extracts a 'shallow.h', which takes all of the headers from

Did you mean s/headers/declarations/ ?

Quoted 8 lines

'commit.h' for functions which already exist in 'shallow.c'. We will bring the remaining shallow-related functions defined in 'commit.c' in a subsequent patch.

For now, move only the ones that already are implemented in 'shallow.c', and update the necessary includes.

#6 lore raw

Re: [PATCH 2/5] shallow: extract a header file for shallow-related functions

In reply to Taylor Blau

First of all, I couldn't apply these patches neither on latest master (86ab15cb15 ("The fourth batch", 2020-04-28)) nor on its 2 immediate ancestors - what is the base of these patches? (Or is there something wrong with my workflow?)

I'll review based on the patches themselves, but what I've seen looks good so far.

builtin.h line 8

Quoted 9 lines
builtin.h +1 -0
index 2b25a80cde..2e701a023c 100644
@@ -5,6 +5,7 @@
 #include "strbuf.h"
 #include "cache.h"
 #include "commit.h"
+#include "shallow.h"

It's a pity that builtin.h has to be modified in this way, but I see that it's necessary - a few files that include builtin.h (at least git.c and builtin/bisect--helper.c) assume that they have shallow function access through this header.

Once I manage to apply these patches myself, I'll verify with --color-moved that the lines moved as I expect, but otherwise patch 1 and 2 look good.

#7 lore raw

Re: [PATCH 2/5] shallow: extract a header file for shallow-related functions

Hi Jonathan,

Quoted 4 lines · Jonathan Tan

First of all, I couldn't apply these patches neither on latest master (86ab15cb15 ("The fourth batch", 2020-04-28)) nor on its 2 immediate ancestors - what is the base of these patches? (Or is there something wrong with my workflow?)

Yes, I should have mentioned in the cover letter that this is based on 'tb/reset-shallow' which is should be part of Junio's next push to master. I didn't mention it because I figured that it would be on master by the time anyone wanted to look at these patches ;).

Anyhow, apologies. It should apply cleanly on any branch that has 'tb/reset-shallow' already.

Quoted 17 lines

I'll review based on the patches themselves, but what I've seen looks good so far.

builtin.h line 8

Quoted 9 lines
builtin.h +1 -0
index 2b25a80cde..2e701a023c 100644
@@ -5,6 +5,7 @@
 #include "strbuf.h"
 #include "cache.h"
 #include "commit.h"
+#include "shallow.h"

It's a pity that builtin.h has to be modified in this way, but I see that it's necessary - a few files that include builtin.h (at least git.c and builtin/bisect--helper.c) assume that they have shallow function access through this header.

Yeah :/.

Quoted 3 lines

Once I manage to apply these patches myself, I'll verify with --color-moved that the lines moved as I expect, but otherwise patch 1 and 2 look good.

Thanks.

Thanks,
Taylor

#8 lore raw

Re: [PATCH 2/5] shallow: extract a header file for shallow-related functions

Quoted 7 lines

Yes, I should have mentioned in the cover letter that this is based on 'tb/reset-shallow' which is should be part of Junio's next push to master. I didn't mention it because I figured that it would be on master by the time anyone wanted to look at these patches ;).

Anyhow, apologies. It should apply cleanly on any branch that has 'tb/reset-shallow' already.

Thanks. Now that I'm able to apply the patches, I see that the prototype for unregister_shallow() was removed with no corresponding addition. This causes a compile error when running "make" with DEVELOPER=1. Other than that, things look fine.

#9 lore raw

Re: [PATCH 2/5] shallow: extract a header file for shallow-related functions

In reply to Taylor Blau
Quoted 7 lines · Taylor Blau

There are many functions in commit.h that are more related to shallow repositories than they are to any sort of generic commit machinery. Likely this began when there were only a few shallow-related functions, and commit.h seemed a reasonable enough place to put them.

But, now there are a good number of shallow-related functions, and placing them all in 'commit.h' doesn't make sense.

Sure. For me, there are a few additional sources of motivation:

- shallow clone is a bit of a thorny feature, so I like having the indication of which source files are interacting with it

- this will give us a good place to put any overview documentation on the shallow API

Quoted 7 lines

This patch extracts a 'shallow.h', which takes all of the headers from 'commit.h' for functions which already exist in 'shallow.c'. We will bring the remaining shallow-related functions defined in 'commit.c' in a subsequent patch.

For now, move only the ones that already are implemented in 'shallow.c', and update the necessary includes.

It's probably worth a mention of the builtin.h part here.

(By the way, I wouldn't be against propagating that to the callers, to better match what https://include-what-you-use.org/ would enforce.)

Thanks,
Jonathan

#10 lore raw

PATCH 3/5 commit: move 'unregister_shallow' to 'shallow.h'

In reply to Taylor Blau

In the last commit, we introduced a header for the functions defined in 'shallow.c'. There is one remaining shallow-related function in commit.c which should be moved, too. This patch moves that function.

---
 commit.c  | 13 -------------
 shallow.c | 13 +++++++++++++
 shallow.h |  1 +
 3 files changed, 14 insertions(+), 13 deletions(-)
commit.c +0 -13
index eebfbeb45d..87686a7055 100644
@@ -246,19 +246,6 @@ int for_each_commit_graft(each_commit_graft_fn fn, void *cb_data)
 	return ret;
 }
 
-int unregister_shallow(const struct object_id *oid)
-{
-	int pos = commit_graft_pos(the_repository, oid->hash);
-	if (pos < 0)
-		return -1;
-	if (pos + 1 < the_repository->parsed_objects->grafts_nr)
-		MOVE_ARRAY(the_repository->parsed_objects->grafts + pos,
-			   the_repository->parsed_objects->grafts + pos + 1,
-			   the_repository->parsed_objects->grafts_nr - pos - 1);
-	the_repository->parsed_objects->grafts_nr--;
-	return 0;
-}
-
 struct commit_buffer {
 	void *buffer;
 	unsigned long size;
shallow.c +13 -0
index d0191c7609..76e00893fe 100644
@@ -39,6 +39,19 @@ int register_shallow(struct repository *r, const struct object_id *oid)
 	return register_commit_graft(r, graft, 0);
 }
 
+int unregister_shallow(const struct object_id *oid)
+{
+	int pos = commit_graft_pos(the_repository, oid->hash);
+	if (pos < 0)
+		return -1;
+	if (pos + 1 < the_repository->parsed_objects->grafts_nr)
+		MOVE_ARRAY(the_repository->parsed_objects->grafts + pos,
+			   the_repository->parsed_objects->grafts + pos + 1,
+			   the_repository->parsed_objects->grafts_nr - pos - 1);
+	the_repository->parsed_objects->grafts_nr--;
+	return 0;
+}
+
 int is_repository_shallow(struct repository *r)
 {
 	FILE *fp;
shallow.h +1 -0
index 14dd748625..b50a85ed7e 100644
@@ -8,6 +8,7 @@
 
 void set_alternate_shallow_file(struct repository *r, const char *path, int override);
 int register_shallow(struct repository *r, const struct object_id *oid);
+int unregister_shallow(const struct object_id *oid);
 int is_repository_shallow(struct repository *r);
 int commit_shallow_file(struct repository *r, struct lock_file *lk);
 void rollback_shallow_file(struct repository *r, struct lock_file *lk);
Signature · 1 line
2.26.0.113.ge9739cdccc
Reviewed-by on v1 3/5
#11 lore raw

Re: [PATCH 3/5] commit: move 'unregister_shallow' to 'shallow.h'

Quoted 10 lines · Taylor Blau

In the last commit, we introduced a header for the functions defined in 'shallow.c'. There is one remaining shallow-related function in commit.c which should be moved, too. This patch moves that function.

---
 commit.c  | 13 -------------
 shallow.c | 13 +++++++++++++
 shallow.h |  1 +
 3 files changed, 14 insertions(+), 13 deletions(-)

Yes, an obviously good thing to do.

Perhaps could be squashed with patch 1 (but also see my review of that one).

Should this take a "struct repository" parameter?

#12 lore raw

Re: [PATCH 3/5] commit: move 'unregister_shallow' to 'shallow.h'

Quoted 13 lines · Jonathan Nieder
Quoted 10 lines · Taylor Blau

In the last commit, we introduced a header for the functions defined in 'shallow.c'. There is one remaining shallow-related function in commit.c which should be moved, too. This patch moves that function.

---
 commit.c  | 13 -------------
 shallow.c | 13 +++++++++++++
 shallow.h |  1 +
 3 files changed, 14 insertions(+), 13 deletions(-)
Quoted 4 lines

Yes, an obviously good thing to do.

Perhaps could be squashed with patch 1 (but also see my review of that one).

Do you mean patch 2/5? If so, I think that it probably makes more sense to go there than in the first patch.

(I originally thought that it would be useful for people reading the diff to have this change broken out into its own patch, but I think that it's more juggling to do in terms of figuring out which headers to include than is worth.)

Quoted 3 lines

Should this take a "struct repository" parameter?

Probably, but I'd rather leave this series to be just focused on moving this code around while being minimally invasive.

Thanks,
Taylor

#13 lore raw

PATCH 4/5 shallow.h: document '{commit,rollback}_shallow_file'

In reply to Taylor Blau

When 'commit_shallow_file()' and 'rollback_shallow_file()' were introduced, they did not have an documenting comment, when they could have benefited from one.

Add a brief note about what these functions do, and make a special note that they reset stat-validity checks.

---
 shallow.h | 4 ++++
 1 file changed, 4 insertions(+)
shallow.h +4 -0
index b50a85ed7e..08e1bc4fd0 100644
@@ -10,6 +10,10 @@ void set_alternate_shallow_file(struct repository *r, const char *path, int over
 int register_shallow(struct repository *r, const struct object_id *oid);
 int unregister_shallow(const struct object_id *oid);
 int is_repository_shallow(struct repository *r);
+/*
+ * {commit,rollback}_shallow_file commits or performs a rollback to the
+ * '.git/shallow' file, respectively, and resets stat-validity checks.
+ */
 int commit_shallow_file(struct repository *r, struct lock_file *lk);
 void rollback_shallow_file(struct repository *r, struct lock_file *lk);
 
Signature · 1 line
2.26.0.113.ge9739cdccc
#14 lore raw

Re: [PATCH 4/5] shallow.h: document '{commit,rollback}_shallow_file'

Quoted 3 lines · Taylor Blau

When 'commit_shallow_file()' and 'rollback_shallow_file()' were introduced, they did not have an documenting comment, when they could have benefited from one.

"an" seems wrong; did you mean "a" or "any"? Or, rewrite as: "...they were not documented...".

Quoted 7 lines

Add a brief note about what these functions do, and make a special note that they reset stat-validity checks.

---

shallow.h void set_alternate_shallow_file(struct repository *r, const char *path, int over · line 18

Quoted 9 lines
shallow.h +4 -0
@@ -10,6 +10,10 @@ void set_alternate_shallow_file(struct repository *r, const char *path, int over
 int register_shallow(struct repository *r, const struct object_id *oid);
 int unregister_shallow(const struct object_id *oid);
 int is_repository_shallow(struct repository *r);
+/*
+ * {commit,rollback}_shallow_file commits or performs a rollback to the
+ * '.git/shallow' file, respectively, and resets stat-validity checks.
+ */
 int commit_shallow_file(struct repository *r, struct lock_file *lk);
 void rollback_shallow_file(struct repository *r, struct lock_file *lk);

Or, simpler:

    /* commit .git/shallow and reset stat-validity checks */
    int commit_shallow_file(...);
    /* rollback .git/shallow and reset stat-validity checks */
    void rollback_shallow_file(...);
#15 lore raw

PATCH 5/5 shallow: use struct 'shallow_lock' for additional safety

In reply to Taylor Blau

In previous patches, the functions 'commit_shallow_file' and 'rollback_shallow_file' were introduced to reset the shallowness validity checks on a repository after potentially modifying '.git/shallow'.

These functions can be made safer by wrapping the 'struct lockfile *' in a new type, 'shallow_lock', so that they cannot be called with a raw lock (and potentially misused by other code that happens to possess a lockfile, but has nothing to do with shallowness).

This patch introduces that type as a thin wrapper around 'struct lockfile', and updates the two aforementioned functions and their callers to use it.

---
 builtin/receive-pack.c |  2 +-
 fetch-pack.c           |  2 +-
 shallow.c              | 22 +++++++++++-----------
 shallow.h              | 16 +++++++++++++---
 4 files changed, 26 insertions(+), 16 deletions(-)
builtin/receive-pack.c +1 -1
index 652661fa99..10fd2c52ec 100644
@@ -855,7 +855,7 @@ static void refuse_unconfigured_deny_delete_current(void)
 static int command_singleton_iterator(void *cb_data, struct object_id *oid);
 static int update_shallow_ref(struct command *cmd, struct shallow_info *si)
 {
-	struct lock_file shallow_lock = LOCK_INIT;
+	struct shallow_lock shallow_lock = SHALLOW_LOCK_INIT;
 	struct oid_array extra = OID_ARRAY_INIT;
 	struct check_connected_options opt = CHECK_CONNECTED_INIT;
 	uint32_t mask = 1 << (cmd->index % 32);
fetch-pack.c +1 -1
index 401d028e41..27d2d08cc0 100644
@@ -35,7 +35,7 @@ static int fetch_fsck_objects = -1;
 static int transfer_fsck_objects = -1;
 static int agent_supported;
 static int server_supports_filtering;
-static struct lock_file shallow_lock;
+static struct shallow_lock shallow_lock;
 static const char *alternate_shallow_file;
 static struct strbuf fsck_msg_types = STRBUF_INIT;
 
shallow.c +11 -11
index 76e00893fe..1acf8ce95b 100644
@@ -92,16 +92,16 @@ static void reset_repository_shallow(struct repository *r)
 	stat_validity_clear(r->parsed_objects->shallow_stat);
 }
 
-int commit_shallow_file(struct repository *r, struct lock_file *lk)
+int commit_shallow_file(struct repository *r, struct shallow_lock *lk)
 {
-	int res = commit_lock_file(lk);
+	int res = commit_lock_file(&lk->lk);
 	reset_repository_shallow(r);
 	return res;
 }
 
-void rollback_shallow_file(struct repository *r, struct lock_file *lk)
+void rollback_shallow_file(struct repository *r, struct shallow_lock *lk)
 {
-	rollback_lock_file(lk);
+	rollback_lock_file(&lk->lk);
 	reset_repository_shallow(r);
 }
 
@@ -366,22 +366,22 @@ const char *setup_temporary_shallow(const struct oid_array *extra)
 	return "";
 }
 
-void setup_alternate_shallow(struct lock_file *shallow_lock,
+void setup_alternate_shallow(struct shallow_lock *shallow_lock,
 			     const char **alternate_shallow_file,
 			     const struct oid_array *extra)
 {
 	struct strbuf sb = STRBUF_INIT;
 	int fd;
 
-	fd = hold_lock_file_for_update(shallow_lock,
+	fd = hold_lock_file_for_update(&shallow_lock->lk,
 				       git_path_shallow(the_repository),
 				       LOCK_DIE_ON_ERROR);
 	check_shallow_file_for_update(the_repository);
 	if (write_shallow_commits(&sb, 0, extra)) {
 		if (write_in_full(fd, sb.buf, sb.len) < 0)
 			die_errno("failed to write to %s",
-				  get_lock_file_path(shallow_lock));
-		*alternate_shallow_file = get_lock_file_path(shallow_lock);
+				  get_lock_file_path(&shallow_lock->lk));
+		*alternate_shallow_file = get_lock_file_path(&shallow_lock->lk);
 	} else
 		/*
 		 * is_repository_shallow() sees empty string as "no
@@ -414,7 +414,7 @@ void advertise_shallow_grafts(int fd)
  */
 void prune_shallow(unsigned options)
 {
-	struct lock_file shallow_lock = LOCK_INIT;
+	struct shallow_lock shallow_lock = SHALLOW_LOCK_INIT;
 	struct strbuf sb = STRBUF_INIT;
 	unsigned flags = SEEN_ONLY;
 	int fd;
@@ -428,14 +428,14 @@ void prune_shallow(unsigned options)
 		strbuf_release(&sb);
 		return;
 	}
-	fd = hold_lock_file_for_update(&shallow_lock,
+	fd = hold_lock_file_for_update(&shallow_lock.lk,
 				       git_path_shallow(the_repository),
 				       LOCK_DIE_ON_ERROR);
 	check_shallow_file_for_update(the_repository);
 	if (write_shallow_commits_1(&sb, 0, NULL, flags)) {
 		if (write_in_full(fd, sb.buf, sb.len) < 0)
 			die_errno("failed to write to %s",
-				  get_lock_file_path(&shallow_lock));
+				  get_lock_file_path(&shallow_lock.lk));
 		commit_shallow_file(the_repository, &shallow_lock);
 	} else {
 		unlink(git_path_shallow(the_repository));
shallow.h +13 -3
index 08e1bc4fd0..d12096fbc4 100644
@@ -10,12 +10,22 @@ void set_alternate_shallow_file(struct repository *r, const char *path, int over
 int register_shallow(struct repository *r, const struct object_id *oid);
 int unregister_shallow(const struct object_id *oid);
 int is_repository_shallow(struct repository *r);
+
+/*
+ * shallow_lock is a thin wrapper around 'struct lock_file' in order to restrict
+ * which locks can be used with '{commit,rollback}_shallow_file()'.
+ */
+struct shallow_lock {
+	struct lock_file lk;
+};
+#define SHALLOW_LOCK_INIT { LOCK_INIT }
+
 /*
  * {commit,rollback}_shallow_file commits or performs a rollback to the
  * '.git/shallow' file, respectively, and resets stat-validity checks.
  */
-int commit_shallow_file(struct repository *r, struct lock_file *lk);
-void rollback_shallow_file(struct repository *r, struct lock_file *lk);
+int commit_shallow_file(struct repository *r, struct shallow_lock *lk);
+void rollback_shallow_file(struct repository *r, struct shallow_lock *lk);
 
 struct commit_list *get_shallow_commits(struct object_array *heads,
 					int depth, int shallow_flag, int not_shallow_flag);
@@ -24,7 +34,7 @@ struct commit_list *get_shallow_commits_by_rev_list(
 int write_shallow_commits(struct strbuf *out, int use_pack_protocol,
 			  const struct oid_array *extra);
 
-void setup_alternate_shallow(struct lock_file *shallow_lock,
+void setup_alternate_shallow(struct shallow_lock *shallow_lock,
 			     const char **alternate_shallow_file,
 			     const struct oid_array *extra);
 
Signature · 1 line
2.26.0.113.ge9739cdccc
#16 lore raw

Re: [PATCH 5/5] shallow: use struct 'shallow_lock' for additional safety

Quoted 9 lines · Taylor Blau

[...]
This patch introduces that type as a thin wrapper around 'struct lockfile', and updates the two aforementioned functions and their callers to use it.

---

shallow.h void set_alternate_shallow_file(struct repository *r, const char *path, int over · line 16

Quoted 7 lines
shallow.h +7 -0
@@ -10,12 +10,22 @@ void set_alternate_shallow_file(struct repository *r, const char *path, int over
+/*
+ * shallow_lock is a thin wrapper around 'struct lock_file' in order to restrict
+ * which locks can be used with '{commit,rollback}_shallow_file()'.
+ */
+struct shallow_lock {
+       struct lock_file lk;
+};

The documentation comment for 'shallow_lock' may help newcomers to C but probably doesn't add much value for seasoned programmers. If this is the sort of idiom we want to introduce (or exists already in this codebase) -- declaring a specific C type to avoid accidental use of an unrelated lock -- then it's probably better documented in CodingGuidelines rather than repeating it at each point in the code which employs the idiom.

#17 lore raw

Re: [PATCH 5/5] shallow: use struct 'shallow_lock' for additional safety

Quoted 18 lines · Eric Sunshine
Quoted 9 lines · Taylor Blau

[...]
This patch introduces that type as a thin wrapper around 'struct lockfile', and updates the two aforementioned functions and their callers to use it.

---

shallow.h void set_alternate_shallow_file(struct repository *r, const char *path, int over · line 16

Quoted 7 lines
shallow.h +7 -0
@@ -10,12 +10,22 @@ void set_alternate_shallow_file(struct repository *r, const char *path, int over
+/*
+ * shallow_lock is a thin wrapper around 'struct lock_file' in order to restrict
+ * which locks can be used with '{commit,rollback}_shallow_file()'.
+ */
+struct shallow_lock {
+       struct lock_file lk;
+};
Quoted 7 lines

The documentation comment for 'shallow_lock' may help newcomers to C but probably doesn't add much value for seasoned programmers. If this is the sort of idiom we want to introduce (or exists already in this codebase) -- declaring a specific C type to avoid accidental use of an unrelated lock -- then it's probably better documented in CodingGuidelines rather than repeating it at each point in the code which employs the idiom.

Fair enough; I definitely weighed the usefulness of this comment a little bit when I was writing it. I figured that I didn't want to commit to updating CodingGuidelines in this series, but that I didn't want to leave the explanation only in the commit message.

I figure that it's probably fine to document it in the commit message, and leave it at that for now.

Thanks for this suggestion (and the earlier ones, too). I have applied them locally, and I'll sit on them for a day or two before sending out v2. Thanks again.

Thanks,
Taylor

#18 lore raw

Re: [PATCH 5/5] shallow: use struct 'shallow_lock' for additional safety

In reply to Taylor Blau
Quoted 7 lines
shallow.c +1 -1
@@ -428,14 +428,14 @@ void prune_shallow(unsigned options)
 		strbuf_release(&sb);
 		return;
 	}
-	fd = hold_lock_file_for_update(&shallow_lock,
+	fd = hold_lock_file_for_update(&shallow_lock.lk,
 				       git_path_shallow(the_repository),

shallow.c void prune_shallow(unsigned options) · line 441

Quoted 10 lines
shallow.c +1 -1
 				       LOCK_DIE_ON_ERROR);
 	check_shallow_file_for_update(the_repository);
 	if (write_shallow_commits_1(&sb, 0, NULL, flags)) {
 		if (write_in_full(fd, sb.buf, sb.len) < 0)
 			die_errno("failed to write to %s",
-				  get_lock_file_path(&shallow_lock));
+				  get_lock_file_path(&shallow_lock.lk));
 		commit_shallow_file(the_repository, &shallow_lock);
 	} else {
 		unlink(git_path_shallow(the_repository));

I was hoping that the inner lock ("lk") wouldn't need to be exposed, so that it wouldn't be possible to inadvertently commit the lock without going through commit_shallow_file(), but this patch is still a step towards that.

Quoted 6 lines
shallow.h +0 -0
index 08e1bc4fd0..d12096fbc4 100644
@@ -10,12 +10,22 @@ void set_alternate_shallow_file(struct repository *r, const char *path, int over
 int register_shallow(struct repository *r, const struct object_id *oid);

shallow.h void set_alternate_shallow_file(struct repository *r, const char *path, int over · line 20

Quoted 10 lines
shallow.h +8 -0
 int unregister_shallow(const struct object_id *oid);
 int is_repository_shallow(struct repository *r);
+
+/*
+ * shallow_lock is a thin wrapper around 'struct lock_file' in order to restrict
+ * which locks can be used with '{commit,rollback}_shallow_file()'.
+ */
+struct shallow_lock {
+	struct lock_file lk;
+};

As far as I know, we don't use many abbreviations in struct members - maybe s/lk/lock/.

I couldn't find any other issues with all 5 patches in this patch series, but I would like to be able to apply the patches to be sure.

Reviewed-by on v1 5/5
#19 lore raw

Re: [PATCH 5/5] shallow: use struct 'shallow_lock' for additional safety

In reply to Taylor Blau

Hi,

Quoted 14 lines · Taylor Blau

In previous patches, the functions 'commit_shallow_file' and 'rollback_shallow_file' were introduced to reset the shallowness validity checks on a repository after potentially modifying '.git/shallow'.

These functions can be made safer by wrapping the 'struct lockfile *' in a new type, 'shallow_lock', so that they cannot be called with a raw lock (and potentially misused by other code that happens to possess a lockfile, but has nothing to do with shallowness).

This patch introduces that type as a thin wrapper around 'struct lockfile', and updates the two aforementioned functions and their callers to use it.

Quoted 8 lines
---
 builtin/receive-pack.c |  2 +-
 fetch-pack.c           |  2 +-
 shallow.c              | 22 +++++++++++-----------
 shallow.h              | 16 +++++++++++++---
 4 files changed, 26 insertions(+), 16 deletions(-)

Yay! Thanks for indulging the suggestion.

[...]

Quoted 5 lines
shallow.h +0 -0
@@ -10,12 +10,22 @@ void set_alternate_shallow_file(struct repository *r, const char *path, int over
 int register_shallow(struct repository *r, const struct object_id *oid);
 int unregister_shallow(const struct object_id *oid);

shallow.h void set_alternate_shallow_file(struct repository *r, const char *path, int over · line 21

Quoted 10 lines
shallow.h +9 -0
 int is_repository_shallow(struct repository *r);
+
+/*
+ * shallow_lock is a thin wrapper around 'struct lock_file' in order to restrict
+ * which locks can be used with '{commit,rollback}_shallow_file()'.
+ */
+struct shallow_lock {
+	struct lock_file lk;
+};
+#define SHALLOW_LOCK_INIT { LOCK_INIT }

I think I disagree with Eric here: it's useful to have a comment here to describe the purpose of the struct (i.e., the "why" as opposed to the "what").

I wonder if we can go further, though --- when using a shallow_lock, how should I think of it as a caller? In some sense, the use of 'struct lock_file' is an implementation detail, so we could say:

/*
* Lock for updating the $GIT_DIR/shallow file.
*
* Use commit_shallow_file() to commit an update, or
* rollback_shallow_file() to roll it back. In either case,
* any in-memory cached information about which commits are
* shallow will be appropriately invalidated so that future
* operations reflect the new state.
*/

What do you think?

[...]

Quoted 2 lines
shallow.c +0 -0

[...]

Quoted 6 lines
shallow.c +1 -1
@@ -366,22 +366,22 @@ const char *setup_temporary_shallow(const struct oid_array *extra)
 	return "";
 }
 
-void setup_alternate_shallow(struct lock_file *shallow_lock,
+void setup_alternate_shallow(struct shallow_lock *shallow_lock,

shallow.c const char *setup_temporary_shallow(const struct oid_array *extra) · line 378

Quoted 10 lines
shallow.c +1 -1
 			     const char **alternate_shallow_file,
 			     const struct oid_array *extra)
 {
 	struct strbuf sb = STRBUF_INIT;
 	int fd;
 
-	fd = hold_lock_file_for_update(shallow_lock,
+	fd = hold_lock_file_for_update(&shallow_lock->lk,
 				       git_path_shallow(the_repository),
 				       LOCK_DIE_ON_ERROR);

This is peeking into the underlying lock_file, so I should ask myself whether it's hinting at some missing function in the shallow_lock API. My feeling is "no": setup_alternate_shallow is itself that function. :)

[...]

Quoted 14 lines
shallow.c +1 -2
@@ -414,7 +414,7 @@ void advertise_shallow_grafts(int fd)
  */
 void prune_shallow(unsigned options)
 {
-	struct lock_file shallow_lock = LOCK_INIT;
+	struct shallow_lock shallow_lock = SHALLOW_LOCK_INIT;
 	struct strbuf sb = STRBUF_INIT;
 	unsigned flags = SEEN_ONLY;
 	int fd;
@@ -428,14 +428,14 @@ void prune_shallow(unsigned options)
 		strbuf_release(&sb);
 		return;
 	}
-	fd = hold_lock_file_for_update(&shallow_lock,

shallow.c void prune_shallow(unsigned options) · line 439

Quoted 10 lines
shallow.c +2 -1
+	fd = hold_lock_file_for_update(&shallow_lock.lk,
 				       git_path_shallow(the_repository),
 				       LOCK_DIE_ON_ERROR);
 	check_shallow_file_for_update(the_repository);
 	if (write_shallow_commits_1(&sb, 0, NULL, flags)) {
 		if (write_in_full(fd, sb.buf, sb.len) < 0)
 			die_errno("failed to write to %s",
-				  get_lock_file_path(&shallow_lock));
+				  get_lock_file_path(&shallow_lock.lk));
 		commit_shallow_file(the_repository, &shallow_lock);

There's no obvious helper to extract here either, so this looks good to me.

With whatever tweaks based on Eric's and Jonathan's reviews seem appropriate,

Thanks.

#20 lore raw

Re: [PATCH 5/5] shallow: use struct 'shallow_lock' for additional safety

Quoted 9 lines · Jonathan Nieder
Quoted 4 lines · Taylor Blau

+/*
+ * shallow_lock is a thin wrapper around 'struct lock_file' in order to restrict
+ * which locks can be used with '{commit,rollback}_shallow_file()'.
+ */

I think I disagree with Eric here: it's useful to have a comment here to describe the purpose of the struct (i.e., the "why" as opposed to the "what").

I'm not, in general, opposed to the structure being documented; it's just that the comment, as presented, doesn't seem to add value.

Quoted 14 lines

I wonder if we can go further, though --- when using a shallow_lock, how should I think of it as a caller? In some sense, the use of 'struct lock_file' is an implementation detail, so we could say:

/*
* Lock for updating the $GIT_DIR/shallow file.
*
* Use commit_shallow_file() to commit an update, or
* rollback_shallow_file() to roll it back. In either case,
* any in-memory cached information about which commits are
* shallow will be appropriately invalidated so that future
* operations reflect the new state.
*/

Quoted 1 line

What do you think?

This comment makes more sense and wouldn't have led to me questioning its usefulness. Thanks.

#21 lore raw

Re: [PATCH 5/5] shallow: use struct 'shallow_lock' for additional safety

Quoted 28 lines · Eric Sunshine
Quoted 9 lines · Jonathan Nieder
Quoted 4 lines · Taylor Blau

+/*
+ * shallow_lock is a thin wrapper around 'struct lock_file' in order to restrict
+ * which locks can be used with '{commit,rollback}_shallow_file()'.
+ */

I think I disagree with Eric here: it's useful to have a comment here to describe the purpose of the struct (i.e., the "why" as opposed to the "what").

I'm not, in general, opposed to the structure being documented; it's just that the comment, as presented, doesn't seem to add value.

Quoted 14 lines

I wonder if we can go further, though --- when using a shallow_lock, how should I think of it as a caller? In some sense, the use of 'struct lock_file' is an implementation detail, so we could say:

/*
* Lock for updating the $GIT_DIR/shallow file.
*
* Use commit_shallow_file() to commit an update, or
* rollback_shallow_file() to roll it back. In either case,
* any in-memory cached information about which commits are
* shallow will be appropriately invalidated so that future
* operations reflect the new state.
*/

Quoted 4 lines
Quoted 1 line

What do you think?

This comment makes more sense and wouldn't have led to me questioning its usefulness. Thanks.

Me either, thanks for the suggestion.

Thanks,
Taylor