Enrich Trailer API
cover Enrich Trailer API
This patch series is the first 10 patches of a much larger series I've been working. The main goal of this series is to enrich the API in trailer.h. The larger series brings a number of additional code simplifications and cleanups (exposing and fixing some bugs along the way), and builds on top of this series. The goal of the larger series is to make the trailer interface ready for unit testing. By "trailer API" I mean those functions exposed in trailer.h.
Currently, we have "process_trailers()" in trailer.h which does many different things (parse command-line arguments, create temporary files, etc) that are independent of the concept of "trailers", whose interface trailer.h defines. This makes unit-testing this function difficult. While there is no technical reason why we couldn't write unit tests for the smaller functions that are called within process_trailers(), doing so would involve testing private ("static" in trailer.c) functions instead of the public functions exposed in trailer.h which authoritatively define the API.
As an alternative to this patch series, we could keep trailer.h intact and decide to unit-test the existing "trailer_info_get()" function which does most of the trailer parsing work. However this function wouldn't be easy to test either, because the resulting data structure merely contains the unparsed "trailers" lines. So the unit test (if it wants to inspect the result of parsing these lines) would have to invoke additional parsing functions itself. And at that point it would not longer be a unit test in the traditional sense, because it would be invoking multiple functions at once.
This series breaks up "process_trailers()" into smaller pieces, exposing many of the parts relevant to trailer-related processing in trailer.h. This forces us to start writing unit tests for these now public functions, but that is a good thing because those same unit tests should be easy to write (due to their small(er) sizes), but also, because those unit tests will now ensure some degree of stability across new versions of trailer.h (we will start noticing when the behavior of any of these API functions change).
Another benefit is that more clients (perhaps those outside of Git in the future) will be able to use the same trailer processing algorithms used by the interpret-trailers builtin. For example, a web server may want to parse trailers the same way that interpret-trailers would parse them, without having to shell out to interpret-trailers. Importing the new (richer) trailer.h file that this series promotes would help them achieve that goal. This use case was the original motivation behind my work in this area of Git.
Thanks to the aggressive refactoring in this series, I've been able to identify and fix a couple bugs in our existing implementation. Those fixes build on top of this series but were not included here, in order to keep this series small.
Linus Arver (10):
trailer: move process_trailers() to interpret-trailers.c
trailer: include "trailer" term in API functions
trailer: unify trailer formatting machinery
trailer: delete obsolete formatting functions
sequencer: use the trailer iterator
trailer: make trailer_info struct private
trailer: spread usage of "trailer_block" language
trailer: prepare to move parse_trailers_from_command_line_args() to
builtin
trailer: move arg handling to interpret-trailers.c
trailer: delete obsolete argument handling code from API
builtin/interpret-trailers.c | 169 ++++++++-- builtin/shortlog.c | 7 +- pretty.c | 2 +- ref-filter.c | 2 +- sequencer.c | 35 +-- trailer.c | 579 ++++++++++++++++------------------- trailer.h | 106 ++++--- 7 files changed, 482 insertions(+), 418 deletions(-)
base-commit: a54a84b333adbecf7bc4483c0e36ed5878cac17b
Published-As: https://github.com/gitgitgadget/git/releases/tag/pr-1632%2Flistx%2Ftrailer-api-refactor-part-1-v1
Fetch-It-Via: git fetch https://github.com/gitgitgadget/git pr-1632/listx/trailer-api-refactor-part-1-v1
Pull-Request: https://github.com/gitgitgadget/git/pull/1632
Signature · 1 line
gitgitgadget
PATCH 1/10 trailer: move process_trailers() to interpret-trailers.c
From: Linus Arver <[email protected]>
The interpret-trailers.c builtin is the only place we need to call process_trailers(). As it stands, process_trailers() is inherently tied to how the builtin behaves, so move its definition there.
Delete the corresponding declaration from trailer.h, which then forces us to expose the working innards of that function. This enriches trailer.h to include a more granular API, which can then be unit-tested in the future (because process_trailers() by itself does too many things to be able to be easily unit-tested).
Take this opportunity to demote some file-handling functions out of the trailer API implementation, as these have nothing to do with trailers.
While we're at it, rename process_trailers() to interpret_trailers() in the builtin for consistency with the existing cmd_interpret_trailers(), which wraps around this function.
--- builtin/interpret-trailers.c | 98 +++++++++++++++++++++++++++- trailer.c | 120 ++++------------------------------- trailer.h | 20 +++++- 3 files changed, 126 insertions(+), 112 deletions(-)
builtin/interpret-trailers.c +96 -2
@@ -9,6 +9,7 @@#include "gettext.h" #include "parse-options.h" #include "string-list.h" +#include "tempfile.h" #include "trailer.h" #include "config.h"
@@ -91,6 +92,99 @@ static int parse_opt_parse(const struct option *opt, const char *arg,return 0 ; } +static struct tempfile *trailers_tempfile; + +static FILE *create_in_place_tempfile (const char *file) +{ +struct stat st; +struct strbuf filename_template =STRBUF_INIT ; +const char *tail; +FILE *outfile; + +if (stat (file, &st)) +die_errno (_ ("could not stat %s" ), file); +if (!S_ISREG (st.st_mode)) +die (_ ("file %s is not a regular file" ), file); +if (!(st.st_mode &S_IWUSR )) +die (_ ("file %s is not writable by user" ), file); + +/* Create temporary file in the same directory as the original */ + tail =strrchr (file,'/' ); +if (tail) +strbuf_add (&filename_template, file, tail - file +1 ); +strbuf_addstr (&filename_template,"git-interpret-trailers-XXXXXX" ); + + trailers_tempfile =xmks_tempfile_m (filename_template.buf, st.st_mode); +strbuf_release (&filename_template); + outfile =fdopen_tempfile (trailers_tempfile,"w" ); +if (!outfile) +die_errno (_ ("could not open temporary file" )); + +return outfile; +} + +static void read_input_file (struct strbuf *sb,const char *file) +{ +if (file) { +if (strbuf_read_file (sb, file,0 ) <0 ) +die_errno (_ ("could not read input file '%s'" ), file); + }else { +if (strbuf_read (sb,fileno (stdin),0 ) <0 ) +die_errno (_ ("could not read from stdin" )); + } +} + +static void interpret_trailers (const char *file, +const struct process_trailer_options *opts, +struct list_head *new_trailer_head) +{ +LIST_HEAD (head); +struct strbuf sb =STRBUF_INIT ; +struct trailer_info info; +FILE *outfile = stdout; + +ensure_configured (); + +read_input_file (&sb, file); + +if (opts->in_place) + outfile =create_in_place_tempfile (file); + +parse_trailers (&info, sb.buf, &head, opts); + +/* Print the lines before the trailers */ +if (!opts->only_trailers) +fwrite (sb.buf,1 , info.trailer_block_start, outfile); + +if (!opts->only_trailers && !info.blank_line_before_trailer) +fprintf (outfile,"\n" ); + + +if (!opts->only_input) { +LIST_HEAD (config_head); +LIST_HEAD (arg_head); +parse_trailers_from_config (&config_head); +parse_trailers_from_command_line_args (&arg_head, new_trailer_head); +list_splice (&config_head, &arg_head); +process_trailers_lists (&head, &arg_head); + } + +print_all (outfile, &head, opts); + +free_all (&head); +trailer_info_release (&info); + +/* Print the lines after the trailers as is */ +if (!opts->only_trailers) +fwrite (sb.buf + info.trailer_block_end,1 , sb.len - info.trailer_block_end, outfile); + +if (opts->in_place) +if (rename_tempfile (&trailers_tempfile, file)) +die_errno (_ ("could not rename temporary file to %s" ), file); + +strbuf_release (&sb); +} +int cmd_interpret_trailers (int argc,const char **argv,const char *prefix) {struct process_trailer_options opts =PROCESS_TRAILER_OPTIONS_INIT ;
@@ -132,11 +226,11 @@ int cmd_interpret_trailers(int argc, const char **argv, const char *prefix)if (argc) {int i;for (i =0 ; i < argc; i++) -process_trailers (argv[i], &opts, &trailers); +interpret_trailers (argv[i], &opts, &trailers); }else {if (opts.in_place)die (_ ("no input file given for in-place editing" )); -process_trailers (NULL , &opts, &trailers); +interpret_trailers (NULL , &opts, &trailers); }new_trailers_clear (&trailers);
trailer.c +13 -107
180 lines not on this page · raw message
trailer.h +17 -3
@@ -81,15 +81,29 @@ struct process_trailer_options {#define PROCESS_TRAILER_OPTIONS_INIT {0} -void process_trailers (const char *file, -const struct process_trailer_options *opts, -struct list_head *new_trailer_head); +void parse_trailers_from_config (struct list_head *config_head); + +void parse_trailers_from_command_line_args (struct list_head *arg_head, +struct list_head *new_trailer_head); + +void process_trailers_lists (struct list_head *head, +struct list_head *arg_head); + +void parse_trailers (struct trailer_info *info, +const char *str, +struct list_head *head, +const struct process_trailer_options *opts);void trailer_info_get (struct trailer_info *info,const char *str,const struct process_trailer_options *opts);void trailer_info_release (struct trailer_info *info); +void ensure_configured (void ); +void print_all (FILE *outfile,struct list_head *head, +const struct process_trailer_options *opts); +void free_all (struct list_head *head); +/* * Format the trailers from the commit msg "msg" into the strbuf "out". * Note two caveats about "opts":
Signature · 1 line
gitgitgadget
Re: [PATCH 01/10] trailer: move process_trailers() to interpret-trailers.c
Quoted 13 lines · Linus Arver via GitGitGadget
trailer.h +2
-3@@ -81,15 +81,29 @@ struct process_trailer_options {#define PROCESS_TRAILER_OPTIONS_INIT {0} -void process_trailers (const char *file, -const struct process_trailer_options *opts, -struct list_head *new_trailer_head); +void parse_trailers_from_config (struct list_head *config_head); +
trailer.h struct process_trailer_options { · line 95
Quoted 10 lines
trailer.h +10
-0+void parse_trailers_from_command_line_args (struct list_head *arg_head, +struct list_head *new_trailer_head); + +void process_trailers_lists (struct list_head *head, +struct list_head *arg_head); + +void parse_trailers (struct trailer_info *info, +const char *str, +struct list_head *head, +const struct process_trailer_options *opts);
OK.
trailer.h struct process_trailer_options { · line 105
Quoted 4 lines
trailer.h +4
-0+void ensure_configured (void ); +void print_all (FILE *outfile,struct list_head *head, +const struct process_trailer_options *opts); +void free_all (struct list_head *head);
All of these names are way overly generic to live in the global namespace, no? Granted, they may only be visible to folks who include <trailer.h>, but sooner or later other subsystems would find need to provide library-ish functions that allows their callers to do these things to their subsystem: make sure the subsystem has been initialized, print info on all "things" on a list that the subsystem works on, and free all "things" on such a list.
It is sad to have a function that takes "struct list_head *" as its parameter without having any comment on what the elements on that list are about. free_trailer_items() might be a more appropriate name (or free_all_trailer_items(), if we foresee a need to just free the first item on the list and give such a helper free_trailer_item(), in which case, the distinction between "item" vs "items" might become too subtle.
I am assuming (and did not verify more than seeing the "git show" output with "--color-moved") that other changes in this step are all pure moves? If so, other than need to be careful about naming when making things from static to extern pointed out above, this step looks OK to me.
Thanks.
Re: [PATCH 01/10] trailer: move process_trailers() to interpret-trailers.c
Quoted 3 lines · Junio C Hamano
I am assuming (and did not verify more than seeing the "git show" output with "--color-moved") that other changes in this step are all pure moves?
Yup.
PATCH 2/10 trailer: include "trailer" term in API functions
In reply to Linus Arver via GitGitGadgetFrom: Linus Arver <[email protected]>
These functions are exposed to clients and so they should include "trailer" in their names for easier identification, just like all the other functions already exposed by trailer.h.
--- builtin/interpret-trailers.c | 7 ++++--- trailer.c | 10 +++++----- trailer.h | 10 +++++----- 3 files changed, 14 insertions(+), 13 deletions(-)
builtin/interpret-trailers.c +4 -3
@@ -143,7 +143,7 @@ static void interpret_trailers(const char *file,struct trailer_info info;FILE *outfile = stdout; -ensure_configured (); +trailer_config_init ();read_input_file (&sb, file);
@@ -169,9 +169,10 @@ static void interpret_trailers(const char *file,process_trailers_lists (&head, &arg_head); } -print_all (outfile, &head, opts); +/* Print trailer block. */ +format_trailers (outfile, &head, opts); -free_all (&head); +free_trailers (&head);trailer_info_release (&info);/* Print the lines after the trailers as is */
trailer.c +5 -5
@@ -162,8 +162,8 @@ static void print_tok_val(FILE *outfile, const char *tok, const char *val)fprintf (outfile,"%s%c %s\n" , tok, separators[0 ], val); } -void print_all (FILE *outfile,struct list_head *head, -const struct process_trailer_options *opts) +void format_trailers (FILE *outfile,struct list_head *head, +const struct process_trailer_options *opts) {struct list_head *pos;struct trailer_item *item;
@@ -588,7 +588,7 @@ static int git_trailer_config(const char *conf_key, const char *value,return 0 ; } -void ensure_configured (void ) +void trailer_config_init (void ) {if (configured)return ;
@@ -1023,7 +1023,7 @@ void parse_trailers(struct trailer_info *info, } } -void free_all (struct list_head *head) +void free_trailers (struct list_head *head) {struct list_head *pos, *p;list_for_each_safe (pos, p, head) {
@@ -1041,7 +1041,7 @@ void trailer_info_get(struct trailer_info *info, const char *str,size_t nr =0 , alloc =0 ;char **last =NULL ; -ensure_configured (); +trailer_config_init (); end_of_log_message =find_end_of_log_message (str, opts->no_divider); trailer_block_start =find_trailer_block_start (str, end_of_log_message);
trailer.h +5 -5
@@ -99,11 +99,11 @@ void trailer_info_get(struct trailer_info *info, const char *str,void trailer_info_release (struct trailer_info *info); -void ensure_configured (void ); -void print_all (FILE *outfile,struct list_head *head, -const struct process_trailer_options *opts); -void free_all (struct list_head *head); +void trailer_config_init (void ); +void free_trailers (struct list_head *trailers); +void format_trailers (FILE *outfile,struct list_head *head, +const struct process_trailer_options *opts);/* * Format the trailers from the commit msg "msg" into the strbuf "out". * Note two caveats about "opts":
@@ -111,7 +111,7 @@ void free_all(struct list_head *head);* - this is primarily a helper for pretty.c, and not * all of the flags are supported. * -* - this differs from process_trailers slightly in that we always format +* - this differs from format_trailers slightly in that we always format * only the trailer block itself, even if the "only_trailers" option is not * set. */
Signature · 1 line
gitgitgadget
Re: [PATCH 02/10] trailer: include "trailer" term in API functions
Quoted 5 lines · Linus Arver via GitGitGadget
From: Linus Arver <[email protected]>
These functions are exposed to clients and so they should include "trailer" in their names for easier identification, just like all the other functions already exposed by
trailer.h.
Oh, if you were to do this and code movement in two separate patches, doing the rename before the move in the previous step would have made much more sense. If we stopped after 01/10, the tree would have been a very sorry state. If this came first, even if we stop after these renaming of internal functions that are not extern, nobody wil be hurt by these new and improved names.
Re: [PATCH 02/10] trailer: include "trailer" term in API functions
Quoted 8 lines · Junio C Hamano
Quoted 5 lines · Linus Arver via GitGitGadget
From: Linus Arver <[email protected]>
These functions are exposed to clients and so they should include "trailer" in their names for easier identification, just like all the other functions already exposed by
trailer.h.
Quoted 6 lines
Oh, if you were to do this and code movement in two separate patches, doing the rename before the move in the previous step would have made much more sense. If we stopped after 01/10, the tree would have been a very sorry state. If this came first, even if we stop after these renaming of internal functions that are not extern, nobody wil be hurt by these new and improved names.
Ah very true. I think I was thinking of the series as one atomic thing (all 10 patches or nothing), which is a bad habit I need to break. I'll reorder these two on the next reroll, because principles matter (and it's an easy mechanical change). Thanks.
Re: [PATCH 02/10] trailer: include "trailer" term in API functions
Quoted 4 lines · Linus Arver
Ah very true. I think I was thinking of the series as one atomic thing (all 10 patches or nothing), which is a bad habit I need to break. I'll reorder these two on the next reroll, because principles matter (and it's an easy mechanical change). Thanks.
Thanks. I wouldn't have minded if these renames and moves were done in a single step, but because you already have them as separate two steps, let's keep them separate.
PATCH 3/10 trailer: unify trailer formatting machinery
In reply to Linus Arver via GitGitGadgetFrom: Linus Arver <[email protected]>
Currently have two functions for formatting trailers exposed in trailer.h:
void format_trailers(FILE *outfile, struct list_head *head,
const struct process_trailer_options *opts);
void format_trailers_from_commit(struct strbuf *out, const char *msg,
const struct process_trailer_options *opts);
and previously these functions, although similar enough (even taking the same process_trailer_options struct pointer), did not build on each other.
Make format_trailers_from_commit() rely on format_trailers(). Teach format_trailers() to process trailers with the additional process_trailer_options fields like opts->key_only which is only used by format_trailers_from_commit() and not builtin/interpret-trailers.c.
This will allow us to delete the format_trailer_info() and print_tok_val() functions in the next patch. They are not deleted here in order to keep the diff small.
--- builtin/interpret-trailers.c | 5 +- pretty.c | 2 +- ref-filter.c | 2 +- trailer.c | 105 +++++++++++++++++++++++++++++------ trailer.h | 21 +++---- 5 files changed, 102 insertions(+), 33 deletions(-)
builtin/interpret-trailers.c +4 -1
@@ -140,6 +140,7 @@ static void interpret_trailers(const char *file, {LIST_HEAD (head);struct strbuf sb =STRBUF_INIT ; +struct strbuf trailer_block =STRBUF_INIT ;struct trailer_info info;FILE *outfile = stdout;
@@ -170,7 +171,9 @@ static void interpret_trailers(const char *file, }/* Print trailer block. */ -format_trailers (outfile, &head, opts); +format_trailers (&head, opts, &trailer_block); +fwrite (trailer_block.buf,1 , trailer_block.len, outfile); +strbuf_release (&trailer_block);free_trailers (&head);trailer_info_release (&info);
pretty.c +1 -1
@@ -1759,7 +1759,7 @@ static size_t format_commit_one(struct strbuf *sb, /* in UTF-8 */ goto trailer_out; }if (*arg ==')' ) { -format_trailers_from_commit (sb, msg + c->subject_off, &opts); +format_trailers_from_commit (msg + c->subject_off, &opts, sb); ret = arg - placeholder +1 ; } trailer_out:
ref-filter.c +1 -1
@@ -1985,7 +1985,7 @@ static void grab_sub_body_contents(struct atom_value *val, int deref, struct expstruct strbuf s =STRBUF_INIT ;/* Format the trailer info according to the trailer_opts given */ -format_trailers_from_commit (&s, subpos, &atom->u.contents.trailer_opts); +format_trailers_from_commit (subpos, &atom->u.contents.trailer_opts, &s); v->s =strbuf_detach (&s,NULL ); }else if (atom->u.contents.option ==C_BARE )
trailer.c +88 -17
126 lines not on this page · raw message
trailer.h +8 -13
@@ -102,21 +102,16 @@ void trailer_info_release(struct trailer_info *info);void trailer_config_init (void );void free_trailers (struct list_head *trailers); -void format_trailers (FILE *outfile,struct list_head *head, -const struct process_trailer_options *opts); +void format_trailers (struct list_head *head, +const struct process_trailer_options *opts, +struct strbuf *out);/* -* Format the trailers from the commit msg "msg" into the strbuf "out". -* Note two caveats about "opts": -* -* - this is primarily a helper for pretty.c, and not -* all of the flags are supported. -* -* - this differs from format_trailers slightly in that we always format -* only the trailer block itself, even if the "only_trailers" option is not -* set. +* Convenience function to format the trailers from the commit msg "msg" into +* the strbuf "out". Reuses format_trailers internally. */ -void format_trailers_from_commit (struct strbuf *out,const char *msg, -const struct process_trailer_options *opts); +void format_trailers_from_commit (const char *msg, +const struct process_trailer_options *opts, +struct strbuf *out);/* * An interface for iterating over the trailers found in a particular commit
Signature · 1 line
gitgitgadget
Re: [PATCH 03/10] trailer: unify trailer formatting machinery
Quoted 11 lines · Linus Arver via GitGitGadget
From: Linus Arver <[email protected]>
Currently have two functions for formatting trailers exposed in
trailer.h:void format_trailers(FILE *outfile, struct
list_head*head,
const structprocess_trailer_options*opts);void format_trailers_from_commit(struct strbuf *out, const char *msg,
const structprocess_trailer_options*opts);
Quoted 8 lines
and previously these functions, although similar enough (even taking the same
process_trailer_optionsstruct pointer), did not build on each other.Make
format_trailers_from_commit()rely onformat_trailers(). Teachformat_trailers()to process trailers with the additionalprocess_trailer_optionsfields likeopts->key_onlywhich is only used byformat_trailers_from_commit()and notbuiltin/interpret-trailers.c.
Yay. It feels a bit disappointing to see the diffstat and learn that we are not deleting substantial number of lines.
Quoted 13 lines
--- builtin/interpret-trailers.c | 5 +- pretty.c | 2 +- ref-filter.c | 2 +- trailer.c | 105 +++++++++++++++++++++++++++++------ trailer.h | 21 +++---- 5 files changed, 102 insertions(+), 33 deletions(-)pretty.c +0
-0
pretty.c static size_t format_commit_one(struct strbuf *sb, /* in UTF-8 */ · line 1762
Quoted 5 lines
pretty.c +1
-1@@ -1759,7 +1759,7 @@ static size_t format_commit_one(struct strbuf *sb, /* in UTF-8 */ goto trailer_out; }if (*arg ==')' ) { -format_trailers_from_commit (sb, msg + c->subject_off, &opts); +format_trailers_from_commit (msg + c->subject_off, &opts, sb);
I am curious (read: no objection---merely wondering if there is a guiding principle behind the choice of the new order) why this new parameter ordering. I suspect it was originally written with a strbuf-centric worldview and having sb at the beginning may have made sense, but if we are moving them around, wouldn't it make more sense to have &opts as the first parameter, as this is primarily a "trailers" function? Unsure until I read through to the end, but that is my gut reaction.
Quoted 28 lines
pretty.c +21
-0static struct trailer_item *trailer_from_arg (struct arg_item *arg_tok) {struct trailer_item *new_item =xcalloc (1 ,sizeof (*new_item));@@ -984,6 +971,78 @@ static void unfold_value(struct strbuf *val)strbuf_release (&out); } +void format_trailers (struct list_head *head, +const struct process_trailer_options *opts, +struct strbuf *out) +{ +struct list_head *pos; +struct trailer_item *item; +int need_separator =0 ; + +list_for_each (pos, head) { + item = list_entry(pos, struct trailer_item, list); +if (item->token) { +char c; + ... +if (!opts->filter || opts->filter (&tok, opts->filter_data)) { +if (opts->unfold) +unfold_value (&val); + +if (opts->separator && need_separator) +strbuf_addbuf (out, opts->separator); +if (!opts->value_only) +strbuf_addbuf (out, &tok);
pretty.c static void unfold_value(struct strbuf *val) · line 1004
Quoted 10 lines
pretty.c +10
-0+if (!opts->key_only && !opts->value_only) { +if (opts->key_value_separator) +strbuf_addbuf (out, opts->key_value_separator); +else { + c =last_non_space_char (tok.buf); +if (c) { +if (!strchr (separators, c)) +strbuf_addf (out,"%c " , separators[0 ]); + } + }
That's an overly deep nesting. I wonder if a small file-scope helper function is in order?
static add_separator(struct process_trailer_options *opts,
const char *token
struct strbuf *out)
{
if (opts->key_value_separator)
strbuf_addbuf(out, opts->key_value_separator);
else
strbuf_addstr(out, ": ");
}Or perhaps inside the context of the loop to go over the list of trailer items, one iteration of the list_for_each() loop can become one call to a small helper function format_one_trailer() and that may make the result easier to follow?
In any case, I didn't see anything glaringly wrong so far in this series. Let me keep reading.
Thanks.
Re: [PATCH 03/10] trailer: unify trailer formatting machinery
Quoted 17 lines · Junio C Hamano
Quoted 15 lines · Linus Arver via GitGitGadget
From: Linus Arver <[email protected]>
Currently have two functions for formatting trailers exposed in
trailer.h:void format_trailers(FILE *outfile, struct
list_head*head,
const structprocess_trailer_options*opts);void format_trailers_from_commit(struct strbuf *out, const char *msg,
const structprocess_trailer_options*opts);and previously these functions, although similar enough (even taking the same
process_trailer_optionsstruct pointer), did not build on each other.
Quoted 7 lines
Quoted 4 lines
Make
format_trailers_from_commit()rely onformat_trailers(). Teachformat_trailers()to process trailers with the additionalprocess_trailer_optionsfields likeopts->key_onlywhich is only used byformat_trailers_from_commit()and notbuiltin/interpret-trailers.c.Yay. It feels a bit disappointing to see the diffstat and learn that we are not deleting substantial number of lines.
Indeed ;)
Quoted 8 lines
Quoted 7 lines
--- builtin/interpret-trailers.c | 5 +- pretty.c | 2 +- ref-filter.c | 2 +- trailer.c | 105 +++++++++++++++++++++++++++++------ trailer.h | 21 +++---- 5 files changed, 102 insertions(+), 33 deletions(-)
Quoted 14 lines
pretty.c static size_t format_commit_one(struct strbuf *sb, /* in UTF-8 */ · line 1762
Quoted 10 lines
pretty.c +1
-1@@ -1759,7 +1759,7 @@ static size_t format_commit_one(struct strbuf *sb, /* in UTF-8 */ goto trailer_out; }if (*arg ==')' ) { -format_trailers_from_commit (sb, msg + c->subject_off, &opts); +format_trailers_from_commit (msg + c->subject_off, &opts, sb);I am curious (read: no objection---merely wondering if there is a guiding principle behind the choice of the new order) why this new parameter ordering.
Glen Choo told me a while ago [1] that we usually put "out parameters" at the end, and somehow that stuck with me.
Quoted 3 lines
I suspect it was originally written with a strbuf-centric worldview and having sb at the beginning may have made sense,
Having gotten more familiar with the strbuf.h functions since this patch was originally written, I agree.
Quoted 4 lines
but if we are moving them around, wouldn't it make more sense to have &opts as the first parameter, as this is primarily a "trailers" function? Unsure until I read through to the end, but that is my gut reaction.
I simply (mechanically) moved "sb" from the beginning of the parameters to the end, and didn't think much beyond that adjustment.
Your ordering seems fine to me. Noted for the next reroll, but I will wait until you're done reviewing the other patches before going with the new ordering (in case you change your mind).
Quoted 52 lines
Quoted 28 lines
pretty.c +21
-0static struct trailer_item *trailer_from_arg (struct arg_item *arg_tok) {struct trailer_item *new_item =xcalloc (1 ,sizeof (*new_item));@@ -984,6 +971,78 @@ static void unfold_value(struct strbuf *val)strbuf_release (&out); } +void format_trailers (struct list_head *head, +const struct process_trailer_options *opts, +struct strbuf *out) +{ +struct list_head *pos; +struct trailer_item *item; +int need_separator =0 ; + +list_for_each (pos, head) { + item = list_entry(pos, struct trailer_item, list); +if (item->token) { +char c; + ... +if (!opts->filter || opts->filter (&tok, opts->filter_data)) { +if (opts->unfold) +unfold_value (&val); + +if (opts->separator && need_separator) +strbuf_addbuf (out, opts->separator); +if (!opts->value_only) +strbuf_addbuf (out, &tok);pretty.c static void unfold_value(struct strbuf *val) · line 1004
Quoted 10 lines
pretty.c +10
-0+if (!opts->key_only && !opts->value_only) { +if (opts->key_value_separator) +strbuf_addbuf (out, opts->key_value_separator); +else { + c =last_non_space_char (tok.buf); +if (c) { +if (!strchr (separators, c)) +strbuf_addf (out,"%c " , separators[0 ]); + } + }That's an overly deep nesting. I wonder if a small file-scope helper function is in order?
static add_separator(struct process_trailer_options *opts, const char *token struct strbuf *out) { if (opts->key_value_separator) strbuf_addbuf(out, opts->key_value_separator); else strbuf_addstr(out, ": "); }
Quoted 4 lines
Or perhaps inside the context of the loop to go over the list of trailer items, one iteration of the
list_for_each()loop can become one call to a small helper functionformat_one_trailer()and that may make the result easier to follow?
This is actually what I've already done (introducing helper functions to make this more readable and reduce nesting), but in the larger series (not in this patch series). I think in this patch I tried to avoid introducing new functions in order to keep the original "shape" of the existing refactored functions, including all of the nesting that they originally had. I wanted to keep the original shape because I thought that would make review simpler.
Quoted 4 lines
In any case, I didn't see anything glaringly wrong so far in this series. Let me keep reading.
Thanks.
Thank you for reviewing!
PATCH 4/10 trailer: delete obsolete formatting functions
In reply to Linus Arver via GitGitGadgetFrom: Linus Arver <[email protected]>
--- trailer.c | 79 ------------------------------------------------------- 1 file changed, 79 deletions(-)
trailer.c +0 -79
@@ -144,24 +144,6 @@ static char last_non_space_char(const char *s)return '\0' ; } -static void print_tok_val (FILE *outfile,const char *tok,const char *val) -{ -char c; - -if (!tok) { -fprintf (outfile,"%s\n" , val); -return ; - } - - c =last_non_space_char (tok); -if (!c) -return ; -if (strchr (separators, c)) -fprintf (outfile,"%s%s\n" , tok, val); -else -fprintf (outfile,"%s%c %s\n" , tok, separators[0 ], val); -} -static struct trailer_item *trailer_from_arg (struct arg_item *arg_tok) {struct trailer_item *new_item =xcalloc (1 ,sizeof (*new_item));
@@ -1142,67 +1124,6 @@ void trailer_info_release(struct trailer_info *info)free (info->trailers); } -static void format_trailer_info (struct strbuf *out, -const struct trailer_info *info, -const char *msg, -const struct process_trailer_options *opts) -{ -size_t origlen = out->len; -size_t i; - -/* If we want the whole block untouched, we can take the fast path. */ -if (!opts->only_trailers && !opts->unfold && !opts->filter && - !opts->separator && !opts->key_only && !opts->value_only && - !opts->key_value_separator) { -strbuf_add (out, msg + info->trailer_block_start, - info->trailer_block_end - info->trailer_block_start); -return ; - } - -for (i =0 ; i < info->trailer_nr; i++) { -char *trailer = info->trailers[i]; -ssize_t separator_pos =find_separator (trailer, separators); - -if (separator_pos >=1 ) { -struct strbuf tok =STRBUF_INIT ; -struct strbuf val =STRBUF_INIT ; - -parse_trailer (&tok, &val,NULL , trailer, separator_pos); -if (!opts->filter || opts->filter (&tok, opts->filter_data)) { -if (opts->unfold) -unfold_value (&val); - -if (opts->separator && out->len != origlen) -strbuf_addbuf (out, opts->separator); -if (!opts->value_only) -strbuf_addbuf (out, &tok); -if (!opts->key_only && !opts->value_only) { -if (opts->key_value_separator) -strbuf_addbuf (out, opts->key_value_separator); -else -strbuf_addstr (out,": " ); - } -if (!opts->key_only) -strbuf_addbuf (out, &val); -if (!opts->separator) -strbuf_addch (out,'\n' ); - } -strbuf_release (&tok); -strbuf_release (&val); - - }else if (!opts->only_trailers) { -if (opts->separator && out->len != origlen) { -strbuf_addbuf (out, opts->separator); - } -strbuf_addstr (out, trailer); -if (opts->separator) { -strbuf_rtrim (out); - } - } - } - -} -void format_trailers_from_commit (const char *msg,const struct process_trailer_options *opts,struct strbuf *out)
Signature · 1 line
gitgitgadget
Re: [PATCH 04/10] trailer: delete obsolete formatting functions
Quoted 6 lines · Linus Arver via GitGitGadget
From: Linus Arver <[email protected]>
Signed-off-by Linus Arver <[email protected]>--- trailer.c | 79 ------------------------------------------------------- 1 file changed, 79 deletions(-)
OK, these unused functions are the reason why 03/10 weren't removing as many lines as I would have expected from the refactoring.
Looking good.
PATCH 5/10 sequencer: use the trailer iterator
In reply to Linus Arver via GitGitGadgetFrom: Linus Arver <[email protected]>
This patch allows for the removal of "trailer_info_get()" from the trailer.h API, which will be in the next patch.
Instead of calling "trailer_info_get()", which is a low-level function in the trailers implementation (trailer.c), call trailer_iterator_advance(), which was specifically designed for public consumption in f0939a0eb1 (trailer: add interface for iterating over commit trailers, 2020-09-27).
Avoiding "trailer_info_get()" means we don't have to worry about options like "no_divider" (relevant for parsing trailers). We also don't have to check for things like "info.trailer_start == info.trailer_end" to see whether there were any trailers (instead we can just check to see whether the iterator advanced at all).
Also, teach the iterator about non-trailer lines, by adding a new field called "raw" to hold both trailer and non-trailer lines. This is necessary because a "trailer block" is a list of trailer lines of at least 25% trailers (see 146245063e (trailer: allow non-trailers in trailer block, 2016-10-21)), such that it may hold non-trailer lines.
--- builtin/shortlog.c | 7 +++++-- sequencer.c | 35 +++++++++++++++-------------------- trailer.c | 20 ++++++++++++-------- trailer.h | 13 +++++++++++++ 4 files changed, 45 insertions(+), 30 deletions(-)
builtin/shortlog.c +5 -2
@@ -172,7 +172,7 @@ static void insert_records_from_trailers(struct shortlog *log, const char *oneline) {struct trailer_iterator iter; -const char *commit_buffer, *body; +const char *commit_buffer, *body, *value;struct strbuf ident =STRBUF_INIT ;if (!log->trailers.nr)
@@ -190,7 +190,10 @@ static void insert_records_from_trailers(struct shortlog *log,trailer_iterator_init (&iter, body);while (trailer_iterator_advance (&iter)) { -const char *value = iter.val.buf; +if (!iter.is_trailer) +continue ; + + value = iter.val.buf;if (!string_list_has_string (&log->trailers, iter.key.buf))continue ;
sequencer.c +15 -20
@@ -319,37 +319,32 @@ static const char *get_todo_path(const struct replay_opts *opts)static int has_conforming_footer (struct strbuf *sb,struct strbuf *sob,size_t ignore_footer) { -struct process_trailer_options opts =PROCESS_TRAILER_OPTIONS_INIT ; -struct trailer_info info; -size_t i; -int found_sob =0 , found_sob_last =0 ; -char saved_char; - - opts.no_divider =1 ; +struct trailer_iterator iter; +size_t i =0 , found_sob =0 ; +char saved_char = sb->buf[sb->len - ignore_footer];if (ignore_footer) { - saved_char = sb->buf[sb->len - ignore_footer]; sb->buf[sb->len - ignore_footer] ='\0' ; } -trailer_info_get (&info, sb->buf, &opts); +trailer_iterator_init (&iter, sb->buf); +while (trailer_iterator_advance (&iter)) { + i++; +if (sob && + iter.is_trailer && + !strncmp (iter.raw.buf, sob->buf, sob->len)) { + found_sob = i; + } + } +trailer_iterator_release (&iter);if (ignore_footer) sb->buf[sb->len - ignore_footer] = saved_char; -if (info.trailer_block_start == info.trailer_block_end) +if (!i)return 0 ; -for (i =0 ; i < info.trailer_nr; i++) -if (sob && !strncmp (info.trailers[i], sob->buf, sob->len)) { - found_sob =1 ; -if (i == info.trailer_nr -1 ) - found_sob_last =1 ; - } - -trailer_info_release (&info); - -if (found_sob_last) +if (found_sob == i)return 3 ;if (found_sob)return 2 ;
trailer.c +12 -8
@@ -1151,6 +1151,7 @@ void trailer_iterator_init(struct trailer_iterator *iter, const char *msg)struct process_trailer_options opts =PROCESS_TRAILER_OPTIONS_INIT ;strbuf_init (&iter->key,0 );strbuf_init (&iter->val,0 ); +strbuf_init (&iter->raw,0 ); opts.no_divider =1 ;trailer_info_get (&iter->internal.info, msg, &opts); iter->internal.cur =0 ;
@@ -1158,17 +1159,19 @@ void trailer_iterator_init(struct trailer_iterator *iter, const char *msg)int trailer_iterator_advance (struct trailer_iterator *iter) { -while (iter->internal.cur < iter->internal.info.trailer_nr) { -char *trailer = iter->internal.info.trailers[iter->internal.cur++]; -int separator_pos =find_separator (trailer, separators); - -if (separator_pos <1 ) -continue ;/* not a real trailer */ - +char *line; +int separator_pos; +if (iter->internal.cur < iter->internal.info.trailer_nr) { + line = iter->internal.info.trailers[iter->internal.cur++]; + separator_pos =find_separator (line, separators); + iter->is_trailer = (separator_pos >0 ); + +strbuf_reset (&iter->raw); +strbuf_addstr (&iter->raw, line);strbuf_reset (&iter->key);strbuf_reset (&iter->val);parse_trailer (&iter->key, &iter->val,NULL , - trailer, separator_pos); + line, separator_pos);unfold_value (&iter->val);return 1 ; }
@@ -1180,4 +1183,5 @@ void trailer_iterator_release(struct trailer_iterator *iter)trailer_info_release (&iter->internal.info);strbuf_release (&iter->val);strbuf_release (&iter->key); +strbuf_release (&iter->raw); }
trailer.h +13 -0
@@ -127,6 +127,19 @@ struct trailer_iterator {struct strbuf key;struct strbuf val; +/* +* Raw line (e.g., "foo: bar baz") before being parsed as a trailer +* key/val pair. This field can contain non-trailer lines because it's +* valid for a trailer block to contain such lines (i.e., we only +* require 25% of the lines in a trailer block to be trailer lines). +*/ +struct strbuf raw; + +/* +* 1 if the raw line was parsed as a separate key/val pair. +*/ +int is_trailer; +/* private */ struct {struct trailer_info info;
Signature · 1 line
gitgitgadget
Re: [PATCH 05/10] sequencer: use the trailer iterator
Quoted 11 lines · Linus Arver via GitGitGadget
From: Linus Arver <[email protected]>
This patch allows for the removal of "
trailer_info_get()" from thetrailer.hAPI, which will be in the next patch.Instead of calling "
trailer_info_get()", which is a low-level function in the trailers implementation (trailer.c), calltrailer_iterator_advance(), which was specifically designed for public consumption inf0939a0eb1(trailer: add interface for iterating over commit trailers, 2020-09-27).
Quoted 5 lines
Avoiding "
trailer_info_get()" means we don't have to worry about options like "no_divider" (relevant for parsing trailers). We also don't have to check for things like "info.trailer_start == info.trailer_end" to see whether there were any trailers (instead we can just check to see whether the iterator advanced at all).
Nice.
Quoted 5 lines
Also, teach the iterator about non-trailer lines, by adding a new field called "raw" to hold both trailer and non-trailer lines. This is necessary because a "trailer block" is a list of trailer lines of at least 25% trailers (see
146245063e(trailer: allow non-trailers in trailer block, 2016-10-21)), such that it may hold non-trailer lines.
OK. This would change behaviour, wouldn't it, in the sense that we used to yield a non-trailer line from the old iterator but the new one skips them? Is that something we can demonstrate and protect in tests (presumably once we conclude these refactoring, we would be able to call into this machinery from unit-testing framework)?
Thanks.
Quoted 160 lines
Signed-off-by Linus Arver <[email protected]>--- builtin/shortlog.c | 7 +++++-- sequencer.c | 35 +++++++++++++++-------------------- trailer.c | 20 ++++++++++++-------- trailer.h | 13 +++++++++++++ 4 files changed, 45 insertions(+), 30 deletions(-)builtin/shortlog.c +5
-2@@ -172,7 +172,7 @@ static void insert_records_from_trailers(struct shortlog *log, const char *oneline) {struct trailer_iterator iter; -const char *commit_buffer, *body; +const char *commit_buffer, *body, *value;struct strbuf ident =STRBUF_INIT ;if (!log->trailers.nr)@@ -190,7 +190,10 @@ static void insert_records_from_trailers(struct shortlog *log,trailer_iterator_init (&iter, body);while (trailer_iterator_advance (&iter)) { -const char *value = iter.val.buf; +if (!iter.is_trailer) +continue ; + + value = iter.val.buf;if (!string_list_has_string (&log->trailers, iter.key.buf))continue ;sequencer.c +15
-20@@ -319,37 +319,32 @@ static const char *get_todo_path(const struct replay_opts *opts)static int has_conforming_footer (struct strbuf *sb,struct strbuf *sob,size_t ignore_footer) { -struct process_trailer_options opts =PROCESS_TRAILER_OPTIONS_INIT ; -struct trailer_info info; -size_t i; -int found_sob =0 , found_sob_last =0 ; -char saved_char; - - opts.no_divider =1 ; +struct trailer_iterator iter; +size_t i =0 , found_sob =0 ; +char saved_char = sb->buf[sb->len - ignore_footer];if (ignore_footer) { - saved_char = sb->buf[sb->len - ignore_footer]; sb->buf[sb->len - ignore_footer] ='\0' ; } -trailer_info_get (&info, sb->buf, &opts); +trailer_iterator_init (&iter, sb->buf); +while (trailer_iterator_advance (&iter)) { + i++; +if (sob && + iter.is_trailer && + !strncmp (iter.raw.buf, sob->buf, sob->len)) { + found_sob = i; + } + } +trailer_iterator_release (&iter);if (ignore_footer) sb->buf[sb->len - ignore_footer] = saved_char; -if (info.trailer_block_start == info.trailer_block_end) +if (!i)return 0 ; -for (i =0 ; i < info.trailer_nr; i++) -if (sob && !strncmp (info.trailers[i], sob->buf, sob->len)) { - found_sob =1 ; -if (i == info.trailer_nr -1 ) - found_sob_last =1 ; - } - -trailer_info_release (&info); - -if (found_sob_last) +if (found_sob == i)return 3 ;if (found_sob)return 2 ;trailer.c +12
-8@@ -1151,6 +1151,7 @@ void trailer_iterator_init(struct trailer_iterator *iter, const char *msg)struct process_trailer_options opts =PROCESS_TRAILER_OPTIONS_INIT ;strbuf_init (&iter->key,0 );strbuf_init (&iter->val,0 ); +strbuf_init (&iter->raw,0 ); opts.no_divider =1 ;trailer_info_get (&iter->internal.info, msg, &opts); iter->internal.cur =0 ;@@ -1158,17 +1159,19 @@ void trailer_iterator_init(struct trailer_iterator *iter, const char *msg)int trailer_iterator_advance (struct trailer_iterator *iter) { -while (iter->internal.cur < iter->internal.info.trailer_nr) { -char *trailer = iter->internal.info.trailers[iter->internal.cur++]; -int separator_pos =find_separator (trailer, separators); - -if (separator_pos <1 ) -continue ;/* not a real trailer */ - +char *line; +int separator_pos; +if (iter->internal.cur < iter->internal.info.trailer_nr) { + line = iter->internal.info.trailers[iter->internal.cur++]; + separator_pos =find_separator (line, separators); + iter->is_trailer = (separator_pos >0 ); + +strbuf_reset (&iter->raw); +strbuf_addstr (&iter->raw, line);strbuf_reset (&iter->key);strbuf_reset (&iter->val);parse_trailer (&iter->key, &iter->val,NULL , - trailer, separator_pos); + line, separator_pos);unfold_value (&iter->val);return 1 ; }@@ -1180,4 +1183,5 @@ void trailer_iterator_release(struct trailer_iterator *iter)trailer_info_release (&iter->internal.info);strbuf_release (&iter->val);strbuf_release (&iter->key); +strbuf_release (&iter->raw); }trailer.h +13
-0@@ -127,6 +127,19 @@ struct trailer_iterator {struct strbuf key;struct strbuf val; +/* +* Raw line (e.g., "foo: bar baz") before being parsed as a trailer +* key/val pair. This field can contain non-trailer lines because it's +* valid for a trailer block to contain such lines (i.e., we only +* require 25% of the lines in a trailer block to be trailer lines). +*/ +struct strbuf raw; + +/* +* 1 if the raw line was parsed as a separate key/val pair. +*/ +int is_trailer; +/* private */ struct {struct trailer_info info;
Re: [PATCH 05/10] sequencer: use the trailer iterator
Quoted 10 lines · Junio C Hamano
Quoted 6 lines
From: Linus Arver <[email protected]>
Also, teach the iterator about non-trailer lines, by adding a new field called "raw" to hold both trailer and non-trailer lines. This is necessary because a "trailer block" is a list of trailer lines of at least 25% trailers (see146245063e(trailer: allow non-trailers in trailer block, 2016-10-21)), such that it may hold non-trailer lines.OK. This would change behaviour, wouldn't it, in the sense that we used to yield a non-trailer line from the old iterator but the new one skips them?
I think it's the other way; the old iterator only iterated over trailer lines, skipping over non-trailer lines (see the "not a real trailer" deleted bit for trailer_iterator_advance()). The new one iterates over all lines found in the trailer block, whether they are trailer or non-trailer lines.
The function insert_records_from_trailers() from shortlog.c uses the new iterator, but has to be careful because the new iterator goes over non-trailer lines too. That's why it now does
if (!iter.is_trailer)
continue;to do the skipping itself.
Quoted 3 lines
Is that something we can demonstrate and protect in tests (presumably once we conclude these refactoring, we would be able to call into this machinery from unit-testing framework)?
Yup, that is exactly what I want to do once the dust around the trailer API settles down after this series (and also the larger series). :)
Re: [PATCH 05/10] sequencer: use the trailer iterator
In reply to Linus Arver via GitGitGadgetQuoted 5 lines · Linus Arver via GitGitGadget
trailer.h +0
-0
trailer.h struct trailer_iterator { · line 136
Quoted 10 lines
trailer.h +7
-0@@ -127,6 +127,19 @@ struct trailer_iterator {struct strbuf key;struct strbuf val; +/* +* Raw line (e.g., "foo: bar baz") before being parsed as a trailer +* key/val pair. This field can contain non-trailer lines because it's +* valid for a trailer block to contain such lines (i.e., we only +* require 25% of the lines in a trailer block to be trailer lines). +*/ +struct strbuf raw;
Originally I used a strbuf here for consistency with the other strbufs used in the iterator for the key and val members. But now I've realized that there's no need to make "raw" a strbuf at all, because iterator users will never need to manipulate the string that this points to. Will change to just "const char *" in the reroll.
PATCH 6/10 trailer: make trailer_info struct private
In reply to Linus Arver via GitGitGadgetFrom: Linus Arver <[email protected]>
In 13211ae23f (trailer: separate public from internal portion of trailer_iterator, 2023-09-09) we moved trailer_info behind an anonymous struct to discourage use by trailer.h API users. However it still left open the possibility of external use of trailer_info itself. Now that there are no external users of trailer_info, we can make this struct private.
Make this struct private by putting its definition inside trailer.c. This has two benefits:
(1) it makes the surface area of the public facing interface (trailer.h) smaller, and
(2) external API users are unable to peer inside this struct (because it is only ever exposed as an opaque pointer).
This change exposes some deficiencies in the API, mainly with regard to information about the location of the trailer block that was parsed. Expose new API functions to access this information (needed by builtin/interpret-trailers.c).
The idea in this patch to hide implementation details behind an "opaque pointer" is also known as the "pimpl" (pointer to implementation) idiom in C++ and is a common pattern in that language (where, for example, abstract classes only have pointers to concrete classes).
However, the original inspiration to use this idiom does not come from C++, but instead the book "C Interfaces and Implementations: Techniques for Creating Reusable Software" [1]. This book recommends opaque pointers as a good design principle for designing C libraries, using the term "interface" as the functions defined in *.h (header) files and "implementation" as the corresponding *.c file which define the interfaces.
The book says this about opaque pointers:
... clients can manipulate such pointers freely, but they can’t dereference them; that is, they can’t look at the innards of the structure pointed to by them. Only the implementation has that privilege. Opaque pointers hide representation details and help catch errors.
In our case, "struct trailer_info" is now hidden from clients, and the ways in which this opaque pointer can be used is limited to the richness of the trailer.h file. In other words, trailer.h exclusively controls exactly how "trailer_info" pointers are to be used.
[1] Hanson, David R. "C Interfaces and Implementations: Techniques for Creating Reusable Software". Addison Wesley, 1997. p. 22
--- builtin/interpret-trailers.c | 13 +-- trailer.c | 154 +++++++++++++++++++++++------------ trailer.h | 37 ++------- 3 files changed, 117 insertions(+), 87 deletions(-)
builtin/interpret-trailers.c +7 -6
@@ -141,7 +141,7 @@ static void interpret_trailers(const char *file,LIST_HEAD (head);struct strbuf sb =STRBUF_INIT ;struct strbuf trailer_block =STRBUF_INIT ; -struct trailer_info info; +struct trailer_info *info;FILE *outfile = stdout;trailer_config_init ();
@@ -151,13 +151,13 @@ static void interpret_trailers(const char *file,if (opts->in_place) outfile =create_in_place_tempfile (file); -parse_trailers (&info, sb.buf, &head, opts); + info =parse_trailers (sb.buf, &head, opts);/* Print the lines before the trailers */ if (!opts->only_trailers) -fwrite (sb.buf,1 , info.trailer_block_start, outfile); +fwrite (sb.buf,1 ,trailer_block_start (info), outfile); -if (!opts->only_trailers && !info.blank_line_before_trailer) +if (!opts->only_trailers && !blank_line_before_trailer_block (info))fprintf (outfile,"\n" );
@@ -176,11 +176,12 @@ static void interpret_trailers(const char *file,strbuf_release (&trailer_block);free_trailers (&head); -trailer_info_release (&info);/* Print the lines after the trailers as is */ if (!opts->only_trailers) -fwrite (sb.buf + info.trailer_block_end,1 , sb.len - info.trailer_block_end, outfile); +fwrite (sb.buf +trailer_block_end (info),1 , sb.len -trailer_block_end (info), outfile); + +trailer_info_release (info);if (opts->in_place)if (rename_tempfile (&trailers_tempfile, file))
trailer.c +101 -53
232 lines not on this page · raw message
trailer.h +9 -28
@@ -4,6 +4,8 @@#include "list.h" #include "strbuf.h" +struct trailer_info ; +enum trailer_where {WHERE_DEFAULT ,WHERE_END ,
@@ -29,27 +31,6 @@ int trailer_set_where(enum trailer_where *item, const char *value);int trailer_set_if_exists (enum trailer_if_exists *item,const char *value);int trailer_set_if_missing (enum trailer_if_missing *item,const char *value); -struct trailer_info { -/* -* True if there is a blank line before the location pointed to by -* trailer_block_start. -*/ -int blank_line_before_trailer; - -/* -* Offsets to the trailer block start and end positions in the input -* string. If no trailer block is found, these are both set to the -* "true" end of the input (find_end_of_log_message()). -*/ -size_t trailer_block_start, trailer_block_end; - -/* -* Array of trailers found. -*/ -char **trailers; -size_t trailer_nr; -}; -/* * A list that represents newly-added trailers, such as those provided * with the --trailer command line option of git-interpret-trailers.
@@ -89,13 +70,13 @@ void parse_trailers_from_command_line_args(struct list_head *arg_head,void process_trailers_lists (struct list_head *head,struct list_head *arg_head); -void parse_trailers (struct trailer_info *info, -const char *str, -struct list_head *head, -const struct process_trailer_options *opts); +struct trailer_info *parse_trailers (const char *str, +struct list_head *head, +const struct process_trailer_options *opts); -void trailer_info_get (struct trailer_info *info,const char *str, -const struct process_trailer_options *opts); +size_t trailer_block_start (struct trailer_info *info); +size_t trailer_block_end (struct trailer_info *info); +int blank_line_before_trailer_block (struct trailer_info *info);void trailer_info_release (struct trailer_info *info);
@@ -142,7 +123,7 @@ struct trailer_iterator {/* private */ struct { -struct trailer_info info; +struct trailer_info *info;size_t cur; } internal; };
Signature · 1 line
gitgitgadget
Re: [PATCH 06/10] trailer: make trailer_info struct private
Quoted 8 lines · Linus Arver via GitGitGadget
From: Linus Arver <[email protected]>
In
13211ae23f(trailer: separate public from internal portion oftrailer_iterator, 2023-09-09) we movedtrailer_infobehind an anonymous struct to discourage use bytrailer.hAPI users. However it still left open the possibility of external use oftrailer_infoitself. Now that there are no external users oftrailer_info, we can make this struct private.
Surely, and looking good from a cursory glance. I'll defer to Christian to comment on this step as an area expert, though.
Thanks.
Re: [PATCH 06/10] trailer: make trailer_info struct private
In reply to Linus Arver via GitGitGadgetQuoted 52 lines · Linus Arver via GitGitGadget
From: Linus Arver <[email protected]>
In
13211ae23f(trailer: separate public from internal portion oftrailer_iterator, 2023-09-09) we movedtrailer_infobehind an anonymous struct to discourage use bytrailer.hAPI users. However it still left open the possibility of external use oftrailer_infoitself. Now that there are no external users oftrailer_info, we can make this struct private.Make this struct private by putting its definition inside
trailer.c. This has two benefits:(1) it makes the surface area of the public facing interface (
trailer.h) smaller, and(2) external API users are unable to peer inside this struct (because it is only ever exposed as an opaque pointer).
This change exposes some deficiencies in the API, mainly with regard to information about the location of the trailer block that was parsed. Expose new API functions to access this information (needed by
builtin/interpret-trailers.c).The idea in this patch to hide implementation details behind an "opaque pointer" is also known as the "pimpl" (pointer to implementation) idiom in C++ and is a common pattern in that language (where, for example, abstract classes only have pointers to concrete classes).
However, the original inspiration to use this idiom does not come from C++, but instead the book "C Interfaces and Implementations: Techniques for Creating Reusable Software" [1]. This book recommends opaque pointers as a good design principle for designing C libraries, using the term "interface" as the functions defined in *.h (header) files and "implementation" as the corresponding *.c file which define the interfaces.
The book says this about opaque pointers:
... clients can manipulate such pointers freely, but they can’t dereference them; that is, they can’t look at the innards of the structure pointed to by them. Only the implementation has that privilege. Opaque pointers hide representation details and help catch errors.
In our case, "struct
trailer_info" is now hidden from clients, and the ways in which this opaque pointer can be used is limited to the richness of thetrailer.hfile. In other words,trailer.hexclusively controls exactly how "trailer_info" pointers are to be used.[1] Hanson, David R. "C Interfaces and Implementations: Techniques for Creating Reusable Software". Addison Wesley, 1997. p. 22
Quoted 6 lines
Signed-off-by Linus Arver <[email protected]>--- builtin/interpret-trailers.c | 13 +-- trailer.c | 154 +++++++++++++++++++++++------------ trailer.h | 37 ++------- 3 files changed, 117 insertions(+), 87 deletions(-)
Looks like a pretty straightforward change. I think the only point worth discussing is using the "pimpl" idiom. I think it's harder to see the value because the trailer_info struct is fairly simple, but I can definitely see this pattern being useful as we libify more complex parts of Git where the struct internals have more complicated logic involved. The pimpl pattern also seems like it will force us to think harder about providing a useful interface, so I am in favor of using it here as practice for future libification.
Re: [PATCH 06/10] trailer: make trailer_info struct private
Quoted 3 lines · Josh Steadmon
The pimpl pattern also seems like it will force us to think harder about providing a useful interface, so I am in favor of using it here as practice for future libification.
Sounds good.
PATCH 7/10 trailer: spread usage of "trailer_block" language
In reply to Linus Arver via GitGitGadgetFrom: Linus Arver <[email protected]>
Deprecate the "trailer_info" struct name and replace it with "trailer_block". The main reason is to help readability, because "trailer_info" on the surface sounds like it's about a single trailer when in reality it is a collection of contiguous lines, at least 25% of which are trailers.
--- builtin/interpret-trailers.c | 26 +++++----- trailer.c | 99 ++++++++++++++++++------------------ trailer.h | 18 +++---- 3 files changed, 71 insertions(+), 72 deletions(-)
builtin/interpret-trailers.c +13 -13
@@ -140,8 +140,8 @@ static void interpret_trailers(const char *file, {LIST_HEAD (head);struct strbuf sb =STRBUF_INIT ; -struct strbuf trailer_block =STRBUF_INIT ; -struct trailer_info *info; +struct strbuf tb =STRBUF_INIT ; +struct trailer_block *trailer_block;FILE *outfile = stdout;trailer_config_init ();
@@ -151,13 +151,13 @@ static void interpret_trailers(const char *file,if (opts->in_place) outfile =create_in_place_tempfile (file); - info =parse_trailers (sb.buf, &head, opts); + trailer_block =parse_trailers (sb.buf, opts, &head); -/* Print the lines before the trailers */ +/* Print the lines before the trailer block */ if (!opts->only_trailers) -fwrite (sb.buf,1 ,trailer_block_start (info), outfile); +fwrite (sb.buf,1 ,trailer_block_start (trailer_block), outfile); -if (!opts->only_trailers && !blank_line_before_trailer_block (info)) +if (!opts->only_trailers && !blank_line_before_trailer_block (trailer_block))fprintf (outfile,"\n" );
@@ -171,17 +171,17 @@ static void interpret_trailers(const char *file, }/* Print trailer block. */ -format_trailers (&head, opts, &trailer_block); -fwrite (trailer_block.buf,1 , trailer_block.len, outfile); -strbuf_release (&trailer_block); +format_trailers (&head, opts, &tb); +fwrite (tb.buf,1 , tb.len, outfile); +strbuf_release (&tb);free_trailers (&head); -/* Print the lines after the trailers as is */ +/* Print the lines after the trailer block as is */ if (!opts->only_trailers) -fwrite (sb.buf +trailer_block_end (info),1 , sb.len -trailer_block_end (info), outfile); - -trailer_info_release (info); +fwrite (sb.buf +trailer_block_end (trailer_block), +1 , sb.len -trailer_block_end (trailer_block), outfile); +trailer_block_release (trailer_block);if (opts->in_place)if (rename_tempfile (&trailers_tempfile, file))
trailer.c +49 -50
199 lines not on this page · raw message
trailer.h +9 -9
@@ -4,7 +4,7 @@#include "list.h" #include "strbuf.h" -struct trailer_info ; +struct trailer_block ;enum trailer_where {WHERE_DEFAULT ,
@@ -70,15 +70,15 @@ void parse_trailers_from_command_line_args(struct list_head *arg_head,void process_trailers_lists (struct list_head *head,struct list_head *arg_head); -struct trailer_info *parse_trailers (const char *str, -struct list_head *head, -const struct process_trailer_options *opts); +struct trailer_block *parse_trailers (const char *str, +const struct process_trailer_options *opts, +struct list_head *head); -size_t trailer_block_start (struct trailer_info *info); -size_t trailer_block_end (struct trailer_info *info); -int blank_line_before_trailer_block (struct trailer_info *info); +size_t trailer_block_start (struct trailer_block *trailer_block); +size_t trailer_block_end (struct trailer_block *trailer_block); +int blank_line_before_trailer_block (struct trailer_block *trailer_block); -void trailer_info_release (struct trailer_info *info); +void trailer_block_release (struct trailer_block *trailer_block);void trailer_config_init (void );void free_trailers (struct list_head *trailers);
@@ -123,7 +123,7 @@ struct trailer_iterator {/* private */ struct { -struct trailer_info *info; +struct trailer_block *trailer_block;size_t cur; } internal; };
Signature · 1 line
gitgitgadget
Re: [PATCH 07/10] trailer: spread usage of "trailer_block" language
Quoted 7 lines · Linus Arver via GitGitGadget
From: Linus Arver <[email protected]>
Deprecate the "
trailer_info" struct name and replace it with "trailer_block". The main reason is to help readability, because "trailer_info" on the surface sounds like it's about a single trailer when in reality it is a collection of contiguous lines, at least 25% of which are trailers.
Together with the introduction of trailer_block_{start,end}() accessor functions in the previous step, this sounds like the right thing to do.
"info" is a word with so low information contents. At least "block" would hint that we are talking about a block of text that makes up the trailer attached to a single commit.
Re: [PATCH 07/10] trailer: spread usage of "trailer_block" language
Quoted 3 lines · Junio C Hamano
"info" is a word with so low information contents. At least "block" would hint that we are talking about a block of text that makes up the trailer attached to a single commit.
There is also "conf_info" and the whole "key"/"key alias" vs "token" lingo which (if we are going to rename things for consistency) needs to be updated to match documentation. In the larger series I've cleaned this up as well.
PATCH 8/10 trailer: prepare to move parse_trailers_from_command_line_args() to builtin
In reply to Linus Arver via GitGitGadgetFrom: Linus Arver <[email protected]>
Expose more functions in the trailer.h API, in preparation for moving out
parse_trailers_from_command_line_args()
to interpret-trailer.c, because the trailer API should not be concerned with command line arguments (as it has nothing to do with trailers themselves). The interpret-trailers builtin is the only user of the above function.
--- trailer.c | 66 +++++++++++++++++++++++++++---------------------------- trailer.h | 10 +++++++++ 2 files changed, 42 insertions(+), 34 deletions(-)
trailer.c +32 -34
@@ -33,7 +33,7 @@ struct trailer_block {size_t trailer_nr; }; -struct conf_info { +struct trailer_conf {char *name;char *key;char *command;
@@ -43,7 +43,7 @@ struct conf_info {enum trailer_if_missing if_missing; }; -static struct conf_info default_conf_info; +static struct trailer_conf default_trailer_conf;struct trailer_item {struct list_head list;
@@ -59,7 +59,7 @@ struct arg_item {struct list_head list;char *token;char *value; -struct conf_info conf; +struct trailer_conf conf; };static LIST_HEAD (conf_head);
@@ -210,7 +210,7 @@ static int check_if_different(struct trailer_item *in_tok,return 1 ; } -static char *apply_command (struct conf_info *conf,const char *arg) +static char *apply_command (struct trailer_conf *conf,const char *arg) {struct strbuf cmd =STRBUF_INIT ;struct strbuf buf =STRBUF_INIT ;
@@ -424,7 +424,8 @@ int trailer_set_if_missing(enum trailer_if_missing *item, const char *value)return 0 ; } -static void duplicate_conf (struct conf_info *dst,const struct conf_info *src) +void duplicate_trailer_conf (struct trailer_conf *dst, +const struct trailer_conf *src) { *dst = *src; dst->name =xstrdup_or_null (src->name);
@@ -447,7 +448,7 @@ static struct arg_item *get_conf_item(const char *name)/* Item does not already exists, create it */ CALLOC_ARRAY (item,1 ); -duplicate_conf (&item->conf, &default_conf_info); +duplicate_trailer_conf (&item->conf, &default_trailer_conf); item->conf.name =xstrdup (name);list_add_tail (&item->list, &conf_head);
@@ -482,17 +483,17 @@ static int git_trailer_default_config(const char *conf_key, const char *value, variable_name =strrchr (trailer_item,'.' );if (!variable_name) {if (!strcmp (trailer_item,"where" )) { -if (trailer_set_where (&default_conf_info.where, +if (trailer_set_where (&default_trailer_conf.where, value) <0 )warning (_ ("unknown value '%s' for key '%s'" ), value, conf_key); }else if (!strcmp (trailer_item,"ifexists" )) { -if (trailer_set_if_exists (&default_conf_info.if_exists, +if (trailer_set_if_exists (&default_trailer_conf.if_exists, value) <0 )warning (_ ("unknown value '%s' for key '%s'" ), value, conf_key); }else if (!strcmp (trailer_item,"ifmissing" )) { -if (trailer_set_if_missing (&default_conf_info.if_missing, +if (trailer_set_if_missing (&default_trailer_conf.if_missing, value) <0 )warning (_ ("unknown value '%s' for key '%s'" ), value, conf_key);
@@ -511,7 +512,7 @@ static int git_trailer_config(const char *conf_key, const char *value, {const char *trailer_item, *variable_name;struct arg_item *item; -struct conf_info *conf; +struct trailer_conf *conf;char *name =NULL ;enum trailer_info_type type;int i;
@@ -585,9 +586,9 @@ void trailer_config_init(void)return ;/* Default config must be setup first */ - default_conf_info.where =WHERE_END ; - default_conf_info.if_exists =EXISTS_ADD_IF_DIFFERENT_NEIGHBOR ; - default_conf_info.if_missing =MISSING_ADD ; + default_trailer_conf.where =WHERE_END ; + default_trailer_conf.if_exists =EXISTS_ADD_IF_DIFFERENT_NEIGHBOR ; + default_trailer_conf.if_missing =MISSING_ADD ;git_config (git_trailer_default_config,NULL );git_config (git_trailer_config,NULL ); configured =1 ;
@@ -620,7 +621,7 @@ static int token_matches_item(const char *tok, struct arg_item *item, size_t tok* distinguished from the non-well-formed-line case (in which this function * returns -1) because some callers of this function need such a distinction. */ -static ssize_t find_separator (const char *line,const char *separators) +ssize_t find_separator (const char *line,const char *separators) {int whitespace_found =0 ;const char *c;
@@ -645,28 +646,28 @@ static ssize_t find_separator(const char *line, const char *separators)* * If separator_pos is -1, interpret the whole trailer as a token. */ -static void parse_trailer (struct strbuf *tok,struct strbuf *val, -const struct conf_info **conf,const char *trailer, -ssize_t separator_pos) +void parse_trailer (const char *line,ssize_t separator_pos, +struct strbuf *tok,struct strbuf *val, +const struct trailer_conf **conf) {struct arg_item *item;size_t tok_len;struct list_head *pos;if (separator_pos !=-1 ) { -strbuf_add (tok, trailer, separator_pos); +strbuf_add (tok, line, separator_pos);strbuf_trim (tok); -strbuf_addstr (val, trailer + separator_pos +1 ); +strbuf_addstr (val, line + separator_pos +1 );strbuf_trim (val); }else { -strbuf_addstr (tok, trailer); +strbuf_addstr (tok, line);strbuf_trim (tok); }/* Lookup if the token matches something in the config */ tok_len =token_len_without_separator (tok->buf, tok->len);if (conf) - *conf = &default_conf_info; + *conf = &default_trailer_conf;list_for_each (pos, &conf_head) { item = list_entry(pos, struct arg_item, list);if (token_matches_item (tok->buf, item, tok_len)) {
@@ -691,13 +692,13 @@ static struct trailer_item *add_trailer_item(struct list_head *head, char *tok, }static void add_arg_item (struct list_head *arg_head,char *tok,char *val, -const struct conf_info *conf, +const struct trailer_conf *conf,const struct new_trailer_item *new_trailer_item) {struct arg_item *new_item =xcalloc (1 ,sizeof (*new_item)); new_item->token = tok; new_item->value = val; -duplicate_conf (&new_item->conf, conf); +duplicate_trailer_conf (&new_item->conf, conf);if (new_trailer_item) {if (new_trailer_item->where !=WHERE_DEFAULT ) new_item->conf.where = new_trailer_item->where;
@@ -730,7 +731,7 @@ void parse_trailers_from_command_line_args(struct list_head *arg_head, {struct strbuf tok =STRBUF_INIT ;struct strbuf val =STRBUF_INIT ; -const struct conf_info *conf; +const struct trailer_conf *conf;struct list_head *pos;/*
@@ -753,8 +754,7 @@ void parse_trailers_from_command_line_args(struct list_head *arg_head, (int) sb.len, sb.buf);strbuf_release (&sb); }else { -parse_trailer (&tok, &val, &conf, tr->text, - separator_pos); +parse_trailer (tr->text, separator_pos, &tok, &val, &conf); add_arg_item(arg_head, strbuf_detach(&tok, NULL), strbuf_detach(&val, NULL),
@@ -1116,20 +1116,19 @@ struct trailer_block *parse_trailers(const char *str,for (i =0 ; i < trailer_block->trailer_nr; i++) {int separator_pos; -char *trailer = trailer_block->trailers[i]; -if (trailer[0 ] == comment_line_char) +char *line = trailer_block->trailers[i]; +if (line[0 ] == comment_line_char)continue ; - separator_pos =find_separator (trailer, separators); + separator_pos =find_separator (line, separators);if (separator_pos >=1 ) { -parse_trailer (&tok, &val,NULL , trailer, - separator_pos); +parse_trailer (line, separator_pos, &tok, &val,NULL );if (opts->unfold)unfold_value (&val);add_trailer_item (head,strbuf_detach (&tok,NULL ),strbuf_detach (&val,NULL )); }else if (!opts->only_trailers) { -strbuf_addstr (&val, trailer); +strbuf_addstr (&val, line);strbuf_strip_suffix (&val,"\n" ); add_trailer_item(head, NULL,
@@ -1217,8 +1216,7 @@ int trailer_iterator_advance(struct trailer_iterator *iter)strbuf_addstr (&iter->raw, line);strbuf_reset (&iter->key);strbuf_reset (&iter->val); -parse_trailer (&iter->key, &iter->val,NULL , - line, separator_pos); +parse_trailer (line, separator_pos, &iter->key, &iter->val,NULL );unfold_value (&iter->val);return 1 ; }
trailer.h +10 -0
@@ -5,6 +5,7 @@#include "strbuf.h" struct trailer_block ; +struct trailer_conf ;enum trailer_where {WHERE_DEFAULT ,
@@ -45,6 +46,9 @@ struct new_trailer_item {enum trailer_if_missing if_missing; }; +void duplicate_trailer_conf (struct trailer_conf *dst, +const struct trailer_conf *src); +struct process_trailer_options {int in_place;int trim_empty;
@@ -70,6 +74,12 @@ void parse_trailers_from_command_line_args(struct list_head *arg_head,void process_trailers_lists (struct list_head *head,struct list_head *arg_head); +ssize_t find_separator (const char *line,const char *separators); + +void parse_trailer (const char *line,ssize_t separator_pos, +struct strbuf *tok,struct strbuf *val, +const struct trailer_conf **conf); +struct trailer_block *parse_trailers (const char *str,const struct process_trailer_options *opts,struct list_head *head);
Signature · 1 line
gitgitgadget
Re: [PATCH 08/10] trailer: prepare to move parse_trailers_from_command_line_args() to builtin
Quoted 23 lines · Linus Arver via GitGitGadget
From: Linus Arver <[email protected]>
Expose more functions in the
trailer.hAPI, in preparation for moving out
parse_trailers_from_command_line_args()to
interpret-trailer.c, because the trailer API should not be concerned with command line arguments (as it has nothing to do with trailers themselves). The interpret-trailers builtin is the only user of the above function.Signed-off-by Linus Arver <[email protected]>--- trailer.c | 66 +++++++++++++++++++++++++++---------------------------- trailer.h | 10 +++++++++ 2 files changed, 42 insertions(+), 34 deletions(-)trailer.c +0
-0
trailer.c struct trailer_block { · line 36
Quoted 5 lines
trailer.c +1
-1@@ -33,7 +33,7 @@ struct trailer_block {size_t trailer_nr; }; -struct conf_info { +struct trailer_conf {
Can you also add a note about this conf_info -> trailer_conf rename? I agree that it's an improvement but I think it should be mentioned in the commit message.
Re: [PATCH 08/10] trailer: prepare to move parse_trailers_from_command_line_args() to builtin
Quoted 9 lines · Josh Steadmon
Quoted 8 lines · Linus Arver via GitGitGadget
trailer.c +0
-0@@ -33,7 +33,7 @@ struct trailer_block {size_t trailer_nr; };
Quoted 6 lines
trailer.c struct trailer_block { · line 36
Quoted 2 lines
trailer.c +1
-1-struct conf_info { +struct trailer_conf {Can you also add a note about this
conf_info->trailer_confrename? I agree that it's an improvement but I think it should be mentioned in the commit message.
Will do.
PATCH 9/10 trailer: move arg handling to interpret-trailers.c
In reply to Linus Arver via GitGitGadgetFrom: Linus Arver <[email protected]>
We don't move the "arg_item" struct to interpret-trailers.c, because it is now a struct that contains information about trailers that should be injected into the input text's own trailers. We will rename this language as such in a follow-up patch to keep the diff here small.
--- builtin/interpret-trailers.c | 88 ++++++++++++++++++++++-------------- trailer.c | 63 +++++++++++++++++++------- trailer.h | 12 +++++ 3 files changed, 113 insertions(+), 50 deletions(-)
builtin/interpret-trailers.c +55 -33
@@ -45,23 +45,17 @@ static int option_parse_if_missing(const struct option *opt,return trailer_set_if_missing (opt->value, arg); } -static void new_trailers_clear (struct list_head *trailers) -{ -struct list_head *pos, *tmp; -struct new_trailer_item *item; - -list_for_each_safe (pos, tmp, trailers) { - item = list_entry(pos, struct new_trailer_item, list); -list_del (pos); -free (item); - } -} +static char *cl_separators;static int option_parse_trailer (const struct option *opt,const char *arg,int unset) {struct list_head *trailers = opt->value; -struct new_trailer_item *item; +struct strbuf tok =STRBUF_INIT ; +struct strbuf val =STRBUF_INIT ; +const struct trailer_conf *conf; +struct trailer_conf *conf_current =new_trailer_conf (); +ssize_t separator_pos;if (unset) {new_trailers_clear (trailers);
@@ -71,12 +65,31 @@ static int option_parse_trailer(const struct option *opt,if (!arg)return -1 ; - item =xmalloc (sizeof (*item)); - item->text = arg; - item->where = where; - item->if_exists = if_exists; - item->if_missing = if_missing; -list_add_tail (&item->list, trailers); + separator_pos =find_separator (arg, cl_separators); +if (separator_pos) { +parse_trailer (arg, separator_pos, &tok, &val, &conf); +duplicate_trailer_conf (conf_current, conf); + +/* +* Override conf_current with settings specified via CLI flags. +*/ +trailer_conf_set (where, if_exists, if_missing, conf_current); + +add_arg_item (strbuf_detach (&tok,NULL ), +strbuf_detach (&val,NULL ), + conf_current, + trailers); + }else { +struct strbuf sb =STRBUF_INIT ; +strbuf_addstr (&sb, arg); +strbuf_trim (&sb); +error (_ ("empty trailer token in trailer '%.*s'" ), + (int ) sb.len, sb.buf); +strbuf_release (&sb); + } + +free (conf_current); +return 0 ; }
@@ -136,7 +149,7 @@ static void read_input_file(struct strbuf *sb, const char *file)static void interpret_trailers (const char *file,const struct process_trailer_options *opts, -struct list_head *new_trailer_head) +struct list_head *arg_trailers) {LIST_HEAD (head);struct strbuf sb =STRBUF_INIT ;
@@ -144,8 +157,6 @@ static void interpret_trailers(const char *file,struct trailer_block *trailer_block;FILE *outfile = stdout; -trailer_config_init (); -read_input_file (&sb, file);if (opts->in_place)
@@ -162,12 +173,7 @@ static void interpret_trailers(const char *file,if (!opts->only_input) { -LIST_HEAD (config_head); -LIST_HEAD (arg_head); -parse_trailers_from_config (&config_head); -parse_trailers_from_command_line_args (&arg_head, new_trailer_head); -list_splice (&config_head, &arg_head); -process_trailers_lists (&head, &arg_head); +process_trailers_lists (&head, arg_trailers); }/* Print trailer block. */
@@ -193,7 +199,8 @@ static void interpret_trailers(const char *file,int cmd_interpret_trailers (int argc,const char **argv,const char *prefix) {struct process_trailer_options opts =PROCESS_TRAILER_OPTIONS_INIT ; -LIST_HEAD (trailers); +LIST_HEAD (configured_trailers); +LIST_HEAD (arg_trailers);struct option options[] = {OPT_BOOL (0 ,"in-place" , &opts.in_place,N_ ("edit files in place" )),
@@ -212,33 +219,48 @@ int cmd_interpret_trailers(int argc, const char **argv, const char *prefix)OPT_CALLBACK_F (0 ,"parse" , &opts,NULL ,N_ ("alias for --only-trailers --only-input --unfold" ),PARSE_OPT_NOARG |PARSE_OPT_NONEG , parse_opt_parse),OPT_BOOL (0 ,"no-divider" , &opts.no_divider,N_ ("do not treat \"---\" as the end of input" )), -OPT_CALLBACK (0 ,"trailer" , &trailers,N_ ("trailer" ), +OPT_CALLBACK (0 ,"trailer" , &arg_trailers,N_ ("trailer" ),N_ ("trailer(s) to add" ), option_parse_trailer),OPT_END () };git_config (git_default_config,NULL ); +trailer_config_init (); + +if (!opts.only_input) { +parse_trailers_from_config (&configured_trailers); + } + +/* +* In command-line arguments, '=' is accepted (in addition to the +* separators that are defined). +*/ + cl_separators =xstrfmt ("=%s" ,default_separators ()); argc =parse_options (argc, argv, prefix, options, git_interpret_trailers_usage,0 ); -if (opts.only_input && !list_empty (&trailers)) +free (cl_separators); + +if (opts.only_input && !list_empty (&arg_trailers))usage_msg_opt (_ ("--trailer with --only-input does not make sense" ), git_interpret_trailers_usage, options); +list_splice (&configured_trailers, &arg_trailers); +if (argc) {int i;for (i =0 ; i < argc; i++) -interpret_trailers (argv[i], &opts, &trailers); +interpret_trailers (argv[i], &opts, &arg_trailers); }else {if (opts.in_place)die (_ ("no input file given for in-place editing" )); -interpret_trailers (NULL , &opts, &trailers); +interpret_trailers (NULL , &opts, &arg_trailers); } -new_trailers_clear (&trailers); +new_trailers_clear (&arg_trailers);return 0 ; }
trailer.c +46 -17
112 lines not on this page · raw message
trailer.h +12 -0
@@ -46,9 +46,20 @@ struct new_trailer_item {enum trailer_if_missing if_missing; }; +void trailer_conf_set (enum trailer_where where, +enum trailer_if_exists if_exists, +enum trailer_if_missing if_missing, +struct trailer_conf *conf); + +struct trailer_conf *new_trailer_conf (void );void duplicate_trailer_conf (struct trailer_conf *dst,const struct trailer_conf *src); +const char *default_separators (void ); + +void add_arg_item (char *tok,char *val,const struct trailer_conf *conf, +struct list_head *arg_head); +struct process_trailer_options {int in_place;int trim_empty;
@@ -92,6 +103,7 @@ void trailer_block_release(struct trailer_block *trailer_block);void trailer_config_init (void );void free_trailers (struct list_head *trailers); +void new_trailers_clear (struct list_head *trailers); void format_trailers(struct list_head *head, const struct process_trailer_options *opts,
Signature · 1 line
gitgitgadget
Re: [PATCH 09/10] trailer: move arg handling to interpret-trailers.c
trailer.c static LIST_HEAD(conf_head); · line 72
Quoted 12 lines · Linus Arver via GitGitGadget
trailer.c +4
-0@@ -66,6 +66,11 @@ static LIST_HEAD(conf_head);static char *separators =":" ; +const char *default_separators (void ) +{ +return separators; +}
This allows API users to peek into the current set of separator bytes (either the default ":" or specified by the configuration varaible "trailer.separators"), which is an improvement over directly exposing the "separators" variable, but in a longer term, do we need to have some "trailer context" object that holds this and possibly other global variables like this?
I do not demand such further abstraction in this series, but I'd prefer to see if we all have shared vision into the future.
Thanks.
Re: [PATCH 09/10] trailer: move arg handling to interpret-trailers.c
Quoted 10 lines · Junio C Hamano
Quoted 8 lines · Linus Arver via GitGitGadget
trailer.c +0
-0@@ -66,6 +66,11 @@ static LIST_HEAD(conf_head);static char *separators =":" ;
Quoted 11 lines
trailer.c static LIST_HEAD(conf_head); · line 72
Quoted 4 lines
trailer.c +4
-0+const char *default_separators (void ) +{ +return separators; +}This allows API users to peek into the current set of separator bytes (either the default ":" or specified by the configuration varaible "trailer.separators"), which is an improvement over directly exposing the "separators" variable, but in a longer term, do we need to have some "trailer context" object that holds this and possibly other global variables like this?
Yes, and I've implemented a "trailer_subsystem_conf" struct to hold all configuration-related bits (and hardcoded defaults) relating to trailers in one place, in the larger series.
Quoted 2 lines
I do not demand such further abstraction in this series, but I'd prefer to see if we all have shared vision into the future.
Makes sense. Thanks.
PATCH 10/10 trailer: delete obsolete argument handling code from API
In reply to Linus Arver via GitGitGadgetFrom: Linus Arver <[email protected]>
This commit was not squashed with its parent in order to keep the diff separate (to make the additive changes in the parent easier to read).
--- trailer.c | 39 --------------------------------------- trailer.h | 17 ----------------- 2 files changed, 56 deletions(-)
trailer.c +0 -39
@@ -745,45 +745,6 @@ void parse_trailers_from_config(struct list_head *config_head) } } -void parse_trailers_from_command_line_args (struct list_head *arg_head, -struct list_head *new_trailer_head) -{ -struct strbuf tok =STRBUF_INIT ; -struct strbuf val =STRBUF_INIT ; -const struct trailer_conf *conf; -struct list_head *pos; - -/* -* In command-line arguments, '=' is accepted (in addition to the -* separators that are defined). -*/ -char *cl_separators =xstrfmt ("=%s" , separators); - -/* Add an arg item for each trailer on the command line */ -list_for_each (pos, new_trailer_head) { -struct new_trailer_item *tr = - list_entry(pos, struct new_trailer_item, list); -ssize_t separator_pos =find_separator (tr->text, cl_separators); - -if (separator_pos ==0 ) { -struct strbuf sb =STRBUF_INIT ; -strbuf_addstr (&sb, tr->text); -strbuf_trim (&sb); -error (_ ("empty trailer token in trailer '%.*s'" ), - (int ) sb.len, sb.buf); -strbuf_release (&sb); - }else { -parse_trailer (tr->text, separator_pos, &tok, &val, &conf); -add_arg_item (strbuf_detach (&tok,NULL ), -strbuf_detach (&val,NULL ), - conf, - arg_head); - } - } - -free (cl_separators); -} -static const char *next_line (const char *str) {const char *nl =strchrnul (str,'\n' );
trailer.h +0 -17
@@ -32,20 +32,6 @@ int trailer_set_where(enum trailer_where *item, const char *value);int trailer_set_if_exists (enum trailer_if_exists *item,const char *value);int trailer_set_if_missing (enum trailer_if_missing *item,const char *value); -/* -* A list that represents newly-added trailers, such as those provided -* with the --trailer command line option of git-interpret-trailers. -*/ -struct new_trailer_item { -struct list_head list; - -const char *text; - -enum trailer_where where; -enum trailer_if_exists if_exists; -enum trailer_if_missing if_missing; -}; - void trailer_conf_set(enum trailer_where where, enum trailer_if_exists if_exists, enum trailer_if_missing if_missing,
@@ -79,9 +65,6 @@ struct process_trailer_options {void parse_trailers_from_config (struct list_head *config_head); -void parse_trailers_from_command_line_args (struct list_head *arg_head, -struct list_head *new_trailer_head); -void process_trailers_lists (struct list_head *head,struct list_head *arg_head);
Signature · 1 line
gitgitgadget
Quoted 7 lines · Linus Arver via GitGitGadget
This patch series is the first 10 patches of a much larger series I've been working. The main goal of this series is to enrich the API in
trailer.h. The larger series brings a number of additional code simplifications and cleanups (exposing and fixing some bugs along the way), and builds on top of this series. The goal of the larger series is to make the trailer interface ready for unit testing. By "trailer API" I mean those functions exposed intrailer.h.
Are there places in the current code that deals with trailers but does not use the trailer API (e.g., manually parse and/or insert the trailer in an in-core buffer)? Is it part of the larger goal to update these places so that we will always use the trailer API to touch trailers, and if so, have these places been identified?
Obviously the reason why I ask is that testing cannot be the goal by itself. The "alternative" ...
Quoted 3 lines
As an alternative to this patch series, we could keep
trailer.hintact and decide to unit-test the existing "trailer_info_get()" function which does most of the trailer parsing work.
... may allow you to "test", but it would make it more difficult in the future to revamp the trailer API, if it is needed, in order to cover code paths that ought to be using but currently bypassing the trailer API.
Quoted 7 lines
This series breaks up "
process_trailers()" into smaller pieces, exposing many of the parts relevant to trailer-related processing intrailer.h. This forces us to start writing unit tests for these now public functions, but that is a good thing because those same unit tests should be easy to write (due to their small(er) sizes), but also, because those unit tests will now ensure some degree of stability across new versions oftrailer.h(we will start noticing when the behavior of any of these API functions change).
And helper functions, each of which does one small thing well, may be more applicable to other code paths that are currently bypassing the API.
Quoted 4 lines
Thanks to the aggressive refactoring in this series, I've been able to identify and fix a couple bugs in our existing implementation. Those fixes build on top of this series but were not included here, in order to keep this series small.
It would be nicer to have a concise list of these fixes (in the form of "git shortlog") as a teaser here ;-). That would hopefully entice others into reviewing this part that forms the foundation.
Thanks.
Quoted 10 lines · Junio C Hamano
Quoted 7 lines · Linus Arver via GitGitGadget
This patch series is the first 10 patches of a much larger series I've been working. The main goal of this series is to enrich the API in
trailer.h. The larger series brings a number of additional code simplifications and cleanups (exposing and fixing some bugs along the way), and builds on top of this series. The goal of the larger series is to make the trailer interface ready for unit testing. By "trailer API" I mean those functions exposed intrailer.h.
Quoted 3 lines
Are there places in the current code that deals with trailers but does not use the trailer API (e.g., manually parse and/or insert the trailer in an in-core buffer)?
While working on this series I unfortunately did not search for such use cases (I limited the scope of my work to mainly the interpret-trailers builtin). But, a quick search just now on master branch turned up append_signoff() in sequencer.c which constructs a Signed-off-by trailer manually with a raw strbuf [1].
This is somewhat understandable though, because AFAICS the current trailer API does not support creating and formatting single trailer objects.
Quoted 3 lines
Is it part of the larger goal to
update these places so that we will always use the trailer API to touch trailers
That sounds like The Right Thing to do.
Quoted 1 line
, and if so, have these places been identified?
Not yet, but, it should be easy to check any remaining cases other than the one I identified up above.
Quoted 2 lines
Obviously the reason why I ask is that testing cannot be the goal by itself.
I now seem to recall an offline discussion where I said I wanted to enrich the API to make other parts of Git also use this new API. Somehow I've left that motivation out of the cover letter (will include in the next reroll).
Quoted 10 lines
The "alternative" ...
Quoted 3 lines
As an alternative to this patch series, we could keep
trailer.hintact and decide to unit-test the existing "trailer_info_get()" function which does most of the trailer parsing work.... may allow you to "test", but it would make it more difficult in the future to revamp the trailer API, if it is needed, in order to cover code paths that ought to be using but currently bypassing the trailer API.
Agreed. I should include this rationale as well in the next cover letter, thanks.
Quoted 11 lines
Quoted 7 lines
This series breaks up "
process_trailers()" into smaller pieces, exposing many of the parts relevant to trailer-related processing intrailer.h. This forces us to start writing unit tests for these now public functions, but that is a good thing because those same unit tests should be easy to write (due to their small(er) sizes), but also, because those unit tests will now ensure some degree of stability across new versions oftrailer.h(we will start noticing when the behavior of any of these API functions change).And helper functions, each of which does one small thing well, may be more applicable to other code paths that are currently bypassing the API.
Yep.
Quoted 8 lines
Quoted 4 lines
Thanks to the aggressive refactoring in this series, I've been able to identify and fix a couple bugs in our existing implementation. Those fixes build on top of this series but were not included here, in order to keep this series small.
It would be nicer to have a concise list of these fixes (in the form of "git shortlog") as a teaser here ;-). That would hopefully entice others into reviewing this part that forms the foundation.
Ah, good idea. Here's a shortlog (with a short summary of each one) of bug fixes that are forthcoming:
trailer: trailer replacement should not change its position
(Summary: If we found a trailer we'd like to replace, preserve its position relative to the other trailers found in the trailer block, instead of always moving it to the beginning or end of the entire trailer block.)
interpret-trailers: preserve trailers coming from the input
(Summary: Sometimes, the parsed trailers from the input will be formatted differently depending on whether we provide --only-trailers or not. Make the trailers that were not modified and are coming directly from the input get formatted the same way, regardless of this flag.)
interpret-trailers: fail if given unrecognized arguments
(Summary: E.g., for "--where", only accept recognized WHERE_* enum values. If we get something unrecognized, fail with an error instead of silently doing nothing. Ditto for "--if-exists" and "--if-missing".)
The last one is a different class of bug than the first two, and perhaps less interesting.
Thanks.
[1] https://github.com/git/git/blob/d4dbce1db5cd227a57074bcfc7ec9f0655961bba/sequencer.c#L5299-L5301
Quoted 8 lines · Linus Arver
interpret-trailers: fail if given unrecognized arguments
(Summary: E.g., for "--where", only accept recognized WHERE_* enum values. If we get something unrecognized, fail with an error instead of silently doing nothing. Ditto for "--if-exists" and "--if-missing".)The last one is a different class of bug than the first two, and perhaps less interesting.
Actually, upon closer inspection I realize that we already fail if given unrecognized arguments to --where, --if-exists, and --if-missing. But we don't explain why to the user because no error message is printed. This commit has been retitled to "interpret-trailers: print error if given unrecognized arguments".
Thanks.
Quoted 7 lines · Linus Arver via GitGitGadget
This patch series is the first 10 patches of a much larger series I've been working. The main goal of this series is to enrich the API in
trailer.h. The larger series brings a number of additional code simplifications and cleanups (exposing and fixing some bugs along the way), and builds on top of this series. The goal of the larger series is to make the trailer interface ready for unit testing. By "trailer API" I mean those functions exposed intrailer.h.
I agree with Junio's points, and I added a small nitpick about patch 8's commit message. But apart from that, this all looks good to me and I'm interested in seeing the followup series as well. Thanks!
v2 cover Enrich Trailer API
In reply to Linus Arver via GitGitGadgetThis patch series is the first 10 patches of a larger cleanup/bugfix series (henceforth "larger series") I've been working on. The main goal of this series is to begin the process of "libifying" the trailer API. By "API" I mean the interface exposed in trailer.h. The larger series brings a number of additional cleanups (exposing and fixing some bugs along the way), and builds on top of this series.
When the larger series is merged, we will be in a good state to additionally pursue the following goals:
1. "API reuse inside Git": make the API expressive enough to eliminate any need by other parts of Git to use the interpret-trailers builtin as a subprocess (instead they could just use the API directly);
2. "API stability": add unit tests to codify the expected behavior of API functions; and
3. "API documentation": create developer-focused documentation to explain how to use the API effectively, noting any API limitations or anti-patterns.
The reason why the larger series itself doesn't tackle these goals directly is because I believe that API code should be thought from the ground up with a libification-focused perspective. Some structs and functions exposed in the API today should probably not be libified (read: kept in trailer.h) as is. For example, the "trailer_iterator" struct has a "private" member and it feels wrong to allow API users to peek inside here (and take at face value our future API users' pinky promise that they won't depend on those private internals not meant for public consumption).
One pattern we could use here to cleanly separate "what is the API" (publicly exposed) and "what is the implementation" (private) is the pointer-to-implementation ("pimpl") idiom. There may be other appropriate patterns, but I've chosen this one because it's a simple, low-level concept (put structs in foo.c instead of foo.h), which has far-reaching high-level consequences (API users must rely exclusively on the API to make use of such private structs, via opaque pointers). The pimpl idiom for C comes from the book "C Interfaces and Implementations" (see patch "trailer: make trailer_info struct private").
The idea of turning a public struct into a private one is a fundamental question of libification because it forces us to reconsider all of the data structures we have and how they're actually used by already existing users. For the trailer API, those existing users are the "interpret-trailers" builtin command, and anything else that includes the "trailer.h" header file (e.g., sequencer.c). One advantage of this idiom is that even the compiler understands it --- the compiler will loudly complain if you try to access the innards of a private struct through an opaque pointer.
Another advantage of this idiom is that it helps to reduce the probability of breaking changes in the API. Because a private struct's members are out of view from our users (they only know about opaque pointers to the private struct, not its members), we are free to modify the members of the struct at any time, as much as we like, as long as we don't break the semantics of the exposed API functions (which is why unit-testing these API functions will be crucial long-term).
If this pimpl idiom turns out to be a mistake, undoing it is easy --- just move the relevant struct definition from foo.c to the header file. So it's a great way to try things out without digging ourselves into a pit of despair that will be difficult to get out of.
With the libification-focused goals out of the way, let's turn to this patch series in more detail.
Currently, we have "process_trailers()" in trailer.h which does many different things (parse command-line arguments, create temporary files, etc) that are independent of the concept of "trailers". Keeping this function as an API function would make unit-testing it difficult. While there is no technical reason why we couldn't write unit tests for the smaller functions that are called within process_trailers(), doing so would involve testing private ("static" in trailer.c) functions instead of API functions, which defeats the goal of "API stability" mentioned earlier above.
As an alternative to how things are done in this patch series, we could keep trailer.h intact and decide to unit-test the existing "trailer_info_get()" function which does most of the trailer parsing work (and is used by sequencer.c). However this function wouldn't be easy to test either, because the resulting "trailer_info" struct merely contains the unparsed "trailers" lines. So the unit test (if it wants to inspect the result of parsing these lines) would have to invoke additional parsing functions itself. And at that point it would no longer be a unit test in the traditional sense, because it would be invoking multiple functions at once.
In summary this series breaks up "process_trailers()" into smaller pieces, exposing many of the parts relevant to trailer-related processing in trailer.h. This will force us to eventually introduce unit tests for these API functions, but that is a good thing for API stability.
In the future after libification is "complete", users external to Git will be able to use the same trailer processing API used by the interpret-trailers builtin. For example, a web server may want to parse trailers the same way that Git would parse them, without having to call interpret-trailers as a subprocess. This use case was the original motivation behind my work in this area.
Thanks to the aggressive refactoring in this series, I've been able to identify and fix several bugs in our existing implementation. Those fixes build on top of this series but were not included here, in order to keep this series small. Below is a "shortlog" of those fixes I have locally:
* "trailer: trailer replacement should not change its position" (If we found a trailer we'd like to replace, preserve its position relative to the other trailers found in the trailer block, instead of always moving it to the beginning or end of the entire trailer block.)
* "interpret-trailers: preserve trailers coming from the input" (Sometimes, the parsed trailers from the input will be formatted differently depending on whether we provide --only-trailers or not. Make the trailers that were not modified and which are coming directly from the input get formatted the same way, regardless of this flag.)
* "interpret-trailers: do not modify the input if NOP" (Refrain from subtracting or adding a newline around the patch divider "---" if we are not adding new trailers.)
* "trailer formatter: split up format_trailer() monolith" (Fix a bug in git-log where we still printed a blank newline even if we didn't want to format anything.)
* "interpret-trailers: fail if given unrecognized arguments" (E.g., for "--where", only accept recognized WHERE_* enum values. If we get something unrecognized, fail with an error instead of silently doing nothing. Ditto for "--if-exists" and "--if-missing".)
Notable changes in v2
=====================
* Reorder function parameters to have trailer options at the beginning (and out parameters toward the end)
* "sequencer: use the trailer iterator": prefer C string instead of strbuf for new "raw" field
* Patch 1 (was Patch 2) also renames ensure_configured() to trailer_config_init() (forgot to rename this one previously)
Linus Arver (10):
trailer: prepare to expose functions as part of API
trailer: move interpret_trailers() to interpret-trailers.c
trailer: unify trailer formatting machinery
trailer: delete obsolete formatting functions
sequencer: use the trailer iterator
trailer: make trailer_info struct private
trailer: spread usage of "trailer_block" language
trailer: prepare to move parse_trailers_from_command_line_args() to
builtin
trailer: move arg handling to interpret-trailers.c
trailer: delete obsolete argument handling code from API
builtin/interpret-trailers.c | 169 ++++++++-- builtin/shortlog.c | 7 +- pretty.c | 2 +- ref-filter.c | 2 +- sequencer.c | 35 +-- trailer.c | 576 ++++++++++++++++------------------- trailer.h | 105 ++++--- 7 files changed, 478 insertions(+), 418 deletions(-)
base-commit: a54a84b333adbecf7bc4483c0e36ed5878cac17b
Published-As: https://github.com/gitgitgadget/git/releases/tag/pr-1632%2Flistx%2Ftrailer-api-refactor-part-1-v2
Fetch-It-Via: git fetch https://github.com/gitgitgadget/git pr-1632/listx/trailer-api-refactor-part-1-v2
Pull-Request: https://github.com/gitgitgadget/git/pull/1632
Range-diff vs v1:
2: 5f64718abfc ! 1: e2d3ed9b5b6 trailer: include "trailer" term in API functions
@@ Metadata
Author: Linus Arver <[email protected]>
## Commit message ##
- trailer: include "trailer" term in API functions
+ trailer: prepare to expose functions as part of API
- These functions are exposed to clients and so they should include
- "trailer" in their names for easier identification, just like all the
- other functions already exposed by trailer.h.
+ In the next patch, we will move "process_trailers" from trailer.c to
+ builtin/interpret-trailers.c. That move will necessitate the growth of
+ the trailer.h API, forcing us to expose some additional functions in
+ trailer.h.
+ Rename relevant functions so that they include the term "trailer" in
+ their name, so that clients of the API will be able to easily identify
+ them by their "trailer" moniker, just like all the other functions
+ already exposed by trailer.h.
+
+ The the opportunity to start putting trailer processions options (opts)
+ as the first parameter. This will be the pattern going forward in this
+ series.
+
+ Helped-by: Junio C Hamano <[email protected]>
## builtin/interpret-trailers.c ##
-@@ builtin/interpret-trailers.c: static void interpret_trailers(const char *file,
- struct trailer_info info;
- FILE *outfile = stdout;
-
-- ensure_configured();
-+ trailer_config_init();
-
- read_input_file(&sb, file);
-
-@@ builtin/interpret-trailers.c: static void interpret_trailers(const char *file,
- process_trailers_lists(&head, &arg_head);
+@@ builtin/interpret-trailers.c: int cmd_interpret_trailers(int argc, const char **argv, const char *prefix)
+ if (argc) {
+ int i;
+ for (i = 0; i < argc; i++)
+- process_trailers(argv[i], &opts, &trailers);
++ interpret_trailers(&opts, &trailers, argv[i]);
+ } else {
+ if (opts.in_place)
+ die(_("no input file given for in-place editing"));
+- process_trailers(NULL, &opts, &trailers);
++ interpret_trailers(&opts, &trailers, NULL);
}
-- print_all(outfile, &head, opts);
-+ /* Print trailer block. */
-+ format_trailers(outfile, &head, opts);
-
-- free_all(&head);
-+ free_trailers(&head);
- trailer_info_release(&info);
-
- /* Print the lines after the trailers as is */
+ new_trailers_clear(&trailers);
## trailer.c ##
@@ trailer.c: static void print_tok_val(FILE *outfile, const char *tok, const char *val)
fprintf(outfile, "%s%c %s\n", tok, separators[0], val);
}
--void print_all(FILE *outfile, struct list_head *head,
-- const struct process_trailer_options *opts)
-+void format_trailers(FILE *outfile, struct list_head *head,
-+ const struct process_trailer_options *opts)
+-static void print_all(FILE *outfile, struct list_head *head,
+- const struct process_trailer_options *opts)
++static void format_trailers(const struct process_trailer_options *opts,
++ struct list_head *trailers, FILE *outfile)
{
struct list_head *pos;
struct trailer_item *item;
+- list_for_each(pos, head) {
++ list_for_each(pos, trailers) {
+ item = list_entry(pos, struct trailer_item, list);
+ if ((!opts->trim_empty || strlen(item->value) > 0) &&
+ (!opts->only_trailers || item->token))
@@ trailer.c: static int git_trailer_config(const char *conf_key, const char *value,
return 0;
}
--void ensure_configured(void)
-+void trailer_config_init(void)
+-static void ensure_configured(void)
++static void trailer_config_init(void)
{
if (configured)
return;
-@@ trailer.c: void parse_trailers(struct trailer_info *info, +@@ trailer.c: static void parse_trailers(struct trailer_info *info,
}
}
--void free_all(struct list_head *head)
-+void free_trailers(struct list_head *head)
+-static void free_all(struct list_head *head)
++static void free_trailers(struct list_head *trailers)
{
struct list_head *pos, *p;
- list_for_each_safe(pos, p, head) {
+- list_for_each_safe(pos, p, head) {
++ list_for_each_safe(pos, p, trailers) {
+ list_del(pos);
+ free_trailer_item(list_entry(pos, struct trailer_item, list));
+ }
+@@ trailer.c: static FILE *create_in_place_tempfile(const char *file)
+ return outfile;
+ }
+
+-void process_trailers(const char *file,
+- const struct process_trailer_options *opts,
+- struct list_head *new_trailer_head)
++void interpret_trailers(const struct process_trailer_options *opts,
++ struct list_head *new_trailer_head,
++ const char *file)
+ {
+ LIST_HEAD(head);
+ struct strbuf sb = STRBUF_INIT;
+ struct trailer_info info;
+ FILE *outfile = stdout;
+
+- ensure_configured();
++ trailer_config_init();
+
+ read_input_file(&sb, file);
+
+@@ trailer.c: void process_trailers(const char *file,
+ process_trailers_lists(&head, &arg_head);
+ }
+
+- print_all(outfile, &head, opts);
++ format_trailers(opts, &head, outfile);
+
+- free_all(&head);
++ free_trailers(&head);
+ trailer_info_release(&info);
+
+ /* Print the lines after the trailers as is */
@@ trailer.c: void trailer_info_get(struct trailer_info *info, const char *str,
size_t nr = 0, alloc = 0;
char **last = NULL;
@@ trailer.c: void trailer_info_get(struct trailer_info *info, const char *str,
trailer_block_start = find_trailer_block_start(str, end_of_log_message);
## trailer.h ##
-@@ trailer.h: void trailer_info_get(struct trailer_info *info, const char *str, -
- void trailer_info_release(struct trailer_info *info);
-
--void ensure_configured(void);
--void print_all(FILE *outfile, struct list_head *head,
-- const struct process_trailer_options *opts);
--void free_all(struct list_head *head);
-+void trailer_config_init(void);
-+void free_trailers(struct list_head *trailers);
-
-+void format_trailers(FILE *outfile, struct list_head *head,
-+ const struct process_trailer_options *opts);
- /*
- * Format the trailers from the commit msg "msg" into the strbuf "out".
- * Note two caveats about "opts":
-@@ trailer.h: void free_all(struct list_head *head);
- * - this is primarily a helper for pretty.c, and not
- * all of the flags are supported.
- *
-- * - this differs from process_trailers slightly in that we always format
-+ * - this differs from format_trailers slightly in that we always format
- * only the trailer block itself, even if the "only_trailers" option is not
- * set.
- */
+@@ trailer.h: struct process_trailer_options {
+
+ #define PROCESS_TRAILER_OPTIONS_INIT {0}
+
+-void process_trailers(const char *file,
+- const struct process_trailer_options *opts,
+- struct list_head *new_trailer_head);
++void interpret_trailers(const struct process_trailer_options *opts,
++ struct list_head *new_trailer_head,
++ const char *file);
+
+ void trailer_info_get(struct trailer_info *info, const char *str,
+ const struct process_trailer_options *opts);
1: 2dc3279b37f ! 2: eaca39fd7ea trailer: move process_trailers() to interpret-trailers.c
@@ Metadata
Author: Linus Arver <[email protected]>
## Commit message ##
- trailer: move process_trailers() to interpret-trailers.c
+ trailer: move interpret_trailers() to interpret-trailers.c
The interpret-trailers.c builtin is the only place we need to call
- process_trailers(). As it stands, process_trailers() is inherently tied
- to how the builtin behaves, so move its definition there.
+ interpret_trailers(), so move its definition there.
Delete the corresponding declaration from trailer.h, which then forces
us to expose the working innards of that function. This enriches
- trailer.h to include a more granular API, which can then be unit-tested
- in the future (because process_trailers() by itself does too many things
- to be able to be easily unit-tested).
+ trailer.h with a more granular API, which can then be unit-tested in the
+ future (because interpret_trailers() by itself does too many things to
+ be able to be easily unit-tested).
Take this opportunity to demote some file-handling functions out of the
trailer API implementation, as these have nothing to do with trailers.
- While we're at it, rename process_trailers() to interpret_trailers() in
- the builtin for consistency with the existing cmd_interpret_trailers(),
- which wraps around this function.
-
Signed-off-by: Linus Arver <[email protected]>
## builtin/interpret-trailers.c ##
@@ builtin/interpret-trailers.c: static int parse_opt_parse(const struct option *op
+ }
+}
+
-+static void interpret_trailers(const char *file,
-+ const struct process_trailer_options *opts,
-+ struct list_head *new_trailer_head)
++static void interpret_trailers(const struct process_trailer_options *opts,
++ struct list_head *new_trailer_head,
++ const char *file)
+{
+ LIST_HEAD(head);
+ struct strbuf sb = STRBUF_INIT;
+ struct trailer_info info;
+ FILE *outfile = stdout;
+
-+ ensure_configured();
++ trailer_config_init();
+
+ read_input_file(&sb, file);
+
+ if (opts->in_place)
+ outfile = create_in_place_tempfile(file);
+
-+ parse_trailers(&info, sb.buf, &head, opts);
++ parse_trailers(opts, &info, sb.buf, &head);
+
+ /* Print the lines before the trailers */
+ if (!opts->only_trailers)
@@ builtin/interpret-trailers.c: static int parse_opt_parse(const struct option *op
+ process_trailers_lists(&head, &arg_head);
+ }
+
-+ print_all(outfile, &head, opts);
++ format_trailers(opts, &head, outfile);
+
-+ free_all(&head);
++ free_trailers(&head);
+ trailer_info_release(&info);
+
+ /* Print the lines after the trailers as is */
@@ builtin/interpret-trailers.c: static int parse_opt_parse(const struct option *op
int cmd_interpret_trailers(int argc, const char **argv, const char *prefix)
{
struct process_trailer_options opts = PROCESS_TRAILER_OPTIONS_INIT;
-@@ builtin/interpret-trailers.c: int cmd_interpret_trailers(int argc, const char **argv, const char *prefix)
- if (argc) {
- int i;
- for (i = 0; i < argc; i++)
-- process_trailers(argv[i], &opts, &trailers);
-+ interpret_trailers(argv[i], &opts, &trailers);
- } else {
- if (opts.in_place)
- die(_("no input file given for in-place editing"));
-- process_trailers(NULL, &opts, &trailers);
-+ interpret_trailers(NULL, &opts, &trailers);
- }
-
- new_trailers_clear(&trailers);
## trailer.c ##
@@
@@ trailer.c: static void print_tok_val(FILE *outfile, const char *tok, const char
fprintf(outfile, "%s%c %s\n", tok, separators[0], val);
}
--static void print_all(FILE *outfile, struct list_head *head,
-- const struct process_trailer_options *opts)
-+void print_all(FILE *outfile, struct list_head *head,
-+ const struct process_trailer_options *opts)
+-static void format_trailers(const struct process_trailer_options *opts,
+- struct list_head *trailers, FILE *outfile)
++void format_trailers(const struct process_trailer_options *opts,
++ struct list_head *trailers, FILE *outfile)
{
struct list_head *pos;
struct trailer_item *item;
@@ trailer.c: static int git_trailer_config(const char *conf_key, const char *value
return 0;
}
--static void ensure_configured(void)
-+void ensure_configured(void)
+-static void trailer_config_init(void)
++void trailer_config_init(void)
{
if (configured)
return;
@@ trailer.c: static void unfold_value(struct strbuf *val)
- const char *str,
- struct list_head *head,
- const struct process_trailer_options *opts)
-+void parse_trailers(struct trailer_info *info,
++void parse_trailers(const struct process_trailer_options *opts,
++ struct trailer_info *info,
+ const char *str,
-+ struct list_head *head,
-+ const struct process_trailer_options *opts)
++ struct list_head *head)
{
struct strbuf tok = STRBUF_INIT;
struct strbuf val = STRBUF_INIT;
@@ trailer.c: static void parse_trailers(struct trailer_info *info,
}
}
--static void free_all(struct list_head *head)
-+void free_all(struct list_head *head)
+-static void free_trailers(struct list_head *trailers)
++void free_trailers(struct list_head *trailers)
{
struct list_head *pos, *p;
- list_for_each_safe(pos, p, head) {
-@@ trailer.c: static void free_all(struct list_head *head)
+ list_for_each_safe(pos, p, trailers) {
+@@ trailer.c: static void free_trailers(struct list_head *trailers)
}
}
@@ trailer.c: static void free_all(struct list_head *head)
- return outfile;
-}
-
--void process_trailers(const char *file,
-- const struct process_trailer_options *opts,
-- struct list_head *new_trailer_head)
+-void interpret_trailers(const struct process_trailer_options *opts,
+- struct list_head *new_trailer_head,
+- const char *file)
-{
- LIST_HEAD(head);
- struct strbuf sb = STRBUF_INIT;
- struct trailer_info info;
- FILE *outfile = stdout;
-
-- ensure_configured();
+- trailer_config_init();
-
- read_input_file(&sb, file);
-
@@ trailer.c: static void free_all(struct list_head *head)
- process_trailers_lists(&head, &arg_head);
- }
-
-- print_all(outfile, &head, opts);
+- format_trailers(opts, &head, outfile);
-
-- free_all(&head);
+- free_trailers(&head);
- trailer_info_release(&info);
-
- /* Print the lines after the trailers as is */
@@ trailer.h: struct process_trailer_options {
#define PROCESS_TRAILER_OPTIONS_INIT {0}
--void process_trailers(const char *file,
-- const struct process_trailer_options *opts,
-- struct list_head *new_trailer_head);
+-void interpret_trailers(const struct process_trailer_options *opts,
+- struct list_head *new_trailer_head,
+- const char *file);
+void parse_trailers_from_config(struct list_head *config_head);
+
+void parse_trailers_from_command_line_args(struct list_head *arg_head,
@@ trailer.h: struct process_trailer_options {
+void process_trailers_lists(struct list_head *head,
+ struct list_head *arg_head);
+
-+void parse_trailers(struct trailer_info *info,
++void parse_trailers(const struct process_trailer_options *opts,
++ struct trailer_info *info,
+ const char *str,
-+ struct list_head *head,
-+ const struct process_trailer_options *opts);
++ struct list_head *head);
void trailer_info_get(struct trailer_info *info, const char *str,
const struct process_trailer_options *opts);
void trailer_info_release(struct trailer_info *info);
-+void ensure_configured(void);
-+void print_all(FILE *outfile, struct list_head *head,
-+ const struct process_trailer_options *opts);
-+void free_all(struct list_head *head);
++void trailer_config_init(void);
++void format_trailers(const struct process_trailer_options *opts,
++ struct list_head *trailers, FILE *outfile);
++void free_trailers(struct list_head *trailers);
+
/*
* Format the trailers from the commit msg "msg" into the strbuf "out".
3: d3326021fb6 ! 3: 9b7747d550e trailer: unify trailer formatting machinery
@@ Commit message
format_trailers() to process trailers with the additional
process_trailer_options fields like opts->key_only which is only used by
format_trailers_from_commit() and not builtin/interpret-trailers.c.
+ While we're at it, reorder parameters to put the trailer processing
+ options first, and the out parameter (strbuf we write into) at the end.
- This will allow us to delete the format_trailer_info() and
+ This unification will allow us to delete the format_trailer_info() and
print_tok_val() functions in the next patch. They are not deleted here
in order to keep the diff small.
+ Helped-by: Junio C Hamano <[email protected]>
Signed-off-by: Linus Arver <[email protected]>
## builtin/interpret-trailers.c ##
-@@ builtin/interpret-trailers.c: static void interpret_trailers(const char *file,
+@@ builtin/interpret-trailers.c: static void interpret_trailers(const struct process_trailer_options *opts,
{
LIST_HEAD(head);
struct strbuf sb = STRBUF_INIT;
@@ builtin/interpret-trailers.c: static void interpret_trailers(const char *file,
struct trailer_info info;
FILE *outfile = stdout;
-@@ builtin/interpret-trailers.c: static void interpret_trailers(const char *file,
+@@ builtin/interpret-trailers.c: static void interpret_trailers(const struct process_trailer_options *opts,
+ process_trailers_lists(&head, &arg_head);
}
- /* Print trailer block. */
-- format_trailers(outfile, &head, opts);
-+ format_trailers(&head, opts, &trailer_block);
+- format_trailers(opts, &head, outfile);
++ /* Print trailer block. */
++ format_trailers(opts, &head, &trailer_block);
+ fwrite(trailer_block.buf, 1, trailer_block.len, outfile);
+ strbuf_release(&trailer_block);
@@ pretty.c: static size_t format_commit_one(struct strbuf *sb, /* in UTF-8 */
}
if (*arg == ')') {
- format_trailers_from_commit(sb, msg + c->subject_off, &opts);
-+ format_trailers_from_commit(msg + c->subject_off, &opts, sb);
++ format_trailers_from_commit(&opts, msg + c->subject_off, sb);
ret = arg - placeholder + 1;
}
trailer_out:
@@ ref-filter.c: static void grab_sub_body_contents(struct atom_value *val, int der
/* Format the trailer info according to the trailer_opts given */
- format_trailers_from_commit(&s, subpos, &atom->u.contents.trailer_opts);
-+ format_trailers_from_commit(subpos, &atom->u.contents.trailer_opts, &s);
++ format_trailers_from_commit(&atom->u.contents.trailer_opts, subpos, &s);
v->s = strbuf_detach(&s, NULL);
} else if (atom->u.contents.option == C_BARE)
@@ trailer.c: static void print_tok_val(FILE *outfile, const char *tok, const char
fprintf(outfile, "%s%c %s\n", tok, separators[0], val);
}
--void format_trailers(FILE *outfile, struct list_head *head,
-- const struct process_trailer_options *opts)
+-void format_trailers(const struct process_trailer_options *opts,
+- struct list_head *trailers, FILE *outfile)
-{
- struct list_head *pos;
- struct trailer_item *item;
-- list_for_each(pos, head) {
+- list_for_each(pos, trailers) {
- item = list_entry(pos, struct trailer_item, list);
- if ((!opts->trim_empty || strlen(item->value) > 0) &&
- (!opts->only_trailers || item->token))
@@ trailer.c: static void unfold_value(struct strbuf *val)
strbuf_release(&out);
}
-+void format_trailers(struct list_head *head,
-+ const struct process_trailer_options *opts,
++void format_trailers(const struct process_trailer_options *opts,
++ struct list_head *trailers,
+ struct strbuf *out)
+{
+ struct list_head *pos;
+ struct trailer_item *item;
+ int need_separator = 0;
+
-+ list_for_each(pos, head) {
++ list_for_each(pos, trailers) {
+ item = list_entry(pos, struct trailer_item, list);
+ if (item->token) {
+ char c;
@@ trailer.c: static void format_trailer_info(struct strbuf *out,
-void format_trailers_from_commit(struct strbuf *out, const char *msg,
- const struct process_trailer_options *opts)
-+void format_trailers_from_commit(const char *msg,
-+ const struct process_trailer_options *opts,
++void format_trailers_from_commit(const struct process_trailer_options *opts,
++ const char *msg,
+ struct strbuf *out)
{
+ LIST_HEAD(head);
@@ trailer.c: static void format_trailer_info(struct strbuf *out,
- trailer_info_get(&info, msg, opts);
- format_trailer_info(out, &info, msg, opts);
-+ parse_trailers(&info, msg, &head, opts);
++ parse_trailers(opts, &info, msg, &head);
+
+ /* If we want the whole block untouched, we can take the fast path. */
+ if (!opts->only_trailers && !opts->unfold && !opts->filter &&
@@ trailer.c: static void format_trailer_info(struct strbuf *out,
+ strbuf_add(out, msg + info.trailer_block_start,
+ info.trailer_block_end - info.trailer_block_start);
+ } else
-+ format_trailers(&head, opts, out);
++ format_trailers(opts, &head, out);
+
+ free_trailers(&head);
trailer_info_release(&info);
@@ trailer.c: static void format_trailer_info(struct strbuf *out,
## trailer.h ##
@@ trailer.h: void trailer_info_release(struct trailer_info *info);
+
void trailer_config_init(void);
+ void format_trailers(const struct process_trailer_options *opts,
+- struct list_head *trailers, FILE *outfile);
++ struct list_head *trailers,
++ struct strbuf *out);
void free_trailers(struct list_head *trailers);
--void format_trailers(FILE *outfile, struct list_head *head,
-- const struct process_trailer_options *opts);
-+void format_trailers(struct list_head *head,
-+ const struct process_trailer_options *opts,
-+ struct strbuf *out);
/*
- * Format the trailers from the commit msg "msg" into the strbuf "out".
- * Note two caveats about "opts":
@@ trailer.h: void trailer_info_release(struct trailer_info *info);
- * - this is primarily a helper for pretty.c, and not
- * all of the flags are supported.
- *
-- * - this differs from format_trailers slightly in that we always format
+- * - this differs from process_trailers slightly in that we always format
- * only the trailer block itself, even if the "only_trailers" option is not
- * set.
+ * Convenience function to format the trailers from the commit msg "msg" into
@@ trailer.h: void trailer_info_release(struct trailer_info *info);
*/
-void format_trailers_from_commit(struct strbuf *out, const char *msg,
- const struct process_trailer_options *opts);
-+void format_trailers_from_commit(const char *msg,
-+ const struct process_trailer_options *opts,
++void format_trailers_from_commit(const struct process_trailer_options *opts,
++ const char *msg,
+ struct strbuf *out);
/*
4: 8d864614757 ! 4: f1171f5202f trailer: delete obsolete formatting functions
@@ trailer.c: void trailer_info_release(struct trailer_info *info)
-
-}
-
- void format_trailers_from_commit(const char *msg,
- const struct process_trailer_options *opts,
+ void format_trailers_from_commit(const struct process_trailer_options *opts,
+ const char *msg,
struct strbuf *out)
5: fd4a9d54d95 ! 5: 5ba842b5005 sequencer: use the trailer iterator
@@ sequencer.c: static const char *get_todo_path(const struct replay_opts *opts)
+ i++;
+ if (sob &&
+ iter.is_trailer &&
-+ !strncmp(iter.raw.buf, sob->buf, sob->len)) {
++ !strncmp(iter.raw, sob->buf, sob->len)) {
+ found_sob = i;
+ }
+ }
@@ sequencer.c: static const char *get_todo_path(const struct replay_opts *opts)
## trailer.c ##
@@ trailer.c: void trailer_iterator_init(struct trailer_iterator *iter, const char *msg)
- struct process_trailer_options opts = PROCESS_TRAILER_OPTIONS_INIT;
- strbuf_init(&iter->key, 0);
- strbuf_init(&iter->val, 0);
-+ strbuf_init(&iter->raw, 0);
- opts.no_divider = 1;
- trailer_info_get(&iter->internal.info, msg, &opts);
- iter->internal.cur = 0;
-@@ trailer.c: void trailer_iterator_init(struct trailer_iterator *iter, const char *msg)
int trailer_iterator_advance(struct trailer_iterator *iter)
{
@@ trailer.c: void trailer_iterator_init(struct trailer_iterator *iter, const char
+ separator_pos = find_separator(line, separators);
+ iter->is_trailer = (separator_pos > 0);
+
-+ strbuf_reset(&iter->raw);
-+ strbuf_addstr(&iter->raw, line);
++ iter->raw = line;
strbuf_reset(&iter->key);
strbuf_reset(&iter->val);
parse_trailer(&iter->key, &iter->val, NULL,
@@ trailer.c: void trailer_iterator_init(struct trailer_iterator *iter, const char
unfold_value(&iter->val);
return 1;
}
-@@ trailer.c: void trailer_iterator_release(struct trailer_iterator *iter)
- trailer_info_release(&iter->internal.info);
- strbuf_release(&iter->val);
- strbuf_release(&iter->key);
-+ strbuf_release(&iter->raw);
- }
## trailer.h ##
@@ trailer.h: struct trailer_iterator {
@@ trailer.h: struct trailer_iterator {
+ /*
+ * Raw line (e.g., "foo: bar baz") before being parsed as a trailer
-+ * key/val pair. This field can contain non-trailer lines because it's
-+ * valid for a trailer block to contain such lines (i.e., we only
-+ * require 25% of the lines in a trailer block to be trailer lines).
++ * key/val pair as part of a trailer block. A trailer block can be
++ * either 100% trailer lines, or mixed in with non-trailer lines (in
++ * which case at least 25% must be trailer lines).
+ */
-+ struct strbuf raw;
++ const char *raw;
+
+ /*
-+ * 1 if the raw line was parsed as a separate key/val pair.
++ * 1 if the raw line was parsed as a trailer line (key/val pair).
+ */
+ int is_trailer;
+
6: 0cbe96421c7 ! 6: f0ac2f6c4b9 trailer: make trailer_info struct private
@@ Commit message
Make this struct private by putting its definition inside trailer.c.
This has two benefits:
- (1) it makes the surface area of the public facing interface (trailer.h)
- smaller, and
+ (1) it makes the surface area of the public facing
+ interface (trailer.h) smaller, and
- (2) external API users are unable to peer inside this struct (because it
- is only ever exposed as an opaque pointer).
+ (2) external API users are unable to peer inside this struct (because
+ it is only ever exposed as an opaque pointer).
This change exposes some deficiencies in the API, mainly with regard to
information about the location of the trailer block that was parsed.
@@ Commit message
Signed-off-by: Linus Arver <[email protected]>
## builtin/interpret-trailers.c ##
-@@ builtin/interpret-trailers.c: static void interpret_trailers(const char *file,
+@@ builtin/interpret-trailers.c: static void interpret_trailers(const struct process_trailer_options *opts,
LIST_HEAD(head);
struct strbuf sb = STRBUF_INIT;
struct strbuf trailer_block = STRBUF_INIT;
@@ builtin/interpret-trailers.c: static void interpret_trailers(const char *file,
FILE *outfile = stdout;
trailer_config_init();
-@@ builtin/interpret-trailers.c: static void interpret_trailers(const char *file,
+@@ builtin/interpret-trailers.c: static void interpret_trailers(const struct process_trailer_options *opts,
if (opts->in_place)
outfile = create_in_place_tempfile(file);
-- parse_trailers(&info, sb.buf, &head, opts);
-+ info = parse_trailers(sb.buf, &head, opts);
+- parse_trailers(opts, &info, sb.buf, &head);
++ info = parse_trailers(opts, sb.buf, &head);
/* Print the lines before the trailers */
if (!opts->only_trailers)
@@ builtin/interpret-trailers.c: static void interpret_trailers(const char *file,
fprintf(outfile, "\n");
-@@ builtin/interpret-trailers.c: static void interpret_trailers(const char *file,
+@@ builtin/interpret-trailers.c: static void interpret_trailers(const struct process_trailer_options *opts,
strbuf_release(&trailer_block);
free_trailers(&head);
@@ trailer.c
struct conf_info {
char *name;
char *key;
-@@ trailer.c: void format_trailers(struct list_head *head,
+@@ trailer.c: void format_trailers(const struct process_trailer_options *opts,
}
}
@@ trailer.c: void format_trailers(struct list_head *head,
+ return info;
+}
+
-+static struct trailer_info *trailer_info_get(const char *str,
-+ const struct process_trailer_options *opts)
++static struct trailer_info *trailer_info_get(const struct process_trailer_options *opts,
++ const char *str)
+{
+ struct trailer_info *info = trailer_info_new();
+ size_t end_of_log_message = 0, trailer_block_start = 0;
@@ trailer.c: void format_trailers(struct list_head *head,
* Parse trailers in "str", populating the trailer info and "head"
* linked list structure.
*/
--void parse_trailers(struct trailer_info *info,
+-void parse_trailers(const struct process_trailer_options *opts,
+- struct trailer_info *info,
- const char *str,
-- struct list_head *head,
-- const struct process_trailer_options *opts)
-+struct trailer_info *parse_trailers(const char *str,
-+ struct list_head *head,
-+ const struct process_trailer_options *opts)
+- struct list_head *head)
++struct trailer_info *parse_trailers(const struct process_trailer_options *opts,
++ const char *str,
++ struct list_head *head)
{
+ struct trailer_info *info;
struct strbuf tok = STRBUF_INIT;
@@ trailer.c: void format_trailers(struct list_head *head,
size_t i;
- trailer_info_get(info, str, opts);
-+ info = trailer_info_get(str, opts);
++ info = trailer_info_get(opts, str);
for (i = 0; i < info->trailer_nr; i++) {
int separator_pos;
-@@ trailer.c: void parse_trailers(struct trailer_info *info,
+@@ trailer.c: void parse_trailers(const struct process_trailer_options *opts,
strbuf_detach(&val, NULL));
}
}
@@ trailer.c: void parse_trailers(struct trailer_info *info,
+ return info;
}
- void free_trailers(struct list_head *head)
-@@ trailer.c: void free_trailers(struct list_head *head)
+ void free_trailers(struct list_head *trailers)
+@@ trailer.c: void free_trailers(struct list_head *trailers)
}
}
@@ trailer.c: void trailer_info_release(struct trailer_info *info)
+ free(info);
}
- void format_trailers_from_commit(const char *msg,
-@@ trailer.c: void format_trailers_from_commit(const char *msg,
+ void format_trailers_from_commit(const struct process_trailer_options *opts,
+@@ trailer.c: void format_trailers_from_commit(const struct process_trailer_options *opts,
struct strbuf *out)
{
LIST_HEAD(head);
- struct trailer_info info;
-
-- parse_trailers(&info, msg, &head, opts);
-+ struct trailer_info *info = parse_trailers(msg, &head, opts);
+- parse_trailers(opts, &info, msg, &head);
++ struct trailer_info *info = parse_trailers(opts, msg, &head);
/* If we want the whole block untouched, we can take the fast path. */
if (!opts->only_trailers && !opts->unfold && !opts->filter &&
@@ trailer.c: void format_trailers_from_commit(const char *msg,
+ strbuf_add(out, msg + info->trailer_block_start,
+ info->trailer_block_end - info->trailer_block_start);
} else
- format_trailers(&head, opts, out);
+ format_trailers(opts, &head, out);
free_trailers(&head);
- trailer_info_release(&info);
@@ trailer.c: void format_trailers_from_commit(const char *msg,
+ struct trailer_info *internal = trailer_info_new();
strbuf_init(&iter->key, 0);
strbuf_init(&iter->val, 0);
- strbuf_init(&iter->raw, 0);
opts.no_divider = 1;
- trailer_info_get(&iter->internal.info, msg, &opts);
+ iter->internal.info = internal;
-+ iter->internal.info = trailer_info_get(msg, &opts);
++ iter->internal.info = trailer_info_get(&opts, msg);
iter->internal.cur = 0;
}
@@ trailer.c: int trailer_iterator_advance(struct trailer_iterator *iter)
+ trailer_info_release(iter->internal.info);
strbuf_release(&iter->val);
strbuf_release(&iter->key);
- strbuf_release(&iter->raw);
+ }
## trailer.h ##
@@
@@ trailer.h: void parse_trailers_from_command_line_args(struct list_head *arg_head
void process_trailers_lists(struct list_head *head,
struct list_head *arg_head);
--void parse_trailers(struct trailer_info *info,
+-void parse_trailers(const struct process_trailer_options *opts,
+- struct trailer_info *info,
- const char *str,
-- struct list_head *head,
-- const struct process_trailer_options *opts);
-+struct trailer_info *parse_trailers(const char *str,
-+ struct list_head *head,
-+ const struct process_trailer_options *opts);
+- struct list_head *head);
++struct trailer_info *parse_trailers(const struct process_trailer_options *opts,
++ const char *str,
++ struct list_head *head);
-void trailer_info_get(struct trailer_info *info, const char *str,
- const struct process_trailer_options *opts);
7: 9183990583f ! 7: 291aa83af55 trailer: spread usage of "trailer_block" language
@@ Commit message
Signed-off-by: Linus Arver <[email protected]>
## builtin/interpret-trailers.c ##
-@@ builtin/interpret-trailers.c: static void interpret_trailers(const char *file,
+@@ builtin/interpret-trailers.c: static void interpret_trailers(const struct process_trailer_options *opts,
{
LIST_HEAD(head);
struct strbuf sb = STRBUF_INIT;
@@ builtin/interpret-trailers.c: static void interpret_trailers(const char *file,
FILE *outfile = stdout;
trailer_config_init();
-@@ builtin/interpret-trailers.c: static void interpret_trailers(const char *file,
+@@ builtin/interpret-trailers.c: static void interpret_trailers(const struct process_trailer_options *opts,
if (opts->in_place)
outfile = create_in_place_tempfile(file);
-- info = parse_trailers(sb.buf, &head, opts);
-+ trailer_block = parse_trailers(sb.buf, opts, &head);
+- info = parse_trailers(opts, sb.buf, &head);
++ trailer_block = parse_trailers(opts, sb.buf, &head);
- /* Print the lines before the trailers */
+ /* Print the lines before the trailer block */
@@ builtin/interpret-trailers.c: static void interpret_trailers(const char *file,
fprintf(outfile, "\n");
-@@ builtin/interpret-trailers.c: static void interpret_trailers(const char *file,
+@@ builtin/interpret-trailers.c: static void interpret_trailers(const struct process_trailer_options *opts,
}
/* Print trailer block. */
-- format_trailers(&head, opts, &trailer_block);
+- format_trailers(opts, &head, &trailer_block);
- fwrite(trailer_block.buf, 1, trailer_block.len, outfile);
- strbuf_release(&trailer_block);
-+ format_trailers(&head, opts, &tb);
++ format_trailers(opts, &head, &tb);
+ fwrite(tb.buf, 1, tb.len, outfile);
+ strbuf_release(&tb);
@@ trailer.c
/*
* Array of trailers found.
-@@ trailer.c: void format_trailers(struct list_head *head,
+@@ trailer.c: void format_trailers(const struct process_trailer_options *opts,
}
}
@@ trailer.c: void format_trailers(struct list_head *head,
+ return trailer_block;
}
--static struct trailer_info *trailer_info_get(const char *str,
-- const struct process_trailer_options *opts)
-+static struct trailer_block *trailer_block_get(const char *str,
-+ const struct process_trailer_options *opts)
+-static struct trailer_info *trailer_info_get(const struct process_trailer_options *opts,
+- const char *str)
++static struct trailer_block *trailer_block_get(const struct process_trailer_options *opts,
++ const char *str)
{
- struct trailer_info *info = trailer_info_new();
+ struct trailer_block *trailer_block = trailer_block_new();
size_t end_of_log_message = 0, trailer_block_start = 0;
struct strbuf **trailer_lines, **ptr;
char **trailer_strings = NULL;
-@@ trailer.c: static struct trailer_info *trailer_info_get(const char *str,
+@@ trailer.c: static struct trailer_info *trailer_info_get(const struct process_trailer_option
}
strbuf_list_free(trailer_lines);
@@ trailer.c: static struct trailer_info *trailer_info_get(const char *str,
+ * Parse trailers in "str", populating the trailer_block info and "head" linked
+ * list structure.
*/
--struct trailer_info *parse_trailers(const char *str,
-- struct list_head *head,
-- const struct process_trailer_options *opts)
-+struct trailer_block *parse_trailers(const char *str,
-+ const struct process_trailer_options *opts,
+-struct trailer_info *parse_trailers(const struct process_trailer_options *opts,
+- const char *str,
+- struct list_head *head)
++struct trailer_block *parse_trailers(const struct process_trailer_options *opts,
++ const char *str,
+ struct list_head *head)
{
- struct trailer_info *info;
@@ trailer.c: static struct trailer_info *trailer_info_get(const char *str,
struct strbuf val = STRBUF_INIT;
size_t i;
-- info = trailer_info_get(str, opts);
-+ trailer_block = trailer_block_get(str, opts);
+- info = trailer_info_get(opts, str);
++ trailer_block = trailer_block_get(opts, str);
- for (i = 0; i < info->trailer_nr; i++) {
+ for (i = 0; i < trailer_block->trailer_nr; i++) {
@@ trailer.c: static struct trailer_info *trailer_info_get(const char *str,
if (trailer[0] == comment_line_char)
continue;
separator_pos = find_separator(trailer, separators);
-@@ trailer.c: struct trailer_info *parse_trailers(const char *str,
+@@ trailer.c: struct trailer_info *parse_trailers(const struct process_trailer_options *opts,
}
}
@@ trailer.c: struct trailer_info *parse_trailers(const char *str,
+ return trailer_block;
}
- void free_trailers(struct list_head *head)
-@@ trailer.c: void free_trailers(struct list_head *head)
+ void free_trailers(struct list_head *trailers)
+@@ trailer.c: void free_trailers(struct list_head *trailers)
}
}
@@ trailer.c: void free_trailers(struct list_head *head)
+ free(trailer_block);
}
- void format_trailers_from_commit(const char *msg,
-@@ trailer.c: void format_trailers_from_commit(const char *msg,
+ void format_trailers_from_commit(const struct process_trailer_options *opts,
+@@ trailer.c: void format_trailers_from_commit(const struct process_trailer_options *opts,
struct strbuf *out)
{
LIST_HEAD(head);
-- struct trailer_info *info = parse_trailers(msg, &head, opts);
-+ struct trailer_block *trailer_block = parse_trailers(msg, opts, &head);
+- struct trailer_info *info = parse_trailers(opts, msg, &head);
++ struct trailer_block *trailer_block = parse_trailers(opts, msg, &head);
/* If we want the whole block untouched, we can take the fast path. */
if (!opts->only_trailers && !opts->unfold && !opts->filter &&
@@ trailer.c: void format_trailers_from_commit(const char *msg,
+ strbuf_add(out, msg + trailer_block->start,
+ trailer_block->end - trailer_block->start);
} else
- format_trailers(&head, opts, out);
+ format_trailers(opts, &head, out);
free_trailers(&head);
- trailer_info_release(info);
@@ trailer.c: void format_trailers_from_commit(const char *msg,
- struct trailer_info *internal = trailer_info_new();
strbuf_init(&iter->key, 0);
strbuf_init(&iter->val, 0);
- strbuf_init(&iter->raw, 0);
opts.no_divider = 1;
- iter->internal.info = internal;
-- iter->internal.info = trailer_info_get(msg, &opts);
-+ iter->internal.trailer_block = trailer_block_get(msg, &opts);
+- iter->internal.info = trailer_info_get(&opts, msg);
++ iter->internal.trailer_block = trailer_block_get(&opts, msg);
iter->internal.cur = 0;
}
@@ trailer.c: int trailer_iterator_advance(struct trailer_iterator *iter)
+ trailer_block_release(iter->internal.trailer_block);
strbuf_release(&iter->val);
strbuf_release(&iter->key);
- strbuf_release(&iter->raw);
+ }
## trailer.h ##
@@
@@ trailer.h: void parse_trailers_from_command_line_args(struct list_head *arg_head
void process_trailers_lists(struct list_head *head,
struct list_head *arg_head);
--struct trailer_info *parse_trailers(const char *str,
-- struct list_head *head,
-- const struct process_trailer_options *opts);
-+struct trailer_block *parse_trailers(const char *str,
-+ const struct process_trailer_options *opts,
+-struct trailer_info *parse_trailers(const struct process_trailer_options *opts,
+- const char *str,
+- struct list_head *head);
++struct trailer_block *parse_trailers(const struct process_trailer_options *opts,
++ const char *str,
+ struct list_head *head);
-size_t trailer_block_start(struct trailer_info *info);
@@ trailer.h: void parse_trailers_from_command_line_args(struct list_head *arg_head
+void trailer_block_release(struct trailer_block *trailer_block);
void trailer_config_init(void);
- void free_trailers(struct list_head *trailers);
+ void format_trailers(const struct process_trailer_options *opts,
@@ trailer.h: struct trailer_iterator {
/* private */ 8: 406725df46a ! 8: 64ee07d0b53 trailer: prepare to move parse_trailers_from_command_line_args() to builtin
@@ Commit message
parse_trailers_from_command_line_args()
to interpret-trailer.c, because the trailer API should not be concerned
- with command line arguments (as it has nothing to do with trailers
- themselves). The interpret-trailers builtin is the only user of the
- above function.
+ with command line arguments (as they have nothing to do with trailers
+ themselves). The interpret-trailers builtin is the only caller of this
+ function.
+ Also rename "conf_info" to "trailer_conf" for readability, dropping the
+ low-value "_info" suffix as we did earlier in this series for
+ "trailer_info" to "trailer_block".
+
+ Helped-by: Josh Steadmon <[email protected]>
## trailer.c ##
@@ trailer.c: void parse_trailers_from_command_line_args(struct list_head *arg_head
add_arg_item(arg_head,
strbuf_detach(&tok, NULL),
strbuf_detach(&val, NULL),
-@@ trailer.c: struct trailer_block *parse_trailers(const char *str,
+@@ trailer.c: struct trailer_block *parse_trailers(const struct process_trailer_options *opts,
for (i = 0; i < trailer_block->trailer_nr; i++) {
int separator_pos;
@@ trailer.c: struct trailer_block *parse_trailers(const char *str,
add_trailer_item(head,
NULL,
@@ trailer.c: int trailer_iterator_advance(struct trailer_iterator *iter)
- strbuf_addstr(&iter->raw, line);
+ iter->raw = line;
strbuf_reset(&iter->key);
strbuf_reset(&iter->val);
- parse_trailer(&iter->key, &iter->val, NULL,
@@ trailer.h: void parse_trailers_from_command_line_args(struct list_head *arg_head
+ struct strbuf *tok, struct strbuf *val,
+ const struct trailer_conf **conf);
+
- struct trailer_block *parse_trailers(const char *str,
- const struct process_trailer_options *opts,
+ struct trailer_block *parse_trailers(const struct process_trailer_options *opts,
+ const char *str,
struct list_head *head);
9: 8a99d0fca21 ! 9: 1b4bdde65bc trailer: move arg handling to interpret-trailers.c
@@ builtin/interpret-trailers.c: static int option_parse_trailer(const struct optio
}
@@ builtin/interpret-trailers.c: static void read_input_file(struct strbuf *sb, const char *file)
+ }
- static void interpret_trailers(const char *file,
- const struct process_trailer_options *opts,
-- struct list_head *new_trailer_head)
-+ struct list_head *arg_trailers)
+ static void interpret_trailers(const struct process_trailer_options *opts,
+- struct list_head *new_trailer_head,
++ struct list_head *arg_trailers,
+ const char *file)
{
LIST_HEAD(head);
- struct strbuf sb = STRBUF_INIT;
-@@ builtin/interpret-trailers.c: static void interpret_trailers(const char *file,
+@@ builtin/interpret-trailers.c: static void interpret_trailers(const struct process_trailer_options *opts,
struct trailer_block *trailer_block;
FILE *outfile = stdout;
@@ builtin/interpret-trailers.c: static void interpret_trailers(const char *file,
read_input_file(&sb, file);
if (opts->in_place)
-@@ builtin/interpret-trailers.c: static void interpret_trailers(const char *file,
+@@ builtin/interpret-trailers.c: static void interpret_trailers(const struct process_trailer_options *opts,
if (!opts->only_input) {
@@ builtin/interpret-trailers.c: static void interpret_trailers(const char *file,
}
/* Print trailer block. */
-@@ builtin/interpret-trailers.c: static void interpret_trailers(const char *file,
+@@ builtin/interpret-trailers.c: static void interpret_trailers(const struct process_trailer_options *opts,
int cmd_interpret_trailers(int argc, const char **argv, const char *prefix)
{
struct process_trailer_options opts = PROCESS_TRAILER_OPTIONS_INIT;
@@ builtin/interpret-trailers.c: int cmd_interpret_trailers(int argc, const char **
if (argc) {
int i;
for (i = 0; i < argc; i++)
-- interpret_trailers(argv[i], &opts, &trailers);
-+ interpret_trailers(argv[i], &opts, &arg_trailers);
+- interpret_trailers(&opts, &trailers, argv[i]);
++ interpret_trailers(&opts, &arg_trailers, argv[i]);
} else {
if (opts.in_place)
die(_("no input file given for in-place editing"));
-- interpret_trailers(NULL, &opts, &trailers);
-+ interpret_trailers(NULL, &opts, &arg_trailers);
+- interpret_trailers(&opts, &trailers, NULL);
++ interpret_trailers(&opts, &arg_trailers, NULL);
}
- new_trailers_clear(&trailers);
@@ trailer.c: void parse_trailers_from_command_line_args(struct list_head *arg_head
}
}
-@@ trailer.c: void free_trailers(struct list_head *head)
+@@ trailer.c: void free_trailers(struct list_head *trailers)
}
}
@@ trailer.h: struct new_trailer_item {
struct process_trailer_options {
int in_place;
int trim_empty;
-@@ trailer.h: void trailer_block_release(struct trailer_block *trailer_block);
-
- void trailer_config_init(void);
+@@ trailer.h: void format_trailers(const struct process_trailer_options *opts,
+ struct list_head *trailers,
+ struct strbuf *out);
void free_trailers(struct list_head *trailers);
-+void new_trailers_clear(struct list_head *trailers);
-
- void format_trailers(struct list_head *head,
- const struct process_trailer_options *opts,
+-
++void new_trailers_clear(struct list_head *new_trailers);
+ /*
+ * Convenience function to format the trailers from the commit msg "msg" into
+ * the strbuf "out". Reuses format_trailers internally. 10: 243eee730e4 = 10: ed67ebf8647 trailer: delete obsolete argument handling code from API
Signature · 1 line
gitgitgadget
PATCH v2 1/10 trailer: prepare to expose functions as part of API
From: Linus Arver <[email protected]>
In the next patch, we will move "process_trailers" from trailer.c to builtin/interpret-trailers.c. That move will necessitate the growth of the trailer.h API, forcing us to expose some additional functions in trailer.h.
Rename relevant functions so that they include the term "trailer" in their name, so that clients of the API will be able to easily identify them by their "trailer" moniker, just like all the other functions already exposed by trailer.h.
The the opportunity to start putting trailer processions options (opts) as the first parameter. This will be the pattern going forward in this series.
--- builtin/interpret-trailers.c | 4 ++-- trailer.c | 26 +++++++++++++------------- trailer.h | 6 +++--- 3 files changed, 18 insertions(+), 18 deletions(-)
builtin/interpret-trailers.c +2 -2
@@ -132,11 +132,11 @@ int cmd_interpret_trailers(int argc, const char **argv, const char *prefix)if (argc) {int i;for (i =0 ; i < argc; i++) -process_trailers (argv[i], &opts, &trailers); +interpret_trailers (&opts, &trailers, argv[i]); }else {if (opts.in_place)die (_ ("no input file given for in-place editing" )); -process_trailers (NULL , &opts, &trailers); +interpret_trailers (&opts, &trailers,NULL ); }new_trailers_clear (&trailers);
trailer.c +13 -13
@@ -163,12 +163,12 @@ static void print_tok_val(FILE *outfile, const char *tok, const char *val)fprintf (outfile,"%s%c %s\n" , tok, separators[0 ], val); } -static void print_all (FILE *outfile,struct list_head *head, -const struct process_trailer_options *opts) +static void format_trailers (const struct process_trailer_options *opts, +struct list_head *trailers,FILE *outfile) {struct list_head *pos;struct trailer_item *item; -list_for_each (pos, head) { +list_for_each (pos, trailers) { item = list_entry(pos, struct trailer_item, list);if ((!opts->trim_empty ||strlen (item->value) >0 ) && (!opts->only_trailers || item->token))
@@ -589,7 +589,7 @@ static int git_trailer_config(const char *conf_key, const char *value,return 0 ; } -static void ensure_configured (void ) +static void trailer_config_init (void ) {if (configured)return ;
@@ -1035,10 +1035,10 @@ static void parse_trailers(struct trailer_info *info, } } -static void free_all (struct list_head *head) +static void free_trailers (struct list_head *trailers) {struct list_head *pos, *p; -list_for_each_safe (pos, p, head) { +list_for_each_safe (pos, p, trailers) {list_del (pos);free_trailer_item (list_entry(pos ,struct trailer_item ,list )); }
@@ -1075,16 +1075,16 @@ static FILE *create_in_place_tempfile(const char *file)return outfile; } -void process_trailers (const char *file, -const struct process_trailer_options *opts, -struct list_head *new_trailer_head) +void interpret_trailers (const struct process_trailer_options *opts, +struct list_head *new_trailer_head, +const char *file) {LIST_HEAD (head);struct strbuf sb =STRBUF_INIT ;struct trailer_info info;FILE *outfile = stdout; -ensure_configured (); +trailer_config_init ();read_input_file (&sb, file);
@@ -1110,9 +1110,9 @@ void process_trailers(const char *file,process_trailers_lists (&head, &arg_head); } -print_all (outfile, &head, opts); +format_trailers (opts, &head, outfile); -free_all (&head); +free_trailers (&head);trailer_info_release (&info);/* Print the lines after the trailers as is */
@@ -1135,7 +1135,7 @@ void trailer_info_get(struct trailer_info *info, const char *str,size_t nr =0 , alloc =0 ;char **last =NULL ; -ensure_configured (); +trailer_config_init (); end_of_log_message =find_end_of_log_message (str, opts->no_divider); trailer_block_start =find_trailer_block_start (str, end_of_log_message);
trailer.h +3 -3
@@ -81,9 +81,9 @@ struct process_trailer_options {#define PROCESS_TRAILER_OPTIONS_INIT {0} -void process_trailers (const char *file, -const struct process_trailer_options *opts, -struct list_head *new_trailer_head); +void interpret_trailers (const struct process_trailer_options *opts, +struct list_head *new_trailer_head, +const char *file);void trailer_info_get (struct trailer_info *info,const char *str,const struct process_trailer_options *opts);
Signature · 1 line
gitgitgadget
Re: [PATCH v2 01/10] trailer: prepare to expose functions as part of API
Quoted 7 lines · Linus Arver via GitGitGadget
From: Linus Arver <[email protected]>
In the next patch, we will move "
process_trailers" fromtrailer.ctobuiltin/interpret-trailers.c. That move will necessitate the growth of thetrailer.hAPI, forcing us to expose some additional functions intrailer.h.
Quoted 6 lines
Rename relevant functions so that they include the term "trailer" in their name, so that clients of the API will be able to easily identify them by their "trailer" moniker, just like all the other functions already exposed by
trailer.h.The the opportunity to start putting trailer processions options (opts)
Nitpick: typo in the commit message.
s/The the opportunity/Take the opportunity/ ?
Quoted 10 lines
as the first parameter. This will be the pattern going forward in this series.
Helped-by Junio C Hamano <[email protected]>Signed-off-by Linus Arver <[email protected]>--- builtin/interpret-trailers.c | 4 ++-- trailer.c | 26 +++++++++++++------------- trailer.h | 6 +++--- 3 files changed, 18 insertions(+), 18 deletions(-)
Re: [PATCH v2 01/10] trailer: prepare to expose functions as part of API
Quoted 13 lines · Josh Steadmon
Quoted 12 lines · Linus Arver via GitGitGadget
From: Linus Arver <[email protected]>
In the next patch, we will move "
process_trailers" fromtrailer.ctobuiltin/interpret-trailers.c. That move will necessitate the growth of thetrailer.hAPI, forcing us to expose some additional functions intrailer.h.Rename relevant functions so that they include the term "trailer" in their name, so that clients of the API will be able to easily identify them by their "trailer" moniker, just like all the other functions already exposed by
trailer.h.
Quoted 4 lines
Quoted 1 line
The the opportunity to start putting trailer processions options (opts)
Nitpick: typo in the commit message.
s/The the opportunity/Take the opportunity/ ?
Ack, will update in reroll.
PATCH v2 2/10 trailer: move interpret_trailers() to interpret-trailers.c
In reply to Linus Arver via GitGitGadgetFrom: Linus Arver <[email protected]>
The interpret-trailers.c builtin is the only place we need to call interpret_trailers(), so move its definition there.
Delete the corresponding declaration from trailer.h, which then forces us to expose the working innards of that function. This enriches trailer.h with a more granular API, which can then be unit-tested in the future (because interpret_trailers() by itself does too many things to be able to be easily unit-tested).
Take this opportunity to demote some file-handling functions out of the trailer API implementation, as these have nothing to do with trailers.
--- builtin/interpret-trailers.c | 94 +++++++++++++++++++++++++++ trailer.c | 120 ++++------------------------------- trailer.h | 20 +++++- 3 files changed, 124 insertions(+), 110 deletions(-)
builtin/interpret-trailers.c +94 -0
@@ -9,6 +9,7 @@#include "gettext.h" #include "parse-options.h" #include "string-list.h" +#include "tempfile.h" #include "trailer.h" #include "config.h"
@@ -91,6 +92,99 @@ static int parse_opt_parse(const struct option *opt, const char *arg,return 0 ; } +static struct tempfile *trailers_tempfile; + +static FILE *create_in_place_tempfile (const char *file) +{ +struct stat st; +struct strbuf filename_template =STRBUF_INIT ; +const char *tail; +FILE *outfile; + +if (stat (file, &st)) +die_errno (_ ("could not stat %s" ), file); +if (!S_ISREG (st.st_mode)) +die (_ ("file %s is not a regular file" ), file); +if (!(st.st_mode &S_IWUSR )) +die (_ ("file %s is not writable by user" ), file); + +/* Create temporary file in the same directory as the original */ + tail =strrchr (file,'/' ); +if (tail) +strbuf_add (&filename_template, file, tail - file +1 ); +strbuf_addstr (&filename_template,"git-interpret-trailers-XXXXXX" ); + + trailers_tempfile =xmks_tempfile_m (filename_template.buf, st.st_mode); +strbuf_release (&filename_template); + outfile =fdopen_tempfile (trailers_tempfile,"w" ); +if (!outfile) +die_errno (_ ("could not open temporary file" )); + +return outfile; +} + +static void read_input_file (struct strbuf *sb,const char *file) +{ +if (file) { +if (strbuf_read_file (sb, file,0 ) <0 ) +die_errno (_ ("could not read input file '%s'" ), file); + }else { +if (strbuf_read (sb,fileno (stdin),0 ) <0 ) +die_errno (_ ("could not read from stdin" )); + } +} + +static void interpret_trailers (const struct process_trailer_options *opts, +struct list_head *new_trailer_head, +const char *file) +{ +LIST_HEAD (head); +struct strbuf sb =STRBUF_INIT ; +struct trailer_info info; +FILE *outfile = stdout; + +trailer_config_init (); + +read_input_file (&sb, file); + +if (opts->in_place) + outfile =create_in_place_tempfile (file); + +parse_trailers (opts, &info, sb.buf, &head); + +/* Print the lines before the trailers */ +if (!opts->only_trailers) +fwrite (sb.buf,1 , info.trailer_block_start, outfile); + +if (!opts->only_trailers && !info.blank_line_before_trailer) +fprintf (outfile,"\n" ); + + +if (!opts->only_input) { +LIST_HEAD (config_head); +LIST_HEAD (arg_head); +parse_trailers_from_config (&config_head); +parse_trailers_from_command_line_args (&arg_head, new_trailer_head); +list_splice (&config_head, &arg_head); +process_trailers_lists (&head, &arg_head); + } + +format_trailers (opts, &head, outfile); + +free_trailers (&head); +trailer_info_release (&info); + +/* Print the lines after the trailers as is */ +if (!opts->only_trailers) +fwrite (sb.buf + info.trailer_block_end,1 , sb.len - info.trailer_block_end, outfile); + +if (opts->in_place) +if (rename_tempfile (&trailers_tempfile, file)) +die_errno (_ ("could not rename temporary file to %s" ), file); + +strbuf_release (&sb); +} +int cmd_interpret_trailers (int argc,const char **argv,const char *prefix) {struct process_trailer_options opts =PROCESS_TRAILER_OPTIONS_INIT ;
trailer.c +13 -107
180 lines not on this page · raw message
trailer.h +17 -3
@@ -81,15 +81,29 @@ struct process_trailer_options {#define PROCESS_TRAILER_OPTIONS_INIT {0} -void interpret_trailers (const struct process_trailer_options *opts, -struct list_head *new_trailer_head, -const char *file); +void parse_trailers_from_config (struct list_head *config_head); + +void parse_trailers_from_command_line_args (struct list_head *arg_head, +struct list_head *new_trailer_head); + +void process_trailers_lists (struct list_head *head, +struct list_head *arg_head); + +void parse_trailers (const struct process_trailer_options *opts, +struct trailer_info *info, +const char *str, +struct list_head *head);void trailer_info_get (struct trailer_info *info,const char *str,const struct process_trailer_options *opts);void trailer_info_release (struct trailer_info *info); +void trailer_config_init (void ); +void format_trailers (const struct process_trailer_options *opts, +struct list_head *trailers,FILE *outfile); +void free_trailers (struct list_head *trailers); +/* * Format the trailers from the commit msg "msg" into the strbuf "out". * Note two caveats about "opts":
Signature · 1 line
gitgitgadget
PATCH v2 3/10 trailer: unify trailer formatting machinery
In reply to Linus Arver via GitGitGadgetFrom: Linus Arver <[email protected]>
Currently have two functions for formatting trailers exposed in trailer.h:
void format_trailers(FILE *outfile, struct list_head *head,
const struct process_trailer_options *opts);
void format_trailers_from_commit(struct strbuf *out, const char *msg,
const struct process_trailer_options *opts);
and previously these functions, although similar enough (even taking the same process_trailer_options struct pointer), did not build on each other.
Make format_trailers_from_commit() rely on format_trailers(). Teach format_trailers() to process trailers with the additional process_trailer_options fields like opts->key_only which is only used by format_trailers_from_commit() and not builtin/interpret-trailers.c. While we're at it, reorder parameters to put the trailer processing options first, and the out parameter (strbuf we write into) at the end.
This unification will allow us to delete the format_trailer_info() and print_tok_val() functions in the next patch. They are not deleted here in order to keep the diff small.
--- builtin/interpret-trailers.c | 6 +- pretty.c | 2 +- ref-filter.c | 2 +- trailer.c | 105 +++++++++++++++++++++++++++++------ trailer.h | 19 +++---- 5 files changed, 102 insertions(+), 32 deletions(-)
builtin/interpret-trailers.c +5 -1
@@ -140,6 +140,7 @@ static void interpret_trailers(const struct process_trailer_options *opts, {LIST_HEAD (head);struct strbuf sb =STRBUF_INIT ; +struct strbuf trailer_block =STRBUF_INIT ;struct trailer_info info;FILE *outfile = stdout;
@@ -169,7 +170,10 @@ static void interpret_trailers(const struct process_trailer_options *opts,process_trailers_lists (&head, &arg_head); } -format_trailers (opts, &head, outfile); +/* Print trailer block. */ +format_trailers (opts, &head, &trailer_block); +fwrite (trailer_block.buf,1 , trailer_block.len, outfile); +strbuf_release (&trailer_block);free_trailers (&head);trailer_info_release (&info);
pretty.c +1 -1
@@ -1759,7 +1759,7 @@ static size_t format_commit_one(struct strbuf *sb, /* in UTF-8 */ goto trailer_out; }if (*arg ==')' ) { -format_trailers_from_commit (sb, msg + c->subject_off, &opts); +format_trailers_from_commit (&opts, msg + c->subject_off, sb); ret = arg - placeholder +1 ; } trailer_out:
ref-filter.c +1 -1
@@ -1985,7 +1985,7 @@ static void grab_sub_body_contents(struct atom_value *val, int deref, struct expstruct strbuf s =STRBUF_INIT ;/* Format the trailer info according to the trailer_opts given */ -format_trailers_from_commit (&s, subpos, &atom->u.contents.trailer_opts); +format_trailers_from_commit (&atom->u.contents.trailer_opts, subpos, &s); v->s =strbuf_detach (&s,NULL ); }else if (atom->u.contents.option ==C_BARE )
trailer.c +88 -17
126 lines not on this page · raw message
trailer.h +7 -12
@@ -101,22 +101,17 @@ void trailer_info_release(struct trailer_info *info);void trailer_config_init (void );void format_trailers (const struct process_trailer_options *opts, -struct list_head *trailers,FILE *outfile); +struct list_head *trailers, +struct strbuf *out);void free_trailers (struct list_head *trailers);/* -* Format the trailers from the commit msg "msg" into the strbuf "out". -* Note two caveats about "opts": -* -* - this is primarily a helper for pretty.c, and not -* all of the flags are supported. -* -* - this differs from process_trailers slightly in that we always format -* only the trailer block itself, even if the "only_trailers" option is not -* set. +* Convenience function to format the trailers from the commit msg "msg" into +* the strbuf "out". Reuses format_trailers internally. */ -void format_trailers_from_commit (struct strbuf *out,const char *msg, -const struct process_trailer_options *opts); +void format_trailers_from_commit (const struct process_trailer_options *opts, +const char *msg, +struct strbuf *out);/* * An interface for iterating over the trailers found in a particular commit
Signature · 1 line
gitgitgadget
Re: [PATCH v2 03/10] trailer: unify trailer formatting machinery
Quoted 22 lines · Linus Arver via GitGitGadget
From: Linus Arver <[email protected]>
Currently have two functions for formatting trailers exposed in
trailer.h:void format_trailers(FILE *outfile, struct
list_head*head,
const structprocess_trailer_options*opts);void format_trailers_from_commit(struct strbuf *out, const char *msg,
const structprocess_trailer_options*opts);and previously these functions, although similar enough (even taking the same
process_trailer_optionsstruct pointer), did not build on each other.Make
format_trailers_from_commit()rely onformat_trailers(). Teachformat_trailers()to process trailers with the additionalprocess_trailer_optionsfields likeopts->key_onlywhich is only used byformat_trailers_from_commit()and notbuiltin/interpret-trailers.c. While we're at it, reorder parameters to put the trailer processing options first, and the out parameter (strbuf we write into) at the end.
Quoted 3 lines
This unification will allow us to delete the
format_trailer_info()andprint_tok_val()functions in the next patch. They are not deleted here in order to keep the diff small.
Unfortunately this breaks the build:
trailer.c:1145:13: error: ‘format_trailer_info’ defined but not used [-Werror=unused-function]
and
trailer.c:147:13: error: ‘print_tok_val’ defined but not used [-Werror=unused-function]
While separating this patch from the deletion does make it easier to review, it may make bisection more difficult.
Re: [PATCH v2 03/10] trailer: unify trailer formatting machinery
Quoted 29 lines · Josh Steadmon
Quoted 22 lines · Linus Arver via GitGitGadget
From: Linus Arver <[email protected]>
Currently have two functions for formatting trailers exposed in
trailer.h:void format_trailers(FILE *outfile, struct
list_head*head,
const structprocess_trailer_options*opts);void format_trailers_from_commit(struct strbuf *out, const char *msg,
const structprocess_trailer_options*opts);and previously these functions, although similar enough (even taking the same
process_trailer_optionsstruct pointer), did not build on each other.Make
format_trailers_from_commit()rely onformat_trailers(). Teachformat_trailers()to process trailers with the additionalprocess_trailer_optionsfields likeopts->key_onlywhich is only used byformat_trailers_from_commit()and notbuiltin/interpret-trailers.c. While we're at it, reorder parameters to put the trailer processing options first, and the out parameter (strbuf we write into) at the end.Quoted 3 lines
This unification will allow us to delete the
format_trailer_info()andprint_tok_val()functions in the next patch. They are not deleted here in order to keep the diff small.Unfortunately this breaks the build:
Quoted 8 lines
trailer.c:1145:13: error: ‘format_trailer_info’ defined but not used [-Werror=unused-function]
and
trailer.c:147:13: error: ‘print_tok_val’ defined but not used [-Werror=unused-function]
While separating this patch from the deletion does make it easier to review, it may make bisection more difficult.
FTR I've tried a preview version of squashing the deletion into this patch with "/preview" in GitGitGadget, and it generated a clean-enough diff where the deletions weren't intermixed with additions (maybe it uses the patience diff algorithm). But I didn't squash them for v2 because I was concerned about the range diff becoming even more difficult to read for reviewers.
I'm OK with squashing them for v3, but I'm also not sure that's necessary. For example, during bisection you could use DEVOPTS=no-error (or similar) in config.mak to skip over harmless errors like "unused-function". Personally I'd prefer to keep the patches separate because they started separately on the list.
Ultimately, I don't have a strong opinion on this. Maybe Junio or someone else can cast the tie-breaking vote? To squash or not to squash? I will take lazy consensus to mean "squash" for v3 if no one has objections. Thanks.
PATCH v2 4/10 trailer: delete obsolete formatting functions
In reply to Linus Arver via GitGitGadgetFrom: Linus Arver <[email protected]>
--- trailer.c | 79 ------------------------------------------------------- 1 file changed, 79 deletions(-)
trailer.c +0 -79
@@ -144,24 +144,6 @@ static char last_non_space_char(const char *s)return '\0' ; } -static void print_tok_val (FILE *outfile,const char *tok,const char *val) -{ -char c; - -if (!tok) { -fprintf (outfile,"%s\n" , val); -return ; - } - - c =last_non_space_char (tok); -if (!c) -return ; -if (strchr (separators, c)) -fprintf (outfile,"%s%s\n" , tok, val); -else -fprintf (outfile,"%s%c %s\n" , tok, separators[0 ], val); -} -static struct trailer_item *trailer_from_arg (struct arg_item *arg_tok) {struct trailer_item *new_item =xcalloc (1 ,sizeof (*new_item));
@@ -1142,67 +1124,6 @@ void trailer_info_release(struct trailer_info *info)free (info->trailers); } -static void format_trailer_info (struct strbuf *out, -const struct trailer_info *info, -const char *msg, -const struct process_trailer_options *opts) -{ -size_t origlen = out->len; -size_t i; - -/* If we want the whole block untouched, we can take the fast path. */ -if (!opts->only_trailers && !opts->unfold && !opts->filter && - !opts->separator && !opts->key_only && !opts->value_only && - !opts->key_value_separator) { -strbuf_add (out, msg + info->trailer_block_start, - info->trailer_block_end - info->trailer_block_start); -return ; - } - -for (i =0 ; i < info->trailer_nr; i++) { -char *trailer = info->trailers[i]; -ssize_t separator_pos =find_separator (trailer, separators); - -if (separator_pos >=1 ) { -struct strbuf tok =STRBUF_INIT ; -struct strbuf val =STRBUF_INIT ; - -parse_trailer (&tok, &val,NULL , trailer, separator_pos); -if (!opts->filter || opts->filter (&tok, opts->filter_data)) { -if (opts->unfold) -unfold_value (&val); - -if (opts->separator && out->len != origlen) -strbuf_addbuf (out, opts->separator); -if (!opts->value_only) -strbuf_addbuf (out, &tok); -if (!opts->key_only && !opts->value_only) { -if (opts->key_value_separator) -strbuf_addbuf (out, opts->key_value_separator); -else -strbuf_addstr (out,": " ); - } -if (!opts->key_only) -strbuf_addbuf (out, &val); -if (!opts->separator) -strbuf_addch (out,'\n' ); - } -strbuf_release (&tok); -strbuf_release (&val); - - }else if (!opts->only_trailers) { -if (opts->separator && out->len != origlen) { -strbuf_addbuf (out, opts->separator); - } -strbuf_addstr (out, trailer); -if (opts->separator) { -strbuf_rtrim (out); - } - } - } - -} -void format_trailers_from_commit (const struct process_trailer_options *opts,const char *msg,struct strbuf *out)
Signature · 1 line
gitgitgadget
PATCH v2 5/10 sequencer: use the trailer iterator
In reply to Linus Arver via GitGitGadgetFrom: Linus Arver <[email protected]>
This patch allows for the removal of "trailer_info_get()" from the trailer.h API, which will be in the next patch.
Instead of calling "trailer_info_get()", which is a low-level function in the trailers implementation (trailer.c), call trailer_iterator_advance(), which was specifically designed for public consumption in f0939a0eb1 (trailer: add interface for iterating over commit trailers, 2020-09-27).
Avoiding "trailer_info_get()" means we don't have to worry about options like "no_divider" (relevant for parsing trailers). We also don't have to check for things like "info.trailer_start == info.trailer_end" to see whether there were any trailers (instead we can just check to see whether the iterator advanced at all).
Also, teach the iterator about non-trailer lines, by adding a new field called "raw" to hold both trailer and non-trailer lines. This is necessary because a "trailer block" is a list of trailer lines of at least 25% trailers (see 146245063e (trailer: allow non-trailers in trailer block, 2016-10-21)), such that it may hold non-trailer lines.
--- builtin/shortlog.c | 7 +++++-- sequencer.c | 35 +++++++++++++++-------------------- trailer.c | 17 +++++++++-------- trailer.h | 13 +++++++++++++ 4 files changed, 42 insertions(+), 30 deletions(-)
builtin/shortlog.c +5 -2
@@ -172,7 +172,7 @@ static void insert_records_from_trailers(struct shortlog *log, const char *oneline) {struct trailer_iterator iter; -const char *commit_buffer, *body; +const char *commit_buffer, *body, *value;struct strbuf ident =STRBUF_INIT ;if (!log->trailers.nr)
@@ -190,7 +190,10 @@ static void insert_records_from_trailers(struct shortlog *log,trailer_iterator_init (&iter, body);while (trailer_iterator_advance (&iter)) { -const char *value = iter.val.buf; +if (!iter.is_trailer) +continue ; + + value = iter.val.buf;if (!string_list_has_string (&log->trailers, iter.key.buf))continue ;
sequencer.c +15 -20
@@ -319,37 +319,32 @@ static const char *get_todo_path(const struct replay_opts *opts)static int has_conforming_footer (struct strbuf *sb,struct strbuf *sob,size_t ignore_footer) { -struct process_trailer_options opts =PROCESS_TRAILER_OPTIONS_INIT ; -struct trailer_info info; -size_t i; -int found_sob =0 , found_sob_last =0 ; -char saved_char; - - opts.no_divider =1 ; +struct trailer_iterator iter; +size_t i =0 , found_sob =0 ; +char saved_char = sb->buf[sb->len - ignore_footer];if (ignore_footer) { - saved_char = sb->buf[sb->len - ignore_footer]; sb->buf[sb->len - ignore_footer] ='\0' ; } -trailer_info_get (&info, sb->buf, &opts); +trailer_iterator_init (&iter, sb->buf); +while (trailer_iterator_advance (&iter)) { + i++; +if (sob && + iter.is_trailer && + !strncmp (iter.raw, sob->buf, sob->len)) { + found_sob = i; + } + } +trailer_iterator_release (&iter);if (ignore_footer) sb->buf[sb->len - ignore_footer] = saved_char; -if (info.trailer_block_start == info.trailer_block_end) +if (!i)return 0 ; -for (i =0 ; i < info.trailer_nr; i++) -if (sob && !strncmp (info.trailers[i], sob->buf, sob->len)) { - found_sob =1 ; -if (i == info.trailer_nr -1 ) - found_sob_last =1 ; - } - -trailer_info_release (&info); - -if (found_sob_last) +if (found_sob == i)return 3 ;if (found_sob)return 2 ;
trailer.c +9 -8
@@ -1158,17 +1158,18 @@ void trailer_iterator_init(struct trailer_iterator *iter, const char *msg)int trailer_iterator_advance (struct trailer_iterator *iter) { -while (iter->internal.cur < iter->internal.info.trailer_nr) { -char *trailer = iter->internal.info.trailers[iter->internal.cur++]; -int separator_pos =find_separator (trailer, separators); - -if (separator_pos <1 ) -continue ;/* not a real trailer */ - +char *line; +int separator_pos; +if (iter->internal.cur < iter->internal.info.trailer_nr) { + line = iter->internal.info.trailers[iter->internal.cur++]; + separator_pos =find_separator (line, separators); + iter->is_trailer = (separator_pos >0 ); + + iter->raw = line;strbuf_reset (&iter->key);strbuf_reset (&iter->val);parse_trailer (&iter->key, &iter->val,NULL , - trailer, separator_pos); + line, separator_pos);unfold_value (&iter->val);return 1 ; }
trailer.h +13 -0
@@ -127,6 +127,19 @@ struct trailer_iterator {struct strbuf key;struct strbuf val; +/* +* Raw line (e.g., "foo: bar baz") before being parsed as a trailer +* key/val pair as part of a trailer block. A trailer block can be +* either 100% trailer lines, or mixed in with non-trailer lines (in +* which case at least 25% must be trailer lines). +*/ +const char *raw; + +/* +* 1 if the raw line was parsed as a trailer line (key/val pair). +*/ +int is_trailer; +/* private */ struct {struct trailer_info info;
Signature · 1 line
gitgitgadget
PATCH v2 6/10 trailer: make trailer_info struct private
In reply to Linus Arver via GitGitGadgetFrom: Linus Arver <[email protected]>
In 13211ae23f (trailer: separate public from internal portion of trailer_iterator, 2023-09-09) we moved trailer_info behind an anonymous struct to discourage use by trailer.h API users. However it still left open the possibility of external use of trailer_info itself. Now that there are no external users of trailer_info, we can make this struct private.
Make this struct private by putting its definition inside trailer.c. This has two benefits:
(1) it makes the surface area of the public facing interface (trailer.h) smaller, and
(2) external API users are unable to peer inside this struct (because it is only ever exposed as an opaque pointer).
This change exposes some deficiencies in the API, mainly with regard to information about the location of the trailer block that was parsed. Expose new API functions to access this information (needed by builtin/interpret-trailers.c).
The idea in this patch to hide implementation details behind an "opaque pointer" is also known as the "pimpl" (pointer to implementation) idiom in C++ and is a common pattern in that language (where, for example, abstract classes only have pointers to concrete classes).
However, the original inspiration to use this idiom does not come from C++, but instead the book "C Interfaces and Implementations: Techniques for Creating Reusable Software" [1]. This book recommends opaque pointers as a good design principle for designing C libraries, using the term "interface" as the functions defined in *.h (header) files and "implementation" as the corresponding *.c file which define the interfaces.
The book says this about opaque pointers:
... clients can manipulate such pointers freely, but they can’t dereference them; that is, they can’t look at the innards of the structure pointed to by them. Only the implementation has that privilege. Opaque pointers hide representation details and help catch errors.
In our case, "struct trailer_info" is now hidden from clients, and the ways in which this opaque pointer can be used is limited to the richness of the trailer.h file. In other words, trailer.h exclusively controls exactly how "trailer_info" pointers are to be used.
[1] Hanson, David R. "C Interfaces and Implementations: Techniques for Creating Reusable Software". Addison Wesley, 1997. p. 22
--- builtin/interpret-trailers.c | 13 +-- trailer.c | 154 +++++++++++++++++++++++------------ trailer.h | 37 ++------- 3 files changed, 117 insertions(+), 87 deletions(-)
builtin/interpret-trailers.c +7 -6
@@ -141,7 +141,7 @@ static void interpret_trailers(const struct process_trailer_options *opts,LIST_HEAD (head);struct strbuf sb =STRBUF_INIT ;struct strbuf trailer_block =STRBUF_INIT ; -struct trailer_info info; +struct trailer_info *info;FILE *outfile = stdout;trailer_config_init ();
@@ -151,13 +151,13 @@ static void interpret_trailers(const struct process_trailer_options *opts,if (opts->in_place) outfile =create_in_place_tempfile (file); -parse_trailers (opts, &info, sb.buf, &head); + info =parse_trailers (opts, sb.buf, &head);/* Print the lines before the trailers */ if (!opts->only_trailers) -fwrite (sb.buf,1 , info.trailer_block_start, outfile); +fwrite (sb.buf,1 ,trailer_block_start (info), outfile); -if (!opts->only_trailers && !info.blank_line_before_trailer) +if (!opts->only_trailers && !blank_line_before_trailer_block (info))fprintf (outfile,"\n" );
@@ -176,11 +176,12 @@ static void interpret_trailers(const struct process_trailer_options *opts,strbuf_release (&trailer_block);free_trailers (&head); -trailer_info_release (&info);/* Print the lines after the trailers as is */ if (!opts->only_trailers) -fwrite (sb.buf + info.trailer_block_end,1 , sb.len - info.trailer_block_end, outfile); +fwrite (sb.buf +trailer_block_end (info),1 , sb.len -trailer_block_end (info), outfile); + +trailer_info_release (info);if (opts->in_place)if (rename_tempfile (&trailers_tempfile, file))
trailer.c +101 -53
231 lines not on this page · raw message
trailer.h +9 -28
@@ -4,6 +4,8 @@#include "list.h" #include "strbuf.h" +struct trailer_info ; +enum trailer_where {WHERE_DEFAULT ,WHERE_END ,
@@ -29,27 +31,6 @@ int trailer_set_where(enum trailer_where *item, const char *value);int trailer_set_if_exists (enum trailer_if_exists *item,const char *value);int trailer_set_if_missing (enum trailer_if_missing *item,const char *value); -struct trailer_info { -/* -* True if there is a blank line before the location pointed to by -* trailer_block_start. -*/ -int blank_line_before_trailer; - -/* -* Offsets to the trailer block start and end positions in the input -* string. If no trailer block is found, these are both set to the -* "true" end of the input (find_end_of_log_message()). -*/ -size_t trailer_block_start, trailer_block_end; - -/* -* Array of trailers found. -*/ -char **trailers; -size_t trailer_nr; -}; -/* * A list that represents newly-added trailers, such as those provided * with the --trailer command line option of git-interpret-trailers.
@@ -89,13 +70,13 @@ void parse_trailers_from_command_line_args(struct list_head *arg_head,void process_trailers_lists (struct list_head *head,struct list_head *arg_head); -void parse_trailers (const struct process_trailer_options *opts, -struct trailer_info *info, -const char *str, -struct list_head *head); +struct trailer_info *parse_trailers (const struct process_trailer_options *opts, +const char *str, +struct list_head *head); -void trailer_info_get (struct trailer_info *info,const char *str, -const struct process_trailer_options *opts); +size_t trailer_block_start (struct trailer_info *info); +size_t trailer_block_end (struct trailer_info *info); +int blank_line_before_trailer_block (struct trailer_info *info);void trailer_info_release (struct trailer_info *info);
@@ -142,7 +123,7 @@ struct trailer_iterator {/* private */ struct { -struct trailer_info info; +struct trailer_info *info;size_t cur; } internal; };
Signature · 1 line
gitgitgadget
PATCH v2 7/10 trailer: spread usage of "trailer_block" language
In reply to Linus Arver via GitGitGadgetFrom: Linus Arver <[email protected]>
Deprecate the "trailer_info" struct name and replace it with "trailer_block". The main reason is to help readability, because "trailer_info" on the surface sounds like it's about a single trailer when in reality it is a collection of contiguous lines, at least 25% of which are trailers.
--- builtin/interpret-trailers.c | 26 +++++----- trailer.c | 99 ++++++++++++++++++------------------ trailer.h | 18 +++---- 3 files changed, 71 insertions(+), 72 deletions(-)
builtin/interpret-trailers.c +13 -13
@@ -140,8 +140,8 @@ static void interpret_trailers(const struct process_trailer_options *opts, {LIST_HEAD (head);struct strbuf sb =STRBUF_INIT ; -struct strbuf trailer_block =STRBUF_INIT ; -struct trailer_info *info; +struct strbuf tb =STRBUF_INIT ; +struct trailer_block *trailer_block;FILE *outfile = stdout;trailer_config_init ();
@@ -151,13 +151,13 @@ static void interpret_trailers(const struct process_trailer_options *opts,if (opts->in_place) outfile =create_in_place_tempfile (file); - info =parse_trailers (opts, sb.buf, &head); + trailer_block =parse_trailers (opts, sb.buf, &head); -/* Print the lines before the trailers */ +/* Print the lines before the trailer block */ if (!opts->only_trailers) -fwrite (sb.buf,1 ,trailer_block_start (info), outfile); +fwrite (sb.buf,1 ,trailer_block_start (trailer_block), outfile); -if (!opts->only_trailers && !blank_line_before_trailer_block (info)) +if (!opts->only_trailers && !blank_line_before_trailer_block (trailer_block))fprintf (outfile,"\n" );
@@ -171,17 +171,17 @@ static void interpret_trailers(const struct process_trailer_options *opts, }/* Print trailer block. */ -format_trailers (opts, &head, &trailer_block); -fwrite (trailer_block.buf,1 , trailer_block.len, outfile); -strbuf_release (&trailer_block); +format_trailers (opts, &head, &tb); +fwrite (tb.buf,1 , tb.len, outfile); +strbuf_release (&tb);free_trailers (&head); -/* Print the lines after the trailers as is */ +/* Print the lines after the trailer block as is */ if (!opts->only_trailers) -fwrite (sb.buf +trailer_block_end (info),1 , sb.len -trailer_block_end (info), outfile); - -trailer_info_release (info); +fwrite (sb.buf +trailer_block_end (trailer_block), +1 , sb.len -trailer_block_end (trailer_block), outfile); +trailer_block_release (trailer_block);if (opts->in_place)if (rename_tempfile (&trailers_tempfile, file))
trailer.c +49 -50
198 lines not on this page · raw message
trailer.h +9 -9
@@ -4,7 +4,7 @@#include "list.h" #include "strbuf.h" -struct trailer_info ; +struct trailer_block ;enum trailer_where {WHERE_DEFAULT ,
@@ -70,15 +70,15 @@ void parse_trailers_from_command_line_args(struct list_head *arg_head,void process_trailers_lists (struct list_head *head,struct list_head *arg_head); -struct trailer_info *parse_trailers (const struct process_trailer_options *opts, -const char *str, -struct list_head *head); +struct trailer_block *parse_trailers (const struct process_trailer_options *opts, +const char *str, +struct list_head *head); -size_t trailer_block_start (struct trailer_info *info); -size_t trailer_block_end (struct trailer_info *info); -int blank_line_before_trailer_block (struct trailer_info *info); +size_t trailer_block_start (struct trailer_block *trailer_block); +size_t trailer_block_end (struct trailer_block *trailer_block); +int blank_line_before_trailer_block (struct trailer_block *trailer_block); -void trailer_info_release (struct trailer_info *info); +void trailer_block_release (struct trailer_block *trailer_block);void trailer_config_init (void ); void format_trailers(const struct process_trailer_options *opts,
@@ -123,7 +123,7 @@ struct trailer_iterator {/* private */ struct { -struct trailer_info *info; +struct trailer_block *trailer_block;size_t cur; } internal; };
Signature · 1 line
gitgitgadget
PATCH v2 8/10 trailer: prepare to move parse_trailers_from_command_line_args() to builtin
In reply to Linus Arver via GitGitGadgetFrom: Linus Arver <[email protected]>
Expose more functions in the trailer.h API, in preparation for moving out
parse_trailers_from_command_line_args()
to interpret-trailer.c, because the trailer API should not be concerned with command line arguments (as they have nothing to do with trailers themselves). The interpret-trailers builtin is the only caller of this function.
Also rename "conf_info" to "trailer_conf" for readability, dropping the low-value "_info" suffix as we did earlier in this series for "trailer_info" to "trailer_block".
--- trailer.c | 66 +++++++++++++++++++++++++++---------------------------- trailer.h | 10 +++++++++ 2 files changed, 42 insertions(+), 34 deletions(-)
trailer.c +32 -34
@@ -33,7 +33,7 @@ struct trailer_block {size_t trailer_nr; }; -struct conf_info { +struct trailer_conf {char *name;char *key;char *command;
@@ -43,7 +43,7 @@ struct conf_info {enum trailer_if_missing if_missing; }; -static struct conf_info default_conf_info; +static struct trailer_conf default_trailer_conf;struct trailer_item {struct list_head list;
@@ -59,7 +59,7 @@ struct arg_item {struct list_head list;char *token;char *value; -struct conf_info conf; +struct trailer_conf conf; };static LIST_HEAD (conf_head);
@@ -210,7 +210,7 @@ static int check_if_different(struct trailer_item *in_tok,return 1 ; } -static char *apply_command (struct conf_info *conf,const char *arg) +static char *apply_command (struct trailer_conf *conf,const char *arg) {struct strbuf cmd =STRBUF_INIT ;struct strbuf buf =STRBUF_INIT ;
@@ -424,7 +424,8 @@ int trailer_set_if_missing(enum trailer_if_missing *item, const char *value)return 0 ; } -static void duplicate_conf (struct conf_info *dst,const struct conf_info *src) +void duplicate_trailer_conf (struct trailer_conf *dst, +const struct trailer_conf *src) { *dst = *src; dst->name =xstrdup_or_null (src->name);
@@ -447,7 +448,7 @@ static struct arg_item *get_conf_item(const char *name)/* Item does not already exists, create it */ CALLOC_ARRAY (item,1 ); -duplicate_conf (&item->conf, &default_conf_info); +duplicate_trailer_conf (&item->conf, &default_trailer_conf); item->conf.name =xstrdup (name);list_add_tail (&item->list, &conf_head);
@@ -482,17 +483,17 @@ static int git_trailer_default_config(const char *conf_key, const char *value, variable_name =strrchr (trailer_item,'.' );if (!variable_name) {if (!strcmp (trailer_item,"where" )) { -if (trailer_set_where (&default_conf_info.where, +if (trailer_set_where (&default_trailer_conf.where, value) <0 )warning (_ ("unknown value '%s' for key '%s'" ), value, conf_key); }else if (!strcmp (trailer_item,"ifexists" )) { -if (trailer_set_if_exists (&default_conf_info.if_exists, +if (trailer_set_if_exists (&default_trailer_conf.if_exists, value) <0 )warning (_ ("unknown value '%s' for key '%s'" ), value, conf_key); }else if (!strcmp (trailer_item,"ifmissing" )) { -if (trailer_set_if_missing (&default_conf_info.if_missing, +if (trailer_set_if_missing (&default_trailer_conf.if_missing, value) <0 )warning (_ ("unknown value '%s' for key '%s'" ), value, conf_key);
@@ -511,7 +512,7 @@ static int git_trailer_config(const char *conf_key, const char *value, {const char *trailer_item, *variable_name;struct arg_item *item; -struct conf_info *conf; +struct trailer_conf *conf;char *name =NULL ;enum trailer_info_type type;int i;
@@ -585,9 +586,9 @@ void trailer_config_init(void)return ;/* Default config must be setup first */ - default_conf_info.where =WHERE_END ; - default_conf_info.if_exists =EXISTS_ADD_IF_DIFFERENT_NEIGHBOR ; - default_conf_info.if_missing =MISSING_ADD ; + default_trailer_conf.where =WHERE_END ; + default_trailer_conf.if_exists =EXISTS_ADD_IF_DIFFERENT_NEIGHBOR ; + default_trailer_conf.if_missing =MISSING_ADD ;git_config (git_trailer_default_config,NULL );git_config (git_trailer_config,NULL ); configured =1 ;
@@ -620,7 +621,7 @@ static int token_matches_item(const char *tok, struct arg_item *item, size_t tok* distinguished from the non-well-formed-line case (in which this function * returns -1) because some callers of this function need such a distinction. */ -static ssize_t find_separator (const char *line,const char *separators) +ssize_t find_separator (const char *line,const char *separators) {int whitespace_found =0 ;const char *c;
@@ -645,28 +646,28 @@ static ssize_t find_separator(const char *line, const char *separators)* * If separator_pos is -1, interpret the whole trailer as a token. */ -static void parse_trailer (struct strbuf *tok,struct strbuf *val, -const struct conf_info **conf,const char *trailer, -ssize_t separator_pos) +void parse_trailer (const char *line,ssize_t separator_pos, +struct strbuf *tok,struct strbuf *val, +const struct trailer_conf **conf) {struct arg_item *item;size_t tok_len;struct list_head *pos;if (separator_pos !=-1 ) { -strbuf_add (tok, trailer, separator_pos); +strbuf_add (tok, line, separator_pos);strbuf_trim (tok); -strbuf_addstr (val, trailer + separator_pos +1 ); +strbuf_addstr (val, line + separator_pos +1 );strbuf_trim (val); }else { -strbuf_addstr (tok, trailer); +strbuf_addstr (tok, line);strbuf_trim (tok); }/* Lookup if the token matches something in the config */ tok_len =token_len_without_separator (tok->buf, tok->len);if (conf) - *conf = &default_conf_info; + *conf = &default_trailer_conf;list_for_each (pos, &conf_head) { item = list_entry(pos, struct arg_item, list);if (token_matches_item (tok->buf, item, tok_len)) {
@@ -691,13 +692,13 @@ static struct trailer_item *add_trailer_item(struct list_head *head, char *tok, }static void add_arg_item (struct list_head *arg_head,char *tok,char *val, -const struct conf_info *conf, +const struct trailer_conf *conf,const struct new_trailer_item *new_trailer_item) {struct arg_item *new_item =xcalloc (1 ,sizeof (*new_item)); new_item->token = tok; new_item->value = val; -duplicate_conf (&new_item->conf, conf); +duplicate_trailer_conf (&new_item->conf, conf);if (new_trailer_item) {if (new_trailer_item->where !=WHERE_DEFAULT ) new_item->conf.where = new_trailer_item->where;
@@ -730,7 +731,7 @@ void parse_trailers_from_command_line_args(struct list_head *arg_head, {struct strbuf tok =STRBUF_INIT ;struct strbuf val =STRBUF_INIT ; -const struct conf_info *conf; +const struct trailer_conf *conf;struct list_head *pos;/*
@@ -753,8 +754,7 @@ void parse_trailers_from_command_line_args(struct list_head *arg_head, (int) sb.len, sb.buf);strbuf_release (&sb); }else { -parse_trailer (&tok, &val, &conf, tr->text, - separator_pos); +parse_trailer (tr->text, separator_pos, &tok, &val, &conf); add_arg_item(arg_head, strbuf_detach(&tok, NULL), strbuf_detach(&val, NULL),
@@ -1116,20 +1116,19 @@ struct trailer_block *parse_trailers(const struct process_trailer_options *opts,for (i =0 ; i < trailer_block->trailer_nr; i++) {int separator_pos; -char *trailer = trailer_block->trailers[i]; -if (trailer[0 ] == comment_line_char) +char *line = trailer_block->trailers[i]; +if (line[0 ] == comment_line_char)continue ; - separator_pos =find_separator (trailer, separators); + separator_pos =find_separator (line, separators);if (separator_pos >=1 ) { -parse_trailer (&tok, &val,NULL , trailer, - separator_pos); +parse_trailer (line, separator_pos, &tok, &val,NULL );if (opts->unfold)unfold_value (&val);add_trailer_item (head,strbuf_detach (&tok,NULL ),strbuf_detach (&val,NULL )); }else if (!opts->only_trailers) { -strbuf_addstr (&val, trailer); +strbuf_addstr (&val, line);strbuf_strip_suffix (&val,"\n" ); add_trailer_item(head, NULL,
@@ -1215,8 +1214,7 @@ int trailer_iterator_advance(struct trailer_iterator *iter) iter->raw = line;strbuf_reset (&iter->key);strbuf_reset (&iter->val); -parse_trailer (&iter->key, &iter->val,NULL , - line, separator_pos); +parse_trailer (line, separator_pos, &iter->key, &iter->val,NULL );unfold_value (&iter->val);return 1 ; }
trailer.h +10 -0
@@ -5,6 +5,7 @@#include "strbuf.h" struct trailer_block ; +struct trailer_conf ;enum trailer_where {WHERE_DEFAULT ,
@@ -45,6 +46,9 @@ struct new_trailer_item {enum trailer_if_missing if_missing; }; +void duplicate_trailer_conf (struct trailer_conf *dst, +const struct trailer_conf *src); +struct process_trailer_options {int in_place;int trim_empty;
@@ -70,6 +74,12 @@ void parse_trailers_from_command_line_args(struct list_head *arg_head,void process_trailers_lists (struct list_head *head,struct list_head *arg_head); +ssize_t find_separator (const char *line,const char *separators); + +void parse_trailer (const char *line,ssize_t separator_pos, +struct strbuf *tok,struct strbuf *val, +const struct trailer_conf **conf); +struct trailer_block *parse_trailers (const struct process_trailer_options *opts,const char *str,struct list_head *head);
Signature · 1 line
gitgitgadget
PATCH v2 9/10 trailer: move arg handling to interpret-trailers.c
In reply to Linus Arver via GitGitGadgetFrom: Linus Arver <[email protected]>
We don't move the "arg_item" struct to interpret-trailers.c, because it is now a struct that contains information about trailers that should be injected into the input text's own trailers. We will rename this language as such in a follow-up patch to keep the diff here small.
--- builtin/interpret-trailers.c | 88 ++++++++++++++++++++++-------------- trailer.c | 63 +++++++++++++++++++------- trailer.h | 13 +++++- 3 files changed, 113 insertions(+), 51 deletions(-)
builtin/interpret-trailers.c +55 -33
@@ -45,23 +45,17 @@ static int option_parse_if_missing(const struct option *opt,return trailer_set_if_missing (opt->value, arg); } -static void new_trailers_clear (struct list_head *trailers) -{ -struct list_head *pos, *tmp; -struct new_trailer_item *item; - -list_for_each_safe (pos, tmp, trailers) { - item = list_entry(pos, struct new_trailer_item, list); -list_del (pos); -free (item); - } -} +static char *cl_separators;static int option_parse_trailer (const struct option *opt,const char *arg,int unset) {struct list_head *trailers = opt->value; -struct new_trailer_item *item; +struct strbuf tok =STRBUF_INIT ; +struct strbuf val =STRBUF_INIT ; +const struct trailer_conf *conf; +struct trailer_conf *conf_current =new_trailer_conf (); +ssize_t separator_pos;if (unset) {new_trailers_clear (trailers);
@@ -71,12 +65,31 @@ static int option_parse_trailer(const struct option *opt,if (!arg)return -1 ; - item =xmalloc (sizeof (*item)); - item->text = arg; - item->where = where; - item->if_exists = if_exists; - item->if_missing = if_missing; -list_add_tail (&item->list, trailers); + separator_pos =find_separator (arg, cl_separators); +if (separator_pos) { +parse_trailer (arg, separator_pos, &tok, &val, &conf); +duplicate_trailer_conf (conf_current, conf); + +/* +* Override conf_current with settings specified via CLI flags. +*/ +trailer_conf_set (where, if_exists, if_missing, conf_current); + +add_arg_item (strbuf_detach (&tok,NULL ), +strbuf_detach (&val,NULL ), + conf_current, + trailers); + }else { +struct strbuf sb =STRBUF_INIT ; +strbuf_addstr (&sb, arg); +strbuf_trim (&sb); +error (_ ("empty trailer token in trailer '%.*s'" ), + (int ) sb.len, sb.buf); +strbuf_release (&sb); + } + +free (conf_current); +return 0 ; }
@@ -135,7 +148,7 @@ static void read_input_file(struct strbuf *sb, const char *file) }static void interpret_trailers (const struct process_trailer_options *opts, -struct list_head *new_trailer_head, +struct list_head *arg_trailers,const char *file) {LIST_HEAD (head);
@@ -144,8 +157,6 @@ static void interpret_trailers(const struct process_trailer_options *opts,struct trailer_block *trailer_block;FILE *outfile = stdout; -trailer_config_init (); -read_input_file (&sb, file);if (opts->in_place)
@@ -162,12 +173,7 @@ static void interpret_trailers(const struct process_trailer_options *opts,if (!opts->only_input) { -LIST_HEAD (config_head); -LIST_HEAD (arg_head); -parse_trailers_from_config (&config_head); -parse_trailers_from_command_line_args (&arg_head, new_trailer_head); -list_splice (&config_head, &arg_head); -process_trailers_lists (&head, &arg_head); +process_trailers_lists (&head, arg_trailers); }/* Print trailer block. */
@@ -193,7 +199,8 @@ static void interpret_trailers(const struct process_trailer_options *opts,int cmd_interpret_trailers (int argc,const char **argv,const char *prefix) {struct process_trailer_options opts =PROCESS_TRAILER_OPTIONS_INIT ; -LIST_HEAD (trailers); +LIST_HEAD (configured_trailers); +LIST_HEAD (arg_trailers);struct option options[] = {OPT_BOOL (0 ,"in-place" , &opts.in_place,N_ ("edit files in place" )),
@@ -212,33 +219,48 @@ int cmd_interpret_trailers(int argc, const char **argv, const char *prefix)OPT_CALLBACK_F (0 ,"parse" , &opts,NULL ,N_ ("alias for --only-trailers --only-input --unfold" ),PARSE_OPT_NOARG |PARSE_OPT_NONEG , parse_opt_parse),OPT_BOOL (0 ,"no-divider" , &opts.no_divider,N_ ("do not treat \"---\" as the end of input" )), -OPT_CALLBACK (0 ,"trailer" , &trailers,N_ ("trailer" ), +OPT_CALLBACK (0 ,"trailer" , &arg_trailers,N_ ("trailer" ),N_ ("trailer(s) to add" ), option_parse_trailer),OPT_END () };git_config (git_default_config,NULL ); +trailer_config_init (); + +if (!opts.only_input) { +parse_trailers_from_config (&configured_trailers); + } + +/* +* In command-line arguments, '=' is accepted (in addition to the +* separators that are defined). +*/ + cl_separators =xstrfmt ("=%s" ,default_separators ()); argc =parse_options (argc, argv, prefix, options, git_interpret_trailers_usage,0 ); -if (opts.only_input && !list_empty (&trailers)) +free (cl_separators); + +if (opts.only_input && !list_empty (&arg_trailers))usage_msg_opt (_ ("--trailer with --only-input does not make sense" ), git_interpret_trailers_usage, options); +list_splice (&configured_trailers, &arg_trailers); +if (argc) {int i;for (i =0 ; i < argc; i++) -interpret_trailers (&opts, &trailers, argv[i]); +interpret_trailers (&opts, &arg_trailers, argv[i]); }else {if (opts.in_place)die (_ ("no input file given for in-place editing" )); -interpret_trailers (&opts, &trailers,NULL ); +interpret_trailers (&opts, &arg_trailers,NULL ); } -new_trailers_clear (&trailers); +new_trailers_clear (&arg_trailers);return 0 ; }
trailer.c +46 -17
112 lines not on this page · raw message
trailer.h +12 -1
@@ -46,9 +46,20 @@ struct new_trailer_item {enum trailer_if_missing if_missing; }; +void trailer_conf_set (enum trailer_where where, +enum trailer_if_exists if_exists, +enum trailer_if_missing if_missing, +struct trailer_conf *conf); + +struct trailer_conf *new_trailer_conf (void );void duplicate_trailer_conf (struct trailer_conf *dst,const struct trailer_conf *src); +const char *default_separators (void ); + +void add_arg_item (char *tok,char *val,const struct trailer_conf *conf, +struct list_head *arg_head); +struct process_trailer_options {int in_place;int trim_empty;
@@ -95,7 +106,7 @@ void format_trailers(const struct process_trailer_options *opts,struct list_head *trailers, struct strbuf *out);void free_trailers (struct list_head *trailers); - +void new_trailers_clear (struct list_head *new_trailers);/* * Convenience function to format the trailers from the commit msg "msg" into * the strbuf "out". Reuses format_trailers internally.
Signature · 1 line
gitgitgadget
Re: [PATCH v2 09/10] trailer: move arg handling to interpret-trailers.c
Quoted 11 lines · Linus Arver via GitGitGadget
trailer.h +3
-0@@ -46,9 +46,20 @@ struct new_trailer_item {enum trailer_if_missing if_missing; }; +void trailer_conf_set(enum trailer_where where, + enum trailer_if_exists if_exists, + enum trailer_if_missing if_missing,
trailer.h struct new_trailer_item { · line 61
Quoted 10 lines
trailer.h +7
-0+ struct trailer_conf *conf); + +struct trailer_conf *new_trailer_conf (void );void duplicate_trailer_conf (struct trailer_conf *dst,const struct trailer_conf *src); +const char *default_separators (void ); + +void add_arg_item (char *tok,char *val,const struct trailer_conf *conf, +struct list_head *arg_head);
Looks like I forgot to add a "trailer" keyword for these API functions. Will rename to "trailer_default_separators()" and "trailer_add_arg_item()" in next reroll.
Re: [PATCH v2 09/10] trailer: move arg handling to interpret-trailers.c
In reply to Linus Arver via GitGitGadgetQuoted 6 lines · Linus Arver via GitGitGadget
From: Linus Arver <[email protected]>
We don't move the "
arg_item" struct tointerpret-trailers.c, because it is now a struct that contains information about trailers that should be injected into the input text's own trailers. We will rename this language as such in a follow-up patch to keep the diff here small.
I forgot to add this follow-up patch in this series. That will be patch 11 in v3, which renames "arg_item" to "trailer_template" (the idea being that trailer templates are used to create new trailers, using the template as a guide).
Quoted 9 lines
builtin/interpret-trailers.c +0
-1@@ -45,23 +45,17 @@ static int option_parse_if_missing(const struct option *opt,return trailer_set_if_missing (opt->value, arg); } -static void new_trailers_clear (struct list_head *trailers)
builtin/interpret-trailers.c static int option_parse_if_missing(const struct option *opt, · line 58
Quoted 10 lines
builtin/interpret-trailers.c +0
-10-{ -struct list_head *pos, *tmp; -struct new_trailer_item *item; - -list_for_each_safe (pos, tmp, trailers) { - item = list_entry(pos, struct new_trailer_item, list); -list_del (pos); -free (item); - } -}
This function will also get promoted to the API, and will be renamed to "free_new_trailers()" initially in patch 9, but renamed to "free_trailer_templates()" in patch 11 (we wait until patch 11 to introduce the term "template").
PATCH v2 10/10 trailer: delete obsolete argument handling code from API
In reply to Linus Arver via GitGitGadgetFrom: Linus Arver <[email protected]>
This commit was not squashed with its parent in order to keep the diff separate (to make the additive changes in the parent easier to read).
--- trailer.c | 39 --------------------------------------- trailer.h | 17 ----------------- 2 files changed, 56 deletions(-)
trailer.c +0 -39
@@ -745,45 +745,6 @@ void parse_trailers_from_config(struct list_head *config_head) } } -void parse_trailers_from_command_line_args (struct list_head *arg_head, -struct list_head *new_trailer_head) -{ -struct strbuf tok =STRBUF_INIT ; -struct strbuf val =STRBUF_INIT ; -const struct trailer_conf *conf; -struct list_head *pos; - -/* -* In command-line arguments, '=' is accepted (in addition to the -* separators that are defined). -*/ -char *cl_separators =xstrfmt ("=%s" , separators); - -/* Add an arg item for each trailer on the command line */ -list_for_each (pos, new_trailer_head) { -struct new_trailer_item *tr = - list_entry(pos, struct new_trailer_item, list); -ssize_t separator_pos =find_separator (tr->text, cl_separators); - -if (separator_pos ==0 ) { -struct strbuf sb =STRBUF_INIT ; -strbuf_addstr (&sb, tr->text); -strbuf_trim (&sb); -error (_ ("empty trailer token in trailer '%.*s'" ), - (int ) sb.len, sb.buf); -strbuf_release (&sb); - }else { -parse_trailer (tr->text, separator_pos, &tok, &val, &conf); -add_arg_item (strbuf_detach (&tok,NULL ), -strbuf_detach (&val,NULL ), - conf, - arg_head); - } - } - -free (cl_separators); -} -static const char *next_line (const char *str) {const char *nl =strchrnul (str,'\n' );
trailer.h +0 -17
@@ -32,20 +32,6 @@ int trailer_set_where(enum trailer_where *item, const char *value);int trailer_set_if_exists (enum trailer_if_exists *item,const char *value);int trailer_set_if_missing (enum trailer_if_missing *item,const char *value); -/* -* A list that represents newly-added trailers, such as those provided -* with the --trailer command line option of git-interpret-trailers. -*/ -struct new_trailer_item { -struct list_head list; - -const char *text; - -enum trailer_where where; -enum trailer_if_exists if_exists; -enum trailer_if_missing if_missing; -}; - void trailer_conf_set(enum trailer_where where, enum trailer_if_exists if_exists, enum trailer_if_missing if_missing,
@@ -79,9 +65,6 @@ struct process_trailer_options {void parse_trailers_from_config (struct list_head *config_head); -void parse_trailers_from_command_line_args (struct list_head *arg_head, -struct list_head *new_trailer_head); -void process_trailers_lists (struct list_head *head,struct list_head *arg_head);
Signature · 1 line
gitgitgadget
v3 cover Enrich Trailer API
In reply to Linus Arver via GitGitGadgetThis patch series is the first 10 patches of a larger cleanup/bugfix series (henceforth "larger series") I've been working on. The main goal of this series is to begin the process of "libifying" the trailer API. By "API" I mean the interface exposed in trailer.h. The larger series brings a number of additional cleanups (exposing and fixing some bugs along the way), and builds on top of this series.
When the larger series is merged, we will be in a good state to additionally pursue the following goals:
1. "API reuse inside Git": make the API expressive enough to eliminate any need by other parts of Git to use the interpret-trailers builtin as a subprocess (instead they could just use the API directly);
2. "API stability": add unit tests to codify the expected behavior of API functions; and
3. "API documentation": create developer-focused documentation to explain how to use the API effectively, noting any API limitations or anti-patterns.
The reason why the larger series itself doesn't tackle these goals directly is because I believe that API code should be thought from the ground up with a libification-focused perspective. Some structs and functions exposed in the API today should probably not be libified (read: kept in trailer.h) as is. For example, the "trailer_iterator" struct has a "private" member and it feels wrong to allow API users to peek inside here (and take at face value our future API users' pinky promise that they won't depend on those private internals not meant for public consumption).
One pattern we could use here to cleanly separate "what is the API" (publicly exposed) and "what is the implementation" (private) is the pointer-to-implementation ("pimpl") idiom. There may be other appropriate patterns, but I've chosen this one because it's a simple, low-level concept (put structs in foo.c instead of foo.h), which has far-reaching high-level consequences (API users must rely exclusively on the API to make use of such private structs, via opaque pointers). The pimpl idiom for C comes from the book "C Interfaces and Implementations" (see patch "trailer: make trailer_info struct private").
The idea of turning a public struct into a private one is a fundamental question of libification because it forces us to reconsider all of the data structures we have and how they're actually used by already existing users. For the trailer API, those existing users are the "interpret-trailers" builtin command, and anything else that includes the "trailer.h" header file (e.g., sequencer.c). One advantage of this idiom is that even the compiler understands it --- the compiler will loudly complain if you try to access the innards of a private struct through an opaque pointer.
Another advantage of this idiom is that it helps to reduce the probability of breaking changes in the API. Because a private struct's members are out of view from our users (they only know about opaque pointers to the private struct, not its members), we are free to modify the members of the struct at any time, as much as we like, as long as we don't break the semantics of the exposed API functions (which is why unit-testing these API functions will be crucial long-term).
If this pimpl idiom turns out to be a mistake, undoing it is easy --- just move the relevant struct definition from foo.c to the header file. So it's a great way to try things out without digging ourselves into a pit of despair that will be difficult to get out of.
With the libification-focused goals out of the way, let's turn to this patch series in more detail.
Currently, we have "process_trailers()" in trailer.h which does many different things (parse command-line arguments, create temporary files, etc) that are independent of the concept of "trailers". Keeping this function as an API function would make unit-testing it difficult. While there is no technical reason why we couldn't write unit tests for the smaller functions that are called within process_trailers(), doing so would involve testing private ("static" in trailer.c) functions instead of API functions, which defeats the goal of "API stability" mentioned earlier above.
As an alternative to how things are done in this patch series, we could keep trailer.h intact and decide to unit-test the existing "trailer_info_get()" function which does most of the trailer parsing work (and is used by sequencer.c). However this function wouldn't be easy to test either, because the resulting "trailer_info" struct merely contains the unparsed "trailers" lines. So the unit test (if it wants to inspect the result of parsing these lines) would have to invoke additional parsing functions itself. And at that point it would no longer be a unit test in the traditional sense, because it would be invoking multiple functions at once.
In summary this series breaks up "process_trailers()" into smaller pieces, exposing many of the parts relevant to trailer-related processing in trailer.h. This will force us to eventually introduce unit tests for these API functions, but that is a good thing for API stability.
In the future after libification is "complete", users external to Git will be able to use the same trailer processing API used by the interpret-trailers builtin. For example, a web server may want to parse trailers the same way that Git would parse them, without having to call interpret-trailers as a subprocess. This use case was the original motivation behind my work in this area.
Thanks to the aggressive refactoring in this series, I've been able to identify and fix several bugs in our existing implementation. Those fixes build on top of this series but were not included here, in order to keep this series small. Below is a "shortlog" of those fixes I have locally:
* "trailer: trailer replacement should not change its position" (If we found a trailer we'd like to replace, preserve its position relative to the other trailers found in the trailer block, instead of always moving it to the beginning or end of the entire trailer block.)
* "interpret-trailers: preserve trailers coming from the input" (Sometimes, the parsed trailers from the input will be formatted differently depending on whether we provide --only-trailers or not. Make the trailers that were not modified and which are coming directly from the input get formatted the same way, regardless of this flag.)
* "interpret-trailers: do not modify the input if NOP" (Refrain from subtracting or adding a newline around the patch divider "---" if we are not adding new trailers.)
* "trailer formatter: split up format_trailer() monolith" (Fix a bug in git-log where we still printed a blank newline even if we didn't want to format anything.)
* "interpret-trailers: fail if given unrecognized arguments" (E.g., for "--where", only accept recognized WHERE_* enum values. If we get something unrecognized, fail with an error instead of silently doing nothing. Ditto for "--if-exists" and "--if-missing".)
Notable changes in v3
=====================
* Squashed Patch 4 into Patch 3 ("trailer: unify trailer formatting machinery"), to avoid breaking the build ("-Werror=unused-function" violations)
* NEW (Patch 10): Introduce "trailer template" terminology for readability (no behavioral change)
* (API function) Rename default_separators() to trailer_default_separators()
* (API function) Rename new_trailers_clear() to free_trailer_templates()
* trailer.h: for single-parameter functions, anonymize the parameter name to reduce verbosity
Notable changes in v2
=====================
* (cover letter) Discuss goals of the larger series in more detail, especially the pimpl idiom
* (cover letter) List bug fixes pending in the larger series that depend on this series
* Reorder function parameters to have trailer options at the beginning (and out parameters toward the end)
* "sequencer: use the trailer iterator": prefer C string instead of strbuf for new "raw" field
* Patch 1 (was Patch 2) also renames ensure_configured() to trailer_config_init() (forgot to rename this one previously)
Linus Arver (10):
trailer: prepare to expose functions as part of API
trailer: move interpret_trailers() to interpret-trailers.c
trailer: unify trailer formatting machinery
sequencer: use the trailer iterator
trailer: make trailer_info struct private
trailer: spread usage of "trailer_block" language
trailer: prepare to move parse_trailers_from_command_line_args() to
builtin
trailer: move arg handling to interpret-trailers.c
trailer: delete obsolete argument handling code from API
trailer: introduce "template" term for readability
builtin/interpret-trailers.c | 183 ++++++-- builtin/shortlog.c | 7 +- pretty.c | 2 +- ref-filter.c | 2 +- sequencer.c | 35 +- trailer.c | 835 +++++++++++++++++------------------ trailer.h | 105 +++-- 7 files changed, 631 insertions(+), 538 deletions(-)
base-commit: a54a84b333adbecf7bc4483c0e36ed5878cac17b
Published-As: https://github.com/gitgitgadget/git/releases/tag/pr-1632%2Flistx%2Ftrailer-api-refactor-part-1-v3
Fetch-It-Via: git fetch https://github.com/gitgitgadget/git pr-1632/listx/trailer-api-refactor-part-1-v3
Pull-Request: https://github.com/gitgitgadget/git/pull/1632
Range-diff vs v2:
1: e2d3ed9b5b6 ! 1: 72cc12a3066 trailer: prepare to expose functions as part of API
@@ Commit message
them by their "trailer" moniker, just like all the other functions already exposed by trailer.h.
- The the opportunity to start putting trailer processions options (opts)
+ Take the opportunity to start putting trailer processions options (opts)
as the first parameter. This will be the pattern going forward in this series.
2: eaca39fd7ea ! 2: cafa39d1048 trailer: move interpret_trailers() to interpret-trailers.c
@@ trailer.h: struct process_trailer_options {
+void trailer_config_init(void);
+void format_trailers(const struct process_trailer_options *opts,
+ struct list_head *trailers, FILE *outfile);
-+void free_trailers(struct list_head *trailers);
++void free_trailers(struct list_head *);
+
/*
* Format the trailers from the commit msg "msg" into the strbuf "out".
3: 9b7747d550e ! 3: 5c7a2354df0 trailer: unify trailer formatting machinery
@@ ref-filter.c: static void grab_sub_body_contents(struct atom_value *val, int der
} else if (atom->u.contents.option == C_BARE) ## trailer.c ##
-@@ trailer.c: static void print_tok_val(FILE *outfile, const char *tok, const char *val)
- fprintf(outfile, "%s%c %s\n", tok, separators[0], val);
+@@ trailer.c: static char last_non_space_char(const char *s)
+ return '\0';
}
+-static void print_tok_val(FILE *outfile, const char *tok, const char *val)
+-{
+- char c;
+-
+- if (!tok) {
+- fprintf(outfile, "%s\n", val);
+- return;
+- }
+-
+- c = last_non_space_char(tok);
+- if (!c)
+- return;
+- if (strchr(separators, c))
+- fprintf(outfile, "%s%s\n", tok, val);
+- else
+- fprintf(outfile, "%s%c %s\n", tok, separators[0], val);
+-}
+-
-void format_trailers(const struct process_trailer_options *opts,
- struct list_head *trailers, FILE *outfile)
-{
@@ trailer.c: static void unfold_value(struct strbuf *val)
/*
* Parse trailers in "str", populating the trailer info and "head"
* linked list structure.
-@@ trailer.c: static void format_trailer_info(struct strbuf *out,
-
+@@ trailer.c: void trailer_info_release(struct trailer_info *info)
+ free(info->trailers);
}
--void format_trailers_from_commit(struct strbuf *out, const char *msg,
-- const struct process_trailer_options *opts)
+-static void format_trailer_info(struct strbuf *out,
+- const struct trailer_info *info,
+- const char *msg,
+- const struct process_trailer_options *opts)
+void format_trailers_from_commit(const struct process_trailer_options *opts,
+ const char *msg,
+ struct strbuf *out)
{
+- size_t origlen = out->len;
+- size_t i;
+ LIST_HEAD(head);
- struct trailer_info info;
-
-- trailer_info_get(&info, msg, opts);
-- format_trailer_info(out, &info, msg, opts);
-+ parse_trailers(opts, &info, msg, &head);
++ struct trailer_info info;
+
-+ /* If we want the whole block untouched, we can take the fast path. */
-+ if (!opts->only_trailers && !opts->unfold && !opts->filter &&
-+ !opts->separator && !opts->key_only && !opts->value_only &&
-+ !opts->key_value_separator) {
++ parse_trailers(opts, &info, msg, &head);
+
+ /* If we want the whole block untouched, we can take the fast path. */
+ if (!opts->only_trailers && !opts->unfold && !opts->filter &&
+ !opts->separator && !opts->key_only && !opts->value_only &&
+ !opts->key_value_separator) {
+- strbuf_add(out, msg + info->trailer_block_start,
+- info->trailer_block_end - info->trailer_block_start);
+- return;
+- }
+-
+- for (i = 0; i < info->trailer_nr; i++) {
+- char *trailer = info->trailers[i];
+- ssize_t separator_pos = find_separator(trailer, separators);
+-
+- if (separator_pos >= 1) {
+- struct strbuf tok = STRBUF_INIT;
+- struct strbuf val = STRBUF_INIT;
+-
+- parse_trailer(&tok, &val, NULL, trailer, separator_pos);
+- if (!opts->filter || opts->filter(&tok, opts->filter_data)) {
+- if (opts->unfold)
+- unfold_value(&val);
+-
+- if (opts->separator && out->len != origlen)
+- strbuf_addbuf(out, opts->separator);
+- if (!opts->value_only)
+- strbuf_addbuf(out, &tok);
+- if (!opts->key_only && !opts->value_only) {
+- if (opts->key_value_separator)
+- strbuf_addbuf(out, opts->key_value_separator);
+- else
+- strbuf_addstr(out, ": ");
+- }
+- if (!opts->key_only)
+- strbuf_addbuf(out, &val);
+- if (!opts->separator)
+- strbuf_addch(out, '\n');
+- }
+- strbuf_release(&tok);
+- strbuf_release(&val);
+-
+- } else if (!opts->only_trailers) {
+- if (opts->separator && out->len != origlen) {
+- strbuf_addbuf(out, opts->separator);
+- }
+- strbuf_addstr(out, trailer);
+- if (opts->separator) {
+- strbuf_rtrim(out);
+- }
+- }
+- }
+-
+-}
+-
+-void format_trailers_from_commit(struct strbuf *out, const char *msg,
+- const struct process_trailer_options *opts)
+-{
+- struct trailer_info info;
+ strbuf_add(out, msg + info.trailer_block_start,
+ info.trailer_block_end - info.trailer_block_start);
+ } else
+ format_trailers(opts, &head, out);
-+
+
+- trailer_info_get(&info, msg, opts);
+- format_trailer_info(out, &info, msg, opts);
+ free_trailers(&head);
trailer_info_release(&info);
}
@@ trailer.h: void trailer_info_release(struct trailer_info *info);
- struct list_head *trailers, FILE *outfile);
+ struct list_head *trailers,
+ struct strbuf *out);
- void free_trailers(struct list_head *trailers);
+ void free_trailers(struct list_head *);
/*
- * Format the trailers from the commit msg "msg" into the strbuf "out".
4: f1171f5202f < -: ----------- trailer: delete obsolete formatting functions
5: 5ba842b5005 = 4: bf2b8e1a3c4 sequencer: use the trailer iterator
6: f0ac2f6c4b9 = 5: c19c1dcc592 trailer: make trailer_info struct private
7: 291aa83af55 = 6: 0a9a7438c3f trailer: spread usage of "trailer_block" language
8: 64ee07d0b53 ! 7: 97e5d86ddf0 trailer: prepare to move parse_trailers_from_command_line_args() to builtin @@ Commit message
themselves). The interpret-trailers builtin is the only caller of this function.
- Also rename "conf_info" to "trailer_conf" for readability, dropping the
- low-value "_info" suffix as we did earlier in this series for
- "trailer_info" to "trailer_block".
+ Rename add_arg_item() to trailer_add_arg_item() because it will have to
+ be exposed as an API function in the next patch. Rename
+ new_trailers_clear() to free_new_trailers() because it will be promoted
+ into an API function; the API already has free_trailers(), so using the
+ "free_*" naming style will keep it consistent. Also rename "conf_info"
+ to "trailer_conf" for readability, dropping the low-value "_info" suffix
+ as we did earlier in this series for "trailer_info" to "trailer_block".
+ ## builtin/interpret-trailers.c ##
+@@ builtin/interpret-trailers.c: static int option_parse_if_missing(const struct option *opt,
+ return trailer_set_if_missing(opt->value, arg);
+ }
+
+-static void new_trailers_clear(struct list_head *trailers)
++static void free_new_trailers(struct list_head *trailers)
+ {
+ struct list_head *pos, *tmp;
+ struct new_trailer_item *item;
+@@ builtin/interpret-trailers.c: static int option_parse_trailer(const struct option *opt,
+ struct new_trailer_item *item;
+
+ if (unset) {
+- new_trailers_clear(trailers);
++ free_new_trailers(trailers);
+ return 0;
+ }
+
+@@ builtin/interpret-trailers.c: int cmd_interpret_trailers(int argc, const char **argv, const char *prefix)
+ interpret_trailers(&opts, &trailers, NULL);
+ }
+
+- new_trailers_clear(&trailers);
++ free_new_trailers(&trailers);
+
+ return 0;
+ }
+
## trailer.c ##
@@ trailer.c: struct trailer_block {
size_t trailer_nr;
@@ trailer.c: static ssize_t find_separator(const char *line, const char *separator
item = list_entry(pos, struct arg_item, list);
if (token_matches_item(tok->buf, item, tok_len)) {
@@ trailer.c: static struct trailer_item *add_trailer_item(struct list_head *head, char *tok,
+ return new_item;
}
- static void add_arg_item(struct list_head *arg_head, char *tok, char *val, +-static void add_arg_item(struct list_head *arg_head, char *tok, char *val,
- const struct conf_info *conf,
-+ const struct trailer_conf *conf,
- const struct new_trailer_item *new_trailer_item)
+- const struct new_trailer_item *new_trailer_item)
++static void trailer_add_arg_item(struct list_head *arg_head, char *tok, char *val,
++ const struct trailer_conf *conf,
++ const struct new_trailer_item *new_trailer_item)
{
struct arg_item *new_item = xcalloc(1, sizeof(*new_item));
new_item->token = tok;
@@ trailer.c: static struct trailer_item *add_trailer_item(struct list_head *head,
if (new_trailer_item) {
if (new_trailer_item->where != WHERE_DEFAULT)
new_item->conf.where = new_trailer_item->where;
+@@ trailer.c: void parse_trailers_from_config(struct list_head *config_head)
+ list_for_each(pos, &conf_head) {
+ item = list_entry(pos, struct arg_item, list);
+ if (item->conf.command)
+- add_arg_item(config_head,
+- xstrdup(token_from_item(item, NULL)),
+- xstrdup(""),
+- &item->conf, NULL);
++ trailer_add_arg_item(config_head,
++ xstrdup(token_from_item(item, NULL)),
++ xstrdup(""),
++ &item->conf, NULL);
+ }
+ }
+
@@ trailer.c: void parse_trailers_from_command_line_args(struct list_head *arg_head,
{
struct strbuf tok = STRBUF_INIT;
@@ trailer.c: void parse_trailers_from_command_line_args(struct list_head *arg_head
} else {
- parse_trailer(&tok, &val, &conf, tr->text,
- separator_pos);
+- add_arg_item(arg_head,
+- strbuf_detach(&tok, NULL),
+- strbuf_detach(&val, NULL),
+- conf, tr);
+ parse_trailer(tr->text, separator_pos, &tok, &val, &conf);
- add_arg_item(arg_head,
- strbuf_detach(&tok, NULL),
- strbuf_detach(&val, NULL),
++ trailer_add_arg_item(arg_head,
++ strbuf_detach(&tok, NULL),
++ strbuf_detach(&val, NULL),
++ conf, tr);
+ }
+ }
+
@@ trailer.c: struct trailer_block *parse_trailers(const struct process_trailer_options *opts,
for (i = 0; i < trailer_block->trailer_nr; i++) {
9: 1b4bdde65bc ! 8: 465dc51cdcb trailer: move arg handling to interpret-trailers.c
@@ Commit message
trailer: move arg handling to interpret-trailers.c
We don't move the "arg_item" struct to interpret-trailers.c, because it
- is now a struct that contains information about trailers that should be
- injected into the input text's own trailers. We will rename this
- language as such in a follow-up patch to keep the diff here small.
+ is now a struct that contains information about trailers that could be
+ added into the input text's own trailers. This is a generic concept that
+ extends beyond trailers defined as CLI arguments (it applies to trailers
+ defined in configuration as well). We will rename "arg_item" to
+ "trailer_template" in a follow-up patch to keep the diff here small.
Signed-off-by: Linus Arver <[email protected]>
@@ builtin/interpret-trailers.c: static int option_parse_if_missing(const struct op
return trailer_set_if_missing(opt->value, arg);
}
--static void new_trailers_clear(struct list_head *trailers)
+-static void free_new_trailers(struct list_head *trailers)
-{
- struct list_head *pos, *tmp;
- struct new_trailer_item *item;
@@ builtin/interpret-trailers.c: static int option_parse_if_missing(const struct op
+ ssize_t separator_pos;
if (unset) {
- new_trailers_clear(trailers);
+ free_new_trailers(trailers);
@@ builtin/interpret-trailers.c: static int option_parse_trailer(const struct option *opt,
if (!arg)
return -1;
@@ builtin/interpret-trailers.c: static int option_parse_trailer(const struct optio
+ */
+ trailer_conf_set(where, if_exists, if_missing, conf_current);
+
-+ add_arg_item(strbuf_detach(&tok, NULL),
-+ strbuf_detach(&val, NULL),
-+ conf_current,
-+ trailers);
++ trailer_add_arg_item(strbuf_detach(&tok, NULL),
++ strbuf_detach(&val, NULL),
++ conf_current,
++ trailers);
+ } else {
+ struct strbuf sb = STRBUF_INIT;
+ strbuf_addstr(&sb, arg);
@@ builtin/interpret-trailers.c: int cmd_interpret_trailers(int argc, const char **
+ * In command-line arguments, '=' is accepted (in addition to the
+ * separators that are defined).
+ */
-+ cl_separators = xstrfmt("=%s", default_separators());
++ cl_separators = xstrfmt("=%s", trailer_default_separators());
argc = parse_options(argc, argv, prefix, options,
git_interpret_trailers_usage, 0);
@@ builtin/interpret-trailers.c: int cmd_interpret_trailers(int argc, const char **
+ interpret_trailers(&opts, &arg_trailers, NULL);
}
-- new_trailers_clear(&trailers);
-+ new_trailers_clear(&arg_trailers);
+- free_new_trailers(&trailers);
++ free_new_trailers(&arg_trailers);
return 0;
}
@@ trailer.c: static LIST_HEAD(conf_head);
static char *separators = ":";
-+const char *default_separators(void)
++const char *trailer_default_separators(void)
+{
+ return separators;
+}
@@ trailer.c: ssize_t find_separator(const char *line, const char *separators)
* Obtain the token, value, and conf from the given trailer.
*
+ * The conf needs special handling. We first read hardcoded defaults, and
-+ * override them if we find a matching trailer configuration in the config.
++ * override them if we find a matching trailer configuration.
+ *
* separator_pos must not be 0, since the token cannot be an empty string.
*
@@ trailer.c: static struct trailer_item *add_trailer_item(struct list_head *head,
return new_item;
}
--static void add_arg_item(struct list_head *arg_head, char *tok, char *val,
-- const struct trailer_conf *conf,
-- const struct new_trailer_item *new_trailer_item)
-+void add_arg_item(char *tok, char *val, const struct trailer_conf *conf,
-+ struct list_head *arg_head)
-+
+-static void trailer_add_arg_item(struct list_head *arg_head, char *tok, char *val,
+- const struct trailer_conf *conf,
+- const struct new_trailer_item *new_trailer_item)
++void trailer_add_arg_item(char *tok, char *val, const struct trailer_conf *conf,
++ struct list_head *arg_head)
{
struct arg_item *new_item = xcalloc(1, sizeof(*new_item));
new_item->token = tok;
@@ trailer.c: void parse_trailers_from_config(struct list_head *config_head)
list_for_each(pos, &conf_head) {
item = list_entry(pos, struct arg_item, list);
if (item->conf.command)
-- add_arg_item(config_head,
-- xstrdup(token_from_item(item, NULL)),
-+ add_arg_item(xstrdup(token_from_item(item, NULL)),
- xstrdup(""),
-- &item->conf, NULL);
-+ &item->conf,
-+ config_head);
+- trailer_add_arg_item(config_head,
+- xstrdup(token_from_item(item, NULL)),
++ trailer_add_arg_item(xstrdup(token_from_item(item, NULL)),
+ xstrdup(""),
+- &item->conf, NULL);
++ &item->conf,
++ config_head);
}
}
@@ trailer.c: void parse_trailers_from_command_line_args(struct list_head *arg_head
strbuf_release(&sb);
} else {
parse_trailer(tr->text, separator_pos, &tok, &val, &conf);
-- add_arg_item(arg_head,
-- strbuf_detach(&tok, NULL),
-+ add_arg_item(strbuf_detach(&tok, NULL),
- strbuf_detach(&val, NULL),
-- conf, tr);
-+ conf,
-+ arg_head);
+- trailer_add_arg_item(arg_head,
+- strbuf_detach(&tok, NULL),
++ trailer_add_arg_item(strbuf_detach(&tok, NULL),
+ strbuf_detach(&val, NULL),
+- conf, tr);
++ conf,
++ arg_head);
}
}
@@ trailer.c: void free_trailers(struct list_head *trailers)
}
}
-+void new_trailers_clear(struct list_head *trailers)
++void free_new_trailers(struct list_head *trailers)
+{
+ struct list_head *pos, *p;
+
@@ trailer.h: struct new_trailer_item {
void duplicate_trailer_conf(struct trailer_conf *dst,
const struct trailer_conf *src);
-+const char *default_separators(void);
++const char *trailer_default_separators(void);
+
-+void add_arg_item(char *tok, char *val, const struct trailer_conf *conf,
-+ struct list_head *arg_head);
++void trailer_add_arg_item(char *tok, char *val, const struct trailer_conf *conf,
++ struct list_head *arg_head);
+
struct process_trailer_options {
int in_place;
@@ trailer.h: struct new_trailer_item {
@@ trailer.h: void format_trailers(const struct process_trailer_options *opts,
struct list_head *trailers,
struct strbuf *out);
- void free_trailers(struct list_head *trailers);
--
-+void new_trailers_clear(struct list_head *new_trailers);
+ void free_trailers(struct list_head *);
++void free_new_trailers(struct list_head *);
+
/*
* Convenience function to format the trailers from the commit msg "msg" into
- * the strbuf "out". Reuses format_trailers internally.
10: ed67ebf8647 ! 9: 885ac87a544 trailer: delete obsolete argument handling code from API
@@ Commit message
This commit was not squashed with its parent in order to keep the diff
separate (to make the additive changes in the parent easier to read).
+ Note that we remove the "new_trailer_item" struct, because it has some
+ overlap with "arg_item" struct that also deals with trailers coming from
+ the command line. The latter will be renamed to "trailer_template" in
+ the next patch.
+
Signed-off-by: Linus Arver <[email protected]>
## trailer.c ##
@@ trailer.c: void parse_trailers_from_config(struct list_head *config_head)
- strbuf_release(&sb);
- } else {
- parse_trailer(tr->text, separator_pos, &tok, &val, &conf);
-- add_arg_item(strbuf_detach(&tok, NULL),
-- strbuf_detach(&val, NULL),
-- conf,
-- arg_head);
+- trailer_add_arg_item(strbuf_detach(&tok, NULL),
+- strbuf_detach(&val, NULL),
+- conf,
+- arg_head);
- }
- }
- -: ----------- > 10: bcd3fc9660e trailer: introduce "template" term for readability
Signature · 1 line
gitgitgadget
PATCH v3 1/10 trailer: prepare to expose functions as part of API
From: Linus Arver <[email protected]>
In the next patch, we will move "process_trailers" from trailer.c to builtin/interpret-trailers.c. That move will necessitate the growth of the trailer.h API, forcing us to expose some additional functions in trailer.h.
Rename relevant functions so that they include the term "trailer" in their name, so that clients of the API will be able to easily identify them by their "trailer" moniker, just like all the other functions already exposed by trailer.h.
Take the opportunity to start putting trailer processions options (opts) as the first parameter. This will be the pattern going forward in this series.
--- builtin/interpret-trailers.c | 4 ++-- trailer.c | 26 +++++++++++++------------- trailer.h | 6 +++--- 3 files changed, 18 insertions(+), 18 deletions(-)
builtin/interpret-trailers.c +2 -2
@@ -132,11 +132,11 @@ int cmd_interpret_trailers(int argc, const char **argv, const char *prefix)if (argc) {int i;for (i =0 ; i < argc; i++) -process_trailers (argv[i], &opts, &trailers); +interpret_trailers (&opts, &trailers, argv[i]); }else {if (opts.in_place)die (_ ("no input file given for in-place editing" )); -process_trailers (NULL , &opts, &trailers); +interpret_trailers (&opts, &trailers,NULL ); }new_trailers_clear (&trailers);
trailer.c +13 -13
@@ -163,12 +163,12 @@ static void print_tok_val(FILE *outfile, const char *tok, const char *val)fprintf (outfile,"%s%c %s\n" , tok, separators[0 ], val); } -static void print_all (FILE *outfile,struct list_head *head, -const struct process_trailer_options *opts) +static void format_trailers (const struct process_trailer_options *opts, +struct list_head *trailers,FILE *outfile) {struct list_head *pos;struct trailer_item *item; -list_for_each (pos, head) { +list_for_each (pos, trailers) { item = list_entry(pos, struct trailer_item, list);if ((!opts->trim_empty ||strlen (item->value) >0 ) && (!opts->only_trailers || item->token))
@@ -589,7 +589,7 @@ static int git_trailer_config(const char *conf_key, const char *value,return 0 ; } -static void ensure_configured (void ) +static void trailer_config_init (void ) {if (configured)return ;
@@ -1035,10 +1035,10 @@ static void parse_trailers(struct trailer_info *info, } } -static void free_all (struct list_head *head) +static void free_trailers (struct list_head *trailers) {struct list_head *pos, *p; -list_for_each_safe (pos, p, head) { +list_for_each_safe (pos, p, trailers) {list_del (pos);free_trailer_item (list_entry(pos ,struct trailer_item ,list )); }
@@ -1075,16 +1075,16 @@ static FILE *create_in_place_tempfile(const char *file)return outfile; } -void process_trailers (const char *file, -const struct process_trailer_options *opts, -struct list_head *new_trailer_head) +void interpret_trailers (const struct process_trailer_options *opts, +struct list_head *new_trailer_head, +const char *file) {LIST_HEAD (head);struct strbuf sb =STRBUF_INIT ;struct trailer_info info;FILE *outfile = stdout; -ensure_configured (); +trailer_config_init ();read_input_file (&sb, file);
@@ -1110,9 +1110,9 @@ void process_trailers(const char *file,process_trailers_lists (&head, &arg_head); } -print_all (outfile, &head, opts); +format_trailers (opts, &head, outfile); -free_all (&head); +free_trailers (&head);trailer_info_release (&info);/* Print the lines after the trailers as is */
@@ -1135,7 +1135,7 @@ void trailer_info_get(struct trailer_info *info, const char *str,size_t nr =0 , alloc =0 ;char **last =NULL ; -ensure_configured (); +trailer_config_init (); end_of_log_message =find_end_of_log_message (str, opts->no_divider); trailer_block_start =find_trailer_block_start (str, end_of_log_message);
trailer.h +3 -3
@@ -81,9 +81,9 @@ struct process_trailer_options {#define PROCESS_TRAILER_OPTIONS_INIT {0} -void process_trailers (const char *file, -const struct process_trailer_options *opts, -struct list_head *new_trailer_head); +void interpret_trailers (const struct process_trailer_options *opts, +struct list_head *new_trailer_head, +const char *file);void trailer_info_get (struct trailer_info *info,const char *str,const struct process_trailer_options *opts);
Signature · 1 line
gitgitgadget
PATCH v3 2/10 trailer: move interpret_trailers() to interpret-trailers.c
In reply to Linus Arver via GitGitGadgetFrom: Linus Arver <[email protected]>
The interpret-trailers.c builtin is the only place we need to call interpret_trailers(), so move its definition there.
Delete the corresponding declaration from trailer.h, which then forces us to expose the working innards of that function. This enriches trailer.h with a more granular API, which can then be unit-tested in the future (because interpret_trailers() by itself does too many things to be able to be easily unit-tested).
Take this opportunity to demote some file-handling functions out of the trailer API implementation, as these have nothing to do with trailers.
--- builtin/interpret-trailers.c | 94 +++++++++++++++++++++++++++ trailer.c | 120 ++++------------------------------- trailer.h | 20 +++++- 3 files changed, 124 insertions(+), 110 deletions(-)
builtin/interpret-trailers.c +94 -0
@@ -9,6 +9,7 @@#include "gettext.h" #include "parse-options.h" #include "string-list.h" +#include "tempfile.h" #include "trailer.h" #include "config.h"
@@ -91,6 +92,99 @@ static int parse_opt_parse(const struct option *opt, const char *arg,return 0 ; } +static struct tempfile *trailers_tempfile; + +static FILE *create_in_place_tempfile (const char *file) +{ +struct stat st; +struct strbuf filename_template =STRBUF_INIT ; +const char *tail; +FILE *outfile; + +if (stat (file, &st)) +die_errno (_ ("could not stat %s" ), file); +if (!S_ISREG (st.st_mode)) +die (_ ("file %s is not a regular file" ), file); +if (!(st.st_mode &S_IWUSR )) +die (_ ("file %s is not writable by user" ), file); + +/* Create temporary file in the same directory as the original */ + tail =strrchr (file,'/' ); +if (tail) +strbuf_add (&filename_template, file, tail - file +1 ); +strbuf_addstr (&filename_template,"git-interpret-trailers-XXXXXX" ); + + trailers_tempfile =xmks_tempfile_m (filename_template.buf, st.st_mode); +strbuf_release (&filename_template); + outfile =fdopen_tempfile (trailers_tempfile,"w" ); +if (!outfile) +die_errno (_ ("could not open temporary file" )); + +return outfile; +} + +static void read_input_file (struct strbuf *sb,const char *file) +{ +if (file) { +if (strbuf_read_file (sb, file,0 ) <0 ) +die_errno (_ ("could not read input file '%s'" ), file); + }else { +if (strbuf_read (sb,fileno (stdin),0 ) <0 ) +die_errno (_ ("could not read from stdin" )); + } +} + +static void interpret_trailers (const struct process_trailer_options *opts, +struct list_head *new_trailer_head, +const char *file) +{ +LIST_HEAD (head); +struct strbuf sb =STRBUF_INIT ; +struct trailer_info info; +FILE *outfile = stdout; + +trailer_config_init (); + +read_input_file (&sb, file); + +if (opts->in_place) + outfile =create_in_place_tempfile (file); + +parse_trailers (opts, &info, sb.buf, &head); + +/* Print the lines before the trailers */ +if (!opts->only_trailers) +fwrite (sb.buf,1 , info.trailer_block_start, outfile); + +if (!opts->only_trailers && !info.blank_line_before_trailer) +fprintf (outfile,"\n" ); + + +if (!opts->only_input) { +LIST_HEAD (config_head); +LIST_HEAD (arg_head); +parse_trailers_from_config (&config_head); +parse_trailers_from_command_line_args (&arg_head, new_trailer_head); +list_splice (&config_head, &arg_head); +process_trailers_lists (&head, &arg_head); + } + +format_trailers (opts, &head, outfile); + +free_trailers (&head); +trailer_info_release (&info); + +/* Print the lines after the trailers as is */ +if (!opts->only_trailers) +fwrite (sb.buf + info.trailer_block_end,1 , sb.len - info.trailer_block_end, outfile); + +if (opts->in_place) +if (rename_tempfile (&trailers_tempfile, file)) +die_errno (_ ("could not rename temporary file to %s" ), file); + +strbuf_release (&sb); +} +int cmd_interpret_trailers (int argc,const char **argv,const char *prefix) {struct process_trailer_options opts =PROCESS_TRAILER_OPTIONS_INIT ;
trailer.c +13 -107
180 lines not on this page · raw message
trailer.h +17 -3
@@ -81,15 +81,29 @@ struct process_trailer_options {#define PROCESS_TRAILER_OPTIONS_INIT {0} -void interpret_trailers (const struct process_trailer_options *opts, -struct list_head *new_trailer_head, -const char *file); +void parse_trailers_from_config (struct list_head *config_head); + +void parse_trailers_from_command_line_args (struct list_head *arg_head, +struct list_head *new_trailer_head); + +void process_trailers_lists (struct list_head *head, +struct list_head *arg_head); + +void parse_trailers (const struct process_trailer_options *opts, +struct trailer_info *info, +const char *str, +struct list_head *head);void trailer_info_get (struct trailer_info *info,const char *str,const struct process_trailer_options *opts);void trailer_info_release (struct trailer_info *info); +void trailer_config_init (void ); +void format_trailers (const struct process_trailer_options *opts, +struct list_head *trailers,FILE *outfile); +void free_trailers (struct list_head *); +/* * Format the trailers from the commit msg "msg" into the strbuf "out". * Note two caveats about "opts":
Signature · 1 line
gitgitgadget
Re: [PATCH v3 02/10] trailer: move interpret_trailers() to interpret-trailers.c
Quoted 4 lines · Linus Arver via GitGitGadget
From: Linus Arver <[email protected]>
The
interpret-trailers.cbuiltin is the only place we need to callinterpret_trailers(), so move its definition there.
A few helper functions that are only called by interpret_trailers() are also moved, naturally. I would have less surprised to see the addtion near the beginning of builtin/interpret-trailers.c if this part said:
..., so move its definition there, together with a few helper functions called only by it, and remove its external declaration from <trailer.h>.
Quoted 2 lines
Delete the corresponding declaration from
trailer.h, which then forces us to expose the working innards of that function.
This was a bit confusing, at least to me. The reason why several other helper functions that are called by interpret_trailers() need to be declared in trailer.h is not because the declaration of interpret_trailers() is deleted from trailer.h but that is how I read the above.
Several helper functions that are called by interpret_trailers() remain in trailer.c because other callers in the same file still call them, so add declaration for them to <trailer.h>.
Quoted 5 lines
This enriches
trailer.hwith a more granular API, which can then be unit-tested in the future (becauseinterpret_trailers()by itself does too many things to be able to be easily unit-tested).
Quoted 8 lines
Take this opportunity to demote some file-handling functions out of the trailer API implementation, as these have nothing to do with trailers.
Signed-off-by Linus Arver <[email protected]>--- builtin/interpret-trailers.c | 94 +++++++++++++++++++++++++++ trailer.c | 120 ++++------------------------------- trailer.h | 20 +++++-
Together with the preparatory renaming in the previous step, this made quite a pleasant read. Thanks.
Re: [PATCH v3 02/10] trailer: move interpret_trailers() to interpret-trailers.c
Quoted 7 lines · Junio C Hamano
Quoted 4 lines · Linus Arver via GitGitGadget
From: Linus Arver <[email protected]>
The
interpret-trailers.cbuiltin is the only place we need to callinterpret_trailers(), so move its definition there.
Quoted 8 lines
A few helper functions that are only called by
interpret_trailers()are also moved, naturally. I would have less surprised to see the addtion near the beginning ofbuiltin/interpret-trailers.cif this part said:..., so move its definition there, together with a few helper functions called only by it, and remove its external declaration from <
trailer.h>.
Will add in next reroll.
Quoted 9 lines
Quoted 2 lines
Delete the corresponding declaration from
trailer.h, which then forces us to expose the working innards of that function.This was a bit confusing, at least to me. The reason why several other helper functions that are called by
interpret_trailers()need to be declared intrailer.his not because the declaration ofinterpret_trailers()is deleted fromtrailer.hbut that is how I read the above.
Quoted 3 lines
Several helper functions that are called by
interpret_trailers()remain intrailer.cbecause other callers in the same file still call them, so add declaration for them to <trailer.h>.
I've adopted most of this language in the next reroll to make the reasoning a bit easier to follow. Thanks.
PATCH v3 3/10 trailer: unify trailer formatting machinery
In reply to Linus Arver via GitGitGadgetFrom: Linus Arver <[email protected]>
Currently have two functions for formatting trailers exposed in trailer.h:
void format_trailers(FILE *outfile, struct list_head *head,
const struct process_trailer_options *opts);
void format_trailers_from_commit(struct strbuf *out, const char *msg,
const struct process_trailer_options *opts);
and previously these functions, although similar enough (even taking the same process_trailer_options struct pointer), did not build on each other.
Make format_trailers_from_commit() rely on format_trailers(). Teach format_trailers() to process trailers with the additional process_trailer_options fields like opts->key_only which is only used by format_trailers_from_commit() and not builtin/interpret-trailers.c. While we're at it, reorder parameters to put the trailer processing options first, and the out parameter (strbuf we write into) at the end.
This unification will allow us to delete the format_trailer_info() and print_tok_val() functions in the next patch. They are not deleted here in order to keep the diff small.
--- builtin/interpret-trailers.c | 6 +- pretty.c | 2 +- ref-filter.c | 2 +- trailer.c | 176 +++++++++++++++++------------------ trailer.h | 19 ++-- 5 files changed, 98 insertions(+), 107 deletions(-)
builtin/interpret-trailers.c +5 -1
@@ -140,6 +140,7 @@ static void interpret_trailers(const struct process_trailer_options *opts, {LIST_HEAD (head);struct strbuf sb =STRBUF_INIT ; +struct strbuf trailer_block =STRBUF_INIT ;struct trailer_info info;FILE *outfile = stdout;
@@ -169,7 +170,10 @@ static void interpret_trailers(const struct process_trailer_options *opts,process_trailers_lists (&head, &arg_head); } -format_trailers (opts, &head, outfile); +/* Print trailer block. */ +format_trailers (opts, &head, &trailer_block); +fwrite (trailer_block.buf,1 , trailer_block.len, outfile); +strbuf_release (&trailer_block);free_trailers (&head);trailer_info_release (&info);
pretty.c +1 -1
@@ -1759,7 +1759,7 @@ static size_t format_commit_one(struct strbuf *sb, /* in UTF-8 */ goto trailer_out; }if (*arg ==')' ) { -format_trailers_from_commit (sb, msg + c->subject_off, &opts); +format_trailers_from_commit (&opts, msg + c->subject_off, sb); ret = arg - placeholder +1 ; } trailer_out:
ref-filter.c +1 -1
@@ -1985,7 +1985,7 @@ static void grab_sub_body_contents(struct atom_value *val, int deref, struct expstruct strbuf s =STRBUF_INIT ;/* Format the trailer info according to the trailer_opts given */ -format_trailers_from_commit (&s, subpos, &atom->u.contents.trailer_opts); +format_trailers_from_commit (&atom->u.contents.trailer_opts, subpos, &s); v->s =strbuf_detach (&s,NULL ); }else if (atom->u.contents.option ==C_BARE )
trailer.c +84 -92
201 lines not on this page · raw message
trailer.h +7 -12
@@ -101,22 +101,17 @@ void trailer_info_release(struct trailer_info *info);void trailer_config_init (void );void format_trailers (const struct process_trailer_options *opts, -struct list_head *trailers,FILE *outfile); +struct list_head *trailers, +struct strbuf *out);void free_trailers (struct list_head *);/* -* Format the trailers from the commit msg "msg" into the strbuf "out". -* Note two caveats about "opts": -* -* - this is primarily a helper for pretty.c, and not -* all of the flags are supported. -* -* - this differs from process_trailers slightly in that we always format -* only the trailer block itself, even if the "only_trailers" option is not -* set. +* Convenience function to format the trailers from the commit msg "msg" into +* the strbuf "out". Reuses format_trailers internally. */ -void format_trailers_from_commit (struct strbuf *out,const char *msg, -const struct process_trailer_options *opts); +void format_trailers_from_commit (const struct process_trailer_options *opts, +const char *msg, +struct strbuf *out);/* * An interface for iterating over the trailers found in a particular commit
Signature · 1 line
gitgitgadget
Re: [PATCH v3 03/10] trailer: unify trailer formatting machinery
Quoted 3 lines · Linus Arver via GitGitGadget
This unification will allow us to delete the
format_trailer_info()andprint_tok_val()functions in the next patch. They are not deleted here in order to keep the diff small.
Needs to be removed after squashing v2 patch 4 :)
Re: [PATCH v3 03/10] trailer: unify trailer formatting machinery
Quoted 6 lines · Josh Steadmon
Quoted 3 lines · Linus Arver via GitGitGadget
This unification will allow us to delete the
format_trailer_info()andprint_tok_val()functions in the next patch. They are not deleted here in order to keep the diff small.Needs to be removed after squashing v2 patch 4 :)
Oops. Will update in next reroll, thanks.
Re: [PATCH v3 03/10] trailer: unify trailer formatting machinery
Quoted 10 lines · Linus Arver
Quoted 6 lines · Josh Steadmon
Quoted 3 lines · Linus Arver via GitGitGadget
This unification will allow us to delete the
format_trailer_info()andprint_tok_val()functions in the next patch. They are not deleted here in order to keep the diff small.Needs to be removed after squashing v2 patch 4 :)
Oops. Will update in next reroll, thanks.
FWIW, by the way, having them in the same patch made it a lot easier to compare what the original did (with these removed functions) and what the updated code would do. When a change is supposed to be a clean-up of an existing code without changing the behaviour, it helps to make the before and after versions visible in the patch.
Thanks.
Re: [PATCH v3 03/10] trailer: unify trailer formatting machinery
Quoted 13 lines · Junio C Hamano
Quoted 10 lines · Linus Arver
Quoted 6 lines · Josh Steadmon
Quoted 3 lines · Linus Arver via GitGitGadget
This unification will allow us to delete the
format_trailer_info()andprint_tok_val()functions in the next patch. They are not deleted here in order to keep the diff small.Needs to be removed after squashing v2 patch 4 :)
Oops. Will update in next reroll, thanks.
Quoted 7 lines
FWIW, by the way, having them in the same patch made it a lot easier to compare what the original did (with these removed functions) and what the updated code would do. When a change is supposed to be a clean-up of an existing code without changing the behaviour, it helps to make the before and after versions visible in the patch.
Thanks.
Ack, will try to keep that in mind.
Re: [PATCH v3 03/10] trailer: unify trailer formatting machinery
In reply to Linus Arver via GitGitGadgetQuoted 22 lines · Linus Arver via GitGitGadget
From: Linus Arver <[email protected]>
Currently have two functions for formatting trailers exposed in
trailer.h:void format_trailers(FILE *outfile, struct
list_head*head,
const structprocess_trailer_options*opts);void format_trailers_from_commit(struct strbuf *out, const char *msg,
const structprocess_trailer_options*opts);and previously these functions, although similar enough (even taking the same
process_trailer_optionsstruct pointer), did not build on each other.Make
format_trailers_from_commit()rely onformat_trailers(). Teachformat_trailers()to process trailers with the additionalprocess_trailer_optionsfields likeopts->key_onlywhich is only used byformat_trailers_from_commit()and notbuiltin/interpret-trailers.c. While we're at it, reorder parameters to put the trailer processing options first, and the out parameter (strbuf we write into) at the end.
Quoted 7 lines
This unification will allow us to delete the
format_trailer_info()andprint_tok_val()functions in the next patch. They are not deleted here in order to keep the diff small.Helped-by Junio C Hamano <[email protected]>Signed-off-by Linus Arver <[email protected]>---
I am not sure how I helped this particularly (say, compared to all the other patches on the list from everybody), though.
The updated format_trailers() does so much more than the original and does so quite differently, it is hard to tell if the existing caller is getting the same behaviour (modulo obviously it now needs to prepare a strbuf and print the resulting string in the strbuf, which is expected) as before.
The conversion for the sole existing caller looks like this, ...
Review
Quoted 10 lines
(quoted diff) +5
-1LIST_HEAD(head); struct strbuf sb = STRBUF_INIT; + struct strbuf trailer_block = STRBUF_INIT; struct trailer_info info; - format_trailers(opts, &head, outfile); + /* Print trailer block. */ + format_trailers(opts, &head, &trailer_block); + fwrite(trailer_block.buf, 1, trailer_block.len, outfile); + strbuf_release(&trailer_block);
... and it is very straight-forward.
But what it called was this:
Quoted 20 lines
trailer.c +0
-20-static void print_tok_val (FILE *outfile,const char *tok,const char *val) -{ -char c; - -if (!tok) { -fprintf (outfile,"%s\n" , val); -return ; - } - - c =last_non_space_char (tok); -if (!c) -return ; -if (strchr (separators, c)) -fprintf (outfile,"%s%s\n" , tok, val); -else -fprintf (outfile,"%s%c %s\n" , tok, separators[0 ], val); -} - -void format_trailers (const struct process_trailer_options *opts, -struct list_head *trailers,FILE *outfile)
trailer.c static char last_non_space_char(const char *s) · line 176
Quoted 10 lines
trailer.c +0
-10-{ -struct list_head *pos; -struct trailer_item *item; -list_for_each (pos, trailers) { - item = list_entry(pos, struct trailer_item, list); -if ((!opts->trim_empty ||strlen (item->value) >0 ) && - (!opts->only_trailers || item->token)) -print_tok_val (outfile, item->token, item->value); - } -}
i.e. iterate over trailers, and sometimes call print_tok_val(), which does not do all that much. Print only the val, or when tok is not empty, show "tok: val" while taking into account the possibility that the last byte of tok may already be the separator.
But the new thing is way more complex.
Quoted 16 lines
trailer.c +16
-0+void format_trailers (const struct process_trailer_options *opts, +struct list_head *trailers, +struct strbuf *out) +{ +struct list_head *pos; +struct trailer_item *item; +int need_separator =0 ; + +list_for_each (pos, trailers) { + item = list_entry(pos, struct trailer_item, list); +if (item->token) { +char c; + +struct strbuf tok =STRBUF_INIT ; +struct strbuf val =STRBUF_INIT ; +strbuf_addstr (&tok, item->token);
trailer.c static void unfold_value(struct strbuf *val) · line 981
Quoted 10 lines
trailer.c +10
-0+strbuf_addstr (&val, item->value); + +/* +* Skip key/value pairs where the value was empty. This +* can happen from trailers specified without a +* separator, like `--trailer "Reviewed-by"` (no +* corresponding value). +*/ +if (opts->trim_empty && !strlen (item->value)) +continue ;
OK, this matches the first condition to stay silent in the original.
trailer.c static void unfold_value(struct strbuf *val) · line 983
Quoted 1 line
trailer.c +1
-0+if (!opts->filter || opts->filter (&tok, opts->filter_data)) {
For the original caller of format_trailers(), which is the interpret_trailers(), .filter member is never set, so we always come here, I presume. cmd_interpret_trailers(), before calling interpret_trailers() could affect the following members:
.in_place .trim_empty .only_trailers .only_input .unfold .no_divider
so we should make sure this new implementation does not change the behaviour from the original with various combination of these options.
trailer.c static void unfold_value(struct strbuf *val) · line 985
Quoted 2 lines
trailer.c +2
-0+if (opts->unfold) +unfold_value (&val);
So, ... how would this affect an invocation of
$ git interpret-trailers --unfold
which would have set opts.unfold to true in cmd_interpret_trailers() and eventually called process_trailers() with it, which eventually called print_all(), which conditionally called print_tok_val() but never gave the val to unfold_value()?
... goes and digs a bit more ...
Ahhhh, original process_trailers() did this by calling parse_trailers() that munged the value. So its print_all() codepath only had to print what has already been munged.
But then in this new code, do we unfold only here? I thought that in the new code you moved around, the caller, whose name is now interpret_trailers(), still calls parse_trailers() and that calls the unfold_value(). So, are we doing redundant work that may merely be unneeded (if we are lucky) or could be harmful (if things, other than the unfold thing I just noticed, that are done both in parse_trailers() and this function are not idempotent)?
It could be that a bit more preparatory refactoring would clarify. I dunno.
Quoted 40 lines
trailer.c +40
-0+if (opts->separator && need_separator) +strbuf_addbuf (out, opts->separator); +if (!opts->value_only) +strbuf_addbuf (out, &tok); +if (!opts->key_only && !opts->value_only) { +if (opts->key_value_separator) +strbuf_addbuf (out, opts->key_value_separator); +else { + c =last_non_space_char (tok.buf); +if (c) { +if (!strchr (separators, c)) +strbuf_addf (out,"%c " , separators[0 ]); + } + } + } +if (!opts->key_only) +strbuf_addbuf (out, &val); +if (!opts->separator) +strbuf_addch (out,'\n' ); + + need_separator =1 ; + } + +strbuf_release (&tok); +strbuf_release (&val); + }else if (!opts->only_trailers) { +if (opts->separator && need_separator) { +strbuf_addbuf (out, opts->separator); + } +strbuf_addstr (out, item->value); +if (opts->separator) +strbuf_rtrim (out); +else +strbuf_addch (out,'\n' ); + + need_separator =1 ; + } + + } +}
Re: [PATCH v3 03/10] trailer: unify trailer formatting machinery
Quoted 18 lines · Junio C Hamano
trailer.c static void unfold_value(struct strbuf *val) · line 985
Quoted 2 lines
trailer.c +2
-0+if (opts->unfold) +unfold_value (&val);So, ... how would this affect an invocation of
$ git interpret-trailers --unfoldwhich would have set opts.unfold to true in
cmd_interpret_trailers()and eventually calledprocess_trailers()with it, which eventually calledprint_all(), which conditionally calledprint_tok_val()but never gave the val tounfold_value()?... goes and digs a bit more ...
Ahhhh, original
process_trailers()did this by callingparse_trailers()that munged the value. So itsprint_all()codepath only had to print what has already been munged.
Quoted 7 lines
But then in this new code, do we unfold only here? I thought that in the new code you moved around, the caller, whose name is now
interpret_trailers(), still callsparse_trailers()and that calls theunfold_value(). So, are we doing redundant work that may merely be unneeded (if we are lucky) or could be harmful (if things, other than the unfold thing I just noticed, that are done both inparse_trailers()and this function are not idempotent)?
I was too confused by the code flow and resorted to tracing what happens when "git interpret-trailers --unfold" is run in a way similar to how t7513 does in gdb. Shame shame.
In any case, the updated code does try to call unfold_value() in format_trailers() on "val" that has already been unfolded in parse_trailers(). This may not produce an incorrect result if unfold_value() is truly idempotent (I do not know), but even if it is correct for its handling of .unfold bit, this episode lowered my confidence level on the new code significantly, as I do not know what unintended effects [*] all the other new things done in this function have, or if none of these unintended effects are error-free.
Quoted 2 lines
It could be that a bit more preparatory refactoring would clarify. I dunno.
Thanks.
[Footnote]
* I am assuming that calling unfold twice on the same value and relying for its idempotent-ness for correctness was not your intention.
Re: [PATCH v3 03/10] trailer: unify trailer formatting machinery
Quoted 28 lines · Junio C Hamano
Quoted 18 lines · Junio C Hamano
trailer.c static void unfold_value(struct strbuf *val) · line 985
Quoted 2 lines
trailer.c +2
-0+if (opts->unfold) +unfold_value (&val);So, ... how would this affect an invocation of
$ git interpret-trailers --unfoldwhich would have set opts.unfold to true in
cmd_interpret_trailers()and eventually calledprocess_trailers()with it, which eventually calledprint_all(), which conditionally calledprint_tok_val()but never gave the val tounfold_value()?... goes and digs a bit more ...
Ahhhh, original
process_trailers()did this by callingparse_trailers()that munged the value. So itsprint_all()codepath only had to print what has already been munged.Quoted 7 lines
But then in this new code, do we unfold only here? I thought that in the new code you moved around, the caller, whose name is now
interpret_trailers(), still callsparse_trailers()and that calls theunfold_value(). So, are we doing redundant work that may merely be unneeded (if we are lucky) or could be harmful (if things, other than the unfold thing I just noticed, that are done both inparse_trailers()and this function are not idempotent)?
Quoted 3 lines
I was too confused by the code flow and resorted to tracing what happens when "git interpret-trailers --unfold" is run in a way similar to how t7513 does in gdb. Shame shame.
In my larger series I've made the parser and formater much simpler (removing nesting, calling helper functions, _only parsing once and only once_, etc) to make both parsing and formatting much easier to understand. While I am biased as the author of these refactors, I do think they make the code simpler.
Quoted 3 lines
In any case, the updated code does try to call
unfold_value()informat_trailers()on "val" that has already been unfolded inparse_trailers().
Correct. But this was already the case before this series. IOW the existing code assumes that this function is idempotent: we call unfold_value() in parse_trailers() and again in format_trailer_info().
In my tests if I remove the redundant call to unfold_value() in the new formatter (so that unfolding only happens during parse_trailers()), all trailer-related tests still pass:
prove -j47 t{7513,3507,7502,4205,3511,3428,6300}*.shFWIW in the larger series we prohibit the parser from making mutations to the input (unfolding is one such mutation), and allow multiline (folded) strings to be stored as is in "val", only unfolding the value if we need to during formatting.
Quoted 7 lines
This may not produce an incorrect result if
unfold_value()is truly idempotent (I do not know), but even if it is correct for its handling of .unfold bit, this episode lowered my confidence level on the new code significantly, as I do not know what unintended effects [*] all the other new things done in this function have, or if none of these unintended effects are error-free.
I think dropping the redundant call to unfold_value() would help address some of your concerns. Of course, all of the existing test cases pass (with and without the redundant call). As for addressing _all_ (not just some) concerns, I am not confident I can deliver that as an additional patch or two to this series because ...
Quoted 2 lines
Quoted 2 lines
It could be that a bit more preparatory refactoring would clarify. I dunno.
... this is basically what I've done in the larger series, because there are many areas that could be simplified (not to mention addressing some bugs some bugs are lurking around). Granted, those are more aggressive refactorings, and are not "preparatory refactoring" at all.
I could just grow this series with another ~22 patches to include those additional refactors, but I am hesitant about doing so, simply due to the sheer number of them.
How would you like me to proceed, other than deleting the redundant unfold_value() call in the next reroll?
For reference, here's a list of those 22 commits that build on this series as a preview (roughly grouped on themes):
trailer formatter: deprecate format_trailers()
trailer formatter: introduce format_trailer_block() trailer parser: parse_trailer_v2() for '--trailer <...>' CLI arguments trailer parser: parse_trailer_v2() for configuration trailer parser: parse_trailer_v2() for trailer blocks trailer parser: introduce parse_trailer_v2()
interpret-trailers: preserve trailers coming from the input
trailer_block: remove trailer_strings member
trailer_block: parse trailers in one place
trailer_block: prepare to remove trailer_strings member
trailer: make find_same_and_apply_arg() do one thing
trailer: unify global configuration
interpret-trailers: print error if given unrecognized arguments
trailer: make entire iterator struct private
trailer: rename terms for consistency
trailer: use create_new_target_for() everywhere
trailer: capture behavior of addIfDifferentNeighbor
trailer: EXISTS_REPLACE preserves original position
trailer: capture replacement behavior for multiple matches
trailer: split template application into 2 steps
trailer: free templates in one place
trailer: template's final value does not depend on in_tok
and "trailer formatter: introduce format_trailer_block()" is the one that refactors the unified formatter introduced in this patch to have multiple smaller helper functions.
Re: [PATCH v3 03/10] trailer: unify trailer formatting machinery
Quoted 7 lines · Linus Arver
Quoted 3 lines
In any case, the updated code does try to call
unfold_value()informat_trailers()on "val" that has already been unfolded inparse_trailers().Correct. But this was already the case before this series. IOW the existing code assumes that this function is idempotent: we call
unfold_value()inparse_trailers()and again informat_trailer_info().
But not in format_trailers(), which is the theme of this step. In other words, the behaviour before and after this step of the function are not the same (modulo that the new version stores the output in a strbuf), and as the way the changes are presented here, it is almost impossible to make sure that we are not introducing regressions, without making such assumptions like "unfold_value() is idempotent and we already rely on that fact elsewhere in the code".
It is not just "unfold", which was the first thing I happened to notice, by the way. There are many more lines in the new lines of that function, doing things that the original version did not appear to do, or doing in very different ways.
Quoted 3 lines
I could just grow this series with another ~22 patches to include those additional refactors, but I am hesitant about doing so, simply due to the sheer number of them.
I actually do not mind at all if you started with a preliminary clean-up series, and stopped the first batch somewhere in the middle of the 20+ patches before even reaching any of these 10 patches we see here, if that gives us a readable set of bite-sized changes that prepare a solid foundation to rebuild things on top. I am having a feeling that not even a single person has reviewed them on list even though we are already at the third iteration, which is quite frustrating (and I would imagine that it would be frustrating for you, too), and I suspect that the step like [v3 03/10] that makes too large a change with too little explanation (and perhaps a bit of "trust me, this does not change the behaviour") is one contributing factor why people are afraid of touching it.
Re: [PATCH v3 03/10] trailer: unify trailer formatting machinery
Quoted 6 lines · Junio C Hamano
..., if that gives us a readable set of bite-sized changes that prepare a solid foundation to rebuild things on top. I am having a feeling that not even a single person has reviewed them on list even though we are already at the third iteration, which is quite frustrating (and I would imagine that it would be frustrating for you, too), ...
I guess "not even a single person" was a bit unfair, given that we did see some minor comments from me and also Josh during the first round.
But neither of two rounds saw any in-depth reviews that question "is the code doing the right thing?", which would take a real reading of and a comparison between the code before and after the patches, with some understanding of how things have been working, how things were envisioned to evolve, and how the patch author would want to change the course of the evolution of the code in the longer term.
Christian, you've been touching the code in this area the longuest. Can we have some of your time reviewing these?
Thanks.
Re: [PATCH v3 03/10] trailer: unify trailer formatting machinery
In reply to Junio C HamanoQuoted 6 lines · Junio C Hamano
Quoted 3 lines · Linus Arver
I could just grow this series with another ~22 patches to include those additional refactors, but I am hesitant about doing so, simply due to the sheer number of them.
Quoted 12 lines
I actually do not mind at all if you started with a preliminary clean-up series, and stopped the first batch somewhere in the middle of the 20+ patches before even reaching any of these 10 patches we see here, if that gives us a readable set of bite-sized changes that prepare a solid foundation to rebuild things on top. I am having a feeling that not even a single person has reviewed them on list even though we are already at the third iteration, which is quite frustrating (and I would imagine that it would be frustrating for you, too), and I suspect that the step like [v3 03/10] that makes too large a change with too little explanation (and perhaps a bit of "trust me, this does not change the behaviour") is one contributing factor why people are afraid of touching it.
I am planning to spend today trying to break up this patch into smaller preparatory chunks that still end up at the same state as this patch.
Will post another update on how this goes by EOD. Thanks.
Re: [PATCH v3 03/10] trailer: unify trailer formatting machinery
Quoted 4 lines · Linus Arver
I am planning to spend today trying to break up this patch into smaller preparatory chunks that still end up at the same state as this patch.
Will post another update on how this goes by EOD. Thanks.
I stopped reading the function after noticing the double unfolding, so there may be similar "why do we do this unexplained new thing in the function that the original didn't?" issues in the "same state",
In any case, if I understood your plan I heard from you in the discussion yesterday correctly, the unfolding should not be added to format (to make it double), but would be moved from parse to format in a single step. It would avoid making it double, and would make the parse step about purely parsing without modification, which is a very worthwhile thing to do. So I am not sure if we want to end up with the same state in the first place, though.
THanks.
Re: [PATCH v3 03/10] trailer: unify trailer formatting machinery
Quoted 6 lines · Junio C Hamano
Quoted 4 lines · Linus Arver
I am planning to spend today trying to break up this patch into smaller preparatory chunks that still end up at the same state as this patch.
Will post another update on how this goes by EOD. Thanks.
I'm happy to report that this breaking-up of things is going a lot smoother than expected. The hard part is not so much the rearranging of code but rather thinking up of good commit messages to explain the intent of each smaller step. I have most of this patch broken up into much smaller steps with all tests passing.
Quoted 3 lines
I stopped reading the function after noticing the double unfolding, so there may be similar "why do we do this unexplained new thing in the function that the original didn't?" issues in the "same state",
Yep, and these unexplained new things are the things I am recalling (from a few weeks back when I first started this series) and am now trying to find the right commit messages for.
Quoted 3 lines
In any case, if I understood your plan I heard from you in the discussion yesterday correctly, the unfolding should not be added to format (to make it double),
Yes, it will be done during parsing for now. This is because of additional refactors that are coming in the later series, which ...
Quoted 4 lines
but would be moved from parse to format
in a single step. It would avoid making it double, and would make the parse step about purely parsing without modification, which is a very worthwhile thing to do.
... achieve this exact thing (unfolding is done "lazily" during formatting only, not "eagerly" as we do now during parsing).
Quoted 4 lines
So I am not sure if we want to end up
with the same state in the first place, though.THanks.
So far the breaking-up of this patch has not revealed a need to change the end result significantly from what I have here. But I admit I am not sure this will be the case for the other patches that need similar treatment in this series.
Considering how it took me most of the day to break up this single patch, I am not sure I can get a v4 ready by tomorrow. Might need a few days for that.
Thank you for your very helpful review comments for this series so far. They have been quite illuminating. :)
Re: [PATCH v3 03/10] trailer: unify trailer formatting machinery
Quoted 3 lines · Linus Arver
The hard part is not so much the rearranging of
code but rather thinking up of good commit messages to explain the intent of each smaller step.
Good.
Coming up with a good explanation of what you did forces you to think it thorough again. People often discover bugs in the code they just wrote, or different and better ways to solve the problem, while explaining the change to their colleagues, and I found it has very similar effect to try to write a good explanation in the commit log. Time to write such a good explanation is time worth investing in.
Incidentally, this is why we value clearly written proposed log message while reviewing. A commit that is a product of "I tried this, which did not work, and then tried something else, which did not work either, and after some more random tries, this seems to work" would not have a clear thinking behind it, but if such iterations of random tries happened to hit the best solution, thinking backwards from the result to the original problem and explaining how the solution works would result in a good description.
Thanks.
Re: [PATCH v3 03/10] trailer: unify trailer formatting machinery
In reply to Junio C HamanoQuoted 28 lines · Junio C Hamano
Quoted 26 lines · Linus Arver via GitGitGadget
From: Linus Arver <[email protected]>
Currently have two functions for formatting trailers exposed in
trailer.h:void format_trailers(FILE *outfile, struct
list_head*head,
const structprocess_trailer_options*opts);void format_trailers_from_commit(struct strbuf *out, const char *msg,
const structprocess_trailer_options*opts);and previously these functions, although similar enough (even taking the same
process_trailer_optionsstruct pointer), did not build on each other.Make
format_trailers_from_commit()rely onformat_trailers(). Teachformat_trailers()to process trailers with the additionalprocess_trailer_optionsfields likeopts->key_onlywhich is only used byformat_trailers_from_commit()and notbuiltin/interpret-trailers.c. While we're at it, reorder parameters to put the trailer processing options first, and the out parameter (strbuf we write into) at the end.This unification will allow us to delete the
format_trailer_info()andprint_tok_val()functions in the next patch. They are not deleted here in order to keep the diff small.
Quoted 6 lines
Quoted 3 lines
Helped-by Junio C Hamano <[email protected]>Signed-off-by Linus Arver <[email protected]>---
I am not sure how I helped this particularly (say, compared to all the other patches on the list from everybody), though.
You made a suggestion to put trailer processing options first for function parameters, which I've adopted in this series (but also in the larger series).
PATCH v3 4/10 sequencer: use the trailer iterator
In reply to Linus Arver via GitGitGadgetFrom: Linus Arver <[email protected]>
This patch allows for the removal of "trailer_info_get()" from the trailer.h API, which will be in the next patch.
Instead of calling "trailer_info_get()", which is a low-level function in the trailers implementation (trailer.c), call trailer_iterator_advance(), which was specifically designed for public consumption in f0939a0eb1 (trailer: add interface for iterating over commit trailers, 2020-09-27).
Avoiding "trailer_info_get()" means we don't have to worry about options like "no_divider" (relevant for parsing trailers). We also don't have to check for things like "info.trailer_start == info.trailer_end" to see whether there were any trailers (instead we can just check to see whether the iterator advanced at all).
Also, teach the iterator about non-trailer lines, by adding a new field called "raw" to hold both trailer and non-trailer lines. This is necessary because a "trailer block" is a list of trailer lines of at least 25% trailers (see 146245063e (trailer: allow non-trailers in trailer block, 2016-10-21)), such that it may hold non-trailer lines.
--- builtin/shortlog.c | 7 +++++-- sequencer.c | 35 +++++++++++++++-------------------- trailer.c | 17 +++++++++-------- trailer.h | 13 +++++++++++++ 4 files changed, 42 insertions(+), 30 deletions(-)
builtin/shortlog.c +5 -2
@@ -172,7 +172,7 @@ static void insert_records_from_trailers(struct shortlog *log, const char *oneline) {struct trailer_iterator iter; -const char *commit_buffer, *body; +const char *commit_buffer, *body, *value;struct strbuf ident =STRBUF_INIT ;if (!log->trailers.nr)
@@ -190,7 +190,10 @@ static void insert_records_from_trailers(struct shortlog *log,trailer_iterator_init (&iter, body);while (trailer_iterator_advance (&iter)) { -const char *value = iter.val.buf; +if (!iter.is_trailer) +continue ; + + value = iter.val.buf;if (!string_list_has_string (&log->trailers, iter.key.buf))continue ;
sequencer.c +15 -20
@@ -319,37 +319,32 @@ static const char *get_todo_path(const struct replay_opts *opts)static int has_conforming_footer (struct strbuf *sb,struct strbuf *sob,size_t ignore_footer) { -struct process_trailer_options opts =PROCESS_TRAILER_OPTIONS_INIT ; -struct trailer_info info; -size_t i; -int found_sob =0 , found_sob_last =0 ; -char saved_char; - - opts.no_divider =1 ; +struct trailer_iterator iter; +size_t i =0 , found_sob =0 ; +char saved_char = sb->buf[sb->len - ignore_footer];if (ignore_footer) { - saved_char = sb->buf[sb->len - ignore_footer]; sb->buf[sb->len - ignore_footer] ='\0' ; } -trailer_info_get (&info, sb->buf, &opts); +trailer_iterator_init (&iter, sb->buf); +while (trailer_iterator_advance (&iter)) { + i++; +if (sob && + iter.is_trailer && + !strncmp (iter.raw, sob->buf, sob->len)) { + found_sob = i; + } + } +trailer_iterator_release (&iter);if (ignore_footer) sb->buf[sb->len - ignore_footer] = saved_char; -if (info.trailer_block_start == info.trailer_block_end) +if (!i)return 0 ; -for (i =0 ; i < info.trailer_nr; i++) -if (sob && !strncmp (info.trailers[i], sob->buf, sob->len)) { - found_sob =1 ; -if (i == info.trailer_nr -1 ) - found_sob_last =1 ; - } - -trailer_info_release (&info); - -if (found_sob_last) +if (found_sob == i)return 3 ;if (found_sob)return 2 ;
trailer.c +9 -8
@@ -1158,17 +1158,18 @@ void trailer_iterator_init(struct trailer_iterator *iter, const char *msg)int trailer_iterator_advance (struct trailer_iterator *iter) { -while (iter->internal.cur < iter->internal.info.trailer_nr) { -char *trailer = iter->internal.info.trailers[iter->internal.cur++]; -int separator_pos =find_separator (trailer, separators); - -if (separator_pos <1 ) -continue ;/* not a real trailer */ - +char *line; +int separator_pos; +if (iter->internal.cur < iter->internal.info.trailer_nr) { + line = iter->internal.info.trailers[iter->internal.cur++]; + separator_pos =find_separator (line, separators); + iter->is_trailer = (separator_pos >0 ); + + iter->raw = line;strbuf_reset (&iter->key);strbuf_reset (&iter->val);parse_trailer (&iter->key, &iter->val,NULL , - trailer, separator_pos); + line, separator_pos);unfold_value (&iter->val);return 1 ; }
trailer.h +13 -0
@@ -127,6 +127,19 @@ struct trailer_iterator {struct strbuf key;struct strbuf val; +/* +* Raw line (e.g., "foo: bar baz") before being parsed as a trailer +* key/val pair as part of a trailer block. A trailer block can be +* either 100% trailer lines, or mixed in with non-trailer lines (in +* which case at least 25% must be trailer lines). +*/ +const char *raw; + +/* +* 1 if the raw line was parsed as a trailer line (key/val pair). +*/ +int is_trailer; +/* private */ struct {struct trailer_info info;
Signature · 1 line
gitgitgadget
Re: [PATCH v3 04/10] sequencer: use the trailer iterator
Quoted 4 lines · Linus Arver via GitGitGadget
From: Linus Arver <[email protected]>
This patch allows for the removal of "
trailer_info_get()" from thetrailer.hAPI, which will be in the next patch.
Hmph, do you mean "shortlog" and the sequencer were the only two external callers and with this we can make it file-scope static to trailer.c? Or do you mean the next step will be more than a removal of a declaration from trailer.h plus adding "static" in front of its definition in trailer.c, because there need other adjustments before that happens?
Quoted 5 lines
Instead of calling "
trailer_info_get()", which is a low-level function in the trailers implementation (trailer.c), calltrailer_iterator_advance(), which was specifically designed for public consumption inf0939a0eb1(trailer: add interface for iterating over commit trailers, 2020-09-27).
;-).
Quoted 5 lines
Also, teach the iterator about non-trailer lines, by adding a new field called "raw" to hold both trailer and non-trailer lines. This is necessary because a "trailer block" is a list of trailer lines of at least 25% trailers (see
146245063e(trailer: allow non-trailers in trailer block, 2016-10-21)), such that it may hold non-trailer lines.
That sounds like a task larger than something we would want in a patch that focuses on another task (e.g. update sequencer not to call trailer_info_get()) while at it. It seems from a casual glance that the change to shortlog.c is to accomodate this change in the semantics of what the iterator could return? It smells that this patch does two more or less unrelated things at the same time?
Quoted 145 lines
Signed-off-by Linus Arver <[email protected]>--- builtin/shortlog.c | 7 +++++-- sequencer.c | 35 +++++++++++++++-------------------- trailer.c | 17 +++++++++-------- trailer.h | 13 +++++++++++++ 4 files changed, 42 insertions(+), 30 deletions(-)builtin/shortlog.c +5
-2@@ -172,7 +172,7 @@ static void insert_records_from_trailers(struct shortlog *log, const char *oneline) {struct trailer_iterator iter; -const char *commit_buffer, *body; +const char *commit_buffer, *body, *value;struct strbuf ident =STRBUF_INIT ;if (!log->trailers.nr)@@ -190,7 +190,10 @@ static void insert_records_from_trailers(struct shortlog *log,trailer_iterator_init (&iter, body);while (trailer_iterator_advance (&iter)) { -const char *value = iter.val.buf; +if (!iter.is_trailer) +continue ; + + value = iter.val.buf;if (!string_list_has_string (&log->trailers, iter.key.buf))continue ;sequencer.c +15
-20@@ -319,37 +319,32 @@ static const char *get_todo_path(const struct replay_opts *opts)static int has_conforming_footer (struct strbuf *sb,struct strbuf *sob,size_t ignore_footer) { -struct process_trailer_options opts =PROCESS_TRAILER_OPTIONS_INIT ; -struct trailer_info info; -size_t i; -int found_sob =0 , found_sob_last =0 ; -char saved_char; - - opts.no_divider =1 ; +struct trailer_iterator iter; +size_t i =0 , found_sob =0 ; +char saved_char = sb->buf[sb->len - ignore_footer];if (ignore_footer) { - saved_char = sb->buf[sb->len - ignore_footer]; sb->buf[sb->len - ignore_footer] ='\0' ; } -trailer_info_get (&info, sb->buf, &opts); +trailer_iterator_init (&iter, sb->buf); +while (trailer_iterator_advance (&iter)) { + i++; +if (sob && + iter.is_trailer && + !strncmp (iter.raw, sob->buf, sob->len)) { + found_sob = i; + } + } +trailer_iterator_release (&iter);if (ignore_footer) sb->buf[sb->len - ignore_footer] = saved_char; -if (info.trailer_block_start == info.trailer_block_end) +if (!i)return 0 ; -for (i =0 ; i < info.trailer_nr; i++) -if (sob && !strncmp (info.trailers[i], sob->buf, sob->len)) { - found_sob =1 ; -if (i == info.trailer_nr -1 ) - found_sob_last =1 ; - } - -trailer_info_release (&info); - -if (found_sob_last) +if (found_sob == i)return 3 ;if (found_sob)return 2 ;trailer.c +9
-8@@ -1158,17 +1158,18 @@ void trailer_iterator_init(struct trailer_iterator *iter, const char *msg)int trailer_iterator_advance (struct trailer_iterator *iter) { -while (iter->internal.cur < iter->internal.info.trailer_nr) { -char *trailer = iter->internal.info.trailers[iter->internal.cur++]; -int separator_pos =find_separator (trailer, separators); - -if (separator_pos <1 ) -continue ;/* not a real trailer */ - +char *line; +int separator_pos; +if (iter->internal.cur < iter->internal.info.trailer_nr) { + line = iter->internal.info.trailers[iter->internal.cur++]; + separator_pos =find_separator (line, separators); + iter->is_trailer = (separator_pos >0 ); + + iter->raw = line;strbuf_reset (&iter->key);strbuf_reset (&iter->val);parse_trailer (&iter->key, &iter->val,NULL , - trailer, separator_pos); + line, separator_pos);unfold_value (&iter->val);return 1 ; }trailer.h +13
-0@@ -127,6 +127,19 @@ struct trailer_iterator {struct strbuf key;struct strbuf val; +/* +* Raw line (e.g., "foo: bar baz") before being parsed as a trailer +* key/val pair as part of a trailer block. A trailer block can be +* either 100% trailer lines, or mixed in with non-trailer lines (in +* which case at least 25% must be trailer lines). +*/ +const char *raw; + +/* +* 1 if the raw line was parsed as a trailer line (key/val pair). +*/ +int is_trailer; +/* private */ struct {struct trailer_info info;
Re: [PATCH v3 04/10] sequencer: use the trailer iterator
Quoted 10 lines · Junio C Hamano
Quoted 4 lines · Linus Arver via GitGitGadget
From: Linus Arver <[email protected]>
This patch allows for the removal of "
trailer_info_get()" from thetrailer.hAPI, which will be in the next patch.Hmph, do you mean "shortlog" and the sequencer were the only two external callers and with this we can make it file-scope static to
trailer.c?
This was what I meant (originally ...
Quoted 4 lines
Or do you mean the next step will be more than a removal of a declaration from
trailer.hplus adding "static" in front of its definition intrailer.c, because there need other adjustments before that happens?
... but now I realize that the operation adds a few small tweaks, such as tweaking the parameters it expects and also what it returns). In the spirit of breaking up patch 3, I will also break this up into preparatory patches as well.
Quoted 6 lines
Quoted 5 lines
Also, teach the iterator about non-trailer lines, by adding a new field called "raw" to hold both trailer and non-trailer lines. This is necessary because a "trailer block" is a list of trailer lines of at least 25% trailers (see
146245063e(trailer: allow non-trailers in trailer block, 2016-10-21)), such that it may hold non-trailer lines.
Quoted 6 lines
That sounds like a task larger than something we would want in a patch that focuses on another task (e.g. update sequencer not to call
trailer_info_get()) while at it. It seems from a casual glance that the change toshortlog.cis to accomodate this change in the semantics of what the iterator could return? It smells that this patch does two more or less unrelated things at the same time?
I think you're correct. Hopefully breaking this up will make things easier to review.
I am learning very quickly from your review comments in patch 3 and in here that, in the absence of area experts, the existing tests/CI tests cannot be trusted alone (after all some tests could be missing), which makes it more important to do so-called "micro-commits".
But overall, breaking things up is a good thing anyway as a general practice, so, I think this is a good lesson. TBH I have a (bad) habit of saying "is the diff ~100 lines?" and if so I don't spend any time thinking of breaking these up. X-<
Thanks.
Re: [PATCH v3 04/10] sequencer: use the trailer iterator
Quoted 19 lines · Linus Arver
Quoted 10 lines · Junio C Hamano
Quoted 7 lines · Linus Arver via GitGitGadget
From: Linus Arver <[email protected]>
Also, teach the iterator about non-trailer lines, by adding a new field called "raw" to hold both trailer and non-trailer lines. This is necessary because a "trailer block" is a list of trailer lines of at least 25% trailers (see
146245063e(trailer: allow non-trailers in trailer block, 2016-10-21)), such that it may hold non-trailer lines.Quoted 6 lines
That sounds like a task larger than something we would want in a patch that focuses on another task (e.g. update sequencer not to call
trailer_info_get()) while at it. It seems from a casual glance that the change toshortlog.cis to accomodate this change in the semantics of what the iterator could return? It smells that this patch does two more or less unrelated things at the same time?
Quoted 2 lines
I think you're correct. Hopefully breaking this up will make things easier to review.
And now that I've broken it up locally, I can say that the change I made to shortlog was unnecessary (shortlog already has a check to see if the trailer key is empty) which makes the "is_trailer" check I added to it here redundant (because non-trailer lines, which the new iterator can iterate over, have empty keys).
Will remove the shortlog change in v4. Thanks.
PATCH v3 5/10 trailer: make trailer_info struct private
In reply to Linus Arver via GitGitGadgetFrom: Linus Arver <[email protected]>
In 13211ae23f (trailer: separate public from internal portion of trailer_iterator, 2023-09-09) we moved trailer_info behind an anonymous struct to discourage use by trailer.h API users. However it still left open the possibility of external use of trailer_info itself. Now that there are no external users of trailer_info, we can make this struct private.
Make this struct private by putting its definition inside trailer.c. This has two benefits:
(1) it makes the surface area of the public facing interface (trailer.h) smaller, and
(2) external API users are unable to peer inside this struct (because it is only ever exposed as an opaque pointer).
This change exposes some deficiencies in the API, mainly with regard to information about the location of the trailer block that was parsed. Expose new API functions to access this information (needed by builtin/interpret-trailers.c).
The idea in this patch to hide implementation details behind an "opaque pointer" is also known as the "pimpl" (pointer to implementation) idiom in C++ and is a common pattern in that language (where, for example, abstract classes only have pointers to concrete classes).
However, the original inspiration to use this idiom does not come from C++, but instead the book "C Interfaces and Implementations: Techniques for Creating Reusable Software" [1]. This book recommends opaque pointers as a good design principle for designing C libraries, using the term "interface" as the functions defined in *.h (header) files and "implementation" as the corresponding *.c file which define the interfaces.
The book says this about opaque pointers:
... clients can manipulate such pointers freely, but they can’t dereference them; that is, they can’t look at the innards of the structure pointed to by them. Only the implementation has that privilege. Opaque pointers hide representation details and help catch errors.
In our case, "struct trailer_info" is now hidden from clients, and the ways in which this opaque pointer can be used is limited to the richness of the trailer.h file. In other words, trailer.h exclusively controls exactly how "trailer_info" pointers are to be used.
[1] Hanson, David R. "C Interfaces and Implementations: Techniques for Creating Reusable Software". Addison Wesley, 1997. p. 22
--- builtin/interpret-trailers.c | 13 +-- trailer.c | 154 +++++++++++++++++++++++------------ trailer.h | 37 ++------- 3 files changed, 117 insertions(+), 87 deletions(-)
builtin/interpret-trailers.c +7 -6
@@ -141,7 +141,7 @@ static void interpret_trailers(const struct process_trailer_options *opts,LIST_HEAD (head);struct strbuf sb =STRBUF_INIT ;struct strbuf trailer_block =STRBUF_INIT ; -struct trailer_info info; +struct trailer_info *info;FILE *outfile = stdout;trailer_config_init ();
@@ -151,13 +151,13 @@ static void interpret_trailers(const struct process_trailer_options *opts,if (opts->in_place) outfile =create_in_place_tempfile (file); -parse_trailers (opts, &info, sb.buf, &head); + info =parse_trailers (opts, sb.buf, &head);/* Print the lines before the trailers */ if (!opts->only_trailers) -fwrite (sb.buf,1 , info.trailer_block_start, outfile); +fwrite (sb.buf,1 ,trailer_block_start (info), outfile); -if (!opts->only_trailers && !info.blank_line_before_trailer) +if (!opts->only_trailers && !blank_line_before_trailer_block (info))fprintf (outfile,"\n" );
@@ -176,11 +176,12 @@ static void interpret_trailers(const struct process_trailer_options *opts,strbuf_release (&trailer_block);free_trailers (&head); -trailer_info_release (&info);/* Print the lines after the trailers as is */ if (!opts->only_trailers) -fwrite (sb.buf + info.trailer_block_end,1 , sb.len - info.trailer_block_end, outfile); +fwrite (sb.buf +trailer_block_end (info),1 , sb.len -trailer_block_end (info), outfile); + +trailer_info_release (info);if (opts->in_place)if (rename_tempfile (&trailers_tempfile, file))
trailer.c +101 -53
231 lines not on this page · raw message
trailer.h +9 -28
@@ -4,6 +4,8 @@#include "list.h" #include "strbuf.h" +struct trailer_info ; +enum trailer_where {WHERE_DEFAULT ,WHERE_END ,
@@ -29,27 +31,6 @@ int trailer_set_where(enum trailer_where *item, const char *value);int trailer_set_if_exists (enum trailer_if_exists *item,const char *value);int trailer_set_if_missing (enum trailer_if_missing *item,const char *value); -struct trailer_info { -/* -* True if there is a blank line before the location pointed to by -* trailer_block_start. -*/ -int blank_line_before_trailer; - -/* -* Offsets to the trailer block start and end positions in the input -* string. If no trailer block is found, these are both set to the -* "true" end of the input (find_end_of_log_message()). -*/ -size_t trailer_block_start, trailer_block_end; - -/* -* Array of trailers found. -*/ -char **trailers; -size_t trailer_nr; -}; -/* * A list that represents newly-added trailers, such as those provided * with the --trailer command line option of git-interpret-trailers.
@@ -89,13 +70,13 @@ void parse_trailers_from_command_line_args(struct list_head *arg_head,void process_trailers_lists (struct list_head *head,struct list_head *arg_head); -void parse_trailers (const struct process_trailer_options *opts, -struct trailer_info *info, -const char *str, -struct list_head *head); +struct trailer_info *parse_trailers (const struct process_trailer_options *opts, +const char *str, +struct list_head *head); -void trailer_info_get (struct trailer_info *info,const char *str, -const struct process_trailer_options *opts); +size_t trailer_block_start (struct trailer_info *info); +size_t trailer_block_end (struct trailer_info *info); +int blank_line_before_trailer_block (struct trailer_info *info);void trailer_info_release (struct trailer_info *info);
@@ -142,7 +123,7 @@ struct trailer_iterator {/* private */ struct { -struct trailer_info info; +struct trailer_info *info;size_t cur; } internal; };
Signature · 1 line
gitgitgadget
Re: [PATCH v3 05/10] trailer: make trailer_info struct private
Quoted 8 lines · Linus Arver via GitGitGadget
Make this struct private by putting its definition inside
trailer.c. This has two benefits:(1) it makes the surface area of the public facing interface (
trailer.h) smaller, and(2) external API users are unable to peer inside this struct (because it is only ever exposed as an opaque pointer).
At the cost of an extra pointer dereference every time the member of the struct is accessed, plus the cost of allocation/deallocation.
Which may not be a huge deal, but I wonder if the approach to name the member of the outer struct with "private" that seems to be used in other parts of the code (e.g. the .private_size member in the hashmap structure, the .refs_private member in the repository structure) or even a documented convention (e.g. raw_object_store), might be more appropriate here. If Coccinelle works well (which we may be having some trouble with --- cf. <[email protected]>), we should be able to catch external accesses without having to hide the implementation details via an extra pointer dereference.
builtin/interpret-trailers.c static void interpret_trailers(const struct process_trailer_options *opts, · line 184
Quoted 12 lines
builtin/interpret-trailers.c +3
-2@@ -176,11 +176,12 @@ static void interpret_trailers(const struct process_trailer_options *opts,strbuf_release (&trailer_block);free_trailers (&head); -trailer_info_release (&info);/* Print the lines after the trailers as is */ if (!opts->only_trailers) -fwrite (sb.buf + info.trailer_block_end,1 , sb.len - info.trailer_block_end, outfile); +fwrite (sb.buf +trailer_block_end (info),1 , sb.len -trailer_block_end (info), outfile); + +trailer_info_release (info);
Interesting. Is this an indenendent bugfix even if we decided not to take this patch? No, I have not fully decided to be negative on the move this entire patch makes (even though I am leaning towards saying so). Just hypothetically, even if we wanted to keep "info" here as a structure and not a pointer to an opaque structure, doesn't this hunk fix a real bug?
Well, technically, not quite, because the members referenced in that if (.only_trailers) block are still live in the info struct. But it still smells wrong to access info.* after calling _release() on it, and this fix should come before "info" is turned from an instance to a pointer, I would say.
Quoted 14 lines
trailer.h +2
-0@@ -4,6 +4,8 @@#include "list.h" #include "strbuf.h" +struct trailer_info ; +enum trailer_where {WHERE_DEFAULT ,WHERE_END ,
trailer.h int trailer_set_where(enum trailer_where *item, const char *value); · line 36
Quoted 6 lines
trailer.h +3
-0@@ -29,27 +31,6 @@ int trailer_set_where(enum trailer_where *item, const char *value);int trailer_set_if_exists (enum trailer_if_exists *item,const char *value);int trailer_set_if_missing (enum trailer_if_missing *item,const char *value); +size_t trailer_block_start (struct trailer_info *info); +size_t trailer_block_end (struct trailer_info *info); +int blank_line_before_trailer_block (struct trailer_info *info);
And we need new accessors, which is a good change regardless of the answer to the "do we really want an extra pointer dereference? Shouldn't the existing 'private' and 'internal' label we see below sufficient?" question.
Quoted 9 lines
trailer.h +1
-1@@ -142,7 +123,7 @@ struct trailer_iterator {/* private */ struct { -struct trailer_info info; +struct trailer_info *info;size_t cur; } internal; };
Re: [PATCH v3 05/10] trailer: make trailer_info struct private
Quoted 5 lines · Junio C Hamano
Quoted 3 lines · Linus Arver via GitGitGadget
Make this struct private by putting its definition inside
trailer.c. This has two benefits:
Quoted 8 lines
Quoted 5 lines
(1) it makes the surface area of the public facing interface (
trailer.h) smaller, and(2) external API users are unable to peer inside this struct (because it is only ever exposed as an opaque pointer).
At the cost of an extra pointer dereference every time the member of the struct is accessed, plus the cost of allocation/deallocation.
Added to commit message for v4, thanks.
Quoted 6 lines
Which may not be a huge deal, but I wonder if the approach to name the member of the outer struct with "private" that seems to be used in other parts of the code (e.g. the .private_size member in the hashmap structure, the .refs_private member in the repository structure) or even a documented convention (e.g.
raw_object_store), might be more appropriate here.
Having gotten my hands dirty with the pimpl idiom, I think possibly the best thing about it is that the compiler can tell me exactly where every Git subsystem outside of trailer.c is accessing members inside the (newly private) struct. So it's great for checking existing usage of how things are used already, day-to-day. Not being well-versed in shortlog or sequencer internals, these warnings from the compiler for these functions (trying to peer through the opaque pointer) have been very informative.
I think it would be reasonable to drop the idiom if the additional performance costs (pointer dereference, allocation/deallocation) are too much to bear. For the trailer subsystem I don't see an immediate need to focus on performance though, so I think it's fine for now.
Quoted 4 lines
If Coccinelle works well (which we
may be having some trouble with --- cf. <[email protected]>), we should be able to catch external accesses without having to hide the implementation details via an extra pointer dereference.
That's true. But that would only work for trailer API users inside the Git codebase. Eventually I envision projects external to Git using <trailer.h>, and in that scenario we would _really_ not want to let these external users peek inside structs with members named "private" or "internal" in name only. Murphy's law suggests those external users will (naughtily) depend on the internals, and that would place an undue burden on us if we ever wanted to make large changes to these (public) structs because we might break them.
Another thing to consider is that if our API users ever want to get more flexibility out of it, they would immediately come to us if we used the pimpl idiom (our users are bound by exactly how we define the API). If the structs were public, then they would be free to implement new functionality to extend the API on their own, without ever letting us know. If there are folks making small (unofficial) extensions to the API, I want that to happen _in_ this project, not outside.
In summary what I'm saying is that this idiom gives very strong guidance for desining an API for both Git-internal and external-to-Git usage. I think for at least the trailer subsystem it's worth trying out. I've pointed out some of the same points in the cover letter also.
Quoted 6 lines
Quoted 6 lines
builtin/interpret-trailers.c +0
-1@@ -176,11 +176,12 @@ static void interpret_trailers(const struct process_trailer_options *opts,strbuf_release (&trailer_block);free_trailers (&head); -trailer_info_release (&info);
Quoted 9 lines
builtin/interpret-trailers.c static void interpret_trailers(const struct process_trailer_options *opts, · line 184
Quoted 6 lines
builtin/interpret-trailers.c +3
-1/* Print the lines after the trailers as is */ if (!opts->only_trailers) -fwrite (sb.buf + info.trailer_block_end,1 , sb.len - info.trailer_block_end, outfile); +fwrite (sb.buf +trailer_block_end (info),1 , sb.len -trailer_block_end (info), outfile); + +trailer_info_release (info);Interesting. Is this an indenendent bugfix even if we decided not to take this patch?
Nice catch!
Quoted 11 lines
No, I have not fully decided to be negative on
the move this entire patch makes (even though I am leaning towards saying so). Just hypothetically, even if we wanted to keep "info" here as a structure and not a pointer to an opaque structure, doesn't this hunk fix a real bug?Well, technically, not quite, because the members referenced in that if (.only_trailers) block are still live in the info struct. But it still smells wrong to access info.* after calling
_release()on it, and this fix should come before "info" is turned from an instance to a pointer, I would say.
I've promoted this change into a bugfix patch as the very first patch for the next reroll. Thanks.
Quoted 17 lines
Quoted 17 lines
trailer.h +2
-0@@ -4,6 +4,8 @@#include "list.h" #include "strbuf.h" +struct trailer_info ; +enum trailer_where {WHERE_DEFAULT ,WHERE_END ,@@ -29,27 +31,6 @@ int trailer_set_where(enum trailer_where *item, const char *value);int trailer_set_if_exists (enum trailer_if_exists *item,const char *value);int trailer_set_if_missing (enum trailer_if_missing *item,const char *value);
Quoted 8 lines
trailer.h void parse_trailers_from_command_line_args(struct list_head *arg_head, · line 79
Quoted 3 lines
trailer.h +3
-0+size_t trailer_block_start (struct trailer_info *info); +size_t trailer_block_end (struct trailer_info *info); +int blank_line_before_trailer_block (struct trailer_info *info);And we need new accessors, which is a good change regardless of the answer to the "do we really want an extra pointer dereference? Shouldn't the existing 'private' and 'internal' label we see below sufficient?" question.
I am very surprised with your response here, because I was expecting the complete opposite reaction from reviewers --- something like
Hmph, we have to write accessor functions now when before we could just reach inside the struct directly? Isn't this just adding needless verbosity?
(perhaps with more dissatisfaction). Something tells me you meant "bad change" but accidentally wrote "good change". Am I correct?
Re: [PATCH v3 05/10] trailer: make trailer_info struct private
Quoted 12 lines · Linus Arver
Quoted 8 lines
trailer.h void parse_trailers_from_command_line_args(struct list_head *arg_head, · line 79
Quoted 3 lines
trailer.h +3
-0+size_t trailer_block_start (struct trailer_info *info); +size_t trailer_block_end (struct trailer_info *info); +int blank_line_before_trailer_block (struct trailer_info *info);And we need new accessors, which is a good change regardless of the answer to the "do we really want an extra pointer dereference? Shouldn't the existing 'private' and 'internal' label we see below sufficient?" question.
I am very surprised with your response here, because I was expecting the complete opposite reaction from reviewers --- something like
Quoted 6 lines
Hmph, we have to write accessor functions now when before we could just reach inside the struct directly? Isn't this just adding needless verbosity?
(perhaps with more dissatisfaction). Something tells me you meant "bad change" but accidentally wrote "good change". Am I correct?
I often make typoes and screw up my double negations, but not this time. While I still suspect that the extra secrecy afforded by using a pointer to an opaque structure is something unnecessary between friends, as coding convention, it would be a good change to introduce accessors and have them used by the API users, i.e. code outside the API implementation.
You can still "git grep" for references to the ".trailer_private" (or whatever the "private" members are named by convention) member outside the trailer "client code" to see if there are people who are too intimate than they should be that way, as they should all be using the published accessors.
PATCH v3 6/10 trailer: spread usage of "trailer_block" language
In reply to Linus Arver via GitGitGadgetFrom: Linus Arver <[email protected]>
Deprecate the "trailer_info" struct name and replace it with "trailer_block". The main reason is to help readability, because "trailer_info" on the surface sounds like it's about a single trailer when in reality it is a collection of contiguous lines, at least 25% of which are trailers.
--- builtin/interpret-trailers.c | 26 +++++----- trailer.c | 99 ++++++++++++++++++------------------ trailer.h | 18 +++---- 3 files changed, 71 insertions(+), 72 deletions(-)
builtin/interpret-trailers.c +13 -13
@@ -140,8 +140,8 @@ static void interpret_trailers(const struct process_trailer_options *opts, {LIST_HEAD (head);struct strbuf sb =STRBUF_INIT ; -struct strbuf trailer_block =STRBUF_INIT ; -struct trailer_info *info; +struct strbuf tb =STRBUF_INIT ; +struct trailer_block *trailer_block;FILE *outfile = stdout;trailer_config_init ();
@@ -151,13 +151,13 @@ static void interpret_trailers(const struct process_trailer_options *opts,if (opts->in_place) outfile =create_in_place_tempfile (file); - info =parse_trailers (opts, sb.buf, &head); + trailer_block =parse_trailers (opts, sb.buf, &head); -/* Print the lines before the trailers */ +/* Print the lines before the trailer block */ if (!opts->only_trailers) -fwrite (sb.buf,1 ,trailer_block_start (info), outfile); +fwrite (sb.buf,1 ,trailer_block_start (trailer_block), outfile); -if (!opts->only_trailers && !blank_line_before_trailer_block (info)) +if (!opts->only_trailers && !blank_line_before_trailer_block (trailer_block))fprintf (outfile,"\n" );
@@ -171,17 +171,17 @@ static void interpret_trailers(const struct process_trailer_options *opts, }/* Print trailer block. */ -format_trailers (opts, &head, &trailer_block); -fwrite (trailer_block.buf,1 , trailer_block.len, outfile); -strbuf_release (&trailer_block); +format_trailers (opts, &head, &tb); +fwrite (tb.buf,1 , tb.len, outfile); +strbuf_release (&tb);free_trailers (&head); -/* Print the lines after the trailers as is */ +/* Print the lines after the trailer block as is */ if (!opts->only_trailers) -fwrite (sb.buf +trailer_block_end (info),1 , sb.len -trailer_block_end (info), outfile); - -trailer_info_release (info); +fwrite (sb.buf +trailer_block_end (trailer_block), +1 , sb.len -trailer_block_end (trailer_block), outfile); +trailer_block_release (trailer_block);if (opts->in_place)if (rename_tempfile (&trailers_tempfile, file))
trailer.c +49 -50
198 lines not on this page · raw message
trailer.h +9 -9
@@ -4,7 +4,7 @@#include "list.h" #include "strbuf.h" -struct trailer_info ; +struct trailer_block ;enum trailer_where {WHERE_DEFAULT ,
@@ -70,15 +70,15 @@ void parse_trailers_from_command_line_args(struct list_head *arg_head,void process_trailers_lists (struct list_head *head,struct list_head *arg_head); -struct trailer_info *parse_trailers (const struct process_trailer_options *opts, -const char *str, -struct list_head *head); +struct trailer_block *parse_trailers (const struct process_trailer_options *opts, +const char *str, +struct list_head *head); -size_t trailer_block_start (struct trailer_info *info); -size_t trailer_block_end (struct trailer_info *info); -int blank_line_before_trailer_block (struct trailer_info *info); +size_t trailer_block_start (struct trailer_block *trailer_block); +size_t trailer_block_end (struct trailer_block *trailer_block); +int blank_line_before_trailer_block (struct trailer_block *trailer_block); -void trailer_info_release (struct trailer_info *info); +void trailer_block_release (struct trailer_block *trailer_block);void trailer_config_init (void ); void format_trailers(const struct process_trailer_options *opts,
@@ -123,7 +123,7 @@ struct trailer_iterator {/* private */ struct { -struct trailer_info *info; +struct trailer_block *trailer_block;size_t cur; } internal; };
Signature · 1 line
gitgitgadget
Re: [PATCH v3 06/10] trailer: spread usage of "trailer_block" language
Quoted 7 lines · Linus Arver via GitGitGadget
From: Linus Arver <[email protected]>
Deprecate the "
trailer_info" struct name and replace it with "trailer_block". The main reason is to help readability, because "trailer_info" on the surface sounds like it's about a single trailer when in reality it is a collection of contiguous lines, at least 25% of which are trailers.
Yup, "info" is usually a fairly meaningless word. At least "block" may imply it is a collection of trailers.
The naming would not matter as much to the API users, if the thing is now opaque, though.
Re: [PATCH v3 06/10] trailer: spread usage of "trailer_block" language
Quoted 10 lines · Junio C Hamano
Quoted 7 lines · Linus Arver via GitGitGadget
From: Linus Arver <[email protected]>
Deprecate the "
trailer_info" struct name and replace it with "trailer_block". The main reason is to help readability, because "trailer_info" on the surface sounds like it's about a single trailer when in reality it is a collection of contiguous lines, at least 25% of which are trailers.
Quoted 5 lines
Yup, "info" is usually a fairly meaningless word. At least "block" may imply it is a collection of trailers.
The naming would not matter as much to the API users, if the thing is now opaque, though.
You make an interesting point (and I agree).
If we were to provide additional private structs named "trailer_<foo>" at that point we should think about how these <foo> parts "interact" with each other (if you will) in terms of names. For example we probably would never want to name a struct "trailer_block_parser" if it has no relationship to the existing "trailer_block" struct. More elaborate APIs might design a particular naming scheme (with some rules about certain suffixes, perhaps, for opaque pointers that all behave a certain way).
But such naming considerations would naturally come into view independent of this public vs public struct discussion, so I think the above paragraph is moot.
PATCH v3 7/10 trailer: prepare to move parse_trailers_from_command_line_args() to builtin
In reply to Linus Arver via GitGitGadgetFrom: Linus Arver <[email protected]>
Expose more functions in the trailer.h API, in preparation for moving out
parse_trailers_from_command_line_args()
to interpret-trailer.c, because the trailer API should not be concerned with command line arguments (as they have nothing to do with trailers themselves). The interpret-trailers builtin is the only caller of this function.
Rename add_arg_item() to trailer_add_arg_item() because it will have to be exposed as an API function in the next patch. Rename new_trailers_clear() to free_new_trailers() because it will be promoted into an API function; the API already has free_trailers(), so using the "free_*" naming style will keep it consistent. Also rename "conf_info" to "trailer_conf" for readability, dropping the low-value "_info" suffix as we did earlier in this series for "trailer_info" to "trailer_block".
--- builtin/interpret-trailers.c | 6 +-- trailer.c | 86 ++++++++++++++++++------------------ trailer.h | 10 +++++ 3 files changed, 55 insertions(+), 47 deletions(-)
builtin/interpret-trailers.c +3 -3
@@ -45,7 +45,7 @@ static int option_parse_if_missing(const struct option *opt,return trailer_set_if_missing (opt->value, arg); } -static void new_trailers_clear (struct list_head *trailers) +static void free_new_trailers (struct list_head *trailers) {struct list_head *pos, *tmp;struct new_trailer_item *item;
@@ -64,7 +64,7 @@ static int option_parse_trailer(const struct option *opt,struct new_trailer_item *item;if (unset) { -new_trailers_clear (trailers); +free_new_trailers (trailers);return 0 ; }
@@ -238,7 +238,7 @@ int cmd_interpret_trailers(int argc, const char **argv, const char *prefix)interpret_trailers (&opts, &trailers,NULL ); } -new_trailers_clear (&trailers); +free_new_trailers (&trailers);return 0 ; }
trailer.c +42 -44
223 lines not on this page · raw message
trailer.h +10 -0
@@ -5,6 +5,7 @@#include "strbuf.h" struct trailer_block ; +struct trailer_conf ;enum trailer_where {WHERE_DEFAULT ,
@@ -45,6 +46,9 @@ struct new_trailer_item {enum trailer_if_missing if_missing; }; +void duplicate_trailer_conf (struct trailer_conf *dst, +const struct trailer_conf *src); +struct process_trailer_options {int in_place;int trim_empty;
@@ -70,6 +74,12 @@ void parse_trailers_from_command_line_args(struct list_head *arg_head,void process_trailers_lists (struct list_head *head,struct list_head *arg_head); +ssize_t find_separator (const char *line,const char *separators); + +void parse_trailer (const char *line,ssize_t separator_pos, +struct strbuf *tok,struct strbuf *val, +const struct trailer_conf **conf); +struct trailer_block *parse_trailers (const struct process_trailer_options *opts,const char *str,struct list_head *head);
Signature · 1 line
gitgitgadget
Re: [PATCH v3 07/10] trailer: prepare to move parse_trailers_from_command_line_args() to builtin
Quoted 7 lines · Linus Arver via GitGitGadget
Rename
add_arg_item()totrailer_add_arg_item()because it will have to be exposed as an API function in the next patch. Renamenew_trailers_clear()tofree_new_trailers()because it will be promoted into an API function; the API already hasfree_trailers(), so using the "free_*" naming style will keep it consistent. Also rename "conf_info" to "trailer_conf" for readability, dropping the low-value "_info" suffix as we did earlier in this series for "trailer_info" to "trailer_block".
Makes sense.
Thanks.
PATCH v3 8/10 trailer: move arg handling to interpret-trailers.c
In reply to Linus Arver via GitGitGadgetFrom: Linus Arver <[email protected]>
We don't move the "arg_item" struct to interpret-trailers.c, because it is now a struct that contains information about trailers that could be added into the input text's own trailers. This is a generic concept that extends beyond trailers defined as CLI arguments (it applies to trailers defined in configuration as well). We will rename "arg_item" to "trailer_template" in a follow-up patch to keep the diff here small.
--- builtin/interpret-trailers.c | 88 ++++++++++++++++++++++-------------- trailer.c | 62 ++++++++++++++++++------- trailer.h | 12 +++++ 3 files changed, 112 insertions(+), 50 deletions(-)
builtin/interpret-trailers.c +55 -33
@@ -45,23 +45,17 @@ static int option_parse_if_missing(const struct option *opt,return trailer_set_if_missing (opt->value, arg); } -static void free_new_trailers (struct list_head *trailers) -{ -struct list_head *pos, *tmp; -struct new_trailer_item *item; - -list_for_each_safe (pos, tmp, trailers) { - item = list_entry(pos, struct new_trailer_item, list); -list_del (pos); -free (item); - } -} +static char *cl_separators;static int option_parse_trailer (const struct option *opt,const char *arg,int unset) {struct list_head *trailers = opt->value; -struct new_trailer_item *item; +struct strbuf tok =STRBUF_INIT ; +struct strbuf val =STRBUF_INIT ; +const struct trailer_conf *conf; +struct trailer_conf *conf_current =new_trailer_conf (); +ssize_t separator_pos;if (unset) {free_new_trailers (trailers);
@@ -71,12 +65,31 @@ static int option_parse_trailer(const struct option *opt,if (!arg)return -1 ; - item =xmalloc (sizeof (*item)); - item->text = arg; - item->where = where; - item->if_exists = if_exists; - item->if_missing = if_missing; -list_add_tail (&item->list, trailers); + separator_pos =find_separator (arg, cl_separators); +if (separator_pos) { +parse_trailer (arg, separator_pos, &tok, &val, &conf); +duplicate_trailer_conf (conf_current, conf); + +/* +* Override conf_current with settings specified via CLI flags. +*/ +trailer_conf_set (where, if_exists, if_missing, conf_current); + +trailer_add_arg_item (strbuf_detach (&tok,NULL ), +strbuf_detach (&val,NULL ), + conf_current, + trailers); + }else { +struct strbuf sb =STRBUF_INIT ; +strbuf_addstr (&sb, arg); +strbuf_trim (&sb); +error (_ ("empty trailer token in trailer '%.*s'" ), + (int ) sb.len, sb.buf); +strbuf_release (&sb); + } + +free (conf_current); +return 0 ; }
@@ -135,7 +148,7 @@ static void read_input_file(struct strbuf *sb, const char *file) }static void interpret_trailers (const struct process_trailer_options *opts, -struct list_head *new_trailer_head, +struct list_head *arg_trailers,const char *file) {LIST_HEAD (head);
@@ -144,8 +157,6 @@ static void interpret_trailers(const struct process_trailer_options *opts,struct trailer_block *trailer_block;FILE *outfile = stdout; -trailer_config_init (); -read_input_file (&sb, file);if (opts->in_place)
@@ -162,12 +173,7 @@ static void interpret_trailers(const struct process_trailer_options *opts,if (!opts->only_input) { -LIST_HEAD (config_head); -LIST_HEAD (arg_head); -parse_trailers_from_config (&config_head); -parse_trailers_from_command_line_args (&arg_head, new_trailer_head); -list_splice (&config_head, &arg_head); -process_trailers_lists (&head, &arg_head); +process_trailers_lists (&head, arg_trailers); }/* Print trailer block. */
@@ -193,7 +199,8 @@ static void interpret_trailers(const struct process_trailer_options *opts,int cmd_interpret_trailers (int argc,const char **argv,const char *prefix) {struct process_trailer_options opts =PROCESS_TRAILER_OPTIONS_INIT ; -LIST_HEAD (trailers); +LIST_HEAD (configured_trailers); +LIST_HEAD (arg_trailers);struct option options[] = {OPT_BOOL (0 ,"in-place" , &opts.in_place,N_ ("edit files in place" )),
@@ -212,33 +219,48 @@ int cmd_interpret_trailers(int argc, const char **argv, const char *prefix)OPT_CALLBACK_F (0 ,"parse" , &opts,NULL ,N_ ("alias for --only-trailers --only-input --unfold" ),PARSE_OPT_NOARG |PARSE_OPT_NONEG , parse_opt_parse),OPT_BOOL (0 ,"no-divider" , &opts.no_divider,N_ ("do not treat \"---\" as the end of input" )), -OPT_CALLBACK (0 ,"trailer" , &trailers,N_ ("trailer" ), +OPT_CALLBACK (0 ,"trailer" , &arg_trailers,N_ ("trailer" ),N_ ("trailer(s) to add" ), option_parse_trailer),OPT_END () };git_config (git_default_config,NULL ); +trailer_config_init (); + +if (!opts.only_input) { +parse_trailers_from_config (&configured_trailers); + } + +/* +* In command-line arguments, '=' is accepted (in addition to the +* separators that are defined). +*/ + cl_separators =xstrfmt ("=%s" ,trailer_default_separators ()); argc =parse_options (argc, argv, prefix, options, git_interpret_trailers_usage,0 ); -if (opts.only_input && !list_empty (&trailers)) +free (cl_separators); + +if (opts.only_input && !list_empty (&arg_trailers))usage_msg_opt (_ ("--trailer with --only-input does not make sense" ), git_interpret_trailers_usage, options); +list_splice (&configured_trailers, &arg_trailers); +if (argc) {int i;for (i =0 ; i < argc; i++) -interpret_trailers (&opts, &trailers, argv[i]); +interpret_trailers (&opts, &arg_trailers, argv[i]); }else {if (opts.in_place)die (_ ("no input file given for in-place editing" )); -interpret_trailers (&opts, &trailers,NULL ); +interpret_trailers (&opts, &arg_trailers,NULL ); } -free_new_trailers (&trailers); +free_new_trailers (&arg_trailers);return 0 ; }
trailer.c +45 -17
111 lines not on this page · raw message
trailer.h +12 -0
@@ -46,9 +46,20 @@ struct new_trailer_item {enum trailer_if_missing if_missing; }; +void trailer_conf_set (enum trailer_where where, +enum trailer_if_exists if_exists, +enum trailer_if_missing if_missing, +struct trailer_conf *conf); + +struct trailer_conf *new_trailer_conf (void );void duplicate_trailer_conf (struct trailer_conf *dst,const struct trailer_conf *src); +const char *trailer_default_separators (void ); + +void trailer_add_arg_item (char *tok,char *val,const struct trailer_conf *conf, +struct list_head *arg_head); +struct process_trailer_options {int in_place;int trim_empty;
@@ -95,6 +106,7 @@ void format_trailers(const struct process_trailer_options *opts,struct list_head *trailers, struct strbuf *out);void free_trailers (struct list_head *); +void free_new_trailers (struct list_head *);/* * Convenience function to format the trailers from the commit msg "msg" into
Signature · 1 line
gitgitgadget
Re: [PATCH v3 08/10] trailer: move arg handling to interpret-trailers.c
Quoted 26 lines · Linus Arver via GitGitGadget
From: Linus Arver <[email protected]>
We don't move the "
arg_item" struct tointerpret-trailers.c, because it is now a struct that contains information about trailers that could be added into the input text's own trailers. This is a generic concept that extends beyond trailers defined as CLI arguments (it applies to trailers defined in configuration as well). We will rename "arg_item" to "trailer_template" in a follow-up patch to keep the diff here small.Signed-off-by Linus Arver <[email protected]>--- builtin/interpret-trailers.c | 88 ++++++++++++++++++++++-------------- trailer.c | 62 ++++++++++++++++++------- trailer.h | 12 +++++ 3 files changed, 112 insertions(+), 50 deletions(-)builtin/interpret-trailers.c +0
-2@@ -45,23 +45,17 @@ static int option_parse_if_missing(const struct option *opt,return trailer_set_if_missing (opt->value, arg); } -static void free_new_trailers (struct list_head *trailers) -{
builtin/interpret-trailers.c static int option_parse_if_missing(const struct option *opt, · line 48
Quoted 10 lines
builtin/interpret-trailers.c +1
-9-struct list_head *pos, *tmp; -struct new_trailer_item *item; - -list_for_each_safe (pos, tmp, trailers) { - item = list_entry(pos, struct new_trailer_item, list); -list_del (pos); -free (item); - } -} +static char *cl_separators;
It somehow feels ugly and goes backward to depend on a new global, especially when you are aiming to libify more things. If we are doing something like ...
Quoted 21 lines
builtin/interpret-trailers.c +5
-5static int option_parse_trailer (const struct option *opt,const char *arg,int unset) {struct list_head *trailers = opt->value; -struct new_trailer_item *item; +struct strbuf tok =STRBUF_INIT ; +struct strbuf val =STRBUF_INIT ; +const struct trailer_conf *conf; +struct trailer_conf *conf_current =new_trailer_conf (); +ssize_t separator_pos;if (unset) {free_new_trailers (trailers);@@ -71,12 +65,31 @@ static int option_parse_trailer(const struct option *opt,if (!arg)return -1 ; - item =xmalloc (sizeof (*item)); - item->text = arg; - item->where = where; - item->if_exists = if_exists;
builtin/interpret-trailers.c static int option_parse_trailer(const struct option *opt, · line 75
Quoted 10 lines
builtin/interpret-trailers.c +8
-2- item->if_missing = if_missing; -list_add_tail (&item->list, trailers); + separator_pos =find_separator (arg, cl_separators); +if (separator_pos) { +parse_trailer (arg, separator_pos, &tok, &val, &conf); +duplicate_trailer_conf (conf_current, conf); + +/* +* Override conf_current with settings specified via CLI flags. +*/
... this, which apparently needs to know that we are dealing with input from CLI, shouldn't we be able to do the "CLI allows '=' as well as whatever is the default" here, instead of mucking with the global variable in the caller?
Even if you plan to later make this function callable from outside the context of parse_options() callback, and if you do not want "CLI allows '=' as well" for such new callers, we should be able to have a shared helper function that is the bulk of this function but takes additional parameter to tweak its behaviour slightly depending on the needs of the callers?
builtin/interpret-trailers.c static int option_parse_trailer(const struct option *opt, · line 76
Quoted 1 line
builtin/interpret-trailers.c +1
-0+trailer_conf_set (where, if_exists, if_missing, conf_current);
I am getting an impression that the use of and the introduction of the new helper, mixed with movement of the responsibility, makes reviewing the change unnecessarily more cumbersome. An equivalent series with a few more steps, each of them focusing on a small change (like, "updating the conf_current members is done with assignments that appear as a pattern very often---introduce a helper to reduce boilerplate") would have been more enticing to reviewers.
Quoted 38 lines
builtin/interpret-trailers.c +16
-3+trailer_add_arg_item (strbuf_detach (&tok,NULL ), +strbuf_detach (&val,NULL ), + conf_current, + trailers); + }else { +struct strbuf sb =STRBUF_INIT ; +strbuf_addstr (&sb, arg); +strbuf_trim (&sb); +error (_ ("empty trailer token in trailer '%.*s'" ), + (int ) sb.len, sb.buf); +strbuf_release (&sb); + } + +free (conf_current); +return 0 ; }@@ -135,7 +148,7 @@ static void read_input_file(struct strbuf *sb, const char *file) }static void interpret_trailers (const struct process_trailer_options *opts, -struct list_head *new_trailer_head, +struct list_head *arg_trailers,const char *file) {LIST_HEAD (head);@@ -144,8 +157,6 @@ static void interpret_trailers(const struct process_trailer_options *opts,struct trailer_block *trailer_block;FILE *outfile = stdout; -trailer_config_init (); -read_input_file (&sb, file);if (opts->in_place)@@ -162,12 +173,7 @@ static void interpret_trailers(const struct process_trailer_options *opts,
builtin/interpret-trailers.c static void interpret_trailers(const struct process_trailer_options *opts, · line 177
Quoted 10 lines
builtin/interpret-trailers.c +1
-6if (!opts->only_input) { -LIST_HEAD (config_head); -LIST_HEAD (arg_head); -parse_trailers_from_config (&config_head); -parse_trailers_from_command_line_args (&arg_head, new_trailer_head); -list_splice (&config_head, &arg_head); -process_trailers_lists (&head, &arg_head); +process_trailers_lists (&head, arg_trailers); }
So, the bulk of the parsing is no longer responsibility of this function. Instead, the caller (e.g., cmd_interpret_trailers()) is expected to do that before they call us.
builtin/interpret-trailers.c int cmd_interpret_trailers(int argc, const char **argv, const char *prefix) · line 232
Quoted 7 lines
...
builtin/interpret-trailers.c +5
-0git_config (git_default_config,NULL ); +trailer_config_init (); + +if (!opts.only_input) { +parse_trailers_from_config (&configured_trailers); + }
By the way, until we add more statements in this block, lose the unnecessary {} around it.
Quoted 9 lines
builtin/interpret-trailers.c +5
-0+/* +* In command-line arguments, '=' is accepted (in addition to the +* separators that are defined). +*/ + cl_separators =xstrfmt ("=%s" ,trailer_default_separators ()); argc =parse_options (argc, argv, prefix, options, git_interpret_trailers_usage,0 );
builtin/interpret-trailers.c int cmd_interpret_trailers(int argc, const char **argv, const char *prefix) · line 251
Quoted 10 lines
builtin/interpret-trailers.c +4
-1-if (opts.only_input && !list_empty (&trailers)) +free (cl_separators); + +if (opts.only_input && !list_empty (&arg_trailers))usage_msg_opt (_ ("--trailer with --only-input does not make sense" ), git_interpret_trailers_usage, options); +list_splice (&configured_trailers, &arg_trailers);
This corresponds to what the old code did in interpret_trailers(), OK.
The move of the responsibility may make sense.
Quoted 39 lines
builtin/interpret-trailers.c +3
-3if (argc) {int i;for (i =0 ; i < argc; i++) -interpret_trailers (&opts, &trailers, argv[i]); +interpret_trailers (&opts, &arg_trailers, argv[i]); }else {if (opts.in_place)die (_ ("no input file given for in-place editing" )); -interpret_trailers (&opts, &trailers,NULL ); +interpret_trailers (&opts, &arg_trailers,NULL ); } -free_new_trailers (&trailers); +free_new_trailers (&arg_trailers);return 0 ; }trailer.c +7
-0@@ -66,6 +66,11 @@ static LIST_HEAD(conf_head);static char *separators =":" ; +const char *trailer_default_separators (void ) +{ +return separators; +} +static int configured;#define TRAILER_ARG_STRING "$ARG"@@ -424,6 +429,25 @@ int trailer_set_if_missing(enum trailer_if_missing *item, const char *value)return 0 ; } +void trailer_conf_set(enum trailer_where where, + enum trailer_if_exists if_exists,
trailer.c int trailer_set_if_missing(enum trailer_if_missing *item, const char *value) · line 443
Quoted 10 lines
trailer.c +10
-0+ enum trailer_if_missing if_missing, + struct trailer_conf *conf) +{ +if (where !=WHERE_DEFAULT ) + conf->where = where; +if (if_exists !=EXISTS_DEFAULT ) + conf->if_exists = if_exists; +if (if_missing !=MISSING_DEFAULT ) + conf->if_missing = if_missing; +}
So, this is such a helper function. It is curious that it deliberately lacks the ability to reset what has already been configured back to the default.
For example, we earlier saw this original code ...
trailer.c int trailer_set_if_missing(enum trailer_if_missing *item, const char *value)
Quoted 5 lines
trailer.c +0
-5- item =xmalloc (sizeof (*item)); - item->text = arg; - item->where = where; - item->if_exists = if_exists; - item->if_missing = if_missing;
... gets replaced with this call.
trailer.c
Quoted 3 lines
trailer.c +2
-0+struct trailer_conf *conf_current =new_trailer_conf (); +trailer_conf_set (where, if_exists, if_missing, conf_current);
For this conversion to be correct, we require that the value of the *_DEFAULT macro to be 0 and/or these three values getting assigned are not *_DEFAULT values. Maybe that may happen to be the case in today's code, but such an unwritten assumption makes me feel nervous.
I am not sure if it is worth the confusion factor to make a function whose name is $anything_set() to be making a conditional assignment. If such a conditional assignment *also* happens often and deserves to have its own helper, it is fine to have such a helper for conditional assignment, but calling it $anything_set() is probably a mistake.
Other than that, the main thrust of this step seems sensible.
Thanks.
Re: [PATCH v3 08/10] trailer: move arg handling to interpret-trailers.c
Quoted 7 lines · Junio C Hamano
"Linus Arver via GitGitGadget" <[email protected]> writes:
[...]
Other than that, the main thrust of this step seems sensible.
Thanks.
Quick update: I've broken down patches 3 and 4 into smaller pieces, and am now ready to break this one down, too.
Hopefully sometime over the weekend I'll have some answers ready for the many good questions you've raised. Thanks.
Re: [PATCH v3 08/10] trailer: move arg handling to interpret-trailers.c
In reply to Junio C HamanoQuoted 10 lines · Junio C Hamano
Quoted 8 lines · Linus Arver via GitGitGadget
builtin/interpret-trailers.c +0
-0@@ -45,23 +45,17 @@ static int option_parse_if_missing(const struct option *opt,return trailer_set_if_missing (opt->value, arg); }
Quoted 15 lines
builtin/interpret-trailers.c static int option_parse_if_missing(const struct option *opt, · line 48
Quoted 12 lines
builtin/interpret-trailers.c +1
-11-static void free_new_trailers (struct list_head *trailers) -{ -struct list_head *pos, *tmp; -struct new_trailer_item *item; - -list_for_each_safe (pos, tmp, trailers) { - item = list_entry(pos, struct new_trailer_item, list); -list_del (pos); -free (item); - } -} +static char *cl_separators;It somehow feels ugly and goes backward to depend on a new global, especially when you are aiming to libify more things.
Removed in the next reroll (we can just use a regular stack variable, not a global).
Quoted 6 lines
Even if you plan to later make this function callable from outside the context of
parse_options()callback, and if you do not want "CLI allows '=' as well" for such new callers, we should be able to have a shared helper function that is the bulk of this function but takes additional parameter to tweak its behaviour slightly depending on the needs of the callers?
I'll refrain from exploring this possibility in this series (and just make do with the non-global variable as described above) because of the additional pending changes around trailer configuration handling in the larger series. FWIW even in the larger series I don't think there's a need to have such a helper function.
Quoted 9 lines
builtin/interpret-trailers.c static int option_parse_trailer(const struct option *opt, · line 76
Quoted 1 line
builtin/interpret-trailers.c +1
-0+trailer_conf_set (where, if_exists, if_missing, conf_current);I am getting an impression that the use of and the introduction of the new helper, mixed with movement of the responsibility, makes reviewing the change unnecessarily more cumbersome. An equivalent series with a few more steps, each of them focusing on a small change (like, "updating the
conf_currentmembers is done with assignments that appear as a pattern very often---introduce a helper to reduce boilerplate") would have been more enticing to reviewers.
I've broken this patch down into smaller steps (along with the other notable patches in this series).
Quoted 39 lines
Quoted 39 lines
builtin/interpret-trailers.c +16
-3+trailer_add_arg_item (strbuf_detach (&tok,NULL ), +strbuf_detach (&val,NULL ), + conf_current, + trailers); + }else { +struct strbuf sb =STRBUF_INIT ; +strbuf_addstr (&sb, arg); +strbuf_trim (&sb); +error (_ ("empty trailer token in trailer '%.*s'" ), + (int ) sb.len, sb.buf); +strbuf_release (&sb); + } + +free (conf_current); +return 0 ; }@@ -135,7 +148,7 @@ static void read_input_file(struct strbuf *sb, const char *file) }static void interpret_trailers (const struct process_trailer_options *opts, -struct list_head *new_trailer_head, +struct list_head *arg_trailers,const char *file) {LIST_HEAD (head);@@ -144,8 +157,6 @@ static void interpret_trailers(const struct process_trailer_options *opts,struct trailer_block *trailer_block;FILE *outfile = stdout; -trailer_config_init (); -read_input_file (&sb, file);if (opts->in_place)@@ -162,12 +173,7 @@ static void interpret_trailers(const struct process_trailer_options *opts,
Quoted 13 lines
builtin/interpret-trailers.c static void interpret_trailers(const struct process_trailer_options *opts, · line 177
Quoted 9 lines
builtin/interpret-trailers.c +1
-6if (!opts->only_input) { -LIST_HEAD (config_head); -LIST_HEAD (arg_head); -parse_trailers_from_config (&config_head); -parse_trailers_from_command_line_args (&arg_head, new_trailer_head); -list_splice (&config_head, &arg_head); -process_trailers_lists (&head, &arg_head); +process_trailers_lists (&head, arg_trailers); }So, the bulk of the parsing is no longer responsibility of this function. Instead, the caller (e.g.,
cmd_interpret_trailers()) is expected to do that before they call us.
Yup. This movement of "parsing responsibility" logic should be easy to see in the next reroll (as it will be broken out separately).
Quoted 10 lines
builtin/interpret-trailers.c int cmd_interpret_trailers(int argc, const char **argv, const char *prefix) · line 232
Quoted 7 lines
...
builtin/interpret-trailers.c +5
-0git_config (git_default_config,NULL ); +trailer_config_init (); + +if (!opts.only_input) { +parse_trailers_from_config (&configured_trailers); + }By the way, until we add more statements in this block, lose the unnecessary {} around it.
Oops. Done.
Quoted 40 lines
Quoted 6 lines
builtin/interpret-trailers.c +2
-0@@ -424,6 +429,25 @@ int trailer_set_if_missing(enum trailer_if_missing *item, const char *value)return 0 ; } +void trailer_conf_set(enum trailer_where where, + enum trailer_if_exists if_exists,builtin/interpret-trailers.c int trailer_set_if_missing(enum trailer_if_missing *item, const char *value) · line 443
Quoted 10 lines
builtin/interpret-trailers.c +10
-0+ enum trailer_if_missing if_missing, + struct trailer_conf *conf) +{ +if (where !=WHERE_DEFAULT ) + conf->where = where; +if (if_exists !=EXISTS_DEFAULT ) + conf->if_exists = if_exists; +if (if_missing !=MISSING_DEFAULT ) + conf->if_missing = if_missing; +}So, this is such a helper function. It is curious that it deliberately lacks the ability to reset what has already been configured back to the default.
For example, we earlier saw this original code ...
builtin/interpret-trailers.c static int option_parse_trailer(const struct option *opt, · line 78
Quoted 5 lines
builtin/interpret-trailers.c +0
-5- item =xmalloc (sizeof (*item)); - item->text = arg; - item->where = where; - item->if_exists = if_exists; - item->if_missing = if_missing;... gets replaced with this call.
builtin/interpret-trailers.c
Quoted 3 lines
builtin/interpret-trailers.c +2
-0+struct trailer_conf *conf_current =new_trailer_conf (); +trailer_conf_set (where, if_exists, if_missing, conf_current);For this conversion to be correct, we require that the value of the
*_DEFAULTmacro to be 0 and/or these three values getting assigned are not*_DEFAULTvalues. Maybe that may happen to be the case in today's code, but such an unwritten assumption makes me feel nervous.
Quoted 6 lines
I am not sure if it is worth the confusion factor to make a function whose name is $anything_set() to be making a conditional assignment. If such a conditional assignment *also* happens often and deserves to have its own helper, it is fine to have such a helper for conditional assignment, but calling it $anything_set() is probably a mistake.
Agreed. I've split this out into separate helpers that do not have conditionals built into them.
Quoted 1 line
Other than that, the main thrust of this step seems sensible.
Ack.
Overall, for the next reroll I have the commits broken down and it is mostly the same. I just need to wait for CI to pass and update the cover letter, before sending it (as v4). Should be ready later tonight. Thanks.
PATCH v3 9/10 trailer: delete obsolete argument handling code from API
In reply to Linus Arver via GitGitGadgetFrom: Linus Arver <[email protected]>
This commit was not squashed with its parent in order to keep the diff separate (to make the additive changes in the parent easier to read).
Note that we remove the "new_trailer_item" struct, because it has some overlap with "arg_item" struct that also deals with trailers coming from the command line. The latter will be renamed to "trailer_template" in the next patch.
--- trailer.c | 39 --------------------------------------- trailer.h | 17 ----------------- 2 files changed, 56 deletions(-)
trailer.c +0 -39
@@ -744,45 +744,6 @@ void parse_trailers_from_config(struct list_head *config_head) } } -void parse_trailers_from_command_line_args (struct list_head *arg_head, -struct list_head *new_trailer_head) -{ -struct strbuf tok =STRBUF_INIT ; -struct strbuf val =STRBUF_INIT ; -const struct trailer_conf *conf; -struct list_head *pos; - -/* -* In command-line arguments, '=' is accepted (in addition to the -* separators that are defined). -*/ -char *cl_separators =xstrfmt ("=%s" , separators); - -/* Add an arg item for each trailer on the command line */ -list_for_each (pos, new_trailer_head) { -struct new_trailer_item *tr = - list_entry(pos, struct new_trailer_item, list); -ssize_t separator_pos =find_separator (tr->text, cl_separators); - -if (separator_pos ==0 ) { -struct strbuf sb =STRBUF_INIT ; -strbuf_addstr (&sb, tr->text); -strbuf_trim (&sb); -error (_ ("empty trailer token in trailer '%.*s'" ), - (int ) sb.len, sb.buf); -strbuf_release (&sb); - }else { -parse_trailer (tr->text, separator_pos, &tok, &val, &conf); -trailer_add_arg_item (strbuf_detach (&tok,NULL ), -strbuf_detach (&val,NULL ), - conf, - arg_head); - } - } - -free (cl_separators); -} -static const char *next_line (const char *str) {const char *nl =strchrnul (str,'\n' );
trailer.h +0 -17
@@ -32,20 +32,6 @@ int trailer_set_where(enum trailer_where *item, const char *value);int trailer_set_if_exists (enum trailer_if_exists *item,const char *value);int trailer_set_if_missing (enum trailer_if_missing *item,const char *value); -/* -* A list that represents newly-added trailers, such as those provided -* with the --trailer command line option of git-interpret-trailers. -*/ -struct new_trailer_item { -struct list_head list; - -const char *text; - -enum trailer_where where; -enum trailer_if_exists if_exists; -enum trailer_if_missing if_missing; -}; - void trailer_conf_set(enum trailer_where where, enum trailer_if_exists if_exists, enum trailer_if_missing if_missing,
@@ -79,9 +65,6 @@ struct process_trailer_options {void parse_trailers_from_config (struct list_head *config_head); -void parse_trailers_from_command_line_args (struct list_head *arg_head, -struct list_head *new_trailer_head); -void process_trailers_lists (struct list_head *head,struct list_head *arg_head);
Signature · 1 line
gitgitgadget
Re: [PATCH v3 09/10] trailer: delete obsolete argument handling code from API
Quoted 4 lines · Linus Arver via GitGitGadget
From: Linus Arver <[email protected]>
This commit was not squashed with its parent in order to keep the diff separate (to make the additive changes in the parent easier to read).
Hopefully we won't see such an artificial separation in the new iteration. As we saw, being able to compare before and after images in a single patch is useful while reviewing a change that is supposed to be making things cleaner without altering what they do.
Re: [PATCH v3 09/10] trailer: delete obsolete argument handling code from API
Quoted 11 lines · Junio C Hamano
Quoted 4 lines · Linus Arver via GitGitGadget
From: Linus Arver <[email protected]>
This commit was not squashed with its parent in order to keep the diff separate (to make the additive changes in the parent easier to read).
Hopefully we won't see such an artificial separation in the new iteration. As we saw, being able to compare before and after images in a single patch is useful while reviewing a change that is supposed to be making things cleaner without altering what they do.
Totally agree (and I'm reaping the benefits of this as well in the smaller preparatory refactoring changes I've made for the next reroll).
PATCH v3 10/10 trailer: introduce "template" term for readability
In reply to Linus Arver via GitGitGadgetFrom: Linus Arver <[email protected]>
The term "arg_item" is ambiguous because we use it to hold data for
(1) trailers specified as command line arguments (in builtin/interpret-trailers.c), and
(2) trailers specified in configuration,
and these are both used to ultimately insert new trailers (based on the contents of arg_item, acting as a kind of template) into some other set of existing trailers (such as those found in a trailer block inside a log message) that have already been parsed.
Rename "arg_item" to "trailer_template". This necessitates further renames to make the functions that act on these templates match the data structures (parameters) they act on:
- [*] add_arg_to_input_list() to apply_template_to_trailers() - [*] apply_arg_if_exists() to maybe_add_if_exists() - [*] apply_arg_if_missing() to maybe_add_if_missing() - apply_command() to run_command_from_template() - [*] apply_item_command() to populate_template_value() - free_arg_item() to free_template() (non-API function) - free_new_trailers() to free_trailer_templates() (API function) - get_conf_item() to get_or_add_template_by() - option_parse_trailer() to option_parse_trailer_template() - parse_trailers_from_config() to parse_trailer_templates_from_config() - [*] process_trailers_lists() to apply_trailer_templates() - token_from_item() to token_from_template() - token_matches_item to token_matches_template - [*] trailer_add_arg_item() to add_trailer_template() - trailer_from_arg() to trailer_from() - [*] check_if_different() (reorder parameters only) - [*] find_same_and_apply_arg() (reorder parameters only)
Reorder parameters where appropriate; these functions have been marked with an asterisk ([*]).
This removes the "arg" terminology (standing for "CLI arguments") from the trailer implementation, which makes sense because trailers themselves have nothing to do with CLI argument handling.
Also note that these renames expose the previously liberal use of "trailer" to mean both trailers we read from the input text (trailer block) and trailer templates that are defined as CLI args or configurations. Some functions implied a single action when they could do two different things, so introduce words like "maybe" and "or" to unmask their behavior.
In summary this patch renames and reorders parameters for readability, without any behavioral change. We don't rename find_same_and_apply_arg(), because it will be refactored soon. As an added benefit, we no longer use the term "arg" to mean "CLI arguments" in the trailer implementation, because trailers themselves should not be concerned about CLI arguments (this is the domain of the interpret-trailers builtin).
For parse_trailers_from_config() (renamed to parse_trailer_templates_from_config()), add a NEEDSWORK discussion about how the deprecated trailer.*.command configuration option is oddly more featureful than trailer.*.cmd (if we were to remove support for trailer.*.command, users would not be able to replicate the behavior with trailer.*.cmd and lose out on functionality).
--- builtin/interpret-trailers.c | 48 +++--- trailer.c | 292 +++++++++++++++++++---------------- trailer.h | 11 +- 3 files changed, 192 insertions(+), 159 deletions(-)
builtin/interpret-trailers.c +26 -22
@@ -47,10 +47,14 @@ static int option_parse_if_missing(const struct option *opt,static char *cl_separators; -static int option_parse_trailer (const struct option *opt, -const char *arg,int unset) +/* +* Interpret "--trailer ..." as trailer templates (trailers we want to add into +* the input text). +*/ +static int option_parse_trailer_template (const struct option *opt, +const char *arg,int unset) { -struct list_head *trailers = opt->value; +struct list_head *templates = opt->value;struct strbuf tok =STRBUF_INIT ;struct strbuf val =STRBUF_INIT ;const struct trailer_conf *conf;
@@ -58,7 +62,7 @@ static int option_parse_trailer(const struct option *opt,ssize_t separator_pos;if (unset) { -free_new_trailers (trailers); +free_trailer_templates (templates);return 0 ; }
@@ -75,10 +79,10 @@ static int option_parse_trailer(const struct option *opt,*/ trailer_conf_set (where, if_exists, if_missing, conf_current); -trailer_add_arg_item (strbuf_detach (&tok,NULL ), +add_trailer_template (strbuf_detach (&tok,NULL ),strbuf_detach (&val,NULL ), conf_current, - trailers); + templates); }else {struct strbuf sb =STRBUF_INIT ;strbuf_addstr (&sb, arg);
@@ -148,10 +152,10 @@ static void read_input_file(struct strbuf *sb, const char *file) }static void interpret_trailers (const struct process_trailer_options *opts, -struct list_head *arg_trailers, +struct list_head *templates,const char *file) { -LIST_HEAD (head); +LIST_HEAD (trailers_from_sb);struct strbuf sb =STRBUF_INIT ;struct strbuf tb =STRBUF_INIT ;struct trailer_block *trailer_block;
@@ -162,7 +166,7 @@ static void interpret_trailers(const struct process_trailer_options *opts,if (opts->in_place) outfile =create_in_place_tempfile (file); - trailer_block =parse_trailers (opts, sb.buf, &head); + trailer_block =parse_trailers (opts, sb.buf, &trailers_from_sb);/* Print the lines before the trailer block */ if (!opts->only_trailers)
@@ -173,15 +177,15 @@ static void interpret_trailers(const struct process_trailer_options *opts,if (!opts->only_input) { -process_trailers_lists (&head, arg_trailers); +apply_trailer_templates (templates, &trailers_from_sb); }/* Print trailer block. */ -format_trailers (opts, &head, &tb); +format_trailers (opts, &trailers_from_sb, &tb);fwrite (tb.buf,1 , tb.len, outfile);strbuf_release (&tb); -free_trailers (&head); +free_trailers (&trailers_from_sb);/* Print the lines after the trailer block as is */ if (!opts->only_trailers)
@@ -199,8 +203,8 @@ static void interpret_trailers(const struct process_trailer_options *opts,int cmd_interpret_trailers (int argc,const char **argv,const char *prefix) {struct process_trailer_options opts =PROCESS_TRAILER_OPTIONS_INIT ; -LIST_HEAD (configured_trailers); -LIST_HEAD (arg_trailers); +LIST_HEAD (configured_templates); +LIST_HEAD (templates);struct option options[] = {OPT_BOOL (0 ,"in-place" , &opts.in_place,N_ ("edit files in place" )),
@@ -219,8 +223,8 @@ int cmd_interpret_trailers(int argc, const char **argv, const char *prefix)OPT_CALLBACK_F (0 ,"parse" , &opts,NULL ,N_ ("alias for --only-trailers --only-input --unfold" ),PARSE_OPT_NOARG |PARSE_OPT_NONEG , parse_opt_parse),OPT_BOOL (0 ,"no-divider" , &opts.no_divider,N_ ("do not treat \"---\" as the end of input" )), -OPT_CALLBACK (0 ,"trailer" , &arg_trailers,N_ ("trailer" ), -N_ ("trailer(s) to add" ), option_parse_trailer), +OPT_CALLBACK (0 ,"trailer" , &templates,N_ ("trailer" ), +N_ ("trailer(s) to add" ), option_parse_trailer_template), OPT_END() };
@@ -228,7 +232,7 @@ int cmd_interpret_trailers(int argc, const char **argv, const char *prefix)trailer_config_init ();if (!opts.only_input) { -parse_trailers_from_config (&configured_trailers); +parse_trailer_templates_from_config (&configured_templates); }/*
@@ -242,25 +246,25 @@ int cmd_interpret_trailers(int argc, const char **argv, const char *prefix)free (cl_separators); -if (opts.only_input && !list_empty (&arg_trailers)) +if (opts.only_input && !list_empty (&templates))usage_msg_opt (_ ("--trailer with --only-input does not make sense" ), git_interpret_trailers_usage, options); -list_splice (&configured_trailers, &arg_trailers); +list_splice (&configured_templates, &templates);if (argc) {int i;for (i =0 ; i < argc; i++) -interpret_trailers (&opts, &arg_trailers, argv[i]); +interpret_trailers (&opts, &templates, argv[i]); }else {if (opts.in_place)die (_ ("no input file given for in-place editing" )); -interpret_trailers (&opts, &arg_trailers,NULL ); +interpret_trailers (&opts, &templates,NULL ); } -free_new_trailers (&arg_trailers); +free_trailer_templates (&templates);return 0 ; }
trailer.c +161 -131
525 lines not on this page · raw message
trailer.h +5 -6
@@ -43,8 +43,8 @@ void duplicate_trailer_conf(struct trailer_conf *dst,const char *trailer_default_separators (void ); -void trailer_add_arg_item (char *tok,char *val,const struct trailer_conf *conf, -struct list_head *arg_head); +void add_trailer_template (char *tok,char *val,const struct trailer_conf *conf, +struct list_head *templates);struct process_trailer_options {int in_place;
@@ -63,10 +63,9 @@ struct process_trailer_options {#define PROCESS_TRAILER_OPTIONS_INIT {0} -void parse_trailers_from_config (struct list_head *config_head); +void parse_trailer_templates_from_config (struct list_head *config_head); -void process_trailers_lists (struct list_head *head, -struct list_head *arg_head); +void apply_trailer_templates (struct list_head *templates,struct list_head *trailers_head);ssize_t find_separator (const char *line,const char *separators);
@@ -89,7 +88,7 @@ void format_trailers(const struct process_trailer_options *opts,struct list_head *trailers, struct strbuf *out);void free_trailers (struct list_head *); -void free_new_trailers (struct list_head *); +void free_trailer_templates (struct list_head *);/* * Convenience function to format the trailers from the commit msg "msg" into
Signature · 1 line
gitgitgadget
v4 cover Enrich Trailer API
In reply to Linus Arver via GitGitGadgetThis patch series is the first 10 patches of a larger cleanup/bugfix series (henceforth "larger series") I've been working on. The main goal of this series is to begin the process of "libifying" the trailer API. By "API" I mean the interface exposed in trailer.h. The larger series brings a number of additional cleanups (exposing and fixing some bugs along the way), and builds on top of this series.
When the larger series is merged, we will be in a good state to additionally pursue the following goals:
1. "API reuse inside Git": make the API expressive enough to eliminate any need by other parts of Git to use the interpret-trailers builtin as a subprocess (instead they could just use the API directly);
2. "API stability": add unit tests to codify the expected behavior of API functions; and
3. "API documentation": create developer-focused documentation to explain how to use the API effectively, noting any API limitations or anti-patterns.
The reason why the larger series itself doesn't tackle these goals directly is because I believe that API code should be thought from the ground up with a libification-focused perspective. Some structs and functions exposed in the API today should probably not be libified (read: kept in trailer.h) as is. For example, the "trailer_iterator" struct has a "private" member and it feels wrong to allow API users to peek inside here (and take at face value our future API users' pinky promise that they won't depend on those private internals not meant for public consumption).
One pattern we could use here to cleanly separate "what is the API" (publicly exposed) and "what is the implementation" (private) is the pointer-to-implementation ("pimpl") idiom. There may be other appropriate patterns, but I've chosen this one because it's a simple, low-level concept (put structs in foo.c instead of foo.h), which has far-reaching high-level consequences (API users must rely exclusively on the API to make use of such private structs, via opaque pointers). The pimpl idiom for C comes from the book "C Interfaces and Implementations" (see patch "trailer: make trailer_info struct private").
The idea of turning a public struct into a private one is a fundamental question of libification because it forces us to reconsider all of the data structures we have and how they're actually used by already existing users. For the trailer API, those existing users are the "interpret-trailers" builtin command, and anything else that includes the "trailer.h" header file (e.g., sequencer.c). One advantage of this idiom is that even the compiler understands it --- the compiler will loudly complain if you try to access the innards of a private struct through an opaque pointer.
Another advantage of this idiom is that it helps to reduce the probability of breaking changes in the API. Because a private struct's members are out of view from our users (they only know about opaque pointers to the private struct, not its members), we are free to modify the members of the struct at any time, as much as we like, as long as we don't break the semantics of the exposed API functions (which is why unit-testing these API functions will be crucial long-term).
If this pimpl idiom turns out to be a mistake, undoing it is easy --- just move the relevant struct definition from foo.c to the header file. So it's a great way to try things out without digging ourselves into a pit of despair that will be difficult to get out of.
With the libification-focused goals out of the way, let's turn to this patch series in more detail.
Currently, we have "process_trailers()" in trailer.h which does many different things (parse command-line arguments, create temporary files, etc) that are independent of the concept of "trailers". Keeping this function as an API function would make unit-testing it difficult. While there is no technical reason why we couldn't write unit tests for the smaller functions that are called within process_trailers(), doing so would involve testing private ("static" in trailer.c) functions instead of API functions, which defeats the goal of "API stability" mentioned earlier above.
As an alternative to how things are done in this patch series, we could keep trailer.h intact and decide to unit-test the existing "trailer_info_get()" function which does most of the trailer parsing work (and is used by sequencer.c). However this function wouldn't be easy to test either, because the resulting "trailer_info" struct merely contains the unparsed "trailers" lines. So the unit test (if it wants to inspect the result of parsing these lines) would have to invoke additional parsing functions itself. And at that point it would no longer be a unit test in the traditional sense, because it would be invoking multiple functions at once.
In summary this series breaks up "process_trailers()" into smaller pieces, exposing many of the parts relevant to trailer-related processing in trailer.h. This will force us to eventually introduce unit tests for these API functions, but that is a good thing for API stability.
In the future after libification is "complete", users external to Git will be able to use the same trailer processing API used by the interpret-trailers builtin. For example, a web server may want to parse trailers the same way that Git would parse them, without having to call interpret-trailers as a subprocess. This use case was the original motivation behind my work in this area.
Thanks to the aggressive refactoring in this series, I've been able to identify and fix several bugs in our existing implementation. Those fixes build on top of this series but were not included here, in order to keep this series small. Below is a "shortlog" of those fixes I have locally:
* "trailer: trailer replacement should not change its position" (If we found a trailer we'd like to replace, preserve its position relative to the other trailers found in the trailer block, instead of always moving it to the beginning or end of the entire trailer block.)
* "interpret-trailers: preserve trailers coming from the input" (Sometimes, the parsed trailers from the input will be formatted differently depending on whether we provide --only-trailers or not. Make the trailers that were not modified and which are coming directly from the input get formatted the same way, regardless of this flag.)
* "interpret-trailers: do not modify the input if NOP" (Refrain from subtracting or adding a newline around the patch divider "---" if we are not adding new trailers.)
* "trailer formatter: split up format_trailer() monolith" (Fix a bug in git-log where we still printed a blank newline even if we didn't want to format anything.)
* "interpret-trailers: fail if given unrecognized arguments" (E.g., for "--where", only accept recognized WHERE_* enum values. If we get something unrecognized, fail with an error instead of silently doing nothing. Ditto for "--if-exists" and "--if-missing".)
Notable changes in v4
=====================
* Patches 3, 4, 5, and 8 have been broken up into smaller steps. There are 28 instead of 10 patches now, but these 28 should be much easier to review than the (previously condensed) 10.
* NEW Patch 1: "trailer: free trailer_info after all related usage" fixes awkward use-after-free coding style
* NEW Patch 2: "shortlog: add test for de-duplicating folded trailers" increases test coverage related to trailer iterators and "unfold_value()"
* NEW Patch 27: "trailer_set_*(): put out parameter at the end" is a small refactor to reorder parameters.
* Patches 5-16: These smaller patches make up Patch 3 from v3.
* Patches 17-18: These smaller patches make up Patch 4 from v3.
* Patches 19-20: These smaller patches make up Patch 5 from v3.
* Patches 23-26: These smaller patches make up Patch 8 from v3.
* Anonymize unambiguous parameters in <trailer.h>.
Notable changes in v3
=====================
* Squashed Patch 4 into Patch 3 ("trailer: unify trailer formatting machinery"), to avoid breaking the build ("-Werror=unused-function" violations)
* NEW (Patch 10): Introduce "trailer template" terminology for readability (no behavioral change)
* (API function) Rename default_separators() to trailer_default_separators()
* (API function) Rename new_trailers_clear() to free_trailer_templates()
* trailer.h: for single-parameter functions, anonymize the parameter name to reduce verbosity
Notable changes in v2
=====================
* (cover letter) Discuss goals of the larger series in more detail, especially the pimpl idiom
* (cover letter) List bug fixes pending in the larger series that depend on this series
* Reorder function parameters to have trailer options at the beginning (and out parameters toward the end)
* "sequencer: use the trailer iterator": prefer C string instead of strbuf for new "raw" field
* Patch 1 (was Patch 2) also renames ensure_configured() to trailer_config_init() (forgot to rename this one previously)
Linus Arver (28):
trailer: free trailer_info _after_ all related usage
shortlog: add test for de-duplicating folded trailers
trailer: prepare to expose functions as part of API
trailer: move interpret_trailers() to interpret-trailers.c
trailer: start preparing for formatting unification trailer_info_get(): reorder parameters
format_trailers(): use strbuf instead of FILE format_trailer_info(): move "fast path" to caller format_trailers_from_commit(): indirectly call trailer_info_get() format_trailer_info(): use trailer_item objects format_trailer_info(): drop redundant unfold_value() format_trailer_info(): append newline for non-trailer lines
trailer: begin formatting unification format_trailer_info(): teach it about opts->trim_empty format_trailer_info(): avoid double-printing the separator
trailer: finish formatting unification
trailer: teach iterator about non-trailer lines
sequencer: use the trailer iterator
trailer: make trailer_info struct private
trailer: retire trailer_info_get() from API
trailer: spread usage of "trailer_block" language
trailer: prepare to delete "parse_trailers_from_command_line_args()"
trailer: add new helper functions to API trailer_add_arg_item(): drop new_trailer_item usage
trailer: deprecate "new_trailer_item" struct from API
trailer: unify "--trailer ..." arg handling trailer_set_*(): put out parameter at the end
trailer: introduce "template" term for readability
builtin/interpret-trailers.c | 189 ++++++-- pretty.c | 2 +- ref-filter.c | 2 +- sequencer.c | 27 +- t/t4201-shortlog.sh | 32 ++ trailer.c | 811 +++++++++++++++++------------------ trailer.h | 109 ++--- 7 files changed, 642 insertions(+), 530 deletions(-)
base-commit: a54a84b333adbecf7bc4483c0e36ed5878cac17b
Published-As: https://github.com/gitgitgadget/git/releases/tag/pr-1632%2Flistx%2Ftrailer-api-refactor-part-1-v4
Fetch-It-Via: git fetch https://github.com/gitgitgadget/git pr-1632/listx/trailer-api-refactor-part-1-v4
Pull-Request: https://github.com/gitgitgadget/git/pull/1632
Range-diff vs v3:
-: ----------- > 1: 652df25f30e trailer: free trailer_info _after_ all related usage -: ----------- > 2: fdccaca2ba0 shortlog: add test for de-duplicating folded trailers 1: 72cc12a3066 ! 3: 4372af244f0 trailer: prepare to expose functions as part of API
@@ Commit message
them by their "trailer" moniker, just like all the other functions already exposed by trailer.h.
- Take the opportunity to start putting trailer processions options (opts)
+ Take the opportunity to start putting trailer processing options (opts)
as the first parameter. This will be the pattern going forward in this series.
@@ trailer.c: void process_trailers(const char *file,
}
- print_all(outfile, &head, opts);
-+ format_trailers(opts, &head, outfile);
-
- free_all(&head);
++ format_trailers(opts, &head, outfile);
+ free_trailers(&head);
- trailer_info_release(&info);
/* Print the lines after the trailers as is */
+ if (!opts->only_trailers)
@@ trailer.c: void trailer_info_get(struct trailer_info *info, const char *str,
size_t nr = 0, alloc = 0;
char **last = NULL;
2: cafa39d1048 ! 4: 4073b8eb510 trailer: move interpret_trailers() to interpret-trailers.c
@@ Commit message
trailer: move interpret_trailers() to interpret-trailers.c
The interpret-trailers.c builtin is the only place we need to call
- interpret_trailers(), so move its definition there.
+ interpret_trailers(), so move its definition there (together with a few
+ helper functions called only by it) and remove its external declaration
+ from <trailer.h>.
- Delete the corresponding declaration from trailer.h, which then forces
- us to expose the working innards of that function. This enriches
- trailer.h with a more granular API, which can then be unit-tested in the
- future (because interpret_trailers() by itself does too many things to
- be able to be easily unit-tested).
+ Several helper functions that are called by interpret_trailers() remain
+ in trailer.c because other callers in the same file still call them.
+ Declare them in <trailer.h> so that interpret_trailers() (now in
+ builtin/interpret-trailers.c) can continue calling them as a trailer API
+ user.
+
+ This enriches <trailer.h> with a more granular API, which can then be
+ unit-tested in the future (because interpret_trailers() by itself does
+ too many things to be able to be easily unit-tested).
Take this opportunity to demote some file-handling functions out of the trailer API implementation, as these have nothing to do with trailers.
+ Helped-by: Junio C Hamano <[email protected]>
## builtin/interpret-trailers.c ##
@@ builtin/interpret-trailers.c: static int parse_opt_parse(const struct option *op
+ }
+
+ format_trailers(opts, &head, outfile);
-+
+ free_trailers(&head);
-+ trailer_info_release(&info);
+
+ /* Print the lines after the trailers as is */
+ if (!opts->only_trailers)
+ fwrite(sb.buf + info.trailer_block_end, 1, sb.len - info.trailer_block_end, outfile);
++ trailer_info_release(&info);
+
+ if (opts->in_place)
+ if (rename_tempfile(&trailers_tempfile, file))
@@ trailer.c: static void free_trailers(struct list_head *trailers)
- }
-
- format_trailers(opts, &head, outfile);
--
- free_trailers(&head);
-- trailer_info_release(&info);
-
- /* Print the lines after the trailers as is */
- if (!opts->only_trailers)
- fwrite(sb.buf + info.trailer_block_end, 1, sb.len - info.trailer_block_end, outfile);
+- trailer_info_release(&info);
-
- if (opts->in_place)
- if (rename_tempfile(&trailers_tempfile, file))
@@ trailer.h: struct process_trailer_options {
+void process_trailers_lists(struct list_head *head,
+ struct list_head *arg_head);
+
-+void parse_trailers(const struct process_trailer_options *opts,
-+ struct trailer_info *info,
++void parse_trailers(const struct process_trailer_options *,
++ struct trailer_info *,
+ const char *str,
+ struct list_head *head);
@@ trailer.h: struct process_trailer_options {
void trailer_info_release(struct trailer_info *info);
+void trailer_config_init(void);
-+void format_trailers(const struct process_trailer_options *opts, ++void format_trailers(const struct process_trailer_options *,
+ struct list_head *trailers, FILE *outfile);
+void free_trailers(struct list_head *);
+
3: 5c7a2354df0 ! 5: b2a0f7829a1 trailer: unify trailer formatting machinery
@@ Metadata
Author: Linus Arver <[email protected]>
## Commit message ##
- trailer: unify trailer formatting machinery
+ trailer: start preparing for formatting unification
- Currently have two functions for formatting trailers exposed in
- trailer.h:
+ Currently there are two functions for formatting trailers in
+ <trailer.h>:
- void format_trailers(FILE *outfile, struct list_head *head,
- const struct process_trailer_options *opts);
+ void format_trailers(const struct process_trailer_options *,
+ struct list_head *trailers, FILE *outfile);
void format_trailers_from_commit(struct strbuf *out, const char *msg,
- const struct process_trailer_options *opts);
+ const struct process_trailer_options *opts);
- and previously these functions, although similar enough (even taking the
- same process_trailer_options struct pointer), did not build on each
- other.
+ and although they are similar enough (even taking the same
+ process_trailer_options struct pointer) they are used quite differently.
+ One might intuitively think that format_trailers_from_commit() builds on
+ top of format_trailers(), but this is not the case. Instead
+ format_trailers_from_commit() calls format_trailer_info() and
+ format_trailers() is never called in that codepath.
- Make format_trailers_from_commit() rely on format_trailers(). Teach
- format_trailers() to process trailers with the additional
- process_trailer_options fields like opts->key_only which is only used by
- format_trailers_from_commit() and not builtin/interpret-trailers.c.
- While we're at it, reorder parameters to put the trailer processing
- options first, and the out parameter (strbuf we write into) at the end.
+ This is a preparatory refactor to help us deprecate format_trailers() in
+ favor of format_trailer_info() (at which point we can rename the latter
+ to the former). When the deprecation is complete, both
+ format_trailers_from_commit(), and the interpret-trailers builtin will
+ be able to call into the same helper function (instead of
+ format_trailers() and format_trailer_info(), respectively). Unifying the
+ formatters is desirable because it simplifies the API.
- This unification will allow us to delete the format_trailer_info() and
- print_tok_val() functions in the next patch. They are not deleted here
- in order to keep the diff small.
+ Reorder parameters for format_trailers_from_commit() to prefer
- Helped-by: Junio C Hamano <[email protected]>
- Signed-off-by: Linus Arver <[email protected]>
+ const struct process_trailer_options *opts
- ## builtin/interpret-trailers.c ##
-@@ builtin/interpret-trailers.c: static void interpret_trailers(const struct process_trailer_options *opts,
- {
- LIST_HEAD(head);
- struct strbuf sb = STRBUF_INIT;
-+ struct strbuf trailer_block = STRBUF_INIT;
- struct trailer_info info;
- FILE *outfile = stdout;
-
-@@ builtin/interpret-trailers.c: static void interpret_trailers(const struct process_trailer_options *opts,
- process_trailers_lists(&head, &arg_head);
- }
-
-- format_trailers(opts, &head, outfile);
-+ /* Print trailer block. */
-+ format_trailers(opts, &head, &trailer_block);
-+ fwrite(trailer_block.buf, 1, trailer_block.len, outfile);
-+ strbuf_release(&trailer_block);
-
- free_trailers(&head);
- trailer_info_release(&info);
+ as the first parameter, because these options are intimately tied to
+ formatting trailers. And take
+
+ struct strbuf *out
+
+ last, because it's an "out parameter" (something that the caller wants
+ to use as the output of this function).
+
+ Signed-off-by: Linus Arver <[email protected]>
## pretty.c ##
@@ pretty.c: static size_t format_commit_one(struct strbuf *sb, /* in UTF-8 */
@@ ref-filter.c: static void grab_sub_body_contents(struct atom_value *val, int der
} else if (atom->u.contents.option == C_BARE)
## trailer.c ##
-@@ trailer.c: static char last_non_space_char(const char *s)
- return '\0';
- }
-
--static void print_tok_val(FILE *outfile, const char *tok, const char *val)
--{
-- char c;
--
-- if (!tok) {
-- fprintf(outfile, "%s\n", val);
-- return;
-- }
--
-- c = last_non_space_char(tok);
-- if (!c)
-- return;
-- if (strchr(separators, c))
-- fprintf(outfile, "%s%s\n", tok, val);
-- else
-- fprintf(outfile, "%s%c %s\n", tok, separators[0], val);
--}
--
--void format_trailers(const struct process_trailer_options *opts,
-- struct list_head *trailers, FILE *outfile)
--{
-- struct list_head *pos;
-- struct trailer_item *item;
-- list_for_each(pos, trailers) {
-- item = list_entry(pos, struct trailer_item, list);
-- if ((!opts->trim_empty || strlen(item->value) > 0) &&
-- (!opts->only_trailers || item->token))
-- print_tok_val(outfile, item->token, item->value);
-- }
--}
--
- static struct trailer_item *trailer_from_arg(struct arg_item *arg_tok)
- {
- struct trailer_item *new_item = xcalloc(1, sizeof(*new_item));
-@@ trailer.c: static void unfold_value(struct strbuf *val)
- strbuf_release(&out);
- }
-
-+void format_trailers(const struct process_trailer_options *opts,
-+ struct list_head *trailers,
-+ struct strbuf *out)
-+{
-+ struct list_head *pos;
-+ struct trailer_item *item;
-+ int need_separator = 0;
-+
-+ list_for_each(pos, trailers) {
-+ item = list_entry(pos, struct trailer_item, list);
-+ if (item->token) {
-+ char c;
-+
-+ struct strbuf tok = STRBUF_INIT;
-+ struct strbuf val = STRBUF_INIT;
-+ strbuf_addstr(&tok, item->token);
-+ strbuf_addstr(&val, item->value);
-+
-+ /*
-+ * Skip key/value pairs where the value was empty. This
-+ * can happen from trailers specified without a
-+ * separator, like `--trailer "Reviewed-by"` (no
-+ * corresponding value).
-+ */
-+ if (opts->trim_empty && !strlen(item->value))
-+ continue;
-+
-+ if (!opts->filter || opts->filter(&tok, opts->filter_data)) {
-+ if (opts->unfold)
-+ unfold_value(&val);
-+
-+ if (opts->separator && need_separator)
-+ strbuf_addbuf(out, opts->separator);
-+ if (!opts->value_only)
-+ strbuf_addbuf(out, &tok);
-+ if (!opts->key_only && !opts->value_only) {
-+ if (opts->key_value_separator)
-+ strbuf_addbuf(out, opts->key_value_separator);
-+ else {
-+ c = last_non_space_char(tok.buf);
-+ if (c) {
-+ if (!strchr(separators, c))
-+ strbuf_addf(out, "%c ", separators[0]);
-+ }
-+ }
-+ }
-+ if (!opts->key_only)
-+ strbuf_addbuf(out, &val);
-+ if (!opts->separator)
-+ strbuf_addch(out, '\n');
-+
-+ need_separator = 1;
-+ }
-+
-+ strbuf_release(&tok);
-+ strbuf_release(&val);
-+ } else if (!opts->only_trailers) {
-+ if (opts->separator && need_separator) {
-+ strbuf_addbuf(out, opts->separator);
-+ }
-+ strbuf_addstr(out, item->value);
-+ if (opts->separator)
-+ strbuf_rtrim(out);
-+ else
-+ strbuf_addch(out, '\n');
-+
-+ need_separator = 1;
-+ }
-+
-+ }
-+}
-+
- /*
- * Parse trailers in "str", populating the trailer info and "head"
- * linked list structure.
@@ trailer.c: void trailer_info_release(struct trailer_info *info)
free(info->trailers);
}
-static void format_trailer_info(struct strbuf *out,
-- const struct trailer_info *info,
-- const char *msg,
++static void format_trailer_info(const struct process_trailer_options *opts,
+ const struct trailer_info *info,
+ const char *msg,
- const struct process_trailer_options *opts)
-+void format_trailers_from_commit(const struct process_trailer_options *opts,
-+ const char *msg,
-+ struct strbuf *out)
++ struct strbuf *out)
{
-- size_t origlen = out->len;
-- size_t i;
-+ LIST_HEAD(head);
-+ struct trailer_info info;
-+
-+ parse_trailers(opts, &info, msg, &head);
+ size_t origlen = out->len;
+ size_t i;
+@@ trailer.c: static void format_trailer_info(struct strbuf *out,
+
+ }
- /* If we want the whole block untouched, we can take the fast path. */
- if (!opts->only_trailers && !opts->unfold && !opts->filter &&
- !opts->separator && !opts->key_only && !opts->value_only &&
- !opts->key_value_separator) {
-- strbuf_add(out, msg + info->trailer_block_start,
-- info->trailer_block_end - info->trailer_block_start);
-- return;
-- }
--
-- for (i = 0; i < info->trailer_nr; i++) {
-- char *trailer = info->trailers[i];
-- ssize_t separator_pos = find_separator(trailer, separators);
--
-- if (separator_pos >= 1) {
-- struct strbuf tok = STRBUF_INIT;
-- struct strbuf val = STRBUF_INIT;
--
-- parse_trailer(&tok, &val, NULL, trailer, separator_pos);
-- if (!opts->filter || opts->filter(&tok, opts->filter_data)) {
-- if (opts->unfold)
-- unfold_value(&val);
--
-- if (opts->separator && out->len != origlen)
-- strbuf_addbuf(out, opts->separator);
-- if (!opts->value_only)
-- strbuf_addbuf(out, &tok);
-- if (!opts->key_only && !opts->value_only) {
-- if (opts->key_value_separator)
-- strbuf_addbuf(out, opts->key_value_separator);
-- else
-- strbuf_addstr(out, ": ");
-- }
-- if (!opts->key_only)
-- strbuf_addbuf(out, &val);
-- if (!opts->separator)
-- strbuf_addch(out, '\n');
-- }
-- strbuf_release(&tok);
-- strbuf_release(&val);
--
-- } else if (!opts->only_trailers) {
-- if (opts->separator && out->len != origlen) {
-- strbuf_addbuf(out, opts->separator);
-- }
-- strbuf_addstr(out, trailer);
-- if (opts->separator) {
-- strbuf_rtrim(out);
-- }
-- }
-- }
--
--}
--
-void format_trailers_from_commit(struct strbuf *out, const char *msg,
- const struct process_trailer_options *opts)
--{
-- struct trailer_info info;
-+ strbuf_add(out, msg + info.trailer_block_start,
-+ info.trailer_block_end - info.trailer_block_start);
-+ } else
-+ format_trailers(opts, &head, out);
++void format_trailers_from_commit(const struct process_trailer_options *opts,
++ const char *msg,
++ struct strbuf *out)
+ {
+ struct trailer_info info;
-- trailer_info_get(&info, msg, opts);
+ trailer_info_get(&info, msg, opts);
- format_trailer_info(out, &info, msg, opts);
-+ free_trailers(&head);
++ format_trailer_info(opts, &info, msg, out);
trailer_info_release(&info);
}
## trailer.h ##
-@@ trailer.h: void trailer_info_release(struct trailer_info *info);
-
- void trailer_config_init(void);
- void format_trailers(const struct process_trailer_options *opts,
-- struct list_head *trailers, FILE *outfile);
-+ struct list_head *trailers,
-+ struct strbuf *out);
- void free_trailers(struct list_head *);
-
- /*
-- * Format the trailers from the commit msg "msg" into the strbuf "out".
-- * Note two caveats about "opts":
-- *
-- * - this is primarily a helper for pretty.c, and not
-- * all of the flags are supported.
-- *
-- * - this differs from process_trailers slightly in that we always format
-- * only the trailer block itself, even if the "only_trailers" option is not
-- * set.
-+ * Convenience function to format the trailers from the commit msg "msg" into
-+ * the strbuf "out". Reuses format_trailers internally.
+@@ trailer.h: void free_trailers(struct list_head *);
+ * only the trailer block itself, even if the "only_trailers" option is not
+ * set.
*/
-void format_trailers_from_commit(struct strbuf *out, const char *msg,
- const struct process_trailer_options *opts);
-: ----------- > 6: c1760f80356 trailer_info_get(): reorder parameters
-: ----------- > 7: 9dc912b5bc5 format_trailers(): use strbuf instead of FILE
-: ----------- > 8: b97c06d8bc3 format_trailer_info(): move "fast path" to caller
-: ----------- > 9: 6906910417a format_trailers_from_commit(): indirectly call trailer_info_get()
-: ----------- > 10: f5b7ba08aa7 format_trailer_info(): use trailer_item objects
-: ----------- > 11: 457f2a839d5 format_trailer_info(): drop redundant unfold_value()
-: ----------- > 12: a72eca301f7 format_trailer_info(): append newline for non-trailer lines
-: ----------- > 13: ad77c33e457 trailer: begin formatting unification
-: ----------- > 14: 11f854399db format_trailer_info(): teach it about opts->trim_empty
-: ----------- > 15: ba1f387747b format_trailer_info(): avoid double-printing the separator
-: ----------- > 16: 31725832224 trailer: finish formatting unification
4: bf2b8e1a3c4 ! 17: 6f17c022b15 sequencer: use the trailer iterator @@ Metadata
Author: Linus Arver <[email protected]>
## Commit message ##
- sequencer: use the trailer iterator
+ trailer: teach iterator about non-trailer lines
- This patch allows for the removal of "trailer_info_get()" from the
- trailer.h API, which will be in the next patch.
+ Previously the iterator did not iterate over non-trailer lines. This was
+ somewhat unfortunate, because trailer blocks could have non-trailer
+ lines in them since 146245063e (trailer: allow non-trailers in trailer
+ block, 2016-10-21), which was before the iterator was created in
+ f0939a0eb1 (trailer: add interface for iterating over commit trailers,
+ 2020-09-27).
- Instead of calling "trailer_info_get()", which is a low-level function
- in the trailers implementation (trailer.c), call
- trailer_iterator_advance(), which was specifically designed for public
- consumption in f0939a0eb1 (trailer: add interface for iterating over
- commit trailers, 2020-09-27).
+ So if trailer API users wanted to iterate over all lines in a trailer
+ block (including non-trailer lines), they could not use the iterator and
+ were forced to use the lower-level trailer_info struct directly (which
+ provides a raw string array that includes all lines in the trailer
+ block).
- Avoiding "trailer_info_get()" means we don't have to worry about options
- like "no_divider" (relevant for parsing trailers). We also don't have to
- check for things like "info.trailer_start == info.trailer_end" to see
- whether there were any trailers (instead we can just check to see
- whether the iterator advanced at all).
+ Change the iterator's behavior so that we also iterate over non-trailer
+ lines, instead of skipping over them. The new "raw" member of the
+ iterator allows API users to access previously inaccessible non-trailer
+ lines. Reword the variable "trailer" to just "line" because this
+ variable can now hold both trailer lines _and_ non-trailer lines.
- Also, teach the iterator about non-trailer lines, by adding a new field
- called "raw" to hold both trailer and non-trailer lines. This is
- necessary because a "trailer block" is a list of trailer lines of at
- least 25% trailers (see 146245063e (trailer: allow non-trailers in
- trailer block, 2016-10-21)), such that it may hold non-trailer lines.
+ The new "raw" member is important because anyone currently not using the
+ iterator is using trailer_info's raw string array directly to access
+ lines to check what the combined key + value looks like. If we didn't
+ provide a "raw" member here, iterator users would have to re-construct
+ the unparsed line by concatenating the key and value back together again
+ --- which places an undue burden for iterator users.
- Signed-off-by: Linus Arver <[email protected]>
+ The next patch demonstrates the use of the iterator in sequencer.c as an
+ example of where "raw" will be useful, so that it can start using the
+ iterator.
- ## builtin/shortlog.c ##
-@@ builtin/shortlog.c: static void insert_records_from_trailers(struct shortlog *log,
- const char *oneline)
- {
- struct trailer_iterator iter;
-- const char *commit_buffer, *body;
-+ const char *commit_buffer, *body, *value;
- struct strbuf ident = STRBUF_INIT;
-
- if (!log->trailers.nr)
-@@ builtin/shortlog.c: static void insert_records_from_trailers(struct shortlog *log, -
- trailer_iterator_init(&iter, body);
- while (trailer_iterator_advance(&iter)) {
-- const char *value = iter.val.buf;
-+ if (!iter.is_trailer)
-+ continue;
-+
-+ value = iter.val.buf;
-
- if (!string_list_has_string(&log->trailers, iter.key.buf))
- continue;
+ For the existing use of the iterator in builtin/shortlog.c, we don't
+ have to change the code there because that code does
- ## sequencer.c ##
-@@ sequencer.c: static const char *get_todo_path(const struct replay_opts *opts)
- static int has_conforming_footer(struct strbuf *sb, struct strbuf *sob,
- size_t ignore_footer)
- {
-- struct process_trailer_options opts = PROCESS_TRAILER_OPTIONS_INIT;
-- struct trailer_info info;
-- size_t i;
-- int found_sob = 0, found_sob_last = 0;
-- char saved_char;
--
-- opts.no_divider = 1;
-+ struct trailer_iterator iter;
-+ size_t i = 0, found_sob = 0;
-+ char saved_char = sb->buf[sb->len - ignore_footer];
-
- if (ignore_footer) {
-- saved_char = sb->buf[sb->len - ignore_footer];
- sb->buf[sb->len - ignore_footer] = '\0';
- }
-
-- trailer_info_get(&info, sb->buf, &opts);
-+ trailer_iterator_init(&iter, sb->buf);
-+ while (trailer_iterator_advance(&iter)) {
-+ i++;
-+ if (sob &&
-+ iter.is_trailer &&
-+ !strncmp(iter.raw, sob->buf, sob->len)) {
-+ found_sob = i;
-+ }
-+ }
-+ trailer_iterator_release(&iter);
-
- if (ignore_footer)
- sb->buf[sb->len - ignore_footer] = saved_char;
-
-- if (info.trailer_block_start == info.trailer_block_end)
-+ if (!i)
- return 0;
-
-- for (i = 0; i < info.trailer_nr; i++)
-- if (sob && !strncmp(info.trailers[i], sob->buf, sob->len)) {
-- found_sob = 1;
-- if (i == info.trailer_nr - 1)
-- found_sob_last = 1;
-- }
--
-- trailer_info_release(&info);
--
-- if (found_sob_last)
-+ if (found_sob == i)
- return 3;
- if (found_sob)
- return 2;
+ trailer_iterator_init(&iter, body);
+ while (trailer_iterator_advance(&iter)) {
+ const char *value = iter.val.buf;
+
+ if (!string_list_has_string(&log->trailers, iter.key.buf))
+ continue;
+
+ ...
+
+ and the
+
+ if (!string_list_has_string(&log->trailers, iter.key.buf))
+
+ condition already skips over non-trailer lines (iter.key.buf is empty
+ for non-trailer lines, making the comparison still work unmodified even
+ with this patch).
+
+ Signed-off-by: Linus Arver <[email protected]>
## trailer.c ##
@@ trailer.c: void trailer_iterator_init(struct trailer_iterator *iter, const char *msg)
@@ trailer.c: void trailer_iterator_init(struct trailer_iterator *iter, const char
-
- if (separator_pos < 1)
- continue; /* not a real trailer */
--
-+ char *line;
-+ int separator_pos;
+ if (iter->internal.cur < iter->internal.info.trailer_nr) {
-+ line = iter->internal.info.trailers[iter->internal.cur++];
-+ separator_pos = find_separator(line, separators);
-+ iter->is_trailer = (separator_pos > 0);
-+
++ char *line = iter->internal.info.trailers[iter->internal.cur++];
++ int separator_pos = find_separator(line, separators);
+
+ iter->raw = line;
strbuf_reset(&iter->key);
strbuf_reset(&iter->val);
parse_trailer(&iter->key, &iter->val, NULL,
- trailer, separator_pos);
+ line, separator_pos);
+ /* Always unfold values during iteration. */
unfold_value(&iter->val);
return 1;
- }
## trailer.h ##
-@@ trailer.h: struct trailer_iterator {
- struct strbuf key;
- struct strbuf val;
-
+@@ trailer.h: void format_trailers_from_commit(const struct process_trailer_options *,
+ * trailer_iterator_release(&iter);
+ */
+ struct trailer_iterator {
+ /*
+ * Raw line (e.g., "foo: bar baz") before being parsed as a trailer
+ * key/val pair as part of a trailer block. A trailer block can be
@@ trailer.h: struct trailer_iterator {
+ */
+ const char *raw;
+
-+ /*
-+ * 1 if the raw line was parsed as a trailer line (key/val pair).
-+ */
-+ int is_trailer;
-+
- /* private */
- struct {
- struct trailer_info info;
+ struct strbuf key;
+ struct strbuf val;
+
-: ----------- > 18: cc92dfb0bda sequencer: use the trailer iterator
5: c19c1dcc592 ! 19: f5f0d06613f trailer: make trailer_info struct private
@@ Commit message
(2) external API users are unable to peer inside this struct (because
it is only ever exposed as an opaque pointer).
- This change exposes some deficiencies in the API, mainly with regard to
- information about the location of the trailer block that was parsed.
- Expose new API functions to access this information (needed by
- builtin/interpret-trailers.c).
+ There are a couple disadvantages:
+
+ (A) every time the member of the struct is accessed an extra pointer
+ dereference must be done, and
+
+ (B) for users of trailer_info outside trailer.c, this struct can no
+ longer be allocated on the stack and may only be allocated on the
+ heap (because its definition is hidden away in trailer.c) and
+ appropriately deallocated by the user.
+
+ This patch believes that the benefits outweight the advantages for
+ designing APIs, as explained below.
+
+ Making trailer_info private exposes existing deficiencies in the API.
+ This is because users of this struct had full access to its internals,
+ so there wasn't much need to actually design it to be "complete" in the
+ sense that API users only needed to use what was provided by the API.
+ For example, the location of the trailer block (start/end offsets
+ relative to the start of the input text) was accessible by looking at
+ these struct members directly. Now that the struct is private, we have
+ to expose new API functions to allow clients to access this
+ information (see builtin/interpret-trailers.c).
The idea in this patch to hide implementation details behind an "opaque
pointer" is also known as the "pimpl" (pointer to implementation) idiom
@@ Commit message
In our case, "struct trailer_info" is now hidden from clients, and the
ways in which this opaque pointer can be used is limited to the richness
- of the trailer.h file. In other words, trailer.h exclusively controls
- exactly how "trailer_info" pointers are to be used.
+ of <trailer.h>. In other words, <trailer.h> exclusively controls exactly
+ how "trailer_info" pointers are to be used.
[1] Hanson, David R. "C Interfaces and Implementations: Techniques for
Creating Reusable Software". Addison Wesley, 1997. p. 22
+ Helped-by: Junio C Hamano <[email protected]>
Signed-off-by: Linus Arver <[email protected]>
## builtin/interpret-trailers.c ##
@@ builtin/interpret-trailers.c: static void interpret_trailers(const struct proces
@@ builtin/interpret-trailers.c: static void interpret_trailers(const struct process_trailer_options *opts,
- strbuf_release(&trailer_block);
-
- free_trailers(&head);
-- trailer_info_release(&info);
/* Print the lines after the trailers as is */
if (!opts->only_trailers)
- fwrite(sb.buf + info.trailer_block_end, 1, sb.len - info.trailer_block_end, outfile);
+- trailer_info_release(&info);
+ fwrite(sb.buf + trailer_block_end(info), 1, sb.len - trailer_block_end(info), outfile);
-+
+ trailer_info_release(info);
if (opts->in_place)
@@ trailer.c
struct conf_info {
char *name;
char *key;
-@@ trailer.c: void format_trailers(const struct process_trailer_options *opts,
- }
+@@ trailer.c: static void unfold_value(struct strbuf *val)
+ strbuf_release(&out);
}
+static struct trailer_info *trailer_info_new(void)
@@ trailer.c: void format_trailers(const struct process_trailer_options *opts,
+ struct trailer_info *info = xcalloc(1, sizeof(*info));
+ return info;
+}
-+
-+static struct trailer_info *trailer_info_get(const struct process_trailer_options *opts,
-+ const char *str)
-+{
-+ struct trailer_info *info = trailer_info_new();
-+ size_t end_of_log_message = 0, trailer_block_start = 0;
-+ struct strbuf **trailer_lines, **ptr;
-+ char **trailer_strings = NULL;
-+ size_t nr = 0, alloc = 0;
-+ char **last = NULL;
-+
-+ trailer_config_init();
-+
-+ end_of_log_message = find_end_of_log_message(str, opts->no_divider);
-+ trailer_block_start = find_trailer_block_start(str, end_of_log_message);
-+
-+ trailer_lines = strbuf_split_buf(str + trailer_block_start,
-+ end_of_log_message - trailer_block_start,
-+ '\n',
-+ 0);
-+ for (ptr = trailer_lines; *ptr; ptr++) {
-+ if (last && isspace((*ptr)->buf[0])) {
-+ struct strbuf sb = STRBUF_INIT;
-+ strbuf_attach(&sb, *last, strlen(*last), strlen(*last));
-+ strbuf_addbuf(&sb, *ptr);
-+ *last = strbuf_detach(&sb, NULL);
-+ continue;
-+ }
-+ ALLOC_GROW(trailer_strings, nr + 1, alloc);
-+ trailer_strings[nr] = strbuf_detach(*ptr, NULL);
-+ last = find_separator(trailer_strings[nr], separators) >= 1
-+ ? &trailer_strings[nr]
-+ : NULL;
-+ nr++;
-+ }
-+ strbuf_list_free(trailer_lines);
-+
-+ info->blank_line_before_trailer = ends_with_blank_line(str,
-+ trailer_block_start);
-+ info->trailer_block_start = trailer_block_start;
-+ info->trailer_block_end = end_of_log_message;
-+ info->trailers = trailer_strings;
-+ info->trailer_nr = nr;
-+
-+ return info;
-+}
+
/*
* Parse trailers in "str", populating the trailer info and "head"
@@ trailer.c: void format_trailers(const struct process_trailer_options *opts,
struct strbuf val = STRBUF_INIT;
size_t i;
-- trailer_info_get(info, str, opts);
+- trailer_info_get(opts, str, info);
+ info = trailer_info_get(opts, str);
for (i = 0; i < info->trailer_nr; i++) {
@@ trailer.c: void free_trailers(struct list_head *trailers)
}
}
--void trailer_info_get(struct trailer_info *info, const char *str,
-- const struct process_trailer_options *opts)
+-void trailer_info_get(const struct process_trailer_options *opts,
+- const char *str,
+- struct trailer_info *info)
+size_t trailer_block_start(struct trailer_info *info)
- {
-- size_t end_of_log_message = 0, trailer_block_start = 0;
-- struct strbuf **trailer_lines, **ptr;
-- char **trailer_strings = NULL;
-- size_t nr = 0, alloc = 0;
-- char **last = NULL;
--
-- trailer_config_init();
--
-- end_of_log_message = find_end_of_log_message(str, opts->no_divider);
-- trailer_block_start = find_trailer_block_start(str, end_of_log_message);
++{
+ return info->trailer_block_start;
+}
-
-- trailer_lines = strbuf_split_buf(str + trailer_block_start,
-- end_of_log_message - trailer_block_start,
-- '\n',
-- 0);
-- for (ptr = trailer_lines; *ptr; ptr++) {
-- if (last && isspace((*ptr)->buf[0])) {
-- struct strbuf sb = STRBUF_INIT;
-- strbuf_attach(&sb, *last, strlen(*last), strlen(*last));
-- strbuf_addbuf(&sb, *ptr);
-- *last = strbuf_detach(&sb, NULL);
-- continue;
-- }
-- ALLOC_GROW(trailer_strings, nr + 1, alloc);
-- trailer_strings[nr] = strbuf_detach(*ptr, NULL);
-- last = find_separator(trailer_strings[nr], separators) >= 1
-- ? &trailer_strings[nr]
-- : NULL;
-- nr++;
-- }
-- strbuf_list_free(trailer_lines);
++
+size_t trailer_block_end(struct trailer_info *info)
+{
+ return info->trailer_block_end;
+}
-
-- info->blank_line_before_trailer = ends_with_blank_line(str,
-- trailer_block_start);
-- info->trailer_block_start = trailer_block_start;
-- info->trailer_block_end = end_of_log_message;
-- info->trailers = trailer_strings;
-- info->trailer_nr = nr;
++
+int blank_line_before_trailer_block(struct trailer_info *info)
+{
+ return info->blank_line_before_trailer;
++}
++
++struct trailer_info *trailer_info_get(const struct process_trailer_options *opts,
++ const char *str)
+ {
++ struct trailer_info *info = trailer_info_new();
+ size_t end_of_log_message = 0, trailer_block_start = 0;
+ struct strbuf **trailer_lines, **ptr;
+ char **trailer_strings = NULL;
+@@ trailer.c: void trailer_info_get(const struct process_trailer_options *opts,
+ info->trailer_block_end = end_of_log_message;
+ info->trailers = trailer_strings;
+ info->trailer_nr = nr;
++
++ return info;
}
void trailer_info_release(struct trailer_info *info)
@@ trailer.c: void trailer_info_release(struct trailer_info *info)
+ free(info);
}
- void format_trailers_from_commit(const struct process_trailer_options *opts,
+ void format_trailers(const struct process_trailer_options *opts,
@@ trailer.c: void format_trailers_from_commit(const struct process_trailer_options *opts,
struct strbuf *out)
{
- LIST_HEAD(head);
+ LIST_HEAD(trailers);
- struct trailer_info info;
-
-- parse_trailers(opts, &info, msg, &head);
-+ struct trailer_info *info = parse_trailers(opts, msg, &head);
+- parse_trailers(opts, &info, msg, &trailers);
++ struct trailer_info *info = parse_trailers(opts, msg, &trailers);
/* If we want the whole block untouched, we can take the fast path. */
if (!opts->only_trailers && !opts->unfold && !opts->filter &&
@@ trailer.c: void format_trailers_from_commit(const struct process_trailer_options
+ strbuf_add(out, msg + info->trailer_block_start,
+ info->trailer_block_end - info->trailer_block_start);
} else
- format_trailers(opts, &head, out);
+ format_trailers(opts, &trailers, out);
- free_trailers(&head);
+ free_trailers(&trailers);
- trailer_info_release(&info);
+ trailer_info_release(info);
}
void trailer_iterator_init(struct trailer_iterator *iter, const char *msg)
- {
- struct process_trailer_options opts = PROCESS_TRAILER_OPTIONS_INIT;
-+ struct trailer_info *internal = trailer_info_new();
+@@ trailer.c: void trailer_iterator_init(struct trailer_iterator *iter, const char *msg)
strbuf_init(&iter->key, 0);
strbuf_init(&iter->val, 0);
opts.no_divider = 1;
-- trailer_info_get(&iter->internal.info, msg, &opts);
-+ iter->internal.info = internal;
+- trailer_info_get(&opts, msg, &iter->internal.info);
+ iter->internal.info = trailer_info_get(&opts, msg);
iter->internal.cur = 0;
}
-@@ trailer.c: int trailer_iterator_advance(struct trailer_iterator *iter)
+ int trailer_iterator_advance(struct trailer_iterator *iter)
{
- char *line;
- int separator_pos;
- if (iter->internal.cur < iter->internal.info.trailer_nr) {
-- line = iter->internal.info.trailers[iter->internal.cur++];
+- char *line = iter->internal.info.trailers[iter->internal.cur++];
+ if (iter->internal.cur < iter->internal.info->trailer_nr) {
-+ line = iter->internal.info->trailers[iter->internal.cur++];
- separator_pos = find_separator(line, separators);
- iter->is_trailer = (separator_pos > 0);
++ char *line = iter->internal.info->trailers[iter->internal.cur++];
+ int separator_pos = find_separator(line, separators);
+ iter->raw = line;
@@ trailer.c: int trailer_iterator_advance(struct trailer_iterator *iter)
void trailer_iterator_release(struct trailer_iterator *iter)
@@ trailer.h: void parse_trailers_from_command_line_args(struct list_head *arg_head
void process_trailers_lists(struct list_head *head,
struct list_head *arg_head);
--void parse_trailers(const struct process_trailer_options *opts,
-- struct trailer_info *info,
+-void parse_trailers(const struct process_trailer_options *,
+- struct trailer_info *,
- const char *str,
- struct list_head *head);
-+struct trailer_info *parse_trailers(const struct process_trailer_options *opts,
++struct trailer_info *parse_trailers(const struct process_trailer_options *,
+ const char *str,
+ struct list_head *head);
-
--void trailer_info_get(struct trailer_info *info, const char *str,
-- const struct process_trailer_options *opts);
-+size_t trailer_block_start(struct trailer_info *info);
-+size_t trailer_block_end(struct trailer_info *info);
-+int blank_line_before_trailer_block(struct trailer_info *info);
++struct trailer_info *trailer_info_get(const struct process_trailer_options *,
++ const char *str);
+
+-void trailer_info_get(const struct process_trailer_options *,
+- const char *str,
+- struct trailer_info *);
++size_t trailer_block_start(struct trailer_info *);
++size_t trailer_block_end(struct trailer_info *);
++int blank_line_before_trailer_block(struct trailer_info *);
void trailer_info_release(struct trailer_info *info); -: ----------- > 20: 607ae7a90cd trailer: retire trailer_info_get() from API
6: 0a9a7438c3f ! 21: 38f4b4c4135 trailer: spread usage of "trailer_block" language
@@ builtin/interpret-trailers.c: static void interpret_trailers(const struct proces
/* Print trailer block. */
- format_trailers(opts, &head, &trailer_block);
++ format_trailers(opts, &head, &tb);
+ free_trailers(&head);
- fwrite(trailer_block.buf, 1, trailer_block.len, outfile);
- strbuf_release(&trailer_block);
-+ format_trailers(opts, &head, &tb);
+ fwrite(tb.buf, 1, tb.len, outfile);
+ strbuf_release(&tb);
- free_trailers(&head);
-
- /* Print the lines after the trailers as is */
-+ /* Print the lines after the trailer block as is */
++ /* Print the lines after the trailer block as is. */
if (!opts->only_trailers)
- fwrite(sb.buf + trailer_block_end(info), 1, sb.len - trailer_block_end(info), outfile);
--
- trailer_info_release(info);
-+ fwrite(sb.buf + trailer_block_end(trailer_block),
-+ 1, sb.len - trailer_block_end(trailer_block), outfile);
++ fwrite(sb.buf + trailer_block_end(trailer_block), 1,
++ sb.len - trailer_block_end(trailer_block), outfile);
+ trailer_block_release(trailer_block);
if (opts->in_place)
@@ trailer.c
/*
* Array of trailers found.
-@@ trailer.c: void format_trailers(const struct process_trailer_options *opts,
- }
+@@ trailer.c: static void unfold_value(struct strbuf *val)
+ strbuf_release(&out);
}
-static struct trailer_info *trailer_info_new(void)
@@ trailer.c: void free_trailers(struct list_head *trailers)
+ free(trailer_block);
}
- void format_trailers_from_commit(const struct process_trailer_options *opts,
+ void format_trailers(const struct process_trailer_options *opts,
@@ trailer.c: void format_trailers_from_commit(const struct process_trailer_options *opts,
struct strbuf *out)
{
- LIST_HEAD(head);
-- struct trailer_info *info = parse_trailers(opts, msg, &head);
-+ struct trailer_block *trailer_block = parse_trailers(opts, msg, &head);
+ LIST_HEAD(trailers);
+- struct trailer_info *info = parse_trailers(opts, msg, &trailers);
++ struct trailer_block *trailer_block = parse_trailers(opts, msg, &trailers);
/* If we want the whole block untouched, we can take the fast path. */
if (!opts->only_trailers && !opts->unfold && !opts->filter &&
@@ trailer.c: void format_trailers_from_commit(const struct process_trailer_options
+ strbuf_add(out, msg + trailer_block->start,
+ trailer_block->end - trailer_block->start);
} else
- format_trailers(opts, &head, out);
+ format_trailers(opts, &trailers, out);
- free_trailers(&head);
+ free_trailers(&trailers);
- trailer_info_release(info);
+ trailer_block_release(trailer_block);
}
void trailer_iterator_init(struct trailer_iterator *iter, const char *msg)
- {
- struct process_trailer_options opts = PROCESS_TRAILER_OPTIONS_INIT;
-- struct trailer_info *internal = trailer_info_new();
+@@ trailer.c: void trailer_iterator_init(struct trailer_iterator *iter, const char *msg)
strbuf_init(&iter->key, 0);
strbuf_init(&iter->val, 0);
opts.no_divider = 1;
-- iter->internal.info = internal;
- iter->internal.info = trailer_info_get(&opts, msg);
+ iter->internal.trailer_block = trailer_block_get(&opts, msg);
iter->internal.cur = 0;
}
-@@ trailer.c: int trailer_iterator_advance(struct trailer_iterator *iter)
+ int trailer_iterator_advance(struct trailer_iterator *iter)
{
- char *line;
- int separator_pos;
- if (iter->internal.cur < iter->internal.info->trailer_nr) {
-- line = iter->internal.info->trailers[iter->internal.cur++];
+- char *line = iter->internal.info->trailers[iter->internal.cur++];
+ if (iter->internal.cur < iter->internal.trailer_block->trailer_nr) {
-+ line = iter->internal.trailer_block->trailers[iter->internal.cur++];
- separator_pos = find_separator(line, separators);
- iter->is_trailer = (separator_pos > 0);
++ char *line = iter->internal.trailer_block->trailers[iter->internal.cur++];
+ int separator_pos = find_separator(line, separators);
+ iter->raw = line;
@@ trailer.c: int trailer_iterator_advance(struct trailer_iterator *iter)
void trailer_iterator_release(struct trailer_iterator *iter)
@@ trailer.h: void parse_trailers_from_command_line_args(struct list_head *arg_head
void process_trailers_lists(struct list_head *head,
struct list_head *arg_head);
--struct trailer_info *parse_trailers(const struct process_trailer_options *opts,
+-struct trailer_info *parse_trailers(const struct process_trailer_options *,
- const char *str,
- struct list_head *head);
-+struct trailer_block *parse_trailers(const struct process_trailer_options *opts,
++struct trailer_block *parse_trailers(const struct process_trailer_options *,
+ const char *str,
+ struct list_head *head);
--size_t trailer_block_start(struct trailer_info *info);
--size_t trailer_block_end(struct trailer_info *info);
--int blank_line_before_trailer_block(struct trailer_info *info);
-+size_t trailer_block_start(struct trailer_block *trailer_block);
-+size_t trailer_block_end(struct trailer_block *trailer_block);
-+int blank_line_before_trailer_block(struct trailer_block *trailer_block);
+-size_t trailer_block_start(struct trailer_info *);
+-size_t trailer_block_end(struct trailer_info *);
+-int blank_line_before_trailer_block(struct trailer_info *);
++size_t trailer_block_start(struct trailer_block *);
++size_t trailer_block_end(struct trailer_block *);
++int blank_line_before_trailer_block(struct trailer_block *);
-void trailer_info_release(struct trailer_info *info);
-+void trailer_block_release(struct trailer_block *trailer_block);
++void trailer_block_release(struct trailer_block *);
void trailer_config_init(void);
- void format_trailers(const struct process_trailer_options *opts,
+ void format_trailers(const struct process_trailer_options *,
@@ trailer.h: struct trailer_iterator {
/* private */ 7: 97e5d86ddf0 ! 22: 94bf182e3ff trailer: prepare to move parse_trailers_from_command_line_args() to builtin
@@ Metadata
Author: Linus Arver <[email protected]>
## Commit message ##
- trailer: prepare to move parse_trailers_from_command_line_args() to builtin
+ trailer: prepare to delete "parse_trailers_from_command_line_args()"
- Expose more functions in the trailer.h API, in preparation for moving
- out
+ Expose more functions in the trailer.h API, in preparation for deleting
parse_trailers_from_command_line_args()
- to interpret-trailer.c, because the trailer API should not be concerned
+ from the trailers implementation, because it should not be concerned
with command line arguments (as they have nothing to do with trailers
- themselves). The interpret-trailers builtin is the only caller of this
- function.
+ themselves). Indeed, the interpret-trailers builtin is the only caller
+ of this function inside Git.
- Rename add_arg_item() to trailer_add_arg_item() because it will have to
- be exposed as an API function in the next patch. Rename
- new_trailers_clear() to free_new_trailers() because it will be promoted
- into an API function; the API already has free_trailers(), so using the
- "free_*" naming style will keep it consistent. Also rename "conf_info"
- to "trailer_conf" for readability, dropping the low-value "_info" suffix
- as we did earlier in this series for "trailer_info" to "trailer_block".
+ Rename add_arg_item() to trailer_add_arg_item() to expose it as an API
+ function. Rename new_trailers_clear() to free_new_trailers() because it
+ will be promoted into an API function; the API already has
+ free_trailers(), so using the "free_*" naming style will keep it
+ consistent. Also rename "conf_info" to "trailer_conf" for readability,
+ dropping the low-value "_info" suffix as we did earlier in this series
+ for "trailer_info" to "trailer_block".
@@ trailer.c: static struct trailer_item *add_trailer_item(struct list_head *head,
-static void add_arg_item(struct list_head *arg_head, char *tok, char *val,
- const struct conf_info *conf,
- const struct new_trailer_item *new_trailer_item)
-+static void trailer_add_arg_item(struct list_head *arg_head, char *tok, char *val,
-+ const struct trailer_conf *conf,
-+ const struct new_trailer_item *new_trailer_item)
++void trailer_add_arg_item(struct list_head *arg_head, char *tok, char *val,
++ const struct trailer_conf *conf,
++ const struct new_trailer_item *new_trailer_item)
{
struct arg_item *new_item = xcalloc(1, sizeof(*new_item)); new_item->token = tok;
@@ trailer.c: int trailer_iterator_advance(struct trailer_iterator *iter)
- parse_trailer(&iter->key, &iter->val, NULL,
- line, separator_pos);
+ parse_trailer(line, separator_pos, &iter->key, &iter->val, NULL);
+ /* Always unfold values during iteration. */
unfold_value(&iter->val);
return 1;
- }
## trailer.h ##
@@
@@ trailer.h: struct new_trailer_item {
+void duplicate_trailer_conf(struct trailer_conf *dst,
+ const struct trailer_conf *src);
++void trailer_add_arg_item(struct list_head *arg_head, char *tok, char *val,
++ const struct trailer_conf *conf,
++ const struct new_trailer_item *new_trailer_item);
+
struct process_trailer_options {
int in_place;
@@ trailer.h: void parse_trailers_from_command_line_args(struct list_head *arg_head
+
+void parse_trailer(const char *line, ssize_t separator_pos,
+ struct strbuf *tok, struct strbuf *val,
-+ const struct trailer_conf **conf);
++ const struct trailer_conf **);
+
- struct trailer_block *parse_trailers(const struct process_trailer_options *opts,
+ struct trailer_block *parse_trailers(const struct process_trailer_options *, const char *str,
struct list_head *head);
8: 465dc51cdcb ! 23: 3bfe4809ecb trailer: move arg handling to interpret-trailers.c
@@ Metadata
Author: Linus Arver <[email protected]>
## Commit message ##
- trailer: move arg handling to interpret-trailers.c
+ trailer: add new helper functions to API
- We don't move the "arg_item" struct to interpret-trailers.c, because it
- is now a struct that contains information about trailers that could be
- added into the input text's own trailers. This is a generic concept that
- extends beyond trailers defined as CLI arguments (it applies to trailers
- defined in configuration as well). We will rename "arg_item" to
- "trailer_template" in a follow-up patch to keep the diff here small.
+ This is a preparatory refactor for deprecating "new_trailer_item" from
+ the API (which will let us deprecate
+ parse_trailers_from_command_line_args()).
+
+ Expose new helper functions from the API, because we'll be calling them
+ from interpret-trailers.c soon when we move
+ parse_trailers_from_command_line_args() there.
+
+ Move free_new_trailers() from the builtin to trailer.c because later on
+ we will adjust it to free arg_item structs, which are private to
+ trailer.c.
Signed-off-by: Linus Arver <[email protected]>
@@ builtin/interpret-trailers.c: static int option_parse_if_missing(const struct op
- free(item);
- }
-}
-+static char *cl_separators;
-
+-
static int option_parse_trailer(const struct option *opt,
const char *arg, int unset)
{
- struct list_head *trailers = opt->value;
-- struct new_trailer_item *item;
-+ struct strbuf tok = STRBUF_INIT;
-+ struct strbuf val = STRBUF_INIT;
-+ const struct trailer_conf *conf;
-+ struct trailer_conf *conf_current = new_trailer_conf();
-+ ssize_t separator_pos;
-
- if (unset) {
- free_new_trailers(trailers);
-@@ builtin/interpret-trailers.c: static int option_parse_trailer(const struct option *opt,
- if (!arg)
- return -1;
-
-- item = xmalloc(sizeof(*item));
-- item->text = arg;
-- item->where = where;
-- item->if_exists = if_exists;
-- item->if_missing = if_missing;
-- list_add_tail(&item->list, trailers);
-+ separator_pos = find_separator(arg, cl_separators);
-+ if (separator_pos) {
-+ parse_trailer(arg, separator_pos, &tok, &val, &conf);
-+ duplicate_trailer_conf(conf_current, conf);
-+
-+ /*
-+ * Override conf_current with settings specified via CLI flags.
-+ */
-+ trailer_conf_set(where, if_exists, if_missing, conf_current);
-+
-+ trailer_add_arg_item(strbuf_detach(&tok, NULL),
-+ strbuf_detach(&val, NULL),
-+ conf_current,
-+ trailers);
-+ } else {
-+ struct strbuf sb = STRBUF_INIT;
-+ strbuf_addstr(&sb, arg);
-+ strbuf_trim(&sb);
-+ error(_("empty trailer token in trailer '%.*s'"),
-+ (int) sb.len, sb.buf);
-+ strbuf_release(&sb);
-+ }
-+
-+ free(conf_current);
-+
- return 0;
- }
-
-@@ builtin/interpret-trailers.c: static void read_input_file(struct strbuf *sb, const char *file)
- }
-
- static void interpret_trailers(const struct process_trailer_options *opts,
-- struct list_head *new_trailer_head,
-+ struct list_head *arg_trailers,
- const char *file)
- {
- LIST_HEAD(head);
-@@ builtin/interpret-trailers.c: static void interpret_trailers(const struct process_trailer_options *opts,
- struct trailer_block *trailer_block;
- FILE *outfile = stdout;
-
-- trailer_config_init();
--
- read_input_file(&sb, file);
-
- if (opts->in_place)
-@@ builtin/interpret-trailers.c: static void interpret_trailers(const struct process_trailer_options *opts,
-
-
- if (!opts->only_input) {
-- LIST_HEAD(config_head);
-- LIST_HEAD(arg_head);
-- parse_trailers_from_config(&config_head);
-- parse_trailers_from_command_line_args(&arg_head, new_trailer_head);
-- list_splice(&config_head, &arg_head);
-- process_trailers_lists(&head, &arg_head);
-+ process_trailers_lists(&head, arg_trailers);
- }
-
- /* Print trailer block. */
-@@ builtin/interpret-trailers.c: static void interpret_trailers(const struct process_trailer_options *opts,
- int cmd_interpret_trailers(int argc, const char **argv, const char *prefix)
- {
- struct process_trailer_options opts = PROCESS_TRAILER_OPTIONS_INIT;
-- LIST_HEAD(trailers);
-+ LIST_HEAD(configured_trailers);
-+ LIST_HEAD(arg_trailers);
-
- struct option options[] = {
- OPT_BOOL(0, "in-place", &opts.in_place, N_("edit files in place")),
-@@ builtin/interpret-trailers.c: int cmd_interpret_trailers(int argc, const char **argv, const char *prefix)
- OPT_CALLBACK_F(0, "parse", &opts, NULL, N_("alias for --only-trailers --only-input --unfold"),
- PARSE_OPT_NOARG | PARSE_OPT_NONEG, parse_opt_parse),
- OPT_BOOL(0, "no-divider", &opts.no_divider, N_("do not treat \"---\" as the end of input")),
-- OPT_CALLBACK(0, "trailer", &trailers, N_("trailer"),
-+ OPT_CALLBACK(0, "trailer", &arg_trailers, N_("trailer"),
- N_("trailer(s) to add"), option_parse_trailer),
- OPT_END()
- };
-
- git_config(git_default_config, NULL);
-+ trailer_config_init();
-+
-+ if (!opts.only_input) {
-+ parse_trailers_from_config(&configured_trailers);
-+ }
-+
-+ /*
-+ * In command-line arguments, '=' is accepted (in addition to the
-+ * separators that are defined).
-+ */
-+ cl_separators = xstrfmt("=%s", trailer_default_separators());
-
- argc = parse_options(argc, argv, prefix, options,
- git_interpret_trailers_usage, 0);
-
-- if (opts.only_input && !list_empty(&trailers))
-+ free(cl_separators);
-+
-+ if (opts.only_input && !list_empty(&arg_trailers))
- usage_msg_opt(
- _("--trailer with --only-input does not make sense"),
- git_interpret_trailers_usage,
- options);
-
-+ list_splice(&configured_trailers, &arg_trailers);
-+
- if (argc) {
- int i;
- for (i = 0; i < argc; i++)
-- interpret_trailers(&opts, &trailers, argv[i]);
-+ interpret_trailers(&opts, &arg_trailers, argv[i]);
- } else {
- if (opts.in_place)
- die(_("no input file given for in-place editing"));
-- interpret_trailers(&opts, &trailers, NULL);
-+ interpret_trailers(&opts, &arg_trailers, NULL);
- }
-
-- free_new_trailers(&trailers);
-+ free_new_trailers(&arg_trailers);
-
- return 0;
- }
## trailer.c ##
@@ trailer.c: static LIST_HEAD(conf_head);
@@ trailer.c: int trailer_set_if_missing(enum trailer_if_missing *item, const char
return 0;
}
-+void trailer_conf_set(enum trailer_where where,
-+ enum trailer_if_exists if_exists,
-+ enum trailer_if_missing if_missing,
-+ struct trailer_conf *conf)
++void trailer_set_conf_where(enum trailer_where where,
++ struct trailer_conf *conf)
++{
++ conf->where = where;
++}
++
++void trailer_set_conf_if_exists(enum trailer_if_exists if_exists,
++ struct trailer_conf *conf)
++{
++ conf->if_exists = if_exists;
++}
++
++void trailer_set_conf_if_missing(enum trailer_if_missing if_missing,
++ struct trailer_conf *conf)
+{
-+ if (where != WHERE_DEFAULT)
-+ conf->where = where;
-+ if (if_exists != EXISTS_DEFAULT)
-+ conf->if_exists = if_exists;
-+ if (if_missing != MISSING_DEFAULT)
-+ conf->if_missing = if_missing;
++ conf->if_missing = if_missing;
+}
+
+struct trailer_conf *new_trailer_conf(void)
+{
-+ struct trailer_conf *new = xcalloc(1, sizeof(*new));
-+ return new;
++ return xcalloc(1, sizeof(struct trailer_conf));
+}
+
void duplicate_trailer_conf(struct trailer_conf *dst,
const struct trailer_conf *src)
{
-@@ trailer.c: ssize_t find_separator(const char *line, const char *separators)
- /*
- * Obtain the token, value, and conf from the given trailer.
- *
-+ * The conf needs special handling. We first read hardcoded defaults, and
-+ * override them if we find a matching trailer configuration.
-+ *
- * separator_pos must not be 0, since the token cannot be an empty string.
- *
- * If separator_pos is -1, interpret the whole trailer as a token.
-@@ trailer.c: static struct trailer_item *add_trailer_item(struct list_head *head, char *tok,
- return new_item;
+@@ trailer.c: void duplicate_trailer_conf(struct trailer_conf *dst,
+ dst->cmd = xstrdup_or_null(src->cmd);
}
--static void trailer_add_arg_item(struct list_head *arg_head, char *tok, char *val,
-- const struct trailer_conf *conf,
-- const struct new_trailer_item *new_trailer_item)
-+void trailer_add_arg_item(char *tok, char *val, const struct trailer_conf *conf,
-+ struct list_head *arg_head)
++void free_trailer_conf(struct trailer_conf *conf)
++{
++ free(conf->name);
++ free(conf->key);
++ free(conf->command);
++ free(conf->cmd);
++ free(conf);
++}
++
+ static struct arg_item *get_conf_item(const char *name)
{
- struct arg_item *new_item = xcalloc(1, sizeof(*new_item));
- new_item->token = tok;
- new_item->value = val;
- duplicate_trailer_conf(&new_item->conf, conf);
-- if (new_trailer_item) {
-- if (new_trailer_item->where != WHERE_DEFAULT)
-- new_item->conf.where = new_trailer_item->where;
-- if (new_trailer_item->if_exists != EXISTS_DEFAULT)
-- new_item->conf.if_exists = new_trailer_item->if_exists;
-- if (new_trailer_item->if_missing != MISSING_DEFAULT)
-- new_item->conf.if_missing = new_trailer_item->if_missing;
-- }
- list_add_tail(&new_item->list, arg_head);
- }
-
-@@ trailer.c: void parse_trailers_from_config(struct list_head *config_head)
- list_for_each(pos, &conf_head) {
- item = list_entry(pos, struct arg_item, list);
- if (item->conf.command)
-- trailer_add_arg_item(config_head,
-- xstrdup(token_from_item(item, NULL)),
-+ trailer_add_arg_item(xstrdup(token_from_item(item, NULL)),
- xstrdup(""),
-- &item->conf, NULL);
-+ &item->conf,
-+ config_head);
- }
- }
-
-@@ trailer.c: void parse_trailers_from_command_line_args(struct list_head *arg_head,
- strbuf_release(&sb);
- } else {
- parse_trailer(tr->text, separator_pos, &tok, &val, &conf);
-- trailer_add_arg_item(arg_head,
-- strbuf_detach(&tok, NULL),
-+ trailer_add_arg_item(strbuf_detach(&tok, NULL),
- strbuf_detach(&val, NULL),
-- conf, tr);
-+ conf,
-+ arg_head);
- }
- }
-
+ struct list_head *pos;
@@ trailer.c: void free_trailers(struct list_head *trailers)
}
}
+void free_new_trailers(struct list_head *trailers)
+{
-+ struct list_head *pos, *p;
++ struct list_head *pos, *tmp;
++ struct new_trailer_item *item;
+
-+ list_for_each_safe(pos, p, trailers) {
++ list_for_each_safe(pos, tmp, trailers) {
++ item = list_entry(pos, struct new_trailer_item, list);
+ list_del(pos);
-+ free_arg_item(list_entry(pos, struct arg_item, list));
++ free(item);
+ }
+}
+
@@ trailer.h: struct new_trailer_item {
enum trailer_if_missing if_missing;
};
-+void trailer_conf_set(enum trailer_where where,
-+ enum trailer_if_exists if_exists,
-+ enum trailer_if_missing if_missing,
-+ struct trailer_conf *conf);
++void trailer_set_conf_where(enum trailer_where, struct trailer_conf *);
++void trailer_set_conf_if_exists(enum trailer_if_exists, struct trailer_conf *);
++void trailer_set_conf_if_missing(enum trailer_if_missing, struct trailer_conf *);
+
+struct trailer_conf *new_trailer_conf(void);
void duplicate_trailer_conf(struct trailer_conf *dst,
const struct trailer_conf *src);
-
+const char *trailer_default_separators(void);
-+
-+void trailer_add_arg_item(char *tok, char *val, const struct trailer_conf *conf,
-+ struct list_head *arg_head);
-+
- struct process_trailer_options {
- int in_place;
- int trim_empty;
-@@ trailer.h: void format_trailers(const struct process_trailer_options *opts,
+ void trailer_add_arg_item(struct list_head *arg_head, char *tok, char *val,
+ const struct trailer_conf *conf,
+ const struct new_trailer_item *new_trailer_item);
+@@ trailer.h: void format_trailers(const struct process_trailer_options *,
struct list_head *trailers,
struct strbuf *out);
void free_trailers(struct list_head *);
+void free_new_trailers(struct list_head *);
++void free_trailer_conf(struct trailer_conf *);
/*
* Convenience function to format the trailers from the commit msg "msg" into
-: ----------- > 24: 80e1958bb8d trailer_add_arg_item(): drop new_trailer_item usage
9: 885ac87a544 ! 25: a9080597a28 trailer: delete obsolete argument handling code from API
@@ Metadata
Author: Linus Arver <[email protected]>
## Commit message ##
- trailer: delete obsolete argument handling code from API
+ trailer: deprecate "new_trailer_item" struct from API
- This commit was not squashed with its parent in order to keep the diff
- separate (to make the additive changes in the parent easier to read).
+ Previously, the "new_trailer_item" struct served only one purpose --- to
+ capture the unparsed raw string <RAW> in "--trailer <RAW>", as well as
+ the current state of the "where", "if_exists", and "if_missing" global
+ variables at the time that the "--trailer <RAW>" CLI argument was
+ encountered.
- Note that we remove the "new_trailer_item" struct, because it has some
- overlap with "arg_item" struct that also deals with trailers coming from
- the command line. The latter will be renamed to "trailer_template" in
- the next patch.
+ In addition, the previous CLI argument handling behavior was to capture
+ the <RAW> string in all "--trailer <RAW>" arguments and to collect
+ them (via option_parse_trailer()) into the "new_trailer_head" list. We
+ would then iterate over this list again in
+ parse_trailers_from_command_line_args() and convert these
+ "new_trailer_item" objects into "arg_item" objects.
+
+ Skip this intermediate storage of "new_trailer_item" objects in favor of
+ just storing "arg_item" objects. Remove the looping behavior of
+ parse_trailers_from_command_line_args() so that it parses a single
+ "--trailer ..." argument at a time. Rename it to
+ parse_trailer_from_command_line_arg() to reflect this new behavior of
+ only looking at one string (not multiple strings) at a time. Make
+ option_parse_trailer() call parse_trailer_from_command_line_arg() so
+ that the CLI arguments it sees are parsed immediately without the need
+ for intermediate storage.
+
+ Delete "new_trailer_item", because we don't need it any more.
+
+ In the next patch we will retire parse_trailer_from_command_line_arg()
+ as well, combining it with option_parse_trailer().
Signed-off-by: Linus Arver <[email protected]>
+ ## builtin/interpret-trailers.c ##
+@@ builtin/interpret-trailers.c: static int option_parse_trailer(const struct option *opt,
+ const char *arg, int unset)
+ {
+ struct list_head *trailers = opt->value;
+- struct new_trailer_item *item;
+
+ if (unset) {
+ free_new_trailers(trailers);
+@@ builtin/interpret-trailers.c: static int option_parse_trailer(const struct option *opt,
+ if (!arg)
+ return -1;
+
+- item = xmalloc(sizeof(*item));
+- item->text = arg;
+- item->where = where;
+- item->if_exists = if_exists;
+- item->if_missing = if_missing;
+- list_add_tail(&item->list, trailers);
++ parse_trailer_from_command_line_arg(arg, where, if_exists, if_missing, trailers);
++
+ return 0;
+ }
+
+@@ builtin/interpret-trailers.c: static void interpret_trailers(const struct process_trailer_options *opts,
+ struct trailer_block *trailer_block;
+ FILE *outfile = stdout;
+
+- trailer_config_init();
+-
+ read_input_file(&sb, file);
+
+ if (opts->in_place)
+@@ builtin/interpret-trailers.c: static void interpret_trailers(const struct process_trailer_options *opts,
+ if (!opts->only_trailers && !blank_line_before_trailer_block(trailer_block))
+ fprintf(outfile, "\n");
+
+-
+- if (!opts->only_input) {
+- LIST_HEAD(config_head);
+- LIST_HEAD(arg_head);
+- parse_trailers_from_config(&config_head);
+- parse_trailers_from_command_line_args(&arg_head, new_trailer_head);
+- list_splice(&config_head, &arg_head);
+- process_trailers_lists(&head, &arg_head);
+- }
++ if (!opts->only_input)
++ process_trailers_lists(&head, new_trailer_head);
+
+ /* Print trailer block. */
+ format_trailers(opts, &head, &tb);
+@@ builtin/interpret-trailers.c: static void interpret_trailers(const struct process_trailer_options *opts,
+ int cmd_interpret_trailers(int argc, const char **argv, const char *prefix)
+ {
+ struct process_trailer_options opts = PROCESS_TRAILER_OPTIONS_INIT;
++ LIST_HEAD(configured_trailers);
+ LIST_HEAD(trailers);
+
+ struct option options[] = {
+@@ builtin/interpret-trailers.c: int cmd_interpret_trailers(int argc, const char **argv, const char *prefix)
+ };
+
+ git_config(git_default_config, NULL);
++ trailer_config_init();
++
++ if (!opts.only_input)
++ parse_trailers_from_config(&configured_trailers);
+
+ argc = parse_options(argc, argv, prefix, options,
+ git_interpret_trailers_usage, 0);
+@@ builtin/interpret-trailers.c: int cmd_interpret_trailers(int argc, const char **argv, const char *prefix)
+ git_interpret_trailers_usage,
+ options);
+
++ list_splice(&configured_trailers, &trailers);
++
+ if (argc) {
+ int i;
+ for (i = 0; i < argc; i++)
+
## trailer.c ##
@@ trailer.c: void parse_trailers_from_config(struct list_head *config_head)
}
@@ trailer.c: void parse_trailers_from_config(struct list_head *config_head)
-void parse_trailers_from_command_line_args(struct list_head *arg_head,
- struct list_head *new_trailer_head)
--{
-- struct strbuf tok = STRBUF_INIT;
-- struct strbuf val = STRBUF_INIT;
-- const struct trailer_conf *conf;
++void parse_trailer_from_command_line_arg(const char *line,
++ enum trailer_where where,
++ enum trailer_if_exists if_exists,
++ enum trailer_if_missing if_missing,
++ struct list_head *arg_head)
+ {
+ struct strbuf tok = STRBUF_INIT;
+ struct strbuf val = STRBUF_INIT;
+ const struct trailer_conf *conf;
- struct list_head *pos;
--
-- /*
-- * In command-line arguments, '=' is accepted (in addition to the
-- * separators that are defined).
-- */
+
+ /*
+ * In command-line arguments, '=' is accepted (in addition to the
+ * separators that are defined).
+ */
- char *cl_separators = xstrfmt("=%s", separators);
--
++ char *cl_separators = xstrfmt("=%s", trailer_default_separators());
+
- /* Add an arg item for each trailer on the command line */
- list_for_each(pos, new_trailer_head) {
- struct new_trailer_item *tr =
- list_entry(pos, struct new_trailer_item, list);
- ssize_t separator_pos = find_separator(tr->text, cl_separators);
--
++ /* Add an arg item for a trailer from the command line */
++ ssize_t separator_pos = find_separator(line, cl_separators);
++ free(cl_separators);
+
- if (separator_pos == 0) {
- struct strbuf sb = STRBUF_INIT;
- strbuf_addstr(&sb, tr->text);
@@ trailer.c: void parse_trailers_from_config(struct list_head *config_head)
- (int) sb.len, sb.buf);
- strbuf_release(&sb);
- } else {
+- struct trailer_conf *conf_current = new_trailer_conf();
- parse_trailer(tr->text, separator_pos, &tok, &val, &conf);
-- trailer_add_arg_item(strbuf_detach(&tok, NULL),
+- duplicate_trailer_conf(conf_current, conf);
++ if (separator_pos == 0) {
++ struct strbuf sb = STRBUF_INIT;
++ strbuf_addstr(&sb, line);
++ strbuf_trim(&sb);
++ error(_("empty trailer token in trailer '%.*s'"),
++ (int) sb.len, sb.buf);
++ strbuf_release(&sb);
++ } else {
++ struct trailer_conf *conf_current = new_trailer_conf();
++ parse_trailer(line, separator_pos, &tok, &val, &conf);
++ duplicate_trailer_conf(conf_current, conf);
+
+- /*
+- * Override conf_current with settings specified via CLI flags.
+- */
+- if (tr->where != WHERE_DEFAULT)
+- trailer_set_conf_where(tr->where, conf_current);
+- if (tr->if_exists != EXISTS_DEFAULT)
+- trailer_set_conf_if_exists(tr->if_exists, conf_current);
+- if (tr->if_missing != MISSING_DEFAULT)
+- trailer_set_conf_if_missing(tr->if_missing, conf_current);
+-
+- trailer_add_arg_item(arg_head,
+- strbuf_detach(&tok, NULL),
- strbuf_detach(&val, NULL),
-- conf,
-- arg_head);
+- conf_current);
+- free_trailer_conf(conf_current);
- }
-- }
++ /*
++ * Override conf_current with settings specified via CLI flags.
++ */
++ if (where != WHERE_DEFAULT)
++ trailer_set_conf_where(where, conf_current);
++ if (if_exists != EXISTS_DEFAULT)
++ trailer_set_conf_if_exists(if_exists, conf_current);
++ if (if_missing != MISSING_DEFAULT)
++ trailer_set_conf_if_missing(if_missing, conf_current);
++
++ trailer_add_arg_item(arg_head,
++ strbuf_detach(&tok, NULL),
++ strbuf_detach(&val, NULL),
++ conf_current);
++ free_trailer_conf(conf_current);
+ }
-
- free(cl_separators);
--}
--
+ }
+
static const char *next_line(const char *str)
+@@ trailer.c: void free_trailers(struct list_head *trailers)
+
+ void free_new_trailers(struct list_head *trailers)
{
- const char *nl = strchrnul(str, '\n');
+- struct list_head *pos, *tmp;
+- struct new_trailer_item *item;
++ struct list_head *pos, *p;
+
+- list_for_each_safe(pos, tmp, trailers) {
+- item = list_entry(pos, struct new_trailer_item, list);
++ list_for_each_safe(pos, p, trailers) {
+ list_del(pos);
+- free(item);
++ free_arg_item(list_entry(pos, struct arg_item, list));
+ }
+ }
+
## trailer.h ##
@@ trailer.h: int trailer_set_where(enum trailer_where *item, const char *value);
@@ trailer.h: int trailer_set_where(enum trailer_where *item, const char *value);
- enum trailer_if_missing if_missing;
-};
-
- void trailer_conf_set(enum trailer_where where,
- enum trailer_if_exists if_exists,
- enum trailer_if_missing if_missing,
+ void trailer_set_conf_where(enum trailer_where, struct trailer_conf *);
+ void trailer_set_conf_if_exists(enum trailer_if_exists, struct trailer_conf *);
+ void trailer_set_conf_if_missing(enum trailer_if_missing, struct trailer_conf *);
@@ trailer.h: struct process_trailer_options {
void parse_trailers_from_config(struct list_head *config_head);
-void parse_trailers_from_command_line_args(struct list_head *arg_head,
- struct list_head *new_trailer_head);
--
++void parse_trailer_from_command_line_arg(const char *line,
++ enum trailer_where where,
++ enum trailer_if_exists if_exists,
++ enum trailer_if_missing if_missing,
++ struct list_head *arg_head);
+
void process_trailers_lists(struct list_head *head,
struct list_head *arg_head);
-
-: ----------- > 26: 9720526dd8a trailer: unify "--trailer ..." arg handling
-: ----------- > 27: 26df2514acb trailer_set_*(): put out parameter at the end
10: bcd3fc9660e ! 28: 14927038d85 trailer: introduce "template" term for readability @@ Commit message
- [*] check_if_different() (reorder parameters only)
- [*] find_same_and_apply_arg() (reorder parameters only)
- Reorder parameters where appropriate; these functions have been marked
- with an asterisk ([*]).
+ Reorder parameters to prefer input parameters toward the beginning and
+ out parameters at the end; these functions have been marked with an
+ asterisk ([*]).
This removes the "arg" terminology (standing for "CLI arguments") from the trailer implementation, which makes sense because trailers
@@ Commit message
block) and trailer templates that are defined as CLI args or configurations. Some functions implied a single action when they could do two different things, so introduce words like "maybe" and "or" to
- unmask their behavior.
+ make their behavior more explicit.
In summary this patch renames and reorders parameters for readability, without any behavioral change. We don't rename
- find_same_and_apply_arg(), because it will be refactored soon. As an
- added benefit, we no longer use the term "arg" to mean "CLI arguments"
- in the trailer implementation, because trailers themselves should not be
- concerned about CLI arguments (this is the domain of the
- interpret-trailers builtin).
+ find_same_and_apply_arg(), because it will be refactored soon.
For parse_trailers_from_config() (renamed to parse_trailer_templates_from_config()), add a NEEDSWORK discussion about how the deprecated trailer.*.command configuration option is oddly more featureful than trailer.*.cmd (if we were to remove support for trailer.*.command, users would not be able to replicate the behavior
- with trailer.*.cmd and lose out on functionality).
+ with trailer.*.cmd and would lose out on functionality).
## builtin/interpret-trailers.c ##
@@ builtin/interpret-trailers.c: static int option_parse_if_missing(const struct option *opt,
-
- static char *cl_separators;
+ return trailer_set_if_missing(arg, opt->value);
+ }
-static int option_parse_trailer(const struct option *opt,
- const char *arg, int unset)
@@ builtin/interpret-trailers.c: static int option_parse_if_missing(const struct op
struct strbuf val = STRBUF_INIT;
const struct trailer_conf *conf;
@@ builtin/interpret-trailers.c: static int option_parse_trailer(const struct option *opt,
- ssize_t separator_pos;
+ static char *cl_separators;
if (unset) {
- free_new_trailers(trailers);
@@ builtin/interpret-trailers.c: static int option_parse_trailer(const struct optio
}
@@ builtin/interpret-trailers.c: static int option_parse_trailer(const struct option *opt,
- */
- trailer_conf_set(where, if_exists, if_missing, conf_current);
+ if (if_missing != MISSING_DEFAULT)
+ trailer_set_conf_if_missing(if_missing, conf_current);
-- trailer_add_arg_item(strbuf_detach(&tok, NULL),
+- trailer_add_arg_item(trailers,
+- strbuf_detach(&tok, NULL),
+ add_trailer_template(strbuf_detach(&tok, NULL),
strbuf_detach(&val, NULL),
- conf_current,
-- trailers);
+- conf_current);
++ conf_current,
+ templates);
- } else {
- struct strbuf sb = STRBUF_INIT;
- strbuf_addstr(&sb, arg);
+ free_trailer_conf(conf_current);
+ }
+
@@ builtin/interpret-trailers.c: static void read_input_file(struct strbuf *sb, const char *file)
}
static void interpret_trailers(const struct process_trailer_options *opts,
-- struct list_head *arg_trailers,
+- struct list_head *new_trailer_head,
+ struct list_head *templates,
const char *file)
{
@@ builtin/interpret-trailers.c: static void interpret_trailers(const struct proces
/* Print the lines before the trailer block */
if (!opts->only_trailers)
@@ builtin/interpret-trailers.c: static void interpret_trailers(const struct process_trailer_options *opts,
+ fprintf(outfile, "\n");
-
- if (!opts->only_input) {
-- process_trailers_lists(&head, arg_trailers);
+ if (!opts->only_input)
+- process_trailers_lists(&head, new_trailer_head);
+ apply_trailer_templates(templates, &trailers_from_sb);
- }
/* Print trailer block. */
- format_trailers(opts, &head, &tb);
+- free_trailers(&head);
+ format_trailers(opts, &trailers_from_sb, &tb);
++ free_trailers(&trailers_from_sb);
fwrite(tb.buf, 1, tb.len, outfile);
strbuf_release(&tb);
-- free_trailers(&head);
-+ free_trailers(&trailers_from_sb);
-
- /* Print the lines after the trailer block as is */
- if (!opts->only_trailers)
@@ builtin/interpret-trailers.c: static void interpret_trailers(const struct process_trailer_options *opts,
int cmd_interpret_trailers(int argc, const char **argv, const char *prefix)
{
struct process_trailer_options opts = PROCESS_TRAILER_OPTIONS_INIT;
- LIST_HEAD(configured_trailers);
-- LIST_HEAD(arg_trailers);
+- LIST_HEAD(trailers);
+ LIST_HEAD(configured_templates);
+ LIST_HEAD(templates);
@@ builtin/interpret-trailers.c: int cmd_interpret_trailers(int argc, const char **
OPT_CALLBACK_F(0, "parse", &opts, NULL, N_("alias for --only-trailers --only-input --unfold"),
PARSE_OPT_NOARG | PARSE_OPT_NONEG, parse_opt_parse),
OPT_BOOL(0, "no-divider", &opts.no_divider, N_("do not treat \"---\" as the end of input")),
-- OPT_CALLBACK(0, "trailer", &arg_trailers, N_("trailer"),
+- OPT_CALLBACK(0, "trailer", &trailers, N_("trailer"),
- N_("trailer(s) to add"), option_parse_trailer),
+ OPT_CALLBACK(0, "trailer", &templates, N_("trailer"),
+ N_("trailer(s) to add"), option_parse_trailer_template),
@@ builtin/interpret-trailers.c: int cmd_interpret_trailers(int argc, const char **
@@ builtin/interpret-trailers.c: int cmd_interpret_trailers(int argc, const char **argv, const char *prefix)
trailer_config_init();
- if (!opts.only_input) {
+ if (!opts.only_input)
- parse_trailers_from_config(&configured_trailers);
+ parse_trailer_templates_from_config(&configured_templates);
- }
-
- /*
-@@ builtin/interpret-trailers.c: int cmd_interpret_trailers(int argc, const char **argv, const char *prefix)
- free(cl_separators);
+ argc = parse_options(argc, argv, prefix, options,
+ git_interpret_trailers_usage, 0);
-- if (opts.only_input && !list_empty(&arg_trailers))
+- if (opts.only_input && !list_empty(&trailers))
+ if (opts.only_input && !list_empty(&templates))
usage_msg_opt(
_("--trailer with --only-input does not make sense"), git_interpret_trailers_usage,
options);
-- list_splice(&configured_trailers, &arg_trailers);
+- list_splice(&configured_trailers, &trailers);
+ list_splice(&configured_templates, &templates);
if (argc) {
int i;
for (i = 0; i < argc; i++)
-- interpret_trailers(&opts, &arg_trailers, argv[i]);
+- interpret_trailers(&opts, &trailers, argv[i]);
+ interpret_trailers(&opts, &templates, argv[i]);
} else {
if (opts.in_place)
die(_("no input file given for in-place editing"));
-- interpret_trailers(&opts, &arg_trailers, NULL);
+- interpret_trailers(&opts, &trailers, NULL);
+ interpret_trailers(&opts, &templates, NULL);
}
-- free_new_trailers(&arg_trailers);
+- free_new_trailers(&trailers);
+ free_trailer_templates(&templates);
return 0;
@@ trailer.c: static char *apply_command(struct trailer_conf *conf, const char *arg
}
}
-@@ trailer.c: void duplicate_trailer_conf(struct trailer_conf *dst,
- dst->cmd = xstrdup_or_null(src->cmd);
+@@ trailer.c: void free_trailer_conf(struct trailer_conf *conf)
+ free(conf);
}
-static struct arg_item *get_conf_item(const char *name)
@@ trailer.c: static struct trailer_item *add_trailer_item(struct list_head *head,
return new_item;
}
--void trailer_add_arg_item(char *tok, char *val, const struct trailer_conf *conf,
-- struct list_head *arg_head)
+-void trailer_add_arg_item(struct list_head *arg_head, char *tok, char *val,
+- const struct trailer_conf *conf)
+void add_trailer_template(char *tok, char *val, const struct trailer_conf *conf,
+ struct list_head *templates)
{
@@ trailer.c: static struct trailer_item *add_trailer_item(struct list_head *head,
- list_for_each(pos, &conf_head) {
- item = list_entry(pos, struct arg_item, list);
- if (item->conf.command)
-- trailer_add_arg_item(xstrdup(token_from_item(item, NULL)),
+- trailer_add_arg_item(config_head,
+- xstrdup(token_from_item(item, NULL)),
- xstrdup(""),
-- &item->conf,
-- config_head);
+- &item->conf);
+ /*
+ * Get configured templates with a ".command" option.
+ *
@@ trailer.c: static struct trailer_item *add_trailer_item(struct list_head *head,
}
}
-@@ trailer.c: static size_t find_trailer_block_start(const char *buf, size_t len)
- * Get the start of the trailers by looking starting from the end for a
- * blank line before a set of non-blank lines that (i) are all
- * trailers, or (ii) contains at least one Git-generated trailer and
-- * consists of at least 25% trailers.
-+ * consists of at least 25% configured trailers.
- */
- for (l = last_line(buf, len);
- l >= end_of_title;
@@ trailer.c: static size_t find_trailer_block_start(const char *buf, size_t len)
possible_continuation_lines = 0;
if (recognized_prefix)
@@ trailer.c: void free_trailers(struct list_head *trailers)
## trailer.h ##
-@@ trailer.h: void duplicate_trailer_conf(struct trailer_conf *dst, -
+@@ trailer.h: struct trailer_conf *new_trailer_conf(void);
+ void duplicate_trailer_conf(struct trailer_conf *dst,
+ const struct trailer_conf *src);
const char *trailer_default_separators(void);
-
--void trailer_add_arg_item(char *tok, char *val, const struct trailer_conf *conf,
-- struct list_head *arg_head);
-+void add_trailer_template(char *tok, char *val, const struct trailer_conf *conf, +-void trailer_add_arg_item(struct list_head *arg_head, char *tok, char *val,
+- const struct trailer_conf *conf);
++void add_trailer_template(char *tok, char *val, const struct trailer_conf *,
+ struct list_head *templates);
struct process_trailer_options {
@@ trailer.h: struct process_trailer_options {
-void process_trailers_lists(struct list_head *head,
- struct list_head *arg_head);
-+void apply_trailer_templates(struct list_head *templates, struct list_head *trailers_head); ++void apply_trailer_templates(struct list_head *templates,
++ struct list_head *trailers_head);
ssize_t find_separator(const char *line, const char *separators);
-@@ trailer.h: void format_trailers(const struct process_trailer_options *opts, +@@ trailer.h: void format_trailers(const struct process_trailer_options *,
struct list_head *trailers,
struct strbuf *out);
void free_trailers(struct list_head *);
-void free_new_trailers(struct list_head *);
+ void free_trailer_conf(struct trailer_conf *);
+void free_trailer_templates(struct list_head *);
/*
Signature · 1 line
gitgitgadget
PATCH v4 1/28 trailer: free trailer_info _after_ all related usage
From: Linus Arver <[email protected]>
In de7c27a186 (trailer: use offsets for trailer_start/trailer_end, 2023-10-20), we started using trailer block offsets in trailer_info. In particular, we dropped the use of a separate stack variable "size_t trailer_end", in favor of accessing the new "trailer_block_end" member of trailer_info (as "info.trailer_block_end").
At that time, we forgot to also move the
trailer_info_release(&info);
line to be _after_ this new use of the trailer_info struct. Move it now.
Note that even without this patch, we didn't have leaks or any other problems because trailer_info_release() only frees memory allocated on the heap. The "trailer_block_end" member was allocated on the stack back then (as it is now) so it was still safe to use for all this time.
--- trailer.c | 3 +-- 1 file changed, 1 insertion(+), 2 deletions(-)
trailer.c +1 -2
@@ -1111,13 +1111,12 @@ void process_trailers(const char *file, }print_all (outfile, &head, opts); -free_all (&head); -trailer_info_release (&info);/* Print the lines after the trailers as is */ if (!opts->only_trailers)fwrite (sb.buf + info.trailer_block_end,1 , sb.len - info.trailer_block_end, outfile); +trailer_info_release (&info);if (opts->in_place)if (rename_tempfile (&trailers_tempfile, file))
Signature · 1 line
gitgitgadget
PATCH v4 2/28 shortlog: add test for de-duplicating folded trailers
In reply to Linus Arver via GitGitGadgetFrom: Linus Arver <[email protected]>
The shortlog builtin was taught to use the trailer iterator interface in 47beb37bc6 (shortlog: match commit trailers with --group, 2020-09-27). The iterator always unfolds values and this has always been the case since the time the iterator was first introduced in f0939a0eb1 (trailer:
add interface for iterating over commit trailers, 2020-09-27). Add a comment line to remind readers of this behavior.
The fact that the iterator always unfolds values is important (at least for shortlog) because unfolding allows it to recognize both folded and unfolded versions of the same trailer for de-duplication.
Capture the existing behavior in a new test case to guard against regressions in this area. This test case is based off of the existing "shortlog de-duplicates trailers in a single commit" just above it. Now if we were to remove the call to
unfold_value(&iter->val);
inside the iterator, this new test case will break.
--- t/t4201-shortlog.sh | 32 ++++++++++++++++++++++++++++++++ trailer.c | 1 + 2 files changed, 33 insertions(+)
t/t4201-shortlog.sh +32 -0
@@ -312,6 +312,38 @@ test_expect_success 'shortlog de-duplicates trailers in a single commit' ' test_cmp expect actual ' +# Trailers that have unfolded (single line) and folded (multiline) values which +# are otherwise identical are treated as the same trailer for de-duplication. +test_expect_success 'shortlog de-duplicates trailers in a single commit (folded/unfolded values)' ' + git commit --allow-empty -F - <<-\EOF && + subject one + + this message has two distinct values, plus a repeat (folded) + + Repeated-trailer: Foo foo foo + Repeated-trailer: Bar + Repeated-trailer: Foo + foo foo + EOF + + git commit --allow-empty -F - <<-\EOF && + subject two + + similar to the previous, but without the second distinct value + + Repeated-trailer: Foo foo foo + Repeated-trailer: Foo + foo foo + EOF + + cat >expect <<-\EOF && + 2 Foo foo foo + 1 Bar + EOF + git shortlog -ns --group=trailer:repeated-trailer -2 HEAD >actual && + test_cmp expect actual +' + test_expect_success 'shortlog can match multiple groups' ' git commit --allow-empty -F - <<-\EOF && subject one
trailer.c +1 -0
@@ -1270,6 +1270,7 @@ int trailer_iterator_advance(struct trailer_iterator *iter)strbuf_reset (&iter->val);parse_trailer (&iter->key, &iter->val,NULL , trailer, separator_pos); +/* Always unfold values during iteration. */ unfold_value (&iter->val);return 1 ; }
Signature · 1 line
gitgitgadget
PATCH v4 3/28 trailer: prepare to expose functions as part of API
In reply to Linus Arver via GitGitGadgetFrom: Linus Arver <[email protected]>
In the next patch, we will move "process_trailers" from trailer.c to builtin/interpret-trailers.c. That move will necessitate the growth of the trailer.h API, forcing us to expose some additional functions in trailer.h.
Rename relevant functions so that they include the term "trailer" in their name, so that clients of the API will be able to easily identify them by their "trailer" moniker, just like all the other functions already exposed by trailer.h.
Take the opportunity to start putting trailer processing options (opts) as the first parameter. This will be the pattern going forward in this series.
--- builtin/interpret-trailers.c | 4 ++-- trailer.c | 26 +++++++++++++------------- trailer.h | 6 +++--- 3 files changed, 18 insertions(+), 18 deletions(-)
builtin/interpret-trailers.c +2 -2
@@ -132,11 +132,11 @@ int cmd_interpret_trailers(int argc, const char **argv, const char *prefix)if (argc) {int i;for (i =0 ; i < argc; i++) -process_trailers (argv[i], &opts, &trailers); +interpret_trailers (&opts, &trailers, argv[i]); }else {if (opts.in_place)die (_ ("no input file given for in-place editing" )); -process_trailers (NULL , &opts, &trailers); +interpret_trailers (&opts, &trailers,NULL ); }new_trailers_clear (&trailers);
trailer.c +13 -13
@@ -163,12 +163,12 @@ static void print_tok_val(FILE *outfile, const char *tok, const char *val)fprintf (outfile,"%s%c %s\n" , tok, separators[0 ], val); } -static void print_all (FILE *outfile,struct list_head *head, -const struct process_trailer_options *opts) +static void format_trailers (const struct process_trailer_options *opts, +struct list_head *trailers,FILE *outfile) {struct list_head *pos;struct trailer_item *item; -list_for_each (pos, head) { +list_for_each (pos, trailers) { item = list_entry(pos, struct trailer_item, list);if ((!opts->trim_empty ||strlen (item->value) >0 ) && (!opts->only_trailers || item->token))
@@ -589,7 +589,7 @@ static int git_trailer_config(const char *conf_key, const char *value,return 0 ; } -static void ensure_configured (void ) +static void trailer_config_init (void ) {if (configured)return ;
@@ -1035,10 +1035,10 @@ static void parse_trailers(struct trailer_info *info, } } -static void free_all (struct list_head *head) +static void free_trailers (struct list_head *trailers) {struct list_head *pos, *p; -list_for_each_safe (pos, p, head) { +list_for_each_safe (pos, p, trailers) {list_del (pos);free_trailer_item (list_entry(pos ,struct trailer_item ,list )); }
@@ -1075,16 +1075,16 @@ static FILE *create_in_place_tempfile(const char *file)return outfile; } -void process_trailers (const char *file, -const struct process_trailer_options *opts, -struct list_head *new_trailer_head) +void interpret_trailers (const struct process_trailer_options *opts, +struct list_head *new_trailer_head, +const char *file) {LIST_HEAD (head);struct strbuf sb =STRBUF_INIT ;struct trailer_info info;FILE *outfile = stdout; -ensure_configured (); +trailer_config_init ();read_input_file (&sb, file);
@@ -1110,8 +1110,8 @@ void process_trailers(const char *file,process_trailers_lists (&head, &arg_head); } -print_all (outfile, &head, opts); -free_all (&head); +format_trailers (opts, &head, outfile); +free_trailers (&head);/* Print the lines after the trailers as is */ if (!opts->only_trailers)
@@ -1134,7 +1134,7 @@ void trailer_info_get(struct trailer_info *info, const char *str,size_t nr =0 , alloc =0 ;char **last =NULL ; -ensure_configured (); +trailer_config_init (); end_of_log_message =find_end_of_log_message (str, opts->no_divider); trailer_block_start =find_trailer_block_start (str, end_of_log_message);
trailer.h +3 -3
@@ -81,9 +81,9 @@ struct process_trailer_options {#define PROCESS_TRAILER_OPTIONS_INIT {0} -void process_trailers (const char *file, -const struct process_trailer_options *opts, -struct list_head *new_trailer_head); +void interpret_trailers (const struct process_trailer_options *opts, +struct list_head *new_trailer_head, +const char *file);void trailer_info_get (struct trailer_info *info,const char *str,const struct process_trailer_options *opts);
Signature · 1 line
gitgitgadget
PATCH v4 4/28 trailer: move interpret_trailers() to interpret-trailers.c
In reply to Linus Arver via GitGitGadgetFrom: Linus Arver <[email protected]>
The interpret-trailers.c builtin is the only place we need to call interpret_trailers(), so move its definition there (together with a few helper functions called only by it) and remove its external declaration from <trailer.h>.
Several helper functions that are called by interpret_trailers() remain in trailer.c because other callers in the same file still call them. Declare them in <trailer.h> so that interpret_trailers() (now in builtin/interpret-trailers.c) can continue calling them as a trailer API user.
This enriches <trailer.h> with a more granular API, which can then be unit-tested in the future (because interpret_trailers() by itself does too many things to be able to be easily unit-tested).
Take this opportunity to demote some file-handling functions out of the trailer API implementation, as these have nothing to do with trailers.
--- builtin/interpret-trailers.c | 93 +++++++++++++++++++++++++++ trailer.c | 119 ++++------------------------------- trailer.h | 20 +++++- 3 files changed, 123 insertions(+), 109 deletions(-)
builtin/interpret-trailers.c +93 -0
@@ -9,6 +9,7 @@#include "gettext.h" #include "parse-options.h" #include "string-list.h" +#include "tempfile.h" #include "trailer.h" #include "config.h"
@@ -91,6 +92,98 @@ static int parse_opt_parse(const struct option *opt, const char *arg,return 0 ; } +static struct tempfile *trailers_tempfile; + +static FILE *create_in_place_tempfile (const char *file) +{ +struct stat st; +struct strbuf filename_template =STRBUF_INIT ; +const char *tail; +FILE *outfile; + +if (stat (file, &st)) +die_errno (_ ("could not stat %s" ), file); +if (!S_ISREG (st.st_mode)) +die (_ ("file %s is not a regular file" ), file); +if (!(st.st_mode &S_IWUSR )) +die (_ ("file %s is not writable by user" ), file); + +/* Create temporary file in the same directory as the original */ + tail =strrchr (file,'/' ); +if (tail) +strbuf_add (&filename_template, file, tail - file +1 ); +strbuf_addstr (&filename_template,"git-interpret-trailers-XXXXXX" ); + + trailers_tempfile =xmks_tempfile_m (filename_template.buf, st.st_mode); +strbuf_release (&filename_template); + outfile =fdopen_tempfile (trailers_tempfile,"w" ); +if (!outfile) +die_errno (_ ("could not open temporary file" )); + +return outfile; +} + +static void read_input_file (struct strbuf *sb,const char *file) +{ +if (file) { +if (strbuf_read_file (sb, file,0 ) <0 ) +die_errno (_ ("could not read input file '%s'" ), file); + }else { +if (strbuf_read (sb,fileno (stdin),0 ) <0 ) +die_errno (_ ("could not read from stdin" )); + } +} + +static void interpret_trailers (const struct process_trailer_options *opts, +struct list_head *new_trailer_head, +const char *file) +{ +LIST_HEAD (head); +struct strbuf sb =STRBUF_INIT ; +struct trailer_info info; +FILE *outfile = stdout; + +trailer_config_init (); + +read_input_file (&sb, file); + +if (opts->in_place) + outfile =create_in_place_tempfile (file); + +parse_trailers (opts, &info, sb.buf, &head); + +/* Print the lines before the trailers */ +if (!opts->only_trailers) +fwrite (sb.buf,1 , info.trailer_block_start, outfile); + +if (!opts->only_trailers && !info.blank_line_before_trailer) +fprintf (outfile,"\n" ); + + +if (!opts->only_input) { +LIST_HEAD (config_head); +LIST_HEAD (arg_head); +parse_trailers_from_config (&config_head); +parse_trailers_from_command_line_args (&arg_head, new_trailer_head); +list_splice (&config_head, &arg_head); +process_trailers_lists (&head, &arg_head); + } + +format_trailers (opts, &head, outfile); +free_trailers (&head); + +/* Print the lines after the trailers as is */ +if (!opts->only_trailers) +fwrite (sb.buf + info.trailer_block_end,1 , sb.len - info.trailer_block_end, outfile); +trailer_info_release (&info); + +if (opts->in_place) +if (rename_tempfile (&trailers_tempfile, file)) +die_errno (_ ("could not rename temporary file to %s" ), file); + +strbuf_release (&sb); +} +int cmd_interpret_trailers (int argc,const char **argv,const char *prefix) {struct process_trailer_options opts =PROCESS_TRAILER_OPTIONS_INIT ;
trailer.c +13 -106
179 lines not on this page · raw message
trailer.h +17 -3
@@ -81,15 +81,29 @@ struct process_trailer_options {#define PROCESS_TRAILER_OPTIONS_INIT {0} -void interpret_trailers (const struct process_trailer_options *opts, -struct list_head *new_trailer_head, -const char *file); +void parse_trailers_from_config (struct list_head *config_head); + +void parse_trailers_from_command_line_args (struct list_head *arg_head, +struct list_head *new_trailer_head); + +void process_trailers_lists (struct list_head *head, +struct list_head *arg_head); + +void parse_trailers (const struct process_trailer_options *, +struct trailer_info *, +const char *str, +struct list_head *head);void trailer_info_get (struct trailer_info *info,const char *str,const struct process_trailer_options *opts);void trailer_info_release (struct trailer_info *info); +void trailer_config_init (void ); +void format_trailers (const struct process_trailer_options *, +struct list_head *trailers,FILE *outfile); +void free_trailers (struct list_head *); +/* * Format the trailers from the commit msg "msg" into the strbuf "out". * Note two caveats about "opts":
Signature · 1 line
gitgitgadget
PATCH v4 5/28 trailer: start preparing for formatting unification
In reply to Linus Arver via GitGitGadgetFrom: Linus Arver <[email protected]>
Currently there are two functions for formatting trailers in <trailer.h>:
void format_trailers(const struct process_trailer_options *,
struct list_head *trailers, FILE *outfile);
void format_trailers_from_commit(struct strbuf *out, const char *msg,
const struct process_trailer_options *opts);
and although they are similar enough (even taking the same process_trailer_options struct pointer) they are used quite differently. One might intuitively think that format_trailers_from_commit() builds on top of format_trailers(), but this is not the case. Instead format_trailers_from_commit() calls format_trailer_info() and format_trailers() is never called in that codepath.
This is a preparatory refactor to help us deprecate format_trailers() in favor of format_trailer_info() (at which point we can rename the latter to the former). When the deprecation is complete, both format_trailers_from_commit(), and the interpret-trailers builtin will be able to call into the same helper function (instead of format_trailers() and format_trailer_info(), respectively). Unifying the formatters is desirable because it simplifies the API.
Reorder parameters for format_trailers_from_commit() to prefer
const struct process_trailer_options *opts
as the first parameter, because these options are intimately tied to formatting trailers. And take
struct strbuf *out
last, because it's an "out parameter" (something that the caller wants to use as the output of this function).
--- pretty.c | 2 +- ref-filter.c | 2 +- trailer.c | 11 ++++++----- trailer.h | 5 +++-- 4 files changed, 11 insertions(+), 9 deletions(-)
pretty.c +1 -1
@@ -1759,7 +1759,7 @@ static size_t format_commit_one(struct strbuf *sb, /* in UTF-8 */ goto trailer_out; }if (*arg ==')' ) { -format_trailers_from_commit (sb, msg + c->subject_off, &opts); +format_trailers_from_commit (&opts, msg + c->subject_off, sb); ret = arg - placeholder +1 ; } trailer_out:
ref-filter.c +1 -1
@@ -1985,7 +1985,7 @@ static void grab_sub_body_contents(struct atom_value *val, int deref, struct expstruct strbuf s =STRBUF_INIT ;/* Format the trailer info according to the trailer_opts given */ -format_trailers_from_commit (&s, subpos, &atom->u.contents.trailer_opts); +format_trailers_from_commit (&atom->u.contents.trailer_opts, subpos, &s); v->s =strbuf_detach (&s,NULL ); }else if (atom->u.contents.option ==C_BARE )
trailer.c +6 -5
@@ -1083,10 +1083,10 @@ void trailer_info_release(struct trailer_info *info)free (info->trailers); } -static void format_trailer_info (struct strbuf *out, +static void format_trailer_info (const struct process_trailer_options *opts,const struct trailer_info *info,const char *msg, -const struct process_trailer_options *opts) +struct strbuf *out) {size_t origlen = out->len;size_t i;
@@ -1144,13 +1144,14 @@ static void format_trailer_info(struct strbuf *out, } -void format_trailers_from_commit (struct strbuf *out,const char *msg, -const struct process_trailer_options *opts) +void format_trailers_from_commit (const struct process_trailer_options *opts, +const char *msg, +struct strbuf *out) {struct trailer_info info;trailer_info_get (&info, msg, opts); -format_trailer_info (out, &info, msg, opts); +format_trailer_info (opts, &info, msg, out);trailer_info_release (&info); }
trailer.h +3 -2
@@ -115,8 +115,9 @@ void free_trailers(struct list_head *);* only the trailer block itself, even if the "only_trailers" option is not * set. */ -void format_trailers_from_commit (struct strbuf *out,const char *msg, -const struct process_trailer_options *opts); +void format_trailers_from_commit (const struct process_trailer_options *opts, +const char *msg, +struct strbuf *out);/* * An interface for iterating over the trailers found in a particular commit
Signature · 1 line
gitgitgadget
PATCH v4 6/28 trailer_info_get(): reorder parameters
In reply to Linus Arver via GitGitGadgetFrom: Linus Arver <[email protected]>
This is another preparatory refactor to unify the trailer formatters.
Take
const struct process_trailer_options *opts
as the first parameter, because these options are required for parsing trailers (e.g., whether to treat "---" as the end of the log message). And take
struct trailer_info *info
last, because it's an "out parameter" (something that the caller wants to use as the output of this function).
--- sequencer.c | 2 +- trailer.c | 11 ++++++----- trailer.h | 5 +++-- 3 files changed, 10 insertions(+), 8 deletions(-)
sequencer.c +1 -1
@@ -332,7 +332,7 @@ static int has_conforming_footer(struct strbuf *sb, struct strbuf *sob, sb->buf[sb->len - ignore_footer] ='\0' ; } -trailer_info_get (&info, sb->buf, &opts); +trailer_info_get (&opts, sb->buf, &info);if (ignore_footer) sb->buf[sb->len - ignore_footer] = saved_char;
trailer.c +6 -5
@@ -997,7 +997,7 @@ void parse_trailers(const struct process_trailer_options *opts,struct strbuf val =STRBUF_INIT ;size_t i; -trailer_info_get (info, str, opts); +trailer_info_get (opts, str, info);for (i =0 ; i < info->trailer_nr; i++) {int separator_pos;
@@ -1032,8 +1032,9 @@ void free_trailers(struct list_head *trailers) } } -void trailer_info_get (struct trailer_info *info,const char *str, -const struct process_trailer_options *opts) +void trailer_info_get (const struct process_trailer_options *opts, +const char *str, +struct trailer_info *info) {size_t end_of_log_message =0 , trailer_block_start =0 ;struct strbuf **trailer_lines, **ptr;
@@ -1150,7 +1151,7 @@ void format_trailers_from_commit(const struct process_trailer_options *opts, {struct trailer_info info; -trailer_info_get (&info, msg, opts); +trailer_info_get (opts, msg, &info);format_trailer_info (opts, &info, msg, out);trailer_info_release (&info); }
@@ -1161,7 +1162,7 @@ void trailer_iterator_init(struct trailer_iterator *iter, const char *msg)strbuf_init (&iter->key,0 );strbuf_init (&iter->val,0 ); opts.no_divider =1 ; -trailer_info_get (&iter->internal.info, msg, &opts); +trailer_info_get (&opts, msg, &iter->internal.info); iter->internal.cur =0 ; }
trailer.h +3 -2
@@ -94,8 +94,9 @@ void parse_trailers(const struct process_trailer_options *,const char *str, struct list_head *head); -void trailer_info_get (struct trailer_info *info,const char *str, -const struct process_trailer_options *opts); +void trailer_info_get (const struct process_trailer_options *, +const char *str, +struct trailer_info *);void trailer_info_release (struct trailer_info *info);
Signature · 1 line
gitgitgadget
PATCH v4 7/28 format_trailers(): use strbuf instead of FILE
In reply to Linus Arver via GitGitGadgetFrom: Linus Arver <[email protected]>
This is another preparatory refactor to unify the trailer formatters.
Make format_trailers() also write to a strbuf, to align with format_trailers_from_commit() which also does the same. Doing this makes format_trailers() behave similar to format_trailer_info() (which will soon help us replace one with the other).
--- builtin/interpret-trailers.c | 6 +++++- trailer.c | 13 +++++++------ trailer.h | 3 ++- 3 files changed, 14 insertions(+), 8 deletions(-)
builtin/interpret-trailers.c +5 -1
@@ -140,6 +140,7 @@ static void interpret_trailers(const struct process_trailer_options *opts, {LIST_HEAD (head);struct strbuf sb =STRBUF_INIT ; +struct strbuf trailer_block =STRBUF_INIT ;struct trailer_info info;FILE *outfile = stdout;
@@ -169,8 +170,11 @@ static void interpret_trailers(const struct process_trailer_options *opts,process_trailers_lists (&head, &arg_head); } -format_trailers (opts, &head, outfile); +/* Print trailer block. */ +format_trailers (opts, &head, &trailer_block);free_trailers (&head); +fwrite (trailer_block.buf,1 , trailer_block.len, outfile); +strbuf_release (&trailer_block);/* Print the lines after the trailers as is */ if (!opts->only_trailers)
trailer.c +7 -6
@@ -144,12 +144,12 @@ static char last_non_space_char(const char *s)return '\0' ; } -static void print_tok_val (FILE *outfile,const char *tok,const char *val) +static void print_tok_val (struct strbuf *out,const char *tok,const char *val) {char c;if (!tok) { -fprintf (outfile,"%s\n" , val); +strbuf_addf (out,"%s\n" , val);return ; }
@@ -157,13 +157,14 @@ static void print_tok_val(FILE *outfile, const char *tok, const char *val)if (!c)return ;if (strchr (separators, c)) -fprintf (outfile,"%s%s\n" , tok, val); +strbuf_addf (out,"%s%s\n" , tok, val);else -fprintf (outfile,"%s%c %s\n" , tok, separators[0 ], val); +strbuf_addf (out,"%s%c %s\n" , tok, separators[0 ], val); }void format_trailers (const struct process_trailer_options *opts, -struct list_head *trailers,FILE *outfile) +struct list_head *trailers, +struct strbuf *out) {struct list_head *pos;struct trailer_item *item;
@@ -171,7 +172,7 @@ void format_trailers(const struct process_trailer_options *opts, item = list_entry(pos, struct trailer_item, list);if ((!opts->trim_empty ||strlen (item->value) >0 ) && (!opts->only_trailers || item->token)) -print_tok_val (outfile, item->token, item->value); +print_tok_val (out, item->token, item->value); } }
trailer.h +2 -1
@@ -102,7 +102,8 @@ void trailer_info_release(struct trailer_info *info);void trailer_config_init (void );void format_trailers (const struct process_trailer_options *, -struct list_head *trailers,FILE *outfile); +struct list_head *trailers, +struct strbuf *out);void free_trailers (struct list_head *);/*
Signature · 1 line
gitgitgadget
PATCH v4 8/28 format_trailer_info(): move "fast path" to caller
In reply to Linus Arver via GitGitGadgetFrom: Linus Arver <[email protected]>
This is another preparatory refactor to unify the trailer formatters.
This allows us to drop the "msg" parameter from format_trailer_info(), so that it take 3 parameters, similar to format_trailers() which also takes 3 parameters:
void format_trailers(const struct process_trailer_options *opts,
struct list_head *trailers, struct strbuf *out)
The short-term goal is to make format_trailer_info() be smart enough to deprecate format_trailers(). And then ultimately we will rename format_trailer_info() to format_trailers().
--- trailer.c | 20 +++++++++----------- 1 file changed, 9 insertions(+), 11 deletions(-)
trailer.c +9 -11
@@ -1087,21 +1087,11 @@ void trailer_info_release(struct trailer_info *info)static void format_trailer_info (const struct process_trailer_options *opts,const struct trailer_info *info, -const char *msg,struct strbuf *out) {size_t origlen = out->len;size_t i; -/* If we want the whole block untouched, we can take the fast path. */ -if (!opts->only_trailers && !opts->unfold && !opts->filter && - !opts->separator && !opts->key_only && !opts->value_only && - !opts->key_value_separator) { -strbuf_add (out, msg + info->trailer_block_start, - info->trailer_block_end - info->trailer_block_start); -return ; - } -for (i =0 ; i < info->trailer_nr; i++) {char *trailer = info->trailers[i];ssize_t separator_pos =find_separator (trailer, separators);
@@ -1153,7 +1143,15 @@ void format_trailers_from_commit(const struct process_trailer_options *opts,struct trailer_info info;trailer_info_get (opts, msg, &info); -format_trailer_info (opts, &info, msg, out); +/* If we want the whole block untouched, we can take the fast path. */ +if (!opts->only_trailers && !opts->unfold && !opts->filter && + !opts->separator && !opts->key_only && !opts->value_only && + !opts->key_value_separator) { +strbuf_add (out, msg + info.trailer_block_start, + info.trailer_block_end - info.trailer_block_start); + }else +format_trailer_info (opts, &info, out); +trailer_info_release (&info); }
Signature · 1 line
gitgitgadget
PATCH v4 9/28 format_trailers_from_commit(): indirectly call trailer_info_get()
In reply to Linus Arver via GitGitGadgetFrom: Linus Arver <[email protected]>
This is another preparatory refactor to unify the trailer formatters.
Instead of calling trailer_info_get() directly, call parse_trailers() which already calls trailer_info_get(). This change is a NOP because format_trailer_info() only looks at the "trailers" string array, not the trailer_item objects which parse_trailers() populates.
In the next patch, we'll change format_trailer_info() to use the parsed trailer_item objects instead of the string array.
--- trailer.c | 5 ++++- 1 file changed, 4 insertions(+), 1 deletion(-)
trailer.c +4 -1
@@ -1140,9 +1140,11 @@ void format_trailers_from_commit(const struct process_trailer_options *opts,const char *msg, struct strbuf *out) { +LIST_HEAD (trailers );struct trailer_info info; -trailer_info_get (opts, msg, &info); +parse_trailers (opts, &info, msg, &trailers); +/* If we want the whole block untouched, we can take the fast path. */ if (!opts->only_trailers && !opts->unfold && !opts->filter && !opts->separator && !opts->key_only && !opts->value_only &&
@@ -1152,6 +1154,7 @@ void format_trailers_from_commit(const struct process_trailer_options *opts, }else format_trailer_info (opts, &info, out); +free_trailers (&trailers);trailer_info_release (&info); }
Signature · 1 line
gitgitgadget
PATCH v4 10/28 format_trailer_info(): use trailer_item objects
In reply to Linus Arver via GitGitGadgetFrom: Linus Arver <[email protected]>
This is another preparatory refactor to unify the trailer formatters.
Make format_trailer_info() operate on trailer_item objects, not the raw string array.
This breaks t4205 and t6300. We will continue to make improvements until the test suite passes again, ultimately renaming format_trailer_info() to format_trailers(), at which point the unification of these formatters will be complete.
--- trailer.c | 21 ++++++++++----------- 1 file changed, 10 insertions(+), 11 deletions(-)
trailer.c +10 -11
@@ -1086,21 +1086,21 @@ void trailer_info_release(struct trailer_info *info) }static void format_trailer_info (const struct process_trailer_options *opts, -const struct trailer_info *info, +struct list_head *trailers,struct strbuf *out) {size_t origlen = out->len; -size_t i; - -for (i =0 ; i < info->trailer_nr; i++) { -char *trailer = info->trailers[i]; -ssize_t separator_pos =find_separator (trailer, separators); +struct list_head *pos; +struct trailer_item *item; -if (separator_pos >=1 ) { +list_for_each (pos, trailers) { + item = list_entry(pos, struct trailer_item, list); +if (item->token) {struct strbuf tok =STRBUF_INIT ;struct strbuf val =STRBUF_INIT ; +strbuf_addstr (&tok, item->token); +strbuf_addstr (&val, item->value); -parse_trailer (&tok, &val,NULL , trailer, separator_pos);if (!opts->filter || opts->filter (&tok, opts->filter_data)) {if (opts->unfold)unfold_value (&val);
@@ -1127,13 +1127,12 @@ static void format_trailer_info(const struct process_trailer_options *opts,if (opts->separator && out->len != origlen) {strbuf_addbuf (out, opts->separator); } -strbuf_addstr (out, trailer); +strbuf_addstr (out, item->value);if (opts->separator) {strbuf_rtrim (out); } } } - } void format_trailers_from_commit(const struct process_trailer_options *opts,
@@ -1152,7 +1151,7 @@ void format_trailers_from_commit(const struct process_trailer_options *opts,strbuf_add (out, msg + info.trailer_block_start, info.trailer_block_end - info.trailer_block_start); }else -format_trailer_info (opts, &info, out); +format_trailer_info (opts, &trailers, out);free_trailers (&trailers);trailer_info_release (&info);
Signature · 1 line
gitgitgadget
Re: [PATCH v4 10/28] format_trailer_info(): use trailer_item objects
Quoted 12 lines · Linus Arver via GitGitGadget
From: Linus Arver <[email protected]>
This is another preparatory refactor to unify the trailer formatters.
Make
format_trailer_info()operate ontrailer_itemobjects, not the raw string array.This breaks t4205 and t6300. We will continue to make improvements until the test suite passes again, ultimately renaming
format_trailer_info()toformat_trailers(), at which point the unification of these formatters will be complete.
Quoted 4 lines
Signed-off-by Linus Arver <[email protected]>--- trailer.c | 21 ++++++++++----------- 1 file changed, 10 insertions(+), 11 deletions(-)
I would have expected a (tentative) flip from test_expect_success to test_expect_failure in the affected tests, to illustrate what behaviour change this step introduces and why.
But the huge single step in the previous round broken out into smaller steps like this round makes them much easier to follow.
Thanks.
Quoted 58 lines
trailer.c +10
-11@@ -1086,21 +1086,21 @@ void trailer_info_release(struct trailer_info *info) }static void format_trailer_info (const struct process_trailer_options *opts, -const struct trailer_info *info, +struct list_head *trailers,struct strbuf *out) {size_t origlen = out->len; -size_t i; - -for (i =0 ; i < info->trailer_nr; i++) { -char *trailer = info->trailers[i]; -ssize_t separator_pos =find_separator (trailer, separators); +struct list_head *pos; +struct trailer_item *item; -if (separator_pos >=1 ) { +list_for_each (pos, trailers) { + item = list_entry(pos, struct trailer_item, list); +if (item->token) {struct strbuf tok =STRBUF_INIT ;struct strbuf val =STRBUF_INIT ; +strbuf_addstr (&tok, item->token); +strbuf_addstr (&val, item->value); -parse_trailer (&tok, &val,NULL , trailer, separator_pos);if (!opts->filter || opts->filter (&tok, opts->filter_data)) {if (opts->unfold)unfold_value (&val);@@ -1127,13 +1127,12 @@ static void format_trailer_info(const struct process_trailer_options *opts,if (opts->separator && out->len != origlen) {strbuf_addbuf (out, opts->separator); } -strbuf_addstr (out, trailer); +strbuf_addstr (out, item->value);if (opts->separator) {strbuf_rtrim (out); } } } - } void format_trailers_from_commit(const struct process_trailer_options *opts,@@ -1152,7 +1151,7 @@ void format_trailers_from_commit(const struct process_trailer_options *opts,strbuf_add (out, msg + info.trailer_block_start, info.trailer_block_end - info.trailer_block_start); }else -format_trailer_info (opts, &info, out); +format_trailer_info (opts, &trailers, out);free_trailers (&trailers);trailer_info_release (&info);
Re: [PATCH v4 10/28] format_trailer_info(): use trailer_item objects
Quoted 14 lines · Junio C Hamano
Quoted 12 lines · Linus Arver via GitGitGadget
From: Linus Arver <[email protected]>
This is another preparatory refactor to unify the trailer formatters.
Make
format_trailer_info()operate ontrailer_itemobjects, not the raw string array.This breaks t4205 and t6300. We will continue to make improvements until the test suite passes again, ultimately renaming
format_trailer_info()toformat_trailers(), at which point the unification of these formatters will be complete.
Quoted 8 lines
Quoted 4 lines
Signed-off-by Linus Arver <[email protected]>--- trailer.c | 21 ++++++++++----------- 1 file changed, 10 insertions(+), 11 deletions(-)I would have expected a (tentative) flip from
test_expect_successtotest_expect_failurein the affected tests, to illustrate what behaviour change this step introduces and why.
Somehow, such a simple idea did not cross my mind (even though I admit I didn't like how I was breaking tests, albeit temporarily). Will update on next reroll.
Quoted 2 lines
But the huge single step in the previous round broken out into smaller steps like this round makes them much easier to follow.
Great, I'm doing something right for once! ;)
PATCH v4 11/28 format_trailer_info(): drop redundant unfold_value()
In reply to Linus Arver via GitGitGadgetFrom: Linus Arver <[email protected]>
This is another preparatory refactor to unify the trailer formatters.
In the last patch we made format_trailer_info() use trailer_item objects instead of the "trailers" string array. This means that the call to unfold_value() here is redundant because the trailer_item objects are already unfolded in parse_trailers() which is a dependency of our caller, format_trailers_from_commit().
Remove the redundant call.
--- trailer.c | 3 --- 1 file changed, 3 deletions(-)
trailer.c +0 -3
@@ -1102,9 +1102,6 @@ static void format_trailer_info(const struct process_trailer_options *opts,strbuf_addstr (&val, item->value);if (!opts->filter || opts->filter (&tok, opts->filter_data)) { -if (opts->unfold) -unfold_value (&val); -if (opts->separator && out->len != origlen)strbuf_addbuf (out, opts->separator);if (!opts->value_only)
Signature · 1 line
gitgitgadget
Re: [PATCH v4 11/28] format_trailer_info(): drop redundant unfold_value()
Quoted 11 lines · Linus Arver via GitGitGadget
From: Linus Arver <[email protected]>
This is another preparatory refactor to unify the trailer formatters.
In the last patch we made
format_trailer_info()usetrailer_itemobjects instead of the "trailers" string array. This means that the call tounfold_value()here is redundant because thetrailer_itemobjects are already unfolded inparse_trailers()which is a dependency of our caller,format_trailers_from_commit().Remove the redundant call.
OK. The previous step had this hunk:
- parse_trailer(&tok, &val, NULL, trailer, separator_pos);
if (!opts->filter || opts->filter(&tok, opts->filter_data)) {
if (opts->unfold)
unfold_value(&val);
where parse_trailers() already has a call to parse_trailer() followed by a call to unfold_value(), so in a sense, switching to use the result of calling parse_trailers() by the caller instead of duplicating our own parsing in format_trailer_info() that started at step [09/28] made both parse_trailer() call (removed in step [10/28]) and unfold_value() call (removed in this step [11/28]).
So it would have also made sense if this were done as part of [10/28], but it is also OK to keep them separated.
In either way, breaking the transition into these steps does make them easier to follow.
Quoted 19 lines
Signed-off-by Linus Arver <[email protected]>--- trailer.c | 3 --- 1 file changed, 3 deletions(-)trailer.c +0
-3@@ -1102,9 +1102,6 @@ static void format_trailer_info(const struct process_trailer_options *opts,strbuf_addstr (&val, item->value);if (!opts->filter || opts->filter (&tok, opts->filter_data)) { -if (opts->unfold) -unfold_value (&val); -if (opts->separator && out->len != origlen)strbuf_addbuf (out, opts->separator);if (!opts->value_only)
PATCH v4 12/28 format_trailer_info(): append newline for non-trailer lines
In reply to Linus Arver via GitGitGadgetFrom: Linus Arver <[email protected]>
This wraps up the preparatory refactors to unify the trailer formatters.
Two patches ago we made format_trailer_info() use trailer_item objects instead of the "trailers" string array. The strings in the array include trailing newlines, because the string array is split up with
trailer_lines = strbuf_split_buf(str + trailer_block_start,
end_of_log_message - trailer_block_start, '\n',
0);
in trailer_info_get() and strbuf_split_buf() includes the terminator (in this case the newline character '\n') for each split-up substring.
And before we made the transition to use trailer_item objects for it, format_trailer_info() called parse_trailer() (which trims newlines) for trailer lines but did _not_ call parse_trailer() for non-trailer lines. So for trailer lines it had to add back the trimmed newline like this
if (!opts->separator)
strbuf_addch(out, '\n');But for non-trailer lines it didn't have to add back the newline because it could just reuse same string in the "trailers" string array (which again, already included the trailing newline).
Now that format_trailer_info() uses trailer_item objects for all cases, it can't rely on "trailers" string array anymore. And so it must be taught to add a newline back when printing non-trailer lines, just like it already does for trailer lines. Do so now.
The test suite passes again, so format_trailer_info() is in better shape supersede format_trailers(), which we'll do in the next patch.
--- trailer.c | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-)
trailer.c +3 -2
@@ -1125,9 +1125,10 @@ static void format_trailer_info(const struct process_trailer_options *opts,strbuf_addbuf (out, opts->separator); }strbuf_addstr (out, item->value); -if (opts->separator) { +if (opts->separator)strbuf_rtrim (out); - } +else +strbuf_addch (out,'\n' ); } } }
Signature · 1 line
gitgitgadget
Re: [PATCH v4 12/28] format_trailer_info(): append newline for non-trailer lines
Quoted 8 lines · Linus Arver via GitGitGadget
And before we made the transition to use
trailer_itemobjects for it,format_trailer_info()calledparse_trailer()(which trims newlines) for trailer lines but did _not_ callparse_trailer()for non-trailer lines. So for trailer lines it had to add back the trimmed newline like thisif (!opts->separator) strbuf_addch(out, '\n');
Quoted 8 lines
But for non-trailer lines it didn't have to add back the newline because it could just reuse same string in the "trailers" string array (which again, already included the trailing newline).
Now that
format_trailer_info()usestrailer_itemobjects for all cases, it can't rely on "trailers" string array anymore. And so it must be taught to add a newline back when printing non-trailer lines, just like it already does for trailer lines. Do so now.
Very nicely explained.
Quoted 25 lines
The test suite passes again, so
format_trailer_info()is in better shape supersedeformat_trailers(), which we'll do in the next patch.Signed-off-by Linus Arver <[email protected]>--- trailer.c | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-)trailer.c +3
-2@@ -1125,9 +1125,10 @@ static void format_trailer_info(const struct process_trailer_options *opts,strbuf_addbuf (out, opts->separator); }strbuf_addstr (out, item->value); -if (opts->separator) { +if (opts->separator)strbuf_rtrim (out); - } +else +strbuf_addch (out,'\n' ); } } }
Re: [PATCH v4 12/28] format_trailer_info(): append newline for non-trailer lines
In reply to Linus Arver via GitGitGadgetOn Tue, Feb 6, 2024 at 6:12 AM Linus Arver via GitGitGadget <[email protected]> wrote:
[...]
Quoted 2 lines
The test suite passes again, so
format_trailer_info()is in better shape supersedeformat_trailers(), which we'll do in the next patch.
s/supersede/to supersede/
Re: [PATCH v4 12/28] format_trailer_info(): append newline for non-trailer lines
Quoted 9 lines · Christian Couder
On Tue, Feb 6, 2024 at 6:12 AM Linus Arver via GitGitGadget <[email protected]> wrote:
[...]
Quoted 2 lines
The test suite passes again, so
format_trailer_info()is in better shape supersedeformat_trailers(), which we'll do in the next patch.s/supersede/to supersede/
Nice catch! Will update for next reroll, thanks.
PATCH v4 13/28 trailer: begin formatting unification
In reply to Linus Arver via GitGitGadgetFrom: Linus Arver <[email protected]>
Now that the preparatory refactors are over, we can replace the call to format_trailers() in interpret-trailers with format_trailer_info(). This unifies the trailer formatting machinery, but at the cost of breaking tests.
More specifically, this patch breaks t7502 and t7513, but only because we haven't fully stolen the features present in format_trailers() (which knows about opts->trim_empty) and print_tok_val() (which has non-hardcoded printing of the separator and space).
We will teach format_trailer_info() these features in the next two patches to make all tests pass again.
--- builtin/interpret-trailers.c | 2 +- trailer.c | 12 ++++++------ trailer.h | 2 +- 3 files changed, 8 insertions(+), 8 deletions(-)
builtin/interpret-trailers.c +1 -1
@@ -171,7 +171,7 @@ static void interpret_trailers(const struct process_trailer_options *opts, }/* Print trailer block. */ -format_trailers (opts, &head, &trailer_block); +format_trailer_info (opts, &head, &trailer_block);free_trailers (&head);fwrite (trailer_block.buf,1 , trailer_block.len, outfile);strbuf_release (&trailer_block);
trailer.c +6 -6
@@ -162,9 +162,9 @@ static void print_tok_val(struct strbuf *out, const char *tok, const char *val)strbuf_addf (out,"%s%c %s\n" , tok, separators[0 ], val); } -void format_trailers (const struct process_trailer_options *opts, -struct list_head *trailers, -struct strbuf *out) +static void format_trailers (const struct process_trailer_options *opts, +struct list_head *trailers, +struct strbuf *out) {struct list_head *pos;struct trailer_item *item;
@@ -1085,9 +1085,9 @@ void trailer_info_release(struct trailer_info *info)free (info->trailers); } -static void format_trailer_info (const struct process_trailer_options *opts, -struct list_head *trailers, -struct strbuf *out) +void format_trailer_info (const struct process_trailer_options *opts, +struct list_head *trailers, +struct strbuf *out) {size_t origlen = out->len;struct list_head *pos;
trailer.h +1 -1
@@ -101,7 +101,7 @@ void trailer_info_get(const struct process_trailer_options *,void trailer_info_release (struct trailer_info *info);void trailer_config_init (void ); -void format_trailers (const struct process_trailer_options *, +void format_trailer_info (const struct process_trailer_options *,struct list_head *trailers,struct strbuf *out);void free_trailers (struct list_head *);
Signature · 1 line
gitgitgadget
PATCH v4 14/28 format_trailer_info(): teach it about opts->trim_empty
In reply to Linus Arver via GitGitGadgetFrom: Linus Arver <[email protected]>
This fixes 4 tests in t7513 to go from
t7513-interpret-trailers.sh (Wstat: 256 (exited 1) Tests: 94 Failed: 55)
Failed tests: 2-5, 8, 14, 24-28, 31-37, 43-62, 66-74
77-80, 82-85to
t7513-interpret-trailers.sh (Wstat: 256 (exited 1) Tests: 94 Failed: 51)
Failed tests: 2-5, 14, 24-28, 31-32, 36-37, 43-62, 66-74
77-80, 82-85. The next patch will fix the remaining broken test cases in t7513 and t7502.
Even though the next patch fixes the vast majority of these test cases, we have to position that patch after this one to avoid breaking the build because of the way these patches delete relevant (and obsolete) code.
--- trailer.c | 23 +++++++++-------------- 1 file changed, 9 insertions(+), 14 deletions(-)
trailer.c +9 -14
@@ -162,20 +162,6 @@ static void print_tok_val(struct strbuf *out, const char *tok, const char *val)strbuf_addf (out,"%s%c %s\n" , tok, separators[0 ], val); } -static void format_trailers (const struct process_trailer_options *opts, -struct list_head *trailers, -struct strbuf *out) -{ -struct list_head *pos; -struct trailer_item *item; -list_for_each (pos, trailers) { - item = list_entry(pos, struct trailer_item, list); -if ((!opts->trim_empty ||strlen (item->value) >0 ) && - (!opts->only_trailers || item->token)) -print_tok_val (out, item->token, item->value); - } -} -static struct trailer_item *trailer_from_arg (struct arg_item *arg_tok) {struct trailer_item *new_item =xcalloc (1 ,sizeof (*new_item));
@@ -1101,6 +1087,15 @@ void format_trailer_info(const struct process_trailer_options *opts,strbuf_addstr (&tok, item->token);strbuf_addstr (&val, item->value); +/* +* Skip key/value pairs where the value was empty. This +* can happen from trailers specified without a +* separator, like `--trailer "Reviewed-by"` (no +* corresponding value). +*/ +if (opts->trim_empty && !strlen (item->value)) +continue ; +if (!opts->filter || opts->filter (&tok, opts->filter_data)) {if (opts->separator && out->len != origlen)strbuf_addbuf (out, opts->separator);
Signature · 1 line
gitgitgadget
Re: [PATCH v4 14/28] format_trailer_info(): teach it about opts->trim_empty
Quoted 11 lines
trailer.c +0
-3@@ -162,20 +162,6 @@ static void print_tok_val(struct strbuf *out, const char *tok, const char *val)strbuf_addf (out,"%s%c %s\n" , tok, separators[0 ], val); } -static void format_trailers (const struct process_trailer_options *opts, -struct list_head *trailers, -struct strbuf *out)
trailer.c static void print_tok_val(struct strbuf *out, const char *tok, const char *val) · line 177
Quoted 10 lines
trailer.c +0
-10-{ -struct list_head *pos; -struct trailer_item *item; -list_for_each (pos, trailers) { - item = list_entry(pos, struct trailer_item, list); -if ((!opts->trim_empty ||strlen (item->value) >0 ) && - (!opts->only_trailers || item->token)) -print_tok_val (out, item->token, item->value); - } -}
It seems to me that this function could and should have been removed in the previous patch. If there is a reason why it is better to do it in this patch, I think it should be explained more clearly in the commit message.
Quoted 6 lines
trailer.c +0
-0static struct trailer_item *trailer_from_arg (struct arg_item *arg_tok) {struct trailer_item *new_item =xcalloc (1 ,sizeof (*new_item));@@ -1101,6 +1087,15 @@ void format_trailer_info(const struct process_trailer_options *opts,strbuf_addstr (&tok, item->token);strbuf_addstr (&val, item->value);
trailer.c void format_trailer_info(const struct process_trailer_options *opts, · line 1098
Quoted 10 lines
trailer.c +9
-0+/* +* Skip key/value pairs where the value was empty. This +* can happen from trailers specified without a +* separator, like `--trailer "Reviewed-by"` (no +* corresponding value). +*/ +if (opts->trim_empty && !strlen (item->value)) +continue ; +
Wasn't it possible to make this change in format_trailer_info() before using format_trailer_info() to replace format_trailers()?
Quoted 3 lines
trailer.c +0
-0if (!opts->filter || opts->filter (&tok, opts->filter_data)) {if (opts->separator && out->len != origlen)strbuf_addbuf (out, opts->separator);
Re: [PATCH v4 14/28] format_trailer_info(): teach it about opts->trim_empty
Quoted 18 lines · Christian Couder
Quoted 18 lines
trailer.c +0
-10@@ -162,20 +162,6 @@ static void print_tok_val(struct strbuf *out, const char *tok, const char *val)strbuf_addf (out,"%s%c %s\n" , tok, separators[0 ], val); } -static void format_trailers (const struct process_trailer_options *opts, -struct list_head *trailers, -struct strbuf *out) -{ -struct list_head *pos; -struct trailer_item *item; -list_for_each (pos, trailers) { - item = list_entry(pos, struct trailer_item, list); -if ((!opts->trim_empty ||strlen (item->value) >0 ) && - (!opts->only_trailers || item->token))
Quoted 8 lines
trailer.c static void print_tok_val(struct strbuf *out, const char *tok, const char *val) · line 177
Quoted 3 lines
trailer.c +0
-3-print_tok_val (out, item->token, item->value); - } -}It seems to me that this function could and should have been removed in the previous patch. If there is a reason why it is better to do it in this patch, I think it should be explained more clearly in the commit message.
Ah yes, the decision to delay the deletion like this was deliberate. Will update the commit message to add something like:
Although we could have deleted format_trailers() in the previous patch, we perform the deletion here like this in order to isolate (and highlight) in this patch the salvaging of the logic in the deleted code
if ((!opts->trim_empty || strlen(item->value) > 0) && ...)
print_tok_val(...)
as
if (opts->trim_empty && !strlen(item->value))
continue;
in the new code, which has the same effect (because we are skipping the formatting in the new code).
Quoted 7 lines
Quoted 7 lines
trailer.c +0
-0static struct trailer_item *trailer_from_arg (struct arg_item *arg_tok) {struct trailer_item *new_item =xcalloc (1 ,sizeof (*new_item));@@ -1101,6 +1087,15 @@ void format_trailer_info(const struct process_trailer_options *opts,strbuf_addstr (&tok, item->token);strbuf_addstr (&val, item->value);
Quoted 12 lines
trailer.c void format_trailer_info(const struct process_trailer_options *opts, · line 1098
Quoted 9 lines
trailer.c +9
-0+/* +* Skip key/value pairs where the value was empty. This +* can happen from trailers specified without a +* separator, like `--trailer "Reviewed-by"` (no +* corresponding value). +*/ +if (opts->trim_empty && !strlen (item->value)) +continue ; +Wasn't it possible to make this change in
format_trailer_info()before usingformat_trailer_info()to replaceformat_trailers()?
It was certainly possible, but the choice to purposely time the addition/deletion of code like this was deliberate (see my comment above).
Quoted 3 lines
Quoted 3 lines
trailer.c +0
-0if (!opts->filter || opts->filter (&tok, opts->filter_data)) {if (opts->separator && out->len != origlen)strbuf_addbuf (out, opts->separator);
Re: [PATCH v4 14/28] format_trailer_info(): teach it about opts->trim_empty
Quoted 22 lines · Linus Arver
Quoted 7 lines · Christian Couder
Quoted 7 lines
static struct
trailer_item*trailer_from_arg(structarg_item*arg_tok){ struct trailer_item *new_item = xcalloc(1, sizeof(*new_item));trailer.c +0
-0@@ -1101,6 +1087,15 @@ void format_trailer_info(const struct process_trailer_options *opts,strbuf_addstr (&tok, item->token);strbuf_addstr (&val, item->value);Quoted 12 lines
trailer.c void format_trailer_info(const struct process_trailer_options *opts, · line 1098
Quoted 9 lines
trailer.c +9
-0+/* +* Skip key/value pairs where the value was empty. This +* can happen from trailers specified without a +* separator, like `--trailer "Reviewed-by"` (no +* corresponding value). +*/ +if (opts->trim_empty && !strlen (item->value)) +continue ; +Wasn't it possible to make this change in
format_trailer_info()before usingformat_trailer_info()to replaceformat_trailers()?
Quoted 3 lines
It was certainly possible, but the choice to purposely time the addition/deletion of code like this was deliberate (see my comment above).
I would have thought that it would be better to make this change earlier to avoid breaking tests.
Quoted 3 lines
Quoted 3 lines
Quoted 3 lines
trailer.c +0
-0if (!opts->filter || opts->filter (&tok, opts->filter_data)) {if (opts->separator && out->len != origlen)strbuf_addbuf (out, opts->separator);
PATCH v4 15/28 format_trailer_info(): avoid double-printing the separator
In reply to Linus Arver via GitGitGadgetFrom: Linus Arver <[email protected]>
Do not hardcode the printing of ": " as the separator and space (which can result in double-printing these characters); instead only print the separator and space if we cannot find any recognized separator somewhere in the key (yes, keys may have a trailing separator in it --- we will eventually fix this design but not now). Do so by copying the code out of print_tok_val(), and deleting the same function.
The test suite passes again with this change.
--- trailer.c | 25 +++++-------------------- 1 file changed, 5 insertions(+), 20 deletions(-)
trailer.c +5 -20
@@ -144,24 +144,6 @@ static char last_non_space_char(const char *s)return '\0' ; } -static void print_tok_val (struct strbuf *out,const char *tok,const char *val) -{ -char c; - -if (!tok) { -strbuf_addf (out,"%s\n" , val); -return ; - } - - c =last_non_space_char (tok); -if (!c) -return ; -if (strchr (separators, c)) -strbuf_addf (out,"%s%s\n" , tok, val); -else -strbuf_addf (out,"%s%c %s\n" , tok, separators[0 ], val); -} -static struct trailer_item *trailer_from_arg (struct arg_item *arg_tok) {struct trailer_item *new_item =xcalloc (1 ,sizeof (*new_item));
@@ -1104,8 +1086,11 @@ void format_trailer_info(const struct process_trailer_options *opts,if (!opts->key_only && !opts->value_only) {if (opts->key_value_separator)strbuf_addbuf (out, opts->key_value_separator); -else -strbuf_addstr (out,": " ); +else { +char c =last_non_space_char (tok.buf); +if (c && !strchr (separators, c)) +strbuf_addf (out,"%c " , separators[0 ]); + } }if (!opts->key_only)strbuf_addbuf (out, &val);
Signature · 1 line
gitgitgadget
Re: [PATCH v4 15/28] format_trailer_info(): avoid double-printing the separator
Quoted 11 lines · Linus Arver via GitGitGadget
From: Linus Arver <[email protected]>
Do not hardcode the printing of ": " as the separator and space (which can result in double-printing these characters); instead only print the separator and space if we cannot find any recognized separator somewhere in the key (yes, keys may have a trailing separator in it --- we will eventually fix this design but not now). Do so by copying the code out of
print_tok_val(), and deleting the same function.The test suite passes again with this change.
I think it should be clearer above that this fixes a bug that was introduced earlier in the series.
Also I wonder why it was not possible to modify format_trailer_info() like it is done in this patch before using it to replace format_trailers().
Re: [PATCH v4 15/28] format_trailer_info(): avoid double-printing the separator
Quoted 12 lines · Christian Couder
Quoted 10 lines · Linus Arver via GitGitGadget
From: Linus Arver <[email protected]>
Do not hardcode the printing of ": " as the separator and space (which can result in double-printing these characters); instead only print the separator and space if we cannot find any recognized separator somewhere in the key (yes, keys may have a trailing separator in it --- we will eventually fix this design but not now). Do so by copying the code out of
print_tok_val(), and deleting the same function.
Quoted 4 lines
Quoted 1 line
The test suite passes again with this change.
I think it should be clearer above that this fixes a bug that was introduced earlier in the series.
Ack, will add something like
This double printing is from a bug introduced earlier when we started using format_trailer_info() everywhere.
to this patch's description, but also add explicit language in "trailer: begin formatting unification" to say that the change is introducing temporary bugs (and that this is why the tests break).
Quoted 3 lines
Also I wonder why it was not possible to modify
format_trailer_info()like it is done in this patch before using it to replaceformat_trailers().
The artificial organization apparent in this patch was deliberate, in order to make it painfully obvious exactly what was being replaced and how. See https://lore.kernel.org/git/[email protected]/
Re: [PATCH v4 15/28] format_trailer_info(): avoid double-printing the separator
Quoted 6 lines · Linus Arver
Quoted 2 lines · Christian Couder
On Tue, Feb 6, 2024 at 6:12 AM Linus Arver via GitGitGadget <[email protected]> wrote:
Quoted 7 lines
Quoted 3 lines
Also I wonder why it was not possible to modify
format_trailer_info()like it is done in this patch before using it to replaceformat_trailers().The artificial organization apparent in this patch was deliberate, in order to make it painfully obvious exactly what was being replaced and how. See https://lore.kernel.org/git/[email protected]/
As for the previous patch, I would have thought that it would be better not to break the tests.
Re: [PATCH v4 15/28] format_trailer_info(): avoid double-printing the separator
Quoted 11 lines · Christian Couder
Quoted 10 lines · Linus Arver
Quoted 6 lines · Christian Couder
On Tue, Feb 6, 2024 at 6:12 AM Linus Arver via GitGitGadget <[email protected]> wrote:
Also I wonder why it was not possible to modify
format_trailer_info()like it is done in this patch before using it to replaceformat_trailers().
Quoted 6 lines
Quoted 3 lines
The artificial organization apparent in this patch was deliberate, in order to make it painfully obvious exactly what was being replaced and how. See https://lore.kernel.org/git/[email protected]/
As for the previous patch, I would have thought that it would be better not to break the tests.
I could just squash these patches together to avoid breaking tests (and also avoid doing the flipping of expect_success to expect_fail and back again). I don't mind at all which way we go, but now that we have these patches broken out I wonder if it's better to just keep them that way.
Junio, do you mind if I squash the relevant changes together into just one patch? I'd like your input because you requested the current style (modulo test breakages which was my error). Thanks.
Re: [PATCH v4 15/28] format_trailer_info(): avoid double-printing the separator
Quoted 20 lines · Linus Arver
Quoted 11 lines · Christian Couder
Quoted 10 lines · Linus Arver
Quoted 6 lines · Christian Couder
On Tue, Feb 6, 2024 at 6:12 AM Linus Arver via GitGitGadget <[email protected]> wrote:
Also I wonder why it was not possible to modify
format_trailer_info()like it is done in this patch before using it to replaceformat_trailers().Quoted 6 lines
Quoted 3 lines
The artificial organization apparent in this patch was deliberate, in order to make it painfully obvious exactly what was being replaced and how. See https://lore.kernel.org/git/[email protected]/
As for the previous patch, I would have thought that it would be better not to break the tests.
Quoted 8 lines
I could just squash these patches together to avoid breaking tests (and also avoid doing the flipping of
expect_successtoexpect_failand back again). I don't mind at all which way we go, but now that we have these patches broken out I wonder if it's better to just keep them that way.Junio, do you mind if I squash the relevant changes together into just one patch? I'd like your input because you requested the current style (modulo test breakages which was my error). Thanks.
When I asked this question, I forgot that the number of test cases that break are around ~50. This is a very large number. So I think it would be cleaner to squash this and the previous patch down to avoid having to flip test_expect_{success,failure} for 50+ individual test cases.
For the earlier patch
[PATCH v4 10/28] format_trailer_info(): use trailer_item objects
there are only 8 failures so I think doing the *_{success,failure} flip is reasonable.
Re: [PATCH v4 15/28] format_trailer_info(): avoid double-printing the separator
In reply to Linus Arver via GitGitGadgetQuoted 9 lines · Linus Arver via GitGitGadget
From: Linus Arver <[email protected]>
Do not hardcode the printing of ": " as the separator and space (which can result in double-printing these characters); instead only print the separator and space if we cannot find any recognized separator somewhere in the key (yes, keys may have a trailing separator in it --- we will eventually fix this design but not now). Do so by copying the code out of
print_tok_val(), and deleting the same function.
Quoted 3 lines
The test suite passes again with this change.
Signed-off-by Linus Arver <[email protected]>
Nice find and a great commit message!
Signature · 1 line
Kristoffer Haugsbakk
PATCH v4 16/28 trailer: finish formatting unification
In reply to Linus Arver via GitGitGadgetFrom: Linus Arver <[email protected]>
Rename format_trailer_info() to format_trailers(). Finally, both interpret-trailers and format_trailers_from_commit() can call "format_trailers()"!
Update the comment in <trailer.h> to remove the (now obsolete) caveats about format_trailers_from_commit().
--- builtin/interpret-trailers.c | 2 +- trailer.c | 8 ++++---- trailer.h | 15 ++++----------- 3 files changed, 9 insertions(+), 16 deletions(-)
builtin/interpret-trailers.c +1 -1
@@ -171,7 +171,7 @@ static void interpret_trailers(const struct process_trailer_options *opts, }/* Print trailer block. */ -format_trailer_info (opts, &head, &trailer_block); +format_trailers (opts, &head, &trailer_block);free_trailers (&head);fwrite (trailer_block.buf,1 , trailer_block.len, outfile);strbuf_release (&trailer_block);
trailer.c +4 -4
@@ -1053,9 +1053,9 @@ void trailer_info_release(struct trailer_info *info)free (info->trailers); } -void format_trailer_info (const struct process_trailer_options *opts, -struct list_head *trailers, -struct strbuf *out) +void format_trailers (const struct process_trailer_options *opts, +struct list_head *trailers, +struct strbuf *out) {size_t origlen = out->len;struct list_head *pos;
@@ -1129,7 +1129,7 @@ void format_trailers_from_commit(const struct process_trailer_options *opts,strbuf_add (out, msg + info.trailer_block_start, info.trailer_block_end - info.trailer_block_start); }else -format_trailer_info (opts, &trailers, out); +format_trailers (opts, &trailers, out);free_trailers (&trailers);trailer_info_release (&info);
trailer.h +4 -11
@@ -101,23 +101,16 @@ void trailer_info_get(const struct process_trailer_options *,void trailer_info_release (struct trailer_info *info);void trailer_config_init (void ); -void format_trailer_info (const struct process_trailer_options *, +void format_trailers (const struct process_trailer_options *,struct list_head *trailers,struct strbuf *out);void free_trailers (struct list_head *);/* -* Format the trailers from the commit msg "msg" into the strbuf "out". -* Note two caveats about "opts": -* -* - this is primarily a helper for pretty.c, and not -* all of the flags are supported. -* -* - this differs from process_trailers slightly in that we always format -* only the trailer block itself, even if the "only_trailers" option is not -* set. +* Convenience function to format the trailers from the commit msg "msg" into +* the strbuf "out". Reuses format_trailers() internally. */ -void format_trailers_from_commit (const struct process_trailer_options *opts, +void format_trailers_from_commit (const struct process_trailer_options *,const char *msg,struct strbuf *out);
Signature · 1 line
gitgitgadget
Re: [PATCH v4 16/28] trailer: finish formatting unification
Quoted 8 lines · Linus Arver via GitGitGadget
From: Linus Arver <[email protected]>
Rename
format_trailer_info()toformat_trailers(). Finally, both interpret-trailers andformat_trailers_from_commit()can call "format_trailers()"!Update the comment in <
trailer.h> to remove the (now obsolete) caveats aboutformat_trailers_from_commit().
Nice.
Re: [PATCH v4 16/28] trailer: finish formatting unification
In reply to Linus Arver via GitGitGadgetQuoted 10 lines · Linus Arver via GitGitGadget
/*
- * Format the trailers from the commit msg "msg" into the strbuf "out".
- * Note two caveats about "opts":
- *
- * - this is primarily a helper forpretty.c, and not
- * all of the flags are supported.
- *
- * - this differs fromprocess_trailersslightly in that we always format
- * only the trailer block itself, even if the "only_trailers" option is not
- * set.
This makes me wonder if there was actually a good reason why format_trailers() and format_trailer_info() were 2 different functions. Is there info about this in the commit message of the commit which introduced this comment?
Re: [PATCH v4 16/28] trailer: finish formatting unification
Quoted 14 lines · Christian Couder
Quoted 10 lines · Linus Arver via GitGitGadget
/*
- * Format the trailers from the commit msg "msg" into the strbuf "out".
- * Note two caveats about "opts":
- *
- * - this is primarily a helper forpretty.c, and not
- * all of the flags are supported.
- *
- * - this differs fromprocess_trailersslightly in that we always format
- * only the trailer block itself, even if the "only_trailers" option is not
- * set.
Quoted 4 lines
This makes me wonder if there was actually a good reason why
format_trailers()andformat_trailer_info()were 2 different functions. Is there info about this in the commit message of the commit which introduced this comment?
Good question. I see a388b10fc1 (pretty: move trailer formatting to trailer.c, 2017-08-15) and there it says:
pretty: move trailer formatting to trailer.c
The next commit will add many features to the %(trailer) placeholder in pretty.c. We'll need to access some internal functions of trailer.c for that, so our options are either:
1. expose those functions publicly
or
2. make an entry point into trailer.c to do the formatting
Doing (2) ends up exposing less surface area, though do note that caveats in the docstring of the new function.
so it looks like this function started out from pretty.c and did not have access to all of the trailer implementation internals, and was never intended to replace (unify) the formatting machinery in trailer.c both before and after that commit. This seems like good information to include in the commit message, so I will do so in the next reroll.
Aside: it is interesting that the current patch series is taking the direction of (1) instead of (2) as was done in the past (we had a choice to "libify" at that time but did not do so, in order to "expos[e] less surface area [in <trailer.h>]").