Skip to contentSkip to conversation

gitweb: fix problem causing erroneous project list

PATCH In review Charles McGarvey 3 participants 4 messages Jun 15, 2016

lore
Share & tools
lore
#0 lore raw

PATCH 1/1 gitweb: fix problem causing erroneous project list

The bug is manifest when running gitweb in a persistent process (e.g. FastCGI, PSGI), and it's easy to reproduce. If a gitweb request includes the searchtext parameter (i.e. s), subsequent requests using the project_list action--which is the default action--and without a searchtext parameter will be filtered by the searchtext value of the first request. This is because the value of the $search_regexp global (the value of which is based on the searchtext parameter) is currently being persisted between requests.

Instead, clear $search_regexp before dispatching each request.

---
I don't think there are currently any persistent-process gitweb tests to copy from, so writing a test for this seems to be non-trivial.

 gitweb/gitweb.perl | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
gitweb/gitweb.perl +1 -1
index 80950c0..8d69ada 100755
@@ -1086,7 +1086,7 @@ sub evaluate_and_validate_params {
 	our $search_use_regexp = $input_params{'search_use_regexp'};
 
 	our $searchtext = $input_params{'searchtext'};
-	our $search_regexp;
+	our $search_regexp = undef;
 	if (defined $searchtext) {
 		if (length($searchtext) < 2) {
 			die_error(403, "At least two characters are required for search parameter");
Signature · 1 line
1.8.1.5
#1 lore raw
Quoted 9 lines · Charles McGarvey

The bug is manifest when running gitweb in a persistent process (e.g. FastCGI, PSGI), and it's easy to reproduce. If a gitweb request includes the searchtext parameter (i.e. s), subsequent requests using the project_list action--which is the default action--and without a searchtext parameter will be filtered by the searchtext value of the first request. This is because the value of the $search_regexp global (the value of which is based on the searchtext parameter) is currently being persisted between requests.

Quoted 6 lines

Instead, clear $search_regexp before dispatching each request.

---
I don't think there are currently any persistent-process gitweb tests to copy from, so writing a test for this seems to be non-trivial.

The problem description makes sense to me, and clearing with "undef" is in line with the case where the CGI is run for the first time, so I think this patch is correct.

Will wait for a while to give Jakub some time to comment on (like:
Ack ;-) and then apply. Thanks.

By the way, I looked at how $search_regexp is used in the code:

* esc_html_match_hl and esc_html_match_hl__chopped (called from git_project_list_rows, for example) want to have "undef"; an empty string will not do.

* search_projects_list (called from git_project_list_body)

x git_search_files and git_search_grep_body assume that
$search_regexp can be interpolated in m//, which is not very nice. They want an empty string.

So as an independent fix, the two subs may want to be fixed if we want to be undef clean. Or am I missing something? Jakub, isn't this kind of "undef" reference t9500 was designed to catch?

Quoted 16 lines
 gitweb/gitweb.perl | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
gitweb/gitweb.perl +1 -1
index 80950c0..8d69ada 100755
@@ -1086,7 +1086,7 @@ sub evaluate_and_validate_params {
 	our $search_use_regexp = $input_params{'search_use_regexp'};
 
 	our $searchtext = $input_params{'searchtext'};
-	our $search_regexp;
+	our $search_regexp = undef;
 	if (defined $searchtext) {
 		if (length($searchtext) < 2) {
 			die_error(403, "At least two characters are required for search parameter");
#2 lore raw
Quoted 11 lines · Junio C Hamano
Quoted 9 lines · Charles McGarvey

The bug is manifest when running gitweb in a persistent process (e.g. FastCGI, PSGI), and it's easy to reproduce. If a gitweb request includes the searchtext parameter (i.e. s), subsequent requests using the project_list action--which is the default action--and without a searchtext parameter will be filtered by the searchtext value of the first request. This is because the value of the $search_regexp global (the value of which is based on the searchtext parameter) is currently being persisted between requests.

Quoted 3 lines
Quoted 3 lines

Instead, clear $search_regexp before dispatching each request.

Quoted 3 lines
Quoted 3 lines

---
I don't think there are currently any persistent-process gitweb tests to copy from, so writing a test for this seems to be non-trivial.

Well, there is Plack::Test, and gitweb supports running as PSGI app. Though all such test would have to be under new PLACK or PSGI prerequisite.

Quoted 8 lines

The problem description makes sense to me, and clearing with "undef" is in line with the case where the CGI is run for the first time, so I think this patch is correct.

Will wait for a while to give Jakub some time to comment on (like:
Ack ;-) and then apply. Thanks.

By the way, I looked at how $search_regexp is used in the code:

How $search_regexp is used does not matter. What was intended (but was not implemented) is for $search_regexp to matter and to be used only if $searchtext is defined. $searchtext is reset on each request, so $search_regexp should be also reset... like in Charles's patch.

Anyway in the analysis below we need to check if code checks $searchtext first.

Quoted 9 lines

* esc_html_match_hl and esc_html_match_hl__chopped (called from git_project_list_rows, for example) want to have "undef"; an empty string will not do.

* search_projects_list (called from git_project_list_body)

x git_search_files and git_search_grep_body assume that
$search_regexp can be interpolated in m//, which is not very nice. They want an empty string.

But both git_search_files() and git_search_grep_body() are run from git_search(), which "dies" (returns HTTP 400 "Text field is empty" error) if $searchtext is not defined; if $searchtext is defined then $search_regexp is string and is never undef.

Quoted 20 lines

So as an independent fix, the two subs may want to be fixed if we want to be undef clean. Or am I missing something? Jakub, isn't this kind of "undef" reference t9500 was designed to catch?

Quoted 16 lines
 gitweb/gitweb.perl | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
gitweb/gitweb.perl +1 -1
index 80950c0..8d69ada 100755
@@ -1086,7 +1086,7 @@ sub evaluate_and_validate_params {
      our $search_use_regexp = $input_params{'search_use_regexp'};
 
      our $searchtext = $input_params{'searchtext'};
-     our $search_regexp;
+     our $search_regexp = undef;
      if (defined $searchtext) {
              if (length($searchtext) < 2) {
                      die_error(403, "At least two characters are required for search parameter");
Signature · 1 line
Jakub Narebski
#3 lore raw
Quoted 5 lines · Jakub Narębski
Quoted 3 lines
Quoted 3 lines

Instead, clear $search_regexp before dispatching each request.

Thanks (the ack was a few hours too late and the commit is already in 'next', so I won't be able to rewind it though).

Quoted 7 lines
Quoted 1 line

By the way, I looked at how $search_regexp is used in the code:

How $search_regexp is used does not matter. What was intended (but was not implemented) is for $search_regexp to matter and to be used only if $searchtext is defined. $searchtext is reset on each request, so $search_regexp should be also reset... like in Charles's patch.

Oh, we are in total agreement about that. That is why the part is marked with "By the way"---it is an orthogonal issue (which turned out to be a non-issue).

Quoted 8 lines
Quoted 3 lines

x git_search_files and git_search_grep_body assume that
$search_regexp can be interpolated in m//, which is not very nice. They want an empty string.

But both git_search_files() and git_search_grep_body() are run from git_search(), which "dies" (returns HTTP 400 "Text field is empty" error) if $searchtext is not defined; if $searchtext is defined then $search_regexp is string and is never undef.

Thanks; that is what I missed.

Quoted 2 lines
Quoted 2 lines

So as an independent fix, the two subs may want to be fixed if we want to be undef clean. Or am I missing something?