Skip to contentSkip to conversation

kbuild: doc: describe proper script invocation

PATCH Applied Lukas Bulwahn 2 participants 4 messages Oct 1, 2020 – Oct 14, 2020

Subsystems (2)
lore
Share & tools
lore
#0 lore raw

PATCH 1/1 kbuild: doc: describe proper script invocation

During an investigation to fix up the execute bits of scripts in the kernel repository, Andrew Morton and Kees Cook pointed out that the execute bit should not matter, and that build scripts cannot rely on that. Kees could not point to any documentation, though.

Masahiro Yamada explained the convention of setting execute bits to make it easier for manual script invocation.

Provide some basic documentation how the build shall invoke scripts, such that the execute bits do not matter, and acknowledge that execute bits are useful nonetheless.

This serves as reference for further clean-up patches in the future.

---
RFC v1 -> RFC v2:
explain why execute bits are still convenient.

Kees, Andrew, please ack.

Masahiro-san, I have taken your feedback into account. Please pick this small documentation update into your kbuild tree.

Ujjwal Kumar, a potential future mentee, will follow up with further fixes to the build scripts.

 Documentation/kbuild/makefiles.rst | 20 ++++++++++++++++++++
 1 file changed, 20 insertions(+)
Documentation/kbuild/makefiles.rst +20 -0
index 58d513a0fa95..bd3e1baf58be 100644
@@ -21,6 +21,7 @@ This document describes the Linux kernel Makefiles.
 	   --- 3.10 Special Rules
 	   --- 3.11 $(CC) support functions
 	   --- 3.12 $(LD) support functions
+	   --- 3.13 Script Invocation
 
 	=== 4 Host Program support
 	   --- 4.1 Simple Host Program
@@ -605,6 +606,25 @@ more details, with real examples.
 		#Makefile
 		LDFLAGS_vmlinux += $(call ld-option, -X)
 
+3.13 Script invocation
+----------------------
+
+	Make rules may invoke scripts to build the kernel. The rules shall
+	always provide the appropriate interpreter to execute the script. They
+	shall not rely on the execute bits being set, and shall not invoke the
+	script directly. For the convenience of manual script invocation, such
+	as invoking ./scripts/checkpatch.pl, it is recommended to set execute
+	bits on the scripts nonetheless.
+
+	Kbuild provides variables $(CONFIG_SHELL), $(AWK), $(PERL),
+	$(PYTHON) and $(PYTHON3) to refer to interpreters for the respective
+	scripts.
+
+	Example::
+
+		#Makefile
+		cmd_depmod = $(CONFIG_SHELL) $(srctree)/scripts/depmod.sh $(DEPMOD) \
+			     $(KERNELRELEASE)
 
 4 Host Program support
 ======================
Signature · 1 line
2.17.1
#1 lore raw
Quoted 15 lines · Lukas Bulwahn

During an investigation to fix up the execute bits of scripts in the kernel repository, Andrew Morton and Kees Cook pointed out that the execute bit should not matter, and that build scripts cannot rely on that. Kees could not point to any documentation, though.

Masahiro Yamada explained the convention of setting execute bits to make it easier for manual script invocation.

Provide some basic documentation how the build shall invoke scripts, such that the execute bits do not matter, and acknowledge that execute bits are useful nonetheless.

This serves as reference for further clean-up patches in the future.

Quoted 7 lines

Applied to linux-kbuild.
Thanks.

Quoted 56 lines

---
RFC v1 -> RFC v2:
explain why execute bits are still convenient.

Kees, Andrew, please ack.

Masahiro-san, I have taken your feedback into account. Please pick this small documentation update into your kbuild tree.

Ujjwal Kumar, a potential future mentee, will follow up with further fixes to the build scripts.

 Documentation/kbuild/makefiles.rst | 20 ++++++++++++++++++++
 1 file changed, 20 insertions(+)
Documentation/kbuild/makefiles.rst +20 -1
index 58d513a0fa95..bd3e1baf58be 100644
@@ -21,6 +21,7 @@ This document describes the Linux kernel Makefiles.
           --- 3.10 Special Rules
           --- 3.11 $(CC) support functions
           --- 3.12 $(LD) support functions
+          --- 3.13 Script Invocation
 
        === 4 Host Program support
           --- 4.1 Simple Host Program
@@ -605,6 +606,25 @@ more details, with real examples.
                #Makefile
                LDFLAGS_vmlinux += $(call ld-option, -X)
 
+3.13 Script invocation
+----------------------
+
+       Make rules may invoke scripts to build the kernel. The rules shall
+       always provide the appropriate interpreter to execute the script. They
+       shall not rely on the execute bits being set, and shall not invoke the
+       script directly. For the convenience of manual script invocation, such
+       as invoking ./scripts/checkpatch.pl, it is recommended to set execute
+       bits on the scripts nonetheless.
+
+       Kbuild provides variables $(CONFIG_SHELL), $(AWK), $(PERL),
+       $(PYTHON) and $(PYTHON3) to refer to interpreters for the respective
+       scripts.
+
+       Example::
+
+               #Makefile
+               cmd_depmod = $(CONFIG_SHELL) $(srctree)/scripts/depmod.sh $(DEPMOD) \
+                            $(KERNELRELEASE)
 
 4 Host Program support
 ======================
--

2.17.1

Signature · 6 lines
Best Regards
Masahiro Yamada
_______________________________________________
Linux-kernel-mentees mailing list
[email protected]
https://lists.linuxfoundation.org/mailman/listinfo/linux-kernel-mentees
#2 lore raw
Quoted 21 lines · Masahiro Yamada
Quoted 19 lines · Lukas Bulwahn

During an investigation to fix up the execute bits of scripts in the kernel repository, Andrew Morton and Kees Cook pointed out that the execute bit should not matter, and that build scripts cannot rely on that. Kees could not point to any documentation, though.

Masahiro Yamada explained the convention of setting execute bits to make it easier for manual script invocation.

Provide some basic documentation how the build shall invoke scripts, such that the execute bits do not matter, and acknowledge that execute bits are useful nonetheless.

This serves as reference for further clean-up patches in the future.

Quoted 8 lines
Quoted 3 lines

Applied to linux-kbuild.
Thanks.

No, not really.

I will re-think if this is the right thing to do.

--
Best Regards
Masahiro Yamada
_______________________________________________
Linux-kernel-mentees mailing list
[email protected]
https://lists.linuxfoundation.org/mailman/listinfo/linux-kernel-mentees

#3 lore raw
Quoted 27 lines · Masahiro Yamada
Quoted 26 lines · Masahiro Yamada
Quoted 22 lines · Lukas Bulwahn

During an investigation to fix up the execute bits of scripts in the kernel repository, Andrew Morton and Kees Cook pointed out that the execute bit should not matter, and that build scripts cannot rely on that. Kees could not point to any documentation, though.

Masahiro Yamada explained the convention of setting execute bits to make it easier for manual script invocation.

Provide some basic documentation how the build shall invoke scripts, such that the execute bits do not matter, and acknowledge that execute bits are useful nonetheless.

This serves as reference for further clean-up patches in the future.

Quoted 9 lines
Quoted 3 lines

Applied to linux-kbuild.
Thanks.

No, not really.

I will re-think if this is the right thing to do.

Masahiro-san, Andrew Morton has already picked this patch in his branch; so, if we do not shout loudly, it will be merged. And we can follow up with a solid improvement for rc2.

I am happy to rework the documentation and help guide and review the follow-up patches that have been sent by Ujjwal.

Please provide some specific feedback what is wrong and why; I think the basic request not to rely on the execute bit from Andrew and Kees is still valid. Maybe we just need to be more specific on the rules to follow in Makefiles and have multiple examples for the different cases to consider.

Thanks,

Lukas
_______________________________________________
Linux-kernel-mentees mailing list
[email protected]
https://lists.linuxfoundation.org/mailman/listinfo/linux-kernel-mentees