kbuild: add dummy toolchains to enable all cc-option etc. in Kconfig
PATCH 1/1 kbuild: add dummy toolchains to enable all cc-option etc. in Kconfig
Staring v4.18, Kconfig evaluates compiler capabilities, and hides CONFIG options your compiler does not support. This works well if you configure and build the kernel on the same host machine.
It is inconvenient if you prepare the .config that is carried to a different build environment (typically this happens when you package the kernel for distros) because using a different compiler potentially produces different CONFIG options than the real build environment. So, you probably want to make as many options visible as possible. In other words, you need to create a super-set of CONFIG options that cover any build environment. If some of the CONFIG options turned out to be unsupported on the build machine, they are automatically disabled by the nature of Kconfig.
However, it is not feasible to get a full-featured compiler for every arch.
This issue was discussed here:
https://lkml.org/lkml/2019/12/9/620
Other than distros, savedefconfig is also a problem. Some arch subsytems periodically resync defconfig files. If you use a less-capable compiler for savedefconfig, options that do not meet 'depends on $(cc-option,...)' will be forcibly disabled. So, defconfig && savedefconfig may silently change the behavior.
This commit adds a set of dummy toolchains that pretend to support any feature.
Most of compiler features are tested by cc-option, which simply checks the exit code of $(CC). The dummy tools are just a shell script that exits with 0 in most cases. So, $(cc-option, ...) is evaluated as 'y'.
There are more complicated checks such as:
scripts/gcc-x86_{32,64}-has-stack-protector.sh
scripts/gcc-plugin.sh
scripts/tools-support-relr.sh
I tried my best to implement the dummy scripts to pass all checks.
From the top directory of the source tree, you can do:
$ make CROSS_COMPILE=scripts/dummy-tools/ oldconfig
---
scripts/dummy-tools/gcc | 91 +++++++++++++++++++++++++++++++++++++ scripts/dummy-tools/ld | 4 ++ scripts/dummy-tools/nm | 4 ++ scripts/dummy-tools/objcopy | 4 ++ 4 files changed, 103 insertions(+) create mode 100755 scripts/dummy-tools/gcc create mode 100755 scripts/dummy-tools/ld create mode 100755 scripts/dummy-tools/nm create mode 100755 scripts/dummy-tools/objcopy
scripts/dummy-tools/gcc new file +91 -0
@@ -0,0 +1,91 @@ +#!/bin/sh +# SPDX-License-Identifier: GPL-2.0-only +# +# Staring v4.18, Kconfig evaluates compiler capabilities, and hides CONFIG +# options your compiler does not support. This works well if you configure and +# build the kernel on the same host machine. +# +# It is inconvenient if you prepare the .config that is carried to a different +# build environment (typically this happens when you package the kernel for +# distros) because using a different compiler potentially produces different +# CONFIG options than the real build environment. So, you probably want to make +# as many options visible as possible. In other words, you need to create a +# super-set of CONFIG options that cover any build environment. If some of the +# CONFIG options turned out to be unsupported on the build machine, they are +# automatically disabled by the nature of Kconfig. +# +# However, it is not feasible to get a full-featured compiler for every arch. +# Hence these dummy toolchains to make all compiler tests pass. +# +# Usage: +# +# From the top directory of the source tree, run +# +# $ make CROSS_COMPILE=scripts/dummy-tools/ oldconfig +# +# Most of compiler features are tested by cc-option, which simply checks the +# exit code of $(CC). This script does nothing and just exits with 0 in most +# cases. So, $(cc-option, ...) is evaluated as 'y'. +# +# This scripts caters to more checks; handle --version and pre-process __GNUC__ +# etc. to pretend to be GCC, and also do right things to satisfy some scripts. + +# Check if the first parameter appears in the rest. Succeeds if found. +# This helper is useful if a particular option was passed to this script. +# Typically used like this: +# arg_contain <word-you-are-searching-for> "$@" +arg_contain () +{ + search="$1" + shift + + while [ $# -gt 0 ] + do + if [ "$search" = "$1" ]; then + return 0 + fi + shift + done + + return 1 +} + +# To set CONFIG_CC_IS_GCC=y +if arg_contain --version "$@"; then + echo "gcc (scripts/dummy-tools/gcc)" + exit 0 +fi + +if arg_contain -E "$@"; then + # For scripts/gcc-version.sh; This emulates GCC 20.0.0 + if arg_contain - "$@"; then + sed 's/^__GNUC__$/20/; s/^__GNUC_MINOR__$/0/; s/^__GNUC_PATCHLEVEL__$/0/' + exit 0 + else + echo "no input files" >&2 + exit 1 + fi +fi + +if arg_contain -S "$@"; then + # For scripts/gcc-x86-*-has-stack-protector.sh + if arg_contain -fstack-protector "$@"; then + echo "%gs" + exit 0 + fi +fi + +# For scripts/gcc-plugin.sh +if arg_contain -print-file-name=plugin "$@"; then + plugin_dir=$(mktemp -d) + + sed -n 's/.*#include "\(.*\)"/\1/p' $(dirname $0)/../gcc-plugins/gcc-common.h | + while read header + do + mkdir -p $plugin_dir/include/$(dirname $header) + touch $plugin_dir/include/$header + done + + echo $plugin_dir + exit 0 +fi
scripts/dummy-tools/ld new file +4 -0
@@ -0,0 +1,4 @@ +#!/bin/sh +# SPDX-License-Identifier: GPL-2.0-only + +# Dummy script that always succeeds
scripts/dummy-tools/nm new file +4 -0
@@ -0,0 +1,4 @@ +#!/bin/sh +# SPDX-License-Identifier: GPL-2.0-only + +# Dummy script that always succeeds
scripts/dummy-tools/objcopy new file +4 -0
@@ -0,0 +1,4 @@ +#!/bin/sh +# SPDX-License-Identifier: GPL-2.0-only + +# Dummy script that always succeeds
Signature · 1 line
2.17.1
Hi Masahiro,
Quoted 40 lines · On Fri, 3 Apr 2020 18:02:24 +0900 Masahiro Yamada <[email protected]> wrote:
Staring v4.18,
Kconfigevaluates compiler capabilities, and hides CONFIG options your compiler does not support. This works well if you configure and build the kernel on the same host machine.It is inconvenient if you prepare the .config that is carried to a different build environment (typically this happens when you package the kernel for distros) because using a different compiler potentially produces different CONFIG options than the real build environment. So, you probably want to make as many options visible as possible. In other words, you need to create a super-set of CONFIG options that cover any build environment. If some of the CONFIG options turned out to be unsupported on the build machine, they are automatically disabled by the nature of
Kconfig.However, it is not feasible to get a full-featured compiler for every arch.
This issue was discussed here:
https://lkml.org/lkml/2019/12/9/620
Other than distros, savedefconfig is also a problem. Some arch subsytems periodically resync defconfig files. If you use a less-capable compiler for savedefconfig, options that do not meet 'depends on $(cc-option,...)' will be forcibly disabled. So, defconfig && savedefconfig may silently change the behavior.
This commit adds a set of dummy toolchains that pretend to support any feature.
Most of compiler features are tested by cc-option, which simply checks the exit code of $(CC). The dummy tools are just a shell script that exits with 0 in most cases. So, $(cc-option, ...) is evaluated as 'y'.
There are more complicated checks such as:
scripts/gcc-x86_{32,64}-has-stack-protector.sh
scripts/gcc-plugin.sh
scripts/tools-support-relr.sh
Quoted 7 lines
I tried my best to implement the dummy scripts to pass all checks.
From the top directory of the source tree, you can do:
$ make CROSS_COMPILE=scripts/dummy-tools/ oldconfigSigned-off-by Masahiro Yamada <[email protected]>
look good to me
Thanks a lot
Philipp
Quoted 59 lines · Masahiro Yamada
Staring v4.18,
Kconfigevaluates compiler capabilities, and hides CONFIG options your compiler does not support. This works well if you configure and build the kernel on the same host machine.It is inconvenient if you prepare the .config that is carried to a different build environment (typically this happens when you package the kernel for distros) because using a different compiler potentially produces different CONFIG options than the real build environment. So, you probably want to make as many options visible as possible. In other words, you need to create a super-set of CONFIG options that cover any build environment. If some of the CONFIG options turned out to be unsupported on the build machine, they are automatically disabled by the nature of
Kconfig.However, it is not feasible to get a full-featured compiler for every arch.
This issue was discussed here:
https://lkml.org/lkml/2019/12/9/620
Other than distros, savedefconfig is also a problem. Some arch subsytems periodically resync defconfig files. If you use a less-capable compiler for savedefconfig, options that do not meet 'depends on $(cc-option,...)' will be forcibly disabled. So, defconfig && savedefconfig may silently change the behavior.
This commit adds a set of dummy toolchains that pretend to support any feature.
Most of compiler features are tested by cc-option, which simply checks the exit code of $(CC). The dummy tools are just a shell script that exits with 0 in most cases. So, $(cc-option, ...) is evaluated as 'y'.
There are more complicated checks such as:
scripts/gcc-x86_{32,64}-has-stack-protector.sh
scripts/gcc-plugin.sh
scripts/tools-support-relr.shI tried my best to implement the dummy scripts to pass all checks.
From the top directory of the source tree, you can do:
$ make CROSS_COMPILE=scripts/dummy-tools/ oldconfigSigned-off-by Masahiro Yamada <[email protected]>---
scripts/dummy-tools/gcc | 91 +++++++++++++++++++++++++++++++++++++ scripts/dummy-tools/ld | 4 ++ scripts/dummy-tools/nm | 4 ++ scripts/dummy-tools/objcopy | 4 ++ 4 files changed, 103 insertions(+) create mode 100755 scripts/dummy-tools/gcc create mode 100755 scripts/dummy-tools/ld create mode 100755 scripts/dummy-tools/nm create mode 100755 scripts/dummy-tools/objcopy
<snip>
scripts/dummy-tools/ld line 4
Quoted 10 lines
scripts/dummy-tools/ld new file +4
-0@@ -0,0 +1,4 @@ +#!/bin/sh +# SPDX-License-Identifier: GPL-2.0-only + +# Dummy script that always succeeds
It looks like scripts/Kbuild.include expects "$(LD) --version" to return something. If it doesn't "ld-ifversion" stops working.
Other than that it seems to work as advertised. Thanks!
- Jeremy
Quoted 5 lines · Jeremy Cline
Quoted 5 lines
scripts/dummy-tools/ld new file +0
-0
Quoted 8 lines
scripts/dummy-tools/ld line 4
Quoted 5 lines
scripts/dummy-tools/ld new file +4
-0@@ -0,0 +1,4 @@ +#!/bin/sh +# SPDX-License-Identifier: GPL-2.0-only + +# Dummy script that always succeedsIt looks like
scripts/Kbuild.includeexpects "$(LD) --version" to return something. If it doesn't "ld-ifversion" stops working.
Actually, scripts/Kbuild.include is not used in the Kconfig stage. So, scripts/dummy-tools/ld does not need to handle --version or -v, but we may do that in the future.
I will support it in v2.
Quoted 4 lines
Other than that it seems to work as advertised. Thanks!
- Jeremy
Signature · 2 lines
Best Regards Masahiro Yamada