package/scons: explicitly specify host Python 3
PATCH 1/1 package/scons: explicitly specify host Python 3
All packages using scons are now using Python 3 to run it, so explicitly set scons as using host-python3. This avoids a spurious host Python 2 dependency if BR2_PACKAGE_PYTHON3 is not set (for example, if no Python is packaged for the target).
--- package/scons/scons.mk | 2 ++ 1 file changed, 2 insertions(+)
package/scons/scons.mk +2 -0
@@ -10,6 +10,8 @@ SCONS_LICENSE = MIT SCONS_LICENSE_FILES = LICENSE.txt SCONS_SETUP_TYPE = distutils +HOST_SCONS_NEEDS_HOST_PYTHON = python3 + HOST_SCONS_INSTALL_OPTS = \ --install-lib=$(HOST_DIR)/lib/scons-$(SCONS_VERSION)
Signature · 1 line
2.18.4
PATCH 1/1 package/scons: explicitly specify host Python 3
Quoted 15 lines · On Mon, 13 Jul 2020 21:39:27 -0600 Robert Hancock <[email protected]> wrote:
All packages using scons are now using Python 3 to run it, so explicitly set scons as using host-python3. This avoids a spurious host Python 2 dependency if
BR2_PACKAGE_PYTHON3is not set (for example, if no Python is packaged for the target).Signed-off-by Robert Hancock <[email protected]>--- package/scons/scons.mk | 2 ++ 1 file changed, 2 insertions(+)package/scons/scons.mk +0
-0
package/scons/scons.mk SCONS_LICENSE = MIT · line 13
Quoted 4 lines
package/scons/scons.mk +1
-0@@ -10,6 +10,8 @@ SCONS_LICENSE = MIT SCONS_LICENSE_FILES = LICENSE.txt SCONS_SETUP_TYPE = distutils +HOST_SCONS_NEEDS_HOST_PYTHON = python3
I am just wondering if we should do our usual dance that consists in relying on python2 if enabled, i.e something like this:
HOST_SCONS_NEEDS_HOST_PYTHON = $(if ($(BR2_PACKAGE_PYTHON),python,python3)
or if we simply stop doing this and say that we switch to just python3.
Titouan, what do you think ?
Thomas
Signature · 3 lines
Thomas Petazzoni, CTO, Bootlin Embedded Linux and Kernel engineering https://bootlin.com
PATCH 1/1 package/scons: explicitly specify host Python 3
Hello Thomas, Robert and all,
Quoted 21 lines · Thomas Petazzoni
Quoted 18 lines · On Mon, 13 Jul 2020 21:39:27 -0600 Robert Hancock <[email protected]> wrote:
All packages using scons are now using Python 3 to run it, so explicitly set scons as using host-python3. This avoids a spurious host Python 2 dependency if
BR2_PACKAGE_PYTHON3is not set (for example, if no Python is packaged for the target).Signed-off-by Robert Hancock <[email protected]>--- package/scons/scons.mk | 2 ++ 1 file changed, 2 insertions(+)package/scons/scons.mk +0
-0@@ -10,6 +10,8 @@ SCONS_LICENSE = MIT SCONS_LICENSE_FILES = LICENSE.txt SCONS_SETUP_TYPE = distutils
Quoted 6 lines
package/scons/scons.mk SCONS_LICENSE = MIT · line 13
Quoted 1 line
package/scons/scons.mk +1
-0+HOST_SCONS_NEEDS_HOST_PYTHON = python3I am just wondering if we should do our usual dance that consists in relying on python2 if enabled, i.e something like this:
HOST_SCONS_NEEDS_HOST_PYTHON= $(if ($(BR2_PACKAGE_PYTHON),python,python3)
AFAIK, we usually do the opposite:
$(if $(BR2_PACKAGE_PYTHON3),python3,python)
Quoted 3 lines
or if we simply stop doing this and say that we switch to just python3 > Titouan, what do you think ?
In my very own opinion, we should now only use host-python3 everywhere, unless host-python(2) is strictly required. Pragmatically speaking, in the rare cases where host-python(2) is still necessary, having both Pythons on the host would not be that much of an overhead (both in terms of building time and disk space); and would reduce the clutter in all the places where we do the fancy dance you describe above.
On the target side, I'm also looking forward to invert the target py2/py3 logic, ie changing
$(if $(BR2_PACKAGE_PYTHON3),python3,python))
into
$(if $(BR2_PACKAGE_PYTHON),python,python3))
especially in package/pkg-python.mk.
Again, the goal is to have Python3 as default, while still allowing old Python2-only programs to run where needed. I'll try to find some time this week to go through the Buildroot tree and update the Python3 migration page (https://www.elinux.org/Buildroot:Python2Packages), as there has been some change since the FOSDEM dev days. This shall help us understand where Python2 is still required.
Quoted 3 lines
Thomas
Titouan
PATCH 1/1 package/scons: explicitly specify host Python 3
Quoted 4 lines · On Tue, 14 Jul 2020 15:31:09 +0200 Titouan Christophe…
Quoted 1 line
HOST_SCONS_NEEDS_HOST_PYTHON= $(if ($(BR2_PACKAGE_PYTHON),python,python3)AFAIK, we usually do the opposite:
$(if $(BR2_PACKAGE_PYTHON3),python3,python)
Yes, but the idea is to reverse this progressively, and switch more and more to "Python 3.x" is the default.
Quoted 6 lines
In my very own opinion, we should now only use host-python3 everywhere, unless host-python(2) is strictly required. Pragmatically speaking, in the rare cases where host-python(2) is still necessary, having both Pythons on the host would not be that much of an overhead (both in terms of building time and disk space); and would reduce the clutter in all the places where we do the fancy dance you describe above.
I'm fine with moving towards host-python3 only where possible.
Quoted 9 lines
On the target side, I'm also looking forward to invert the target py2/py3 logic, ie changing
$(if $(BR2_PACKAGE_PYTHON3),python3,python))
into
$(if $(BR2_PACKAGE_PYTHON),python,python3))
Quoted 8 lines
especially in
package/pkg-python.mk.Again, the goal is to have Python3 as default, while still allowing old Python2-only programs to run where needed. I'll try to find some time this week to go through the Buildroot tree and update the Python3 migration page (https://www.elinux.org/Buildroot:Python2Packages), as there has been some change since the FOSDEM dev days. This shall help us understand where Python2 is still required.
That would be great indeed!
Thomas
Signature · 3 lines
Thomas Petazzoni, CTO, Bootlin Embedded Linux and Kernel engineering https://bootlin.com
PATCH 1/1 package/scons: explicitly specify host Python 3
In reply to Thomas PetazzoniQuoted 21 lines · Thomas Petazzoni
Quoted 18 lines · On Mon, 13 Jul 2020 21:39:27 -0600 Robert Hancock <[email protected]> wrote:
All packages using scons are now using Python 3 to run it, so explicitly set scons as using host-python3. This avoids a spurious host Python 2 dependency if
BR2_PACKAGE_PYTHON3is not set (for example, if no Python is packaged for the target).Signed-off-by Robert Hancock <[email protected]>--- package/scons/scons.mk | 2 ++ 1 file changed, 2 insertions(+)package/scons/scons.mk +0
-0@@ -10,6 +10,8 @@ SCONS_LICENSE = MIT SCONS_LICENSE_FILES = LICENSE.txt SCONS_SETUP_TYPE = distutils
Quoted 8 lines
package/scons/scons.mk SCONS_LICENSE = MIT · line 13
Quoted 1 line
package/scons/scons.mk +1
-0+HOST_SCONS_NEEDS_HOST_PYTHON = python3I am just wondering if we should do our usual dance that consists in relying on python2 if enabled, i.e something like this:
HOST_SCONS_NEEDS_HOST_PYTHON= $(if ($(BR2_PACKAGE_PYTHON),python,python3)or if we simply stop doing this and say that we switch to just python3.
What you describe is basically the existing default behavior in package/pkg-python.mk when *_NEEDS_HOST_PYTHON is not set, except that the default is reversed, it defaults to python unless BR2_PACKAGE_PYTHON3 is set. The problem with that is it conflates what is selected for the target with what is needed on the host. In our configuration, no Python is selected for the target, so a dependency on host-python gets added, even though all of the packages using SCons explicitly depend on host-python3 and run SCons using python3, so the host-python dependency is pointless.
I went with this simple change in the SCons case, as because it doesn't seem widely used (only 3 packages in Buildroot now), the chance that another package will end up being added that both uses SCons and can't use Python 3 to run it, seems quite unlikely.
Quoted 5 lines
Titouan, what do you think ?
Thomas
Signature · 4 lines
Robert Hancock Senior Hardware Designer SED Systems, a division of Calian Ltd. Email: hancock at sedsystems.ca
Quoted 9 lines · On Mon, 13 Jul 2020 21:39:27 -0600 Robert Hancock <[email protected]> wrote:
All packages using scons are now using Python 3 to run it, so explicitly set scons as using host-python3. This avoids a spurious host Python 2 dependency if
BR2_PACKAGE_PYTHON3is not set (for example, if no Python is packaged for the target).Signed-off-by Robert Hancock <[email protected]>--- package/scons/scons.mk | 2 ++ 1 file changed, 2 insertions(+)
After so much time: patch applied! I also took the opportunity of your patch to do two scons-related changes:
https://git.buildroot.org/buildroot/commit/?id=726209fc7999986fa414d629ff60d1bc76c63a2c
https://git.buildroot.org/buildroot/commit/?id=c240410d4b38c7946d2dd65c1c1eec6d172a0814
Best regards,
Thomas
Signature · 7 lines
Thomas Petazzoni, CTO, Bootlin Embedded Linux and Kernel engineering https://bootlin.com _______________________________________________ buildroot mailing list [email protected] https://lists.buildroot.org/mailman/listinfo/buildroot