New: host-python2 build fails on aarch64

https://bugs.busybox.net/show_bug.cgi?id=13661

Bug ID: 13661
Summary: host-python2 build fails on aarch64
Product: buildroot
Version: unspecified
Hardware: All
OS: Linux
Status: NEW
Severity: normal
Priority: P5
Component: Other
Assignee: unassigned at buildroot.uclibc.org
Reporter: christian at paral.in
CC: buildroot at uclibc.org
Target Milestone: ---

I'm seeing the following build error on armv8 (aarch64):

/build/host-python-2.7.18/Modules/_ctypes/libffi/src/closures.c:472:7: warning:
ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result]

2021-03-23T08:50:16.2844591Z   472 |       ftruncate (execfd, offset);
2021-03-23T08:50:16.2845961Z       |       ^~~~~~~~~~~~~~~~~~~~~~~~~~
2021-03-23T08:50:16.3656935Z
/build/host-python-2.7.18/Modules/_ctypes/libffi/src/aarch64/sysv.S: Assembler
messages:
2021-03-23T08:50:16.3669765Z
/build/host-python-2.7.18/Modules/_ctypes/libffi/src/aarch64/sysv.S:145: Error:
constant expression required at operand 2 -- `tbz
x23,#AARCH64_FFI_WITH_V_BIT,1f'
2021-03-23T08:50:16.3679469Z
/build/host-python-2.7.18/Modules/_ctypes/libffi/src/aarch64/sysv.S:174: Error:
constant expression required at operand 2 -- `tbz
x23,#AARCH64_FFI_WITH_V_BIT,1f'
2021-03-23T08:50:16.3688258Z
/build/host-python-2.7.18/Modules/_ctypes/libffi/src/aarch64/sysv.S:282: Error:
constant expression required at operand 2 -- `tbz
x0,#AARCH64_FFI_WITH_V_BIT,1f'
2021-03-23T08:50:16.3692215Z building dbm using gdbm
2021-03-23T08:50:16.3693379Z 
2021-03-23T08:50:16.3695198Z Python build finished, but the necessary bits to
build these modules were not found:
2021-03-23T08:50:16.3697325Z _tkinter           bsddb185           dl           
2021-03-23T08:50:16.3698676Z imageop            sunaudiodev                     
2021-03-23T08:50:16.3702910Z To find the necessary bits, look in setup.py in
detect_modules() for the module's name.
2021-03-23T08:50:16.3704463Z 
2021-03-23T08:50:16.3705077Z 
2021-03-23T08:50:16.3706170Z Failed to build these modules:
2021-03-23T08:50:16.3707366Z _ctypes                    

This is building on Gentoo arm64 on a Jetson tx2:

gcc --version
gcc (Gentoo 10.2.0-r5 p6) 10.2.0

Is the compiler generating invalid asm? How to fix this, so that host-python works on arm64?

The full build output is here (& attached to bug):

https://github.com/skiffos/SkiffOS/runs/2172698881

You are receiving this mail because:
You are on the CC list for the bug.

https://bugs.busybox.net/show_bug.cgi?id=13661

Christian Stewart <[email protected]> changed:

What |Removed |Added
----------------------------------------------------------------------------

            Version|unspecified                 |2020.11.3
                 CC|                            |christian at paral.in
               Host|                            |jetson tx2 (arm64)
              Build|                            |ccf38c04f05819594b034b5def8
                   |                            |4e18e4699cffd
             Target|                            |odroid c4 (arm64)

You are receiving this mail because:
You are on the CC list for the bug.

https://bugs.busybox.net/show_bug.cgi?id=13661

Christian Stewart <[email protected]> changed:

What |Removed |Added
----------------------------------------------------------------------------

             Status|NEW                         |RESOLVED
         Resolution|---                         |WORKSFORME

--- Comment #1 from Christian Stewart <[email protected]> --- Not seeing this anymore, not sure why.

You are receiving this mail because:
You are on the CC list for the bug.

https://bugs.busybox.net/show_bug.cgi?id=13661

Christian Stewart <[email protected]> changed:

What |Removed |Added
----------------------------------------------------------------------------

             Status|RESOLVED                    |REOPENED
         Resolution|WORKSFORME                  |---

--- Comment #2 from Christian Stewart <[email protected]> ---
https://github.com/skiffos/SkiffOS/issues/142

According to some users attempting to build with Arm64 machines using Ubuntu as the host (for Buildroot) against latest 2021.02.3,

This issue is still present - host-python fails to build.

You are receiving this mail because:
You are on the CC list for the bug.

https://bugs.busybox.net/show_bug.cgi?id=13661

--- Comment #3 from Torsten Hahn <[email protected]> --- I experiencing the same issue here:

Host System: docker container running at an Apple M1 machine, git checkout of recent stable buildroot

(created via docker buildx build --platform linux/arm64 -t br_db/arm64) running a recent ubuntu image as triggers the described error as soon as host-python2 is built.

Would be very nice to have a workaround / fix for this because we have several build machines with aarch64 architecture.

You are receiving this mail because:
You are on the CC list for the bug.

https://bugs.busybox.net/show_bug.cgi?id=13661

Torsten Hahn <[email protected]> changed:

What |Removed |Added
----------------------------------------------------------------------------

           Severity|normal                      |major
                 CC|                            |torstenhahn at fastmail.fm

You are receiving this mail because:
You are on the CC list for the bug.

https://bugs.busybox.net/show_bug.cgi?id=13661

--- Comment #4 from Erico Nunes <[email protected]> --- Created attachment 9006
--> https://bugs.busybox.net/attachment.cgi?id=9006&action=edit
0001-python-use-system-libffi-for-host-python.patch

I remember seeing this a while back. I looked a bit into the problem back then and solved it with the attached patch.
I never went around to fully testing it and submitting it to the list. If it solves the problem for you, feel free to take it and submit it to the list.

You are receiving this mail because:
You are on the CC list for the bug.

https://bugs.busybox.net/show_bug.cgi?id=13661

--- Comment #5 from Christian Stewart <[email protected]> --- Erico, thanks, your patch works great.

I will submit to the list.

You are receiving this mail because:
You are on the CC list for the bug.

https://bugs.busybox.net/show_bug.cgi?id=13661

Yann E. MORIN <[email protected]> changed:

What |Removed |Added
----------------------------------------------------------------------------

             Status|REOPENED                    |RESOLVED
         Resolution|---                         |FIXED
                 CC|                            |yann.morin.1998 at free.fr

--- Comment #6 from Yann E. MORIN <[email protected]> --- Christian, All,

Thanks for the report.

We believe this is now fixed with the patch you submitted, and which was just appiled as of commit b31f7bc958.

Thank you!

Regards,
Yann E. MORIN.

You are receiving this mail because:
You are on the CC list for the bug.