Message-ID: <733b4eec-6297-e72e-0803-a32a25d83072@gmail.com>
Date:   Fri, 4 Aug 2023 13:25:14 -0700
MIME-Version: 1.0
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101
 Thunderbird/102.13.0
To:     linux-mips@vger.kernel.org,
        "Maciej W. Rozycki" <macro@orcam.me.uk>,
        Thomas Bogendoerfer <tsbogend@alpha.franken.de>,
        Serge Semin <fancer.lancer@gmail.com>
Content-Language: en-US
From:   Florian Fainelli <f.fainelli@gmail.com>
Subject: soft and hard float n32 and n64 binaries getting illegal instructions
 on Cobalt Qube2
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
Precedence: bulk

Hi all,

A number of programs built with the n32 or n64 ABI running on a MIPS64 
are getting an illegal instruction, not right away, but typically when 
they send/receive across the opened sockets. Trying different kernel 
versions: 4.14, 5.4, 6.5-rc4 does not appear to materially change 
anything so it must be within the C library/toolchain somehow.

For instance, ping gets an illegal instruction right away with 
soft-float, but works in hard float. iperf gets an illegal instruction 
right away with soft float, but can exchange one chunk of data in hard 
float mode.

This however is not happening with udhcpc (busybox's DHCP client) which 
is also a network program.

This is seen with both musl-libc 1.2.4 and glibc 2.37.2, both use GCC 
11.4.0. This is not seen

Unfortunately gdb also produces the same illegal instruction so I have 
not been able to get much debug so far, any hints or clues as to what 
could be wrong?

Thanks!

Buildroot configuration: 
https://gist.github.com/ffainelli/08baae86281aa4a6b4f71de8049ca27a

Kernel configuration: 
https://gist.github.com/ffainelli/83d16fe47b8daab00aa39f5d2bb1f2ca
-- 
Florian