Non systematic PCIe error on resume on i.MX8QP on Linux 7.2
Subsystems (2)
Hello,
our CI spotted this error on resume. It is not systematic, and it is possible that this is not a new issue from 7.2.
Does it rings any bell?
[ 745.849237] imx8qm-hsio-phy 5f180000.phy: HSIO_PM_REQ_CORE_RST is set [ 745.855800] phy phy-5f180000.phy.1: phy poweron failed --> -110 [ 745.861824] imx6q-pcie 5f000000.pcie: waiting for PHY ready timeout! [ 745.868378] imx6q-pcie 5f000000.pcie: Host init failed: -110 [ 745.874144] imx6q-pcie 5f000000.pcie: PM: dpm_run_callback(): genpd_resume_noirq returns -110 [ 745.882791] imx6q-pcie 5f000000.pcie: PM: failed to resume noirq: error -110 [ 745.889979] Internal error: synchronous external abort: 0000000096000210 [#1] SMP [ 745.897647] Modules linked in: can_raw can 8021q garp stp mrp llc bluetooth ecdh_generic ecc uas nls_iso8859_1 nls_cp437 mwifiex_pcie mwifiex cfg80211 ahci rfkill sd_mod cdns caam_jr caamhash_desc spidev caamalg_desc rng crypto_engine kpp rng_core libdes snd_soc_fsl_asoc_card aes_ce_blk ghash_ce snd_soc_simple_card snd_soc_imx_audmux leds_gpio gf128mul imx_sc_thermal rtc_imx_sc nvmem_imx_ocotp_scu snd_soc_simple_card_utils led_class gpio_fan ahci_imx libahci_platform libahci phy_fsl_imx8qm_hsio libata fsl_imx8_ddr_perf ci_hdrc_imx ci_hdrc ulpi phy_cadence_salvo ehci_hcd roles usbmisc_imx phy_mxs_usb cdns3_imx usb3503 snd_soc_sgtl5000 flexcan can_dev imx8qxp_adc snd_soc_fsl_spdif snd_soc_fsl_sai imx_pcm_dma snd_soc_fsl_utils snd_soc_fsl_asrc pwm_imx27 spi_fsl_lpspi caam etnaviv error gpu_sched amphion_vpu fuse autofs4 [ 745.970466] CPU: 2 UID: 0 PID: 53 Comm: kworker/u21:2 Tainted: G M 7.2.0-rc4-0.0.0-devel #1 PREEMPT [ 745.981181] Tainted: [M]=MACHINE_CHECK [ 745.985018] Hardware name: Toradex Apalis iMX8QP V1.1 on Apalis Ixora V1.2 Carrier Board (DT) [ 745.993643] Workqueue: async async_run_entry_fn [ 745.998279] pstate: 600000c5 (nZCv daIF -PAN -UAO -TCO -DIT -SSBS BTYPE=--) [ 746.005337] pc : pci_generic_config_read+0x64/0xc0 [ 746.010231] lr : pci_generic_config_read+0x24/0xc0 [ 746.015118] sp : ffff800080513ba0 [ 746.018520] x29: ffff800080513ba0 x28: 0000000000000000 x27: 0000000000000000 [ 746.025761] x26: ffff00000043d400 x25: 0000000000000000 x24: ffff0000004d1e05 [ 746.033000] x23: 0000000000000003 x22: ffffa79a09fe3118 x21: ffff000003a000d0 [ 746.040242] x20: 0000000000000002 x19: ffff800080513be4 x18: 0000000000000001 [ 746.047482] x17: 0000000000000000 x16: 0000000000000000 x15: 0000000000000002 [ 746.054720] x14: ffff000000718f90 x13: ffffa79a09f6f068 x12: 0000000000000003 [ 746.061959] x11: 0000000000000028 x10: 000000016a2a9b62 x9 : 000000000000003c [ 746.069197] x8 : ffffa79a09861b20 x7 : ffff0000067fe800 x6 : ffffa79a0a6bf000 [ 746.076438] x5 : 0000000000000000 x4 : ffff800080513be4 x3 : ffffa79a0989d904 [ 746.083676] x2 : 0000000000000044 x1 : 0000000000000000 x0 : ffff8000827c0044 [ 746.090917] Call trace: [ 746.093455] pci_generic_config_read+0x64/0xc0 (P) [ 746.098345] pci_bus_read_config_word+0x74/0xe0 [ 746.102971] pci_read_config_word+0x2c/0x48 [ 746.107252] pci_power_up+0x50/0x1e4 [ 746.110927] pci_pm_power_up_and_verify_state+0x2c/0xa0 [ 746.116249] pci_pm_resume_noirq+0xe8/0x1ac [ 746.120528] dpm_run_callback+0x4c/0x108 [ 746.124550] device_resume_noirq+0x110/0x3c4 [ 746.128917] async_resume_noirq+0x20/0x40 [ 746.133024] async_run_entry_fn+0x34/0x164 [ 746.137215] process_one_work+0x15c/0x2a0 [ 746.141317] worker_thread+0x18c/0x2e0 [ 746.145159] kthread+0x11c/0x13c [ 746.148486] ret_from_fork+0x10/0x20 [ 746.152167] Code: 52800000 a8c27bfd d50323bf d65f03c0 (79400000) [ 746.158371] ------------[ cut here ]------------ [ 746.163077] WARNING: /usr/src/kernel/kernel/printk/printk.c:4627 at __wake_up_klogd+0xf4/0x100, CPU#2: kworker/u21:2/53 [ 746.173972] Modules linked in: can_raw can 8021q garp stp mrp llc bluetooth ecdh_generic ecc uas nls_iso8859_1 nls_cp437 mwifiex_pcie mwifiex cfg80211 ahci rfkill sd_mod cdns caam_jr caamhash_desc spidev caamalg_desc rng crypto_engine kpp rng_core libdes snd_soc_fsl_asoc_card aes_ce_blk ghash_ce snd_soc_simple_card snd_soc_imx_audmux leds_gpio gf128mul imx_sc_thermal rtc_imx_sc nvmem_imx_ocotp_scu snd_soc_simple_card_utils led_class gpio_fan ahci_imx libahci_platform libahci phy_fsl_imx8qm_hsio libata fsl_imx8_ddr_perf ci_hdrc_imx ci_hdrc ulpi phy_cadence_salvo ehci_hcd roles usbmisc_imx phy_mxs_usb cdns3_imx usb3503 snd_soc_sgtl5000 flexcan can_dev imx8qxp_adc snd_soc_fsl_spdif snd_soc_fsl_sai imx_pcm_dma snd_soc_fsl_utils snd_soc_fsl_asrc pwm_imx27 spi_fsl_lpspi caam etnaviv error gpu_sched amphion_vpu fuse autofs4 [ 746.246751] CPU: 2 UID: 0 PID: 53 Comm: kworker/u21:2 Tainted: G M 7.2.0-rc4-0.0.0-devel #1 PREEMPT [ 746.257464] Tainted: [M]=MACHINE_CHECK [ 746.261300] Hardware name: Toradex Apalis iMX8QP V1.1 on Apalis Ixora V1.2 Carrier Board (DT) [ 746.269921] Workqueue: async async_run_entry_fn [ 746.274548] pstate: 600000c5 (nZCv daIF -PAN -UAO -TCO -DIT -SSBS BTYPE=--) [ 746.281605] pc : __wake_up_klogd+0xf4/0x100 [ 746.285881] lr : wake_up_klogd+0x14/0x20 [ 746.289899] sp : ffff800080513920 [ 746.293304] x29: ffff800080513920 x28: ffff000000718f00 x27: 0000000000000000 [ 746.300545] x26: ffff00000043d400 x25: 0000000000000000 x24: 00000000000000c0 [ 746.307786] x23: ffffa79a09861b84 x22: 0000000000000000 x21: ffff800080513a60 [ 746.315026] x20: ffffa79a0a202cc0 x19: ffffa79a0a678370 x18: 000000000000000a [ 746.322266] x17: 3430306337323830 x16: 3030386666666620 x15: 0730076307330730 [ 746.329506] x14: 0766073507360764 x13: 0730076307330730 x12: 0766073507360764 [ 746.336746] x11: ffffa79a0a55c7c0 x10: 00000000000002af x9 : ffffa79a0a55c7c0 [ 746.343986] x8 : 3fffffffffffefff x7 : ffffa79a0a5b47c0 x6 : 0000000000000000 [ 746.351226] x5 : 00000000000002b0 x4 : 0000000000000000 x3 : 0000000000000000 [ 746.358467] x2 : 0000000000000000 x1 : 0000000000000001 x0 : 0000000000000001 [ 746.365708] Call trace: [ 746.368241] __wake_up_klogd+0xf4/0x100 (P) [ 746.372520] bust_spinlocks+0x4c/0x60 [ 746.376279] die+0xc0/0x144 [ 746.379166] arm64_notify_die+0xa0/0xa4 [ 746.383099] do_sea+0x68/0x80 [ 746.386163] do_mem_abort+0x40/0x9c [ 746.389745] el1_abort+0x44/0x64 [ 746.393068] el1h_64_sync_handler+0x50/0xac [ 746.397348] el1h_64_sync+0x6c/0x70 [ 746.400934] pci_generic_config_read+0x64/0xc0 (P) [ 746.405821] pci_bus_read_config_word+0x74/0xe0 [ 746.410448] pci_read_config_word+0x2c/0x48 [ 746.414727] pci_power_up+0x50/0x1e4 [ 746.418398] pci_pm_power_up_and_verify_state+0x2c/0xa0 [ 746.423721] pci_pm_resume_noirq+0xe8/0x1ac [ 746.427998] dpm_run_callback+0x4c/0x108 [ 746.432013] device_resume_noirq+0x110/0x3c4 [ 746.436380] async_resume_noirq+0x20/0x40 [ 746.440482] async_run_entry_fn+0x34/0x164 [ 746.444674] process_one_work+0x15c/0x2a0 [ 746.448778] worker_thread+0x18c/0x2e0 [ 746.452620] kthread+0x11c/0x13c [ 746.455943] ret_from_fork+0x10/0x20 [ 746.459614] ---[ end trace 0000000000000000 ]--- [ 746.464322] ---[ end trace 0000000000000000 ]--- [ 746.469033] note: kworker/u21:2[53] exited with irqs disabled [ 746.474916] note: kworker/u21:2[53] exited with preempt_count 1
Quoted 11 lines
-----Original Message-----
From: Francesco Dolcini <[email protected]>
Sent: Monday, July 20, 2026 1:28 PM
To: Hongxing Zhu <[email protected]>; Frank Li <[email protected]>; linux- [email protected]; [email protected]
Cc: [email protected]; [email protected]; [email protected]; [email protected]; [email protected]; [email protected]; [email protected]; [email protected]; [email protected]; linux- [email protected]
Subject: Non systematic PCIe error on resume on i.MX8QP on Linux 7.2
Quoted 8 lines
Hello,
our CI spotted this error on resume. It is not systematic, and it is possible that this is not a new issue from 7.2.Does it rings any bell?
[ 745.849237] imx8qm-hsio-phy 5f180000.phy: HSIO_PM_REQ_CORE_RST is set [ 745.855800] phy phy-5f180000.phy.1: phy poweron failed --> -110
Based on the log, the PHY initialization is failing during resume. I'll set up a platform on my end to see if I can reproduce this issue consistently.
BTW, is this occurring on the i.MX8QM MEK board? What's the frequency of occurrence in CI (failure rate)?
Best Regards
Richard Zhu
Quoted 110 lines
[ 745.861824] imx6q-pcie 5f000000.pcie: waiting for PHY ready timeout! [ 745.868378] imx6q-pcie 5f000000.pcie: Host init failed: -110 [ 745.874144]imx6q-pcie 5f000000.pcie: PM:
dpm_run_callback():genpd_resume_noirqreturns -110 [ 745.882791] imx6q-pcie 5f000000.pcie: PM: failed to resume
noirq: error -110 [ 745.889979] Internal error: synchronous external abort:
0000000096000210 [#1] SMP [ 745.897647] Modules linked in:can_rawcan 8021q garp stp mrp llc bluetoothecdh_genericecc uasnls_iso8859_1nls_cp437mwifiex_pciemwifiex cfg80211 ahci rfkillsd_modcdnscaam_jrcaamhash_descspidevcaamalg_descrngcrypto_enginekpprng_corelibdessnd_soc_fsl_asoc_cardaes_ce_blkghash_cesnd_soc_simple_cardsnd_soc_imx_audmuxleds_gpiogf128mulimx_sc_thermalrtc_imx_scnvmem_imx_ocotp_scusnd_soc_simple_card_utilsled_classgpio_fanahci_imxlibahci_platformlibahciphy_fsl_imx8qm_hsiolibatafsl_imx8_ddr_perfci_hdrc_imxci_hdrculpiphy_cadence_salvoehci_hcdrolesusbmisc_imxphy_mxs_usbcdns3_imxusb3503snd_soc_sgtl5000flexcancan_devimx8qxp_adcsnd_soc_fsl_spdifsnd_soc_fsl_saiimx_pcm_dmasnd_soc_fsl_utilssnd_soc_fsl_asrcpwm_imx27spi_fsl_lpspicaam etnaviv errorgpu_schedamphion_vpufuse autofs4[ 745.970466] CPU: 2 UID: 0 PID: 53 Comm: kworker/u21:2 Tainted: G M 7.2.0-rc4-0.0.0-devel #1 PREEMPT [ 745.981181] Tainted: [M]=MACHINE_CHECK [ 745.985018] Hardware name: Toradex Apalis iMX8QP V1.1 on Apalis Ixora V1.2 Carrier Board (DT) [ 745.993643] Workqueue: async async_run_entry_fn [ 745.998279] pstate: 600000c5 (nZCv daIF -PAN -UAO -TCO -DIT -SSBS BTYPE=--) [ 746.005337] pc : pci_generic_config_read+0x64/0xc0 [ 746.010231] lr : pci_generic_config_read+0x24/0xc0 [ 746.015118] sp : ffff800080513ba0 [ 746.018520] x29: ffff800080513ba0 x28: 0000000000000000 x27:0000000000000000 [ 746.025761] x26:
ffff00000043d400x25:
0000000000000000 x24:ffff0000004d1e05[ 746.033000] x23:
0000000000000003 x22:ffffa79a09fe3118x21:ffff000003a000d0[ 746.040242]
x20: 0000000000000002 x19:ffff800080513be4x18: 0000000000000001[ 746.047482] x17: 0000000000000000 x16: 0000000000000000 x15:0000000000000002 [ 746.054720] x14:
ffff000000718f90x13:ffffa79a09f6f068
x12: 0000000000000003 [ 746.061959] x11: 0000000000000028 x10:000000016a2a9b62x9 :000000000000003c[ 746.069197] x8 :ffffa79a09861b20x7 :ffff0000067fe800x6 :ffffa79a0a6bf000[ 746.076438] x5 :
0000000000000000 x4 :ffff800080513be4x3 :ffffa79a0989d904[ 746.083676] x2 : 0000000000000044 x1 : 0000000000000000 x0 :ffff8000827c0044[ 746.090917] Call trace: [ 746.093455] pci_generic_config_read+0x64/0xc0 (P) [ 746.098345] pci_bus_read_config_word+0x74/0xe0 [ 746.102971] pci_read_config_word+0x2c/0x48 [ 746.107252] pci_power_up+0x50/0x1e4 [ 746.110927] pci_pm_power_up_and_verify_state+0x2c/0xa0 [ 746.116249] pci_pm_resume_noirq+0xe8/0x1ac [ 746.120528] dpm_run_callback+0x4c/0x108 [ 746.124550] device_resume_noirq+0x110/0x3c4 [ 746.128917] async_resume_noirq+0x20/0x40 [ 746.133024] async_run_entry_fn+0x34/0x164 [ 746.137215] process_one_work+0x15c/0x2a0 [ 746.141317] worker_thread+0x18c/0x2e0 [ 746.145159] kthread+0x11c/0x13c [ 746.148486] ret_from_fork+0x10/0x20 [ 746.152167] Code: 52800000 a8c27bfd d50323bf d65f03c0 (79400000) [ 746.158371] ------------[ cut here ]------------ [ 746.163077] WARNING:
/usr/src/kernel/kernel/printk/printk.c:4627at__wake_up_klogd+0xf4/0x100, CPU#2: kworker/u21:2/53 [ 746.173972] Modules linked in:can_rawcan 8021q garp stp mrp llc bluetoothecdh_genericecc uasnls_iso8859_1nls_cp437mwifiex_pciemwifiex cfg80211 ahci rfkillsd_modcdnscaam_jrcaamhash_descspidevcaamalg_descrngcrypto_enginekpprng_corelibdessnd_soc_fsl_asoc_cardaes_ce_blkghash_cesnd_soc_simple_cardsnd_soc_imx_audmuxleds_gpiogf128mulimx_sc_thermalrtc_imx_scnvmem_imx_ocotp_scusnd_soc_simple_card_utilsled_classgpio_fanahci_imxlibahci_platformlibahciphy_fsl_imx8qm_hsiolibatafsl_imx8_ddr_perfci_hdrc_imxci_hdrculpiphy_cadence_salvoehci_hcdrolesusbmisc_imxphy_mxs_usbcdns3_imxusb3503snd_soc_sgtl5000flexcancan_devimx8qxp_adcsnd_soc_fsl_spdifsnd_soc_fsl_saiimx_pcm_dmasnd_soc_fsl_utilssnd_soc_fsl_asrcpwm_imx27spi_fsl_lpspicaam etnaviv errorgpu_schedamphion_vpufuse autofs4[ 746.246751] CPU: 2 UID: 0 PID: 53 Comm: kworker/u21:2 Tainted: G M 7.2.0-rc4-0.0.0-devel #1 PREEMPT [ 746.257464] Tainted: [M]=MACHINE_CHECK [ 746.261300] Hardware name: Toradex Apalis iMX8QP V1.1 on Apalis Ixora V1.2 Carrier Board (DT) [ 746.269921] Workqueue: async async_run_entry_fn [ 746.274548] pstate: 600000c5 (nZCv daIF -PAN -UAO -TCO -DIT -SSBS BTYPE=--) [ 746.281605] pc : __wake_up_klogd+0xf4/0x100 [ 746.285881] lr : wake_up_klogd+0x14/0x20 [ 746.289899] sp : ffff800080513920 [ 746.293304] x29: ffff800080513920 x28: ffff000000718f00 x27: 0000000000000000 [ 746.300545] x26: ffff00000043d400 x25: 0000000000000000 x24: 00000000000000c0 [ 746.307786] x23: ffffa79a09861b84 x22: 0000000000000000 x21: ffff800080513a60 [ 746.315026] x20: ffffa79a0a202cc0 x19: ffffa79a0a678370 x18: 000000000000000a [ 746.322266] x17: 3430306337323830 x16: 3030386666666620 x15: 0730076307330730 [ 746.329506] x14: 0766073507360764 x13: 0730076307330730 x12: 0766073507360764 [ 746.336746] x11: ffffa79a0a55c7c0 x10: 00000000000002af x9 :
ffffa79a0a55c7c0[ 746.343986] x8 :3fffffffffffefffx7 :ffffa79a0a5b47c0x6 :
0000000000000000 [ 746.351226] x5 :00000000000002b0x4 :
0000000000000000 x3 : 0000000000000000 [ 746.358467] x2 :
0000000000000000 x1 : 0000000000000001 x0 : 0000000000000001[ 746.365708] Call trace: [ 746.368241] __wake_up_klogd+0xf4/0x100 (P) [ 746.372520] bust_spinlocks+0x4c/0x60 [ 746.376279] die+0xc0/0x144 [ 746.379166] arm64_notify_die+0xa0/0xa4 [ 746.383099] do_sea+0x68/0x80 [ 746.386163] do_mem_abort+0x40/0x9c [ 746.389745] el1_abort+0x44/0x64 [ 746.393068] el1h_64_sync_handler+0x50/0xac [ 746.397348] el1h_64_sync+0x6c/0x70 [ 746.400934] pci_generic_config_read+0x64/0xc0 (P) [ 746.405821] pci_bus_read_config_word+0x74/0xe0 [ 746.410448] pci_read_config_word+0x2c/0x48 [ 746.414727] pci_power_up+0x50/0x1e4 [ 746.418398] pci_pm_power_up_and_verify_state+0x2c/0xa0 [ 746.423721] pci_pm_resume_noirq+0xe8/0x1ac [ 746.427998] dpm_run_callback+0x4c/0x108 [ 746.432013] device_resume_noirq+0x110/0x3c4 [ 746.436380] async_resume_noirq+0x20/0x40 [ 746.440482] async_run_entry_fn+0x34/0x164 [ 746.444674] process_one_work+0x15c/0x2a0 [ 746.448778] worker_thread+0x18c/0x2e0 [ 746.452620] kthread+0x11c/0x13c [ 746.455943] ret_from_fork+0x10/0x20 [ 746.459614] ---[ end trace 0000000000000000 ]--- [ 746.464322] ---[ endtrace 0000000000000000 ]--- [ 746.469033] note: kworker/u21:2[53] exited with irqs disabled [ 746.474916] note: kworker/u21:2[53] exited with
preempt_count1
Quoted 15 lines · Hongxing Zhu
Quoted 15 lines
-----Original Message-----
From: Francesco Dolcini <[email protected]>
Sent: Monday, July 20, 2026 1:28 PM
To: Hongxing Zhu <[email protected]>; Frank Li <[email protected]>; linux- [email protected]; [email protected]
Cc: [email protected]; [email protected]; [email protected]; [email protected]; [email protected]; [email protected]; [email protected]; [email protected]; [email protected]; linux- [email protected]
Subject: Non systematic PCIe error on resume on i.MX8QP on Linux 7.2Hello,
our CI spotted this error on resume. It is not systematic, and it is possible that this is not a new issue from 7.2.
Quoted 6 lines
Quoted 4 lines
Does it rings any bell?
[ 745.849237] imx8qm-hsio-phy 5f180000.phy: HSIO_PM_REQ_CORE_RST is set [ 745.855800] phy phy-5f180000.phy.1: phy poweron failed --> -110Based on the log, the PHY initialization is failing during resume. I'll set up a platform on my end to see if I can reproduce this issue consistently.
Thanks for the support, appreciated.
Quoted 1 line
BTW, is this occurring on the i.MX8QM MEK board?
The issue is on apalis-imx8 (you can find the DT in the usual place in the linux kernel tree).
Quoted 1 line
What's the frequency of occurrence in CI (failure rate)?
The last batch was 3 failure in 10 executions, so 30%.
Francesco
Quoted 35 lines
-----Original Message-----
From: Francesco Dolcini <[email protected]>
Sent: Monday, July 20, 2026 5:39 PM
To: Hongxing Zhu <[email protected]>
Cc: Francesco Dolcini <[email protected]>; Frank Li <[email protected]>; linux- [email protected]; [email protected]; [email protected]; [email protected]; [email protected]; [email protected]; [email protected]; [email protected]; [email protected]; [email protected]; [email protected]
Subject: Re: Non systematic PCIe error on resume on i.MX8QP on Linux 7.2Quoted 15 lines · Hongxing Zhu
Quoted 15 lines
-----Original Message-----
From: Francesco Dolcini <[email protected]>
Sent: Monday, July 20, 2026 1:28 PM
To: Hongxing Zhu <[email protected]>; Frank Li <[email protected]>; linux- [email protected]; [email protected]
Cc: [email protected]; [email protected]; [email protected]; [email protected]; [email protected]; [email protected]; [email protected]; [email protected]; [email protected]; linux- [email protected]
Subject: Non systematic PCIe error on resume on i.MX8QP on Linux 7.2Hello,
our CI spotted this error on resume. It is not systematic, and it is possible that this is not a new issue from 7.2.Quoted 7 lines
Quoted 5 lines
Does it rings any bell?
[ 745.849237] imx8qm-hsio-phy 5f180000.phy: HSIO_PM_REQ_CORE_RST isset [ 745.855800] phy phy-5f180000.phy.1: phy poweron failed --> -110
Based on the log, the PHY initialization is failing during resume. I'll set up a platform on my end to see if I can reproduce this issue consistently.
Quoted 8 lines
Thanks for the support, appreciated.
Quoted 1 line
BTW, is this occurring on the i.MX8QM MEK board?
The issue is on apalis-imx8 (you can find the DT in the usual place in the linux kernel tree).
Quoted 1 line
What's the frequency of occurrence in CI (failure rate)?
The last batch was 3 failure in 10 executions, so 30%.
Hi Francesco:
I tried the stress PM tests on both i.MX8QM MEK and i.MX8QXP MEK boards. Unfortunately, I can't reproduce this random problem.
Best Regards
Richard Zhu
Quoted 3 lines
Francesco