Skip to contentSkip to conversation

rtmutex deadlock detected (3.18.19-rt15)

DISCUSSION DIXLOR 2 participants 4 messages Jul 25, 2015 – Jul 30, 2015

lore
Share & tools
lore

DIXLOR

author
#0 lore raw

# xfs_fsr;
^C

[ 3380.373641] WARNING: CPU: 6 PID: 3664 at kernel/locking/rtmutex.h:29 0xffffffff814d4ea2()
[ 3380.373641] rtmutex deadlock detected
[ 3380.373645] Modules linked in: cpufreq_userspace cpufreq_powersave cpufreq_conservative nct6775 hwmon_vid xhci_hcd usbcore iTCO_wdt crct10dif_pclmul iTCO_vendor_support shpchp crc32c_intel i2c_i801 lpc_ich i2c_core usb_common mfd_core button processor dm_mod raid1 ahci libahci fan thermal thermal_sys [last unloaded: xhci_pci]
[ 3380.373646] CPU: 6 PID: 3664 Comm: xfs_fsr Tainted: G D        3.18.19-rt15 #3
[ 3380.373647] Hardware name: MSI MS-7823/B85M-G43 (MS-7823), BIOS V3.14B3 06/23/2014
[ 3380.373647]  0000000000000000 0000000000000009 ffffffff814d1350 ffff8807ef65f538
[ 3380.373648]  ffffffff810498dd ffff8807cf289d10 ffff8807ef65f5c0 0000000000000000
[ 3380.373648]  0000000000000000 0000000000000002 ffffffff81049955 ffffffff81680648
[ 3380.373649] Call Trace:
[ 3380.373649]  [<ffffffff814d1350>] ? 0xffffffff814d1350
[ 3380.373649]  [<ffffffff810498dd>] ? 0xffffffff810498dd
[ 3380.373650]  [<ffffffff81049955>] ? 0xffffffff81049955
[ 3380.373650]  [<ffffffff814d4ea2>] ? 0xffffffff814d4ea2
[ 3380.373651]  [<ffffffff81245565>] ? 0xffffffff81245565
[ 3380.373651]  [<ffffffff81262cb0>] ? 0xffffffff81262cb0
[ 3380.373651]  [<ffffffff81245797>] ? 0xffffffff81245797
[ 3380.373651]  [<ffffffff8115a7d5>] ? 0xffffffff8115a7d5
[ 3380.373652]  [<ffffffff811558f8>] ? 0xffffffff811558f8
[ 3380.373652]  [<ffffffff81155a56>] ? 0xffffffff81155a56
[ 3380.373652]  [<ffffffff81140b23>] ? 0xffffffff81140b23
[ 3380.373653]  [<ffffffff81064074>] ? 0xffffffff81064074
[ 3380.373653]  [<ffffffff8104c366>] ? 0xffffffff8104c366
[ 3380.373653]  [<ffffffff810061f7>] ? 0xffffffff810061f7
[ 3380.373654]  [<ffffffff8103b2d6>] ? 0xffffffff8103b2d6
[ 3380.373654]  [<ffffffff8103bc6e>] ? 0xffffffff8103bc6e
[ 3380.373654]  [<ffffffff8125c3bb>] ? 0xffffffff8125c3bb
[ 3380.373655]  [<ffffffff8125c6dc>] ? 0xffffffff8125c6dc
[ 3380.373655]  [<ffffffff81234500>] ? 0xffffffff81234500
[ 3380.373655]  [<ffffffff81083a4d>] ? 0xffffffff81083a4d
[ 3380.373655]  [<ffffffff81234500>] ? 0xffffffff81234500
[ 3380.373656]  [<ffffffff814d7a22>] ? 0xffffffff814d7a22
[ 3380.373656]  [<ffffffff8115af85>] ? 0xffffffff8115af85
[ 3380.373656]  [<ffffffff81239492>] ? 0xffffffff81239492
[ 3380.373657]  [<ffffffff8120bf8d>] ? 0xffffffff8120bf8d
[ 3380.373657]  [<ffffffff81205d7f>] ? 0xffffffff81205d7f
[ 3380.373657]  [<ffffffff8120b656>] ? 0xffffffff8120b656
[ 3380.373658]  [<ffffffff8120ce11>] ? 0xffffffff8120ce11
[ 3380.373658]  [<ffffffff812322da>] ? 0xffffffff812322da
[ 3380.373659]  [<ffffffff811379cd>] ? 0xffffffff811379cd
[ 3380.373659]  [<ffffffff81237a6b>] ? 0xffffffff81237a6b
[ 3380.373659]  [<ffffffff8114159d>] ? 0xffffffff8114159d
[ 3380.373660]  [<ffffffff8113d4d6>] ? 0xffffffff8113d4d6
[ 3380.373660]  [<ffffffff811522b0>] ? 0xffffffff811522b0
[ 3380.373660]  [<ffffffff81152769>] ? 0xffffffff81152769
[ 3380.373661]  [<ffffffff811527d6>] ? 0xffffffff811527d6
[ 3380.373661]  [<ffffffff814d7a22>] ? 0xffffffff814d7a22
[ 3380.373661]  [<ffffffff814d64f2>] ? 0xffffffff814d64f2
[ 3380.373661] ---[ end trace 0000000000000003 ]---
#1 lore raw
Quoted 11 lines · DIXLOR

# xfs_fsr;
^C

[ 3380.373641] WARNING: CPU: 6 PID: 3664 at kernel/locking/rtmutex.h:29
0xffffffff814d4ea2()
[ 3380.373641] rtmutex deadlock detected
[ 3380.373645] Modules linked in: cpufreq_userspace cpufreq_powersave

cpufreq_conservative nct6775 hwmon_vid xhci_hcd usbcore iTCO_wdt crct10dif_pclmul iTCO_vendor_support shpchp crc32c_intel i2c_i801 lpc_ich i2c_core usb_common mfd_core button processor dm_mod raid1 ahci libahci fan thermal thermal_sys [last unloaded: xhci_pci]

Quoted 12 lines
[ 3380.373646] CPU: 6 PID: 3664 Comm: xfs_fsr Tainted: G D        3.18.19-rt15
#3
[ 3380.373647] Hardware name: MSI MS-7823/B85M-G43 (MS-7823), BIOS V3.14B3
06/23/2014
[ 3380.373647]  0000000000000000 0000000000000009 ffffffff814d1350
ffff8807ef65f538
[ 3380.373648]  ffffffff810498dd ffff8807cf289d10 ffff8807ef65f5c0
0000000000000000
[ 3380.373648]  0000000000000000 0000000000000002 ffffffff81049955
ffffffff81680648
[ 3380.373649] Call Trace:
[ 3380.373649]  [<ffffffff814d1350>] ? 0xffffffff814d1350

Can you please build your kernel with KALLSYSMS_ALL enabled, so we get a symbolic resolution of the call trace.

You can also try and enable CONFIG_PROVE_LOCKING. That will give us even more detailed information about the problem at hand. Note, that CONFIG_PROVE_LOCKING slows down your kernel, so don't try to run on a production environment.

Thanks,

tglx

author
#2 lore raw

26.07.2015 21:56, Thomas Gleixner пишет:

Quoted 24 lines · DIXLOR
Quoted 11 lines

# xfs_fsr;
^C

[ 3380.373641] WARNING: CPU: 6 PID: 3664 at kernel/locking/rtmutex.h:29
0xffffffff814d4ea2()
[ 3380.373641] rtmutex deadlock detected
[ 3380.373645] Modules linked in: cpufreq_userspace cpufreq_powersave

cpufreq_conservative nct6775 hwmon_vid xhci_hcd usbcore iTCO_wdt crct10dif_pclmul iTCO_vendor_support shpchp crc32c_intel i2c_i801 lpc_ich i2c_core usb_common mfd_core button processor dm_mod raid1 ahci libahci fan thermal thermal_sys [last unloaded: xhci_pci]

Quoted 12 lines
[ 3380.373646] CPU: 6 PID: 3664 Comm: xfs_fsr Tainted: G D        3.18.19-rt15
#3
[ 3380.373647] Hardware name: MSI MS-7823/B85M-G43 (MS-7823), BIOS V3.14B3
06/23/2014
[ 3380.373647]  0000000000000000 0000000000000009 ffffffff814d1350
ffff8807ef65f538
[ 3380.373648]  ffffffff810498dd ffff8807cf289d10 ffff8807ef65f5c0
0000000000000000
[ 3380.373648]  0000000000000000 0000000000000002 ffffffff81049955
ffffffff81680648
[ 3380.373649] Call Trace:
[ 3380.373649]  [<ffffffff814d1350>] ? 0xffffffff814d1350
Quoted 7 lines

Can you please build your kernel with KALLSYSMS_ALL enabled, so we get a symbolic resolution of the call trace.

You can also try and enable CONFIG_PROVE_LOCKING. That will give us even more detailed information about the problem at hand. Note, that CONFIG_PROVE_LOCKING slows down your kernel, so don't try to run on a production environment.

I found the reason: xfs mount with filestreams option.

--
To unsubscribe from this list: send the line "unsubscribe linux-rt-users" in the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html

#3 lore raw
Quoted 27 lines · DIXLOR

26.07.2015 21:56, Thomas Gleixner пишет:

Quoted 26 lines · DIXLOR
Quoted 25 lines

# xfs_fsr;
^C

[ 3380.373641] WARNING: CPU: 6 PID: 3664 at kernel/locking/rtmutex.h:29
0xffffffff814d4ea2()
[ 3380.373641] rtmutex deadlock detected
[ 3380.373645] Modules linked in: cpufreq_userspace cpufreq_powersave

cpufreq_conservative nct6775 hwmon_vid xhci_hcd usbcore iTCO_wdt crct10dif_pclmul iTCO_vendor_support shpchp crc32c_intel i2c_i801 lpc_ich i2c_core usb_common mfd_core button processor dm_mod raid1 ahci libahci fan
thermal thermal_sys [last unloaded: xhci_pci]

[ 3380.373646] CPU: 6 PID: 3664 Comm: xfs_fsr Tainted: G D
3.18.19-rt15
#3
[ 3380.373647] Hardware name: MSI MS-7823/B85M-G43 (MS-7823), BIOS V3.14B3
06/23/2014
[ 3380.373647]  0000000000000000 0000000000000009 ffffffff814d1350
ffff8807ef65f538
[ 3380.373648]  ffffffff810498dd ffff8807cf289d10 ffff8807ef65f5c0
0000000000000000
[ 3380.373648]  0000000000000000 0000000000000002 ffffffff81049955
ffffffff81680648
[ 3380.373649] Call Trace:
[ 3380.373649]  [<ffffffff814d1350>] ? 0xffffffff814d1350
Quoted 8 lines
Quoted 7 lines

Can you please build your kernel with KALLSYSMS_ALL enabled, so we get a symbolic resolution of the call trace.

You can also try and enable CONFIG_PROVE_LOCKING. That will give us even more detailed information about the problem at hand. Note, that CONFIG_PROVE_LOCKING slows down your kernel, so don't try to run on a production environment.

I found the reason: xfs mount with filestreams option.

Ok. So we still need to investigate what happens there.

Is there anything else required than

- xfs mount with filestreams option
- Running xfs_fsr and ^C it?

Thanks,

tglx