Skip to contentSkip to conversation

Hi, I have one question about rt_mutex.

DISCUSSION Li Yu 2 participants 4 messages May 10, 2007 – May 11, 2007

lore
Share & tools
lore

Li Yu

author
#0 lore raw

Hi, Steven.

Nice to meet you again.

I have read the rt-mutex-design.txt that you wrote. That is excellent description of rt_mutex. But I have a question for rt_mutex.

Quoted 1 line · As you

Now since mutexes can be defined by user-land applications, we don't

want a DOS

Quoted 5 lines

type of application that nests large amounts of mutexes to create a large PI chain, and have the code holding spin locks while looking at a large amount of data. So to prevent this, the implementation not only implements a maximum lock depth, but also only holds at most two different locks at a time, as it walks the PI chain. More about this below.

After read the implementation of rt_mutex_adjust_prio_chain(), I found the we really require maximin lock depth (1024 default), but I can not see the check for more same locks duplication. Does this doc is inconsistent with code?

Thanks in advanced.

Good luck.
- Li Yu

#1 lore raw
Quoted 8 lines · Li Yu
Quoted 1 line

Now since mutexes can be defined by user-land applications, we don't

want a DOS

Quoted 5 lines

type of application that nests large amounts of mutexes to create a large PI chain, and have the code holding spin locks while looking at a large amount of data. So to prevent this, the implementation not only implements a maximum lock depth, but also only holds at most two different locks at a time, as it walks the PI chain. More about this below.

Quoted 4 lines

After read the implementation of rt_mutex_adjust_prio_chain(), I found the we really require maximin lock depth (1024 default), but I can not see the check for more same locks duplication. Does this doc is inconsistent with code?

Nope, the code and the doc are still the same.

The thing that was most difficult in writing that document, was a way to talk about the user locks (futex - fast user mutex) and the kernel locks (spin_locks) without confusing the two. The max depth is in reference to the user futex, but the comment about the "at most two different locks" is referencing the kernel's spin_locks.

I don't remember talking about looking for "lock duplication", which I'm thinking you are referring to circular dead locks. I didn't cover that in the document and I believe I even mentioned that I would not cover the debug aspect of the code which would handle catching circular deadlocks.

But back to the "no more than two kernel locks held". This is very important. Some PI implementations requires all locks in the PI chain to have their internal locks held (as in spin_locks). But letting user space determine the number of spin locks held can cause large latencies for the rest of the system. So we designed a method to only need to hold two internal spin_locks in the PI chain at a time. The kernel doesn't care if the user application is abusing itself (holding too many of it's own user locks). But the kernel does care if a user application can affect other non related applications.

As Esben already mentioned, the PI chain even lets the locking user mutex schedule without holding any kernel locks. This is very key. It keeps the latency down on setting up a PI chain which can be very expensive.

Note: Esben helped a lot in the development of the final design of rtmutex.c.

-- Steve

author
#2 lore raw
Quoted 41 lines · Steven Rostedt
Quoted 10 lines · Li Yu
Quoted 2 lines

Now since mutexes can be defined by user-land applications, we don't

want a DOS

Quoted 6 lines

type of application that nests large amounts of mutexes to create a large PI chain, and have the code holding spin locks while looking at a large amount of data. So to prevent this, the implementation not only implements a maximum lock depth, but also only holds at most two different locks at a time, as it walks the PI chain. More about this below.

Quoted 5 lines

After read the implementation of rt_mutex_adjust_prio_chain(), I found the we really require maximin lock depth (1024 default), but I can not see the check for more same locks duplication. Does this doc is inconsistent with code?

Nope, the code and the doc are still the same.

The thing that was most difficult in writing that document, was a way to talk about the user locks (futex - fast user mutex) and the kernel locks (spin_locks) without confusing the two. The max depth is in reference to the user futex, but the comment about the "at most two different locks" is referencing the kernel's spin_locks.

I don't remember talking about looking for "lock duplication", which I'm thinking you are referring to circular dead locks. I didn't cover that in the document and I believe I even mentioned that I would not cover the debug aspect of the code which would handle catching circular deadlocks.

But back to the "no more than two kernel locks held". This is very important. Some PI implementations requires all locks in the PI chain to have their internal locks held (as in spin_locks). But letting user space determine the number of spin locks held can cause large latencies for the rest of the system. So we designed a method to only need to hold two internal spin_locks in the PI chain at a time. The kernel doesn't care if the user application is abusing itself (holding too many of it's own user locks). But the kernel does care if a user application can affect other non related applications.

Quoted 9 lines

As Esben already mentioned, the PI chain even lets the locking user mutex schedule without holding any kernel locks. This is very key. It keeps the latency down on setting up a PI chain which can be very expensive.

Note: Esben helped a lot in the development of the final design of rtmutex.c.

-- Steve

First, Thanks for such good explanation from you two guru in time.

Er, I think these two locks which you said are task->pi_lock and rt_mutex->wait_lock.

Quoted 3 lines

The max depth is in reference to the user futex, but the comment about the "at most two different locks" is referencing the kernel's spin_locks.

This sentence make the my world clear from now on ;)

However, I found the sys_futex() do not use rt_mutex, so what's mean of the user futex you said? Even, I have not found any usage for rt_mutex in kernel code. Or, some beautiful story will happen in future?

Goodluck.

- Li Yu

#3 lore raw
Quoted 4 lines · Li Yu

However, I found the sys_futex() do not use rt_mutex, so what's mean of the user futex you said? Even, I have not found any usage for rt_mutex in kernel code. Or, some beautiful story will happen in future?

Just need to look a little deeper :-)

sys_futex calls do_futex

do_futex with the option of FUTEX_LOCK_PI will call futex_lock_pi

futex_lock_pi calls rt_mutex_timed_lock or rt_mutex_trylock both of which are part of the rtmutex.c code.

So it's there today :-)

-- Steve