Skip to contentSkip to conversation

bind() call in cgroup's css structure

DISCUSSION Glauber Costa 3 participants 3 messages Apr 9, 2012 – Apr 10, 2012 cgroup

lore
Share & tools
lore
#0 lore raw

Hello Tejun,

During your cgroup refactor, I was wondering if you have any plans to get rid of the bind() callback that is called when hierarchies are moved?

At least in tree, there seems to be no users for that.
I actually planned to use it myself, to start or remove a jump label when cpuacct and cpu cgroups were comounted.

Problem is, because we have some calls in the cpuset cgroup from inside the cpu hotplug handler, we end up taking the almighty cgroup_mutex from inside the cpu_hotplug.lock.

jump labels take it in most arches through the get_online_cpus() function call. This means we effectively can't apply jump labels with the cgroup_mutex held, which is the case throughout the whole bind() call.

All that explained, I figured I might as well ask before I attempted a solution to that myself: as much as populate(), bind seems to be one of the overly complicated callbacks, designed for a scenario in which everything can come and go at will, which is something we're trying to fix.

thanks in advance for your answer!

maintainer
#1 lore raw

Hello, Glauber.

Quoted 5 lines · Glauber Costa

During your cgroup refactor, I was wondering if you have any plans to get rid of the bind() callback that is called when hierarchies are moved?

At least in tree, there seems to be no users for that.

I don't have any current plan for the callback but if it doesn't have in-kernel user, I'd prefer to remove it.

Quoted 2 lines

I actually planned to use it myself, to start or remove a jump label when cpuacct and cpu cgroups were comounted.

I see.

Quoted 3 lines

Problem is, because we have some calls in the cpuset cgroup from inside the cpu hotplug handler, we end up taking the almighty cgroup_mutex from inside the cpu_hotplug.lock.

Yeah, those two are pretty big locks.

Quoted 10 lines

jump labels take it in most arches through the get_online_cpus() function call. This means we effectively can't apply jump labels with the cgroup_mutex held, which is the case throughout the whole bind() call.

All that explained, I figured I might as well ask before I attempted a solution to that myself: as much as populate(), bind seems to be one of the overly complicated callbacks, designed for a scenario in which everything can come and go at will, which is something we're trying to fix.

I haven't read the code so this could be completely off but if this is jump label optimization which can be made to work w/o it immediately applied, maybe just punt it to a work item from the callback? Note that if cancellation is necessary for e.g. unbinding, it may re-introduce locking dependency through flushing.

Thanks.

Signature · 1 line
tejun
#2 lore raw
In reply to Glauber Costa
Quoted 3 lines · Glauber Costa

Hello Tejun,

During your cgroup refactor, I was wondering if you have any plans to get rid of the bind() callback that is called when hierarchies are moved?

I planned to remove it long ago, and Paul M agreed. But after some time, I was trying to make use of it in a patchset, which was used to fix the problem that remount with different subsys bits will fail for !root cgroups.

Quoted 11 lines

At least in tree, there seems to be no users for that.
I actually planned to use it myself, to start or remove a jump label when cpuacct and cpu cgroups were comounted.

Problem is, because we have some calls in the cpuset cgroup from inside the cpu hotplug handler, we end up taking the almighty cgroup_mutex from inside the cpu_hotplug.lock.

jump labels take it in most arches through the get_online_cpus() function call. This means we effectively can't apply jump labels with the cgroup_mutex held, which is the case throughout the whole bind() call.

All that explained, I figured I might as well ask before I attempted a solution to that myself: as much as populate(), bind seems to be one of the overly complicated callbacks, designed for a scenario in which everything can come and go at will, which is something we're trying to fix.

As we aim for single hierarchy, it defenitely should be removed.