percpu data: only iterate over possible CPUs
Subsystems (4)
A message that is not in the archive (sent off-list or not yet received): [email protected]
Quoted 10 lines
tree
8c30052a0d7fadec37c785a42a71b28d0a9c5fcf
parentcef5076987dd545ac74f4efcf1c962be8eac34b0
author Eric Dumazet <[email protected]> Sun, 05 Feb 2006 15:27:36 -0800 committer Linus Torvalds <[email protected]> Mon, 06 Feb 2006 03:06:51 -0800[PATCH] percpu data: only iterate over possible CPUs
percpu_datablindly allocates bootmem memory to storeNR_CPUSinstances of cpudata, instead of allocating memory only for possible cpus.
Quoted 6 lines
As a preparation for changing that, we need to convert various 0 ->
NR_CPUSloops to usefor_each_cpu().(The above only applies to users of
asm-generic/percpu.h. powerpc has gone it alone and is presently only allocating memory for present CPUs, so it's currently corrupting memory).
This patch is broken since it replaces several loops that iterate NR_CPUS times with for_each_cpu before cpu_possible_map is setup:
fs/file.c static void __devinit fdtable_defer_list · line 384
Quoted 11 lines
fs/file.c +1
-2@@ -379,7 +379,6 @@ static void __devinit fdtable_defer_listvoid __init files_defer_init (void ) {int i; -/* Really early - can't use for_each_cpu */ -for (i =0 ; i <NR_CPUS ; i++) +for_each_cpu (i)fdtable_defer_list_init (i); }
The old comment indicates it: called before smp_prepare_cpus gets called which sets up cpu_possible_map.
kernel/sched.c void __init sched_init(void) · line 6113
Quoted 11 lines
kernel/sched.c +1
-1@@ -6109,7 +6109,7 @@ void __init sched_init(void)runqueue_t *rq;int i, j, k; -for (i =0 ; i <NR_CPUS ; i++) { +for_each_cpu (i) {prio_array_t *array;
Same here.
I didn't check the rest, but it looks like we end up with a bit of uninitialized stuff.
Heiko
Quoted 13 lines · Heiko Carstens
Quoted 13 lines
tree
8c30052a0d7fadec37c785a42a71b28d0a9c5fcf
parentcef5076987dd545ac74f4efcf1c962be8eac34b0
author Eric Dumazet <[email protected]> Sun, 05 Feb 2006 15:27:36 -0800 committer Linus Torvalds <[email protected]> Mon, 06 Feb 2006 03:06:51 -0800[PATCH] percpu data: only iterate over possible CPUs
percpu_datablindly allocates bootmem memory to storeNR_CPUSinstances of cpudata, instead of allocating memory only for possible cpus.As a preparation for changing that, we need to convert various 0 ->
NR_CPUSloops to usefor_each_cpu().
Quoted 6 lines
Quoted 3 lines
(The above only applies to users of
asm-generic/percpu.h. powerpc has gone it alone and is presently only allocating memory for present CPUs, so it's currently corrupting memory).This patch is broken since it replaces several loops that iterate
NR_CPUStimes withfor_each_cpubeforecpu_possible_mapis setup:
Hrmpf, chicking and egg - we must not initialize data for unknown CPUs, but we can't check since it's not setup.
To me it sounds really broken that core structures like that are not setup before we init eg fs stuff.
Signature · 1 line
Jens Axboe
Quoted 13 lines · Heiko Carstens
Quoted 13 lines
tree
8c30052a0d7fadec37c785a42a71b28d0a9c5fcf
parentcef5076987dd545ac74f4efcf1c962be8eac34b0
author Eric Dumazet <[email protected]> Sun, 05 Feb 2006 15:27:36 -0800 committer Linus Torvalds <[email protected]> Mon, 06 Feb 2006 03:06:51 -0800[PATCH] percpu data: only iterate over possible CPUs
percpu_datablindly allocates bootmem memory to storeNR_CPUSinstances of cpudata, instead of allocating memory only for possible cpus.As a preparation for changing that, we need to convert various 0 ->
NR_CPUSloops to usefor_each_cpu().
Quoted 6 lines
Quoted 3 lines
(The above only applies to users of
asm-generic/percpu.h. powerpc has gone it alone and is presently only allocating memory for present CPUs, so it's currently corrupting memory).This patch is broken since it replaces several loops that iterate
NR_CPUStimes withfor_each_cpubeforecpu_possible_mapis setup:
This patch assumes that cpu_possible_map is setup before setup_per_cpu_areas().
That sounds a reasonable assumption, but maybe not on your architecture ?
I dont think cpu_possible_map has to be filled at smp_prepare_cpus() time, but long before.
On i386/x86_64/ia64, this is done from setup_arch() called from start_kernel() just before setup_per_cpu_areas()
On powerpc it's done from setup_system(), called before start_kernel()
Eric
Quoted 5 lines · Eric Dumazet
This patch assumes that
cpu_possible_mapis setup beforesetup_per_cpu_areas().That sounds a reasonable assumption, but maybe not on your architecture ?
I have to say, it sounds not just like a reasonable assumption, but like the only sane assumption that there _could_ be.
Quoted 7 lines
I dont think
cpu_possible_maphas to be filled atsmp_prepare_cpus()time, but long before.On i386/x86_64/ia64, this is done from
setup_arch()called fromstart_kernel()just beforesetup_per_cpu_areas()On powerpc it's done from
setup_system(), called beforestart_kernel()
It absolutely _has_ to be done from setup_arch() or earlier, as shown by the fact that "setup_per_cpu_areas()" is the very next thing that init/main.c calls (and clearly, that needs to know what CPU's are possible).
ppc64 certainly calls it early enough, as does x86/x86-64/ia64. I don't see anybody else doing it too late either.
Heiko, can you point to the "old comment" you mentioned in the email, or the architecture that does this wrong?
Linus
Quoted 26 lines · Linus Torvalds
Quoted 5 lines · Eric Dumazet
This patch assumes that
cpu_possible_mapis setup beforesetup_per_cpu_areas().That sounds a reasonable assumption, but maybe not on your architecture ?
I have to say, it sounds not just like a reasonable assumption, but like the only sane assumption that there _could_ be.
Quoted 7 lines
I dont think
cpu_possible_maphas to be filled atsmp_prepare_cpus()time, but long before.On i386/x86_64/ia64, this is done from
setup_arch()called fromstart_kernel()just beforesetup_per_cpu_areas()On powerpc it's done from
setup_system(), called beforestart_kernel()It absolutely _has_ to be done from
setup_arch()or earlier, as shown by the fact that "setup_per_cpu_areas()" is the very next thing thatinit/main.ccalls (and clearly, that needs to know what CPU's are possible).
Quoted 6 lines
ppc64 certainly calls it early enough, as does x86/x86-64/ia64. I don't see anybody else doing it too late either.
Heiko, can you point to the "old comment" you mentioned in the email, or the architecture that does this wrong?
This one:
fs/file.c renamed from fs/file.c~reduce-size-of-percpudata-and-make-sure-per_cpuobject +1 -2
@@ -379,7 +379,6 @@ static void __devinit fdtable_defer_listvoid __init files_defer_init (void ) {int i; -/* Really early - can't use for_each_cpu */ -for (i =0 ; i <NR_CPUS ; i++) +for_each_cpu (i)fdtable_defer_list_init (i); }
And yes, me too - when I saw that comment disappear I checked and decided that the comment was both wrong and undesirable.
Quoted 15 lines · Andrew Morton
This one:
fs/file.c renamed from fs/file.c~reduce-size-of-percpudata-and-make-sure-per_cpuobject +1
-2@@ -379,7 +379,6 @@ static void __devinit fdtable_defer_listvoid __init files_defer_init (void ) {int i; -/* Really early - can't use for_each_cpu */ -for (i =0 ; i <NR_CPUS ; i++) +for_each_cpu (i)fdtable_defer_list_init (i); }
Quoted 2 lines
And yes, me too - when I saw that comment disappear I checked and decided that the comment was both wrong and undesirable.
Ahh, yes. The comment is totally incorrect, we must have done the CPU setup much too later a long long time ago ;)
Linus
Quoted 18 lines · Linus Torvalds
Quoted 15 lines · Andrew Morton
This one:
fs/file.c renamed from fs/file.c~reduce-size-of-percpudata-and-make-sure-per_cpuobject +1
-2@@ -379,7 +379,6 @@ static void __devinit fdtable_defer_listvoid __init files_defer_init (void ) {int i; -/* Really early - can't use for_each_cpu */ -for (i =0 ; i <NR_CPUS ; i++) +for_each_cpu (i)fdtable_defer_list_init (i); }
Quoted 5 lines
Quoted 2 lines
And yes, me too - when I saw that comment disappear I checked and decided that the comment was both wrong and undesirable.
Ahh, yes. The comment is totally incorrect, we must have done the CPU setup much too later a long long time ago ;)
One would think so, but I recall not all archs did that. Alpha for example sets up cpu_possible_map in smp_prepare_cpus(). It however makes more sense to fix the arch then use NR_CPUS, IMO.
Thanks
Dipankar
Quoted 4 lines · Dipankar Sarma
One would think so, but I recall not all archs did that. Alpha for example sets up
cpu_possible_mapinsmp_prepare_cpus(). It however makes more sense to fix the arch then useNR_CPUS, IMO.
Ehh? alpha does it in setup_smp(), which in turn is called very early from setup_arch().
Were you perhaps thinking of something else? Or am I just going blind and confused?
Linus
Quoted 8 lines · Linus Torvalds
Quoted 4 lines · Dipankar Sarma
One would think so, but I recall not all archs did that. Alpha for example sets up
cpu_possible_mapinsmp_prepare_cpus(). It however makes more sense to fix the arch then useNR_CPUS, IMO.
Quoted 5 lines
Ehh? alpha does it in
setup_smp(), which in turn is called very early fromsetup_arch().Were you perhaps thinking of something else? Or am I just going blind and confused?
I am looking at 2.6.16-rc1 and I don't see cpu_possible_map being set in setup_smp(). That said, it seems alpha setup_smp() probes for cpus there, so there is no reason why it cannot be set there. I think it is wrong not to set cpu_possible_map very early.
Or perhaps it got fixed later on, in which case, oh well, I need to download more often. <sigh>.
Thanks
Dipankar
Quoted 3 lines · Dipankar Sarma
I am looking at 2.6.16-rc1 and I don't see
cpu_possible_mapbeing set insetup_smp()
You're right, my bad. I looked at setup_smp() and how it walked through every CPU in the firmware, but it doesn't actually ever set the possible map, it fills in just hwrpb_cpu_present_mask (which is then then only used _later_ to set cpu_possible_map for some silly reason).
As far as I can tell, "hwrpb_cpu_present_mask" is just wrong, and the code _should_ be using cpu_possible_map.
rth? Ivan?
Linus
Quoted 10 lines
Quoted 2 lines
I am looking at 2.6.16-rc1 and I don't see
cpu_possible_mapbeing set insetup_smp()You're right, my bad. I looked at
setup_smp()and how it walked through every CPU in the firmware, but it doesn't actually ever set the possible map, it fills in justhwrpb_cpu_present_mask(which is then then only used _later_ to setcpu_possible_mapfor some silly reason).As far as I can tell, "
hwrpb_cpu_present_mask" is just wrong, and the code _should_ be usingcpu_possible_map.
We still have this one in init/main.c:
/* Sets up cpus_possible() */
smp_prepare_cpus(max_cpus);That is actually why s390 is doing this in smp_prepare_cpus. We also use the passed value of max_cpus to set the number of bits in cpu_possible_map accordingly. This isn't possible anymore if this should be done in setup_arch.
So it looks like we have to switch to setup_arch and set NR_CPUS bits in cpu_possible_map on s390.
Heiko
Quoted 7 lines · Linus Torvalds
You're right, my bad. I looked at
setup_smp()and how it walked through every CPU in the firmware, but it doesn't actually ever set the possible map, it fills in justhwrpb_cpu_present_mask(which is then then only used _later_ to setcpu_possible_mapfor some silly reason).As far as I can tell, "
hwrpb_cpu_present_mask" is just wrong, and the code _should_ be usingcpu_possible_map.
Yep, it seems that we can get rid of hwrpb_cpu_present_mask. The appended patch is only minimally tested (works on UP with SMP kernel).
Ivan.
arch/alpha/kernel/smp.c renamed from arch/alpha/kernel/smp.c.orig +4 -21
@@ -73,9 +73,6 @@ cpumask_t cpu_online_map;EXPORT_SYMBOL (cpu_online_map); -/* cpus reported in the hwrpb */ -static unsigned long hwrpb_cpu_present_mask__initdata =0 ; -int smp_num_probed;/* Internal processor count */ int smp_num_cpus =1 ;/* Number that came online. */
@@ -442,7 +439,7 @@ setup_smp(void)if ((cpu->flags &0x1cc ) ==0x1cc ) { smp_num_probed++;/* Assume here that "whami" == index */ - hwrpb_cpu_present_mask |= (1UL << i); +cpu_set (i, cpu_possible_map); cpu->pal_revision = boot_cpu_palrev; }
@@ -453,12 +450,12 @@ setup_smp(void) } }else { smp_num_probed =1 ; - hwrpb_cpu_present_mask = (1UL << boot_cpuid); +cpu_set (boot_cpuid, cpu_possible_map); } cpu_present_mask =cpumask_of_cpu (boot_cpuid);printk (KERN_INFO "SMP: %d CPUs probed -- cpu_present_mask = %lx\n" , - smp_num_probed, hwrpb_cpu_present_mask); + smp_num_probed, cpu_possible_map.bits[0 ]); }/*
@@ -467,8 +464,6 @@ setup_smp(void)void __init smp_prepare_cpus (unsigned int max_cpus) { -int cpu_count, i; -/* Take care of some initial bookkeeping. */ memset (ipi_data,0 ,sizeof (ipi_data));
@@ -486,19 +481,7 @@ smp_prepare_cpus(unsigned int max_cpus)printk (KERN_INFO "SMP starting up secondaries.\n" ); - cpu_count =1 ; -for (i =0 ; (i <NR_CPUS ) && (cpu_count < max_cpus); i++) { -if (i == boot_cpuid) -continue ; - -if (((hwrpb_cpu_present_mask >> i) &1 ) ==0 ) -continue ; - -cpu_set (i, cpu_possible_map); - cpu_count++; - } - - smp_num_cpus = cpu_count; + smp_num_cpus = smp_num_probed; }void __devinit
Quoted 1 line · Linux Kernel Mailing List
[PATCH] percpu data: only iterate over possible CPUs
This sched.c bit breaks Xen, and probably also other architectures that have CPU hotplug. I suspect the reason is that during early bootup only the boot CPU is online, so nothing initialises the runqueues for CPUs that are brought up afterwards.
I suspect we can get rid of this problem quite easily by moving runqueue initialisation to init_idle()...
Quoted 13 lines
kernel/sched.c +1
-1@@ -6109,7 +6109,7 @@ void __init sched_init(void)runqueue_t *rq;int i, j, k; -for (i =0 ; i <NR_CPUS ; i++) { +for_each_cpu (i) {prio_array_t *array; rq =cpu_rq (i);
Signature · 1 line
All Rights Reversed
Quoted 11 lines · Rik van Riel
Quoted 1 line · Linux Kernel Mailing List
[PATCH] percpu data: only iterate over possible CPUs
The
sched.cbit breaks Xen, and probably also other architectures that have CPU hotplug. I suspect the reason is that during early bootup only the boot CPU is online, so nothing initialises the runqueues for CPUs that are brought up afterwards.I suspect we can get rid of this problem quite easily by moving runqueue initialisation to
init_idle()...
Well, it works. This (fairly trivial) patch makes hotplug cpu work again, by ensuring that the runqueues of a newly brought up CPU are initialized just before they are needed.
Without this patch the "spin_lock_irqsave(&rq->lock, flags);" in init_idle() would oops if CONFIG_DEBUG_SPINLOCK was set.
With this patch, things just work.
kernel/sched.c renamed from kernel/sched.c.idle_init +29 -35
@@ -4437,6 +4437,35 @@ void __devinit init_idle(task_t *idle, i {runqueue_t *rq =cpu_rq (cpu);unsigned long flags; +prio_array_t *array; +int j, k; + +spin_lock_init (&rq->lock); + rq->nr_running =0 ; + rq->active = rq->arrays; + rq->expired = rq->arrays +1 ; + rq->best_expired_prio =MAX_PRIO ; + +#ifdef CONFIG_SMP + rq->sd =NULL ; +for (j =1 ; j <3 ; j++) + rq->cpu_load[j] =0 ; + rq->active_balance =0 ; + rq->push_cpu =0 ; + rq->migration_thread =NULL ; +INIT_LIST_HEAD (&rq->migration_queue); +#endif +atomic_set (&rq->nr_iowait,0 ); + +for (j =0 ; j <2 ; j++) { + array = rq->arrays + j; +for (k =0 ; k <MAX_PRIO ; k++) { +INIT_LIST_HEAD (array->queue + k); +__clear_bit (k, array->bitmap); + } +// delimiter for bitsearch +__set_bit (MAX_PRIO , array->bitmap); + } idle->sleep_avg =0 ; idle->array =NULL ;
@@ -6110,41 +6139,6 @@ int in_sched_functions(unsigned long addvoid __init sched_init (void ) { -runqueue_t *rq; -int i, j, k; - -for_each_cpu (i) { -prio_array_t *array; - - rq =cpu_rq (i); -spin_lock_init (&rq->lock); - rq->nr_running =0 ; - rq->active = rq->arrays; - rq->expired = rq->arrays +1 ; - rq->best_expired_prio =MAX_PRIO ; - -#ifdef CONFIG_SMP - rq->sd =NULL ; -for (j =1 ; j <3 ; j++) - rq->cpu_load[j] =0 ; - rq->active_balance =0 ; - rq->push_cpu =0 ; - rq->migration_thread =NULL ; -INIT_LIST_HEAD (&rq->migration_queue); -#endif -atomic_set (&rq->nr_iowait,0 ); - -for (j =0 ; j <2 ; j++) { - array = rq->arrays + j; -for (k =0 ; k <MAX_PRIO ; k++) { -INIT_LIST_HEAD (array->queue + k); -__clear_bit (k, array->bitmap); - } -// delimiter for bitsearch -__set_bit (MAX_PRIO , array->bitmap); - } - } -/* * The boot idle thread does lazy MMU switching as well: */
Quoted 5 lines · Rik van Riel
Quoted 1 line · Linux Kernel Mailing List
[PATCH] percpu data: only iterate over possible CPUs
Quoted 7 lines
This
sched.cbit breaks Xen, and probably also other architectures that have CPU hotplug. I suspect the reason is that during early bootup only the boot CPU is online, so nothing initialises the runqueues for CPUs that are brought up afterwards.I suspect we can get rid of this problem quite easily by moving runqueue initialisation to
init_idle()...
We've hit this snag with a few architectures. They're setting up cpu_possible_map too late. It's never been clearly defined.
sched_init() is called here:
asmlinkage void __init start_kernel(void)
{
...
printk(linux_banner);
setup_arch(&command_line);
setup_per_cpu_areas();
smp_prepare_boot_cpu();
sched_init();Users of __GENERIC_PER_CPU definitely need cpu_possible_map to be initialised by the time setup_per_cpu_areas() is called, so I think it makes sense to say "thou shalt initialise cpu_possible_map in setup_arch()".
I guess Xen isn't doing that. Can it be made to?
Quoted 3 lines · Andrew Morton
Users of
__GENERIC_PER_CPUdefinitely needcpu_possible_mapto be initialised
by the timesetup_per_cpu_areas()is called,
err, they'll need it once Eric's dont-waste-percpu-memory-on-not-possible-CPUs patch is merged..
Quoted 4 lines
so I think it makes sense to
say "thou shalt initialisecpu_possible_mapinsetup_arch()".I guess Xen isn't doing that. Can it be made to?
Lame fix: cpu_possible_map = (1<<NR_CPUS)-1 in setup_arch().
Quoted 7 lines · Andrew Morton
Quoted 2 lines · Andrew Morton
Users of
__GENERIC_PER_CPUdefinitely needcpu_possible_mapto be initialised
by the timesetup_per_cpu_areas()is called,err, they'll need it once Eric's dont-waste-percpu-memory-on-not-possible-CPUs patch is merged..
Quoted 6 lines
Quoted 4 lines
so I think it makes sense to
say "thou shalt initialisecpu_possible_mapinsetup_arch()".I guess Xen isn't doing that. Can it be made to?
Lame fix:
cpu_possible_map= (1<<NR_CPUS)-1 insetup_arch().
I dont understand why this HOTPLUG stuff is problematic for Xen (or other arch) : If CONFIG_HOTPLUG_CPU is configured, then the map should be preset to CPU_MASK_ALL. Its even documented in line 332 of include/linux/cpumask.h
* #ifdef CONFIG_HOTPLUG_CPU
* cpu_possible_map - all NR_CPUS bits set
arch/i386/kernel/smpboot.c is doing the only sane stuff about it :
#ifdef CONFIG_HOTPLUG_CPUcpumask_t cpu_possible_map = CPU_MASK_ALL;
#elsecpumask_t cpu_possible_map;
#endif
Some remarks :
1) These cpu_possible_map could have __read_mostly attribute.
2) cpu_possible(cpu) macro could be defined to 1 if CONFIG_HOTPLUG_CPU, or a test against NR_CPUS
#ifdef CONFIG_HOTPLUG_CPU
#define cpu_possible(cpu) cpu_isset((cpu), cpu_possible_map)
#else
#define cpu_possible(cpu) ((unsigned)(cpu) < NR_CPUS)
#endif
Eric
Quoted 12 lines · Eric Dumazet
Quoted 10 lines · Andrew Morton
Quoted 2 lines · Andrew Morton
Users of
__GENERIC_PER_CPUdefinitely needcpu_possible_mapto be initialised
by the timesetup_per_cpu_areas()is called,err, they'll need it once Eric's dont-waste-percpu-memory-on-not-possible-CPUs patch is merged..
Quoted 3 lines
so I think it makes sense to
say "thou shalt initialisecpu_possible_mapinsetup_arch()".
Quoted 7 lines
Quoted 3 lines
Quoted 1 line
I guess Xen isn't doing that. Can it be made to?
Lame fix:
cpu_possible_map= (1<<NR_CPUS)-1 insetup_arch().I dont understand why this HOTPLUG stuff is problematic for Xen (or other arch) : If
CONFIG_HOTPLUG_CPUis configured, then the map should be preset toCPU_MASK_ALL.
Presumably not all architectures are doing that. And some of the problems
we've had are with CONFIG_HOTPLUG_CPU=n.
Quoted 4 lines
Its even documented in line 332 of
include/linux/cpumask.h* #ifdef
CONFIG_HOTPLUG_CPU
*cpu_possible_map- allNR_CPUSbits set
That seems a quite bad idea. If we know which CPUs are possible we should populate cpu_possible_map correctly, whether or not CONFIG_HOTPLUG_CPU is set. Setting all the bits like that wastes memory and wastes CPU cycles.
<greps>
That comment came from the tender pinkies of [email protected], although I suspect it was just a transliteration of then-current practice.
Quoted 2 lines · Andrew
That comment came from the tender pinkies of [email protected], although I suspect it was just a transliteration of then-current practice.
You give my pinkie more credit than is its due.
That comment looks bogus.
Hmmm ... what should it be ...
* #ifdef CONFIG_HOTPLUG_CPU
* cpu_possible_map - has bit 'cpu' set iff cpu could be populated
Signature · 3 lines
I won't rest till it's the best ...
Programmer, Linux Scalability
Paul Jackson <[email protected]> 1.925.600.0401Quoted 15 lines · Andrew Morton
Quoted 14 lines · Eric Dumazet
Quoted 12 lines · Andrew Morton
Quoted 2 lines · Andrew Morton
Users of
__GENERIC_PER_CPUdefinitely needcpu_possible_mapto be initialised
by the timesetup_per_cpu_areas()is called,err, they'll need it once Eric's dont-waste-percpu-memory-on-not-possible-CPUs patch is merged..
Quoted 4 lines
so I think it makes sense to
say "thou shalt initialisecpu_possible_mapinsetup_arch()".I guess Xen isn't doing that. Can it be made to?
Quoted 7 lines
Quoted 5 lines
Quoted 1 line
Lame fix:
cpu_possible_map= (1<<NR_CPUS)-1 insetup_arch().I dont understand why this HOTPLUG stuff is problematic for Xen (or other arch) : If
CONFIG_HOTPLUG_CPUis configured, then the map should be preset toCPU_MASK_ALL.Presumably not all architectures are doing that.
powerpc/ppc64, for instance, determines the number of possible cpus from information exported by firmware (and I'm mystified as to why other platforms don't do this). So it's typical to have a kernel an a pSeries partition with NR_CPUS=128, but cpu_possible_map = 0xff.
Quoted 8 lines
Quoted 4 lines
Its even documented in line 332 of
include/linux/cpumask.h* #ifdef
CONFIG_HOTPLUG_CPU
*cpu_possible_map- allNR_CPUSbits setThat seems a quite bad idea. If we know which CPUs are possible we should populate
cpu_possible_mapcorrectly, whether or notCONFIG_HOTPLUG_CPUis set. Setting all the bits like that wastes memory and wastes CPU cycles.
Yes, that comment is wrong or outdated.
Quoted 5 lines
Quoted 1 line
Presumably not all architectures are doing that.
powerpc/ppc64, for instance, determines the number of possible cpus from information exported by firmware (and I'm mystified as to why other platforms don't do this). So it's typical to have a kernel an a pSeries partition with NR_CPUS=128, but
cpu_possible_map=0xff.
Simply because there is no such interface on s390. The only thing we know for sure is that if we are running under z/VM the user is free to configure up to 63 additional virtual cpus on the fly...
Heiko
Quoted 3 lines · Heiko Carstens
Simply because there is no such interface on s390. The only thing we know for sure is that if we are running under z/VM the user is free to configure up to 63 additional virtual cpus on the fly...
Xen is in a similar situation.
Signature · 1 line
All Rights Reversed
Quoted 9 lines · Heiko Carstens
Quoted 5 lines
Quoted 1 line
Presumably not all architectures are doing that.
powerpc/ppc64, for instance, determines the number of possible cpus from information exported by firmware (and I'm mystified as to why other platforms don't do this). So it's typical to have a kernel an a pSeries partition with NR_CPUS=128, but
cpu_possible_map=0xff.Simply because there is no such interface on s390. The only thing we know for sure is that if we are running under z/VM the user is free to configure up to 63 additional virtual cpus on the fly...
My "mystified" parenthetical was not meant as a criticism of arch/!powerpc, but of the platform implementations themselves, for not making such an interface available.
Quoted 9 lines · Heiko Carstens
Quoted 5 lines
Quoted 1 line
Presumably not all architectures are doing that.
powerpc/ppc64, for instance, determines the number of possible cpus from information exported by firmware (and I'm mystified as to why other platforms don't do this). So it's typical to have a kernel an a pSeries partition with NR_CPUS=128, but
cpu_possible_map=0xff.Simply because there is no such interface on s390. The only thing we know for sure is that if we are running under z/VM the user is free to configure up to 63 additional virtual cpus on the fly...
x86-64 had the same problem, but we now require that you boot with additional_cpus=... for how many you want. Default is 0 (used to be half available CPUs but that lead to confusion)
Also the firmware has a way now to give this information automatically.
You can of course make it default to 64, but it will cost you several MB of memory in usually unused copies of per cpu data.
-Andi
Quoted 5 lines
Quoted 5 lines
Quoted 4 lines
powerpc/ppc64, for instance, determines the number of possible cpus from information exported by firmware (and I'm mystified as to why other platforms don't do this). So it's typical to have a kernel an a pSeries partition with NR_CPUS=128, but
cpu_possible_map=0xff.
Quoted 7 lines
Quoted 3 lines
Simply because there is no such interface on s390. The only thing we know for sure is that if we are running under z/VM the user is free to configure up to 63 additional virtual cpus on the fly...
x86-64 had the same problem, but we now require that you boot with additional_cpus=... for how many you want. Default is 0 (used to be half available CPUs but that lead to confusion)
So introducing the additional_cpus kernel parameter seems to be the way to go (for XEN probably too). Even though it seems to be a bit odd if the user specifies both maxcpus=... and additional_cpus=...
Heiko
[putting some Xen people into cc]
Quoted 9 lines · Heiko Carstens
Quoted 9 lines
Quoted 8 lines
Quoted 4 lines
powerpc/ppc64, for instance, determines the number of possible cpus from information exported by firmware (and I'm mystified as to why other platforms don't do this). So it's typical to have a kernel an a pSeries partition with NR_CPUS=128, but
cpu_possible_map=0xff.Simply because there is no such interface on s390. The only thing we know for sure is that if we are running under z/VM the user is free to configure up to 63 additional virtual cpus on the fly...
Quoted 7 lines
Quoted 3 lines
x86-64 had the same problem, but we now require that you boot with additional_cpus=... for how many you want. Default is 0 (used to be half available CPUs but that lead to confusion)
So introducing the
additional_cpuskernel parameter seems to be the way to go (for XEN probably too). Even though it seems to be a bit odd if the user specifies both maxcpus=... and additional_cpus=...
With additional_cpus you don't need maxcpus. They are added together.
Also for Xen it's probably not needed by default, but the hypervisor can somehow pass it (it doesn't make sense to have more vcpus than real cpus and that should be relatively small number, so the memory waste shouldn't be that bad).
On x86-64 there is also a new firmware
way to specify it, but current machines don't support that yet.
-Andi
Quoted 9 lines
Quoted 7 lines
Quoted 3 lines
x86-64 had the same problem, but we now require that you boot with additional_cpus=... for how many you want. Default is 0 (used to be half available CPUs but that lead to confusion)
So introducing the
additional_cpuskernel parameter seems to be the way to go (for XEN probably too). Even though it seems to be a bit odd if the user specifies both maxcpus=... and additional_cpus=...With
additional_cpusyou don't need maxcpus. They are added together.
How does x86_64 manage to get 'additional_cpus' parsed early enough? As far as I can see this is done when parse_args() in start_kernel() gets called, but that's after you need the parameter in prefill_possible_map(). IMHO that should be an early_param and you would need to call parse_early_param() from setup_arch(). But then again, maybe I got it all wrong.
But the more interesting question is: what do you do if the command line contains both additional_cpus and maxcpus. I was just trying to make some sense of this, but the result is questionable.
I ended up with a cpu_possible_map that has 'present cpus' + 'additional_cpus' bits set. And in smp_prepare_cpus I make sure that cpu_present_map has not more than max_cpus bits set.
At least that doesn't break the current semantics of the maxcpus parameter. But we're still wasting memory, since it would make sense that the cpu_possible_map shouldn't have more than max_cpus bits set.
Heiko
Quoted 8 lines · Heiko Carstens
Quoted 8 lines
Quoted 7 lines
Quoted 3 lines
x86-64 had the same problem, but we now require that you boot with additional_cpus=... for how many you want. Default is 0 (used to be half available CPUs but that lead to confusion)
So introducing the
additional_cpuskernel parameter seems to be the way to go (for XEN probably too). Even though it seems to be a bit odd if the user specifies both maxcpus=... and additional_cpus=...
Quoted 8 lines
Quoted 1 line
With
additional_cpusyou don't need maxcpus. They are added together.How does
x86_64manage to get 'additional_cpus' parsed early enough? As far as I can see this is done whenparse_args()instart_kernel()gets called, but that's after you need the parameter inprefill_possible_map(). IMHO that should be anearly_paramand you would need to callparse_early_param()fromsetup_arch(). But then again, maybe I got it all wrong.
Yes, you're right - it's added too late to the map right now. I will fix that. There are no earlyparams unfortunately, except for a big hack in setup.c
Quoted 10 lines
But the more interesting question is: what do you do if the command line contains both
additional_cpusand maxcpus. I was just trying to make some sense of this, but the result is questionable.
I ended up with acpu_possible_mapthat has 'present cpus' + 'additional_cpus' bits set. And insmp_prepare_cpusI make sure thatcpu_present_maphas not more thanmax_cpusbits set.At least that doesn't break the current semantics of the maxcpus parameter. But we're still wasting memory, since it would make sense that the
cpu_possible_mapshouldn't have more thanmax_cpusbits set.
Yes, maybe it should be a early parameter too. But frankly I see maxcpus more as a debugging hack or workarouno. I don't think it matters much if it's not as efficient as it could be.
-Andi
Quoted 6 lines · Nathan Lynch
powerpc/ppc64, for instance, determines the number of possible cpus from information exported by firmware (and I'm mystified as to why other platforms don't do this). So it's typical to have a kernel an a pSeries partition with NR_CPUS=128, but
cpu_possible_map=0xff.
Iam assuming in the above ase, cpu_possible_map == cpu_present_map and both dont change after the OS is booted. v.s in platforms capable of hot-plug cpus present could grow up to cpu_possible_map (max) when a new cpu is newly added, that wasnt even present at boot time.
The problem was with ACPI just simply looking at the namespace doesnt exactly give us an idea of how many processors are possible in this platform.
The reason is we could get more added via SSDT dynamically.
on x86_64, we used the number of disabled cpus reported in MADT at boot time as an indicator to set cpu_possible_map. So if you had 4 sockets, but just 2 populated, the BIOS would set the missing CPUS with disabled flag. We simply count the number of disabled CPUs and add to possible map.
Andi added documentation to cover that as well in Documentation/x86_64/cpu-hotplug-spec as a guideline for BIOS folks.
Signature · 3 lines
Cheers, Ashok Raj - Open Source Technology Center
Quoted 8 lines · Ashok Raj
Quoted 6 lines · Nathan Lynch
powerpc/ppc64, for instance, determines the number of possible cpus from information exported by firmware (and I'm mystified as to why other platforms don't do this). So it's typical to have a kernel an a pSeries partition with NR_CPUS=128, but
cpu_possible_map=0xff.
Quoted 4 lines
Iam assuming in the above ase,
cpu_possible_map==cpu_present_mapand both dont change after the OS is booted. v.s in platforms capable of hot-plug cpus present could grow up tocpu_possible_map(max) when a new cpu is newly added, that wasnt even present at boot time.
No, cpu_present_map need not equal cpu_possible_map. Of course cpu_possible_map doesn't change after boot, but cpu_present_map can. Apart from that, I don't really understand what you're trying to say here.
Quoted 3 lines · Ashok Raj
The problem was with ACPI just simply looking at the namespace doesnt
exactly give us an idea of how many processors are possible in this platform.
We need to fix this asap - the performance penalty for HOTPLUG_CPU=y, NR_CPUS=lots will be appreciable.
Do any x86 platforms actually support CPU hotplug?
Does the ACPI problem which you describe occur with present-CPUs, or only with possible-but-not-present ones?
Quoted 5 lines · Andrew Morton
We need to fix this asap - the performance penalty for HOTPLUG_CPU=y, NR_CPUS=lots will be appreciable.
Do any x86 platforms actually support CPU hotplug?
Hi Andrew,
logical cpu hotplug (i.e onlining and offlining) can be done on any system. No hw or BIOS support is required. (this is what smp suspend/resume folks use)
I remember Natalie from Unisys mentioned they have one system which is ACPI based and supports physical cpu hotplug, but the BIOS is old and didnt support the hotplug notify via ACPI. They probably have some other sysmgmt way to interact and initiate the hotplug.
Iam aware of couple more that use ia64 NUMA type hw as well. (I dont think i can announce for them:-) ).
Quoted 3 lines
Does the ACPI problem which you describe occur with present-CPUs, or only with possible-but-not-present ones?
Describing present cpus is not problem.
Only knowing possible-but-not-present upfront is an issue.
logical-cpu-hotplug only: cpu_present_map == cpu_possible_map always
physical-cpu-hotplug: At boot, cpu_present_map is a subset of possible_map.
Think its best to NOT set cpu_present_map to MASK_ALL as its being proposed, but let the arch/platform code figure out early enough to set possible_map accurately for that platform. If a platform has no way to determine it, then it could use cmdline like what x86_64 introduced (additional_cpus=) to overcome that.
Signature · 3 lines
Cheers, Ashok Raj - Open Source Technology Center
Quoted 9 lines · Ashok Raj
Quoted 4 lines
Does the ACPI problem which you describe occur with present-CPUs, or only with possible-but-not-present ones?
Describing present cpus is not problem.
Only knowing possible-but-not-present upfront is an issue.
Quoted 8 lines
logical-cpu-hotplug only:
cpu_present_map==cpu_possible_mapalways
physical-cpu-hotplug: At boot,cpu_present_mapis a subset ofpossible_map.Think its best to NOT set
cpu_present_maptoMASK_ALLas its being proposed, but let thearch/platformcode figure out early enough to setpossible_mapaccurately for that platform. If a platform has no way to determine it, then it could use cmdline like whatx86_64introduced (additional_cpus=) to overcome that.
There is no proposal to change cpu_present_map.
The problem is cpu_possible_map. That is presently being initialised to CPU_MASK_ALL, which adversely affects perfoermance. An NR_CPUS=16 kernel on a 2-way presently has cpu_possible_map=0xffff, which will hurt.
The proposal is this:
From: Andrew Morton <[email protected]>
Initialising cpu_possible_map to all-ones with CONFIG_HOTPLUG_CPU means that
a) All for_each_cpu() loops will iterate across all NR_CPUS CPUs, rather than over possible ones. That can be quite expensive.
b) Soon we'll be allocating per-cpu areas only for possible CPUs. So with CPU_MASK_ALL, we'll be wasting memory.
I also switched voyager over to not use CPU_MASK_ALL in the non-CPU-hotplug case. Will that break it?
I note that parisc is also using CPU_MASK_ALL. Suggest that it stop doing that.
---
arch/i386/kernel/smpboot.c | 4 ---- arch/i386/mach-voyager/voyager_smp.c | 2 +- 2 files changed, 1 insertion(+), 5 deletions(-)
arch/i386/kernel/smpboot.c renamed from arch/i386/kernel/smpboot.c~x86-dont-initialise-cpu_possible_map-to-all-ones +0 -4
@@ -87,11 +87,7 @@ EXPORT_SYMBOL(cpu_online_map);cpumask_t cpu_callin_map;cpumask_t cpu_callout_map;EXPORT_SYMBOL (cpu_callout_map); -#ifdef CONFIG_HOTPLUG_CPU -cpumask_t cpu_possible_map =CPU_MASK_ALL ; -#else cpumask_t cpu_possible_map; -#endif EXPORT_SYMBOL (cpu_possible_map);static cpumask_t smp_commenced_mask;
arch/i386/mach-voyager/voyager_smp.c renamed from arch/i386/mach-voyager/voyager_smp.c~x86-dont-initialise-cpu_possible_map-to-all-ones +1 -1
@@ -240,7 +240,7 @@ static cpumask_t smp_commenced_mask = CPcpumask_t cpu_callin_map =CPU_MASK_NONE ;cpumask_t cpu_callout_map =CPU_MASK_NONE ;EXPORT_SYMBOL (cpu_callout_map); -cpumask_t cpu_possible_map =CPU_MASK_ALL ; +cpumask_t cpu_possible_map =CPU_MASK_NONE ;EXPORT_SYMBOL (cpu_possible_map);/* The per processor IRQ masks (these are usually kept in sync) */
_
Quoted 6 lines · Andrew Morton
There is no proposal to change
cpu_present_map.The problem is
cpu_possible_map. That is presently being initialised toCPU_MASK_ALL, which adversely affects perfoermance. An NR_CPUS=16 kernel on a 2-way presently has cpu_possible_map=0xffff, which will hurt.
Think i miss typed earlier. What you proposed is the correct solution.
I will followup with similar change on ia64 as well, (currently we do this in smp_build_cpu_map()). And add something similar to what we did for x86_64.
Quoted 7 lines · Andrew Morton
Quoted 3 lines · Ashok Raj
The problem was with ACPI just simply looking at the namespace doesnt
exactly give us an idea of how many processors are possible in this platform.We need to fix this asap - the performance penalty for HOTPLUG_CPU=y, NR_CPUS=lots will be appreciable.
What is this performance penalty exactly?
It wastes quite some memory (each possible CPU needs 32K of memory which adds quickly up), but it shouldn't impact other CPU use.
Quoted 2 lines
Do any x86 platforms actually support CPU hotplug?
Xen does. And it's needed for suspend/resume on normal x86 now.
-Andi
Quoted 11 lines · Andi Kleen
Quoted 7 lines · Andrew Morton
Quoted 3 lines · Ashok Raj
The problem was with ACPI just simply looking at the namespace doesnt
exactly give us an idea of how many processors are possible in this platform.We need to fix this asap - the performance penalty for HOTPLUG_CPU=y, NR_CPUS=lots will be appreciable.
What is this performance penalty exactly?
All those for_each_cpu() loops will hit NR_CPUS cachelines instead of hweight(cpu_possible_map) cachelines.
Quoted 7 lines
It wastes quite some memory (each possible CPU needs 32K of memory which adds quickly up), but it shouldn't impact other CPU use.
Quoted 2 lines
Do any x86 platforms actually support CPU hotplug?
Xen does.
yup.
Quoted 1 line
And it's needed for suspend/resume on normal x86 now.
True.
Quoted 11 lines · Andrew Morton
Quoted 7 lines · Andi Kleen
Quoted 5 lines · Andrew Morton
Quoted 2 lines · Ashok Raj
The problem was with ACPI just simply looking at the namespace doesnt
exactly give us an idea of how many processors are possible in this platform.We need to fix this asap - the performance penalty for HOTPLUG_CPU=y, NR_CPUS=lots will be appreciable.
What is this performance penalty exactly?
All those
for_each_cpu()loops will hitNR_CPUScachelines instead ofhweight(cpu_possible_map)cachelines.
You mean NR_CPUS bits, mostly all included in a single cacheline, and even in a single long word :) for most cases (NR_CPUS <= 32 or 64)
Quoted 9 lines · Eric Dumazet
Quoted 7 lines · Andrew Morton
Quoted 6 lines · Andi Kleen
Quoted 5 lines · Andrew Morton
Quoted 2 lines · Ashok Raj
The problem was with ACPI just simply looking at the namespace doesnt
exactly give us an idea of how many processors are possible in this platform.We need to fix this asap - the performance penalty for HOTPLUG_CPU=y, NR_CPUS=lots will be appreciable.
Quoted 8 lines
Quoted 4 lines
Quoted 1 line
What is this performance penalty exactly?
All those
for_each_cpu()loops will hitNR_CPUScachelines instead ofhweight(cpu_possible_map)cachelines.You mean
NR_CPUSbits, mostly all included in a single cacheline, and even in a single long word :) for most cases (NR_CPUS<= 32 or 64)
No, I mean cachelines:
static void recalc_bh_state(void)
{
int i;
int tot = 0;
if (__get_cpu_var(bh_accounting).ratelimit++ < 4096)
return;
__get_cpu_var(bh_accounting).ratelimit = 0;
for_each_cpu(i)
tot += per_cpu(bh_accounting, i).nr;That's going to hit NR_CPUS cachelines even on a 2-way.
Or am I missing something really obvious here?
(Probably the most expensive ones will be get_page_state() and friends. And argh, they're still hardwired to CPU_MASK_ALL).
Quoted 4 lines · Andrew Morton
(Probably the most expensive ones will be
get_page_state()and friends.
And argh, they're still hardwired toCPU_MASK_ALL).
No, we mask it with cpu_online_map. Phew.
Quoted 28 lines · Andrew Morton
Quoted 4 lines · Eric Dumazet
Quoted 3 lines · Andrew Morton
Quoted 2 lines · Andi Kleen
Quoted 1 line · Andrew Morton
Ashok Raj <[email protected]> wrote:
Quoted 9 lines
Quoted 7 lines
Quoted 5 lines
Quoted 4 lines
Quoted 2 lines
The problem was with ACPI just simply looking at the namespace doesnt
exactly give us an idea of how many processors are possible in this platform.We need to fix this asap - the performance penalty for HOTPLUG_CPU=y, NR_CPUS=lots will be appreciable.
What is this performance penalty exactly?
All those
for_each_cpu()loops will hitNR_CPUScachelines instead ofhweight(cpu_possible_map)cachelines.You mean
NR_CPUSbits, mostly all included in a single cacheline, and even in a single long word :) for most cases (NR_CPUS<= 32 or 64)No, I mean cachelines:
static void
recalc_bh_state(void){ int i; int tot = 0; if (__get_cpu_var(bh_accounting).ratelimit++ < 4096) return; __get_cpu_var(bh_accounting).ratelimit = 0; for_each_cpu(i) tot += per_cpu(bh_accounting, i).nr;
Quoted 3 lines
That's going to hit
NR_CPUScachelines even on a 2-way.Or am I missing something really obvious here?
OK I see. This can be solved with this patch :
[PATCH] HOTPLUG_CPU : avoid hitting too many cachelines in recalc_bh_state()
Instead of using for_each_cpu(i), we can use for_each_online_cpu(i) : The difference matters if HOTPUG_CPU=y
When a CPU goes offline (ie removed from online map), it might have a non null bh_accounting.nr, so this patch adds a transfert of this counter to an online CPU counter.
We already have a hotcpu_notifier, (function buffer_cpu_notify()), where we can do this bh_accounting.nr transfert.
fs/buffer.c +4 -1
@@ -3138,7 +3138,7 @@if (__get_cpu_var (bh_accounting).ratelimit++ <4096 )return ;__get_cpu_var (bh_accounting).ratelimit =0 ; -for_each_cpu (i) +for_each_online_cpu (i) tot +=per_cpu (bh_accounting, i).nr; buffer_heads_over_limit = (tot > max_buffer_heads); }
@@ -3187,6 +3187,9 @@brelse (b->bhs[i]); b->bhs[i] =NULL ; } +get_cpu_var (bh_accounting).nr +=per_cpu (bh_accounting, cpu).nr ; +per_cpu (bh_accounting, cpu).nr =0 ; +put_cpu_var (bh_accounting); } static int buffer_cpu_notify(struct notifier_block *self,
Quoted 27 lines · Eric Dumazet
[PATCH]
HOTPLUG_CPU: avoid hitting too many cachelines inrecalc_bh_state()Instead of using
for_each_cpu(i), we can usefor_each_online_cpu(i): The difference matters if HOTPUG_CPU=yWhen a CPU goes offline (ie removed from online map), it might have a non null bh_accounting.nr, so this patch adds a transfert of this counter to an online CPU counter.
We already have a
hotcpu_notifier, (functionbuffer_cpu_notify()), where we can do this bh_accounting.nr transfert.Signed-off-by Eric Dumazet <[email protected]>fs/buffer.c +1
-1@@ -3138,7 +3138,7 @@if (__get_cpu_var (bh_accounting).ratelimit++ <4096 )return ;__get_cpu_var (bh_accounting).ratelimit =0 ; -for_each_cpu (i) +for_each_online_cpu (i) tot +=per_cpu (bh_accounting, i).nr; buffer_heads_over_limit = (tot > max_buffer_heads); }
fs/buffer.c line 3193
Quoted 7 lines
fs/buffer.c +3
-0@@ -3187,6 +3187,9 @@brelse (b->bhs[i]); b->bhs[i] =NULL ; } +get_cpu_var (bh_accounting).nr +=per_cpu (bh_accounting, cpu).nr ; +per_cpu (bh_accounting, cpu).nr =0 ; +put_cpu_var (bh_accounting); }
But now there is a window between the time the cpu is marked offline and the time its bh_accounting.nr is moved to another cpu. So recalc_bh_state could fail to set buffer_heads_over_limit when it should.
Maybe it's not worth worrying about? I don't really know this code, just thought I would point it out.
Quoted 33 lines · Nathan Lynch
Quoted 31 lines · Eric Dumazet
[PATCH]
HOTPLUG_CPU: avoid hitting too many cachelines inrecalc_bh_state()Instead of using
for_each_cpu(i), we can usefor_each_online_cpu(i): The difference matters if HOTPUG_CPU=yWhen a CPU goes offline (ie removed from online map), it might have a non null bh_accounting.nr, so this patch adds a transfert of this counter to an online CPU counter.
We already have a
hotcpu_notifier, (functionbuffer_cpu_notify()), where we can do this bh_accounting.nr transfert.Signed-off-by Eric Dumazet <[email protected]>fs/buffer.c +2
-1@@ -3138,7 +3138,7 @@if (__get_cpu_var (bh_accounting).ratelimit++ <4096 )return ;__get_cpu_var (bh_accounting).ratelimit =0 ; -for_each_cpu (i) +for_each_online_cpu (i) tot +=per_cpu (bh_accounting, i).nr; buffer_heads_over_limit = (tot > max_buffer_heads); }@@ -3187,6 +3187,9 @@brelse (b->bhs[i]); b->bhs[i] =NULL ; } +get_cpu_var (bh_accounting).nr +=per_cpu (bh_accounting, cpu).nr ;
Quoted 8 lines
fs/buffer.c line 3193
Quoted 3 lines
fs/buffer.c +2
-0+per_cpu (bh_accounting, cpu).nr =0 ; +put_cpu_var (bh_accounting); }But now there is a window between the time the cpu is marked offline and the time its bh_accounting.nr is moved to another cpu. So
recalc_bh_statecould fail to setbuffer_heads_over_limitwhen it should.
Yes, there is a wee race there, but the consequences of a glitch or small inaccuracy in buffer_heads_over_limit will be transient and negligibe.
Quoted 8 lines · Andrew Morton
Quoted 7 lines · Andi Kleen
Quoted 5 lines · Andrew Morton
Quoted 3 lines · Ashok Raj
The problem was with ACPI just simply looking at the namespace doesnt
exactly give us an idea of how many processors are possible in this platform.
Quoted 7 lines
Quoted 4 lines
Quoted 2 lines
We need to fix this asap - the performance penalty for HOTPLUG_CPU=y, NR_CPUS=lots will be appreciable.
What is this performance penalty exactly?
All those
for_each_cpu()loops will hitNR_CPUScachelines instead ofhweight(cpu_possible_map)cachelines.
But are there any in real fast paths? iirc they are mostly in initialization, where it doesn't matter too much.
-Andi
Quoted 13 lines · Andi Kleen
Quoted 11 lines · Andrew Morton
Quoted 10 lines · Andi Kleen
Quoted 7 lines · Andrew Morton
Quoted 3 lines · Ashok Raj
The problem was with ACPI just simply looking at the namespace doesnt
exactly give us an idea of how many processors are possible in this platform.We need to fix this asap - the performance penalty for HOTPLUG_CPU=y, NR_CPUS=lots will be appreciable.
Quoted 8 lines
Quoted 4 lines
Quoted 1 line
What is this performance penalty exactly?
All those
for_each_cpu()loops will hitNR_CPUScachelines instead ofhweight(cpu_possible_map)cachelines.But are there any in real fast paths? iirc they are mostly in initialization, where it doesn't matter too much.
Could be so.
I just added one to percpu_counters though. And it'd be a pain to introduce a cpu notifier for each and every percpu_counter.
From: Andrew Morton <[email protected]>
Implement percpu_counter_sum(). This is a more accurate but slower version of percpu_counter_read_positive().
We need this for Alex's speedup-ext3_statfs patch. Otherwise it would be too inaccurate on large CPU counts.
---
include/linux/percpu_counter.h | 6 ++++++ mm/swap.c | 25 +++++++++++++++++++++++-- 2 files changed, 29 insertions(+), 2 deletions(-)
include/linux/percpu_counter.h renamed from include/linux/percpu_counter.h~percpu_counter_sum +6 -0
@@ -39,6 +39,7 @@ static inline void percpu_counter_destro }void percpu_counter_mod (struct percpu_counter *fbc,long amount); +long percpu_counter_sum (struct percpu_counter *fbc);static inline long percpu_counter_read (struct percpu_counter *fbc) {
@@ -92,6 +93,11 @@ static inline long percpu_counter_read_p return fbc->count; } +static inline long percpu_counter_sum (struct percpu_counter *fbc) +{ +return percpu_counter_read_positive (fbc); +} +#endif /* CONFIG_SMP */ static inline void percpu_counter_inc (struct percpu_counter *fbc)
mm/swap.c renamed from mm/swap.c~percpu_counter_sum +23 -2
@@ -491,13 +491,34 @@ void percpu_counter_mod(struct percpu_coif (count >=FBC_BATCH || count <= -FBC_BATCH ) {spin_lock (&fbc->lock); fbc->count += count; + *pcount =0 ;spin_unlock (&fbc->lock); - count =0 ; + }else { + *pcount = count; } - *pcount = count; put_cpu(); }EXPORT_SYMBOL (percpu_counter_mod); + +/* +* Add up all the per-cpu counts, return the result. This is a more accurate +* but much slower version of percpu_counter_read_positive() +*/ +long percpu_counter_sum (struct percpu_counter *fbc) +{ +long ret; +int cpu; + +spin_lock (&fbc->lock); + ret = fbc->count; +for_each_cpu (cpu) { +long *pcount =per_cpu_ptr (fbc->counters, cpu); + ret += *pcount; + } +spin_unlock (&fbc->lock); +return ret <0 ?0 : ret; +} +EXPORT_SYMBOL (percpu_counter_sum);#endif /*
_
Quoted 10 lines · Rik van Riel
Quoted 1 line · Linux Kernel Mailing List
[PATCH] percpu data: only iterate over possible CPUs
This
sched.cbit breaks Xen, and probably also other architectures
that have CPU hotplug. I suspect the reason is that during early bootup only the boot CPU is online, so nothing initialises the runqueues for CPUs that are brought up afterwards.I suspect we can get rid of this problem quite easily by moving runqueue initialisation to
init_idle()...
Please fix Xen to match include/linux/cpumask.h documentation that says :
/*
* The following particular system cpumasks and operations manage
* possible, present and online cpus. Each of them is a fixed size
* bitmap of size NR_CPUS.
*
* #ifdef CONFIG_HOTPLUG_CPU
* cpu_possible_map - all NR_CPUS bits set * cpu_present_map - has bit 'cpu' set iff cpu is populated * cpu_online_map - has bit 'cpu' set iff cpu available to scheduler * #else * cpu_possible_map - has bit 'cpu' set iff cpu is populated * cpu_present_map - copy of cpu_possible_map * cpu_online_map - has bit 'cpu' set iff cpu available to scheduler
* #endif
*/
Eric
Quoted 17 lines · Eric Dumazet
Quoted 11 lines · Rik van Riel
Quoted 1 line · Linux Kernel Mailing List
[PATCH] percpu data: only iterate over possible CPUs
This
sched.cbit breaks Xen, and probably also other architectures
that have CPU hotplug. I suspect the reason is that during early bootup only the boot CPU is online, so nothing initialises the runqueues for CPUs that are brought up afterwards.I suspect we can get rid of this problem quite easily by moving runqueue initialisation to
init_idle()...Please fix Xen to match
include/linux/cpumask.hdocumentation that says :
Quoted 7 lines
/*
* The following particular system cpumasks and operations manage
* possible, present and online cpus. Each of them is a fixed size
* bitmap of sizeNR_CPUS.
*
* #ifdefCONFIG_HOTPLUG_CPU
*cpu_possible_map- allNR_CPUSbits set
Note that this shouldn't have to be all NR_CPUs if the platform can determine all possible hotpluggable CPUs.
Signature · 2 lines
SUSE Labs, Novell Inc. Send instant messages to your online friends http://au.messenger.yahoo.com