Skip to contentSkip to conversation

flex_array: Change behaviour on zero size allocations

PATCH Superseded Steffen Klassert 3 participants 7 messages Jan 31, 2011 – Feb 2, 2011 Library code

v1 of 2 Superseded Latest is v2 →

lore
Share & tools
lore
#0 lore raw

PATCH 1/1 flex_array: Change behaviour on zero size allocations

flex_array_alloc allocates the basic struct flex_array regardless whether total_nr_elements or element_size is zero. Then flex_array_prealloc fails with -ENOSPC if total_nr_elements is zero or it hits a division by zero if element_size is zero.

This patch changes the behaviour on zero size allocations to the same as kmalloc, so zero size allocations are leagal now. This fixes a regression on selinux policy loading.

---
 lib/flex_array.c |   25 +++++++++++++++++++++----
 1 files changed, 21 insertions(+), 4 deletions(-)
lib/flex_array.c +21 -4
index c0ea40b..8eb437b 100644
@@ -88,8 +88,11 @@ struct flex_array *flex_array_alloc(int element_size, unsigned int total,
 					gfp_t flags)
 {
 	struct flex_array *ret;
-	int max_size = FLEX_ARRAY_NR_BASE_PTRS *
-				FLEX_ARRAY_ELEMENTS_PER_PART(element_size);
+	int max_size = 0;
+
+	if (element_size)
+		max_size = FLEX_ARRAY_NR_BASE_PTRS *
+			   FLEX_ARRAY_ELEMENTS_PER_PART(element_size);
 
 	/* max_size will end up 0 if element_size > PAGE_SIZE */
 	if (total > max_size)
@@ -183,15 +186,18 @@ __fa_get_part(struct flex_array *fa, int part_nr, gfp_t flags)
 int flex_array_put(struct flex_array *fa, unsigned int element_nr, void *src,
 			gfp_t flags)
 {
-	int part_nr = fa_element_to_part_nr(fa, element_nr);
+	int part_nr;
 	struct flex_array_part *part;
 	void *dst;
 
+	if (!fa->element_size)
+		return 0;
 	if (element_nr >= fa->total_nr_elements)
 		return -ENOSPC;
 	if (elements_fit_in_base(fa))
 		part = (struct flex_array_part *)&fa->parts[0];
 	else {
+		part_nr = fa_element_to_part_nr(fa, element_nr);
 		part = __fa_get_part(fa, part_nr, flags);
 		if (!part)
 			return -ENOMEM;
@@ -211,15 +217,18 @@ EXPORT_SYMBOL(flex_array_put);
  */
 int flex_array_clear(struct flex_array *fa, unsigned int element_nr)
 {
-	int part_nr = fa_element_to_part_nr(fa, element_nr);
+	int part_nr;
 	struct flex_array_part *part;
 	void *dst;
 
+	if (!fa->element_size)
+		return 0;
 	if (element_nr >= fa->total_nr_elements)
 		return -ENOSPC;
 	if (elements_fit_in_base(fa))
 		part = (struct flex_array_part *)&fa->parts[0];
 	else {
+		part_nr = fa_element_to_part_nr(fa, element_nr);
 		part = fa->parts[part_nr];
 		if (!part)
 			return -EINVAL;
@@ -252,8 +261,12 @@ int flex_array_prealloc(struct flex_array *fa, unsigned int start,
 	int part_nr;
 	struct flex_array_part *part;
 
+	if (!fa->total_nr_elements)
+		return 0;
 	if (start >= fa->total_nr_elements || end >= fa->total_nr_elements)
 		return -ENOSPC;
+	if (!fa->element_size)
+		return 0;
 	if (elements_fit_in_base(fa))
 		return 0;
 	start_part = fa_element_to_part_nr(fa, start);
@@ -284,6 +297,8 @@ void *flex_array_get(struct flex_array *fa, unsigned int element_nr)
 	int part_nr = fa_element_to_part_nr(fa, element_nr);
 	struct flex_array_part *part;
 
+	if (!fa->total_nr_elements || !fa->element_size)
+		return NULL;
 	if (element_nr >= fa->total_nr_elements)
 		return NULL;
 	if (elements_fit_in_base(fa))
@@ -343,6 +358,8 @@ int flex_array_shrink(struct flex_array *fa)
 	int part_nr;
 	int ret = 0;
 
+	if (!fa->total_nr_elements || !fa->element_size)
+		return 0;
 	if (elements_fit_in_base(fa))
 		return ret;
 	for (part_nr = 0; part_nr < FLEX_ARRAY_NR_BASE_PTRS; part_nr++) {
Signature · 1 line
1.7.0.4
#1 lore raw

lib/flex_array.c __fa_get_part(struct flex_array *fa, int part_nr, gfp_t flags) · line 196

Quoted 12 lines · Steffen Klassert

int flex_array_put(struct flex_array *fa, unsigned int element_nr, void *src,
gfp_t flags)
{

lib/flex_array.c +3 -1
-       int part_nr = fa_element_to_part_nr(fa, element_nr);
+       int part_nr;
        struct flex_array_part *part;
        void *dst;
 
+       if (!fa->element_size)
+               return 0;
        if (element_nr >= fa->total_nr_elements)
                return -ENOSPC; 

I think this still has some of the issues of the earlier patch. The zero-size check needs to be moved after the ->total_nr_elements check. Otherwise, this won't produce any errors:

	fa = flex_array_alloc(0, 100, GFP_KERNEL);
	flex_array_put(fa, 1001, ptr, GFP_KERNEL);

lib/flex_array.c void *flex_array_get(struct flex_array *fa, unsigned int element_nr) · line 304

Quoted 9 lines
lib/flex_array.c +2 -0
@@ -284,6 +297,8 @@ void *flex_array_get(struct flex_array *fa, unsigned int element_nr)
        int part_nr = fa_element_to_part_nr(fa, element_nr);
        struct flex_array_part *part;
 
+       if (!fa->total_nr_elements || !fa->element_size)
+               return NULL;
        if (element_nr >= fa->total_nr_elements)
                return NULL;
        if (elements_fit_in_base(fa))

Do you really need to check fa->total_nr_elements both for zero and against element_nr? Seems a but superfluous to me.

-- Dave

#2 lore raw
Quoted 12 lines · Dave Hansen

I think this still has some of the issues of the earlier patch. The zero-size check needs to be moved after the ->total_nr_elements check. Otherwise, this won't produce any errors:

	fa = flex_array_alloc(0, 100, GFP_KERNEL);
	flex_array_put(fa, 1001, ptr, GFP_KERNEL);
Quoted 4 lines
lib/flex_array.c +0 -0
@@ -284,6 +297,8 @@ void *flex_array_get(struct flex_array *fa, unsigned int element_nr)
        int part_nr = fa_element_to_part_nr(fa, element_nr);
        struct flex_array_part *part;
 
Quoted 9 lines

lib/flex_array.c void *flex_array_get(struct flex_array *fa, unsigned int element_nr) · line 304

Quoted 5 lines
lib/flex_array.c +2 -0
+       if (!fa->total_nr_elements || !fa->element_size)
+               return NULL;
        if (element_nr >= fa->total_nr_elements)
                return NULL;
        if (elements_fit_in_base(fa))

Do you really need to check fa->total_nr_elements both for zero and against element_nr? Seems a but superfluous to me.

Both objections are correct, I'll send an updated patch.

Steffen

#3 lore raw
Quoted 3 lines · Steffen Klassert

Both objections are correct, I'll send an updated patch.

I think we need to fix selinux too to get rid of the policy loading problem. In security/selinux/ss/policydb.c are several pieces of code like this one:

p->type_val_to_struct_array = flex_array_alloc(sizeof(struct type_datum *),

                                               p->p_types.nprim,              
                                               GFP_KERNEL | __GFP_ZERO);
if (!p->type_val_to_struct_array)      
	goto out;

rc = flex_array_prealloc(p->type_val_to_struct_array, 0,

                         p->p_types.nprim - 1, GFP_KERNEL | __GFP_ZERO);
if (rc)
	goto out;

If p->p_types.nprim is zero, we allocare with total_nr_elements equal to zerro and then we try to prealloc with p->p_types.nprim - 1. flex_array_prealloc interprets this as an unsigned int and fails, because this is bigger than total_nr_elements, which is correct I think.

Thoughts?

Steffen

#4 lore raw
Quoted 5 lines · Steffen Klassert

rc = flex_array_prealloc(p->type_val_to_struct_array, 0,

                         p->p_types.nprim - 1, GFP_KERNEL | __GFP_ZERO);
if (rc)
        goto out;
Quoted 7 lines

If p->p_types.nprim is zero, we allocare with total_nr_elements equal to zerro and then we try to prealloc with p->p_types.nprim - 1. flex_array_prealloc interprets this as an unsigned int and fails, because this is bigger than total_nr_elements, which is correct I think.

Thoughts?

The most we ever hold in a flex_array is ~2 million entries. So we have plenty of room to use a normal int if you want.

On the other hand, there's only one user of flex_array_prealloc(), and making the "end" argument inclusive doesn't seem to be what that user wants. We might want to either make flex_array_prealloc() take start and length, or instead make "end" be exclusive of the "end" index.

I thought that flex_array_prealloc would say, effectively: "all put()'s would work up until 'end'". But, looking at it now, that's probably not how people will use it.

-- Dave

#5 lore raw
Quoted 17 lines · Dave Hansen
Quoted 5 lines · Steffen Klassert

rc = flex_array_prealloc(p->type_val_to_struct_array, 0,

                         p->p_types.nprim - 1, GFP_KERNEL | __GFP_ZERO);
if (rc)
        goto out;
Quoted 7 lines

If p->p_types.nprim is zero, we allocare with total_nr_elements equal to zerro and then we try to prealloc with p->p_types.nprim - 1. flex_array_prealloc interprets this as an unsigned int and fails, because this is bigger than total_nr_elements, which is correct I think.

Thoughts?

The most we ever hold in a flex_array is ~2 million entries. So we have plenty of room to use a normal int if you want.

Quoted 8 lines

On the other hand, there's only one user of flex_array_prealloc(), and making the "end" argument inclusive doesn't seem to be what that user wants. We might want to either make flex_array_prealloc() take start and length, or instead make "end" be exclusive of the "end" index.

I thought that flex_array_prealloc would say, effectively: "all put()'s would work up until 'end'". But, looking at it now, that's probably not how people will use it.

I'm fine with any solution. It's obviously broken for SELinux to be passing -1 even if the library supported it. I guess I don't really have strong feelings on how to fix it.

1) make end exclusive
2) change 'end' to 'len'
3) just make selinux not prealloc() when the #elements == 0

All seem perfectly reasonable to me, but I'd probably do them in that order.

-Eric

#6 lore raw
Quoted 5 lines · Eric Paris

I'm fine with any solution. It's obviously broken for SELinux to be passing -1 even if the library supported it. I guess I don't really have strong feelings on how to fix it.

Quoted 7 lines

1) make end exclusive
2) change 'end' to 'len'
3) just make selinux not prealloc() when the #elements == 0

All seem perfectly reasonable to me, but I'd probably do them in that order.

I think I would prefer option 2. Passing a size or a length to a memory allocator is quite common and we would not need to care for bugs where 'end' is smaller than 'start'.

So I'd do it like that, if noone has strong feelings for another option.

Steffen