Skip to contentSkip to conversation

numactl: fix libnuma on big-endian 64-bit systems

PATCH Superseded Arnd Bergmann 2 participants 5 messages Dec 4, 2008 – Dec 5, 2008

lore
Share & tools
lore
#0 lore raw

PATCH 1/1 numactl: fix libnuma on big-endian 64-bit systems

The read-mask function assumes that it is running in 32-bit mode, by addressing the bitmask as a series of int values, instead of longs. This is broken as can easily be reproduced by running numademo on a bit-endian 64-bit system.

Changing the addressing to use 'long' values fixes the problem.

---

Note: the set_nodemask_size() function is broken as well, it seems to always set the nodemask size to "17" with the s2nbits implementation. The fallback path in there looks correct.

libnuma.c +5 -5
@@ -392,9 +372,9 @@ read_mask(char *s, struct bitmask *bmp)
 {
 	char *end = s;
 	char *prevend;
-	unsigned long *start = bmp->maskp;
-	unsigned long *p = start;
-	unsigned long *q;
+	unsigned int *start = (unsigned int *)bmp->maskp;
+	unsigned int *p = start;
+	unsigned int *q;
 	unsigned int i;
 	unsigned int n = 0;
 
@@ -431,14 +411,14 @@
 	}
 
 	/* Poor mans fls() */
-	for(i = sizeof(long) * 8 - 1; i >= 0; i--)
+	for(i = 31; i >= 0; i--)
 		if (test_bit(i, start + n))
 			break;
 
 	/*
 	 * Return the last bit set
 	 */
-	return ((sizeof(unsigned long)*8) * n) + i;
+	return ((sizeof(unsigned int)*8) * n) + i;
 }
 
 /*
#1 lore raw
Quoted 6 lines · Arnd Bergmann

The read-mask function assumes that it is running in 32-bit mode, by addressing the bitmask as a series of int values, instead of longs. This is broken as can easily be reproduced by running numademo on a bit-endian 64-bit system.

Changing the addressing to use 'long' values fixes the problem.

Hi, Arnd:

Not sure what you mean here. If the patch below is a proposed fix [I don't see a 'Signed-off-by:", but maybe not needed for libnuma patches?], the description above doesn't match the code. Looks like you're changing the addressing FROM 'long' values to use 'int' values so that the size is compatible between 32- and 64-bits. Or is that a reverse patch/diff below?

Lee

Quoted 40 lines

---

Note: the set_nodemask_size() function is broken as well, it seems to always set the nodemask size to "17" with the s2nbits implementation. The fallback path in there looks correct.

libnuma.c +5 -5
@@ -392,9 +372,9 @@ read_mask(char *s, struct bitmask *bmp)
 {
 	char *end = s;
 	char *prevend;
-	unsigned long *start = bmp->maskp;
-	unsigned long *p = start;
-	unsigned long *q;
+	unsigned int *start = (unsigned int *)bmp->maskp;
+	unsigned int *p = start;
+	unsigned int *q;
 	unsigned int i;
 	unsigned int n = 0;
 
@@ -431,14 +411,14 @@
 	}
 
 	/* Poor mans fls() */
-	for(i = sizeof(long) * 8 - 1; i >= 0; i--)
+	for(i = 31; i >= 0; i--)
 		if (test_bit(i, start + n))
 			break;
 
 	/*
 	 * Return the last bit set
 	 */
-	return ((sizeof(unsigned long)*8) * n) + i;
+	return ((sizeof(unsigned int)*8) * n) + i;
 }
 
 /*
#2 lore raw
Quoted 8 lines · Lee Schermerhorn
Quoted 6 lines · Arnd Bergmann

The read-mask function assumes that it is running in 32-bit mode, by addressing the bitmask as a series of int values, instead of longs. This is broken as can easily be reproduced by running numademo on a bit-endian 64-bit system.

Changing the addressing to use 'long' values fixes the problem.

Quoted 8 lines

Hi, Arnd:

Not sure what you mean here. If the patch below is a proposed fix [I don't see a 'Signed-off-by:", but maybe not needed for libnuma patches?], the description above doesn't match the code. Looks like you're changing the addressing FROM 'long' values to use 'int' values so that the size is compatible between 32- and 64-bits. Or is that a reverse patch/diff below?

Sorry about that, I was in a hurry when sending this one out and attached the wrong file, the reverse patch is needed indeed. I'll resend with a proper Signed-off-by.

	Arnd <><
#3 lore raw

PATCH v2 1/1 numactl: fix libnuma on big-endian 64-bit systems

The read-mask function assumes that it is running in 32-bit mode, by addressing the bitmask as a series of int values, instead of longs. This is broken as can easily be reproduced by running numademo on a bit-endian 64-bit system.

Changing the addressing to use 'long' values fixes the problem.

---
 libnuma.c |   10 +++++-----
 1 files changed, 5 insertions(+), 5 deletions(-)
libnuma.c +5 -5
index 4d26093..9a9fbbe 100755
@@ -376,9 +376,9 @@ read_mask(char *s, struct bitmask *bmp)
 {
 	char *end = s;
 	char *prevend;
-	unsigned int *start = (unsigned int *)bmp->maskp;
-	unsigned int *p = start;
-	unsigned int *q;
+	unsigned long *start = bmp->maskp;
+	unsigned long *p = start;
+	unsigned long *q;
 	unsigned int i;
 	unsigned int n = 0;
 
@@ -415,14 +415,14 @@ read_mask(char *s, struct bitmask *bmp)
 	}
 
 	/* Poor mans fls() */
-	for(i = 31; i >= 0; i--)
+	for(i = sizeof(long) * 8 - 1; i >= 0; i--)
 		if (test_bit(i, start + n))
 			break;
 
 	/*
 	 * Return the last bit set
 	 */
-	return ((sizeof(unsigned int)*8) * n) + i;
+	return ((sizeof(unsigned long)*8) * n) + i;
 }
 
 /*
#4 lore raw
Quoted 6 lines · Arnd Bergmann

The read-mask function assumes that it is running in 32-bit mode, by addressing the bitmask as a series of int values, instead of longs. This is broken as can easily be reproduced by running numademo on a bit-endian 64-bit system.

Changing the addressing to use 'long' values fixes the problem.

Unfortunately, this is still wrong, as it tries recreating a kernel data structure that is represented as a series of 'int' values, just in a different order.

What we really need is the reverse of bitmap_scnprintf from linux/lib/bitmap.c. I don't have access to a little-endian NUMA machine with more than 64 CPUs, so I really don't want to send another embarrassingly wrong patch for this.

Can anyone else try to come up with a version that handles endianess correctly and still works on x86-64?

	Arnd <><