Skip to contentSkip to conversation

net: unix socket code abuses csum_partial

PATCH In review Anton Blanchard 3 participants 8 messages Mar 4, 2014 – Mar 6, 2014

Subsystems (3)
lore
Share & tools
lore
#0 lore raw

PATCH 1/1 net: unix socket code abuses csum_partial

The unix socket code is using the result of csum_partial to hash into a lookup table:

	unix_hash_fold(csum_partial(sunaddr, len, 0));

csum_partial is only guaranteed to produce something that can be folded into a checksum, as its prototype explains:

* returns a 32-bit number suitable for feeding into itself
* or csum_tcpudp_magic

The 32bit value should not be used directly.

Depending on the alignment the ppc64 csum_partial will return different 32bit values that will fold into the same checksum.

This difference causes the following testcase (courtesy of Gustavo) to sometimes fail:

#include <sys/socket.h>
#include <stdio.h>

int main()

{
	int fd = socket(PF_LOCAL, SOCK_STREAM|SOCK_CLOEXEC, 0);

	int i = 1;
	setsockopt(fd, SOL_SOCKET, SO_REUSEADDR, &i, 4);

	struct sockaddr addr;
	addr.sa_family = AF_LOCAL;
	bind(fd, &addr, 2);

	listen(fd, 128);

	struct sockaddr_storage ss;
	socklen_t sslen = (socklen_t)sizeof(ss);
	getsockname(fd, (struct sockaddr*)&ss, &sslen);

	fd = socket(PF_LOCAL, SOCK_STREAM|SOCK_CLOEXEC, 0);

	if (connect(fd, (struct sockaddr*)&ss, sslen) == -1){
		perror(NULL);
		return 1;
	}
	printf("OK\n");
	return 0;
}

Use jhash instead of the current hand crafted csum_partial + xor based hash.

---

Would appreciate a sanity check here. Are there other users that expect a stable 32bit value out of csum_partial?

Is this performance critical enough that jhash is going to hurt? Another option would be to csum_fold the 32bit intermediate value and just hash based on the result.

net/unix/af_unix.c +5 -8
Index: b/net/unix/af_unix.c
===================================================================
@@ -117,6 +117,7 @@
 #include <net/checksum.h>
 #include <linux/security.h>
 #include <linux/freezer.h>
+#include <linux/jhash.h>
 
 struct hlist_head unix_socket_table[2 * UNIX_HASH_SIZE];
 EXPORT_SYMBOL_GPL(unix_socket_table);
@@ -161,13 +162,9 @@ static inline void unix_set_secdata(stru
  *    each socket state is protected by separate spin lock.
  */
 
-static inline unsigned int unix_hash_fold(__wsum n)
+static inline unsigned int unix_hash(void *data, unsigned int len)
 {
-	unsigned int hash = (__force unsigned int)n;
-
-	hash ^= hash>>16;
-	hash ^= hash>>8;
-	return hash&(UNIX_HASH_SIZE-1);
+	return jhash(data, len, 0) & (UNIX_HASH_SIZE - 1);
 }
 
 #define unix_peer(sk) (unix_sk(sk)->peer)
@@ -232,7 +229,7 @@ static int unix_mkname(struct sockaddr_u
 		return len;
 	}
 
-	*hashp = unix_hash_fold(csum_partial(sunaddr, len, 0));
+	*hashp = unix_hash(sunaddr, len);
 	return len;
 }
 
@@ -738,7 +735,7 @@ static int unix_autobind(struct socket *
 
 retry:
 	addr->len = sprintf(addr->name->sun_path+1, "%05x", ordernum) + 1 + sizeof(short);
-	addr->hash = unix_hash_fold(csum_partial(addr->name, addr->len, 0));
+	addr->hash = unix_hash(addr->name, addr->len);
 
 	spin_lock(&unix_table_lock);
 	ordernum = (ordernum+1)&0xFFFFF;
maintainer
#1 lore raw

From: Anton Blanchard <[email protected]>
Date: Tue, 4 Mar 2014 21:01:04 +1100

Quoted 11 lines

The unix socket code is using the result of csum_partial to hash into a lookup table:

	unix_hash_fold(csum_partial(sunaddr, len, 0));

csum_partial is only guaranteed to produce something that can be folded into a checksum, as its prototype explains:

* returns a 32-bit number suitable for feeding into itself
* or csum_tcpudp_magic

Quoted 7 lines

The 32bit value should not be used directly.

Depending on the alignment the ppc64 csum_partial will return different 32bit values that will fold into the same checksum.

This difference causes the following testcase (courtesy of Gustavo) to sometimes fail:

Alternatively you could just make unix_hash_fold() use csum_fold(), right?

static inline unsigned int unix_hash_fold(__wsum n)

{
	unsigned int hash = (__force unsigned int) csum_fold(n);

	hash ^= hash>>8;
	return hash&(UNIX_HASH_SIZE-1);
}
#2 lore raw
Quoted 10 lines · David Miller

Alternatively you could just make unix_hash_fold() use csum_fold(), right?

static inline unsigned int unix_hash_fold(__wsum n)

{
	unsigned int hash = (__force unsigned int) csum_fold(n);

	hash ^= hash>>8;
	return hash&(UNIX_HASH_SIZE-1);
}

Or simply use full_name_hash()

maintainer
#3 lore raw

From: Eric Dumazet <[email protected]>
Date: Tue, 04 Mar 2014 10:50:53 -0800

Quoted 9 lines · David Miller
Quoted 8 lines

Alternatively you could just make unix_hash_fold() use csum_fold(), right?

static inline unsigned int unix_hash_fold(__wsum n)

{
	unsigned int hash = (__force unsigned int) csum_fold(n);
Quoted 5 lines
Quoted 3 lines
	hash ^= hash>>8;
	return hash&(UNIX_HASH_SIZE-1);
}

Or simply use full_name_hash()

I would prefer not, because this would be a performance regression on platforms other than x86 and ARM, because only they implement the optimized load_unaligned_zeropad().

Other architectures would end up with a byte-by-byte hash computation.

#4 lore raw
Quoted 9 lines · David Miller

From: Eric Dumazet <[email protected]>

Quoted 1 line

Or simply use full_name_hash()

I would prefer not, because this would be a performance regression on platforms other than x86 and ARM, because only they implement the optimized load_unaligned_zeropad().

Other architectures would end up with a byte-by-byte hash computation.

Oh right, I missed this was fast only on x86 and ARM.

Sound like a project for arches maintainers then ;)

#5 lore raw
In reply to David Miller

Hi Dave,

Quoted 10 lines

Alternatively you could just make unix_hash_fold() use csum_fold(), right?

static inline unsigned int unix_hash_fold(__wsum n)

{
	unsigned int hash = (__force unsigned int) csum_fold(n);

	hash ^= hash>>8;
	return hash&(UNIX_HASH_SIZE-1);
}

Thanks, sounds good. Updated patch on the way.

Anton

#6 lore raw

PATCH 1/1 net: unix socket code abuses csum_partial

In reply to Anton Blanchard

The unix socket code is using the result of csum_partial to hash into a lookup table:

	unix_hash_fold(csum_partial(sunaddr, len, 0));

csum_partial is only guaranteed to produce something that can be folded into a checksum, as its prototype explains:

* returns a 32-bit number suitable for feeding into itself
* or csum_tcpudp_magic

The 32bit value should not be used directly.

Depending on the alignment, the ppc64 csum_partial will return different 32bit partial checksums that will fold into the same 16bit checksum.

This difference causes the following testcase (courtesy of Gustavo) to sometimes fail:

#include <sys/socket.h>
#include <stdio.h>

int main()

{
	int fd = socket(PF_LOCAL, SOCK_STREAM|SOCK_CLOEXEC, 0);

	int i = 1;
	setsockopt(fd, SOL_SOCKET, SO_REUSEADDR, &i, 4);

	struct sockaddr addr;
	addr.sa_family = AF_LOCAL;
	bind(fd, &addr, 2);

	listen(fd, 128);

	struct sockaddr_storage ss;
	socklen_t sslen = (socklen_t)sizeof(ss);
	getsockname(fd, (struct sockaddr*)&ss, &sslen);

	fd = socket(PF_LOCAL, SOCK_STREAM|SOCK_CLOEXEC, 0);

	if (connect(fd, (struct sockaddr*)&ss, sslen) == -1){
		perror(NULL);
		return 1;
	}
	printf("OK\n");
	return 0;
}

As suggested by davem, fix this by using csum_fold to fold the partial 32bit checksum into a 16bit checksum before using it.

---

net/unix/af_unix.c +1 -2
Index: b/net/unix/af_unix.c
===================================================================
@@ -163,9 +163,8 @@ static inline void unix_set_secdata(stru
 
 static inline unsigned int unix_hash_fold(__wsum n)
 {
-	unsigned int hash = (__force unsigned int)n;
+	unsigned int hash = (__force unsigned int)csum_fold(n);
 
-	hash ^= hash>>16;
 	hash ^= hash>>8;
 	return hash&(UNIX_HASH_SIZE-1);
 }
maintainer
#7 lore raw

From: Anton Blanchard <[email protected]>
Date: Wed, 5 Mar 2014 14:29:58 +1100

Quoted 5 lines

Index: b/net/unix/af_unix.c
===================================================================

net/unix/af_unix.c static inline void unix_set_secdata(stru · line 169

Quoted 9 lines
net/unix/af_unix.c +1 -2
@@ -163,9 +163,8 @@ static inline void unix_set_secdata(stru
 
 static inline unsigned int unix_hash_fold(__wsum n)
 {
-	unsigned int hash = (__force unsigned int)n;
+	unsigned int hash = (__force unsigned int)csum_fold(n);
 
-	hash ^= hash>>16;
 	hash ^= hash>>8;
 	return hash&(UNIX_HASH_SIZE-1);

Looks great, I'll apply this, thanks Anton!