net: low latency sockets follow ups
Subsystems (11)
v3 cover net: low latency sockets follow ups
David,
Here are three clean up patches, plus one that adds a socket option for LLS.
Patch 1 converts low latency sockets to sched_clock.
Patch 2 removes the config menu for NET_LL_RX_POLL and defaults to y. Patch 3 converts sysctl_net_ll_poll into an unsigned int
Patch 4 adds an SO_LL socket option to allow per-socket control of busy polling.
I will reply to this thread with a patch to sockperf that enables the socket option. (unchanged from v2)
Again, thanks to everyone for their comments.
-Eliezer
Change log:
v3
- Suggested by David Miller and Stephen Hemminger:
added a patch to covert from get_cycles() to sched_clock(), remove dependency on X86_TSC.
- Suggested by Eric Dumazet:
un-exported sysctl_net_ll_poll since for now it's not needed in modules.
v2
- added a patch to convert sysctl_net_ll_poll into an unsigned int.
- suggested by Eric Dimazet: treat sk_ll_usec as a u_int rather than a u_long.
- suggested by Ben Huchings: allow unprivileged user to decrease SO_LL value, correct return value when operation is not allowed.
------------------------------------------------------------------------------
This SF.net email is sponsored by Windows:
Build for Windows Store.
http://p.sf.net/sfu/windows-dev2dev
_______________________________________________
E1000-devel mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/e1000-devel
To learn more about Intel® Ethernet, visit http://communities.intel.com/community/wired
PATCH v3 1/4 net: convert low latency sockets to sched_clock()
Use sched_clock() instead of get_cycles().
We can use sched_clock() because we don't care much about accuracy. Remove the dependency on X86_TSC
---
include/net/ll_poll.h | 23 +++++++++++------------ net/Kconfig | 1 - 2 files changed, 11 insertions(+), 13 deletions(-)
include/net/ll_poll.h +11 -12
@@ -21,10 +21,6 @@* e1000-devel Mailing List <[email protected]> */ -/* -* For now this depends on CONFIG_X86_TSC -*/ -#ifndef _LINUX_NET_LL_POLL_H#define _LINUX_NET_LL_POLL_H
@@ -41,11 +37,14 @@ extern unsigned long sysctl_net_ll_poll __read_mostly;#define LL_FLUSH_BUSY -2/* we don't mind a ~2.5% imprecision */ -#define TSC_MHZ (tsc_khz >> 10) +#define USECS_TO_NS (us) (us << 10) -static inline cycles_t ll_end_time (void ) +/* we can use sched_clock() because we don't care much about precision +* we only care that the average is bounded +*/ +static inline u64 ll_end_time (void ) { -return TSC_MHZ *ACCESS_ONCE (sysctl_net_ll_poll) +get_cycles (); +return sched_clock () +USECS_TO_NS (ACCESS_ONCE (sysctl_net_ll_poll)); }static inline bool sk_valid_ll (struct sock *sk)
@@ -54,16 +53,16 @@ static inline bool sk_valid_ll(struct sock *sk) !need_resched () && !signal_pending (current); } -static inline bool can_poll_ll (cycles_t end_time) +static inline bool can_poll_ll (u64 end_time) { -return !time_after ((unsigned long )get_cycles (), +return !time_after ((unsigned long )sched_clock (), (unsigned long )end_time); }static inline bool sk_poll_ll (struct sock *sk,int nonblock) { -cycles_t end_time =ll_end_time ();const struct net_device_ops *ops; +u64 end_time =ll_end_time ();struct napi_struct *napi;int rc = false;
@@ -116,7 +115,7 @@ static inline void sk_mark_ll(struct sock *sk, struct sk_buff *skb)#else /* CONFIG_NET_LL_RX_POLL */ -static inline cycles_t ll_end_time (void ) +static inline u64 ll_end_time (void ) {return 0 ; }
@@ -139,7 +138,7 @@ static inline void sk_mark_ll(struct sock *sk, struct sk_buff *skb) { } -static inline bool can_poll_ll (cycles_t end_time) +static inline bool can_poll_ll (u64 end_time) {return false; }
net/Kconfig +0 -1
@@ -245,7 +245,6 @@ config NETPRIO_CGROUP config NET_LL_RX_POLL bool "Low Latency Receive Poll" - depends on X86_TSC default n ---help--- Support Low Latency Receive Queue Poll.
------------------------------------------------------------------------------
This SF.net email is sponsored by Windows:
Build for Windows Store.
http://p.sf.net/sfu/windows-dev2dev
_______________________________________________
E1000-devel mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/e1000-devel
To learn more about Intel® Ethernet, visit http://communities.intel.com/community/wired
PATCH v3 2/4 net: remove NET_LL_RX_POLL config menue
In reply to Eliezer TamirRemove NET_LL_RX_POLL from the config menu. Change default to y.
Busy polling still needs to be enabled at run time.
---
net/Kconfig | 11 ++--------- 1 files changed, 2 insertions(+), 9 deletions(-)
net/Kconfig +2 -9
@@ -244,15 +244,8 @@ config NETPRIO_CGROUP a per-interface basis config NET_LL_RX_POLL - bool "Low Latency Receive Poll" - default n - ---help--- - Support Low Latency Receive Queue Poll. - (For network card drivers which support this option.) - When waiting for data in read or poll call directly into the the device driver - to flush packets which may be pending on the device queues into the stack. - - If unsure, say N. + boolean + default y config BQL boolean
------------------------------------------------------------------------------
This SF.net email is sponsored by Windows:
Build for Windows Store.
http://p.sf.net/sfu/windows-dev2dev
_______________________________________________
E1000-devel mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/e1000-devel
To learn more about Intel® Ethernet, visit http://communities.intel.com/community/wired
PATCH v3 3/4 net: change sysctl_net_ll_poll into an unsigned int
In reply to Eliezer TamirThere is no reason for sysctl_net_ll_poll to be an unsigned long. Change it into an unsigned int.
Fix the proc handler.
---
include/net/ll_poll.h | 2 +- net/core/sysctl_net_core.c | 4 ++-- net/socket.c | 2 +- 3 files changed, 4 insertions(+), 4 deletions(-)
include/net/ll_poll.h +1 -1
@@ -30,7 +30,7 @@#ifdef CONFIG_NET_LL_RX_POLL struct napi_struct ; -extern unsigned long sysctl_net_ll_poll__read_mostly ; +extern unsigned int sysctl_net_ll_poll__read_mostly ;/* return values from ndo_ll_poll */ #define LL_FLUSH_FAILED -1
net/core/sysctl_net_core.c +2 -2
@@ -289,9 +289,9 @@ static struct ctl_table net_core_table[] = { { .procname = "low_latency_poll", .data = &sysctl_net_ll_poll, - .maxlen = sizeof(unsigned long), + .maxlen = sizeof(unsigned int), .mode = 0644, - .proc_handler = proc_doulongvec_minmax + .proc_handler = proc_dointvec }, #endif #endif /* CONFIG_NET */
net/socket.c +1 -1
@@ -107,7 +107,7 @@#include <net/ll_poll.h> #ifdef CONFIG_NET_LL_RX_POLL -unsigned long sysctl_net_ll_poll__read_mostly ; +unsigned int sysctl_net_ll_poll__read_mostly ;EXPORT_SYMBOL_GPL (sysctl_net_ll_poll);#endif
------------------------------------------------------------------------------
This SF.net email is sponsored by Windows:
Build for Windows Store.
http://p.sf.net/sfu/windows-dev2dev
_______________________________________________
E1000-devel mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/e1000-devel
To learn more about Intel® Ethernet, visit http://communities.intel.com/community/wired
Re: [PATCH v3 net-next 3/4] net: change sysctl_net_ll_poll into an unsigned int
Quoted 17 lines · Eliezer Tamir
There is no reason for
sysctl_net_ll_pollto be an unsigned long. Change it into an unsigned int.
Fix the proc handler.Signed-off-by Eliezer Tamir <[email protected]>---
include/net/ll_poll.h | 2 +- net/core/sysctl_net_core.c | 4 ++-- net/socket.c | 2 +- 3 files changed, 4 insertions(+), 4 deletions(-)include/net/ll_poll.h +0
-0
include/net/ll_poll.h line 34
Quoted 6 lines
include/net/ll_poll.h +1
-1@@ -30,7 +30,7 @@#ifdef CONFIG_NET_LL_RX_POLL struct napi_struct ; -extern unsigned long sysctl_net_ll_poll__read_mostly ; +extern unsigned int sysctl_net_ll_poll__read_mostly ;
Oh well, you re-introduce the overflow
hint : you defined
#define USECS_TO_NS(us) (us << 10)
------------------------------------------------------------------------------
This SF.net email is sponsored by Windows:
Build for Windows Store.
http://p.sf.net/sfu/windows-dev2dev
_______________________________________________
E1000-devel mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/e1000-devel
To learn more about Intel® Ethernet, visit http://communities.intel.com/community/wired
Re: [PATCH v3 net-next 3/4] net: change sysctl_net_ll_poll into an unsigned int
Quoted 9 lines · Eric Dumazet
Quoted 2 lines · Eliezer Tamir
+extern unsigned int
sysctl_net_ll_poll__read_mostly;Oh well, you re-introduce the overflow
hint : you defined
#define
USECS_TO_NS(us)(us << 10)
ouch!
(thanks)
------------------------------------------------------------------------------
This SF.net email is sponsored by Windows:
Build for Windows Store.
http://p.sf.net/sfu/windows-dev2dev
_______________________________________________
E1000-devel mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/e1000-devel
To learn more about Intel® Ethernet, visit http://communities.intel.com/community/wired
PATCH v3 4/4 net: add socket option for low latency polling
In reply to Eliezer Tamiradds a socket option for low latency polling.
This allows overriding the global sysctl value with a per-socket one. Unexport sysctl_net_ll_poll since for now it's not needed in modules.
---
arch/alpha/include/uapi/asm/socket.h | 2 ++ arch/avr32/include/uapi/asm/socket.h | 2 ++ arch/cris/include/uapi/asm/socket.h | 2 ++ arch/frv/include/uapi/asm/socket.h | 2 ++ arch/h8300/include/uapi/asm/socket.h | 2 ++ arch/ia64/include/uapi/asm/socket.h | 2 ++ arch/m32r/include/uapi/asm/socket.h | 2 ++ arch/mips/include/uapi/asm/socket.h | 2 ++ arch/mn10300/include/uapi/asm/socket.h | 2 ++ arch/parisc/include/uapi/asm/socket.h | 2 ++ arch/powerpc/include/uapi/asm/socket.h | 2 ++ arch/s390/include/uapi/asm/socket.h | 2 ++ arch/sparc/include/uapi/asm/socket.h | 2 ++ arch/xtensa/include/uapi/asm/socket.h | 2 ++ include/net/ll_poll.h | 10 +++++----- include/net/sock.h | 2 ++ include/uapi/asm-generic/socket.h | 2 ++ net/core/sock.c | 20 ++++++++++++++++++++ net/socket.c | 1 - 19 files changed, 57 insertions(+), 6 deletions(-)
arch/alpha/include/uapi/asm/socket.h +2 -0
@@ -81,4 +81,6 @@#define SO_SELECT_ERR_QUEUE 45 +#define SO_LL 46 +#endif /* _UAPI_ASM_SOCKET_H */
arch/avr32/include/uapi/asm/socket.h +2 -0
@@ -74,4 +74,6 @@#define SO_SELECT_ERR_QUEUE 45 +#define SO_LL 46 +#endif /* __ASM_AVR32_SOCKET_H */
arch/cris/include/uapi/asm/socket.h +2 -0
@@ -76,6 +76,8 @@#define SO_SELECT_ERR_QUEUE 45 +#define SO_LL 46 +#endif /* _ASM_SOCKET_H */
arch/frv/include/uapi/asm/socket.h +2 -0
@@ -74,5 +74,7 @@#define SO_SELECT_ERR_QUEUE 45 +#define SO_LL 46 +#endif /* _ASM_SOCKET_H */
arch/h8300/include/uapi/asm/socket.h +2 -0
@@ -74,4 +74,6 @@#define SO_SELECT_ERR_QUEUE 45 +#define SO_LL 46 +#endif /* _ASM_SOCKET_H */
arch/ia64/include/uapi/asm/socket.h +2 -0
@@ -83,4 +83,6 @@#define SO_SELECT_ERR_QUEUE 45 +#define SO_LL 46 +#endif /* _ASM_IA64_SOCKET_H */
arch/m32r/include/uapi/asm/socket.h +2 -0
@@ -74,4 +74,6 @@#define SO_SELECT_ERR_QUEUE 45 +#define SO_LL 46 +#endif /* _ASM_M32R_SOCKET_H */
arch/mips/include/uapi/asm/socket.h +2 -0
@@ -92,4 +92,6 @@#define SO_SELECT_ERR_QUEUE 45 +#define SO_LL 46 +#endif /* _UAPI_ASM_SOCKET_H */
arch/mn10300/include/uapi/asm/socket.h +2 -0
@@ -74,4 +74,6 @@#define SO_SELECT_ERR_QUEUE 45 +#define SO_LL 46 +#endif /* _ASM_SOCKET_H */
arch/parisc/include/uapi/asm/socket.h +2 -0
@@ -73,6 +73,8 @@#define SO_SELECT_ERR_QUEUE 0x4026 +#define SO_LL 0x4027 +/* O_NONBLOCK clashes with the bits used for socket types. Therefore we * have to define SOCK_NONBLOCK to a different value here. */
arch/powerpc/include/uapi/asm/socket.h +2 -0
@@ -81,4 +81,6 @@#define SO_SELECT_ERR_QUEUE 45 +#define SO_LL 46 +#endif /* _ASM_POWERPC_SOCKET_H */
arch/s390/include/uapi/asm/socket.h +2 -0
@@ -80,4 +80,6 @@#define SO_SELECT_ERR_QUEUE 45 +#define SO_LL 46 +#endif /* _ASM_SOCKET_H */
arch/sparc/include/uapi/asm/socket.h +2 -0
@@ -70,6 +70,8 @@#define SO_SELECT_ERR_QUEUE 0x0029 +#define SO_LL 0x0030 +/* Security levels - as per NRL IPv6 - don't actually do anything */ #define SO_SECURITY_AUTHENTICATION 0x5001#define SO_SECURITY_ENCRYPTION_TRANSPORT 0x5002
arch/xtensa/include/uapi/asm/socket.h +2 -0
@@ -85,4 +85,6 @@#define SO_SELECT_ERR_QUEUE 45 +#define SO_LL 46 +#endif /* _XTENSA_SOCKET_H */
include/net/ll_poll.h +5 -5
@@ -42,14 +42,14 @@ extern unsigned int sysctl_net_ll_poll __read_mostly;/* we can use sched_clock() because we don't care much about precision * we only care that the average is bounded */ -static inline u64 ll_end_time (void ) +static inline u64 ll_end_time (struct sock *sk) { -return sched_clock () +USECS_TO_NS (ACCESS_ONCE (sysctl_net_ll_poll)); +return sched_clock () +USECS_TO_NS (ACCESS_ONCE (sk->sk_ll_usec)); }static inline bool sk_valid_ll (struct sock *sk) { -return sysctl_net_ll_poll && sk->sk_napi_id && +return sk->sk_ll_usec && sk->sk_napi_id && !need_resched () && !signal_pending (current); }
@@ -62,7 +62,7 @@ static inline bool can_poll_ll(u64 end_time)static inline bool sk_poll_ll (struct sock *sk,int nonblock) {const struct net_device_ops *ops; -u64 end_time =ll_end_time (); +u64 end_time =ll_end_time (sk);struct napi_struct *napi;int rc = false;
@@ -115,7 +115,7 @@ static inline void sk_mark_ll(struct sock *sk, struct sk_buff *skb)#else /* CONFIG_NET_LL_RX_POLL */ -static inline u64 ll_end_time (void ) +static inline u64 ll_end_time (struct sock *sk) {return 0 ; }
include/net/sock.h +2 -0
@@ -230,6 +230,7 @@ struct cg_proto;* @sk_wmem_queued: persistent queue size * @sk_forward_alloc: space allocated forward * @sk_napi_id: id of the last napi context to receive data for sk +* @sk_ll_usec: usecs to busypoll when there is no data * @sk_allocation: allocation mode * @sk_sndbuf: size of send buffer in bytes * @sk_flags: %SO_LINGER (l_onoff), %SO_BROADCAST, %SO_KEEPALIVE,
@@ -328,6 +329,7 @@ struct sock {#endif #ifdef CONFIG_NET_LL_RX_POLL unsigned int sk_napi_id; +unsigned int sk_ll_usec;#endif atomic_t sk_drops;int sk_rcvbuf;
include/uapi/asm-generic/socket.h +2 -0
@@ -76,4 +76,6 @@#define SO_SELECT_ERR_QUEUE 45 +#define SO_LL 46 +#endif /* __ASM_GENERIC_SOCKET_H */
net/core/sock.c +20 -0
@@ -913,6 +913,19 @@ set_rcvbuf:sock_valbool_flag (sk,SOCK_SELECT_ERR_QUEUE , valbool);break ; +#ifdef CONFIG_NET_LL_RX_POLL +case SO_LL : +/* allow unprivileged users to decrease the value */ +if ((val > sk->sk_ll_usec) && !capable (CAP_NET_ADMIN )) + ret = -EPERM ; +else { +if (val <0 ) + ret = -EINVAL ; +else + sk->sk_ll_usec = val; + } +break ; +#endif default : ret = -ENOPROTOOPT ;break ;
@@ -1170,6 +1183,12 @@ int sock_getsockopt(struct socket *sock, int level, int optname, v.val =sock_flag (sk,SOCK_SELECT_ERR_QUEUE );break ; +#ifdef CONFIG_NET_LL_RX_POLL +case SO_LL : + v.val = sk->sk_ll_usec; +break ; +#endif +default :return -ENOPROTOOPT ; }
@@ -2288,6 +2307,7 @@ void sock_init_data(struct socket *sock, struct sock *sk)#ifdef CONFIG_NET_LL_RX_POLL sk->sk_napi_id =0 ; + sk->sk_ll_usec = sysctl_net_ll_poll;#endif /*
net/socket.c +0 -1
@@ -108,7 +108,6 @@#ifdef CONFIG_NET_LL_RX_POLL unsigned int sysctl_net_ll_poll__read_mostly ; -EXPORT_SYMBOL_GPL (sysctl_net_ll_poll);#endif static int sock_no_open (struct inode *irrelevant,struct file *dontcare);
------------------------------------------------------------------------------
This SF.net email is sponsored by Windows:
Build for Windows Store.
http://p.sf.net/sfu/windows-dev2dev
_______________________________________________
E1000-devel mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/e1000-devel
To learn more about Intel® Ethernet, visit http://communities.intel.com/community/wired
PATCH 1/1 sockperf: add SO_LL socketop support
In reply to Eliezer TamirAdd lls socket option support to sockperf.
Right now we always get the option before set to show the option is working properly. We should probably remove that in an official release. use --lls (value in usecs) to override global setting.
---
src/Defs.h | 3 +++ src/SockPerf.cpp | 54 +++++++++++++++++++++++++++++++++++++++++++++++++++++- 2 files changed, 56 insertions(+), 1 deletions(-)
src/Defs.h +3 -0
@@ -161,6 +161,7 @@ enum {OPT_OUTPUT_PRECISION ,//35 OPT_CLIENTPORT ,//36 OPT_CLIENTIP ,//37 + OPT_LLS, //38 };#define MODULE_NAME "sockperf"
@@ -527,6 +528,8 @@ struct user_params_t {// bool stream_mode; - use b_stream instead int mthread_server;struct timeval * select_timeout; +unsigned long lls_usecs; +bool lls_is_set;int sock_buff_size;int threads_num;char threads_affinity[MAX_ARGV_SIZE ];
src/SockPerf.cpp +4 -0
@@ -207,6 +207,10 @@ static const AOPT_DESC common_opt_desc[] = "Limit the lifetime of the message (default 2)." }, { + OPT_LLS, AOPT_ARG, aopt_set_literal( 0 ), aopt_set_string( "lls" ), + "Turn on LLS via socket option (value = us to poll)." + }, + { OPT_BUFFER_SIZE, AOPT_ARG, aopt_set_literal( 0 ),
aopt_set_string( "buffer-size" ),
"Set total socket receive/send buffer <size> in bytes (system
defined by default)."
},
@@ -292,7 +296,7 @@ static int proc_mode_help( int id, int argc, const char **argv )
int i = 0;
printf(MODULE_NAME " is a tool for testing network latency and
throughput.\n");
- printf("version %s\n", STR(VERSION));
+ printf("version %s-lls\n", STR(VERSION));
printf("\n");
printf("Usage: " MODULE_NAME " <subcommand> [options] [args]\n");
printf("Type: \'" MODULE_NAME " <subcommand> --help\' for help on
a specific subcommand.\n");
@@ -1789,6 +1793,26 @@ static int parse_common_opt( const AOPT_OBJECT
*common_obj )
s_user_params.is_nonblocked_send = true;
}+ if ( !rc && aopt_check(common_obj, OPT_LLS) ) {
+ const char* optarg = aopt_value(common_obj, OPT_LLS);
+ if (optarg) {
+ errno = 0;
+ int value = strtoul(optarg, NULL, 0);
+ if (errno != 0 || value < 0) {+ log_msg("'-%d' Invalid LLS value: %s", OPT_LLS,
optarg);
+ rc = SOCKPERF_ERR_BAD_ARGUMENT;
+ }
+ else {
+ s_user_params.lls_usecs = value;
+ s_user_params.lls_is_set = true;
+ }
+ }
+ else {
+ log_msg("'-%d' Invalid value", OPT_LLS);
+ rc = SOCKPERF_ERR_BAD_ARGUMENT;
+ }
+ }
+
if ( !rc && aopt_check(common_obj, OPT_RECV_LOOPING) ) {
const char* optarg = aopt_value(common_obj, OPT_RECV_LOOPING);
@@ -2296,6 +2320,29 @@ int sock_set_reuseaddr(int fd)
return rc;}
+#ifndef SO_LL
+#define SO_LL 46
+#endif
+int sock_set_lls(int fd)
+{
+ int rc = SOCKPERF_ERR_NONE; + unsigned long lls; + int size = sizeof(lls);
+
+ if(getsockopt(fd, SOL_SOCKET, SO_LL, &lls, (socklen_t *)&size) < 0){
+ log_err("getsockopt(SO_LL) failed");
+ return SOCKPERF_ERR_SOCKET;
+ } else
+ log_msg("socket option SO_LL default was %lu, changing to %lu",
lls, s_user_params.lls_usecs);
+
+ if (setsockopt(fd, SOL_SOCKET, SO_LL, &(s_user_params.lls_usecs),sizeof(s_user_params.lls_usecs)) < 0) {
+ log_err("setsockopt(SO_LL) failed");
+ rc = SOCKPERF_ERR_SOCKET;
+ }
+ return rc;
+}
+
+
int sock_set_snd_rcv_bufs(int fd)
{
/*
@@ -2460,6 +2507,11 @@ int prepare_socket(int fd, struct fds_data *p_data)
}
if (!rc &&+ (s_user_params.lls_is_set == true))
+ {
+ rc = sock_set_lls(fd);
+ }
+ if (!rc &&
(s_user_params.sock_buff_size > 0))
{
rc = sock_set_snd_rcv_bufs(fd);------------------------------------------------------------------------------
This SF.net email is sponsored by Windows:
Build for Windows Store.
http://p.sf.net/sfu/windows-dev2dev
_______________________________________________
E1000-devel mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/e1000-devel
To learn more about Intel® Ethernet, visit http://communities.intel.com/community/wired
Re: [PATCH] sockperf: add SO_LL socketop support
Quoted 4 lines · Eliezer Tamir
Add lls socket option support to sockperf.
Right now we always get the option before set to show the option is working properly. We should probably remove that in an official release. use --lls (value in usecs) to override global setting.
Sorry, this is the patch from v1.
I will send a corrected patch in a moment.
------------------------------------------------------------------------------
This SF.net email is sponsored by Windows:
Build for Windows Store.
http://p.sf.net/sfu/windows-dev2dev
_______________________________________________
E1000-devel mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/e1000-devel
To learn more about Intel® Ethernet, visit http://communities.intel.com/community/wired
PATCH v2 1/1 sockperf: add SO_LL socketop support
In reply to Eliezer TamirAdd lls socket option support.
use --lls (value in usecs) to override global setting.
Right now we always get and print the value of the option before we set, to show that the option works properly.
This should be removed in an official release.
---
src/Defs.h | 3 +++ src/SockPerf.cpp | 58 +++++++++++++++++++++++++++++++++++++++++++++++++++--- 2 files changed, 58 insertions(+), 3 deletions(-)
src/Defs.h +3 -0
@@ -161,6 +161,7 @@ enum {OPT_OUTPUT_PRECISION ,//35 OPT_CLIENTPORT ,//36 OPT_CLIENTIP ,//37 + OPT_LLS, //38 };#define MODULE_NAME "sockperf"
@@ -527,6 +528,8 @@ struct user_params_t {// bool stream_mode; - use b_stream instead int mthread_server;struct timeval * select_timeout; +unsigned int lls_usecs; +bool lls_is_set;int sock_buff_size;int threads_num;char threads_affinity[MAX_ARGV_SIZE ];
src/SockPerf.cpp +4 -0
@@ -207,6 +207,10 @@ static const AOPT_DESC common_opt_desc[] = "Limit the lifetime of the message (default 2)." }, { + OPT_LLS, AOPT_ARG, aopt_set_literal( 0 ), aopt_set_string( "lls" ), + "Turn on LLS via socket option (value = us to poll)." + }, + { OPT_BUFFER_SIZE, AOPT_ARG, aopt_set_literal( 0 ),
aopt_set_string( "buffer-size" ),
"Set total socket receive/send buffer <size> in bytes (system
defined by default)."
},
@@ -292,7 +296,7 @@ static int proc_mode_help( int id, int argc, const char **argv )
int i = 0;
printf(MODULE_NAME " is a tool for testing network latency and
throughput.\n");
- printf("version %s\n", STR(VERSION));
+ printf("version %s-lls\n", STR(VERSION));
printf("\n");
printf("Usage: " MODULE_NAME " <subcommand> [options] [args]\n");
printf("Type: \'" MODULE_NAME " <subcommand> --help\' for help on
a specific subcommand.\n");
@@ -1382,8 +1386,8 @@ static int proc_mode_server( int id, int argc,
const char **argv )
{
'B', AOPT_NOARG, aopt_set_literal( 'B' ), aopt_set_string( "Bridge" ),
"Run in Bridge mode."
- },
-*/
+ },
+*/
{
OPT_THREADS_NUM, AOPT_ARG, aopt_set_literal( 0 ),aopt_set_string( "threads-num" ),
"Run <N> threads on server side (requires '-f' option)."
@@ -1789,6 +1793,26 @@ static int parse_common_opt( const AOPT_OBJECT *common_obj )
s_user_params.is_nonblocked_send = true;
}+ if ( !rc && aopt_check(common_obj, OPT_LLS) ) {
+ const char* optarg = aopt_value(common_obj, OPT_LLS);
+ if (optarg) {
+ errno = 0;
+ int value = strtoul(optarg, NULL, 0);
+ if (errno != 0 || value < 0) {+ log_msg("'-%d' Invalid LLS value: %s", OPT_LLS,
optarg);
+ rc = SOCKPERF_ERR_BAD_ARGUMENT;
+ }
+ else {
+ s_user_params.lls_usecs = value;
+ s_user_params.lls_is_set = true;
+ }
+ }
+ else {
+ log_msg("'-%d' Invalid value", OPT_LLS);
+ rc = SOCKPERF_ERR_BAD_ARGUMENT;
+ }
+ }
+
if ( !rc && aopt_check(common_obj, OPT_RECV_LOOPING) ) {
const char* optarg = aopt_value(common_obj, OPT_RECV_LOOPING);
@@ -2296,6 +2320,29 @@ int sock_set_reuseaddr(int fd)
return rc;}
+#ifndef SO_LL
+#define SO_LL 46
+#endif
+int sock_set_lls(int fd)
+{
+ int rc = SOCKPERF_ERR_NONE; + unsigned int lls; + int size = sizeof(lls);
+
+ if(getsockopt(fd, SOL_SOCKET, SO_LL, &lls, (socklen_t *)&size) < 0){
+ log_err("getsockopt(SO_LL) failed");
+ return SOCKPERF_ERR_SOCKET;
+ } else
+ log_msg("socket option SO_LL default was %u, changing to %u",
lls, s_user_params.lls_usecs);
+
+ if (setsockopt(fd, SOL_SOCKET, SO_LL, &(s_user_params.lls_usecs),sizeof(s_user_params.lls_usecs)) < 0) {
+ log_err("setsockopt(SO_LL) failed");
+ rc = SOCKPERF_ERR_SOCKET;
+ }
+ return rc;
+}
+
+
int sock_set_snd_rcv_bufs(int fd)
{
/*
@@ -2460,6 +2507,11 @@ int prepare_socket(int fd, struct fds_data *p_data)
}
if (!rc &&+ (s_user_params.lls_is_set == true))
+ {
+ rc = sock_set_lls(fd);
+ }
+ if (!rc &&
(s_user_params.sock_buff_size > 0))
{
rc = sock_set_snd_rcv_bufs(fd);------------------------------------------------------------------------------
This SF.net email is sponsored by Windows:
Build for Windows Store.
http://p.sf.net/sfu/windows-dev2dev
_______________________________________________
E1000-devel mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/e1000-devel
To learn more about Intel® Ethernet, visit http://communities.intel.com/community/wired
David Miller
maintainerFrom: Eliezer Tamir <[email protected]>
Date: Thu, 13 Jun 2013 17:46:13 +0300
Quoted 11 lines
Here are three clean up patches, plus one that adds a socket option for LLS.
Patch 1 converts low latency sockets to
sched_clock.
Patch 2 removes the config menu forNET_LL_RX_POLLand defaults to y. Patch 3 convertssysctl_net_ll_pollinto an unsigned int
Patch 4 adds anSO_LLsocket option to allow per-socket control of busy polling.I will reply to this thread with a patch to sockperf that enables the socket option. (unchanged from v2)
Again, thanks to everyone for their comments.
Please respin with the overflow introduced by patch #3 corrected, everything else looks fine to me.