Skip to contentSkip to conversation

Statd port change recovery

PATCH New Benjamin Coddington 1 participant 3 messages Sep 23, 2014

Subsystems (3)
lore
Share & tools
lore
#0 lore raw

cover Statd port change recovery

These two attempt to address the issue of the kernel not recovering from a statd port change, which Bruce pointed out in

http://marc.info/?t=140865700700001&r=1&w=2

The second patch here re-attempts the call after doing rpc_force_rebind which is basically copied from what NLM would do in the same case. However, while working on that I discovered that when the transport attempts to reuse a socket in the first call after rpc_force_rebind, it calls kernel_connect with AF_UNSPEC to disconnect, which wakes the task in xs_error_report. The change in the task's status causes the first call after rpc_force_rebind to fail, and a soft task returns which would otherwise succeed if the connection had already been up.

The first patch tries to remedy this by not waking the task if we end up in xs_error_report while trying to reuse the connection. We expect to end up in xs_error_report with an error, but we don't want to wake the task yet since we're already set up to immediately reconnect.

Benjamin Coddington (2):
SUNRPC: Don't wake tasks during connection abort
lockd: Try to reconnect if statd has moved

 fs/lockd/mon.c              |    6 ++++++
 include/linux/sunrpc/xprt.h |    1 +
 net/sunrpc/xprtsock.c       |    4 ++++
 3 files changed, 11 insertions(+), 0 deletions(-)
#1 lore raw

PATCH 1/2 SUNRPC: Don't wake tasks during connection abort

When aborting a connection to preserve source ports, don't wake the task in xs_error_report. This allows tasks with RPC_TASK_SOFTCONN to succeed if the connection needs to be re-established since it preserves the task's status instead of setting it to the status of the aborting kernel_connect().

This may also avoid a potential conflict on the socket's lock.

---
 include/linux/sunrpc/xprt.h |    1 +
 net/sunrpc/xprtsock.c       |    4 ++++
 2 files changed, 5 insertions(+), 0 deletions(-)
include/linux/sunrpc/xprt.h +1 -0
index fcbfe87..cf391ee 100644
@@ -357,6 +357,7 @@ int			xs_swapper(struct rpc_xprt *xprt, int enable);
 #define XPRT_CONNECTION_ABORT	(7)
 #define XPRT_CONNECTION_CLOSE	(8)
 #define XPRT_CONGESTED		(9)
+#define XPRT_CONNECTION_REUSE	(10)
 
 static inline void xprt_set_connected(struct rpc_xprt *xprt)
 {
net/sunrpc/xprtsock.c +4 -0
index 43cd89e..700f879 100644
@@ -845,6 +845,8 @@ static void xs_error_report(struct sock *sk)
 	dprintk("RPC:       xs_error_report client %p, error=%d...\n",
 			xprt, -err);
 	trace_rpc_socket_error(xprt, sk->sk_socket, err);
+	if (test_bit(XPRT_CONNECTION_REUSE, &xprt->state))
+		goto out;
 	xprt_wake_pending_tasks(xprt, err);
  out:
 	read_unlock_bh(&sk->sk_callback_lock);
@@ -2245,7 +2247,9 @@ static void xs_tcp_setup_socket(struct work_struct *work)
 		abort_and_exit = test_and_clear_bit(XPRT_CONNECTION_ABORT,
 				&xprt->state);
 		/* "close" the socket, preserving the local port */
+		set_bit(XPRT_CONNECTION_REUSE, &xprt->state);
 		xs_tcp_reuse_connection(transport);
+		clear_bit(XPRT_CONNECTION_REUSE, &xprt->state);
 
 		if (abort_and_exit)
 			goto out_eagain;
Signature · 1 line
1.7.1
#2 lore raw

PATCH 2/2 lockd: Try to reconnect if statd has moved

In reply to Benjamin Coddington

If rpc.statd is restarted, upcalls to monitor hosts can fail with ECONNREFUSED. In that case force a lookup of statd's new port and retry the upcall.

---
 fs/lockd/mon.c |    6 ++++++
 1 files changed, 6 insertions(+), 0 deletions(-)
fs/lockd/mon.c +6 -0
index daa8e75..9106f42 100644
@@ -159,6 +159,12 @@ static int nsm_mon_unmon(struct nsm_handle *nsm, u32 proc, struct nsm_res *res,
 
 	msg.rpc_proc = &clnt->cl_procinfo[proc];
 	status = rpc_call_sync(clnt, &msg, RPC_TASK_SOFTCONN);
+	if (status == -ECONNREFUSED) {
+		dprintk("lockd:	NSM upcall RPC failed, status=%d, forcing rebind\n",
+				status);
+		rpc_force_rebind(clnt);
+		status = rpc_call_sync(clnt, &msg, RPC_TASK_SOFTCONN);
+	}
 	if (status < 0)
 		dprintk("lockd: NSM upcall RPC failed, status=%d\n",
 				status);
Signature · 1 line
1.7.1