NBD: tune handshake timeout
cover NBD: tune handshake timeout
Originally posted as the tail part of this v4 series:
https://lists.gnu.org/archive/html/qemu-devel/2024-08/msg01154.html
but not deemed necessary for 9.1 as it is a feature addition that was not proposed before soft freeze (even if the point of the feature is to enable interop testing to revert back to 9.0 behavior allowing for unlimited time when debuging an NBD_OPT interchange under gdb).
As part of closing out the CVE, where the v4 patches used handshake_limit, the actual pull request used handshake_max_secs (a bit more self-documenting); I rebased that rename into the QMP code, but prefer to keep the qemu-nbd command-line spelling shorter. But I'm open to any arguments on why the names should be the same, or on any other better spellings to expose to the user.
Eric Blake (2):
qemu-nbd: Allow users to adjust handshake limit nbd/server: Allow users to adjust handshake limit in QMP
docs/tools/qemu-nbd.rst | 5 +++++ qapi/block-export.json | 10 +++++++++ include/block/nbd.h | 6 ++--- block/monitor/block-hmp-cmds.c | 4 ++-- blockdev-nbd.c | 26 ++++++++++++++------- qemu-nbd.c | 41 +++++++++++++++++++++------------- 6 files changed, 64 insertions(+), 28 deletions(-)
Signature · 1 line
2.46.0
PATCH 1/2 qemu-nbd: Allow users to adjust handshake limit
Although defaulting the handshake limit to 10 seconds was a nice QoI change to weed out intentionally slow clients, it can interfere with integration testing done with manual NBD_OPT commands over 'nbdsh --opt-mode'. Expose a command line option to allow the user to alter the timeout away from the default. This option is unlikely to be used in enough scenarios to warrant a short option letter.
The option --handshake-limit intentionally differs from the name of the constant added in commit fb1c2aaa98 (limit instead of max_secs) and the QMP name to be added in the next commit; this is because typing a longer command-line name is undesirable and there is sufficient --help text to document the units.
--- docs/tools/qemu-nbd.rst | 5 +++++ qemu-nbd.c | 41 ++++++++++++++++++++++++++--------------- 2 files changed, 31 insertions(+), 15 deletions(-)
docs/tools/qemu-nbd.rst +5 -0
@@ -154,6 +154,11 @@ driver options if :option:`--image-opts` is specified. Set the NBD volume export description, as a human-readable string. +.. option:: --handshake-limit=N + + Set the timeout for a client to successfully complete its handshake + to N seconds (default 10), or 0 for no limit. + .. option:: -L, --list Connect as a client and list all details about the exports exposed by
qemu-nbd.c +26 -15
77 lines not on this page · raw message
Signature · 1 line
2.46.0
Re: [PATCH 1/2] qemu-nbd: Allow users to adjust handshake limit
Quoted 7 lines · Eric Blake
Although defaulting the handshake limit to 10 seconds was a nice QoI change to weed out intentionally slow clients, it can interfere with integration testing done with manual
NBD_OPTcommands over 'nbdsh --opt-mode'. Expose a command line option to allow the user to alter the timeout away from the default. This option is unlikely to be used in enough scenarios to warrant a short option letter.
Quoted 7 lines
The option --handshake-limit intentionally differs from the name of the constant added in commit
fb1c2aaa98(limit instead ofmax_secs) and the QMP name to be added in the next commit; this is because typing a longer command-line name is undesirable and there is sufficient --help text to document the units.Signed-off-by Eric Blake<[email protected]>
Signature · 2 lines
Best regards, Vladimir
PATCH 2/2 nbd/server: Allow users to adjust handshake limit in QMP
In reply to Eric BlakeAlthough defaulting the handshake limit to 10 seconds was a nice QoI change to weed out intentionally slow clients, it can interfere with integration testing done with manual NBD_OPT commands over 'nbdsh --opt-mode'. Expose a QMP knob 'handshake-max-secs' to allow the user to alter the timeout away from the default.
The parameter name here intentionally matches the spelling of the constant added in commit fb1c2aaa98, and not the command-line spelling added in the previous patch for qemu-nbd; that's because in QMP, longer names serve as good self-documentation, and unlike the command line, machines don't have problems generating longer spellings.
--- qapi/block-export.json | 10 ++++++++++ include/block/nbd.h | 6 +++--- block/monitor/block-hmp-cmds.c | 4 ++-- blockdev-nbd.c | 26 ++++++++++++++++++-------- 4 files changed, 33 insertions(+), 13 deletions(-)
qapi/block-export.json +10 -0
@@ -17,6 +17,10 @@ # # @addr: Address on which to listen. # +# @handshake-max-secs: Time limit, in seconds, at which a client that +# has not completed the negotiation handshake will be disconnected, +# or 0 for no limit (since 9.2; default: 10). +# # @tls-creds: ID of the TLS credentials object (since 2.6). # # @tls-authz: ID of the QAuthZ authorization object used to validate
@@ -34,6 +38,7 @@ ## { 'struct': 'NbdServerOptions', 'data': { 'addr': 'SocketAddress', + '*handshake-max-secs': 'uint32', '*tls-creds': 'str', '*tls-authz': 'str', '*max-connections': 'uint32' } }
@@ -52,6 +57,10 @@ # # @addr: Address on which to listen. # +# @handshake-max-secs: Time limit, in seconds, at which a client that +# has not completed the negotiation handshake will be disconnected, +# or 0 for no limit (since 9.2; default: 10). +# # @tls-creds: ID of the TLS credentials object (since 2.6). # # @tls-authz: ID of the QAuthZ authorization object used to validate
@@ -72,6 +81,7 @@ ## { 'command': 'nbd-server-start', 'data': { 'addr': 'SocketAddressLegacy', + '*handshake-max-secs': 'uint32', '*tls-creds': 'str', '*tls-authz': 'str', '*max-connections': 'uint32' },
include/block/nbd.h +3 -3
@@ -428,9 +428,9 @@ void nbd_client_put(NBDClient *client);void nbd_server_is_qemu_nbd (int max_connections);bool nbd_server_is_running (void );int nbd_server_max_connections (void ); -void nbd_server_start (SocketAddress *addr,const char *tls_creds, -const char *tls_authz,uint32_t max_connections, -Error **errp); +void nbd_server_start (SocketAddress *addr,uint32_t handshake_max_secs, +const char *tls_creds,const char *tls_authz, +uint32_t max_connections,Error **errp);void nbd_server_start_options (NbdServerOptions *arg,Error **errp);/* nbd_read
block/monitor/block-hmp-cmds.c +2 -2
@@ -402,8 +402,8 @@ void hmp_nbd_server_start(Monitor *mon, const QDict *qdict) goto exit; } -nbd_server_start (addr,NULL ,NULL ,NBD_DEFAULT_MAX_CONNECTIONS , - &local_err); +nbd_server_start (addr,NBD_DEFAULT_HANDSHAKE_MAX_SECS ,NULL ,NULL , +NBD_DEFAULT_MAX_CONNECTIONS , &local_err);qapi_free_SocketAddress (addr);if (local_err !=NULL ) { goto exit;
blockdev-nbd.c +18 -8
@@ -28,6 +28,7 @@ typedef struct NBDConn { typedef struct NBDServerData { QIONetListener *listener; + uint32_t handshake_max_secs; QCryptoTLSCreds *tlscreds; char *tlsauthz; uint32_t max_connections;
@@ -84,8 +85,7 @@ static void nbd_accept(QIONetListener *listener, QIOChannelSocket *cioc,nbd_update_server_watch (nbd_server);qio_channel_set_name (QIO_CHANNEL (cioc),"nbd-server" ); -/* TODO - expose handshake timeout as QMP option */ -nbd_client_new (cioc,NBD_DEFAULT_HANDSHAKE_MAX_SECS , +nbd_client_new (cioc, nbd_server->handshake_max_secs, nbd_server->tlscreds, nbd_server->tlsauthz, nbd_blockdev_client_closed, conn); }
@@ -158,9 +158,9 @@ static QCryptoTLSCreds *nbd_get_tls_creds(const char *id, Error **errp) } -void nbd_server_start (SocketAddress *addr,const char *tls_creds, -const char *tls_authz,uint32_t max_connections, -Error **errp) +void nbd_server_start (SocketAddress *addr,uint32_t handshake_max_secs, +const char *tls_creds,const char *tls_authz, +uint32_t max_connections,Error **errp) {if (nbd_server) {error_setg (errp,"NBD server already running" );
@@ -169,6 +169,7 @@ void nbd_server_start(SocketAddress *addr, const char *tls_creds, nbd_server =g_new0 (NBDServerData,1 ); nbd_server->max_connections = max_connections; + nbd_server->handshake_max_secs = handshake_max_secs; nbd_server->listener =qio_net_listener_new (); qio_net_listener_set_name(nbd_server->listener,
@@ -206,12 +207,17 @@ void nbd_server_start_options(NbdServerOptions *arg, Error **errp)if (!arg->has_max_connections) { arg->max_connections =NBD_DEFAULT_MAX_CONNECTIONS ; } +if (!arg->has_handshake_max_secs) { + arg->handshake_max_secs =NBD_DEFAULT_HANDSHAKE_MAX_SECS ; + } -nbd_server_start (arg->addr, arg->tls_creds, arg->tls_authz, - arg->max_connections, errp); +nbd_server_start (arg->addr, arg->handshake_max_secs, arg->tls_creds, + arg->tls_authz, arg->max_connections, errp); } void qmp_nbd_server_start(SocketAddressLegacy *addr, + bool has_handshake_max_secs, + uint32_t handshake_max_secs, const char *tls_creds, const char *tls_authz, bool has_max_connections, uint32_t max_connections,
@@ -222,8 +228,12 @@ void qmp_nbd_server_start(SocketAddressLegacy *addr,if (!has_max_connections) { max_connections =NBD_DEFAULT_MAX_CONNECTIONS ; } +if (!has_handshake_max_secs) { + handshake_max_secs =NBD_DEFAULT_HANDSHAKE_MAX_SECS ; + } -nbd_server_start (addr_flat, tls_creds, tls_authz, max_connections, errp); +nbd_server_start (addr_flat, handshake_max_secs, tls_creds, tls_authz, + max_connections, errp);qapi_free_SocketAddress (addr_flat); }
Signature · 1 line
2.46.0
Re: [PATCH 2/2] nbd/server: Allow users to adjust handshake limit in QMP
Quoted 6 lines · Eric Blake
Although defaulting the handshake limit to 10 seconds was a nice QoI change to weed out intentionally slow clients, it can interfere with integration testing done with manual
NBD_OPTcommands over 'nbdsh --opt-mode'. Expose a QMP knob 'handshake-max-secs' to allow the user to alter the timeout away from the default.
Quoted 7 lines
The parameter name here intentionally matches the spelling of the constant added in commit
fb1c2aaa98, and not the command-line spelling added in the previous patch for qemu-nbd; that's because in QMP, longer names serve as good self-documentation, and unlike the command line, machines don't have problems generating longer spellings.Signed-off-by Eric Blake <[email protected]>
Quoted 42 lines
--- qapi/block-export.json | 10 ++++++++++ include/block/nbd.h | 6 +++--- block/monitor/block-hmp-cmds.c | 4 ++-- blockdev-nbd.c | 26 ++++++++++++++++++-------- 4 files changed, 33 insertions(+), 13 deletions(-)qapi/block-export.json +9
-0@@ -17,6 +17,10 @@ # # @addr: Address on which to listen. # +# @handshake-max-secs: Time limit, in seconds, at which a client that +# has not completed the negotiation handshake will be disconnected, +# or 0 for no limit (since 9.2; default: 10). +# # @tls-creds: ID of the TLS credentials object (since 2.6). # # @tls-authz: ID of the QAuthZ authorization object used to validate@@ -34,6 +38,7 @@ ## { 'struct': 'NbdServerOptions', 'data': { 'addr': 'SocketAddress', + '*handshake-max-secs': 'uint32', '*tls-creds': 'str', '*tls-authz': 'str', '*max-connections': 'uint32' } }@@ -52,6 +57,10 @@ # # @addr: Address on which to listen. # +# @handshake-max-secs: Time limit, in seconds, at which a client that +# has not completed the negotiation handshake will be disconnected, +# or 0 for no limit (since 9.2; default: 10). +# # @tls-creds: ID of the TLS credentials object (since 2.6). # # @tls-authz: ID of the QAuthZ authorization object used to validate
qapi/block-export.json line 87
Quoted 7 lines
qapi/block-export.json +1
-0@@ -72,6 +81,7 @@ ## { 'command': 'nbd-server-start', 'data': { 'addr': 'SocketAddressLegacy', + '*handshake-max-secs': 'uint32', '*tls-creds': 'str', '*tls-authz': 'str', '*max-connections': 'uint32' },
Hmm, can we make common base for these two structures, to avoid adding things always in two places? At some point would be good to somehow deprecate old syntax and finally remove it. SocketAddressLegacy is marked as deprecated in comment in qapi/sockets.json, but no word in deprecated.rst, and I'm unsure how is it possible to deprecate this.. May be, the only way is introducing new command, and deprecate nbd-server-start altogether. Aha, that should happen when add a possibility to start multiple nbd servers.
Signature · 2 lines
Best regards, Vladimir
Re: [PATCH 2/2] nbd/server: Allow users to adjust handshake limit in QMP
In reply to Eric BlakeQuoted 55 lines · Eric Blake
Although defaulting the handshake limit to 10 seconds was a nice QoI change to weed out intentionally slow clients, it can interfere with integration testing done with manual
NBD_OPTcommands over 'nbdsh --opt-mode'. Expose a QMP knob 'handshake-max-secs' to allow the user to alter the timeout away from the default.The parameter name here intentionally matches the spelling of the constant added in commit
fb1c2aaa98, and not the command-line spelling added in the previous patch for qemu-nbd; that's because in QMP, longer names serve as good self-documentation, and unlike the command line, machines don't have problems generating longer spellings.Signed-off-by Eric Blake <[email protected]>--- qapi/block-export.json | 10 ++++++++++ include/block/nbd.h | 6 +++--- block/monitor/block-hmp-cmds.c | 4 ++-- blockdev-nbd.c | 26 ++++++++++++++++++-------- 4 files changed, 33 insertions(+), 13 deletions(-)qapi/block-export.json +9
-0@@ -17,6 +17,10 @@ # # @addr: Address on which to listen. # +# @handshake-max-secs: Time limit, in seconds, at which a client that +# has not completed the negotiation handshake will be disconnected, +# or 0 for no limit (since 9.2; default: 10). +# # @tls-creds: ID of the TLS credentials object (since 2.6). # # @tls-authz: ID of the QAuthZ authorization object used to validate@@ -34,6 +38,7 @@ ## { 'struct': 'NbdServerOptions', 'data': { 'addr': 'SocketAddress', + '*handshake-max-secs': 'uint32', '*tls-creds': 'str', '*tls-authz': 'str', '*max-connections': 'uint32' } }@@ -52,6 +57,10 @@ # # @addr: Address on which to listen. # +# @handshake-max-secs: Time limit, in seconds, at which a client that +# has not completed the negotiation handshake will be disconnected, +# or 0 for no limit (since 9.2; default: 10). +# # @tls-creds: ID of the TLS credentials object (since 2.6). # # @tls-authz: ID of the QAuthZ authorization object used to validate
qapi/block-export.json line 87
Quoted 7 lines
qapi/block-export.json +1
-0@@ -72,6 +81,7 @@ ## { 'command': 'nbd-server-start', 'data': { 'addr': 'SocketAddressLegacy', + '*handshake-max-secs': 'uint32', '*tls-creds': 'str', '*tls-authz': 'str', '*max-connections': 'uint32' },
Are we confident we'll never need less than a full second?
[...]
Re: [PATCH 2/2] nbd/server: Allow users to adjust handshake limit in QMP
Quoted 58 lines · Markus Armbruster
Quoted 56 lines · Eric Blake
Although defaulting the handshake limit to 10 seconds was a nice QoI change to weed out intentionally slow clients, it can interfere with integration testing done with manual
NBD_OPTcommands over 'nbdsh --opt-mode'. Expose a QMP knob 'handshake-max-secs' to allow the user to alter the timeout away from the default.The parameter name here intentionally matches the spelling of the constant added in commit
fb1c2aaa98, and not the command-line spelling added in the previous patch for qemu-nbd; that's because in QMP, longer names serve as good self-documentation, and unlike the command line, machines don't have problems generating longer spellings.Signed-off-by Eric Blake <[email protected]>--- qapi/block-export.json | 10 ++++++++++ include/block/nbd.h | 6 +++--- block/monitor/block-hmp-cmds.c | 4 ++-- blockdev-nbd.c | 26 ++++++++++++++++++-------- 4 files changed, 33 insertions(+), 13 deletions(-)qapi/block-export.json +9
-0@@ -17,6 +17,10 @@ # # @addr: Address on which to listen. # +# @handshake-max-secs: Time limit, in seconds, at which a client that +# has not completed the negotiation handshake will be disconnected, +# or 0 for no limit (since 9.2; default: 10). +# # @tls-creds: ID of the TLS credentials object (since 2.6). # # @tls-authz: ID of the QAuthZ authorization object used to validate@@ -34,6 +38,7 @@ ## { 'struct': 'NbdServerOptions', 'data': { 'addr': 'SocketAddress', + '*handshake-max-secs': 'uint32', '*tls-creds': 'str', '*tls-authz': 'str', '*max-connections': 'uint32' } }@@ -52,6 +57,10 @@ # # @addr: Address on which to listen. # +# @handshake-max-secs: Time limit, in seconds, at which a client that +# has not completed the negotiation handshake will be disconnected, +# or 0 for no limit (since 9.2; default: 10). +# # @tls-creds: ID of the TLS credentials object (since 2.6). # # @tls-authz: ID of the QAuthZ authorization object used to validate@@ -72,6 +81,7 @@ ##
Quoted 9 lines
qapi/block-export.json line 87
Quoted 6 lines
qapi/block-export.json +1
-0{ 'command': 'nbd-server-start', 'data': { 'addr': 'SocketAddressLegacy', + '*handshake-max-secs': 'uint32', '*tls-creds': 'str', '*tls-authz': 'str', '*max-connections': 'uint32' },Are we confident we'll never need less than a full second?
Hmm, recent "[PATCH v2] chardev: introduce 'reconnect-ms' and deprecate 'reconnect'" shows that at least sometimes second is not enough precision.
Maybe, using milliseconds consistently for all relatively short time intervals in QAPI would be a good rule?
Signature · 2 lines
Best regards, Vladimir
Re: [PATCH 2/2] nbd/server: Allow users to adjust handshake limit in QMP
Quoted 16 lines · Vladimir Sementsov-Ogievskiy
Quoted 15 lines · Markus Armbruster
Quoted 13 lines · Eric Blake
Although defaulting the handshake limit to 10 seconds was a nice QoI change to weed out intentionally slow clients, it can interfere with integration testing done with manual
NBD_OPTcommands over 'nbdsh --opt-mode'. Expose a QMP knob 'handshake-max-secs' to allow the user to alter the timeout away from the default.The parameter name here intentionally matches the spelling of the constant added in commit
fb1c2aaa98, and not the command-line spelling added in the previous patch for qemu-nbd; that's because in QMP, longer names serve as good self-documentation, and unlike the command line, machines don't have problems generating longer spellings.Signed-off-by Eric Blake <[email protected]>
[...]
Quoted 5 lines
Quoted 1 line
Are we confident we'll never need less than a full second?
Hmm, recent "[PATCH v2] chardev: introduce 'reconnect-ms' and deprecate 'reconnect'" shows that at least sometimes second is not enough precision.
Maybe, using milliseconds consistently for all relatively short time intervals in QAPI would be a good rule?
Ideally, we'd use a single unit for time: nanoseconds. But we missed that chance long ago, and now are stuck with a mix of seconds, milliseconds, microseconds, and nanoseconds.
I think a good rule is to pick the first from this list that will surely provide all the precision we'll ever need.
In this case, milliseconds should do.
Re: [PATCH 2/2] nbd/server: Allow users to adjust handshake limit in QMP
Quoted 6 lines · Markus Armbruster
Quoted 5 lines
Quoted 1 line
Are we confident we'll never need less than a full second?
Hmm, recent "[PATCH v2] chardev: introduce 'reconnect-ms' and deprecate 'reconnect'" shows that at least sometimes second is not enough precision.
Maybe, using milliseconds consistently for all relatively short time intervals in QAPI would be a good rule?
Quoted 8 lines
Ideally, we'd use a single unit for time: nanoseconds. But we missed that chance long ago, and now are stuck with a mix of seconds, milliseconds, microseconds, and nanoseconds.
I think a good rule is to pick the first from this list that will surely provide all the precision we'll ever need.
In this case, milliseconds should do.
I'll use milliseconds in the next revision.
Signature · 3 lines
Eric Blake, Principal Software Engineer Red Hat, Inc. Virtualization: qemu.org | libguestfs.org