replace telemetry with process_info
Subsystems (2)
cover replace telemetry with process_info
From: Bruce Richardson <[email protected]>
This patchset proposes a new library, called "process-info" for now, to replace the existing telemetry library in DPDK. (Name subject to change if someone can propose a better one).
The existing telemetry library provides useful capabilities if used:
- Creates a unix socket on the system to allow external programs connect and gather stats about the DPDK process.
- Supports outputting the xstats for various network cards on the system.
- Can be used to output any other information exported to the metrics library, e.g. by applications.
- Uses JSON message format, which is widely supported by other languages and systems.
- Is supported by a plugin to collectd.
However, the library also has some issues and limitations that could be improved upon:
- Has a dependency on libjansson for JSON processing, so is disabled by default.
- Tied entirely to the metrics library for statistics.
- No support for sending non-stats data, e.g. something as simple as DPDK version string.
- All data gathering functions are in the library itself, which also means…
- No support for libraries or drivers to present their own information via the library.
We therefore propose to keep the good points of the existing library, but change the way things work to rectify the downsides. This leads to the following design choices in the library:
- Keep the existing idea of using a unix socket for connection (just simplifying the connection handling).
- We would like to use JSON format, where possible, but the jansson library dependency is problematic. However, creating JSON-encoded data is easier than trying to parse JSON in C code, so we can keep the JSON output format for processing by e.g. collectd and other tools, while simplifying the input to be plain text commands:
- Commands in this RFC are designed to all start with "/" for consistency
- Any parameters to the commands, e.g. the specific port to get stats for, are placed after a comma ","
- Have the library only handle socket creation and input handling. All data gathering should be provided by functions external to the library registered by other components, e.g. have ethdev library provide the function to query NIC xstats, etc.
- Have the library directly initialized by EAL by default, so that unless an app explicitly does not want the support, monitoring is available on all DPDK apps.
The obvious question that remains to be answered here is: "why a new library rather than just fixing the old one?"
The answer is that we have conflicts between the final two design choices above, which require that the library be built early in the build as other libraries will call into it to register callbacks, and the desire to keep backward compatibility e.g. for use with collectd plugin, which requires the existing library code be kept around and built - as it is now - at the end of the build process since it calls into other DPDK libraries. We therefore cannot have one library that meets both requirements, hence the replacement which allows us to maintain backward compatibility by just leaving the old lib in place until e.g. 20.11.
This is also why the new library is called "process_info", since the name "telemetry" is already taken. Suggestions for a better name welcome.
Bruce Richardson (4):
process-info: introduce process-info library
eal: integrate process-info library
usertools: add process-info python script
ethdev: add callback support for process-info
Ciara Power (2):
rawdev: add callback support for process-info examples/l3fwd-power: enable use of process-info
config/common_base | 5 + examples/l3fwd-power/main.c | 83 ++----- lib/Makefile | 3 +- lib/librte_eal/common/eal_common_options.c | 75 ++++++ lib/librte_eal/common/eal_internal_cfg.h | 1 + lib/librte_eal/common/eal_options.h | 5 + lib/librte_eal/freebsd/eal/Makefile | 1 + lib/librte_eal/freebsd/eal/eal.c | 14 ++ lib/librte_eal/linux/eal/Makefile | 1 + lib/librte_eal/linux/eal/eal.c | 15 ++ lib/librte_eal/meson.build | 2 +- lib/librte_ethdev/Makefile | 2 +- lib/librte_ethdev/rte_ethdev.c | 73 ++++++ lib/librte_process_info/Makefile | 26 ++ lib/librte_process_info/meson.build | 8 + lib/librte_process_info/process_info.c | 231 ++++++++++++++++++ lib/librte_process_info/rte_process_info.h | 25 ++ .../rte_process_info_version.map | 6 + lib/librte_rawdev/Makefile | 3 +- lib/librte_rawdev/meson.build | 1 + lib/librte_rawdev/rte_rawdev.c | 82 +++++++ lib/meson.build | 1 + mk/rte.app.mk | 1 + usertools/test_new_telemetry.py | 28 +++ 24 files changed, 630 insertions(+), 62 deletions(-) create mode 100644 lib/librte_process_info/Makefile create mode 100644 lib/librte_process_info/meson.build create mode 100644 lib/librte_process_info/process_info.c create mode 100644 lib/librte_process_info/rte_process_info.h create mode 100644 lib/librte_process_info/rte_process_info_version.map create mode 100755 usertools/test_new_telemetry.py
Signature · 1 line
2.17.1
RFC 1/6 process-info: introduce process-info library
From: Bruce Richardson <[email protected]>
This patch introduces the process_info library. The library does socket and connection management on a local unix socket, and allows the calling of callback functions on receipt of a message from a connected client.
---
The library is not yet initialised to run, this will come in a later patch integrating with the EAL library.
--- config/common_base | 5 + lib/Makefile | 1 + lib/librte_process_info/Makefile | 26 ++ lib/librte_process_info/meson.build | 8 + lib/librte_process_info/process_info.c | 231 ++++++++++++++++++ lib/librte_process_info/rte_process_info.h | 25 ++ .../rte_process_info_version.map | 6 + lib/meson.build | 1 + mk/rte.app.mk | 1 + 9 files changed, 304 insertions(+) create mode 100644 lib/librte_process_info/Makefile create mode 100644 lib/librte_process_info/meson.build create mode 100644 lib/librte_process_info/process_info.c create mode 100644 lib/librte_process_info/rte_process_info.h create mode 100644 lib/librte_process_info/rte_process_info_version.map
config/common_base +5 -0
@@ -1093,3 +1093,8 @@ CONFIG_RTE_APP_CRYPTO_PERF=y # Compile the eventdev application # CONFIG_RTE_APP_EVENTDEV=y + +# +# Compile the process_info library +# +CONFIG_RTE_LIBRTE_PROCESS_INFO=y
lib/Makefile +1 -0
@@ -4,6 +4,7 @@ include $(RTE_SDK)/mk/rte.vars.mk DIRS-$(CONFIG_RTE_LIBRTE_KVARGS) += librte_kvargs +DIRS-$(CONFIG_RTE_LIBRTE_PROCESS_INFO) += librte_process_info DIRS-$(CONFIG_RTE_LIBRTE_EAL) += librte_eal DEPDIRS-librte_eal := librte_kvargs DIRS-$(CONFIG_RTE_LIBRTE_PCI) += librte_pci
lib/librte_process_info/Makefile new file +26 -0
@@ -0,0 +1,26 @@ +# SPDX-License-Identifier: BSD-3-Clause +# Copyright 2019 Intel Corporation + +include $(RTE_SDK)/mk/rte.vars.mk + +# library name +LIB = librte_process_info.a + +CFLAGS += $(WERROR_FLAGS) -I$(SRCDIR) -O3 +CFLAGS += -I$(RTE_SDK)/lib/librte_eal/common/include +CFLAGS += -I$(RTE_SDK)/lib/librte_eal/common/include/arch/$(ARCH_DIR)/ +CFLAGS += -pthread +LDLIBS += -pthread + +EXPORT_MAP := rte_process_info_version.map + +LIBABIVER := 1 + +# all source are stored in SRCS-y +SRCS-$(CONFIG_RTE_LIBRTE_KVARGS) := process_info.c + +# install includes +INCS := rte_process_info.h +SYMLINK-y-include := $(INCS) + +include $(RTE_SDK)/mk/rte.lib.mk
lib/librte_process_info/meson.build new file +8 -0
@@ -0,0 +1,8 @@ +# SPDX-License-Identifier: BSD-3-Clause +# Copyright(c) 2019 Intel Corporation + +includes = [global_inc] +includes += include_directories('../librte_eal/common/include/arch/' + arch_subdir) + +sources = files('process_info.c') +headers = files('rte_process_info.h')
lib/librte_process_info/process_info.c new file +231 -0
231 lines not on this page · raw message
lib/librte_process_info/rte_process_info.h new file +25 -0
@@ -0,0 +1,25 @@ +/* SPDX-License-Identifier: BSD-3-Clause +* Copyright(c) 2019 Intel Corporation +*/ + +#ifndef _RTE_PROCESS_INFO_H_ +#define _RTE_PROCESS_INFO_H_ + +#include <stdint.h> +#include <rte_compat.h> + +#define PROCESS_INFO_MAX_CALLBACKS 64 + +/* callback returns json data in buffer, up to buf_len long. +* returns length of buffer used on success, negative on error. +*/ +typedef int (*process_info_cb )(const char *cmd,const char *params, +char *buffer,int buf_len); + +__rte_experimental +int rte_process_info_register(const char *cmd, process_info_cb fn); + +__rte_experimental +int rte_process_info_init(const char *runtime_dir, const char **err_str); + +#endif
lib/librte_process_info/rte_process_info_version.map new file +6 -0
@@ -0,0 +1,6 @@ +EXPERIMENTAL { + global: + rte_process_info_init; + rte_process_info_register; + local: *; +};
lib/meson.build +1 -0
@@ -10,6 +10,7 @@ # core libs which are widely reused, so their deps are kept to a minimum. libraries = [ 'kvargs', # eal depends on kvargs + 'process_info', # basic info querying capability about dpdk processes 'eal', # everything depends on eal 'ring', 'mempool', 'mbuf', 'net', 'meter', 'ethdev', 'pci', # core 'cmdline',
mk/rte.app.mk +1 -0
@@ -77,6 +77,7 @@ _LDLIBS-$(CONFIG_RTE_LIBRTE_HASH) += -lrte_hash _LDLIBS-$(CONFIG_RTE_LIBRTE_MEMBER) += -lrte_member _LDLIBS-$(CONFIG_RTE_LIBRTE_VHOST) += -lrte_vhost _LDLIBS-$(CONFIG_RTE_LIBRTE_KVARGS) += -lrte_kvargs +_LDLIBS-$(CONFIG_RTE_LIBRTE_PROCESS_INFO) += -lrte_process_info _LDLIBS-$(CONFIG_RTE_LIBRTE_MBUF) += -lrte_mbuf _LDLIBS-$(CONFIG_RTE_LIBRTE_NET) += -lrte_net _LDLIBS-$(CONFIG_RTE_LIBRTE_ETHER) += -lrte_ethdev
Signature · 1 line
2.17.1
RFC 2/6 eal: integrate process-info library
In reply to Ciara PowerFrom: Bruce Richardson <[email protected]>
Integrate the process info library into the EAL.
- Initialize the process-info library as part of EAL init. This can be disabled using an EAL parameter.
- Register commands to provide some basic info from EAL.
--- lib/Makefile | 2 +- lib/librte_eal/common/eal_common_options.c | 75 ++++++++++++++++++++++ lib/librte_eal/common/eal_internal_cfg.h | 1 + lib/librte_eal/common/eal_options.h | 5 ++ lib/librte_eal/freebsd/eal/Makefile | 1 + lib/librte_eal/freebsd/eal/eal.c | 14 ++++ lib/librte_eal/linux/eal/Makefile | 1 + lib/librte_eal/linux/eal/eal.c | 15 +++++ lib/librte_eal/meson.build | 2 +- 9 files changed, 114 insertions(+), 2 deletions(-)
lib/Makefile +1 -1
@@ -6,7 +6,7 @@ include $(RTE_SDK)/mk/rte.vars.mk DIRS-$(CONFIG_RTE_LIBRTE_KVARGS) += librte_kvargs DIRS-$(CONFIG_RTE_LIBRTE_PROCESS_INFO) += librte_process_info DIRS-$(CONFIG_RTE_LIBRTE_EAL) += librte_eal -DEPDIRS-librte_eal := librte_kvargs +DEPDIRS-librte_eal := librte_kvargs librte_process_info DIRS-$(CONFIG_RTE_LIBRTE_PCI) += librte_pci DEPDIRS-librte_pci := librte_eal DIRS-$(CONFIG_RTE_LIBRTE_RING) += librte_ring
lib/librte_eal/common/eal_common_options.c +75 -0
105 lines not on this page · raw message
lib/librte_eal/common/eal_internal_cfg.h +1 -0
@@ -82,6 +82,7 @@ struct internal_config {rte_cpuset_t ctrl_cpuset;/**< cpuset for ctrl threads */ volatile unsigned int init_complete;/**< indicates whether EAL has completed initialization */ +unsigned int no_process_info;/**< true to disable Process Info */ };extern struct internal_config internal_config;/**< Global EAL configuration. */
lib/librte_eal/common/eal_options.h +5 -0
@@ -69,6 +69,8 @@ enum {OPT_IOVA_MODE_NUM , #define OPT_MATCH_ALLOCATIONS "match-allocations"OPT_MATCH_ALLOCATIONS_NUM , +#define OPT_NO_PROCESS_INFO "no-process-info" +OPT_NO_PROCESS_INFO_NUM , OPT_LONG_MAX_NUM };
@@ -84,5 +86,8 @@ int eal_check_common_options(struct internal_config *internal_cfg);void eal_common_usage (void );enum rte_proc_type_t eal_proc_type_detect (void );int eal_plugins_init (void ); +int eal_save_args (int argc,char **argv); +int handle_eal_info_request(const char *cmd, const char *params __rte_unused, +char *buffer,int buf_len);#endif /* EAL_OPTIONS_H */
lib/librte_eal/freebsd/eal/Makefile +1 -0
@@ -19,6 +19,7 @@ LDLIBS += -lexecinfo LDLIBS += -lpthread LDLIBS += -lgcc_s LDLIBS += -lrte_kvargs +LDLIBS += -lrte_process_info EXPORT_MAP := ../../rte_eal_version.map
lib/librte_eal/freebsd/eal/eal.c +14 -0
@@ -44,6 +44,7 @@#include <rte_option.h> #include <rte_atomic.h> #include <malloc_heap.h> +#include <rte_process_info.h> #include "eal_private.h" #include "eal_thread.h"
@@ -724,6 +725,9 @@ rte_eal_init(int argc, char **argv)eal_reset_internal_config (&internal_config); +/* clone argv to report out later in telemetry */ +eal_save_args (argc, argv); +/* set log level as early as possible */ eal_log_level_parse (argc, argv);
@@ -952,6 +956,16 @@ rte_eal_init(int argc, char **argv)rte_eal_init_alert ("Cannot clear runtime directory\n" );return -1 ; } +if (!internal_config.no_process_info) { +const char *error_str; +if (rte_process_info_init (rte_eal_get_runtime_dir (), + &error_str) !=0 ) { +rte_eal_init_alert (error_str); +return -1 ; + } +rte_process_info_register ("/eal:version" , + handle_eal_info_request); + }eal_mcfg_complete ();
lib/librte_eal/linux/eal/Makefile +1 -0
@@ -23,6 +23,7 @@ LDLIBS += -lpthread LDLIBS += -lgcc_s LDLIBS += -lrt LDLIBS += -lrte_kvargs +LDLIBS += -lrte_process_info ifeq ($(CONFIG_RTE_EAL_NUMA_AWARE_HUGEPAGES),y) LDLIBS += -lnuma endif
lib/librte_eal/linux/eal/eal.c +15 -0
@@ -50,6 +50,7 @@#include <malloc_heap.h> #include <rte_vfio.h> #include <rte_option.h> +#include <rte_process_info.h> #include "eal_private.h" #include "eal_thread.h"
@@ -987,6 +988,9 @@ rte_eal_init(int argc, char **argv)eal_reset_internal_config (&internal_config); +/* clone argv to report out later in telemetry */ +eal_save_args (argc, argv); +/* set log level as early as possible */ eal_log_level_parse (argc, argv);
@@ -1291,6 +1295,17 @@ rte_eal_init(int argc, char **argv)return -1 ; } +if (!internal_config.no_process_info) { +const char *error_str; +if (rte_process_info_init (rte_eal_get_runtime_dir (), + &error_str) !=0 ) { +rte_eal_init_alert (error_str); +return -1 ; + } +rte_process_info_register ("/eal:version" , + handle_eal_info_request); + } +eal_mcfg_complete ();/* Call each registered callback, if enabled */
lib/librte_eal/meson.build +1 -1
@@ -13,7 +13,7 @@ dpdk_conf.set('RTE_EXEC_ENV_' + exec_env.to_upper(), 1) subdir(exec_env + '/eal') allow_experimental_apis = true -deps += 'kvargs' +deps += ['kvargs', 'process_info'] if dpdk_conf.has('RTE_USE_LIBBSD') ext_deps += libbsd endif
Signature · 1 line
2.17.1
RFC 3/6 usertools: add process-info python script
In reply to Ciara PowerFrom: Bruce Richardson <[email protected]>
This patch adds a python script that can be used with the process_info library. It connects as a client to the process_info socket, and allows the user send a command and see the JSON response.
The example usage below shows the script connecting to the process_info socket, and sending two basic commands entered by the user. The response for each command is shown below the user input.
Connecting to /var/run/dpdk/rte/process_info.22103 --> / {"/":["/","/eal:app_params","/eal:params","/eal:version"]}
--> /eal:version
{"/eal:version":"DPDK 20.02.0-rc0"}
--- usertools/test_new_telemetry.py | 28 ++++++++++++++++++++++++++++ 1 file changed, 28 insertions(+) create mode 100755 usertools/test_new_telemetry.py
usertools/test_new_telemetry.py new file +28 -0
@@ -0,0 +1,28 @@ +#! /usr/bin/python3 +# SPDX-License-Identifier: BSD-3-Clause +# Copyright(c) 2019 Intel Corporation + +import socket +import os +import sys +import time +import glob + +def handle_socket(path): + print("Connecting to " + path) + try: + fd.connect(path) + except OSError: + return + text = input('--> ') + while (text != "quit"): + fd.send(text.encode()) + print(fd.recv(4096).decode()) + text = input('--> ') + fd.close() + +fd = socket.socket(socket.AF_UNIX, socket.SOCK_SEQPACKET) +for f in glob.glob('/var/run/dpdk/*/process_info.*'): + handle_socket(f) +for f in glob.glob('/run/user/%d/dpdk/*/process_info.*' % os.getuid()): + handle_socket(f)
Signature · 1 line
2.17.1
RFC 4/6 ethdev: add callback support for process-info
In reply to Ciara PowerFrom: Bruce Richardson <[email protected]>
The ethdev library now registers commands with process_info, and implements the callback functions. These commands allow the list of ethdev ports and the stats for a port to be queried.
--- lib/librte_ethdev/Makefile | 2 +- lib/librte_ethdev/rte_ethdev.c | 73 ++++++++++++++++++++++++++++++++++ 2 files changed, 74 insertions(+), 1 deletion(-)
lib/librte_ethdev/Makefile +1 -1
@@ -12,7 +12,7 @@ CFLAGS += -DALLOW_EXPERIMENTAL_API CFLAGS += -O3 CFLAGS += $(WERROR_FLAGS) LDLIBS += -lrte_net -lrte_eal -lrte_mempool -lrte_ring -LDLIBS += -lrte_mbuf -lrte_kvargs -lrte_meter +LDLIBS += -lrte_mbuf -lrte_kvargs -lrte_meter -lrte_process_info EXPORT_MAP := rte_ethdev_version.map
lib/librte_ethdev/rte_ethdev.c +73 -0
88 lines not on this page · raw message
Signature · 1 line
2.17.1
RFC 5/6 rawdev: add callback support for process-info
In reply to Ciara PowerThe rawdev library now registers commands with process_info, and implements the corresponding callback functions. These allow a list of rawdev devices and stats for a rawdev port to be queried.
--- lib/librte_rawdev/Makefile | 3 +- lib/librte_rawdev/meson.build | 1 + lib/librte_rawdev/rte_rawdev.c | 82 ++++++++++++++++++++++++++++++++++ 3 files changed, 85 insertions(+), 1 deletion(-)
lib/librte_rawdev/Makefile +2 -1
@@ -9,7 +9,8 @@ LIB = librte_rawdev.a # build flags CFLAGS += -O3 CFLAGS += $(WERROR_FLAGS) -LDLIBS += -lrte_eal +CFLAGS += -DALLOW_EXPERIMENTAL_API +LDLIBS += -lrte_eal -lrte_process_info # library source files SRCS-y += rte_rawdev.c
lib/librte_rawdev/meson.build +1 -0
@@ -1,5 +1,6 @@ # SPDX-License-Identifier: BSD-3-Clause # Copyright(c) 2018 Intel Corporation +allow_experimental_apis = true sources = files('rte_rawdev.c') headers = files('rte_rawdev.h', 'rte_rawdev_pmd.h')
lib/librte_rawdev/rte_rawdev.c +82 -0
97 lines not on this page · raw message
Signature · 1 line
2.17.1
RFC 6/6 examples/l3fwd-power: enable use of process-info
In reply to Ciara PowerThe l3fwd-power example app now registers a stats command with process_info, and provides a callback function to handle formatting the power stats.
Using the process-info library in this app replaces the previous method of making l3fwd-power stats available in the metrics library, for use with telemetry.
--- examples/l3fwd-power/main.c | 83 +++++++++++-------------------------- 1 file changed, 25 insertions(+), 58 deletions(-)
examples/l3fwd-power/main.c +25 -58
@@ -45,7 +45,7 @@#include <rte_power.h> #include <rte_spinlock.h> #include <rte_power_empty_poll.h> -#include <rte_metrics.h> +#include <rte_process_info.h> #include "perf_core.h" #include "main.h"
@@ -131,7 +131,7 @@#define EMPTY_POLL_MED_THRESHOLD 350000UL#define EMPTY_POLL_HGH_THRESHOLD 580000UL - +#define NUM_TELSTATS RTE_DIM(telstats_strings)static uint16_t nb_rxd =RTE_TEST_RX_DESC_DEFAULT ;static uint16_t nb_txd =RTE_TEST_TX_DESC_DEFAULT ;
@@ -154,11 +154,6 @@ volatile bool quit_signal;static struct ep_params *ep_params;static struct ep_policy policy;static long ep_med_edpi, ep_hgh_edpi; -/* timer to update telemetry every 500ms */ -static struct rte_timer telemetry_timer; - -/* stats index returned by metrics lib */ -int telstats_index;struct telstats_name {char name[RTE_ETH_XSTATS_NAME_SIZE ];
@@ -187,9 +182,6 @@ enum busy_rate {#define MIN_CYCLES 1500000ULL#define MAX_CYCLES 22000000ULL -/* (500ms) */ -#define TELEMETRY_INTERVALS_PER_SEC 2 -static int parse_ptype;/**< Parse packet type using rx callback, and */ /**< disabled by default */
@@ -2087,17 +2079,21 @@ init_power_library(void) }return ret; } -static void -update_telemetry (__attribute__((unused))struct rte_timer *tim, - __attribute__((unused))void *arg) + +static int +handle_app_stats(const char *cmd __rte_unused, + const char *params __rte_unused, +char *buffer,int buf_len) {unsigned int lcore_id =rte_lcore_id ();struct lcore_conf *qconf;uint64_t app_eps =0 , app_fps =0 , app_br =0 ; -uint64_t values[3 ] = {0 }; -int ret; +uint64_t values[NUM_TELSTATS ]; +int ret, used =0 ; +uint32_t i;uint64_t count =0 ; + used =strlcpy (buffer,"{" , buf_len);RTE_LCORE_FOREACH_SLAVE (lcore_id) { qconf = &lcore_conf[lcore_id];if (qconf->n_rx_queue ==0 )
@@ -2114,32 +2110,21 @@ update_telemetry(__attribute__((unused)) struct rte_timer *tim, values[0 ] = app_eps/count; values[1 ] = app_fps/count; values[2 ] = app_br/count; - }else { - values[0 ] =0 ; - values[1 ] =0 ; - values[2 ] =0 ; + }else +memset (values,0 ,sizeof (uint64_t ) *NUM_TELSTATS ); + +for (i =0 ; i <NUM_TELSTATS ; i++) { + ret =snprintf (buffer + used, buf_len - used,"\"%s\":%" PRIu64"," , + telstats_strings[i].name, values[i]); +if (ret + used >= buf_len) +break ; + used += ret; } - ret =rte_metrics_update_values (RTE_METRICS_GLOBAL , telstats_index, - values,RTE_DIM (values)); -if (ret <0 ) -RTE_LOG (WARNING ,POWER ,"failed to update metrcis\n" ); + buffer[used -1 ] ='}' ; +return used; } -static void -telemetry_setup_timer (void ) -{ -int lcore_id =rte_lcore_id (); -uint64_t hz =rte_get_timer_hz (); -uint64_t ticks; - ticks = hz /TELEMETRY_INTERVALS_PER_SEC ; -rte_timer_reset_sync (&telemetry_timer, - ticks, -PERIODICAL , - lcore_id, - update_telemetry, -NULL ); -}static void empty_poll_setup_timer (void ) {
@@ -2176,8 +2161,6 @@ launch_timer(unsigned int lcore_id)if (app_mode ==APP_MODE_EMPTY_POLL )empty_poll_setup_timer (); -else -telemetry_setup_timer (); cycles_10ms =rte_get_timer_hz () /100 ;
@@ -2196,7 +2179,6 @@ launch_timer(unsigned int lcore_id)return 0 ; } -int main (int argc,char **argv) {
@@ -2212,8 +2194,6 @@ main(int argc, char **argv)uint32_t dev_rxq_num, dev_txq_num;uint8_t nb_rx_queue, queue, socketid;uint16_t portid; -uint8_t num_telstats =RTE_DIM (telstats_strings); -const char *ptr_strings[num_telstats];/* catch SIGINT and restore cpufreq governor to ondemand */ signal (SIGINT , signal_exit_now);
@@ -2507,29 +2487,16 @@ main(int argc, char **argv)rte_eal_mp_remote_launch (main_empty_poll_loop,NULL ,SKIP_MASTER ); }else { -unsigned int i; - -/* Init metrics library */ -rte_metrics_init (rte_socket_id ()); -/** Register stats with metrics library */ -for (i =0 ; i < num_telstats; i++) - ptr_strings[i] = telstats_strings[i].name; - - ret =rte_metrics_reg_names (ptr_strings, num_telstats); -if (ret >=0 ) - telstats_index = ret; -else -rte_exit (EXIT_FAILURE ,"failed to register metrics names" ); -RTE_LCORE_FOREACH_SLAVE (lcore_id) {rte_spinlock_init (&stats[lcore_id].telemetry_lock); } -rte_timer_init (&telemetry_timer); +rte_process_info_register ("/l3fwd-power:stats" , + handle_app_stats);rte_eal_mp_remote_launch (main_telemetry_loop,NULL ,SKIP_MASTER ); } -if (app_mode ==APP_MODE_EMPTY_POLL || app_mode ==APP_MODE_TELEMETRY ) +if (app_mode ==APP_MODE_EMPTY_POLL )launch_timer (rte_lcore_id ());RTE_LCORE_FOREACH_SLAVE (lcore_id) {
Signature · 1 line
2.17.1
Hello Ciara, Bruce,
Quoted 66 lines · Ciara Power
From: Bruce Richardson <[email protected]>
This patchset proposes a new library, called "process-info" for now, to replace the existing telemetry library in DPDK. (Name subject to change if someone can propose a better one).
The existing telemetry library provides useful capabilities if used:
- Creates a unix socket on the system to allow external programs connect and gather stats about the DPDK process.
- Supports outputting the xstats for various network cards on the system.
- Can be used to output any other information exported to the metrics library, e.g. by applications.
- Uses JSON message format, which is widely supported by other languages and systems.
- Is supported by a plugin to collectd.However, the library also has some issues and limitations that could be improved upon:
- Has a dependency on libjansson for JSON processing, so is disabled by default.
- Tied entirely to the metrics library for statistics.
- No support for sending non-stats data, e.g. something as simple as DPDK version string.
- All data gathering functions are in the library itself, which also means…
- No support for libraries or drivers to present their own information via the library.We therefore propose to keep the good points of the existing library, but change the way things work to rectify the downsides. This leads to the following design choices in the library:
- Keep the existing idea of using a unix socket for connection (just simplifying the connection handling).
- We would like to use JSON format, where possible, but the jansson library dependency is problematic. However, creating JSON-encoded data is easier than trying to parse JSON in C code, so we can keep the JSON output format for processing by e.g. collectd and other tools, while simplifying the input to be plain text commands:
- Commands in this RFC are designed to all start with "/" for consistency
- Any parameters to the commands, e.g. the specific port to get stats for, are placed after a comma ","
- Have the library only handle socket creation and input handling. All data gathering should be provided by functions external to the library registered by other components, e.g. have ethdev library provide the function to query NIC xstats, etc.
- Have the library directly initialized by EAL by default, so that unless an app explicitly does not want the support, monitoring is available on all DPDK apps.The obvious question that remains to be answered here is: "why a new library rather than just fixing the old one?"
The answer is that we have conflicts between the final two design choices above, which require that the library be built early in the build as other libraries will call into it to register callbacks, and the desire to keep backward compatibility e.g. for use with collectd plugin, which requires the existing library code be kept around and built - as it is now - at the end of the build process since it calls into other DPDK libraries. We therefore cannot have one library that meets both requirements, hence the replacement which allows us to maintain backward compatibility by just leaving the old lib in place until e.g. 20.11.
Quoted 3 lines
This is also why the new library is called "
process_info", since the name "telemetry" is already taken. Suggestions for a better name welcome.
The only user of the rte_telemetry api I could find is the (not yet merged [1]) dpdk collectd plugin.
How will this impact it?
Can we expect compatibility?
1: https://github.com/collectd/collectd/pull/3273
Signature · 1 line
David Marchand
Quoted 73 lines · David Marchand
Hello Ciara, Bruce,
Quoted 66 lines · Ciara Power
From: Bruce Richardson <[email protected]>
This patchset proposes a new library, called "process-info" for now, to replace the existing telemetry library in DPDK. (Name subject to change if someone can propose a better one).
The existing telemetry library provides useful capabilities if used:
- Creates a unix socket on the system to allow external programs connect and gather stats about the DPDK process.
- Supports outputting the xstats for various network cards on the system.
- Can be used to output any other information exported to the metrics library, e.g. by applications.
- Uses JSON message format, which is widely supported by other languages and systems.
- Is supported by a plugin to collectd.However, the library also has some issues and limitations that could be improved upon:
- Has a dependency on libjansson for JSON processing, so is disabled by default.
- Tied entirely to the metrics library for statistics.
- No support for sending non-stats data, e.g. something as simple as DPDK version string.
- All data gathering functions are in the library itself, which also means…
- No support for libraries or drivers to present their own information via the library.We therefore propose to keep the good points of the existing library, but change the way things work to rectify the downsides. This leads to the following design choices in the library:
- Keep the existing idea of using a unix socket for connection (just simplifying the connection handling).
- We would like to use JSON format, where possible, but the jansson library dependency is problematic. However, creating JSON-encoded data is easier than trying to parse JSON in C code, so we can keep the JSON output format for processing by e.g. collectd and other tools, while simplifying the input to be plain text commands:
- Commands in this RFC are designed to all start with "/" for consistency
- Any parameters to the commands, e.g. the specific port to get stats for, are placed after a comma ","
- Have the library only handle socket creation and input handling. All data gathering should be provided by functions external to the library registered by other components, e.g. have ethdev library provide the function to query NIC xstats, etc.
- Have the library directly initialized by EAL by default, so that unless an app explicitly does not want the support, monitoring is available on all DPDK apps.The obvious question that remains to be answered here is: "why a new library rather than just fixing the old one?"
The answer is that we have conflicts between the final two design choices above, which require that the library be built early in the build as other libraries will call into it to register callbacks, and the desire to keep backward compatibility e.g. for use with collectd plugin, which requires the existing library code be kept around and built - as it is now - at the end of the build process since it calls into other DPDK libraries. We therefore cannot have one library that meets both requirements, hence the replacement which allows us to maintain backward compatibility by just leaving the old lib in place until e.g. 20.11.
Quoted 3 lines
This is also why the new library is called "
process_info", since the name "telemetry" is already taken. Suggestions for a better name welcome.
Quoted 9 lines
The only user of the
rte_telemetryapi I could find is the (not yet merged [1]) dpdk collectd plugin.How will this impact it?
Can we expect compatibility?
Yes, we are aware of this, and we are investigating compatibility options. Hopefully, we'll have more on this to share in 20.05 timeframe, as we do more prototyping and investigation.
/Bruce