dtc: Add a plugin interface
Subsystems (2)
v2 cover dtc: Add a plugin interface
v2 includes data flow information in "Documentation/manual.txt" under "5.2) Exporting Functionality". The full changelog is below.
===========
This is one possible implementation of a plugin interface for dtc.
A plugin interface would allow us to add checks in languages other than C. Specifically, it would allow dtc and DT Schema (which is written in Python) to be integrated.
It would also allow for better debugging of dts files. For example, DT Schema would be able to print dts source line information, without us having to add source line annotations to yaml files.
The plugin interface exports the live tree, making it an ABI. Plugins are allowed to modify the live tree and pass it back for further processing.
There is a possibility of improving "dtc-plugin.h" by making a standard library for live trees.
There's also a question of whether we should relicense dtc-plugin.h to dual BSD to be able call Python code.
Any thoughts would be much appreciated.
Thanks,
Andrei.
Changes in v2:
- improved documentation
- plugins must register with the build system
- the "validate_fn_t" hook can return a status
- define "struct reserve_info" in "dtc-plugin.h"
- specify that minor versions are compatible
- check if plugin_dir is NULL, just in case
- better variable names in register_plugin_info
Andrei Ziureaev (3):
dtc: Add plugin documentation and examples
dtc: Move some definitions into dtc-plugin.h
dtc: Add a plugin interface
Documentation/manual.txt | 93 +++++++++++++ Makefile | 29 +++- dtc-plugin.h | 232 +++++++++++++++++++++++++++++++ dtc.c | 142 ++++++++++++++++++- dtc.h | 200 +++++++------------------- plugins/example/Makefile.example | 20 +++ plugins/example/example.c | 29 ++++ treesource.c | 21 --- 8 files changed, 591 insertions(+), 175 deletions(-) create mode 100644 dtc-plugin.h create mode 100644 plugins/example/Makefile.example create mode 100644 plugins/example/example.c
Signature · 1 line
2.17.1
A message that is not in the archive (sent off-list or not yet received): 20200821180155.16680-1-andrei.ziureaev-5wv7dgnIgG8@public.gmane.org
RFC PATCH v2 1/3 dtc: Add plugin documentation and examples
Document the plugin API in Documentation/manual.txt and provide an example plugin.
---
Changes in v2:
- better structure
- information about the data model under "5.2) Exporting Functionality"
- plugins must register with the build system
- the "validate_fn_t" hook can return a status
Documentation/manual.txt | 93 ++++++++++++++++++++++++++++++++ plugins/example/Makefile.example | 20 +++++++ plugins/example/example.c | 29 ++++++++++ 3 files changed, 142 insertions(+) create mode 100644 plugins/example/Makefile.example create mode 100644 plugins/example/example.c
Documentation/manual.txt +93 -0
@@ -10,6 +10,9 @@ I - "dtc", the device tree compiler 4.1) Overview 4.2) Properties 4.3) Labels and References + 5) Plugins + 5.1) Building and Installing + 5.2) Exporting Functionality II - The DT block format 1) Header
@@ -115,6 +118,16 @@ Options: -d <dependency_filename> Generate a dependency file during compilation. + -l, --plugin <plugin name>[,key][,value] + Load a plugin and, optionally, pass it an argument. + plugin name - the name of the shared object without the extension (can contain a path) + key - the name of the argument + value - can be omitted + Example: dtc -l some-plugin,o,out.dts -l some-plugin,help -l another-plugin [...] + + -L, --plugin-dir <arg> + The directory in which to search for plugins + -q Quiet: -q suppress warnings, -qq errors, -qqq all
@@ -272,6 +285,86 @@ And used in properties, labels may appear before or after any value: }; +5) Plugins + +Plugins are shared libraries that DTC loads at runtime using + + dlopen(path, RTLD_NOW | RTLD_GLOBAL | RTLD_DEEPBIND) + +RTLD_NOW means they are loaded immediately (right before the parsing +stage). + +RTLD_GLOBAL means their symbols can be used by other plugins. + +RTLD_DEEPBIND means the dynamic linker will look for symbols within the +plugin first, before searching in the main program and other plugins. + +All plugins must include the "dtc-plugin.h" header. + + +5.1) Building and Installing + +Plugins are built and installed using the command "make plugins". + +Suppose your plugin is called "example". To register it with the build +system, create a file "plugins/example/Makefile.example" with the +following line as its contents: + +PLUGIN_LIBS += $(PLUGIN_dir)/example/example.so + +This means "make plugins" will try to build + + plugins/example/example.so + +from + + plugins/example/example.c + +It will also make a symlink + + plugins/example.so + +for convenience. + +Please, see "plugins/example/Makefile.example" for how to override the +default behavior, add GCC flags, etc. + + +5.2) Exporting Functionality + +Plugins export functionality through the "EXPORT_FUNCTION(type, fn)" +macro, where "fn" is the function that will be called by DTC, and +"type" must be a name of one of the following typedefs: + +/** + * Called right after the plugin is loaded. + * + * Every plugin must export a function of this type. + * + * @param dtc_ver DTC's plugin API version + * @param argc Length of argv + * @param argv Array of plugin arguments + * @return 0 on success, or 1 on failure + */ +typedef int (*init_fn_t)(struct plugin_version dtc_ver, int argc, + struct plugin_arg *argv); + +/** + * Called after DTC's parsing stage, but before the output stage. + * + * @param dti DTC's internal live tree. Implementations can modify + * the live tree and "pass it back" to DTC and to + * subsequent plugins. + * @return 1 on a fatal failure, otherwise 0 + */ +typedef int (*validate_fn_t)(struct dt_info *dti); + + +DTC calls each type exactly once for each plugin. + +Please, see an example at "plugins/example/example.c". + + II - The DT block format ========================
plugins/example/Makefile.example new file +20 -0
@@ -0,0 +1,20 @@ +# Allow "make plugins" to discover the plugin +PLUGIN_LIBS += $(PLUGIN_dir)/example/example.so + +# Add GCC flags: +# PLUGIN_CFLAGS_example = -some-flag + +# Add libraries: +# PLUGIN_LDLIBS_example = -lsome-lib + +# Add files to clean: +# PLUGIN_CLEANFILES += $(PLUGIN_dir)/example/*.tmp + +# Override the default rules: +# $(PLUGIN_dir)/example/example.$(SHAREDLIB_EXT): $(PLUGIN_dir)/example/example.o +# @$(VECHO) LD $@ +# ... +# +# $(PLUGIN_dir)/example/example.o: $(PLUGIN_dir)/example/example.c +# @$(VECHO) CC $@ +# ...
plugins/example/example.c new file +29 -0
@@ -0,0 +1,29 @@ +#include <stdio.h> +#include <string.h> + +#include "dtc-plugin.h" + +#define NAME "example: " + +static int init_example (struct plugin_version dtc_ver,int argc,struct plugin_arg *argv) +{ +if (!dtc_plugin_default_version_check (dtc_ver)) { +fprintf (stderr,NAME "Plugin is incompatible with this version of DTC\n" ); +return 1 ; + } + +for (int i =0 ; i < argc; i++) { +if (strcmp (argv[i].key,"h" ) ==0 + ||strcmp (argv[i].key,"help" ) ==0 ) { +printf (NAME "This is an example plugin. It prints its arguments.\n" ); +return 1 ; + }else { +printf (NAME "%s: %s\n" , argv[i].key, + argv[i].value ? argv[i].value :"" ); + } + } + +printf (NAME "Loaded plugin 'example'\n" ); +return 0 ; +} +EXPORT_FUNCTION (init_fn_t, init_example);
Signature · 1 line
2.17.1
RFC PATCH v2 2/3 dtc: Move some definitions into dtc-plugin.h
In reply to a message not in the archiveMove some functionality that is useful for plugins into its own header.
---
Changes in v2:
- define "struct reserve_info" in "dtc-plugin.h"
- #include "srcpos.h" in this patch
dtc-plugin.h | 182 +++++++++++++++++++++++++++++++++++++++++++++++++++ dtc.h | 153 +------------------------------------------ treesource.c | 21 ------ 3 files changed, 183 insertions(+), 173 deletions(-) create mode 100644 dtc-plugin.h
dtc-plugin.h new file +182 -0
@@ -0,0 +1,182 @@ +/* SPDX-License-Identifier: GPL-2.0-or-later */ +#ifndef DTC_PLUGIN_H +#define DTC_PLUGIN_H + +/* +* (C) Copyright Arm Holdings. 2020 +* (C) Copyright David Gibson <[email protected]>, IBM Corporation. 2005. +*/ + +#include <stdint.h> +#include <stdbool.h> + +#include "srcpos.h" + +struct dt_info { +unsigned int dtsflags; +struct reserve_info *reservelist; +uint32_t boot_cpuid_phys; +struct node *dt;/* the device tree */ +const char *outname;/* filename being written to, "-" for stdout */ +}; + +struct reserve_info { +uint64_t address, size; + +struct reserve_info *next; + +struct label *labels; +}; + +typedef uint32_t cell_t ; + +enum markertype { +TYPE_NONE , +REF_PHANDLE , +REF_PATH , +LABEL , +TYPE_UINT8 , +TYPE_UINT16 , +TYPE_UINT32 , +TYPE_UINT64 , +TYPE_STRING , +}; + +struct marker { +enum markertype type; +int offset; +char *ref; +struct marker *next; +}; + +struct data { +int len; +char *val; +struct marker *markers; +}; + +#define for_each_marker (m) \ + for (; (m); (m) = (m)->next) +#define for_each_marker_of_type (m, t) \ + for_each_marker(m) \ + if ((m)->type == (t)) + +/* Live trees */ +struct label { +bool deleted; +char *label; +struct label *next; +}; + +struct bus_type { +const char *name; +}; + +struct property { +bool deleted; +char *name; +struct data val; + +struct property *next; + +struct label *labels; +struct srcpos *srcpos; +}; + +struct node { +bool deleted; +char *name; +struct property *proplist; +struct node *children; + +struct node *parent; +struct node *next_sibling; + +char *fullpath; +int basenamelen; + +cell_t phandle; +int addr_cells, size_cells; + +struct label *labels; +const struct bus_type *bus; +struct srcpos *srcpos; + +bool omit_if_unused, is_referenced; +}; + +#define for_each_label_withdel (l0, l) \ + for ((l) = (l0); (l); (l) = (l)->next) + +#define for_each_label (l0, l) \ + for_each_label_withdel(l0, l) \ + if (!(l)->deleted) + +#define for_each_property_withdel (n, p) \ + for ((p) = (n)->proplist; (p); (p) = (p)->next) + +#define for_each_property (n, p) \ + for_each_property_withdel(n, p) \ + if (!(p)->deleted) + +#define for_each_child_withdel (n, c) \ + for ((c) = (n)->children; (c); (c) = (c)->next_sibling) + +#define for_each_child (n, c) \ + for_each_child_withdel(n, c) \ + if (!(c)->deleted) + +static inline uint16_t dtb_ld16 (const void *p) +{ +const uint8_t *bp = (const uint8_t *)p; + +return ((uint16_t )bp[0 ] <<8 ) + | bp[1 ]; +} + +static inline uint32_t dtb_ld32 (const void *p) +{ +const uint8_t *bp = (const uint8_t *)p; + +return ((uint32_t )bp[0 ] <<24 ) + | ((uint32_t )bp[1 ] <<16 ) + | ((uint32_t )bp[2 ] <<8 ) + | bp[3 ]; +} + +static inline uint64_t dtb_ld64 (const void *p) +{ +const uint8_t *bp = (const uint8_t *)p; + +return ((uint64_t )bp[0 ] <<56 ) + | ((uint64_t )bp[1 ] <<48 ) + | ((uint64_t )bp[2 ] <<40 ) + | ((uint64_t )bp[3 ] <<32 ) + | ((uint64_t )bp[4 ] <<24 ) + | ((uint64_t )bp[5 ] <<16 ) + | ((uint64_t )bp[6 ] <<8 ) + | bp[7 ]; +} + +static inline bool has_data_type_information (struct marker *m) +{ +return m->type >=TYPE_UINT8 ; +} + +static inline struct marker *next_type_marker (struct marker *m) +{ +while (m && !has_data_type_information (m)) + m = m->next; +return m; +} + +static inline size_t type_marker_length (struct marker *m) +{ +struct marker *next =next_type_marker (m->next); + +if (next) +return next->offset - m->offset; +return 0 ; +} + +#endif /* DTC_PLUGIN_H */
dtc.h +1 -152
191 lines not on this page · raw message
treesource.c +0 -21
@@ -124,27 +124,6 @@ static void write_propval_int(FILE *f, const char *p, size_t len, size_t width) } } -static bool has_data_type_information (struct marker *m) -{ -return m->type >=TYPE_UINT8 ; -} - -static struct marker *next_type_marker (struct marker *m) -{ -while (m && !has_data_type_information (m)) - m = m->next; -return m; -} - -size_t type_marker_length (struct marker *m) -{ -struct marker *next =next_type_marker (m->next); - -if (next) -return next->offset - m->offset; -return 0 ; -} -static const char *delim_start[] = { [TYPE_UINT8 ] ="[" , [TYPE_UINT16 ] ="/bits/ 16 <" ,
Signature · 1 line
2.17.1
RFC PATCH v2 3/3 dtc: Add a plugin interface
In reply to a message not in the archiveAdd support for building and loading plugins.
A plugin interface makes it possible to add checks in any language. It also allows these checks to print dts source line information.
---
Changes in v2:
- describe the data model in dtc-plugin.h
- plugins must register with the build system
- the "validate_fn_t" hook can return a status
- specify that minor versions are compatible
- check if plugin_dir is NULL, just in case
- better variable names in register_plugin_info
Makefile | 29 ++++++++++- dtc-plugin.h | 50 ++++++++++++++++++ dtc.c | 142 ++++++++++++++++++++++++++++++++++++++++++++++++++- dtc.h | 47 +++++++++++++++++ 4 files changed, 266 insertions(+), 2 deletions(-)
Makefile +28 -1
@@ -25,6 +25,8 @@ WARNINGS = -Wall -Wpointer-arith -Wcast-qual -Wnested-externs \ -Wstrict-prototypes -Wmissing-prototypes -Wredundant-decls -Wshadow CFLAGS = -g -Os $(SHAREDLIB_CFLAGS) -Werror $(WARNINGS) $(EXTRA_CFLAGS) +LDLIBS_dtc += -ldl -export-dynamic + BISON = bison LEX = flex SWIG = swig
@@ -65,14 +67,17 @@ ifeq ($(HOSTOS),darwin) SHAREDLIB_EXT = dylib SHAREDLIB_CFLAGS = -fPIC SHAREDLIB_LDFLAGS = -fPIC -dynamiclib -Wl,-install_name -Wl, +PLUGIN_ldflags = -fPIC -dynamiclib else ifeq ($(HOSTOS),$(filter $(HOSTOS),msys cygwin)) SHAREDLIB_EXT = so SHAREDLIB_CFLAGS = SHAREDLIB_LDFLAGS = -shared -Wl,--version-script=$(LIBFDT_version) -Wl,-soname, +PLUGIN_ldflags = -shared else SHAREDLIB_EXT = so SHAREDLIB_CFLAGS = -fPIC SHAREDLIB_LDFLAGS = -fPIC -shared -Wl,--version-script=$(LIBFDT_version) -Wl,-soname, +PLUGIN_ldflags = -fPIC -shared endif #
@@ -186,7 +191,29 @@ ifneq ($(MAKECMDGOALS),libfdt) endif endif +# +# Rules for plugins +# +PLUGIN_dir = plugins +PLUGIN_CLEANFILES += $(PLUGIN_dir)/*.$(SHAREDLIB_EXT) +PLUGIN_CLEANFILES += $(addprefix $(PLUGIN_dir)/*/,*.o *.$(SHAREDLIB_EXT)) + +include $(wildcard $(PLUGIN_dir)/*/Makefile.*) + +plugins: $(PLUGIN_LIBS) + +$(PLUGIN_dir)/%.$(SHAREDLIB_EXT): $(PLUGIN_dir)/%.o + @$(VECHO) LD $@ + $(LINK.c) $(PLUGIN_ldflags) -o $@ $< $(PLUGIN_LDLIBS_$(notdir $*)) + ln -sf $(patsubst $(PLUGIN_dir)/%,%,$@) $(PLUGIN_dir)/$(notdir $@) + +$(PLUGIN_dir)/%.o: $(PLUGIN_dir)/%.c + @$(VECHO) CC $@ + $(CC) $(CPPFLAGS) $(CFLAGS) $(PLUGIN_CFLAGS_$(notdir $*)) -o $@ -c $< +plugins_clean: + @$(VECHO) CLEAN "(plugins)" + rm -f $(PLUGIN_CLEANFILES) # # Rules for libfdt
@@ -330,7 +357,7 @@ endif STD_CLEANFILES = *~ *.o *.$(SHAREDLIB_EXT) *.d *.a *.i *.s core a.out vgcore.* \ *.tab.[ch] *.lex.c *.output -clean: libfdt_clean pylibfdt_clean tests_clean +clean: libfdt_clean pylibfdt_clean tests_clean plugins_clean @$(VECHO) CLEAN rm -f $(STD_CLEANFILES) rm -f $(VERSION_FILE)
dtc-plugin.h +50 -0
54 lines not on this page · raw message
dtc.c +141 -1
201 lines not on this page · raw message
dtc.h +47 -0
51 lines not on this page · raw message
Signature · 1 line
2.17.1