tools/xenstore: drop TDB
v4 cover tools/xenstore: drop TDB
Using TDB for storing the Xenstore nodes is adding more complexity instead of removing it. With keeping the data in memory only, the main reason for using TDB has disappeared.
This series is replacing TDB with a hashlist referencing directly individually allocated Xenstore nodes.
This in turn allows to use references of the stored nodes instead of copying them in case only read access is needed. Some simple tests using the test-xenstore utility have shown no single test being slower with this series applied, but some tests experienced up to 10% better performance.
Changes in V4:
- addressed comments
- patches 1-7 already applied
- dropped patch 15 of v3
- add patches 18+19
Changes in V3:
- addressed comments
- add patches 14+15
- replace patch 18 of v2 with patches 20-25
Changes in V2:
- addressed comments
- split former patch 9 into 2 patches
- added patches 13-18
Juergen Gross (19):
tools/xenstore: make hashtable key parameter const tools/xenstore: let hashtable_add() fail in case of existing entry tools/xenstore: add hashtable_replace() function tools/xenstore: drop use of tdb
tools/xenstore: remove tdb code
tools/xenstore: let db_delete() return void tools/xenstore: change talloc_free() to take a const pointer tools/xenstore: move copying of node data out of db_fetch() tools/xenstore: rework struct xs_tdb_record_hdr tools/xenstore: don't use struct node_perms in struct node tools/xenstore: use struct node_hdr in struct node tools/xenstore: alloc new memory in domain_adjust_node_perms() tools/xenstore: introduce read_node_const() tools/xenstore: merge get_spec_node() into get_node_canonicalized() tools/xenstore: merge is_valid_nodename() into canonicalize() tools/xenstore: rework get_node()
tools/xenstore: introduce get_node_const()
tools/config: add XEN_RUN_STORED to config.h tools/xenstore: move xenstored sources into dedicated directory
.gitignore | 2 +-
MAINTAINERS | 1 +
configure | 5 +
m4/paths.m4 | 1 +
stubdom/Makefile | 4 +-
tools/Makefile | 1 +
tools/config.h.in | 3 +
tools/configure | 5 +
tools/libs/store/Makefile | 1 -
tools/xenstore/Makefile | 30 +-
tools/xenstore/Makefile.common | 31 -
tools/xenstore/tdb.c | 1748 -----------------
tools/xenstore/tdb.h | 132 --
tools/xenstored/Makefile | 48 +
tools/xenstored/Makefile.common | 29 +
tools/{xenstore => xenstored}/README | 0
.../control.c} | 8 +-
.../control.h} | 0
.../xenstored_core.c => xenstored/core.c} | 643 +++---
.../xenstored_core.h => xenstored/core.h} | 77 +-
.../xenstored_domain.c => xenstored/domain.c} | 44 +-
.../xenstored_domain.h => xenstored/domain.h} | 8 +-
tools/{xenstore => xenstored}/hashtable.c | 60 +-
tools/{xenstore => xenstored}/hashtable.h | 24 +-
tools/{xenstore => xenstored}/list.h | 0
.../xenstored_lu.c => xenstored/lu.c} | 8 +-
.../xenstored_lu.h => xenstored/lu.h} | 0
.../lu_daemon.c} | 4 +-
.../lu_minios.c} | 2 +-
.../xenstored_minios.c => xenstored/minios.c} | 2 +-
.../xenstored_osdep.h => xenstored/osdep.h} | 0
.../xenstored_posix.c => xenstored/posix.c} | 4 +-
tools/{xenstore => xenstored}/talloc.c | 10 +-
tools/{xenstore => xenstored}/talloc.h | 4 +-
.../{xenstore => xenstored}/talloc_guide.txt | 0
.../transaction.c} | 57 +-
.../transaction.h} | 2 +-
tools/{xenstore => xenstored}/utils.c | 0
tools/{xenstore => xenstored}/utils.h | 9 -
.../xenstored_watch.c => xenstored/watch.c} | 45 +-
.../xenstored_watch.h => xenstored/watch.h} | 5 +-
.../include => xenstored}/xenstore_state.h | 0
42 files changed, 666 insertions(+), 2391 deletions(-)
delete mode 100644 tools/xenstore/Makefile.common
delete mode 100644 tools/xenstore/tdb.c
delete mode 100644 tools/xenstore/tdb.h
create mode 100644 tools/xenstored/Makefile
create mode 100644 tools/xenstored/Makefile.common
rename tools/{xenstore => xenstored}/README (100%)
rename tools/{xenstore/xenstored_control.c => xenstored/control.c} (98%)
rename tools/{xenstore/xenstored_control.h => xenstored/control.h} (100%)
rename tools/{xenstore/xenstored_core.c => xenstored/core.c} (88%)
rename tools/{xenstore/xenstored_core.h => xenstored/core.h} (88%)
rename tools/{xenstore/xenstored_domain.c => xenstored/domain.c} (98%)
rename tools/{xenstore/xenstored_domain.h => xenstored/domain.h} (95%)
rename tools/{xenstore => xenstored}/hashtable.c (89%)
rename tools/{xenstore => xenstored}/hashtable.h (89%)
rename tools/{xenstore => xenstored}/list.h (100%)
rename tools/{xenstore/xenstored_lu.c => xenstored/lu.c} (98%)
rename tools/{xenstore/xenstored_lu.h => xenstored/lu.h} (100%)
rename tools/{xenstore/xenstored_lu_daemon.c => xenstored/lu_daemon.c} (97%)
rename tools/{xenstore/xenstored_lu_minios.c => xenstored/lu_minios.c} (98%)
rename tools/{xenstore/xenstored_minios.c => xenstored/minios.c} (97%)
rename tools/{xenstore/xenstored_osdep.h => xenstored/osdep.h} (100%)
rename tools/{xenstore/xenstored_posix.c => xenstored/posix.c} (98%)
rename tools/{xenstore => xenstored}/talloc.c (99%)
rename tools/{xenstore => xenstored}/talloc.h (98%)
rename tools/{xenstore => xenstored}/talloc_guide.txt (100%)
rename tools/{xenstore/xenstored_transaction.c => xenstored/transaction.c} (93%)
rename tools/{xenstore/xenstored_transaction.h => xenstored/transaction.h} (98%)
rename tools/{xenstore => xenstored}/utils.c (100%)
rename tools/{xenstore => xenstored}/utils.h (89%)
rename tools/{xenstore/xenstored_watch.c => xenstored/watch.c} (90%)
rename tools/{xenstore/xenstored_watch.h => xenstored/watch.h} (93%)
rename tools/{xenstore/include => xenstored}/xenstore_state.h (100%)Signature · 1 line
2.35.3
PATCH v4 1/19 tools/xenstore: make hashtable key parameter const
The key is never modified by hashtable code, so it should be marked as const.
---
V3:
- make value const, too.
V4:
- undo V3 change again (Julien Grall)
--- tools/xenstore/hashtable.c | 5 +++-- tools/xenstore/hashtable.h | 4 ++-- 2 files changed, 5 insertions(+), 4 deletions(-)
tools/xenstore/hashtable.c +3 -2
@@ -11,7 +11,8 @@struct entry { -void *k, *v; +const void *k; +void *v;unsigned int h;struct entry *next; };
@@ -140,7 +141,7 @@ static int hashtable_expand(struct hashtable *h)return 0 ; } -int hashtable_add (struct hashtable *h,void *k,void *v) +int hashtable_add (struct hashtable *h,const void *k,void *v) {/* This method allows duplicate keys - but they shouldn't be used */ unsigned int index;
tools/xenstore/hashtable.h +2 -2
@@ -48,8 +48,8 @@ create_hashtable(const void *ctx, const char *name,* If in doubt, remove before insert. */ -int -hashtable_add (struct hashtable *h,void *k,void *v); +int +hashtable_add (struct hashtable *h,const void *k,void *v);/***************************************************************************** * hashtable_search
Signature · 1 line
2.35.3
Re: [PATCH v4 01/19] tools/xenstore: make hashtable key parameter const
Hi Juergen,
Quoted 4 lines · Juergen Gross
The key is never modified by hashtable code, so it should be marked as const.
Signed-off-by Juergen Gross <[email protected]>
Cheers,
Signature · 1 line
Julien Grall
PATCH v4 2/19 tools/xenstore: let hashtable_add() fail in case of existing entry
In reply to Juergen GrossSilently adding another entry with the same key to a hashtable is a perfect receipt for later failure with hard to diagnose symptoms.
Let hashtable_add() fail in case another entry with the same key is already existing.
---
V2:
- split off from next patch (Julien Grall)
- fix coding style (Julien Grall)
- use for () loop (Julien Grall)
--- tools/xenstore/hashtable.c | 40 ++++++++++++++++++++++++++------------ tools/xenstore/hashtable.h | 6 ------ 2 files changed, 28 insertions(+), 18 deletions(-)
tools/xenstore/hashtable.c +28 -12
@@ -141,11 +141,34 @@ static int hashtable_expand(struct hashtable *h)return 0 ; } +static struct entry *hashtable_search_entry (const struct hashtable *h, +const void *k) +{ +struct entry *e; +unsigned int hashvalue, index; + + hashvalue =hash (h, k); + index =indexFor (h->tablelength, hashvalue); + e = h->table[index]; + +for (e = h->table[index]; e; e = e->next) + { +/* Check hash value to short circuit heavier comparison */ +if ((hashvalue == e->h) && (h->eqfn (k, e->k))) +return e; + } + +return NULL ; +} +int hashtable_add (struct hashtable *h,const void *k,void *v) { -/* This method allows duplicate keys - but they shouldn't be used */ unsigned int index;struct entry *e; + +if (hashtable_search_entry (h, k)) +return EEXIST ; +if (++(h->entrycount) > h->loadlimit) {/* Ignore the return value. If expand fails, we should
@@ -176,17 +199,10 @@ int hashtable_add(struct hashtable *h, const void *k, void *v)void *hashtable_search (const struct hashtable *h,const void *k) {struct entry *e; -unsigned int hashvalue, index; - hashvalue =hash (h,k); - index =indexFor (h->tablelength,hashvalue); - e = h->table[index]; -while (NULL != e) - { -/* Check hash value to short circuit heavier comparison */ -if ((hashvalue == e->h) && (h->eqfn (k, e->k)))return e->v; - e = e->next; - } -return NULL ; + + e =hashtable_search_entry (h, k); + +return e ? e->v :NULL ; }void
tools/xenstore/hashtable.h +0 -6
@@ -40,12 +40,6 @@ create_hashtable(const void *ctx, const char *name,* * This function will cause the table to expand if the insertion would take * the ratio of entries to table size over the maximum load factor. -* -* This function does not check for repeated insertions with a duplicate key. -* The value returned when using a duplicate key is undefined -- when -* the hashtable changes size, the order of retrieval of duplicate key -* entries is reversed. -* If in doubt, remove before insert. */ int
Signature · 1 line
2.35.3
PATCH v4 3/19 tools/xenstore: add hashtable_replace() function
In reply to Juergen GrossFor an effective way to replace a hashtable entry add a new function hashtable_replace().
This is in preparation to replace TDB with a more simple data storage.
---
V3:
- fix commit message (Julien Grall)
- move unrelated change to previous patch (Julien Grall)
- make value parameter const
V4:
- remove "const" from value parameter again (Julien Grall)
--- tools/xenstore/hashtable.c | 19 +++++++++++++++++++ tools/xenstore/hashtable.h | 16 ++++++++++++++++ 2 files changed, 35 insertions(+)
tools/xenstore/hashtable.c +19 -0
@@ -205,6 +205,25 @@ void *hashtable_search(const struct hashtable *h, const void *k)return e ? e->v :NULL ; } +int hashtable_replace (struct hashtable *h,const void *k,void *v) +{ +struct entry *e; + + e =hashtable_search_entry (h, k); +if (!e) +return ENOENT ; + +if (h->flags &HASHTABLE_FREE_VALUE ) + { +talloc_free (e->v); +talloc_steal (e, v); + } + + e->v = v; + +return 0 ; +} +void hashtable_remove (struct hashtable *h,const void *k) {
tools/xenstore/hashtable.h +16 -0
@@ -45,6 +45,22 @@ create_hashtable(const void *ctx, const char *name,int hashtable_add (struct hashtable *h,const void *k,void *v); +/***************************************************************************** +* hashtable_replace + +* @name hashtable_nsert +* @param h the hashtable to insert into +* @param k the key - hashtable claims ownership and will free on removal +* @param v the value - does not claim ownership +* @return zero for successful insertion +* +* This function does check for an entry being present before replacing it +* with a new value. +*/ + +int +hashtable_replace (struct hashtable *h,const void *k,void *v); +/***************************************************************************** * hashtable_search
Signature · 1 line
2.35.3
PATCH v4 4/19 tools/xenstore: drop use of tdb
In reply to Juergen GrossToday all Xenstore nodes are stored in a TDB data base. This data base has several disadvantages:
- It is using a fixed sized hash table, resulting in high memory overhead for small installations with only very few VMs, and a rather large performance hit for systems with lots of VMs due to many collisions.
The hash table size today is 7919 entries. This means that e.g. in case of a simple desktop use case with 2 or 3 VMs probably far less than 10% of the entries will be used (assuming roughly 100 nodes per VM). OTOH a setup on a large server with 500 VMs would result in heavy conflicts in the hash list with 5-10 nodes per hash table entry.
- TDB is using a single large memory area for storing the nodes. It only ever increases this area and will never shrink it afterwards. This will result in more memory usage than necessary after a peak of Xenstore usage.
- Xenstore is only single-threaded, while TDB is designed to be fit for multi-threaded use cases, resulting in much higher code complexity than needed.
- Special use cases of Xenstore are not possible to implement with TDB in an effective way, while an implementation of a data base tailored for Xenstore could simplify some handling (e.g. transactions) a lot.
So drop using TDB and store the nodes directly in memory making them easily accessible. Use a hash-based lookup mechanism for fast lookup of nodes by their full path.
For now only replace TDB keeping the current access functions.
---
V2:
- add const (Julien Grall)
- use specific pointer type instead of void * (Julien Grall)
- add comment to db_fetch() (Julien Grall)
V3:
- use talloc_memdup() (Julien Grall)
--- tools/xenstore/xenstored_core.c | 156 ++++++++++--------------- tools/xenstore/xenstored_core.h | 5 +- tools/xenstore/xenstored_transaction.c | 1 - 3 files changed, 62 insertions(+), 100 deletions(-)
tools/xenstore/xenstored_core.c +60 -96
@@ -53,7 +53,6 @@#include "xenstored_domain.h" #include "xenstored_control.h" #include "xenstored_lu.h" -#include "tdb.h" #ifndef NO_SOCKETS #if defined(HAVE_SYSTEMD )
@@ -85,7 +84,7 @@ bool keep_orphans = false;static int reopen_log_pipe[2 ];static int reopen_log_pipe0_pollfd_idx =-1 ;char *tracefile =NULL ; -static TDB_CONTEXT *tdb_ctx =NULL ; +static struct hashtable *nodes;unsigned int trace_flags =TRACE_OBJ |TRACE_IO ;static const char *sockmsg_string (enum xsd_sockmsg_type type);
@@ -556,32 +555,30 @@ static void initialize_fds(int *p_sock_pollfd_idx, int *ptimeout) } } -static void set_tdb_key (const char *name,TDB_DATA *key) -{ -/* -* Dropping const is fine here, as the key will never be modified -* by TDB. -*/ - key->dptr = (char *)name; - key->dsize =strlen (name); -} -struct xs_tdb_record_hdr *db_fetch (const char *db_name,size_t *size) { -TDB_DATA key, data; +const struct xs_tdb_record_hdr *hdr; +struct xs_tdb_record_hdr *p; -set_tdb_key (db_name, &key); - data =tdb_fetch (tdb_ctx, key); -if (!data.dptr) { - errno = (tdb_error (tdb_ctx) ==TDB_ERR_NOEXIST ) ?ENOENT :EIO ; - *size =0 ; - }else { - *size = data.dsize; -trace_tdb ("read %s size %zu\n" , db_name, - *size +strlen (db_name)); + hdr =hashtable_search (nodes, db_name); +if (!hdr) { + errno =ENOENT ; +return NULL ; } -return (struct xs_tdb_record_hdr *)data.dptr; + *size =sizeof (*hdr) + hdr->num_perms *sizeof (hdr->perms[0 ]) + + hdr->datalen + hdr->childlen; + +/* Return a copy, avoiding a potential modification in the DB. */ + p =talloc_memdup (NULL , hdr, *size); +if (!p) { + errno =ENOMEM ; +return NULL ; + } + +trace_tdb ("read %s size %zu\n" , db_name, *size +strlen (db_name)); + +return p; }static void get_acc_data (const char *name,struct node_account_data *acc)
@@ -621,12 +618,10 @@ int db_write(struct connection *conn, const char *db_name, void *data,struct xs_tdb_record_hdr *hdr = data;struct node_account_data old_acc = {};unsigned int old_domid, new_domid; +size_t name_len =strlen (db_name); +const char *name;int ret; -TDB_DATA key, dat; -set_tdb_key (db_name, &key); - dat.dptr = data; - dat.dsize = size;if (!acc) old_acc.memory =-1 ;else
@@ -642,29 +637,36 @@ int db_write(struct connection *conn, const char *db_name, void *data,*/ if (old_acc.memory)domain_memory_add_nochk (conn, old_domid, - -old_acc.memory - key.dsize); - ret =domain_memory_add (conn, new_domid, size + key.dsize, + -old_acc.memory - name_len); + ret =domain_memory_add (conn, new_domid, size + name_len, no_quota_check);if (ret) {/* Error path, so no quota check. */ if (old_acc.memory)domain_memory_add_nochk (conn, old_domid, - old_acc.memory + key.dsize); + old_acc.memory + name_len);return ret; } -/* TDB should set errno, but doesn't even set ecode AFAICT. */ -if (tdb_store (tdb_ctx, key, dat, - (mode ==NODE_CREATE ) ?TDB_INSERT :TDB_MODIFY ) !=0 ) { -domain_memory_add_nochk (conn, new_domid, -size - key.dsize); +if (mode ==NODE_CREATE ) { +/* db_name could be modified later, so allocate a copy. */ + name =talloc_strdup (data, db_name); + ret = name ?hashtable_add (nodes, name, data) :ENOMEM ; + }else + ret =hashtable_replace (nodes, db_name, data); + +if (ret) { +/* Free data, as it isn't owned by hashtable now. */ +talloc_free (data); +domain_memory_add_nochk (conn, new_domid, -size - name_len);/* Error path, so no quota check. */ if (old_acc.memory)domain_memory_add_nochk (conn, old_domid, - old_acc.memory + key.dsize); - errno =EIO ; + old_acc.memory + name_len); + errno = ret;return errno; } -trace_tdb ("store %s size %zu\n" , db_name, size + key.dsize); +trace_tdb ("store %s size %zu\n" , db_name, size + name_len);if (acc) {/* Don't use new_domid, as it might be a transaction node. */
@@ -680,9 +682,6 @@ int db_delete(struct connection *conn, const char *name, {struct node_account_data tmp_acc;unsigned int domid; -TDB_DATA key; - -set_tdb_key (name, &key);if (!acc) { acc = &tmp_acc;
@@ -691,15 +690,13 @@ int db_delete(struct connection *conn, const char *name,get_acc_data (name, acc); -if (tdb_delete (tdb_ctx, key)) { - errno =EIO ; -return errno; - } +hashtable_remove (nodes, name);trace_tdb ("delete %s\n" , name);if (acc->memory) { domid =get_acc_domid (conn, name, acc->domid); -domain_memory_add_nochk (conn, domid, -acc->memory - key.dsize); +domain_memory_add_nochk (conn, domid, + -acc->memory -strlen (name)); }return 0 ;
@@ -2354,43 +2351,29 @@ static void manual_node(const char *name, const char *child)talloc_free (node); } -static void tdb_logger (TDB_CONTEXT *tdb,int level,const char * fmt, ...) +static unsigned int hash_from_key_fn (const void *k) { -va_list ap; -char *s; -int saved_errno = errno; +const char *str = k; +unsigned int hash =5381 ; +char c; -va_start (ap, fmt); - s =talloc_vasprintf (NULL , fmt, ap); -va_end (ap); +while ((c = *str++)) + hash = ((hash <<5 ) + hash) + (unsigned int )c; -if (s) { -trace ("TDB: %s\n" , s); -syslog (LOG_ERR ,"TDB: %s" , s); -if (verbose) -xprintf ("TDB: %s" , s); -talloc_free (s); - }else { -trace ("talloc failure during logging\n" ); -syslog (LOG_ERR ,"talloc failure during logging\n" ); - } +return hash; +} - errno = saved_errno; +static int keys_equal_fn (const void *key1,const void *key2) +{ +return 0 ==strcmp (key1, key2); }void setup_structure (bool live_update) { -char *tdbname; - - tdbname =talloc_strdup (talloc_autofree_context (),"/dev/mem" ); -if (!tdbname) -barf_perror ("Could not create tdbname" ); - - tdb_ctx =tdb_open_ex (tdbname,7919 ,TDB_INTERNAL |TDB_NOLOCK , -O_RDWR |O_CREAT |O_EXCL |O_CLOEXEC , -0640 , &tdb_logger,NULL ); -if (!tdb_ctx) -barf_perror ("Could not create tdb file %s" , tdbname); + nodes =create_hashtable (NULL ,"nodes" , hash_from_key_fn, keys_equal_fn, +HASHTABLE_FREE_KEY |HASHTABLE_FREE_VALUE ); +if (!nodes) +barf_perror ("Could not create nodes hashtable" );if (live_update)manual_node ("/" ,NULL );
@@ -2404,24 +2387,6 @@ void setup_structure(bool live_update) } } -static unsigned int hash_from_key_fn (const void *k) -{ -const char *str = k; -unsigned int hash =5381 ; -char c; - -while ((c = *str++)) - hash = ((hash <<5 ) + hash) + (unsigned int )c; - -return hash; -} - - -static int keys_equal_fn (const void *key1,const void *key2) -{ -return 0 ==strcmp (key1, key2); -} -int remember_string (struct hashtable *hash,const char *str) {char *k =talloc_strdup (NULL , str);
@@ -2481,12 +2446,11 @@ static int check_store_enoent(const void *ctx, struct connection *conn,/** * Helper to clean_store below. */ -static int clean_store_ (TDB_CONTEXT *tdb,TDB_DATA key,TDB_DATA val, -void *private) +static int clean_store_ (const void *key,void *val,void *private) {struct hashtable *reachable = private;char *slash; -char * name =talloc_strndup (NULL , key.dptr, key.dsize); +char *name =talloc_strdup (NULL , key);if (!name) {log ("clean_store: ENOMEM" );
@@ -2516,7 +2480,7 @@ static int clean_store_(TDB_CONTEXT *tdb, TDB_DATA key, TDB_DATA val,*/ static void clean_store (struct check_store_data *data) { -tdb_traverse (tdb_ctx, &clean_store_, data->reachable); +hashtable_iterate (nodes, clean_store_, data->reachable);domain_check_acc (data->domains); }
tools/xenstore/xenstored_core.h +2 -3
@@ -33,7 +33,6 @@#include "xenstore_lib.h" #include "xenstore_state.h" #include "list.h" -#include "tdb.h" #include "hashtable.h" #ifndef O_CLOEXEC
@@ -237,7 +236,7 @@ static inline unsigned int get_node_owner(const struct node *node)return node->perms.p[0 ].id; } -/* Write a node to the tdb data base. */ +/* Write a node to the data base. */ enum write_node_mode {NODE_CREATE ,NODE_MODIFY
@@ -247,7 +246,7 @@ int write_node_raw(struct connection *conn, const char *db_name, struct node *node, enum write_node_mode mode, bool no_quota_check); -/* Get a node from the tdb data base. */ +/* Get a node from the data base. */ struct node *read_node (struct connection *conn,const void *ctx,const char *name);
tools/xenstore/xenstored_transaction.c +0 -1
@@ -397,7 +397,6 @@ static int finalize_transaction(struct connection *conn, ? NODE_CREATE : NODE_MODIFY; *is_corrupt |=db_write (conn, i->node, hdr, size,NULL , mode, true); -talloc_free (hdr);if (db_delete (conn, i->trans_name,NULL )) *is_corrupt = true; }else {
Signature · 1 line
2.35.3
PATCH v4 5/19 tools/xenstore: remove tdb code
In reply to Juergen GrossNow that TDB isn't used anymore, remove it.
--- tools/xenstore/Makefile.common | 2 +- tools/xenstore/tdb.c | 1748 -------------------------------- tools/xenstore/tdb.h | 132 --- 3 files changed, 1 insertion(+), 1881 deletions(-) delete mode 100644 tools/xenstore/tdb.c delete mode 100644 tools/xenstore/tdb.h
tools/xenstore/Makefile.common +1 -1
@@ -2,7 +2,7 @@ XENSTORED_OBJS-y := xenstored_core.o xenstored_watch.o xenstored_domain.o XENSTORED_OBJS-y += xenstored_transaction.o xenstored_control.o xenstored_lu.o -XENSTORED_OBJS-y += talloc.o utils.o tdb.o hashtable.o +XENSTORED_OBJS-y += talloc.o utils.o hashtable.o XENSTORED_OBJS-$(CONFIG_Linux) += xenstored_posix.o xenstored_lu_daemon.o XENSTORED_OBJS-$(CONFIG_NetBSD) += xenstored_posix.o xenstored_lu_daemon.o
tools/xenstore/tdb.c deleted +0 -1748
1,748 lines not on this page · raw message
tools/xenstore/tdb.h deleted +0 -132
132 lines not on this page · raw message
Signature · 1 line
2.35.3
PATCH v4 6/19 tools/xenstore: let db_delete() return void
In reply to Juergen Grossdb_delete() only ever is returning 0. Switch it to return void and remove all the error handling dealing wit a non-zero return value.
---
V2:
- new patch
--- tools/xenstore/xenstored_core.c | 11 ++++------- tools/xenstore/xenstored_core.h | 4 ++-- tools/xenstore/xenstored_transaction.c | 14 +++++--------- 3 files changed, 11 insertions(+), 18 deletions(-)
tools/xenstore/xenstored_core.c +4 -7
@@ -677,8 +677,8 @@ int db_write(struct connection *conn, const char *db_name, void *data,return 0 ; } -int db_delete (struct connection *conn,const char *name, -struct node_account_data *acc) +void db_delete (struct connection *conn,const char *name, +struct node_account_data *acc) {struct node_account_data tmp_acc;unsigned int domid;
@@ -698,8 +698,6 @@ int db_delete(struct connection *conn, const char *name,domain_memory_add_nochk (conn, domid, -acc->memory -strlen (name)); } - -return 0 ; }/*
@@ -1670,9 +1668,8 @@ static int delnode_sub(const void *ctx, struct connection *conn,if (domain_nbentry_dec (conn,get_node_owner (node)))return WALK_TREE_ERROR_STOP ; -/* In case of error stop the walk. */ -if (!ret &&db_delete (conn, db_name, &node->acc)) -return WALK_TREE_ERROR_STOP ; +if (!ret) +db_delete (conn, db_name, &node->acc);/* * Fire the watches now, when we can still see the node permissions.
tools/xenstore/xenstored_core.h +2 -2
@@ -366,8 +366,8 @@ struct xs_tdb_record_hdr *db_fetch(const char *db_name, size_t *size);int db_write (struct connection *conn,const char *db_name,void *data,size_t size,struct node_account_data *acc,enum write_node_mode mode,bool no_quota_check); -int db_delete (struct connection *conn,const char *name, -struct node_account_data *acc); +void db_delete (struct connection *conn,const char *name, +struct node_account_data *acc);void conn_free_buffered_data (struct connection *conn);
tools/xenstore/xenstored_transaction.c +5 -9
@@ -377,10 +377,8 @@ static int finalize_transaction(struct connection *conn,/* Entries for unmodified nodes can be removed early. */ if (!i->modified) { -if (i->ta_node) { -if (db_delete (conn, i->trans_name,NULL )) -return EIO ; - } +if (i->ta_node) +db_delete (conn, i->trans_name,NULL );list_del (&i->list);talloc_free (i); }
@@ -397,8 +395,7 @@ static int finalize_transaction(struct connection *conn, ? NODE_CREATE : NODE_MODIFY; *is_corrupt |=db_write (conn, i->node, hdr, size,NULL , mode, true); -if (db_delete (conn, i->trans_name,NULL )) - *is_corrupt = true; +db_delete (conn, i->trans_name,NULL ); }else { *is_corrupt = true; }
@@ -408,9 +405,8 @@ static int finalize_transaction(struct connection *conn,* in this transaction will have no generation * information stored. */ - *is_corrupt |= (i->generation ==NO_GENERATION ) - ? false - :db_delete (conn, i->node,NULL ); +if (i->generation !=NO_GENERATION ) +db_delete (conn, i->node,NULL ); }if (i->fire_watch) fire_watches(conn, trans, i->node, NULL, i->watch_exact,
Signature · 1 line
2.35.3
PATCH v4 7/19 tools/xenstore: change talloc_free() to take a const pointer
In reply to Juergen GrossWith talloc_free() and related functions not taking a pointer to const it is tedious to use the const attribute for talloc()-ed memory in many cases.
Change the related prototypes to use "const void *" instead of "void *".
---
V3:
- new patch
V4:
- add comment (Julien Grall)
--- tools/xenstore/talloc.c | 10 ++++++---- tools/xenstore/talloc.h | 4 ++-- 2 files changed, 8 insertions(+), 6 deletions(-)
tools/xenstore/talloc.c +6 -4
@@ -319,7 +319,7 @@ static int talloc_unreference(const void *context, const void *ptr)remove a specific parent context from a pointer. This is a more controlled varient of talloc_free() */ -int talloc_unlink (const void *context,void *ptr) +int talloc_unlink (const void *context,const void *ptr) {struct talloc_chunk *tc_p, *new_p;void *new_parent;
@@ -499,7 +499,7 @@ void *talloc_init(const char *fmt, ...)should probably not be used in new code. It's in here to keep the talloc code consistent across Samba 3 and 4. */ -static void talloc_free_children (void *ptr) +static void talloc_free_children (const void *ptr) {struct talloc_chunk *tc;
@@ -539,7 +539,7 @@ static void talloc_free_children(void *ptr)will not be freed if the ref_count is > 1 or the destructor (if any) returns non-zero */ -int talloc_free (void *ptr) +int talloc_free (const void *ptr) {int saved_errno = errno;struct talloc_chunk *tc;
@@ -571,7 +571,9 @@ int talloc_free(void *ptr) goto err; } tc->destructor = (talloc_destructor_t)-1 ; -if (d (ptr) ==-1 ) { + +/* The destructor needs to be able to change the object! */ +if (d ((void *)ptr) ==-1 ) { tc->destructor = d; goto err; }
tools/xenstore/talloc.h +2 -2
@@ -92,7 +92,7 @@ void *_talloc(const void *context, size_t size);void talloc_set_destructor (const void *ptr,int (*destructor)(void *));void talloc_increase_ref_count (const void *ptr);void *talloc_reference (const void *context,const void *ptr); -int talloc_unlink (const void *context,void *ptr); +int talloc_unlink (const void *context,const void *ptr); void talloc_set_name(const void *ptr, const char *fmt, ...) PRINTF_ATTRIBUTE(2,3);void talloc_set_name_const (const void *ptr,const char *name); void *talloc_named(const void *context, size_t size,
@@ -103,7 +103,7 @@ void *talloc_check_name(const void *ptr, const char *name);void talloc_report_depth (const void *ptr,FILE *f,int depth);void *talloc_parent (const void *ptr);void *talloc_init (const char *fmt, ...)PRINTF_ATTRIBUTE (1 ,2 ); -int talloc_free (void *ptr); +int talloc_free (const void *ptr);void *_talloc_realloc (const void *context,void *ptr,size_t size,const char *name);void *talloc_steal (const void *new_ctx,const void *ptr);off_t talloc_total_size (const void *ptr);
Signature · 1 line
2.35.3
Re: [PATCH v4 07/19] tools/xenstore: change talloc_free() to take a const pointer
Hi Juergen,
Quoted 8 lines · Juergen Gross
With
talloc_free()and related functions not taking a pointer to const it is tedious to use the const attribute for talloc()-ed memory in many cases.Change the related prototypes to use "const void *" instead of "void *".
Signed-off-by Juergen Gross <[email protected]>
Cheers,
Signature · 1 line
Julien Grall
PATCH v4 8/19 tools/xenstore: move copying of node data out of db_fetch()
In reply to Juergen GrossToday the node data is copied in db_fetch() on each data base read in order to avoid accidental data base modifications when working on a node.
read_node() is the only caller of db_fetch() which isn't freeing the returned data area immediately after using it. The other callers don't modify the returned data, so they don't need the data to be copied.
Move copying of the data into read_node(), resulting in a speedup of the other callers due to no memory allocation and no copying being needed anymore.
This allows to let db_fetch() return a pointer to const data.
As db_fetch() can't return any error other than ENOENT now, error handling for the callers can be simplified.
---
V2:
- new patch
V3:
- modify return type of db_fetch() to return a pointer to const (Julien Grall)
- drop stale comment (Julien Grall)
- fix transaction handling
V4:
- don't drop const attribute for hdr (Julien Grall)
--- tools/xenstore/xenstored_core.c | 43 ++++++++++---------------- tools/xenstore/xenstored_core.h | 2 +- tools/xenstore/xenstored_transaction.c | 23 +++++++++----- 3 files changed, 34 insertions(+), 34 deletions(-)
tools/xenstore/xenstored_core.c +17 -26
@@ -555,10 +555,9 @@ static void initialize_fds(int *p_sock_pollfd_idx, int *ptimeout) } } -struct xs_tdb_record_hdr *db_fetch (const char *db_name,size_t *size) +const struct xs_tdb_record_hdr *db_fetch (const char *db_name,size_t *size) {const struct xs_tdb_record_hdr *hdr; -struct xs_tdb_record_hdr *p; hdr =hashtable_search (nodes, db_name);if (!hdr) {
@@ -569,22 +568,15 @@ struct xs_tdb_record_hdr *db_fetch(const char *db_name, size_t *size) *size =sizeof (*hdr) + hdr->num_perms *sizeof (hdr->perms[0 ]) + hdr->datalen + hdr->childlen; -/* Return a copy, avoiding a potential modification in the DB. */ - p =talloc_memdup (NULL , hdr, *size); -if (!p) { - errno =ENOMEM ; -return NULL ; - } -trace_tdb ("read %s size %zu\n" , db_name, *size +strlen (db_name)); -return p; +return hdr; }static void get_acc_data (const char *name,struct node_account_data *acc) {size_t size; -struct xs_tdb_record_hdr *hdr; +const struct xs_tdb_record_hdr *hdr;if (acc->memory <0 ) { hdr =db_fetch (name, &size);
@@ -595,7 +587,6 @@ static void get_acc_data(const char *name, struct node_account_data *acc) acc->memory = size; acc->domid = hdr->perms[0 ].id; } -talloc_free (hdr); } }
@@ -708,7 +699,7 @@ struct node *read_node(struct connection *conn, const void *ctx, const char *name) {size_t size; -struct xs_tdb_record_hdr *hdr; +const struct xs_tdb_record_hdr *hdr;struct node *node;const char *db_name;int err;
@@ -729,30 +720,30 @@ struct node *read_node(struct connection *conn, const void *ctx, hdr =db_fetch (db_name, &size);if (hdr ==NULL ) { -if (errno ==ENOENT ) { - node->generation =NO_GENERATION ; - err =access_node (conn, node,NODE_ACCESS_READ ,NULL ); - errno = err ? :ENOENT ; - }else { -log ("DB error on read: %s" ,strerror (errno)); - errno =EIO ; - } + node->generation =NO_GENERATION ; + err =access_node (conn, node,NODE_ACCESS_READ ,NULL ); + errno = err ? :ENOENT ; goto error; } node->parent =NULL ; -talloc_steal (node, hdr);/* Datalen, childlen, number of permissions */ node->generation = hdr->generation; node->perms.num = hdr->num_perms; node->datalen = hdr->datalen; node->childlen = hdr->childlen; - -/* Permissions are struct xs_permissions. */ - node->perms.p = hdr->perms; - node->acc.domid =get_node_owner (node); + node->acc.domid = hdr->perms[0 ].id; node->acc.memory = size; + +/* Copy node data to new memory area, starting with permissions. */ + size -=sizeof (*hdr); + node->perms.p =talloc_memdup (node, hdr->perms, size); +if (node->perms.p ==NULL ) { + errno =ENOMEM ; + goto error; + } +if (domain_adjust_node_perms (node)) goto error;
tools/xenstore/xenstored_core.h +1 -1
@@ -362,7 +362,7 @@ extern xengnttab_handle **xgt_handle;int remember_string (struct hashtable *hash,const char *str);/* Data base access functions. */ -struct xs_tdb_record_hdr *db_fetch (const char *db_name,size_t *size); +const struct xs_tdb_record_hdr *db_fetch (const char *db_name,size_t *size);int db_write (struct connection *conn,const char *db_name,void *data,size_t size,struct node_account_data *acc,enum write_node_mode mode,bool no_quota_check);
tools/xenstore/xenstored_transaction.c +16 -7
@@ -357,20 +357,17 @@ static int finalize_transaction(struct connection *conn, {struct accessed_node *i, *n;size_t size; -struct xs_tdb_record_hdr *hdr; +const struct xs_tdb_record_hdr *hdr;uint64_t gen;list_for_each_entry_safe (i, n, &trans->accessed, list) {if (i->check_gen) { hdr =db_fetch (i->node, &size);if (!hdr) { -if (errno !=ENOENT ) -return errno; gen =NO_GENERATION ; }else { gen = hdr->generation; } -talloc_free (hdr);if (i->generation != gen)return EAGAIN ; }
@@ -388,14 +385,26 @@ static int finalize_transaction(struct connection *conn,if (i->ta_node) { hdr =db_fetch (i->trans_name, &size);if (hdr) { +/* +* Delete transaction entry and write it as +* no-TA entry. As we only hold a reference +* to the data, increment its ref count, then +* delete it from the DB. Now we own it and can +* drop the const attribute for changing the +* generation count. +*/ enum write_node_mode mode; +struct xs_tdb_record_hdr *own; - hdr->generation = ++generation; +talloc_increase_ref_count (hdr); +db_delete (conn, i->trans_name,NULL ); + + own = (struct xs_tdb_record_hdr *)hdr; + own->generation = ++generation; mode = (i->generation ==NO_GENERATION ) ?NODE_CREATE :NODE_MODIFY ; - *is_corrupt |=db_write (conn, i->node, hdr, + *is_corrupt |=db_write (conn, i->node, own, size,NULL , mode, true); -db_delete (conn, i->trans_name,NULL ); }else { *is_corrupt = true; }
Signature · 1 line
2.35.3
Re: [PATCH v4 08/19] tools/xenstore: move copying of node data out of db_fetch()
Hi Juergen,
Quoted 12 lines · Juergen Gross
Today the node data is copied in
db_fetch()on each data base read in order to avoid accidental data base modifications when working on a node.
read_node()is the only caller ofdb_fetch()which isn't freeing the returned data area immediately after using it. The other callers don't modify the returned data, so they don't need the data to be copied.Move copying of the data into
read_node(), resulting in a speedup of the other callers due to no memory allocation and no copying being needed anymore.
Quoted 6 lines
This allows to let
db_fetch()return a pointer to const data.As
db_fetch()can't return any error other than ENOENT now, error handling for the callers can be simplified.Signed-off-by Juergen Gross <[email protected]>
Cheers,
Signature · 1 line
Julien Grall
PATCH v4 9/19 tools/xenstore: rework struct xs_tdb_record_hdr
In reply to Juergen GrossStruct xs_tdb_record_hdr is used for nodes stored in the data base. When working on a node, struct node is being used, which is including the same information as struct xs_tdb_record_hdr, but in a different format. Rework struct xs_tdb_record_hdr in order to prepare including it in struct node.
Do the following modifications:
- move its definition to xenstored_core.h, as the reason to put it into utils.h are no longer existing
- rename it to struct node_hdr, as the "tdb" in its name has only historical reasons
- replace the empty permission array at the end with a comment about the layout of data in the data base (concatenation of header, permissions, node contents, and children list)
- use narrower types for num_perms and datalen, as those are naturally limited to XENSTORE_PAYLOAD_MAX (childlen is different here, as it is in theory basically unlimited)
---
V2:
- new patch
V4:
- add BUILD_BUG_ON() for verifying datalen can hold large enough value for XENSTORE_PAYLOAD_MAX (Julien Grall)
- let perms_from_node_hdr() return const (Julien Grall)
- open code perms_from_node_hdr() for the non-const case (Julien Grall)
--- tools/xenstore/utils.h | 9 ----- tools/xenstore/xenstored_core.c | 46 +++++++++++++++++--------- tools/xenstore/xenstored_core.h | 20 ++++++++++- tools/xenstore/xenstored_transaction.c | 6 ++-- 4 files changed, 53 insertions(+), 28 deletions(-)
tools/xenstore/utils.h +0 -9
@@ -9,15 +9,6 @@#include "xenstore_lib.h" -/* Header of the node record in tdb. */ -struct xs_tdb_record_hdr { -uint64_t generation; -uint32_t num_perms; -uint32_t datalen; -uint32_t childlen; -struct xs_permissions perms[0 ]; -}; -/* Is A == B ? */ #define streq (a,b) (strcmp((a),(b)) == 0)
tools/xenstore/xenstored_core.c +31 -15
132 lines not on this page · raw message
tools/xenstore/xenstored_core.h +19 -1
@@ -168,6 +168,24 @@ struct connection };extern struct list_head connections; +/* +* Header of the node record in the data base. +* In the data base the memory of the node is a single memory chunk with the +* following format: +* struct { +* node_hdr hdr; +* struct xs_permissions perms[hdr.num_perms]; +* char data[hdr.datalen]; +* char children[hdr.childlen]; +* }; +*/ +struct node_hdr { +uint64_t generation; +uint16_t num_perms; +uint16_t datalen; +uint32_t childlen; +}; +struct node_perms {unsigned int num;struct xs_permissions *p;
@@ -362,7 +380,7 @@ extern xengnttab_handle **xgt_handle;int remember_string (struct hashtable *hash,const char *str);/* Data base access functions. */ -const struct xs_tdb_record_hdr *db_fetch (const char *db_name,size_t *size); +const struct node_hdr *db_fetch (const char *db_name,size_t *size);int db_write (struct connection *conn,const char *db_name,void *data,size_t size,struct node_account_data *acc,enum write_node_mode mode,bool no_quota_check);
tools/xenstore/xenstored_transaction.c +3 -3
@@ -357,7 +357,7 @@ static int finalize_transaction(struct connection *conn, {struct accessed_node *i, *n;size_t size; -const struct xs_tdb_record_hdr *hdr; +const struct node_hdr *hdr;uint64_t gen;list_for_each_entry_safe (i, n, &trans->accessed, list) {
@@ -394,12 +394,12 @@ static int finalize_transaction(struct connection *conn,* generation count. */ enum write_node_mode mode; -struct xs_tdb_record_hdr *own; +struct node_hdr *own;talloc_increase_ref_count (hdr);db_delete (conn, i->trans_name,NULL ); - own = (struct xs_tdb_record_hdr *)hdr; + own = (struct node_hdr *)hdr; own->generation = ++generation; mode = (i->generation ==NO_GENERATION ) ?NODE_CREATE :NODE_MODIFY ;
Signature · 1 line
2.35.3
Re: [PATCH v4 09/19] tools/xenstore: rework struct xs_tdb_record_hdr
Hi Juergen,
Quoted 18 lines · Juergen Gross
Struct
xs_tdb_record_hdris used for nodes stored in the data base. When working on a node, struct node is being used, which is including the same information as structxs_tdb_record_hdr, but in a different format. Rework structxs_tdb_record_hdrin order to prepare including it in struct node.Do the following modifications:
- move its definition to
xenstored_core.h, as the reason to put it intoutils.hare no longer existing- rename it to struct
node_hdr, as the "tdb" in its name has only historical reasons- replace the empty permission array at the end with a comment about the layout of data in the data base (concatenation of header, permissions, node contents, and children list)
Quoted 5 lines
- use narrower types for
num_permsand datalen, as those are naturally limited toXENSTORE_PAYLOAD_MAX(childlen is different here, as it is in theory basically unlimited)Signed-off-by Juergen Gross <[email protected]>
Cheers,
Signature · 1 line
Julien Grall
PATCH v4 10/19 tools/xenstore: don't use struct node_perms in struct node
In reply to Juergen GrossOpen code struct node_perms in struct node in order to prepare using struct node_hdr in struct node.
Add two helpers to transfer permissions between struct node and struct node_perms and a helper to directly get connection base permissions from a node.
Let perms_to_strings() take a struct node as parameter and rename it to node_perms_to_strings().
---
V2:
- new patch
V4:
- add perm_for_conn_from_node() helper (Julien Grall)
- let perms_to_strings() take the node as parameter (Julien Grall)
- rename perms_to_strings()
--- tools/xenstore/xenstored_core.c | 86 +++++++++++++------------- tools/xenstore/xenstored_core.h | 31 +++++++++- tools/xenstore/xenstored_domain.c | 13 ++-- tools/xenstore/xenstored_transaction.c | 8 +-- tools/xenstore/xenstored_watch.c | 4 +- 5 files changed, 83 insertions(+), 59 deletions(-)
tools/xenstore/xenstored_core.c +42 -44
@@ -736,7 +736,7 @@ struct node *read_node(struct connection *conn, const void *ctx,/* Datalen, childlen, number of permissions */ node->generation = hdr->generation; - node->perms.num = hdr->num_perms; + node->num_perms = hdr->num_perms; node->datalen = hdr->datalen; node->childlen = hdr->childlen; node->acc.domid =perms_from_node_hdr (hdr)->id;
@@ -744,8 +744,8 @@ struct node *read_node(struct connection *conn, const void *ctx,/* Copy node data to new memory area, starting with permissions. */ size -=sizeof (*hdr); - node->perms.p =talloc_memdup (node,perms_from_node_hdr (hdr), size); -if (node->perms.p ==NULL ) { + node->perms =talloc_memdup (node,perms_from_node_hdr (hdr), size); +if (node->perms ==NULL ) { errno =ENOMEM ; goto error; }
@@ -758,7 +758,7 @@ struct node *read_node(struct connection *conn, const void *ctx, node->acc.memory =0 ;/* Data is binary blob (usually ascii, no nul). */ - node->data = node->perms.p + hdr->num_perms; + node->data = node->perms + hdr->num_perms;/* Children is strings, nul separated. */ node->children = node->data + node->datalen;
@@ -797,7 +797,7 @@ int write_node_raw(struct connection *conn, const char *db_name,return errno; size =sizeof (*hdr) - + node->perms.num *sizeof (node->perms.p[0 ]) + + node->num_perms *sizeof (node->perms[0 ]) + node->datalen + node->childlen;/* Call domain_max_chk() in any case in order to record max values. */
@@ -816,14 +816,14 @@ int write_node_raw(struct connection *conn, const char *db_name, hdr = data; hdr->generation = node->generation; - hdr->num_perms = node->perms.num; + hdr->num_perms = node->num_perms; hdr->datalen = node->datalen; hdr->childlen = node->childlen;/* Open code perms_from_node_hdr() for the non-const case. */ p = hdr +1 ; -memcpy (p, node->perms.p, node->perms.num *sizeof (*node->perms.p)); - p += node->perms.num *sizeof (*node->perms.p); +memcpy (p, node->perms, node->num_perms *sizeof (*node->perms)); + p += node->num_perms *sizeof (*node->perms);memcpy (p, node->data, node->datalen); p += node->datalen;memcpy (p, node->children, node->childlen);
@@ -923,7 +923,8 @@ static int ask_parents(struct connection *conn, const void *ctx,return 0 ; } - *perm =perm_for_conn (conn, &node->perms); + *perm =perm_for_conn_from_node (conn, node); +return 0 ; }
@@ -963,11 +964,9 @@ static struct node *get_node(struct connection *conn, node =read_node (conn, ctx, name);/* If we don't have permission, we don't have node. */ -if (node) { -if ((perm_for_conn (conn, &node->perms) & perm) != perm) { - errno =EACCES ; - node =NULL ; - } +if (node && (perm_for_conn_from_node (conn, node) & perm) != perm) { + errno =EACCES ; + node =NULL ; }/* Clean up errno if they weren't supposed to know. */ if (!node && !read_node_can_propagate_errno ())
@@ -1211,19 +1210,18 @@ const char *onearg(struct buffered_data *in)return in->buffer; } -static char *perms_to_strings (const void *ctx,const struct node_perms *perms, -unsigned int *len) +static char *node_perms_to_strings (const struct node *node,unsigned int *len) {unsigned int i;char *strings =NULL ; char buffer[MAX_STRLEN(unsigned int) + 1]; -for (*len =0 , i =0 ; i < perms->num; i++) { -if (!xenstore_perm_to_string (&perms->p[i], buffer, +for (*len =0 , i =0 ; i < node->num_perms; i++) { +if (!xenstore_perm_to_string (&node->perms[i], buffer,sizeof (buffer)))return NULL ; - strings =talloc_realloc (ctx, strings, char, + strings =talloc_realloc (node, strings, char, *len +strlen (buffer) +1 );if (!strings)return NULL ;
@@ -1438,14 +1436,14 @@ static struct node *construct_node(struct connection *conn, const void *ctx, node->name =talloc_steal (node, names[levels -1 ]);/* Inherit permissions, unpriv domains own what they create. */ - node->perms.num = parent->perms.num; - node->perms.p =talloc_memdup (node, parent->perms.p, - node->perms.num * -sizeof (*node->perms.p)); -if (!node->perms.p) + node->num_perms = parent->num_perms; + node->perms =talloc_memdup (node, parent->perms, + node->num_perms * +sizeof (*node->perms)); +if (!node->perms) goto nomem;if (domain_is_unprivileged (conn)) - node->perms.p[0 ].id = conn->id; + node->perms[0 ].id = conn->id;/* No children, no data */ node->children = node->data =NULL ;
@@ -1773,7 +1771,7 @@ static int do_get_perms(const void *ctx, struct connection *conn,if (!node)return errno; - strings =perms_to_strings (node, &node->perms, &len); + strings =node_perms_to_strings (node, &len);if (!strings)return errno;
@@ -1822,10 +1820,10 @@ static int do_set_perms(const void *ctx, struct connection *conn, perms.p[0].id != get_node_owner(node))return EPERM ; - old_perms = node->perms; +node_to_node_perms (node, &old_perms);if (domain_nbentry_dec (conn,get_node_owner (node)))return ENOMEM ; - node->perms = perms; +node_perms_to_node (&perms, node);if (domain_nbentry_inc (conn,get_node_owner (node)))return ENOMEM ;
@@ -2344,8 +2342,8 @@ static void manual_node(const char *name, const char *child)barf_perror ("Could not allocate initial node %s" , name); node->name = name; - node->perms.p = &perms; - node->perms.num =1 ; + node->perms = &perms; + node->num_perms =1 ; node->children = (char *)child;if (child) node->childlen =strlen (child) +1 ;
@@ -3216,10 +3214,10 @@ static int dump_state_node(const void *ctx, struct connection *conn, sn.conn_id =0 ; sn.ta_id =0 ; sn.ta_access =0 ; - sn.perm_n = node->perms.num; + sn.perm_n = node->num_perms; sn.path_len = pathlen; sn.data_len = node->datalen; - head.length += node->perms.num *sizeof (*sn.perms); + head.length += node->num_perms *sizeof (*sn.perms); head.length += pathlen; head.length += node->datalen; head.length =ROUNDUP (head.length,3 );
@@ -3229,7 +3227,7 @@ static int dump_state_node(const void *ctx, struct connection *conn,if (fwrite (&sn,sizeof (sn),1 , fp) !=1 )return dump_state_node_err (data,"Dump node state error" ); - ret =dump_state_node_perms (fp, node->perms.p, node->perms.num); + ret =dump_state_node_perms (fp, node->perms, node->num_perms);if (ret)return dump_state_node_err (data, ret);
@@ -3426,29 +3424,29 @@ void read_state_node(const void *ctx, const void *state) node->data = name + sn->path_len; node->childlen =0 ; node->children =NULL ; - node->perms.num = sn->perm_n; - node->perms.p = talloc_array(node, struct xs_permissions, - node->perms.num); -if (!node->perms.p) + node->num_perms = sn->perm_n; + node->perms = talloc_array(node, struct xs_permissions, + node->num_perms); +if (!node->perms)barf ("allocation error restoring node" ); -for (i =0 ; i < node->perms.num; i++) { +for (i =0 ; i < node->num_perms; i++) {switch (sn->perms[i].access) {case 'r' : - node->perms.p[i].perms =XS_PERM_READ ; + node->perms[i].perms =XS_PERM_READ ;break ;case 'w' : - node->perms.p[i].perms =XS_PERM_WRITE ; + node->perms[i].perms =XS_PERM_WRITE ;break ;case 'b' : - node->perms.p[i].perms =XS_PERM_READ |XS_PERM_WRITE ; + node->perms[i].perms =XS_PERM_READ |XS_PERM_WRITE ;break ;default : - node->perms.p[i].perms =XS_PERM_NONE ; + node->perms[i].perms =XS_PERM_NONE ;break ; }if (sn->perms[i].flags &XS_STATE_NODE_PERM_IGNORE ) - node->perms.p[i].perms |=XS_PERM_IGNORE ; - node->perms.p[i].id = sn->perms[i].domid; + node->perms[i].perms |=XS_PERM_IGNORE ; + node->perms[i].id = sn->perms[i].domid; }if (!strstarts (name,"@" )) {
tools/xenstore/xenstored_core.h +29 -2
@@ -209,7 +209,8 @@ struct node {#define NO_GENERATION ~((uint64_t)0)/* Permissions. */ -struct node_perms perms; +unsigned int num_perms; +struct xs_permissions *perms;/* Contents. */ unsigned int datalen;
@@ -251,7 +252,33 @@ unsigned int perm_for_conn(struct connection *conn,/* Get owner of a node. */ static inline unsigned int get_node_owner (const struct node *node) { -return node->perms.p[0 ].id; +return node->perms[0 ].id; +} + +/* Transfer permissions from node to struct node_perms. */ +static inline void node_to_node_perms (const struct node *node, +struct node_perms *perms) +{ + perms->num = node->num_perms; + perms->p = node->perms; +} + +static inline unsigned int perm_for_conn_from_node (struct connection *conn, +const struct node *node) +{ +struct node_perms perms; + +node_to_node_perms (node, &perms); + +return perm_for_conn (conn, &perms); +} + +/* Transfer permissions from struct node_perms to node. */ +static inline void node_perms_to_node (const struct node_perms *perms, +struct node *node) +{ + node->num_perms = perms->num; + node->perms = perms->p; }/* Write a node to the data base. */
tools/xenstore/xenstored_domain.c +6 -7
@@ -513,12 +513,12 @@ static int domain_tree_remove_sub(const void *ctx, struct connection *conn,struct domain *domain = arg;int ret =WALK_TREE_OK ; -if (node->perms.p[0 ].id != domain->domid) +if (node->perms[0 ].id != domain->domid)return WALK_TREE_OK ;if (keep_orphans) {domain_nbentry_dec (NULL , domain->domid); - node->perms.p[0 ].id = priv_domid; + node->perms[0 ].id = priv_domid; node->acc.memory =0 ;domain_nbentry_inc (NULL , priv_domid);if (write_node_raw (NULL , node->name, node,NODE_MODIFY , true)) {
@@ -1335,12 +1335,11 @@ int domain_adjust_node_perms(struct node *node) {unsigned int i; -for (i =1 ; i < node->perms.num; i++) { -if (node->perms.p[i].perms &XS_PERM_IGNORE ) +for (i =1 ; i < node->num_perms; i++) { +if (node->perms[i].perms &XS_PERM_IGNORE )continue ; -if (!chk_domain_generation (node->perms.p[i].id, - node->generation)) - node->perms.p[i].perms |=XS_PERM_IGNORE ; +if (!chk_domain_generation (node->perms[i].id, node->generation)) + node->perms[i].perms |=XS_PERM_IGNORE ; }return 0 ;
tools/xenstore/xenstored_transaction.c +4 -4
@@ -259,13 +259,13 @@ int access_node(struct connection *conn, struct node *node,if (!i->trans_name) goto nomem; i->node =strchr (i->trans_name,'/' ) +1 ; -if (node->generation !=NO_GENERATION && node->perms.num) { +if (node->generation !=NO_GENERATION && node->num_perms) { i->perms.p = talloc_array(i, struct xs_permissions, - node->perms.num); + node->num_perms);if (!i->perms.p) goto nomem; - i->perms.num = node->perms.num; -memcpy (i->perms.p, node->perms.p, + i->perms.num = node->num_perms; +memcpy (i->perms.p, node->perms, i->perms.num *sizeof (*i->perms.p)); }
tools/xenstore/xenstored_watch.c +2 -2
@@ -92,7 +92,7 @@ static bool watch_permitted(struct connection *conn, const void *ctx,return false; } - perm =perm_for_conn (conn, &node->perms); + perm =perm_for_conn_from_node (conn, node);if (perm &XS_PERM_READ )return true;
@@ -106,7 +106,7 @@ static bool watch_permitted(struct connection *conn, const void *ctx,return false; } - perm =perm_for_conn (conn, &parent->perms); + perm =perm_for_conn_from_node (conn, parent);return perm &XS_PERM_READ ; }
Signature · 1 line
2.35.3
Re: [PATCH v4 10/19] tools/xenstore: don't use struct node_perms in struct node
Hi Juergen,
Quoted 11 lines · Juergen Gross
Open code struct
node_permsin struct node in order to prepare using structnode_hdrin struct node.Add two helpers to transfer permissions between struct node and struct
node_permsand a helper to directly get connection base permissions from a node.Let
perms_to_strings()take a struct node as parameter and rename it tonode_perms_to_strings().Signed-off-by Juergen Gross <[email protected]>
Cheers,
Signature · 1 line
Julien Grall
PATCH v4 11/19 tools/xenstore: use struct node_hdr in struct node
In reply to Juergen GrossReplace some individual fields in struct node with struct node_hdr.
This allows to add a helper for calculating the accounted memory size of a node.
---
V2:
- new patch
V4:
- add const to parameter of calc_node_acc_size()
- modify comment (Julien Grall)
--- tools/xenstore/xenstored_core.c | 110 ++++++++++++------------- tools/xenstore/xenstored_core.h | 16 ++-- tools/xenstore/xenstored_domain.c | 5 +- tools/xenstore/xenstored_transaction.c | 13 +-- 4 files changed, 72 insertions(+), 72 deletions(-)
tools/xenstore/xenstored_core.c +55 -55
@@ -555,6 +555,12 @@ static void initialize_fds(int *p_sock_pollfd_idx, int *ptimeout) } } +static size_t calc_node_acc_size (const struct node_hdr *hdr) +{ +return sizeof (*hdr) + hdr->num_perms *sizeof (struct xs_permissions ) + + hdr->datalen + hdr->childlen; +} +const struct node_hdr *db_fetch (const char *db_name,size_t *size) {const struct node_hdr *hdr;
@@ -565,8 +571,7 @@ const struct node_hdr *db_fetch(const char *db_name, size_t *size)return NULL ; } - *size =sizeof (*hdr) + hdr->num_perms *sizeof (struct xs_permissions ) + - hdr->datalen + hdr->childlen; + *size =calc_node_acc_size (hdr);trace_tdb ("read %s size %zu\n" , db_name, *size +strlen (db_name));
@@ -726,7 +731,7 @@ struct node *read_node(struct connection *conn, const void *ctx, hdr =db_fetch (db_name, &size);if (hdr ==NULL ) { - node->generation =NO_GENERATION ; + node->hdr.generation =NO_GENERATION ; err =access_node (conn, node,NODE_ACCESS_READ ,NULL ); errno = err ? :ENOENT ; goto error;
@@ -735,10 +740,7 @@ struct node *read_node(struct connection *conn, const void *ctx, node->parent =NULL ;/* Datalen, childlen, number of permissions */ - node->generation = hdr->generation; - node->num_perms = hdr->num_perms; - node->datalen = hdr->datalen; - node->childlen = hdr->childlen; + node->hdr = *hdr; node->acc.domid =perms_from_node_hdr (hdr)->id; node->acc.memory = size;
@@ -760,7 +762,7 @@ struct node *read_node(struct connection *conn, const void *ctx,/* Data is binary blob (usually ascii, no nul). */ node->data = node->perms + hdr->num_perms;/* Children is strings, nul separated. */ - node->children = node->data + node->datalen; + node->children = node->data + node->hdr.datalen;if (access_node (conn, node,NODE_ACCESS_READ ,NULL )) goto error;
@@ -796,9 +798,7 @@ int write_node_raw(struct connection *conn, const char *db_name,if (domain_adjust_node_perms (node))return errno; - size =sizeof (*hdr) - + node->num_perms *sizeof (node->perms[0 ]) - + node->datalen + node->childlen; + size =calc_node_acc_size (&node->hdr);/* Call domain_max_chk() in any case in order to record max values. */ if (domain_max_chk (conn,ACC_NODESZ , size) && !no_quota_check) {
@@ -815,18 +815,15 @@ int write_node_raw(struct connection *conn, const char *db_name,BUILD_BUG_ON (XENSTORE_PAYLOAD_MAX >= (typeof (hdr->datalen))(-1 )); hdr = data; - hdr->generation = node->generation; - hdr->num_perms = node->num_perms; - hdr->datalen = node->datalen; - hdr->childlen = node->childlen; + *hdr = node->hdr;/* Open code perms_from_node_hdr() for the non-const case. */ p = hdr +1 ; -memcpy (p, node->perms, node->num_perms *sizeof (*node->perms)); - p += node->num_perms *sizeof (*node->perms); -memcpy (p, node->data, node->datalen); - p += node->datalen; -memcpy (p, node->children, node->childlen); +memcpy (p, node->perms, node->hdr.num_perms *sizeof (*node->perms)); + p += node->hdr.num_perms *sizeof (*node->perms); +memcpy (p, node->data, node->hdr.datalen); + p += node->hdr.datalen; +memcpy (p, node->children, node->hdr.childlen);if (db_write (conn, db_name, data, size, &node->acc, mode, no_quota_check))
@@ -1216,7 +1213,7 @@ static char *node_perms_to_strings(const struct node *node, unsigned int *len)char *strings =NULL ; char buffer[MAX_STRLEN(unsigned int) + 1]; -for (*len =0 , i =0 ; i < node->num_perms; i++) { +for (*len =0 , i =0 ; i < node->hdr.num_perms; i++) {if (!xenstore_perm_to_string (&node->perms[i], buffer,sizeof (buffer)))return NULL ;
@@ -1287,7 +1284,7 @@ static int send_directory(const void *ctx, struct connection *conn,if (!node)return errno; -send_reply (conn,XS_DIRECTORY , node->children, node->childlen); +send_reply (conn,XS_DIRECTORY , node->children, node->hdr.childlen);return 0 ; }
@@ -1312,10 +1309,11 @@ static int send_directory_part(const void *ctx, struct connection *conn,/* Second arg is childlist offset. */ off =atoi (in->buffer +strlen (in->buffer) +1 ); - genlen =snprintf (gen,sizeof (gen),"%" PRIu64, node->generation) +1 ; + genlen =snprintf (gen,sizeof (gen),"%" PRIu64, node->hdr.generation) + +1 ;/* Offset behind list: just return a list with an empty string. */ -if (off >= node->childlen) { +if (off >= node->hdr.childlen) { gen[genlen] =0 ;send_reply (conn,XS_DIRECTORY_PART , gen, genlen +1 );return 0 ;
@@ -1328,7 +1326,7 @@ static int send_directory_part(const void *ctx, struct connection *conn,while (len +strlen (child) < maxlen) { len +=strlen (child) +1 ; child +=strlen (child) +1 ; -if (off + len == node->childlen) +if (off + len == node->hdr.childlen)break ; }
@@ -1338,7 +1336,7 @@ static int send_directory_part(const void *ctx, struct connection *conn,memcpy (data, gen, genlen);memcpy (data + genlen, node->children + off, len); -if (off + len == node->childlen) { +if (off + len == node->hdr.childlen) { data[genlen + len] =0 ; len++; }
@@ -1358,7 +1356,7 @@ static int do_read(const void *ctx, struct connection *conn,if (!node)return errno; -send_reply (conn,XS_READ , node->data, node->datalen); +send_reply (conn,XS_READ , node->data, node->hdr.datalen);return 0 ; }
@@ -1377,13 +1375,13 @@ static int add_child(const void *ctx, struct node *parent, const char *name) base =basename (name); baselen =strlen (base) +1 ; - children =talloc_array (ctx, char, parent->childlen + baselen); + children =talloc_array (ctx, char, parent->hdr.childlen + baselen);if (!children)return ENOMEM ; -memcpy (children, parent->children, parent->childlen); -memcpy (children + parent->childlen, base, baselen); +memcpy (children, parent->children, parent->hdr.childlen); +memcpy (children + parent->hdr.childlen, base, baselen); parent->children = children; - parent->childlen += baselen; + parent->hdr.childlen += baselen;return 0 ; }
@@ -1436,9 +1434,9 @@ static struct node *construct_node(struct connection *conn, const void *ctx, node->name =talloc_steal (node, names[levels -1 ]);/* Inherit permissions, unpriv domains own what they create. */ - node->num_perms = parent->num_perms; + node->hdr.num_perms = parent->hdr.num_perms; node->perms =talloc_memdup (node, parent->perms, - node->num_perms * + node->hdr.num_perms *sizeof (*node->perms));if (!node->perms) goto nomem;
@@ -1447,7 +1445,7 @@ static struct node *construct_node(struct connection *conn, const void *ctx,/* No children, no data */ node->children = node->data =NULL ; - node->childlen = node->datalen =0 ; + node->hdr.childlen = node->hdr.datalen =0 ; node->acc.memory =0 ; node->parent = parent;
@@ -1499,7 +1497,7 @@ static struct node *create_node(struct connection *conn, const void *ctx,ta_node_created (conn->transaction); node->data = data; - node->datalen = datalen; + node->hdr.datalen = datalen;/* * We write out the nodes bottom up.
@@ -1579,7 +1577,7 @@ static int do_write(const void *ctx, struct connection *conn,return errno; }else { node->data = in->buffer + offset; - node->datalen = datalen; + node->hdr.datalen = datalen;if (write_node (conn, node,NODE_MODIFY , false))return errno; }
@@ -1627,8 +1625,8 @@ static int remove_child_entry(struct connection *conn, struct node *node, {size_t childlen =strlen (node->children + offset); -memdel (node->children, offset, childlen +1 , node->childlen); - node->childlen -= childlen +1 ; +memdel (node->children, offset, childlen +1 , node->hdr.childlen); + node->hdr.childlen -= childlen +1 ;return write_node (conn, node,NODE_MODIFY , true); }
@@ -1638,8 +1636,9 @@ static int delete_child(struct connection *conn, {unsigned int i; -for (i =0 ; i < node->childlen; i +=strlen (node->children+i) +1 ) { -if (streq (node->children+i, childname)) { +for (i =0 ; i < node->hdr.childlen; + i +=strlen (node->children + i) +1 ) { +if (streq (node->children + i, childname)) { errno =remove_child_entry (conn, node, i) ?EIO :0 ;return errno; }
@@ -1906,7 +1905,7 @@ int walk_node_tree(const void *ctx, struct connection *conn, const char *root,/* node == NULL possible only for the initial loop iteration. */ if (node) {/* Go one step up if ret or if last child finished. */ -if (ret || node->childoff >= node->childlen) { +if (ret || node->childoff >= node->hdr.childlen) { parent = node->parent;/* Call function AFTER processing a node. */ ret = walk_call_func(ctx, conn, node, parent,
@@ -2343,10 +2342,10 @@ static void manual_node(const char *name, const char *child) node->name = name; node->perms = &perms; - node->num_perms =1 ; + node->hdr.num_perms =1 ; node->children = (char *)child;if (child) - node->childlen =strlen (child) +1 ; + node->hdr.childlen =strlen (child) +1 ;if (write_node (NULL , node,NODE_CREATE , false))barf_perror ("Could not create initial node %s" , name);
@@ -3214,12 +3213,12 @@ static int dump_state_node(const void *ctx, struct connection *conn, sn.conn_id =0 ; sn.ta_id =0 ; sn.ta_access =0 ; - sn.perm_n = node->num_perms; + sn.perm_n = node->hdr.num_perms; sn.path_len = pathlen; - sn.data_len = node->datalen; - head.length += node->num_perms *sizeof (*sn.perms); + sn.data_len = node->hdr.datalen; + head.length += node->hdr.num_perms *sizeof (*sn.perms); head.length += pathlen; - head.length += node->datalen; + head.length += node->hdr.datalen; head.length =ROUNDUP (head.length,3 );if (fwrite (&head,sizeof (head),1 , fp) !=1 )
@@ -3227,14 +3226,15 @@ static int dump_state_node(const void *ctx, struct connection *conn,if (fwrite (&sn,sizeof (sn),1 , fp) !=1 )return dump_state_node_err (data,"Dump node state error" ); - ret =dump_state_node_perms (fp, node->perms, node->num_perms); + ret =dump_state_node_perms (fp, node->perms, node->hdr.num_perms);if (ret)return dump_state_node_err (data, ret);if (fwrite (node->name, pathlen,1 , fp) !=1 )return dump_state_node_err (data,"Dump node path error" ); -if (node->datalen &&fwrite (node->data, node->datalen,1 , fp) !=1 ) +if (node->hdr.datalen && +fwrite (node->data, node->hdr.datalen,1 , fp) !=1 )return dump_state_node_err (data,"Dump node data error" ); ret =dump_state_align (fp);
@@ -3419,17 +3419,17 @@ void read_state_node(const void *ctx, const void *state) node->acc.memory =0 ; node->name = name; - node->generation = ++generation; - node->datalen = sn->data_len; + node->hdr.generation = ++generation; + node->hdr.datalen = sn->data_len; node->data = name + sn->path_len; - node->childlen =0 ; + node->hdr.childlen =0 ; node->children =NULL ; - node->num_perms = sn->perm_n; + node->hdr.num_perms = sn->perm_n; node->perms = talloc_array(node, struct xs_permissions, - node->num_perms); + node->hdr.num_perms);if (!node->perms)barf ("allocation error restoring node" ); -for (i =0 ; i < node->num_perms; i++) { +for (i =0 ; i < node->hdr.num_perms; i++) {switch (sn->perms[i].access) {case 'r' : node->perms[i].perms =XS_PERM_READ ;
tools/xenstore/xenstored_core.h +7 -9
@@ -181,6 +181,7 @@ extern struct list_head connections;*/ struct node_hdr {uint64_t generation; +#define NO_GENERATION ~((uint64_t)0)uint16_t num_perms;uint16_t datalen;uint32_t childlen;
@@ -197,6 +198,10 @@ struct node_account_data { };struct node { +/* Copied to/from data base. */ +struct node_hdr hdr; + +/* Xenstore path. */ const char *name;/* Name used to access data base. */ const char *db_name;
@@ -204,20 +209,13 @@ struct node {/* Parent (optional) */ struct node *parent; -/* Generation count. */ -uint64_t generation; -#define NO_GENERATION ~((uint64_t)0) -/* Permissions. */ -unsigned int num_perms;struct xs_permissions *perms;/* Contents. */ -unsigned int datalen;void *data;/* Children, each nul-terminated. */ -unsigned int childlen;unsigned int childoff;/* Used by walk_node_tree() internally. */ char *children;
@@ -259,7 +257,7 @@ static inline unsigned int get_node_owner(const struct node *node)static inline void node_to_node_perms (const struct node *node,struct node_perms *perms) { - perms->num = node->num_perms; + perms->num = node->hdr.num_perms; perms->p = node->perms; }
@@ -277,7 +275,7 @@ static inline unsigned int perm_for_conn_from_node(struct connection *conn,static inline void node_perms_to_node (const struct node_perms *perms,struct node *node) { - node->num_perms = perms->num; + node->hdr.num_perms = perms->num; node->perms = perms->p; }
tools/xenstore/xenstored_domain.c +3 -2
@@ -1335,10 +1335,11 @@ int domain_adjust_node_perms(struct node *node) {unsigned int i; -for (i =1 ; i < node->num_perms; i++) { +for (i =1 ; i < node->hdr.num_perms; i++) {if (node->perms[i].perms &XS_PERM_IGNORE )continue ; -if (!chk_domain_generation (node->perms[i].id, node->generation)) +if (!chk_domain_generation (node->perms[i].id, + node->hdr.generation)) node->perms[i].perms |=XS_PERM_IGNORE ; }
tools/xenstore/xenstored_transaction.c +7 -6
@@ -232,7 +232,7 @@ int access_node(struct connection *conn, struct node *node,bool introduce = false;if (type !=NODE_ACCESS_READ ) { - node->generation = ++generation; + node->hdr.generation = ++generation;if (conn && !conn->transaction)wrl_apply_debit_direct (conn); }
@@ -259,12 +259,13 @@ int access_node(struct connection *conn, struct node *node,if (!i->trans_name) goto nomem; i->node =strchr (i->trans_name,'/' ) +1 ; -if (node->generation !=NO_GENERATION && node->num_perms) { +if (node->hdr.generation !=NO_GENERATION && + node->hdr.num_perms) { i->perms.p = talloc_array(i, struct xs_permissions, - node->num_perms); + node->hdr.num_perms);if (!i->perms.p) goto nomem; - i->perms.num = node->num_perms; + i->perms.num = node->hdr.num_perms;memcpy (i->perms.p, node->perms, i->perms.num *sizeof (*i->perms.p)); }
@@ -282,9 +283,9 @@ int access_node(struct connection *conn, struct node *node,* from the write types. */ if (type ==NODE_ACCESS_READ ) { - i->generation = node->generation; + i->generation = node->hdr.generation; i->check_gen = true; -if (node->generation !=NO_GENERATION ) { +if (node->hdr.generation !=NO_GENERATION ) { ret =write_node_raw (conn, i->trans_name, node,NODE_CREATE , true);if (ret)
Signature · 1 line
2.35.3
Re: [PATCH v4 11/19] tools/xenstore: use struct node_hdr in struct node
Hi Juergen,
Quoted 6 lines · Juergen Gross
Replace some individual fields in struct node with struct
node_hdr.This allows to add a helper for calculating the accounted memory size of a node.
Signed-off-by Juergen Gross <[email protected]>
Cheers,
Signature · 1 line
Julien Grall
PATCH v4 12/19 tools/xenstore: alloc new memory in domain_adjust_node_perms()
In reply to Juergen GrossIn order to avoid modifying the node data in the data base in case a domain is gone, let domain_adjust_node_perms() allocate new memory for the permissions in case they need to be modified. As this should happen only in very rare cases, it is fine to do this even when having copied the node data already.
---
V3:
- new patch
V4:
- add comments (Julien Grall)
--- tools/xenstore/xenstored_core.c | 10 +++++----- tools/xenstore/xenstored_domain.c | 24 ++++++++++++++++++++---- tools/xenstore/xenstored_domain.h | 8 +++++++- 3 files changed, 32 insertions(+), 10 deletions(-)
tools/xenstore/xenstored_core.c +5 -5
@@ -752,6 +752,11 @@ struct node *read_node(struct connection *conn, const void *ctx, goto error; } +/* Data is binary blob (usually ascii, no nul). */ + node->data = node->perms + hdr->num_perms; +/* Children is strings, nul separated. */ + node->children = node->data + node->hdr.datalen; +if (domain_adjust_node_perms (node)) goto error;
@@ -759,11 +764,6 @@ struct node *read_node(struct connection *conn, const void *ctx,if (node->acc.domid !=get_node_owner (node)) node->acc.memory =0 ; -/* Data is binary blob (usually ascii, no nul). */ - node->data = node->perms + hdr->num_perms; -/* Children is strings, nul separated. */ - node->children = node->data + node->hdr.datalen; -if (access_node (conn, node,NODE_ACCESS_READ ,NULL )) goto error;
tools/xenstore/xenstored_domain.c +20 -4
@@ -1334,13 +1334,29 @@ int domain_alloc_permrefs(struct node_perms *perms)int domain_adjust_node_perms (struct node *node) {unsigned int i; +struct xs_permissions *perms = node->perms; +bool copied = false;for (i =1 ; i < node->hdr.num_perms; i++) { -if (node->perms[i].perms &XS_PERM_IGNORE ) +if ((perms[i].perms &XS_PERM_IGNORE ) || +chk_domain_generation (perms[i].id, node->hdr.generation))continue ; -if (!chk_domain_generation (node->perms[i].id, - node->hdr.generation)) - node->perms[i].perms |=XS_PERM_IGNORE ; + +/* +* Don't do a in-place modification, as the node might +* reference data directly in the data base, which we don't +* want to modify. +*/ +if (!copied) { + perms =talloc_memdup (node, node->perms, + node->hdr.num_perms *sizeof (*perms)); +if (!perms) +return ENOMEM ; + node->perms = perms; + copied = true; + } + + perms[i].perms |=XS_PERM_IGNORE ; }return 0 ;
tools/xenstore/xenstored_domain.h +7 -1
@@ -90,8 +90,14 @@ void ignore_connection(struct connection *conn, unsigned int err);/* Returns the implicit path of a connection (only domains have this) */ const char *get_implicit_path (const struct connection *conn); -/* Remove node permissions for no longer existing domains. */ +/* +* Remove node permissions for no longer existing domains. +* In case of a change of permissions the related array is reallocated in +* order to avoid a data base change when operating on a node directly +* referencing the data base contents. +*/ int domain_adjust_node_perms (struct node *node); +int domain_alloc_permrefs (struct node_perms *perms);/* Quota manipulation */
Signature · 1 line
2.35.3
Re: [PATCH v4 12/19]tools/xenstore: alloc new memory in domain_adjust_node_perms()
Hi Juergen,
Quoted 7 lines · Juergen Gross
In order to avoid modifying the node data in the data base in case a domain is gone, let
domain_adjust_node_perms()allocate new memory for the permissions in case they need to be modified. As this should happen only in very rare cases, it is fine to do this even when having copied the node data already.Signed-off-by Juergen Gross <[email protected]>
Cheers,
Signature · 1 line
Julien Grall
PATCH v4 13/19 tools/xenstore: introduce read_node_const()
In reply to Juergen GrossIntroduce a read_node() variant returning a pointer to const struct node, which doesn't do a copy of the node data after retrieval from the data base.
Call this variant where appropriate.
---
V3:
- new approach (Julien Grall)
V4:
- fix patch subject (Julien Grall)
- let read_node_helper() return a bool (Julien Grall)
--- tools/xenstore/xenstored_core.c | 105 ++++++++++++++++++++++-------- tools/xenstore/xenstored_core.h | 2 + tools/xenstore/xenstored_domain.c | 4 +- tools/xenstore/xenstored_watch.c | 10 +-- tools/xenstore/xenstored_watch.h | 3 +- 5 files changed, 90 insertions(+), 34 deletions(-)
tools/xenstore/xenstored_core.c +79 -26
@@ -706,11 +706,11 @@ void db_delete(struct connection *conn, const char *name,* If it fails, returns NULL and sets errno. * Temporary memory allocations will be done with ctx. */ -struct node *read_node (struct connection *conn,const void *ctx, -const char *name) +static struct node *read_node_alloc (struct connection *conn,const void *ctx, +const char *name, +const struct node_hdr **hdr) {size_t size; -const struct node_hdr *hdr;struct node *node;const char *db_name;int err;
@@ -720,17 +720,16 @@ struct node *read_node(struct connection *conn, const void *ctx, errno =ENOMEM ;return NULL ; } + node->name =talloc_strdup (node, name);if (!node->name) { -talloc_free (node); errno =ENOMEM ; -return NULL ; + goto error; } db_name =transaction_prepend (conn, name); - hdr =db_fetch (db_name, &size); - -if (hdr ==NULL ) { + *hdr =db_fetch (db_name, &size); +if (*hdr ==NULL ) { node->hdr.generation =NO_GENERATION ; err =access_node (conn, node,NODE_ACCESS_READ ,NULL ); errno = err ? :ENOENT ;
@@ -740,31 +739,80 @@ struct node *read_node(struct connection *conn, const void *ctx, node->parent =NULL ;/* Datalen, childlen, number of permissions */ - node->hdr = *hdr; - node->acc.domid =perms_from_node_hdr (hdr)->id; + node->hdr = **hdr; + node->acc.domid =perms_from_node_hdr (*hdr)->id; node->acc.memory = size; -/* Copy node data to new memory area, starting with permissions. */ - size -=sizeof (*hdr); - node->perms =talloc_memdup (node,perms_from_node_hdr (hdr), size); -if (node->perms ==NULL ) { - errno =ENOMEM ; - goto error; - } +return node; + + error: +talloc_free (node); +return NULL ; +} +static bool read_node_helper (struct connection *conn,struct node *node) +{/* Data is binary blob (usually ascii, no nul). */ - node->data = node->perms + hdr->num_perms; + node->data = node->perms + node->hdr.num_perms;/* Children is strings, nul separated. */ node->children = node->data + node->hdr.datalen;if (domain_adjust_node_perms (node)) - goto error; +return false;/* If owner is gone reset currently accounted memory size. */ if (node->acc.domid !=get_node_owner (node)) node->acc.memory =0 ;if (access_node (conn, node,NODE_ACCESS_READ ,NULL )) +return false; + +return true; +} + +struct node *read_node (struct connection *conn,const void *ctx, +const char *name) +{ +size_t size; +const struct node_hdr *hdr; +struct node *node; + + node =read_node_alloc (conn, ctx, name, &hdr); +if (!node) +return NULL ; + +/* Copy node data to new memory area, starting with permissions. */ + size = node->acc.memory -sizeof (*hdr); + node->perms =talloc_memdup (node,perms_from_node_hdr (hdr), size); +if (node->perms ==NULL ) { + errno =ENOMEM ; + goto error; + } + +if (!read_node_helper (conn, node)) + goto error; + +return node; + + error: +talloc_free (node); +return NULL ; +} + +const struct node *read_node_const (struct connection *conn,const void *ctx, +const char *name) +{ +const struct node_hdr *hdr; +struct node *node; + + node =read_node_alloc (conn, ctx, name, &hdr); +if (!node) +return NULL ; + +/* Unfortunately node->perms isn't const. */ + node->perms = (void *)perms_from_node_hdr (hdr); + +if (!read_node_helper (conn, node)) goto error;return node;
@@ -900,13 +948,13 @@ char *get_parent(const void *ctx, const char *node)static int ask_parents (struct connection *conn,const void *ctx,const char *name,unsigned int *perm) { -struct node *node; +const struct node *node; do { name = get_parent(ctx, name); if (!name) return errno; - node = read_node(conn, ctx, name); + node = read_node_const(conn, ctx, name); if (node) break; if (read_node_can_propagate_errno())
@@ -3197,9 +3245,8 @@ static int dump_state_node_err(struct dump_node_data *data, const char *err) }static int dump_state_node (const void *ctx,struct connection *conn, -struct node *node,void *arg) +const struct node *node,struct dump_node_data *data) { -struct dump_node_data *data = arg;FILE *fp = data->fp;unsigned int pathlen;struct xs_state_record_header head;
@@ -3244,14 +3291,20 @@ static int dump_state_node(const void *ctx, struct connection *conn,return WALK_TREE_OK ; } +static int dump_state_node_enter (const void *ctx,struct connection *conn, +struct node *node,void *arg) +{ +return dump_state_node (ctx, conn, node, arg); +} +static int dump_state_special_node (FILE *fp,const void *ctx,struct dump_node_data *data,const char *name) { -struct node *node; +const struct node *node;int ret; - node =read_node (NULL , ctx, name); + node =read_node_const (NULL , ctx, name);if (!node)return dump_state_node_err (data,"Dump node read node error" );
@@ -3267,7 +3320,7 @@ const char *dump_state_nodes(FILE *fp, const void *ctx) .fp = fp, .err = "Dump node walk error" }; -struct walk_funcs walkfuncs = { .enter = dump_state_node }; +struct walk_funcs walkfuncs = { .enter = dump_state_node_enter };if (walk_node_tree (ctx,NULL ,"/" , &walkfuncs, &data))return data.err;
tools/xenstore/xenstored_core.h +2 -0
@@ -292,6 +292,8 @@ int write_node_raw(struct connection *conn, const char *db_name,/* Get a node from the data base. */ struct node *read_node (struct connection *conn,const void *ctx,const char *name); +const struct node *read_node_const (struct connection *conn,const void *ctx, +const char *name);/* Remove a node and its children. */ int rm_node (struct connection *conn,const void *ctx,const char *name);
tools/xenstore/xenstored_domain.c +2 -2
@@ -563,12 +563,12 @@ static void domain_tree_remove(struct domain *domain)static void fire_special_watches (const char *name) {void *ctx =talloc_new (NULL ); -struct node *node; +const struct node *node;if (!ctx)return ; - node =read_node (NULL , ctx, name); + node =read_node_const (NULL , ctx, name);if (node)fire_watches (NULL , ctx, name, node, true,NULL );
tools/xenstore/xenstored_watch.c +5 -5
@@ -73,11 +73,11 @@ static const char *get_watch_path(const struct watch *watch, const char *name)* changed permissions we need to take the old permissions into account, too. */ static bool watch_permitted (struct connection *conn,const void *ctx, -const char *name,struct node *node, +const char *name,const struct node *node,struct node_perms *perms) {unsigned int perm; -struct node *parent; +const struct node *parent;char *parent_name;if (perms) {
@@ -87,7 +87,7 @@ static bool watch_permitted(struct connection *conn, const void *ctx, }if (!node) { - node =read_node (conn, ctx, name); + node =read_node_const (conn, ctx, name);if (!node)return false; }
@@ -101,7 +101,7 @@ static bool watch_permitted(struct connection *conn, const void *ctx, parent_name =get_parent (ctx, node->name);if (!parent_name)return false; - parent =read_node (conn, ctx, parent_name); + parent =read_node_const (conn, ctx, parent_name);if (!parent)return false; }
@@ -119,7 +119,7 @@ static bool watch_permitted(struct connection *conn, const void *ctx,* watch event, too. */ void fire_watches (struct connection *conn,const void *ctx,const char *name, -struct node *node,bool exact,struct node_perms *perms) +const struct node *node,bool exact,struct node_perms *perms) {struct connection *i;struct buffered_data *req;
tools/xenstore/xenstored_watch.h +2 -1
@@ -28,7 +28,8 @@ int do_unwatch(const void *ctx, struct connection *conn,/* Fire all watches: !exact means all the children are affected (ie. rm). */ void fire_watches (struct connection *conn,const void *tmp,const char *name, -struct node *node,bool exact,struct node_perms *perms); +const struct node *node,bool exact, +struct node_perms *perms);void conn_delete_all_watches (struct connection *conn);
Signature · 1 line
2.35.3
Re: [PATCH v4 13/19] tools/xenstore: introduce read_node_const()
Hi Juergen,
Quoted 7 lines · Juergen Gross
Introduce a
read_node()variant returning a pointer to const struct node, which doesn't do a copy of the node data after retrieval from the data base.Call this variant where appropriate.
Signed-off-by Juergen Gross <[email protected]>
Cheers,
Signature · 1 line
Julien Grall
PATCH v4 14/19 tools/xenstore: merge get_spec_node() into get_node_canonicalized()
In reply to Juergen GrossAdd a "allow_special" parameter to get_node_canonicalized() allowing to merge get_spec_node() into get_node_canonicalized().
Add the same parameter to is_valid_nodename(), as this will simplify check_watch_path().
This is done in preparation to introducing a get_node() variant returning a pointer to const struct node.
Note that this will change how special node names are going to be validated, as now the normal restrictions for node names will be applied:
- they can't end with "/"
- they can't contain "//"
- they can't contain characters other than the ones allowed for normal nodes
- the length of the node name is restricted by the max path length quota
For defined special node names this isn't any real restriction, though.
---
V3:
- new patch
V4:
- expand commit message (Julien Grall)
--- tools/xenstore/xenstored_core.c | 45 +++++++++++++------------------- tools/xenstore/xenstored_core.h | 3 ++- tools/xenstore/xenstored_watch.c | 19 +++++--------- 3 files changed, 26 insertions(+), 41 deletions(-)
tools/xenstore/xenstored_core.c +18 -27
@@ -1219,13 +1219,14 @@ static bool valid_chars(const char *node) "0123456789-/_@") == strlen(node)); } -bool is_valid_nodename (const struct connection *conn,const char *node) +bool is_valid_nodename (const struct connection *conn,const char *node, +bool allow_special) {int local_off =0 ;unsigned int domid; -/* Must start in /. */ -if (!strstarts (node,"/" )) +/* Must start in / or - if special nodes are allowed - in @. */ +if (!strstarts (node,"/" ) && (!allow_special || !strstarts (node,"@" )))return false;/* Cannot end in / (unless it's just "/"). */
@@ -1293,7 +1294,8 @@ static struct node *get_node_canonicalized(struct connection *conn,const void *ctx, const char *name, const char **canonical_name, - unsigned int perm) + unsigned int perm, + bool allow_special) { const char *tmp_name;
@@ -1302,33 +1304,20 @@ static struct node *get_node_canonicalized(struct connection *conn, *canonical_name =canonicalize (conn, ctx, name);if (!*canonical_name)return NULL ; -if (!is_valid_nodename (conn, *canonical_name)) { +if (!is_valid_nodename (conn, *canonical_name, allow_special)) { errno =EINVAL ;return NULL ; }return get_node (conn, ctx, *canonical_name, perm); } -static struct node *get_spec_node (struct connection *conn,const void *ctx, -const char *name,const char **canonical_name, -unsigned int perm) -{ -if (name[0 ] =='@' ) { -if (canonical_name) - *canonical_name = name; -return get_node (conn, ctx, name, perm); - } - -return get_node_canonicalized (conn, ctx, name, canonical_name, perm); -} -static int send_directory (const void *ctx,struct connection *conn,struct buffered_data *in) {struct node *node; node =get_node_canonicalized (conn, ctx,onearg (in),NULL , -XS_PERM_READ ); +XS_PERM_READ , false);if (!node)return errno;
@@ -1350,7 +1339,7 @@ static int send_directory_part(const void *ctx, struct connection *conn,/* First arg is node name. */ node =get_node_canonicalized (conn, ctx, in->buffer,NULL , -XS_PERM_READ ); +XS_PERM_READ , false);if (!node)return errno;
@@ -1400,7 +1389,7 @@ static int do_read(const void *ctx, struct connection *conn,struct node *node; node =get_node_canonicalized (conn, ctx,onearg (in),NULL , -XS_PERM_READ ); +XS_PERM_READ , false);if (!node)return errno;
@@ -1614,7 +1603,8 @@ static int do_write(const void *ctx, struct connection *conn, offset =strlen (vec[0 ]) +1 ; datalen = in->used - offset; - node =get_node_canonicalized (conn, ctx, vec[0 ], &name,XS_PERM_WRITE ); + node =get_node_canonicalized (conn, ctx, vec[0 ], &name,XS_PERM_WRITE , + false);if (!node) {/* No permissions, invalid input? */ if (errno !=ENOENT )
@@ -1643,7 +1633,7 @@ static int do_mkdir(const void *ctx, struct connection *conn,const char *name; node =get_node_canonicalized (conn, ctx,onearg (in), &name, -XS_PERM_WRITE ); +XS_PERM_WRITE , false);/* If it already exists, fine. */ if (!node) {
@@ -1773,7 +1763,7 @@ static int do_rm(const void *ctx, struct connection *conn,char *parentname; node =get_node_canonicalized (conn, ctx,onearg (in), &name, -XS_PERM_WRITE ); +XS_PERM_WRITE , false);if (!node) {/* Didn't exist already? Fine, if parent exists. */ if (errno ==ENOENT ) {
@@ -1814,7 +1804,8 @@ static int do_get_perms(const void *ctx, struct connection *conn,char *strings;unsigned int len; - node =get_spec_node (conn, ctx,onearg (in),NULL ,XS_PERM_READ ); + node =get_node_canonicalized (conn, ctx,onearg (in),NULL ,XS_PERM_READ , + true);if (!node)return errno;
@@ -1857,8 +1848,8 @@ static int do_set_perms(const void *ctx, struct connection *conn,return ENOENT ;/* We must own node to do this (tools can do this too). */ - node =get_spec_node (conn, ctx, in->buffer, &name, -XS_PERM_WRITE |XS_PERM_OWNER ); + node =get_node_canonicalized (conn, ctx, in->buffer, &name, +XS_PERM_WRITE |XS_PERM_OWNER , true);if (!node)return errno;
tools/xenstore/xenstored_core.h +2 -1
@@ -305,7 +305,8 @@ void check_store(void);void corrupt (struct connection *conn,const char *fmt, ...);/* Is this a valid node name? */ -bool is_valid_nodename (const struct connection *conn,const char *node); +bool is_valid_nodename (const struct connection *conn,const char *node, +bool allow_special);/* Get name of parent node. */ char *get_parent (const void *ctx,const char *node);
tools/xenstore/xenstored_watch.c +6 -13
@@ -163,19 +163,12 @@ static int destroy_watch(void *_watch)static int check_watch_path (struct connection *conn,const void *ctx,const char **path,bool *relative) { -/* Check if valid event. */ -if (strstarts (*path,"@" )) { - *relative = false; -if (strlen (*path) >XENSTORE_REL_PATH_MAX ) - goto inval; - }else { - *relative = !strstarts (*path,"/" ); - *path =canonicalize (conn, ctx, *path); -if (!*path) -return errno; -if (!is_valid_nodename (conn, *path)) - goto inval; - } + *relative = !strstarts (*path,"/" ) && !strstarts (*path,"@" ); + *path =canonicalize (conn, ctx, *path); +if (!*path) +return errno; +if (!is_valid_nodename (conn, *path, true)) + goto inval;return 0 ;
Signature · 1 line
2.35.3
Re: [PATCH v4 14/19] tools/xenstore: merge get_spec_node() into get_node_canonicalized()
Hi Juergen,
Quoted 20 lines · Juergen Gross
Add a "
allow_special" parameter toget_node_canonicalized()allowing to mergeget_spec_node()intoget_node_canonicalized().Add the same parameter to
is_valid_nodename(), as this will simplifycheck_watch_path().This is done in preparation to introducing a
get_node()variant returning a pointer to const struct node.Note that this will change how special node names are going to be validated, as now the normal restrictions for node names will be applied:
- they can't end with "/"
- they can't contain "//"
- they can't contain characters other than the ones allowed for normal nodes
- the length of the node name is restricted by the max path length quota
Quoted 3 lines
For defined special node names this isn't any real restriction, though.
Signed-off-by Juergen Gross <[email protected]>
Cheers,
Signature · 1 line
Julien Grall
PATCH v4 15/19 tools/xenstore: merge is_valid_nodename() into canonicalize()
In reply to Juergen GrossToday is_valid_nodename() is always called directly after calling canonicalize(), with the exception of do_unwatch(), where the call is missing (which is not correct, but results just in a wrong error reason being returned).
Merge is_valid_nodename() into canonicalize(). While at it merge valid_chars() into it, too.
---
V3:
- new patch
V4:
- make name const in canonicalize()
- don't merge valid_chars() (Julien Grall)
- free full path string in case of error (Julien Grall)
--- tools/xenstore/xenstored_core.c | 85 +++++++++++++++++--------------- tools/xenstore/xenstored_core.h | 6 +-- tools/xenstore/xenstored_watch.c | 16 ++---- 3 files changed, 50 insertions(+), 57 deletions(-)
tools/xenstore/xenstored_core.c +45 -40
@@ -1219,33 +1219,6 @@ static bool valid_chars(const char *node) "0123456789-/_@") == strlen(node)); } -bool is_valid_nodename (const struct connection *conn,const char *node, -bool allow_special) -{ -int local_off =0 ; -unsigned int domid; - -/* Must start in / or - if special nodes are allowed - in @. */ -if (!strstarts (node,"/" ) && (!allow_special || !strstarts (node,"@" ))) -return false; - -/* Cannot end in / (unless it's just "/"). */ -if (strends (node,"/" ) && !streq (node,"/" )) -return false; - -/* No double //. */ -if (strstr (node,"//" )) -return false; - -if (sscanf (node,"/local/domain/%5u/%n" , &domid, &local_off) !=1 ) - local_off =0 ; - -if (domain_max_chk (conn,ACC_PATHLEN ,strlen (node) - local_off)) -return false; - -return valid_chars (node); -} -/* We expect one arg in the input: return NULL otherwise. * The payload must contain exactly one nul, at the end. */
@@ -1278,16 +1251,51 @@ static char *node_perms_to_strings(const struct node *node, unsigned int *len) }const char *canonicalize (struct connection *conn,const void *ctx, -const char *node) +const char *node,bool allow_special) { -const char *prefix; +const char *name; +int local_off =0 ; +unsigned int domid; -if (!node || (node[0 ] =='/' ) || (node[0 ] =='@' )) -return node; - prefix =get_implicit_path (conn); -if (prefix) -return talloc_asprintf (ctx,"%s/%s" , prefix, node); -return node; +/* +* Invalid if any of: +* - no node at all +* - illegal character in node +* - starts with '@' but no special node allowed +*/ + errno =EINVAL ; +if (!node || + !valid_chars (node) || + (node[0 ] =='@' && !allow_special)) +return NULL ; + +if (node[0 ] !='/' && node[0 ] !='@' ) { + name =talloc_asprintf (ctx,"%s/%s" ,get_implicit_path (conn), + node); +if (!name) +return NULL ; + }else + name = node; + +if (sscanf (name,"/local/domain/%5u/%n" , &domid, &local_off) !=1 ) + local_off =0 ; + +/* +* Only valid if: +* - doesn't end in / (unless it's just "/") +* - no double // +* - not violating max allowed path length +*/ +if (!(strends (name,"/" ) && !streq (name,"/" )) && + !strstr (name,"//" ) && + !domain_max_chk (conn,ACC_PATHLEN ,strlen (name) - local_off)) +return name; + +/* Release the memory if 'name' was allocated by us. */ +if (name != node) +talloc_free (name); + +return NULL ; } static struct node *get_node_canonicalized(struct connection *conn,
@@ -1301,13 +1309,10 @@ static struct node *get_node_canonicalized(struct connection *conn,if (!canonical_name) canonical_name = &tmp_name; - *canonical_name =canonicalize (conn, ctx, name); + *canonical_name =canonicalize (conn, ctx, name, allow_special);if (!*canonical_name)return NULL ; -if (!is_valid_nodename (conn, *canonical_name, allow_special)) { - errno =EINVAL ; -return NULL ; - } +return get_node (conn, ctx, *canonical_name, perm); }
tools/xenstore/xenstored_core.h +1 -5
@@ -241,7 +241,7 @@ void send_ack(struct connection *conn, enum xsd_sockmsg_type type);/* Canonicalize this path if possible. */ const char *canonicalize (struct connection *conn,const void *ctx, -const char *node); +const char *node,bool allow_special);/* Get access permissions. */ unsigned int perm_for_conn(struct connection *conn,
@@ -304,10 +304,6 @@ struct connection *get_connection_by_id(unsigned int conn_id);void check_store (void );void corrupt (struct connection *conn,const char *fmt, ...); -/* Is this a valid node name? */ -bool is_valid_nodename (const struct connection *conn,const char *node, -bool allow_special); -/* Get name of parent node. */ char *get_parent (const void *ctx,const char *node);
tools/xenstore/xenstored_watch.c +4 -12
@@ -164,17 +164,9 @@ static int check_watch_path(struct connection *conn, const void *ctx, const char **path, bool *relative) { *relative = !strstarts (*path,"/" ) && !strstarts (*path,"@" ); - *path =canonicalize (conn, ctx, *path); -if (!*path) -return errno; -if (!is_valid_nodename (conn, *path, true)) - goto inval; - -return 0 ; + *path =canonicalize (conn, ctx, *path, true); - inval: - errno =EINVAL ; -return errno; +return *path ?0 : errno; } static struct watch *add_watch(struct connection *conn, const char *path,
@@ -258,9 +250,9 @@ int do_unwatch(const void *ctx, struct connection *conn,if (get_strings (in, vec,ARRAY_SIZE (vec)) !=ARRAY_SIZE (vec))return EINVAL ; - node =canonicalize (conn, ctx, vec[0 ]); + node =canonicalize (conn, ctx, vec[0 ], true);if (!node) -return ENOMEM ; +return errno;list_for_each_entry (watch, &conn->watches, list) {if (streq (watch->node, node) &&streq (watch->token, vec[1 ])) {list_del (&watch->list);
Signature · 1 line
2.35.3
Re: [PATCH v4 15/19] tools/xenstore: merge is_valid_nodename() into canonicalize()
Hi Juergen,
Quoted 7 lines · Juergen Gross
Today
is_valid_nodename()is always called directly after callingcanonicalize(), with the exception ofdo_unwatch(), where the call is missing (which is not correct, but results just in a wrong error reason being returned).Merge
is_valid_nodename()intocanonicalize(). While at it mergevalid_chars()into it, too.
You don't valid_chars() anymore. So the second sentence can be removed.
I can do the change while committing.
Quoted 2 lines
Signed-off-by Juergen Gross <[email protected]>
Cheers,
Signature · 1 line
Julien Grall
PATCH v4 16/19 tools/xenstore: rework get_node()
In reply to Juergen GrossToday get_node_canonicalized() is the only caller of get_node().
In order to prepare introducing a get_node() variant returning a pointer to const struct node, do the following restructuring:
- move the call of read_node() from get_node() into get_node_canonicalized()
- rename get_node() to get_node_chk_perm()
- rename get_node_canonicalized() to get_node()
---
V3:
- new patch
V4:
- change initial value of err in get_node_chk_perm() (Julien Grall)
- rename err to success in get_node_chk_perm() (Julien Grall)
--- tools/xenstore/xenstored_core.c | 57 +++++++++++++++------------------ 1 file changed, 25 insertions(+), 32 deletions(-)
tools/xenstore/xenstored_core.c +25 -32
@@ -1000,23 +1000,22 @@ static int errno_from_parents(struct connection *conn, const void *ctx,* If it fails, returns NULL and sets errno. * Temporary memory allocations are done with ctx. */ -static struct node *get_node (struct connection *conn, -const void *ctx, -const char *name, -unsigned int perm) +static bool get_node_chk_perm (struct connection *conn,const void *ctx, +const struct node *node,const char *name, +unsigned int perm) { -struct node *node; +bool success = node; - node =read_node (conn, ctx, name);/* If we don't have permission, we don't have node. */ if (node && (perm_for_conn_from_node (conn, node) & perm) != perm) { errno =EACCES ; - node =NULL ; + success = false; }/* Clean up errno if they weren't supposed to know. */ -if (!node && !read_node_can_propagate_errno ()) +if (!success && !read_node_can_propagate_errno ()) errno =errno_from_parents (conn, ctx, name, errno, perm); -return node; + +return success; }static struct buffered_data *new_buffer (void *ctx)
@@ -1298,14 +1297,12 @@ const char *canonicalize(struct connection *conn, const void *ctx,return NULL ; } -static struct node *get_node_canonicalized (struct connection *conn, -const void *ctx, -const char *name, -const char **canonical_name, -unsigned int perm, -bool allow_special) +static struct node *get_node (struct connection *conn,const void *ctx, +const char *name,const char **canonical_name, +unsigned int perm,bool allow_special) {const char *tmp_name; +struct node *node;if (!canonical_name) canonical_name = &tmp_name;
@@ -1313,7 +1310,10 @@ static struct node *get_node_canonicalized(struct connection *conn,if (!*canonical_name)return NULL ; -return get_node (conn, ctx, *canonical_name, perm); + node =read_node (conn, ctx, *canonical_name); + +return get_node_chk_perm (conn, ctx, node, *canonical_name, perm) + ? node :NULL ; } static int send_directory(const void *ctx, struct connection *conn,
@@ -1321,8 +1321,7 @@ static int send_directory(const void *ctx, struct connection *conn, {struct node *node; - node =get_node_canonicalized (conn, ctx,onearg (in),NULL , -XS_PERM_READ , false); + node =get_node (conn, ctx,onearg (in),NULL ,XS_PERM_READ , false);if (!node)return errno;
@@ -1343,8 +1342,7 @@ static int send_directory_part(const void *ctx, struct connection *conn,return EINVAL ;/* First arg is node name. */ - node =get_node_canonicalized (conn, ctx, in->buffer,NULL , -XS_PERM_READ , false); + node =get_node (conn, ctx, in->buffer,NULL ,XS_PERM_READ , false);if (!node)return errno;
@@ -1393,8 +1391,7 @@ static int do_read(const void *ctx, struct connection *conn, {struct node *node; - node =get_node_canonicalized (conn, ctx,onearg (in),NULL , -XS_PERM_READ , false); + node =get_node (conn, ctx,onearg (in),NULL ,XS_PERM_READ , false);if (!node)return errno;
@@ -1608,8 +1605,7 @@ static int do_write(const void *ctx, struct connection *conn, offset =strlen (vec[0 ]) +1 ; datalen = in->used - offset; - node =get_node_canonicalized (conn, ctx, vec[0 ], &name,XS_PERM_WRITE , - false); + node =get_node (conn, ctx, vec[0 ], &name,XS_PERM_WRITE , false);if (!node) {/* No permissions, invalid input? */ if (errno !=ENOENT )
@@ -1637,8 +1633,7 @@ static int do_mkdir(const void *ctx, struct connection *conn,struct node *node;const char *name; - node =get_node_canonicalized (conn, ctx,onearg (in), &name, -XS_PERM_WRITE , false); + node =get_node (conn, ctx,onearg (in), &name,XS_PERM_WRITE , false);/* If it already exists, fine. */ if (!node) {
@@ -1767,8 +1762,7 @@ static int do_rm(const void *ctx, struct connection *conn,const char *name;char *parentname; - node =get_node_canonicalized (conn, ctx,onearg (in), &name, -XS_PERM_WRITE , false); + node =get_node (conn, ctx,onearg (in), &name,XS_PERM_WRITE , false);if (!node) {/* Didn't exist already? Fine, if parent exists. */ if (errno ==ENOENT ) {
@@ -1809,8 +1803,7 @@ static int do_get_perms(const void *ctx, struct connection *conn,char *strings;unsigned int len; - node =get_node_canonicalized (conn, ctx,onearg (in),NULL ,XS_PERM_READ , - true); + node =get_node (conn, ctx,onearg (in),NULL ,XS_PERM_READ , true);if (!node)return errno;
@@ -1853,8 +1846,8 @@ static int do_set_perms(const void *ctx, struct connection *conn,return ENOENT ;/* We must own node to do this (tools can do this too). */ - node =get_node_canonicalized (conn, ctx, in->buffer, &name, -XS_PERM_WRITE |XS_PERM_OWNER , true); + node =get_node (conn, ctx, in->buffer, &name, +XS_PERM_WRITE |XS_PERM_OWNER , true);if (!node)return errno;
Signature · 1 line
2.35.3
Re: [PATCH v4 16/19] tools/xenstore: rework get_node()
Hi Juergen,
Quoted 5 lines · Juergen Gross
Today
get_node_canonicalized()is the only caller ofget_node().In order to prepare introducing a
get_node()variant returning a pointer to const struct node, do the following restructuring:
Quoted 8 lines
- move the call of
read_node()fromget_node()intoget_node_canonicalized()- rename
get_node()toget_node_chk_perm()- rename
get_node_canonicalized()toget_node()Signed-off-by Juergen Gross <[email protected]>
Cheers,
Signature · 1 line
Julien Grall
PATCH v4 17/19 tools/xenstore: introduce get_node_const()
In reply to Juergen GrossAdd a variant of get_node() returning a const struct node pointer.
Note that all callers of this new variant don't supply a pointer where to store the canonical node name, while all callers needing a non-const node do supply this pointer. This results in an asymmetric simplification of the two variants.
---
V3:
- new approach (Julien Grall)
--- tools/xenstore/xenstored_core.c | 35 ++++++++++++++++++++++----------- 1 file changed, 24 insertions(+), 11 deletions(-)
tools/xenstore/xenstored_core.c +24 -11
@@ -1301,11 +1301,8 @@ static struct node *get_node(struct connection *conn, const void *ctx, const char *name, const char **canonical_name, unsigned int perm, bool allow_special) { - const char *tmp_name; struct node *node; -if (!canonical_name) - canonical_name = &tmp_name; *canonical_name =canonicalize (conn, ctx, name, allow_special);if (!*canonical_name)return NULL ;
@@ -1316,12 +1313,28 @@ static struct node *get_node(struct connection *conn, const void *ctx, ? node : NULL; } +static const struct node *get_node_const (struct connection *conn, +const void *ctx,const char *name, +unsigned int perm,bool allow_special) +{ +const char *tmp_name; +const struct node *node; + + tmp_name =canonicalize (conn, ctx, name, allow_special); +if (!tmp_name) +return NULL ; + + node =read_node_const (conn, ctx, tmp_name); + +return get_node_chk_perm (conn, ctx, node, tmp_name, perm) ? node :NULL ; +} +static int send_directory (const void *ctx,struct connection *conn,struct buffered_data *in) { -struct node *node; +const struct node *node; - node =get_node (conn, ctx,onearg (in),NULL ,XS_PERM_READ , false); + node =get_node_const (conn, ctx,onearg (in),XS_PERM_READ , false);if (!node)return errno;
@@ -1335,14 +1348,14 @@ static int send_directory_part(const void *ctx, struct connection *conn, {unsigned int off, len, maxlen, genlen;char *child, *data; -struct node *node; +const struct node *node;char gen[24 ];if (xenstore_count_strings (in->buffer, in->used) !=2 )return EINVAL ;/* First arg is node name. */ - node =get_node (conn, ctx, in->buffer,NULL ,XS_PERM_READ , false); + node =get_node_const (conn, ctx, in->buffer,XS_PERM_READ , false);if (!node)return errno;
@@ -1389,9 +1402,9 @@ static int send_directory_part(const void *ctx, struct connection *conn,static int do_read (const void *ctx,struct connection *conn,struct buffered_data *in) { -struct node *node; +const struct node *node; - node =get_node (conn, ctx,onearg (in),NULL ,XS_PERM_READ , false); + node =get_node_const (conn, ctx,onearg (in),XS_PERM_READ , false);if (!node)return errno;
@@ -1799,11 +1812,11 @@ static int do_rm(const void *ctx, struct connection *conn,static int do_get_perms (const void *ctx,struct connection *conn,struct buffered_data *in) { -struct node *node; +const struct node *node;char *strings;unsigned int len; - node =get_node (conn, ctx,onearg (in),NULL ,XS_PERM_READ , true); + node =get_node_const (conn, ctx,onearg (in),XS_PERM_READ , true);if (!node)return errno;
Signature · 1 line
2.35.3
Re: [PATCH v4 17/19] tools/xenstore: introduce get_node_const()
Hi Juergen,
Quoted 8 lines · Juergen Gross
Add a variant of
get_node()returning a const struct node pointer.Note that all callers of this new variant don't supply a pointer where to store the canonical node name, while all callers needing a non-const node do supply this pointer. This results in an asymmetric simplification of the two variants.
Signed-off-by Juergen Gross <[email protected]>
Cheers,
Signature · 1 line
Julien Grall
PATCH v4 18/19 tools/config: add XEN_RUN_STORED to config.h
In reply to Juergen GrossInstead of adding the definition of XEN_RUN_STORED to CFLAGS in multiple Makefiles, let configure add it to tools/config.h instead.
---
V4:
- new patch
--- configure | 5 +++++ m4/paths.m4 | 1 + tools/config.h.in | 3 +++ tools/configure | 5 +++++ tools/libs/store/Makefile | 1 - tools/xenstore/Makefile.common | 1 - 6 files changed, 14 insertions(+), 2 deletions(-)
configure +5 -0
@@ -2079,6 +2079,11 @@ _ACEOF XEN_RUN_STORED=$rundir_path/xenstored +cat >>confdefs.h <<_ACEOF +#define XEN_RUN_STORED "$XEN_RUN_STORED" +_ACEOF + + XEN_LIB_DIR=$localstatedir/lib/xen
m4/paths.m4 +1 -0
@@ -138,6 +138,7 @@ AC_DEFINE_UNQUOTED([XEN_LOG_DIR], ["$XEN_LOG_DIR"], [Xen's log dir]) XEN_RUN_STORED=$rundir_path/xenstored AC_SUBST(XEN_RUN_STORED) +AC_DEFINE_UNQUOTED([XEN_RUN_STORED], ["$XEN_RUN_STORED"], [Xenstore's runstate path]) XEN_LIB_DIR=$localstatedir/lib/xen AC_SUBST(XEN_LIB_DIR)
tools/config.h.in +3 -0
@@ -153,6 +153,9 @@ /* Xen's script dir */ #undef XEN_SCRIPT_DIR +/* Xenstore's runstate path */ +#undef XEN_RUN_STORED + /* Enable large inode numbers on Mac OS X 10.5. */ #ifndef _DARWIN_USE_64_BIT_INODE # define _DARWIN_USE_64_BIT_INODE 1
tools/configure +5 -0
@@ -4060,6 +4060,11 @@ _ACEOF XEN_RUN_STORED=$rundir_path/xenstored +cat >>confdefs.h <<_ACEOF +#define XEN_RUN_STORED "$XEN_RUN_STORED" +_ACEOF + + XEN_LIB_DIR=$localstatedir/lib/xen
tools/libs/store/Makefile +0 -1
@@ -18,7 +18,6 @@ include ../libs.mk # Include configure output (config.h) CFLAGS += -include $(XEN_ROOT)/tools/config.h CFLAGS += $(CFLAGS_libxentoolcore) -CFLAGS += -DXEN_RUN_STORED="\"$(XEN_RUN_STORED)\"" xs.opic: CFLAGS += -DUSE_PTHREAD ifeq ($(CONFIG_Linux),y)
tools/xenstore/Makefile.common +0 -1
@@ -16,7 +16,6 @@ CFLAGS += $(CFLAGS_libxenevtchn) CFLAGS += $(CFLAGS_libxenctrl) CFLAGS += $(CFLAGS_libxenguest) CFLAGS += $(CFLAGS_libxentoolcore) -CFLAGS += -DXEN_RUN_STORED="\"$(XEN_RUN_STORED)\"" ifdef CONFIG_STUBDOM CFLAGS += -DNO_SOCKETS=1
Signature · 1 line
2.35.3
Re: [PATCH v4 18/19] tools/config: add XEN_RUN_STORED to config.h
Quoted 4 lines · Juergen Gross
Instead of adding the definition of
XEN_RUN_STOREDto CFLAGS in multiple Makefiles, let configure add it totools/config.hinstead.Signed-off-by Juergen Gross <[email protected]>
I think with this change, you could probably remove XEN_RUN_STORED from "config/Paths.mk.in".
In any case, patch looks fine:
Thanks,
Signature · 1 line
Anthony PERARD
Re: [PATCH v4 18/19] tools/config: add XEN_RUN_STORED to config.h
Quoted 8 lines · Anthony PERARD
Quoted 4 lines · Juergen Gross
Instead of adding the definition of
XEN_RUN_STOREDto CFLAGS in multiple Makefiles, let configure add it totools/config.hinstead.Signed-off-by Juergen Gross <[email protected]>I think with this change, you could probably remove
XEN_RUN_STOREDfrom "config/Paths.mk.in".
Ah, indeed. I'll send an updated patch (V4.1).
Quoted 3 lines
In any case, patch looks fine:
Reviewed-by Anthony PERARD <[email protected]>
Thanks,
Juergen
PATCH v4 18/19 tools/config: add XEN_RUN_STORED to config.h
In reply to Juergen GrossInstead of adding the definition of XEN_RUN_STORED to CFLAGS in multiple Makefiles, let configure add it to tools/config.h instead.
---
V4:
- new patch
V4.1:
- drop XEN_RUN_STORED from config/Paths.mk.in (Anthony PERARD)
--- config/Paths.mk.in | 1 - configure | 5 +++++ m4/paths.m4 | 1 + tools/config.h.in | 3 +++ tools/configure | 5 +++++ tools/libs/store/Makefile | 1 - tools/xenstore/Makefile.common | 1 - 7 files changed, 14 insertions(+), 3 deletions(-)
config/Paths.mk.in +0 -1
@@ -41,7 +41,6 @@ MAN8DIR := $(mandir)/man8 XEN_RUN_DIR := @XEN_RUN_DIR@ XEN_LOG_DIR := @XEN_LOG_DIR@ XEN_LIB_DIR := @XEN_LIB_DIR@ -XEN_RUN_STORED := @XEN_RUN_STORED@ CONFIG_DIR := @CONFIG_DIR@ INITD_DIR := @INITD_DIR@
configure +5 -0
@@ -2079,6 +2079,11 @@ _ACEOF XEN_RUN_STORED=$rundir_path/xenstored +cat >>confdefs.h <<_ACEOF +#define XEN_RUN_STORED "$XEN_RUN_STORED" +_ACEOF + + XEN_LIB_DIR=$localstatedir/lib/xen
m4/paths.m4 +1 -0
@@ -138,6 +138,7 @@ AC_DEFINE_UNQUOTED([XEN_LOG_DIR], ["$XEN_LOG_DIR"], [Xen's log dir]) XEN_RUN_STORED=$rundir_path/xenstored AC_SUBST(XEN_RUN_STORED) +AC_DEFINE_UNQUOTED([XEN_RUN_STORED], ["$XEN_RUN_STORED"], [Xenstore's runstate path]) XEN_LIB_DIR=$localstatedir/lib/xen AC_SUBST(XEN_LIB_DIR)
tools/config.h.in +3 -0
@@ -153,6 +153,9 @@ /* Xen's script dir */ #undef XEN_SCRIPT_DIR +/* Xenstore's runstate path */ +#undef XEN_RUN_STORED + /* Enable large inode numbers on Mac OS X 10.5. */ #ifndef _DARWIN_USE_64_BIT_INODE # define _DARWIN_USE_64_BIT_INODE 1
tools/configure +5 -0
@@ -4060,6 +4060,11 @@ _ACEOF XEN_RUN_STORED=$rundir_path/xenstored +cat >>confdefs.h <<_ACEOF +#define XEN_RUN_STORED "$XEN_RUN_STORED" +_ACEOF + + XEN_LIB_DIR=$localstatedir/lib/xen
tools/libs/store/Makefile +0 -1
@@ -18,7 +18,6 @@ include ../libs.mk # Include configure output (config.h) CFLAGS += -include $(XEN_ROOT)/tools/config.h CFLAGS += $(CFLAGS_libxentoolcore) -CFLAGS += -DXEN_RUN_STORED="\"$(XEN_RUN_STORED)\"" xs.opic: CFLAGS += -DUSE_PTHREAD ifeq ($(CONFIG_Linux),y)
tools/xenstore/Makefile.common +0 -1
@@ -16,7 +16,6 @@ CFLAGS += $(CFLAGS_libxenevtchn) CFLAGS += $(CFLAGS_libxenctrl) CFLAGS += $(CFLAGS_libxenguest) CFLAGS += $(CFLAGS_libxentoolcore) -CFLAGS += -DXEN_RUN_STORED="\"$(XEN_RUN_STORED)\"" ifdef CONFIG_STUBDOM CFLAGS += -DNO_SOCKETS=1
Signature · 1 line
2.35.3
PATCH v4 19/19 tools/xenstore: move xenstored sources into dedicated directory
In reply to Juergen GrossIn tools/xenstore there are living xenstored and xenstore clients. They are no longer sharing anything apart from the "xenstore" in their names.
Move the xenstored sources into a new directory tools/xenstored while dropping the "xenstored_" prefix from their names. This will make it clearer that xenstore clients and xenstored are independent from each other.
---
After the large overhaul of xenstored I think such a reorg would make sense to go into the same Xen version. Delaying it until the next version would make potential backports for 4.18 harder. V4:
- new patch
---
.gitignore | 2 +-
MAINTAINERS | 1 +
stubdom/Makefile | 4 +-
tools/Makefile | 1 +
tools/xenstore/Makefile | 30 ++----------
tools/xenstored/Makefile | 48 +++++++++++++++++++
tools/{xenstore => xenstored}/Makefile.common | 13 +++--
tools/{xenstore => xenstored}/README | 0
.../control.c} | 8 ++--
.../control.h} | 0
.../xenstored_core.c => xenstored/core.c} | 14 +++---
.../xenstored_core.h => xenstored/core.h} | 0
.../xenstored_domain.c => xenstored/domain.c} | 10 ++--
.../xenstored_domain.h => xenstored/domain.h} | 0
tools/{xenstore => xenstored}/hashtable.c | 0
tools/{xenstore => xenstored}/hashtable.h | 0
tools/{xenstore => xenstored}/list.h | 0
.../xenstored_lu.c => xenstored/lu.c} | 8 ++--
.../xenstored_lu.h => xenstored/lu.h} | 0
.../lu_daemon.c} | 4 +-
.../lu_minios.c} | 2 +-
.../xenstored_minios.c => xenstored/minios.c} | 2 +-
.../xenstored_osdep.h => xenstored/osdep.h} | 0
.../xenstored_posix.c => xenstored/posix.c} | 4 +-
tools/{xenstore => xenstored}/talloc.c | 0
tools/{xenstore => xenstored}/talloc.h | 0
.../{xenstore => xenstored}/talloc_guide.txt | 0
.../transaction.c} | 6 +--
.../transaction.h} | 2 +-
tools/{xenstore => xenstored}/utils.c | 0
tools/{xenstore => xenstored}/utils.h | 0
.../xenstored_watch.c => xenstored/watch.c} | 6 +--
.../xenstored_watch.h => xenstored/watch.h} | 2 +-
.../include => xenstored}/xenstore_state.h | 0
34 files changed, 98 insertions(+), 69 deletions(-)
create mode 100644 tools/xenstored/Makefile
rename tools/{xenstore => xenstored}/Makefile.common (50%)
rename tools/{xenstore => xenstored}/README (100%)
rename tools/{xenstore/xenstored_control.c => xenstored/control.c} (98%)
rename tools/{xenstore/xenstored_control.h => xenstored/control.h} (100%)
rename tools/{xenstore/xenstored_core.c => xenstored/core.c} (99%)
rename tools/{xenstore/xenstored_core.h => xenstored/core.h} (100%)
rename tools/{xenstore/xenstored_domain.c => xenstored/domain.c} (99%)
rename tools/{xenstore/xenstored_domain.h => xenstored/domain.h} (100%)
rename tools/{xenstore => xenstored}/hashtable.c (100%)
rename tools/{xenstore => xenstored}/hashtable.h (100%)
rename tools/{xenstore => xenstored}/list.h (100%)
rename tools/{xenstore/xenstored_lu.c => xenstored/lu.c} (98%)
rename tools/{xenstore/xenstored_lu.h => xenstored/lu.h} (100%)
rename tools/{xenstore/xenstored_lu_daemon.c => xenstored/lu_daemon.c} (97%)
rename tools/{xenstore/xenstored_lu_minios.c => xenstored/lu_minios.c} (98%)
rename tools/{xenstore/xenstored_minios.c => xenstored/minios.c} (97%)
rename tools/{xenstore/xenstored_osdep.h => xenstored/osdep.h} (100%)
rename tools/{xenstore/xenstored_posix.c => xenstored/posix.c} (98%)
rename tools/{xenstore => xenstored}/talloc.c (100%)
rename tools/{xenstore => xenstored}/talloc.h (100%)
rename tools/{xenstore => xenstored}/talloc_guide.txt (100%)
rename tools/{xenstore/xenstored_transaction.c => xenstored/transaction.c} (99%)
rename tools/{xenstore/xenstored_transaction.h => xenstored/transaction.h} (98%)
rename tools/{xenstore => xenstored}/utils.c (100%)
rename tools/{xenstore => xenstored}/utils.h (100%)
rename tools/{xenstore/xenstored_watch.c => xenstored/watch.c} (98%)
rename tools/{xenstore/xenstored_watch.h => xenstored/watch.h} (98%)
rename tools/{xenstore/include => xenstored}/xenstore_state.h (100%).gitignore +1 -1
@@ -247,7 +247,7 @@ tools/xenstore/xenstore-read tools/xenstore/xenstore-rm tools/xenstore/xenstore-watch tools/xenstore/xenstore-write -tools/xenstore/xenstored +tools/xenstored/xenstored tools/xentop/xentop tools/xentrace/xentrace_setsize tools/xentrace/tbctl
MAINTAINERS +1 -0
@@ -670,6 +670,7 @@ F: tools/include/xenstore_lib.h F: tools/include/xen-tools/xenstore-common.h F: tools/libs/store/ F: tools/xenstore/ +F: tools/xenstored/ XENTRACE M: George Dunlap <[email protected]>
stubdom/Makefile +2 -2
@@ -371,10 +371,10 @@ endef $(foreach lib,$(STUB_LIBS),$(eval $(call BUILD_lib,$(lib)))) -xenstore/stamp: $(XEN_ROOT)/tools/xenstore/Makefile.common +xenstore/stamp: $(XEN_ROOT)/tools/xenstored/Makefile.common $(do_links) -xenstorepvh/stamp: $(XEN_ROOT)/tools/xenstore/Makefile.common +xenstorepvh/stamp: $(XEN_ROOT)/tools/xenstored/Makefile.common $(do_links) LINK_DIRS := xenstore xenstorepvh $(foreach dir,$(STUB_LIBS),libs-$(XEN_TARGET_ARCH)/$(dir))
tools/Makefile +1 -0
@@ -9,6 +9,7 @@ SUBDIRS-y += libs SUBDIRS-y += flask SUBDIRS-y += fuzz SUBDIRS-y += xenstore +SUBDIRS-$(XENSTORE_XENSTORED) += xenstored SUBDIRS-y += misc SUBDIRS-y += examples SUBDIRS-y += hotplug
tools/xenstore/Makefile +5 -25
@@ -1,18 +1,11 @@ XEN_ROOT=$(CURDIR)/../.. include $(XEN_ROOT)/tools/Rules.mk -include Makefile.common - -xenstored: LDLIBS += $(LDLIBS_libxenevtchn) -xenstored: LDLIBS += $(LDLIBS_libxengnttab) -xenstored: LDLIBS += $(LDLIBS_libxenctrl) -xenstored: LDLIBS += -lrt -xenstored: LDLIBS += $(SOCKET_LIBS) - -ifeq ($(CONFIG_SYSTEMD),y) -$(XENSTORED_OBJS-y): CFLAGS += $(SYSTEMD_CFLAGS) -xenstored: LDLIBS += $(SYSTEMD_LIBS) -endif +CFLAGS += -include $(XEN_ROOT)/tools/config.h +CFLAGS += $(CFLAGS_libxenctrl) +CFLAGS += $(CFLAGS_libxenguest) +CFLAGS += $(CFLAGS_libxentoolcore) +CFLAGS += $(CFLAGS_libxenstore) xenstore: LDLIBS += $(LDLIBS_libxenstore) xenstore: LDLIBS += $(LDLIBS_libxentoolcore)
@@ -28,9 +21,6 @@ CLIENTS := xenstore-exists xenstore-list xenstore-read xenstore-rm xenstore-chmo CLIENTS += xenstore-write xenstore-ls xenstore-watch TARGETS := xenstore $(CLIENTS) xenstore-control -ifeq ($(XENSTORE_XENSTORED),y) -TARGETS += xenstored -endif .PHONY: all all: $(TARGETS)
@@ -38,9 +28,6 @@ all: $(TARGETS) .PHONY: clients clients: xenstore $(CLIENTS) xenstore-control -xenstored: $(XENSTORED_OBJS-y) - $(CC) $(LDFLAGS) $^ $(LDLIBS) -o $@ $(APPEND_LDFLAGS) - $(CLIENTS): xenstore ln -f xenstore $@
@@ -64,10 +51,6 @@ TAGS: .PHONY: install install: all $(INSTALL_DIR) $(DESTDIR)$(bindir) -ifeq ($(XENSTORE_XENSTORED),y) - $(INSTALL_DIR) $(DESTDIR)$(sbindir) - $(INSTALL_PROG) xenstored $(DESTDIR)$(sbindir) -endif $(INSTALL_PROG) xenstore-control $(DESTDIR)$(bindir) $(INSTALL_PROG) xenstore $(DESTDIR)$(bindir) set -e ; for c in $(CLIENTS) ; do \
@@ -79,9 +62,6 @@ uninstall: rm -f $(addprefix $(DESTDIR)$(bindir)/, $(CLIENTS)) rm -f $(DESTDIR)$(bindir)/xenstore rm -f $(DESTDIR)$(bindir)/xenstore-control -ifeq ($(XENSTORE_XENSTORED),y) - rm -f $(DESTDIR)$(sbindir)/xenstored -endif if [ -d $(DESTDIR)$(includedir)/xenstore-compat ]; then \ rmdir --ignore-fail-on-non-empty $(DESTDIR)$(includedir)/xenstore-compat; \ fi
tools/xenstored/Makefile new file +48 -0
48 lines not on this page · raw message
tools/xenstored/Makefile.common renamed from tools/xenstore/Makefile.common +6 -7
@@ -1,17 +1,16 @@ # Makefile shared with stubdom -XENSTORED_OBJS-y := xenstored_core.o xenstored_watch.o xenstored_domain.o -XENSTORED_OBJS-y += xenstored_transaction.o xenstored_control.o xenstored_lu.o +XENSTORED_OBJS-y := core.o watch.o domain.o +XENSTORED_OBJS-y += transaction.o control.o lu.o XENSTORED_OBJS-y += talloc.o utils.o hashtable.o -XENSTORED_OBJS-$(CONFIG_Linux) += xenstored_posix.o xenstored_lu_daemon.o -XENSTORED_OBJS-$(CONFIG_NetBSD) += xenstored_posix.o xenstored_lu_daemon.o -XENSTORED_OBJS-$(CONFIG_FreeBSD) += xenstored_posix.o xenstored_lu_daemon.o -XENSTORED_OBJS-$(CONFIG_MiniOS) += xenstored_minios.o xenstored_lu_minios.o +XENSTORED_OBJS-$(CONFIG_Linux) += posix.o lu_daemon.o +XENSTORED_OBJS-$(CONFIG_NetBSD) += posix.o lu_daemon.o +XENSTORED_OBJS-$(CONFIG_FreeBSD) += posix.o lu_daemon.o +XENSTORED_OBJS-$(CONFIG_MiniOS) += minios.o lu_minios.o # Include configure output (config.h) CFLAGS += -include $(XEN_ROOT)/tools/config.h -CFLAGS += -I./include CFLAGS += $(CFLAGS_libxenevtchn) CFLAGS += $(CFLAGS_libxenctrl) CFLAGS += $(CFLAGS_libxenguest)
tools/xenstored/README renamed from tools/xenstore/README +0 -0
tools/xenstored/control.c renamed from tools/xenstore/xenstored_control.c +4 -4
@@ -27,10 +27,10 @@#include "utils.h" #include "talloc.h" -#include "xenstored_core.h" -#include "xenstored_control.h" -#include "xenstored_domain.h" -#include "xenstored_lu.h" +#include "core.h" +#include "control.h" +#include "domain.h" +#include "lu.h" struct cmd_s {char *cmd;
tools/xenstored/control.h renamed from tools/xenstore/xenstored_control.h +0 -0
tools/xenstored/core.c renamed from tools/xenstore/xenstored_core.c +7 -7
@@ -47,12 +47,12 @@#include "utils.h" #include "list.h" #include "talloc.h" -#include "xenstored_core.h" -#include "xenstored_watch.h" -#include "xenstored_transaction.h" -#include "xenstored_domain.h" -#include "xenstored_control.h" -#include "xenstored_lu.h" +#include "core.h" +#include "watch.h" +#include "transaction.h" +#include "domain.h" +#include "control.h" +#include "lu.h" #ifndef NO_SOCKETS #if defined(HAVE_SYSTEMD )
@@ -64,7 +64,7 @@#include <systemd/sd-daemon.h> #endif -extern xenevtchn_handle *xce_handle;/* in xenstored_domain.c */ +extern xenevtchn_handle *xce_handle;/* in domain.c */ static int xce_pollfd_idx =-1 ;static struct pollfd *fds;static unsigned int current_array_size;
tools/xenstored/core.h renamed from tools/xenstore/xenstored_core.h +0 -0
tools/xenstored/domain.c renamed from tools/xenstore/xenstored_domain.c +5 -5
@@ -27,11 +27,11 @@#include "utils.h" #include "talloc.h" -#include "xenstored_core.h" -#include "xenstored_domain.h" -#include "xenstored_transaction.h" -#include "xenstored_watch.h" -#include "xenstored_control.h" +#include "core.h" +#include "domain.h" +#include "transaction.h" +#include "watch.h" +#include "control.h" #include <xenevtchn.h> #include <xenctrl.h>
tools/xenstored/domain.h renamed from tools/xenstore/xenstored_domain.h +0 -0
tools/xenstored/hashtable.c renamed from tools/xenstore/hashtable.c +0 -0
tools/xenstored/hashtable.h renamed from tools/xenstore/hashtable.h +0 -0
tools/xenstored/list.h renamed from tools/xenstore/list.h +0 -0
tools/xenstored/lu.c renamed from tools/xenstore/xenstored_lu.c +4 -4
@@ -13,10 +13,10 @@#include <time.h> #include "talloc.h" -#include "xenstored_core.h" -#include "xenstored_domain.h" -#include "xenstored_lu.h" -#include "xenstored_watch.h" +#include "core.h" +#include "domain.h" +#include "lu.h" +#include "watch.h" #ifndef NO_LIVE_UPDATE struct live_update *lu_status;
tools/xenstored/lu.h renamed from tools/xenstore/xenstored_lu.h +0 -0
tools/xenstored/lu_daemon.c renamed from tools/xenstore/xenstored_lu_daemon.c +2 -2
@@ -13,8 +13,8 @@#include <xen-tools/xenstore-common.h> #include "talloc.h" -#include "xenstored_core.h" -#include "xenstored_lu.h" +#include "core.h" +#include "lu.h" #ifndef NO_LIVE_UPDATE void lu_get_dump_state (struct lu_dump_state *state)
tools/xenstored/lu_minios.c renamed from tools/xenstore/xenstored_lu_minios.c +1 -1
@@ -14,7 +14,7 @@#include <xen-tools/common-macros.h> #include "talloc.h" -#include "xenstored_lu.h" +#include "lu.h" /* Mini-OS only knows about MAP_ANON. */ #ifndef MAP_ANONYMOUS
tools/xenstored/minios.c renamed from tools/xenstore/xenstored_minios.c +1 -1
@@ -17,7 +17,7 @@*/ #include <sys/types.h> #include <sys/mman.h> -#include "xenstored_core.h" +#include "core.h" #include <xen/grant_table.h> void write_pidfile (const char *pidfile)
tools/xenstored/osdep.h renamed from tools/xenstore/xenstored_osdep.h +0 -0
tools/xenstored/posix.c renamed from tools/xenstore/xenstored_posix.c +2 -2
@@ -24,8 +24,8 @@#include <sys/mman.h> #include "utils.h" -#include "xenstored_core.h" -#include "xenstored_osdep.h" +#include "core.h" +#include "osdep.h" void write_pidfile (const char *pidfile) {
tools/xenstored/talloc.c renamed from tools/xenstore/talloc.c +0 -0
tools/xenstored/talloc.h renamed from tools/xenstore/talloc.h +0 -0
tools/xenstored/talloc_guide.txt renamed from tools/xenstore/talloc_guide.txt +0 -0
tools/xenstored/transaction.c renamed from tools/xenstore/xenstored_transaction.c +3 -3
@@ -30,9 +30,9 @@#include <unistd.h> #include "talloc.h" #include "list.h" -#include "xenstored_transaction.h" -#include "xenstored_watch.h" -#include "xenstored_domain.h" +#include "transaction.h" +#include "watch.h" +#include "domain.h" #include "xenstore_lib.h" #include "utils.h"
tools/xenstored/transaction.h renamed from tools/xenstore/xenstored_transaction.h +1 -1
@@ -17,7 +17,7 @@*/ #ifndef _XENSTORED_TRANSACTION_H#define _XENSTORED_TRANSACTION_H -#include "xenstored_core.h" +#include "core.h" enum node_access_type { NODE_ACCESS_READ,
tools/xenstored/utils.c renamed from tools/xenstore/utils.c +0 -0
tools/xenstored/utils.h renamed from tools/xenstore/utils.h +0 -0
tools/xenstored/watch.c renamed from tools/xenstore/xenstored_watch.c +3 -3
@@ -25,11 +25,11 @@#include <assert.h> #include "talloc.h" #include "list.h" -#include "xenstored_watch.h" +#include "watch.h" #include "xenstore_lib.h" #include "utils.h" -#include "xenstored_domain.h" -#include "xenstored_transaction.h" +#include "domain.h" +#include "transaction.h" struct watch {
tools/xenstored/watch.h renamed from tools/xenstore/xenstored_watch.h +1 -1
@@ -19,7 +19,7 @@#ifndef _XENSTORED_WATCH_H#define _XENSTORED_WATCH_H -#include "xenstored_core.h" +#include "core.h" int do_watch (const void *ctx,struct connection *conn,struct buffered_data *in);
tools/xenstored/xenstore_state.h renamed from tools/xenstore/include/xenstore_state.h +0 -0
Signature · 1 line
2.35.3
Re: [PATCH v4 19/19] tools/xenstore: move xenstored sources into dedicated directory
Hi Juergen,
Quoted 8 lines · Juergen Gross
In
tools/xenstorethere are living xenstored and xenstore clients. They are no longer sharing anything apart from the "xenstore" in their names.Move the xenstored sources into a new directory
tools/xenstoredwhile dropping the "xenstored_" prefix from their names. This will make it clearer that xenstore clients and xenstored are independent from each other.
In term of naming, I would prefer if we follow what was done for the console. I.e:
xenstore/client: All the clients
xenstore/daemon: C Xenstored
This would avoid the one character difference between the two directories.
What do the other thinks?
Quoted 6 lines
Signed-off-by Juergen Gross <[email protected]>---
After the large overhaul of xenstored I think such a reorg would make sense to go into the same Xen version. Delaying it until the next version would make potential backports for 4.18 harder.
+1.
Cheers,
Signature · 1 line
Julien Grall
Re: [PATCH v4 19/19] tools/xenstore: move xenstored sources into dedicated directory
Quoted 12 lines · Julien Grall
Hi Juergen,
Quoted 8 lines · Juergen Gross
In
tools/xenstorethere are living xenstored and xenstore clients. They are no longer sharing anything apart from the "xenstore" in their names.Move the xenstored sources into a new directory
tools/xenstoredwhile dropping the "xenstored_" prefix from their names. This will make it clearer that xenstore clients and xenstored are independent from each other.
Quoted 6 lines
In term of naming, I would prefer if we follow what was done for the console. I.e:
xenstore/client: All the clients
xenstore/daemon: C XenstoredThis would avoid the one character difference between the two directories.
Yes, that would be the alternative (apart from renaming the xenstore directory to something different, e.g. xs-clients).
The reason I was leaning towards my solution was that the clients are meant to be used with any xenstored implementation. This wouldn't be reflected by using a common tools/xenstore parent directory for the clients and C xenstored.
In the end I could live with your proposal, too.
Quoted 11 lines
What do the other thinks?
Quoted 6 lines
Signed-off-by Juergen Gross <[email protected]>---
After the large overhaul of xenstored I think such a reorg would make sense to go into the same Xen version. Delaying it until the next version would make potential backports for 4.18 harder.+1.
Thanks,
Juergen
Re: [PATCH v4 19/19] tools/xenstore: move xenstored sources into dedicated directory
Hi Juergen,
Quoted 15 lines · Juergen Gross
Quoted 14 lines · Julien Grall
Hi Juergen,
Quoted 8 lines · Juergen Gross
In
tools/xenstorethere are living xenstored and xenstore clients. They are no longer sharing anything apart from the "xenstore" in their names.Move the xenstored sources into a new directory
tools/xenstoredwhile dropping the "xenstored_" prefix from their names. This will make it clearer that xenstore clients and xenstored are independent from each other.In term of naming, I would prefer if we follow what was done for the console. I.e:
Quoted 7 lines
Quoted 4 lines
xenstore/client: All the clients
xenstore/daemon: C XenstoredThis would avoid the one character difference between the two directories.
Yes, that would be the alternative (apart from renaming the xenstore directory to something different, e.g. xs-clients).
xs-clients would be OK. I guess you didn't suggest xenstore-clients because it is too long?
Quoted 4 lines
The reason I was leaning towards my solution was that the clients are meant to be used with any xenstored implementation. This wouldn't be reflected by using a common
tools/xenstoreparent directory for the clients and C xenstored.
You have a point. I was also trying to avoid to have too many directoy in tools. But we already have 'qemu-trad' and 'qemu-upstream'...
Quoted 2 lines
In the end I could live with your proposal, too.
My main concern with your proposal was the one character difference in the name. xenstored and xs-clients/xenstore-clients would work for me.
Cheers,
Signature · 1 line
Julien Grall
Re: [PATCH v4 19/19] tools/xenstore: move xenstored sources into dedicated directory
Quoted 21 lines · Julien Grall
Hi Juergen,
Quoted 18 lines · Juergen Gross
Quoted 17 lines · Julien Grall
Hi Juergen,
Quoted 8 lines · Juergen Gross
In
tools/xenstorethere are living xenstored and xenstore clients. They are no longer sharing anything apart from the "xenstore" in their names.Move the xenstored sources into a new directory
tools/xenstoredwhile dropping the "xenstored_" prefix from their names. This will make it clearer that xenstore clients and xenstored are independent from each other.In term of naming, I would prefer if we follow what was done for the console. I.e:
xenstore/client: All the clients
xenstore/daemon: C Xenstored
Quoted 6 lines
Quoted 4 lines
Quoted 1 line
This would avoid the one character difference between the two directories.
Yes, that would be the alternative (apart from renaming the xenstore directory to something different, e.g. xs-clients).
xs-clients would be OK. I guess you didn't suggest xenstore-clients because it is too long?
I was more thinking about path name completion when typing. Using xs-clients would allow to use the <tab> after the second character already. :-)
Quoted 6 lines
Quoted 5 lines
The reason I was leaning towards my solution was that the clients are meant to be used with any xenstored implementation. This wouldn't be reflected by using a common
tools/xenstoreparent directory for the clients and C xenstored.
Quoted 6 lines
You have a point. I was also trying to avoid to have too many directoy in tools. But we already have 'qemu-trad' and 'qemu-upstream'...
Quoted 2 lines
In the end I could live with your proposal, too.
My main concern with your proposal was the one character difference in the name. xenstored and xs-clients/xenstore-clients would work for me.
Okay, thanks.
With above reasoning I'm leaning towards xs-clients.
Juergen
Hi Juergen,
Quoted 11 lines · Juergen Gross
Juergen Gross (19):
tools/xenstore: make hashtable key parameter consttools/xenstore: lethashtable_add()fail in case of existing entrytools/xenstore: addhashtable_replace()functiontools/xenstore: drop use of tdb
tools/xenstore: remove tdb code
tools/xenstore: letdb_delete()return voidtools/xenstore: changetalloc_free()to take a const pointertools/xenstore: move copying of node data out ofdb_fetch()tools/xenstore: rework structxs_tdb_record_hdrtools/xenstore: don't use structnode_permsin struct node
Quoted 8 lines
tools/xenstore: use structnode_hdrin struct nodetools/xenstore: alloc new memory indomain_adjust_node_perms()tools/xenstore: introduceread_node_const()tools/xenstore: mergeget_spec_node()intoget_node_canonicalized()tools/xenstore: mergeis_valid_nodename()intocanonicalize()tools/xenstore: reworkget_node()
tools/xenstore: introduceget_node_const()
tools/config: addXEN_RUN_STOREDtoconfig.h
I have committed up to this patch.
Cheers,
Signature · 1 line
Julien Grall