Tinfoil rework

Tinfoil is an API that allows you to write simple utilities that call into BitBake code to read variables, parse recipes, etc. (as used by various scripts in BitBake & OE, including bitbake-layers, devtool, etc.) This patchset reworks tinfoil in order to address several limitations of the current implementation, first and foremost that it doesn't currently work in bitbake's memory resident mode. This rework is also known as "tinfoil2" although the classes and modules have not changed name. Fixes for a few other related issues I found along the way are also included. There is an additional set of patches for OE-Core that make corresponding changes there - both sets should be applied together in order for things to remain working.

Note that whilst these patchsets make some significant improvements to how the system behaves in memory resident mode, there are still a number of issues that prevent memory resident mode from being reliable. See this wiki page for a few more details:

https://wiki.yoctoproject.org/wiki/index.php?title=Tinfoil2

I will be converting some of these into bugzilla entries after this patchset and the corresponding one for OE-Core get merged.

The following changes since commit b65a8193368ffa1d15af24a6acde8dce6bd4d383:

toaster: views Remove old code that converts template context to JSON (2016-12-12 20:44:47 +0000)

are available in the git repository at:

git://git.yoctoproject.org/poky-contrib paule/tinfoil2-bb
http://git.yoctoproject.org/cgit.cgi/poky-contrib/log/?h=paule/tinfoil2-bb

Paul Eggleton (15):
data_smart: fix resetting of reference on variablehistory
knotty: make quiet option a level option
knotty: fix --observe-only option
server/xmlrpc: send back 503 response with correct encoding
data_smart: implement remote datastore functionality
command: provide a means to shut down from the client in memres mode
tinfoil: rewrite as a wrapper around the UI
remotedata: enable transporting datastore from the client to the server
tinfoil: implement server-side recipe parsing
tinfoil: pass datastore to server when expanding python references
cooker: allow buildFile warning to be hidden programmatically
data_smart: support serialisation
runqueue: enable setVariable command to affect task execution
siggen: add means of ignoring basehash mismatch server/process: don't change UI process signal handler on terminate

 bin/bitbake-worker       |  12 +-
 lib/bb/command.py        | 253 ++++++++++++++++++++++++++-
 lib/bb/cooker.py         |  36 +++-
 lib/bb/cookerdata.py     |   1 +
 lib/bb/data_smart.py     |  54 +++++-
 lib/bb/main.py           |  87 ++++++----
 lib/bb/remotedata.py     | 116 +++++++++++++
 lib/bb/runqueue.py       |   1 +
 lib/bb/server/process.py |   1 -
 lib/bb/server/xmlrpc.py  |   2 +-
 lib/bb/siggen.py         |   3 +-
 lib/bb/tests/data.py     |  68 ++++++++
 lib/bb/tinfoil.py        | 439 +++++++++++++++++++++++++++++++++++++++--------
 lib/bb/ui/knotty.py      |  45 +++--
 lib/bblayers/query.py    |  28 +--
 15 files changed, 982 insertions(+), 164 deletions(-)
 create mode 100644 lib/bb/remotedata.py

2.5.5