From: Mark Hatle <mark.hatle@windriver.com>
To: <bitbake-devel@lists.openembedded.org>
Date: Mon, 14 May 2018 10:21:37 -0400
Message-ID: <20180514142139.165484-1-mark.hatle@windriver.com>
MIME-Version: 1.0
Subject: [PATCH 0/2] Add maximum task accounting
Precedence: list
Content-Type: text/plain

On my own machine, a 192 thread machine, if I start a new project without
a local download cache, I end of DoSing my machine.  I wanted a way to
create a maximum number of tasks, of any given type, so that I could limit
the number of concurrent do_fetch commands.

The first patch is a cleanup, while it's not required for the task accounting
I did discover that a few operations were happening in the wrong order --
this could cause a problem if anyone is trying to use the RunQueueStats in
new ways.

The second patch is the one that actually implements the max-task limits.
As noted in the comment, while theoretically you could set this in a recipe,
the behavior will be unpredictable, it's meant to be set in the global
configuration space, i.e. the local.conf.

I've been using these patches successfully for the path few months.


Mark Hatle (2):
  runqueue.py: Minor cleanup for RunQueueStats and users
  runqueue.py: Initial implementation of per task process limits

 lib/bb/runqueue.py | 39 ++++++++++++++++++++++++++++++---------
 1 file changed, 30 insertions(+), 9 deletions(-)

-- 
1.8.3.1