Skip to content

Python package infrastructure

Thomas Petazzoni buildroot 2 versions New

Get series with b4
b4 am 1386793631-14026-1-git-send-email-thomas.petazzoni@free-electrons.com

Versions newest first · linked by author and title

  1. v2 Latest36 patches 0 repliesNew
  2. v10 of 38 patches 0 repliesSuperseded

Changes in v2 from the cover letter

================

* Rebased on top of the latest master, so I dropped the first two patches on the 'dialog' patches, since they have already been merged.

* Fix a number of typos in the documentation, and generally give a number of additional details, according to suggestions made by Thomas DS.

* Fixed all the spacing issues reported by Thomas DS in packages.

* Significantly improved the comment that explains the mysterious $(2)_DEPENDENCIES line in pkg-python.mk, as well as minor other improvements suggested by Thomas DS.

* Fixed some copy and paste error in the python-pysnmp packages.

* Fixed some comments in Config.in related to toolchain dependencies, according to Thomas DS comments.

Patches in v2 No applies recorded yet

#Subject and filesSizeRepliesApplied
1/36package: introduce Python package infrastructuredocs/manual/adding-packages-python.txt docs/manual/adding-packages.txt package/Makefile.in +1 more+381 -01 reply
1/36package: introduce Python package infrastructure+0 -01 reply
2/36python-bottle: convert to the Python package infrastructurepackage/python-bottle/python-bottle.mk+2 -100 replies
3/36python-crc16: convert to the Python package infrastructurepackage/python-crc16/python-crc16.mk+2 -230 replies
4/36python-dpkt: convert to the Python package infrastructurepackage/python-dpkt/python-dpkt.mk+2 -110 replies
5/36python-id3: convert to the Python package infrastructurepackage/python-id3/python-id3.mk+2 -110 replies
6/36python-ipy: convert to the Python package infrastructurepackage/python-ipy/python-ipy.mk+2 -150 replies
7/36python-m2crypto: convert to the Python package infrastructurepackage/python-m2crypto/python-m2crypto.mk+8 -120 replies
8/36python-mad: convert to the Python package infrastructurepackage/python-mad/python-mad.mk+3 -170 replies
9/36python-meld3: convert to the Python package infrastructurepackage/python-meld3/python-meld3.mk+2 -100 replies
10/36python-nfc: convert to the Python package infrastructurepackage/python-nfc/python-nfc.mk+3 -100 replies
11/36python-protobuf: convert to the Python package infrastructurepackage/python-protobuf/python-protobuf.mk+4 -160 replies
12/36python-pygame: convert to the Python package infrastructurepackage/python-pygame/python-pygame.mk+8 -170 replies
13/36python-pyparsing: convert to the Python package infrastructurepackage/python-pyparsing/python-pyparsing.mk+2 -260 replies
14/36python-pyro: convert to the Python package infrastructurepackage/python-pyro/python-pyro.mk+2 -60 replies
15/36python-pyzmq: convert to the Python package infrastructurepackage/python-pyzmq/python-pyzmq.mk+3 -230 replies
16/36python-serial: convert to the Python package infrastructurepackage/python-serial/python-serial.mk+2 -110 replies
17/36python-setuptools: convert to the Python package infrastructurepackage/python-setuptools/python-setuptools.mk+3 -250 replies
18/36scons: convert to the Python package infrastructurepackage/scons/scons.mk+4 -90 replies
19/36python-netifaces: convert to the Python package infrastructurepackage/python-netifaces/Config.in package/python-netifaces/python-netifaces.mk+2 -180 replies
20/36supervisor: convert to the Python package infrastructurepackage/supervisor/Config.in package/supervisor/supervisor.mk+11 -120 replies
21/36python-distutilscross: convert to the Python package infrastructurepackage/python-distutilscross/python-distutilscross.mk+2 -110 replies
22/36python-thrift: convert to the Python package infrastructurepackage/python-thrift/python-thrift.mk+3 -230 replies
23/36python-dialog: convert to the Python package infrastructurepackage/python-dialog/python-dialog.mk+3 -110 replies
24/36python-pyusb: new packagepackage/Config.in package/python-pyusb/Config.in package/python-pyusb/python-pyusb.mk+29 -00 replies
25/36python-msgpack: new packagepackage/Config.in package/python-msgpack/Config.in package/python-msgpack/python-msgpack.mk+32 -00 replies
26/36python-configobj: new packagepackage/Config.in package/python-configobj/Config.in package/python-configobj/python-configobj.mk+25 -00 replies
27/36python-versiontools: new packagepackage/Config.in package/python-versiontools/Config.in package/python-versiontools/python-versiontools.mk+21 -00 replies
28/36python-keyring: new packagepackage/Config.in package/python-keyring/Config.in package/python-keyring/python-keyring.mk+28 -00 replies
29/36python-simplejson: new packagepackage/Config.in package/python-simplejson/Config.in package/python-simplejson/python-simplejson.mk+22 -00 replies
30/36python-json-schema-validator: new packagepackage/Config.in package/python-json-schema-validator/Config.in package/python-json-schema-validator/python-json-schema-validator.mk+24 -01 reply
31/36python-tornado: new packagepackage/Config.in package/python-tornado/Config.in package/python-tornado/python-tornado.mk+22 -00 replies
32/36python-pyasn: new packagepackage/Config.in package/python-pyasn/Config.in package/python-pyasn/python-pyasn.mk+33 -01 reply
33/36python-pycrypto: new packagepackage/Config.in package/python-pycrypto/Config.in package/python-pycrypto/python-pycrypto.mk+45 -00 replies
34/36python-pysnmp: new packagepackage/Config.in package/python-pysnmp/Config.in package/python-pysnmp/python-pysnmp.mk+32 -00 replies
35/36python-pysnmp-apps: new packagepackage/Config.in package/python-pysnmp-apps/Config.in package/python-pysnmp-apps/python-pysnmp-apps.mk+31 -01 reply
36/36python-pysnmp-mibs: new packagepackage/Config.in package/python-pysnmp-mibs/Config.in package/python-pysnmp-mibs/python-pysnmp-mibs.mk+30 -00 replies

Reviews trailers per patch

No Reviewed-by, Acked-by or Tested-by trailers for v2 yet.

Read the v2 thread

Cover letter [Buildroot] [PATCHv2 00/36] Python package infrastructure

Hello,

This set of patches add a new infrastructure for Python packages, which support both distutils and setuptools based packages. It also converts all the current Python packages to this infrastructure, and adds a bunch of new Python packages that have been sitting in patchwork for a while.

Thanks to this infrastructure, the vast majority of Python packages no longer need to write any <something>_CMDS. All they need to do is to explicitly say, through the <pkg>_SETUP_TYPE variable, whether the setup.py of the package is distutils-based or setuptools-based.

When it's setuptools-based, then the infrastructure will automatically build host-setuptools an host-distutilscross.

A short overview of the patches:

* Patch 1 adds the Python infrastructure itself.

* Patches 2 to 23 convert all the existing Python packages to use the new infrastructure.

* Patches 23 to 36 add new Python packages that have been sitting on patchwork for some time, including some contributed by Ryan Barnett, who did rebase them on the Python infrastructure.

I have already started working on making the infrastructure work with Python 3 as well, and I have a bunch of patches that do this. However, they are not completely ready yet, and since Python modules anyway can't be used today with Python 3, merging this Python 2 only package infrastructure is not a regression.

Changes since v1
================

* Rebased on top of the latest master, so I dropped the first two patches on the 'dialog' patches, since they have already been merged.

* Fix a number of typos in the documentation, and generally give a number of additional details, according to suggestions made by Thomas DS.

* Fixed all the spacing issues reported by Thomas DS in packages.

* Significantly improved the comment that explains the mysterious $(2)_DEPENDENCIES line in pkg-python.mk, as well as minor other improvements suggested by Thomas DS.

* Fixed some copy and paste error in the python-pysnmp packages.

* Fixed some comments in Config.in related to toolchain dependencies, according to Thomas DS comments.

This branch is available at:

http://git.free-electrons.com/users/thomas-petazzoni/buildroot/log/?h=python-pkg-v2

Of course, testing is more than welcome.

Thanks a lot!

Thomas

Ludovic Desroches (4):
python-versiontools: new package
python-keyring: new package
python-simplejson: new package
python-json-schema-validator: new package

Ryan Barnett (6):
python-tornado: new package
python-pyasn: new package
python-pycrypto: new package
python-pysnmp: new package
python-pysnmp-apps: new package
python-pysnmp-mibs: new package

Thomas Petazzoni (23):
package: introduce Python package infrastructure
python-bottle: convert to the Python package infrastructure
python-crc16: convert to the Python package infrastructure
python-dpkt: convert to the Python package infrastructure
python-id3: convert to the Python package infrastructure
python-ipy: convert to the Python package infrastructure
python-m2crypto: convert to the Python package infrastructure
python-mad: convert to the Python package infrastructure
python-meld3: convert to the Python package infrastructure
python-nfc: convert to the Python package infrastructure
python-protobuf: convert to the Python package infrastructure
python-pygame: convert to the Python package infrastructure
python-pyparsing: convert to the Python package infrastructure
python-pyro: convert to the Python package infrastructure
python-pyzmq: convert to the Python package infrastructure
python-serial: convert to the Python package infrastructure
python-setuptools: convert to the Python package infrastructure
scons: convert to the Python package infrastructure
python-netifaces: convert to the Python package infrastructure
supervisor: convert to the Python package infrastructure
python-distutilscross: convert to the Python package infrastructure
python-thrift: convert to the Python package infrastructure
python-dialog: convert to the Python package infrastructure

Wojciech M. Zabolotny (2):
python-pyusb: new package
python-msgpack: new package

Zoltan Gyarmati (1):
python-configobj: new package

 docs/manual/adding-packages-python.txt             | 159 +++++++++++++++
 docs/manual/adding-packages.txt                    |   2 +
 package/Config.in                                  |  13 ++
 package/Makefile.in                                |   1 +
 package/pkg-python.mk                              | 219 +++++++++++++++++++++
 package/python-bottle/python-bottle.mk             |  12 +-
 package/python-configobj/Config.in                 |  10 +
 package/python-configobj/python-configobj.mk       |  14 ++
 package/python-crc16/python-crc16.mk               |  25 +--
 package/python-dialog/python-dialog.mk             |  14 +-
 .../python-distutilscross/python-distutilscross.mk |  13 +-
 package/python-dpkt/python-dpkt.mk                 |  13 +-
 package/python-id3/python-id3.mk                   |  13 +-
 package/python-ipy/python-ipy.mk                   |  17 +-
 package/python-json-schema-validator/Config.in     |   8 +
 .../python-json-schema-validator.mk                |  15 ++
 package/python-keyring/Config.in                   |   8 +
 package/python-keyring/python-keyring.mk           |  19 ++
 package/python-m2crypto/python-m2crypto.mk         |  20 +-
 package/python-mad/python-mad.mk                   |  20 +-
 package/python-meld3/python-meld3.mk               |  12 +-
 package/python-msgpack/Config.in                   |  16 ++
 package/python-msgpack/python-msgpack.mk           |  15 ++
 package/python-netifaces/Config.in                 |   1 -
 package/python-netifaces/python-netifaces.mk       |  19 +-
 package/python-nfc/python-nfc.mk                   |  13 +-
 package/python-protobuf/python-protobuf.mk         |  20 +-
 package/python-pyasn/Config.in                     |  13 ++
 package/python-pyasn/python-pyasn.mk               |  19 ++
 package/python-pycrypto/Config.in                  |   9 +
 package/python-pycrypto/python-pycrypto.mk         |  35 ++++
 package/python-pygame/python-pygame.mk             |  25 +--
 package/python-pyparsing/python-pyparsing.mk       |  28 +--
 package/python-pyro/python-pyro.mk                 |   8 +-
 package/python-pysnmp-apps/Config.in               |  14 ++
 package/python-pysnmp-apps/python-pysnmp-apps.mk   |  16 ++
 package/python-pysnmp-mibs/Config.in               |  13 ++
 package/python-pysnmp-mibs/python-pysnmp-mibs.mk   |  16 ++
 package/python-pysnmp/Config.in                    |  14 ++
 package/python-pysnmp/python-pysnmp.mk             |  17 ++
 package/python-pyusb/Config.in                     |  14 ++
 package/python-pyusb/python-pyusb.mk               |  14 ++
 package/python-pyzmq/python-pyzmq.mk               |  26 +--
 package/python-serial/python-serial.mk             |  13 +-
 package/python-setuptools/python-setuptools.mk     |  28 +--
 package/python-simplejson/Config.in                |   7 +
 package/python-simplejson/python-simplejson.mk     |  14 ++
 package/python-thrift/python-thrift.mk             |  26 +--
 package/python-tornado/Config.in                   |   8 +
 package/python-tornado/python-tornado.mk           |  13 ++
 package/python-versiontools/Config.in              |   7 +
 package/python-versiontools/python-versiontools.mk |  13 ++
 package/scons/scons.mk                             |  13 +-
 package/supervisor/Config.in                       |   1 -
 package/supervisor/supervisor.mk                   |  22 +--
 55 files changed, 830 insertions(+), 327 deletions(-)
 create mode 100644 docs/manual/adding-packages-python.txt
 create mode 100644 package/pkg-python.mk
 create mode 100644 package/python-configobj/Config.in
 create mode 100644 package/python-configobj/python-configobj.mk
 create mode 100644 package/python-json-schema-validator/Config.in
 create mode 100644 package/python-json-schema-validator/python-json-schema-validator.mk
 create mode 100644 package/python-keyring/Config.in
 create mode 100644 package/python-keyring/python-keyring.mk
 create mode 100644 package/python-msgpack/Config.in
 create mode 100644 package/python-msgpack/python-msgpack.mk
 create mode 100644 package/python-pyasn/Config.in
 create mode 100644 package/python-pyasn/python-pyasn.mk
 create mode 100644 package/python-pycrypto/Config.in
 create mode 100644 package/python-pycrypto/python-pycrypto.mk
 create mode 100644 package/python-pysnmp-apps/Config.in
 create mode 100644 package/python-pysnmp-apps/python-pysnmp-apps.mk
 create mode 100644 package/python-pysnmp-mibs/Config.in
 create mode 100644 package/python-pysnmp-mibs/python-pysnmp-mibs.mk
 create mode 100644 package/python-pysnmp/Config.in
 create mode 100644 package/python-pysnmp/python-pysnmp.mk
 create mode 100644 package/python-pyusb/Config.in
 create mode 100644 package/python-pyusb/python-pyusb.mk
 create mode 100644 package/python-simplejson/Config.in
 create mode 100644 package/python-simplejson/python-simplejson.mk
 create mode 100644 package/python-tornado/Config.in
 create mode 100644 package/python-tornado/python-tornado.mk
 create mode 100644 package/python-versiontools/Config.in
 create mode 100644 package/python-versiontools/python-versiontools.mk
Signature · 1 line
1.8.1.2