RFC python/qemu: refactor as installable package
Status from this message: Thanks, applied to my python-next tree:
Get series with b4
b4 am [email protected]Versions newest first
- v1 RFC Latest32 patches 52 repliesApplied
Patches in v1 Applied
| # | Subject and files | Size | Replies | Applied |
|---|---|---|---|---|
| 1/32 | python/qemu: create qemu.lib modulepython/ python/ python/ +16 more | +74 | 16 replies | |
| 2/32 | scripts/qmp: Fix shebang and importsscripts/ scripts/ scripts/ +3 more | +21 | 1 reply | |
| 3/32 | python//machine.py: remove bare exceptpython/ | +21 | 6 replies | |
| 4/32 | python/qemu/lib: delint, add pylintrcpython/ python/ python/ | +88 | 1 reply | |
| 5/32 | python/qemu/lib: delint; add flake8 configpython/ python/ python/ +1 more | +19 | 2 replies | |
| 6/32 | python/qemu: formalize as packagepython/ python/ | +56 | 1 reply | |
| 7/32 | python/qemu: add README.rstpython/ | +8 | 0 replies | |
| 8/32 | python/qemu: Add Pipfilepython/ | +11 | 0 replies | |
| 9/32 | python/qemu: add pylint to Pipfilepython/ python/ | +124 | 0 replies | |
| 10/32 | python/qemu: Add flake8 to Pipfilepython/ python/ | +31 | 0 replies | |
| 11/32 | python/qemu/lib: remove Python2 style super() callspython/ python/ | +8 | 2 replies | |
| 12/32 | python/qemu/lib: fix socket.makefile() typingpython/ python/ | +15 | 1 reply | |
| 13/32 | python/qemu/lib: Adjust traceback typingpython/ python/ | +14 | 2 replies | |
| 14/32 | python//qmp.py: use True/False for non/blocking modespython/ | +2 | 2 replies | |
| 15/32 | python//qmp.py: Define common typespython/ | +18 | 0 replies | |
| 16/32 | python//qmp.py: re-absorb MonitorResponseErrorpython/ python/ scripts/ | +18 | 1 reply | |
| 17/32 | python//qmp.py: Do not return None from cmd_objpython/ | +5 | 0 replies | |
| 18/32 | python//qmp.py: add casts to JSON deserializationpython/ | +6 | 1 reply | |
| 19/32 | python//qmp.py: add QMPProtocolErrorpython/ | +10 | 1 reply | |
| 20/32 | python//qmp.py: assert sockfile is not Nonepython/ | +1 | 3 replies | |
| 21/32 | python//machine.py: remove logging configurationpython/ | +0 | 2 replies | |
| 22/32 | python//machine.py: Fix monitor address typingpython/ | +29 | 0 replies | |
| 23/32 | python//machine.py: reorder __init__python/ | +17 | 1 reply | |
| 24/32 | python//machine.py: Don't modify state in _base_args()python/ python/ | +18 | 0 replies | |
| 25/32 | python//machine.py: Handle None events in event_waitpython/ | +5 | 0 replies | |
| 26/32 | python//machine.py: use qmp.commandpython/ | +15 | 4 replies | |
| 27/32 | python//machine.py: Add _qmp access shimpython/ | +9 | 0 replies | |
| 28/32 | python//machine.py: fix _popen accesspython/ | +12 | 0 replies | |
| 29/32 | python//qtest.py: Check before accessing _qtestpython/ | +11 | 2 replies | |
| 30/32 | python/qemu/lib: make 'args' style arguments immutablepython/ python/ | +29 | 0 replies | |
| 31/32 | python/qemu: add mypy to Pipfilepython/ python/ | +37 | 0 replies | |
| 32/32 | python/qemu/lib: Add mypy type annotationspython/ python/ python/ +1 more | +99 | 0 replies |
Reviews trailers per patch
16 of 32 patches have a Reviewed-by or Acked-by.
| Patch | Philippe Mathieu-Daudé |
|---|---|
| 1/32 | |
| 2/32 | R-b |
| 3/32 | R-b |
| 4/32 | R-b |
| 5/32 | R-b |
| 6/32 | A-b |
| 7/32 | |
| 8/32 | |
| 9/32 | |
| 10/32 | |
| 11/32 | R-b |
| 12/32 | R-b |
| 13/32 | A-b |
| 14/32 | R-b |
| 15/32 | |
| 16/32 | R-b |
| 17/32 | |
| 18/32 | A-b |
| 19/32 | R-b |
| 20/32 | A-b R-b |
| 21/32 | R-b |
| 22/32 | |
| 23/32 | R-b |
| 24/32 | |
| 25/32 | |
| 26/32 | |
| 27/32 | |
| 28/32 | |
| 29/32 | R-b |
| 30/32 | |
| 31/32 | |
| 32/32 |
Trailers given in replies are filled; those carried in the patches from earlier versions are outlined with dashes.
Cover letter [PATCH RFC 00/32] python/qemu: refactor as installable package
Hey, I got lost on my way to the store and I accidentally got 32 patches that convert our python library into something that passes pylint, flake8, and mypy --strict.
...So, a few things:
1. This is just an RFC. The actual design of these libraries really needs adjusted to be more pythonic. In general this means less Optional[T] return types and raising more exceptions. This could be handled later, but we ought to address it before publishing, if we do.
2. We still need to think carefully about how we package this, if we even want to package it, what the license on the top-level package should be, etc.
3. We should consider how to version it. For now, I'm using a lockstep versioning.
4. You can install this package using pip3 or python3 setup.py to a virtual environment or to your real one. From there, any python code in the QEMU tree that imports these modules will work with no sys.path hacking or custom PYTHONPATH exports.
5. You don't have to install it, though. I left all of the usual hacks in place in the rest of the tree so that everything will just keep working exactly as-is for right now. It's just that you COULD install it.
6. Here's a cool trick if you don't know about it yet:
Quoted 2 lines
cd qemu/python/qemu
pip3 install --user -e .
This will install the package in "develop" mode, which installs a forwarder package. When you update your source tree, the installed package stays "up to date" with the most recent edits.
Alright, have fun, stay safe!
John Snow (32):
python/qemu: create qemu.lib module scripts/qmp: Fix shebang and imports python//machine.py: remove bare except python/qemu/lib: delint, add pylintrc python/qemu/lib: delint; add flake8 config python/qemu: formalize as package python/qemu: add README.rst
python/qemu: Add Pipfile
python/qemu: add pylint to Pipfile python/qemu: Add flake8 to Pipfile python/qemu/lib: remove Python2 style super() calls python/qemu/lib: fix socket.makefile() typing python/qemu/lib: Adjust traceback typing python//qmp.py: use True/False for non/blocking modes python//qmp.py: Define common types python//qmp.py: re-absorb MonitorResponseError python//qmp.py: Do not return None from cmd_obj python//qmp.py: add casts to JSON deserialization python//qmp.py: add QMPProtocolError python//qmp.py: assert sockfile is not None python//machine.py: remove logging configuration python//machine.py: Fix monitor address typing python//machine.py: reorder __init__ python//machine.py: Don't modify state in _base_args() python//machine.py: Handle None events in event_wait python//machine.py: use qmp.command python//machine.py: Add _qmp access shim python//machine.py: fix _popen access python//qtest.py: Check before accessing _qtest python/qemu/lib: make 'args' style arguments immutable python/qemu: add mypy to Pipfile python/qemu/lib: Add mypy type annotations
python/README.rst | 6 +
python/qemu/README.rst | 8 +
python/Pipfile | 14 +
python/Pipfile.lock | 187 +++++++++++++
python/qemu/__init__.py | 11 -
python/qemu/lib/.flake8 | 2 +
python/qemu/lib/__init__.py | 57 ++++
python/qemu/{ => lib}/accel.py | 17 +-
python/qemu/{ => lib}/machine.py | 320 +++++++++++++---------
python/qemu/lib/pylintrc | 58 ++++
python/qemu/{ => lib}/qmp.py | 140 +++++++---
python/qemu/lib/qtest.py | 160 +++++++++++
python/qemu/qtest.py | 119 --------
python/setup.py | 50 ++++
scripts/device-crash-test | 2 +-
scripts/qmp/qemu-ga-client | 2 +-
scripts/qmp/qmp | 4 +-
scripts/qmp/qmp-shell | 2 +-
scripts/qmp/qom-fuse | 4 +-
scripts/qmp/qom-get | 6 +-
scripts/qmp/qom-list | 4 +-
scripts/qmp/qom-set | 6 +-
scripts/qmp/qom-tree | 6 +-
scripts/render_block_graph.py | 5 +-
scripts/simplebench/bench_block_job.py | 4 +-
tests/acceptance/avocado_qemu/__init__.py | 2 +-
tests/acceptance/boot_linux.py | 3 +-
tests/acceptance/virtio_check_params.py | 2 +-
tests/acceptance/virtio_version.py | 2 +-
tests/migration/guestperf/engine.py | 2 +-
tests/qemu-iotests/235 | 2 +-
tests/qemu-iotests/iotests.py | 2 +-
tests/vm/basevm.py | 6 +-
33 files changed, 881 insertions(+), 334 deletions(-)
create mode 100644 python/README.rst
create mode 100644 python/qemu/README.rst
create mode 100644 python/Pipfile
create mode 100644 python/Pipfile.lock
delete mode 100644 python/qemu/__init__.py
create mode 100644 python/qemu/lib/.flake8
create mode 100644 python/qemu/lib/__init__.py
rename python/qemu/{ => lib}/accel.py (86%)
rename python/qemu/{ => lib}/machine.py (67%)
create mode 100644 python/qemu/lib/pylintrc
rename python/qemu/{ => lib}/qmp.py (70%)
create mode 100644 python/qemu/lib/qtest.py
delete mode 100644 python/qemu/qtest.py
create mode 100755 python/setup.pySignature · 1 line
2.21.1