nvme-cli & json vs blktests
Christoph Hellwig
maintainerHi all,
I recently did a long overdue update of blktests on my main test machine, and a large part of the nvme tests started failing. I eventually bisected this down to:
commit 444f0df9f0c537335f59c1721240212852656e5b
Author: Hannes Reinecke <[email protected]> Date: Wed Oct 30 15:51:45 2024 +0900
nvme: check for controller device in _nvme_connect_subsys()
which adds a requirements for json output from nvme connect, and just silently fails if not present.
Now after figuring this out I went to rebuild my nvme-cli after installing the json-c development package.
... and nothing changes.
It looks like the nvme-cli build system unfortunately doesn't pick up changes in available dependencies even after a make clean. It turns out a make purge eventually fixed it, but that's a little unexpected.
Can we get proper feature check for json support in blktests and maybe make the nvme-cli build a little less arcane?
Quoted 1 line · Christoph Hellwig
make the nvme-cli build a little less arcane?
There is no magic build into the meson/ninja build system. meson creates the ninja build instruction which are fully hardcoded, thus it wont pick up any newly installed libraries on automatically. Running meson with 'setup --reconfigure' is a design choice of this build system.
I don't really see a problem with this approach.
Christoph Hellwig
maintainerQuoted 9 lines · Daniel Wagner
Quoted 1 line · Christoph Hellwig
make the nvme-cli build a little less arcane?
There is no magic build into the meson/ninja build system. meson creates the ninja build instruction which are fully hardcoded, thus it wont pick up any newly installed libraries on automatically. Running meson with 'setup --reconfigure' is a design choice of this build system.
I don't really see a problem with this approach.
The fact that a make clean is not clean enough to find newly installed dependencies is very unusual.
Quoted 9 lines · Christoph Hellwig
Quoted 8 lines · Daniel Wagner
Quoted 1 line · Christoph Hellwig
make the nvme-cli build a little less arcane?
There is no magic build into the meson/ninja build system. meson creates the ninja build instruction which are fully hardcoded, thus it wont pick up any newly installed libraries on automatically. Running meson with 'setup --reconfigure' is a design choice of this build system.
Quoted 4 lines
Quoted 1 line
I don't really see a problem with this approach.
The fact that a make clean is not clean enough to find newly installed dependencies is very unusual.
Okay, so the Makefile is not really working in your workflow as expected. I see there are two targets 'clean' and 'purge'. I suppose it would make sense to model the 'clean' target more what autotools & co are doing. Really wiping everything away. Let me fix this.
Quoted 9 lines · Daniel Wagner
Quoted 8 lines · Christoph Hellwig
Quoted 7 lines · Daniel Wagner
Quoted 1 line · Christoph Hellwig
make the nvme-cli build a little less arcane?
There is no magic build into the meson/ninja build system. meson creates the ninja build instruction which are fully hardcoded, thus it wont pick up any newly installed libraries on automatically. Running meson with 'setup --reconfigure' is a design choice of this build system.
Quoted 7 lines
Quoted 3 lines
Quoted 1 line
I don't really see a problem with this approach.
The fact that a make clean is not clean enough to find newly installed dependencies is very unusual.
Okay, so the
Makefileis not really working in your workflow as expected. I see there are two targets 'clean' and 'purge'. I suppose it would make sense to model the 'clean' target more what autotools & co are doing. Really wiping everything away. Let me fix this.
yes please hope should fix the issue that I'm also seeing from last week.
-ck
Quoted 6 lines · Chaitanya Kulkarni
Quoted 4 lines
Okay, so the
Makefileis not really working in your workflow as expected. I see there are two targets 'clean' and 'purge'. I suppose it would make sense to model the 'clean' target more what autotools & co are doing. Really wiping everything away. Let me fix this.yes please hope should fix the issue that I'm also seeing from last week.
I've updated the Makefile. The 'clean' target is now doing a proper cleanup and deletes all the build artifacts and configuration files.
Christoph Hellwig
maintainerQuoted 2 lines · Daniel Wagner
I've updated the
Makefile. The 'clean' target is now doing a proper cleanup and deletes all the build artifacts and configuration files.
Thanks!
Quoted 7 lines · Christoph Hellwig
Hi all,
I recently did a long overdue update of blktests on my main test machine, and a large part of the nvme tests started failing. I eventually bisected this down to:
commit
444f0df9f0c537335f59c1721240212852656e5b
Quoted 8 lines
Author: Hannes Reinecke <[email protected]> Date: Wed Oct 30 15:51:45 2024 +0900nvme: check for controller device in
_nvme_connect_subsys()which adds a requirements for json output from nvme connect, and just silently fails if not present.
I uninstalled json-c-devel package from my Fedora system, and built nvme-cli. Then confirmed the slient fail. That is a painful pit-fall.
...
Quoted 3 lines
Can we get proper feature check for json support in blktests and maybe make the nvme-cli build a little less arcane?
As to blktests, I quickly created a patch below, and confirmed it informs that nvme-cli is missing json output support. Will do some more testing and post as a formal patch.
tests/nvme/rc +9 -1
@@ -55,7 +55,7 @@ _set_nvmet_blkdev_type() { } _nvme_requires() { - _have_program nvme + _have_nvme_cli_with_json_support _require_nvme_test_img_size 4m case ${nvme_trtype} in loop)
@@ -626,6 +626,14 @@ _have_systemd_tlshd_service() { fi } +_have_nvme_cli_with_json_support() { + _have_program nvme || return $? + + if ! nvme list --output-format=json &> /dev/null; then + SKIP_REASONS+=("nvme-cli does not support json output format") + fi +} + _have_libnvme_ver() { local ver