deprecate -mem-path fallback to anonymous RAM
PATCH 1/1 deprecate -mem-path fallback to anonymous RAM
Fallback might affect guest or worse whole host performance or functionality if backing file were used to share guest RAM with another process.
Patch deprecates fallback so that we could remove it in future and ensure that QEMU will provide expected behavior and fail if it can't use user provided backing file.
---
PS:
Patch is written on top of
[PATCH v4 0/3] numa: deprecate '-numa node, mem' and default memory distribution
to avoid conflicts in qemu-deprecated.texi
numa.c | 4 ++-- qemu-deprecated.texi | 8 ++++++++ 2 files changed, 10 insertions(+), 2 deletions(-)
numa.c +2 -2
@@ -494,8 +494,8 @@ static void allocate_system_memory_nonnuma(MemoryRegion *mr, Object *owner,if (mem_prealloc) {exit (1 ); } -error_report ("falling back to regular RAM allocation." ); - +warn_report ("falling back to regular RAM allocation. " +"Fallback to RAM allocation is deprecated." );/* Legacy behavior: if allocation failed, fall back to * regular RAM allocation. */
qemu-deprecated.texi +8 -0
@@ -112,6 +112,14 @@ QEMU using implicit generic or board specific splitting rule. Use @option{memdev} with @var{memory-backend-ram} backend or @option{mem} (if it's supported by used machine type) to define mapping explictly instead. +@subsection -mem-path fallback to RAM (since 4.1) +Currently if system memory allocation from file pointed by @option{mem-path} +fails, QEMU fallbacks to allocating from anonymous RAM. Which might result +in unpredictable behavior since provided backing file wasn't used. In future +QEMU will not fallback and fail to start up, so user could fix his/her QEMU/host +configuration or explicitly use -m without -mem-path if system memory allocated +from anonymous RAM suits usecase. + @section QEMU Machine Protocol (QMP) commands @subsection block-dirty-bitmap-add "autoload" parameter (since 2.12.0)
Signature · 1 line
2.18.1
Quoted 15 lines · Igor Mammedov
Fallback might affect guest or worse whole host performance or functionality if backing file were used to share guest RAM with another process.
Patch deprecates fallback so that we could remove it in future and ensure that QEMU will provide expected behavior and fail if it can't use user provided backing file.
Signed-off-by Igor Mammedov <[email protected]>---
PS:
Patch is written on top of
[PATCH v4 0/3] numa: deprecate '-numa node, mem' and default memory distribution
to avoid conflicts in qemu-deprecated.texi
Quoted 3 lines
numa.c | 4 ++-- qemu-deprecated.texi | 8 ++++++++ 2 files changed, 10 insertions(+), 2 deletions(-)
Regards,
Daniel
Signature · 3 lines
|: https://berrange.com -o- https://www.flickr.com/photos/dberrange :| |: https://libvirt.org -o- https://fstop138.berrange.com :| |: https://entangle-photo.org -o- https://www.instagram.com/dberrange :|
Quoted 9 lines · * Igor Mammedov ([email protected]) wrote:
Fallback might affect guest or worse whole host performance or functionality if backing file were used to share guest RAM with another process.
Patch deprecates fallback so that we could remove it in future and ensure that QEMU will provide expected behavior and fail if it can't use user provided backing file.
Signed-off-by Igor Mammedov <[email protected]>
Ah yes that's useful because it's a mess for postcopy.
Quoted 48 lines
---
PS:
Patch is written on top of
[PATCH v4 0/3] numa: deprecate '-numa node, mem' and default memory distribution
to avoid conflicts in qemu-deprecated.texinuma.c | 4 ++-- qemu-deprecated.texi | 8 ++++++++ 2 files changed, 10 insertions(+), 2 deletions(-)numa.c +2
-2@@ -494,8 +494,8 @@ static void allocate_system_memory_nonnuma(MemoryRegion *mr, Object *owner,if (mem_prealloc) {exit (1 ); } -error_report ("falling back to regular RAM allocation." ); - +warn_report ("falling back to regular RAM allocation. " +"Fallback to RAM allocation is deprecated." );/* Legacy behavior: if allocation failed, fall back to * regular RAM allocation. */ qemu-deprecated.texi +8
-0@@ -112,6 +112,14 @@ QEMU using implicit generic or board specific splitting rule. Use @option{memdev} with @var{memory-backend-ram} backend or @option{mem} (if it's supported by used machine type) to define mapping explictly instead. +@subsection -mem-path fallback to RAM (since 4.1) +Currently if system memory allocation from file pointed by @option{mem-path} +fails, QEMU fallbacks to allocating from anonymous RAM. Which might result +in unpredictable behavior since provided backing file wasn't used. In future +QEMU will not fallback and fail to start up, so user could fix his/her QEMU/host +configuration or explicitly use -m without -mem-path if system memory allocated +from anonymous RAM suits usecase. + @section QEMU Machine Protocol (QMP) commands @subsection block-dirty-bitmap-add "autoload" parameter (since 2.12.0)Signature · 1 line
2.18.1
--
Dr. David Alan Gilbert / [email protected] / Manchester, UK
Quoted 24 lines · Igor Mammedov
Fallback might affect guest or worse whole host performance or functionality if backing file were used to share guest RAM with another process.
Patch deprecates fallback so that we could remove it in future and ensure that QEMU will provide expected behavior and fail if it can't use user provided backing file.
Signed-off-by Igor Mammedov <[email protected]>---
PS:
Patch is written on top of
[PATCH v4 0/3] numa: deprecate '-numa node, mem' and default memory distribution
to avoid conflicts in qemu-deprecated.texinuma.c | 4 ++-- qemu-deprecated.texi | 8 ++++++++ 2 files changed, 10 insertions(+), 2 deletions(-)numa.c +0
-0
numa.c static void allocate_system_memory_nonnuma(MemoryRegion *mr, Object *owner, · line 498
Quoted 7 lines
numa.c +2
-2@@ -494,8 +494,8 @@ static void allocate_system_memory_nonnuma(MemoryRegion *mr, Object *owner,if (mem_prealloc) {exit (1 ); } -error_report ("falling back to regular RAM allocation." ); - +warn_report ("falling back to regular RAM allocation. " +"Fallback to RAM allocation is deprecated." );
Can we give the user clues on how to avoid the deprecated fallback?
Warning message nitpick: the message should be a single phrase, with no newline or trailing punctuation. Suggest something like
warn_report("falling back to regular RAM allocation");
error_printf("This is deprecated. <Advice on what\n"
"to do goes here>\n");Quoted 8 lines
numa.c +0
-0/* Legacy behavior: if allocation failed, fall back to * regular RAM allocation. */ qemu-deprecated.texi +0
-0
qemu-deprecated.texi QEMU using implicit generic or board specific splitting rule. · line 118
Quoted 7 lines
qemu-deprecated.texi +4
-0@@ -112,6 +112,14 @@ QEMU using implicit generic or board specific splitting rule. Use @option{memdev} with @var{memory-backend-ram} backend or @option{mem} (if it's supported by used machine type) to define mapping explictly instead. +@subsection -mem-path fallback to RAM (since 4.1) +Currently if system memory allocation from file pointed by @option{mem-path} +fails, QEMU fallbacks to allocating from anonymous RAM. Which might result +in unpredictable behavior since provided backing file wasn't used.
Noch such verb "to fallback", obvious fix "QEMU falls back to"
Suggest "RAM, which might".
Better: "since the backing file specified by the user is ignored".
qemu-deprecated.texi QEMU using implicit generic or board specific splitting rule. · line 121
Quoted 4 lines
qemu-deprecated.texi +3
-0In future +QEMU will not fallback and fail to start up, so user could fix his/her QEMU/host +configuration or explicitly use -m without -mem-path if system memory allocated +from anonymous RAM suits usecase.
What's "system memory allocation"?
Perhaps: "In the future, QEMU will not fall back, but fail instead. Adjust either the host configuration [FIXME how?] or the QEMU configuration [FIXME how?]."
Quoted 4 lines
qemu-deprecated.texi +1
-0+ @section QEMU Machine Protocol (QMP) commands@subsection block-dirty-bitmap-add "autoload" parameter (since 2.12.0)
Quoted 21 lines · Markus Armbruster
Quoted 19 lines · Igor Mammedov
Fallback might affect guest or worse whole host performance or functionality if backing file were used to share guest RAM with another process.
Patch deprecates fallback so that we could remove it in future and ensure that QEMU will provide expected behavior and fail if it can't use user provided backing file.
Signed-off-by Igor Mammedov <[email protected]>---
PS:
Patch is written on top of
[PATCH v4 0/3] numa: deprecate '-numa node, mem' and default memory distribution
to avoid conflicts in qemu-deprecated.texinuma.c | 4 ++-- qemu-deprecated.texi | 8 ++++++++ 2 files changed, 10 insertions(+), 2 deletions(-)
Quoted 14 lines
numa.c static void allocate_system_memory_nonnuma(MemoryRegion *mr, Object *owner, · line 498
Quoted 12 lines
numa.c +2
-2@@ -494,8 +494,8 @@ static void allocate_system_memory_nonnuma(MemoryRegion *mr, Object *owner,if (mem_prealloc) {exit (1 ); } -error_report ("falling back to regular RAM allocation." ); - +warn_report ("falling back to regular RAM allocation. " +"Fallback to RAM allocation is deprecated." );Can we give the user clues on how to avoid the deprecated fallback?
There's nothing a user can do aside from ensuring they have sufficient free memory before launching QEMU to satisfy the huge pag request.
Probably just needs changing to do.
"This is deprecated, future QEMU releases will exit when
huge pages cannot be allocated"
Regards,
Daniel
Signature · 3 lines
|: https://berrange.com -o- https://www.flickr.com/photos/dberrange :| |: https://libvirt.org -o- https://fstop138.berrange.com :| |: https://entangle-photo.org -o- https://www.instagram.com/dberrange :|
Quoted 37 lines · On Mon, 24 Jun 2019 10:36:55 +0100 Daniel P. Berrangé <[email protected]>…
Quoted 21 lines · Markus Armbruster
Quoted 19 lines · Igor Mammedov
Fallback might affect guest or worse whole host performance or functionality if backing file were used to share guest RAM with another process.
Patch deprecates fallback so that we could remove it in future and ensure that QEMU will provide expected behavior and fail if it can't use user provided backing file.
Signed-off-by Igor Mammedov <[email protected]>---
PS:
Patch is written on top of
[PATCH v4 0/3] numa: deprecate '-numa node, mem' and default memory distribution
to avoid conflicts in qemu-deprecated.texinuma.c | 4 ++-- qemu-deprecated.texi | 8 ++++++++ 2 files changed, 10 insertions(+), 2 deletions(-)Quoted 14 lines
numa.c static void allocate_system_memory_nonnuma(MemoryRegion *mr, Object *owner, · line 498
Quoted 12 lines
numa.c +2
-2@@ -494,8 +494,8 @@ static void allocate_system_memory_nonnuma(MemoryRegion *mr, Object *owner,if (mem_prealloc) {exit (1 ); } -error_report ("falling back to regular RAM allocation." ); - +warn_report ("falling back to regular RAM allocation. " +"Fallback to RAM allocation is deprecated." );Can we give the user clues on how to avoid the deprecated fallback?
Quoted 7 lines
There's nothing a user can do aside from ensuring they have sufficient free memory before launching QEMU to satisfy the huge pag request.
Probably just needs changing to do.
"This is deprecated, future QEMU releases will exit when
huge pages cannot be allocated"
Also it could be that users might use other than hugepages backing storage, that's why I completely left concrete advice out from suggestion.
User should know what he/she is doing when providing mem-path, if user supplies mis-configured path QEMU will print error from memory-backend-file if/when allocation fails.
Quoted 2 lines
Regards,
Daniel
Quoted 21 lines · On Mon, 24 Jun 2019 10:17:33 +0200 Markus Armbruster <[email protected]> wrote:
Quoted 19 lines · Igor Mammedov
Fallback might affect guest or worse whole host performance or functionality if backing file were used to share guest RAM with another process.
Patch deprecates fallback so that we could remove it in future and ensure that QEMU will provide expected behavior and fail if it can't use user provided backing file.
Signed-off-by Igor Mammedov <[email protected]>---
PS:
Patch is written on top of
[PATCH v4 0/3] numa: deprecate '-numa node, mem' and default memory distribution
to avoid conflicts in qemu-deprecated.texinuma.c | 4 ++-- qemu-deprecated.texi | 8 ++++++++ 2 files changed, 10 insertions(+), 2 deletions(-)
Quoted 14 lines
numa.c static void allocate_system_memory_nonnuma(MemoryRegion *mr, Object *owner, · line 498
Quoted 12 lines
numa.c +2
-2@@ -494,8 +494,8 @@ static void allocate_system_memory_nonnuma(MemoryRegion *mr, Object *owner,if (mem_prealloc) {exit (1 ); } -error_report ("falling back to regular RAM allocation." ); - +warn_report ("falling back to regular RAM allocation. " +"Fallback to RAM allocation is deprecated." );Can we give the user clues on how to avoid the deprecated fallback?
I've intentionally left it out for a lack of clear enough advise. Something like:
"Make sure that host has resources to map file pointed by -mem-path"
would be pretty useless.
I think describing how host should be configured in various ways depending on type of backing storage is well out of scope of any QEMU documentation. But if you have an idea to what to put there (or what to put in deprecation doc and refer to from here), I'll add it on respin.
Quoted 28 lines
Warning message nitpick: the message should be a single phrase, with no newline or trailing punctuation. Suggest something like
warn_report("falling back to regular RAM allocation"); error_printf("This is deprecated. <Advice on what\n" "to do goes here>\n");Quoted 8 lines
numa.c +0
-0/* Legacy behavior: if allocation failed, fall back to * regular RAM allocation. */ qemu-deprecated.texi +0
-0qemu-deprecated.texi QEMU using implicit generic or board specific splitting rule. · line 118
Quoted 7 lines
qemu-deprecated.texi +4
-0@@ -112,6 +112,14 @@ QEMU using implicit generic or board specific splitting rule. Use @option{memdev} with @var{memory-backend-ram} backend or @option{mem} (if it's supported by used machine type) to define mapping explictly instead. +@subsection -mem-path fallback to RAM (since 4.1) +Currently if system memory allocation from file pointed by @option{mem-path} +fails, QEMU fallbacks to allocating from anonymous RAM. Which might result +in unpredictable behavior since provided backing file wasn't used.Noch such verb "to fallback", obvious fix "QEMU falls back to"
Suggest "RAM, which might".
Quoted 8 lines
Better: "since the backing file specified by the user is ignored".
qemu-deprecated.texi QEMU using implicit generic or board specific splitting rule. · line 121
Quoted 4 lines
qemu-deprecated.texi +3
-0In future +QEMU will not fallback and fail to start up, so user could fix his/her QEMU/host +configuration or explicitly use -m without -mem-path if system memory allocated +from anonymous RAM suits usecase.What's "system memory allocation"?
Using man page language, would be
'guest startup RAM size'
acceptable?
Quoted 3 lines
Perhaps: "In the future, QEMU will not fall back, but fail instead. Adjust either the host configuration [FIXME how?] or the QEMU configuration [FIXME how?]."
Maybe
"
In the future, QEMU will not fall back, but fail instead. Adjust either the QEMU configuration by removing @option{-mem-path} so QEMU will use only anonymous or host configuration to make sure that there are sufficient resources on backing storage pointed by -mem-path to allocate amount specified by @option{-m}.
"
Quoted 5 lines
Quoted 4 lines
qemu-deprecated.texi +1
-0+ @section QEMU Machine Protocol (QMP) commands@subsection block-dirty-bitmap-add "autoload" parameter (since 2.12.0)
Quoted 39 lines · Igor Mammedov
Quoted 21 lines · On Mon, 24 Jun 2019 10:17:33 +0200 Markus Armbruster <[email protected]> wrote:
Quoted 19 lines · Igor Mammedov
Fallback might affect guest or worse whole host performance or functionality if backing file were used to share guest RAM with another process.
Patch deprecates fallback so that we could remove it in future and ensure that QEMU will provide expected behavior and fail if it can't use user provided backing file.
Signed-off-by Igor Mammedov <[email protected]>---
PS:
Patch is written on top of
[PATCH v4 0/3] numa: deprecate '-numa node, mem' and default memory distribution
to avoid conflicts in qemu-deprecated.texinuma.c | 4 ++-- qemu-deprecated.texi | 8 ++++++++ 2 files changed, 10 insertions(+), 2 deletions(-)Quoted 14 lines
numa.c static void allocate_system_memory_nonnuma(MemoryRegion *mr, Object *owner, · line 498
Quoted 12 lines
numa.c +2
-2@@ -494,8 +494,8 @@ static void allocate_system_memory_nonnuma(MemoryRegion *mr, Object *owner,if (mem_prealloc) {exit (1 ); } -error_report ("falling back to regular RAM allocation." ); - +warn_report ("falling back to regular RAM allocation. " +"Fallback to RAM allocation is deprecated." );Can we give the user clues on how to avoid the deprecated fallback?
Quoted 4 lines
I've intentionally left it out for a lack of clear enough advise. Something like:
"Make sure that host has resources to map file pointed by -mem-path"
would be pretty useless.
I see.
Quoted 51 lines
I think describing how host should be configured in various ways depending on type of backing storage is well out of scope of any QEMU documentation. But if you have an idea to what to put there (or what to put in deprecation doc and refer to from here), I'll add it on respin.
Quoted 28 lines
Warning message nitpick: the message should be a single phrase, with no newline or trailing punctuation. Suggest something like
warn_report("falling back to regular RAM allocation"); error_printf("This is deprecated. <Advice on what\n" "to do goes here>\n");Quoted 8 lines
numa.c +0
-0/* Legacy behavior: if allocation failed, fall back to * regular RAM allocation. */ qemu-deprecated.texi +0
-0qemu-deprecated.texi QEMU using implicit generic or board specific splitting rule. · line 118
Quoted 7 lines
qemu-deprecated.texi +4
-0@@ -112,6 +112,14 @@ QEMU using implicit generic or board specific splitting rule. Use @option{memdev} with @var{memory-backend-ram} backend or @option{mem} (if it's supported by used machine type) to define mapping explictly instead. +@subsection -mem-path fallback to RAM (since 4.1) +Currently if system memory allocation from file pointed by @option{mem-path} +fails, QEMU fallbacks to allocating from anonymous RAM. Which might result +in unpredictable behavior since provided backing file wasn't used.Noch such verb "to fallback", obvious fix "QEMU falls back to"
Suggest "RAM, which might".
Quoted 8 lines
Better: "since the backing file specified by the user is ignored".
qemu-deprecated.texi QEMU using implicit generic or board specific splitting rule. · line 121
Quoted 4 lines
qemu-deprecated.texi +3
-0In future +QEMU will not fallback and fail to start up, so user could fix his/her QEMU/host +configuration or explicitly use -m without -mem-path if system memory allocated +from anonymous RAM suits usecase.What's "system memory allocation"?
Using man page language, would be
'guest startup RAM size'
acceptable?Quoted 3 lines
Perhaps: "In the future, QEMU will not fall back, but fail instead. Adjust either the host configuration [FIXME how?] or the QEMU configuration [FIXME how?]."
Quoted 5 lines
Maybe
"
In the future, QEMU will not fall back, but fail instead. Adjust either the QEMU configuration by removing @option{-mem-path} so QEMU will use only anonymous or host configuration to make sure that
Do you mean "only anonymous memory"?
Quoted 3 lines
there are sufficient resources on backing storage pointed by -mem-path to allocate amount specified by @option{-m}.
"
Perhaps this could suffice: "Users will be responsible for making sure the backing storage specified with -mem-path can actually provide the guest RAM configured with -m."
Quoted 5 lines
Quoted 5 lines
Quoted 4 lines
qemu-deprecated.texi +1
-0+ @section QEMU Machine Protocol (QMP) commands@subsection block-dirty-bitmap-add "autoload" parameter (since 2.12.0)
Quoted 99 lines · On Mon, 24 Jun 2019 16:01:49 +0200 Markus Armbruster <[email protected]> wrote:
Quoted 39 lines · Igor Mammedov
Quoted 21 lines · On Mon, 24 Jun 2019 10:17:33 +0200 Markus Armbruster <[email protected]> wrote:
Quoted 19 lines · Igor Mammedov
Fallback might affect guest or worse whole host performance or functionality if backing file were used to share guest RAM with another process.
Patch deprecates fallback so that we could remove it in future and ensure that QEMU will provide expected behavior and fail if it can't use user provided backing file.
Signed-off-by Igor Mammedov <[email protected]>---
PS:
Patch is written on top of
[PATCH v4 0/3] numa: deprecate '-numa node, mem' and default memory distribution
to avoid conflicts in qemu-deprecated.texinuma.c | 4 ++-- qemu-deprecated.texi | 8 ++++++++ 2 files changed, 10 insertions(+), 2 deletions(-)Quoted 14 lines
numa.c static void allocate_system_memory_nonnuma(MemoryRegion *mr, Object *owner, · line 498
Quoted 12 lines
numa.c +2
-2@@ -494,8 +494,8 @@ static void allocate_system_memory_nonnuma(MemoryRegion *mr, Object *owner,if (mem_prealloc) {exit (1 ); } -error_report ("falling back to regular RAM allocation." ); - +warn_report ("falling back to regular RAM allocation. " +"Fallback to RAM allocation is deprecated." );Can we give the user clues on how to avoid the deprecated fallback?
Quoted 4 lines
I've intentionally left it out for a lack of clear enough advise. Something like:
"Make sure that host has resources to map file pointed by -mem-path"
would be pretty useless.I see.
Quoted 51 lines
I think describing how host should be configured in various ways depending on type of backing storage is well out of scope of any QEMU documentation. But if you have an idea to what to put there (or what to put in deprecation doc and refer to from here), I'll add it on respin.
Quoted 28 lines
Warning message nitpick: the message should be a single phrase, with no newline or trailing punctuation. Suggest something like
warn_report("falling back to regular RAM allocation"); error_printf("This is deprecated. <Advice on what\n" "to do goes here>\n");Quoted 8 lines
numa.c +0
-0/* Legacy behavior: if allocation failed, fall back to * regular RAM allocation. */ qemu-deprecated.texi +0
-0qemu-deprecated.texi QEMU using implicit generic or board specific splitting rule. · line 118
Quoted 7 lines
qemu-deprecated.texi +4
-0@@ -112,6 +112,14 @@ QEMU using implicit generic or board specific splitting rule. Use @option{memdev} with @var{memory-backend-ram} backend or @option{mem} (if it's supported by used machine type) to define mapping explictly instead. +@subsection -mem-path fallback to RAM (since 4.1) +Currently if system memory allocation from file pointed by @option{mem-path} +fails, QEMU fallbacks to allocating from anonymous RAM. Which might result +in unpredictable behavior since provided backing file wasn't used.Noch such verb "to fallback", obvious fix "QEMU falls back to"
Suggest "RAM, which might".
Quoted 8 lines
Better: "since the backing file specified by the user is ignored".
qemu-deprecated.texi QEMU using implicit generic or board specific splitting rule. · line 121
Quoted 4 lines
qemu-deprecated.texi +3
-0In future +QEMU will not fallback and fail to start up, so user could fix his/her QEMU/host +configuration or explicitly use -m without -mem-path if system memory allocated +from anonymous RAM suits usecase.What's "system memory allocation"?
Using man page language, would be
'guest startup RAM size'
acceptable?Quoted 3 lines
Perhaps: "In the future, QEMU will not fall back, but fail instead. Adjust either the host configuration [FIXME how?] or the QEMU configuration [FIXME how?]."
Quoted 7 lines
Quoted 5 lines
Maybe
"
In the future, QEMU will not fall back, but fail instead. Adjust either the QEMU configuration by removing @option{-mem-path} so QEMU will use only anonymous or host configuration to make sure thatDo you mean "only anonymous memory"?
yep
Quoted 7 lines
Quoted 3 lines
there are sufficient resources on backing storage pointed by -mem-path to allocate amount specified by @option{-m}.
"Perhaps this could suffice: "Users will be responsible for making sure the backing storage specified with -mem-path can actually provide the guest RAM configured with -m."
amended hunk will look like:
"
@subsection -mem-path fallback to RAM (since 4.1)
Currently if guest RAM allocation from file pointed by @option{mem-path} fails, QEMU falls back to allocating from RAM, which might result in unpredictable behavior since the backing file specified by the user is ignored. In the future, users will be responsible for making sure the backing storage specified with @option{-mem-path} can actually provide the guest RAM configured with @option{-m} and fail to start up if RAM allocation is unsuccessful.
"
Quoted 6 lines
Quoted 6 lines
Quoted 6 lines
Quoted 5 lines
qemu-deprecated.texi +1
-0+ @section QEMU Machine Protocol (QMP) commands@subsection block-dirty-bitmap-add "autoload" parameter (since 2.12.0)