Skip to contentSkip to conversation

numa: warn if numa 'mem' option or default RAM splitting between nodes is used.

PATCH Superseded Igor Mammedov 3 participants 8 messages Mar 6, 2019 – Mar 7, 2019

v1 of 2 Superseded Latest is v2 →

lore
Share & tools
lore
#0 lore raw

PATCH 1/1 numa: warn if numa 'mem' option or default RAM splitting between nodes is used.

Ammend -numa option docs and print warnings if 'mem' option or default RAM splitting between nodes is used. It's intended to discourage users from using configuration that allows only to fake NUMA on guest side while leading to reduced performance of the guest due to inability to properly configure VM's RAM on the host.

In NUMA case, it's recommended to always explicitly configure guest RAM using -numa node,memdev={backend-id} option.

---
 numa.c          |  5 +++++
 qemu-options.hx | 12 ++++++++----
 2 files changed, 13 insertions(+), 4 deletions(-)
numa.c +5 -0
index 3875e1e..c6c2a6f 100644
@@ -121,6 +121,8 @@ static void parse_numa_node(MachineState *ms, NumaNodeOptions *node,
 
     if (node->has_mem) {
         numa_info[nodenr].node_mem = node->mem;
+        warn_report("Parameter -numa node,mem is obsolete,"
+                    " use -numa node,memdev instead");
     }
     if (node->has_memdev) {
         Object *o;
@@ -407,6 +409,9 @@ void numa_complete_configuration(MachineState *ms)
         if (i == nb_numa_nodes) {
             assert(mc->numa_auto_assign_ram);
             mc->numa_auto_assign_ram(mc, numa_info, nb_numa_nodes, ram_size);
+            warn_report("Default splitting of RAM between nodes is obsolete,"
+                        " Use '-numa node,memdev' to explictly define RAM"
+                        " allocation per node");
         }
 
         numa_total = 0;
qemu-options.hx +8 -4
index 1cf9aac..033e311 100644
@@ -206,10 +206,14 @@ For example:
 -numa cpu,node-id=0,socket-id=0 -numa cpu,node-id=1,socket-id=1
 @end example
 
-@samp{mem} assigns a given RAM amount to a node. @samp{memdev}
-assigns RAM from a given memory backend device to a node. If
-@samp{mem} and @samp{memdev} are omitted in all nodes, RAM is
-split equally between them.
+@samp{memdev} assigns RAM from a given memory backend device to a node.
+
+Legacy options/behaviour: @samp{mem} assigns a given RAM amount to a node.
+If @samp{mem} and @samp{memdev} are omitted in all nodes, RAM is split equally
+between them. Option @samp{mem} and default RAM splitting are obsolete as they
+do not provide means to manage RAM on host side and only allow QEMU to fake
+NUMA support which in practice could degrade VM performance.
+It's advised to always explicitly configure NUMA RAM using @samp{memdev} option.
 
 @samp{mem} and @samp{memdev} are mutually exclusive. Furthermore,
 if one node uses @samp{memdev}, all of them have to use it.
Signature · 1 line
2.7.4
#1 lore raw
Quoted 1 line · Igor Mammedov

Ammend -numa option docs and print warnings if 'mem' option or default RAM

s/Ammend/Amend/

Quoted 16 lines

splitting between nodes is used. It's intended to discourage users from using configuration that allows only to fake NUMA on guest side while leading to reduced performance of the guest due to inability to properly configure VM's RAM on the host.

In NUMA case, it's recommended to always explicitly configure guest RAM using -numa node,memdev={backend-id} option.

---
 numa.c          |  5 +++++
 qemu-options.hx | 12 ++++++++----
 2 files changed, 13 insertions(+), 4 deletions(-)

numa.c void numa_complete_configuration(MachineState *ms) · line 413

Quoted 5 lines
numa.c +2 -0
@@ -407,6 +409,9 @@ void numa_complete_configuration(MachineState *ms)
         if (i == nb_numa_nodes) {
             assert(mc->numa_auto_assign_ram);
             mc->numa_auto_assign_ram(mc, numa_info, nb_numa_nodes, ram_size);
+            warn_report("Default splitting of RAM between nodes is obsolete,"
+                        " Use '-numa node,memdev' to explictly define RAM"

s/explictly/explicitly/

Quoted 5 lines
qemu-options.hx +1 -0
+++ b/qemu-options.hx
@@ -206,10 +206,14 @@ For example:
 -numa cpu,node-id=0,socket-id=0 -numa cpu,node-id=1,socket-id=1
 @end example
 

qemu-options.hx For example: · line 214

Quoted 10 lines
qemu-options.hx +6 -4
-@samp{mem} assigns a given RAM amount to a node. @samp{memdev}
-assigns RAM from a given memory backend device to a node. If
-@samp{mem} and @samp{memdev} are omitted in all nodes, RAM is
-split equally between them.
+@samp{memdev} assigns RAM from a given memory backend device to a node.
+
+Legacy options/behaviour: @samp{mem} assigns a given RAM amount to a node.
+If @samp{mem} and @samp{memdev} are omitted in all nodes, RAM is split equally
+between them. Option @samp{mem} and default RAM splitting are obsolete as they
+do not provide means to manage RAM on host side and only allow QEMU to fake

s/on host/on the host/

qemu-options.hx For example: · line 216

Quoted 2 lines
qemu-options.hx +2 -0
+NUMA support which in practice could degrade VM performance.
+It's advised to always explicitly configure NUMA RAM using @samp{memdev} option.

s/using/by using the/

Signature · 3 lines
Eric Blake, Principal Software Engineer
Red Hat, Inc.           +1-919-301-3226
Virtualization:  qemu.org | libvirt.org
#2 lore raw
In reply to Igor Mammedov
Quoted 20 lines · Igor Mammedov

Ammend -numa option docs and print warnings if 'mem' option or default RAM splitting between nodes is used. It's intended to discourage users from using configuration that allows only to fake NUMA on guest side while leading to reduced performance of the guest due to inability to properly configure VM's RAM on the host.

In NUMA case, it's recommended to always explicitly configure guest RAM using -numa node,memdev={backend-id} option.

---
 numa.c          |  5 +++++
 qemu-options.hx | 12 ++++++++----
 2 files changed, 13 insertions(+), 4 deletions(-)
numa.c +0 -0
index 3875e1e..c6c2a6f 100644

numa.c static void parse_numa_node(MachineState *ms, NumaNodeOptions *node, · line 125

Quoted 5 lines
numa.c +2 -0
@@ -121,6 +121,8 @@ static void parse_numa_node(MachineState *ms, NumaNodeOptions *node,
 
     if (node->has_mem) {
         numa_info[nodenr].node_mem = node->mem;
+        warn_report("Parameter -numa node,mem is obsolete,"
+                    " use -numa node,memdev instead");

I don't think we should do this. Libvirt isn't going to stop using this option in the near term. When users see warnings like this in logs they'll often file bugs reports thinking something is broken which is not the case here.

numa.c void numa_complete_configuration(MachineState *ms) · line 414

Quoted 10 lines
numa.c +3 -0
     }
     if (node->has_memdev) {
         Object *o;
@@ -407,6 +409,9 @@ void numa_complete_configuration(MachineState *ms)
         if (i == nb_numa_nodes) {
             assert(mc->numa_auto_assign_ram);
             mc->numa_auto_assign_ram(mc, numa_info, nb_numa_nodes, ram_size);
+            warn_report("Default splitting of RAM between nodes is obsolete,"
+                        " Use '-numa node,memdev' to explictly define RAM"
+                        " allocation per node");

I think this one is ok as I don't believe libvirt triggers this code path

Quoted 26 lines
qemu-options.hx +8 -4
index 1cf9aac..033e311 100644
@@ -206,10 +206,14 @@ For example:
 -numa cpu,node-id=0,socket-id=0 -numa cpu,node-id=1,socket-id=1
 @end example
 
-@samp{mem} assigns a given RAM amount to a node. @samp{memdev}
-assigns RAM from a given memory backend device to a node. If
-@samp{mem} and @samp{memdev} are omitted in all nodes, RAM is
-split equally between them.
+@samp{memdev} assigns RAM from a given memory backend device to a node.
+
+Legacy options/behaviour: @samp{mem} assigns a given RAM amount to a node.
+If @samp{mem} and @samp{memdev} are omitted in all nodes, RAM is split equally
+between them. Option @samp{mem} and default RAM splitting are obsolete as they
+do not provide means to manage RAM on host side and only allow QEMU to fake
+NUMA support which in practice could degrade VM performance.
+It's advised to always explicitly configure NUMA RAM using @samp{memdev} option.
 
 @samp{mem} and @samp{memdev} are mutually exclusive. Furthermore,
 if one node uses @samp{memdev}, all of them have to use it.
Signature · 1 line
2.7.4

Regards,
Daniel

Signature · 3 lines
|: https://berrange.com      -o-    https://www.flickr.com/photos/dberrange :|
|: https://libvirt.org         -o-            https://fstop138.berrange.com :|
|: https://entangle-photo.org    -o-    https://www.instagram.com/dberrange :|
#3 lore raw
Quoted 22 lines · On Wed, 6 Mar 2019 16:39:38 +0000 Daniel P. Berrangé <[email protected]>…
Quoted 21 lines · Igor Mammedov

Ammend -numa option docs and print warnings if 'mem' option or default RAM splitting between nodes is used. It's intended to discourage users from using configuration that allows only to fake NUMA on guest side while leading to reduced performance of the guest due to inability to properly configure VM's RAM on the host.

In NUMA case, it's recommended to always explicitly configure guest RAM using -numa node,memdev={backend-id} option.

---
 numa.c          |  5 +++++
 qemu-options.hx | 12 ++++++++----
 2 files changed, 13 insertions(+), 4 deletions(-)
numa.c +0 -0
index 3875e1e..c6c2a6f 100644
@@ -121,6 +121,8 @@ static void parse_numa_node(MachineState *ms, NumaNodeOptions *node,
 
Quoted 7 lines

numa.c static void parse_numa_node(MachineState *ms, NumaNodeOptions *node, · line 125

Quoted 4 lines
numa.c +2 -0
     if (node->has_mem) {
         numa_info[nodenr].node_mem = node->mem;
+        warn_report("Parameter -numa node,mem is obsolete,"
+                    " use -numa node,memdev instead");

I don't think we should do this. Libvirt isn't going to stop using this option in the near term. When users see warnings like this in logs

well when it was the only option available libvirt had no other choice, but since memdev became available libvirt should try to use it whenever possible.

Quoted 2 lines

they'll often file bugs reports thinking something is broken which is not the case here.

It's the exact purpose of the warning, to force user asking questions and fix configuration, since he/she obviously not getting NUMA benefits and/or performance-wise

I have to disagree here, I don't like ducking our head and ignoring broken configuration when there is working alternative. As end user I'd hate that problem was hidden from me.

I'll respin v2 after fixing mistakes Eric pointed out.

Quoted 43 lines

numa.c void numa_complete_configuration(MachineState *ms) · line 414

Quoted 11 lines
numa.c +3 -0
     }
     if (node->has_memdev) {
         Object *o;
@@ -407,6 +409,9 @@ void numa_complete_configuration(MachineState *ms)
         if (i == nb_numa_nodes) {
             assert(mc->numa_auto_assign_ram);
             mc->numa_auto_assign_ram(mc, numa_info, nb_numa_nodes, ram_size);
+            warn_report("Default splitting of RAM between nodes is obsolete,"
+                        " Use '-numa node,memdev' to explictly define RAM"
+                        " allocation per node");

I think this one is ok as I don't believe libvirt triggers this code path

Quoted 26 lines
qemu-options.hx +8 -4
index 1cf9aac..033e311 100644
@@ -206,10 +206,14 @@ For example:
 -numa cpu,node-id=0,socket-id=0 -numa cpu,node-id=1,socket-id=1
 @end example
 
-@samp{mem} assigns a given RAM amount to a node. @samp{memdev}
-assigns RAM from a given memory backend device to a node. If
-@samp{mem} and @samp{memdev} are omitted in all nodes, RAM is
-split equally between them.
+@samp{memdev} assigns RAM from a given memory backend device to a node.
+
+Legacy options/behaviour: @samp{mem} assigns a given RAM amount to a node.
+If @samp{mem} and @samp{memdev} are omitted in all nodes, RAM is split equally
+between them. Option @samp{mem} and default RAM splitting are obsolete as they
+do not provide means to manage RAM on host side and only allow QEMU to fake
+NUMA support which in practice could degrade VM performance.
+It's advised to always explicitly configure NUMA RAM using @samp{memdev} option.
 
 @samp{mem} and @samp{memdev} are mutually exclusive. Furthermore,
 if one node uses @samp{memdev}, all of them have to use it.
Signature · 1 line
2.7.4

Regards,
Daniel

#4 lore raw
Quoted 32 lines · Igor Mammedov
Quoted 22 lines · On Wed, 6 Mar 2019 16:39:38 +0000 Daniel P. Berrangé <[email protected]>…
Quoted 21 lines · Igor Mammedov

Ammend -numa option docs and print warnings if 'mem' option or default RAM splitting between nodes is used. It's intended to discourage users from using configuration that allows only to fake NUMA on guest side while leading to reduced performance of the guest due to inability to properly configure VM's RAM on the host.

In NUMA case, it's recommended to always explicitly configure guest RAM using -numa node,memdev={backend-id} option.

---
 numa.c          |  5 +++++
 qemu-options.hx | 12 ++++++++----
 2 files changed, 13 insertions(+), 4 deletions(-)
numa.c +0 -0
index 3875e1e..c6c2a6f 100644
@@ -121,6 +121,8 @@ static void parse_numa_node(MachineState *ms, NumaNodeOptions *node,
 
Quoted 7 lines

numa.c static void parse_numa_node(MachineState *ms, NumaNodeOptions *node, · line 125

Quoted 4 lines
numa.c +2 -0
     if (node->has_mem) {
         numa_info[nodenr].node_mem = node->mem;
+        warn_report("Parameter -numa node,mem is obsolete,"
+                    " use -numa node,memdev instead");

I don't think we should do this. Libvirt isn't going to stop using this option in the near term. When users see warnings like this in logs

Quoted 3 lines

well when it was the only option available libvirt had no other choice, but since memdev became available libvirt should try to use it whenever possible.

As we previously discussed, it is not possible for libvirt to use it in all cases.

Quoted 6 lines
Quoted 3 lines

they'll often file bugs reports thinking something is broken which is not the case here.

It's the exact purpose of the warning, to force user asking questions and fix configuration, since he/she obviously not getting NUMA benefits and/or performance-wise

That's only useful if it is possible to do something about the problem. Libvirt wants to use the new option but it can't due to the live migration problems. So this simply leads to bug reports that will end up marked as CANTFIX.

I don't believe libvirt actually suffers from the performance problem
you describe wrt lack of pinning. When we attempt to pin guest NUMA
nodes to host NUMA nodes, libvirt *will* use "memdev". IIUC, we use "mem" in the case where there /no/ requested pinning of guest NUMA nodes, and so we're not suffering from the limitations of "mem" in that case.

Quoted 3 lines

I have to disagree here, I don't like ducking our head and ignoring broken configuration when there is working alternative. As end user I'd hate that problem was hidden from me.

Regards,
Daniel

Signature · 3 lines
|: https://berrange.com      -o-    https://www.flickr.com/photos/dberrange :|
|: https://libvirt.org         -o-            https://fstop138.berrange.com :|
|: https://entangle-photo.org    -o-    https://www.instagram.com/dberrange :|
#5 lore raw
Quoted 43 lines · On Wed, 6 Mar 2019 17:10:37 +0000 Daniel P. Berrangé <[email protected]>…
Quoted 32 lines · Igor Mammedov
Quoted 22 lines · On Wed, 6 Mar 2019 16:39:38 +0000 Daniel P. Berrangé <[email protected]>…
Quoted 21 lines · Igor Mammedov

Ammend -numa option docs and print warnings if 'mem' option or default RAM splitting between nodes is used. It's intended to discourage users from using configuration that allows only to fake NUMA on guest side while leading to reduced performance of the guest due to inability to properly configure VM's RAM on the host.

In NUMA case, it's recommended to always explicitly configure guest RAM using -numa node,memdev={backend-id} option.

---
 numa.c          |  5 +++++
 qemu-options.hx | 12 ++++++++----
 2 files changed, 13 insertions(+), 4 deletions(-)
numa.c +0 -0
index 3875e1e..c6c2a6f 100644
@@ -121,6 +121,8 @@ static void parse_numa_node(MachineState *ms, NumaNodeOptions *node,
 
Quoted 7 lines

numa.c static void parse_numa_node(MachineState *ms, NumaNodeOptions *node, · line 125

Quoted 4 lines
numa.c +2 -0
     if (node->has_mem) {
         numa_info[nodenr].node_mem = node->mem;
+        warn_report("Parameter -numa node,mem is obsolete,"
+                    " use -numa node,memdev instead");

I don't think we should do this. Libvirt isn't going to stop using this option in the near term. When users see warnings like this in logs

Quoted 3 lines

well when it was the only option available libvirt had no other choice, but since memdev became available libvirt should try to use it whenever possible.

As we previously discussed, it is not possible for libvirt to use it in all cases.

Quoted 3 lines
Quoted 3 lines

they'll often file bugs reports thinking something is broken which is not the case here.

Quoted 8 lines
Quoted 3 lines

It's the exact purpose of the warning, to force user asking questions and fix configuration, since he/she obviously not getting NUMA benefits and/or performance-wise

That's only useful if it is possible to do something about the problem. Libvirt wants to use the new option but it can't due to the live migration problems. So this simply leads to bug reports that will end up marked as CANTFIX.

The problem could be solved by user though, by reconfiguring and restarting domain since it's impossible to (at least as it stands now wrt migration).

Quoted 6 lines

I don't believe libvirt actually suffers from the performance problem
you describe wrt lack of pinning. When we attempt to pin guest NUMA
nodes to host NUMA nodes, libvirt *will* use "memdev". IIUC, we use "mem" in the case where there /no/ requested pinning of guest NUMA nodes, and so we're not suffering from the limitations of "mem" in that case.

What would be the use-case for not pinning numa nodes?
If user isn't asking for pinning, VM would run with degraded performance and it would be better of being non-numa.

Even if user doesn't ask for pinning, non-pinned memdev (for new VMs where available) could be used as well. Users of 'mem' with new QEMU will see the warning and probably think about if they are configured VM correctly.

Desire to deprecate 'mem' at least for new machines is to be able to prevent user from creating broken configs and manage all RAM in the same manner (frontend/backend). (I can't do it for old machine types but for new it is possible).

Quoted 8 lines
Quoted 3 lines

I have to disagree here, I don't like ducking our head and ignoring broken configuration when there is working alternative. As end user I'd hate that problem was hidden from me.

Regards,
Daniel

#6 lore raw
Quoted 63 lines · Igor Mammedov
Quoted 43 lines · On Wed, 6 Mar 2019 17:10:37 +0000 Daniel P. Berrangé <[email protected]>…
Quoted 32 lines · Igor Mammedov
Quoted 22 lines · On Wed, 6 Mar 2019 16:39:38 +0000 Daniel P. Berrangé <[email protected]>…
Quoted 21 lines · Igor Mammedov

Ammend -numa option docs and print warnings if 'mem' option or default RAM splitting between nodes is used. It's intended to discourage users from using configuration that allows only to fake NUMA on guest side while leading to reduced performance of the guest due to inability to properly configure VM's RAM on the host.

In NUMA case, it's recommended to always explicitly configure guest RAM using -numa node,memdev={backend-id} option.

---
 numa.c          |  5 +++++
 qemu-options.hx | 12 ++++++++----
 2 files changed, 13 insertions(+), 4 deletions(-)
numa.c +0 -0
index 3875e1e..c6c2a6f 100644
@@ -121,6 +121,8 @@ static void parse_numa_node(MachineState *ms, NumaNodeOptions *node,
 
Quoted 7 lines

numa.c static void parse_numa_node(MachineState *ms, NumaNodeOptions *node, · line 125

Quoted 4 lines
numa.c +2 -0
     if (node->has_mem) {
         numa_info[nodenr].node_mem = node->mem;
+        warn_report("Parameter -numa node,mem is obsolete,"
+                    " use -numa node,memdev instead");

I don't think we should do this. Libvirt isn't going to stop using this option in the near term. When users see warnings like this in logs

Quoted 3 lines

well when it was the only option available libvirt had no other choice, but since memdev became available libvirt should try to use it whenever possible.

As we previously discussed, it is not possible for libvirt to use it in all cases.

Quoted 3 lines
Quoted 3 lines

they'll often file bugs reports thinking something is broken which is not the case here.

Quoted 8 lines
Quoted 3 lines

It's the exact purpose of the warning, to force user asking questions and fix configuration, since he/she obviously not getting NUMA benefits and/or performance-wise

That's only useful if it is possible to do something about the problem. Libvirt wants to use the new option but it can't due to the live migration problems. So this simply leads to bug reports that will end up marked as CANTFIX.

The problem could be solved by user though, by reconfiguring and restarting domain since it's impossible to (at least as it stands now wrt migration).

Quoted 6 lines

I don't believe libvirt actually suffers from the performance problem
you describe wrt lack of pinning. When we attempt to pin guest NUMA
nodes to host NUMA nodes, libvirt *will* use "memdev". IIUC, we use "mem" in the case where there /no/ requested pinning of guest NUMA nodes, and so we're not suffering from the limitations of "mem" in that case.

Quoted 3 lines

What would be the use-case for not pinning numa nodes?
If user isn't asking for pinning, VM would run with degraded performance and it would be better of being non-numa.

The guest could have been originally booted on a host which has 2 NUMA nodes and have been migrated to a host with 1 NUMA node, in which case pinnning is not relevant.

For CI purposes too it is reasonable to create guests with NUMA configurations that bear no resemblance to the host NUMA configuration. This allows for testing the operation of guest applications. This is something that is relevant to OpenStack for testnig Nova's handling of NUMA placement logic, since almost all their testing is in VMs not bare metal.

Not pinning isn't common, but it is reasonable to do it.

Quoted 3 lines

Even if user doesn't ask for pinning, non-pinned memdev (for new VMs where available) could be used as well. Users of 'mem' with new QEMU will see the warning and probably think about if they are configured VM correctly.

We can't change to memdev due to migration problems. Since there is no functional problem with using 'mem' in this scenario there's no pressing reason to stop using 'mem'.

Quoted 3 lines

Desire to deprecate 'mem' at least for new machines is to be able to prevent user from creating broken configs and manage all RAM in the same manner (frontend/backend). (I can't do it for old machine types but for new it is possible).

As before libvirt can't make its CLI config dependant on machine type version as that breaks live migration to old libvirt versions.

Regards,
Daniel

Signature · 3 lines
|: https://berrange.com      -o-    https://www.flickr.com/photos/dberrange :|
|: https://libvirt.org         -o-            https://fstop138.berrange.com :|
|: https://entangle-photo.org    -o-    https://www.instagram.com/dberrange :|
#7 lore raw
Quoted 82 lines · On Thu, 7 Mar 2019 10:04:56 +0000 Daniel P. Berrangé <[email protected]>…
Quoted 63 lines · Igor Mammedov
Quoted 43 lines · On Wed, 6 Mar 2019 17:10:37 +0000 Daniel P. Berrangé <[email protected]>…
Quoted 32 lines · Igor Mammedov
Quoted 22 lines · On Wed, 6 Mar 2019 16:39:38 +0000 Daniel P. Berrangé <[email protected]>…
Quoted 21 lines · Igor Mammedov

Ammend -numa option docs and print warnings if 'mem' option or default RAM splitting between nodes is used. It's intended to discourage users from using configuration that allows only to fake NUMA on guest side while leading to reduced performance of the guest due to inability to properly configure VM's RAM on the host.

In NUMA case, it's recommended to always explicitly configure guest RAM using -numa node,memdev={backend-id} option.

---
 numa.c          |  5 +++++
 qemu-options.hx | 12 ++++++++----
 2 files changed, 13 insertions(+), 4 deletions(-)
numa.c +0 -0
index 3875e1e..c6c2a6f 100644
@@ -121,6 +121,8 @@ static void parse_numa_node(MachineState *ms, NumaNodeOptions *node,
 
Quoted 7 lines

numa.c static void parse_numa_node(MachineState *ms, NumaNodeOptions *node, · line 125

Quoted 4 lines
numa.c +2 -0
     if (node->has_mem) {
         numa_info[nodenr].node_mem = node->mem;
+        warn_report("Parameter -numa node,mem is obsolete,"
+                    " use -numa node,memdev instead");  

I don't think we should do this. Libvirt isn't going to stop using this option in the near term. When users see warnings like this in logs

Quoted 3 lines

well when it was the only option available libvirt had no other choice, but since memdev became available libvirt should try to use it whenever possible.

As we previously discussed, it is not possible for libvirt to use it in all cases.

Quoted 3 lines
Quoted 3 lines

they'll often file bugs reports thinking something is broken which is not the case here.

Quoted 8 lines
Quoted 3 lines

It's the exact purpose of the warning, to force user asking questions and fix configuration, since he/she obviously not getting NUMA benefits and/or performance-wise

That's only useful if it is possible to do something about the problem. Libvirt wants to use the new option but it can't due to the live migration problems. So this simply leads to bug reports that will end up marked as CANTFIX.

The problem could be solved by user though, by reconfiguring and restarting domain since it's impossible to (at least as it stands now wrt migration).

Quoted 6 lines

I don't believe libvirt actually suffers from the performance problem
you describe wrt lack of pinning. When we attempt to pin guest NUMA
nodes to host NUMA nodes, libvirt *will* use "memdev". IIUC, we use "mem" in the case where there /no/ requested pinning of guest NUMA nodes, and so we're not suffering from the limitations of "mem" in that case.

Quoted 3 lines

What would be the use-case for not pinning numa nodes?
If user isn't asking for pinning, VM would run with degraded performance and it would be better of being non-numa.

The guest could have been originally booted on a host which has 2 NUMA nodes and have been migrated to a host with 1 NUMA node, in which case pinnning is not relevant.

For CI purposes too it is reasonable to create guests with NUMA configurations that bear no resemblance to the host NUMA configuration. This allows for testing the operation of guest applications. This is something that is relevant to OpenStack for testnig Nova's handling of NUMA placement logic, since almost all their testing is in VMs not bare metal.

Not pinning isn't common, but it is reasonable to do it.

Quoted 7 lines
Quoted 3 lines

Even if user doesn't ask for pinning, non-pinned memdev (for new VMs where available) could be used as well. Users of 'mem' with new QEMU will see the warning and probably think about if they are configured VM correctly.

We can't change to memdev due to migration problems. Since there is no functional problem with using 'mem' in this scenario there's no pressing reason to stop using 'mem'.

The problem with it is that it blocks fixing bug in QEMU for the multi node case
'-numa node,mem + -mem-path + -mem-prealloc + -object "memdev",policy=bind'
and it also gets in the way of unifying RAM handling using device-memory for initial RAM due to the same migration issue since RAM layout in migration stream is different.

Quoted 9 lines
Quoted 3 lines

Desire to deprecate 'mem' at least for new machines is to be able to prevent user from creating broken configs and manage all RAM in the same manner (frontend/backend). (I can't do it for old machine types but for new it is possible).

As before libvirt can't make its CLI config dependant on machine type version as that breaks live migration to old libvirt versions.

Regards,
Daniel