Skip to contentSkip to conversation

docs: specify stability of hypfs path documentation

PATCH Superseded Juergen Gross 3 participants 12 messages Jul 13, 2020 – Jul 20, 2020

v2 of 3 Superseded Latest is v3 →

lore
Share & tools
lore
#0 lore raw

PATCH v2 1/1 docs: specify stability of hypfs path documentation

In docs/misc/hypfs-paths.pandoc the supported paths in the hypervisor file system are specified. Make it more clear that path availability might change, e.g. due to scope widening or narrowing (e.g. being limited to a specific architecture).

---
V2: reworded as requested by Jan Beulich

---
 docs/misc/hypfs-paths.pandoc | 8 ++++++++
 1 file changed, 8 insertions(+)
docs/misc/hypfs-paths.pandoc +8 -0
index a111c6f25c..00a7cec031 100644
@@ -5,6 +5,9 @@ in the Xen hypervisor file system (hypfs).
 
 The hypervisor file system can be accessed via the xenhypfs tool.
 
+The availability of the hypervisor file system depends on the hypervisor
+config option CONFIG_HYPFS, which is on per default.
+
 ## Notation
 
 The hypervisor file system is similar to the Linux kernel's sysfs.
@@ -55,6 +58,11 @@ tags enclosed in square brackets.
 * CONFIG_* -- Path is valid only in case the hypervisor was built with
   the respective config option.
 
+In case a tag for a path indicates that this path is available in some
+case only, this availability might be extended or reduced in future by
+modification or removal of the tag. A path once assigned meaning won't go
+away altogether or change its meaning, though.
+
 So an entry could look like this:
 
     /cpu-bugs/active-pv/xpti = ("No"|{"dom0", "domU", "PCID-on"}) [w,X86,PV]
Signature · 1 line
2.26.2
Acked-by on v2 1/1
#1 lore raw
Quoted 7 lines · Juergen Gross

In docs/misc/hypfs-paths.pandoc the supported paths in the hypervisor file system are specified. Make it more clear that path availability might change, e.g. due to scope widening or narrowing (e.g. being limited to a specific architecture).

However, I'd like agreement by at least one other REST maintainer on
...

docs/misc/hypfs-paths.pandoc tags enclosed in square brackets. · line 64

Quoted 8 lines
docs/misc/hypfs-paths.pandoc +4 -0
@@ -55,6 +58,11 @@ tags enclosed in square brackets.
 * CONFIG_* -- Path is valid only in case the hypervisor was built with
   the respective config option.
 
+In case a tag for a path indicates that this path is available in some
+case only, this availability might be extended or reduced in future by
+modification or removal of the tag. A path once assigned meaning won't go
+away altogether or change its meaning, though.

... the newly imposed guarantee we're now making. We really want to avoid declaring something as stable without being quite certain we can keep it stable.

Jan

#2 lore raw
Quoted 22 lines · Jan Beulich
Quoted 7 lines · Juergen Gross

In docs/misc/hypfs-paths.pandoc the supported paths in the hypervisor file system are specified. Make it more clear that path availability might change, e.g. due to scope widening or narrowing (e.g. being limited to a specific architecture).

However, I'd like agreement by at least one other REST maintainer on
...

Quoted 4 lines
docs/misc/hypfs-paths.pandoc +0 -0
@@ -55,6 +58,11 @@ tags enclosed in square brackets.
 * CONFIG_* -- Path is valid only in case the hypervisor was built with
  the respective config option.
 
Quoted 8 lines

docs/misc/hypfs-paths.pandoc tags enclosed in square brackets. · line 64

Quoted 4 lines
docs/misc/hypfs-paths.pandoc +4 -0
+In case a tag for a path indicates that this path is available in some
+case only, this availability might be extended or reduced in future by
+modification or removal of the tag. A path once assigned meaning won't go
+away altogether or change its meaning, though.

... the newly imposed guarantee we're now making. We really want to avoid declaring something as stable without being quite certain we can keep it stable.

The declaration of new nodes must all happen in this file, right? So as long as the maintainer(s) fo this file are aware of that, and it’s commented so that people know that expecation, I think it’s OK.

But I think this paragraph isn’t very clear to me what “might be extended or reduced …but won’t go away altogether”.

IT sounds like you’re saying:

1. Paths listed without conditions will always be available

2. Paths listed with conditions may be extended: i.e., a node currently listed as PV might also become available for HVM guests

3. Paths listed with conditions might have those conditions reduced, but will never entirely disappear. So something currently listed as PV might be reduced to CONFIG_HAS_FOO, but won’t be completely removed.

Is that what you meant?

-George

#3 lore raw
Quoted 37 lines · George Dunlap
Quoted 22 lines · Jan Beulich
Quoted 7 lines · Juergen Gross

In docs/misc/hypfs-paths.pandoc the supported paths in the hypervisor file system are specified. Make it more clear that path availability might change, e.g. due to scope widening or narrowing (e.g. being limited to a specific architecture).

However, I'd like agreement by at least one other REST maintainer on
...

Quoted 4 lines
docs/misc/hypfs-paths.pandoc +0 -0
@@ -55,6 +58,11 @@ tags enclosed in square brackets.
 * CONFIG_* -- Path is valid only in case the hypervisor was built with
   the respective config option.
 
Quoted 8 lines

docs/misc/hypfs-paths.pandoc tags enclosed in square brackets. · line 64

Quoted 4 lines
docs/misc/hypfs-paths.pandoc +4 -0
+In case a tag for a path indicates that this path is available in some
+case only, this availability might be extended or reduced in future by
+modification or removal of the tag. A path once assigned meaning won't go
+away altogether or change its meaning, though.

... the newly imposed guarantee we're now making. We really want to avoid declaring something as stable without being quite certain we can keep it stable.

The declaration of new nodes must all happen in this file, right? So as long as the maintainer(s) fo this file are aware of that, and it’s commented so that people know that expecation, I think it’s OK.

But I think this paragraph isn’t very clear to me what “might be extended or reduced …but won’t go away altogether”.

IT sounds like you’re saying:

Quoted 7 lines

1. Paths listed without conditions will always be available

2. Paths listed with conditions may be extended: i.e., a node currently listed as PV might also become available for HVM guests

3. Paths listed with conditions might have those conditions reduced, but will never entirely disappear. So something currently listed as PV might be reduced to CONFIG_HAS_FOO, but won’t be completely removed.

Is that what you meant?

Yes.

Juergen

#4 lore raw
In reply to George Dunlap
Quoted 9 lines · George Dunlap

IT sounds like you’re saying:

1. Paths listed without conditions will always be available

2. Paths listed with conditions may be extended: i.e., a node currently listed as PV might also become available for HVM guests

3. Paths listed with conditions might have those conditions reduced, but will never entirely disappear. So something currently listed as PV might be reduced to CONFIG_HAS_FOO, but won’t be completely removed.

Is that what you meant?

I see Jürgen replied "yes" to this, but I'm not sure about 1.
above: I think it's quite reasonable to expect that paths without condition may gain a condition. Just like paths now having a condition and (perhaps temporarily) losing it shouldn't all of the sudden become "always available" when they weren't meant to be.

As far a 3. goes, I'm also unsure in how far this is any better stability wise (from a consumer pov) than allowing paths to entirely disappear.

Jan

#5 lore raw
Quoted 18 lines · Jan Beulich
Quoted 9 lines · George Dunlap

IT sounds like you’re saying:

1. Paths listed without conditions will always be available

2. Paths listed with conditions may be extended: i.e., a node currently listed as PV might also become available for HVM guests

3. Paths listed with conditions might have those conditions reduced, but will never entirely disappear. So something currently listed as PV might be reduced to CONFIG_HAS_FOO, but won’t be completely removed.

Is that what you meant?

I see Jürgen replied "yes" to this, but I'm not sure about 1.
above: I think it's quite reasonable to expect that paths without condition may gain a condition. Just like paths now having a condition and (perhaps temporarily) losing it shouldn't all of the sudden become "always available" when they weren't meant to be.

Quoted 3 lines

As far a 3. goes, I'm also unsure in how far this is any better stability wise (from a consumer pov) than allowing paths to entirely disappear.

The idea is that any user tool using hypfs can rely on paths under 1 to exist, while the ones under 3 might not be there due to the hypervisor config or the used system.

A path not being allowed to entirely disappear ensures that it remains in the documentation, so the same path can't be reused for something different in future.

Juergen

#6 lore raw
Quoted 23 lines · Jürgen Groß
Quoted 18 lines · Jan Beulich
Quoted 9 lines · George Dunlap

IT sounds like you’re saying:

1. Paths listed without conditions will always be available

2. Paths listed with conditions may be extended: i.e., a node currently listed as PV might also become available for HVM guests

3. Paths listed with conditions might have those conditions reduced, but will never entirely disappear. So something currently listed as PV might be reduced to CONFIG_HAS_FOO, but won’t be completely removed.

Is that what you meant?

I see Jürgen replied "yes" to this, but I'm not sure about 1.
above: I think it's quite reasonable to expect that paths without condition may gain a condition. Just like paths now having a condition and (perhaps temporarily) losing it shouldn't all of the sudden become "always available" when they weren't meant to be.

Quoted 3 lines

As far a 3. goes, I'm also unsure in how far this is any better stability wise (from a consumer pov) than allowing paths to entirely disappear.

Quoted 7 lines

The idea is that any user tool using hypfs can rely on paths under 1 to exist, while the ones under 3 might not be there due to the hypervisor config or the used system.

A path not being allowed to entirely disappear ensures that it remains in the documentation, so the same path can't be reused for something different in future.

And then how do you deal with a condition getting dropped, and later wanting to get re-added? Do we need a placeholder condition like [ALWAYS] or [TRUE]?

Jan

#7 lore raw
Quoted 28 lines · Jan Beulich
Quoted 27 lines · Jürgen Groß
Quoted 18 lines · Jan Beulich
Quoted 9 lines · George Dunlap

IT sounds like you’re saying:

1. Paths listed without conditions will always be available

2. Paths listed with conditions may be extended: i.e., a node currently listed as PV might also become available for HVM guests

3. Paths listed with conditions might have those conditions reduced, but will never entirely disappear. So something currently listed as PV might be reduced to CONFIG_HAS_FOO, but won’t be completely removed.

Is that what you meant?

I see Jürgen replied "yes" to this, but I'm not sure about 1.
above: I think it's quite reasonable to expect that paths without condition may gain a condition. Just like paths now having a condition and (perhaps temporarily) losing it shouldn't all of the sudden become "always available" when they weren't meant to be.

Quoted 3 lines

As far a 3. goes, I'm also unsure in how far this is any better stability wise (from a consumer pov) than allowing paths to entirely disappear.

The idea is that any user tool using hypfs can rely on paths under 1 to exist, while the ones under 3 might not be there due to the hypervisor config or the used system.

Quoted 7 lines
Quoted 3 lines

A path not being allowed to entirely disappear ensures that it remains in the documentation, so the same path can't be reused for something different in future.

And then how do you deal with a condition getting dropped, and later wanting to get re-added? Do we need a placeholder condition like [ALWAYS] or [TRUE]?

Dropping a condition has to be considered very carefully, same as introducing a new path without any condition.

In worst case you can still go with [CONFIG_HYPFS].

Juergen

#8 lore raw
Quoted 36 lines · Jürgen Groß
Quoted 31 lines · Jan Beulich
Quoted 30 lines · Jürgen Groß
Quoted 18 lines · Jan Beulich
Quoted 9 lines · George Dunlap

IT sounds like you’re saying:

1. Paths listed without conditions will always be available

2. Paths listed with conditions may be extended: i.e., a node currently listed as PV might also become available for HVM guests

3. Paths listed with conditions might have those conditions reduced, but will never entirely disappear. So something currently listed as PV might be reduced to CONFIG_HAS_FOO, but won’t be completely removed.

Is that what you meant?

I see Jürgen replied "yes" to this, but I'm not sure about 1.
above: I think it's quite reasonable to expect that paths without condition may gain a condition. Just like paths now having a condition and (perhaps temporarily) losing it shouldn't all of the sudden become "always available" when they weren't meant to be.

Quoted 3 lines

As far a 3. goes, I'm also unsure in how far this is any better stability wise (from a consumer pov) than allowing paths to entirely disappear.

The idea is that any user tool using hypfs can rely on paths under 1 to exist, while the ones under 3 might not be there due to the hypervisor config or the used system.

A path not being allowed to entirely disappear ensures that it remains in the documentation, so the same path can't be reused for something different in future.

Quoted 8 lines
Quoted 3 lines

And then how do you deal with a condition getting dropped, and later wanting to get re-added? Do we need a placeholder condition like [ALWAYS] or [TRUE]?

Dropping a condition has to be considered very carefully, same as introducing a new path without any condition.

In worst case you can still go with [CONFIG_HYPFS].

Couldn’t we just have a section of the document for dead paths that aren’t allowed to be used?

Alternately, we could have a tag for entries we don’t want used anymore; [DEAD] or [OBSOLETE] maybe? [DEFUNCT]? [REMOVED]?

So I think I’d write a separate section, like this:

~~
# Stability

Path *presence* is not stable, but path *meaning* is always stable: if a tool you write finds a path present, it can rely on behavior in future versions of the hypervisors, and in different configurations. Specifically:

1. Conditions under which paths are used may be extended, restricted, or removed. For example, a path that’s always available only on ARM systems may become available on x86; or a path available on both systems may be restricted to only appearing on ARM systems. Paths may also disappear entirely.

2. However, the meaning of a path will never change. If a path is present, it will always have exactly the meaning that it always had. In order to maintain this, removed paths should be retained with the tag [REMOVED]. The path may be restored *only* if the restored version of the path is compatible with the previous functionality.
~~~

Thoughts?

-George

#9 lore raw
Quoted 54 lines · George Dunlap
Quoted 36 lines · Jürgen Groß
Quoted 31 lines · Jan Beulich
Quoted 30 lines · Jürgen Groß
Quoted 18 lines · Jan Beulich
Quoted 9 lines · George Dunlap

IT sounds like you’re saying:

1. Paths listed without conditions will always be available

2. Paths listed with conditions may be extended: i.e., a node currently listed as PV might also become available for HVM guests

3. Paths listed with conditions might have those conditions reduced, but will never entirely disappear. So something currently listed as PV might be reduced to CONFIG_HAS_FOO, but won’t be completely removed.

Is that what you meant?

I see Jürgen replied "yes" to this, but I'm not sure about 1.
above: I think it's quite reasonable to expect that paths without condition may gain a condition. Just like paths now having a condition and (perhaps temporarily) losing it shouldn't all of the sudden become "always available" when they weren't meant to be.

Quoted 3 lines

As far a 3. goes, I'm also unsure in how far this is any better stability wise (from a consumer pov) than allowing paths to entirely disappear.

The idea is that any user tool using hypfs can rely on paths under 1 to exist, while the ones under 3 might not be there due to the hypervisor config or the used system.

A path not being allowed to entirely disappear ensures that it remains in the documentation, so the same path can't be reused for something different in future.

Quoted 8 lines
Quoted 3 lines

And then how do you deal with a condition getting dropped, and later wanting to get re-added? Do we need a placeholder condition like [ALWAYS] or [TRUE]?

Dropping a condition has to be considered very carefully, same as introducing a new path without any condition.

In worst case you can still go with [CONFIG_HYPFS].

Couldn’t we just have a section of the document for dead paths that aren’t allowed to be used?

Alternately, we could have a tag for entries we don’t want used anymore; [DEAD] or [OBSOLETE] maybe? [DEFUNCT]? [REMOVED]?

So I think I’d write a separate section, like this:

~~
# Stability

Quoted 8 lines

Path *presence* is not stable, but path *meaning* is always stable: if a tool you write finds a path present, it can rely on behavior in future versions of the hypervisors, and in different configurations. Specifically:

1. Conditions under which paths are used may be extended, restricted, or removed. For example, a path that’s always available only on ARM systems may become available on x86; or a path available on both systems may be restricted to only appearing on ARM systems. Paths may also disappear entirely.

2. However, the meaning of a path will never change. If a path is present, it will always have exactly the meaning that it always had. In order to maintain this, removed paths should be retained with the tag [REMOVED]. The path may be restored *only* if the restored version of the path is compatible with the previous functionality.
~~~

Thoughts?

Would work for me, too.

Juergen

#10 lore raw
Quoted 58 lines · Jürgen Groß
Quoted 42 lines · George Dunlap
Quoted 34 lines · Jürgen Groß
Quoted 31 lines · Jan Beulich
Quoted 30 lines · Jürgen Groß
Quoted 18 lines · Jan Beulich
Quoted 9 lines · George Dunlap

IT sounds like you’re saying:

1. Paths listed without conditions will always be available

2. Paths listed with conditions may be extended: i.e., a node currently listed as PV might also become available for HVM guests

3. Paths listed with conditions might have those conditions reduced, but will never entirely disappear. So something currently listed as PV might be reduced to CONFIG_HAS_FOO, but won’t be completely removed.

Is that what you meant?

I see Jürgen replied "yes" to this, but I'm not sure about 1.
above: I think it's quite reasonable to expect that paths without condition may gain a condition. Just like paths now having a condition and (perhaps temporarily) losing it shouldn't all of the sudden become "always available" when they weren't meant to be.

Quoted 3 lines

As far a 3. goes, I'm also unsure in how far this is any better stability wise (from a consumer pov) than allowing paths to entirely disappear.

The idea is that any user tool using hypfs can rely on paths under 1 to exist, while the ones under 3 might not be there due to the hypervisor config or the used system.

A path not being allowed to entirely disappear ensures that it remains in the documentation, so the same path can't be reused for something different in future.

Quoted 8 lines
Quoted 3 lines

And then how do you deal with a condition getting dropped, and later wanting to get re-added? Do we need a placeholder condition like [ALWAYS] or [TRUE]?

Dropping a condition has to be considered very carefully, same as introducing a new path without any condition.

In worst case you can still go with [CONFIG_HYPFS].

Quoted 10 lines

Couldn’t we just have a section of the document for dead paths that aren’t allowed to be used?
Alternately, we could have a tag for entries we don’t want used anymore; [DEAD] or [OBSOLETE] maybe? [DEFUNCT]? [REMOVED]?
So I think I’d write a separate section, like this:
~~
# Stability
Path *presence* is not stable, but path *meaning* is always stable: if a tool you write finds a path present, it can rely on behavior in future versions of the hypervisors, and in different configurations. Specifically:
1. Conditions under which paths are used may be extended, restricted, or removed. For example, a path that’s always available only on ARM systems may become available on x86; or a path available on both systems may be restricted to only appearing on ARM systems. Paths may also disappear entirely.
2. However, the meaning of a path will never change. If a path is present, it will always have exactly the meaning that it always had. In order to maintain this, removed paths should be retained with the tag [REMOVED]. The path may be restored *only* if the restored version of the path is compatible with the previous functionality.
~~~
Thoughts?

Quoted 1 line

Would work for me, too.

So whose court is the ball in now? Are you going to send another patch, or would you prefer I do it?

-George

#11 lore raw
Quoted 58 lines · George Dunlap
Quoted 58 lines · Jürgen Groß
Quoted 52 lines · George Dunlap
Quoted 34 lines · Jürgen Groß
Quoted 31 lines · Jan Beulich
Quoted 30 lines · Jürgen Groß
Quoted 18 lines · Jan Beulich
Quoted 9 lines · George Dunlap

IT sounds like you’re saying:

1. Paths listed without conditions will always be available

2. Paths listed with conditions may be extended: i.e., a node currently listed as PV might also become available for HVM guests

3. Paths listed with conditions might have those conditions reduced, but will never entirely disappear. So something currently listed as PV might be reduced to CONFIG_HAS_FOO, but won’t be completely removed.

Is that what you meant?

I see Jürgen replied "yes" to this, but I'm not sure about 1.
above: I think it's quite reasonable to expect that paths without condition may gain a condition. Just like paths now having a condition and (perhaps temporarily) losing it shouldn't all of the sudden become "always available" when they weren't meant to be.

Quoted 3 lines

As far a 3. goes, I'm also unsure in how far this is any better stability wise (from a consumer pov) than allowing paths to entirely disappear.

The idea is that any user tool using hypfs can rely on paths under 1 to exist, while the ones under 3 might not be there due to the hypervisor config or the used system.

A path not being allowed to entirely disappear ensures that it remains in the documentation, so the same path can't be reused for something different in future.

Quoted 8 lines
Quoted 3 lines

And then how do you deal with a condition getting dropped, and later wanting to get re-added? Do we need a placeholder condition like [ALWAYS] or [TRUE]?

Dropping a condition has to be considered very carefully, same as introducing a new path without any condition.

In worst case you can still go with [CONFIG_HYPFS].

Couldn’t we just have a section of the document for dead paths that aren’t allowed to be used?
Alternately, we could have a tag for entries we don’t want used anymore; [DEAD] or [OBSOLETE] maybe? [DEFUNCT]? [REMOVED]?
So I think I’d write a separate section, like this:
~~
# Stability
Path *presence* is not stable, but path *meaning* is always stable: if a tool you write finds a path present, it can rely on behavior in future versions of the hypervisors, and in different configurations. Specifically:
1. Conditions under which paths are used may be extended, restricted, or removed. For example, a path that’s always available only on ARM systems may become available on x86; or a path available on both systems may be restricted to only appearing on ARM systems. Paths may also disappear entirely.
2. However, the meaning of a path will never change. If a path is present, it will always have exactly the meaning that it always had. In order to maintain this, removed paths should be retained with the tag [REMOVED]. The path may be restored *only* if the restored version of the path is compatible with the previous functionality.
~~~
Thoughts?

Quoted 3 lines
Quoted 1 line

Would work for me, too.

So whose court is the ball in now? Are you going to send another patch, or would you prefer I do it?

I can do it. I just hoped that maybe someone else would agree to this approach.

Juergen