x86/dom0: miscellaneous fixes for PV dom0 builder
v2 cover x86/dom0: miscellaneous fixes for PV dom0 builder
Hello,
One fix to correctly restore the context on an error path, and another fix to limit SMAP disabling to PV dom0 builder. Previously part of the Address Space Isolation series, now split for ease of review.
Thanks, Roger.
Roger Pau Monne (2):
x86/dom0: fix restoring %cr3 and the mapcache override on PV build
error
x86/dom0: only disable SMAP for the PV dom0 build
xen/arch/x86/pv/dom0_build.c | 15 +++++++++++++++ xen/arch/x86/setup.c | 17 ----------------- 2 files changed, 15 insertions(+), 17 deletions(-)
Signature · 1 line
2.45.2
PATCH v2 1/2 x86/dom0: fix restoring %cr3 and the mapcache override on PV build error
One of the error paths in the PV dom0 builder section that runs on the guest page-tables wasn't restoring the Xen value of %cr3, neither removing the mapcache override.
--- xen/arch/x86/pv/dom0_build.c | 2 ++ 1 file changed, 2 insertions(+)
xen/arch/x86/pv/dom0_build.c +2 -0
@@ -825,6 +825,8 @@ int __init dom0_construct_pv(struct domain *d, rc =elf_load_binary (&elf);if ( rc <0 ) { +mapcache_override_current (NULL ); +switch_cr3_cr4 (current->arch.cr3,read_cr4 ());printk ("Failed to load the kernel binary\n" ); goto out; }
Signature · 1 line
2.45.2
Re: [PATCH v2 1/2] x86/dom0: fix restoring %cr3 and the mapcache override on PV build error
Quoted 3 lines · Roger Pau Monne
One of the error paths in the PV dom0 builder section that runs on the guest page-tables wasn't restoring the Xen value of %cr3, neither removing the mapcache override.
s/neither/nor/ ?
xen/arch/x86/pv/dom0_build.c int __init dom0_construct_pv(struct domain *d, · line 832
Quoted 11 lines
xen/arch/x86/pv/dom0_build.c +2
-0@@ -825,6 +825,8 @@ int __init dom0_construct_pv(struct domain *d, rc =elf_load_binary (&elf);if ( rc <0 ) { +mapcache_override_current (NULL ); +switch_cr3_cr4 (current->arch.cr3,read_cr4 ());printk ("Failed to load the kernel binary\n" ); goto out; }
Just below here we have
bootstrap_map(NULL);
This too is wanted in the error case aiui. Happy to move it up immediately ahead of the if() while committing, so long as you agree. Then:
Jan
Re: [PATCH v2 1/2] x86/dom0: fix restoring %cr3 and the mapcache override on PV build error
Quoted 21 lines · Jan Beulich
Quoted 3 lines · Roger Pau Monne
One of the error paths in the PV dom0 builder section that runs on the guest page-tables wasn't restoring the Xen value of %cr3, neither removing the mapcache override.
s/neither/nor/ ?
xen/arch/x86/pv/dom0_build.c int __init dom0_construct_pv(struct domain *d, · line 832
Quoted 11 lines
xen/arch/x86/pv/dom0_build.c +2
-0@@ -825,6 +825,8 @@ int __init dom0_construct_pv(struct domain *d, rc =elf_load_binary (&elf);if ( rc <0 ) { +mapcache_override_current (NULL ); +switch_cr3_cr4 (current->arch.cr3,read_cr4 ());printk ("Failed to load the kernel binary\n" ); goto out; }Just below here we have
Quoted 5 lines
bootstrap_map(NULL);This too is wanted in the error case aiui. Happy to move it up immediately ahead of the
if()while committing, so long as you agree. Then:Reviewed-by Jan Beulich <[email protected]>
I'm happy with this, but note there are further instances of error paths above this one that already don't remove the bootstrap mappings.
Thanks, Roger.
Re: [PATCH v2 1/2] x86/dom0: fix restoring %cr3 and the mapcache override on PV build error
Quoted 16 lines · Roger Pau Monné
Quoted 15 lines · Jan Beulich
xen/arch/x86/pv/dom0_build.c int __init dom0_construct_pv(struct domain *d, · line 832
Quoted 11 lines · Roger Pau Monne
xen/arch/x86/pv/dom0_build.c +2
-0@@ -825,6 +825,8 @@ int __init dom0_construct_pv(struct domain *d, rc =elf_load_binary (&elf);if ( rc <0 ) { +mapcache_override_current (NULL ); +switch_cr3_cr4 (current->arch.cr3,read_cr4 ());printk ("Failed to load the kernel binary\n" ); goto out; }Just below here we have
Quoted 8 lines
Quoted 5 lines
bootstrap_map(NULL);This too is wanted in the error case aiui. Happy to move it up immediately ahead of the
if()while committing, so long as you agree. Then:Reviewed-by Jan Beulich <[email protected]>I'm happy with this, but note there are further instances of error paths above this one that already don't remove the bootstrap mappings.
Hmm, you're right. I'll leave that untouched then.
Jan
PATCH v2 2/2 x86/dom0: only disable SMAP for the PV dom0 build
In reply to Roger Pau MonneThe PVH dom0 builder doesn't switch page tables and has no need to run with SMAP disabled.
Use stac() and clac(), as that's safe to use even if events would hit in the middle of the region with SMAP disabled. Nesting stac() and clac() calls is not safe, so the stac() call is done strictly after elf_load_binary() because that uses raw_{copy_to,clear}_guest() accessors which toggle SMAP.
--- xen/arch/x86/pv/dom0_build.c | 13 +++++++++++++ xen/arch/x86/setup.c | 17 ----------------- 2 files changed, 13 insertions(+), 17 deletions(-)
xen/arch/x86/pv/dom0_build.c +13 -0
@@ -830,6 +830,15 @@ int __init dom0_construct_pv(struct domain *d,printk ("Failed to load the kernel binary\n" ); goto out; } + +/* +* Disable SMAP to allow user-accesses when running on dom0 page-tables. +* Note this must be done after elf_load_binary(), as such helper uses +* raw_{copy_to,clear}_guest() helpers which internally call stac()/clac() +* and those calls would otherwise nest with the ones here. +*/ +stac (); +bootstrap_map (NULL );if (UNSET_ADDR != parms.virt_hypercall )
@@ -837,6 +846,7 @@ int __init dom0_construct_pv(struct domain *d,if ( (parms.virt_hypercall < v_start) || (parms.virt_hypercall >= v_end) ) { +clac ();mapcache_override_current (NULL );switch_cr3_cr4 (current->arch.cr3,read_cr4 ());printk ("Invalid HYPERCALL_PAGE field in ELF notes.\n" );
@@ -978,6 +988,9 @@ int __init dom0_construct_pv(struct domain *d, : XLAT_start_info_console_dom0);#endif +/* Possibly re-enable SMAP. */ +clac (); +/* Return to idle domain's page tables. */ mapcache_override_current (NULL );switch_cr3_cr4 (current->arch.cr3,read_cr4 ());
xen/arch/x86/setup.c +0 -17
@@ -955,26 +955,9 @@ static struct domain *__init create_dom0(const module_t *image, } } -/* -* Temporarily clear SMAP in CR4 to allow user-accesses in construct_dom0(). -* This saves a large number of corner cases interactions with -* copy_from_user(). -*/ -if ( cpu_has_smap ) - { - cr4_pv32_mask &= ~X86_CR4_SMAP ; -write_cr4 (read_cr4 () & ~X86_CR4_SMAP ); - } -if (construct_dom0 (d, image, headroom, initrd, cmdline) !=0 )panic ("Could not construct domain 0\n" ); -if ( cpu_has_smap ) - { -write_cr4 (read_cr4 () |X86_CR4_SMAP ); - cr4_pv32_mask |=X86_CR4_SMAP ; - } -return d; }
Signature · 1 line
2.45.2
Re: [PATCH v2 2/2] x86/dom0: only disable SMAP for the PV dom0 build
Quoted 7 lines · Roger Pau Monne
The PVH dom0 builder doesn't switch page tables and has no need to run with SMAP disabled.
Use
stac()andclac(), as that's safe to use even if events would hit in the middle of the region with SMAP disabled. Nestingstac()andclac()calls is not safe, so thestac()call is done strictly afterelf_load_binary()because that uses raw_{copy_to,clear}_guest() accessors which toggle SMAP.
And that was the main concern causing the CR4.SMAP override to be used instead, iirc. While I'm sure you've properly audited all code paths, how can we be sure there's not going to be another stac() or clac() added somewhere? Or setting of EFLAGS as a whole, clearing EFLAGS.AC without that being explicit? I think we'd be better off sticking to the fiddling with CR4.
Quoted 1 line
Signed-off-by Roger Pau Monné <[email protected]>
Considering the bug Andrew pointed out on the code you remove from setup.c, don't we want a Fixes: tag as well?
xen/arch/x86/pv/dom0_build.c int __init dom0_construct_pv(struct domain *d, · line 838
Quoted 12 lines
xen/arch/x86/pv/dom0_build.c +6
-0@@ -830,6 +830,15 @@ int __init dom0_construct_pv(struct domain *d,printk ("Failed to load the kernel binary\n" ); goto out; } + +/* +* Disable SMAP to allow user-accesses when running on dom0 page-tables. +* Note this must be done after elf_load_binary(), as such helper uses +* raw_{copy_to,clear}_guest() helpers which internally call stac()/clac() +* and those calls would otherwise nest with the ones here.
Just in case you and Andrew would outvote me on which approach to take:
I'm okay with "helpers" here, but the earlier "such helper" reads a little odd to me. Imo using "that" or "it" instead would be better. Not the least because personally a function like elf_load_binary() goes beyond what I'd call a mere "helper" (in that case dom0_construct_pv() toos could be deemed a helper, etc).
Jan
Re: [PATCH v2 2/2] x86/dom0: only disable SMAP for the PV dom0 build
Quoted 9 lines · Jan Beulich
Quoted 7 lines · Roger Pau Monne
The PVH dom0 builder doesn't switch page tables and has no need to run with SMAP disabled.
Use
stac()andclac(), as that's safe to use even if events would hit in the middle of the region with SMAP disabled. Nestingstac()andclac()calls is not safe, so thestac()call is done strictly afterelf_load_binary()because that uses raw_{copy_to,clear}_guest() accessors which toggle SMAP.
Quoted 5 lines
And that was the main concern causing the CR4.SMAP override to be used instead, iirc. While I'm sure you've properly audited all code paths, how can we be sure there's not going to be another
stac()orclac()added somewhere? Or setting of EFLAGS as a whole, clearing EFLAGS.AC without that being explicit? I think we'd be better off sticking to the fiddling with CR4.
On approach I didn't test would be to add ASSERTs in stac/clac functions to ensure that the state is as intended. IOW: for stac we would assert that the AC flag is not set, while for clac we would do the opposite and assert that it's set before clearing it.
That should detect nesting.
Quoted 5 lines
Quoted 2 lines
Signed-off-by Roger Pau Monné <[email protected]>Considering the bug Andrew pointed out on the code you remove from
setup.c, don't we want a Fixes: tag as well?
No, I think the current code is correct, it was my change that was incorrect.
Quoted 11 lines
Quoted 11 lines
xen/arch/x86/pv/dom0_build.c +5
-0@@ -830,6 +830,15 @@ int __init dom0_construct_pv(struct domain *d,printk ("Failed to load the kernel binary\n" ); goto out; } + +/* +* Disable SMAP to allow user-accesses when running on dom0 page-tables. +* Note this must be done after elf_load_binary(), as such helper uses +* raw_{copy_to,clear}_guest() helpers which internally call stac()/clac()
Quoted 8 lines
xen/arch/x86/pv/dom0_build.c int __init dom0_construct_pv(struct domain *d, · line 838
Quoted 1 line
xen/arch/x86/pv/dom0_build.c +1
-0+* and those calls would otherwise nest with the ones here. Just in case you and Andrew would outvote me on which approach to take:
I'm okay with "helpers" here, but the earlier "such helper" reads a little odd to me. Imo using "that" or "it" instead would be better. Not the least because personally a function likeelf_load_binary()goes beyond what I'd call a mere "helper" (in that casedom0_construct_pv()toos could be deemed a helper, etc).
Hm, yes, would be better to reword that.
Thanks, Roger.
Re: [PATCH v2 2/2] x86/dom0: only disable SMAP for the PV dom0 build
Quoted 16 lines · Roger Pau Monné
Quoted 9 lines · Jan Beulich
Quoted 7 lines · Roger Pau Monne
The PVH dom0 builder doesn't switch page tables and has no need to run with SMAP disabled.
Use
stac()andclac(), as that's safe to use even if events would hit in the middle of the region with SMAP disabled. Nestingstac()andclac()calls is not safe, so thestac()call is done strictly afterelf_load_binary()because that uses raw_{copy_to,clear}_guest() accessors which toggle SMAP.Quoted 5 lines
And that was the main concern causing the CR4.SMAP override to be used instead, iirc. While I'm sure you've properly audited all code paths, how can we be sure there's not going to be another
stac()orclac()added somewhere? Or setting of EFLAGS as a whole, clearing EFLAGS.AC without that being explicit? I think we'd be better off sticking to the fiddling with CR4.
Quoted 6 lines
On approach I didn't test would be to add ASSERTs in stac/clac functions to ensure that the state is as intended. IOW: for stac we would assert that the AC flag is not set, while for clac we would do the opposite and assert that it's set before clearing it.
That should detect nesting.
Yet it would also refuse non-paired uses which are in principle okay. Plus is requires respective code paths to be taken for such assertions to trigger.
Quoted 7 lines
Quoted 4 lines
Quoted 1 line
Signed-off-by Roger Pau Monné <[email protected]>Considering the bug Andrew pointed out on the code you remove from
setup.c, don't we want a Fixes: tag as well?No, I think the current code is correct, it was my change that was incorrect.
Hmm, no I think there was an issue also before, from the cpu_has_smap use in the restore-CR4 conditional: We'd enable SMAP there even if on the command line there was "smap=hvm". While we clear FEATURE_SMAP when "smap=off", we keep the feature available when "smap=hvm". Thus we'd pointlessly write CR4 in the first if() and then enable SMAP in the second one, even though it wasn't enabled earlier on.
Jan
Re: [PATCH v2 2/2] x86/dom0: only disable SMAP for the PV dom0 build
Quoted 17 lines · Jan Beulich
Quoted 16 lines · Roger Pau Monné
Quoted 14 lines · Jan Beulich
Quoted 7 lines · Roger Pau Monne
The PVH dom0 builder doesn't switch page tables and has no need to run with SMAP disabled.
Use
stac()andclac(), as that's safe to use even if events would hit in the middle of the region with SMAP disabled. Nestingstac()andclac()calls is not safe, so thestac()call is done strictly afterelf_load_binary()because that uses raw_{copy_to,clear}_guest() accessors which toggle SMAP.And that was the main concern causing the CR4.SMAP override to be used instead, iirc. While I'm sure you've properly audited all code paths, how can we be sure there's not going to be another
stac()orclac()added somewhere? Or setting of EFLAGS as a whole, clearing EFLAGS.AC without that being explicit? I think we'd be better off sticking to the fiddling with CR4.
Quoted 8 lines
Quoted 6 lines
On approach I didn't test would be to add ASSERTs in stac/clac functions to ensure that the state is as intended. IOW: for stac we would assert that the AC flag is not set, while for clac we would do the opposite and assert that it's set before clearing it.
That should detect nesting.
Yet it would also refuse non-paired uses which are in principle okay.
While such non-paired uses could be fine, it would seem to point to other issues, as I would expect stac/clac to always be paired unless it's a non-return path (a panic or similar).
Quoted 2 lines
Plus is requires respective code paths to be taken for such assertions to trigger.
It does. It seems more reliable to me to use stac/clac, rather than fiddling with %cr4, however there's the nesting issue. I think we need to reach consensus as to which approach is to be used.
Quoted 8 lines
Quoted 7 lines
Quoted 4 lines
Quoted 1 line
Signed-off-by Roger Pau Monné <[email protected]>Considering the bug Andrew pointed out on the code you remove from
setup.c, don't we want a Fixes: tag as well?No, I think the current code is correct, it was my change that was incorrect.
Quoted 6 lines
Hmm, no I think there was an issue also before, from the
cpu_has_smapuse in the restore-CR4 conditional: We'd enable SMAP there even if on the command line there was "smap=hvm". While we clearFEATURE_SMAPwhen "smap=off", we keep the feature available when "smap=hvm". Thus we'd pointlessly write CR4 in the firstif()and then enable SMAP in the second one, even though it wasn't enabled earlier on.
Oh yes, that one. I was thinking about the one related to IST and cr4_pv32_mask. I will add the fixes tag.
Thanks, Roger.
Re: [PATCH v2 2/2] x86/dom0: only disable SMAP for the PV dom0 build
In reply to Roger Pau MonneQuoted 9 lines · Roger Pau Monne
The PVH dom0 builder doesn't switch page tables and has no need to run with SMAP disabled.
Use
stac()andclac(), as that's safe to use even if events would hit in the middle of the region with SMAP disabled. Nestingstac()andclac()calls is not safe, so thestac()call is done strictly afterelf_load_binary()because that uses raw_{copy_to,clear}_guest() accessors which toggle SMAP.Signed-off-by Roger Pau Monné <[email protected]>
Summarising a discussion on Matrix.
There are 3 options.
1) Simply reposition the write_cr4()/cr4_pv32_mask adjustments.
2) This form (use stac/clac instead of playing with cr4).
3) Delay the original set_in_cr4(SMAP).
As proved by the confusion thus far, cr4_pv32_mask adjustments are fragile and can go unnoticed in the general case (need a lucky watchdog NMI hit to trigger). Hence I'd prefer to remove the adjustments.
Using stac()/clac() is much easier. It is fragile because of nesting (no AC save/restore infrastructure), but any mistake here will be picked up reliably in Gitlab CI because both adl-* and zen3p-* support SMAP.
Personally I think option 2 is better than 1, hence why I suggested it. It's got a fragile corner case but will be spotted reliably.
However, it occurs to me that option 3 exists as well... just delay setting SMAP until after dom0 is made. We have form now with only activating CET-SS on the way out of __start_xen().
Furthermore, option 3 would allow us to move the cr4_pv32_mask adjustment into set_in_cr4() and never need to opencode it.
(Although this is a bit tricky given the current code layout. cr4_pv32_mask also wants to be __ro_after_init and non-existent in a !PV32 build.)
~Andrew
Re: [PATCH v2 2/2] x86/dom0: only disable SMAP for the PV dom0 build
Quoted 23 lines · Andrew Cooper
Quoted 9 lines · Roger Pau Monne
The PVH dom0 builder doesn't switch page tables and has no need to run with SMAP disabled.
Use
stac()andclac(), as that's safe to use even if events would hit in the middle of the region with SMAP disabled. Nestingstac()andclac()calls is not safe, so thestac()call is done strictly afterelf_load_binary()because that uses raw_{copy_to,clear}_guest() accessors which toggle SMAP.Signed-off-by Roger Pau Monné <[email protected]>Summarising a discussion on Matrix.
There are 3 options.
1) Simply reposition the write_cr4()/cr4_pv32_mask adjustments.
2) This form (use stac/clac instead of playing with cr4).
3) Delay the originalset_in_cr4(SMAP).As proved by the confusion thus far,
cr4_pv32_maskadjustments are fragile and can go unnoticed in the general case (need a lucky watchdog NMI hit to trigger). Hence I'd prefer to remove the adjustments.
Quoted 6 lines
Using stac()/clac() is much easier. It is fragile because of nesting (no AC save/restore infrastructure), but any mistake here will be picked up reliably in Gitlab CI because both adl-* and zen3p-* support SMAP.
Personally I think option 2 is better than 1, hence why I suggested it. It's got a fragile corner case but will be spotted reliably.
... when code paths in question are always taken. Any such operation on a rarely taken code path quite likely won't be spotted by mere testing.
Jan
Quoted 12 lines
However, it occurs to me that option 3 exists as well... just delay setting SMAP until after dom0 is made. We have form now with only activating CET-SS on the way out of
__start_xen().Furthermore, option 3 would allow us to move the
cr4_pv32_maskadjustment intoset_in_cr4()and never need to opencode it.(Although this is a bit tricky given the current code layout.
cr4_pv32_maskalso wants to be__ro_after_initand non-existent in a !PV32 build.)~Andrew