KVM: s390: some vSIE and UCONTROL fixes
Claudio Imbrenda
maintainerv3 cover KVM: s390: some vSIE and UCONTROL fixes
Fix some memory issues and some hangs in vSIE.
This is still a fallout from the gmap rewrite.
v2->v3:
* Add comments to pte_needs_unshadow() and crste_needs_unshadow() explaining how they work
* Improve some patch descriptions
v1->v2:
* Fix potential leak of struct kvm_s390_mmu_cache in gmap_set_limit()
* Refactor and improve the checks to determine whether an unshadowing is needed
* Set and propagate vsie_gmem properly
* Properly mask the address passed to gmap_insert_rmap() to prevent creating multiple redundant rmaps when shadowing
* Clear the pgste.zero flag when needed, to prevent pages from getting accidentally discarded
Claudio Imbrenda (5):
KVM: s390: vsie: Fix memory leak when unshadowing
KVM: s390: Fix leaking kvm_s390_mmu_cache in case of errors
KVM: s390: vsie: Fix unshadowing logic
KVM: s390: vsie: Fix redundant rmap entries
KVM: s390: Properly reset zero bit in PGSTE
arch/s390/kvm/dat.c | 1 + arch/s390/kvm/dat.h | 3 +- arch/s390/kvm/gaccess.c | 1 + arch/s390/kvm/gmap.c | 18 +++++++----- arch/s390/kvm/gmap.h | 61 +++++++++++++++++++++++++++++++++++++++-- 5 files changed, 73 insertions(+), 11 deletions(-)
Signature · 1 line
2.54.0
Claudio Imbrenda
maintainerPATCH v3 1/5 KVM: s390: vsie: Fix memory leak when unshadowing
When performing a partial unshadowing, the rmap was being leaked.
Add the missing kfree().
--- arch/s390/kvm/gmap.c | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-)
arch/s390/kvm/gmap.c +3 -1
@@ -1143,8 +1143,10 @@ void _gmap_handle_vsie_unshadow_event(struct gmap *parent, gfn_t gfn) }scoped_guard (spinlock, &sg->host_to_rmap_lock) head = radix_tree_delete(&sg->host_to_rmap, gfn); -gmap_for_each_rmap_safe (rmap, rnext, head) +gmap_for_each_rmap_safe (rmap, rnext, head) {gmap_unshadow_level (sg, rmap->r_gfn, rmap->level); +kfree (rmap); + } } }
Signature · 1 line
2.54.0
Claudio Imbrenda
maintainerPATCH v3 2/5 KVM: s390: Fix leaking kvm_s390_mmu_cache in case of errors
In reply to Claudio ImbrendaFix a memory leak that can happen if gmap_ucas_map_one() or kvm_s390_mmu_cache_topup() return error values.
Also fix a similar issue in gmap_set_limit().
--- arch/s390/kvm/gmap.c | 7 +++---- 1 file changed, 3 insertions(+), 4 deletions(-)
arch/s390/kvm/gmap.c +3 -4
@@ -125,7 +125,7 @@ struct gmap *gmap_new_child(struct gmap *parent, gfn_t limit)int gmap_set_limit (struct gmap *gmap,gfn_t limit) { -struct kvm_s390_mmu_cache *mc; + struct kvm_s390_mmu_cache *mc __free(kvm_s390_mmu_cache) = NULL;int rc, type; type =gmap_limit_to_type (limit);
@@ -142,7 +142,6 @@ int gmap_set_limit(struct gmap *gmap, gfn_t limit) rc =dat_set_asce_limit (mc, &gmap->asce, type); }while (rc == -ENOMEM ); -kvm_s390_free_mmu_cache (mc);return 0 ; }
@@ -822,8 +821,8 @@ int gmap_ucas_translate(struct kvm_s390_mmu_cache *mc, struct gmap *gmap, gpa_tint gmap_ucas_map (struct gmap *gmap,gfn_t p_gfn,gfn_t c_gfn,unsigned long count) { -struct kvm_s390_mmu_cache *mc; -int rc; + struct kvm_s390_mmu_cache *mc __free(kvm_s390_mmu_cache) = NULL; +int rc =0 ; mc =kvm_s390_new_mmu_cache ();if (!mc)
Signature · 1 line
2.54.0
Claudio Imbrenda
maintainerPATCH v3 3/5 KVM: s390: vsie: Fix unshadowing logic
In reply to Claudio ImbrendaIn some cases (i.e. under extreme memory pressure on the host), attempting to shadow memory will result in the same memory being unshadowed, causing a loop.
Add a PGSTE bit to distinguish between shadowed memory and shadowed DAT tables, fix the unshadowing logic in _gmap_ptep_xchg() to prevent unnecessary unshadowing and perform better checks.
Also fix the unshadowing logic in _gmap_crstep_xchg_atomic() which did not unshadow properly when the large page would become unprotected.
Opportunistically add a check in gmap_protect_rmap() to make sure it won't be called with level == TABLE_TYPE_PAGE_TABLE.
--- arch/s390/kvm/dat.c | 1 + arch/s390/kvm/dat.h | 3 ++- arch/s390/kvm/gaccess.c | 1 + arch/s390/kvm/gmap.c | 3 ++- arch/s390/kvm/gmap.h | 60 ++++++++++++++++++++++++++++++++++++++--- 5 files changed, 63 insertions(+), 5 deletions(-)
arch/s390/kvm/dat.c +1 -0
@@ -267,6 +267,7 @@ static int dat_split_ste(struct kvm_s390_mmu_cache *mc, union pmd *pmdp, gfn_t g/* No need to take locks as the page table is not installed yet. */ pgste_init.prefix_notif = old.s.fc1.prefix_notif; pgste_init.vsie_notif = old.s.fc1.vsie_notif; + pgste_init.vsie_gmem = old.s.fc1.vsie_notif; pgste_init.pcl = uses_skeys && init.h.i;dat_init_pgstes (pt, pgste_init.val); }else {
arch/s390/kvm/dat.h +2 -1
@@ -145,7 +145,8 @@ union pgste { unsigned long cmma_d : 1; /* Dirty flag for CMMA bits */ unsigned long prefix_notif : 1; /* Guest prefix invalidation notification */ unsigned long vsie_notif : 1; /* Referenced in a shadow table */ - unsigned long : 5; + unsigned long vsie_gmem : 1; /* Contains nested guest memory */ + unsigned long : 4; unsigned long : 8; };struct {
arch/s390/kvm/gaccess.c +1 -0
@@ -1445,6 +1445,7 @@ static int _do_shadow_pte(struct gmap *sg, gpa_t raddr, union pte *ptep_h, union }else { pgste =_gmap_ptep_xchg (sg->parent, ptep_h, newpte, pgste, f->gfn, false); pgste.vsie_notif =1 ; + pgste.vsie_gmem =1 ; }pgste_set_unlock (ptep_h, pgste);if (rc)
arch/s390/kvm/gmap.c +2 -1
@@ -1031,7 +1031,8 @@ int gmap_protect_rmap(struct kvm_s390_mmu_cache *mc, struct gmap *sg, gfn_t p_gfunion pte pte;int flags, rc; -KVM_BUG_ON (!is_shadow (sg), sg->kvm); +if (KVM_BUG_ON (!is_shadow (sg) || level <=TABLE_TYPE_PAGE_TABLE , sg->kvm)) +return -EINVAL ;lockdep_assert_held (&sg->parent->children_lock); flags =DAT_WALK_SPLIT_ALLOC | (uses_skeys (sg->parent) ?DAT_WALK_USES_SKEYS :0 );
arch/s390/kvm/gmap.h +57 -3
85 lines not on this page · raw message
Signature · 1 line
2.54.0
Re: [PATCH v3 3/5] KVM: s390: vsie: Fix unshadowing logic
Am 19.05.26 um 17:01 schrieb Claudio Imbrenda:
Quoted 8 lines
In some cases (i.e. under extreme memory pressure on the host), attempting to shadow memory will result in the same memory being unshadowed, causing a loop.
Add a PGSTE bit to distinguish between shadowed memory and shadowed DAT tables, fix the unshadowing logic in
_gmap_ptep_xchg()to prevent unnecessary unshadowing and perform better checks.
Quoted 8 lines
Also fix the unshadowing logic in
_gmap_crstep_xchg_atomic()which did not unshadow properly when the large page would become unprotected.Opportunistically add a check in
gmap_protect_rmap()to make sure it won't be called with level ==TABLE_TYPE_PAGE_TABLE.Signed-off-by Claudio Imbrenda <[email protected]>Fixes a2c17f9270cc ("KVM: s390: New gmap code")
Claudio Imbrenda
maintainerPATCH v3 4/5 KVM: s390: vsie: Fix redundant rmap entries
In reply to Claudio ImbrendaThe address passed to the gmap rmap was not being masked. As a consequence several different (but functionally equivalent) rmap entries were being created for each shadowed table.
Fix this by properly masking the address depending on the table level.
--- arch/s390/kvm/gmap.c | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-)
arch/s390/kvm/gmap.c +3 -1
@@ -1025,6 +1025,7 @@ int gmap_insert_rmap(struct gmap *sg, gfn_t p_gfn, gfn_t r_gfn, int level)int gmap_protect_rmap (struct kvm_s390_mmu_cache *mc,struct gmap *sg,gfn_t p_gfn,gfn_t r_gfn,kvm_pfn_t pfn,int level,bool wr) { +unsigned long bitmask;union crste *crstep;union pgste pgste;union pte *ptep;
@@ -1041,8 +1042,9 @@ int gmap_protect_rmap(struct kvm_s390_mmu_cache *mc, struct gmap *sg, gfn_t p_gfif (rc)return rc;if (level <=TABLE_TYPE_REGION1 ) { + bitmask =-1UL << (8 +11 * level);scoped_guard (spinlock, &sg->host_to_rmap_lock) - rc = gmap_insert_rmap(sg, p_gfn, r_gfn, level); + rc = gmap_insert_rmap(sg, p_gfn, r_gfn & bitmask, level); }if (rc)return rc;
Signature · 1 line
2.54.0
Claudio Imbrenda
maintainerPATCH v3 5/5 KVM: s390: Properly reset zero bit in PGSTE
In reply to Claudio ImbrendaIn case of memory pressure, it's possible that a guest page gets freed and then almost immediately reused by the guest. If CMMA is enabled, _essa_clear_cbrl() will discard all pages that are either unused or zero. If a discarded page is reused before _essa_clear_cbrl() is called, and the pgste.zero bit is not cleared, the page will be discarded despite not being unused.
When calling _gmap_ptep_xchg(), always clear the pgste.zero bit. This prevents the page from being accidentally discarded when not unused.
--- arch/s390/kvm/gmap.h | 1 + 1 file changed, 1 insertion(+)
arch/s390/kvm/gmap.h +1 -0
@@ -220,6 +220,7 @@ static inline union pgste _gmap_ptep_xchg(struct gmap *gmap, union pte *ptep, un }if (!ptep->s.d && newpte.s.d && !newpte.s.s)SetPageDirty (pfn_to_page (newpte.h.pfra)); + pgste.zero =0 ;return __dat_ptep_xchg (ptep, pgste, newpte, gfn, gmap->asce,uses_skeys (gmap)); }
Signature · 1 line
2.54.0