Skip to content

i915 vgpu PV to improve vgpu performance

Xiaolin Zhang intel-gfx 11 versions – In review

Get series with b4
b4 am [email protected]

Versions newest first · linked by author and title

  1. v10 Latest9 patches 3 repliesIn review
  2. v99 patches 0 repliesSuperseded
  3. v89 patches 4 repliesSuperseded
Earlier versions · 8
VersionPostedPatchesRepliesStatus
v7 posting 2/29 patches2 repliesSuperseded
v7 posting 1/20 of 8 patches0 repliesSuperseded
v68 patches4 repliesSuperseded
v58 patches3 repliesSuperseded
v48 patches7 repliesSuperseded
v38 patches3 repliesSuperseded
v25 patches6 repliesSuperseded
v110 patches4 repliesSuperseded

v4 from the cover letter

1. addressed v3 review comments.
2. extended workload PV submission by skip execlists HW behaviour emulation and context switch interrupt injection.

Patches in v10 No applies recorded yet

#Subject and filesSizeRepliesApplied
1/9drm/i915: introduced vgpu pv capabilitydrivers/gpu/drm/i915/i915_debugfs.c drivers/gpu/drm/i915/i915_drv.h drivers/gpu/drm/i915/i915_pvinfo.h +2 more+59 -20 replies
2/9drm/i915: vgpu shared memory setup for pv optimizationdrivers/gpu/drm/i915/i915_drv.c drivers/gpu/drm/i915/i915_drv.h drivers/gpu/drm/i915/i915_pvinfo.h +2 more+122 -20 replies
3/9drm/i915: vgpu pv command buffer supportdrivers/gpu/drm/i915/i915_pvinfo.h drivers/gpu/drm/i915/i915_vgpu.c drivers/gpu/drm/i915/i915_vgpu.h+260 -01 reply
4/9drm/i915: vgpu ppgtt update pv optimizationdrivers/gpu/drm/i915/i915_gem.c drivers/gpu/drm/i915/i915_gem_gtt.c drivers/gpu/drm/i915/i915_gem_gtt.h +2 more+120 -51 reply
5/9drm/i915: vgpu context submission pv optimizationdrivers/gpu/drm/i915/Makefile drivers/gpu/drm/i915/gt/intel_lrc.c drivers/gpu/drm/i915/i915_vgpu.c +2 more+341 -61 reply
6/9drm/i915/gvt: GVTg handle pv_caps PVINFO registerdrivers/gpu/drm/i915/gvt/handlers.c drivers/gpu/drm/i915/gvt/vgpu.c+7 -00 replies
7/9drm/i915/gvt: GVTg handle shared_page setupdrivers/gpu/drm/i915/gvt/gvt.h drivers/gpu/drm/i915/gvt/handlers.c drivers/gpu/drm/i915/gvt/vgpu.c+70 -10 replies
8/9drm/i915/gvt: GVTg support ppgtt pv optimizationdrivers/gpu/drm/i915/gvt/gtt.c drivers/gpu/drm/i915/gvt/gtt.h drivers/gpu/drm/i915/gvt/gvt.h +2 more+441 -10 replies
9/9drm/i915/gvt: GVTg support context submission pv optimizationdrivers/gpu/drm/i915/gvt/execlist.c drivers/gpu/drm/i915/gvt/handlers.c drivers/gpu/drm/i915/gvt/vgpu.c+37 -10 replies

Reviews trailers per patch

No Reviewed-by, Acked-by or Tested-by trailers for v10 yet.

Read the v10 thread

Cover letter [PATCH v10 0/9] i915 vgpu PV to improve vgpu performance

To improve vgpu performance, it could implement some PV optimization such as to reduce the mmio access trap numbers or eliminate certain piece of HW emulation within guest driver to reduce vm exit/vm enter cost.

the solutions in this patch set are implemented two PV optimizations based on the shared memory region between guest and GVTg for data communication. The shared memory region is allocated by guest driver and this region's memory guest physical address will be passed to GVTg through PVINFO register and later GVTg can access this region directly without trap cost to achieve data exchange purpose between guest and GVTg.

in this patch set, 2 kind of PV optimization implemented controlled by pv_caps PVINO register with different pv bit.
1. workload PV submission (context submission): reduce 4 traps to 1 trap and eliminated execlists HW behaviour emulation.
2. ppgtt PV update: eliminate the cost of ppgtt write protection.

based on the experiment, for small workloads, specifally, glxgears with vblank_mode off, the average performance gain on single vgpu is 30~50%. for large workload such as media and 3D, the average performance gain is about 4%.

based on the PV mechanism, it could achive more vgpu feature optimization such as globle GTT update, display plane and water mark update.

v0: RFC patch set
v1: addressed RFC review comments
v2: addressed v1 review comments, added pv callbacks for pv operations v3:
1. addressed v2 review comments, removed pv callbacks code duplication in v2 and unified pv calls under g2v notification register. different g2v pv notifications defined.
2. dropped pv master irq feature due to hard conflict with recnet i915 change and take time to rework.
v4:
1. addressed v3 review comments.
2. extended workload PV submission by skip execlists HW behaviour emulation and context switch interrupt injection.
v5:
1. addressed v4 review comments from Chris for pv submission.
2. per-engine communication between PV guest and host.
v6:
1. addressed v5 review comments from Chris for pv submission.
2. addressed v5 review comments from Zhenyu for PV version support. v7:
1. addessed v6 review comments from Chris starting to use pv cmd buffer communication between pv guest and GVT.
v8: addressed v7 review comments from Chris to refine pv submssion code.
v9: refined PV user-facing message and to free PV shared memory in i915_destroy_vgpu.
v10: rebased to 5.3.0-rc8 and conducted the IGT BAT test and i915 live test with PV feature. No regression introduced by PV features. for IGT BAT test (fast-feedback.testlist), there are 225 cases in total (162 pass, 12 fail, 42 skip) for both vGPU with/without PV features. for i915 live test, PV features do not bring regression as well. there is a number of cases failed for vGPU live test which include intel_workarounds_live_selftests, intel_hangcheck_live_selftests, igt_vm_isolation, i915_gem_object_blt_live_selftests, preempt, live_virtual_* and required further analysis, not contributed by the PV patches.

Xiaolin Zhang (9):
drm/i915: introduced vgpu pv capability
drm/i915: vgpu shared memory setup for pv optimization drm/i915: vgpu pv command buffer support
drm/i915: vgpu ppgtt update pv optimization drm/i915: vgpu context submission pv optimization drm/i915/gvt: GVTg handle pv_caps PVINFO register drm/i915/gvt: GVTg handle shared_page setup drm/i915/gvt: GVTg support ppgtt pv optimization drm/i915/gvt: GVTg support context submission pv optimization

 drivers/gpu/drm/i915/Makefile              |   2 +-
 drivers/gpu/drm/i915/gt/intel_lrc.c        |  12 +-
 drivers/gpu/drm/i915/gvt/execlist.c        |   6 +
 drivers/gpu/drm/i915/gvt/gtt.c             | 298 ++++++++++++++++++++
 drivers/gpu/drm/i915/gvt/gtt.h             |  11 +
 drivers/gpu/drm/i915/gvt/gvt.h             |  12 +-
 drivers/gpu/drm/i915/gvt/handlers.c        | 181 +++++++++++-
 drivers/gpu/drm/i915/gvt/vgpu.c            |  50 ++++
 drivers/gpu/drm/i915/i915_debugfs.c        |   2 +
 drivers/gpu/drm/i915/i915_drv.c            |   2 +
 drivers/gpu/drm/i915/i915_drv.h            |   6 +-
 drivers/gpu/drm/i915/i915_gem.c            |   3 +-
 drivers/gpu/drm/i915/i915_gem_gtt.c        |  10 +-
 drivers/gpu/drm/i915/i915_gem_gtt.h        |   8 +
 drivers/gpu/drm/i915/i915_pvinfo.h         |   9 +-
 drivers/gpu/drm/i915/i915_vgpu.c           | 426 ++++++++++++++++++++++++++++-
 drivers/gpu/drm/i915/i915_vgpu.h           | 133 +++++++++
 drivers/gpu/drm/i915/intel_pv_submission.c | 300 ++++++++++++++++++++
 18 files changed, 1455 insertions(+), 16 deletions(-)
 create mode 100644 drivers/gpu/drm/i915/intel_pv_submission.c
Signature · 6 lines
1.8.3.1

_______________________________________________
Intel-gfx mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/intel-gfx