drm/i915: Remove obj->mm.lock!
Subsystems (4)
v3 cover drm/i915: Remove obj->mm.lock!
Finally there, just needs a lot of fixes!
A lot of places were calling certain calls without any object lock held, with the removal of mm.lock we can no longer do this, and have to fix it.
Phys page handling has to be redone, as nothing protects obj->ops structure, we have to remove swapping it, and move HAS_STRUCT_PAGE to obj->flags instead.
Userpointer locking is inverted, which we tried to get around with a workqueue. We correct the lock ordering and try to acquire userptr pages first before taking any ww locks. This is more compatible with the locking hierarchy, as we may need to acquire mmap_sem.
The previous versione broke gem_exec_schedule@pi-shared/distinct-iova, but now that we only unbind when required, this is now fixed.
We also have to fix some dma-work, the command parser and clflush are slightly reworked to put all memory allocations and pinning in the preparation, so the work could pass fence annotations.
In a few places like igt_spinner and execlists, we move some part of init to the first pin, because we need to have the ww lock held and it makes it easier that way.
Finally we convert all selftests, and then remove obj->mm.lock!
Previous version had some issues with hwsp, those are now fixed. A memset was missing, and has been re-added.
Some issues with userptr double lock popped up. Userptr notifier_lock is now a spinlock as it should only be held for very short amounts of time and sleeping is not allowed, and now correctly unlocked when invalidating.
This should fix the remaining test issues.
Test-with: [email protected]
Maarten Lankhorst (62):
drm/i915: Move cmd parser pinning to execbuffer
drm/i915: Add missing -EDEADLK handling to execbuf pinning drm/i915: Do not share hwsp across contexts any more, v3. drm/i915: Pin timeline map after first timeline pin, v3. drm/i915: Ensure we hold the object mutex in pin correctly. drm/i915: Add gem object locking to madvise.
drm/i915: Move HAS_STRUCT_PAGE to obj->flags
drm/i915: Rework struct phys attachment handling drm/i915: Convert i915_gem_object_attach_phys() to ww locking drm/i915: make lockdep slightly happier about execbuf. drm/i915: Disable userptr pread/pwrite support.
drm/i915: No longer allow exporting userptr through dma-buf drm/i915: Reject more ioctls for userptr
drm/i915: Reject UNSYNCHRONIZED for userptr
drm/i915: Fix userptr so we do not have to worry about obj->mm.lock,
v3.
drm/i915: Flatten obj->mm.lock
drm/i915: Populate logical context during first pin.
drm/i915: Make ring submission compatible with obj->mm.lock removal,
v2. drm/i915: Handle ww locking in init_status_page
drm/i915: Rework clflush to work correctly without obj->mm.lock. drm/i915: Pass ww ctx to intel_pin_to_display_plane drm/i915: Add object locking to vm_fault_cpu
drm/i915: Move pinning to inside engine_wa_list_verify() drm/i915: Take reservation lock around i915_vma_pin. drm/i915: Make intel_init_workaround_bb more compatible with ww
locking.
drm/i915: Make __engine_unpark() compatible with ww locking. drm/i915: Take obj lock around set_domain ioctl
drm/i915: Defer pin calls in buffer pool until first use by caller. drm/i915: Fix pread/pwrite to work with new locking rules. drm/i915: Fix workarounds selftest, part 1
drm/i915: Add igt_spinner_pin() to allow for ww locking around
spinner.
drm/i915: Add ww locking around vm_access()
drm/i915: Increase ww locking for perf.
drm/i915: Lock ww in ucode objects correctly
drm/i915: Add ww locking to dma-buf ops.
drm/i915: Add missing ww lock in intel_dsb_prepare. drm/i915: Fix ww locking in shmem_create_from_object drm/i915: Use a single page table lock for each gtt. drm/i915/selftests: Prepare huge_pages testcases for obj->mm.lock
removal.
drm/i915/selftests: Prepare client blit for obj->mm.lock removal. drm/i915/selftests: Prepare coherency tests for obj->mm.lock removal. drm/i915/selftests: Prepare context tests for obj->mm.lock removal. drm/i915/selftests: Prepare dma-buf tests for obj->mm.lock removal. drm/i915/selftests: Prepare execbuf tests for obj->mm.lock removal. drm/i915/selftests: Prepare mman testcases for obj->mm.lock removal. drm/i915/selftests: Prepare object tests for obj->mm.lock removal. drm/i915/selftests: Prepare object blit tests for obj->mm.lock
removal.
drm/i915/selftests: Prepare igt_gem_utils for obj->mm.lock removal drm/i915/selftests: Prepare context selftest for obj->mm.lock removal drm/i915/selftests: Prepare hangcheck for obj->mm.lock removal drm/i915/selftests: Prepare execlists for obj->mm.lock removal drm/i915/selftests: Prepare mocs tests for obj->mm.lock removal drm/i915/selftests: Prepare ring submission for obj->mm.lock removal drm/i915/selftests: Prepare timeline tests for obj->mm.lock removal drm/i915/selftests: Prepare i915_request tests for obj->mm.lock
removal
drm/i915/selftests: Prepare memory region tests for obj->mm.lock
removal
drm/i915/selftests: Prepare cs engine tests for obj->mm.lock removal drm/i915/selftests: Prepare gtt tests for obj->mm.lock removal drm/i915: Finally remove obj->mm.lock.
drm/i915: Keep userpointer bindings if seqcount is unchanged, v2. drm/i915: Idea to implement eviction locking
drm/i915: Keep lazy reference to userptr pages
Thomas Hellström (1):
drm/i915: Prepare for obj->mm.lock removal
drivers/gpu/drm/i915/Makefile | 1 - drivers/gpu/drm/i915/display/intel_display.c | 71 +- drivers/gpu/drm/i915/display/intel_display.h | 2 +- drivers/gpu/drm/i915/display/intel_dsb.c | 2 +- drivers/gpu/drm/i915/display/intel_fbdev.c | 2 +- drivers/gpu/drm/i915/display/intel_overlay.c | 34 +- drivers/gpu/drm/i915/gem/i915_gem_clflush.c | 15 +- drivers/gpu/drm/i915/gem/i915_gem_dmabuf.c | 62 +- drivers/gpu/drm/i915/gem/i915_gem_domain.c | 51 +- .../gpu/drm/i915/gem/i915_gem_execbuffer.c | 209 ++++- drivers/gpu/drm/i915/gem/i915_gem_fence.c | 95 -- drivers/gpu/drm/i915/gem/i915_gem_internal.c | 6 +- drivers/gpu/drm/i915/gem/i915_gem_lmem.c | 4 +- drivers/gpu/drm/i915/gem/i915_gem_mman.c | 35 +- drivers/gpu/drm/i915/gem/i915_gem_object.c | 10 +- drivers/gpu/drm/i915/gem/i915_gem_object.h | 126 ++- .../gpu/drm/i915/gem/i915_gem_object_blt.c | 6 + .../gpu/drm/i915/gem/i915_gem_object_types.h | 23 +- drivers/gpu/drm/i915/gem/i915_gem_pages.c | 104 ++- drivers/gpu/drm/i915/gem/i915_gem_phys.c | 95 +- drivers/gpu/drm/i915/gem/i915_gem_region.c | 4 +- drivers/gpu/drm/i915/gem/i915_gem_region.h | 3 +- drivers/gpu/drm/i915/gem/i915_gem_shmem.c | 18 +- drivers/gpu/drm/i915/gem/i915_gem_shrinker.c | 47 +- drivers/gpu/drm/i915/gem/i915_gem_shrinker.h | 4 +- drivers/gpu/drm/i915/gem/i915_gem_stolen.c | 14 +- drivers/gpu/drm/i915/gem/i915_gem_tiling.c | 2 - drivers/gpu/drm/i915/gem/i915_gem_userptr.c | 875 ++++++------------ .../drm/i915/gem/selftests/huge_gem_object.c | 4 +- .../gpu/drm/i915/gem/selftests/huge_pages.c | 38 +- .../i915/gem/selftests/i915_gem_client_blt.c | 8 +- .../i915/gem/selftests/i915_gem_coherency.c | 18 +- .../drm/i915/gem/selftests/i915_gem_context.c | 10 +- .../drm/i915/gem/selftests/i915_gem_dmabuf.c | 2 +- .../i915/gem/selftests/i915_gem_execbuffer.c | 2 +- .../drm/i915/gem/selftests/i915_gem_mman.c | 21 +- .../drm/i915/gem/selftests/i915_gem_object.c | 2 +- .../i915/gem/selftests/i915_gem_object_blt.c | 6 +- .../drm/i915/gem/selftests/i915_gem_phys.c | 10 +- .../drm/i915/gem/selftests/igt_gem_utils.c | 2 +- drivers/gpu/drm/i915/gt/intel_context_types.h | 13 +- drivers/gpu/drm/i915/gt/intel_engine_cs.c | 37 +- drivers/gpu/drm/i915/gt/intel_engine_pm.c | 4 +- drivers/gpu/drm/i915/gt/intel_ggtt.c | 10 +- .../gpu/drm/i915/gt/intel_gt_buffer_pool.c | 47 +- .../gpu/drm/i915/gt/intel_gt_buffer_pool.h | 5 + .../drm/i915/gt/intel_gt_buffer_pool_types.h | 1 + drivers/gpu/drm/i915/gt/intel_gt_types.h | 4 - drivers/gpu/drm/i915/gt/intel_gtt.c | 38 +- drivers/gpu/drm/i915/gt/intel_gtt.h | 5 + drivers/gpu/drm/i915/gt/intel_lrc.c | 150 +-- drivers/gpu/drm/i915/gt/intel_ppgtt.c | 3 +- drivers/gpu/drm/i915/gt/intel_renderstate.c | 2 +- .../gpu/drm/i915/gt/intel_ring_submission.c | 184 ++-- drivers/gpu/drm/i915/gt/intel_timeline.c | 392 ++------ drivers/gpu/drm/i915/gt/intel_timeline.h | 2 + .../gpu/drm/i915/gt/intel_timeline_types.h | 15 +- drivers/gpu/drm/i915/gt/intel_workarounds.c | 24 +- drivers/gpu/drm/i915/gt/mock_engine.c | 22 +- drivers/gpu/drm/i915/gt/selftest_context.c | 4 +- drivers/gpu/drm/i915/gt/selftest_engine_cs.c | 4 +- drivers/gpu/drm/i915/gt/selftest_hangcheck.c | 8 +- drivers/gpu/drm/i915/gt/selftest_lrc.c | 34 +- drivers/gpu/drm/i915/gt/selftest_mocs.c | 2 +- .../drm/i915/gt/selftest_ring_submission.c | 4 +- drivers/gpu/drm/i915/gt/selftest_timeline.c | 98 +- .../gpu/drm/i915/gt/selftest_workarounds.c | 101 +- drivers/gpu/drm/i915/gt/shmem_utils.c | 2 +- drivers/gpu/drm/i915/gt/uc/intel_guc.c | 2 +- drivers/gpu/drm/i915/gt/uc/intel_guc_log.c | 4 +- drivers/gpu/drm/i915/gt/uc/intel_huc.c | 2 +- drivers/gpu/drm/i915/gt/uc/intel_uc_fw.c | 2 +- drivers/gpu/drm/i915/gvt/dmabuf.c | 2 +- drivers/gpu/drm/i915/i915_active.c | 20 +- drivers/gpu/drm/i915/i915_cmd_parser.c | 104 +-- drivers/gpu/drm/i915/i915_debugfs.c | 4 +- drivers/gpu/drm/i915/i915_drv.h | 18 +- drivers/gpu/drm/i915/i915_gem.c | 298 +++--- drivers/gpu/drm/i915/i915_gem.h | 5 +- drivers/gpu/drm/i915/i915_gem_gtt.c | 2 +- drivers/gpu/drm/i915/i915_memcpy.c | 2 +- drivers/gpu/drm/i915/i915_memcpy.h | 2 +- drivers/gpu/drm/i915/i915_perf.c | 56 +- drivers/gpu/drm/i915/i915_request.c | 4 - drivers/gpu/drm/i915/i915_request.h | 10 - drivers/gpu/drm/i915/i915_selftest.h | 2 + drivers/gpu/drm/i915/i915_vma.c | 26 +- drivers/gpu/drm/i915/i915_vma.h | 20 +- drivers/gpu/drm/i915/selftests/i915_gem_gtt.c | 94 +- drivers/gpu/drm/i915/selftests/i915_request.c | 10 +- drivers/gpu/drm/i915/selftests/igt_spinner.c | 136 ++- drivers/gpu/drm/i915/selftests/igt_spinner.h | 5 + .../drm/i915/selftests/intel_memory_region.c | 18 +- drivers/gpu/drm/i915/selftests/mock_region.c | 4 +- 94 files changed, 2094 insertions(+), 2016 deletions(-) delete mode 100644 drivers/gpu/drm/i915/gem/i915_gem_fence.c
base-commit: 114b3ff35870623fbd7b7aa580e4b43c690edace
Signature · 5 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 1/63 drm/i915: Move cmd parser pinning to execbuffer
We need to get rid of allocations in the cmd parser, because it needs to be called from a signaling context, first move all pinning to execbuf, where we already hold all locks.
Allocate jump_whitelist in the execbuffer, and add annotations around intel_engine_cmd_parser(), to ensure we only call the command parser without allocating any memory, or taking any locks we're not supposed to.
Because i915_gem_object_get_page() may also allocate memory, add a path to i915_gem_object_get_sg() that prevents memory allocations, and walk the sg list manually. It should be similarly fast.
This has the added benefit of being able to catch all memory allocation errors before the point of no return, and return -ENOMEM safely to the execbuf submitter.
--- .../gpu/drm/i915/gem/i915_gem_execbuffer.c | 74 ++++++++++++- drivers/gpu/drm/i915/gem/i915_gem_object.h | 10 +- drivers/gpu/drm/i915/gem/i915_gem_pages.c | 21 +++- drivers/gpu/drm/i915/gt/intel_ggtt.c | 2 +- drivers/gpu/drm/i915/i915_cmd_parser.c | 104 ++++++++---------- drivers/gpu/drm/i915/i915_drv.h | 7 +- drivers/gpu/drm/i915/i915_memcpy.c | 2 +- drivers/gpu/drm/i915/i915_memcpy.h | 2 +- 8 files changed, 142 insertions(+), 80 deletions(-)
drivers/gpu/drm/i915/gem/i915_gem_execbuffer.c +68 -6
@@ -27,6 +27,7 @@#include "i915_sw_fence_work.h" #include "i915_trace.h" #include "i915_user_extensions.h" +#include "i915_memcpy.h" struct eb_vma {struct i915_vma *vma;
@@ -2269,24 +2270,45 @@ struct eb_parse_work {struct i915_vma *trampoline;unsigned long batch_offset;unsigned long batch_length; +unsigned long *jump_whitelist; +const void *batch_map; +void *shadow_map; };static int __eb_parse (struct dma_fence_work *work) {struct eb_parse_work *pw =container_of (work,typeof (*pw), base); +int ret; +bool cookie; -return intel_engine_cmd_parser (pw->engine, - pw->batch, - pw->batch_offset, - pw->batch_length, - pw->shadow, - pw->trampoline); + cookie =dma_fence_begin_signalling (); + ret =intel_engine_cmd_parser (pw->engine, + pw->batch, + pw->batch_offset, + pw->batch_length, + pw->shadow, + pw->jump_whitelist, + pw->shadow_map, + pw->batch_map); +dma_fence_end_signalling (cookie); + +return ret; }static void __eb_parse_release (struct dma_fence_work *work) {struct eb_parse_work *pw =container_of (work,typeof (*pw), base); +if (!IS_ERR_OR_NULL (pw->jump_whitelist)) +kfree (pw->jump_whitelist); + +if (pw->batch_map) +i915_gem_object_unpin_map (pw->batch->obj); +else +i915_gem_object_unpin_pages (pw->batch->obj); + +i915_gem_object_unpin_map (pw->shadow->obj); +if (pw->trampoline)i915_active_release (&pw->trampoline->active);i915_active_release (&pw->shadow->active);
@@ -2336,6 +2358,8 @@ static int eb_parse_pipeline(struct i915_execbuffer *eb, struct i915_vma *trampoline) {struct eb_parse_work *pw; +struct drm_i915_gem_object *batch = eb->batch->vma->obj; +bool needs_clflush;int err;GEM_BUG_ON (overflows_type (eb->batch_start_offset, pw->batch_offset));
@@ -2359,6 +2383,34 @@ static int eb_parse_pipeline(struct i915_execbuffer *eb, goto err_shadow; } + pw->shadow_map =i915_gem_object_pin_map (shadow->obj,I915_MAP_FORCE_WB ); +if (IS_ERR (pw->shadow_map)) { + err =PTR_ERR (pw->shadow_map); + goto err_trampoline; + } + + needs_clflush = + !(batch->cache_coherent &I915_BO_CACHE_COHERENT_FOR_READ ); + + pw->batch_map =ERR_PTR (-ENODEV ); +if (needs_clflush &&i915_has_memcpy_from_wc ()) + pw->batch_map =i915_gem_object_pin_map (batch,I915_MAP_WC ); + +if (IS_ERR (pw->batch_map)) { + err =i915_gem_object_pin_pages (batch); +if (err) + goto err_unmap_shadow; + pw->batch_map =NULL ; + } + + pw->jump_whitelist = +intel_engine_cmd_parser_alloc_jump_whitelist (eb->batch_len, + trampoline); +if (IS_ERR (pw->jump_whitelist)) { + err =PTR_ERR (pw->jump_whitelist); + goto err_unmap_batch; + } +dma_fence_work_init (&pw->base, &eb_parse_ops); pw->engine = eb->engine;
@@ -2398,6 +2450,16 @@ static int eb_parse_pipeline(struct i915_execbuffer *eb,dma_fence_work_commit_imm (&pw->base);return err; +err_unmap_batch: +if (pw->batch_map) +i915_gem_object_unpin_map (batch); +else +i915_gem_object_unpin_pages (batch); +err_unmap_shadow: +i915_gem_object_unpin_map (shadow->obj); +err_trampoline: +if (trampoline) +i915_active_release (&trampoline->active); err_shadow:i915_active_release (&shadow->active); err_batch:
drivers/gpu/drm/i915/gem/i915_gem_object.h +5 -5
@@ -275,22 +275,22 @@ struct scatterlist * __i915_gem_object_get_sg(struct drm_i915_gem_object *obj, struct i915_gem_object_page_iter *iter, unsigned int n, - unsigned int *offset); + unsigned int *offset, bool allow_alloc);static inline struct scatterlist *i915_gem_object_get_sg (struct drm_i915_gem_object *obj,unsigned int n, -unsigned int *offset) +unsigned int *offset,bool allow_alloc) { -return __i915_gem_object_get_sg (obj, &obj->mm.get_page, n, offset); +return __i915_gem_object_get_sg (obj, &obj->mm.get_page, n, offset, allow_alloc); }static inline struct scatterlist *i915_gem_object_get_sg_dma (struct drm_i915_gem_object *obj,unsigned int n, -unsigned int *offset) +unsigned int *offset,bool allow_alloc) { -return __i915_gem_object_get_sg (obj, &obj->mm.get_dma_page, n, offset); +return __i915_gem_object_get_sg (obj, &obj->mm.get_dma_page, n, offset, allow_alloc); } struct page *
drivers/gpu/drm/i915/gem/i915_gem_pages.c +17 -4
@@ -457,7 +457,8 @@ struct scatterlist * __i915_gem_object_get_sg(struct drm_i915_gem_object *obj, struct i915_gem_object_page_iter *iter, unsigned int n, - unsigned int *offset) + unsigned int *offset, + bool allow_alloc) { const bool dma = iter == &obj->mm.get_dma_page;struct scatterlist *sg;
@@ -479,6 +480,9 @@ __i915_gem_object_get_sg(struct drm_i915_gem_object *obj,if (n <READ_ONCE (iter->sg_idx)) goto lookup; +if (!allow_alloc) + goto manual_lookup; +mutex_lock (&iter->lock);/* We prefer to reuse the last sg so that repeated lookup of this
@@ -528,7 +532,16 @@ __i915_gem_object_get_sg(struct drm_i915_gem_object *obj,if (unlikely (n < idx))/* insertion completed by another thread */ goto lookup; -/* In case we failed to insert the entry into the radixtree, we need + goto manual_walk; + +manual_lookup: + idx =0 ; + sg = obj->mm.pages->sgl; + count =__sg_page_count (sg); + +manual_walk: +/* +* In case we failed to insert the entry into the radixtree, we need * to look beyond the current sg. */ while (idx + count <= n) {
@@ -575,7 +588,7 @@ i915_gem_object_get_page(struct drm_i915_gem_object *obj, unsigned int n)GEM_BUG_ON (!i915_gem_object_has_struct_page (obj)); - sg =i915_gem_object_get_sg (obj, n, &offset); + sg =i915_gem_object_get_sg (obj, n, &offset, true);return nth_page (sg_page (sg), offset); }
@@ -601,7 +614,7 @@ i915_gem_object_get_dma_address_len(struct drm_i915_gem_object *obj,struct scatterlist *sg;unsigned int offset; - sg =i915_gem_object_get_sg_dma (obj, n, &offset); + sg =i915_gem_object_get_sg_dma (obj, n, &offset, true);if (len) *len =sg_dma_len (sg) - (offset <<PAGE_SHIFT );
drivers/gpu/drm/i915/gt/intel_ggtt.c +1 -1
@@ -1383,7 +1383,7 @@ intel_partial_pages(const struct i915_ggtt_view *view,if (ret) goto err_sg_alloc; - iter =i915_gem_object_get_sg_dma (obj, view->partial.offset, &offset); + iter =i915_gem_object_get_sg_dma (obj, view->partial.offset, &offset, true);GEM_BUG_ON (!iter); sg = st->sgl;
drivers/gpu/drm/i915/i915_cmd_parser.c +43 -61
162 lines not on this page · raw message
drivers/gpu/drm/i915/i915_drv.h +6 -1
@@ -1949,12 +1949,17 @@ const char *i915_cache_level_str(struct drm_i915_private *i915, int type);int i915_cmd_parser_get_version (struct drm_i915_private *dev_priv);void intel_engine_init_cmd_parser (struct intel_engine_cs *engine);void intel_engine_cleanup_cmd_parser (struct intel_engine_cs *engine); +unsigned long *intel_engine_cmd_parser_alloc_jump_whitelist (u32 batch_length, +bool trampoline); +int intel_engine_cmd_parser (struct intel_engine_cs *engine,struct i915_vma *batch,unsigned long batch_offset,unsigned long batch_length,struct i915_vma *shadow, -bool trampoline); +unsigned long *jump_whitelist, +void *shadow_map, +const void *batch_map);#define I915_CMD_PARSER_TRAMPOLINE_SIZE 8/* intel_device_info.c */
drivers/gpu/drm/i915/i915_memcpy.c +1 -1
@@ -135,7 +135,7 @@ bool i915_memcpy_from_wc(void *dst, const void *src, unsigned long len)* accepts that its arguments may not be aligned, but are valid for the * potential 16-byte read past the end. */ -void i915_unaligned_memcpy_from_wc (void *dst,void *src,unsigned long len) +void i915_unaligned_memcpy_from_wc (void *dst,const void *src,unsigned long len) {unsigned long addr;
drivers/gpu/drm/i915/i915_memcpy.h +1 -1
@@ -13,7 +13,7 @@ struct drm_i915_private;void i915_memcpy_init_early (struct drm_i915_private *i915);bool i915_memcpy_from_wc (void *dst,const void *src,unsigned long len); -void i915_unaligned_memcpy_from_wc (void *dst,void *src,unsigned long len); +void i915_unaligned_memcpy_from_wc (void *dst,const void *src,unsigned long len);/* The movntdqa instructions used for memcpy-from-wc require 16-byte alignment, * as well as SSE4.1 support. i915_memcpy_from_wc() will report if it cannot
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 2/63 drm/i915: Add missing -EDEADLK handling to execbuf pinning
In reply to Maarten Lankhorsti915_vma_pin may fail with -EDEADLK when we start locking page tables, so ensure we handle this correctly.
--- .../gpu/drm/i915/gem/i915_gem_execbuffer.c | 23 +++++++++++++++---- 1 file changed, 18 insertions(+), 5 deletions(-)
drivers/gpu/drm/i915/gem/i915_gem_execbuffer.c +18 -5
@@ -419,13 +419,14 @@ static u64 eb_pin_flags(const struct drm_i915_gem_exec_object2 *entry,return pin_flags; } -static inline bool +static inline int eb_pin_vma (struct i915_execbuffer *eb,const struct drm_i915_gem_exec_object2 *entry,struct eb_vma *ev) {struct i915_vma *vma = ev->vma;u64 pin_flags; +int err;if (vma->node.size) pin_flags = vma->node.start;
@@ -438,16 +439,24 @@ eb_pin_vma(struct i915_execbuffer *eb,/* Attempt to reuse the current location if available */ /* TODO: Add -EDEADLK handling here */ -if (unlikely (i915_vma_pin_ww (vma, &eb->ww,0 ,0 , pin_flags))) { + err =i915_vma_pin_ww (vma, &eb->ww,0 ,0 , pin_flags); +if (err == -EDEADLK ) +return err; + +if (unlikely (err)) {if (entry->flags &EXEC_OBJECT_PINNED )return false;/* Failing that pick any _free_ space if suitable */ -if (unlikely (i915_vma_pin_ww (vma, &eb->ww, + err =i915_vma_pin_ww (vma, &eb->ww, entry->pad_to_size, entry->alignment,eb_pin_flags (entry, ev->flags) | -PIN_USER |PIN_NOEVICT ))) +PIN_USER |PIN_NOEVICT ); +if (err == -EDEADLK ) +return err; + +if (unlikely (err))return false; }
@@ -896,7 +905,11 @@ static int eb_validate_vmas(struct i915_execbuffer *eb)if (err)return err; -if (eb_pin_vma (eb, entry, ev)) { + err =eb_pin_vma (eb, entry, ev); +if (err <0 ) +return err; + +if (err >0 ) {if (entry->offset != vma->node.start) { entry->offset = vma->node.start |UPDATE ; eb->args->flags |= __EXEC_HAS_RELOC;
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 3/63 drm/i915: Do not share hwsp across contexts any more, v3.
In reply to Maarten LankhorstInstead of sharing pages with breadcrumbs, give each timeline a single page. This allows unrelated timelines not to share locks any more during command submission.
As an additional benefit, seqno wraparound no longer requires i915_vma_pin, which means we no longer need to worry about a potential -EDEADLK at a point where we are ready to submit.
Changes since v1:
- Fix erroneous i915_vma_acquire that should be a i915_vma_release (ickle).
- Extra check for completion in intel_read_hwsp().
Changes since v2:
- Fix inconsistent indent in hwsp_alloc() (kbuild)
- memset entire cacheline to 0.
--- drivers/gpu/drm/i915/gt/intel_gt_types.h | 4 - drivers/gpu/drm/i915/gt/intel_timeline.c | 385 +++--------------- .../gpu/drm/i915/gt/intel_timeline_types.h | 15 +- drivers/gpu/drm/i915/gt/selftest_timeline.c | 11 +- drivers/gpu/drm/i915/i915_request.c | 4 - drivers/gpu/drm/i915/i915_request.h | 10 - 6 files changed, 60 insertions(+), 369 deletions(-)
drivers/gpu/drm/i915/gt/intel_gt_types.h +0 -4
@@ -39,10 +39,6 @@ struct intel_gt {struct intel_gt_timelines {spinlock_t lock;/* protects active_list */ struct list_head active_list; - -/* Pack multiple timelines' seqnos into the same page */ -spinlock_t hwsp_lock; -struct list_head hwsp_free_list; } timelines;struct intel_gt_requests {
drivers/gpu/drm/i915/gt/intel_timeline.c +53 -332
496 lines not on this page · raw message
drivers/gpu/drm/i915/gt/intel_timeline_types.h +3 -12
@@ -18,7 +18,6 @@struct i915_vma ;struct i915_syncmap ;struct intel_gt ; -struct intel_timeline_hwsp ;struct intel_timeline {u64 fence_context;
@@ -45,12 +44,11 @@ struct intel_timeline {atomic_t pin_count;atomic_t active_count; +void *hwsp_map;const u32 *hwsp_seqno;struct i915_vma *hwsp_ggtt;u32 hwsp_offset; -struct intel_timeline_cacheline *hwsp_cacheline; -bool has_initial_breadcrumb;/**
@@ -67,6 +65,8 @@ struct intel_timeline {*/ struct i915_active_fence last_request; +struct i915_active active; +/** A chain of completed timelines ready for early retirement. */ struct intel_timeline *retire;
@@ -88,13 +88,4 @@ struct intel_timeline { struct rcu_head rcu; }; -struct intel_timeline_cacheline { -struct i915_active active; - -struct intel_timeline_hwsp *hwsp; -void *vaddr; - -struct rcu_head rcu; -}; -#endif /* __I915_TIMELINE_TYPES_H__ */
drivers/gpu/drm/i915/gt/selftest_timeline.c +4 -7
@@ -664,7 +664,7 @@ static int live_hwsp_wrap(void *arg)if (IS_ERR (tl))return PTR_ERR (tl); -if (!tl->has_initial_breadcrumb || !tl->hwsp_cacheline) +if (!tl->has_initial_breadcrumb) goto out_free; err =intel_timeline_pin (tl,NULL );
@@ -780,9 +780,7 @@ static int live_hwsp_rollover_kernel(void *arg) }GEM_BUG_ON (i915_active_fence_isset (&tl->last_request)); - tl->seqno =0 ; -timeline_rollback (tl); -timeline_rollback (tl); + tl->seqno =-2u ;WRITE_ONCE (*(u32 *)tl->hwsp_seqno, tl->seqno);for (i =0 ; i <ARRAY_SIZE (rq); i++) {
@@ -862,11 +860,10 @@ static int live_hwsp_rollover_user(void *arg) goto out; tl = ce->timeline; -if (!tl->has_initial_breadcrumb || !tl->hwsp_cacheline) +if (!tl->has_initial_breadcrumb) goto out; -timeline_rollback (tl); -timeline_rollback (tl); + tl->seqno =-4u ;WRITE_ONCE (*(u32 *)tl->hwsp_seqno, tl->seqno);for (i =0 ; i <ARRAY_SIZE (rq); i++) {
drivers/gpu/drm/i915/i915_request.c +0 -4
@@ -853,7 +853,6 @@ __i915_request_create(struct intel_context *ce, gfp_t gfp) rq->fence.seqno = seqno;RCU_INIT_POINTER (rq->timeline, tl); -RCU_INIT_POINTER (rq->hwsp_cacheline, tl->hwsp_cacheline); rq->hwsp_seqno = tl->hwsp_seqno;GEM_BUG_ON (i915_request_completed (rq));
@@ -1092,9 +1091,6 @@ emit_semaphore_wait(struct i915_request *to,if (i915_request_has_initial_breadcrumb (to)) goto await_fence; -if (!rcu_access_pointer (from->hwsp_cacheline)) - goto await_fence; -/* * If this or its dependents are waiting on an external fence * that may fail catastrophically, then we want to avoid using
drivers/gpu/drm/i915/i915_request.h +0 -10
@@ -234,16 +234,6 @@ struct i915_request {*/ const u32 *hwsp_seqno; -/* -* If we need to access the timeline's seqno for this request in -* another request, we need to keep a read reference to this associated -* cacheline, so that we do not free and recycle it before the foreign -* observers have completed. Hence, we keep a pointer to the cacheline -* inside the timeline's HWSP vma, but it is only valid while this -* request has not completed and guarded by the timeline mutex. -*/ -struct intel_timeline_cacheline __rcu *hwsp_cacheline; -/** Position in the ring of the start of the request */ u32 head;
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 4/63 drm/i915: Pin timeline map after first timeline pin, v3.
In reply to Maarten LankhorstWe're starting to require the reservation lock for pinning, so wait until we have that.
Update the selftests to handle this correctly, and ensure pin is called in live_hwsp_rollover_user() and mock_hwsp_freelist().
Changes since v1:
- Fix NULL + XX arithmatic, use casts. (kbuild)
Changes since v2:
- Clear entire cacheline when pinning.
--- drivers/gpu/drm/i915/gt/intel_timeline.c | 37 ++++++++---- drivers/gpu/drm/i915/gt/intel_timeline.h | 2 + drivers/gpu/drm/i915/gt/mock_engine.c | 22 ++++++- drivers/gpu/drm/i915/gt/selftest_timeline.c | 63 +++++++++++---------- drivers/gpu/drm/i915/i915_selftest.h | 2 + 5 files changed, 83 insertions(+), 43 deletions(-)
drivers/gpu/drm/i915/gt/intel_timeline.c +27 -10
@@ -51,13 +51,28 @@ static int __timeline_active(struct i915_active *active)return 0 ; } +I915_SELFTEST_EXPORT int +intel_timeline_pin_map (struct intel_timeline *timeline) +{ +struct drm_i915_gem_object *obj = timeline->hwsp_ggtt->obj; +u32 ofs =offset_in_page (timeline->hwsp_offset); +void *vaddr; + + vaddr =i915_gem_object_pin_map (obj,I915_MAP_WB ); +if (IS_ERR (vaddr)) +return PTR_ERR (vaddr); + + timeline->hwsp_map = vaddr; + timeline->hwsp_seqno =memset (vaddr + ofs,0 ,CACHELINE_BYTES ); + +return 0 ; +} +static int intel_timeline_init (struct intel_timeline *timeline,struct intel_gt *gt,struct i915_vma *hwsp,unsigned int offset) { -void *vaddr; -kref_init (&timeline->kref);atomic_set (&timeline->pin_count,0 );
@@ -73,13 +88,8 @@ static int intel_timeline_init(struct intel_timeline *timeline,return PTR_ERR (hwsp); timeline->hwsp_ggtt = hwsp; } - - vaddr =i915_gem_object_pin_map (hwsp->obj,I915_MAP_WB ); -if (IS_ERR (vaddr)) -return PTR_ERR (vaddr); - - timeline->hwsp_map = vaddr; - timeline->hwsp_seqno =memset (vaddr + timeline->hwsp_offset,0 ,CACHELINE_BYTES ); + timeline->hwsp_map =NULL ; + timeline->hwsp_seqno = (void *)(long )timeline->hwsp_offset;GEM_BUG_ON (timeline->hwsp_offset >= hwsp->size);
@@ -110,7 +120,8 @@ static void intel_timeline_fini(struct intel_timeline *timeline)GEM_BUG_ON (!list_empty (&timeline->requests));GEM_BUG_ON (timeline->retire); -i915_gem_object_unpin_map (timeline->hwsp_ggtt->obj); +if (timeline->hwsp_map) +i915_gem_object_unpin_map (timeline->hwsp_ggtt->obj);i915_vma_put (timeline->hwsp_ggtt);i915_active_fini (&timeline->active);
@@ -150,6 +161,12 @@ int intel_timeline_pin(struct intel_timeline *tl, struct i915_gem_ww_ctx *ww)if (atomic_add_unless (&tl->pin_count,1 ,0 ))return 0 ; +if (!tl->hwsp_map) { + err =intel_timeline_pin_map (tl); +if (err) +return err; + } + err =i915_ggtt_pin (tl->hwsp_ggtt, ww,0 ,PIN_HIGH );if (err)return err;
drivers/gpu/drm/i915/gt/intel_timeline.h +2 -0
@@ -106,4 +106,6 @@ int intel_timeline_read_hwsp(struct i915_request *from,void intel_gt_init_timelines (struct intel_gt *gt);void intel_gt_fini_timelines (struct intel_gt *gt); +I915_SELFTEST_DECLARE(int intel_timeline_pin_map(struct intel_timeline *tl)); +#endif
drivers/gpu/drm/i915/gt/mock_engine.c +20 -2
@@ -32,9 +32,20 @@#include "mock_engine.h" #include "selftests/mock_request.h" -static void mock_timeline_pin (struct intel_timeline *tl) +static int mock_timeline_pin (struct intel_timeline *tl) { +int err; + +if (WARN_ON (!i915_gem_object_trylock (tl->hwsp_ggtt->obj))) +return -EBUSY ; + + err =intel_timeline_pin_map (tl); +i915_gem_object_unlock (tl->hwsp_ggtt->obj); +if (err) +return err; +atomic_inc (&tl->pin_count); +return 0 ; }static void mock_timeline_unpin (struct intel_timeline *tl)
@@ -152,6 +163,8 @@ static void mock_context_destroy(struct kref *ref)static int mock_context_alloc (struct intel_context *ce) { +int err; + ce->ring =mock_ring (ce->engine);if (!ce->ring)return -ENOMEM ;
@@ -162,7 +175,12 @@ static int mock_context_alloc(struct intel_context *ce)return PTR_ERR (ce->timeline); } -mock_timeline_pin (ce->timeline); + err =mock_timeline_pin (ce->timeline); +if (err) { +intel_timeline_put (ce->timeline); + ce->timeline =NULL ; +return err; + }return 0 ; }
drivers/gpu/drm/i915/gt/selftest_timeline.c +32 -31
165 lines not on this page · raw message
drivers/gpu/drm/i915/i915_selftest.h +2 -0
@@ -107,6 +107,7 @@ int __i915_subtests(const char *caller,#define I915_SELFTEST_DECLARE (x) x#define I915_SELFTEST_ONLY (x) unlikely(x) +#define I915_SELFTEST_EXPORT #else /* !IS_ENABLED(CONFIG_DRM_I915_SELFTEST) */
@@ -116,6 +117,7 @@ static inline int i915_perf_selftests(struct pci_dev *pdev) { return 0; }#define I915_SELFTEST_DECLARE (x)#define I915_SELFTEST_ONLY (x) 0 +#define I915_SELFTEST_EXPORT static#endif
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
Re: [Intel-gfx] [PATCH v3 04/63] drm/i915: Pin timeline map after first timeline pin, v3.
Quoted 13 lines · Maarten Lankhorst
We're starting to require the reservation lock for pinning, so wait until we have that.
Update the selftests to handle this correctly, and ensure pin is called in
live_hwsp_rollover_user()andmock_hwsp_freelist().Changes since v1:
- Fix NULL + XX arithmatic, use casts. (kbuild)
Changes since v2:
- Clear entire cacheline when pinning.Signed-off-by Maarten Lankhorst <[email protected]>Reported-by kernel test robot <[email protected]>
...
drivers/gpu/drm/i915/gt/intel_timeline.c int intel_timeline_pin(struct intel_timeline *tl, struct i915_gem_ww_ctx *ww) · line 169
Quoted 10 lines
drivers/gpu/drm/i915/gt/intel_timeline.c +6
-0@@ -150,6 +161,12 @@ int intel_timeline_pin(struct intel_timeline *tl, struct i915_gem_ww_ctx *ww)if (atomic_add_unless (&tl->pin_count,1 ,0 ))return 0 ; +if (!tl->hwsp_map) { + err =intel_timeline_pin_map (tl); +if (err) +return err; + } +
On subsequent errors or if somebody beats us to the 0->1 transition, we need to unpin_map to avoid leaking pins.
Quoted 20 lines
drivers/gpu/drm/i915/gt/intel_timeline.c +0
-0err =i915_ggtt_pin (tl->hwsp_ggtt, ww,0 ,PIN_HIGH );if (err)return err;drivers/gpu/drm/i915/gt/intel_timeline.h +2
-0@@ -106,4 +106,6 @@ int intel_timeline_read_hwsp(struct i915_request *from,void intel_gt_init_timelines (struct intel_gt *gt);void intel_gt_fini_timelines (struct intel_gt *gt); +I915_SELFTEST_DECLARE(int intel_timeline_pin_map(struct intel_timeline *tl)); +#endif drivers/gpu/drm/i915/gt/mock_engine.c +0
-0
drivers/gpu/drm/i915/gt/mock_engine.c line 40
Quoted 10 lines
drivers/gpu/drm/i915/gt/mock_engine.c +5
-1@@ -32,9 +32,20 @@#include "mock_engine.h" #include "selftests/mock_request.h" -static void mock_timeline_pin (struct intel_timeline *tl) +static int mock_timeline_pin (struct intel_timeline *tl) { +int err; + +if (WARN_ON (!i915_gem_object_trylock (tl->hwsp_ggtt->obj))) +return -EBUSY ;
I think we should either annotate this properly as an isolated lock, or allow a silent -EBUSY.
/Thomas
_______________________________________________
Intel-gfx mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/intel-gfx
Re: [Intel-gfx] [PATCH v3 04/63] drm/i915: Pin timeline map after first timeline pin, v3.
Op 27-10-2020 om 12:03 schreef Thomas Hellström (Intel):
Quoted 16 lines · Maarten Lankhorst
Quoted 13 lines
We're starting to require the reservation lock for pinning, so wait until we have that.
Update the selftests to handle this correctly, and ensure pin is called in
live_hwsp_rollover_user()andmock_hwsp_freelist().Changes since v1:
- Fix NULL + XX arithmatic, use casts. (kbuild)
Changes since v2:
- Clear entire cacheline when pinning.Signed-off-by Maarten Lankhorst <[email protected]>Reported-by kernel test robot <[email protected]>...
Quoted 11 lines
drivers/gpu/drm/i915/gt/intel_timeline.c int intel_timeline_pin(struct intel_timeline *tl, struct i915_gem_ww_ctx *ww) · line 168
Quoted 9 lines
drivers/gpu/drm/i915/gt/intel_timeline.c +5
-0@@ -150,6 +161,12 @@ int intel_timeline_pin(struct intel_timeline *tl, struct i915_gem_ww_ctx *ww) if (atomic_add_unless(&tl->pin_count, 1, 0)) return 0; + if (!tl->hwsp_map) { + err = intel_timeline_pin_map(tl); + if (err) + return err; + } +On subsequent errors or if somebody beats us to the 0->1 transition, we need to
unpin_mapto avoid leaking pins.
No? tl->hwsp_map can stay set. We hold a lock to tl->hwsp_ggtt to prevent any races. :)
~Maarten
Quoted 22 lines
Quoted 22 lines
drivers/gpu/drm/i915/gt/intel_timeline.c +0
-0err = i915_ggtt_pin(tl->hwsp_ggtt, ww, 0, PIN_HIGH); if (err) return err;drivers/gpu/drm/i915/gt/intel_timeline.h +1
-0@@ -106,4 +106,6 @@ int intel_timeline_read_hwsp(struct i915_request *from, void intel_gt_init_timelines(struct intel_gt *gt); void intel_gt_fini_timelines(struct intel_gt *gt); +I915_SELFTEST_DECLARE(int intel_timeline_pin_map(struct intel_timeline *tl)); + #endifdrivers/gpu/drm/i915/gt/mock_engine.c +0
-0@@ -32,9 +32,20 @@ #include "mock_engine.h" #include "selftests/mock_request.h" -static void mock_timeline_pin(struct intel_timeline *tl)
Quoted 8 lines
drivers/gpu/drm/i915/gt/mock_engine.c line 40
Quoted 6 lines
drivers/gpu/drm/i915/gt/mock_engine.c +5
-0+static int mock_timeline_pin (struct intel_timeline *tl) { + int err; + + if (WARN_ON(!i915_gem_object_trylock(tl->hwsp_ggtt->obj))) + return -EBUSY;I think we should either annotate this properly as an isolated lock, or allow a silent
-EBUSY.
This is done in a controlled selftest where we mock the entire i915 device, so normally this can't happen. :)
_______________________________________________
Intel-gfx mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/intel-gfx
Re: [Intel-gfx] [PATCH v3 04/63] drm/i915: Pin timeline map after first timeline pin, v3.
Quoted 26 lines · Maarten Lankhorst
Op 27-10-2020 om 12:03 schreef Thomas Hellström (Intel):
Quoted 15 lines · Maarten Lankhorst
Quoted 13 lines
We're starting to require the reservation lock for pinning, so wait until we have that.
Update the selftests to handle this correctly, and ensure pin is called in
live_hwsp_rollover_user()andmock_hwsp_freelist().Changes since v1:
- Fix NULL + XX arithmatic, use casts. (kbuild)
Changes since v2:
- Clear entire cacheline when pinning.Signed-off-by Maarten Lankhorst <[email protected]>Reported-by kernel test robot <[email protected]>...
Quoted 10 lines
drivers/gpu/drm/i915/gt/intel_timeline.c int intel_timeline_pin(struct intel_timeline *tl, struct i915_gem_ww_ctx *ww) · line 168
Quoted 9 lines
drivers/gpu/drm/i915/gt/intel_timeline.c +5
-0@@ -150,6 +161,12 @@ int intel_timeline_pin(struct intel_timeline *tl, struct i915_gem_ww_ctx *ww) if (atomic_add_unless(&tl->pin_count, 1, 0)) return 0; + if (!tl->hwsp_map) { + err = intel_timeline_pin_map(tl); + if (err) + return err; + } +On subsequent errors or if somebody beats us to the 0->1 transition, we need to
unpin_mapto avoid leaking pins.
Quoted 1 line
No?
tl->hwsp_mapcan stay set. We hold a lock totl->hwsp_ggttto prevent any races. :)
OK, but in that case we need to be consistent. Either there are no races and we can remove the code that handles them, or there are races and we should take this into account.
Quoted 31 lines
~Maarten
Quoted 20 lines
Quoted 20 lines
drivers/gpu/drm/i915/gt/intel_timeline.c +0
-0err = i915_ggtt_pin(tl->hwsp_ggtt, ww, 0, PIN_HIGH); if (err) return err;drivers/gpu/drm/i915/gt/intel_timeline.h +1
-0@@ -106,4 +106,6 @@ int intel_timeline_read_hwsp(struct i915_request *from, void intel_gt_init_timelines(struct intel_gt *gt); void intel_gt_fini_timelines(struct intel_gt *gt); +I915_SELFTEST_DECLARE(int intel_timeline_pin_map(struct intel_timeline *tl)); + #endifdrivers/gpu/drm/i915/gt/mock_engine.c +0
-0@@ -32,9 +32,20 @@ #include "mock_engine.h" #include "selftests/mock_request.h"Quoted 8 lines
drivers/gpu/drm/i915/gt/mock_engine.c line 40
Quoted 7 lines
drivers/gpu/drm/i915/gt/mock_engine.c +5
-0-static void mock_timeline_pin(struct intel_timeline *tl) +static int mock_timeline_pin(struct intel_timeline *tl) { + int err; + + if (WARN_ON(!i915_gem_object_trylock(tl->hwsp_ggtt->obj))) + return -EBUSY;I think we should either annotate this properly as an isolated lock, or allow a silent
-EBUSY.
Quoted 1 line
This is done in a controlled selftest where we mock the entire i915 device, so normally this can't happen. :)
But if it does, we get erratic BAT failures, and if it indeed doesn't happen, then an annotated isolated lock would guarantee that.
/Thomas
_______________________________________________
Intel-gfx mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/intel-gfx
Re: [Intel-gfx] [PATCH v3 04/63] drm/i915: Pin timeline map after first timeline pin, v3.
Quoted 8 lines · Thomas Hellström (Intel)
Quoted 6 lines
Quoted 5 lines
Quoted 4 lines
+
+ if (WARN_ON(!i915_gem_object_trylock(tl->hwsp_ggtt->obj))) + return-EBUSY;I think we should either annotate this properly as an isolated lock, or allow a silent
-EBUSY.This is done in a controlled selftest where we mock the entire i915 device, so normally this can't happen. :)
But if it does, we get erratic BAT failures, and if it indeed doesn't happen, then an annotated isolated lock would guarantee that.
...but if we can't do that since we're actually not locking isolated, I guess we have to leave it as is. (I presume I can't make you add /* Here we should have needed a i915_do_ww() */ :D)
/Thomas
Quoted 3 lines
/Thomas
_______________________________________________
Intel-gfx mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 5/63 drm/i915: Ensure we hold the object mutex in pin correctly.
In reply to Maarten LankhorstCurrently we have a lot of places where we hold the gem object lock, but haven't yet been converted to the ww dance. Complain loudly about those places.
i915_vma_pin shouldn't have the obj lock held, so we can do a ww dance, while i915_vma_pin_ww should.
--- drivers/gpu/drm/i915/gt/intel_renderstate.c | 2 +- drivers/gpu/drm/i915/i915_vma.c | 11 ++++++++++- drivers/gpu/drm/i915/i915_vma.h | 3 +++ 3 files changed, 14 insertions(+), 2 deletions(-)
drivers/gpu/drm/i915/gt/intel_renderstate.c +1 -1
@@ -196,7 +196,7 @@ int intel_renderstate_init(struct intel_renderstate *so,if (err) goto err_context; - err =i915_vma_pin (so->vma,0 ,0 ,PIN_GLOBAL |PIN_HIGH ); + err =i915_vma_pin_ww (so->vma, &so->ww,0 ,0 ,PIN_GLOBAL |PIN_HIGH );if (err) goto err_context;
drivers/gpu/drm/i915/i915_vma.c +10 -1
@@ -863,6 +863,8 @@ int i915_vma_pin_ww(struct i915_vma *vma, struct i915_gem_ww_ctx *ww,#ifdef CONFIG_PROVE_LOCKING if (debug_locks &&lockdep_is_held (&vma->vm->i915->drm.struct_mutex))WARN_ON (!ww); +if (debug_locks && ww && vma->resv) +assert_vma_held (vma);#endif BUILD_BUG_ON (PIN_GLOBAL !=I915_VMA_GLOBAL_BIND );
@@ -1018,8 +1020,15 @@ int i915_ggtt_pin(struct i915_vma *vma, struct i915_gem_ww_ctx *ww,GEM_BUG_ON (!i915_vma_is_ggtt (vma)); +#ifdef CONFIG_LOCKDEP +WARN_ON (!ww && vma->resv &&dma_resv_held (vma->resv)); +#endif + do { - err = i915_vma_pin_ww(vma, ww, 0, align, flags | PIN_GLOBAL); + if (ww) + err = i915_vma_pin_ww(vma, ww, 0, align, flags | PIN_GLOBAL); + else + err = i915_vma_pin(vma, 0, align, flags | PIN_GLOBAL); if (err != -ENOSPC) { if (!err) { err = i915_vma_wait_for_bind(vma);
drivers/gpu/drm/i915/i915_vma.h +3 -0
@@ -243,6 +243,9 @@ i915_vma_pin_ww(struct i915_vma *vma, struct i915_gem_ww_ctx *ww,static inline int __must_check i915_vma_pin (struct i915_vma *vma,u64 size,u64 alignment,u64 flags) { +#ifdef CONFIG_LOCKDEP +WARN_ON_ONCE (vma->resv &&dma_resv_held (vma->resv)); +#endif return i915_vma_pin_ww (vma,NULL , size, alignment, flags); }
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
Re: [Intel-gfx] [PATCH v3 05/63] drm/i915: Ensure we hold the object mutex in pin correctly.
Quoted 8 lines · Maarten Lankhorst
Currently we have a lot of places where we hold the gem object lock, but haven't yet been converted to the ww dance. Complain loudly about those places.
i915_vma_pinshouldn't have the obj lock held, so we can do a ww dance, whilei915_vma_pin_wwshould.Signed-off-by Maarten Lankhorst <[email protected]>
_______________________________________________
Intel-gfx mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 6/63 drm/i915: Add gem object locking to madvise.
In reply to Maarten LankhorstDoesn't need the full ww lock, only checking if pages are bound.
--- drivers/gpu/drm/i915/i915_gem.c | 8 +++++++- 1 file changed, 7 insertions(+), 1 deletion(-)
drivers/gpu/drm/i915/i915_gem.c +7 -1
@@ -1071,10 +1071,14 @@ i915_gem_madvise_ioctl(struct drm_device *dev, void *data,if (!obj)return -ENOENT ; - err =mutex_lock_interruptible (&obj->mm.lock); + err =i915_gem_object_lock_interruptible (obj,NULL );if (err) goto out; + err =mutex_lock_interruptible (&obj->mm.lock); +if (err) + goto out_ww; +if (i915_gem_object_has_pages (obj) &&i915_gem_object_is_tiled (obj) && i915->quirks &QUIRK_PIN_SWIZZLED_PAGES ) {
@@ -1119,6 +1123,8 @@ i915_gem_madvise_ioctl(struct drm_device *dev, void *data, args->retained = obj->mm.madv != __I915_MADV_PURGED;mutex_unlock (&obj->mm.lock); +out_ww: +i915_gem_object_unlock (obj); out:i915_gem_object_put (obj);return err;
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 7/63 drm/i915: Move HAS_STRUCT_PAGE to obj->flags
In reply to Maarten LankhorstWe want to remove the changing of ops structure for attaching phys pages, so we need to kill off HAS_STRUCT_PAGE from ops->flags, and put it in the bo.
This will remove a potential race of dereferencing the wrong obj->ops without ww mutex held.
--- drivers/gpu/drm/i915/gem/i915_gem_dmabuf.c | 2 +- drivers/gpu/drm/i915/gem/i915_gem_internal.c | 6 +++--- drivers/gpu/drm/i915/gem/i915_gem_lmem.c | 4 ++-- drivers/gpu/drm/i915/gem/i915_gem_mman.c | 7 +++---- drivers/gpu/drm/i915/gem/i915_gem_object.c | 4 +++- drivers/gpu/drm/i915/gem/i915_gem_object.h | 5 +++-- drivers/gpu/drm/i915/gem/i915_gem_object_types.h | 8 +++++--- drivers/gpu/drm/i915/gem/i915_gem_pages.c | 5 ++--- drivers/gpu/drm/i915/gem/i915_gem_phys.c | 2 ++ drivers/gpu/drm/i915/gem/i915_gem_region.c | 4 +--- drivers/gpu/drm/i915/gem/i915_gem_region.h | 3 +-- drivers/gpu/drm/i915/gem/i915_gem_shmem.c | 8 ++++---- drivers/gpu/drm/i915/gem/i915_gem_stolen.c | 4 ++-- drivers/gpu/drm/i915/gem/i915_gem_userptr.c | 6 +++--- drivers/gpu/drm/i915/gem/selftests/huge_gem_object.c | 4 ++-- drivers/gpu/drm/i915/gem/selftests/huge_pages.c | 10 +++++----- drivers/gpu/drm/i915/gem/selftests/i915_gem_mman.c | 11 ++++------- drivers/gpu/drm/i915/gem/selftests/i915_gem_phys.c | 12 ++++++++++++ drivers/gpu/drm/i915/gvt/dmabuf.c | 2 +- drivers/gpu/drm/i915/selftests/i915_gem_gtt.c | 2 +- drivers/gpu/drm/i915/selftests/mock_region.c | 4 ++-- 21 files changed, 62 insertions(+), 51 deletions(-)
drivers/gpu/drm/i915/gem/i915_gem_dmabuf.c +1 -1
@@ -259,7 +259,7 @@ struct drm_gem_object *i915_gem_prime_import(struct drm_device *dev, }drm_gem_private_object_init (dev, &obj->base, dma_buf->size); -i915_gem_object_init (obj, &i915_gem_object_dmabuf_ops, &lock_class); +i915_gem_object_init (obj, &i915_gem_object_dmabuf_ops, &lock_class,0 ); obj->base.import_attach = attach; obj->base.resv = dma_buf->resv;
drivers/gpu/drm/i915/gem/i915_gem_internal.c +3 -3
@@ -138,8 +138,7 @@ static void i915_gem_object_put_pages_internal(struct drm_i915_gem_object *obj,static const struct drm_i915_gem_object_ops i915_gem_object_internal_ops = { .name ="i915_gem_object_internal" , - .flags =I915_GEM_OBJECT_HAS_STRUCT_PAGE | -I915_GEM_OBJECT_IS_SHRINKABLE , + .flags =I915_GEM_OBJECT_IS_SHRINKABLE , .get_pages = i915_gem_object_get_pages_internal, .put_pages = i915_gem_object_put_pages_internal, };
@@ -178,7 +177,8 @@ i915_gem_object_create_internal(struct drm_i915_private *i915,return ERR_PTR (-ENOMEM );drm_gem_private_object_init (&i915->drm, &obj->base, size); -i915_gem_object_init (obj, &i915_gem_object_internal_ops, &lock_class); +i915_gem_object_init (obj, &i915_gem_object_internal_ops, &lock_class, +I915_BO_ALLOC_STRUCT_PAGE );/* * Mark the object as volatile, such that the pages are marked as
drivers/gpu/drm/i915/gem/i915_gem_lmem.c +2 -2
@@ -45,13 +45,13 @@ __i915_gem_lmem_object_create(struct intel_memory_region *mem,return ERR_PTR (-ENOMEM );drm_gem_private_object_init (&i915->drm, &obj->base, size); -i915_gem_object_init (obj, &i915_gem_lmem_obj_ops, &lock_class); +i915_gem_object_init (obj, &i915_gem_lmem_obj_ops, &lock_class, flags); obj->read_domains =I915_GEM_DOMAIN_WC |I915_GEM_DOMAIN_GTT ;i915_gem_object_set_cache_coherency (obj,I915_CACHE_NONE ); -i915_gem_object_init_memory_region (obj, mem, flags); +i915_gem_object_init_memory_region (obj, mem);return obj; }
drivers/gpu/drm/i915/gem/i915_gem_mman.c +3 -4
@@ -251,7 +251,7 @@ static vm_fault_t vm_fault_cpu(struct vm_fault *vmf) goto out; iomap =-1 ; -if (!i915_gem_object_type_has (obj,I915_GEM_OBJECT_HAS_STRUCT_PAGE )) { +if (!i915_gem_object_has_struct_page (obj)) { iomap = obj->mm.region->iomap.base; iomap -= obj->mm.region->region.start; }
@@ -653,9 +653,8 @@ __assign_mmap_offset(struct drm_file *file, }if (mmap_type !=I915_MMAP_TYPE_GTT && - !i915_gem_object_type_has (obj, -I915_GEM_OBJECT_HAS_STRUCT_PAGE | -I915_GEM_OBJECT_HAS_IOMEM )) { + !i915_gem_object_has_struct_page (obj) && + !i915_gem_object_type_has (obj,I915_GEM_OBJECT_HAS_IOMEM )) { err = -ENODEV ; goto out; }
drivers/gpu/drm/i915/gem/i915_gem_object.c +3 -1
@@ -60,7 +60,7 @@ void i915_gem_object_free(struct drm_i915_gem_object *obj)void i915_gem_object_init (struct drm_i915_gem_object *obj,const struct drm_i915_gem_object_ops *ops, -struct lock_class_key *key) +struct lock_class_key *key,unsigned flags) {__mutex_init (&obj->mm.lock, ops->name ?:"obj->mm.lock" , key);
@@ -78,6 +78,8 @@ void i915_gem_object_init(struct drm_i915_gem_object *obj,init_rcu_head (&obj->rcu); obj->ops = ops; +GEM_BUG_ON (flags & ~I915_BO_ALLOC_FLAGS ); + obj->flags = flags; obj->mm.madv =I915_MADV_WILLNEED ;INIT_RADIX_TREE (&obj->mm.get_page.radix,GFP_KERNEL | __GFP_NOWARN);
drivers/gpu/drm/i915/gem/i915_gem_object.h +3 -2
@@ -23,7 +23,8 @@ void i915_gem_object_free(struct drm_i915_gem_object *obj);void i915_gem_object_init (struct drm_i915_gem_object *obj,const struct drm_i915_gem_object_ops *ops, -struct lock_class_key *key); +struct lock_class_key *key, +unsigned alloc_flags);struct drm_i915_gem_object *i915_gem_object_create_shmem (struct drm_i915_private *i915,resource_size_t size);
@@ -197,7 +198,7 @@ i915_gem_object_type_has(const struct drm_i915_gem_object *obj,static inline bool i915_gem_object_has_struct_page (const struct drm_i915_gem_object *obj) { -return i915_gem_object_type_has (obj,I915_GEM_OBJECT_HAS_STRUCT_PAGE ); +return obj->flags &I915_BO_ALLOC_STRUCT_PAGE ; } static inline bool
drivers/gpu/drm/i915/gem/i915_gem_object_types.h +5 -3
@@ -30,7 +30,6 @@ struct i915_lut_handle {struct drm_i915_gem_object_ops {unsigned int flags; -#define I915_GEM_OBJECT_HAS_STRUCT_PAGE BIT(0)#define I915_GEM_OBJECT_HAS_IOMEM BIT(1)#define I915_GEM_OBJECT_IS_SHRINKABLE BIT(2)#define I915_GEM_OBJECT_IS_PROXY BIT(3)
@@ -163,8 +162,11 @@ struct drm_i915_gem_object {unsigned long flags;#define I915_BO_ALLOC_CONTIGUOUS BIT(0)#define I915_BO_ALLOC_VOLATILE BIT(1) -#define I915_BO_ALLOC_FLAGS (I915_BO_ALLOC_CONTIGUOUS | I915_BO_ALLOC_VOLATILE) -#define I915_BO_READONLY BIT(2) +#define I915_BO_ALLOC_STRUCT_PAGE BIT(2) +#define I915_BO_ALLOC_FLAGS (I915_BO_ALLOC_CONTIGUOUS | \ + I915_BO_ALLOC_VOLATILE | \ + I915_BO_ALLOC_STRUCT_PAGE) +#define I915_BO_READONLY BIT(3)/* * Is the object to be mapped as read-only to the GPU
drivers/gpu/drm/i915/gem/i915_gem_pages.c +2 -3
@@ -346,13 +346,12 @@ void *i915_gem_object_pin_map(struct drm_i915_gem_object *obj, enum i915_map_type type) {enum i915_map_type has_type; -unsigned int flags;bool pinned;void *ptr;int err; - flags =I915_GEM_OBJECT_HAS_STRUCT_PAGE |I915_GEM_OBJECT_HAS_IOMEM ; -if (!i915_gem_object_type_has (obj, flags)) +if (!i915_gem_object_has_struct_page (obj) && + !i915_gem_object_type_has (obj,I915_GEM_OBJECT_HAS_IOMEM ))return ERR_PTR (-ENXIO ); err =mutex_lock_interruptible_nested (&obj->mm.lock,I915_MM_GET_PAGES );
drivers/gpu/drm/i915/gem/i915_gem_phys.c +2 -0
@@ -185,6 +185,7 @@ int i915_gem_object_attach_phys(struct drm_i915_gem_object *obj, int align) pages =__i915_gem_object_unset_pages (obj); obj->ops = &i915_gem_phys_ops; + obj->flags &= ~I915_BO_ALLOC_STRUCT_PAGE ; err =____i915_gem_object_get_pages (obj);if (err)
@@ -203,6 +204,7 @@ int i915_gem_object_attach_phys(struct drm_i915_gem_object *obj, int align) err_xfer: obj->ops = &i915_gem_shmem_ops; + obj->flags |=I915_BO_ALLOC_STRUCT_PAGE ;if (!IS_ERR_OR_NULL (pages)) {unsigned int sg_page_sizes =i915_sg_page_sizes (pages->sgl);
drivers/gpu/drm/i915/gem/i915_gem_region.c +1 -3
@@ -102,13 +102,11 @@ i915_gem_object_get_pages_buddy(struct drm_i915_gem_object *obj) }void i915_gem_object_init_memory_region (struct drm_i915_gem_object *obj, -struct intel_memory_region *mem, -unsigned long flags) +struct intel_memory_region *mem) {INIT_LIST_HEAD (&obj->mm.blocks); obj->mm.region =intel_memory_region_get (mem); - obj->flags |= flags;if (obj->base.size <= mem->min_page_size) obj->flags |=I915_BO_ALLOC_CONTIGUOUS ;
drivers/gpu/drm/i915/gem/i915_gem_region.h +1 -2
@@ -17,8 +17,7 @@ void i915_gem_object_put_pages_buddy(struct drm_i915_gem_object *obj, struct sg_table *pages);void i915_gem_object_init_memory_region (struct drm_i915_gem_object *obj, -struct intel_memory_region *mem, -unsigned long flags); +struct intel_memory_region *mem);void i915_gem_object_release_memory_region (struct drm_i915_gem_object *obj); struct drm_i915_gem_object *
drivers/gpu/drm/i915/gem/i915_gem_shmem.c +4 -4
@@ -430,8 +430,7 @@ static void shmem_release(struct drm_i915_gem_object *obj)const struct drm_i915_gem_object_ops i915_gem_shmem_ops = { .name ="i915_gem_object_shmem" , - .flags =I915_GEM_OBJECT_HAS_STRUCT_PAGE | -I915_GEM_OBJECT_IS_SHRINKABLE , + .flags =I915_GEM_OBJECT_IS_SHRINKABLE , .get_pages = shmem_get_pages, .put_pages = shmem_put_pages,
@@ -496,7 +495,8 @@ create_shmem(struct intel_memory_region *mem,mapping_set_gfp_mask (mapping, mask);GEM_BUG_ON (!(mapping_gfp_mask (mapping) & __GFP_RECLAIM)); -i915_gem_object_init (obj, &i915_gem_shmem_ops, &lock_class); +i915_gem_object_init (obj, &i915_gem_shmem_ops, &lock_class, +I915_BO_ALLOC_STRUCT_PAGE ); obj->write_domain =I915_GEM_DOMAIN_CPU ; obj->read_domains =I915_GEM_DOMAIN_CPU ;
@@ -520,7 +520,7 @@ create_shmem(struct intel_memory_region *mem,i915_gem_object_set_cache_coherency (obj, cache_level); -i915_gem_object_init_memory_region (obj, mem,0 ); +i915_gem_object_init_memory_region (obj, mem);return obj;
drivers/gpu/drm/i915/gem/i915_gem_stolen.c +2 -2
@@ -586,7 +586,7 @@ __i915_gem_object_create_stolen(struct intel_memory_region *mem, goto err;drm_gem_private_object_init (&mem->i915->drm, &obj->base, stolen->size); -i915_gem_object_init (obj, &i915_gem_object_stolen_ops, &lock_class); +i915_gem_object_init (obj, &i915_gem_object_stolen_ops, &lock_class,0 ); obj->stolen = stolen; obj->read_domains =I915_GEM_DOMAIN_CPU |I915_GEM_DOMAIN_GTT ;
@@ -597,7 +597,7 @@ __i915_gem_object_create_stolen(struct intel_memory_region *mem,if (err) goto cleanup; -i915_gem_object_init_memory_region (obj, mem,0 ); +i915_gem_object_init_memory_region (obj, mem);return obj;
drivers/gpu/drm/i915/gem/i915_gem_userptr.c +3 -3
@@ -702,8 +702,7 @@ i915_gem_userptr_dmabuf_export(struct drm_i915_gem_object *obj)static const struct drm_i915_gem_object_ops i915_gem_userptr_ops = { .name ="i915_gem_object_userptr" , - .flags =I915_GEM_OBJECT_HAS_STRUCT_PAGE | -I915_GEM_OBJECT_IS_SHRINKABLE | + .flags =I915_GEM_OBJECT_IS_SHRINKABLE |I915_GEM_OBJECT_NO_MMAP |I915_GEM_OBJECT_ASYNC_CANCEL , .get_pages = i915_gem_userptr_get_pages,
@@ -810,7 +809,8 @@ i915_gem_userptr_ioctl(struct drm_device *dev,return -ENOMEM ;drm_gem_private_object_init (dev, &obj->base, args->user_size); -i915_gem_object_init (obj, &i915_gem_userptr_ops, &lock_class); +i915_gem_object_init (obj, &i915_gem_userptr_ops, &lock_class, +I915_BO_ALLOC_STRUCT_PAGE ); obj->read_domains =I915_GEM_DOMAIN_CPU ; obj->write_domain =I915_GEM_DOMAIN_CPU ;i915_gem_object_set_cache_coherency (obj,I915_CACHE_LLC );
drivers/gpu/drm/i915/gem/selftests/huge_gem_object.c +2 -2
@@ -89,7 +89,6 @@ static void huge_put_pages(struct drm_i915_gem_object *obj,static const struct drm_i915_gem_object_ops huge_ops = { .name ="huge-gem" , - .flags =I915_GEM_OBJECT_HAS_STRUCT_PAGE , .get_pages = huge_get_pages, .put_pages = huge_put_pages, };
@@ -115,7 +114,8 @@ huge_gem_object(struct drm_i915_private *i915,return ERR_PTR (-ENOMEM );drm_gem_private_object_init (&i915->drm, &obj->base, dma_size); -i915_gem_object_init (obj, &huge_ops, &lock_class); +i915_gem_object_init (obj, &huge_ops, &lock_class, +I915_BO_ALLOC_STRUCT_PAGE ); obj->read_domains =I915_GEM_DOMAIN_CPU ; obj->write_domain =I915_GEM_DOMAIN_CPU ;
drivers/gpu/drm/i915/gem/selftests/huge_pages.c +5 -5
@@ -140,8 +140,7 @@ static void put_huge_pages(struct drm_i915_gem_object *obj,static const struct drm_i915_gem_object_ops huge_page_ops = { .name ="huge-gem" , - .flags =I915_GEM_OBJECT_HAS_STRUCT_PAGE | -I915_GEM_OBJECT_IS_SHRINKABLE , + .flags =I915_GEM_OBJECT_IS_SHRINKABLE , .get_pages = get_huge_pages, .put_pages = put_huge_pages, };
@@ -168,7 +167,8 @@ huge_pages_object(struct drm_i915_private *i915,return ERR_PTR (-ENOMEM );drm_gem_private_object_init (&i915->drm, &obj->base, size); -i915_gem_object_init (obj, &huge_page_ops, &lock_class); +i915_gem_object_init (obj, &huge_page_ops, &lock_class, +I915_BO_ALLOC_STRUCT_PAGE );i915_gem_object_set_volatile (obj);
@@ -319,9 +319,9 @@ fake_huge_pages_object(struct drm_i915_private *i915, u64 size, bool single)drm_gem_private_object_init (&i915->drm, &obj->base, size);if (single) -i915_gem_object_init (obj, &fake_ops_single, &lock_class); +i915_gem_object_init (obj, &fake_ops_single, &lock_class,0 );else -i915_gem_object_init (obj, &fake_ops, &lock_class); +i915_gem_object_init (obj, &fake_ops, &lock_class,0 );i915_gem_object_set_volatile (obj);
drivers/gpu/drm/i915/gem/selftests/i915_gem_mman.c +4 -7
@@ -834,9 +834,8 @@ static bool can_mmap(struct drm_i915_gem_object *obj, enum i915_mmap_type type)return false;if (type !=I915_MMAP_TYPE_GTT && - !i915_gem_object_type_has (obj, -I915_GEM_OBJECT_HAS_STRUCT_PAGE | -I915_GEM_OBJECT_HAS_IOMEM )) + !i915_gem_object_has_struct_page (obj) && + !i915_gem_object_type_has (obj,I915_GEM_OBJECT_HAS_IOMEM ))return false;return true;
@@ -976,10 +975,8 @@ static const char *repr_mmap_type(enum i915_mmap_type type)static bool can_access (const struct drm_i915_gem_object *obj) { -unsigned int flags = -I915_GEM_OBJECT_HAS_STRUCT_PAGE |I915_GEM_OBJECT_HAS_IOMEM ; - -return i915_gem_object_type_has (obj, flags); +return i915_gem_object_has_struct_page (obj) || +i915_gem_object_type_has (obj,I915_GEM_OBJECT_HAS_IOMEM ); } static int __igt_mmap_access(struct drm_i915_private *i915,
drivers/gpu/drm/i915/gem/selftests/i915_gem_phys.c +12 -0
@@ -25,12 +25,24 @@ static int mock_phys_object(void *arg) goto out; } +if (!i915_gem_object_has_struct_page (obj)) { + err = -EINVAL ; +pr_err ("shmem has no struct page\n" ); + goto out_obj; + } + err =i915_gem_object_attach_phys (obj,PAGE_SIZE );if (err) {pr_err ("i915_gem_object_attach_phys failed, err=%d\n" , err); goto out_obj; } +if (i915_gem_object_has_struct_page (obj)) { + err = -EINVAL ; +pr_err ("shmem has a struct page\n" ); + goto out_obj; + } +if (obj->ops != &i915_gem_phys_ops) {pr_err ("i915_gem_object_attach_phys did not create a phys object\n" ); err = -EINVAL ;
drivers/gpu/drm/i915/gvt/dmabuf.c +1 -1
@@ -218,7 +218,7 @@ static struct drm_i915_gem_object *vgpu_create_gem(struct drm_device *dev,drm_gem_private_object_init (dev, &obj->base,roundup (info->size,PAGE_SIZE )); -i915_gem_object_init (obj, &intel_vgpu_gem_ops, &lock_class); +i915_gem_object_init (obj, &intel_vgpu_gem_ops, &lock_class,0 );i915_gem_object_set_readonly (obj); obj->read_domains =I915_GEM_DOMAIN_GTT ;
drivers/gpu/drm/i915/selftests/i915_gem_gtt.c +1 -1
@@ -120,7 +120,7 @@ fake_dma_object(struct drm_i915_private *i915, u64 size) goto err;drm_gem_private_object_init (&i915->drm, &obj->base, size); -i915_gem_object_init (obj, &fake_ops, &lock_class); +i915_gem_object_init (obj, &fake_ops, &lock_class,0 );i915_gem_object_set_volatile (obj);
drivers/gpu/drm/i915/selftests/mock_region.c +2 -2
@@ -32,13 +32,13 @@ mock_object_create(struct intel_memory_region *mem,return ERR_PTR (-ENOMEM );drm_gem_private_object_init (&i915->drm, &obj->base, size); -i915_gem_object_init (obj, &mock_region_obj_ops, &lock_class); +i915_gem_object_init (obj, &mock_region_obj_ops, &lock_class, flags); obj->read_domains =I915_GEM_DOMAIN_CPU |I915_GEM_DOMAIN_GTT ;i915_gem_object_set_cache_coherency (obj,I915_CACHE_NONE ); -i915_gem_object_init_memory_region (obj, mem, flags); +i915_gem_object_init_memory_region (obj, mem);return obj; }
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 8/63 drm/i915: Rework struct phys attachment handling
In reply to Maarten LankhorstInstead of creating a separate object type, we make changes to the shmem type, to clear struct page backing. This will allow us to ensure we never run into a race when we exchange obj->ops with other function pointers.
--- drivers/gpu/drm/i915/gem/i915_gem_object.h | 3 + drivers/gpu/drm/i915/gem/i915_gem_phys.c | 91 ++++++++++--------- drivers/gpu/drm/i915/gem/i915_gem_shmem.c | 8 +- .../drm/i915/gem/selftests/i915_gem_phys.c | 6 -- 4 files changed, 56 insertions(+), 52 deletions(-)
drivers/gpu/drm/i915/gem/i915_gem_object.h +3 -0
@@ -38,6 +38,9 @@ void __i915_gem_object_release_shmem(struct drm_i915_gem_object *obj, bool needs_clflush);int i915_gem_object_attach_phys (struct drm_i915_gem_object *obj,int align); +void i915_gem_object_put_pages_phys (struct drm_i915_gem_object *obj, +struct sg_table *pages); +void i915_gem_flush_free_objects (struct drm_i915_private *i915);
drivers/gpu/drm/i915/gem/i915_gem_phys.c +46 -45
142 lines not on this page · raw message
drivers/gpu/drm/i915/gem/i915_gem_shmem.c +7 -1
@@ -303,6 +303,11 @@ shmem_put_pages(struct drm_i915_gem_object *obj, struct sg_table *pages)struct pagevec pvec;struct page *page; +if (unlikely (!i915_gem_object_has_struct_page (obj))) { +i915_gem_object_put_pages_phys (obj, pages); +return ; + } +__i915_gem_object_release_shmem (obj, pages, true);i915_gem_gtt_finish_pages (obj, pages);
@@ -423,7 +428,8 @@ shmem_pwrite(struct drm_i915_gem_object *obj,static void shmem_release (struct drm_i915_gem_object *obj) { -i915_gem_object_release_memory_region (obj); +if (obj->flags &I915_BO_ALLOC_STRUCT_PAGE ) +i915_gem_object_release_memory_region (obj);fput (obj->base.filp); }
drivers/gpu/drm/i915/gem/selftests/i915_gem_phys.c +0 -6
@@ -38,12 +38,6 @@ static int mock_phys_object(void *arg) }if (i915_gem_object_has_struct_page (obj)) { - err = -EINVAL ; -pr_err ("shmem has a struct page\n" ); - goto out_obj; - } - -if (obj->ops != &i915_gem_phys_ops) {pr_err ("i915_gem_object_attach_phys did not create a phys object\n" ); err = -EINVAL ; goto out_obj;
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 9/63 drm/i915: Convert i915_gem_object_attach_phys() to ww locking
In reply to Maarten LankhorstSimple adding of i915_gem_object_lock, we may start to pass ww to get_pages() in the future, but that won't be the case here; We override shmem's get_pages() handling by calling i915_gem_object_get_pages_phys(), no ww is needed.
--- drivers/gpu/drm/i915/gem/i915_gem_phys.c | 10 +++++++++- 1 file changed, 9 insertions(+), 1 deletion(-)
drivers/gpu/drm/i915/gem/i915_gem_phys.c +9 -1
@@ -182,7 +182,13 @@ int i915_gem_object_attach_phys(struct drm_i915_gem_object *obj, int align)if (err)return err; -mutex_lock_nested (&obj->mm.lock,I915_MM_GET_PAGES ); + err =i915_gem_object_lock_interruptible (obj,NULL ); +if (err) +return err; + + err =mutex_lock_interruptible_nested (&obj->mm.lock,I915_MM_GET_PAGES ); +if (err) + goto err_unlock;if (unlikely (!i915_gem_object_has_struct_page (obj))) goto out;
@@ -213,6 +219,8 @@ int i915_gem_object_attach_phys(struct drm_i915_gem_object *obj, int align) out:mutex_unlock (&obj->mm.lock); +err_unlock: +i915_gem_object_unlock (obj);return err; }
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 10/63 drm/i915: make lockdep slightly happier about execbuf.
In reply to Maarten LankhorstAs soon as we install fences, we should stop allocating memory in order to prevent any potential deadlocks.
This is required later on, when we start adding support for dma-fence annotations.
--- .../gpu/drm/i915/gem/i915_gem_execbuffer.c | 24 ++++++++++++++----- drivers/gpu/drm/i915/i915_active.c | 20 ++++++++-------- drivers/gpu/drm/i915/i915_vma.c | 8 ++++--- drivers/gpu/drm/i915/i915_vma.h | 3 +++ 4 files changed, 36 insertions(+), 19 deletions(-)
drivers/gpu/drm/i915/gem/i915_gem_execbuffer.c +18 -6
@@ -49,11 +49,12 @@ enum {#define DBG_FORCE_RELOC 0/* choose one of the above! */ }; -#define __EXEC_OBJECT_HAS_PIN BIT(31) -#define __EXEC_OBJECT_HAS_FENCE BIT(30) -#define __EXEC_OBJECT_NEEDS_MAP BIT(29) -#define __EXEC_OBJECT_NEEDS_BIAS BIT(28) -#define __EXEC_OBJECT_INTERNAL_FLAGS (~0u << 28)/* all of the above */ +/* __EXEC_OBJECT_NO_RESERVE is BIT(31), defined in i915_vma.h */ +#define __EXEC_OBJECT_HAS_PIN BIT(30) +#define __EXEC_OBJECT_HAS_FENCE BIT(29) +#define __EXEC_OBJECT_NEEDS_MAP BIT(28) +#define __EXEC_OBJECT_NEEDS_BIAS BIT(27) +#define __EXEC_OBJECT_INTERNAL_FLAGS (~0u << 27)/* all of the above + */ #define __EXEC_OBJECT_RESERVED (__EXEC_OBJECT_HAS_PIN | __EXEC_OBJECT_HAS_FENCE)#define __EXEC_HAS_RELOC BIT(31)
@@ -925,6 +926,12 @@ static int eb_validate_vmas(struct i915_execbuffer *eb) } } +if (!(ev->flags &EXEC_OBJECT_WRITE )) { + err =dma_resv_reserve_shared (vma->resv,1 ); +if (err) +return err; + } +GEM_BUG_ON (drm_mm_node_allocated (&vma->node) &&eb_vma_misplaced (&eb->exec[i], vma, ev->flags)); }
@@ -2190,7 +2197,8 @@ static int eb_move_to_gpu(struct i915_execbuffer *eb) }if (err ==0 ) - err =i915_vma_move_to_active (vma, eb->request, flags); + err =i915_vma_move_to_active (vma, eb->request, + flags | __EXEC_OBJECT_NO_RESERVE); }if (unlikely (err))
@@ -2442,6 +2450,10 @@ static int eb_parse_pipeline(struct i915_execbuffer *eb,if (err) goto err_commit; + err =dma_resv_reserve_shared (shadow->resv,1 ); +if (err) + goto err_commit; +/* Wait for all writes (and relocs) into the batch to complete */ err = i915_sw_fence_await_reservation(&pw->base.chain, pw->batch->resv, NULL, false,
drivers/gpu/drm/i915/i915_active.c +10 -10
@@ -296,18 +296,13 @@ static struct active_node *__active_lookup(struct i915_active *ref, u64 idx)static struct i915_active_fence *active_instance (struct i915_active *ref,u64 idx) { -struct active_node *node, *prealloc; +struct active_node *node;struct rb_node **p, *parent; node =__active_lookup (ref, idx);if (likely (node))return &node->base; -/* Preallocate a replacement, just in case */ - prealloc =kmem_cache_alloc (global.slab_cache,GFP_KERNEL ); -if (!prealloc) -return NULL ; -spin_lock_irq (&ref->tree_lock);GEM_BUG_ON (i915_active_is_idle (ref));
@@ -317,10 +312,8 @@ active_instance(struct i915_active *ref, u64 idx) parent = *p; node = rb_entry(parent, struct active_node, node); -if (node->timeline == idx) { -kmem_cache_free (global.slab_cache, prealloc); +if (node->timeline == idx) goto out; - }if (node->timeline < idx) p = &parent->rb_right;
@@ -328,7 +321,14 @@ active_instance(struct i915_active *ref, u64 idx) p = &parent->rb_left; } - node = prealloc; +/* +* XXX: We should preallocate this before i915_active_ref() is ever +* called, but we cannot call into fs_reclaim() anyway, so use GFP_ATOMIC. +*/ + node =kmem_cache_alloc (global.slab_cache,GFP_ATOMIC ); +if (!node) + goto out; +__i915_active_fence_init (&node->base,NULL , node_retire); node->ref = ref; node->timeline = idx;
drivers/gpu/drm/i915/i915_vma.c +5 -3
@@ -1245,9 +1245,11 @@ int i915_vma_move_to_active(struct i915_vma *vma, obj->write_domain =I915_GEM_DOMAIN_RENDER ; obj->read_domains =0 ; }else { - err =dma_resv_reserve_shared (vma->resv,1 ); -if (unlikely (err)) -return err; +if (!(flags & __EXEC_OBJECT_NO_RESERVE)) { + err =dma_resv_reserve_shared (vma->resv,1 ); +if (unlikely (err)) +return err; + }dma_resv_add_shared_fence (vma->resv, &rq->fence); obj->write_domain =0 ;
drivers/gpu/drm/i915/i915_vma.h +3 -0
@@ -52,6 +52,9 @@ static inline bool i915_vma_is_active(const struct i915_vma *vma)return !i915_active_is_idle (&vma->active); } +/* do not reserve memory to prevent deadlocks */ +#define __EXEC_OBJECT_NO_RESERVE BIT(31) +int __must_check __i915_vma_move_to_active (struct i915_vma *vma,struct i915_request *rq); int __must_check i915_vma_move_to_active(struct i915_vma *vma,
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 11/63 drm/i915: Disable userptr pread/pwrite support.
In reply to Maarten LankhorstUserptr should not need the kernel for a userspace memcpy, userspace needs to call memcpy directly.
--- .../gpu/drm/i915/gem/i915_gem_object_types.h | 2 ++ drivers/gpu/drm/i915/gem/i915_gem_userptr.c | 20 +++++++++++++++++++ drivers/gpu/drm/i915/i915_gem.c | 5 +++++ 3 files changed, 27 insertions(+)
drivers/gpu/drm/i915/gem/i915_gem_object_types.h +2 -0
@@ -57,6 +57,8 @@ struct drm_i915_gem_object_ops {int (*pwrite)(struct drm_i915_gem_object *obj,const struct drm_i915_gem_pwrite *arg); +int (*pread)(struct drm_i915_gem_object *obj, +const struct drm_i915_gem_pread *arg);int (*dmabuf_export)(struct drm_i915_gem_object *obj);void (*release)(struct drm_i915_gem_object *obj);
drivers/gpu/drm/i915/gem/i915_gem_userptr.c +20 -0
@@ -700,6 +700,24 @@ i915_gem_userptr_dmabuf_export(struct drm_i915_gem_object *obj)return i915_gem_userptr_init__mmu_notifier (obj,0 ); } +static int +i915_gem_userptr_pwrite (struct drm_i915_gem_object *obj, +const struct drm_i915_gem_pwrite *args) +{ +drm_dbg (obj->base.dev,"pwrite to userptr no longer allowed\n" ); + +return -EINVAL ; +} + +static int +i915_gem_userptr_pread (struct drm_i915_gem_object *obj, +const struct drm_i915_gem_pread *args) +{ +drm_dbg (obj->base.dev,"pread from userptr no longer allowed\n" ); + +return -EINVAL ; +} +static const struct drm_i915_gem_object_ops i915_gem_userptr_ops = { .name ="i915_gem_object_userptr" , .flags = I915_GEM_OBJECT_IS_SHRINKABLE |
@@ -708,6 +726,8 @@ static const struct drm_i915_gem_object_ops i915_gem_userptr_ops = { .get_pages = i915_gem_userptr_get_pages, .put_pages = i915_gem_userptr_put_pages, .dmabuf_export = i915_gem_userptr_dmabuf_export, + .pwrite = i915_gem_userptr_pwrite, + .pread = i915_gem_userptr_pread, .release = i915_gem_userptr_release, };
drivers/gpu/drm/i915/i915_gem.c +5 -0
@@ -526,6 +526,11 @@ i915_gem_pread_ioctl(struct drm_device *dev, void *data, }trace_i915_gem_object_pread (obj, args->offset, args->size); + ret = -ENODEV ; +if (obj->ops->pread) + ret = obj->ops->pread (obj, args); +if (ret != -ENODEV ) + goto out; ret = i915_gem_object_wait(obj, I915_WAIT_INTERRUPTIBLE,
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 12/63 drm/i915: No longer allow exporting userptr through dma-buf
In reply to Maarten LankhorstIt doesn't make sense to export a memory address, we will prevent allowing access this way to different address spaces when we rework userptr handling, so best to explicitly disable it.
--- drivers/gpu/drm/i915/gem/i915_gem_userptr.c | 5 ++--- 1 file changed, 2 insertions(+), 3 deletions(-)
drivers/gpu/drm/i915/gem/i915_gem_userptr.c +2 -3
@@ -694,10 +694,9 @@ i915_gem_userptr_release(struct drm_i915_gem_object *obj)static int i915_gem_userptr_dmabuf_export (struct drm_i915_gem_object *obj) { -if (obj->userptr.mmu_object) -return 0 ; +drm_dbg (obj->base.dev,"Exporting userptr no longer allowed\n" ); -return i915_gem_userptr_init__mmu_notifier (obj,0 ); +return -EINVAL ; } static int
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 13/63 drm/i915: Reject more ioctls for userptr
In reply to Maarten LankhorstAllow set_domain to fail silently, waiting for idle should be good enough. set_tiling and set_caching are rejected with -ENXIO, there's no valid reason to allow it.
--- drivers/gpu/drm/i915/display/intel_display.c | 2 +- drivers/gpu/drm/i915/gem/i915_gem_domain.c | 4 +++- drivers/gpu/drm/i915/gem/i915_gem_object.h | 6 ++++++ drivers/gpu/drm/i915/gem/i915_gem_userptr.c | 3 ++- 4 files changed, 12 insertions(+), 3 deletions(-)
drivers/gpu/drm/i915/display/intel_display.c +1 -1
@@ -17357,7 +17357,7 @@ static int intel_user_framebuffer_create_handle(struct drm_framebuffer *fb,struct drm_i915_gem_object *obj =intel_fb_obj (fb);struct drm_i915_private *i915 =to_i915 (obj->base.dev); -if (obj->userptr.mm) { +if (i915_gem_object_is_userptr (obj)) {drm_dbg (&i915->drm,"attempting to use a userptr for a framebuffer, denied\n" );return -EINVAL ;
drivers/gpu/drm/i915/gem/i915_gem_domain.c +3 -1
@@ -543,7 +543,9 @@ i915_gem_set_domain_ioctl(struct drm_device *dev, void *data,* considered to be outside of any cache domain. */ if (i915_gem_object_is_proxy (obj)) { - err = -ENXIO ; +/* silently allow userptr to complete */ +if (!i915_gem_object_is_userptr (obj)) + err = -ENXIO ; goto out; }
drivers/gpu/drm/i915/gem/i915_gem_object.h +6 -0
@@ -528,6 +528,12 @@ void __i915_gem_object_flush_frontbuffer(struct drm_i915_gem_object *obj,void __i915_gem_object_invalidate_frontbuffer (struct drm_i915_gem_object *obj,enum fb_op_origin origin); +static inline bool +i915_gem_object_is_userptr (struct drm_i915_gem_object *obj) +{ +return obj->userptr.mm; +} +static inline void i915_gem_object_flush_frontbuffer (struct drm_i915_gem_object *obj,enum fb_op_origin origin)
drivers/gpu/drm/i915/gem/i915_gem_userptr.c +2 -1
@@ -721,7 +721,8 @@ static const struct drm_i915_gem_object_ops i915_gem_userptr_ops = { .name = "i915_gem_object_userptr", .flags =I915_GEM_OBJECT_IS_SHRINKABLE |I915_GEM_OBJECT_NO_MMAP | - I915_GEM_OBJECT_ASYNC_CANCEL, +I915_GEM_OBJECT_ASYNC_CANCEL | + I915_GEM_OBJECT_IS_PROXY, .get_pages = i915_gem_userptr_get_pages, .put_pages = i915_gem_userptr_put_pages, .dmabuf_export = i915_gem_userptr_dmabuf_export,
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 14/63 drm/i915: Reject UNSYNCHRONIZED for userptr
In reply to Maarten LankhorstWe should not allow this any more, as it will break with the new userptr implementation, it could still be made to work, but there's no point in doing so.
--- .../gpu/drm/i915/gem/i915_gem_execbuffer.c | 2 + drivers/gpu/drm/i915/gem/i915_gem_object.h | 4 ++ .../gpu/drm/i915/gem/i915_gem_object_types.h | 2 + drivers/gpu/drm/i915/gem/i915_gem_userptr.c | 64 ++++++------------- drivers/gpu/drm/i915/i915_drv.h | 2 + 5 files changed, 31 insertions(+), 43 deletions(-)
drivers/gpu/drm/i915/gem/i915_gem_execbuffer.c +2 -0
@@ -1966,8 +1966,10 @@ static noinline int eb_relocate_parse_slow(struct i915_execbuffer *eb, err =0 ; } +#ifdef CONFIG_MMU_NOTIFIER if (!err)flush_workqueue (eb->i915->mm.userptr_wq); +#endif err_relock:i915_gem_ww_ctx_init (&eb->ww, true);
drivers/gpu/drm/i915/gem/i915_gem_object.h +4 -0
@@ -531,7 +531,11 @@ void __i915_gem_object_invalidate_frontbuffer(struct drm_i915_gem_object *obj,static inline bool i915_gem_object_is_userptr (struct drm_i915_gem_object *obj) { +#ifdef CONFIG_MMU_NOTIFIER return obj->userptr.mm; +#else +return false; +#endif } static inline void
drivers/gpu/drm/i915/gem/i915_gem_object_types.h +2 -0
@@ -289,6 +289,7 @@ struct drm_i915_gem_object {unsigned long *bit_17; union { +#ifdef CONFIG_MMU_NOTIFIER struct i915_gem_userptr { uintptr_t ptr;
@@ -296,6 +297,7 @@ struct drm_i915_gem_object {struct i915_mmu_object *mmu_object; struct work_struct *work; } userptr; +#endif unsigned long scratch;u64 encode;
drivers/gpu/drm/i915/gem/i915_gem_userptr.c +21 -43
145 lines not on this page · raw message
drivers/gpu/drm/i915/i915_drv.h +2 -0
@@ -589,12 +589,14 @@ struct i915_gem_mm {struct notifier_block vmap_notifier;struct shrinker shrinker; +#ifdef CONFIG_MMU_NOTIFIER /** * Workqueue to fault in userptr pages, flushed by the execbuf * when required but otherwise left to userspace to try again * on EAGAIN. */ struct workqueue_struct *userptr_wq; +#endif /* shrinker accounting, also useful for userland debugging */ u64 shrink_memory;
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 15/63 drm/i915: Fix userptr so we do not have to worry about obj->mm.lock, v3.
In reply to Maarten LankhorstInstead of doing what we do currently, which will never work with PROVE_LOCKING, do the same as AMD does, and something similar to relocation slowpath. When all locks are dropped, we acquire the pages for pinning. When the locks are taken, we transfer those pages in .get_pages() to the bo. As a final check before installing the fences, we ensure that the mmu notifier was not called; if it is, we return -EAGAIN to userspace to signal it has to start over.
Changes since v1:
- Unbinding is done in submit_init only. submit_begin() removed.
- MMU_NOTFIER -> MMU_NOTIFIER
Changes since v2:
- Make i915->mm.notifier a spinlock.
--- .../gpu/drm/i915/gem/i915_gem_execbuffer.c | 94 ++- drivers/gpu/drm/i915/gem/i915_gem_object.h | 35 +- .../gpu/drm/i915/gem/i915_gem_object_types.h | 10 +- drivers/gpu/drm/i915/gem/i915_gem_pages.c | 2 +- drivers/gpu/drm/i915/gem/i915_gem_userptr.c | 759 +++++------------- drivers/gpu/drm/i915/i915_drv.h | 9 +- drivers/gpu/drm/i915/i915_gem.c | 5 +- 7 files changed, 327 insertions(+), 587 deletions(-)
drivers/gpu/drm/i915/gem/i915_gem_execbuffer.c +81 -13
@@ -52,14 +52,16 @@ enum {/* __EXEC_OBJECT_NO_RESERVE is BIT(31), defined in i915_vma.h */ #define __EXEC_OBJECT_HAS_PIN BIT(30)#define __EXEC_OBJECT_HAS_FENCE BIT(29) -#define __EXEC_OBJECT_NEEDS_MAP BIT(28) -#define __EXEC_OBJECT_NEEDS_BIAS BIT(27) -#define __EXEC_OBJECT_INTERNAL_FLAGS (~0u << 27)/* all of the above + */ +#define __EXEC_OBJECT_USERPTR_INIT BIT(28) +#define __EXEC_OBJECT_NEEDS_MAP BIT(27) +#define __EXEC_OBJECT_NEEDS_BIAS BIT(26) +#define __EXEC_OBJECT_INTERNAL_FLAGS (~0u << 26)/* all of the above + */ #define __EXEC_OBJECT_RESERVED (__EXEC_OBJECT_HAS_PIN | __EXEC_OBJECT_HAS_FENCE)#define __EXEC_HAS_RELOC BIT(31)#define __EXEC_ENGINE_PINNED BIT(30) -#define __EXEC_INTERNAL_FLAGS (~0u << 30) +#define __EXEC_USERPTR_USED BIT(29) +#define __EXEC_INTERNAL_FLAGS (~0u << 29)#define UPDATE PIN_OFFSET_FIXED#define BATCH_OFFSET_BIAS (256*1024)
@@ -865,6 +867,19 @@ static int eb_lookup_vmas(struct i915_execbuffer *eb) }eb_add_vma (eb, i, batch, vma); + +if (i915_gem_object_is_userptr (vma->obj)) { + err =i915_gem_object_userptr_submit_init (vma->obj); +if (err) { +if (i +1 < eb->buffer_count) + eb->vma[i +1 ].vma =NULL ; + +return err; + } + + eb->vma[i].flags |= __EXEC_OBJECT_USERPTR_INIT; + eb->args->flags |= __EXEC_USERPTR_USED; + } }if (unlikely (eb->batch->flags &EXEC_OBJECT_WRITE )) {
@@ -962,7 +977,7 @@ eb_get_vma(const struct i915_execbuffer *eb, unsigned long handle) } } -static void eb_release_vmas (struct i915_execbuffer *eb,bool final) +static void eb_release_vmas (struct i915_execbuffer *eb,bool final,bool release_userptr) {const unsigned int count = eb->buffer_count;unsigned int i;
@@ -976,6 +991,11 @@ static void eb_release_vmas(struct i915_execbuffer *eb, bool final)eb_unreserve_vma (ev); +if (release_userptr && ev->flags & __EXEC_OBJECT_USERPTR_INIT) { + ev->flags &= ~__EXEC_OBJECT_USERPTR_INIT; +i915_gem_object_userptr_submit_fini (vma->obj); + } +if (final)i915_vma_put (vma); }
@@ -1911,6 +1931,31 @@ static int eb_prefault_relocations(const struct i915_execbuffer *eb)return 0 ; } +static int eb_reinit_userptr (struct i915_execbuffer *eb) +{ +const unsigned int count = eb->buffer_count; +unsigned int i; +int ret; + +if (likely (!(eb->args->flags & __EXEC_USERPTR_USED))) +return 0 ; + +for (i =0 ; i < count; i++) { +struct eb_vma *ev = &eb->vma[i]; + +if (!i915_gem_object_is_userptr (ev->vma->obj)) +continue ; + + ret =i915_gem_object_userptr_submit_init (ev->vma->obj); +if (ret) +return ret; + + ev->flags |= __EXEC_OBJECT_USERPTR_INIT; + } + +return 0 ; +} + static noinline int eb_relocate_parse_slow(struct i915_execbuffer *eb,struct i915_request *rq) {
@@ -1925,7 +1970,7 @@ static noinline int eb_relocate_parse_slow(struct i915_execbuffer *eb, }/* We may process another execbuffer during the unlock... */ -eb_release_vmas (eb, false); +eb_release_vmas (eb, false, true);i915_gem_ww_ctx_fini (&eb->ww);if (rq) {
@@ -1966,10 +2011,8 @@ static noinline int eb_relocate_parse_slow(struct i915_execbuffer *eb, err =0 ; } -#ifdef CONFIG_MMU_NOTIFIER if (!err) -flush_workqueue (eb->i915->mm.userptr_wq); -#endif + err =eb_reinit_userptr (eb); err_relock:i915_gem_ww_ctx_init (&eb->ww, true);
@@ -2031,7 +2074,7 @@ static noinline int eb_relocate_parse_slow(struct i915_execbuffer *eb, err:if (err == -EDEADLK ) { -eb_release_vmas (eb, false); +eb_release_vmas (eb, false, false); err =i915_gem_ww_ctx_backoff (&eb->ww);if (!err) goto repeat_validate;
@@ -2128,7 +2171,7 @@ static int eb_relocate_parse(struct i915_execbuffer *eb) err:if (err == -EDEADLK ) { -eb_release_vmas (eb, false); +eb_release_vmas (eb, false, false); err =i915_gem_ww_ctx_backoff (&eb->ww);if (!err) goto retry;
@@ -2203,6 +2246,30 @@ static int eb_move_to_gpu(struct i915_execbuffer *eb) flags | __EXEC_OBJECT_NO_RESERVE); } +#ifdef CONFIG_MMU_NOTIFIER +if (!err && (eb->args->flags & __EXEC_USERPTR_USED)) { +spin_lock (&eb->i915->mm.notifier_lock); + +/* +* count is always at least 1, otherwise __EXEC_USERPTR_USED +* could not have been set +*/ +for (i = count -1 ; i; i--) { +struct eb_vma *ev = &eb->vma[i]; +struct drm_i915_gem_object *obj = ev->vma->obj; + +if (!i915_gem_object_is_userptr (obj)) +continue ; + + err =i915_gem_object_userptr_submit_done (obj); +if (err) +break ; + } + +spin_unlock (&eb->i915->mm.notifier_lock); + } +#endif +if (unlikely (err)) goto err_skip;
@@ -3341,7 +3408,7 @@ i915_gem_do_execbuffer(struct drm_device *dev, err =eb_lookup_vmas (&eb);if (err) { -eb_release_vmas (&eb, true); +eb_release_vmas (&eb, true, true); goto err_engine; }
@@ -3413,6 +3480,7 @@ i915_gem_do_execbuffer(struct drm_device *dev,trace_i915_request_queue (eb.request, eb.batch_flags); err =eb_submit (&eb, batch); + err_request:i915_request_get (eb.request);eb_request_add (&eb);
@@ -3433,7 +3501,7 @@ i915_gem_do_execbuffer(struct drm_device *dev,i915_request_put (eb.request); err_vma: -eb_release_vmas (&eb, true); +eb_release_vmas (&eb, true, true);if (eb.trampoline)i915_vma_unpin (eb.trampoline);WARN_ON (err == -EDEADLK );
drivers/gpu/drm/i915/gem/i915_gem_object.h +19 -16
@@ -33,6 +33,7 @@ i915_gem_object_create_shmem_from_data(struct drm_i915_private *i915, const void *data, resource_size_t size);extern const struct drm_i915_gem_object_ops i915_gem_shmem_ops; +void __i915_gem_object_release_shmem (struct drm_i915_gem_object *obj,struct sg_table *pages,bool needs_clflush);
@@ -222,12 +223,6 @@ i915_gem_object_never_mmap(const struct drm_i915_gem_object *obj)return i915_gem_object_type_has (obj,I915_GEM_OBJECT_NO_MMAP ); } -static inline bool -i915_gem_object_needs_async_cancel (const struct drm_i915_gem_object *obj) -{ -return i915_gem_object_type_has (obj,I915_GEM_OBJECT_ASYNC_CANCEL ); -} -static inline bool i915_gem_object_is_framebuffer (const struct drm_i915_gem_object *obj) {
@@ -528,16 +523,6 @@ void __i915_gem_object_flush_frontbuffer(struct drm_i915_gem_object *obj,void __i915_gem_object_invalidate_frontbuffer (struct drm_i915_gem_object *obj,enum fb_op_origin origin); -static inline bool -i915_gem_object_is_userptr (struct drm_i915_gem_object *obj) -{ -#ifdef CONFIG_MMU_NOTIFIER -return obj->userptr.mm; -#else -return false; -#endif -} -static inline void i915_gem_object_flush_frontbuffer (struct drm_i915_gem_object *obj,enum fb_op_origin origin)
@@ -554,4 +539,22 @@ i915_gem_object_invalidate_frontbuffer(struct drm_i915_gem_object *obj,__i915_gem_object_invalidate_frontbuffer (obj, origin); } +#ifdef CONFIG_MMU_NOTIFIER +static inline bool +i915_gem_object_is_userptr (struct drm_i915_gem_object *obj) +{ +return obj->userptr.notifier.mm; +} + +int i915_gem_object_userptr_submit_init (struct drm_i915_gem_object *obj); +int i915_gem_object_userptr_submit_done (struct drm_i915_gem_object *obj); +void i915_gem_object_userptr_submit_fini (struct drm_i915_gem_object *obj); +#else +static inline bool i915_gem_object_is_userptr (struct drm_i915_gem_object *obj) {return false; } + +static inline int i915_gem_object_userptr_submit_init (struct drm_i915_gem_object *obj) {GEM_BUG_ON (1 );return -ENODEV ; } +static inline int i915_gem_object_userptr_submit_done (struct drm_i915_gem_object *obj) {GEM_BUG_ON (1 );return -ENODEV ; } +static inline void i915_gem_object_userptr_submit_fini (struct drm_i915_gem_object *obj) {GEM_BUG_ON (1 ); } +#endif +#endif
drivers/gpu/drm/i915/gem/i915_gem_object_types.h +6 -4
@@ -7,6 +7,8 @@#ifndef __I915_GEM_OBJECT_TYPES_H__#define __I915_GEM_OBJECT_TYPES_H__ +#include <linux/mmu_notifier.h> +#include <drm/drm_gem.h> #include <uapi/drm/i915_drm.h>
@@ -34,7 +36,6 @@ struct drm_i915_gem_object_ops {#define I915_GEM_OBJECT_IS_SHRINKABLE BIT(2)#define I915_GEM_OBJECT_IS_PROXY BIT(3)#define I915_GEM_OBJECT_NO_MMAP BIT(4) -#define I915_GEM_OBJECT_ASYNC_CANCEL BIT(5)/* Interface between the GEM object and its backing storage. * get_pages() is called once prior to the use of the associated set
@@ -292,10 +293,11 @@ struct drm_i915_gem_object {#ifdef CONFIG_MMU_NOTIFIER struct i915_gem_userptr {uintptr_t ptr; +unsigned long notifier_seq; -struct i915_mm_struct *mm; -struct i915_mmu_object *mmu_object; -struct work_struct *work; +struct mmu_interval_notifier notifier; +struct page **pvec; +int page_ref; } userptr;#endif
drivers/gpu/drm/i915/gem/i915_gem_pages.c +1 -1
@@ -225,7 +225,7 @@ int __i915_gem_object_put_pages(struct drm_i915_gem_object *obj)* get_pages backends we should be better able to handle the * cancellation of the async task in a more uniform manner. */ -if (!pages && !i915_gem_object_needs_async_cancel (obj)) +if (!pages) pages =ERR_PTR (-EINVAL );if (!IS_ERR (pages))
drivers/gpu/drm/i915/gem/i915_gem_userptr.c +216 -543
875 lines not on this page · raw message
drivers/gpu/drm/i915/i915_drv.h +3 -6
@@ -591,11 +591,10 @@ struct i915_gem_mm {#ifdef CONFIG_MMU_NOTIFIER /** -* Workqueue to fault in userptr pages, flushed by the execbuf -* when required but otherwise left to userspace to try again -* on EAGAIN. +* notifier_lock for mmu notifiers, memory may not be allocated +* while holding this lock. */ -struct workqueue_struct *userptr_wq; +spinlock_t notifier_lock;#endif /* shrinker accounting, also useful for userland debugging */
@@ -978,8 +977,6 @@ struct drm_i915_private {struct i915_ggtt ggtt;/* VM representing the global address space */ struct i915_gem_mm mm; -DECLARE_HASHTABLE (mm_structs,7 ); -spinlock_t mm_lock;/* Kernel Modesetting */
drivers/gpu/drm/i915/i915_gem.c +1 -4
@@ -1183,10 +1183,8 @@ int i915_gem_init(struct drm_i915_private *dev_priv) err_unlock:i915_gem_drain_workqueue (dev_priv); -if (ret != -EIO ) { +if (ret != -EIO )intel_uc_cleanup_firmwares (&dev_priv->gt.uc); -i915_gem_cleanup_userptr (dev_priv); - }if (ret == -EIO ) {/*
@@ -1245,7 +1243,6 @@ void i915_gem_driver_release(struct drm_i915_private *dev_priv)intel_wa_list_free (&dev_priv->gt_wa_list);intel_uc_cleanup_firmwares (&dev_priv->gt.uc); -i915_gem_cleanup_userptr (dev_priv);i915_gem_drain_freed_objects (dev_priv);
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 16/63 drm/i915: Flatten obj->mm.lock
In reply to Maarten LankhorstWith userptr fixed, there is no need for all separate lockdep classes now, and we can remove all lockdep tricks used. A trylock in the shrinker is all we need now to flatten the locking hierarchy.
--- drivers/gpu/drm/i915/gem/i915_gem_object.c | 6 +--- drivers/gpu/drm/i915/gem/i915_gem_object.h | 20 ++---------- drivers/gpu/drm/i915/gem/i915_gem_pages.c | 34 ++++++++++---------- drivers/gpu/drm/i915/gem/i915_gem_phys.c | 2 +- drivers/gpu/drm/i915/gem/i915_gem_shrinker.c | 10 +++--- drivers/gpu/drm/i915/gem/i915_gem_userptr.c | 2 +- 6 files changed, 27 insertions(+), 47 deletions(-)
drivers/gpu/drm/i915/gem/i915_gem_object.c +1 -5
@@ -62,7 +62,7 @@ void i915_gem_object_init(struct drm_i915_gem_object *obj,const struct drm_i915_gem_object_ops *ops, struct lock_class_key *key, unsigned flags) { - __mutex_init(&obj->mm.lock, ops->name ?: "obj->mm.lock", key); + mutex_init(&obj->mm.lock);spin_lock_init (&obj->vma.lock);INIT_LIST_HEAD (&obj->vma.list);
@@ -86,10 +86,6 @@ void i915_gem_object_init(struct drm_i915_gem_object *obj,mutex_init (&obj->mm.get_page.lock);INIT_RADIX_TREE (&obj->mm.get_dma_page.radix,GFP_KERNEL | __GFP_NOWARN);mutex_init (&obj->mm.get_dma_page.lock); - -if (IS_ENABLED (CONFIG_LOCKDEP ) &&i915_gem_object_is_shrinkable (obj)) -i915_gem_shrinker_taints_mutex (to_i915 (obj->base.dev), - &obj->mm.lock); }/**
drivers/gpu/drm/i915/gem/i915_gem_object.h +2 -18
@@ -316,27 +316,10 @@ void __i915_gem_object_set_pages(struct drm_i915_gem_object *obj,int ____i915_gem_object_get_pages (struct drm_i915_gem_object *obj);int __i915_gem_object_get_pages (struct drm_i915_gem_object *obj); -enum i915_mm_subclass {/* lockdep subclass for obj->mm.lock/struct_mutex */ -I915_MM_NORMAL =0 , -/* -* Only used by struct_mutex, when called "recursively" from -* direct-reclaim-esque. Safe because there is only every one -* struct_mutex in the entire system. -*/ -I915_MM_SHRINKER =1 , -/* -* Used for obj->mm.lock when allocating pages. Safe because the object -* isn't yet on any LRU, and therefore the shrinker can't deadlock on -* it. As soon as the object has pages, obj->mm.lock nests within -* fs_reclaim. -*/ -I915_MM_GET_PAGES =1 , -}; -static inline int __must_check i915_gem_object_pin_pages (struct drm_i915_gem_object *obj) { -might_lock_nested (&obj->mm.lock,I915_MM_GET_PAGES ); +might_lock (&obj->mm.lock);if (atomic_inc_not_zero (&obj->mm.pages_pin_count))return 0 ;
@@ -380,6 +363,7 @@ i915_gem_object_unpin_pages(struct drm_i915_gem_object *obj) }int __i915_gem_object_put_pages (struct drm_i915_gem_object *obj); +int __i915_gem_object_put_pages_locked (struct drm_i915_gem_object *obj);void i915_gem_object_truncate (struct drm_i915_gem_object *obj);void i915_gem_object_writeback (struct drm_i915_gem_object *obj);
drivers/gpu/drm/i915/gem/i915_gem_pages.c +17 -17
@@ -111,7 +111,7 @@ int __i915_gem_object_get_pages(struct drm_i915_gem_object *obj) {int err; - err =mutex_lock_interruptible_nested (&obj->mm.lock,I915_MM_GET_PAGES ); + err =mutex_lock_interruptible (&obj->mm.lock);if (err)return err;
@@ -195,21 +195,13 @@ __i915_gem_object_unset_pages(struct drm_i915_gem_object *obj)return pages; } -int __i915_gem_object_put_pages (struct drm_i915_gem_object *obj) +int __i915_gem_object_put_pages_locked (struct drm_i915_gem_object *obj) {struct sg_table *pages; -int err;if (i915_gem_object_has_pinned_pages (obj))return -EBUSY ; -/* May be called by shrinker from within get_pages() (on another bo) */ -mutex_lock (&obj->mm.lock); -if (unlikely (atomic_read (&obj->mm.pages_pin_count))) { - err = -EBUSY ; - goto unlock; - } -i915_gem_object_release_mmap_offset (obj);/*
@@ -225,14 +217,22 @@ int __i915_gem_object_put_pages(struct drm_i915_gem_object *obj)* get_pages backends we should be better able to handle the * cancellation of the async task in a more uniform manner. */ -if (!pages) - pages =ERR_PTR (-EINVAL ); - -if (!IS_ERR (pages)) +if (!IS_ERR_OR_NULL (pages)) obj->ops->put_pages (obj, pages); - err =0 ; -unlock: +return 0 ; +} + +int __i915_gem_object_put_pages (struct drm_i915_gem_object *obj) +{ +int err; + +if (i915_gem_object_has_pinned_pages (obj)) +return -EBUSY ; + +/* May be called by shrinker from within get_pages() (on another bo) */ +mutex_lock (&obj->mm.lock); + err =__i915_gem_object_put_pages_locked (obj);mutex_unlock (&obj->mm.lock);return err;
@@ -354,7 +354,7 @@ void *i915_gem_object_pin_map(struct drm_i915_gem_object *obj, !i915_gem_object_type_has(obj, I915_GEM_OBJECT_HAS_IOMEM))return ERR_PTR (-ENXIO ); - err =mutex_lock_interruptible_nested (&obj->mm.lock,I915_MM_GET_PAGES ); + err =mutex_lock_interruptible (&obj->mm.lock);if (err)return ERR_PTR (err);
drivers/gpu/drm/i915/gem/i915_gem_phys.c +1 -1
@@ -186,7 +186,7 @@ int i915_gem_object_attach_phys(struct drm_i915_gem_object *obj, int align)if (err)return err; - err =mutex_lock_interruptible_nested (&obj->mm.lock,I915_MM_GET_PAGES ); + err =mutex_lock_interruptible (&obj->mm.lock);if (err) goto err_unlock;
drivers/gpu/drm/i915/gem/i915_gem_shrinker.c +5 -5
@@ -48,9 +48,9 @@ static bool unsafe_drop_pages(struct drm_i915_gem_object *obj, flags =I915_GEM_OBJECT_UNBIND_TEST ;if (i915_gem_object_unbind (obj, flags) ==0 ) -__i915_gem_object_put_pages (obj); +return true; -return !i915_gem_object_has_pages (obj); +return false; } static void try_to_writeback(struct drm_i915_gem_object *obj,
@@ -199,10 +199,10 @@ i915_gem_shrink(struct drm_i915_private *i915,spin_unlock_irqrestore (&i915->mm.obj_lock, flags); -if (unsafe_drop_pages (obj, shrink)) { +if (unsafe_drop_pages (obj, shrink) && +mutex_trylock (&obj->mm.lock)) {/* May arrive from get_pages on another bo */ -mutex_lock (&obj->mm.lock); -if (!i915_gem_object_has_pages (obj)) { +if (!__i915_gem_object_put_pages_locked (obj)) {try_to_writeback (obj, shrink); count += obj->base.size >>PAGE_SHIFT ; }
drivers/gpu/drm/i915/gem/i915_gem_userptr.c +1 -1
@@ -235,7 +235,7 @@ static int i915_gem_object_userptr_unbind(struct drm_i915_gem_object *obj, boolif (GEM_WARN_ON (i915_gem_object_has_pinned_pages (obj)))return -EBUSY ; -mutex_lock_nested (&obj->mm.lock,I915_MM_GET_PAGES ); +mutex_lock (&obj->mm.lock); pages =__i915_gem_object_unset_pages (obj);if (!IS_ERR_OR_NULL (pages))
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 17/63 drm/i915: Populate logical context during first pin.
In reply to Maarten LankhorstThis allows us to remove pin_map from state allocation, which saves us a few retry loops. We won't need this until first pin, anyway.
--- drivers/gpu/drm/i915/gt/intel_context_types.h | 13 ++- drivers/gpu/drm/i915/gt/intel_lrc.c | 107 +++++++++--------- 2 files changed, 62 insertions(+), 58 deletions(-)
drivers/gpu/drm/i915/gt/intel_context_types.h +7 -6
@@ -64,12 +64,13 @@ struct intel_context {unsigned long flags;#define CONTEXT_BARRIER_BIT 0#define CONTEXT_ALLOC_BIT 1 -#define CONTEXT_VALID_BIT 2 -#define CONTEXT_CLOSED_BIT 3 -#define CONTEXT_USE_SEMAPHORES 4 -#define CONTEXT_BANNED 5 -#define CONTEXT_FORCE_SINGLE_SUBMISSION 6 -#define CONTEXT_NOPREEMPT 7 +#define CONTEXT_INIT_BIT 2 +#define CONTEXT_VALID_BIT 3 +#define CONTEXT_CLOSED_BIT 4 +#define CONTEXT_USE_SEMAPHORES 5 +#define CONTEXT_BANNED 6 +#define CONTEXT_FORCE_SINGLE_SUBMISSION 7 +#define CONTEXT_NOPREEMPT 8u32 *lrc_reg_state;union {
drivers/gpu/drm/i915/gt/intel_lrc.c +55 -52
150 lines not on this page · raw message
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 18/63 drm/i915: Make ring submission compatible with obj->mm.lock removal, v2.
In reply to Maarten LankhorstWe map the initial context during first pin.
This allows us to remove pin_map from state allocation, which saves us a few retry loops. We won't need this until first pin anyway.
intel_ring_submission_setup() is also reworked slightly to do all pinning in a single ww loop.
Changes since v1:
- Handle -EDEADLK backoff in intel_ring_submission_setup() better.
- Handle smatch errors reported by Dan and testbot.
--- .../gpu/drm/i915/gt/intel_ring_submission.c | 184 +++++++++++------- 1 file changed, 118 insertions(+), 66 deletions(-)
drivers/gpu/drm/i915/gt/intel_ring_submission.c +118 -66
@@ -478,6 +478,26 @@ static void ring_context_destroy(struct kref *ref)intel_context_free (ce); } +static int ring_context_init_default_state (struct intel_context *ce, +struct i915_gem_ww_ctx *ww) +{ +struct drm_i915_gem_object *obj = ce->state->obj; +void *vaddr; + + vaddr =i915_gem_object_pin_map (obj,I915_MAP_WB ); +if (IS_ERR (vaddr)) +return PTR_ERR (vaddr); + +shmem_read (ce->engine->default_state,0 , + vaddr, ce->engine->context_size); + +i915_gem_object_flush_map (obj); +__i915_gem_object_release_map (obj); + +__set_bit (CONTEXT_VALID_BIT , &ce->flags); +return 0 ; +} +static int ring_context_pre_pin (struct intel_context *ce,struct i915_gem_ww_ctx *ww,void **unused)
@@ -485,6 +505,13 @@ static int ring_context_pre_pin(struct intel_context *ce,struct i915_address_space *vm;int err =0 ; +if (ce->engine->default_state && + !test_bit (CONTEXT_VALID_BIT , &ce->flags)) { + err =ring_context_init_default_state (ce, ww); +if (err) +return err; + } + vm =vm_alias (ce->vm);if (vm) err =gen6_ppgtt_pin (i915_vm_to_ppgtt ((vm)), ww);
@@ -540,22 +567,6 @@ alloc_context_vma(struct intel_engine_cs *engine)if (IS_IVYBRIDGE (i915))i915_gem_object_set_cache_coherency (obj,I915_CACHE_L3_LLC ); -if (engine->default_state) { -void *vaddr; - - vaddr =i915_gem_object_pin_map (obj,I915_MAP_WB ); -if (IS_ERR (vaddr)) { - err =PTR_ERR (vaddr); - goto err_obj; - } - -shmem_read (engine->default_state,0 , - vaddr, engine->context_size); - -i915_gem_object_flush_map (obj); -__i915_gem_object_release_map (obj); - } - vma =i915_vma_instance (obj, &engine->gt->ggtt->vm,NULL );if (IS_ERR (vma)) { err =PTR_ERR (vma);
@@ -587,8 +598,6 @@ static int ring_context_alloc(struct intel_context *ce)return PTR_ERR (vma); ce->state = vma; -if (engine->default_state) -__set_bit (CONTEXT_VALID_BIT , &ce->flags); }return 0 ;
@@ -1184,37 +1193,15 @@ static int gen7_ctx_switch_bb_setup(struct intel_engine_cs * const engine,return gen7_setup_clear_gpr_bb (engine, vma); } -static int gen7_ctx_switch_bb_init (struct intel_engine_cs *engine) +static int gen7_ctx_switch_bb_init (struct intel_engine_cs *engine, +struct i915_gem_ww_ctx *ww, +struct i915_vma *vma) { -struct drm_i915_gem_object *obj; -struct i915_vma *vma; -int size;int err; - size =gen7_ctx_switch_bb_setup (engine,NULL /* probe size */ ); -if (size <=0 ) -return size; - - size =ALIGN (size,PAGE_SIZE ); - obj =i915_gem_object_create_internal (engine->i915, size); -if (IS_ERR (obj)) -return PTR_ERR (obj); - - vma =i915_vma_instance (obj, engine->gt->vm,NULL ); -if (IS_ERR (vma)) { - err =PTR_ERR (vma); - goto err_obj; - } - - vma->private =intel_context_create (engine);/* dummy residuals */ -if (IS_ERR (vma->private)) { - err =PTR_ERR (vma->private); - goto err_obj; - } - - err =i915_vma_pin (vma,0 ,0 ,PIN_USER |PIN_HIGH ); + err =i915_vma_pin_ww (vma, ww,0 ,0 ,PIN_USER |PIN_HIGH );if (err) - goto err_private; +return err; err =i915_vma_sync (vma);if (err)
@@ -1229,17 +1216,53 @@ static int gen7_ctx_switch_bb_init(struct intel_engine_cs *engine) err_unpin:i915_vma_unpin (vma); -err_private: -intel_context_put (vma->private); -err_obj: -i915_gem_object_put (obj);return err; } +static struct i915_vma *gen7_ctx_vma (struct intel_engine_cs *engine) +{ +struct drm_i915_gem_object *obj; +struct i915_vma *vma; +int size, err; + +if (!IS_HASWELL (engine->i915) || engine->class !=RENDER_CLASS ) +return 0 ; + + err =gen7_ctx_switch_bb_setup (engine,NULL /* probe size */ ); +if (err <0 ) +return ERR_PTR (err); +if (!err) +return NULL ; + + size =ALIGN (err,PAGE_SIZE ); + + obj =i915_gem_object_create_internal (engine->i915, size); +if (IS_ERR (obj)) +return ERR_CAST (obj); + + vma =i915_vma_instance (obj, engine->gt->vm,NULL ); +if (IS_ERR (vma)) { +i915_gem_object_put (obj); +return ERR_CAST (vma); + } + + vma->private =intel_context_create (engine);/* dummy residuals */ +if (IS_ERR (vma->private)) { + err =PTR_ERR (vma->private); + vma->private =NULL ; +i915_gem_object_put (obj); +return ERR_PTR (err); + } + +return vma; +} +int intel_ring_submission_setup (struct intel_engine_cs *engine) { +struct i915_gem_ww_ctx ww;struct intel_timeline *timeline;struct intel_ring *ring; +struct i915_vma *gen7_wa_vma;int err;setup_common (engine);
@@ -1270,43 +1293,72 @@ int intel_ring_submission_setup(struct intel_engine_cs *engine) }GEM_BUG_ON (timeline->has_initial_breadcrumb); - err =intel_timeline_pin (timeline,NULL ); -if (err) - goto err_timeline; - ring =intel_engine_create_ring (engine,SZ_16K );if (IS_ERR (ring)) { err =PTR_ERR (ring); - goto err_timeline_unpin; + goto err_timeline; } - err =intel_ring_pin (ring,NULL ); -if (err) - goto err_ring; -GEM_BUG_ON (engine->legacy.ring); engine->legacy.ring = ring; engine->legacy.timeline = timeline; -GEM_BUG_ON (timeline->hwsp_ggtt != engine->status_page.vma); + gen7_wa_vma =gen7_ctx_vma (engine); +if (IS_ERR (gen7_wa_vma)) { + err =PTR_ERR (gen7_wa_vma); + goto err_ring; + } -if (IS_HASWELL (engine->i915) && engine->class ==RENDER_CLASS ) { - err =gen7_ctx_switch_bb_init (engine); +i915_gem_ww_ctx_init (&ww, false); + +retry: + err =i915_gem_object_lock (timeline->hwsp_ggtt->obj, &ww); +if (!err && gen7_wa_vma) + err =i915_gem_object_lock (gen7_wa_vma->obj, &ww); +if (!err && engine->legacy.ring->vma->obj) + err =i915_gem_object_lock (engine->legacy.ring->vma->obj, &ww); +if (!err) + err =intel_timeline_pin (timeline, &ww); +if (!err) { + err =intel_ring_pin (ring, &ww);if (err) - goto err_ring_unpin; +intel_timeline_unpin (timeline); } +if (err) + goto out; + +GEM_BUG_ON (timeline->hwsp_ggtt != engine->status_page.vma); + +if (gen7_wa_vma) { + err =gen7_ctx_switch_bb_init (engine, &ww, gen7_wa_vma); +if (err) { +intel_ring_unpin (ring); +intel_timeline_unpin (timeline); + } + } + +out: +if (err == -EDEADLK ) { + err =i915_gem_ww_ctx_backoff (&ww); +if (!err) + goto retry; + } +i915_gem_ww_ctx_fini (&ww); +if (err) + goto err_gen7_put;/* Finally, take ownership and responsibility for cleanup! */ engine->release = ring_release;return 0 ; -err_ring_unpin: -intel_ring_unpin (ring); +err_gen7_put: +if (gen7_wa_vma) { +intel_context_put (gen7_wa_vma->private); +i915_gem_object_put (gen7_wa_vma->obj); + } err_ring:intel_ring_put (ring); -err_timeline_unpin: -intel_timeline_unpin (timeline); err_timeline:intel_timeline_put (timeline); err:
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 19/63 drm/i915: Handle ww locking in init_status_page
In reply to Maarten LankhorstTry to pin to ggtt first, and use a full ww loop to handle eviction correctly.
--- drivers/gpu/drm/i915/gt/intel_engine_cs.c | 37 +++++++++++++++-------- 1 file changed, 24 insertions(+), 13 deletions(-)
drivers/gpu/drm/i915/gt/intel_engine_cs.c +24 -13
@@ -615,6 +615,7 @@ static void cleanup_status_page(struct intel_engine_cs *engine) }static int pin_ggtt_status_page (struct intel_engine_cs *engine, +struct i915_gem_ww_ctx *ww,struct i915_vma *vma) {unsigned int flags;
@@ -635,12 +636,13 @@ static int pin_ggtt_status_page(struct intel_engine_cs *engine,else flags =PIN_HIGH ; -return i915_ggtt_pin (vma,NULL ,0 , flags); +return i915_ggtt_pin (vma, ww,0 , flags); }static int init_status_page (struct intel_engine_cs *engine) {struct drm_i915_gem_object *obj; +struct i915_gem_ww_ctx ww;struct i915_vma *vma;void *vaddr;int ret;
@@ -664,30 +666,39 @@ static int init_status_page(struct intel_engine_cs *engine) vma =i915_vma_instance (obj, &engine->gt->ggtt->vm,NULL );if (IS_ERR (vma)) { ret =PTR_ERR (vma); - goto err; + goto err_put; } +i915_gem_ww_ctx_init (&ww, true); +retry: + ret =i915_gem_object_lock (obj, &ww); +if (!ret && !HWS_NEEDS_PHYSICAL (engine->i915)) + ret =pin_ggtt_status_page (engine, &ww, vma); +if (ret) + goto err; + vaddr =i915_gem_object_pin_map (obj,I915_MAP_WB );if (IS_ERR (vaddr)) { ret =PTR_ERR (vaddr); - goto err; + goto err_unpin; } engine->status_page.addr =memset (vaddr,0 ,PAGE_SIZE ); engine->status_page.vma = vma; -if (!HWS_NEEDS_PHYSICAL (engine->i915)) { - ret =pin_ggtt_status_page (engine, vma); -if (ret) - goto err_unpin; - } - -return 0 ; - err_unpin: -i915_gem_object_unpin_map (obj); +if (ret) +i915_vma_unpin (vma); err: -i915_gem_object_put (obj); +if (ret == -EDEADLK ) { + ret =i915_gem_ww_ctx_backoff (&ww); +if (!ret) + goto retry; + } +i915_gem_ww_ctx_fini (&ww); +err_put: +if (ret) +i915_gem_object_put (obj);return ret; }
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 20/63 drm/i915: Rework clflush to work correctly without obj->mm.lock.
In reply to Maarten LankhorstPin in the caller, not in the work itself. This should also work better for dma-fence annotations.
--- drivers/gpu/drm/i915/gem/i915_gem_clflush.c | 15 +++++++-------- 1 file changed, 7 insertions(+), 8 deletions(-)
drivers/gpu/drm/i915/gem/i915_gem_clflush.c +7 -8
@@ -27,15 +27,8 @@ static void __do_clflush(struct drm_i915_gem_object *obj)static int clflush_work (struct dma_fence_work *base) {struct clflush *clflush =container_of (base,typeof (*clflush), base); -struct drm_i915_gem_object *obj = clflush->obj; -int err; - err =i915_gem_object_pin_pages (obj); -if (err) -return err; - -__do_clflush (obj); -i915_gem_object_unpin_pages (obj); +__do_clflush (clflush->obj);return 0 ; }
@@ -44,6 +37,7 @@ static void clflush_release(struct dma_fence_work *base) {struct clflush *clflush =container_of (base,typeof (*clflush), base); +i915_gem_object_unpin_pages (clflush->obj);i915_gem_object_put (clflush->obj); }
@@ -63,6 +57,11 @@ static struct clflush *clflush_work_create(struct drm_i915_gem_object *obj)if (!clflush)return NULL ; +if (__i915_gem_object_get_pages (obj) <0 ) { +kfree (clflush); +return NULL ; + } +dma_fence_work_init (&clflush->base, &clflush_ops); clflush->obj =i915_gem_object_get (obj);/* obj <-> clflush cycle */
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 21/63 drm/i915: Pass ww ctx to intel_pin_to_display_plane
In reply to Maarten LankhorstInstead of multiple lockings, lock the object once, and perform the ww dance around attach_phys and pin_pages.
--- drivers/gpu/drm/i915/display/intel_display.c | 69 ++++++++++++------- drivers/gpu/drm/i915/display/intel_display.h | 2 +- drivers/gpu/drm/i915/display/intel_fbdev.c | 2 +- drivers/gpu/drm/i915/display/intel_overlay.c | 34 +++++++-- drivers/gpu/drm/i915/gem/i915_gem_domain.c | 30 ++------ drivers/gpu/drm/i915/gem/i915_gem_object.h | 1 + drivers/gpu/drm/i915/gem/i915_gem_phys.c | 10 +-- .../drm/i915/gem/selftests/i915_gem_phys.c | 2 + 8 files changed, 86 insertions(+), 64 deletions(-)
drivers/gpu/drm/i915/display/intel_display.c +43 -26
@@ -2232,6 +2232,7 @@ static bool intel_plane_uses_fence(const struct intel_plane_state *plane_state)struct i915_vma *intel_pin_and_fence_fb_obj (struct drm_framebuffer *fb, +bool phys_cursor,const struct i915_ggtt_view *view,bool uses_fence,unsigned long *out_flags)
@@ -2240,14 +2241,19 @@ intel_pin_and_fence_fb_obj(struct drm_framebuffer *fb,struct drm_i915_private *dev_priv =to_i915 (dev);struct drm_i915_gem_object *obj =intel_fb_obj (fb);intel_wakeref_t wakeref; +struct i915_gem_ww_ctx ww;struct i915_vma *vma;unsigned int pinctl;u32 alignment; +int ret;if (drm_WARN_ON (dev, !i915_gem_object_is_framebuffer (obj)))return ERR_PTR (-EINVAL ); - alignment =intel_surf_alignment (fb,0 ); +if (phys_cursor) + alignment =intel_cursor_alignment (dev_priv); +else + alignment =intel_surf_alignment (fb,0 );if (drm_WARN_ON (dev, alignment && !is_power_of_2 (alignment)))return ERR_PTR (-EINVAL );
@@ -2282,14 +2288,26 @@ intel_pin_and_fence_fb_obj(struct drm_framebuffer *fb,if (HAS_GMCH (dev_priv)) pinctl |=PIN_MAPPABLE ; - vma =i915_gem_object_pin_to_display_plane (obj, - alignment, view, pinctl); -if (IS_ERR (vma)) +i915_gem_ww_ctx_init (&ww, true); +retry: + ret =i915_gem_object_lock (obj, &ww); +if (!ret && phys_cursor) + ret =i915_gem_object_attach_phys (obj, alignment); +if (!ret) + ret =i915_gem_object_pin_pages (obj); +if (ret) goto err; -if (uses_fence &&i915_vma_is_map_and_fenceable (vma)) { -int ret; +if (!ret) { + vma =i915_gem_object_pin_to_display_plane (obj, &ww, alignment, + view, pinctl); +if (IS_ERR (vma)) { + ret =PTR_ERR (vma); + goto err_unpin; + } + } +if (uses_fence &&i915_vma_is_map_and_fenceable (vma)) {/* * Install a fence for tiled scan-out. Pre-i965 always needs a * fence, whereas 965+ only requires a fence if using
@@ -2310,16 +2328,28 @@ intel_pin_and_fence_fb_obj(struct drm_framebuffer *fb, ret =i915_vma_pin_fence (vma);if (ret !=0 &&INTEL_GEN (dev_priv) <4 ) {i915_gem_object_unpin_from_display_plane (vma); - vma =ERR_PTR (ret); - goto err; + goto err_unpin; } + ret =0 ; -if (ret ==0 && vma->fence) +if (vma->fence) *out_flags |=PLANE_HAS_FENCE ; }i915_vma_get (vma); + +err_unpin: +i915_gem_object_unpin_pages (obj); err: +if (ret == -EDEADLK ) { + ret =i915_gem_ww_ctx_backoff (&ww); +if (!ret) + goto retry; + } +i915_gem_ww_ctx_fini (&ww); +if (ret) + vma =ERR_PTR (ret); +atomic_dec (&dev_priv->gpu_error.pending_fb_pin);intel_runtime_pm_put (&dev_priv->runtime_pm, wakeref);return vma;
@@ -16136,19 +16166,11 @@ static int intel_plane_pin_fb(struct intel_plane_state *plane_state)struct drm_i915_private *dev_priv =to_i915 (plane->base.dev);struct drm_framebuffer *fb = plane_state->hw.fb;struct i915_vma *vma; +bool phys_cursor = + plane->id ==PLANE_CURSOR && +INTEL_INFO (dev_priv)->display.cursor_needs_physical; -if (plane->id ==PLANE_CURSOR && -INTEL_INFO (dev_priv)->display.cursor_needs_physical) { -struct drm_i915_gem_object *obj =intel_fb_obj (fb); -const int align =intel_cursor_alignment (dev_priv); -int err; - - err =i915_gem_object_attach_phys (obj, align); -if (err) -return err; - } - - vma =intel_pin_and_fence_fb_obj (fb, + vma =intel_pin_and_fence_fb_obj (fb, phys_cursor, &plane_state->view,intel_plane_uses_fence (plane_state), &plane_state->flags);
@@ -16244,13 +16266,8 @@ intel_prepare_plane_fb(struct drm_plane *_plane,if (!obj)return 0 ; - ret =i915_gem_object_pin_pages (obj); -if (ret) -return ret; ret =intel_plane_pin_fb (new_plane_state); - -i915_gem_object_unpin_pages (obj);if (ret)return ret;
drivers/gpu/drm/i915/display/intel_display.h +1 -1
@@ -551,7 +551,7 @@ void intel_release_load_detect_pipe(struct drm_connector *connector,struct intel_load_detect_pipe *old, struct drm_modeset_acquire_ctx *ctx);struct i915_vma * -intel_pin_and_fence_fb_obj (struct drm_framebuffer *fb, +intel_pin_and_fence_fb_obj (struct drm_framebuffer *fb,bool phys_cursor,const struct i915_ggtt_view *view,bool uses_fence,unsigned long *out_flags);
drivers/gpu/drm/i915/display/intel_fbdev.c +1 -1
@@ -211,7 +211,7 @@ static int intelfb_create(struct drm_fb_helper *helper,* This also validates that any existing fb inherited from the * BIOS is suitable for own access. */ - vma =intel_pin_and_fence_fb_obj (&ifbdev->fb->base, + vma =intel_pin_and_fence_fb_obj (&ifbdev->fb->base, false, &view, false, &flags);if (IS_ERR (vma)) { ret =PTR_ERR (vma);
drivers/gpu/drm/i915/display/intel_overlay.c +29 -5
@@ -755,6 +755,32 @@ static u32 overlay_cmd_reg(struct drm_intel_overlay_put_image *params)return cmd; } +static struct i915_vma *intel_overlay_pin_fb (struct drm_i915_gem_object *new_bo) +{ +struct i915_gem_ww_ctx ww; +struct i915_vma *vma; +int ret; + +i915_gem_ww_ctx_init (&ww, true); +retry: + ret =i915_gem_object_lock (new_bo, &ww); +if (!ret) { + vma =i915_gem_object_pin_to_display_plane (new_bo, &ww,0 , +NULL ,PIN_MAPPABLE ); + ret =PTR_ERR_OR_ZERO (vma); + } +if (ret == -EDEADLK ) { + ret =i915_gem_ww_ctx_backoff (&ww); +if (!ret) + goto retry; + } +i915_gem_ww_ctx_fini (&ww); +if (ret) +return ERR_PTR (ret); + +return vma; +} +static int intel_overlay_do_put_image (struct intel_overlay *overlay,struct drm_i915_gem_object *new_bo,struct drm_intel_overlay_put_image *params)
@@ -776,12 +802,10 @@ static int intel_overlay_do_put_image(struct intel_overlay *overlay,atomic_inc (&dev_priv->gpu_error.pending_fb_pin); - vma =i915_gem_object_pin_to_display_plane (new_bo, -0 ,NULL ,PIN_MAPPABLE ); -if (IS_ERR (vma)) { - ret =PTR_ERR (vma); + vma =intel_overlay_pin_fb (new_bo); +if (IS_ERR (vma)) goto out_pin_section; - } +i915_gem_object_flush_frontbuffer (new_bo,ORIGIN_DIRTYFB );if (!overlay->active) {
drivers/gpu/drm/i915/gem/i915_gem_domain.c +6 -24
@@ -313,12 +313,12 @@ int i915_gem_set_caching_ioctl(struct drm_device *dev, void *data,*/ struct i915_vma *i915_gem_object_pin_to_display_plane (struct drm_i915_gem_object *obj, +struct i915_gem_ww_ctx *ww,u32 alignment,const struct i915_ggtt_view *view,unsigned int flags) {struct drm_i915_private *i915 =to_i915 (obj->base.dev); -struct i915_gem_ww_ctx ww;struct i915_vma *vma;int ret;
@@ -326,11 +326,6 @@ i915_gem_object_pin_to_display_plane(struct drm_i915_gem_object *obj,if (HAS_LMEM (i915) && !i915_gem_object_is_lmem (obj))return ERR_PTR (-EINVAL ); -i915_gem_ww_ctx_init (&ww, true); -retry: - ret =i915_gem_object_lock (obj, &ww); -if (ret) - goto err;/* * The display engine is not coherent with the LLC cache on gen6. As * a result, we make sure that the pinning that is about to occur is
@@ -345,7 +340,7 @@ i915_gem_object_pin_to_display_plane(struct drm_i915_gem_object *obj,HAS_WT (i915) ? I915_CACHE_WT : I915_CACHE_NONE);if (ret) - goto err; +return ERR_PTR (ret);/* * As the user may map the buffer once pinned in the display plane
@@ -358,32 +353,19 @@ i915_gem_object_pin_to_display_plane(struct drm_i915_gem_object *obj, vma =ERR_PTR (-ENOSPC );if ((flags &PIN_MAPPABLE ) ==0 && (!view || view->type ==I915_GGTT_VIEW_NORMAL )) - vma =i915_gem_object_ggtt_pin_ww (obj, &ww, view,0 , alignment, + vma =i915_gem_object_ggtt_pin_ww (obj, ww, view,0 , alignment, flags |PIN_MAPPABLE |PIN_NONBLOCK );if (IS_ERR (vma) && vma !=ERR_PTR (-EDEADLK )) - vma =i915_gem_object_ggtt_pin_ww (obj, &ww, view,0 , + vma =i915_gem_object_ggtt_pin_ww (obj, ww, view,0 , alignment, flags); -if (IS_ERR (vma)) { - ret =PTR_ERR (vma); - goto err; - } +if (IS_ERR (vma)) +return vma; vma->display_alignment =max_t (u64, vma->display_alignment, alignment);i915_gem_object_flush_if_display_locked (obj); -err: -if (ret == -EDEADLK ) { - ret =i915_gem_ww_ctx_backoff (&ww); -if (!ret) - goto retry; - } -i915_gem_ww_ctx_fini (&ww); - -if (ret) -return ERR_PTR (ret); -return vma; }
drivers/gpu/drm/i915/gem/i915_gem_object.h +1 -0
@@ -466,6 +466,7 @@ int __must_check i915_gem_object_set_to_cpu_domain(struct drm_i915_gem_object *obj, bool write);struct i915_vma *__must_check i915_gem_object_pin_to_display_plane (struct drm_i915_gem_object *obj, +struct i915_gem_ww_ctx *ww,u32 alignment,const struct i915_ggtt_view *view,unsigned int flags);
drivers/gpu/drm/i915/gem/i915_gem_phys.c +3 -7
@@ -169,6 +169,8 @@ int i915_gem_object_attach_phys(struct drm_i915_gem_object *obj, int align) {int err; +assert_object_held (obj); +if (align > obj->base.size)return -EINVAL ;
@@ -182,13 +184,9 @@ int i915_gem_object_attach_phys(struct drm_i915_gem_object *obj, int align)if (err)return err; - err =i915_gem_object_lock_interruptible (obj,NULL ); -if (err) -return err; - err =mutex_lock_interruptible (&obj->mm.lock);if (err) - goto err_unlock; +return err;if (unlikely (!i915_gem_object_has_struct_page (obj))) goto out;
@@ -219,8 +217,6 @@ int i915_gem_object_attach_phys(struct drm_i915_gem_object *obj, int align) out:mutex_unlock (&obj->mm.lock); -err_unlock: -i915_gem_object_unlock (obj);return err; }
drivers/gpu/drm/i915/gem/selftests/i915_gem_phys.c +2 -0
@@ -31,7 +31,9 @@ static int mock_phys_object(void *arg) goto out_obj; } +i915_gem_object_lock (obj,NULL ); err =i915_gem_object_attach_phys (obj,PAGE_SIZE ); +i915_gem_object_unlock (obj);if (err) {pr_err ("i915_gem_object_attach_phys failed, err=%d\n" , err); goto out_obj;
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 22/63 drm/i915: Add object locking to vm_fault_cpu
In reply to Maarten LankhorstTake a simple lock so we hold ww around (un)pin_pages as needed.
--- drivers/gpu/drm/i915/gem/i915_gem_mman.c | 4 ++++ 1 file changed, 4 insertions(+)
drivers/gpu/drm/i915/gem/i915_gem_mman.c +4 -0
@@ -246,6 +246,9 @@ static vm_fault_t vm_fault_cpu(struct vm_fault *vmf) area->vm_flags & VM_WRITE))return VM_FAULT_SIGBUS ; +if (i915_gem_object_lock_interruptible (obj,NULL )) +return VM_FAULT_NOPAGE ; + err =i915_gem_object_pin_pages (obj);if (err) goto out;
@@ -269,6 +272,7 @@ static vm_fault_t vm_fault_cpu(struct vm_fault *vmf)i915_gem_object_unpin_pages (obj); out: +i915_gem_object_unlock (obj);return i915_error_to_vmf_fault (err); }
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 23/63 drm/i915: Move pinning to inside engine_wa_list_verify()
In reply to Maarten LankhorstThis should be done as part of the ww loop, in order to remove a i915_vma_pin that needs ww held.
Now only i915_ggtt_pin() callers remaining.
--- drivers/gpu/drm/i915/gt/intel_workarounds.c | 24 ++++++++---------- .../gpu/drm/i915/gt/selftest_workarounds.c | 25 ++++++++++++++++--- 2 files changed, 32 insertions(+), 17 deletions(-)
drivers/gpu/drm/i915/gt/intel_workarounds.c +10 -14
@@ -2004,7 +2004,6 @@ create_scratch(struct i915_address_space *vm, int count)struct drm_i915_gem_object *obj;struct i915_vma *vma;unsigned int size; -int err; size =round_up (count *sizeof (u32),PAGE_SIZE ); obj =i915_gem_object_create_internal (vm->i915, size);
@@ -2015,20 +2014,11 @@ create_scratch(struct i915_address_space *vm, int count) vma =i915_vma_instance (obj, vm,NULL );if (IS_ERR (vma)) { - err =PTR_ERR (vma); - goto err_obj; +i915_gem_object_put (obj); +return vma; } - err =i915_vma_pin (vma,0 ,0 , -i915_vma_is_ggtt (vma) ?PIN_GLOBAL :PIN_USER ); -if (err) - goto err_obj; -return vma; - -err_obj: -i915_gem_object_put (obj); -return ERR_PTR (err); }struct mcr_range {
@@ -2146,10 +2136,15 @@ static int engine_wa_list_verify(struct intel_context *ce,if (err) goto err_pm; + err =i915_vma_pin_ww (vma, &ww,0 ,0 , +i915_vma_is_ggtt (vma) ?PIN_GLOBAL :PIN_USER ); +if (err) + goto err_unpin; + rq =i915_request_create (ce);if (IS_ERR (rq)) { err =PTR_ERR (rq); - goto err_unpin; + goto err_vma; } err =i915_request_await_object (rq, vma->obj, true);
@@ -2190,6 +2185,8 @@ static int engine_wa_list_verify(struct intel_context *ce, err_rq:i915_request_put (rq); +err_vma: +i915_vma_unpin (vma); err_unpin:intel_context_unpin (ce); err_pm:
@@ -2200,7 +2197,6 @@ static int engine_wa_list_verify(struct intel_context *ce, }i915_gem_ww_ctx_fini (&ww);intel_engine_pm_put (ce->engine); -i915_vma_unpin (vma);i915_vma_put (vma);return err; }
drivers/gpu/drm/i915/gt/selftest_workarounds.c +22 -3
@@ -386,6 +386,25 @@ static struct i915_vma *create_batch(struct i915_address_space *vm)return ERR_PTR (err); } +static struct i915_vma * +create_scratch_pinned (struct i915_address_space *vm,int count) +{ +struct i915_vma *vma =create_scratch (vm, count); +int err; + +if (IS_ERR (vma)) +return vma; + + err =i915_vma_pin (vma,0 ,0 , +i915_vma_is_ggtt (vma) ?PIN_GLOBAL :PIN_USER ); +if (err) { +i915_vma_put (vma); +return ERR_PTR (err); + } + +return vma; +} +static u32 reg_write (u32 old,u32 new,u32 rsvd) {if (rsvd ==0x0000ffff ) {
@@ -489,7 +508,7 @@ static int check_dirty_whitelist(struct intel_context *ce)int err =0 , i, v;u32 *cs, *results; - scratch =create_scratch (ce->vm,2 *ARRAY_SIZE (values) +1 ); + scratch =create_scratch_pinned (ce->vm,2 *ARRAY_SIZE (values) +1 );if (IS_ERR (scratch))return PTR_ERR (scratch);
@@ -1043,7 +1062,7 @@ static int live_isolated_whitelist(void *arg) vm =i915_gem_context_get_vm_rcu (c); - client[i].scratch[0 ] =create_scratch (vm,1024 ); + client[i].scratch[0 ] =create_scratch_pinned (vm,1024 );if (IS_ERR (client[i].scratch[0 ])) { err =PTR_ERR (client[i].scratch[0 ]);i915_vm_put (vm);
@@ -1051,7 +1070,7 @@ static int live_isolated_whitelist(void *arg) goto err; } - client[i].scratch[1 ] =create_scratch (vm,1024 ); + client[i].scratch[1 ] =create_scratch_pinned (vm,1024 );if (IS_ERR (client[i].scratch[1 ])) { err =PTR_ERR (client[i].scratch[1 ]);i915_vma_unpin_and_release (&client[i].scratch[0 ],0 );
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 24/63 drm/i915: Take reservation lock around i915_vma_pin.
In reply to Maarten LankhorstWe previously complained when ww == NULL.
This function is now only used in selftests to pin an object, and ww locking is now fixed.
--- .../i915/gem/selftests/i915_gem_coherency.c | 14 +++++-------- drivers/gpu/drm/i915/i915_gem.c | 6 +++++- drivers/gpu/drm/i915/i915_vma.c | 4 +--- drivers/gpu/drm/i915/i915_vma.h | 20 +++++++++++++++---- 4 files changed, 27 insertions(+), 17 deletions(-)
drivers/gpu/drm/i915/gem/selftests/i915_gem_coherency.c +5 -9
@@ -199,16 +199,14 @@ static int gpu_set(struct context *ctx, unsigned long offset, u32 v)u32 *cs;int err; + vma =i915_gem_object_ggtt_pin (ctx->obj,NULL ,0 ,0 ,0 ); +if (IS_ERR (vma)) +return PTR_ERR (vma); +i915_gem_object_lock (ctx->obj,NULL ); err =i915_gem_object_set_to_gtt_domain (ctx->obj, true);if (err) - goto out_unlock; - - vma =i915_gem_object_ggtt_pin (ctx->obj,NULL ,0 ,0 ,0 ); -if (IS_ERR (vma)) { - err =PTR_ERR (vma); - goto out_unlock; - } + goto out_unpin; rq =intel_engine_create_kernel_request (ctx->engine);if (IS_ERR (rq)) {
@@ -248,9 +246,7 @@ static int gpu_set(struct context *ctx, unsigned long offset, u32 v)i915_request_add (rq); out_unpin:i915_vma_unpin (vma); -out_unlock:i915_gem_object_unlock (ctx->obj); -return err; }
drivers/gpu/drm/i915/i915_gem.c +5 -1
@@ -1036,7 +1036,11 @@ i915_gem_object_ggtt_pin_ww(struct drm_i915_gem_object *obj,return ERR_PTR (ret); } - ret =i915_vma_pin_ww (vma, ww, size, alignment, flags |PIN_GLOBAL ); +if (ww) + ret =i915_vma_pin_ww (vma, ww, size, alignment, flags |PIN_GLOBAL ); +else + ret =i915_vma_pin (vma, size, alignment, flags |PIN_GLOBAL ); +if (ret)return ERR_PTR (ret);
drivers/gpu/drm/i915/i915_vma.c +1 -3
@@ -861,9 +861,7 @@ int i915_vma_pin_ww(struct i915_vma *vma, struct i915_gem_ww_ctx *ww,int err;#ifdef CONFIG_PROVE_LOCKING -if (debug_locks &&lockdep_is_held (&vma->vm->i915->drm.struct_mutex)) -WARN_ON (!ww); -if (debug_locks && ww && vma->resv) +if (debug_locks && !WARN_ON (!ww) && vma->resv)assert_vma_held (vma);#endif
drivers/gpu/drm/i915/i915_vma.h +16 -4
@@ -246,10 +246,22 @@ i915_vma_pin_ww(struct i915_vma *vma, struct i915_gem_ww_ctx *ww,static inline int __must_check i915_vma_pin (struct i915_vma *vma,u64 size,u64 alignment,u64 flags) { -#ifdef CONFIG_LOCKDEP -WARN_ON_ONCE (vma->resv &&dma_resv_held (vma->resv)); -#endif -return i915_vma_pin_ww (vma,NULL , size, alignment, flags); +struct i915_gem_ww_ctx ww; +int err; + +i915_gem_ww_ctx_init (&ww, true); +retry: + err =i915_gem_object_lock (vma->obj, &ww); +if (!err) + err =i915_vma_pin_ww (vma, &ww, size, alignment, flags); +if (err == -EDEADLK ) { + err =i915_gem_ww_ctx_backoff (&ww); +if (!err) + goto retry; + } +i915_gem_ww_ctx_fini (&ww); + +return err; } int i915_ggtt_pin(struct i915_vma *vma, struct i915_gem_ww_ctx *ww,
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 25/63 drm/i915: Make intel_init_workaround_bb more compatible with ww locking.
In reply to Maarten LankhorstMake creation separate from pinning, in order to take the lock only once, and pin the mapping with the lock held.
--- drivers/gpu/drm/i915/gt/intel_lrc.c | 43 ++++++++++++++++++++++------- 1 file changed, 33 insertions(+), 10 deletions(-)
drivers/gpu/drm/i915/gt/intel_lrc.c +33 -10
@@ -3972,7 +3972,7 @@ gen10_init_indirectctx_bb(struct intel_engine_cs *engine, u32 *batch)#define CTX_WA_BB_OBJ_SIZE (PAGE_SIZE) -static int lrc_setup_wa_ctx (struct intel_engine_cs *engine) +static int lrc_init_wa_ctx (struct intel_engine_cs *engine) {struct drm_i915_gem_object *obj;struct i915_vma *vma;
@@ -3988,10 +3988,6 @@ static int lrc_setup_wa_ctx(struct intel_engine_cs *engine) goto err; } - err =i915_ggtt_pin (vma,NULL ,0 ,PIN_HIGH ); -if (err) - goto err; - engine->wa_ctx.vma = vma;return 0 ;
@@ -4000,9 +3996,16 @@ static int lrc_setup_wa_ctx(struct intel_engine_cs *engine)return err; } -static void lrc_destroy_wa_ctx (struct intel_engine_cs *engine) +static void lrc_destroy_wa_ctx (struct intel_engine_cs *engine,bool unpin) { -i915_vma_unpin_and_release (&engine->wa_ctx.vma,0 ); +if (!engine->wa_ctx.vma) +return ; + +if (unpin) +i915_vma_unpin (engine->wa_ctx.vma); + +i915_vma_put (engine->wa_ctx.vma); + engine->wa_ctx.vma =NULL ; }typedef u32 *(*wa_bb_func_t )(struct intel_engine_cs *engine,u32 *batch);
@@ -4014,6 +4017,7 @@ static int intel_init_workaround_bb(struct intel_engine_cs *engine) &wa_ctx->per_ctx };wa_bb_func_t wa_bb_fn[2 ];void *batch, *batch_ptr; +struct i915_gem_ww_ctx ww;unsigned int i;int ret;
@@ -4041,13 +4045,21 @@ static int intel_init_workaround_bb(struct intel_engine_cs *engine)return 0 ; } - ret =lrc_setup_wa_ctx (engine); + ret =lrc_init_wa_ctx (engine);if (ret) {drm_dbg (&engine->i915->drm,"Failed to setup context WA page: %d\n" , ret);return ret; } +i915_gem_ww_ctx_init (&ww, true); +retry: + ret =i915_gem_object_lock (wa_ctx->vma->obj, &ww); +if (!ret) + ret =i915_ggtt_pin (wa_ctx->vma, &ww,0 ,PIN_HIGH ); +if (ret) + goto err; + batch =i915_gem_object_pin_map (wa_ctx->vma->obj,I915_MAP_WB );/*
@@ -4071,8 +4083,19 @@ static int intel_init_workaround_bb(struct intel_engine_cs *engine)__i915_gem_object_flush_map (wa_ctx->vma->obj,0 , batch_ptr - batch);__i915_gem_object_release_map (wa_ctx->vma->obj); + +if (ret) +i915_vma_unpin (wa_ctx->vma); + +err: +if (ret == -EDEADLK ) { + ret =i915_gem_ww_ctx_backoff (&ww); +if (!ret) + goto retry; + } +i915_gem_ww_ctx_fini (&ww);if (ret) -lrc_destroy_wa_ctx (engine); +lrc_destroy_wa_ctx (engine, false);return ret; }
@@ -5147,7 +5170,7 @@ static void execlists_release(struct intel_engine_cs *engine)execlists_shutdown (engine);intel_engine_cleanup_common (engine); -lrc_destroy_wa_ctx (engine); +lrc_destroy_wa_ctx (engine, true); } static void
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 26/63 drm/i915: Make __engine_unpark() compatible with ww locking.
In reply to Maarten LankhorstTake the ww lock around engine_unpark. Because of the many many places where rpm is used, I chose the safest option and used a trylock to opportunistically take this lock for __engine_unpark.
--- drivers/gpu/drm/i915/gt/intel_engine_pm.c | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-)
drivers/gpu/drm/i915/gt/intel_engine_pm.c +3 -1
@@ -33,7 +33,8 @@ static int __engine_unpark(struct intel_wakeref *wf)GEM_BUG_ON (test_bit (CONTEXT_VALID_BIT , &ce->flags));/* First poison the image to verify we never fully trust it */ -if (IS_ENABLED (CONFIG_DRM_I915_DEBUG_GEM ) && ce->state) { +if (IS_ENABLED (CONFIG_DRM_I915_DEBUG_GEM ) && ce->state && +i915_gem_object_trylock (ce->state->obj)) {struct drm_i915_gem_object *obj = ce->state->obj;int type =i915_coherent_map_type (engine->i915);void *map;
@@ -44,6 +45,7 @@ static int __engine_unpark(struct intel_wakeref *wf)i915_gem_object_flush_map (obj);i915_gem_object_unpin_map (obj); } +i915_gem_object_unlock (obj); } ce->ops->reset (ce);
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 27/63 drm/i915: Take obj lock around set_domain ioctl
In reply to Maarten LankhorstWe need to lock the object to move it to the correct domain, add the missing lock.
--- drivers/gpu/drm/i915/gem/i915_gem_domain.c | 17 +++++++++-------- 1 file changed, 9 insertions(+), 8 deletions(-)
drivers/gpu/drm/i915/gem/i915_gem_domain.c +9 -8
@@ -531,6 +531,10 @@ i915_gem_set_domain_ioctl(struct drm_device *dev, void *data, goto out; } + err =i915_gem_object_lock_interruptible (obj,NULL ); +if (err) + goto out; +/* * Flush and acquire obj->pages so that we are coherent through * direct access in memory with previous cached writes through
@@ -542,11 +546,7 @@ i915_gem_set_domain_ioctl(struct drm_device *dev, void *data,*/ err =i915_gem_object_pin_pages (obj);if (err) - goto out; - - err =i915_gem_object_lock_interruptible (obj,NULL ); -if (err) - goto out_unpin; + goto out_unlock;if (read_domains &I915_GEM_DOMAIN_WC ) err =i915_gem_object_set_to_wc_domain (obj, write_domain);
@@ -558,13 +558,14 @@ i915_gem_set_domain_ioctl(struct drm_device *dev, void *data,/* And bump the LRU for this access */ i915_gem_object_bump_inactive_ggtt (obj); +i915_gem_object_unpin_pages (obj); + +out_unlock:i915_gem_object_unlock (obj); -if (write_domain) +if (!err && write_domain)i915_gem_object_invalidate_frontbuffer (obj,ORIGIN_CPU ); -out_unpin: -i915_gem_object_unpin_pages (obj); out:i915_gem_object_put (obj);return err;
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 28/63 drm/i915: Defer pin calls in buffer pool until first use by caller.
In reply to Maarten LankhorstWe need to take the obj lock to pin pages, so wait until the callers have done so, before making the object unshrinkable.
--- .../gpu/drm/i915/gem/i915_gem_execbuffer.c | 2 + .../gpu/drm/i915/gem/i915_gem_object_blt.c | 6 +++ .../gpu/drm/i915/gt/intel_gt_buffer_pool.c | 47 +++++++++---------- .../gpu/drm/i915/gt/intel_gt_buffer_pool.h | 5 ++ .../drm/i915/gt/intel_gt_buffer_pool_types.h | 1 + 5 files changed, 35 insertions(+), 26 deletions(-)
drivers/gpu/drm/i915/gem/i915_gem_execbuffer.c +2 -0
@@ -1332,6 +1332,7 @@ static int __reloc_gpu_alloc(struct i915_execbuffer *eb, err =PTR_ERR (cmd); goto err_pool; } +intel_gt_buffer_pool_mark_used (pool); batch =i915_vma_instance (pool->obj, vma->vm,NULL );if (IS_ERR (batch)) {
@@ -2622,6 +2623,7 @@ static int eb_parse(struct i915_execbuffer *eb) err =PTR_ERR (shadow); goto err; } +intel_gt_buffer_pool_mark_used (pool);i915_gem_object_set_readonly (shadow->obj); shadow->private = pool;
drivers/gpu/drm/i915/gem/i915_gem_object_blt.c +6 -0
@@ -54,6 +54,9 @@ struct i915_vma *intel_emit_vma_fill_blt(struct intel_context *ce,if (unlikely (err)) goto out_put; +/* we pinned the pool, mark it as such */ +intel_gt_buffer_pool_mark_used (pool); + cmd =i915_gem_object_pin_map (pool->obj,I915_MAP_WC );if (IS_ERR (cmd)) { err =PTR_ERR (cmd);
@@ -276,6 +279,9 @@ struct i915_vma *intel_emit_vma_copy_blt(struct intel_context *ce,if (unlikely (err)) goto out_put; +/* we pinned the pool, mark it as such */ +intel_gt_buffer_pool_mark_used (pool); + cmd =i915_gem_object_pin_map (pool->obj,I915_MAP_WC );if (IS_ERR (cmd)) { err =PTR_ERR (cmd);
drivers/gpu/drm/i915/gt/intel_gt_buffer_pool.c +21 -26
72 lines not on this page · raw message
drivers/gpu/drm/i915/gt/intel_gt_buffer_pool.h +5 -0
@@ -17,10 +17,15 @@ struct i915_request;struct intel_gt_buffer_pool_node *intel_gt_get_buffer_pool (struct intel_gt *gt,size_t size); +void intel_gt_buffer_pool_mark_used (struct intel_gt_buffer_pool_node *node); +static inline int intel_gt_buffer_pool_mark_active (struct intel_gt_buffer_pool_node *node,struct i915_request *rq) { +/* did we call mark_used? */ +GEM_WARN_ON (!node->pinned); +return i915_active_add_request (&node->active, rq); }
drivers/gpu/drm/i915/gt/intel_gt_buffer_pool_types.h +1 -0
@@ -31,6 +31,7 @@ struct intel_gt_buffer_pool_node { struct rcu_head rcu; };unsigned long age; +bool pinned; };#endif /* INTEL_GT_BUFFER_POOL_TYPES_H */
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 29/63 drm/i915: Fix pread/pwrite to work with new locking rules.
In reply to Maarten LankhorstWe are removing obj->mm.lock, and need to take the reservation lock before we can pin pages. Move the pinning pages into the helper, and merge gtt pwrite/pread preparation and cleanup paths.
The fence lock is also removed; it will conflict with fence annotations, because of memory allocations done when pagefaulting inside copy_*_user.
--- drivers/gpu/drm/i915/Makefile | 1 - drivers/gpu/drm/i915/gem/i915_gem_fence.c | 95 -------- drivers/gpu/drm/i915/gem/i915_gem_object.h | 5 - drivers/gpu/drm/i915/i915_gem.c | 247 +++++++++++---------- 4 files changed, 133 insertions(+), 215 deletions(-) delete mode 100644 drivers/gpu/drm/i915/gem/i915_gem_fence.c
drivers/gpu/drm/i915/Makefile +0 -1
@@ -134,7 +134,6 @@ gem-y += \ gem/i915_gem_dmabuf.o \ gem/i915_gem_domain.o \ gem/i915_gem_execbuffer.o \ - gem/i915_gem_fence.o \ gem/i915_gem_internal.o \ gem/i915_gem_object.o \ gem/i915_gem_object_blt.o \
drivers/gpu/drm/i915/gem/i915_gem_fence.c deleted +0 -95
95 lines not on this page · raw message
drivers/gpu/drm/i915/gem/i915_gem_object.h +0 -5
@@ -157,11 +157,6 @@ static inline void i915_gem_object_unlock(struct drm_i915_gem_object *obj)dma_resv_unlock (obj->base.resv); } -struct dma_fence * -i915_gem_object_lock_fence (struct drm_i915_gem_object *obj); -void i915_gem_object_unlock_fence (struct drm_i915_gem_object *obj, -struct dma_fence *fence); -static inline void i915_gem_object_set_readonly (struct drm_i915_gem_object *obj) {
drivers/gpu/drm/i915/i915_gem.c +133 -114
383 lines not on this page · raw message
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 30/63 drm/i915: Fix workarounds selftest, part 1
In reply to Maarten Lankhorstpin_map needs the ww lock, so ensure we pin both before submission.
--- drivers/gpu/drm/i915/gem/i915_gem_object.h | 3 + drivers/gpu/drm/i915/gem/i915_gem_pages.c | 12 +++ .../gpu/drm/i915/gt/selftest_workarounds.c | 76 ++++++++++++------- 3 files changed, 64 insertions(+), 27 deletions(-)
drivers/gpu/drm/i915/gem/i915_gem_object.h +3 -0
@@ -389,6 +389,9 @@ enum i915_map_type {void *__must_check i915_gem_object_pin_map (struct drm_i915_gem_object *obj,enum i915_map_type type); +void *__must_check i915_gem_object_pin_map_unlocked (struct drm_i915_gem_object *obj, +enum i915_map_type type); +void __i915_gem_object_flush_map (struct drm_i915_gem_object *obj,unsigned long offset,unsigned long size);
drivers/gpu/drm/i915/gem/i915_gem_pages.c +12 -0
@@ -409,6 +409,18 @@ void *i915_gem_object_pin_map(struct drm_i915_gem_object *obj, goto out_unlock; } +void *i915_gem_object_pin_map_unlocked (struct drm_i915_gem_object *obj, +enum i915_map_type type) +{ +void *ret; + +i915_gem_object_lock (obj,NULL ); + ret =i915_gem_object_pin_map (obj, type); +i915_gem_object_unlock (obj); + +return ret; +} +void __i915_gem_object_flush_map (struct drm_i915_gem_object *obj,unsigned long offset,unsigned long size)
drivers/gpu/drm/i915/gt/selftest_workarounds.c +49 -27
177 lines not on this page · raw message
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 31/63 drm/i915: Prepare for obj->mm.lock removal
In reply to Maarten LankhorstFrom: Thomas Hellström <[email protected]>
Stolen objects need to lock, and we may call put_pages when refcount drops to 0, ensure all calls are handled correctly.
Idea-from: Thomas Hellström <[email protected]>
--- drivers/gpu/drm/i915/gem/i915_gem_object.h | 14 ++++++++++++++ drivers/gpu/drm/i915/gem/i915_gem_pages.c | 14 ++++++++++++-- drivers/gpu/drm/i915/gem/i915_gem_stolen.c | 10 +++++++++- 3 files changed, 35 insertions(+), 3 deletions(-)
drivers/gpu/drm/i915/gem/i915_gem_object.h +14 -0
@@ -112,6 +112,20 @@ i915_gem_object_put(struct drm_i915_gem_object *obj)#define assert_object_held (obj) dma_resv_assert_held((obj)->base.resv) +/* +* If more than one potential simultaneous locker, assert held. +*/ +static inline void assert_object_held_shared (struct drm_i915_gem_object *obj) +{ +/* +* Note mm list lookup is protected by +* kref_get_unless_zero(). +*/ +if (IS_ENABLED (CONFIG_LOCKDEP ) && +kref_read (&obj->base.refcount) >0 ) +lockdep_assert_held (&obj->mm.lock); +} +static inline int __i915_gem_object_lock (struct drm_i915_gem_object *obj,struct i915_gem_ww_ctx *ww,bool intr)
drivers/gpu/drm/i915/gem/i915_gem_pages.c +12 -2
@@ -18,7 +18,7 @@ void __i915_gem_object_set_pages(struct drm_i915_gem_object *obj,unsigned long supported =INTEL_INFO (i915)->page_sizes;int i; -lockdep_assert_held (&obj->mm.lock); +assert_object_held_shared (obj);if (i915_gem_object_is_volatile (obj)) obj->mm.madv =I915_MADV_DONTNEED ;
@@ -67,6 +67,7 @@ void __i915_gem_object_set_pages(struct drm_i915_gem_object *obj,struct list_head *list;unsigned long flags; +lockdep_assert_held (&obj->mm.lock);spin_lock_irqsave (&i915->mm.obj_lock, flags); i915->mm.shrink_count++;
@@ -88,6 +89,8 @@ int ____i915_gem_object_get_pages(struct drm_i915_gem_object *obj)struct drm_i915_private *i915 =to_i915 (obj->base.dev);int err; +assert_object_held_shared (obj); +if (unlikely (obj->mm.madv !=I915_MADV_WILLNEED )) {drm_dbg (&i915->drm,"Attempting to obtain a purgeable object\n" );
@@ -115,6 +118,8 @@ int __i915_gem_object_get_pages(struct drm_i915_gem_object *obj)if (err)return err; +assert_object_held_shared (obj); +if (unlikely (!i915_gem_object_has_pages (obj))) {GEM_BUG_ON (i915_gem_object_has_pinned_pages (obj));
@@ -142,7 +147,7 @@ void i915_gem_object_truncate(struct drm_i915_gem_object *obj)/* Try to discard unwanted pages */ void i915_gem_object_writeback (struct drm_i915_gem_object *obj) { -lockdep_assert_held (&obj->mm.lock); +assert_object_held_shared (obj);GEM_BUG_ON (i915_gem_object_has_pages (obj));if (obj->ops->writeback)
@@ -175,6 +180,8 @@ __i915_gem_object_unset_pages(struct drm_i915_gem_object *obj) {struct sg_table *pages; +assert_object_held_shared (obj); + pages =fetch_and_zero (&obj->mm.pages);if (IS_ERR_OR_NULL (pages))return pages;
@@ -202,6 +209,9 @@ int __i915_gem_object_put_pages_locked(struct drm_i915_gem_object *obj)if (i915_gem_object_has_pinned_pages (obj))return -EBUSY ; +/* May be called by shrinker from within get_pages() (on another bo) */ +assert_object_held_shared (obj); +i915_gem_object_release_mmap_offset (obj);/*
drivers/gpu/drm/i915/gem/i915_gem_stolen.c +9 -1
@@ -593,11 +593,19 @@ __i915_gem_object_create_stolen(struct intel_memory_region *mem, cache_level =HAS_LLC (mem->i915) ?I915_CACHE_LLC :I915_CACHE_NONE ;i915_gem_object_set_cache_coherency (obj, cache_level); +if (WARN_ON (!i915_gem_object_trylock (obj))) { + err = -EBUSY ; + goto cleanup; + } + err =i915_gem_object_pin_pages (obj); -if (err) +if (err) { +i915_gem_object_unlock (obj); goto cleanup; + }i915_gem_object_init_memory_region (obj, mem); +i915_gem_object_unlock (obj);return obj;
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 32/63 drm/i915: Add igt_spinner_pin() to allow for ww locking around spinner.
In reply to Maarten LankhorstBy default, we assume that it's called inside igt_create_request to keep existing selftests working, but allow for manual pinning when passing a ww context.
--- drivers/gpu/drm/i915/selftests/igt_spinner.c | 136 ++++++++++++------- drivers/gpu/drm/i915/selftests/igt_spinner.h | 5 + 2 files changed, 95 insertions(+), 46 deletions(-)
drivers/gpu/drm/i915/selftests/igt_spinner.c +90 -46
@@ -11,8 +11,6 @@int igt_spinner_init (struct igt_spinner *spin,struct intel_gt *gt) { -unsigned int mode; -void *vaddr;int err;memset (spin,0 ,sizeof (*spin));
@@ -23,6 +21,7 @@ int igt_spinner_init(struct igt_spinner *spin, struct intel_gt *gt) err =PTR_ERR (spin->hws); goto err; } +i915_gem_object_set_cache_coherency (spin->hws,I915_CACHE_LLC ); spin->obj =i915_gem_object_create_internal (gt->i915,PAGE_SIZE );if (IS_ERR (spin->obj)) {
@@ -30,34 +29,83 @@ int igt_spinner_init(struct igt_spinner *spin, struct intel_gt *gt) goto err_hws; } -i915_gem_object_set_cache_coherency (spin->hws,I915_CACHE_LLC ); - vaddr =i915_gem_object_pin_map (spin->hws,I915_MAP_WB ); -if (IS_ERR (vaddr)) { - err =PTR_ERR (vaddr); - goto err_obj; - } - spin->seqno =memset (vaddr,0xff ,PAGE_SIZE ); - - mode =i915_coherent_map_type (gt->i915); - vaddr =i915_gem_object_pin_map (spin->obj, mode); -if (IS_ERR (vaddr)) { - err =PTR_ERR (vaddr); - goto err_unpin_hws; - } - spin->batch = vaddr; -return 0 ; -err_unpin_hws: -i915_gem_object_unpin_map (spin->hws); -err_obj: -i915_gem_object_put (spin->obj); err_hws:i915_gem_object_put (spin->hws); err:return err; } +static void *igt_spinner_pin_obj (struct intel_context *ce, +struct i915_gem_ww_ctx *ww, +struct drm_i915_gem_object *obj, +unsigned int mode,struct i915_vma **vma) +{ +void *vaddr; +int ret; + + *vma =i915_vma_instance (obj, ce->vm,NULL ); +if (IS_ERR (*vma)) +return ERR_CAST (*vma); + + ret =i915_gem_object_lock (obj, ww); +if (ret) +return ERR_PTR (ret); + + vaddr =i915_gem_object_pin_map (obj, mode); + +if (!ww) +i915_gem_object_unlock (obj); + +if (IS_ERR (vaddr)) +return vaddr; + +if (ww) + ret =i915_vma_pin_ww (*vma, ww,0 ,0 ,PIN_USER ); +else + ret =i915_vma_pin (*vma,0 ,0 ,PIN_USER ); + +if (ret) { +i915_gem_object_unpin_map (obj); +return ERR_PTR (ret); + } + +return vaddr; +} + +int igt_spinner_pin (struct igt_spinner *spin, +struct intel_context *ce, +struct i915_gem_ww_ctx *ww) +{ +void *vaddr; + +if (spin->ce &&WARN_ON (spin->ce != ce)) +return -ENODEV ; + spin->ce = ce; + +if (!spin->seqno) { + vaddr =igt_spinner_pin_obj (ce, ww, spin->hws,I915_MAP_WB , &spin->hws_vma); +if (IS_ERR (vaddr)) +return PTR_ERR (vaddr); + + spin->seqno =memset (vaddr,0xff ,PAGE_SIZE ); + } + +if (!spin->batch) { +unsigned int mode = +i915_coherent_map_type (spin->gt->i915); + + vaddr =igt_spinner_pin_obj (ce, ww, spin->obj, mode, &spin->batch_vma); +if (IS_ERR (vaddr)) +return PTR_ERR (vaddr); + + spin->batch = vaddr; + } + +return 0 ; +} +static unsigned int seqno_offset (u64 fence) {return offset_in_page (sizeof (u32) * fence);
@@ -102,27 +150,18 @@ igt_spinner_create_request(struct igt_spinner *spin,if (!intel_engine_can_store_dword (ce->engine))return ERR_PTR (-ENODEV ); - vma =i915_vma_instance (spin->obj, ce->vm,NULL ); -if (IS_ERR (vma)) -return ERR_CAST (vma); - - hws =i915_vma_instance (spin->hws, ce->vm,NULL ); -if (IS_ERR (hws)) -return ERR_CAST (hws); +if (!spin->batch) { + err =igt_spinner_pin (spin, ce,NULL ); +if (err) +return ERR_PTR (err); + } - err =i915_vma_pin (vma,0 ,0 ,PIN_USER ); -if (err) -return ERR_PTR (err); - - err =i915_vma_pin (hws,0 ,0 ,PIN_USER ); -if (err) - goto unpin_vma; + hws = spin->hws_vma; + vma = spin->batch_vma; rq =intel_context_create_request (ce); -if (IS_ERR (rq)) { - err =PTR_ERR (rq); - goto unpin_hws; - } +if (IS_ERR (rq)) +return ERR_CAST (rq); err =move_to_active (vma, rq,0 );if (err)
@@ -185,10 +224,6 @@ igt_spinner_create_request(struct igt_spinner *spin,i915_request_set_error_once (rq, err);i915_request_add (rq); } -unpin_hws: -i915_vma_unpin (hws); -unpin_vma: -i915_vma_unpin (vma);return err ?ERR_PTR (err) : rq; }
@@ -202,6 +237,9 @@ hws_seqno(const struct igt_spinner *spin, const struct i915_request *rq)void igt_spinner_end (struct igt_spinner *spin) { +if (!spin->batch) +return ; + *spin->batch =MI_BATCH_BUFFER_END ;intel_gt_chipset_flush (spin->gt); }
@@ -210,10 +248,16 @@ void igt_spinner_fini(struct igt_spinner *spin) {igt_spinner_end (spin); -i915_gem_object_unpin_map (spin->obj); +if (spin->batch) { +i915_vma_unpin (spin->batch_vma); +i915_gem_object_unpin_map (spin->obj); + }i915_gem_object_put (spin->obj); -i915_gem_object_unpin_map (spin->hws); +if (spin->seqno) { +i915_vma_unpin (spin->hws_vma); +i915_gem_object_unpin_map (spin->hws); + }i915_gem_object_put (spin->hws); }
drivers/gpu/drm/i915/selftests/igt_spinner.h +5 -0
@@ -20,11 +20,16 @@ struct igt_spinner {struct intel_gt *gt;struct drm_i915_gem_object *hws;struct drm_i915_gem_object *obj; +struct intel_context *ce; +struct i915_vma *hws_vma, *batch_vma;u32 *batch;void *seqno; };int igt_spinner_init (struct igt_spinner *spin,struct intel_gt *gt); +int igt_spinner_pin (struct igt_spinner *spin, +struct intel_context *ce, +struct i915_gem_ww_ctx *ww);void igt_spinner_fini (struct igt_spinner *spin); struct i915_request *
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 33/63 drm/i915: Add ww locking around vm_access()
In reply to Maarten Lankhorsti915_gem_object_pin_map potentially needs a ww context, so ensure we have one we can revoke.
--- drivers/gpu/drm/i915/gem/i915_gem_mman.c | 24 ++++++++++++++++++++++-- 1 file changed, 22 insertions(+), 2 deletions(-)
drivers/gpu/drm/i915/gem/i915_gem_mman.c +22 -2
@@ -421,7 +421,9 @@ vm_access(struct vm_area_struct *area, unsigned long addr, {struct i915_mmap_offset *mmo = area->vm_private_data;struct drm_i915_gem_object *obj = mmo->obj; +struct i915_gem_ww_ctx ww;void *vaddr; +int err =0 ;if (i915_gem_object_is_readonly (obj) && write)return -EACCES ;
@@ -430,10 +432,18 @@ vm_access(struct vm_area_struct *area, unsigned long addr,if (addr >= obj->base.size)return -EINVAL ; +i915_gem_ww_ctx_init (&ww, true); +retry: + err =i915_gem_object_lock (obj, &ww); +if (err) + goto out; +/* As this is primarily for debugging, let's focus on simplicity */ vaddr =i915_gem_object_pin_map (obj,I915_MAP_FORCE_WC ); -if (IS_ERR (vaddr)) -return PTR_ERR (vaddr); +if (IS_ERR (vaddr)) { + err =PTR_ERR (vaddr); + goto out; + }if (write) {memcpy (vaddr + addr, buf, len);
@@ -443,6 +453,16 @@ vm_access(struct vm_area_struct *area, unsigned long addr, }i915_gem_object_unpin_map (obj); +out: +if (err == -EDEADLK ) { + err =i915_gem_ww_ctx_backoff (&ww); +if (!err) + goto retry; + } +i915_gem_ww_ctx_fini (&ww); + +if (err) +return err;return len; }
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 34/63 drm/i915: Increase ww locking for perf.
In reply to Maarten LankhorstWe need to lock a few more objects, some temporarily, add ww lock where needed.
--- drivers/gpu/drm/i915/i915_perf.c | 56 ++++++++++++++++++++++++-------- 1 file changed, 43 insertions(+), 13 deletions(-)
drivers/gpu/drm/i915/i915_perf.c +43 -13
@@ -1579,7 +1579,7 @@ static int alloc_oa_buffer(struct i915_perf_stream *stream) stream->oa_buffer.vma = vma; stream->oa_buffer.vaddr = -i915_gem_object_pin_map (bo,I915_MAP_WB ); +i915_gem_object_pin_map_unlocked (bo,I915_MAP_WB );if (IS_ERR (stream->oa_buffer.vaddr)) { ret =PTR_ERR (stream->oa_buffer.vaddr); goto err_unpin;
@@ -1632,6 +1632,7 @@ static int alloc_noa_wait(struct i915_perf_stream *stream)const u32 base = stream->engine->mmio_base;#define CS_GPR (x) GEN8_RING_CS_GPR(base, x)u32 *batch, *ts0, *cs, *jump; +struct i915_gem_ww_ctx ww;int ret, i;enum {START_TS ,
@@ -1649,15 +1650,21 @@ static int alloc_noa_wait(struct i915_perf_stream *stream)return PTR_ERR (bo); } +i915_gem_ww_ctx_init (&ww, true); +retry: + ret =i915_gem_object_lock (bo, &ww); +if (ret) + goto out_ww; +/* * We pin in GGTT because we jump into this buffer now because * multiple OA config BOs will have a jump to this address and it * needs to be fixed during the lifetime of the i915/perf stream. */ - vma =i915_gem_object_ggtt_pin (bo,NULL ,0 ,0 ,PIN_HIGH ); + vma =i915_gem_object_ggtt_pin_ww (bo, &ww,NULL ,0 ,0 ,PIN_HIGH );if (IS_ERR (vma)) { ret =PTR_ERR (vma); - goto err_unref; + goto out_ww; } batch = cs =i915_gem_object_pin_map (bo,I915_MAP_WB );
@@ -1791,12 +1798,19 @@ static int alloc_noa_wait(struct i915_perf_stream *stream)__i915_gem_object_release_map (bo); stream->noa_wait = vma; -return 0 ; + goto out_ww; err_unpin:i915_vma_unpin_and_release (&vma,0 ); -err_unref: -i915_gem_object_put (bo); +out_ww: +if (ret == -EDEADLK ) { + ret =i915_gem_ww_ctx_backoff (&ww); +if (!ret) + goto retry; + } +i915_gem_ww_ctx_fini (&ww); +if (ret) +i915_gem_object_put (bo);return ret; }
@@ -1839,6 +1853,7 @@ alloc_oa_config_buffer(struct i915_perf_stream *stream, {struct drm_i915_gem_object *obj;struct i915_oa_config_bo *oa_bo; +struct i915_gem_ww_ctx ww;size_t config_length =0 ;u32 *cs;int err;
@@ -1859,10 +1874,16 @@ alloc_oa_config_buffer(struct i915_perf_stream *stream, goto err_free; } +i915_gem_ww_ctx_init (&ww, true); +retry: + err =i915_gem_object_lock (obj, &ww); +if (err) + goto out_ww; + cs =i915_gem_object_pin_map (obj,I915_MAP_WB );if (IS_ERR (cs)) { err =PTR_ERR (cs); - goto err_oa_bo; + goto out_ww; } cs = write_cs_mi_lri(cs,
@@ -1890,19 +1911,28 @@ alloc_oa_config_buffer(struct i915_perf_stream *stream, NULL);if (IS_ERR (oa_bo->vma)) { err =PTR_ERR (oa_bo->vma); - goto err_oa_bo; + goto out_ww; } oa_bo->oa_config =i915_oa_config_get (oa_config);llist_add (&oa_bo->node, &stream->oa_config_bos); -return oa_bo; +out_ww: +if (err == -EDEADLK ) { + err =i915_gem_ww_ctx_backoff (&ww); +if (!err) + goto retry; + } +i915_gem_ww_ctx_fini (&ww); -err_oa_bo: -i915_gem_object_put (obj); +if (err) +i915_gem_object_put (obj); err_free: -kfree (oa_bo); -return ERR_PTR (err); +if (err) { +kfree (oa_bo); +return ERR_PTR (err); + } +return oa_bo; } static struct i915_vma *
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 35/63 drm/i915: Lock ww in ucode objects correctly
In reply to Maarten LankhorstIn the ucode functions, the calls are done before userspace runs, when debugging using debugfs, or when creating semi-permanent mappings; we can safely use the unlocked versions that does the ww dance for us.
Because there is no pin_pages_unlocked yet, add it as convenience function.
This removes possible lockdep splats about missing resv lock for ucode.
--- drivers/gpu/drm/i915/gem/i915_gem_object.h | 2 ++ drivers/gpu/drm/i915/gem/i915_gem_pages.c | 20 ++++++++++++++++++++ drivers/gpu/drm/i915/gt/uc/intel_guc.c | 2 +- drivers/gpu/drm/i915/gt/uc/intel_guc_log.c | 4 ++-- drivers/gpu/drm/i915/gt/uc/intel_huc.c | 2 +- drivers/gpu/drm/i915/gt/uc/intel_uc_fw.c | 2 +- 6 files changed, 27 insertions(+), 5 deletions(-)
drivers/gpu/drm/i915/gem/i915_gem_object.h +2 -0
@@ -336,6 +336,8 @@ i915_gem_object_pin_pages(struct drm_i915_gem_object *obj)return __i915_gem_object_get_pages (obj); } +int i915_gem_object_pin_pages_unlocked (struct drm_i915_gem_object *obj); +static inline bool i915_gem_object_has_pages (struct drm_i915_gem_object *obj) {
drivers/gpu/drm/i915/gem/i915_gem_pages.c +20 -0
@@ -136,6 +136,26 @@ int __i915_gem_object_get_pages(struct drm_i915_gem_object *obj)return err; } +int i915_gem_object_pin_pages_unlocked (struct drm_i915_gem_object *obj) +{ +struct i915_gem_ww_ctx ww; +int err; + +i915_gem_ww_ctx_init (&ww, true); +retry: + err =i915_gem_object_lock (obj, &ww); +if (!err) + err =i915_gem_object_pin_pages (obj); + +if (err == -EDEADLK ) { + err =i915_gem_ww_ctx_backoff (&ww); +if (!err) + goto retry; + } +i915_gem_ww_ctx_fini (&ww); +return err; +} +/* Immediately discard the backing storage */ void i915_gem_object_truncate (struct drm_i915_gem_object *obj) {
drivers/gpu/drm/i915/gt/uc/intel_guc.c +1 -1
@@ -712,7 +712,7 @@ int intel_guc_allocate_and_map_vma(struct intel_guc *guc, u32 size,if (IS_ERR (vma))return PTR_ERR (vma); - vaddr =i915_gem_object_pin_map (vma->obj,I915_MAP_WB ); + vaddr =i915_gem_object_pin_map_unlocked (vma->obj,I915_MAP_WB );if (IS_ERR (vaddr)) {i915_vma_unpin_and_release (&vma,0 );return PTR_ERR (vaddr);
drivers/gpu/drm/i915/gt/uc/intel_guc_log.c +2 -2
@@ -335,7 +335,7 @@ static int guc_log_map(struct intel_guc_log *log)* buffer pages, so that we can directly get the data * (up-to-date) from memory. */ - vaddr =i915_gem_object_pin_map (log->vma->obj,I915_MAP_WC ); + vaddr =i915_gem_object_pin_map_unlocked (log->vma->obj,I915_MAP_WC );if (IS_ERR (vaddr))return PTR_ERR (vaddr);
@@ -744,7 +744,7 @@ int intel_guc_log_dump(struct intel_guc_log *log, struct drm_printer *p,if (!obj)return 0 ; - map =i915_gem_object_pin_map (obj,I915_MAP_WC ); + map =i915_gem_object_pin_map_unlocked (obj,I915_MAP_WC );if (IS_ERR (map)) {DRM_DEBUG ("Failed to pin object\n" );drm_puts (p,"(log data unaccessible)\n" );
drivers/gpu/drm/i915/gt/uc/intel_huc.c +1 -1
@@ -82,7 +82,7 @@ static int intel_huc_rsa_data_create(struct intel_huc *huc)if (IS_ERR (vma))return PTR_ERR (vma); - vaddr =i915_gem_object_pin_map (vma->obj,I915_MAP_WB ); + vaddr =i915_gem_object_pin_map_unlocked (vma->obj,I915_MAP_WB );if (IS_ERR (vaddr)) {i915_vma_unpin_and_release (&vma,0 );return PTR_ERR (vaddr);
drivers/gpu/drm/i915/gt/uc/intel_uc_fw.c +1 -1
@@ -542,7 +542,7 @@ int intel_uc_fw_init(struct intel_uc_fw *uc_fw)if (!intel_uc_fw_is_available (uc_fw))return -ENOEXEC ; - err =i915_gem_object_pin_pages (uc_fw->obj); + err =i915_gem_object_pin_pages_unlocked (uc_fw->obj);if (err) {DRM_DEBUG_DRIVER ("%s fw pin-pages err=%d\n" ,intel_uc_fw_type_repr (uc_fw->type), err);
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 36/63 drm/i915: Add ww locking to dma-buf ops.
In reply to Maarten Lankhorstvmap is using pin_pages, but needs to use ww locking, add pin_pages_unlocked to correctly lock the mapping.
Also add ww locking to begin/end cpu access.
--- drivers/gpu/drm/i915/gem/i915_gem_dmabuf.c | 60 ++++++++++++---------- 1 file changed, 33 insertions(+), 27 deletions(-)
drivers/gpu/drm/i915/gem/i915_gem_dmabuf.c +33 -27
@@ -82,7 +82,7 @@ static int i915_gem_dmabuf_vmap(struct dma_buf *dma_buf, struct dma_buf_map *mapstruct drm_i915_gem_object *obj =dma_buf_to_obj (dma_buf);void *vaddr; - vaddr =i915_gem_object_pin_map (obj,I915_MAP_WB ); + vaddr =i915_gem_object_pin_map_unlocked (obj,I915_MAP_WB );if (IS_ERR (vaddr))return PTR_ERR (vaddr);
@@ -124,42 +124,48 @@ static int i915_gem_begin_cpu_access(struct dma_buf *dma_buf, enum dma_data_dire {struct drm_i915_gem_object *obj =dma_buf_to_obj (dma_buf);bool write = (direction ==DMA_BIDIRECTIONAL || direction ==DMA_TO_DEVICE ); +struct i915_gem_ww_ctx ww;int err; - err =i915_gem_object_pin_pages (obj); -if (err) -return err; - - err =i915_gem_object_lock_interruptible (obj,NULL ); -if (err) - goto out; - - err =i915_gem_object_set_to_cpu_domain (obj, write); -i915_gem_object_unlock (obj); - -out: -i915_gem_object_unpin_pages (obj); +i915_gem_ww_ctx_init (&ww, true); +retry: + err =i915_gem_object_lock (obj, &ww); +if (!err) + err =i915_gem_object_pin_pages (obj); +if (!err) { + err =i915_gem_object_set_to_cpu_domain (obj, write); +i915_gem_object_unpin_pages (obj); + } +if (err == -EDEADLK ) { + err =i915_gem_ww_ctx_backoff (&ww); +if (!err) + goto retry; + } +i915_gem_ww_ctx_fini (&ww);return err; }static int i915_gem_end_cpu_access (struct dma_buf *dma_buf,enum dma_data_direction direction) {struct drm_i915_gem_object *obj =dma_buf_to_obj (dma_buf); +struct i915_gem_ww_ctx ww;int err; - err =i915_gem_object_pin_pages (obj); -if (err) -return err; - - err =i915_gem_object_lock_interruptible (obj,NULL ); -if (err) - goto out; - - err =i915_gem_object_set_to_gtt_domain (obj, false); -i915_gem_object_unlock (obj); - -out: -i915_gem_object_unpin_pages (obj); +i915_gem_ww_ctx_init (&ww, true); +retry: + err =i915_gem_object_lock (obj, &ww); +if (!err) + err =i915_gem_object_pin_pages (obj); +if (!err) { + err =i915_gem_object_set_to_gtt_domain (obj, false); +i915_gem_object_unpin_pages (obj); + } +if (err == -EDEADLK ) { + err =i915_gem_ww_ctx_backoff (&ww); +if (!err) + goto retry; + } +i915_gem_ww_ctx_fini (&ww);return err; }
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 37/63 drm/i915: Add missing ww lock in intel_dsb_prepare.
In reply to Maarten LankhorstBecause of the long lifetime of the mapping, we cannot wrap this in a simple limited ww lock. Just use the unlocked version of pin_map, because we'll likely release the mapping a lot later, in a different thread.
--- drivers/gpu/drm/i915/display/intel_dsb.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
drivers/gpu/drm/i915/display/intel_dsb.c +1 -1
@@ -293,7 +293,7 @@ void intel_dsb_prepare(struct intel_crtc_state *crtc_state) goto out; } - buf =i915_gem_object_pin_map (vma->obj,I915_MAP_WC ); + buf =i915_gem_object_pin_map_unlocked (vma->obj,I915_MAP_WC );if (IS_ERR (buf)) {drm_err (&i915->drm,"Command buffer creation failed\n" );i915_vma_unpin_and_release (&vma,I915_VMA_RELEASE_MAP );
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 38/63 drm/i915: Fix ww locking in shmem_create_from_object
In reply to Maarten LankhorstQuick fix, just use the unlocked version.
--- drivers/gpu/drm/i915/gt/shmem_utils.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
drivers/gpu/drm/i915/gt/shmem_utils.c +1 -1
@@ -39,7 +39,7 @@ struct file *shmem_create_from_object(struct drm_i915_gem_object *obj)return file; } - ptr =i915_gem_object_pin_map (obj,I915_MAP_WB ); + ptr =i915_gem_object_pin_map_unlocked (obj,I915_MAP_WB );if (IS_ERR (ptr))return ERR_CAST (ptr);
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 39/63 drm/i915: Use a single page table lock for each gtt.
In reply to Maarten LankhorstWe may create page table objects on the fly, but we may need to wait with the ww lock held. Instead of waiting on a freed obj lock, ensure we have the same lock for each object to keep -EDEADLK working. This ensures that i915_vma_pin_ww can lock the page tables when required.
--- drivers/gpu/drm/i915/gt/intel_ggtt.c | 8 +++++- drivers/gpu/drm/i915/gt/intel_gtt.c | 38 ++++++++++++++++++++++++++- drivers/gpu/drm/i915/gt/intel_gtt.h | 5 ++++ drivers/gpu/drm/i915/gt/intel_ppgtt.c | 3 ++- drivers/gpu/drm/i915/i915_vma.c | 5 ++++ 5 files changed, 56 insertions(+), 3 deletions(-)
drivers/gpu/drm/i915/gt/intel_ggtt.c +7 -1
@@ -615,7 +615,9 @@ static int init_aliasing_ppgtt(struct i915_ggtt *ggtt)if (err) goto err_ppgtt; +i915_gem_object_lock (ppgtt->vm.scratch[0 ],NULL ); err =i915_vm_pin_pt_stash (&ppgtt->vm, &stash); +i915_gem_object_unlock (ppgtt->vm.scratch[0 ]);if (err) goto err_stash;
@@ -702,6 +704,7 @@ static void ggtt_cleanup_hw(struct i915_ggtt *ggtt)mutex_unlock (&ggtt->vm.mutex);i915_address_space_fini (&ggtt->vm); +dma_resv_fini (&ggtt->vm.resv);arch_phys_wc_del (ggtt->mtrr);
@@ -1078,6 +1081,7 @@ static int ggtt_probe_hw(struct i915_ggtt *ggtt, struct intel_gt *gt) ggtt->vm.gt = gt; ggtt->vm.i915 = i915; ggtt->vm.dma = &i915->drm.pdev->dev; +dma_resv_init (&ggtt->vm.resv);if (INTEL_GEN (i915) <=5 ) ret =i915_gmch_probe (ggtt);
@@ -1085,8 +1089,10 @@ static int ggtt_probe_hw(struct i915_ggtt *ggtt, struct intel_gt *gt) ret =gen6_gmch_probe (ggtt); else ret =gen8_gmch_probe (ggtt); -if (ret) +if (ret) { +dma_resv_fini (&ggtt->vm.resv);return ret; + }if ((ggtt->vm.total -1 ) >>32 ) { drm_err(&i915->drm,
drivers/gpu/drm/i915/gt/intel_gtt.c +37 -1
@@ -13,16 +13,36 @@struct drm_i915_gem_object *alloc_pt_dma (struct i915_address_space *vm,int sz) { +struct drm_i915_gem_object *obj; +if (I915_SELFTEST_ONLY (should_fail (&vm->fault_attr,1 )))i915_gem_shrink_all (vm->i915); -return i915_gem_object_create_internal (vm->i915, sz); + obj =i915_gem_object_create_internal (vm->i915, sz); +/* ensure all dma objects have the same reservation class */ +if (!IS_ERR (obj)) + obj->base.resv = &vm->resv; +return obj; }int pin_pt_dma (struct i915_address_space *vm,struct drm_i915_gem_object *obj) {int err; +i915_gem_object_lock (obj,NULL ); + err =i915_gem_object_pin_pages (obj); +i915_gem_object_unlock (obj); +if (err) +return err; + +i915_gem_object_make_unshrinkable (obj); +return 0 ; +} + +int pin_pt_dma_locked (struct i915_address_space *vm,struct drm_i915_gem_object *obj) +{ +int err; + err =i915_gem_object_pin_pages (obj);if (err)return err;
@@ -56,6 +76,20 @@ void __i915_vm_close(struct i915_address_space *vm)mutex_unlock (&vm->mutex); } +/* lock the vm into the current ww, if we lock one, we lock all */ +int i915_vm_lock_objects (struct i915_address_space *vm, +struct i915_gem_ww_ctx *ww) +{ +if (vm->scratch[0 ]->base.resv == &vm->resv) { +return i915_gem_object_lock (vm->scratch[0 ], ww); + }else { +struct i915_ppgtt *ppgtt =i915_vm_to_ppgtt (vm); + +/* We borrowed the scratch page from ggtt, take the top level object */ +return i915_gem_object_lock (ppgtt->pd->pt.base, ww); + } +} +void i915_address_space_fini (struct i915_address_space *vm) {drm_mm_takedown (&vm->mm);
@@ -69,6 +103,7 @@ static void __i915_vm_release(struct work_struct *work) vm->cleanup (vm);i915_address_space_fini (vm); +dma_resv_fini (&vm->resv);kfree (vm); }
@@ -98,6 +133,7 @@ void i915_address_space_init(struct i915_address_space *vm, int subclass)mutex_init (&vm->mutex);lockdep_set_subclass (&vm->mutex, subclass);i915_gem_shrinker_taints_mutex (vm->i915, &vm->mutex); +dma_resv_init (&vm->resv);GEM_BUG_ON (!vm->total);drm_mm_init (&vm->mm,0 , vm->total);
drivers/gpu/drm/i915/gt/intel_gtt.h +5 -0
@@ -238,6 +238,7 @@ struct i915_address_space {atomic_t open;struct mutex mutex;/* protects vma and our lists */ +struct dma_resv resv;/* reservation lock for all pd objects, and buffer pool */ #define VM_CLASS_GGTT 0#define VM_CLASS_PPGTT 1
@@ -346,6 +347,9 @@ struct i915_ppgtt {#define i915_is_ggtt (vm) ((vm)->is_ggtt) +int __must_check +i915_vm_lock_objects (struct i915_address_space *vm,struct i915_gem_ww_ctx *ww); +static inline bool i915_vm_is_4lvl (const struct i915_address_space *vm) {
@@ -522,6 +526,7 @@ struct i915_page_directory *alloc_pd(struct i915_address_space *vm);struct i915_page_directory *__alloc_pd (int npde);int pin_pt_dma (struct i915_address_space *vm,struct drm_i915_gem_object *obj); +int pin_pt_dma_locked (struct i915_address_space *vm,struct drm_i915_gem_object *obj);void free_px (struct i915_address_space *vm,struct i915_page_table *pt,int lvl);
drivers/gpu/drm/i915/gt/intel_ppgtt.c +2 -1
@@ -262,7 +262,7 @@ int i915_vm_pin_pt_stash(struct i915_address_space *vm,for (n =0 ; n <ARRAY_SIZE (stash->pt); n++) {for (pt = stash->pt[n]; pt; pt = pt->stash) { - err =pin_pt_dma (vm, pt->base); + err =pin_pt_dma_locked (vm, pt->base);if (err)return err; }
@@ -304,6 +304,7 @@ void ppgtt_init(struct i915_ppgtt *ppgtt, struct intel_gt *gt) ppgtt->vm.dma = &i915->drm.pdev->dev; ppgtt->vm.total =BIT_ULL (INTEL_INFO (i915)->ppgtt_size); +dma_resv_init (&ppgtt->vm.resv);i915_address_space_init (&ppgtt->vm,VM_CLASS_PPGTT ); ppgtt->vm.vma_ops.bind_vma = ppgtt_bind_vma;
drivers/gpu/drm/i915/i915_vma.c +5 -0
@@ -882,6 +882,11 @@ int i915_vma_pin_ww(struct i915_vma *vma, struct i915_gem_ww_ctx *ww, wakeref =intel_runtime_pm_get (&vma->vm->i915->runtime_pm);if (flags & vma->vm->bind_async_flags) { +/* lock VM */ + err =i915_vm_lock_objects (vma->vm, ww); +if (err) + goto err_rpm; + work =i915_vma_work ();if (!work) { err = -ENOMEM ;
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 40/63 drm/i915/selftests: Prepare huge_pages testcases for obj->mm.lock removal.
In reply to Maarten LankhorstStraightforward conversion, just convert a bunch of calls to unlocked versions.
--- .../gpu/drm/i915/gem/selftests/huge_pages.c | 28 ++++++++++++++----- 1 file changed, 21 insertions(+), 7 deletions(-)
drivers/gpu/drm/i915/gem/selftests/huge_pages.c +21 -7
@@ -568,7 +568,7 @@ static int igt_mock_ppgtt_misaligned_dma(void *arg) goto out_put; } - err =i915_gem_object_pin_pages (obj); + err =i915_gem_object_pin_pages_unlocked (obj);if (err) goto out_put;
@@ -632,15 +632,19 @@ static int igt_mock_ppgtt_misaligned_dma(void *arg)break ; } +i915_gem_object_lock (obj,NULL );i915_gem_object_unpin_pages (obj);__i915_gem_object_put_pages (obj); +i915_gem_object_unlock (obj);i915_gem_object_put (obj); }return 0 ; out_unpin: +i915_gem_object_lock (obj,NULL );i915_gem_object_unpin_pages (obj); +i915_gem_object_unlock (obj); out_put:i915_gem_object_put (obj);
@@ -654,8 +658,10 @@ static void close_object_list(struct list_head *objects,list_for_each_entry_safe (obj, on, objects, st_link) {list_del (&obj->st_link); +i915_gem_object_lock (obj,NULL );i915_gem_object_unpin_pages (obj);__i915_gem_object_put_pages (obj); +i915_gem_object_unlock (obj);i915_gem_object_put (obj); } }
@@ -692,7 +698,7 @@ static int igt_mock_ppgtt_huge_fill(void *arg)break ; } - err =i915_gem_object_pin_pages (obj); + err =i915_gem_object_pin_pages_unlocked (obj);if (err) {i915_gem_object_put (obj);break ;
@@ -868,7 +874,7 @@ static int igt_mock_ppgtt_64K(void *arg)if (IS_ERR (obj))return PTR_ERR (obj); - err =i915_gem_object_pin_pages (obj); + err =i915_gem_object_pin_pages_unlocked (obj);if (err) goto out_object_put;
@@ -922,8 +928,10 @@ static int igt_mock_ppgtt_64K(void *arg) }i915_vma_unpin (vma); +i915_gem_object_lock (obj,NULL );i915_gem_object_unpin_pages (obj);__i915_gem_object_put_pages (obj); +i915_gem_object_unlock (obj);i915_gem_object_put (obj); } }
@@ -933,7 +941,9 @@ static int igt_mock_ppgtt_64K(void *arg) out_vma_unpin:i915_vma_unpin (vma); out_object_unpin: +i915_gem_object_lock (obj,NULL );i915_gem_object_unpin_pages (obj); +i915_gem_object_unlock (obj); out_object_put:i915_gem_object_put (obj);
@@ -1003,7 +1013,7 @@ static int __cpu_check_vmap(struct drm_i915_gem_object *obj, u32 dword, u32 val)if (err)return err; - ptr =i915_gem_object_pin_map (obj,I915_MAP_WC ); + ptr =i915_gem_object_pin_map_unlocked (obj,I915_MAP_WC );if (IS_ERR (ptr))return PTR_ERR (ptr);
@@ -1283,7 +1293,7 @@ static int igt_ppgtt_smoke_huge(void *arg)return err; } - err =i915_gem_object_pin_pages (obj); + err =i915_gem_object_pin_pages_unlocked (obj);if (err) {if (err == -ENXIO || err == -E2BIG ) {i915_gem_object_put (obj);
@@ -1306,8 +1316,10 @@ static int igt_ppgtt_smoke_huge(void *arg) __func__, size, i); } out_unpin: +i915_gem_object_lock (obj,NULL );i915_gem_object_unpin_pages (obj);__i915_gem_object_put_pages (obj); +i915_gem_object_unlock (obj); out_put:i915_gem_object_put (obj);
@@ -1380,7 +1392,7 @@ static int igt_ppgtt_sanity_check(void *arg)return err; } - err =i915_gem_object_pin_pages (obj); + err =i915_gem_object_pin_pages_unlocked (obj);if (err) {i915_gem_object_put (obj); goto out;
@@ -1394,8 +1406,10 @@ static int igt_ppgtt_sanity_check(void *arg) err =igt_write_huge (ctx, obj); +i915_gem_object_lock (obj,NULL );i915_gem_object_unpin_pages (obj);__i915_gem_object_put_pages (obj); +i915_gem_object_unlock (obj);i915_gem_object_put (obj);if (err) {
@@ -1440,7 +1454,7 @@ static int igt_tmpfs_fallback(void *arg) goto out_restore; } - vaddr =i915_gem_object_pin_map (obj,I915_MAP_WB ); + vaddr =i915_gem_object_pin_map_unlocked (obj,I915_MAP_WB );if (IS_ERR (vaddr)) { err =PTR_ERR (vaddr); goto out_put;
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 41/63 drm/i915/selftests: Prepare client blit for obj->mm.lock removal.
In reply to Maarten LankhorstStraightforward conversion, just convert a bunch of calls to unlocked versions.
--- drivers/gpu/drm/i915/gem/selftests/i915_gem_client_blt.c | 8 ++++---- 1 file changed, 4 insertions(+), 4 deletions(-)
drivers/gpu/drm/i915/gem/selftests/i915_gem_client_blt.c +4 -4
@@ -47,7 +47,7 @@ static int __igt_client_fill(struct intel_engine_cs *engine) goto err_flush; } - vaddr =i915_gem_object_pin_map (obj,I915_MAP_WB ); + vaddr =i915_gem_object_pin_map_unlocked (obj,I915_MAP_WB );if (IS_ERR (vaddr)) { err =PTR_ERR (vaddr); goto err_put;
@@ -159,7 +159,7 @@ static int prepare_blit(const struct tiled_blits *t,u32 src_pitch, dst_pitch;u32 cmd, *cs; - cs =i915_gem_object_pin_map (batch,I915_MAP_WC ); + cs =i915_gem_object_pin_map_unlocked (batch,I915_MAP_WC );if (IS_ERR (cs))return PTR_ERR (cs);
@@ -379,7 +379,7 @@ static int verify_buffer(const struct tiled_blits *t, y =i915_prandom_u32_max_state (t->height, prng); p = y * t->width + x; - vaddr =i915_gem_object_pin_map (buf->vma->obj,I915_MAP_WC ); + vaddr =i915_gem_object_pin_map_unlocked (buf->vma->obj,I915_MAP_WC );if (IS_ERR (vaddr))return PTR_ERR (vaddr);
@@ -566,7 +566,7 @@ static int tiled_blits_prepare(struct tiled_blits *t,int err;int i; - map =i915_gem_object_pin_map (t->scratch.vma->obj,I915_MAP_WC ); + map =i915_gem_object_pin_map_unlocked (t->scratch.vma->obj,I915_MAP_WC );if (IS_ERR (map))return PTR_ERR (map);
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 42/63 drm/i915/selftests: Prepare coherency tests for obj->mm.lock removal.
In reply to Maarten LankhorstStraightforward conversion, just convert a bunch of calls to unlocked versions.
--- drivers/gpu/drm/i915/gem/selftests/i915_gem_coherency.c | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-)
drivers/gpu/drm/i915/gem/selftests/i915_gem_coherency.c +2 -2
@@ -159,7 +159,7 @@ static int wc_set(struct context *ctx, unsigned long offset, u32 v)if (err)return err; - map =i915_gem_object_pin_map (ctx->obj,I915_MAP_WC ); + map =i915_gem_object_pin_map_unlocked (ctx->obj,I915_MAP_WC );if (IS_ERR (map))return PTR_ERR (map);
@@ -182,7 +182,7 @@ static int wc_get(struct context *ctx, unsigned long offset, u32 *v)if (err)return err; - map =i915_gem_object_pin_map (ctx->obj,I915_MAP_WC ); + map =i915_gem_object_pin_map_unlocked (ctx->obj,I915_MAP_WC );if (IS_ERR (map))return PTR_ERR (map);
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 43/63 drm/i915/selftests: Prepare context tests for obj->mm.lock removal.
In reply to Maarten LankhorstStraightforward conversion, just convert a bunch of calls to unlocked versions.
--- drivers/gpu/drm/i915/gem/selftests/i915_gem_context.c | 10 +++++----- 1 file changed, 5 insertions(+), 5 deletions(-)
drivers/gpu/drm/i915/gem/selftests/i915_gem_context.c +5 -5
@@ -1094,7 +1094,7 @@ __read_slice_count(struct intel_context *ce,if (ret <0 )return ret; - buf =i915_gem_object_pin_map (obj,I915_MAP_WB ); + buf =i915_gem_object_pin_map_unlocked (obj,I915_MAP_WB );if (IS_ERR (buf)) { ret =PTR_ERR (buf);return ret;
@@ -1511,7 +1511,7 @@ static int write_to_scratch(struct i915_gem_context *ctx,if (IS_ERR (obj))return PTR_ERR (obj); - cmd =i915_gem_object_pin_map (obj,I915_MAP_WB ); + cmd =i915_gem_object_pin_map_unlocked (obj,I915_MAP_WB );if (IS_ERR (cmd)) { err =PTR_ERR (cmd); goto out;
@@ -1622,7 +1622,7 @@ static int read_from_scratch(struct i915_gem_context *ctx,if (err) goto out_vm; - cmd =i915_gem_object_pin_map (obj,I915_MAP_WB ); + cmd =i915_gem_object_pin_map_unlocked (obj,I915_MAP_WB );if (IS_ERR (cmd)) { err =PTR_ERR (cmd); goto out;
@@ -1658,7 +1658,7 @@ static int read_from_scratch(struct i915_gem_context *ctx,if (err) goto out_vm; - cmd =i915_gem_object_pin_map (obj,I915_MAP_WB ); + cmd =i915_gem_object_pin_map_unlocked (obj,I915_MAP_WB );if (IS_ERR (cmd)) { err =PTR_ERR (cmd); goto out;
@@ -1715,7 +1715,7 @@ static int read_from_scratch(struct i915_gem_context *ctx,if (err) goto out_vm; - cmd =i915_gem_object_pin_map (obj,I915_MAP_WB ); + cmd =i915_gem_object_pin_map_unlocked (obj,I915_MAP_WB );if (IS_ERR (cmd)) { err =PTR_ERR (cmd); goto out_vm;
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 44/63 drm/i915/selftests: Prepare dma-buf tests for obj->mm.lock removal.
In reply to Maarten LankhorstUse pin_pages_unlocked() where we don't have a lock.
--- drivers/gpu/drm/i915/gem/selftests/i915_gem_dmabuf.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
drivers/gpu/drm/i915/gem/selftests/i915_gem_dmabuf.c +1 -1
@@ -194,7 +194,7 @@ static int igt_dmabuf_import_ownership(void *arg)dma_buf_put (dmabuf); - err =i915_gem_object_pin_pages (obj); + err =i915_gem_object_pin_pages_unlocked (obj);if (err) {pr_err ("i915_gem_object_pin_pages failed with err=%d\n" , err); goto out_obj;
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 45/63 drm/i915/selftests: Prepare execbuf tests for obj->mm.lock removal.
In reply to Maarten LankhorstAlso quite simple, a single call needs to use the unlocked version.
--- drivers/gpu/drm/i915/gem/selftests/i915_gem_execbuffer.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
drivers/gpu/drm/i915/gem/selftests/i915_gem_execbuffer.c +1 -1
@@ -116,7 +116,7 @@ static int igt_gpu_reloc(void *arg)if (IS_ERR (scratch))return PTR_ERR (scratch); - map =i915_gem_object_pin_map (scratch,I915_MAP_WC ); + map =i915_gem_object_pin_map_unlocked (scratch,I915_MAP_WC );if (IS_ERR (map)) { err =PTR_ERR (map); goto err_scratch;
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 46/63 drm/i915/selftests: Prepare mman testcases for obj->mm.lock removal.
In reply to Maarten LankhorstEnsure we hold the lock around put_pages, and use the unlocked wrappers for pinning pages and mappings.
--- drivers/gpu/drm/i915/gem/selftests/i915_gem_mman.c | 10 ++++++---- 1 file changed, 6 insertions(+), 4 deletions(-)
drivers/gpu/drm/i915/gem/selftests/i915_gem_mman.c +6 -4
@@ -321,7 +321,7 @@ static int igt_partial_tiling(void *arg)if (IS_ERR (obj))return PTR_ERR (obj); - err =i915_gem_object_pin_pages (obj); + err =i915_gem_object_pin_pages_unlocked (obj);if (err) {pr_err ("Failed to allocate %u pages (%lu total), err=%d\n" , nreal, obj->base.size /PAGE_SIZE , err);
@@ -458,7 +458,7 @@ static int igt_smoke_tiling(void *arg)if (IS_ERR (obj))return PTR_ERR (obj); - err =i915_gem_object_pin_pages (obj); + err =i915_gem_object_pin_pages_unlocked (obj);if (err) {pr_err ("Failed to allocate %u pages (%lu total), err=%d\n" , nreal, obj->base.size /PAGE_SIZE , err);
@@ -797,7 +797,7 @@ static int wc_set(struct drm_i915_gem_object *obj) {void *vaddr; - vaddr =i915_gem_object_pin_map (obj,I915_MAP_WC ); + vaddr =i915_gem_object_pin_map_unlocked (obj,I915_MAP_WC );if (IS_ERR (vaddr))return PTR_ERR (vaddr);
@@ -813,7 +813,7 @@ static int wc_check(struct drm_i915_gem_object *obj)void *vaddr;int err =0 ; - vaddr =i915_gem_object_pin_map (obj,I915_MAP_WC ); + vaddr =i915_gem_object_pin_map_unlocked (obj,I915_MAP_WC );if (IS_ERR (vaddr))return PTR_ERR (vaddr);
@@ -1315,7 +1315,9 @@ static int __igt_mmap_revoke(struct drm_i915_private *i915, }if (type !=I915_MMAP_TYPE_GTT ) { +i915_gem_object_lock (obj,NULL );__i915_gem_object_put_pages (obj); +i915_gem_object_unlock (obj);if (i915_gem_object_has_pages (obj)) {pr_err ("Failed to put-pages object!\n" ); err = -EINVAL ;
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 47/63 drm/i915/selftests: Prepare object tests for obj->mm.lock removal.
In reply to Maarten LankhorstConvert a single pin_pages call to use the unlocked version.
--- drivers/gpu/drm/i915/gem/selftests/i915_gem_object.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
drivers/gpu/drm/i915/gem/selftests/i915_gem_object.c +1 -1
@@ -47,7 +47,7 @@ static int igt_gem_huge(void *arg)if (IS_ERR (obj))return PTR_ERR (obj); - err =i915_gem_object_pin_pages (obj); + err =i915_gem_object_pin_pages_unlocked (obj);if (err) {pr_err ("Failed to allocate %u pages (%lu total), err=%d\n" , nreal, obj->base.size /PAGE_SIZE , err);
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 48/63 drm/i915/selftests: Prepare object blit tests for obj->mm.lock removal.
In reply to Maarten LankhorstUse some unlocked versions where we're not holding the ww lock.
--- drivers/gpu/drm/i915/gem/selftests/i915_gem_object_blt.c | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-)
drivers/gpu/drm/i915/gem/selftests/i915_gem_object_blt.c +3 -3
@@ -262,7 +262,7 @@ static int igt_fill_blt_thread(void *arg) goto err_flush; } - vaddr =i915_gem_object_pin_map (obj,I915_MAP_WB ); + vaddr =i915_gem_object_pin_map_unlocked (obj,I915_MAP_WB );if (IS_ERR (vaddr)) { err =PTR_ERR (vaddr); goto err_put;
@@ -380,7 +380,7 @@ static int igt_copy_blt_thread(void *arg) goto err_flush; } - vaddr =i915_gem_object_pin_map (src,I915_MAP_WB ); + vaddr =i915_gem_object_pin_map_unlocked (src,I915_MAP_WB );if (IS_ERR (vaddr)) { err =PTR_ERR (vaddr); goto err_put_src;
@@ -400,7 +400,7 @@ static int igt_copy_blt_thread(void *arg) goto err_put_src; } - vaddr =i915_gem_object_pin_map (dst,I915_MAP_WB ); + vaddr =i915_gem_object_pin_map_unlocked (dst,I915_MAP_WB );if (IS_ERR (vaddr)) { err =PTR_ERR (vaddr); goto err_put_dst;
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 49/63 drm/i915/selftests: Prepare igt_gem_utils for obj->mm.lock removal
In reply to Maarten Lankhorstigt_emit_store_dw needs to use the unlocked version, as it's not holding a lock. This fixes igt_gpu_fill_dw() which is used by some other selftests.
--- drivers/gpu/drm/i915/gem/selftests/igt_gem_utils.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
drivers/gpu/drm/i915/gem/selftests/igt_gem_utils.c +1 -1
@@ -54,7 +54,7 @@ igt_emit_store_dw(struct i915_vma *vma,if (IS_ERR (obj))return ERR_CAST (obj); - cmd =i915_gem_object_pin_map (obj,I915_MAP_WC ); + cmd =i915_gem_object_pin_map_unlocked (obj,I915_MAP_WC );if (IS_ERR (cmd)) { err =PTR_ERR (cmd); goto err;
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 50/63 drm/i915/selftests: Prepare context selftest for obj->mm.lock removal
In reply to Maarten LankhorstOnly needs to convert a single call to the unlocked version.
--- drivers/gpu/drm/i915/gt/selftest_context.c | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-)
drivers/gpu/drm/i915/gt/selftest_context.c +2 -2
@@ -88,8 +88,8 @@ static int __live_context_size(struct intel_engine_cs *engine)if (err) goto err; - vaddr =i915_gem_object_pin_map (ce->state->obj, -i915_coherent_map_type (engine->i915)); + vaddr =i915_gem_object_pin_map_unlocked (ce->state->obj, +i915_coherent_map_type (engine->i915));if (IS_ERR (vaddr)) { err =PTR_ERR (vaddr);intel_context_unpin (ce);
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 51/63 drm/i915/selftests: Prepare hangcheck for obj->mm.lock removal
In reply to Maarten LankhorstConvert a few calls to use the unlocked versions.
--- drivers/gpu/drm/i915/gt/selftest_hangcheck.c | 8 ++++---- 1 file changed, 4 insertions(+), 4 deletions(-)
drivers/gpu/drm/i915/gt/selftest_hangcheck.c +4 -4
@@ -80,15 +80,15 @@ static int hang_init(struct hang *h, struct intel_gt *gt) }i915_gem_object_set_cache_coherency (h->hws,I915_CACHE_LLC ); - vaddr =i915_gem_object_pin_map (h->hws,I915_MAP_WB ); + vaddr =i915_gem_object_pin_map_unlocked (h->hws,I915_MAP_WB );if (IS_ERR (vaddr)) { err =PTR_ERR (vaddr); goto err_obj; } h->seqno =memset (vaddr,0xff ,PAGE_SIZE ); - vaddr =i915_gem_object_pin_map (h->obj, -i915_coherent_map_type (gt->i915)); + vaddr =i915_gem_object_pin_map_unlocked (h->obj, +i915_coherent_map_type (gt->i915));if (IS_ERR (vaddr)) { err =PTR_ERR (vaddr); goto err_unpin_hws;
@@ -149,7 +149,7 @@ hang_create_request(struct hang *h, struct intel_engine_cs *engine)return ERR_CAST (obj); } - vaddr =i915_gem_object_pin_map (obj,i915_coherent_map_type (gt->i915)); + vaddr =i915_gem_object_pin_map_unlocked (obj,i915_coherent_map_type (gt->i915));if (IS_ERR (vaddr)) {i915_gem_object_put (obj);i915_vm_put (vm);
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 52/63 drm/i915/selftests: Prepare execlists for obj->mm.lock removal
In reply to Maarten LankhorstConvert normal functions to unlocked versions where needed.
--- drivers/gpu/drm/i915/gt/selftest_lrc.c | 34 +++++++++++++------------- 1 file changed, 17 insertions(+), 17 deletions(-)
drivers/gpu/drm/i915/gt/selftest_lrc.c +17 -17
@@ -1007,7 +1007,7 @@ static int live_timeslice_preempt(void *arg) goto err_obj; } - vaddr =i915_gem_object_pin_map (obj,I915_MAP_WC ); + vaddr =i915_gem_object_pin_map_unlocked (obj,I915_MAP_WC );if (IS_ERR (vaddr)) { err =PTR_ERR (vaddr); goto err_obj;
@@ -1315,7 +1315,7 @@ static int live_timeslice_queue(void *arg) goto err_obj; } - vaddr =i915_gem_object_pin_map (obj,I915_MAP_WC ); + vaddr =i915_gem_object_pin_map_unlocked (obj,I915_MAP_WC );if (IS_ERR (vaddr)) { err =PTR_ERR (vaddr); goto err_obj;
@@ -1562,7 +1562,7 @@ static int live_busywait_preempt(void *arg) goto err_ctx_lo; } - map =i915_gem_object_pin_map (obj,I915_MAP_WC ); + map =i915_gem_object_pin_map_unlocked (obj,I915_MAP_WC );if (IS_ERR (map)) { err =PTR_ERR (map); goto err_obj;
@@ -2678,7 +2678,7 @@ static int create_gang(struct intel_engine_cs *engine,if (err) goto err_obj; - cs =i915_gem_object_pin_map (obj,I915_MAP_WC ); + cs =i915_gem_object_pin_map_unlocked (obj,I915_MAP_WC );if (IS_ERR (cs)) goto err_obj;
@@ -2960,7 +2960,7 @@ static int live_preempt_gang(void *arg)* it will terminate the next lowest spinner until there * are no more spinners and the gang is complete. */ - cs =i915_gem_object_pin_map (rq->batch->obj,I915_MAP_WC ); + cs =i915_gem_object_pin_map_unlocked (rq->batch->obj,I915_MAP_WC );if (!IS_ERR (cs)) { *cs =0 ;i915_gem_object_unpin_map (rq->batch->obj);
@@ -3025,7 +3025,7 @@ create_gpr_user(struct intel_engine_cs *engine,return ERR_PTR (err); } - cs =i915_gem_object_pin_map (obj,I915_MAP_WC ); + cs =i915_gem_object_pin_map_unlocked (obj,I915_MAP_WC );if (IS_ERR (cs)) {i915_vma_put (vma);return ERR_CAST (cs);
@@ -3235,7 +3235,7 @@ static int live_preempt_user(void *arg)if (IS_ERR (global))return PTR_ERR (global); - result =i915_gem_object_pin_map (global->obj,I915_MAP_WC ); + result =i915_gem_object_pin_map_unlocked (global->obj,I915_MAP_WC );if (IS_ERR (result)) {i915_vma_unpin_and_release (&global,0 );return PTR_ERR (result);
@@ -3628,7 +3628,7 @@ static int live_preempt_smoke(void *arg) goto err_free; } - cs =i915_gem_object_pin_map (smoke.batch,I915_MAP_WB ); + cs =i915_gem_object_pin_map_unlocked (smoke.batch,I915_MAP_WB );if (IS_ERR (cs)) { err =PTR_ERR (cs); goto err_batch;
@@ -4231,7 +4231,7 @@ static int preserved_virtual_engine(struct intel_gt *gt, goto out_end; } - cs =i915_gem_object_pin_map (scratch->obj,I915_MAP_WB ); + cs =i915_gem_object_pin_map_unlocked (scratch->obj,I915_MAP_WB );if (IS_ERR (cs)) { err =PTR_ERR (cs); goto out_end;
@@ -5259,7 +5259,7 @@ static int __live_lrc_gpr(struct intel_engine_cs *engine, goto err_rq; } - cs =i915_gem_object_pin_map (scratch->obj,I915_MAP_WB ); + cs =i915_gem_object_pin_map_unlocked (scratch->obj,I915_MAP_WB );if (IS_ERR (cs)) { err =PTR_ERR (cs); goto err_rq;
@@ -5553,7 +5553,7 @@ store_context(struct intel_context *ce, struct i915_vma *scratch)if (IS_ERR (batch))return batch; - cs =i915_gem_object_pin_map (batch->obj,I915_MAP_WC ); + cs =i915_gem_object_pin_map_unlocked (batch->obj,I915_MAP_WC );if (IS_ERR (cs)) {i915_vma_put (batch);return ERR_CAST (cs);
@@ -5717,7 +5717,7 @@ static struct i915_vma *load_context(struct intel_context *ce, u32 poison)if (IS_ERR (batch))return batch; - cs =i915_gem_object_pin_map (batch->obj,I915_MAP_WC ); + cs =i915_gem_object_pin_map_unlocked (batch->obj,I915_MAP_WC );if (IS_ERR (cs)) {i915_vma_put (batch);return ERR_CAST (cs);
@@ -5831,29 +5831,29 @@ static int compare_isolation(struct intel_engine_cs *engine,u32 *defaults;int err =0 ; -A [0 ] =i915_gem_object_pin_map (ref[0 ]->obj,I915_MAP_WC ); +A [0 ] =i915_gem_object_pin_map_unlocked (ref[0 ]->obj,I915_MAP_WC );if (IS_ERR (A [0 ]))return PTR_ERR (A [0 ]); -A [1 ] =i915_gem_object_pin_map (ref[1 ]->obj,I915_MAP_WC ); +A [1 ] =i915_gem_object_pin_map_unlocked (ref[1 ]->obj,I915_MAP_WC );if (IS_ERR (A [1 ])) { err =PTR_ERR (A [1 ]); goto err_A0; } -B [0 ] =i915_gem_object_pin_map (result[0 ]->obj,I915_MAP_WC ); +B [0 ] =i915_gem_object_pin_map_unlocked (result[0 ]->obj,I915_MAP_WC );if (IS_ERR (B [0 ])) { err =PTR_ERR (B [0 ]); goto err_A1; } -B [1 ] =i915_gem_object_pin_map (result[1 ]->obj,I915_MAP_WC ); +B [1 ] =i915_gem_object_pin_map_unlocked (result[1 ]->obj,I915_MAP_WC );if (IS_ERR (B [1 ])) { err =PTR_ERR (B [1 ]); goto err_B0; } - lrc =i915_gem_object_pin_map (ce->state->obj, + lrc =i915_gem_object_pin_map_unlocked (ce->state->obj,i915_coherent_map_type (engine->i915));if (IS_ERR (lrc)) { err =PTR_ERR (lrc);
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 53/63 drm/i915/selftests: Prepare mocs tests for obj->mm.lock removal
In reply to Maarten LankhorstUse pin_map_unlocked when we're not holding locks.
--- drivers/gpu/drm/i915/gt/selftest_mocs.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
drivers/gpu/drm/i915/gt/selftest_mocs.c +1 -1
@@ -105,7 +105,7 @@ static int live_mocs_init(struct live_mocs *arg, struct intel_gt *gt)if (IS_ERR (arg->scratch))return PTR_ERR (arg->scratch); - arg->vaddr =i915_gem_object_pin_map (arg->scratch->obj,I915_MAP_WB ); + arg->vaddr =i915_gem_object_pin_map_unlocked (arg->scratch->obj,I915_MAP_WB );if (IS_ERR (arg->vaddr)) { err =PTR_ERR (arg->vaddr); goto err_scratch;
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 54/63 drm/i915/selftests: Prepare ring submission for obj->mm.lock removal
In reply to Maarten LankhorstUse unlocked versions when the ww lock is not held.
--- drivers/gpu/drm/i915/gt/selftest_ring_submission.c | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-)
drivers/gpu/drm/i915/gt/selftest_ring_submission.c +2 -2
@@ -35,7 +35,7 @@ static struct i915_vma *create_wally(struct intel_engine_cs *engine)return ERR_PTR (err); } - cs =i915_gem_object_pin_map (obj,I915_MAP_WC ); + cs =i915_gem_object_pin_map_unlocked (obj,I915_MAP_WC );if (IS_ERR (cs)) {i915_gem_object_put (obj);return ERR_CAST (cs);
@@ -212,7 +212,7 @@ static int __live_ctx_switch_wa(struct intel_engine_cs *engine)if (IS_ERR (bb))return PTR_ERR (bb); - result =i915_gem_object_pin_map (bb->obj,I915_MAP_WC ); + result =i915_gem_object_pin_map_unlocked (bb->obj,I915_MAP_WC );if (IS_ERR (result)) {intel_context_put (bb->private);i915_vma_unpin_and_release (&bb,0 );
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 55/63 drm/i915/selftests: Prepare timeline tests for obj->mm.lock removal
In reply to Maarten LankhorstWe can no longer call intel_timeline_pin with a null argument, so add a ww loop that locks the backing object.
--- drivers/gpu/drm/i915/gt/selftest_timeline.c | 26 ++++++++++++++++++--- 1 file changed, 23 insertions(+), 3 deletions(-)
drivers/gpu/drm/i915/gt/selftest_timeline.c +23 -3
@@ -36,6 +36,26 @@ static unsigned long hwsp_cacheline(struct intel_timeline *tl)return (address +offset_in_page (tl->hwsp_offset)) /CACHELINE_BYTES ; } +static int selftest_tl_pin (struct intel_timeline *tl) +{ +struct i915_gem_ww_ctx ww; +int err; + +i915_gem_ww_ctx_init (&ww, false); +retry: + err =i915_gem_object_lock (tl->hwsp_ggtt->obj, &ww); +if (!err) + err =intel_timeline_pin (tl, &ww); + +if (err == -EDEADLK ) { + err =i915_gem_ww_ctx_backoff (&ww); +if (!err) + goto retry; + } +i915_gem_ww_ctx_fini (&ww); +return err; +} +#define CACHELINES_PER_PAGE (PAGE_SIZE / CACHELINE_BYTES)struct mock_hwsp_freelist {
@@ -77,7 +97,7 @@ static int __mock_hwsp_timeline(struct mock_hwsp_freelist *state,if (IS_ERR (tl))return PTR_ERR (tl); - err =intel_timeline_pin (tl,NULL ); + err =selftest_tl_pin (tl);if (err) {intel_timeline_put (tl);return err;
@@ -463,7 +483,7 @@ checked_tl_write(struct intel_timeline *tl, struct intel_engine_cs *engine, u32struct i915_request *rq;int err; - err =intel_timeline_pin (tl,NULL ); + err =selftest_tl_pin (tl);if (err) { rq =ERR_PTR (err); goto out;
@@ -663,7 +683,7 @@ static int live_hwsp_wrap(void *arg)if (!tl->has_initial_breadcrumb) goto out_free; - err =intel_timeline_pin (tl,NULL ); + err =selftest_tl_pin (tl);if (err) goto out_free;
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 56/63 drm/i915/selftests: Prepare i915_request tests for obj->mm.lock removal
In reply to Maarten LankhorstStraightforward conversion by using unlocked versions.
--- drivers/gpu/drm/i915/selftests/i915_request.c | 10 +++++----- 1 file changed, 5 insertions(+), 5 deletions(-)
drivers/gpu/drm/i915/selftests/i915_request.c +5 -5
@@ -619,7 +619,7 @@ static struct i915_vma *empty_batch(struct drm_i915_private *i915)if (IS_ERR (obj))return ERR_CAST (obj); - cmd =i915_gem_object_pin_map (obj,I915_MAP_WB ); + cmd =i915_gem_object_pin_map_unlocked (obj,I915_MAP_WB );if (IS_ERR (cmd)) { err =PTR_ERR (cmd); goto err;
@@ -781,7 +781,7 @@ static struct i915_vma *recursive_batch(struct drm_i915_private *i915)if (err) goto err; - cmd =i915_gem_object_pin_map (obj,I915_MAP_WC ); + cmd =i915_gem_object_pin_map_unlocked (obj,I915_MAP_WC );if (IS_ERR (cmd)) { err =PTR_ERR (cmd); goto err;
@@ -816,7 +816,7 @@ static int recursive_batch_resolve(struct i915_vma *batch) {u32 *cmd; - cmd =i915_gem_object_pin_map (batch->obj,I915_MAP_WC ); + cmd =i915_gem_object_pin_map_unlocked (batch->obj,I915_MAP_WC );if (IS_ERR (cmd))return PTR_ERR (cmd);
@@ -1069,8 +1069,8 @@ static int live_sequential_engines(void *arg)if (!request[idx])break ; - cmd =i915_gem_object_pin_map (request[idx]->batch->obj, -I915_MAP_WC ); + cmd =i915_gem_object_pin_map_unlocked (request[idx]->batch->obj, +I915_MAP_WC );if (!IS_ERR (cmd)) { *cmd =MI_BATCH_BUFFER_END ;
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 57/63 drm/i915/selftests: Prepare memory region tests for obj->mm.lock removal
In reply to Maarten LankhorstUse the unlocked variants for pin_map and pin_pages, and add lock around unpinning/putting pages.
--- .../drm/i915/selftests/intel_memory_region.c | 18 +++++++++++------- 1 file changed, 11 insertions(+), 7 deletions(-)
drivers/gpu/drm/i915/selftests/intel_memory_region.c +11 -7
@@ -31,10 +31,12 @@ static void close_objects(struct intel_memory_region *mem,struct drm_i915_gem_object *obj, *on;list_for_each_entry_safe (obj, on, objects, st_link) { +i915_gem_object_lock (obj,NULL );if (i915_gem_object_has_pinned_pages (obj))i915_gem_object_unpin_pages (obj);/* No polluting the memory region between tests */ __i915_gem_object_put_pages (obj); +i915_gem_object_unlock (obj);list_del (&obj->st_link);i915_gem_object_put (obj); }
@@ -69,7 +71,7 @@ static int igt_mock_fill(void *arg)break ; } - err =i915_gem_object_pin_pages (obj); + err =i915_gem_object_pin_pages_unlocked (obj);if (err) {i915_gem_object_put (obj);break ;
@@ -109,7 +111,7 @@ igt_object_create(struct intel_memory_region *mem,if (IS_ERR (obj))return obj; - err =i915_gem_object_pin_pages (obj); + err =i915_gem_object_pin_pages_unlocked (obj);if (err) goto put;
@@ -123,8 +125,10 @@ igt_object_create(struct intel_memory_region *mem,static void igt_object_release (struct drm_i915_gem_object *obj) { +i915_gem_object_lock (obj,NULL );i915_gem_object_unpin_pages (obj);__i915_gem_object_put_pages (obj); +i915_gem_object_unlock (obj);list_del (&obj->st_link);i915_gem_object_put (obj); }
@@ -280,7 +284,7 @@ static int igt_cpu_check(struct drm_i915_gem_object *obj, u32 dword, u32 val)if (err)return err; - ptr =i915_gem_object_pin_map (obj,I915_MAP_WC ); + ptr =i915_gem_object_pin_map_unlocked (obj,I915_MAP_WC );if (IS_ERR (ptr))return PTR_ERR (ptr);
@@ -385,7 +389,7 @@ static int igt_lmem_create(void *arg)if (IS_ERR (obj))return PTR_ERR (obj); - err =i915_gem_object_pin_pages (obj); + err =i915_gem_object_pin_pages_unlocked (obj);if (err) goto out_put;
@@ -424,7 +428,7 @@ static int igt_lmem_write_gpu(void *arg) goto out_file; } - err =i915_gem_object_pin_pages (obj); + err =i915_gem_object_pin_pages_unlocked (obj);if (err) goto out_put;
@@ -496,7 +500,7 @@ static int igt_lmem_write_cpu(void *arg)if (IS_ERR (obj))return PTR_ERR (obj); - vaddr =i915_gem_object_pin_map (obj,I915_MAP_WC ); + vaddr =i915_gem_object_pin_map_unlocked (obj,I915_MAP_WC );if (IS_ERR (vaddr)) { err =PTR_ERR (vaddr); goto out_put;
@@ -600,7 +604,7 @@ create_region_for_mapping(struct intel_memory_region *mr, u64 size, u32 type,return obj; } - addr =i915_gem_object_pin_map (obj, type); + addr =i915_gem_object_pin_map_unlocked (obj, type);if (IS_ERR (addr)) {i915_gem_object_put (obj);if (PTR_ERR (addr) == -ENXIO )
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 58/63 drm/i915/selftests: Prepare cs engine tests for obj->mm.lock removal
In reply to Maarten LankhorstSame as other tests, use pin_map_unlocked.
--- drivers/gpu/drm/i915/gt/selftest_engine_cs.c | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-)
drivers/gpu/drm/i915/gt/selftest_engine_cs.c +2 -2
@@ -72,7 +72,7 @@ static struct i915_vma *create_empty_batch(struct intel_context *ce)if (IS_ERR (obj))return ERR_CAST (obj); - cs =i915_gem_object_pin_map (obj,I915_MAP_WB ); + cs =i915_gem_object_pin_map_unlocked (obj,I915_MAP_WB );if (IS_ERR (cs)) { err =PTR_ERR (cs); goto err_put;
@@ -208,7 +208,7 @@ static struct i915_vma *create_nop_batch(struct intel_context *ce)if (IS_ERR (obj))return ERR_CAST (obj); - cs =i915_gem_object_pin_map (obj,I915_MAP_WB ); + cs =i915_gem_object_pin_map_unlocked (obj,I915_MAP_WB );if (IS_ERR (cs)) { err =PTR_ERR (cs); goto err_put;
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 59/63 drm/i915/selftests: Prepare gtt tests for obj->mm.lock removal
In reply to Maarten LankhorstWe need to lock the global gtt dma_resv, use i915_vm_lock_objects to handle this correctly. Add ww handling for this where required.
Add the object lock around unpin/put pages, and use the unlocked versions of pin_pages and pin_map where required.
--- drivers/gpu/drm/i915/selftests/i915_gem_gtt.c | 92 ++++++++++++++----- 1 file changed, 67 insertions(+), 25 deletions(-)
drivers/gpu/drm/i915/selftests/i915_gem_gtt.c +67 -25
@@ -129,7 +129,7 @@ fake_dma_object(struct drm_i915_private *i915, u64 size) obj->cache_level =I915_CACHE_NONE ;/* Preallocate the "backing storage" */ -if (i915_gem_object_pin_pages (obj)) +if (i915_gem_object_pin_pages_unlocked (obj)) goto err_obj;i915_gem_object_unpin_pages (obj);
@@ -145,6 +145,7 @@ static int igt_ppgtt_alloc(void *arg) {struct drm_i915_private *dev_priv = arg;struct i915_ppgtt *ppgtt; +struct i915_gem_ww_ctx ww;u64 size, last, limit;int err =0 ;
@@ -170,6 +171,12 @@ static int igt_ppgtt_alloc(void *arg) limit =totalram_pages () <<PAGE_SHIFT ; limit =min (ppgtt->vm.total, limit); +i915_gem_ww_ctx_init (&ww, false); +retry: + err =i915_vm_lock_objects (&ppgtt->vm, &ww); +if (err) + goto err_ppgtt_cleanup; +/* Check we can allocate the entire range */ for (size =4096 ; size <= limit; size <<=2 ) {struct i915_vm_pt_stash stash = {};
@@ -214,6 +221,13 @@ static int igt_ppgtt_alloc(void *arg) } err_ppgtt_cleanup: +if (err == -EDEADLK ) { + err =i915_gem_ww_ctx_backoff (&ww); +if (!err) + goto retry; + } +i915_gem_ww_ctx_fini (&ww); +i915_vm_put (&ppgtt->vm);return err; }
@@ -275,7 +289,7 @@ static int lowlevel_hole(struct i915_address_space *vm,GEM_BUG_ON (obj->base.size !=BIT_ULL (size)); -if (i915_gem_object_pin_pages (obj)) { +if (i915_gem_object_pin_pages_unlocked (obj)) {i915_gem_object_put (obj);kfree (order);break ;
@@ -296,20 +310,36 @@ static int lowlevel_hole(struct i915_address_space *vm,if (vm->allocate_va_range) {struct i915_vm_pt_stash stash = {}; +struct i915_gem_ww_ctx ww; +int err; + +i915_gem_ww_ctx_init (&ww, false); +retry: + err =i915_vm_lock_objects (vm, &ww); +if (err) + goto alloc_vm_end; + err = -ENOMEM ;if (i915_vm_alloc_pt_stash (vm, &stash,BIT_ULL (size))) -break ; - -if (i915_vm_pin_pt_stash (vm, &stash)) { -i915_vm_free_pt_stash (vm, &stash); -break ; - } + goto alloc_vm_end; - vm->allocate_va_range (vm, &stash, - addr,BIT_ULL (size)); + err =i915_vm_pin_pt_stash (vm, &stash); +if (!err) + vm->allocate_va_range (vm, &stash, + addr,BIT_ULL (size));i915_vm_free_pt_stash (vm, &stash); +alloc_vm_end: +if (err == -EDEADLK ) { + err =i915_gem_ww_ctx_backoff (&ww); +if (!err) + goto retry; + } +i915_gem_ww_ctx_fini (&ww); + +if (err) +break ; } mock_vma->pages = obj->mm.pages;
@@ -1165,7 +1195,7 @@ static int igt_ggtt_page(void *arg)if (IS_ERR (obj))return PTR_ERR (obj); - err =i915_gem_object_pin_pages (obj); + err =i915_gem_object_pin_pages_unlocked (obj);if (err) goto out_free;
@@ -1332,7 +1362,7 @@ static int igt_gtt_reserve(void *arg) goto out; } - err =i915_gem_object_pin_pages (obj); + err =i915_gem_object_pin_pages_unlocked (obj);if (err) {i915_gem_object_put (obj); goto out;
@@ -1384,7 +1414,7 @@ static int igt_gtt_reserve(void *arg) goto out; } - err =i915_gem_object_pin_pages (obj); + err =i915_gem_object_pin_pages_unlocked (obj);if (err) {i915_gem_object_put (obj); goto out;
@@ -1548,7 +1578,7 @@ static int igt_gtt_insert(void *arg) goto out; } - err =i915_gem_object_pin_pages (obj); + err =i915_gem_object_pin_pages_unlocked (obj);if (err) {i915_gem_object_put (obj); goto out;
@@ -1657,7 +1687,7 @@ static int igt_gtt_insert(void *arg) goto out; } - err =i915_gem_object_pin_pages (obj); + err =i915_gem_object_pin_pages_unlocked (obj);if (err) {i915_gem_object_put (obj); goto out;
@@ -1828,7 +1858,7 @@ static int igt_cs_tlb(void *arg) goto out_vm; } - batch =i915_gem_object_pin_map (bbe,I915_MAP_WC ); + batch =i915_gem_object_pin_map_unlocked (bbe,I915_MAP_WC );if (IS_ERR (batch)) { err =PTR_ERR (batch); goto out_put_bbe;
@@ -1844,7 +1874,7 @@ static int igt_cs_tlb(void *arg) }/* Track the execution of each request by writing into different slot */ - batch =i915_gem_object_pin_map (act,I915_MAP_WC ); + batch =i915_gem_object_pin_map_unlocked (act,I915_MAP_WC );if (IS_ERR (batch)) { err =PTR_ERR (batch); goto out_put_act;
@@ -1891,7 +1921,7 @@ static int igt_cs_tlb(void *arg) goto out_put_out;GEM_BUG_ON (vma->node.start != vm->total -PAGE_SIZE ); - result =i915_gem_object_pin_map (out,I915_MAP_WB ); + result =i915_gem_object_pin_map_unlocked (out,I915_MAP_WB );if (IS_ERR (result)) { err =PTR_ERR (result); goto out_put_out;
@@ -1907,6 +1937,7 @@ static int igt_cs_tlb(void *arg)while (!__igt_timeout (end_time,NULL )) {struct i915_vm_pt_stash stash = {};struct i915_request *rq; +struct i915_gem_ww_ctx ww;u64 offset; offset = igt_random_offset(&prng,
@@ -1925,19 +1956,30 @@ static int igt_cs_tlb(void *arg)if (err) goto end; +i915_gem_ww_ctx_init (&ww, false); +retry: + err =i915_vm_lock_objects (vm, &ww); +if (err) + goto end_ww; + err =i915_vm_alloc_pt_stash (vm, &stash, chunk_size);if (err) - goto end; + goto end_ww; err =i915_vm_pin_pt_stash (vm, &stash); -if (err) { -i915_vm_free_pt_stash (vm, &stash); - goto end; - } - - vm->allocate_va_range (vm, &stash, offset, chunk_size); +if (!err) + vm->allocate_va_range (vm, &stash, offset, chunk_size);i915_vm_free_pt_stash (vm, &stash); +end_ww: +if (err == -EDEADLK ) { + err =i915_gem_ww_ctx_backoff (&ww); +if (!err) + goto retry; + } +i915_gem_ww_ctx_fini (&ww); +if (err) + goto end;/* Prime the TLB with the dummy pages */ for (i =0 ; i < count; i++) {
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 60/63 drm/i915: Finally remove obj->mm.lock.
In reply to Maarten LankhorstWith all callers and selftests fixed to use ww locking, we can now finally remove this lock.
--- drivers/gpu/drm/i915/gem/i915_gem_object.c | 2 - drivers/gpu/drm/i915/gem/i915_gem_object.h | 5 +-- .../gpu/drm/i915/gem/i915_gem_object_types.h | 1 - drivers/gpu/drm/i915/gem/i915_gem_pages.c | 38 ++++--------------- drivers/gpu/drm/i915/gem/i915_gem_phys.c | 34 ++++------------- drivers/gpu/drm/i915/gem/i915_gem_shmem.c | 2 +- drivers/gpu/drm/i915/gem/i915_gem_shrinker.c | 37 +++++++++++++----- drivers/gpu/drm/i915/gem/i915_gem_shrinker.h | 4 +- drivers/gpu/drm/i915/gem/i915_gem_tiling.c | 2 - drivers/gpu/drm/i915/gem/i915_gem_userptr.c | 3 +- drivers/gpu/drm/i915/i915_debugfs.c | 4 +- drivers/gpu/drm/i915/i915_gem.c | 8 +--- drivers/gpu/drm/i915/i915_gem_gtt.c | 2 +- 13 files changed, 53 insertions(+), 89 deletions(-)
drivers/gpu/drm/i915/gem/i915_gem_object.c +0 -2
@@ -62,8 +62,6 @@ void i915_gem_object_init(struct drm_i915_gem_object *obj,const struct drm_i915_gem_object_ops *ops, struct lock_class_key *key, unsigned flags) { - mutex_init(&obj->mm.lock); - spin_lock_init(&obj->vma.lock);INIT_LIST_HEAD (&obj->vma.list);
drivers/gpu/drm/i915/gem/i915_gem_object.h +2 -3
@@ -123,7 +123,7 @@ static inline void assert_object_held_shared(struct drm_i915_gem_object *obj)*/ if (IS_ENABLED (CONFIG_LOCKDEP ) &&kref_read (&obj->base.refcount) >0 ) -lockdep_assert_held (&obj->mm.lock); +assert_object_held (obj); } static inline int __i915_gem_object_lock(struct drm_i915_gem_object *obj,
@@ -328,7 +328,7 @@ int __i915_gem_object_get_pages(struct drm_i915_gem_object *obj);static inline int __must_check i915_gem_object_pin_pages (struct drm_i915_gem_object *obj) { -might_lock (&obj->mm.lock); +assert_object_held (obj);if (atomic_inc_not_zero (&obj->mm.pages_pin_count))return 0 ;
@@ -374,7 +374,6 @@ i915_gem_object_unpin_pages(struct drm_i915_gem_object *obj) }int __i915_gem_object_put_pages (struct drm_i915_gem_object *obj); -int __i915_gem_object_put_pages_locked (struct drm_i915_gem_object *obj);void i915_gem_object_truncate (struct drm_i915_gem_object *obj);void i915_gem_object_writeback (struct drm_i915_gem_object *obj);
drivers/gpu/drm/i915/gem/i915_gem_object_types.h +0 -1
@@ -209,7 +209,6 @@ struct drm_i915_gem_object {* Protects the pages and their use. Do not use directly, but * instead go through the pin/unpin interfaces. */ -struct mutex lock;atomic_t pages_pin_count;atomic_t shrink_pin;
drivers/gpu/drm/i915/gem/i915_gem_pages.c +7 -31
@@ -67,7 +67,7 @@ void __i915_gem_object_set_pages(struct drm_i915_gem_object *obj,struct list_head *list;unsigned long flags; -lockdep_assert_held (&obj->mm.lock); +assert_object_held (obj);spin_lock_irqsave (&i915->mm.obj_lock, flags); i915->mm.shrink_count++;
@@ -114,9 +114,7 @@ int __i915_gem_object_get_pages(struct drm_i915_gem_object *obj) {int err; - err =mutex_lock_interruptible (&obj->mm.lock); -if (err) -return err; +assert_object_held (obj);assert_object_held_shared (obj);
@@ -125,15 +123,13 @@ int __i915_gem_object_get_pages(struct drm_i915_gem_object *obj) err =____i915_gem_object_get_pages (obj);if (err) - goto unlock; +return err;smp_mb__before_atomic (); }atomic_inc (&obj->mm.pages_pin_count); -unlock: -mutex_unlock (&obj->mm.lock); -return err; +return 0 ; }int i915_gem_object_pin_pages_unlocked (struct drm_i915_gem_object *obj)
@@ -222,7 +218,7 @@ __i915_gem_object_unset_pages(struct drm_i915_gem_object *obj)return pages; } -int __i915_gem_object_put_pages_locked (struct drm_i915_gem_object *obj) +int __i915_gem_object_put_pages (struct drm_i915_gem_object *obj) {struct sg_table *pages;
@@ -253,21 +249,6 @@ int __i915_gem_object_put_pages_locked(struct drm_i915_gem_object *obj)return 0 ; } -int __i915_gem_object_put_pages (struct drm_i915_gem_object *obj) -{ -int err; - -if (i915_gem_object_has_pinned_pages (obj)) -return -EBUSY ; - -/* May be called by shrinker from within get_pages() (on another bo) */ -mutex_lock (&obj->mm.lock); - err =__i915_gem_object_put_pages_locked (obj); -mutex_unlock (&obj->mm.lock); - -return err; -} -static inline pte_t iomap_pte (resource_size_t base,dma_addr_t offset,pgprot_t prot)
@@ -384,9 +365,7 @@ void *i915_gem_object_pin_map(struct drm_i915_gem_object *obj, !i915_gem_object_type_has(obj, I915_GEM_OBJECT_HAS_IOMEM))return ERR_PTR (-ENXIO ); - err =mutex_lock_interruptible (&obj->mm.lock); -if (err) -return ERR_PTR (err); +assert_object_held (obj); pinned = !(type &I915_MAP_OVERRIDE ); type &= ~I915_MAP_OVERRIDE ;
@@ -428,15 +407,12 @@ void *i915_gem_object_pin_map(struct drm_i915_gem_object *obj, obj->mm.mapping =page_pack_bits (ptr, type); } -out_unlock: -mutex_unlock (&obj->mm.lock);return ptr; err_unpin:atomic_dec (&obj->mm.pages_pin_count); err_unlock: - ptr =ERR_PTR (err); - goto out_unlock; +return ERR_PTR (err); } void *i915_gem_object_pin_map_unlocked(struct drm_i915_gem_object *obj,
drivers/gpu/drm/i915/gem/i915_gem_phys.c +8 -26
@@ -184,40 +184,22 @@ int i915_gem_object_attach_phys(struct drm_i915_gem_object *obj, int align)if (err)return err; - err =mutex_lock_interruptible (&obj->mm.lock); -if (err) -return err; +if (obj->mm.madv !=I915_MADV_WILLNEED ) +return -EFAULT ; -if (unlikely (!i915_gem_object_has_struct_page (obj))) - goto out; +if (obj->mm.quirked) +return -EFAULT ; -if (obj->mm.madv !=I915_MADV_WILLNEED ) { - err = -EFAULT ; - goto out; - } - -if (obj->mm.quirked) { - err = -EFAULT ; - goto out; - } - -if (obj->mm.mapping ||i915_gem_object_has_pinned_pages (obj)) { - err = -EBUSY ; - goto out; - } +if (obj->mm.mapping ||i915_gem_object_has_pinned_pages (obj)) +return -EBUSY ;if (unlikely (obj->mm.madv !=I915_MADV_WILLNEED )) {drm_dbg (obj->base.dev,"Attempting to obtain a purgeable object\n" ); - err = -EFAULT ; - goto out; +return -EFAULT ; } - err =i915_gem_object_shmem_to_phys (obj); - -out: -mutex_unlock (&obj->mm.lock); -return err; +return i915_gem_object_shmem_to_phys (obj); }#if IS_ENABLED (CONFIG_DRM_I915_SELFTEST )
drivers/gpu/drm/i915/gem/i915_gem_shmem.c +1 -1
@@ -99,7 +99,7 @@ static int shmem_get_pages(struct drm_i915_gem_object *obj) goto err_sg; } -i915_gem_shrink (i915,2 * page_count,NULL , *s++); +i915_gem_shrink (NULL , i915,2 * page_count,NULL , *s++);/* * We've tried hard to allocate the memory by reaping
drivers/gpu/drm/i915/gem/i915_gem_shrinker.c +27 -10
@@ -93,7 +93,8 @@ static void try_to_writeback(struct drm_i915_gem_object *obj,* The number of pages of backing storage actually released. */ unsigned long -i915_gem_shrink (struct drm_i915_private *i915, +i915_gem_shrink (struct i915_gem_ww_ctx *ww, +struct drm_i915_private *i915,unsigned long target,unsigned long *nr_scanned,unsigned int shrink)
@@ -112,6 +113,7 @@ i915_gem_shrink(struct drm_i915_private *i915,intel_wakeref_t wakeref =0 ;unsigned long count =0 ;unsigned long scanned =0 ; +int err;trace_i915_gem_shrink (i915, target, shrink);
@@ -199,23 +201,38 @@ i915_gem_shrink(struct drm_i915_private *i915,spin_unlock_irqrestore (&i915->mm.obj_lock, flags); -if (unsafe_drop_pages (obj, shrink) && -mutex_trylock (&obj->mm.lock)) { + err =0 ; +if (unsafe_drop_pages (obj, shrink)) {/* May arrive from get_pages on another bo */ -if (!__i915_gem_object_put_pages_locked (obj)) { +if (!ww) { +if (!i915_gem_object_trylock (obj)) + goto skip; + }else { + err =i915_gem_object_lock (obj, ww); +if (err) + goto skip; + } + +if (!__i915_gem_object_put_pages (obj)) {try_to_writeback (obj, shrink); count += obj->base.size >>PAGE_SHIFT ; } -mutex_unlock (&obj->mm.lock); +if (!ww) +i915_gem_object_unlock (obj); } scanned += obj->base.size >>PAGE_SHIFT ; +skip:i915_gem_object_put (obj);spin_lock_irqsave (&i915->mm.obj_lock, flags); +if (err) +break ; }list_splice_tail (&still_in_list, phase->list);spin_unlock_irqrestore (&i915->mm.obj_lock, flags); +if (err) +return err; }if (shrink &I915_SHRINK_BOUND )
@@ -246,7 +263,7 @@ unsigned long i915_gem_shrink_all(struct drm_i915_private *i915)unsigned long freed =0 ; with_intel_runtime_pm(&i915->runtime_pm, wakeref) { - freed =i915_gem_shrink (i915,-1UL ,NULL , + freed =i915_gem_shrink (NULL , i915,-1UL ,NULL ,I915_SHRINK_BOUND |I915_SHRINK_UNBOUND ); }
@@ -292,7 +309,7 @@ i915_gem_shrinker_scan(struct shrinker *shrinker, struct shrink_control *sc) sc->nr_scanned =0 ; - freed = i915_gem_shrink(i915, + freed = i915_gem_shrink(NULL, i915, sc->nr_to_scan, &sc->nr_scanned, I915_SHRINK_BOUND |
@@ -301,7 +318,7 @@ i915_gem_shrinker_scan(struct shrinker *shrinker, struct shrink_control *sc)intel_wakeref_t wakeref; with_intel_runtime_pm(&i915->runtime_pm, wakeref) { - freed += i915_gem_shrink(i915, + freed += i915_gem_shrink(NULL, i915, sc->nr_to_scan - sc->nr_scanned, &sc->nr_scanned, I915_SHRINK_ACTIVE |
@@ -326,7 +343,7 @@ i915_gem_shrinker_oom(struct notifier_block *nb, unsigned long event, void *ptr) freed_pages =0 ; with_intel_runtime_pm(&i915->runtime_pm, wakeref) - freed_pages +=i915_gem_shrink (i915,-1UL ,NULL , + freed_pages +=i915_gem_shrink (NULL , i915,-1UL ,NULL ,I915_SHRINK_BOUND |I915_SHRINK_UNBOUND |I915_SHRINK_WRITEBACK );
@@ -364,7 +381,7 @@ i915_gem_shrinker_vmap(struct notifier_block *nb, unsigned long event, void *ptrintel_wakeref_t wakeref; with_intel_runtime_pm(&i915->runtime_pm, wakeref) - freed_pages +=i915_gem_shrink (i915,-1UL ,NULL , + freed_pages +=i915_gem_shrink (NULL , i915,-1UL ,NULL ,I915_SHRINK_BOUND |I915_SHRINK_UNBOUND |I915_SHRINK_VMAPS );
drivers/gpu/drm/i915/gem/i915_gem_shrinker.h +3 -1
@@ -9,10 +9,12 @@#include <linux/bits.h> struct drm_i915_private ; +struct i915_gem_ww_ctx ;struct mutex ;/* i915_gem_shrinker.c */ -unsigned long i915_gem_shrink (struct drm_i915_private *i915, +unsigned long i915_gem_shrink (struct i915_gem_ww_ctx *ww, +struct drm_i915_private *i915,unsigned long target,unsigned long *nr_scanned,unsigned flags);
drivers/gpu/drm/i915/gem/i915_gem_tiling.c +0 -2
@@ -265,7 +265,6 @@ i915_gem_object_set_tiling(struct drm_i915_gem_object *obj,* pages to prevent them being swapped out and causing corruption * due to the change in swizzling. */ -mutex_lock (&obj->mm.lock);if (i915_gem_object_has_pages (obj) && obj->mm.madv ==I915_MADV_WILLNEED && i915->quirks &QUIRK_PIN_SWIZZLED_PAGES ) {
@@ -280,7 +279,6 @@ i915_gem_object_set_tiling(struct drm_i915_gem_object *obj, obj->mm.quirked = true; } } -mutex_unlock (&obj->mm.lock);spin_lock (&obj->vma.lock);for_each_ggtt_vma (vma, obj) {
drivers/gpu/drm/i915/gem/i915_gem_userptr.c +1 -2
@@ -235,7 +235,7 @@ static int i915_gem_object_userptr_unbind(struct drm_i915_gem_object *obj, boolif (GEM_WARN_ON (i915_gem_object_has_pinned_pages (obj)))return -EBUSY ; -mutex_lock (&obj->mm.lock); +assert_object_held (obj); pages =__i915_gem_object_unset_pages (obj);if (!IS_ERR_OR_NULL (pages))
@@ -243,7 +243,6 @@ static int i915_gem_object_userptr_unbind(struct drm_i915_gem_object *obj, boolif (get_pages) err =____i915_gem_object_get_pages (obj); -mutex_unlock (&obj->mm.lock);return err; }
drivers/gpu/drm/i915/i915_debugfs.c +2 -2
@@ -1508,10 +1508,10 @@ i915_drop_caches_set(void *data, u64 val)fs_reclaim_acquire (GFP_KERNEL );if (val &DROP_BOUND ) -i915_gem_shrink (i915,LONG_MAX ,NULL ,I915_SHRINK_BOUND ); +i915_gem_shrink (NULL , i915,LONG_MAX ,NULL ,I915_SHRINK_BOUND );if (val &DROP_UNBOUND ) -i915_gem_shrink (i915,LONG_MAX ,NULL ,I915_SHRINK_UNBOUND ); +i915_gem_shrink (NULL , i915,LONG_MAX ,NULL ,I915_SHRINK_UNBOUND );if (val &DROP_SHRINK_ALL )i915_gem_shrink_all (i915);
drivers/gpu/drm/i915/i915_gem.c +1 -7
@@ -1103,10 +1103,6 @@ i915_gem_madvise_ioctl(struct drm_device *dev, void *data,if (err) goto out; - err =mutex_lock_interruptible (&obj->mm.lock); -if (err) - goto out_ww; -if (i915_gem_object_has_pages (obj) &&i915_gem_object_is_tiled (obj) && i915->quirks &QUIRK_PIN_SWIZZLED_PAGES ) {
@@ -1149,9 +1145,7 @@ i915_gem_madvise_ioctl(struct drm_device *dev, void *data,i915_gem_object_truncate (obj); args->retained = obj->mm.madv != __I915_MADV_PURGED; -mutex_unlock (&obj->mm.lock); -out_ww:i915_gem_object_unlock (obj); out:i915_gem_object_put (obj);
@@ -1332,7 +1326,7 @@ int i915_gem_freeze_late(struct drm_i915_private *i915) wakeref =intel_runtime_pm_get (&i915->runtime_pm); -i915_gem_shrink (i915,-1UL ,NULL , ~0 ); +i915_gem_shrink (NULL , i915,-1UL ,NULL , ~0 );i915_gem_drain_freed_objects (i915);list_for_each_entry (obj, &i915->mm.shrink_list, mm.link) {
drivers/gpu/drm/i915/i915_gem_gtt.c +1 -1
@@ -44,7 +44,7 @@ int i915_gem_gtt_prepare_pages(struct drm_i915_gem_object *obj,* the DMA remapper, i915_gem_shrink will return 0. */ GEM_BUG_ON (obj->mm.pages == pages); - }while (i915_gem_shrink (to_i915 (obj->base.dev), + }while (i915_gem_shrink (NULL ,to_i915 (obj->base.dev), obj->base.size >>PAGE_SHIFT ,NULL ,I915_SHRINK_BOUND |I915_SHRINK_UNBOUND ));
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 61/63 drm/i915: Keep userpointer bindings if seqcount is unchanged, v2.
In reply to Maarten LankhorstInstead of force unbinding and rebinding every time, we try to check if our notifier seqcount is still correct when pages are bound. This way we only rebind userptr when we need to, and prevent stalls.
Changes since v1:
- Missing mutex_unlock, reported by kbuild.
--- drivers/gpu/drm/i915/gem/i915_gem_userptr.c | 27 ++++++++++++++++++--- 1 file changed, 24 insertions(+), 3 deletions(-)
drivers/gpu/drm/i915/gem/i915_gem_userptr.c +24 -3
@@ -263,12 +263,33 @@ int i915_gem_object_userptr_submit_init(struct drm_i915_gem_object *obj)if (ret)return ret; -/* Make sure userptr is unbound for next attempt, so we don't use stale pages. */ - ret =i915_gem_object_userptr_unbind (obj, false); +/* optimistically try to preserve current pages while unlocked */ +if (i915_gem_object_has_pages (obj) && + !mmu_interval_check_retry (&obj->userptr.notifier, + obj->userptr.notifier_seq)) { +spin_lock (&i915->mm.notifier_lock); +if (obj->userptr.pvec && + !mmu_interval_read_retry (&obj->userptr.notifier, + obj->userptr.notifier_seq)) { + obj->userptr.page_ref++; + +/* We can keep using the current binding, this is the fastpath */ + ret =1 ; + } +spin_unlock (&i915->mm.notifier_lock); + } + +if (!ret) { +/* Make sure userptr is unbound for next attempt, so we don't use stale pages. */ + ret =i915_gem_object_userptr_unbind (obj, false); + }i915_gem_object_unlock (obj); -if (ret) +if (ret <0 )return ret; +if (ret >0 ) +return 0 ; + notifier_seq =mmu_interval_read_begin (&obj->userptr.notifier); pvec =kvmalloc_array (num_pages,sizeof (struct page *),GFP_KERNEL );
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 62/63 drm/i915: Idea to implement eviction locking
In reply to Maarten Lankhorst--- drivers/gpu/drm/i915/gem/i915_gem_object.h | 39 +++++++++++++++++++- drivers/gpu/drm/i915/gem/i915_gem_shrinker.c | 10 ++++- drivers/gpu/drm/i915/i915_gem.c | 29 ++++++++++++++- drivers/gpu/drm/i915/i915_gem.h | 5 ++- 4 files changed, 78 insertions(+), 5 deletions(-)
drivers/gpu/drm/i915/gem/i915_gem_object.h +38 -1
@@ -126,12 +126,43 @@ static inline void assert_object_held_shared(struct drm_i915_gem_object *obj)assert_object_held (obj); } +static inline int +i915_gem_object_lock_to_evict (struct drm_i915_gem_object *obj, +struct i915_gem_ww_ctx *ww) +{ +int ret; + +if (ww->intr) + ret =dma_resv_lock_interruptible (obj->base.resv, &ww->ctx); +else + ret =dma_resv_lock (obj->base.resv, &ww->ctx); + +if (!ret) { +list_add_tail (&obj->obj_link, &ww->eviction_list); +i915_gem_object_get (obj); + } + +if (ret == -EALREADY && + obj == list_first_entry(&ww->eviction_list, struct drm_i915_gem_object, obj_link)) + ret =0 ; + + ww->evicting = true; + +if (ret == -EDEADLK ) + ww->contended =i915_gem_object_get (obj); + +return ret; +} +static inline int __i915_gem_object_lock (struct drm_i915_gem_object *obj,struct i915_gem_ww_ctx *ww,bool intr) {int ret; +if (ww &&GEM_WARN_ON (ww->evicting)) + ww->evicting = false; +if (intr) ret =dma_resv_lock_interruptible (obj->base.resv, ww ? &ww->ctx :NULL );else
@@ -139,8 +170,14 @@ static inline int __i915_gem_object_lock(struct drm_i915_gem_object *obj,if (!ret && ww)list_add_tail (&obj->obj_link, &ww->obj_list); -if (ret == -EALREADY ) +if (ret == -EALREADY ) { ret =0 ; + if (obj == list_first_entry(&ww->eviction_list, struct drm_i915_gem_object, obj_link)) { +i915_gem_object_put (obj); +list_del (&obj->obj_link); +list_add_tail (&obj->obj_link, &ww->obj_list); + } + }if (ret == -EDEADLK ) ww->contended = obj;
drivers/gpu/drm/i915/gem/i915_gem_shrinker.c +8 -2
@@ -99,6 +99,7 @@ i915_gem_shrink(struct i915_gem_ww_ctx *ww, unsigned long *nr_scanned, unsigned int shrink) { +struct drm_i915_gem_object *obj; const struct { struct list_head *list; unsigned int bit;
@@ -163,7 +164,6 @@ i915_gem_shrink(struct i915_gem_ww_ctx *ww,*/ for (phase = phases; phase->list; phase++) {struct list_head still_in_list; -struct drm_i915_gem_object *obj;unsigned long flags;if ((shrink & phase->bit) ==0 )
@@ -208,7 +208,11 @@ i915_gem_shrink(struct i915_gem_ww_ctx *ww,if (!i915_gem_object_trylock (obj)) goto skip; }else { - err =i915_gem_object_lock (obj, ww); + err =i915_gem_object_lock_to_evict (obj, ww); +if (err == -EALREADY ) { + err =0 ; + goto skip; + }if (err) goto skip; }
@@ -234,6 +238,8 @@ i915_gem_shrink(struct i915_gem_ww_ctx *ww,if (err)return err; } +if (ww) +i915_gem_ww_ctx_unlock_evictions (ww);if (shrink &I915_SHRINK_BOUND )intel_runtime_pm_put (&i915->runtime_pm, wakeref);
drivers/gpu/drm/i915/i915_gem.c +28 -1
@@ -1370,10 +1370,25 @@ void i915_gem_ww_ctx_init(struct i915_gem_ww_ctx *ww, bool intr) {ww_acquire_init (&ww->ctx, &reservation_ww_class);INIT_LIST_HEAD (&ww->obj_list); +INIT_LIST_HEAD (&ww->eviction_list); ww->intr = intr; + ww->evicting = false; ww->contended =NULL ; } +void i915_gem_ww_ctx_unlock_evictions (struct i915_gem_ww_ctx *ww) +{ +struct drm_i915_gem_object *obj; + + while ((obj = list_first_entry_or_null(&ww->eviction_list, struct drm_i915_gem_object, obj_link))) { +list_del (&obj->obj_link); +i915_gem_object_unlock (obj); +i915_gem_object_put (obj); + } + + ww->evicting = false; +} +static void i915_gem_ww_ctx_unlock_all (struct i915_gem_ww_ctx *ww) {struct drm_i915_gem_object *obj;
@@ -1382,6 +1397,12 @@ static void i915_gem_ww_ctx_unlock_all(struct i915_gem_ww_ctx *ww)list_del (&obj->obj_link);i915_gem_object_unlock (obj); } + + while ((obj = list_first_entry_or_null(&ww->eviction_list, struct drm_i915_gem_object, obj_link))) { +list_del (&obj->obj_link); +i915_gem_object_unlock (obj); +i915_gem_object_put (obj); + } }void i915_gem_ww_unlock_single (struct drm_i915_gem_object *obj)
@@ -1411,9 +1432,15 @@ int __must_check i915_gem_ww_ctx_backoff(struct i915_gem_ww_ctx *ww)dma_resv_lock_slow (ww->contended->base.resv, &ww->ctx);if (!ret) -list_add_tail (&ww->contended->obj_link, &ww->obj_list); +list_add_tail (&ww->contended->obj_link, + ww->evicting ? &ww->eviction_list : + &ww->obj_list); +else if (ret && ww->evicting) { +i915_gem_object_put (ww->contended); + } ww->contended =NULL ; + ww->evicting = false;return ret; }
drivers/gpu/drm/i915/i915_gem.h +4 -1
@@ -119,7 +119,8 @@ static inline bool __tasklet_is_scheduled(struct tasklet_struct *t)struct i915_gem_ww_ctx {struct ww_acquire_ctx ctx;struct list_head obj_list; -bool intr; +struct list_head eviction_list; +bool intr, evicting;struct drm_i915_gem_object *contended; };
@@ -128,4 +129,6 @@ void i915_gem_ww_ctx_fini(struct i915_gem_ww_ctx *ctx);int __must_check i915_gem_ww_ctx_backoff (struct i915_gem_ww_ctx *ctx);void i915_gem_ww_unlock_single (struct drm_i915_gem_object *obj); +void i915_gem_ww_ctx_unlock_evictions (struct i915_gem_ww_ctx *ww); +#endif /* __I915_GEM_H__ */
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH v3 63/63 drm/i915: Keep lazy reference to userptr pages
In reply to Maarten Lankhorst--- drivers/gpu/drm/i915/gem/i915_gem_userptr.c | 28 +++++++++++++++------ 1 file changed, 20 insertions(+), 8 deletions(-)
drivers/gpu/drm/i915/gem/i915_gem_userptr.c +20 -8
@@ -71,6 +71,13 @@ static bool i915_gem_userptr_invalidate(struct mmu_interval_notifier *mni,mmu_interval_set_seq (mni, cur_seq); +/* drop the lazy reference we kept */ +if (!obj->userptr.page_ref && obj->userptr.pvec) { +unpin_user_pages (obj->userptr.pvec, obj->base.size >>PAGE_SHIFT ); +kvfree (obj->userptr.pvec); + obj->userptr.pvec =NULL ; + } +spin_unlock (&i915->mm.notifier_lock);/* we will unbind on next submission, still have userptr pins */
@@ -94,12 +101,12 @@ i915_gem_userptr_init__mmu_notifier(struct drm_i915_gem_object *obj) &i915_gem_userptr_notifier_ops); } -static void i915_gem_object_userptr_drop_ref (struct drm_i915_gem_object *obj) +static void i915_gem_object_userptr_drop_ref (struct drm_i915_gem_object *obj,bool free) {struct drm_i915_private *i915 =to_i915 (obj->base.dev);spin_lock (&i915->mm.notifier_lock); -if (!--obj->userptr.page_ref) { +if (!--obj->userptr.page_ref && free) {const unsigned long num_pages = obj->base.size >>PAGE_SHIFT ;unpin_user_pages (obj->userptr.pvec, num_pages);
@@ -162,7 +169,7 @@ static int i915_gem_userptr_get_pages(struct drm_i915_gem_object *obj)return 0 ; err: -i915_gem_object_userptr_drop_ref (obj); +i915_gem_object_userptr_drop_ref (obj, true); err_free:kfree (st);return ret;
@@ -220,7 +227,7 @@ i915_gem_userptr_put_pages(struct drm_i915_gem_object *obj,sg_free_table (pages);kfree (pages); -i915_gem_object_userptr_drop_ref (obj); +i915_gem_object_userptr_drop_ref (obj, true); }static int i915_gem_object_userptr_unbind (struct drm_i915_gem_object *obj,bool get_pages)
@@ -320,10 +327,8 @@ int i915_gem_object_userptr_submit_init(struct drm_i915_gem_object *obj) }if (!obj->userptr.page_ref++) { - obj->userptr.pvec = pvec; +swap (obj->userptr.pvec, pvec); obj->userptr.notifier_seq = notifier_seq; - - pvec =NULL ; } out_unlock:
@@ -352,7 +357,7 @@ int i915_gem_object_userptr_submit_done(struct drm_i915_gem_object *obj)void i915_gem_object_userptr_submit_fini (struct drm_i915_gem_object *obj) { -i915_gem_object_userptr_drop_ref (obj); +i915_gem_object_userptr_drop_ref (obj, false); } static void
@@ -360,6 +365,13 @@ i915_gem_userptr_release(struct drm_i915_gem_object *obj) {mmu_interval_notifier_remove (&obj->userptr.notifier); obj->userptr.notifier.mm =NULL ; +GEM_WARN_ON (obj->userptr.page_ref); + +if (obj->userptr.pvec) { +unpin_user_pages (obj->userptr.pvec, obj->base.size >>PAGE_SHIFT ); +kvfree (obj->userptr.pvec); + obj->userptr.pvec =NULL ; + } } static int
Signature · 6 lines
2.28.0 _______________________________________________ Intel-gfx mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/intel-gfx
Patchwork
CI[Intel-gfx] ✗ Fi.CI.CHECKPATCH: warning for drm/i915: Remove obj->mm.lock! (rev3)
In reply to Maarten Lankhorst== Series Details ==
== Series Details ==
Series: drm/i915: Remove obj->mm.lock! (rev3)
URL : https://patchwork.freedesktop.org/series/82337/
State : warning
== Summary ==
$ dim checkpatch origin/drm-tip 80a8f48f229f drm/i915: Move cmd parser pinning to execbuffer 85953c769887 drm/i915: Add missing -EDEADLK handling to execbuf pinning -:47: CHECK:PARENTHESIS_ALIGNMENT: Alignment should match open parenthesis #47: FILE: drivers/gpu/drm/i915/gem/i915_gem_execbuffer.c:452: + err = i915_vma_pin_ww(vma, &eb->ww, entry->pad_to_size,
total: 0 errors, 0 warnings, 1 checks, 54 lines checked d304ddd05bc2 drm/i915: Do not share hwsp across contexts any more, v3. -:500: CHECK:PARENTHESIS_ALIGNMENT: Alignment should match open parenthesis #500: FILE: drivers/gpu/drm/i915/gt/intel_timeline.c:291:
+ if (tl && (i915_request_completed(from) ||
+ !i915_active_acquire_if_busy(&tl->active)))
total: 0 errors, 0 warnings, 1 checks, 610 lines checkedafc484a312e1 drm/i915: Pin timeline map after first timeline pin, v3. -:13: WARNING:TYPO_SPELLING: 'arithmatic' may be misspelled - perhaps 'arithmetic'? #13:
- Fix NULL + XX arithmatic, use casts. (kbuild)
total: 0 errors, 1 warnings, 0 checks, 293 lines checked 5204c04e1783 drm/i915: Ensure we hold the object mutex in pin correctly. 3078927638f1 drm/i915: Add gem object locking to madvise. f59341469336 drm/i915: Move HAS_STRUCT_PAGE to obj->flags
-:106: WARNING:UNSPECIFIED_INT: Prefer 'unsigned int' to bare use of 'unsigned' #106: FILE: drivers/gpu/drm/i915/gem/i915_gem_object.c:63:
+ struct lock_class_key *key, unsigned flags)
-:129: WARNING:UNSPECIFIED_INT: Prefer 'unsigned int' to bare use of 'unsigned' #129: FILE: drivers/gpu/drm/i915/gem/i915_gem_object.h:27:
+ unsigned alloc_flags);
total: 0 errors, 2 warnings, 0 checks, 348 lines checkeda0e592a97856 drm/i915: Rework struct phys attachment handling174f857c33e0 drm/i915: Convert i915_gem_object_attach_phys() to ww locking6f0824c8b9c0 drm/i915: make lockdep slightly happier about execbuf.371cbc9d8c27 drm/i915: Disable userptr pread/pwrite support.942724c1e6a7 drm/i915: No longer allow exporting userptr through dma-buf415cc556a463 drm/i915: Reject more ioctls for userptr
-:7: WARNING:COMMIT_LOG_LONG_LINE: Possible unwrapped commit description (prefer a maximum 75 chars per line) #7:set_tiling and set_caching are rejected with -ENXIO, there's no valid reason
total: 0 errors, 1 warnings, 0 checks, 39 lines checked6f485e50888c drm/i915: Reject UNSYNCHRONIZED for userptr733050ed7f31 drm/i915: Fix userptr so we do not have to worry about obj->mm.lock, v3.
-:276: WARNING:LONG_LINE: line length of 121 exceeds 100 columns
#276: FILE: drivers/gpu/drm/i915/gem/i915_gem_object.h:555:
+static inline int i915_gem_object_userptr_submit_init(struct drm_i915_gem_object *obj) { GEM_BUG_ON(1); return -ENODEV; }
-:277: WARNING:LONG_LINE: line length of 121 exceeds 100 columns
#277: FILE: drivers/gpu/drm/i915/gem/i915_gem_object.h:556:
+static inline int i915_gem_object_userptr_submit_done(struct drm_i915_gem_object *obj) { GEM_BUG_ON(1); return -ENODEV; }
-:278: WARNING:LONG_LINE: line length of 106 exceeds 100 columns
#278: FILE: drivers/gpu/drm/i915/gem/i915_gem_object.h:557:
+static inline void i915_gem_object_userptr_submit_fini(struct drm_i915_gem_object *obj) { GEM_BUG_ON(1); }
-:336: WARNING:SPDX_LICENSE_TAG: Misplaced SPDX-License-Identifier tag - use line 1 instead #336: FILE: drivers/gpu/drm/i915/gem/i915_gem_userptr.c:2:
* SPDX-License-Identifier: MIT
-:340: WARNING:BLOCK_COMMENT_STYLE: Block comments should align the * on each line #340: FILE: drivers/gpu/drm/i915/gem/i915_gem_userptr.c:6:
+ *
+ * Based on amdgpu_mn, which bears the following notice:
-:341: WARNING:BLOCK_COMMENT_STYLE: Block comments should align the * on each line #341: FILE: drivers/gpu/drm/i915/gem/i915_gem_userptr.c:7:
+ * Based on amdgpu_mn, which bears the following notice:
+ *
-:488: WARNING:LONG_LINE: line length of 106 exceeds 100 columns #488: FILE: drivers/gpu/drm/i915/gem/i915_gem_userptr.c:63:
+ struct drm_i915_gem_object *obj = container_of(mni, struct drm_i915_gem_object, userptr.notifier);
-:1102: CHECK:MULTIPLE_ASSIGNMENTS: multiple assignments should be avoided #1102: FILE: drivers/gpu/drm/i915/gem/i915_gem_userptr.c:282:
+ pinned = ret = 0;
-:1116: CHECK:PARENTHESIS_ALIGNMENT: Alignment should match open parenthesis #1116: FILE: drivers/gpu/drm/i915/gem/i915_gem_userptr.c:296:
+ if (mmu_interval_read_retry(&obj->userptr.notifier,
+ !obj->userptr.page_ref ? notifier_seq :
-:1235: CHECK:UNCOMMENTED_DEFINITION: spinlock_t definition without comment #1235: FILE: drivers/gpu/drm/i915/i915_drv.h:597:
+ spinlock_t notifier_lock;
total: 0 errors, 7 warnings, 3 checks, 1186 lines checked f71980dabbdf drm/i915: Flatten obj->mm.lock0ddefffcf870 drm/i915: Populate logical context during first pin. -:176: CHECK:PARENTHESIS_ALIGNMENT: Alignment should match open parenthesis #176: FILE: drivers/gpu/drm/i915/gt/intel_lrc.c:5523:
+virtual_context_pre_pin(struct intel_context *ce,
+ struct i915_gem_ww_ctx *ww, void **vaddr)
total: 0 errors, 0 warnings, 1 checks, 169 lines checked372d3f54f47f drm/i915: Make ring submission compatible with obj->mm.lock removal, v2. 75e706407c5e drm/i915: Handle ww locking in init_status_page a5600bf6d23a drm/i915: Rework clflush to work correctly without obj->mm.lock. 8e3b1eed034a drm/i915: Pass ww ctx to intel_pin_to_display_plane 8623814b93d2 drm/i915: Add object locking to vm_fault_cpu5c4f1b8547df drm/i915: Move pinning to inside engine_wa_list_verify() -:53: CHECK:PARENTHESIS_ALIGNMENT: Alignment should match open parenthesis #53: FILE: drivers/gpu/drm/i915/gt/intel_workarounds.c:2140:
+ err = i915_vma_pin_ww(vma, &ww, 0, 0,
+ i915_vma_is_ggtt(vma) ? PIN_GLOBAL : PIN_USER);
total: 0 errors, 0 warnings, 1 checks, 109 lines checked605d60eb1494 drm/i915: Take reservation lock around i915_vma_pin.7aa2b4b7eab9 drm/i915: Make intel_init_workaround_bb more compatible with ww locking. 52f4f0994829 drm/i915: Make __engine_unpark() compatible with ww locking. ec1d61a7843a drm/i915: Take obj lock around set_domain ioctla28dce1923d9 drm/i915: Defer pin calls in buffer pool until first use by caller. 6728383c5033 drm/i915: Fix pread/pwrite to work with new locking rules.
-:28: WARNING:FILE_PATH_CHANGES: added, moved or deleted file(s), does MAINTAINERS need updating? #28:
deleted file mode 100644
total: 0 errors, 1 warnings, 0 checks, 401 lines checkede648311856d5 drm/i915: Fix workarounds selftest, part 19d404723b28b drm/i915: Prepare for obj->mm.lock removal
-:131: WARNING:NO_AUTHOR_SIGN_OFF: Missing Signed-off-by: line by nominal patch author '"Thomas Hellström" <[email protected]>'
total: 0 errors, 1 warnings, 0 checks, 96 lines checked2f504829281d drm/i915: Add igt_spinner_pin() to allow for ww locking around spinner. d220a1bf467a drm/i915: Add ww locking around vm_access()1676bdc1ed2e drm/i915: Increase ww locking for perf.78cf25d2059c drm/i915: Lock ww in ucode objects correctly38dfd5400402 drm/i915: Add ww locking to dma-buf ops.929b4826615b drm/i915: Add missing ww lock in intel_dsb_prepare. ead477c41e05 drm/i915: Fix ww locking in shmem_create_from_object d9cbec998e7d drm/i915: Use a single page table lock for each gtt. -:108: WARNING:UNNECESSARY_ELSE: else is not generally useful after a break or return #108: FILE: drivers/gpu/drm/i915/gt/intel_gtt.c:85:
+ return i915_gem_object_lock(vm->scratch[0], ww);
+ } else {
total: 0 errors, 1 warnings, 0 checks, 154 lines checkedc444c91b2ab0 drm/i915/selftests: Prepare huge_pages testcases for obj->mm.lock removal. 4164fa6a8f49 drm/i915/selftests: Prepare client blit for obj->mm.lock removal. ec19378542fb drm/i915/selftests: Prepare coherency tests for obj->mm.lock removal. 7e0846ca1737 drm/i915/selftests: Prepare context tests for obj->mm.lock removal. 78c5bb187f6b drm/i915/selftests: Prepare dma-buf tests for obj->mm.lock removal. 790863ab8235 drm/i915/selftests: Prepare execbuf tests for obj->mm.lock removal. bf606ed2df1e drm/i915/selftests: Prepare mman testcases for obj->mm.lock removal. f54ecd6bac1c drm/i915/selftests: Prepare object tests for obj->mm.lock removal. 957fd6d746ac drm/i915/selftests: Prepare object blit tests for obj->mm.lock removal. 51748645f2d5 drm/i915/selftests: Prepare igt_gem_utils for obj->mm.lock removal ae7debf30f00 drm/i915/selftests: Prepare context selftest for obj->mm.lock removal b5831f57952b drm/i915/selftests: Prepare hangcheck for obj->mm.lock removal 2d5a80056c2e drm/i915/selftests: Prepare execlists for obj->mm.lock removal -:155: CHECK:PARENTHESIS_ALIGNMENT: Alignment should match open parenthesis #155: FILE: drivers/gpu/drm/i915/gt/selftest_lrc.c:5857:
+ lrc = i915_gem_object_pin_map_unlocked(ce->state->obj,
i915_coherent_map_type(engine->i915));
total: 0 errors, 0 warnings, 1 checks, 130 lines checked428290f8289c drm/i915/selftests: Prepare mocs tests for obj->mm.lock removal 0481554c6894 drm/i915/selftests: Prepare ring submission for obj->mm.lock removal 853948ea51a4 drm/i915/selftests: Prepare timeline tests for obj->mm.lock removal 3c9c1a5ddaff drm/i915/selftests: Prepare i915_request tests for obj->mm.lock removal c081d7e17c8b drm/i915/selftests: Prepare memory region tests for obj->mm.lock removal 4df2c5801bef drm/i915/selftests: Prepare cs engine tests for obj->mm.lock removal 135e45899449 drm/i915/selftests: Prepare gtt tests for obj->mm.lock removal d48f071fd0db drm/i915: Finally remove obj->mm.lock.ffa7eb948163 drm/i915: Keep userpointer bindings if seqcount is unchanged, v2. 9ff2dbec02c1 drm/i915: Idea to implement eviction locking
-:7: WARNING:COMMIT_MESSAGE: Missing commit description - Add an appropriate one
-:63: WARNING:LONG_LINE: line length of 104 exceeds 100 columns #63: FILE: drivers/gpu/drm/i915/gem/i915_gem_object.h:175:
+ if (obj == list_first_entry(&ww->eviction_list, struct drm_i915_gem_object, obj_link)) {
-:132: WARNING:LONG_LINE: line length of 108 exceeds 100 columns #132: FILE: drivers/gpu/drm/i915/i915_gem.c:1383:
+ while ((obj = list_first_entry_or_null(&ww->eviction_list, struct drm_i915_gem_object, obj_link))) {
-:149: WARNING:LONG_LINE: line length of 108 exceeds 100 columns #149: FILE: drivers/gpu/drm/i915/i915_gem.c:1401:
+ while ((obj = list_first_entry_or_null(&ww->eviction_list, struct drm_i915_gem_object, obj_link))) {
-:165: WARNING:SUSPECT_CODE_INDENT: suspect code indent for conditional statements (8, 14) #165: FILE: drivers/gpu/drm/i915/i915_gem.c:1438:
+ else if (ret && ww->evicting) {
+ i915_gem_object_put(ww->contended);
-:165: WARNING:BRACES: braces {} are not necessary for single statement blocks #165: FILE: drivers/gpu/drm/i915/i915_gem.c:1438:
+ else if (ret && ww->evicting) {
+ i915_gem_object_put(ww->contended);
+ }
total: 0 errors, 6 warnings, 0 checks, 160 lines checked 61cd49cc7f1d drm/i915: Keep lazy reference to userptr pages
-:7: WARNING:COMMIT_MESSAGE: Missing commit description - Add an appropriate one
total: 0 errors, 1 warnings, 0 checks, 75 lines checked
_______________________________________________
Intel-gfx mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/intel-gfx
Patchwork
CI[Intel-gfx] ✗ Fi.CI.SPARSE: warning for drm/i915: Remove obj->mm.lock! (rev3)
In reply to Maarten Lankhorst== Series Details ==
== Series Details ==
Series: drm/i915: Remove obj->mm.lock! (rev3)
URL : https://patchwork.freedesktop.org/series/82337/
State : warning
== Summary ==
$ dim sparse --fast origin/drm-tip Sparse version: v0.6.2 Fast mode used, each commit won't be checked separately. - +drivers/gpu/drm/i915/gt/intel_reset.c:1312:5: warning: context imbalance in 'intel_gt_reset_trylock' - different lock contexts for basic block +drivers/gpu/drm/i915/gt/intel_ring_submission.c:1229:24: warning: Using plain integer as NULL pointer +drivers/gpu/drm/i915/gvt/mmio.c:290:23: warning: memcpy with byte count of 279040 +drivers/gpu/drm/i915/i915_perf.c:1440:15: warning: memset with byte count of 16777216 +drivers/gpu/drm/i915/i915_perf.c:1494:15: warning: memset with byte count of 16777216 +drivers/gpu/drm/i915/intel_wakeref.c:137:19: warning: context imbalance in 'wakeref_auto_timeout' - unexpected unlock +drivers/gpu/drm/i915/selftests/i915_syncmap.c:80:54: warning: dubious: x | !y +./include/linux/seqlock.h:752:24: warning: trying to copy expression type 31 +./include/linux/seqlock.h:778:16: warning: trying to copy expression type 31 +./include/linux/spinlock.h:409:9: warning: context imbalance in 'fwtable_read16' - different lock contexts for basic block +./include/linux/spinlock.h:409:9: warning: context imbalance in 'fwtable_read32' - different lock contexts for basic block +./include/linux/spinlock.h:409:9: warning: context imbalance in 'fwtable_read64' - different lock contexts for basic block +./include/linux/spinlock.h:409:9: warning: context imbalance in 'fwtable_read8' - different lock contexts for basic block +./include/linux/spinlock.h:409:9: warning: context imbalance in 'fwtable_write16' - different lock contexts for basic block +./include/linux/spinlock.h:409:9: warning: context imbalance in 'fwtable_write32' - different lock contexts for basic block +./include/linux/spinlock.h:409:9: warning: context imbalance in 'fwtable_write8' - different lock contexts for basic block +./include/linux/spinlock.h:409:9: warning: context imbalance in 'gen11_fwtable_read16' - different lock contexts for basic block +./include/linux/spinlock.h:409:9: warning: context imbalance in 'gen11_fwtable_read32' - different lock contexts for basic block +./include/linux/spinlock.h:409:9: warning: context imbalance in 'gen11_fwtable_read64' - different lock contexts for basic block +./include/linux/spinlock.h:409:9: warning: context imbalance in 'gen11_fwtable_read8' - different lock contexts for basic block +./include/linux/spinlock.h:409:9: warning: context imbalance in 'gen11_fwtable_write16' - different lock contexts for basic block +./include/linux/spinlock.h:409:9: warning: context imbalance in 'gen11_fwtable_write32' - different lock contexts for basic block +./include/linux/spinlock.h:409:9: warning: context imbalance in 'gen11_fwtable_write8' - different lock contexts for basic block +./include/linux/spinlock.h:409:9: warning: context imbalance in 'gen12_fwtable_read16' - different lock contexts for basic block +./include/linux/spinlock.h:409:9: warning: context imbalance in 'gen12_fwtable_read32' - different lock contexts for basic block +./include/linux/spinlock.h:409:9: warning: context imbalance in 'gen12_fwtable_read64' - different lock contexts for basic block +./include/linux/spinlock.h:409:9: warning: context imbalance in 'gen12_fwtable_read8' - different lock contexts for basic block +./include/linux/spinlock.h:409:9: warning: context imbalance in 'gen12_fwtable_write16' - different lock contexts for basic block +./include/linux/spinlock.h:409:9: warning: context imbalance in 'gen12_fwtable_write32' - different lock contexts for basic block +./include/linux/spinlock.h:409:9: warning: context imbalance in 'gen12_fwtable_write8' - different lock contexts for basic block +./include/linux/spinlock.h:409:9: warning: context imbalance in 'gen6_read16' - different lock contexts for basic block +./include/linux/spinlock.h:409:9: warning: context imbalance in 'gen6_read32' - different lock contexts for basic block +./include/linux/spinlock.h:409:9: warning: context imbalance in 'gen6_read64' - different lock contexts for basic block +./include/linux/spinlock.h:409:9: warning: context imbalance in 'gen6_read8' - different lock contexts for basic block +./include/linux/spinlock.h:409:9: warning: context imbalance in 'gen6_write16' - different lock contexts for basic block +./include/linux/spinlock.h:409:9: warning: context imbalance in 'gen6_write32' - different lock contexts for basic block +./include/linux/spinlock.h:409:9: warning: context imbalance in 'gen6_write8' - different lock contexts for basic block +./include/linux/spinlock.h:409:9: warning: context imbalance in 'gen8_write16' - different lock contexts for basic block +./include/linux/spinlock.h:409:9: warning: context imbalance in 'gen8_write32' - different lock contexts for basic block +./include/linux/spinlock.h:409:9: warning: context imbalance in 'gen8_write8' - different lock contexts for basic block
_______________________________________________
Intel-gfx mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/intel-gfx
Patchwork
CI[Intel-gfx] ✗ Fi.CI.DOCS: warning for drm/i915: Remove obj->mm.lock! (rev3)
In reply to Maarten Lankhorst== Series Details ==
== Series Details ==
Series: drm/i915: Remove obj->mm.lock! (rev3)
URL : https://patchwork.freedesktop.org/series/82337/
State : warning
== Summary ==
$ make htmldocs 2>&1 > /dev/null | grep i915 ./drivers/gpu/drm/i915/gem/i915_gem_shrinker.c:102: warning: Function parameter or member 'ww' not described in 'i915_gem_shrink' ./drivers/gpu/drm/i915/i915_cmd_parser.c:1414: warning: Excess function parameter 'trampoline' description in 'intel_engine_cmd_parser' ./drivers/gpu/drm/i915/i915_cmd_parser.c:1415: warning: Function parameter or member 'jump_whitelist' not described in 'intel_engine_cmd_parser' ./drivers/gpu/drm/i915/i915_cmd_parser.c:1415: warning: Function parameter or member 'shadow_map' not described in 'intel_engine_cmd_parser' ./drivers/gpu/drm/i915/i915_cmd_parser.c:1415: warning: Function parameter or member 'batch_map' not described in 'intel_engine_cmd_parser' ./drivers/gpu/drm/i915/i915_cmd_parser.c:1415: warning: Excess function parameter 'trampoline' description in 'intel_engine_cmd_parser'
_______________________________________________
Intel-gfx mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/intel-gfx
Patchwork
CI[Intel-gfx] ✓ Fi.CI.BAT: success for drm/i915: Remove obj->mm.lock! (rev3)
In reply to Maarten Lankhorst== Series Details ==
== Series Details ==
Series: drm/i915: Remove obj->mm.lock! (rev3)
URL : https://patchwork.freedesktop.org/series/82337/
State : success
== Summary ==
CI Bug Log - changes from CI_DRM_9140 -> Patchwork_18703
====================================================
Summary
-------
**SUCCESS**
No regressions found.
External URL: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/index.html
Possible new issues
-------------------
Here are the unknown changes that may have been introduced in Patchwork_18703:
### IGT changes ###
#### Suppressed ####
The following results come from untrusted machines, tests, or statuses. They do not affect the overall result.
* {igt@gem_exec_parallel@engines@userptr}:
- fi-kbl-r: [PASS][1] -> [DMESG-FAIL][2]
[1]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/fi-kbl-r/igt@gem_exec_parallel@[email protected]
[2]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/fi-kbl-r/igt@gem_exec_parallel@[email protected]
- fi-cfl-8109u: [PASS][3] -> [DMESG-FAIL][4]
[3]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/fi-cfl-8109u/igt@gem_exec_parallel@[email protected]
[4]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/fi-cfl-8109u/igt@gem_exec_parallel@[email protected]
- {fi-tgl-dsi}: [PASS][5] -> [DMESG-FAIL][6]
[5]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/fi-tgl-dsi/igt@gem_exec_parallel@[email protected]
[6]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/fi-tgl-dsi/igt@gem_exec_parallel@[email protected]
- fi-blb-e6850: [PASS][7] -> [DMESG-FAIL][8]
[7]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/fi-blb-e6850/igt@gem_exec_parallel@[email protected]
[8]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/fi-blb-e6850/igt@gem_exec_parallel@[email protected]
- fi-bsw-nick: [PASS][9] -> [INCOMPLETE][10]
[9]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/fi-bsw-nick/igt@gem_exec_parallel@[email protected]
[10]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/fi-bsw-nick/igt@gem_exec_parallel@[email protected]
- fi-icl-y: [PASS][11] -> [DMESG-FAIL][12]
[11]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/fi-icl-y/igt@gem_exec_parallel@[email protected]
[12]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/fi-icl-y/igt@gem_exec_parallel@[email protected]
- fi-snb-2520m: [PASS][13] -> [DMESG-FAIL][14]
[13]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/fi-snb-2520m/igt@gem_exec_parallel@[email protected]
[14]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/fi-snb-2520m/igt@gem_exec_parallel@[email protected]
- fi-cml-u2: [PASS][15] -> [DMESG-FAIL][16]
[15]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/fi-cml-u2/igt@gem_exec_parallel@[email protected]
[16]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/fi-cml-u2/igt@gem_exec_parallel@[email protected]
- fi-cfl-8700k: [PASS][17] -> [DMESG-FAIL][18]
[17]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/fi-cfl-8700k/igt@gem_exec_parallel@[email protected]
[18]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/fi-cfl-8700k/igt@gem_exec_parallel@[email protected]
- fi-icl-u2: [PASS][19] -> [DMESG-FAIL][20]
[19]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/fi-icl-u2/igt@gem_exec_parallel@[email protected]
[20]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/fi-icl-u2/igt@gem_exec_parallel@[email protected]
- fi-tgl-u2: NOTRUN -> [DMESG-FAIL][21]
[21]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/fi-tgl-u2/igt@gem_exec_parallel@[email protected]
- {fi-ehl-1}: [PASS][22] -> [DMESG-FAIL][23]
[22]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/fi-ehl-1/igt@gem_exec_parallel@[email protected]
[23]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/fi-ehl-1/igt@gem_exec_parallel@[email protected]
- fi-skl-6600u: [PASS][24] -> [DMESG-FAIL][25]
[24]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/fi-skl-6600u/igt@gem_exec_parallel@[email protected]
[25]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/fi-skl-6600u/igt@gem_exec_parallel@[email protected]
- fi-bsw-n3050: [PASS][26] -> [DMESG-FAIL][27]
[26]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/fi-bsw-n3050/igt@gem_exec_parallel@[email protected]
[27]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/fi-bsw-n3050/igt@gem_exec_parallel@[email protected]
- fi-byt-j1900: [PASS][28] -> [DMESG-FAIL][29]
[28]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/fi-byt-j1900/igt@gem_exec_parallel@[email protected]
[29]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/fi-byt-j1900/igt@gem_exec_parallel@[email protected]
- fi-hsw-4770: [PASS][30] -> [DMESG-FAIL][31]
[30]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/fi-hsw-4770/igt@gem_exec_parallel@[email protected]
[31]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/fi-hsw-4770/igt@gem_exec_parallel@[email protected]
- {fi-kbl-7560u}: NOTRUN -> [DMESG-FAIL][32]
[32]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/fi-kbl-7560u/igt@gem_exec_parallel@[email protected]
- fi-cml-s: [PASS][33] -> [DMESG-FAIL][34]
[33]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/fi-cml-s/igt@gem_exec_parallel@[email protected]
[34]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/fi-cml-s/igt@gem_exec_parallel@[email protected]
- fi-ilk-650: [PASS][35] -> [DMESG-FAIL][36]
[35]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/fi-ilk-650/igt@gem_exec_parallel@[email protected]
[36]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/fi-ilk-650/igt@gem_exec_parallel@[email protected]
- fi-elk-e7500: [PASS][37] -> [DMESG-FAIL][38]
[37]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/fi-elk-e7500/igt@gem_exec_parallel@[email protected]
[38]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/fi-elk-e7500/igt@gem_exec_parallel@[email protected]
- fi-cfl-guc: [PASS][39] -> [DMESG-FAIL][40]
[39]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/fi-cfl-guc/igt@gem_exec_parallel@[email protected]
[40]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/fi-cfl-guc/igt@gem_exec_parallel@[email protected]
- fi-kbl-soraka: [PASS][41] -> [DMESG-FAIL][42]
[41]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/fi-kbl-soraka/igt@gem_exec_parallel@[email protected]
[42]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/fi-kbl-soraka/igt@gem_exec_parallel@[email protected]
- fi-ivb-3770: [PASS][43] -> [DMESG-FAIL][44]
[43]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/fi-ivb-3770/igt@gem_exec_parallel@[email protected]
[44]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/fi-ivb-3770/igt@gem_exec_parallel@[email protected]
- fi-skl-6700k2: [PASS][45] -> [DMESG-FAIL][46]
[45]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/fi-skl-6700k2/igt@gem_exec_parallel@[email protected]
[46]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/fi-skl-6700k2/igt@gem_exec_parallel@[email protected]
- fi-skl-lmem: [PASS][47] -> [DMESG-FAIL][48]
[47]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/fi-skl-lmem/igt@gem_exec_parallel@[email protected]
[48]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/fi-skl-lmem/igt@gem_exec_parallel@[email protected]
- fi-glk-dsi: [PASS][49] -> [DMESG-FAIL][50]
[49]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/fi-glk-dsi/igt@gem_exec_parallel@[email protected]
[50]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/fi-glk-dsi/igt@gem_exec_parallel@[email protected]
- fi-kbl-x1275: [PASS][51] -> [DMESG-FAIL][52]
[51]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/fi-kbl-x1275/igt@gem_exec_parallel@[email protected]
[52]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/fi-kbl-x1275/igt@gem_exec_parallel@[email protected]
- fi-snb-2600: [PASS][53] -> [DMESG-FAIL][54]
[53]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/fi-snb-2600/igt@gem_exec_parallel@[email protected]
[54]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/fi-snb-2600/igt@gem_exec_parallel@[email protected]
- fi-tgl-y: [PASS][55] -> [DMESG-FAIL][56]
[55]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/fi-tgl-y/igt@gem_exec_parallel@[email protected]
[56]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/fi-tgl-y/igt@gem_exec_parallel@[email protected]
- fi-kbl-7500u: [PASS][57] -> [DMESG-FAIL][58]
[57]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/fi-kbl-7500u/igt@gem_exec_parallel@[email protected]
[58]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/fi-kbl-7500u/igt@gem_exec_parallel@[email protected]
- fi-kbl-guc: [PASS][59] -> [DMESG-FAIL][60]
[59]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/fi-kbl-guc/igt@gem_exec_parallel@[email protected]
[60]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/fi-kbl-guc/igt@gem_exec_parallel@[email protected]
- fi-bsw-kefka: [PASS][61] -> [DMESG-FAIL][62]
[61]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/fi-bsw-kefka/igt@gem_exec_parallel@[email protected]
[62]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/fi-bsw-kefka/igt@gem_exec_parallel@[email protected]
- fi-bdw-gvtdvm: [PASS][63] -> [DMESG-FAIL][64]
[63]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/fi-bdw-gvtdvm/igt@gem_exec_parallel@[email protected]
[64]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/fi-bdw-gvtdvm/igt@gem_exec_parallel@[email protected]
- fi-bdw-5557u: [PASS][65] -> [DMESG-FAIL][66]
[65]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/fi-bdw-5557u/igt@gem_exec_parallel@[email protected]
[66]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/fi-bdw-5557u/igt@gem_exec_parallel@[email protected]
Known issues
------------
Here are the changes found in Patchwork_18703 that come from known issues:
### IGT changes ###
#### Possible fixes ####
* igt@debugfs_test@read_all_entries:
- {fi-kbl-7560u}: [INCOMPLETE][67] ([i915#2417]) -> [PASS][68]
[67]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/fi-kbl-7560u/igt@debugfs_test@read_all_entries.html
[68]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/fi-kbl-7560u/igt@debugfs_test@read_all_entries.html
#### Warnings ####
* igt@runner@aborted:
- fi-skl-lmem: [FAIL][69] ([i915#1436] / [i915#2439]) -> [FAIL][70] ([i915#2398] / [i915#2439])
[69]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/fi-skl-lmem/igt@[email protected]
[70]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/fi-skl-lmem/igt@[email protected]
{name}: This element is suppressed. This means it is ignored when computing
the status of the difference (SUCCESS, WARNING, or FAILURE).
[fdo#109271]: https://bugs.freedesktop.org/show_bug.cgi?id=109271
[i915#1436]: https://gitlab.freedesktop.org/drm/intel/issues/1436
[i915#1635]: https://gitlab.freedesktop.org/drm/intel/issues/1635
[i915#1784]: https://gitlab.freedesktop.org/drm/intel/issues/1784
[i915#1814]: https://gitlab.freedesktop.org/drm/intel/issues/1814
[i915#2398]: https://gitlab.freedesktop.org/drm/intel/issues/2398
[i915#2417]: https://gitlab.freedesktop.org/drm/intel/issues/2417
[i915#2439]: https://gitlab.freedesktop.org/drm/intel/issues/2439
Participating hosts (43 -> 38)
------------------------------
Additional (1): fi-tgl-u2
Missing (6): fi-ilk-m540 fi-hsw-4200u fi-byt-squawks fi-bsw-cyan fi-byt-clapper fi-bdw-samus
Build changes
-------------
* Linux: CI_DRM_9140 -> Patchwork_18703
CI-20190529: 20190529
CI_DRM_9140: 114b3ff35870623fbd7b7aa580e4b43c690edace @ git://anongit.freedesktop.org/gfx-ci/linux
IGT_5815: 0c3b29498a624ad42033a219d031cb9dd475405b @ git://anongit.freedesktop.org/xorg/app/intel-gpu-tools
Patchwork_18703: 61cd49cc7f1d7ed032d8511897a86affc834c9cf @ git://anongit.freedesktop.org/gfx-ci/linux
== Linux commits ==
61cd49cc7f1d drm/i915: Keep lazy reference to userptr pages9ff2dbec02c1 drm/i915: Idea to implement eviction lockingffa7eb948163 drm/i915: Keep userpointer bindings if seqcount is unchanged, v2. d48f071fd0db drm/i915: Finally remove obj->mm.lock.135e45899449 drm/i915/selftests: Prepare gtt tests for obj->mm.lock removal 4df2c5801bef drm/i915/selftests: Prepare cs engine tests for obj->mm.lock removal c081d7e17c8b drm/i915/selftests: Prepare memory region tests for obj->mm.lock removal 3c9c1a5ddaff drm/i915/selftests: Prepare i915_request tests for obj->mm.lock removal 853948ea51a4 drm/i915/selftests: Prepare timeline tests for obj->mm.lock removal 0481554c6894 drm/i915/selftests: Prepare ring submission for obj->mm.lock removal 428290f8289c drm/i915/selftests: Prepare mocs tests for obj->mm.lock removal 2d5a80056c2e drm/i915/selftests: Prepare execlists for obj->mm.lock removal b5831f57952b drm/i915/selftests: Prepare hangcheck for obj->mm.lock removal ae7debf30f00 drm/i915/selftests: Prepare context selftest for obj->mm.lock removal 51748645f2d5 drm/i915/selftests: Prepare igt_gem_utils for obj->mm.lock removal 957fd6d746ac drm/i915/selftests: Prepare object blit tests for obj->mm.lock removal. f54ecd6bac1c drm/i915/selftests: Prepare object tests for obj->mm.lock removal. bf606ed2df1e drm/i915/selftests: Prepare mman testcases for obj->mm.lock removal. 790863ab8235 drm/i915/selftests: Prepare execbuf tests for obj->mm.lock removal. 78c5bb187f6b drm/i915/selftests: Prepare dma-buf tests for obj->mm.lock removal. 7e0846ca1737 drm/i915/selftests: Prepare context tests for obj->mm.lock removal. ec19378542fb drm/i915/selftests: Prepare coherency tests for obj->mm.lock removal. 4164fa6a8f49 drm/i915/selftests: Prepare client blit for obj->mm.lock removal. c444c91b2ab0 drm/i915/selftests: Prepare huge_pages testcases for obj->mm.lock removal. d9cbec998e7d drm/i915: Use a single page table lock for each gtt. ead477c41e05 drm/i915: Fix ww locking in shmem_create_from_object 929b4826615b drm/i915: Add missing ww lock in intel_dsb_prepare. 38dfd5400402 drm/i915: Add ww locking to dma-buf ops.78cf25d2059c drm/i915: Lock ww in ucode objects correctly1676bdc1ed2e drm/i915: Increase ww locking for perf.d220a1bf467a drm/i915: Add ww locking around vm_access()2f504829281d drm/i915: Add igt_spinner_pin() to allow for ww locking around spinner. 9d404723b28b drm/i915: Prepare for obj->mm.lock removale648311856d5 drm/i915: Fix workarounds selftest, part 16728383c5033 drm/i915: Fix pread/pwrite to work with new locking rules. a28dce1923d9 drm/i915: Defer pin calls in buffer pool until first use by caller. ec1d61a7843a drm/i915: Take obj lock around set_domain ioctl52f4f0994829 drm/i915: Make __engine_unpark() compatible with ww locking. 7aa2b4b7eab9 drm/i915: Make intel_init_workaround_bb more compatible with ww locking. 605d60eb1494 drm/i915: Take reservation lock around i915_vma_pin. 5c4f1b8547df drm/i915: Move pinning to inside engine_wa_list_verify() 8623814b93d2 drm/i915: Add object locking to vm_fault_cpu8e3b1eed034a drm/i915: Pass ww ctx to intel_pin_to_display_plane a5600bf6d23a drm/i915: Rework clflush to work correctly without obj->mm.lock. 75e706407c5e drm/i915: Handle ww locking in init_status_page372d3f54f47f drm/i915: Make ring submission compatible with obj->mm.lock removal, v2. 0ddefffcf870 drm/i915: Populate logical context during first pin. f71980dabbdf drm/i915: Flatten obj->mm.lock733050ed7f31 drm/i915: Fix userptr so we do not have to worry about obj->mm.lock, v3. 6f485e50888c drm/i915: Reject UNSYNCHRONIZED for userptr415cc556a463 drm/i915: Reject more ioctls for userptr942724c1e6a7 drm/i915: No longer allow exporting userptr through dma-buf 371cbc9d8c27 drm/i915: Disable userptr pread/pwrite support.6f0824c8b9c0 drm/i915: make lockdep slightly happier about execbuf. 174f857c33e0 drm/i915: Convert i915_gem_object_attach_phys() to ww locking a0e592a97856 drm/i915: Rework struct phys attachment handling f59341469336 drm/i915: Move HAS_STRUCT_PAGE to obj->flags3078927638f1 drm/i915: Add gem object locking to madvise.5204c04e1783 drm/i915: Ensure we hold the object mutex in pin correctly. afc484a312e1 drm/i915: Pin timeline map after first timeline pin, v3. d304ddd05bc2 drm/i915: Do not share hwsp across contexts any more, v3. 85953c769887 drm/i915: Add missing -EDEADLK handling to execbuf pinning 80a8f48f229f drm/i915: Move cmd parser pinning to execbuffer
== Logs ==
For more details see: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/index.html
_______________________________________________
Intel-gfx mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/intel-gfx
Patchwork
CI[Intel-gfx] ✗ Fi.CI.IGT: failure for drm/i915: Remove obj->mm.lock! (rev3)
In reply to Maarten Lankhorst== Series Details ==
== Series Details ==
Series: drm/i915: Remove obj->mm.lock! (rev3)
URL : https://patchwork.freedesktop.org/series/82337/
State : failure
== Summary ==
CI Bug Log - changes from CI_DRM_9140_full -> Patchwork_18703_full
====================================================
Summary
-------
**FAILURE**
Serious unknown changes coming with Patchwork_18703_full absolutely need to be verified manually.
If you think the reported changes have nothing to do with the changes introduced in Patchwork_18703_full, please notify your bug team to allow them to document this new failure mode, which will reduce false positives in CI.
Possible new issues
-------------------
Here are the unknown changes that may have been introduced in Patchwork_18703_full:
### IGT changes ###
#### Possible regressions ####
* igt@gem_blits@basic:
- shard-tglb: [PASS][1] -> [INCOMPLETE][2] +3 similar issues
[1]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-tglb3/igt@[email protected]
[2]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-tglb7/igt@[email protected]
* igt@gem_exec_capture@userptr:
- shard-iclb: [PASS][3] -> [DMESG-FAIL][4]
[3]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-iclb3/igt@[email protected]
[4]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-iclb8/igt@[email protected]
- shard-glk: [PASS][5] -> [DMESG-FAIL][6]
[5]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-glk4/igt@[email protected]
[6]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-glk6/igt@[email protected]
- shard-kbl: [PASS][7] -> [DMESG-FAIL][8]
[7]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-kbl7/igt@[email protected]
[8]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-kbl6/igt@[email protected]
- shard-snb: [PASS][9] -> [DMESG-FAIL][10]
[9]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-snb4/igt@[email protected]
[10]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-snb7/igt@[email protected]
- shard-skl: NOTRUN -> [DMESG-FAIL][11]
[11]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-skl7/igt@[email protected]
- shard-tglb: [PASS][12] -> [DMESG-FAIL][13]
[12]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-tglb5/igt@[email protected]
[13]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-tglb8/igt@[email protected]
* igt@gem_exec_schedule@pi-distinct-iova@rcs0:
- shard-iclb: [PASS][14] -> [INCOMPLETE][15] +3 similar issues
[14]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-iclb8/igt@gem_exec_schedule@[email protected]
[15]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-iclb6/igt@gem_exec_schedule@[email protected]
- shard-skl: NOTRUN -> [INCOMPLETE][16]
[16]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-skl10/igt@gem_exec_schedule@[email protected]
* igt@gem_exec_schedule@pi-shared-iova@rcs0:
- shard-kbl: [PASS][17] -> [INCOMPLETE][18] +3 similar issues
[17]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-kbl4/igt@gem_exec_schedule@[email protected]
[18]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-kbl4/igt@gem_exec_schedule@[email protected]
- shard-glk: [PASS][19] -> [INCOMPLETE][20] +3 similar issues
[19]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-glk2/igt@gem_exec_schedule@[email protected]
[20]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-glk1/igt@gem_exec_schedule@[email protected]
* igt@gem_exec_schedule@pi-userfault@bcs0:
- shard-tglb: [PASS][21] -> [DMESG-WARN][22] +1 similar issue
[21]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-tglb5/igt@gem_exec_schedule@[email protected]
[22]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-tglb1/igt@gem_exec_schedule@[email protected]
* igt@gem_exec_schedule@pi-userfault@rcs0:
- shard-skl: [PASS][23] -> [DMESG-WARN][24] +2 similar issues
[23]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-skl8/igt@gem_exec_schedule@[email protected]
[24]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-skl7/igt@gem_exec_schedule@[email protected]
- shard-kbl: [PASS][25] -> [DMESG-WARN][26]
[25]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-kbl2/igt@gem_exec_schedule@[email protected]
[26]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-kbl6/igt@gem_exec_schedule@[email protected]
* igt@gem_exec_schedule@pi-userfault@vcs0:
- shard-iclb: [PASS][27] -> [DMESG-WARN][28] +2 similar issues
[27]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-iclb2/igt@gem_exec_schedule@[email protected]
[28]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-iclb7/igt@gem_exec_schedule@[email protected]
* igt@gem_exec_schedule@pi-userfault@vecs0:
- shard-skl: [PASS][29] -> [INCOMPLETE][30] +1 similar issue
[29]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-skl8/igt@gem_exec_schedule@[email protected]
[30]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-skl7/igt@gem_exec_schedule@[email protected]
* igt@gem_exec_whisper@basic-fds-priority-all:
- shard-kbl: [PASS][31] -> [TIMEOUT][32] +1 similar issue
[31]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-kbl1/igt@[email protected]
[32]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-kbl7/igt@[email protected]
* igt@gem_exec_whisper@basic-queues-forked:
- shard-glk: [PASS][33] -> [TIMEOUT][34]
[33]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-glk2/igt@[email protected]
[34]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-glk9/igt@[email protected]
* igt@gem_userptr_blits@map-fixed-invalidate-overlap-gup:
- shard-iclb: NOTRUN -> [SKIP][35] +11 similar issues
[35]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-iclb8/igt@[email protected]
* igt@gem_userptr_blits@process-exit-mmap:
- shard-tglb: NOTRUN -> [SKIP][36] +11 similar issues
[36]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-tglb2/igt@[email protected]
* igt@gem_userptr_blits@stress-mm-invalidate-close:
- shard-iclb: [PASS][37] -> [SKIP][38] +22 similar issues
[37]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-iclb4/igt@[email protected]
[38]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-iclb3/igt@[email protected]
* igt@gem_userptr_blits@unsync-unmap-cycles:
- shard-tglb: [PASS][39] -> [SKIP][40] +22 similar issues
[39]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-tglb7/igt@[email protected]
[40]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-tglb8/igt@[email protected]
#### Warnings ####
* igt@gem_userptr_blits@coherency-unsync:
- shard-tglb: [SKIP][41] ([fdo#110542]) -> [SKIP][42] +1 similar issue
[41]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-tglb2/igt@[email protected]
[42]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-tglb6/igt@[email protected]
- shard-iclb: [SKIP][43] ([fdo#109290]) -> [SKIP][44] +1 similar issue
[43]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-iclb4/igt@[email protected]
[44]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-iclb3/igt@[email protected]
* igt@gem_userptr_blits@readonly-pwrite-unsync:
- shard-tglb: [SKIP][45] ([fdo#110426] / [i915#1704]) -> [SKIP][46] +1 similar issue
[45]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-tglb2/igt@[email protected]
[46]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-tglb2/igt@[email protected]
- shard-iclb: [SKIP][47] ([fdo#110426] / [i915#1704]) -> [SKIP][48] +1 similar issue
[47]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-iclb2/igt@[email protected]
[48]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-iclb6/igt@[email protected]
#### Suppressed ####
The following results come from untrusted machines, tests, or statuses. They do not affect the overall result.
* {igt@gem_ctx_persistence@userptr}:
- shard-glk: [PASS][49] -> [INCOMPLETE][50]
[49]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-glk1/igt@[email protected]
[50]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-glk4/igt@[email protected]
- shard-tglb: [PASS][51] -> [DMESG-FAIL][52] +1 similar issue
[51]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-tglb6/igt@[email protected]
[52]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-tglb7/igt@[email protected]
- shard-iclb: [PASS][53] -> [DMESG-FAIL][54] +1 similar issue
[53]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-iclb3/igt@[email protected]
[54]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-iclb4/igt@[email protected]
* {igt@gem_exec_parallel@engines@userptr}:
- shard-skl: [PASS][55] -> [DMESG-FAIL][56] +1 similar issue
[55]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-skl9/igt@gem_exec_parallel@[email protected]
[56]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-skl8/igt@gem_exec_parallel@[email protected]
- shard-glk: [PASS][57] -> [DMESG-FAIL][58]
[57]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-glk1/igt@gem_exec_parallel@[email protected]
[58]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-glk6/igt@gem_exec_parallel@[email protected]
- shard-kbl: [PASS][59] -> [DMESG-FAIL][60] +1 similar issue
[59]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-kbl6/igt@gem_exec_parallel@[email protected]
[60]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-kbl4/igt@gem_exec_parallel@[email protected]
- shard-snb: [PASS][61] -> [DMESG-FAIL][62]
[61]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-snb7/igt@gem_exec_parallel@[email protected]
[62]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-snb7/igt@gem_exec_parallel@[email protected]
* {igt@gen9_exec_parse@bb-large}:
- shard-skl: [SKIP][63] ([fdo#109271]) -> [FAIL][64]
[63]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-skl3/igt@[email protected]
[64]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-skl3/igt@[email protected]
- shard-glk: [PASS][65] -> [FAIL][66]
[65]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-glk8/igt@[email protected]
[66]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-glk5/igt@[email protected]
- shard-kbl: [PASS][67] -> [FAIL][68]
[67]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-kbl6/igt@[email protected]
[68]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-kbl2/igt@[email protected]
* {igt@prime_vgem@basic-userptr}:
- shard-tglb: [PASS][69] -> [SKIP][70]
[69]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-tglb6/igt@[email protected]
[70]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-tglb7/igt@[email protected]
- shard-iclb: [PASS][71] -> [SKIP][72]
[71]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-iclb3/igt@[email protected]
[72]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-iclb4/igt@[email protected]
### Piglit changes ###
#### Possible regressions ####
* spec@amd_pinned_memory@map-buffer increment-offset (NEW):
- {pig-icl-1065g7}: NOTRUN -> [INCOMPLETE][73] +7 similar issues
[73]: None
#### Suppressed ####
The following results come from untrusted machines, tests, or statuses. They do not affect the overall result.
* spec@amd_pinned_memory@map-buffer offset=0:
- {pig-icl-1065g7}: NOTRUN -> [CRASH][74] +1 similar issue
[74]: None
New tests
---------
New tests have been introduced between CI_DRM_9140_full and Patchwork_18703_full:
### New Piglit tests (8) ###
* spec@amd_pinned_memory@decrement-offset:
- Statuses : 1 incomplete(s)
- Exec time: [0.0] s
* spec@amd_pinned_memory@increment-offset:
- Statuses : 1 incomplete(s)
- Exec time: [0.0] s
* spec@amd_pinned_memory@map-buffer decrement-offset:
- Statuses : 1 incomplete(s)
- Exec time: [0.0] s
* spec@amd_pinned_memory@map-buffer increment-offset:
- Statuses : 1 incomplete(s)
- Exec time: [0.0] s
* spec@amd_vertex_shader_viewport_index@amd_vertex_shader_viewport_index-render:
- Statuses : 1 incomplete(s)
- Exec time: [0.0] s
* spec@arb_map_buffer_range@copybuffersubdata decrement-offset:
- Statuses : 1 incomplete(s)
- Exec time: [0.0] s
* spec@nv_texture_barrier@arb_texture_barrier-texture-halves-ping-pong-operation-chain:
- Statuses : 1 incomplete(s)
- Exec time: [0.0] s
* spec@nv_texture_env_combine4@nv_texture_env_combine4-combine:
- Statuses : 1 incomplete(s)
- Exec time: [0.0] s
Known issues
------------
Here are the changes found in Patchwork_18703_full that come from known issues:
### IGT changes ###
#### Issues hit ####
* igt@gem_blits@basic:
- shard-apl: [PASS][75] -> [INCOMPLETE][76] ([i915#1635]) +3 similar issues
[75]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-apl1/igt@[email protected]
[76]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-apl3/igt@[email protected]
- shard-snb: [PASS][77] -> [INCOMPLETE][78] ([i915#82])
[77]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-snb2/igt@[email protected]
[78]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-snb2/igt@[email protected]
* igt@gem_exec_capture@userptr:
- shard-apl: [PASS][79] -> [DMESG-FAIL][80] ([i915#1635])
[79]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-apl2/igt@[email protected]
[80]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-apl8/igt@[email protected]
* igt@gem_exec_reloc@basic-many-active@bcs0:
- shard-apl: [PASS][81] -> [FAIL][82] ([i915#1635] / [i915#2389]) +2 similar issues
[81]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-apl4/igt@gem_exec_reloc@[email protected]
[82]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-apl3/igt@gem_exec_reloc@[email protected]
* igt@gem_exec_schedule@pi-userfault@rcs0:
- shard-apl: [PASS][83] -> [DMESG-WARN][84] ([i915#1635])
[83]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-apl4/igt@gem_exec_schedule@[email protected]
[84]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-apl4/igt@gem_exec_schedule@[email protected]
* igt@gem_exec_whisper@basic-queues:
- shard-apl: [PASS][85] -> [TIMEOUT][86] ([i915#1635])
[85]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-apl4/igt@[email protected]
[86]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-apl7/igt@[email protected]
* igt@gem_userptr_blits@create-destroy-sync:
- shard-glk: [PASS][87] -> [SKIP][88] ([fdo#109271]) +23 similar issues
[87]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-glk8/igt@[email protected]
[88]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-glk8/igt@[email protected]
* igt@gem_userptr_blits@process-exit-busy:
- shard-skl: [PASS][89] -> [SKIP][90] ([fdo#109271]) +21 similar issues
[89]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-skl9/igt@[email protected]
[90]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-skl6/igt@[email protected]
* igt@gem_userptr_blits@stress-mm-invalidate-close:
- shard-apl: [PASS][91] -> [SKIP][92] ([fdo#109271] / [i915#1635]) +23 similar issues
[91]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-apl8/igt@[email protected]
[92]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-apl6/igt@[email protected]
* igt@gem_userptr_blits@stress-purge:
- shard-snb: [PASS][93] -> [SKIP][94] ([fdo#109271]) +25 similar issues
[93]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-snb5/igt@[email protected]
[94]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-snb4/igt@[email protected]
* igt@gem_userptr_blits@unsync-unmap-cycles:
- shard-kbl: [PASS][95] -> [SKIP][96] ([fdo#109271]) +24 similar issues
[95]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-kbl2/igt@[email protected]
[96]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-kbl6/igt@[email protected]
* igt@i915_suspend@forcewake:
- shard-skl: [PASS][97] -> [INCOMPLETE][98] ([i915#636])
[97]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-skl5/igt@[email protected]
[98]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-skl1/igt@[email protected]
* igt@kms_cursor_edge_walk@pipe-a-64x64-right-edge:
- shard-skl: [PASS][99] -> [DMESG-WARN][100] ([i915#1982]) +6 similar issues
[99]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-skl10/igt@[email protected]
[100]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-skl5/igt@[email protected]
* igt@kms_frontbuffer_tracking@fbc-1p-primscrn-cur-indfb-move:
- shard-tglb: [PASS][101] -> [FAIL][102] ([i915#2416]) +1 similar issue
[101]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-tglb7/igt@[email protected]
[102]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-tglb5/igt@[email protected]
* igt@kms_frontbuffer_tracking@fbcpsr-1p-primscrn-spr-indfb-draw-mmap-wc:
- shard-tglb: [PASS][103] -> [DMESG-WARN][104] ([i915#1982])
[103]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-tglb3/igt@kms_frontbuffer_tracking@fbcpsr-1p-primscrn-spr-indfb-draw-mmap-wc.html
[104]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-tglb3/igt@kms_frontbuffer_tracking@fbcpsr-1p-primscrn-spr-indfb-draw-mmap-wc.html
* igt@kms_hdr@bpc-switch-suspend:
- shard-skl: [PASS][105] -> [FAIL][106] ([i915#1188])
[105]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-skl8/igt@[email protected]
[106]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-skl6/igt@[email protected]
* igt@kms_plane_cursor@pipe-c-primary-size-128:
- shard-kbl: [PASS][107] -> [DMESG-WARN][108] ([i915#1982])
[107]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-kbl4/igt@[email protected]
[108]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-kbl4/igt@[email protected]
* igt@kms_psr@psr2_no_drrs:
- shard-iclb: [PASS][109] -> [SKIP][110] ([fdo#109441]) +1 similar issue
[109]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-iclb2/igt@kms_psr@psr2_no_drrs.html
[110]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-iclb7/igt@kms_psr@psr2_no_drrs.html
* igt@kms_vblank@pipe-a-query-idle-hang:
- shard-apl: [PASS][111] -> [DMESG-WARN][112] ([i915#1635] / [i915#1982])
[111]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-apl4/igt@[email protected]
[112]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-apl7/igt@[email protected]
* igt@perf@blocking-parameterized:
- shard-glk: [PASS][113] -> [DMESG-WARN][114] ([i915#1982])
[113]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-glk2/igt@[email protected]
[114]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-glk1/igt@[email protected]
* igt@perf@polling-parameterized:
- shard-skl: [PASS][115] -> [FAIL][116] ([i915#1542])
[115]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-skl1/igt@[email protected]
[116]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-skl7/igt@[email protected]
#### Possible fixes ####
* igt@gem_exec_whisper@basic-queues:
- shard-glk: [DMESG-WARN][117] ([i915#118] / [i915#95]) -> [PASS][118] +1 similar issue
[117]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-glk7/igt@[email protected]
[118]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-glk2/igt@[email protected]
* igt@kms_big_fb@linear-32bpp-rotate-0:
- shard-skl: [DMESG-WARN][119] ([i915#1982]) -> [PASS][120] +3 similar issues
[119]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-skl1/igt@[email protected]
[120]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-skl7/igt@[email protected]
* igt@kms_big_fb@yf-tiled-16bpp-rotate-180:
- shard-kbl: [DMESG-WARN][121] ([i915#1982]) -> [PASS][122] +1 similar issue
[121]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-kbl6/igt@[email protected]
[122]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-kbl2/igt@[email protected]
* igt@kms_cursor_edge_walk@pipe-b-256x256-right-edge:
- shard-glk: [DMESG-WARN][123] ([i915#1982]) -> [PASS][124]
[123]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-glk2/igt@[email protected]
[124]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-glk9/igt@[email protected]
* igt@kms_draw_crc@draw-method-rgb565-pwrite-ytiled:
- shard-apl: [DMESG-WARN][125] ([i915#1635] / [i915#1982]) -> [PASS][126]
[125]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-apl8/igt@[email protected]
[126]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-apl6/igt@[email protected]
* igt@kms_frontbuffer_tracking@fbc-1p-primscrn-indfb-msflip-blt:
- shard-tglb: [FAIL][127] ([i915#2416]) -> [PASS][128]
[127]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-tglb2/igt@[email protected]
[128]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-tglb6/igt@[email protected]
* igt@kms_frontbuffer_tracking@psr-1p-primscrn-spr-indfb-draw-mmap-cpu:
- shard-tglb: [DMESG-WARN][129] ([i915#1982]) -> [PASS][130] +3 similar issues
[129]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-tglb7/igt@kms_frontbuffer_tracking@psr-1p-primscrn-spr-indfb-draw-mmap-cpu.html
[130]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-tglb7/igt@kms_frontbuffer_tracking@psr-1p-primscrn-spr-indfb-draw-mmap-cpu.html
* igt@kms_frontbuffer_tracking@psr-rgb565-draw-pwrite:
- shard-skl: [FAIL][131] ([i915#49]) -> [PASS][132]
[131]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-skl5/igt@[email protected]
[132]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-skl1/igt@[email protected]
* igt@kms_plane_alpha_blend@pipe-a-coverage-7efc:
- shard-skl: [FAIL][133] ([fdo#108145] / [i915#265]) -> [PASS][134]
[133]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-skl5/igt@[email protected]
[134]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-skl1/igt@[email protected]
* igt@kms_psr2_su@frontbuffer:
- shard-iclb: [SKIP][135] ([fdo#109642] / [fdo#111068]) -> [PASS][136]
[135]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-iclb6/igt@[email protected]
[136]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-iclb2/igt@[email protected]
* igt@kms_psr@psr2_sprite_plane_move:
- shard-iclb: [SKIP][137] ([fdo#109441]) -> [PASS][138] +1 similar issue
[137]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-iclb6/igt@kms_psr@psr2_sprite_plane_move.html
[138]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-iclb2/igt@kms_psr@psr2_sprite_plane_move.html
#### Warnings ####
* igt@kms_flip@flip-vs-expired-vblank@a-edp1:
- shard-skl: [DMESG-WARN][139] ([i915#1982]) -> [DMESG-FAIL][140] ([i915#1982] / [i915#79])
[139]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-skl10/igt@kms_flip@[email protected]
[140]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-skl5/igt@kms_flip@[email protected]
* igt@kms_frontbuffer_tracking@fbcpsr-1p-primscrn-indfb-msflip-blt:
- shard-tglb: [DMESG-FAIL][141] ([i915#1982]) -> [FAIL][142] ([i915#2416])
[141]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-tglb5/igt@kms_frontbuffer_tracking@fbcpsr-1p-primscrn-indfb-msflip-blt.html
[142]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-tglb8/igt@kms_frontbuffer_tracking@fbcpsr-1p-primscrn-indfb-msflip-blt.html
* igt@runner@aborted:
- shard-glk: [FAIL][143] ([i915#2439] / [k.org#202321]) -> ([FAIL][144], [FAIL][145], [FAIL][146], [FAIL][147], [FAIL][148], [FAIL][149], [FAIL][150], [FAIL][151]) ([i915#2398] / [i915#2439] / [k.org#202321])
[143]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_9140/shard-glk6/igt@[email protected]
[144]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-glk9/igt@[email protected]
[145]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-glk4/igt@[email protected]
[146]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-glk6/igt@[email protected]
[147]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-glk1/igt@[email protected]
[148]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-glk6/igt@[email protected]
[149]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-glk7/igt@[email protected]
[150]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-glk2/igt@[email protected]
[151]: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/shard-glk6/igt@[email protected]
{name}: This element is suppressed. This means it is ignored when computing
the status of the difference (SUCCESS, WARNING, or FAILURE).
[fdo#108145]: https://bugs.freedesktop.org/show_bug.cgi?id=108145
[fdo#109271]: https://bugs.freedesktop.org/show_bug.cgi?id=109271
[fdo#109290]: https://bugs.freedesktop.org/show_bug.cgi?id=109290
[fdo#109441]: https://bugs.freedesktop.org/show_bug.cgi?id=109441
[fdo#109642]: https://bugs.freedesktop.org/show_bug.cgi?id=109642
[fdo#110426]: https://bugs.freedesktop.org/show_bug.cgi?id=110426
[fdo#110542]: https://bugs.freedesktop.org/show_bug.cgi?id=110542
[fdo#111068]: https://bugs.freedesktop.org/show_bug.cgi?id=111068
[i915#118]: https://gitlab.freedesktop.org/drm/intel/issues/118
[i915#1188]: https://gitlab.freedesktop.org/drm/intel/issues/1188
[i915#1542]: https://gitlab.freedesktop.org/drm/intel/issues/1542
[i915#1635]: https://gitlab.freedesktop.org/drm/intel/issues/1635
[i915#1704]: https://gitlab.freedesktop.org/drm/intel/issues/1704
[i915#1982]: https://gitlab.freedesktop.org/drm/intel/issues/1982
[i915#2389]: https://gitlab.freedesktop.org/drm/intel/issues/2389
[i915#2398]: https://gitlab.freedesktop.org/drm/intel/issues/2398
[i915#2416]: https://gitlab.freedesktop.org/drm/intel/issues/2416
[i915#2439]: https://gitlab.freedesktop.org/drm/intel/issues/2439
[i915#265]: https://gitlab.freedesktop.org/drm/intel/issues/265
[i915#49]: https://gitlab.freedesktop.org/drm/intel/issues/49
[i915#636]: https://gitlab.freedesktop.org/drm/intel/issues/636
[i915#79]: https://gitlab.freedesktop.org/drm/intel/issu
== Logs ==
For more details see: https://intel-gfx-ci.01.org/tree/drm-tip/Patchwork_18703/index.html
_______________________________________________
Intel-gfx mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/intel-gfx