Resolve issues with ringbuffer space management
Subsystems (2)
A message that is not in the archive (sent off-list or not yet received): [email protected]
PATCH v2 1/1 Resolve issues with ringbuffer space management
Updates and supersedes the referenced patch,
"Reinstate order of operations in {intel,logical}_ring_begin()"
_______________________________________________
Intel-gfx mailing list
[email protected]
http://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH 1/2 drm/i915: use effective_size for ringbuffer calculations
When calculating the available space in a ringbuffer, we should use the effective_size rather than the true size of the ring.
v2: rebase to latest drm-intel-nightly
v3: rebase to latest drm-intel-nightly
--- drivers/gpu/drm/i915/intel_lrc.c | 5 +++-- drivers/gpu/drm/i915/intel_ringbuffer.c | 9 ++++++--- 2 files changed, 9 insertions(+), 5 deletions(-)
drivers/gpu/drm/i915/intel_lrc.c +3 -2
@@ -699,7 +699,7 @@ static int logical_ring_wait_for_space(struct intel_ringbuffer *ringbuf,/* Would completion of this request free enough space? */ space =__intel_ring_space (request->postfix, ringbuf->tail, - ringbuf->size); + ringbuf->effective_size);if (space >= bytes)break ; }
@@ -711,7 +711,8 @@ static int logical_ring_wait_for_space(struct intel_ringbuffer *ringbuf,if (ret)return ret; - ringbuf->space = space; +/* Update ring space after wait+retire */ +intel_ring_update_space (ringbuf);return 0 ; }
drivers/gpu/drm/i915/intel_ringbuffer.c +6 -3
@@ -66,7 +66,8 @@ void intel_ring_update_space(struct intel_ringbuffer *ringbuf) } ringbuf->space =__intel_ring_space (ringbuf->head &HEAD_ADDR , - ringbuf->tail, ringbuf->size); + ringbuf->tail, + ringbuf->effective_size); }int intel_ring_space (struct intel_ringbuffer *ringbuf)
@@ -2117,8 +2118,9 @@ static int ring_wait_for_space(struct intel_engine_cs *ring, int n)return 0 ;list_for_each_entry (request, &ring->request_list, list) { +/* Would completion of this request free enough space? */ space =__intel_ring_space (request->postfix, ringbuf->tail, - ringbuf->size); + ringbuf->effective_size);if (space >= n)break ; }
@@ -2130,7 +2132,8 @@ static int ring_wait_for_space(struct intel_engine_cs *ring, int n)if (ret)return ret; - ringbuf->space = space; +/* Update ring space after wait+retire */ +intel_ring_update_space (ringbuf);return 0 ; }
Signature · 6 lines
1.7.9.5 _______________________________________________ Intel-gfx mailing list [email protected] http://lists.freedesktop.org/mailman/listinfo/intel-gfx
Re: [PATCH 1/2] drm/i915: use effective_size for ringbuffer calculations
Quoted 26 lines · Dave Gordon
When calculating the available space in a ringbuffer, we should use the
effective_sizerather than the true size of the ring.v2: rebase to latest drm-intel-nightly
v3: rebase to latest drm-intel-nightlySigned-off-by Dave Gordon <[email protected]>--- drivers/gpu/drm/i915/intel_lrc.c | 5 +++-- drivers/gpu/drm/i915/intel_ringbuffer.c | 9 ++++++--- 2 files changed, 9 insertions(+), 5 deletions(-)drivers/gpu/drm/i915/intel_lrc.c +1
-1@@ -699,7 +699,7 @@ static int logical_ring_wait_for_space(struct intel_ringbuffer *ringbuf,/* Would completion of this request free enough space? */ space =__intel_ring_space (request->postfix, ringbuf->tail, - ringbuf->size); + ringbuf->effective_size);if (space >= bytes)break ; }
drivers/gpu/drm/i915/intel_lrc.c static int logical_ring_wait_for_space(struct intel_ringbuffer *ringbuf, · line 715
Quoted 6 lines
drivers/gpu/drm/i915/intel_lrc.c +2
-1@@ -711,7 +711,8 @@ static int logical_ring_wait_for_space(struct intel_ringbuffer *ringbuf,if (ret)return ret; - ringbuf->space = space; +/* Update ring space after wait+retire */ +intel_ring_update_space (ringbuf);
Does the function not do what it says on the tin? At least make it seem like you are explaining your reasoning, not documenting the following function.
/*
* Having waited for the request, query the HEAD of most recent retired
* request and use that for our space calcuations.
*/
However, that makes an incorrect assumption about the waiter. Given that the current code is written such that ringbuf->last_retired_head = request->postfix and that space is identical to the repeated calculation, what is your intention exactly?
-Chris
Signature · 5 lines
Chris Wilson, Intel Open Source Technology Centre _______________________________________________ Intel-gfx mailing list [email protected] http://lists.freedesktop.org/mailman/listinfo/intel-gfx
Re: [PATCH 1/2] drm/i915: use effective_size for ringbuffer calculations
Quoted 38 lines · Chris Wilson
Quoted 26 lines · Dave Gordon
When calculating the available space in a ringbuffer, we should use the
effective_sizerather than the true size of the ring.v2: rebase to latest drm-intel-nightly
v3: rebase to latest drm-intel-nightlySigned-off-by Dave Gordon <[email protected]>--- drivers/gpu/drm/i915/intel_lrc.c | 5 +++-- drivers/gpu/drm/i915/intel_ringbuffer.c | 9 ++++++--- 2 files changed, 9 insertions(+), 5 deletions(-)drivers/gpu/drm/i915/intel_lrc.c +1
-1@@ -699,7 +699,7 @@ static int logical_ring_wait_for_space(struct intel_ringbuffer *ringbuf,/* Would completion of this request free enough space? */ space =__intel_ring_space (request->postfix, ringbuf->tail, - ringbuf->size); + ringbuf->effective_size);if (space >= bytes)break ; }drivers/gpu/drm/i915/intel_lrc.c static int logical_ring_wait_for_space(struct intel_ringbuffer *ringbuf, · line 715
Quoted 6 lines
drivers/gpu/drm/i915/intel_lrc.c +2
-1@@ -711,7 +711,8 @@ static int logical_ring_wait_for_space(struct intel_ringbuffer *ringbuf,if (ret)return ret; - ringbuf->space = space; +/* Update ring space after wait+retire */ +intel_ring_update_space (ringbuf);Does the function not do what it says on the tin? At least make it seem like you are explaining your reasoning, not documenting the following function.
Quoted 4 lines
/*
* Having waited for the request, query the HEAD of most recent retired
* request and use that for our space calcuations.
*/
That's what the comment means; the important bit is mentioning "retire", since it's not explicitly called from here but only via wait_request(). We could say,
/* * After waiting, at least one request must have completed * and been retired, so make sure that the ringbuffer's * space calculations are up to date */ intel_ring_update_space(ringbuf); BUG_ON(ringbuf->space < bytes);
Quoted 5 lines
However, that makes an incorrect assumption about the waiter. Given that the current code is written such that
ringbuf->last_retired_head=request->postfixand that space is identical to the repeated calculation, what is your intention exactly?
-Chris
Three factors:
* firstly, a preference: I find it logically simpler that there should be one and only one piece of code that writes into ringbuf->space. One doesn't then have to reason about whether two different calculations are in fact equivalent.
* secondly, for future proofing: although wait_request() now retires only up to the waited-for request, that wasn't always the case, nor is there any reason why it could not in future opportunistically retire additional requests that have completed while it was waiting.
* thirdly, for correctness: using the function has the additional effect of consuming the last_retired_head value set by retire_request. If this is not done, a later call to intel_ring_space() may become confused, with the result that 'head' (and therefore 'space') will be incorrectly updated.
.Dave.
_______________________________________________
Intel-gfx mailing list
[email protected]
http://lists.freedesktop.org/mailman/listinfo/intel-gfx
Re: [PATCH 1/2] drm/i915: use effective_size for ringbuffer calculations
Quoted 6 lines · Dave Gordon
Quoted 5 lines
However, that makes an incorrect assumption about the waiter. Given that the current code is written such that
ringbuf->last_retired_head=request->postfixand that space is identical to the repeated calculation, what is your intention exactly?
-Chris
Quoted 6 lines
Three factors:
* firstly, a preference: I find it logically simpler that there should be one and only one piece of code that writes into
ringbuf->space. One doesn't then have to reason about whether two different calculations are in fact equivalent.
I find the opposite, since we compute how much space we want I think it is counter intuitive to suggest otherwise. You then need to assert that the computed space is enough. By saying if we wait until this request, we must have at least this space available and only using that space there is no implicit knowlege.
Quoted 4 lines
* secondly, for future proofing: although
wait_request()now retires only up to the waited-for request, that wasn't always the case, nor is there any reason why it could not in future opportunistically retire additional requests that have completed while it was waiting.
Because there is a cost associated with every retirement. See above for why being explicit is clearer.
Quoted 5 lines
* thirdly, for correctness: using the function has the additional effect of consuming the
last_retired_headvalue set byretire_request. If this is not done, a later call tointel_ring_space()may become confused, with the result that 'head' (and therefore 'space') will be incorrectly updated.
Eh. The code is still strictly correct. The biggest issue is that we have multiple locations that decide how to interpret the amount of space generated by completing the request. However, we want to keep request retirement very simple since it is a hot function.
-Chris
Signature · 5 lines
Chris Wilson, Intel Open Source Technology Centre _______________________________________________ Intel-gfx mailing list [email protected] http://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH 2/2 drm/i915: Rework order of operations in {__intel, logical}_ring_prepare()
In reply to Dave GordonThe original idea of preallocating the OLR was implemented in
Quoted 1 line
9d773091drm/i915: Preallocate next seqno before touching the ring
and the sequence of operations was to allocate the OLR, then wrap past the end of the ring if necessary, then wait for space if necessary. But subsequently intel_ring_begin() was refactored, in
Quoted 1 line
304d695 drm/i915: Flush outstanding requests before allocating new seqno
to ensure that pending work that might need to be flushed used the old and not the newly-allocated request. This changed the sequence to wrap and/or wait, then allocate, although the comment still said
/* Preallocate the olr before touching the ring */
which was no longer true as intel_wrap_ring_buffer() touches the ring.
However, with the introduction of dynamic pinning, in
Quoted 1 line
7ba717c drm/i915/bdw: Pin the ringbuffer backing object to GGTT on-demand
came the possibility that the ringbuffer might not be pinned to the GTT or mapped into CPU address space when intel_ring_begin() is called. It gets pinned when the request is allocated, so it's now important that this comes *before* anything that can write into the ringbuffer, in this case intel_wrap_ring_buffer(), as this will fault if (a) the ringbuffer happens not to be mapped, and (b) tail happens to be sufficiently close to the end of the ring to trigger wrapping.
So the correct order is neither the original allocate-wait-pad-wait, nor the subsequent wait-pad-wait-allocate, but wait-allocate-pad, avoiding both the problems described in the two commits mentioned above.
As a bonus, we eliminate the special case where a single ring_begin() might end up waiting twice (once to be able to wrap, and then again if that still hadn't actually freed enough space for the request). We just precalculate the total amount of space we'll need *including* any for padding the end of the ring and wait for that much in one go :)
In the time since this code was written, it has all been cloned from the original ringbuffer model to become the execbuffer code, in
Quoted 1 line
82e104c drm/i915/bdw: New logical ring submission mechanism
So now we have to fix it in both paths ...
--- drivers/gpu/drm/i915/intel_lrc.c | 64 +++++++++++++++---------------- drivers/gpu/drm/i915/intel_ringbuffer.c | 63 +++++++++++++++--------------- 2 files changed, 64 insertions(+), 63 deletions(-)
drivers/gpu/drm/i915/intel_lrc.c +32 -32
@@ -740,39 +740,22 @@ intel_logical_ring_advance_and_submit(struct intel_ringbuffer *ringbuf,execlists_context_queue (ring, ctx, ringbuf->tail, request); } -static int logical_ring_wrap_buffer (struct intel_ringbuffer *ringbuf, -struct intel_context *ctx) -{ -uint32_t __iomem *virt; -int rem = ringbuf->size - ringbuf->tail; - -if (ringbuf->space < rem) { -int ret =logical_ring_wait_for_space (ringbuf, ctx, rem); - -if (ret) -return ret; - } - - virt = ringbuf->virtual_start + ringbuf->tail; - rem /=4 ; -while (rem--) -iowrite32 (MI_NOOP , virt++); - - ringbuf->tail =0 ; -intel_ring_update_space (ringbuf); - -return 0 ; -} -static int logical_ring_prepare (struct intel_ringbuffer *ringbuf,struct intel_context *ctx,int bytes) { +int fill =0 ;int ret; +/* +* If the request will not fit between 'tail' and the effective +* size of the ringbuffer, then we need to pad the end of the +* ringbuffer with NOOPs, then start the request at the top of +* the ring. This increases the total size that we need to check +* for by however much is left at the end of the ring ... +*/ if (unlikely (ringbuf->tail + bytes > ringbuf->effective_size)) { - ret =logical_ring_wrap_buffer (ringbuf, ctx); -if (unlikely (ret)) -return ret; + fill = ringbuf->size - ringbuf->tail; + bytes += fill; }if (unlikely (ringbuf->space < bytes)) {
@@ -781,6 +764,28 @@ static int logical_ring_prepare(struct intel_ringbuffer *ringbuf,return ret; } +/* Ensure we have a request before touching the ring */ +if (!ringbuf->ring->outstanding_lazy_request) { + ret =i915_gem_request_alloc (ringbuf->ring, ctx); +if (ret) +return ret; + } + +if (unlikely (fill)) { +uint32_t __iomem *virt = ringbuf->virtual_start + ringbuf->tail; + +/* tail should not have moved */ +if (WARN_ON (fill != ringbuf->size - ringbuf->tail)) + fill = ringbuf->size - ringbuf->tail; + +do +iowrite32 (MI_NOOP , virt++); +while ((fill -=4 ) >0 ); + + ringbuf->tail =0 ; +intel_ring_update_space (ringbuf); + } +return 0 ; }
@@ -814,11 +819,6 @@ static int intel_logical_ring_begin(struct intel_ringbuffer *ringbuf,if (ret)return ret; -/* Preallocate the olr before touching the ring */ - ret =i915_gem_request_alloc (ring, ctx); -if (ret) -return ret; - ringbuf->space -= num_dwords *sizeof (uint32_t );return 0 ; }
drivers/gpu/drm/i915/intel_ringbuffer.c +32 -31
90 lines not on this page · raw message
Signature · 6 lines
1.7.9.5 _______________________________________________ Intel-gfx mailing list [email protected] http://lists.freedesktop.org/mailman/listinfo/intel-gfx
Re: [PATCH 2/2] drm/i915: Rework order of operations in {__intel, logical}_ring_prepare()
Quoted 20 lines · Dave Gordon
The original idea of preallocating the OLR was implemented in
Quoted 1 line
9d773091drm/i915: Preallocate next seqno before touching the ringand the sequence of operations was to allocate the OLR, then wrap past the end of the ring if necessary, then wait for space if necessary. But subsequently
intel_ring_begin()was refactored, inQuoted 1 line
304d695 drm/i915: Flush outstanding requests before allocating new seqno
to ensure that pending work that might need to be flushed used the old and not the newly-allocated request. This changed the sequence to wrap and/or wait, then allocate, although the comment still said
/* Preallocate the olr before touching the ring */which was no longer true as
intel_wrap_ring_buffer()touches the ring.However, with the introduction of dynamic pinning, in
Quoted 1 line
7ba717c drm/i915/bdw: Pin the ringbuffer backing object to GGTT on-demand
Quoted 7 lines
came the possibility that the ringbuffer might not be pinned to the GTT or mapped into CPU address space when
intel_ring_begin()is called. It gets pinned when the request is allocated, so it's now important that this comes *before* anything that can write into the ringbuffer, in this caseintel_wrap_ring_buffer(), as this will fault if (a) the ringbuffer happens not to be mapped, and (b) tail happens to be sufficiently close to the end of the ring to trigger wrapping.
On the other hand, the request allocation can itself write into the ring. This is not the right fix, that is the elimination of olr itself and passing the request into intel_ring_begin. That way we can explicit in our ordering into ring access.
-Chris
Signature · 5 lines
Chris Wilson, Intel Open Source Technology Centre _______________________________________________ Intel-gfx mailing list [email protected] http://lists.freedesktop.org/mailman/listinfo/intel-gfx
Re: [PATCH 2/2] drm/i915: Rework order of operations in {__intel, logical}_ring_prepare()
Quoted 29 lines · Chris Wilson
Quoted 20 lines · Dave Gordon
The original idea of preallocating the OLR was implemented in
Quoted 1 line
9d773091drm/i915: Preallocate next seqno before touching the ringand the sequence of operations was to allocate the OLR, then wrap past the end of the ring if necessary, then wait for space if necessary. But subsequently
intel_ring_begin()was refactored, inQuoted 1 line
304d695 drm/i915: Flush outstanding requests before allocating new seqno
to ensure that pending work that might need to be flushed used the old and not the newly-allocated request. This changed the sequence to wrap and/or wait, then allocate, although the comment still said
/* Preallocate the olr before touching the ring */which was no longer true as
intel_wrap_ring_buffer()touches the ring.However, with the introduction of dynamic pinning, in
Quoted 1 line
7ba717c drm/i915/bdw: Pin the ringbuffer backing object to GGTT on-demand
Quoted 7 lines
came the possibility that the ringbuffer might not be pinned to the GTT or mapped into CPU address space when
intel_ring_begin()is called. It gets pinned when the request is allocated, so it's now important that this comes *before* anything that can write into the ringbuffer, in this caseintel_wrap_ring_buffer(), as this will fault if (a) the ringbuffer happens not to be mapped, and (b) tail happens to be sufficiently close to the end of the ring to trigger wrapping.
Quoted 5 lines
On the other hand, the request allocation can itself write into the ring. This is not the right fix, that is the elimination of olr itself and passing the request into
intel_ring_begin. That way we can explicit in our ordering into ring access.
-Chris
AFAICS, request allocation can write into the ring only if it actually has to flush some *pre-existing* OLR. [Aside: it can actually trigger writing into a completely different ringbuffer, but not the one we're handling here!] The worst-case sequence is:
i915_gem_request_alloc finds there's no OLR
i915_gem_get_seqno finds the seqno is 0
i915_gem_init_seqno for_eash_ring do ...
intel_ring_idle but no OLR, so OK
It only works because i915_gem_request_alloc() allocates the request early but doesn't store it in the OLR until the end.
OTOH I agree that the long-term answer is the elimination of the OLR; this is really something of a stopgap until John H's Anti-OLR patchset is merged.
Although, the simplification of the wait-wrap/wait-space sequence is probably worthwhile in its own right, so if Anti-OLR gets merged first we can put the rest of the changes on top of that. It's only code inside the "if(!OLR)" section that would need to be removed.
.Dave.
_______________________________________________
Intel-gfx mailing list
[email protected]
http://lists.freedesktop.org/mailman/listinfo/intel-gfx
Re: [PATCH 2/2] drm/i915: Rework order of operations in {__intel, logical}_ring_prepare()
Quoted 36 lines · Dave Gordon
Quoted 29 lines · Chris Wilson
Quoted 20 lines · Dave Gordon
The original idea of preallocating the OLR was implemented in
Quoted 1 line
9d773091drm/i915: Preallocate next seqno before touching the ringand the sequence of operations was to allocate the OLR, then wrap past the end of the ring if necessary, then wait for space if necessary. But subsequently
intel_ring_begin()was refactored, inQuoted 1 line
304d695 drm/i915: Flush outstanding requests before allocating new seqno
to ensure that pending work that might need to be flushed used the old and not the newly-allocated request. This changed the sequence to wrap and/or wait, then allocate, although the comment still said
/* Preallocate the olr before touching the ring */which was no longer true as
intel_wrap_ring_buffer()touches the ring.However, with the introduction of dynamic pinning, in
Quoted 1 line
7ba717c drm/i915/bdw: Pin the ringbuffer backing object to GGTT on-demand
Quoted 7 lines
came the possibility that the ringbuffer might not be pinned to the GTT or mapped into CPU address space when
intel_ring_begin()is called. It gets pinned when the request is allocated, so it's now important that this comes *before* anything that can write into the ringbuffer, in this caseintel_wrap_ring_buffer(), as this will fault if (a) the ringbuffer happens not to be mapped, and (b) tail happens to be sufficiently close to the end of the ring to trigger wrapping.Quoted 5 lines
On the other hand, the request allocation can itself write into the ring. This is not the right fix, that is the elimination of olr itself and passing the request into
intel_ring_begin. That way we can explicit in our ordering into ring access.
-Chris
Quoted 4 lines
AFAICS, request allocation can write into the ring only if it actually has to flush some *pre-existing* OLR. [Aside: it can actually trigger writing into a completely different ringbuffer, but not the one we're handling here!] The worst-case sequence is:
You forget that ultimately (or rather should have been in the design for execlists once the shortcomings of the ad hoc method were apparent) equest allocation will also be responsible for context management (since they are one and the same).
Quoted 6 lines
It only works because
i915_gem_request_alloc()allocates the request early but doesn't store it in the OLR until the end.OTOH I agree that the long-term answer is the elimination of the OLR; this is really something of a stopgap until John H's Anti-OLR patchset is merged.
See my patches a year ago for a more complete cleanup. -Chris
Signature · 5 lines
Chris Wilson, Intel Open Source Technology Centre _______________________________________________ Intel-gfx mailing list [email protected] http://lists.freedesktop.org/mailman/listinfo/intel-gfx
(no subject)
In reply to Dave GordonUpdated version split into two. The first tidies up the _ring_prepare() functions and removes the corner case where we might have had to wait twice; the second is a temporary workaround to solve a kernel OOPS that can occur if logical_ring_begin is called while the ringbuffer is not mapped because there's no current request.
The latter will be superseded by the Anti-OLR patch series currently in review. But this helps with GuC submission, which is better than the execlist path at exposing the problematic case :(
_______________________________________________
Intel-gfx mailing list
[email protected]
http://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH 1/2 drm/i915: Don't wait twice in {__intel, logical}_ring_prepare()
In the case that the ringbuffer was near-full AND 'tail' was near the end of the buffer, we could have ended up waiting twice:
once to gain ownership of the space between TAIL and the end (which we just want to fill with padding, so as not to split a single command sequence across the end of the ringbuffer), and then again to get enough space for the new data that the caller wants to add.
Now we just precalculate the total amount of space we'll need *including* any for padding at the end of the ringbuffer and wait for that much in one go.
--- drivers/gpu/drm/i915/intel_lrc.c | 52 +++++++++++++++---------------- drivers/gpu/drm/i915/intel_ringbuffer.c | 51 +++++++++++++++--------------- 2 files changed, 50 insertions(+), 53 deletions(-)
drivers/gpu/drm/i915/intel_lrc.c +25 -27
@@ -740,39 +740,22 @@ intel_logical_ring_advance_and_submit(struct intel_ringbuffer *ringbuf,execlists_context_queue (ring, ctx, ringbuf->tail, request); } -static int logical_ring_wrap_buffer (struct intel_ringbuffer *ringbuf, -struct intel_context *ctx) -{ -uint32_t __iomem *virt; -int rem = ringbuf->size - ringbuf->tail; - -if (ringbuf->space < rem) { -int ret =logical_ring_wait_for_space (ringbuf, ctx, rem); - -if (ret) -return ret; - } - - virt = ringbuf->virtual_start + ringbuf->tail; - rem /=4 ; -while (rem--) -iowrite32 (MI_NOOP , virt++); - - ringbuf->tail =0 ; -intel_ring_update_space (ringbuf); - -return 0 ; -} -static int logical_ring_prepare (struct intel_ringbuffer *ringbuf,struct intel_context *ctx,int bytes) { +int fill =0 ;int ret; +/* +* If the request will not fit between 'tail' and the effective +* size of the ringbuffer, then we need to pad the end of the +* ringbuffer with NOOPs, then start the request at the top of +* the ring. This increases the total size that we need to check +* for by however much is left at the end of the ring ... +*/ if (unlikely (ringbuf->tail + bytes > ringbuf->effective_size)) { - ret =logical_ring_wrap_buffer (ringbuf, ctx); -if (unlikely (ret)) -return ret; + fill = ringbuf->size - ringbuf->tail; + bytes += fill; }if (unlikely (ringbuf->space < bytes)) {
@@ -781,6 +764,21 @@ static int logical_ring_prepare(struct intel_ringbuffer *ringbuf,return ret; } +if (unlikely (fill)) { +uint32_t __iomem *virt = ringbuf->virtual_start + ringbuf->tail; + +/* tail should not have moved */ +if (WARN_ON (fill != ringbuf->size - ringbuf->tail)) + fill = ringbuf->size - ringbuf->tail; + +do +iowrite32 (MI_NOOP , virt++); +while ((fill -=4 ) >0 ); + + ringbuf->tail =0 ; +intel_ring_update_space (ringbuf); + } +return 0 ; }
drivers/gpu/drm/i915/intel_ringbuffer.c +25 -26
72 lines not on this page · raw message
Signature · 6 lines
1.7.9.5 _______________________________________________ Intel-gfx mailing list [email protected] http://lists.freedesktop.org/mailman/listinfo/intel-gfx
PATCH 2/2 drm/i915: Allocate OLR more safely (workaround until OLR goes away)
In reply to Dave GordonThe original idea of preallocating the OLR was implemented in
Quoted 1 line
9d773091drm/i915: Preallocate next seqno before touching the ring
and the sequence of operations was to allocate the OLR, then wrap past the end of the ring if necessary, then wait for space if necessary. But subsequently intel_ring_begin() was refactored, in
Quoted 1 line
304d695 drm/i915: Flush outstanding requests before allocating new seqno
to ensure that pending work that might need to be flushed used the old and not the newly-allocated request. This changed the sequence to wrap and/or wait, then allocate, although the comment still said
/* Preallocate the olr before touching the ring */
which was no longer true as intel_wrap_ring_buffer() touches the ring.
However, with the introduction of dynamic pinning, in
Quoted 1 line
7ba717c drm/i915/bdw: Pin the ringbuffer backing object to GGTT on-demand
came the possibility that the ringbuffer might not be pinned to the GTT or mapped into CPU address space when intel_ring_begin() is called. It gets pinned when the request is allocated, so it's now important that this comes *before* anything that can write into the ringbuffer, in this case intel_wrap_ring_buffer(), as this will fault if (a) the ringbuffer happens not to be mapped, and (b) tail happens to be sufficiently close to the end of the ring to trigger wrapping.
So the correct order is neither the original allocate-wait-pad-wait, nor the subsequent wait-pad-wait-allocate, but wait-allocate-pad, avoiding both the problems described in the two commits mentioned above. So this commit moves the calls to i915_gem_request_alloc() into the middle of {__intel,logical}_ring_prepare() rather than either before or after them.
--- drivers/gpu/drm/i915/intel_lrc.c | 12 +++++++----- drivers/gpu/drm/i915/intel_ringbuffer.c | 12 +++++++----- 2 files changed, 14 insertions(+), 10 deletions(-)
drivers/gpu/drm/i915/intel_lrc.c +7 -5
@@ -764,6 +764,13 @@ static int logical_ring_prepare(struct intel_ringbuffer *ringbuf,return ret; } +/* Ensure we have a request before touching the ring */ +if (!ringbuf->ring->outstanding_lazy_request) { + ret =i915_gem_request_alloc (ringbuf->ring, ctx); +if (ret) +return ret; + } +if (unlikely (fill)) {uint32_t __iomem *virt = ringbuf->virtual_start + ringbuf->tail;
@@ -812,11 +819,6 @@ static int intel_logical_ring_begin(struct intel_ringbuffer *ringbuf,if (ret)return ret; -/* Preallocate the olr before touching the ring */ - ret =i915_gem_request_alloc (ring, ctx); -if (ret) -return ret; - ringbuf->space -= num_dwords *sizeof (uint32_t );return 0 ; }
drivers/gpu/drm/i915/intel_ringbuffer.c +7 -5
@@ -2195,6 +2195,13 @@ static int __intel_ring_prepare(struct intel_engine_cs *ring,return ret; } +/* Ensure we have a request before touching the ring */ +if (!ringbuf->ring->outstanding_lazy_request) { + ret =i915_gem_request_alloc (ringbuf->ring, ring->default_context); +if (ret) +return ret; + } +if (unlikely (fill)) {uint32_t __iomem *virt = ringbuf->virtual_start + ringbuf->tail;
@@ -2228,11 +2235,6 @@ int intel_ring_begin(struct intel_engine_cs *ring,if (ret)return ret; -/* Preallocate the olr before touching the ring */ - ret =i915_gem_request_alloc (ring, ring->default_context); -if (ret) -return ret; - ring->buffer->space -= num_dwords *sizeof (uint32_t );return 0 ; }
Signature · 6 lines
1.7.9.5 _______________________________________________ Intel-gfx mailing list [email protected] http://lists.freedesktop.org/mailman/listinfo/intel-gfx
Re: (no subject)
In reply to Dave GordonQuoted 9 lines · Dave Gordon
Updated version split into two. The first tidies up the
_ring_prepare()functions and removes the corner case where we might have had to wait twice; the second is a temporary workaround to solve a kernel OOPS that can occur iflogical_ring_beginis called while the ringbuffer is not mapped because there's no current request.The latter will be superseded by the Anti-OLR patch series currently in review. But this helps with GuC submission, which is better than the execlist path at exposing the problematic case :(
Maintainer broken record: Lack of changelog makes it hard to figure out what changed and which patches are the latest version. Even more so when trying to catch up from vacation ...
-Daniel
Signature · 7 lines
Daniel Vetter Software Engineer, Intel Corporation http://blog.ffwll.ch _______________________________________________ Intel-gfx mailing list [email protected] http://lists.freedesktop.org/mailman/listinfo/intel-gfx
Jani Nikula
maintainerRe: (no subject)
Quoted 7 lines · Daniel Vetter
Quoted 6 lines · Dave Gordon
Updated version split into two. The first tidies up the
_ring_prepare()functions and removes the corner case where we might have had to wait twice; the second is a temporary workaround to solve a kernel OOPS that can occur iflogical_ring_beginis called while the ringbuffer is not mapped because there's no current request.
Quoted 7 lines
Quoted 3 lines
The latter will be superseded by the Anti-OLR patch series currently in review. But this helps with GuC submission, which is better than the execlist path at exposing the problematic case :(
Maintainer broken record: Lack of changelog makes it hard to figure out what changed and which patches are the latest version. Even more so when trying to catch up from vacation ...
Is it time we adopted Greg's <formletter> approach with copy-pasted snippets from [1]...? See [2] for an example.
BR,
Jani.
[1] https://github.com/gregkh/gregkh-linux/blob/master/forms/patch_bot
[2] http://mid.gmane.org/[email protected]
Quoted 9 lines
-Daniel
Signature · 7 lines
Daniel Vetter Software Engineer, Intel Corporation http://blog.ffwll.ch _______________________________________________ Intel-gfx mailing list [email protected] http://lists.freedesktop.org/mailman/listinfo/intel-gfx
Signature · 5 lines
Jani Nikula, Intel Open Source Technology Center _______________________________________________ Intel-gfx mailing list [email protected] http://lists.freedesktop.org/mailman/listinfo/intel-gfx
Re: (no subject)
In reply to Daniel VetterQuoted 7 lines · Daniel Vetter
Quoted 6 lines · Dave Gordon
Updated version split into two. The first tidies up the
_ring_prepare()functions and removes the corner case where we might have had to wait twice; the second is a temporary workaround to solve a kernel OOPS that can occur iflogical_ring_beginis called while the ringbuffer is not mapped because there's no current request.
Quoted 8 lines
Quoted 3 lines
The latter will be superseded by the Anti-OLR patch series currently in review. But this helps with GuC submission, which is better than the execlist path at exposing the problematic case :(
Maintainer broken record: Lack of changelog makes it hard to figure out what changed and which patches are the latest version. Even more so when trying to catch up from vacation ...
-Daniel
Oops, that wasn't ready to go to the mailing list, that was just supposed to go to myself so I could test whether the changes I'd made to my git-format-patch and git-send-email settings worked! Hence lack of subject line :(
And the settings obviously /weren't/ right; apart from it going to the list, it didn't have the proper "Organisation" header, which was the thing I was trying to update, as well as setting up proper definitions so I could write "git send-email --identity=external --to=myself ..."
I think I got them all sorted out before sending the GuC submission sequence though :)
.Dave.
_______________________________________________
Intel-gfx mailing list
[email protected]
http://lists.freedesktop.org/mailman/listinfo/intel-gfx