Skip to contentSkip to conversation

media: v4l2-mem2mem: allow device run without buf

PATCH NAK Hsia-Jun Li 3 participants 3 messages Nov 23, 2022 – Nov 26, 2022 Media (V4L/DVB)

lore
Share & tools
lore
#0 lore raw

PATCH 1/1 media: v4l2-mem2mem: allow device run without buf

From: Randy Li <[email protected]>

For the decoder supports Dynamic Resolution Change, we don't need to allocate any CAPTURE or graphics buffer for them at inital CAPTURE setup step.

We need to make the device run or we can't get those metadata.

---
 drivers/media/v4l2-core/v4l2-mem2mem.c | 5 +++--
 1 file changed, 3 insertions(+), 2 deletions(-)
drivers/media/v4l2-core/v4l2-mem2mem.c +3 -2
index be7fde1ed3ea..cd56d60fad9d 100644
@@ -301,8 +301,9 @@ static void __v4l2_m2m_try_queue(struct v4l2_m2m_dev *m2m_dev,
 
 	dprintk("Trying to schedule a job for m2m_ctx: %p\n", m2m_ctx);
 
-	if (!m2m_ctx->out_q_ctx.q.streaming
-	    || !m2m_ctx->cap_q_ctx.q.streaming) {
+	if (!(m2m_ctx->out_q_ctx.q.streaming || m2m_ctx->out_q_ctx.buffered)
+	    || !(m2m_ctx->cap_q_ctx.q.streaming
+		 || m2m_ctx->cap_q_ctx.buffered)) {
 		dprintk("Streaming needs to be on for both queues\n");
 		return;
 	}
Signature · 1 line
2.17.1
#1 lore raw

Le mercredi 23 novembre 2022 à 17:24 +0800, Hsia-Jun Li a écrit :

Quoted 8 lines

From: Randy Li <[email protected]>

For the decoder supports Dynamic Resolution Change, we don't need to allocate any CAPTURE or graphics buffer for them at inital CAPTURE setup step.

We need to make the device run or we can't get those metadata.

Nack: This is not how it works. I know the m2m framework make it difficult, but it is expected that the driver have a special state for OUTPUT streamon (before capture streamon). Please have a look at other drivers.

Nicolas

Quoted 22 lines
---
 drivers/media/v4l2-core/v4l2-mem2mem.c | 5 +++--
 1 file changed, 3 insertions(+), 2 deletions(-)
drivers/media/v4l2-core/v4l2-mem2mem.c +3 -2
index be7fde1ed3ea..cd56d60fad9d 100644
@@ -301,8 +301,9 @@ static void __v4l2_m2m_try_queue(struct v4l2_m2m_dev *m2m_dev,
 
 	dprintk("Trying to schedule a job for m2m_ctx: %p\n", m2m_ctx);
 
-	if (!m2m_ctx->out_q_ctx.q.streaming
-	    || !m2m_ctx->cap_q_ctx.q.streaming) {
+	if (!(m2m_ctx->out_q_ctx.q.streaming || m2m_ctx->out_q_ctx.buffered)
+	    || !(m2m_ctx->cap_q_ctx.q.streaming
+		 || m2m_ctx->cap_q_ctx.buffered)) {
 		dprintk("Streaming needs to be on for both queues\n");
 		return;
 	}
#2 lore raw
Quoted 14 lines · Nicolas Dufresne

CAUTION: Email originated externally, do not click links or open attachments unless you recognize the sender and know the content is safe.

Quoted 7 lines · Hsia-Jun Li

From: Randy Li <[email protected]>

For the decoder supports Dynamic Resolution Change, we don't need to allocate any CAPTURE or graphics buffer for them at inital CAPTURE setup step.

Quoted 7 lines
Quoted 2 lines

We need to make the device run or we can't get those metadata.

Nack: This is not how it works. I know the m2m framework make it difficult, but it is expected that the driver have a special state for OUTPUT streamon (before capture streamon). Please have a look at other drivers.

I have some good reasons here that make dynamic resolution should happen in the device_run().
1. If the CAPTURE is STREAMON, when the resolution changed event should be triggered? Of course it would be in device_run(), there is no reason to make an special case here.

The following reasons may be better applied for encrypted(DRM) video, when no normal video stream parser could be invoked.
We don’t know whether the user input contains valid sequence header, would the sequence header applied to the current frame? Beside the metadata we need may not at the beginning of the buffer.
2. If it would cost lots of device time on parsing it, it even may even need to read more than one OUTPUT buffers, we would be better to fix this into the normal schedule procedure. Or it would block the other running contexts(instances)
3. We need extra methods to wait the other context done their work which breaks the original job queue.

buffered flag is a perfect way to fix these problems, I didn’t see any m2m driver uses them.

Quoted 24 lines

Nicolas

Quoted 22 lines

---
drivers/media/v4l2-core/v4l2-mem2mem.c | 5 +++--

1 file changed, 3 insertions(+), 2 deletions(-)
drivers/media/v4l2-core/v4l2-mem2mem.c +3 -2
index be7fde1ed3ea..cd56d60fad9d 100644
@@ -301,8 +301,9 @@ static void __v4l2_m2m_try_queue(struct v4l2_m2m_dev *m2m_dev,
 
     dprintk("Trying to schedule a job for m2m_ctx: %p\n", m2m_ctx);
 
-     if (!m2m_ctx->out_q_ctx.q.streaming
-         || !m2m_ctx->cap_q_ctx.q.streaming) {
+     if (!(m2m_ctx->out_q_ctx.q.streaming || m2m_ctx->out_q_ctx.buffered)
+         || !(m2m_ctx->cap_q_ctx.q.streaming
+              || m2m_ctx->cap_q_ctx.buffered)) {
             dprintk("Streaming needs to be on for both queues\n");
             return;
     }