media: cedrus: h265: Implement tiles support
Jernej Skrabec
maintainercover media: cedrus: h265: Implement tiles support
Now that we have full and stable HEVC uAPI, let's implement last big missing piece of HEVC in Cedrus - tiles support. This is done in last patch. Before that, there are bug fixes (patch 1 & 2, previously submitted separately in [1]), error handling improvements (patch 3, 4) and added helper for dealing with dynamic arrays (patch 5).
These patches are based on top of [2].
Final fluster score with this series is 125/147. 11 bitstreams are MAIN10, which is not yet properly supported. 5 bitstreams need better memory management with auxiliary buffers (wip patches exists). 4 are too big and 2 probably fails due to ffmpeg implementation.
Used ffmpeg source is in [3].
Note - Cedrus driver currently supports only one slice per request since HW takes data for 1 slice only. This can be improved by loading data for next slice automatically after HW signalled end of decoding. Something for later.
Please take a look.
Best regards,
Jernej
[1] https://patchwork.linuxtv.org/project/linux-media/list/?series=8187
[2] https://patchwork.linuxtv.org/project/linux-media/list/?series=8208
[3] https://github.com/jernejsk/FFmpeg/commits/hevc-mainline
Jernej Skrabec (7):
media: cedrus: h265: Fix flag name
media: cedrus: h265: Fix logic for not low delay flag
media: cedrus: Improve error messages for controls
media: cedrus: Add error handling for failed setup
media: cedrus: h265: Add a couple of error checks
media: cedrus: Add helper for determining number of elements
media: cedrus: h265: Implement support for tiles
drivers/staging/media/sunxi/cedrus/cedrus.c | 28 +++- drivers/staging/media/sunxi/cedrus/cedrus.h | 7 +- .../staging/media/sunxi/cedrus/cedrus_dec.c | 25 ++- .../staging/media/sunxi/cedrus/cedrus_h264.c | 5 +- .../staging/media/sunxi/cedrus/cedrus_h265.c | 153 ++++++++++++++++-- .../staging/media/sunxi/cedrus/cedrus_mpeg2.c | 4 +- .../staging/media/sunxi/cedrus/cedrus_regs.h | 3 +- .../staging/media/sunxi/cedrus/cedrus_vp8.c | 5 +- 8 files changed, 204 insertions(+), 26 deletions(-)
Signature · 1 line
2.36.1
Jernej Skrabec
maintainerPATCH 1/7 media: cedrus: h265: Fix flag name
Bit 21 in register 0x24 (slice header info 1) actually represents negated version of low delay flag. This can be seen in vendor Cedar library source code. While this flag is not part of the standard, it can be found in reference HEVC implementation.
Fix macro name and change it to flag.
--- drivers/staging/media/sunxi/cedrus/cedrus_h265.c | 4 +++- drivers/staging/media/sunxi/cedrus/cedrus_regs.h | 3 +-- 2 files changed, 4 insertions(+), 3 deletions(-)
drivers/staging/media/sunxi/cedrus/cedrus_h265.c +3 -1
@@ -576,7 +576,6 @@ static void cedrus_h265_setup(struct cedrus_ctx *ctx, reg =VE_DEC_H265_DEC_SLICE_HDR_INFO1_SLICE_TC_OFFSET_DIV2 (slice_params->slice_tc_offset_div2) |VE_DEC_H265_DEC_SLICE_HDR_INFO1_SLICE_BETA_OFFSET_DIV2 (slice_params->slice_beta_offset_div2) | -VE_DEC_H265_DEC_SLICE_HDR_INFO1_SLICE_POC_BIGEST_IN_RPS_ST (decode_params->num_poc_st_curr_after ==0 ) |VE_DEC_H265_DEC_SLICE_HDR_INFO1_SLICE_CR_QP_OFFSET (slice_params->slice_cr_qp_offset) |VE_DEC_H265_DEC_SLICE_HDR_INFO1_SLICE_CB_QP_OFFSET (slice_params->slice_cb_qp_offset) |VE_DEC_H265_DEC_SLICE_HDR_INFO1_SLICE_QP_DELTA (slice_params->slice_qp_delta);
@@ -589,6 +588,9 @@ static void cedrus_h265_setup(struct cedrus_ctx *ctx,V4L2_HEVC_SLICE_PARAMS_FLAG_SLICE_LOOP_FILTER_ACROSS_SLICES_ENABLED , slice_params->flags); +if (decode_params->num_poc_st_curr_after ==0 ) + reg |=VE_DEC_H265_DEC_SLICE_HDR_INFO1_FLAG_SLICE_NOT_LOW_DELAY ; +cedrus_write (dev,VE_DEC_H265_DEC_SLICE_HDR_INFO1 , reg); chroma_log2_weight_denom = pred_weight_table->luma_log2_weight_denom +
drivers/staging/media/sunxi/cedrus/cedrus_regs.h +1 -2
@@ -377,13 +377,12 @@#define VE_DEC_H265_DEC_SLICE_HDR_INFO1_FLAG_SLICE_DEBLOCKING_FILTER_DISABLED BIT(23)#define VE_DEC_H265_DEC_SLICE_HDR_INFO1_FLAG_SLICE_LOOP_FILTER_ACROSS_SLICES_ENABLED BIT(22) +#define VE_DEC_H265_DEC_SLICE_HDR_INFO1_FLAG_SLICE_NOT_LOW_DELAY BIT(21)#define VE_DEC_H265_DEC_SLICE_HDR_INFO1_SLICE_TC_OFFSET_DIV2 (v) \ SHIFT_AND_MASK_BITS(v, 31, 28)#define VE_DEC_H265_DEC_SLICE_HDR_INFO1_SLICE_BETA_OFFSET_DIV2 (v) \ SHIFT_AND_MASK_BITS(v, 27, 24) -#define VE_DEC_H265_DEC_SLICE_HDR_INFO1_SLICE_POC_BIGEST_IN_RPS_ST (v) \ - ((v) ? BIT(21) : 0)#define VE_DEC_H265_DEC_SLICE_HDR_INFO1_SLICE_CR_QP_OFFSET (v) \ SHIFT_AND_MASK_BITS(v, 20, 16)#define VE_DEC_H265_DEC_SLICE_HDR_INFO1_SLICE_CB_QP_OFFSET (v) \
Signature · 1 line
2.36.1
Jernej Skrabec
maintainerPATCH 2/7 media: cedrus: h265: Fix logic for not low delay flag
In reply to Jernej SkrabecNow that we know real purpose of "not low delay" flag, logic for applying this flag should be fixed too. According to vendor and reference implementation, low delay is signaled when POC of current frame is lower than POC of at least one reference of a slice.
Implement mentioned logic and invert it to conform to flag meaning. Also don't apply flag for I frames. They don't have any reference.
This fixes decoding of 3 reference bitstreams.
--- .../staging/media/sunxi/cedrus/cedrus_h265.c | 27 ++++++++++++++++++- 1 file changed, 26 insertions(+), 1 deletion(-)
drivers/staging/media/sunxi/cedrus/cedrus_h265.c +26 -1
@@ -301,6 +301,31 @@ static void cedrus_h265_write_scaling_list(struct cedrus_ctx *ctx, } } +static int cedrus_h265_is_low_delay (struct cedrus_run *run) +{ +const struct v4l2_ctrl_hevc_slice_params *slice_params; +const struct v4l2_hevc_dpb_entry *dpb; +s32 poc; +int i; + + slice_params = run->h265.slice_params; + poc = run->h265.decode_params->pic_order_cnt_val; + dpb = run->h265.decode_params->dpb; + +for (i =0 ; i < slice_params->num_ref_idx_l0_active_minus1 +1 ; i++) +if (dpb[slice_params->ref_idx_l0[i]].pic_order_cnt_val > poc) +return 1 ; + +if (slice_params->slice_type !=V4L2_HEVC_SLICE_TYPE_B ) +return 0 ; + +for (i =0 ; i < slice_params->num_ref_idx_l1_active_minus1 +1 ; i++) +if (dpb[slice_params->ref_idx_l1[i]].pic_order_cnt_val > poc) +return 1 ; + +return 0 ; +} +static void cedrus_h265_setup (struct cedrus_ctx *ctx,struct cedrus_run *run) {
@@ -588,7 +613,7 @@ static void cedrus_h265_setup(struct cedrus_ctx *ctx,V4L2_HEVC_SLICE_PARAMS_FLAG_SLICE_LOOP_FILTER_ACROSS_SLICES_ENABLED , slice_params->flags); -if (decode_params->num_poc_st_curr_after ==0 ) +if (slice_params->slice_type !=V4L2_HEVC_SLICE_TYPE_I && !cedrus_h265_is_low_delay (run)) reg |=VE_DEC_H265_DEC_SLICE_HDR_INFO1_FLAG_SLICE_NOT_LOW_DELAY ;cedrus_write (dev,VE_DEC_H265_DEC_SLICE_HDR_INFO1 , reg);
Signature · 1 line
2.36.1
Jernej Skrabec
maintainerPATCH 3/7 media: cedrus: Improve error messages for controls
In reply to Jernej SkrabecCurrently error messages when control creation fails are very sparse. Granted, user should never observe them. However, developer working on codecs can. In such cases additional information like which control creation failed and error number are very useful.
Expand error messages with additional info.
--- drivers/staging/media/sunxi/cedrus/cedrus.c | 7 +++++-- 1 file changed, 5 insertions(+), 2 deletions(-)
drivers/staging/media/sunxi/cedrus/cedrus.c +5 -2
@@ -242,7 +242,8 @@ static int cedrus_init_ctrls(struct cedrus_dev *dev, struct cedrus_ctx *ctx)v4l2_ctrl_handler_init (hdl,CEDRUS_CONTROLS_COUNT );if (hdl->error) {v4l2_err (&dev->v4l2_dev, -"Failed to initialize control handler\n" ); +"Failed to initialize control handler: %d\n" , + hdl->error);return hdl->error; }
@@ -257,7 +258,9 @@ static int cedrus_init_ctrls(struct cedrus_dev *dev, struct cedrus_ctx *ctx) NULL);if (hdl->error) {v4l2_err (&dev->v4l2_dev, -"Failed to create new custom control\n" ); +"Failed to create %s control: %d\n" , +v4l2_ctrl_get_name (cedrus_controls[i].cfg.id), + hdl->error);v4l2_ctrl_handler_free (hdl);kfree (ctx->ctrls);
Signature · 1 line
2.36.1
Re: [PATCH 3/7] media: cedrus: Improve error messages for controls
Quoted 8 lines · Jernej Skrabec
Currently error messages when control creation fails are very sparse. Granted, user should never observe them. However, developer working on codecs can. In such cases additional information like which control creation failed and error number are very useful.
Expand error messages with additional info.
Signed-off-by Jernej Skrabec <[email protected]>
Quoted 32 lines
--- drivers/staging/media/sunxi/cedrus/cedrus.c | 7 +++++-- 1 file changed, 5 insertions(+), 2 deletions(-)drivers/staging/media/sunxi/cedrus/cedrus.c +5
-2@@ -242,7 +242,8 @@ static int cedrus_init_ctrls(struct cedrus_dev *dev, struct cedrus_ctx *ctx)v4l2_ctrl_handler_init (hdl,CEDRUS_CONTROLS_COUNT );if (hdl->error) {v4l2_err (&dev->v4l2_dev, -"Failed to initialize control handler\n" ); +"Failed to initialize control handler: %d\n" , + hdl->error);return hdl->error; }@@ -257,7 +258,9 @@ static int cedrus_init_ctrls(struct cedrus_dev *dev, struct cedrus_ctx *ctx) NULL);if (hdl->error) {v4l2_err (&dev->v4l2_dev, -"Failed to create new custom control\n" ); +"Failed to create %s control: %d\n" , +v4l2_ctrl_get_name (cedrus_controls[i].cfg.id), + hdl->error);v4l2_ctrl_handler_free (hdl);kfree (ctx->ctrls);Signature · 1 line
2.36.1
Jernej Skrabec
maintainerPATCH 4/7 media: cedrus: Add error handling for failed setup
In reply to Jernej SkrabecDuring decoding setup stage for complex codecs like HEVC driver can detect inconsistent values in controls or some other task, like allocating memory, can fail.
Currently setup stage has no way of signalling error. Change return type of setup callback to int and if returned value is not zero, skip decoding and finish job immediately with error flag.
While currently there is only one place when setup can fail, it's expected that there will be more such cases in the future, when HEVC decoding is improved.
--- drivers/staging/media/sunxi/cedrus/cedrus.h | 2 +- .../staging/media/sunxi/cedrus/cedrus_dec.c | 21 ++++++++++++++----- .../staging/media/sunxi/cedrus/cedrus_h264.c | 5 +++-- .../staging/media/sunxi/cedrus/cedrus_h265.c | 8 +++---- .../staging/media/sunxi/cedrus/cedrus_mpeg2.c | 4 +++- .../staging/media/sunxi/cedrus/cedrus_vp8.c | 5 +++-- 6 files changed, 30 insertions(+), 15 deletions(-)
drivers/staging/media/sunxi/cedrus/cedrus.h +1 -1
@@ -162,7 +162,7 @@ struct cedrus_dec_ops {void (*irq_clear)(struct cedrus_ctx *ctx);void (*irq_disable)(struct cedrus_ctx *ctx);enum cedrus_irq_status (*irq_status)(struct cedrus_ctx *ctx); -void (*setup)(struct cedrus_ctx *ctx,struct cedrus_run *run); +int (*setup)(struct cedrus_ctx *ctx,struct cedrus_run *run);int (*start)(struct cedrus_ctx *ctx);void (*stop)(struct cedrus_ctx *ctx);void (*trigger)(struct cedrus_ctx *ctx);
drivers/staging/media/sunxi/cedrus/cedrus_dec.c +16 -5
@@ -28,6 +28,7 @@ void cedrus_device_run(void *priv)struct cedrus_dev *dev = ctx->dev;struct cedrus_run run = {};struct media_request *src_req; +int error; run.src =v4l2_m2m_next_src_buf (ctx->fh.m2m_ctx); run.dst =v4l2_m2m_next_dst_buf (ctx->fh.m2m_ctx);
@@ -89,16 +90,26 @@ void cedrus_device_run(void *priv)cedrus_dst_format_set (dev, &ctx->dst_fmt); - dev->dec_ops[ctx->current_codec]->setup (ctx, &run); + error = dev->dec_ops[ctx->current_codec]->setup (ctx, &run); +if (error) +v4l2_err (&ctx->dev->v4l2_dev, +"Failed to setup decoding job: %d\n" , error);/* Complete request(s) controls if needed. */ if (src_req)v4l2_ctrl_request_complete (src_req, &ctx->hdl); - dev->dec_ops[ctx->current_codec]->trigger (ctx); +/* Trigger decoding if setup went well, bail out otherwise. */ +if (!error) { + dev->dec_ops[ctx->current_codec]->trigger (ctx); -/* Start the watchdog timer. */ -schedule_delayed_work (&dev->watchdog_work, -msecs_to_jiffies (2000 )); +/* Start the watchdog timer. */ +schedule_delayed_work (&dev->watchdog_work, +msecs_to_jiffies (2000 )); + }else { +v4l2_m2m_buf_done_and_job_finish (ctx->dev->m2m_dev, + ctx->fh.m2m_ctx, +VB2_BUF_STATE_ERROR ); + } }
drivers/staging/media/sunxi/cedrus/cedrus_h264.c +3 -2
@@ -493,8 +493,7 @@ static void cedrus_h264_irq_disable(struct cedrus_ctx *ctx) reg & ~VE_H264_CTRL_INT_MASK); } -static void cedrus_h264_setup (struct cedrus_ctx *ctx, -struct cedrus_run *run) +static int cedrus_h264_setup (struct cedrus_ctx *ctx,struct cedrus_run *run) {struct cedrus_dev *dev = ctx->dev;
@@ -510,6 +509,8 @@ static void cedrus_h264_setup(struct cedrus_ctx *ctx,cedrus_write_frame_list (ctx, run);cedrus_set_params (ctx, run); + +return 0 ; }static int cedrus_h264_start (struct cedrus_ctx *ctx)
drivers/staging/media/sunxi/cedrus/cedrus_h265.c +4 -4
@@ -326,8 +326,7 @@ static int cedrus_h265_is_low_delay(struct cedrus_run *run)return 0 ; } -static void cedrus_h265_setup (struct cedrus_ctx *ctx, -struct cedrus_run *run) +static int cedrus_h265_setup (struct cedrus_ctx *ctx,struct cedrus_run *run) {struct cedrus_dev *dev = ctx->dev;const struct v4l2_ctrl_hevc_sps *sps;
@@ -385,8 +384,7 @@ static void cedrus_h265_setup(struct cedrus_ctx *ctx, GFP_KERNEL, DMA_ATTR_NO_KERNEL_MAPPING);if (!ctx->codec.h265.mv_col_buf) { ctx->codec.h265.mv_col_buf_size =0 ; -// TODO: Abort the process here. -return ; +return -ENOMEM ; } }
@@ -703,6 +701,8 @@ static void cedrus_h265_setup(struct cedrus_ctx *ctx,/* Enable appropriate interruptions. */ cedrus_write (dev,VE_DEC_H265_CTRL ,VE_DEC_H265_CTRL_IRQ_MASK ); + +return 0 ; }static int cedrus_h265_start (struct cedrus_ctx *ctx)
drivers/staging/media/sunxi/cedrus/cedrus_mpeg2.c +3 -1
@@ -48,7 +48,7 @@ static void cedrus_mpeg2_irq_disable(struct cedrus_ctx *ctx)cedrus_write (dev,VE_DEC_MPEG_CTRL , reg); } -static void cedrus_mpeg2_setup (struct cedrus_ctx *ctx,struct cedrus_run *run) +static int cedrus_mpeg2_setup (struct cedrus_ctx *ctx,struct cedrus_run *run) {const struct v4l2_ctrl_mpeg2_sequence *seq;const struct v4l2_ctrl_mpeg2_picture *pic;
@@ -185,6 +185,8 @@ static void cedrus_mpeg2_setup(struct cedrus_ctx *ctx, struct cedrus_run *run)VE_DEC_MPEG_CTRL_MC_CACHE_EN ;cedrus_write (dev,VE_DEC_MPEG_CTRL , reg); + +return 0 ; }static void cedrus_mpeg2_trigger (struct cedrus_ctx *ctx)
drivers/staging/media/sunxi/cedrus/cedrus_vp8.c +3 -2
@@ -651,8 +651,7 @@ static void cedrus_vp8_irq_disable(struct cedrus_ctx *ctx) reg & ~VE_H264_CTRL_INT_MASK); } -static void cedrus_vp8_setup (struct cedrus_ctx *ctx, -struct cedrus_run *run) +static int cedrus_vp8_setup (struct cedrus_ctx *ctx,struct cedrus_run *run) {const struct v4l2_ctrl_vp8_frame *slice = run->vp8.frame_params;struct vb2_queue *cap_q = &ctx->fh.m2m_ctx->cap_q_ctx.q;
@@ -855,6 +854,8 @@ static void cedrus_vp8_setup(struct cedrus_ctx *ctx, ctx->codec.vp8.last_sharpness_level = slice->lf.sharpness_level; } + +return 0 ; }static int cedrus_vp8_start (struct cedrus_ctx *ctx)
Signature · 1 line
2.36.1
Re: [PATCH 4/7] media: cedrus: Add error handling for failed setup
Hi Jernej,
Quoted 8 lines · Jernej Skrabec
During decoding setup stage for complex codecs like HEVC driver can detect inconsistent values in controls or some other task, like allocating memory, can fail.
Currently setup stage has no way of signalling error. Change return type of setup callback to int and if returned value is not zero, skip decoding and finish job immediately with error flag.
Quoted 5 lines
While currently there is only one place when setup can fail, it's expected that there will be more such cases in the future, when HEVC decoding is improved.
Signed-off-by Jernej Skrabec <[email protected]>
Looks good and it's very typical to have a setup stage to put actions that can be allowed to fail.
Quoted 170 lines
--- drivers/staging/media/sunxi/cedrus/cedrus.h | 2 +- .../staging/media/sunxi/cedrus/cedrus_dec.c | 21 ++++++++++++++----- .../staging/media/sunxi/cedrus/cedrus_h264.c | 5 +++-- .../staging/media/sunxi/cedrus/cedrus_h265.c | 8 +++---- .../staging/media/sunxi/cedrus/cedrus_mpeg2.c | 4 +++- .../staging/media/sunxi/cedrus/cedrus_vp8.c | 5 +++-- 6 files changed, 30 insertions(+), 15 deletions(-)drivers/staging/media/sunxi/cedrus/cedrus.h +1
-1@@ -162,7 +162,7 @@ struct cedrus_dec_ops {void (*irq_clear)(struct cedrus_ctx *ctx);void (*irq_disable)(struct cedrus_ctx *ctx);enum cedrus_irq_status (*irq_status)(struct cedrus_ctx *ctx); -void (*setup)(struct cedrus_ctx *ctx,struct cedrus_run *run); +int (*setup)(struct cedrus_ctx *ctx,struct cedrus_run *run);int (*start)(struct cedrus_ctx *ctx);void (*stop)(struct cedrus_ctx *ctx);void (*trigger)(struct cedrus_ctx *ctx);drivers/staging/media/sunxi/cedrus/cedrus_dec.c +16
-5@@ -28,6 +28,7 @@ void cedrus_device_run(void *priv)struct cedrus_dev *dev = ctx->dev;struct cedrus_run run = {};struct media_request *src_req; +int error; run.src =v4l2_m2m_next_src_buf (ctx->fh.m2m_ctx); run.dst =v4l2_m2m_next_dst_buf (ctx->fh.m2m_ctx);@@ -89,16 +90,26 @@ void cedrus_device_run(void *priv)cedrus_dst_format_set (dev, &ctx->dst_fmt); - dev->dec_ops[ctx->current_codec]->setup (ctx, &run); + error = dev->dec_ops[ctx->current_codec]->setup (ctx, &run); +if (error) +v4l2_err (&ctx->dev->v4l2_dev, +"Failed to setup decoding job: %d\n" , error);/* Complete request(s) controls if needed. */ if (src_req)v4l2_ctrl_request_complete (src_req, &ctx->hdl); - dev->dec_ops[ctx->current_codec]->trigger (ctx); +/* Trigger decoding if setup went well, bail out otherwise. */ +if (!error) { + dev->dec_ops[ctx->current_codec]->trigger (ctx); -/* Start the watchdog timer. */ -schedule_delayed_work (&dev->watchdog_work, -msecs_to_jiffies (2000 )); +/* Start the watchdog timer. */ +schedule_delayed_work (&dev->watchdog_work, +msecs_to_jiffies (2000 )); + }else { +v4l2_m2m_buf_done_and_job_finish (ctx->dev->m2m_dev, + ctx->fh.m2m_ctx, +VB2_BUF_STATE_ERROR ); + } }drivers/staging/media/sunxi/cedrus/cedrus_h264.c +3
-2@@ -493,8 +493,7 @@ static void cedrus_h264_irq_disable(struct cedrus_ctx *ctx) reg & ~VE_H264_CTRL_INT_MASK); } -static void cedrus_h264_setup (struct cedrus_ctx *ctx, -struct cedrus_run *run) +static int cedrus_h264_setup (struct cedrus_ctx *ctx,struct cedrus_run *run) {struct cedrus_dev *dev = ctx->dev;@@ -510,6 +509,8 @@ static void cedrus_h264_setup(struct cedrus_ctx *ctx,cedrus_write_frame_list (ctx, run);cedrus_set_params (ctx, run); + +return 0 ; }static int cedrus_h264_start (struct cedrus_ctx *ctx)drivers/staging/media/sunxi/cedrus/cedrus_h265.c +4
-4@@ -326,8 +326,7 @@ static int cedrus_h265_is_low_delay(struct cedrus_run *run)return 0 ; } -static void cedrus_h265_setup (struct cedrus_ctx *ctx, -struct cedrus_run *run) +static int cedrus_h265_setup (struct cedrus_ctx *ctx,struct cedrus_run *run) {struct cedrus_dev *dev = ctx->dev;const struct v4l2_ctrl_hevc_sps *sps;@@ -385,8 +384,7 @@ static void cedrus_h265_setup(struct cedrus_ctx *ctx, GFP_KERNEL, DMA_ATTR_NO_KERNEL_MAPPING);if (!ctx->codec.h265.mv_col_buf) { ctx->codec.h265.mv_col_buf_size =0 ; -// TODO: Abort the process here. -return ; +return -ENOMEM ; } }@@ -703,6 +701,8 @@ static void cedrus_h265_setup(struct cedrus_ctx *ctx,/* Enable appropriate interruptions. */ cedrus_write (dev,VE_DEC_H265_CTRL ,VE_DEC_H265_CTRL_IRQ_MASK ); + +return 0 ; }static int cedrus_h265_start (struct cedrus_ctx *ctx)drivers/staging/media/sunxi/cedrus/cedrus_mpeg2.c +3
-1@@ -48,7 +48,7 @@ static void cedrus_mpeg2_irq_disable(struct cedrus_ctx *ctx)cedrus_write (dev,VE_DEC_MPEG_CTRL , reg); } -static void cedrus_mpeg2_setup (struct cedrus_ctx *ctx,struct cedrus_run *run) +static int cedrus_mpeg2_setup (struct cedrus_ctx *ctx,struct cedrus_run *run) {const struct v4l2_ctrl_mpeg2_sequence *seq;const struct v4l2_ctrl_mpeg2_picture *pic;@@ -185,6 +185,8 @@ static void cedrus_mpeg2_setup(struct cedrus_ctx *ctx, struct cedrus_run *run)VE_DEC_MPEG_CTRL_MC_CACHE_EN ;cedrus_write (dev,VE_DEC_MPEG_CTRL , reg); + +return 0 ; }static void cedrus_mpeg2_trigger (struct cedrus_ctx *ctx)drivers/staging/media/sunxi/cedrus/cedrus_vp8.c +3
-2@@ -651,8 +651,7 @@ static void cedrus_vp8_irq_disable(struct cedrus_ctx *ctx) reg & ~VE_H264_CTRL_INT_MASK); } -static void cedrus_vp8_setup (struct cedrus_ctx *ctx, -struct cedrus_run *run) +static int cedrus_vp8_setup (struct cedrus_ctx *ctx,struct cedrus_run *run) {const struct v4l2_ctrl_vp8_frame *slice = run->vp8.frame_params;struct vb2_queue *cap_q = &ctx->fh.m2m_ctx->cap_q_ctx.q;@@ -855,6 +854,8 @@ static void cedrus_vp8_setup(struct cedrus_ctx *ctx, ctx->codec.vp8.last_sharpness_level = slice->lf.sharpness_level; } + +return 0 ; }static int cedrus_vp8_start (struct cedrus_ctx *ctx)Signature · 1 line
2.36.1
Jernej Skrabec
maintainerPATCH 5/7 media: cedrus: h265: Add a couple of error checks
In reply to Jernej SkrabecNow that we have infrastructure for reporting errors, let's add two checks, which will make sure slice can be actually decoded.
--- drivers/staging/media/sunxi/cedrus/cedrus_h265.c | 8 ++++++++ 1 file changed, 8 insertions(+)
drivers/staging/media/sunxi/cedrus/cedrus_h265.c +8 -0
@@ -435,9 +435,17 @@ static int cedrus_h265_setup(struct cedrus_ctx *ctx, struct cedrus_run *run)* instead of start of slice data. Padding is 8 bits at most (one bit set to 1 and * at most seven bits set to 0), so we have to inspect only one byte before slice data. */ + +if (slice_params->data_byte_offset ==0 ) +return -EOPNOTSUPP ; + padding = (u8 *)vb2_plane_vaddr (&run->src->vb2_buf,0 ) + slice_params->data_byte_offset -1 ; +/* at least one bit must be set in that byte */ +if (*padding ==0 ) +return -EINVAL ; +for (count =0 ; count <8 ; count++)if (*padding & (1 << count))break ;
Signature · 1 line
2.36.1
Re: [PATCH 5/7] media: cedrus: h265: Add a couple of error checks
drivers/staging/media/sunxi/cedrus/cedrus_h265.c
Quoted 12 lines · Jernej Skrabec
Now that we have infrastructure for reporting errors, let's add two checks, which will make sure slice can be actually decoded.
Signed-off-by Jernej Skrabec <[email protected]>--- drivers/staging/media/sunxi/cedrus/cedrus_h265.c | 8 ++++++++ 1 file changed, 8 insertions(+)drivers/staging/media/sunxi/cedrus/cedrus_h265.c +0
-0
Now that you've allowed setup to fail, I would suggest to have some documentation/comments on struct cedrus_dec_ops, to set the expectation/rules for each ops, including the call paths for each operation, which of them are allowed to sleep, etc.
drivers/staging/media/sunxi/cedrus/cedrus_h265.c static int cedrus_h265_setup(struct cedrus_ctx *ctx, struct cedrus_run *run) · line 441
Quoted 8 lines
drivers/staging/media/sunxi/cedrus/cedrus_h265.c +4
-0@@ -435,9 +435,17 @@ static int cedrus_h265_setup(struct cedrus_ctx *ctx, struct cedrus_run *run)* instead of start of slice data. Padding is 8 bits at most (one bit set to 1 and * at most seven bits set to 0), so we have to inspect only one byte before slice data. */ + +if (slice_params->data_byte_offset ==0 ) +return -EOPNOTSUPP ; +
AFAICS, cedrus_h265_setup is called from .device_run. We've been discussing control validation before, and I think the ideal place to do that is v4l2_ctrl_ops.s_ctrl, if that's at all possible.
Driver's mem2mem device_run are executed in the context of a work_struct and the failure won't really get reported up the stack.
drivers/staging/media/sunxi/cedrus/cedrus_h265.c static int cedrus_h265_setup(struct cedrus_ctx *ctx, struct cedrus_run *run) · line 448
Quoted 7 lines
drivers/staging/media/sunxi/cedrus/cedrus_h265.c +4
-0padding = (u8 *)vb2_plane_vaddr (&run->src->vb2_buf,0 ) + slice_params->data_byte_offset -1 ; +/* at least one bit must be set in that byte */ +if (*padding ==0 ) +return -EINVAL ; +
Maybe this is something to check at cedrus_buf_prepare(), when the buffer is queued?
Thanks,
Ezequiel
Quoted 6 lines
drivers/staging/media/sunxi/cedrus/cedrus_h265.c +0
-0for (count =0 ; count <8 ; count++)if (*padding & (1 << count))break ;Signature · 1 line
2.36.1
Jernej Škrabec
maintainerRe: Re: [PATCH 5/7] media: cedrus: h265: Add a couple of error checks
Hi Ezequiel.
Dne ponedeljek, 11. julij 2022 ob 23:31:11 CEST je Ezequiel Garcia napisal(a):
Quoted 10 lines · Jernej Skrabec
Quoted 9 lines
Now that we have infrastructure for reporting errors, let's add two checks, which will make sure slice can be actually decoded.
Signed-off-by Jernej Skrabec <[email protected]>---
drivers/staging/media/sunxi/cedrus/cedrus_h265.c | 8 ++++++++ 1 file changed, 8 insertions(+)
Quoted 11 lines
drivers/staging/media/sunxi/cedrus/cedrus_h265.c
Quoted 5 lines
(quoted diff) +0
-0
b/drivers/staging/media/sunxi/cedrus/cedrus_h265.cindexcfde4ccf6011..99020b9f9ff8100644drivers/staging/media/sunxi/cedrus/cedrus_h265.c +0
-0Now that you've allowed setup to fail, I would suggest to have some documentation/comments on struct
cedrus_dec_ops, to set the expectation/rules for each ops, including the call paths for each operation, which of them are allowed to sleep, etc.
Documentation can be always added, but it should be separate patch.
Quoted 4 lines
Quoted 4 lines
drivers/staging/media/sunxi/cedrus/cedrus_h265.c +0
-0@@ -435,9 +435,17 @@ static int cedrus_h265_setup(struct cedrus_ctx *ctx,struct
cedrus_run*run)>
* instead of start of slice data. Padding is 8 bits at most (one
bit
Quoted 1 line
Quoted 1 line
set to 1 and * at most seven bits set to 0), so we have to
inspect
Quoted 11 lines
drivers/staging/media/sunxi/cedrus/cedrus_h265.c static int cedrus_h265_setup(struct cedrus_ctx *ctx, struct cedrus_run *run) · line 441
Quoted 6 lines
drivers/staging/media/sunxi/cedrus/cedrus_h265.c +4
-0only one byte before slice data. */ + +if (slice_params->data_byte_offset ==0 ) +return -EOPNOTSUPP ; +AFAICS,
cedrus_h265_setupis called from .device_run. We've been discussing control validation before, and I think the ideal place to do that is v4l2_ctrl_ops.s_ctrl, if that's at all possible.
Yeah, this particular check can be moved to s_ctrl handler.
Quoted 4 lines
Driver's mem2mem
device_runare executed in the context of awork_structand the failure won't really get reported up the stack.
Well, at least there will be a notice in dmesg. Not ideal, I know.
Quoted 5 lines
Quoted 5 lines
drivers/staging/media/sunxi/cedrus/cedrus_h265.c +0
-0padding = (u8 *)vb2_plane_vaddr (&run->src->vb2_buf,0 ) + slice_params->data_byte_offset -1 ;
Quoted 7 lines
drivers/staging/media/sunxi/cedrus/cedrus_h265.c static int cedrus_h265_setup(struct cedrus_ctx *ctx, struct cedrus_run *run) · line 448
Quoted 4 lines
drivers/staging/media/sunxi/cedrus/cedrus_h265.c +4
-0+/* at least one bit must be set in that byte */ +if (*padding ==0 ) +return -EINVAL ; +Maybe this is something to check at
cedrus_buf_prepare(), when the buffer is queued?
I don't think so. This check is HEVC specific, but cedrus_buf_prepare() is not and we need to have slice control ready, which I'm not sure is the case for cedrus_buf_prepare().
Best regards,
Jernej
Quoted 12 lines
Thanks,
EzequielQuoted 8 lines
drivers/staging/media/sunxi/cedrus/cedrus_h265.c +0
-1for (count =0 ; count <8 ; count++)if (*padding & (1 << count))break ; --2.36.1
Ezequiel Garcia
Reviewed-byRe: Re: [PATCH 5/7] media: cedrus: h265: Add a couple of error checks
Hi Jernej,
Quoted 25 lines · Jernej Škrabec
Hi Ezequiel.
Dne ponedeljek, 11. julij 2022 ob 23:31:11 CEST je Ezequiel Garcia napisal(a):
Quoted 10 lines · Jernej Skrabec
Quoted 9 lines
Now that we have infrastructure for reporting errors, let's add two checks, which will make sure slice can be actually decoded.
Signed-off-by Jernej Skrabec <[email protected]>---
drivers/staging/media/sunxi/cedrus/cedrus_h265.c | 8 ++++++++ 1 file changed, 8 insertions(+)Quoted 11 lines
drivers/staging/media/sunxi/cedrus/cedrus_h265.c
Quoted 5 lines
(quoted diff) +0
-0
b/drivers/staging/media/sunxi/cedrus/cedrus_h265.cindexcfde4ccf6011..99020b9f9ff8100644drivers/staging/media/sunxi/cedrus/cedrus_h265.c +0
-0Now that you've allowed setup to fail, I would suggest to have some documentation/comments on struct
cedrus_dec_ops, to set the expectation/rules for each ops, including the call paths for each operation, which of them are allowed to sleep, etc.
Quoted 2 lines
Documentation can be always added, but it should be separate patch.
Of course, this wasn't a comment meant to block the patch in any way.
Quoted 41 lines
Quoted 4 lines
Quoted 4 lines
drivers/staging/media/sunxi/cedrus/cedrus_h265.c +0
-0@@ -435,9 +435,17 @@ static int cedrus_h265_setup(struct cedrus_ctx *ctx,struct
cedrus_run*run)>
* instead of start of slice data. Padding is 8 bits at most (onebit
Quoted 1 line
Quoted 1 line
set to 1 and * at most seven bits set to 0), so we have to
inspect
Quoted 11 lines
drivers/staging/media/sunxi/cedrus/cedrus_h265.c static int cedrus_h265_setup(struct cedrus_ctx *ctx, struct cedrus_run *run) · line 441
Quoted 6 lines
drivers/staging/media/sunxi/cedrus/cedrus_h265.c +4
-0only one byte before slice data. */ + +if (slice_params->data_byte_offset ==0 ) +return -EOPNOTSUPP ; +AFAICS,
cedrus_h265_setupis called from .device_run. We've been discussing control validation before, and I think the ideal place to do that is v4l2_ctrl_ops.s_ctrl, if that's at all possible.Yeah, this particular check can be moved to
s_ctrlhandler.Quoted 4 lines
Driver's mem2mem
device_runare executed in the context of awork_structand the failure won't really get reported up the stack.Well, at least there will be a notice in dmesg. Not ideal, I know.
Quoted 5 lines
Quoted 5 lines
drivers/staging/media/sunxi/cedrus/cedrus_h265.c +0
-0padding = (u8 *)vb2_plane_vaddr (&run->src->vb2_buf,0 ) + slice_params->data_byte_offset -1 ;Quoted 7 lines
drivers/staging/media/sunxi/cedrus/cedrus_h265.c static int cedrus_h265_setup(struct cedrus_ctx *ctx, struct cedrus_run *run) · line 448
Quoted 4 lines
drivers/staging/media/sunxi/cedrus/cedrus_h265.c +4
-0+/* at least one bit must be set in that byte */ +if (*padding ==0 ) +return -EINVAL ; +Maybe this is something to check at
cedrus_buf_prepare(), when the buffer is queued?
Quoted 4 lines
I don't think so. This check is HEVC specific, but
cedrus_buf_prepare()is not and we need to have slice control ready, which I'm not sure is the case forcedrus_buf_prepare().
Hm... this is indeed a special case. The buffer contents depend on a control, and both buffer and control are part of the same request.
At least the decoding job would fail, and would get signaled by the dequeued CAPTURE buffers and the V4L2_BUF_FLAG_ERROR flag, which makes perfect sense.
In general vb2_ops.buf_prepare() is called for each
buffer (either through VIDIOC_QBUF or through MEDIA_REQUEST_IOC_QUEUE), so for some buffer validations .buf_prepare() _might_ work better than .device_run for validation.
In any case, the patch looks good, I don't think these comments should block the patch:
Thanks,
Ezequiel
Quoted 17 lines
Best regards,
JernejQuoted 12 lines
Thanks,
EzequielQuoted 8 lines
drivers/staging/media/sunxi/cedrus/cedrus_h265.c +0
-1for (count =0 ; count <8 ; count++)if (*padding & (1 << count))break ; --2.36.1
Jernej Skrabec
maintainerPATCH 6/7 media: cedrus: Add helper for determining number of elements
In reply to Jernej SkrabecNow that controls can be dynamic arrays, we need to know how many elements are in such array. Add a helper for that.
--- drivers/staging/media/sunxi/cedrus/cedrus.c | 11 +++++++++++ drivers/staging/media/sunxi/cedrus/cedrus.h | 1 + 2 files changed, 12 insertions(+)
drivers/staging/media/sunxi/cedrus/cedrus.c +11 -0
@@ -232,6 +232,17 @@ void *cedrus_find_control_data(struct cedrus_ctx *ctx, u32 id)return NULL ; } +u32 cedrus_get_num_of_controls (struct cedrus_ctx *ctx,u32 id) +{ +unsigned int i; + +for (i =0 ; ctx->ctrls[i]; i++) +if (ctx->ctrls[i]->id == id) +return ctx->ctrls[i]->elems; + +return 0 ; +} +static int cedrus_init_ctrls (struct cedrus_dev *dev,struct cedrus_ctx *ctx) {struct v4l2_ctrl_handler *hdl = &ctx->hdl;
drivers/staging/media/sunxi/cedrus/cedrus.h +1 -0
@@ -261,5 +261,6 @@ vb2_to_cedrus_buffer(const struct vb2_buffer *p) }void *cedrus_find_control_data (struct cedrus_ctx *ctx,u32 id); +u32 cedrus_get_num_of_controls (struct cedrus_ctx *ctx,u32 id);#endif
Signature · 1 line
2.36.1
Re: [PATCH 6/7] media: cedrus: Add helper for determining number of elements
Quoted 4 lines · Jernej Skrabec
Now that controls can be dynamic arrays, we need to know how many elements are in such array. Add a helper for that.
Signed-off-by Jernej Skrabec <[email protected]>
Quoted 41 lines
--- drivers/staging/media/sunxi/cedrus/cedrus.c | 11 +++++++++++ drivers/staging/media/sunxi/cedrus/cedrus.h | 1 + 2 files changed, 12 insertions(+)drivers/staging/media/sunxi/cedrus/cedrus.c +11
-0@@ -232,6 +232,17 @@ void *cedrus_find_control_data(struct cedrus_ctx *ctx, u32 id)return NULL ; } +u32 cedrus_get_num_of_controls (struct cedrus_ctx *ctx,u32 id) +{ +unsigned int i; + +for (i =0 ; ctx->ctrls[i]; i++) +if (ctx->ctrls[i]->id == id) +return ctx->ctrls[i]->elems; + +return 0 ; +} +static int cedrus_init_ctrls (struct cedrus_dev *dev,struct cedrus_ctx *ctx) {struct v4l2_ctrl_handler *hdl = &ctx->hdl;drivers/staging/media/sunxi/cedrus/cedrus.h +1
-0@@ -261,5 +261,6 @@ vb2_to_cedrus_buffer(const struct vb2_buffer *p) }void *cedrus_find_control_data (struct cedrus_ctx *ctx,u32 id); +u32 cedrus_get_num_of_controls (struct cedrus_ctx *ctx,u32 id);#endif Signature · 1 line
2.36.1
Jernej Skrabec
maintainerPATCH 7/7 media: cedrus: h265: Implement support for tiles
In reply to Jernej SkrabecTiles are last remaining unimplemented functionality for HEVC. Implement it.
--- drivers/staging/media/sunxi/cedrus/cedrus.c | 10 ++ drivers/staging/media/sunxi/cedrus/cedrus.h | 4 + .../staging/media/sunxi/cedrus/cedrus_dec.c | 4 + .../staging/media/sunxi/cedrus/cedrus_h265.c | 108 +++++++++++++++++- 4 files changed, 120 insertions(+), 6 deletions(-)
drivers/staging/media/sunxi/cedrus/cedrus.c +10 -0
@@ -189,6 +189,16 @@ static const struct cedrus_control cedrus_controls[] = { }, .codec = CEDRUS_CODEC_H265, }, + { + .cfg = { + .id = V4L2_CID_STATELESS_HEVC_ENTRY_POINT_OFFSETS, + /* maximum 256 entry point offsets per slice */ + .dims = { 256 }, + .max = 0xffffffff, + .step = 1, + }, + .codec = CEDRUS_CODEC_H265, + }, { .cfg = { .id = V4L2_CID_STATELESS_HEVC_DECODE_MODE,
drivers/staging/media/sunxi/cedrus/cedrus.h +4 -0
@@ -81,6 +81,8 @@ struct cedrus_h265_run {const struct v4l2_ctrl_hevc_slice_params *slice_params;const struct v4l2_ctrl_hevc_decode_params *decode_params;const struct v4l2_ctrl_hevc_scaling_matrix *scaling_matrix; +const u32 *entry_points; +u32 entry_points_count; };struct cedrus_vp8_run {
@@ -146,6 +148,8 @@ struct cedrus_ctx {ssize_t mv_col_buf_unit_size;void *neighbor_info_buf;dma_addr_t neighbor_info_buf_addr; +void *entry_points_buf; +dma_addr_t entry_points_buf_addr; } h265;struct {unsigned int last_frame_p_type;
drivers/staging/media/sunxi/cedrus/cedrus_dec.c +4 -0
@@ -75,6 +75,10 @@ void cedrus_device_run(void *priv) V4L2_CID_STATELESS_HEVC_DECODE_PARAMS); run.h265.scaling_matrix =cedrus_find_control_data (ctx,V4L2_CID_STATELESS_HEVC_SCALING_MATRIX ); + run.h265.entry_points =cedrus_find_control_data (ctx, +V4L2_CID_STATELESS_HEVC_ENTRY_POINT_OFFSETS ); + run.h265.entry_points_count =cedrus_get_num_of_controls (ctx, +V4L2_CID_STATELESS_HEVC_ENTRY_POINT_OFFSETS );break ;case V4L2_PIX_FMT_VP8_FRAME :
drivers/staging/media/sunxi/cedrus/cedrus_h265.c +102 -6
166 lines not on this page · raw message
Signature · 1 line
2.36.1
Re: [PATCH 7/7] media: cedrus: h265: Implement support for tiles
Quoted 4 lines · Jernej Skrabec
Tiles are last remaining unimplemented functionality for HEVC. Implement it.
Signed-off-by Jernej Skrabec <[email protected]>
Looks good.
Quoted 246 lines
--- drivers/staging/media/sunxi/cedrus/cedrus.c | 10 ++ drivers/staging/media/sunxi/cedrus/cedrus.h | 4 + .../staging/media/sunxi/cedrus/cedrus_dec.c | 4 + .../staging/media/sunxi/cedrus/cedrus_h265.c | 108 +++++++++++++++++- 4 files changed, 120 insertions(+), 6 deletions(-)drivers/staging/media/sunxi/cedrus/cedrus.c +10
-0@@ -189,6 +189,16 @@ static const struct cedrus_control cedrus_controls[] = { }, .codec = CEDRUS_CODEC_H265, }, + { + .cfg = { + .id = V4L2_CID_STATELESS_HEVC_ENTRY_POINT_OFFSETS, + /* maximum 256 entry point offsets per slice */ + .dims = { 256 }, + .max = 0xffffffff, + .step = 1, + }, + .codec = CEDRUS_CODEC_H265, + }, { .cfg = { .id = V4L2_CID_STATELESS_HEVC_DECODE_MODE,drivers/staging/media/sunxi/cedrus/cedrus.h +4
-0@@ -81,6 +81,8 @@ struct cedrus_h265_run {const struct v4l2_ctrl_hevc_slice_params *slice_params;const struct v4l2_ctrl_hevc_decode_params *decode_params;const struct v4l2_ctrl_hevc_scaling_matrix *scaling_matrix; +const u32 *entry_points; +u32 entry_points_count; };struct cedrus_vp8_run {@@ -146,6 +148,8 @@ struct cedrus_ctx {ssize_t mv_col_buf_unit_size;void *neighbor_info_buf;dma_addr_t neighbor_info_buf_addr; +void *entry_points_buf; +dma_addr_t entry_points_buf_addr; } h265;struct {unsigned int last_frame_p_type;drivers/staging/media/sunxi/cedrus/cedrus_dec.c +4
-0@@ -75,6 +75,10 @@ void cedrus_device_run(void *priv) V4L2_CID_STATELESS_HEVC_DECODE_PARAMS); run.h265.scaling_matrix =cedrus_find_control_data (ctx,V4L2_CID_STATELESS_HEVC_SCALING_MATRIX ); + run.h265.entry_points =cedrus_find_control_data (ctx, +V4L2_CID_STATELESS_HEVC_ENTRY_POINT_OFFSETS ); + run.h265.entry_points_count =cedrus_get_num_of_controls (ctx, +V4L2_CID_STATELESS_HEVC_ENTRY_POINT_OFFSETS );break ;case V4L2_PIX_FMT_VP8_FRAME :drivers/staging/media/sunxi/cedrus/cedrus_h265.c +102
-6@@ -326,6 +326,65 @@ static int cedrus_h265_is_low_delay(struct cedrus_run *run)return 0 ; } +static void cedrus_h265_write_tiles (struct cedrus_ctx *ctx, +struct cedrus_run *run, +unsigned int ctb_addr_x, +unsigned int ctb_addr_y) +{ +const struct v4l2_ctrl_hevc_slice_params *slice_params; +const struct v4l2_ctrl_hevc_pps *pps; +struct cedrus_dev *dev = ctx->dev; +const u32 *entry_points; +u32 *entry_points_buf; +int i, x, tx, y, ty; + + pps = run->h265.pps; + slice_params = run->h265.slice_params; + entry_points = run->h265.entry_points; + entry_points_buf = ctx->codec.h265.entry_points_buf; + +for (x =0 , tx =0 ; tx < pps->num_tile_columns_minus1 +1 ; tx++) { +if (x + pps->column_width_minus1[tx] +1 > ctb_addr_x) +break ; + + x += pps->column_width_minus1[tx] +1 ; + } + +for (y =0 , ty =0 ; ty < pps->num_tile_rows_minus1 +1 ; ty++) { +if (y + pps->row_height_minus1[ty] +1 > ctb_addr_y) +break ; + + y += pps->row_height_minus1[ty] +1 ; + } + +cedrus_write (dev,VE_DEC_H265_TILE_START_CTB , (y <<16 ) | (x <<0 )); +cedrus_write (dev,VE_DEC_H265_TILE_END_CTB , + ((y + pps->row_height_minus1[ty]) <<16 ) | + ((x + pps->column_width_minus1[tx]) <<0 )); + +if (pps->flags &V4L2_HEVC_PPS_FLAG_ENTROPY_CODING_SYNC_ENABLED ) { +for (i =0 ; i < slice_params->num_entry_point_offsets; i++) + entry_points_buf[i] = entry_points[i]; + }else { +for (i =0 ; i < slice_params->num_entry_point_offsets; i++) { +if (tx +1 >= pps->num_tile_columns_minus1 +1 ) { + x =0 ; + tx =0 ; + y += pps->row_height_minus1[ty++] +1 ; + }else { + x += pps->column_width_minus1[tx++] +1 ; + } + + entry_points_buf[i *4 +0 ] = entry_points[i]; + entry_points_buf[i *4 +1 ] =0x0 ; + entry_points_buf[i *4 +2 ] = (y <<16 ) | (x <<0 ); + entry_points_buf[i *4 +3 ] = + ((y + pps->row_height_minus1[ty]) <<16 ) | + ((x + pps->column_width_minus1[tx]) <<0 ); + } + } +} +static int cedrus_h265_setup (struct cedrus_ctx *ctx,struct cedrus_run *run) {struct cedrus_dev *dev = ctx->dev;@@ -336,9 +395,11 @@ static int cedrus_h265_setup(struct cedrus_ctx *ctx, struct cedrus_run *run)const struct v4l2_hevc_pred_weight_table *pred_weight_table;unsigned int width_in_ctb_luma, ctb_size_luma;unsigned int log2_max_luma_coding_block_size; +unsigned int ctb_addr_x, ctb_addr_y;dma_addr_t src_buf_addr;dma_addr_t src_buf_end_addr;u32 chroma_log2_weight_denom; +u32 num_entry_point_offsets;u32 output_pic_list_index;u32 pic_order_cnt[2 ];u8 *padding;@@ -350,6 +411,15 @@ static int cedrus_h265_setup(struct cedrus_ctx *ctx, struct cedrus_run *run) slice_params = run->h265.slice_params; decode_params = run->h265.decode_params; pred_weight_table = &slice_params->pred_weight_table; + num_entry_point_offsets = slice_params->num_entry_point_offsets; + +/* +* If entry points offsets are present, we should get them +* exactly the right amount. +*/ +if (num_entry_point_offsets && + num_entry_point_offsets != run->h265.entry_points_count) +return -ERANGE ; log2_max_luma_coding_block_size = sps->log2_min_luma_coding_block_size_minus3 + 3 +@@ -416,12 +486,19 @@ static int cedrus_h265_setup(struct cedrus_ctx *ctx, struct cedrus_run *run)cedrus_write (dev,VE_DEC_H265_BITS_END_ADDR , reg);/* Coding tree block address */ - reg =VE_DEC_H265_DEC_CTB_ADDR_X (slice_params->slice_segment_addr % width_in_ctb_luma); - reg |=VE_DEC_H265_DEC_CTB_ADDR_Y (slice_params->slice_segment_addr / width_in_ctb_luma); + ctb_addr_x = slice_params->slice_segment_addr % width_in_ctb_luma; + ctb_addr_y = slice_params->slice_segment_addr / width_in_ctb_luma; + reg =VE_DEC_H265_DEC_CTB_ADDR_X (ctb_addr_x); + reg |=VE_DEC_H265_DEC_CTB_ADDR_Y (ctb_addr_y);cedrus_write (dev,VE_DEC_H265_DEC_CTB_ADDR , reg); -cedrus_write (dev,VE_DEC_H265_TILE_START_CTB ,0 ); -cedrus_write (dev,VE_DEC_H265_TILE_END_CTB ,0 ); +if ((pps->flags &V4L2_HEVC_PPS_FLAG_TILES_ENABLED ) || + (pps->flags &V4L2_HEVC_PPS_FLAG_ENTROPY_CODING_SYNC_ENABLED )) { +cedrus_h265_write_tiles (ctx, run, ctb_addr_x, ctb_addr_y); + }else { +cedrus_write (dev,VE_DEC_H265_TILE_START_CTB ,0 ); +cedrus_write (dev,VE_DEC_H265_TILE_END_CTB ,0 ); + }/* Clear the number of correctly-decoded coding tree blocks. */ if (ctx->fh.m2m_ctx->new_frame)@@ -548,7 +625,9 @@ static int cedrus_h265_setup(struct cedrus_ctx *ctx, struct cedrus_run *run)V4L2_HEVC_PPS_FLAG_ENTROPY_CODING_SYNC_ENABLED , pps->flags); -/* TODO: VE_DEC_H265_DEC_PPS_CTRL1_FLAG_TILES_ENABLED */ + reg |=VE_DEC_H265_FLAG (VE_DEC_H265_DEC_PPS_CTRL1_FLAG_TILES_ENABLED , +V4L2_HEVC_PPS_FLAG_TILES_ENABLED , + pps->flags); reg |= VE_DEC_H265_FLAG(VE_DEC_H265_DEC_PPS_CTRL1_FLAG_TRANSQUANT_BYPASS_ENABLED, V4L2_HEVC_PPS_FLAG_TRANSQUANT_BYPASS_ENABLED,@@ -626,12 +705,14 @@ static int cedrus_h265_setup(struct cedrus_ctx *ctx, struct cedrus_run *run) chroma_log2_weight_denom = pred_weight_table->luma_log2_weight_denom + pred_weight_table->delta_chroma_log2_weight_denom; - reg =VE_DEC_H265_DEC_SLICE_HDR_INFO2_NUM_ENTRY_POINT_OFFSETS (0 ) | + reg =VE_DEC_H265_DEC_SLICE_HDR_INFO2_NUM_ENTRY_POINT_OFFSETS (num_entry_point_offsets) |VE_DEC_H265_DEC_SLICE_HDR_INFO2_CHROMA_LOG2_WEIGHT_DENOM (chroma_log2_weight_denom) |VE_DEC_H265_DEC_SLICE_HDR_INFO2_LUMA_LOG2_WEIGHT_DENOM (pred_weight_table->luma_log2_weight_denom);cedrus_write (dev,VE_DEC_H265_DEC_SLICE_HDR_INFO2 , reg); +cedrus_write (dev,VE_DEC_H265_ENTRY_POINT_OFFSET_ADDR , ctx->codec.h265.entry_points_buf_addr >>8 ); +/* Decoded picture size. */ reg = VE_DEC_H265_DEC_PIC_SIZE_WIDTH(ctx->src_fmt.width) |@@ -728,6 +809,18 @@ static int cedrus_h265_start(struct cedrus_ctx *ctx)if (!ctx->codec.h265.neighbor_info_buf)return -ENOMEM ; + ctx->codec.h265.entry_points_buf = +dma_alloc_coherent (dev->dev,CEDRUS_H265_ENTRY_POINTS_BUF_SIZE , + &ctx->codec.h265.entry_points_buf_addr, +GFP_KERNEL ); +if (!ctx->codec.h265.entry_points_buf) { +dma_free_attrs (dev->dev,CEDRUS_H265_NEIGHBOR_INFO_BUF_SIZE , + ctx->codec.h265.neighbor_info_buf, + ctx->codec.h265.neighbor_info_buf_addr, +DMA_ATTR_NO_KERNEL_MAPPING ); +return -ENOMEM ; + } +return 0 ; }@@ -748,6 +841,9 @@ static void cedrus_h265_stop(struct cedrus_ctx *ctx) ctx->codec.h265.neighbor_info_buf, ctx->codec.h265.neighbor_info_buf_addr, DMA_ATTR_NO_KERNEL_MAPPING); +dma_free_coherent (dev->dev,CEDRUS_H265_ENTRY_POINTS_BUF_SIZE , + ctx->codec.h265.entry_points_buf, + ctx->codec.h265.entry_points_buf_addr); }static void cedrus_h265_trigger (struct cedrus_ctx *ctx)Signature · 1 line
2.36.1
Jernej Škrabec
maintainerDne ponedeljek, 20. junij 2022 ob 19:55:10 CEST je Jernej Skrabec napisal(a):
Quoted 29 lines
Now that we have full and stable HEVC uAPI, let's implement last big missing piece of HEVC in Cedrus - tiles support. This is done in last patch. Before that, there are bug fixes (patch 1 & 2, previously submitted separately in [1]), error handling improvements (patch 3, 4) and added helper for dealing with dynamic arrays (patch 5).
These patches are based on top of [2].
Final fluster score with this series is 125/147. 11 bitstreams are MAIN10, which is not yet properly supported. 5 bitstreams need better memory management with auxiliary buffers (wip patches exists). 4 are too big and 2 probably fails due to ffmpeg implementation.
Used ffmpeg source is in [3].
Note - Cedrus driver currently supports only one slice per request since HW takes data for 1 slice only. This can be improved by loading data for next slice automatically after HW signalled end of decoding. Something for later.
Please take a look.
Best regards,
Jernej[1] https://patchwork.linuxtv.org/project/linux-media/list/?series=8187
[2] https://patchwork.linuxtv.org/project/linux-media/list/?series=8208
[3] https://github.com/jernejsk/FFmpeg/commits/hevc-mainline
Quoted 8 lines
Jernej Skrabec (7):
media: cedrus: h265: Fix flag name
media: cedrus: h265: Fix logic for not low delay flag
media: cedrus: Improve error messages for controls
media: cedrus: Add error handling for failed setup
media: cedrus: h265: Add a couple of error checks
media: cedrus: Add helper for determining number of elements
media: cedrus: h265: Implement support for tiles
Hi Hans,
do you mind picking patch 6 and 7? They are reviewed and don't depend on patch 5.
Best regards,
Jernej