Skip to contentSkip to conversation

Media Summit on May 26th in Nice, France

ANNv4 Hans Verkuil 8 participants 26 messages Apr 12 – May 24 Media (V4L/DVB)

lore
Share & tools
lore
#0 lore raw

(Please pass this on to anyone you think might be interested in this!)

Hi all,

This is the fourth version of this announcement, updating the list of attendees and the tentative agenda at the end: please let me know if you see mistakes. Note that there is still time for one or two other topics. Also please check the agenda if you need more (or perhaps less) time for your topic.

This year's Media Summit will be held on Tuesday May 26th the day before the Embedded Recipes Conference in Nice, France:

https://embedded-recipes.org/2026/

The Media Summit will be held at Hotel Campanile and in the same meeting room as last year (Nikaia):

https://nice-aeroport.campanile.com/en-us/

It is close to the Airport and to the Embedded Recipes venue.

The meeting room can hold up to 30 people and I will provide video conferencing support, just like last year. The location and the meeting room was quite nice last year, so I saw no need to change it.

That said, in-person participation is very much preferred. This yearly summit is meant for active media developers to meet face-to-face and to discuss media subsystem issues.

And it is also a good opportunity to talk to each other during the Embedded Recipes conference to discuss topics in a smaller group. But if you are an active media developer and are really not able to attend in person, then remote participation is an option.

If you want to attend the meeting (either in person or remote), then send an email to me directly. The deadline for in-person attendance is May 14 as the hotel needs to know the final number of attendees by then.

There is no registration fee, the meeting room is sponsored by Cisco and Collabora, and the lunch is sponsored by Ideas on Board! Many thanks to our sponsors, it's very much appreciated.

If you have a topic that you want to discuss, just 'Reply All' to this announcement and give the topic title, a short description and a guesstimate of the time you need for your topic.

See last year's Media Summit Report as an example of what to expect:

https://lore.kernel.org/linux-media/[email protected]/

Regards,

Hans

PS: Be aware that May 24 and 25 are public holidays in France. So many shops may be closed those days.

In-person attendees:
Sakari Ailus <[email protected]> Kieran Bingham <[email protected]> Brandon Brnich <[email protected]>
Rouven Czerwinski <[email protected]> Mehdi Djait <[email protected]> Bryan O'Donoghue <[email protected]> Nicolas Dufresne <[email protected]> Marco Felsch <[email protected]>
Paul Kocialkowski <[email protected]>
Jai Luthra <[email protected]> Jacopo Mondi <[email protected]> Benjamin Mugnier <[email protected]> Beleswar Padhi <[email protected]>
Laurent Pinchart <[email protected]> Loic Poulain <[email protected]> Sven Püschel <[email protected]> Ricardo Ribalda <[email protected]> Michael Riesch <[email protected]> Devarsh Thakkar <[email protected]>
Michael Tretter <[email protected]> Hans Verkuil <[email protected]>

Remote attendees:
Yemike Abhilash Chandra <[email protected]> Rishikesh Donadkar <[email protected]>
Jackson Lee <[email protected]>
Dave Stevenson <[email protected]> (tentative)

Agenda (tentative):

8:45-9:20: Arrive, settle in

9:20-9:30: Short intro (Hans Verkuil)

9:30-9:45: Status of ISP support in V4L2
Presenter: Laurent Pinchart
Description: Summary of ISP-related development in V4L2 since the last Linux Media Summit. This includes a brief overview of technical developments, and a summary of the efforts to engage with vendors.

9:45-10:45: V4L2 Stateless Video Encoding uAPI Progress Update
Presenter: Paul Kocialkowski
Description: An update on the ongonig work to support stateless codecs in V4L2. Some of the remaining open topics will be presented and discussed.

10:45-11:00: break

11:00-11:30: Vulkan Video Codecs
Presenter: Nicolas Dufresne
Description: Vulkan video codecs: what are the viable options for Linux Media and what is in preparation outside of our subsystem. The second aspect is informative as these discussions don't seem to lean toward our subsystem as the foundation. But I think it's rather useful for everyone to understand why and what is included.

11:30-12:00: Protected Video playback on i.MX8MQ
Presenter: Rouven Czerwinski
Description: Introduction to protected video playback
on i.MX8MQ and missing bits for linux-media & protected heap interoperability.

12:00-13:30: Lunch

13:30-14:00: HDCP support for HDMI receivers
Presenter: Hans Verkuil
Description: I have been working on adding HDCP support for HDMI receivers. Specifically the HDCP negotiation between sources and sinks.

14:00-14:30: AI patches
Presenter: Sakari Ailus
Description: What is our policy w.r.t. AI generated patches?

14:30-15:00 Overview of Media CI: where do pipelines run?
Presenter: Ricardo Ribalda
Description: How are jobs in pipelines assigned? How does the infrastructure for Media CI work? Are there things that can be tweaked to make it more reliable?

15:00-15:15: Break

15:15-16:15: Discussion of the media subsystem development process
Presenter: Hans Verkuil
Description: Review of the multi-committer model: current status and next steps. Are there any bottlenecks, any ideas for improvements, w.r.t. the development process?

As you can see, there is still some available time for other topics.

#1 lore raw

Hi Hans,

Quoted 1 line · Hans Verkuil

As you can see, there is still some available time for other topics.

I'd like to add:

Title: Common raw sensor model, streams, metadata and metadata series status
Presenter: Sakari Ailus
Time estimate: 45 minutes (depends heavily on how much there will be discussion)
Descriptition: The Common Raw Sensor Model defines a new UAPI for camera sensors in Linux. It provides a more useful UAPI for configuring camera sensors than the existing practice is. The metadata series includes the Common Raw Sensor Model and a number of other improvements, such as generic raw formats, metadata support and finally enabling the streams UAPI.

Signature · 3 lines
Kind regards,

Sakari Ailus
#2 lore raw
Quoted 9 lines · Sakari Ailus

Title: Common raw sensor model, streams, metadata and metadata series status
Presenter: Sakari Ailus
Time estimate: 45 minutes (depends heavily on how much there will be discussion)
Descriptition: The Common Raw Sensor Model defines a new UAPI for camera sensors in Linux. It provides a more useful UAPI for configuring camera sensors than the existing practice is. The metadata series includes the Common Raw Sensor Model and a number of other improvements, such as generic raw formats, metadata support and finally enabling the streams UAPI.

Added!

Hans

#3 lore raw
In reply to Hans Verkuil

Hi Hans,

Quoted 50 lines · Hans Verkuil

[...]
Agenda (tentative):

8:45-9:20: Arrive, settle in

9:20-9:30: Short intro (Hans Verkuil)

9:30-9:45: Status of ISP support in V4L2
Presenter: Laurent Pinchart
Description: Summary of ISP-related development in V4L2 since the last Linux Media Summit. This includes a brief overview of technical developments, and a summary of the efforts to engage with vendors.

9:45-10:45: V4L2 Stateless Video Encoding uAPI Progress Update
Presenter: Paul Kocialkowski
Description: An update on the ongonig work to support stateless codecs in V4L2. Some of the remaining open topics will be presented and discussed.

10:45-11:00: break

11:00-11:30: Vulkan Video Codecs
Presenter: Nicolas Dufresne
Description: Vulkan video codecs: what are the viable options for Linux Media and what is in preparation outside of our subsystem. The second aspect is informative as these discussions don't seem to lean toward our subsystem as the foundation. But I think it's rather useful for everyone to understand why and what is included.

11:30-12:00: Protected Video playback on i.MX8MQ
Presenter: Rouven Czerwinski
Description: Introduction to protected video playback
on i.MX8MQ and missing bits for linux-media & protected heap interoperability.

12:00-13:30: Lunch

13:30-14:00: HDCP support for HDMI receivers
Presenter: Hans Verkuil
Description: I have been working on adding HDCP support for HDMI receivers. Specifically the HDCP negotiation between sources and sinks.

14:00-14:30: AI patches
Presenter: Sakari Ailus
Description: What is our policy w.r.t. AI generated patches?

14:30-15:00 Overview of Media CI: where do pipelines run?
Presenter: Ricardo Ribalda
Description: How are jobs in pipelines assigned? How does the infrastructure for Media CI work? Are there things that can be tweaked to make it more reliable?

Quoted 8 lines

15:00-15:15: Break

15:15-16:15: Discussion of the media subsystem development process
Presenter: Hans Verkuil
Description: Review of the multi-committer model: current status and next steps. Are there any bottlenecks, any ideas for improvements, w.r.t. the development process?

As you can see, there is still some available time for other topics.

If there is still a bit of time left, maybe we can reserve some 15-30 minutes for the following:

-------%<---snip--------------------------------------------------------

The Butterfly Effect or How Support for Complex Hardware may affect the uAPI

Video capture and camera hardware in recent SoCs is exceedingly complex and the assumption that there is one central V4L2 driver that registers the media device does not necessarily hold anymore. IMHO we need a central media device to rule them all and adaptations to the v4l2_{async,device}_register_subdev code. The discussion [0, 1] quickly escalated:
- Dynamic (de)registration of media entities is desired
- This requires considerations about the uAPI
- There is significant overlap with the notion of fault-tolerant V4L2
- There is also a ton of cleanup work, but the resulting patches must not break anything existing
- So we need to talk about possible migration strategies in order to achieve reasonable progress without interfering too much with existing and working parts

TL;DR: This short talk outlines the effects of upstreaming Rockchip RK3588 video capture and camera support on the V4L2/MC uAPI and on the (linux-media) universe as we know it today.

[0]
https://linuxtv.org/irc/oftc/irclogger_log/linux-media?date=2026-02-17,Tue&sel=72#l68
[1]
https://linuxtv.org/irc/oftc/irclogger_log/linux-media?date=2026-02-18,Wed&sel=14#l10

-------%<---snip--------------------------------------------------------

If desired, I'll try to find the time to describe the issue in more detail on the list *before* everyone travels to Nice. Then, we can use the time on site more effectively to discuss it.

Best regards,
Michael

#4 lore raw
Quoted 60 lines · Michael Riesch

Hi Hans,

Quoted 57 lines · Hans Verkuil

[...]
Agenda (tentative):

8:45-9:20: Arrive, settle in

9:20-9:30: Short intro (Hans Verkuil)

9:30-9:45: Status of ISP support in V4L2
Presenter: Laurent Pinchart
Description: Summary of ISP-related development in V4L2 since the last Linux Media Summit. This includes a brief overview of technical developments, and a summary of the efforts to engage with vendors.

9:45-10:45: V4L2 Stateless Video Encoding uAPI Progress Update
Presenter: Paul Kocialkowski
Description: An update on the ongonig work to support stateless codecs in V4L2. Some of the remaining open topics will be presented and discussed.

10:45-11:00: break

11:00-11:30: Vulkan Video Codecs
Presenter: Nicolas Dufresne
Description: Vulkan video codecs: what are the viable options for Linux Media and what is in preparation outside of our subsystem. The second aspect is informative as these discussions don't seem to lean toward our subsystem as the foundation. But I think it's rather useful for everyone to understand why and what is included.

11:30-12:00: Protected Video playback on i.MX8MQ
Presenter: Rouven Czerwinski
Description: Introduction to protected video playback
on i.MX8MQ and missing bits for linux-media & protected heap interoperability.

12:00-13:30: Lunch

13:30-14:00: HDCP support for HDMI receivers
Presenter: Hans Verkuil
Description: I have been working on adding HDCP support for HDMI receivers. Specifically the HDCP negotiation between sources and sinks.

14:00-14:30: AI patches
Presenter: Sakari Ailus
Description: What is our policy w.r.t. AI generated patches?

14:30-15:00 Overview of Media CI: where do pipelines run?
Presenter: Ricardo Ribalda
Description: How are jobs in pipelines assigned? How does the infrastructure for Media CI work? Are there things that can be tweaked to make it more reliable?

15:00-15:15: Break

15:15-16:15: Discussion of the media subsystem development process
Presenter: Hans Verkuil
Description: Review of the multi-committer model: current status and next steps. Are there any bottlenecks, any ideas for improvements, w.r.t. the development process?

Quoted 4 lines
Quoted 1 line

As you can see, there is still some available time for other topics.

If there is still a bit of time left, maybe we can reserve some 15-30 minutes for the following:

I added this to the agenda. Thanks!

Regards,

Hans

Quoted 37 lines

-------%<---snip--------------------------------------------------------

The Butterfly Effect or How Support for Complex Hardware may affect the uAPI

Video capture and camera hardware in recent SoCs is exceedingly complex and the assumption that there is one central V4L2 driver that registers the media device does not necessarily hold anymore. IMHO we need a central media device to rule them all and adaptations to the v4l2_{async,device}_register_subdev code. The discussion [0, 1] quickly escalated:
- Dynamic (de)registration of media entities is desired
- This requires considerations about the uAPI
- There is significant overlap with the notion of fault-tolerant V4L2
- There is also a ton of cleanup work, but the resulting patches must not break anything existing
- So we need to talk about possible migration strategies in order to achieve reasonable progress without interfering too much with existing and working parts

TL;DR: This short talk outlines the effects of upstreaming Rockchip RK3588 video capture and camera support on the V4L2/MC uAPI and on the (linux-media) universe as we know it today.

[0]
https://linuxtv.org/irc/oftc/irclogger_log/linux-media?date=2026-02-17,Tue&sel=72#l68
[1]
https://linuxtv.org/irc/oftc/irclogger_log/linux-media?date=2026-02-18,Wed&sel=14#l10

-------%<---snip--------------------------------------------------------

If desired, I'll try to find the time to describe the issue in more detail on the list *before* everyone travels to Nice. Then, we can use the time on site more effectively to discuss it.

Best regards,
Michael

#5 lore raw
In reply to Hans Verkuil

Hi Hans,

I would be happy to discuss this if a slot is available:

Title: Generic V4L2 ISP M2M framework
Presenter: Loic Poulain
Time estimate: ~20min
Description: During early development of a Qualcomm Offline Image Processing Engine (OPE), we relied on the V4L2 memory‑to‑memory (v4l2‑m2m) framework, which is widely used and provides solid support for buffer management and scheduling. However, applying it to an ISP use case exposes limitations: ISP engines often require a richer media graph, with multiple pads and metadata flows, similar to inline ISP pipelines (params, stats, outputs). This talk proposes discussing the need for and design of a common V4L2 ISP M2M framework to factor out shared functionality across drivers, particularly around buffer/queue management and job scheduling.

Regards,
Loic

Quoted 143 lines · Hans Verkuil

(Please pass this on to anyone you think might be interested in this!)

Hi all,

This is the fourth version of this announcement, updating the list of attendees and the tentative agenda at the end: please let me know if you see mistakes. Note that there is still time for one or two other topics. Also please check the agenda if you need more (or perhaps less) time for your topic.

This year's Media Summit will be held on Tuesday May 26th the day before the Embedded Recipes Conference in Nice, France:

https://embedded-recipes.org/2026/

The Media Summit will be held at Hotel Campanile and in the same meeting room as last year (Nikaia):

https://nice-aeroport.campanile.com/en-us/

It is close to the Airport and to the Embedded Recipes venue.

The meeting room can hold up to 30 people and I will provide video conferencing support, just like last year. The location and the meeting room was quite nice last year, so I saw no need to change it.

That said, in-person participation is very much preferred. This yearly summit is meant for active media developers to meet face-to-face and to discuss media subsystem issues.

And it is also a good opportunity to talk to each other during the Embedded Recipes conference to discuss topics in a smaller group. But if you are an active media developer and are really not able to attend in person, then remote participation is an option.

If you want to attend the meeting (either in person or remote), then send an email to me directly. The deadline for in-person attendance is May 14 as the hotel needs to know the final number of attendees by then.

There is no registration fee, the meeting room is sponsored by Cisco and Collabora, and the lunch is sponsored by Ideas on Board! Many thanks to our sponsors, it's very much appreciated.

If you have a topic that you want to discuss, just 'Reply All' to this announcement and give the topic title, a short description and a guesstimate of the time you need for your topic.

See last year's Media Summit Report as an example of what to expect:

https://lore.kernel.org/linux-media/[email protected]/

Regards,

Hans

PS: Be aware that May 24 and 25 are public holidays in France. So many shops may be closed those days.

In-person attendees:
Sakari Ailus <[email protected]> Kieran Bingham <[email protected]> Brandon Brnich <[email protected]>
Rouven Czerwinski <[email protected]> Mehdi Djait <[email protected]> Bryan O'Donoghue <[email protected]> Nicolas Dufresne <[email protected]> Marco Felsch <[email protected]>
Paul Kocialkowski <[email protected]>
Jai Luthra <[email protected]> Jacopo Mondi <[email protected]> Benjamin Mugnier <[email protected]> Beleswar Padhi <[email protected]>
Laurent Pinchart <[email protected]> Loic Poulain <[email protected]> Sven Püschel <[email protected]> Ricardo Ribalda <[email protected]> Michael Riesch <[email protected]> Devarsh Thakkar <[email protected]>
Michael Tretter <[email protected]> Hans Verkuil <[email protected]>

Remote attendees:
Yemike Abhilash Chandra <[email protected]> Rishikesh Donadkar <[email protected]>
Jackson Lee <[email protected]>
Dave Stevenson <[email protected]> (tentative)

Agenda (tentative):

8:45-9:20: Arrive, settle in

9:20-9:30: Short intro (Hans Verkuil)

9:30-9:45: Status of ISP support in V4L2
Presenter: Laurent Pinchart
Description: Summary of ISP-related development in V4L2 since the last Linux Media Summit. This includes a brief overview of technical developments, and a summary of the efforts to engage with vendors.

9:45-10:45: V4L2 Stateless Video Encoding uAPI Progress Update
Presenter: Paul Kocialkowski
Description: An update on the ongonig work to support stateless codecs in V4L2. Some of the remaining open topics will be presented and discussed.

10:45-11:00: break

11:00-11:30: Vulkan Video Codecs
Presenter: Nicolas Dufresne
Description: Vulkan video codecs: what are the viable options for Linux Media and what is in preparation outside of our subsystem. The second aspect is informative as these discussions don't seem to lean toward our subsystem as the foundation. But I think it's rather useful for everyone to understand why and what is included.

11:30-12:00: Protected Video playback on i.MX8MQ
Presenter: Rouven Czerwinski
Description: Introduction to protected video playback
on i.MX8MQ and missing bits for linux-media & protected heap interoperability.

12:00-13:30: Lunch

13:30-14:00: HDCP support for HDMI receivers
Presenter: Hans Verkuil
Description: I have been working on adding HDCP support for HDMI receivers. Specifically the HDCP negotiation between sources and sinks.

14:00-14:30: AI patches
Presenter: Sakari Ailus
Description: What is our policy w.r.t. AI generated patches?

14:30-15:00 Overview of Media CI: where do pipelines run?
Presenter: Ricardo Ribalda
Description: How are jobs in pipelines assigned? How does the infrastructure for Media CI work? Are there things that can be tweaked to make it more reliable?

15:00-15:15: Break

15:15-16:15: Discussion of the media subsystem development process
Presenter: Hans Verkuil
Description: Review of the multi-committer model: current status and next steps. Are there any bottlenecks, any ideas for improvements, w.r.t. the development process?

As you can see, there is still some available time for other topics.

#6 lore raw
Quoted 4 lines · Loic Poulain

Hi Hans,

I would be happy to discuss this if a slot is available:

Quoted 13 lines

Title: Generic V4L2 ISP M2M framework
Presenter: Loic Poulain
Time estimate: ~20min
Description: During early development of a Qualcomm Offline Image Processing Engine (OPE), we relied on the V4L2 memory‑to‑memory (v4l2‑m2m) framework, which is widely used and provides solid support for buffer management and scheduling. However, applying it to an ISP use case exposes limitations: ISP engines often require a richer media graph, with multiple pads and metadata flows, similar to inline ISP pipelines (params, stats, outputs). This talk proposes discussing the need for and design of a common V4L2 ISP M2M framework to factor out shared functionality across drivers, particularly around buffer/queue management and job scheduling.

That's well aligned with the v4l2-isp framework that Jacopo started, and to the multi-context and media-jobs APIs that we have proposed. I wonder, however, if a short session at the media summit will be enough, or if we should try to organize a half day brainstorming workshop at some point. Depending on when the people interested in this topic plan to arrive, Monday could be an option.

Quoted 144 lines · Hans Verkuil
Quoted 143 lines

(Please pass this on to anyone you think might be interested in this!)

Hi all,

This is the fourth version of this announcement, updating the list of attendees and the tentative agenda at the end: please let me know if you see mistakes. Note that there is still time for one or two other topics. Also please check the agenda if you need more (or perhaps less) time for your topic.

This year's Media Summit will be held on Tuesday May 26th the day before the Embedded Recipes Conference in Nice, France:

https://embedded-recipes.org/2026/

The Media Summit will be held at Hotel Campanile and in the same meeting room as last year (Nikaia):

https://nice-aeroport.campanile.com/en-us/

It is close to the Airport and to the Embedded Recipes venue.

The meeting room can hold up to 30 people and I will provide video conferencing support, just like last year. The location and the meeting room was quite nice last year, so I saw no need to change it.

That said, in-person participation is very much preferred. This yearly summit is meant for active media developers to meet face-to-face and to discuss media subsystem issues.

And it is also a good opportunity to talk to each other during the Embedded Recipes conference to discuss topics in a smaller group. But if you are an active media developer and are really not able to attend in person, then remote participation is an option.

If you want to attend the meeting (either in person or remote), then send an email to me directly. The deadline for in-person attendance is May 14 as the hotel needs to know the final number of attendees by then.

There is no registration fee, the meeting room is sponsored by Cisco and Collabora, and the lunch is sponsored by Ideas on Board! Many thanks to our sponsors, it's very much appreciated.

If you have a topic that you want to discuss, just 'Reply All' to this announcement and give the topic title, a short description and a guesstimate of the time you need for your topic.

See last year's Media Summit Report as an example of what to expect:

https://lore.kernel.org/linux-media/[email protected]/

Regards,

Hans

PS: Be aware that May 24 and 25 are public holidays in France. So many shops may be closed those days.

In-person attendees:
Sakari Ailus <[email protected]> Kieran Bingham <[email protected]> Brandon Brnich <[email protected]>
Rouven Czerwinski <[email protected]> Mehdi Djait <[email protected]> Bryan O'Donoghue <[email protected]> Nicolas Dufresne <[email protected]> Marco Felsch <[email protected]>
Paul Kocialkowski <[email protected]>
Jai Luthra <[email protected]> Jacopo Mondi <[email protected]> Benjamin Mugnier <[email protected]> Beleswar Padhi <[email protected]>
Laurent Pinchart <[email protected]> Loic Poulain <[email protected]> Sven Püschel <[email protected]> Ricardo Ribalda <[email protected]> Michael Riesch <[email protected]> Devarsh Thakkar <[email protected]>
Michael Tretter <[email protected]> Hans Verkuil <[email protected]>

Remote attendees:
Yemike Abhilash Chandra <[email protected]> Rishikesh Donadkar <[email protected]>
Jackson Lee <[email protected]>
Dave Stevenson <[email protected]> (tentative)

Agenda (tentative):

8:45-9:20: Arrive, settle in

9:20-9:30: Short intro (Hans Verkuil)

9:30-9:45: Status of ISP support in V4L2
Presenter: Laurent Pinchart
Description: Summary of ISP-related development in V4L2 since the last Linux Media Summit. This includes a brief overview of technical developments, and a summary of the efforts to engage with vendors.

9:45-10:45: V4L2 Stateless Video Encoding uAPI Progress Update
Presenter: Paul Kocialkowski
Description: An update on the ongonig work to support stateless codecs in V4L2. Some of the remaining open topics will be presented and discussed.

10:45-11:00: break

11:00-11:30: Vulkan Video Codecs
Presenter: Nicolas Dufresne
Description: Vulkan video codecs: what are the viable options for Linux Media and what is in preparation outside of our subsystem. The second aspect is informative as these discussions don't seem to lean toward our subsystem as the foundation. But I think it's rather useful for everyone to understand why and what is included.

11:30-12:00: Protected Video playback on i.MX8MQ
Presenter: Rouven Czerwinski
Description: Introduction to protected video playback
on i.MX8MQ and missing bits for linux-media & protected heap interoperability.

12:00-13:30: Lunch

13:30-14:00: HDCP support for HDMI receivers
Presenter: Hans Verkuil
Description: I have been working on adding HDCP support for HDMI receivers. Specifically the HDCP negotiation between sources and sinks.

14:00-14:30: AI patches
Presenter: Sakari Ailus
Description: What is our policy w.r.t. AI generated patches?

14:30-15:00 Overview of Media CI: where do pipelines run?
Presenter: Ricardo Ribalda
Description: How are jobs in pipelines assigned? How does the infrastructure for Media CI work? Are there things that can be tweaked to make it more reliable?

15:00-15:15: Break

15:15-16:15: Discussion of the media subsystem development process
Presenter: Hans Verkuil
Description: Review of the multi-committer model: current status and next steps. Are there any bottlenecks, any ideas for improvements, w.r.t. the development process?

As you can see, there is still some available time for other topics.

Signature · 3 lines
Regards,

Laurent Pinchart
#7 lore raw

Hi,

Le lundi 13 avril 2026 à 23:19 +0300, Laurent Pinchart a écrit :

Quoted 19 lines · Loic Poulain
Quoted 4 lines

Hi Hans,

I would be happy to discuss this if a slot is available:

Quoted 13 lines

Title: Generic V4L2 ISP M2M framework
Presenter: Loic Poulain
Time estimate: ~20min
Description: During early development of a Qualcomm Offline Image Processing Engine (OPE), we relied on the V4L2 memory‑to‑memory (v4l2‑m2m) framework, which is widely used and provides solid support for buffer management and scheduling. However, applying it to an ISP use case exposes limitations: ISP engines often require a richer media graph, with multiple pads and metadata flows, similar to inline ISP pipelines (params, stats, outputs). This talk proposes discussing the need for and design of a common V4L2 ISP M2M framework to factor out shared functionality across drivers, particularly around buffer/queue management and job scheduling.

Quoted 6 lines

That's well aligned with the v4l2-isp framework that Jacopo started, and to the multi-context and media-jobs APIs that we have proposed. I wonder, however, if a short session at the media summit will be enough, or if we should try to organize a half day brainstorming workshop at some point. Depending on when the people interested in this topic plan to arrive, Monday could be an option.

I'm also/still interested in the multi-context for m2m decoders that have inline post-processing capabilities (current model forces us to waste a lot of RAM). We just restarted some design discussion with the team, with an increased confidence that multi-context is the way. The scheduler could come handy in the future if we get to deal with more multi-stage codecs in the future. I'll be in Nice all day Monday.

Nicolas

Quoted 177 lines
Quoted 177 lines
Quoted 174 lines · Hans Verkuil

(Please pass this on to anyone you think might be interested in this!)

Hi all,

This is the fourth version of this announcement, updating the list of attendees
and the tentative agenda at the end: please let me know if you see mistakes.
Note that there is still time for one or two other topics. Also please check
the agenda if you need more (or perhaps less) time for your topic.

This year's Media Summit will be held on Tuesday May 26th the day before the
Embedded Recipes Conference in Nice, France:

https://embedded-recipes.org/2026/

The Media Summit will be held at Hotel Campanile and in the same meeting room
as last year (Nikaia):

https://nice-aeroport.campanile.com/en-us/

It is close to the Airport and to the Embedded Recipes venue.

The meeting room can hold up to 30 people and I will provide video conferencing support,
just like last year. The location and the meeting room was quite nice last year, so
I saw no need to change it.

That said, in-person participation is very much preferred. This yearly summit is meant
for active media developers to meet face-to-face and to discuss media subsystem issues.

And it is also a good opportunity to talk to each other during the Embedded Recipes
conference to discuss topics in a smaller group. But if you are an active media developer
and are really not able to attend in person, then remote participation is an option.

If you want to attend the meeting (either in person or remote), then send an email to me
directly. The deadline for in-person attendance is May 14 as the hotel needs to know the
final number of attendees by then.

There is no registration fee, the meeting room is sponsored by Cisco and Collabora, and
the lunch is sponsored by Ideas on Board! Many thanks to our sponsors, it's very much
appreciated.

If you have a topic that you want to discuss, just 'Reply All' to this announcement
and give the topic title, a short description and a guesstimate of the time you need
for your topic.

See last year's Media Summit Report as an example of what to expect:

https://lore.kernel.org/linux-media/[email protected]/

Regards,

        Hans

PS: Be aware that May 24 and 25 are public holidays in France. So many shops may be
closed those days.

In-person attendees:
Sakari Ailus <[email protected]> Kieran Bingham <[email protected]> Brandon Brnich <[email protected]>
Rouven Czerwinski <[email protected]> Mehdi Djait <[email protected]> Bryan O'Donoghue <[email protected]> Nicolas Dufresne <[email protected]> Marco Felsch <[email protected]>
Paul Kocialkowski <[email protected]>
Jai Luthra <[email protected]> Jacopo Mondi <[email protected]> Benjamin Mugnier <[email protected]> Beleswar Padhi <[email protected]>
Laurent Pinchart <[email protected]> Loic Poulain <[email protected]> Sven Püschel <[email protected]> Ricardo Ribalda <[email protected]> Michael Riesch <[email protected]> Devarsh Thakkar <[email protected]>
Michael Tretter <[email protected]> Hans Verkuil <[email protected]>

Remote attendees:
Yemike Abhilash Chandra <[email protected]> Rishikesh Donadkar <[email protected]>
Jackson Lee <[email protected]>
Dave Stevenson <[email protected]> (tentative)

Agenda (tentative):

8:45-9:20: Arrive, settle in

9:20-9:30: Short intro (Hans Verkuil)

9:30-9:45: Status of ISP support in V4L2
        Presenter: Laurent Pinchart
        Description: Summary of ISP-related development in V4L2 since the last
        Linux Media Summit. This includes a brief overview of technical developments, and a summary of the efforts to engage with vendors.

9:45-10:45: V4L2 Stateless Video Encoding uAPI Progress Update
        Presenter: Paul Kocialkowski
        Description: An update on the ongonig work to support stateless codecs in V4L2.
        Some of the remaining open topics will be presented and discussed.

10:45-11:00: break

11:00-11:30: Vulkan Video Codecs
        Presenter: Nicolas Dufresne
        Description: Vulkan video codecs: what are the viable options for Linux Media
        and what is in preparation outside of our subsystem. The second aspect is
        informative as these discussions don't seem to lean toward our subsystem as the
        foundation. But I think it's rather useful for everyone to understand why and
        what is included.

11:30-12:00: Protected Video playback on i.MX8MQ
        Presenter: Rouven Czerwinski
        Description: Introduction to protected video playback on i.MX8MQ and missing bits for linux-media & protected heap interoperability.

12:00-13:30: Lunch

13:30-14:00: HDCP support for HDMI receivers
        Presenter: Hans Verkuil
        Description: I have been working on adding HDCP support for HDMI receivers.
        Specifically the HDCP negotiation between sources and sinks.

14:00-14:30: AI patches
        Presenter: Sakari Ailus
        Description: What is our policy w.r.t. AI generated patches?

14:30-15:00 Overview of Media CI: where do pipelines run?
        Presenter: Ricardo Ribalda
        Description: How are jobs in pipelines assigned? How does the infrastructure
        for Media CI work? Are there things that can be tweaked to make it more
        reliable?

15:00-15:15: Break

15:15-16:15: Discussion of the media subsystem development process
        Presenter: Hans Verkuil
        Description: Review of the multi-committer model: current status and next steps.
        Are there any bottlenecks, any ideas for improvements, w.r.t. the development process?

As you can see, there is still some available time for other topics.

#8 lore raw
Quoted 27 lines · Nicolas Dufresne

Le lundi 13 avril 2026 à 23:19 +0300, Laurent Pinchart a écrit :

Quoted 19 lines · Loic Poulain
Quoted 4 lines

Hi Hans,

I would be happy to discuss this if a slot is available:

Quoted 13 lines

Title: Generic V4L2 ISP M2M framework
Presenter: Loic Poulain
Time estimate: ~20min
Description: During early development of a Qualcomm Offline Image Processing Engine (OPE), we relied on the V4L2 memory‑to‑memory (v4l2‑m2m) framework, which is widely used and provides solid support for buffer management and scheduling. However, applying it to an ISP use case exposes limitations: ISP engines often require a richer media graph, with multiple pads and metadata flows, similar to inline ISP pipelines (params, stats, outputs). This talk proposes discussing the need for and design of a common V4L2 ISP M2M framework to factor out shared functionality across drivers, particularly around buffer/queue management and job scheduling.

Quoted 6 lines

That's well aligned with the v4l2-isp framework that Jacopo started, and to the multi-context and media-jobs APIs that we have proposed. I wonder, however, if a short session at the media summit will be enough, or if we should try to organize a half day brainstorming workshop at some point. Depending on when the people interested in this topic plan to arrive, Monday could be an option.

Quoted 6 lines

I'm also/still interested in the multi-context for m2m decoders that have inline post-processing capabilities (current model forces us to waste a lot of RAM). We just restarted some design discussion with the team, with an increased confidence that multi-context is the way. The scheduler could come handy in the future if we get to deal with more multi-stage codecs in the future. I'll be in Nice all day Monday.

I will unfortunately be available only until 15:00 on Monday, but Jacopo should be available through the day. Let's see who would be interested and available, and try to organize something.

Quoted 175 lines
Quoted 175 lines
Quoted 175 lines · Hans Verkuil
Quoted 174 lines

(Please pass this on to anyone you think might be interested in this!)

Hi all,

This is the fourth version of this announcement, updating the list of attendees
and the tentative agenda at the end: please let me know if you see mistakes.
Note that there is still time for one or two other topics. Also please check
the agenda if you need more (or perhaps less) time for your topic.

This year's Media Summit will be held on Tuesday May 26th the day before the
Embedded Recipes Conference in Nice, France:

https://embedded-recipes.org/2026/

The Media Summit will be held at Hotel Campanile and in the same meeting room
as last year (Nikaia):

https://nice-aeroport.campanile.com/en-us/

It is close to the Airport and to the Embedded Recipes venue.

The meeting room can hold up to 30 people and I will provide video conferencing support,
just like last year. The location and the meeting room was quite nice last year, so
I saw no need to change it.

That said, in-person participation is very much preferred. This yearly summit is meant
for active media developers to meet face-to-face and to discuss media subsystem issues.

And it is also a good opportunity to talk to each other during the Embedded Recipes
conference to discuss topics in a smaller group. But if you are an active media developer
and are really not able to attend in person, then remote participation is an option.

If you want to attend the meeting (either in person or remote), then send an email to me
directly. The deadline for in-person attendance is May 14 as the hotel needs to know the
final number of attendees by then.

There is no registration fee, the meeting room is sponsored by Cisco and Collabora, and
the lunch is sponsored by Ideas on Board! Many thanks to our sponsors, it's very much
appreciated.

If you have a topic that you want to discuss, just 'Reply All' to this announcement
and give the topic title, a short description and a guesstimate of the time you need
for your topic.

See last year's Media Summit Report as an example of what to expect:

https://lore.kernel.org/linux-media/[email protected]/

Regards,

        Hans

PS: Be aware that May 24 and 25 are public holidays in France. So many shops may be
closed those days.

In-person attendees:
Sakari Ailus <[email protected]> Kieran Bingham <[email protected]> Brandon Brnich <[email protected]>
Rouven Czerwinski <[email protected]> Mehdi Djait <[email protected]> Bryan O'Donoghue <[email protected]> Nicolas Dufresne <[email protected]> Marco Felsch <[email protected]>
Paul Kocialkowski <[email protected]>
Jai Luthra <[email protected]> Jacopo Mondi <[email protected]> Benjamin Mugnier <[email protected]> Beleswar Padhi <[email protected]>
Laurent Pinchart <[email protected]> Loic Poulain <[email protected]> Sven Püschel <[email protected]> Ricardo Ribalda <[email protected]> Michael Riesch <[email protected]> Devarsh Thakkar <[email protected]>
Michael Tretter <[email protected]> Hans Verkuil <[email protected]>

Remote attendees:
Yemike Abhilash Chandra <[email protected]> Rishikesh Donadkar <[email protected]>
Jackson Lee <[email protected]>
Dave Stevenson <[email protected]> (tentative)

Agenda (tentative):

8:45-9:20: Arrive, settle in

9:20-9:30: Short intro (Hans Verkuil)

9:30-9:45: Status of ISP support in V4L2
        Presenter: Laurent Pinchart
        Description: Summary of ISP-related development in V4L2 since the last
        Linux Media Summit. This includes a brief overview of technical developments, and a summary of the efforts to engage with vendors.

9:45-10:45: V4L2 Stateless Video Encoding uAPI Progress Update
        Presenter: Paul Kocialkowski
        Description: An update on the ongonig work to support stateless codecs in V4L2.
        Some of the remaining open topics will be presented and discussed.

10:45-11:00: break

11:00-11:30: Vulkan Video Codecs
        Presenter: Nicolas Dufresne
        Description: Vulkan video codecs: what are the viable options for Linux Media
        and what is in preparation outside of our subsystem. The second aspect is
        informative as these discussions don't seem to lean toward our subsystem as the
        foundation. But I think it's rather useful for everyone to understand why and
        what is included.

11:30-12:00: Protected Video playback on i.MX8MQ
        Presenter: Rouven Czerwinski
        Description: Introduction to protected video playback on i.MX8MQ and missing bits for linux-media & protected heap interoperability.

12:00-13:30: Lunch

13:30-14:00: HDCP support for HDMI receivers
        Presenter: Hans Verkuil
        Description: I have been working on adding HDCP support for HDMI receivers.
        Specifically the HDCP negotiation between sources and sinks.

14:00-14:30: AI patches
        Presenter: Sakari Ailus
        Description: What is our policy w.r.t. AI generated patches?

14:30-15:00 Overview of Media CI: where do pipelines run?
        Presenter: Ricardo Ribalda
        Description: How are jobs in pipelines assigned? How does the infrastructure
        for Media CI work? Are there things that can be tweaked to make it more
        reliable?

15:00-15:15: Break

15:15-16:15: Discussion of the media subsystem development process
        Presenter: Hans Verkuil
        Description: Review of the multi-committer model: current status and next steps.
        Are there any bottlenecks, any ideas for improvements, w.r.t. the development process?

As you can see, there is still some available time for other topics.

Signature · 3 lines
Regards,

Laurent Pinchart
#9 lore raw
Quoted 35 lines · Laurent Pinchart
Quoted 27 lines · Nicolas Dufresne

Le lundi 13 avril 2026 à 23:19 +0300, Laurent Pinchart a écrit :

Quoted 19 lines · Loic Poulain
Quoted 4 lines

Hi Hans,

I would be happy to discuss this if a slot is available:

Quoted 13 lines

Title: Generic V4L2 ISP M2M framework
Presenter: Loic Poulain
Time estimate: ~20min
Description: During early development of a Qualcomm Offline Image Processing Engine (OPE), we relied on the V4L2 memory‑to‑memory (v4l2‑m2m) framework, which is widely used and provides solid support for buffer management and scheduling. However, applying it to an ISP use case exposes limitations: ISP engines often require a richer media graph, with multiple pads and metadata flows, similar to inline ISP pipelines (params, stats, outputs). This talk proposes discussing the need for and design of a common V4L2 ISP M2M framework to factor out shared functionality across drivers, particularly around buffer/queue management and job scheduling.

Quoted 6 lines

That's well aligned with the v4l2-isp framework that Jacopo started, and to the multi-context and media-jobs APIs that we have proposed. I wonder, however, if a short session at the media summit will be enough, or if we should try to organize a half day brainstorming workshop at some point. Depending on when the people interested in this topic plan to arrive, Monday could be an option.

Quoted 6 lines

I'm also/still interested in the multi-context for m2m decoders that have inline post-processing capabilities (current model forces us to waste a lot of RAM). We just restarted some design discussion with the team, with an increased confidence that multi-context is the way. The scheduler could come handy in the future if we get to deal with more multi-stage codecs in the future. I'll be in Nice all day Monday.

Quoted 3 lines

I will unfortunately be available only until 15:00 on Monday, but Jacopo should be available through the day. Let's see who would be interested and available, and try to organize something.

I'm available on Monday as well. I think this is a topic that is well suited to a brainstorm session.

The agenda for the media summit is getting quite full, and I agree with Laurent that 20 minutes is likely not enough. If we can so a session on Monday instead, then that would be a good solution.

I have never been very enthusiastic about the m2m framework: it's fine for e.g. simple scalers, but it's awkward to use for codecs let alone ISPs.

I always felt that we really need variants of the m2m framework that are customized to specific use-cases: i.e. a codec m2m framework, and (perhaps) an ISP m2m framework.

The big problem with that is of course who will do the work. Making new frameworks is difficult and takes a long time.

Regards,

Hans

Quoted 177 lines
Quoted 176 lines
Quoted 176 lines
Quoted 176 lines · Hans Verkuil
Quoted 174 lines

(Please pass this on to anyone you think might be interested in this!)

Hi all,

This is the fourth version of this announcement, updating the list of attendees
and the tentative agenda at the end: please let me know if you see mistakes.
Note that there is still time for one or two other topics. Also please check
the agenda if you need more (or perhaps less) time for your topic.

This year's Media Summit will be held on Tuesday May 26th the day before the
Embedded Recipes Conference in Nice, France:

https://embedded-recipes.org/2026/

The Media Summit will be held at Hotel Campanile and in the same meeting room
as last year (Nikaia):

https://nice-aeroport.campanile.com/en-us/

It is close to the Airport and to the Embedded Recipes venue.

The meeting room can hold up to 30 people and I will provide video conferencing support,
just like last year. The location and the meeting room was quite nice last year, so
I saw no need to change it.

That said, in-person participation is very much preferred. This yearly summit is meant
for active media developers to meet face-to-face and to discuss media subsystem issues.

And it is also a good opportunity to talk to each other during the Embedded Recipes
conference to discuss topics in a smaller group. But if you are an active media developer
and are really not able to attend in person, then remote participation is an option.

If you want to attend the meeting (either in person or remote), then send an email to me
directly. The deadline for in-person attendance is May 14 as the hotel needs to know the
final number of attendees by then.

There is no registration fee, the meeting room is sponsored by Cisco and Collabora, and
the lunch is sponsored by Ideas on Board! Many thanks to our sponsors, it's very much
appreciated.

If you have a topic that you want to discuss, just 'Reply All' to this announcement
and give the topic title, a short description and a guesstimate of the time you need
for your topic.

See last year's Media Summit Report as an example of what to expect:

https://lore.kernel.org/linux-media/[email protected]/

Regards,

        Hans

PS: Be aware that May 24 and 25 are public holidays in France. So many shops may be
closed those days.

In-person attendees:
Sakari Ailus <[email protected]> Kieran Bingham <[email protected]> Brandon Brnich <[email protected]>
Rouven Czerwinski <[email protected]> Mehdi Djait <[email protected]> Bryan O'Donoghue <[email protected]> Nicolas Dufresne <[email protected]> Marco Felsch <[email protected]>
Paul Kocialkowski <[email protected]>
Jai Luthra <[email protected]> Jacopo Mondi <[email protected]> Benjamin Mugnier <[email protected]> Beleswar Padhi <[email protected]>
Laurent Pinchart <[email protected]> Loic Poulain <[email protected]> Sven Püschel <[email protected]> Ricardo Ribalda <[email protected]> Michael Riesch <[email protected]> Devarsh Thakkar <[email protected]>
Michael Tretter <[email protected]> Hans Verkuil <[email protected]>

Remote attendees:
Yemike Abhilash Chandra <[email protected]> Rishikesh Donadkar <[email protected]>
Jackson Lee <[email protected]>
Dave Stevenson <[email protected]> (tentative)

Agenda (tentative):

8:45-9:20: Arrive, settle in

9:20-9:30: Short intro (Hans Verkuil)

9:30-9:45: Status of ISP support in V4L2
        Presenter: Laurent Pinchart
        Description: Summary of ISP-related development in V4L2 since the last
        Linux Media Summit. This includes a brief overview of technical developments, and a summary of the efforts to engage with vendors.

9:45-10:45: V4L2 Stateless Video Encoding uAPI Progress Update
        Presenter: Paul Kocialkowski
        Description: An update on the ongonig work to support stateless codecs in V4L2.
        Some of the remaining open topics will be presented and discussed.

10:45-11:00: break

11:00-11:30: Vulkan Video Codecs
        Presenter: Nicolas Dufresne
        Description: Vulkan video codecs: what are the viable options for Linux Media
        and what is in preparation outside of our subsystem. The second aspect is
        informative as these discussions don't seem to lean toward our subsystem as the
        foundation. But I think it's rather useful for everyone to understand why and
        what is included.

11:30-12:00: Protected Video playback on i.MX8MQ
        Presenter: Rouven Czerwinski
        Description: Introduction to protected video playback on i.MX8MQ and missing bits for linux-media & protected heap interoperability.

12:00-13:30: Lunch

13:30-14:00: HDCP support for HDMI receivers
        Presenter: Hans Verkuil
        Description: I have been working on adding HDCP support for HDMI receivers.
        Specifically the HDCP negotiation between sources and sinks.

14:00-14:30: AI patches
        Presenter: Sakari Ailus
        Description: What is our policy w.r.t. AI generated patches?

14:30-15:00 Overview of Media CI: where do pipelines run?
        Presenter: Ricardo Ribalda
        Description: How are jobs in pipelines assigned? How does the infrastructure
        for Media CI work? Are there things that can be tweaked to make it more
        reliable?

15:00-15:15: Break

15:15-16:15: Discussion of the media subsystem development process
        Presenter: Hans Verkuil
        Description: Review of the multi-committer model: current status and next steps.
        Are there any bottlenecks, any ideas for improvements, w.r.t. the development process?

As you can see, there is still some available time for other topics.

#10 lore raw

Hi

Quoted 37 lines · Hans Verkuil
Quoted 35 lines · Laurent Pinchart
Quoted 33 lines · Nicolas Dufresne
Quoted 19 lines · Laurent Pinchart
Quoted 4 lines · Loic Poulain

Hi Hans,

I would be happy to discuss this if a slot is available:

Quoted 13 lines

Title: Generic V4L2 ISP M2M framework
Presenter: Loic Poulain
Time estimate: ~20min
Description: During early development of a Qualcomm Offline Image Processing Engine (OPE), we relied on the V4L2 memory‑to‑memory (v4l2‑m2m) framework, which is widely used and provides solid support for buffer management and scheduling. However, applying it to an ISP use case exposes limitations: ISP engines often require a richer media graph, with multiple pads and metadata flows, similar to inline ISP pipelines (params, stats, outputs). This talk proposes discussing the need for and design of a common V4L2 ISP M2M framework to factor out shared functionality across drivers, particularly around buffer/queue management and job scheduling.

Quoted 6 lines

That's well aligned with the v4l2-isp framework that Jacopo started, and to the multi-context and media-jobs APIs that we have proposed. I wonder, however, if a short session at the media summit will be enough, or if we should try to organize a half day brainstorming workshop at some point. Depending on when the people interested in this topic plan to arrive, Monday could be an option.

I'm also/still interested in the multi-context for m2m decoders that have inline post-processing capabilities (current model forces us to waste a lot of RAM). We just restarted some design discussion with the team, with an increased confidence that multi-context is the way. The scheduler could come handy in the future if we get to deal with more multi-stage codecs in the future. I'll be in Nice all day Monday.

Quoted 6 lines
Quoted 3 lines

I will unfortunately be available only until 15:00 on Monday, but Jacopo should be available through the day. Let's see who would be interested and available, and try to organize something.

I'm available on Monday as well. I think this is a topic that is well suited to a brainstorm session.

I am also available on Monday and would like to attend the session.

Regards!

Quoted 196 lines

The agenda for the media summit is getting quite full, and I agree with Laurent that 20 minutes is likely not enough. If we can so a session on Monday instead, then that would be a good solution.

I have never been very enthusiastic about the m2m framework: it's fine for e.g. simple scalers, but it's awkward to use for codecs let alone ISPs.

I always felt that we really need variants of the m2m framework that are customized to specific use-cases: i.e. a codec m2m framework, and (perhaps) an ISP m2m framework.

The big problem with that is of course who will do the work. Making new frameworks is difficult and takes a long time.

Regards,

Hans

Quoted 177 lines
Quoted 176 lines
Quoted 176 lines
Quoted 176 lines · Hans Verkuil
Quoted 174 lines

(Please pass this on to anyone you think might be interested in this!)

Hi all,

This is the fourth version of this announcement, updating the list of attendees
and the tentative agenda at the end: please let me know if you see mistakes.
Note that there is still time for one or two other topics. Also please check
the agenda if you need more (or perhaps less) time for your topic.

This year's Media Summit will be held on Tuesday May 26th the day before the
Embedded Recipes Conference in Nice, France:

https://embedded-recipes.org/2026/

The Media Summit will be held at Hotel Campanile and in the same meeting room
as last year (Nikaia):

https://nice-aeroport.campanile.com/en-us/

It is close to the Airport and to the Embedded Recipes venue.

The meeting room can hold up to 30 people and I will provide video conferencing support,
just like last year. The location and the meeting room was quite nice last year, so
I saw no need to change it.

That said, in-person participation is very much preferred. This yearly summit is meant
for active media developers to meet face-to-face and to discuss media subsystem issues.

And it is also a good opportunity to talk to each other during the Embedded Recipes
conference to discuss topics in a smaller group. But if you are an active media developer
and are really not able to attend in person, then remote participation is an option.

If you want to attend the meeting (either in person or remote), then send an email to me
directly. The deadline for in-person attendance is May 14 as the hotel needs to know the
final number of attendees by then.

There is no registration fee, the meeting room is sponsored by Cisco and Collabora, and
the lunch is sponsored by Ideas on Board! Many thanks to our sponsors, it's very much
appreciated.

If you have a topic that you want to discuss, just 'Reply All' to this announcement
and give the topic title, a short description and a guesstimate of the time you need
for your topic.

See last year's Media Summit Report as an example of what to expect:

https://lore.kernel.org/linux-media/[email protected]/

Regards,

Hans

PS: Be aware that May 24 and 25 are public holidays in France. So many shops may be
closed those days.

In-person attendees:
Sakari Ailus <[email protected]> Kieran Bingham <[email protected]> Brandon Brnich <[email protected]>
Rouven Czerwinski <[email protected]> Mehdi Djait <[email protected]> Bryan O'Donoghue <[email protected]> Nicolas Dufresne <[email protected]> Marco Felsch <[email protected]>
Paul Kocialkowski <[email protected]>
Jai Luthra <[email protected]> Jacopo Mondi <[email protected]> Benjamin Mugnier <[email protected]> Beleswar Padhi <[email protected]>
Laurent Pinchart <[email protected]> Loic Poulain <[email protected]> Sven Püschel <[email protected]> Ricardo Ribalda <[email protected]> Michael Riesch <[email protected]> Devarsh Thakkar <[email protected]>
Michael Tretter <[email protected]> Hans Verkuil <[email protected]>

Remote attendees:
Yemike Abhilash Chandra <[email protected]> Rishikesh Donadkar <[email protected]>
Jackson Lee <[email protected]>
Dave Stevenson <[email protected]> (tentative)

Agenda (tentative):

8:45-9:20: Arrive, settle in

9:20-9:30: Short intro (Hans Verkuil)

9:30-9:45: Status of ISP support in V4L2
Presenter: Laurent Pinchart
Description: Summary of ISP-related development in V4L2 since the
last
Linux Media Summit. This includes a brief overview of technical developments, and a summary of the efforts to engage with vendors.

9:45-10:45: V4L2 Stateless Video Encoding uAPI Progress Update
Presenter: Paul Kocialkowski
Description: An update on the ongonig work to support stateless
codecs in V4L2.
Some of the remaining open topics will be presented and discussed.

10:45-11:00: break

11:00-11:30: Vulkan Video Codecs
Presenter: Nicolas Dufresne
Description: Vulkan video codecs: what are the viable options for
Linux Media
and what is in preparation outside of our subsystem. The second
aspect is
informative as these discussions don't seem to lean toward our
subsystem as the
foundation. But I think it's rather useful for everyone to
understand why and
what is included.

11:30-12:00: Protected Video playback on i.MX8MQ
Presenter: Rouven Czerwinski
Description: Introduction to protected video playback on i.MX8MQ and missing bits for linux-media & protected heap
interoperability.

12:00-13:30: Lunch

13:30-14:00: HDCP support for HDMI receivers
Presenter: Hans Verkuil
Description: I have been working on adding HDCP support for HDMI
receivers.
Specifically the HDCP negotiation between sources and sinks.

14:00-14:30: AI patches
Presenter: Sakari Ailus
Description: What is our policy w.r.t. AI generated patches?

14:30-15:00 Overview of Media CI: where do pipelines run?
Presenter: Ricardo Ribalda
Description: How are jobs in pipelines assigned? How does the
infrastructure
for Media CI work? Are there things that can be tweaked to make it
more
reliable?

15:00-15:15: Break

15:15-16:15: Discussion of the media subsystem development process
Presenter: Hans Verkuil
Description: Review of the multi-committer model: current status
and next steps.
Are there any bottlenecks, any ideas for improvements, w.r.t. the
development process?

As you can see, there is still some available time for other topics.

Signature · 1 line
Ricardo Ribalda
#11 lore raw

Hi all,

Quoted 25 lines · Ricardo Ribalda

Hi

Quoted 22 lines · Hans Verkuil
Quoted 20 lines · Laurent Pinchart
Quoted 19 lines · Nicolas Dufresne
Quoted 18 lines · Laurent Pinchart
Quoted 17 lines · Loic Poulain

Hi Hans,

I would be happy to discuss this if a slot is available:

Title: Generic V4L2 ISP M2M framework
Presenter: Loic Poulain
Time estimate: ~20min
Description: During early development of a Qualcomm Offline Image Processing Engine (OPE), we relied on the V4L2 memory‑to‑memory (v4l2‑m2m) framework, which is widely used and provides solid support for buffer management and scheduling. However, applying it to an ISP use case exposes limitations: ISP engines often require a richer media graph, with multiple pads and metadata flows, similar to inline ISP pipelines (params, stats, outputs). This talk proposes discussing the need for and design of a common V4L2 ISP M2M framework to factor out shared functionality across drivers, particularly around buffer/queue management and job scheduling.

It seems that we share some pain points.. :-) :-/

Over the last year, some ideas have been brewing in my mind. Not necessarily *my* ideas, mind you, rather ideas that have been around in linux-media for quite a while, actually. What I would like to prepare for the Media Summit goes along the same lines.

Quoted 14 lines
Quoted 14 lines
Quoted 14 lines
Quoted 13 lines
Quoted 6 lines

That's well aligned with the v4l2-isp framework that Jacopo started, and to the multi-context and media-jobs APIs that we have proposed. I wonder, however, if a short session at the media summit will be enough, or if we should try to organize a half day brainstorming workshop at some point. Depending on when the people interested in this topic plan to arrive, Monday could be an option.

I'm also/still interested in the multi-context for m2m decoders that have inline post-processing capabilities (current model forces us to waste a lot of RAM). We just restarted some design discussion with the team, with an increased confidence that multi-context is the way. The scheduler could come handy in the future if we get to deal with more multi-stage codecs in the future. I'll be in Nice all day Monday.

Quoted 8 lines
Quoted 6 lines
Quoted 3 lines

I will unfortunately be available only until 15:00 on Monday, but Jacopo should be available through the day. Let's see who would be interested and available, and try to organize something.

I'm available on Monday as well. I think this is a topic that is well suited to a brainstorm session.

I am also available on Monday and would like to attend the session.

I'd be interested too. Right now the plan is to arrive on Monday afternoon. Depending on what time you agree on it may work out anyway. It would be great to know the exact time this session will start (as I might need to adjust my travel arrangements).

Quoted 7 lines

Regards!

Quoted 4 lines

The agenda for the media summit is getting quite full, and I agree with Laurent that 20 minutes is likely not enough. If we can so a session on Monday instead, then that would be a good solution.

Apart from the time and date the scope of this session would be interesting.

Will this be a birds of a feather session in which the next generation kernel ISP framework will be discussed? Or even the next generation kernel video processing framework, where video processing is image signal processing, encoding/decoding, 2D graphics processing (fisheye correction units, 2D GPU such as the Rockchip RGA3, ...)?

Quoted 9 lines
Quoted 9 lines

I have never been very enthusiastic about the m2m framework: it's fine for e.g. simple scalers, but it's awkward to use for codecs let alone ISPs.

I always felt that we really need variants of the m2m framework that are customized to specific use-cases: i.e. a codec m2m framework, and (perhaps) an ISP m2m framework.

The big problem with that is of course who will do the work. Making new frameworks is difficult and takes a long time.

This may be naive and overly optimistic, but I feel there is quite a number of people sharing the same pain points (which are similar to those Loic pointed out). Maybe (hopefully) this birds of a feather session leads to the formation of some work group?

Best regards,
Michael

Quoted 185 lines
Quoted 183 lines

Regards,

Hans

Quoted 177 lines
Quoted 176 lines
Quoted 176 lines
Quoted 176 lines · Hans Verkuil
Quoted 174 lines

(Please pass this on to anyone you think might be interested in this!)

Hi all,

This is the fourth version of this announcement, updating the list of attendees
and the tentative agenda at the end: please let me know if you see mistakes.
Note that there is still time for one or two other topics. Also please check
the agenda if you need more (or perhaps less) time for your topic.

This year's Media Summit will be held on Tuesday May 26th the day before the
Embedded Recipes Conference in Nice, France:

https://embedded-recipes.org/2026/

The Media Summit will be held at Hotel Campanile and in the same meeting room
as last year (Nikaia):

https://nice-aeroport.campanile.com/en-us/

It is close to the Airport and to the Embedded Recipes venue.

The meeting room can hold up to 30 people and I will provide video conferencing support,
just like last year. The location and the meeting room was quite nice last year, so
I saw no need to change it.

That said, in-person participation is very much preferred. This yearly summit is meant
for active media developers to meet face-to-face and to discuss media subsystem issues.

And it is also a good opportunity to talk to each other during the Embedded Recipes
conference to discuss topics in a smaller group. But if you are an active media developer
and are really not able to attend in person, then remote participation is an option.

If you want to attend the meeting (either in person or remote), then send an email to me
directly. The deadline for in-person attendance is May 14 as the hotel needs to know the
final number of attendees by then.

There is no registration fee, the meeting room is sponsored by Cisco and Collabora, and
the lunch is sponsored by Ideas on Board! Many thanks to our sponsors, it's very much
appreciated.

If you have a topic that you want to discuss, just 'Reply All' to this announcement
and give the topic title, a short description and a guesstimate of the time you need
for your topic.

See last year's Media Summit Report as an example of what to expect:

https://lore.kernel.org/linux-media/[email protected]/

Regards,

Hans

PS: Be aware that May 24 and 25 are public holidays in France. So many shops may be
closed those days.

In-person attendees:
Sakari Ailus <[email protected]> Kieran Bingham <[email protected]> Brandon Brnich <[email protected]>
Rouven Czerwinski <[email protected]> Mehdi Djait <[email protected]> Bryan O'Donoghue <[email protected]> Nicolas Dufresne <[email protected]> Marco Felsch <[email protected]>
Paul Kocialkowski <[email protected]>
Jai Luthra <[email protected]> Jacopo Mondi <[email protected]> Benjamin Mugnier <[email protected]> Beleswar Padhi <[email protected]>
Laurent Pinchart <[email protected]> Loic Poulain <[email protected]> Sven Püschel <[email protected]> Ricardo Ribalda <[email protected]> Michael Riesch <[email protected]> Devarsh Thakkar <[email protected]>
Michael Tretter <[email protected]> Hans Verkuil <[email protected]>

Remote attendees:
Yemike Abhilash Chandra <[email protected]> Rishikesh Donadkar <[email protected]>
Jackson Lee <[email protected]>
Dave Stevenson <[email protected]> (tentative)

Agenda (tentative):

8:45-9:20: Arrive, settle in

9:20-9:30: Short intro (Hans Verkuil)

9:30-9:45: Status of ISP support in V4L2
Presenter: Laurent Pinchart
Description: Summary of ISP-related development in V4L2 since the
last
Linux Media Summit. This includes a brief overview of technical developments, and a summary of the efforts to engage with vendors.

9:45-10:45: V4L2 Stateless Video Encoding uAPI Progress Update
Presenter: Paul Kocialkowski
Description: An update on the ongonig work to support stateless
codecs in V4L2.
Some of the remaining open topics will be presented and discussed.

10:45-11:00: break

11:00-11:30: Vulkan Video Codecs
Presenter: Nicolas Dufresne
Description: Vulkan video codecs: what are the viable options for
Linux Media
and what is in preparation outside of our subsystem. The second
aspect is
informative as these discussions don't seem to lean toward our
subsystem as the
foundation. But I think it's rather useful for everyone to
understand why and
what is included.

11:30-12:00: Protected Video playback on i.MX8MQ
Presenter: Rouven Czerwinski
Description: Introduction to protected video playback on i.MX8MQ and missing bits for linux-media & protected heap
interoperability.

12:00-13:30: Lunch

13:30-14:00: HDCP support for HDMI receivers
Presenter: Hans Verkuil
Description: I have been working on adding HDCP support for HDMI
receivers.
Specifically the HDCP negotiation between sources and sinks.

14:00-14:30: AI patches
Presenter: Sakari Ailus
Description: What is our policy w.r.t. AI generated patches?

14:30-15:00 Overview of Media CI: where do pipelines run?
Presenter: Ricardo Ribalda
Description: How are jobs in pipelines assigned? How does the
infrastructure
for Media CI work? Are there things that can be tweaked to make it
more
reliable?

15:00-15:15: Break

15:15-16:15: Discussion of the media subsystem development process
Presenter: Hans Verkuil
Description: Review of the multi-committer model: current status
and next steps.
Are there any bottlenecks, any ideas for improvements, w.r.t. the
development process?

As you can see, there is still some available time for other topics.

#12 lore raw
Quoted 52 lines · Michael Riesch
Quoted 9 lines · Ricardo Ribalda
Quoted 8 lines · Hans Verkuil
Quoted 7 lines · Laurent Pinchart
Quoted 6 lines · Nicolas Dufresne
Quoted 5 lines · Laurent Pinchart
Quoted 4 lines · Loic Poulain

Hi Hans,

I would be happy to discuss this if a slot is available:

Quoted 13 lines
Quoted 5 lines
Quoted 5 lines
Quoted 5 lines
Quoted 5 lines
Quoted 5 lines

Title: Generic V4L2 ISP M2M framework
Presenter: Loic Poulain
Time estimate: ~20min
Description: During early development of a Qualcomm Offline Image Processing Engine (OPE), we relied on the V4L2 memory‑to‑memory

Quoted 8 lines
Quoted 8 lines
Quoted 8 lines
Quoted 8 lines
Quoted 8 lines

(v4l2‑m2m) framework, which is widely used and provides solid support for buffer management and scheduling. However, applying it to an ISP use case exposes limitations: ISP engines often require a richer media graph, with multiple pads and metadata flows, similar to inline ISP pipelines (params, stats, outputs). This talk proposes discussing the need for and design of a common V4L2 ISP M2M framework to factor out shared functionality across drivers, particularly around buffer/queue management and job scheduling.

It seems that we share some pain points.. :-) :-/

Over the last year, some ideas have been brewing in my mind. Not necessarily *my* ideas, mind you, rather ideas that have been around in linux-media for quite a while, actually. What I would like to prepare for the Media Summit goes along the same lines.

Quoted 21 lines
Quoted 20 lines
Quoted 14 lines
Quoted 7 lines
Quoted 6 lines

That's well aligned with the v4l2-isp framework that Jacopo started, and to the multi-context and media-jobs APIs that we have proposed. I wonder, however, if a short session at the media summit will be enough, or if we should try to organize a half day brainstorming workshop at some point. Depending on when the people interested in this topic plan to arrive, Monday could be an option.

Quoted 6 lines

I'm also/still interested in the multi-context for m2m decoders that have inline post-processing capabilities (current model forces us to waste a lot of RAM). We just restarted some design discussion with the team, with an increased confidence that multi-context is the way. The scheduler could come handy in the future if we get to deal with more multi-stage codecs in the future. I'll be in Nice all day Monday.

Quoted 3 lines

I will unfortunately be available only until 15:00 on Monday, but Jacopo should be available through the day. Let's see who would be interested and available, and try to organize something.

I'm available on Monday as well. I think this is a topic that is well suited to a brainstorm session.

Quoted 6 lines
Quoted 1 line

I am also available on Monday and would like to attend the session.

I'd be interested too. Right now the plan is to arrive on Monday afternoon. Depending on what time you agree on it may work out anyway. It would be great to know the exact time this session will start (as I might need to adjust my travel arrangements).

We need a volunteer to organize this, as in finding and booking a meeting space. Note that Monday is a public holiday in France (Monday the 25th of May in particular, not all Mondays).

If the number of attendees was small I was thinking of hosting the event in the place where the Ideas on Board team will be staying, but it looks like we're already reaching a fair number of people.

Quoted 6 lines
Quoted 5 lines

Regards!

Quoted 3 lines

The agenda for the media summit is getting quite full, and I agree with Laurent that 20 minutes is likely not enough. If we can so a session on Monday instead, then that would be a good solution.

Quoted 7 lines

Apart from the time and date the scope of this session would be interesting.

Will this be a birds of a feather session in which the next generation kernel ISP framework will be discussed? Or even the next generation kernel video processing framework, where video processing is image signal processing, encoding/decoding, 2D graphics processing (fisheye correction units, 2D GPU such as the Rockchip RGA3, ...)?

I would focus on Loic's original scope. If the solution can be used for other devices that's great too. I believe that the current multi-context patch series is a good fit for codecs. If we broaden the scope too much right away we'll achieve nothing.

Quoted 159 lines
Quoted 8 lines
Quoted 8 lines

I have never been very enthusiastic about the m2m framework: it's fine for e.g. simple scalers, but it's awkward to use for codecs let alone ISPs.

I always felt that we really need variants of the m2m framework that are customized to specific use-cases: i.e. a codec m2m framework, and (perhaps) an ISP m2m framework.

The big problem with that is of course who will do the work. Making new frameworks is difficult and takes a long time.

This may be naive and overly optimistic, but I feel there is quite a number of people sharing the same pain points (which are similar to those Loic pointed out). Maybe (hopefully) this birds of a feather session leads to the formation of some work group?

Quoted 145 lines
Quoted 145 lines
Quoted 145 lines
Quoted 145 lines
Quoted 145 lines
Quoted 145 lines · Hans Verkuil
Quoted 144 lines

(Please pass this on to anyone you think might be interested in this!)

Hi all,

This is the fourth version of this announcement, updating the list of attendees and the tentative agenda at the end: please let me know if you see mistakes. Note that there is still time for one or two other topics. Also please check the agenda if you need more (or perhaps less) time for your topic.

This year's Media Summit will be held on Tuesday May 26th the day before the Embedded Recipes Conference in Nice, France:

https://embedded-recipes.org/2026/

The Media Summit will be held at Hotel Campanile and in the same meeting room as last year (Nikaia):

https://nice-aeroport.campanile.com/en-us/

It is close to the Airport and to the Embedded Recipes venue.

The meeting room can hold up to 30 people and I will provide video conferencing support, just like last year. The location and the meeting room was quite nice last year, so I saw no need to change it.

That said, in-person participation is very much preferred. This yearly summit is meant for active media developers to meet face-to-face and to discuss media subsystem issues.

And it is also a good opportunity to talk to each other during the Embedded Recipes conference to discuss topics in a smaller group. But if you are an active media developer and are really not able to attend in person, then remote participation is an option.

If you want to attend the meeting (either in person or remote), then send an email to me directly. The deadline for in-person attendance is May 14 as the hotel needs to know the final number of attendees by then.

There is no registration fee, the meeting room is sponsored by Cisco and Collabora, and the lunch is sponsored by Ideas on Board! Many thanks to our sponsors, it's very much appreciated.

If you have a topic that you want to discuss, just 'Reply All' to this announcement and give the topic title, a short description and a guesstimate of the time you need for your topic.

See last year's Media Summit Report as an example of what to expect:

https://lore.kernel.org/linux-media/[email protected]/

Regards,

Hans

PS: Be aware that May 24 and 25 are public holidays in France. So many shops may be
closed those days.

In-person attendees:
Sakari Ailus <[email protected]> Kieran Bingham <[email protected]> Brandon Brnich <[email protected]>
Rouven Czerwinski <[email protected]> Mehdi Djait <[email protected]> Bryan O'Donoghue <[email protected]> Nicolas Dufresne <[email protected]> Marco Felsch <[email protected]>
Paul Kocialkowski <[email protected]>
Jai Luthra <[email protected]> Jacopo Mondi <[email protected]> Benjamin Mugnier <[email protected]> Beleswar Padhi <[email protected]>
Laurent Pinchart <[email protected]> Loic Poulain <[email protected]> Sven Püschel <[email protected]> Ricardo Ribalda <[email protected]> Michael Riesch <[email protected]> Devarsh Thakkar <[email protected]>
Michael Tretter <[email protected]> Hans Verkuil <[email protected]>

Remote attendees:
Yemike Abhilash Chandra <[email protected]> Rishikesh Donadkar <[email protected]>
Jackson Lee <[email protected]>
Dave Stevenson <[email protected]> (tentative)

Agenda (tentative):

8:45-9:20: Arrive, settle in

9:20-9:30: Short intro (Hans Verkuil)

9:30-9:45: Status of ISP support in V4L2
Presenter: Laurent Pinchart
Description: Summary of ISP-related development in V4L2 since the last Linux Media Summit. This includes a brief overview of technical developments, and a summary of the efforts to engage with vendors.

9:45-10:45: V4L2 Stateless Video Encoding uAPI Progress Update
Presenter: Paul Kocialkowski
Description: An update on the ongonig work to support stateless codecs in V4L2. Some of the remaining open topics will be presented and discussed.

10:45-11:00: break

11:00-11:30: Vulkan Video Codecs
Presenter: Nicolas Dufresne
Description: Vulkan video codecs: what are the viable options for Linux Media and what is in preparation outside of our subsystem. The second aspect is informative as these discussions don't seem to lean toward our subsystem as the foundation. But I think it's rather useful for everyone to understand why and what is included.

11:30-12:00: Protected Video playback on i.MX8MQ
Presenter: Rouven Czerwinski
Description: Introduction to protected video playback
on i.MX8MQ and missing bits for linux-media & protected heap interoperability.

12:00-13:30: Lunch

13:30-14:00: HDCP support for HDMI receivers
Presenter: Hans Verkuil
Description: I have been working on adding HDCP support for HDMI receivers. Specifically the HDCP negotiation between sources and sinks.

14:00-14:30: AI patches
Presenter: Sakari Ailus
Description: What is our policy w.r.t. AI generated patches?

14:30-15:00 Overview of Media CI: where do pipelines run?
Presenter: Ricardo Ribalda
Description: How are jobs in pipelines assigned? How does the infrastructure for Media CI work? Are there things that can be tweaked to make it more reliable?

15:00-15:15: Break

15:15-16:15: Discussion of the media subsystem development process
Presenter: Hans Verkuil
Description: Review of the multi-committer model: current status and next steps. Are there any bottlenecks, any ideas for improvements, w.r.t. the development process?

As you can see, there is still some available time for other topics.

Signature · 3 lines
Regards,

Laurent Pinchart
#13 lore raw
Quoted 54 lines · Laurent Pinchart
Quoted 52 lines · Michael Riesch
Quoted 9 lines · Ricardo Ribalda
Quoted 8 lines · Hans Verkuil
Quoted 7 lines · Laurent Pinchart
Quoted 6 lines · Nicolas Dufresne
Quoted 5 lines · Laurent Pinchart
Quoted 4 lines · Loic Poulain

Hi Hans,

I would be happy to discuss this if a slot is available:

Quoted 13 lines
Quoted 5 lines
Quoted 5 lines
Quoted 5 lines
Quoted 5 lines
Quoted 5 lines

Title: Generic V4L2 ISP M2M framework
Presenter: Loic Poulain
Time estimate: ~20min
Description: During early development of a Qualcomm Offline Image Processing Engine (OPE), we relied on the V4L2 memory‑to‑memory

Quoted 8 lines
Quoted 8 lines
Quoted 8 lines
Quoted 8 lines
Quoted 8 lines

(v4l2‑m2m) framework, which is widely used and provides solid support for buffer management and scheduling. However, applying it to an ISP use case exposes limitations: ISP engines often require a richer media graph, with multiple pads and metadata flows, similar to inline ISP pipelines (params, stats, outputs). This talk proposes discussing the need for and design of a common V4L2 ISP M2M framework to factor out shared functionality across drivers, particularly around buffer/queue management and job scheduling.

It seems that we share some pain points.. :-) :-/

Over the last year, some ideas have been brewing in my mind. Not necessarily *my* ideas, mind you, rather ideas that have been around in linux-media for quite a while, actually. What I would like to prepare for the Media Summit goes along the same lines.

Quoted 21 lines
Quoted 20 lines
Quoted 14 lines
Quoted 7 lines
Quoted 6 lines

That's well aligned with the v4l2-isp framework that Jacopo started, and to the multi-context and media-jobs APIs that we have proposed. I wonder, however, if a short session at the media summit will be enough, or if we should try to organize a half day brainstorming workshop at some point. Depending on when the people interested in this topic plan to arrive, Monday could be an option.

Quoted 6 lines

I'm also/still interested in the multi-context for m2m decoders that have inline post-processing capabilities (current model forces us to waste a lot of RAM). We just restarted some design discussion with the team, with an increased confidence that multi-context is the way. The scheduler could come handy in the future if we get to deal with more multi-stage codecs in the future. I'll be in Nice all day Monday.

Quoted 3 lines

I will unfortunately be available only until 15:00 on Monday, but Jacopo should be available through the day. Let's see who would be interested and available, and try to organize something.

I'm available on Monday as well. I think this is a topic that is well suited to a brainstorm session.

Quoted 6 lines
Quoted 6 lines
Quoted 1 line

I am also available on Monday and would like to attend the session.

I'd be interested too. Right now the plan is to arrive on Monday afternoon. Depending on what time you agree on it may work out anyway. It would be great to know the exact time this session will start (as I might need to adjust my travel arrangements).

I can arrive on Monday, with a preference for the afternoon.

Quoted 23 lines

We need a volunteer to organize this, as in finding and booking a meeting space. Note that Monday is a public holiday in France (Monday the 25th of May in particular, not all Mondays).

If the number of attendees was small I was thinking of hosting the event in the place where the Ideas on Board team will be staying, but it looks like we're already reaching a fair number of people.

Quoted 6 lines
Quoted 5 lines

Regards!

Quoted 3 lines

The agenda for the media summit is getting quite full, and I agree with Laurent that 20 minutes is likely not enough. If we can so a session on Monday instead, then that would be a good solution.

Quoted 7 lines

Apart from the time and date the scope of this session would be interesting.

Will this be a birds of a feather session in which the next generation kernel ISP framework will be discussed? Or even the next generation kernel video processing framework, where video processing is image signal processing, encoding/decoding, 2D graphics processing (fisheye correction units, 2D GPU such as the Rockchip RGA3, ...)?

Quoted 13 lines

I would focus on Loic's original scope. If the solution can be used for other devices that's great too. I believe that the current multi-context patch series is a good fit for codecs. If we broaden the scope too much right away we'll achieve nothing.

Quoted 8 lines
Quoted 8 lines
Quoted 8 lines

I have never been very enthusiastic about the m2m framework: it's fine for e.g. simple scalers, but it's awkward to use for codecs let alone ISPs.

I always felt that we really need variants of the m2m framework that are customized to specific use-cases: i.e. a codec m2m framework, and (perhaps) an ISP m2m framework.

The big problem with that is of course who will do the work. Making new frameworks is difficult and takes a long time.

A couple of weeks ago, I submitted an initial driver for a Qualcomm Offline ISP based on the standard v4l2-m2m framework. Following discussions around which parts could be generalized, I started migrating this work to a new v4l2-isp-m2m framework:
(https://github.com/loicpoulain/linux/commit/5d575d7eff8f2371e91d8237148ffdb44b0af5b0).

The API and overall logic closely mirror v4l2-m2m.c, but are extended to address ISP‑specific requirements such as multi‑device support and multiple queue handling. I am planning to submit this work as an RFC before the Media Summit. At this stage, the framework is still fairly basic and primarily tailored to the Qualcomm use case. There is definitely room for improvement, for example, integrating Jacopo’s multi‑context support, since for now, the Qualcomm driver simply instantiates a single ISP‑M2M context.

As I am still getting familiar with the media subsystem, this work may overlap with or conflict with ongoing efforts. Synchronizing seems indeed important. Based on my current understanding, there are several related areas of work that appear either complementary or orthogonal:
- Multi‑context support, to instantiate multiple processing sessions on shared hardware/driver.
- Media jobs, to synchronize work across multiple drivers within the same media pipeline.
- ISP M2M, aiming to provide a v4l2-m2m‑like framework specifically for memory‑to‑memory ISP devices.

Quoted 143 lines
Quoted 143 lines

This may be naive and overly optimistic, but I feel there is quite a number of people sharing the same pain points (which are similar to those Loic pointed out). Maybe (hopefully) this birds of a feather session leads to the formation of some work group?

Quoted 137 lines
Quoted 137 lines
Quoted 137 lines
Quoted 137 lines
Quoted 137 lines
Quoted 137 lines · Hans Verkuil
Quoted 136 lines

(Please pass this on to anyone you think might be interested in this!)

Hi all,

This is the fourth version of this announcement, updating the list of attendees and the tentative agenda at the end: please let me know if you see mistakes. Note that there is still time for one or two other topics. Also please check the agenda if you need more (or perhaps less) time for your topic.

This year's Media Summit will be held on Tuesday May 26th the day before the Embedded Recipes Conference in Nice, France:

https://embedded-recipes.org/2026/

The Media Summit will be held at Hotel Campanile and in the same meeting room as last year (Nikaia):

https://nice-aeroport.campanile.com/en-us/

It is close to the Airport and to the Embedded Recipes venue.

The meeting room can hold up to 30 people and I will provide video conferencing support, just like last year. The location and the meeting room was quite nice last year, so I saw no need to change it.

That said, in-person participation is very much preferred. This yearly summit is meant for active media developers to meet face-to-face and to discuss media subsystem issues.

And it is also a good opportunity to talk to each other during the Embedded Recipes conference to discuss topics in a smaller group. But if you are an active media developer and are really not able to attend in person, then remote participation is an option.

If you want to attend the meeting (either in person or remote), then send an email to me directly. The deadline for in-person attendance is May 14 as the hotel needs to know the final number of attendees by then.

There is no registration fee, the meeting room is sponsored by Cisco and Collabora, and the lunch is sponsored by Ideas on Board! Many thanks to our sponsors, it's very much appreciated.

If you have a topic that you want to discuss, just 'Reply All' to this announcement and give the topic title, a short description and a guesstimate of the time you need for your topic.

See last year's Media Summit Report as an example of what to expect:

https://lore.kernel.org/linux-media/[email protected]/

Regards,

Hans

PS: Be aware that May 24 and 25 are public holidays in France. So many shops may be
closed those days.

In-person attendees:
Sakari Ailus <[email protected]> Kieran Bingham <[email protected]> Brandon Brnich <[email protected]>
Rouven Czerwinski <[email protected]> Mehdi Djait <[email protected]> Bryan O'Donoghue <[email protected]> Nicolas Dufresne <[email protected]> Marco Felsch <[email protected]>
Paul Kocialkowski <[email protected]>
Jai Luthra <[email protected]> Jacopo Mondi <[email protected]> Benjamin Mugnier <[email protected]> Beleswar Padhi <[email protected]>
Laurent Pinchart <[email protected]> Loic Poulain <[email protected]> Sven Püschel <[email protected]> Ricardo Ribalda <[email protected]> Michael Riesch <[email protected]> Devarsh Thakkar <[email protected]>
Michael Tretter <[email protected]> Hans Verkuil <[email protected]>

Remote attendees:
Yemike Abhilash Chandra <[email protected]> Rishikesh Donadkar <[email protected]>
Jackson Lee <[email protected]>
Dave Stevenson <[email protected]> (tentative)

Agenda (tentative):

8:45-9:20: Arrive, settle in

9:20-9:30: Short intro (Hans Verkuil)

9:30-9:45: Status of ISP support in V4L2
Presenter: Laurent Pinchart
Description: Summary of ISP-related development in V4L2 since the last Linux Media Summit. This includes a brief overview of technical developments, and a summary of the efforts to engage with vendors.

9:45-10:45: V4L2 Stateless Video Encoding uAPI Progress Update
Presenter: Paul Kocialkowski
Description: An update on the ongonig work to support stateless codecs in V4L2. Some of the remaining open topics will be presented and discussed.

10:45-11:00: break

11:00-11:30: Vulkan Video Codecs
Presenter: Nicolas Dufresne
Description: Vulkan video codecs: what are the viable options for Linux Media and what is in preparation outside of our subsystem. The second aspect is informative as these discussions don't seem to lean toward our subsystem as the foundation. But I think it's rather useful for everyone to understand why and what is included.

11:30-12:00: Protected Video playback on i.MX8MQ
Presenter: Rouven Czerwinski
Description: Introduction to protected video playback
on i.MX8MQ and missing bits for linux-media & protected heap interoperability.

12:00-13:30: Lunch

13:30-14:00: HDCP support for HDMI receivers
Presenter: Hans Verkuil
Description: I have been working on adding HDCP support for HDMI receivers. Specifically the HDCP negotiation between sources and sinks.

14:00-14:30: AI patches
Presenter: Sakari Ailus
Description: What is our policy w.r.t. AI generated patches?

14:30-15:00 Overview of Media CI: where do pipelines run?
Presenter: Ricardo Ribalda
Description: How are jobs in pipelines assigned? How does the infrastructure for Media CI work? Are there things that can be tweaked to make it more reliable?

Quoted 8 lines
Quoted 8 lines
Quoted 8 lines
Quoted 8 lines
Quoted 8 lines
Quoted 8 lines
Quoted 8 lines
Quoted 8 lines
Quoted 8 lines

15:00-15:15: Break

15:15-16:15: Discussion of the media subsystem development process
Presenter: Hans Verkuil
Description: Review of the multi-committer model: current status and next steps. Are there any bottlenecks, any ideas for improvements, w.r.t. the development process?

As you can see, there is still some available time for other topics.

Regards,
Loic

#14 lore raw
Quoted 96 lines · Loic Poulain
Quoted 53 lines · Laurent Pinchart
Quoted 52 lines · Michael Riesch
Quoted 9 lines · Ricardo Ribalda
Quoted 8 lines · Hans Verkuil
Quoted 7 lines · Laurent Pinchart
Quoted 6 lines · Nicolas Dufresne
Quoted 5 lines · Laurent Pinchart
Quoted 4 lines · Loic Poulain

Hi Hans,

I would be happy to discuss this if a slot is available:

Quoted 13 lines
Quoted 5 lines
Quoted 5 lines
Quoted 5 lines
Quoted 5 lines
Quoted 5 lines

Title: Generic V4L2 ISP M2M framework
Presenter: Loic Poulain
Time estimate: ~20min
Description: During early development of a Qualcomm Offline Image Processing Engine (OPE), we relied on the V4L2 memory‑to‑memory

Quoted 8 lines
Quoted 8 lines
Quoted 8 lines
Quoted 8 lines
Quoted 8 lines

(v4l2‑m2m) framework, which is widely used and provides solid support for buffer management and scheduling. However, applying it to an ISP use case exposes limitations: ISP engines often require a richer media graph, with multiple pads and metadata flows, similar to inline ISP pipelines (params, stats, outputs). This talk proposes discussing the need for and design of a common V4L2 ISP M2M framework to factor out shared functionality across drivers, particularly around buffer/queue management and job scheduling.

It seems that we share some pain points.. :-) :-/

Over the last year, some ideas have been brewing in my mind. Not necessarily *my* ideas, mind you, rather ideas that have been around in linux-media for quite a while, actually. What I would like to prepare for the Media Summit goes along the same lines.

Quoted 21 lines
Quoted 20 lines
Quoted 14 lines
Quoted 7 lines
Quoted 6 lines

That's well aligned with the v4l2-isp framework that Jacopo started, and to the multi-context and media-jobs APIs that we have proposed. I wonder, however, if a short session at the media summit will be enough, or if we should try to organize a half day brainstorming workshop at some point. Depending on when the people interested in this topic plan to arrive, Monday could be an option.

Quoted 6 lines

I'm also/still interested in the multi-context for m2m decoders that have inline post-processing capabilities (current model forces us to waste a lot of RAM). We just restarted some design discussion with the team, with an increased confidence that multi-context is the way. The scheduler could come handy in the future if we get to deal with more multi-stage codecs in the future. I'll be in Nice all day Monday.

Quoted 3 lines

I will unfortunately be available only until 15:00 on Monday, but Jacopo should be available through the day. Let's see who would be interested and available, and try to organize something.

I'm available on Monday as well. I think this is a topic that is well suited to a brainstorm session.

Quoted 6 lines
Quoted 6 lines
Quoted 1 line

I am also available on Monday and would like to attend the session.

I'd be interested too. Right now the plan is to arrive on Monday afternoon. Depending on what time you agree on it may work out anyway. It would be great to know the exact time this session will start (as I might need to adjust my travel arrangements).

I can arrive on Monday, with a preference for the afternoon.

Quoted 33 lines

We need a volunteer to organize this, as in finding and booking a meeting space. Note that Monday is a public holiday in France (Monday the 25th of May in particular, not all Mondays).

If the number of attendees was small I was thinking of hosting the event in the place where the Ideas on Board team will be staying, but it looks like we're already reaching a fair number of people.

Quoted 6 lines
Quoted 5 lines

Regards!

Quoted 3 lines

The agenda for the media summit is getting quite full, and I agree with Laurent that 20 minutes is likely not enough. If we can so a session on Monday instead, then that would be a good solution.

Quoted 7 lines

Apart from the time and date the scope of this session would be interesting.

Will this be a birds of a feather session in which the next generation kernel ISP framework will be discussed? Or even the next generation kernel video processing framework, where video processing is image signal processing, encoding/decoding, 2D graphics processing (fisheye correction units, 2D GPU such as the Rockchip RGA3, ...)?

I would focus on Loic's original scope. If the solution can be used for other devices that's great too. I believe that the current multi-context patch series is a good fit for codecs. If we broaden the scope too much right away we'll achieve nothing.

Quoted 6 lines
Quoted 6 lines
Quoted 6 lines

I have never been very enthusiastic about the m2m framework: it's fine for e.g. simple scalers, but it's awkward to use for codecs let alone ISPs.

I always felt that we really need variants of the m2m framework that are customized to specific use-cases: i.e. a codec m2m framework, and (perhaps) an ISP m2m framework.

Quoted 8 lines
Quoted 2 lines
Quoted 2 lines
Quoted 2 lines
Quoted 2 lines

The big problem with that is of course who will do the work. Making new frameworks is difficult and takes a long time.

A couple of weeks ago, I submitted an initial driver for a Qualcomm Offline ISP based on the standard v4l2-m2m framework. Following discussions around which parts could be generalized, I started migrating this work to a new v4l2-isp-m2m framework:
(https://github.com/loicpoulain/linux/commit/5d575d7eff8f2371e91d8237148ffdb44b0af5b0).

I definitely want to discuss this, but I will be available on Monday until 15:00 only.

Quoted 3 lines

The API and overall logic closely mirror v4l2-m2m.c, but are extended to address ISP‑specific requirements such as multi‑device support and multiple queue handling.

That part I don't like. The V4L2 M2M framework is a big mid-layer that prevents drivers from having control of how operations are handled. It does too much, and doesn't give enough flexibility to drivers. It may have been fine when the framework was designed, for the devices we had back then, but today it's just painful. I want to turn this around and give control to the drivers, with helpers they can use to implement parts that are not driver-specific. This needs to be opt-in, not a layer that takes completely control between the uAPI and driver operations.

Let's not reproduce the design mistakes made in the V4L2 M2M framework.

I also think you need to decouple the context handling and scheduling in two separate components. They need to work together, but shouldn't be bundled into a monolithic system. Very importantly, a driver should be able to implement contexts with the multi-context helpers, and implement custom scheduling itself.

Quoted 168 lines

I am planning to submit this work as an RFC
before the Media Summit. At this stage, the framework is still fairly basic and primarily tailored to the Qualcomm use case. There is definitely room for improvement, for example, integrating Jacopo’s multi‑context support, since for now, the Qualcomm driver simply instantiates a single ISP‑M2M context.

As I am still getting familiar with the media subsystem, this work may overlap with or conflict with ongoing efforts. Synchronizing seems indeed important. Based on my current understanding, there are several related areas of work that appear either complementary or orthogonal:
- Multi‑context support, to instantiate multiple processing sessions on shared hardware/driver.
- Media jobs, to synchronize work across multiple drivers within the same media pipeline.
- ISP M2M, aiming to provide a v4l2-m2m‑like framework specifically for memory‑to‑memory ISP devices.

Quoted 150 lines
Quoted 150 lines

This may be naive and overly optimistic, but I feel there is quite a number of people sharing the same pain points (which are similar to those Loic pointed out). Maybe (hopefully) this birds of a feather session leads to the formation of some work group?

Quoted 145 lines
Quoted 145 lines
Quoted 145 lines
Quoted 145 lines
Quoted 145 lines
Quoted 145 lines · Hans Verkuil
Quoted 144 lines

(Please pass this on to anyone you think might be interested in this!)

Hi all,

This is the fourth version of this announcement, updating the list of attendees and the tentative agenda at the end: please let me know if you see mistakes. Note that there is still time for one or two other topics. Also please check the agenda if you need more (or perhaps less) time for your topic.

This year's Media Summit will be held on Tuesday May 26th the day before the Embedded Recipes Conference in Nice, France:

https://embedded-recipes.org/2026/

The Media Summit will be held at Hotel Campanile and in the same meeting room as last year (Nikaia):

https://nice-aeroport.campanile.com/en-us/

It is close to the Airport and to the Embedded Recipes venue.

The meeting room can hold up to 30 people and I will provide video conferencing support, just like last year. The location and the meeting room was quite nice last year, so I saw no need to change it.

That said, in-person participation is very much preferred. This yearly summit is meant for active media developers to meet face-to-face and to discuss media subsystem issues.

And it is also a good opportunity to talk to each other during the Embedded Recipes conference to discuss topics in a smaller group. But if you are an active media developer and are really not able to attend in person, then remote participation is an option.

If you want to attend the meeting (either in person or remote), then send an email to me directly. The deadline for in-person attendance is May 14 as the hotel needs to know the final number of attendees by then.

There is no registration fee, the meeting room is sponsored by Cisco and Collabora, and the lunch is sponsored by Ideas on Board! Many thanks to our sponsors, it's very much appreciated.

If you have a topic that you want to discuss, just 'Reply All' to this announcement and give the topic title, a short description and a guesstimate of the time you need for your topic.

See last year's Media Summit Report as an example of what to expect:

https://lore.kernel.org/linux-media/[email protected]/

Regards,

Hans

PS: Be aware that May 24 and 25 are public holidays in France. So many shops may be
closed those days.

In-person attendees:
Sakari Ailus <[email protected]> Kieran Bingham <[email protected]> Brandon Brnich <[email protected]>
Rouven Czerwinski <[email protected]> Mehdi Djait <[email protected]> Bryan O'Donoghue <[email protected]> Nicolas Dufresne <[email protected]> Marco Felsch <[email protected]>
Paul Kocialkowski <[email protected]>
Jai Luthra <[email protected]> Jacopo Mondi <[email protected]> Benjamin Mugnier <[email protected]> Beleswar Padhi <[email protected]>
Laurent Pinchart <[email protected]> Loic Poulain <[email protected]> Sven Püschel <[email protected]> Ricardo Ribalda <[email protected]> Michael Riesch <[email protected]> Devarsh Thakkar <[email protected]>
Michael Tretter <[email protected]> Hans Verkuil <[email protected]>

Remote attendees:
Yemike Abhilash Chandra <[email protected]> Rishikesh Donadkar <[email protected]>
Jackson Lee <[email protected]>
Dave Stevenson <[email protected]> (tentative)

Agenda (tentative):

8:45-9:20: Arrive, settle in

9:20-9:30: Short intro (Hans Verkuil)

9:30-9:45: Status of ISP support in V4L2
Presenter: Laurent Pinchart
Description: Summary of ISP-related development in V4L2 since the last Linux Media Summit. This includes a brief overview of technical developments, and a summary of the efforts to engage with vendors.

9:45-10:45: V4L2 Stateless Video Encoding uAPI Progress Update
Presenter: Paul Kocialkowski
Description: An update on the ongonig work to support stateless codecs in V4L2. Some of the remaining open topics will be presented and discussed.

10:45-11:00: break

11:00-11:30: Vulkan Video Codecs
Presenter: Nicolas Dufresne
Description: Vulkan video codecs: what are the viable options for Linux Media and what is in preparation outside of our subsystem. The second aspect is informative as these discussions don't seem to lean toward our subsystem as the foundation. But I think it's rather useful for everyone to understand why and what is included.

11:30-12:00: Protected Video playback on i.MX8MQ
Presenter: Rouven Czerwinski
Description: Introduction to protected video playback
on i.MX8MQ and missing bits for linux-media & protected heap interoperability.

12:00-13:30: Lunch

13:30-14:00: HDCP support for HDMI receivers
Presenter: Hans Verkuil
Description: I have been working on adding HDCP support for HDMI receivers. Specifically the HDCP negotiation between sources and sinks.

14:00-14:30: AI patches
Presenter: Sakari Ailus
Description: What is our policy w.r.t. AI generated patches?

14:30-15:00 Overview of Media CI: where do pipelines run?
Presenter: Ricardo Ribalda
Description: How are jobs in pipelines assigned? How does the infrastructure for Media CI work? Are there things that can be tweaked to make it more reliable?

15:00-15:15: Break

15:15-16:15: Discussion of the media subsystem development process
Presenter: Hans Verkuil
Description: Review of the multi-committer model: current status and next steps. Are there any bottlenecks, any ideas for improvements, w.r.t. the development process?

As you can see, there is still some available time for other topics.

Signature · 3 lines
Regards,

Laurent Pinchart
#15 lore raw

Hey,

Le mardi 14 avril 2026 à 11:42 +0300, Laurent Pinchart a écrit :

Quoted 7 lines

Let's not reproduce the design mistakes made in the V4L2 M2M framework.

I also think you need to decouple the context handling and scheduling in two separate components. They need to work together, but shouldn't be bundled into a monolithic system. Very importantly, a driver should be able to implement contexts with the multi-context helpers, and implement custom scheduling itself.

Note that the v4l2_m2m_dev is juts miss-named, it does not wrap a specific dev instance anymore. I'll rename and clean that up eventually, but I agree its not meant for your purpose, and it will be a good fight to use. Its already a pretty big miss-fit for stateful codec, which don't really have the notion of "active central job". Jacopo's proposal is to have multi-context MC (as you already know), making the media device as the central source of context, so I think that's a path in the right direction.

But I'll be honest, I would see a future where we actually drop (or break down into pieces) VB2, which is I read you well, its not miss-aligned with your say.

Nicolas

#16 lore raw
Quoted 19 lines · Nicolas Dufresne

Hey,

Le mardi 14 avril 2026 à 11:42 +0300, Laurent Pinchart a écrit :

Quoted 7 lines

Let's not reproduce the design mistakes made in the V4L2 M2M framework.

I also think you need to decouple the context handling and scheduling in two separate components. They need to work together, but shouldn't be bundled into a monolithic system. Very importantly, a driver should be able to implement contexts with the multi-context helpers, and implement custom scheduling itself.

Note that the v4l2_m2m_dev is juts miss-named, it does not wrap a specific dev instance anymore. I'll rename and clean that up eventually, but I agree its not meant for your purpose, and it will be a good fight to use. Its already a pretty big miss-fit for stateful codec, which don't really have the notion of "active central job". Jacopo's proposal is to have multi-context MC (as you already know), making the media device as the central source of context, so I think that's a path in the right direction.

Quoted 2 lines

But I'll be honest, I would see a future where we actually drop (or break down into pieces) VB2, which is I read you well, its not miss-aligned with your say.

I won't object :-) vb2 was designed as a midlayer, and that causes headaches (I'm thinking in particular about how .start_streaming() is delayed until buffers get queued). I have less issues with vb2 than with the M2M midlayer, as vb2 gets less in the way, but I think we should overall favour for new developments smaller helpers that drivers can assemble based on their needs over monolithic midlayers.

Signature · 3 lines
Regards,

Laurent Pinchart
#17 lore raw
In reply to Laurent Pinchart
Quoted 101 lines · Laurent Pinchart
Quoted 99 lines · Loic Poulain
Quoted 53 lines · Laurent Pinchart
Quoted 52 lines · Michael Riesch
Quoted 9 lines · Ricardo Ribalda
Quoted 8 lines · Hans Verkuil
Quoted 7 lines · Laurent Pinchart
Quoted 6 lines · Nicolas Dufresne
Quoted 5 lines · Laurent Pinchart
Quoted 4 lines · Loic Poulain

Hi Hans,

I would be happy to discuss this if a slot is available:

Quoted 13 lines
Quoted 5 lines
Quoted 5 lines
Quoted 5 lines
Quoted 5 lines
Quoted 5 lines

Title: Generic V4L2 ISP M2M framework
Presenter: Loic Poulain
Time estimate: ~20min
Description: During early development of a Qualcomm Offline Image Processing Engine (OPE), we relied on the V4L2 memory‑to‑memory

Quoted 8 lines
Quoted 8 lines
Quoted 8 lines
Quoted 8 lines
Quoted 8 lines

(v4l2‑m2m) framework, which is widely used and provides solid support for buffer management and scheduling. However, applying it to an ISP use case exposes limitations: ISP engines often require a richer media graph, with multiple pads and metadata flows, similar to inline ISP pipelines (params, stats, outputs). This talk proposes discussing the need for and design of a common V4L2 ISP M2M framework to factor out shared functionality across drivers, particularly around buffer/queue management and job scheduling.

It seems that we share some pain points.. :-) :-/

Over the last year, some ideas have been brewing in my mind. Not necessarily *my* ideas, mind you, rather ideas that have been around in linux-media for quite a while, actually. What I would like to prepare for the Media Summit goes along the same lines.

Quoted 21 lines
Quoted 20 lines
Quoted 14 lines
Quoted 7 lines
Quoted 6 lines

That's well aligned with the v4l2-isp framework that Jacopo started, and to the multi-context and media-jobs APIs that we have proposed. I wonder, however, if a short session at the media summit will be enough, or if we should try to organize a half day brainstorming workshop at some point. Depending on when the people interested in this topic plan to arrive, Monday could be an option.

Quoted 6 lines

I'm also/still interested in the multi-context for m2m decoders that have inline post-processing capabilities (current model forces us to waste a lot of RAM). We just restarted some design discussion with the team, with an increased confidence that multi-context is the way. The scheduler could come handy in the future if we get to deal with more multi-stage codecs in the future. I'll be in Nice all day Monday.

Quoted 3 lines

I will unfortunately be available only until 15:00 on Monday, but Jacopo should be available through the day. Let's see who would be interested and available, and try to organize something.

I'm available on Monday as well. I think this is a topic that is well suited to a brainstorm session.

Quoted 6 lines
Quoted 6 lines
Quoted 1 line

I am also available on Monday and would like to attend the session.

I'd be interested too. Right now the plan is to arrive on Monday afternoon. Depending on what time you agree on it may work out anyway. It would be great to know the exact time this session will start (as I might need to adjust my travel arrangements).

I can arrive on Monday, with a preference for the afternoon.

Quoted 35 lines

We need a volunteer to organize this, as in finding and booking a meeting space. Note that Monday is a public holiday in France (Monday the 25th of May in particular, not all Mondays).

If the number of attendees was small I was thinking of hosting the event in the place where the Ideas on Board team will be staying, but it looks like we're already reaching a fair number of people.

Quoted 6 lines
Quoted 5 lines

Regards!

Quoted 3 lines

The agenda for the media summit is getting quite full, and I agree with Laurent that 20 minutes is likely not enough. If we can so a session on Monday instead, then that would be a good solution.

Quoted 7 lines

Apart from the time and date the scope of this session would be interesting.

Will this be a birds of a feather session in which the next generation kernel ISP framework will be discussed? Or even the next generation kernel video processing framework, where video processing is image signal processing, encoding/decoding, 2D graphics processing (fisheye correction units, 2D GPU such as the Rockchip RGA3, ...)?

I would focus on Loic's original scope. If the solution can be used for other devices that's great too. I believe that the current multi-context patch series is a good fit for codecs. If we broaden the scope too much right away we'll achieve nothing.

Quoted 8 lines
Quoted 8 lines
Quoted 8 lines

I have never been very enthusiastic about the m2m framework: it's fine for e.g. simple scalers, but it's awkward to use for codecs let alone ISPs.

I always felt that we really need variants of the m2m framework that are customized to specific use-cases: i.e. a codec m2m framework, and (perhaps) an ISP m2m framework.

The big problem with that is of course who will do the work. Making new frameworks is difficult and takes a long time.

Quoted 8 lines
Quoted 5 lines

A couple of weeks ago, I submitted an initial driver for a Qualcomm Offline ISP based on the standard v4l2-m2m framework. Following discussions around which parts could be generalized, I started migrating this work to a new v4l2-isp-m2m framework:
(https://github.com/loicpoulain/linux/commit/5d575d7eff8f2371e91d8237148ffdb44b0af5b0).

I definitely want to discuss this, but I will be available on Monday until 15:00 only.

I think I can arrange to arrive in the morning if 10am works.

Quoted 14 lines
Quoted 4 lines

The API and overall logic closely mirror v4l2-m2m.c, but are extended to address ISP‑specific requirements such as multi‑device support and multiple queue handling.

That part I don't like. The V4L2 M2M framework is a big mid-layer that prevents drivers from having control of how operations are handled. It does too much, and doesn't give enough flexibility to drivers. It may have been fine when the framework was designed, for the devices we had back then, but today it's just painful. I want to turn this around and give control to the drivers, with helpers they can use to implement parts that are not driver-specific. This needs to be opt-in, not a layer that takes completely control between the uAPI and driver operations.

Quoted 7 lines

Let's not reproduce the design mistakes made in the V4L2 M2M framework.

I also think you need to decouple the context handling and scheduling in two separate components. They need to work together, but shouldn't be bundled into a monolithic system. Very importantly, a driver should be able to implement contexts with the multi-context helpers, and implement custom scheduling itself.

Understood, thanks for the feedback, these are important points. Decoupling should be straightforward to address, and I will make sure to take Jacopo’s multi‑context work into account as part of the design.

I also need to find the right balance between what can be easily generalized and moved out of the driver, and raising issues or discussions that, while valid, could branch into too many parallel topics and significantly delay integration. I guess this can be addressed in multiple steps: starting with an initial driver, followed by a gradual split and migration toward a common framework, as long as the user‑facing API remains stable (video devices, media graph, etc.).

Quoted 174 lines
Quoted 8 lines

I am planning to submit this work as an RFC
before the Media Summit. At this stage, the framework is still fairly basic and primarily tailored to the Qualcomm use case. There is definitely room for improvement, for example, integrating Jacopo’s multi‑context support, since for now, the Qualcomm driver simply instantiates a single ISP‑M2M context.

Quoted 161 lines

As I am still getting familiar with the media subsystem, this work may overlap with or conflict with ongoing efforts. Synchronizing seems indeed important. Based on my current understanding, there are several related areas of work that appear either complementary or orthogonal:
- Multi‑context support, to instantiate multiple processing sessions on shared hardware/driver.
- Media jobs, to synchronize work across multiple drivers within the same media pipeline.
- ISP M2M, aiming to provide a v4l2-m2m‑like framework specifically for memory‑to‑memory ISP devices.

Quoted 150 lines
Quoted 150 lines

This may be naive and overly optimistic, but I feel there is quite a number of people sharing the same pain points (which are similar to those Loic pointed out). Maybe (hopefully) this birds of a feather session leads to the formation of some work group?

Quoted 145 lines
Quoted 145 lines
Quoted 145 lines
Quoted 145 lines
Quoted 145 lines
Quoted 145 lines · Hans Verkuil
Quoted 144 lines

(Please pass this on to anyone you think might be interested in this!)

Hi all,

This is the fourth version of this announcement, updating the list of attendees and the tentative agenda at the end: please let me know if you see mistakes. Note that there is still time for one or two other topics. Also please check the agenda if you need more (or perhaps less) time for your topic.

This year's Media Summit will be held on Tuesday May 26th the day before the Embedded Recipes Conference in Nice, France:

https://embedded-recipes.org/2026/

The Media Summit will be held at Hotel Campanile and in the same meeting room as last year (Nikaia):

https://nice-aeroport.campanile.com/en-us/

It is close to the Airport and to the Embedded Recipes venue.

The meeting room can hold up to 30 people and I will provide video conferencing support, just like last year. The location and the meeting room was quite nice last year, so I saw no need to change it.

That said, in-person participation is very much preferred. This yearly summit is meant for active media developers to meet face-to-face and to discuss media subsystem issues.

And it is also a good opportunity to talk to each other during the Embedded Recipes conference to discuss topics in a smaller group. But if you are an active media developer and are really not able to attend in person, then remote participation is an option.

If you want to attend the meeting (either in person or remote), then send an email to me directly. The deadline for in-person attendance is May 14 as the hotel needs to know the final number of attendees by then.

There is no registration fee, the meeting room is sponsored by Cisco and Collabora, and the lunch is sponsored by Ideas on Board! Many thanks to our sponsors, it's very much appreciated.

If you have a topic that you want to discuss, just 'Reply All' to this announcement and give the topic title, a short description and a guesstimate of the time you need for your topic.

See last year's Media Summit Report as an example of what to expect:

https://lore.kernel.org/linux-media/[email protected]/

Regards,

Hans

PS: Be aware that May 24 and 25 are public holidays in France. So many shops may be
closed those days.

In-person attendees:
Sakari Ailus <[email protected]> Kieran Bingham <[email protected]> Brandon Brnich <[email protected]>
Rouven Czerwinski <[email protected]> Mehdi Djait <[email protected]> Bryan O'Donoghue <[email protected]> Nicolas Dufresne <[email protected]> Marco Felsch <[email protected]>
Paul Kocialkowski <[email protected]>
Jai Luthra <[email protected]> Jacopo Mondi <[email protected]> Benjamin Mugnier <[email protected]> Beleswar Padhi <[email protected]>
Laurent Pinchart <[email protected]> Loic Poulain <[email protected]> Sven Püschel <[email protected]> Ricardo Ribalda <[email protected]> Michael Riesch <[email protected]> Devarsh Thakkar <[email protected]>
Michael Tretter <[email protected]> Hans Verkuil <[email protected]>

Remote attendees:
Yemike Abhilash Chandra <[email protected]> Rishikesh Donadkar <[email protected]>
Jackson Lee <[email protected]>
Dave Stevenson <[email protected]> (tentative)

Agenda (tentative):

8:45-9:20: Arrive, settle in

9:20-9:30: Short intro (Hans Verkuil)

9:30-9:45: Status of ISP support in V4L2
Presenter: Laurent Pinchart
Description: Summary of ISP-related development in V4L2 since the last Linux Media Summit. This includes a brief overview of technical developments, and a summary of the efforts to engage with vendors.

9:45-10:45: V4L2 Stateless Video Encoding uAPI Progress Update
Presenter: Paul Kocialkowski
Description: An update on the ongonig work to support stateless codecs in V4L2. Some of the remaining open topics will be presented and discussed.

10:45-11:00: break

11:00-11:30: Vulkan Video Codecs
Presenter: Nicolas Dufresne
Description: Vulkan video codecs: what are the viable options for Linux Media and what is in preparation outside of our subsystem. The second aspect is informative as these discussions don't seem to lean toward our subsystem as the foundation. But I think it's rather useful for everyone to understand why and what is included.

11:30-12:00: Protected Video playback on i.MX8MQ
Presenter: Rouven Czerwinski
Description: Introduction to protected video playback
on i.MX8MQ and missing bits for linux-media & protected heap interoperability.

12:00-13:30: Lunch

13:30-14:00: HDCP support for HDMI receivers
Presenter: Hans Verkuil
Description: I have been working on adding HDCP support for HDMI receivers. Specifically the HDCP negotiation between sources and sinks.

14:00-14:30: AI patches
Presenter: Sakari Ailus
Description: What is our policy w.r.t. AI generated patches?

14:30-15:00 Overview of Media CI: where do pipelines run?
Presenter: Ricardo Ribalda
Description: How are jobs in pipelines assigned? How does the infrastructure for Media CI work? Are there things that can be tweaked to make it more reliable?

15:00-15:15: Break

15:15-16:15: Discussion of the media subsystem development process
Presenter: Hans Verkuil
Description: Review of the multi-committer model: current status and next steps. Are there any bottlenecks, any ideas for improvements, w.r.t. the development process?

As you can see, there is still some available time for other topics.

--
Regards,

Laurent Pinchart

#18 lore raw
In reply to Laurent Pinchart

Hello

Quoted 64 lines · Laurent Pinchart
Quoted 63 lines · Loic Poulain
Quoted 53 lines · Laurent Pinchart
Quoted 52 lines · Michael Riesch
Quoted 9 lines · Ricardo Ribalda
Quoted 8 lines · Hans Verkuil
Quoted 7 lines · Laurent Pinchart
Quoted 6 lines · Nicolas Dufresne
Quoted 5 lines · Laurent Pinchart
Quoted 4 lines · Loic Poulain

Hi Hans,

I would be happy to discuss this if a slot is available:

Quoted 13 lines
Quoted 5 lines
Quoted 5 lines
Quoted 5 lines
Quoted 5 lines
Quoted 5 lines

Title: Generic V4L2 ISP M2M framework
Presenter: Loic Poulain
Time estimate: ~20min
Description: During early development of a Qualcomm Offline Image Processing Engine (OPE), we relied on the V4L2 memory‑to‑memory

Quoted 8 lines
Quoted 8 lines
Quoted 8 lines
Quoted 8 lines
Quoted 8 lines

(v4l2‑m2m) framework, which is widely used and provides solid support for buffer management and scheduling. However, applying it to an ISP use case exposes limitations: ISP engines often require a richer media graph, with multiple pads and metadata flows, similar to inline ISP pipelines (params, stats, outputs). This talk proposes discussing the need for and design of a common V4L2 ISP M2M framework to factor out shared functionality across drivers, particularly around buffer/queue management and job scheduling.

It seems that we share some pain points.. :-) :-/

Over the last year, some ideas have been brewing in my mind. Not necessarily *my* ideas, mind you, rather ideas that have been around in linux-media for quite a while, actually. What I would like to prepare for the Media Summit goes along the same lines.

Quoted 21 lines
Quoted 20 lines
Quoted 14 lines
Quoted 7 lines
Quoted 6 lines

That's well aligned with the v4l2-isp framework that Jacopo started, and to the multi-context and media-jobs APIs that we have proposed. I wonder, however, if a short session at the media summit will be enough, or if we should try to organize a half day brainstorming workshop at some point. Depending on when the people interested in this topic plan to arrive, Monday could be an option.

Quoted 6 lines

I'm also/still interested in the multi-context for m2m decoders that have inline post-processing capabilities (current model forces us to waste a lot of RAM). We just restarted some design discussion with the team, with an increased confidence that multi-context is the way. The scheduler could come handy in the future if we get to deal with more multi-stage codecs in the future. I'll be in Nice all day Monday.

Quoted 3 lines

I will unfortunately be available only until 15:00 on Monday, but Jacopo should be available through the day. Let's see who would be interested and available, and try to organize something.

I'm available on Monday as well. I think this is a topic that is well suited to a brainstorm session.

Quoted 6 lines
Quoted 6 lines
Quoted 1 line

I am also available on Monday and would like to attend the session.

I'd be interested too. Right now the plan is to arrive on Monday afternoon. Depending on what time you agree on it may work out anyway. It would be great to know the exact time this session will start (as I might need to adjust my travel arrangements).

I can arrive on Monday, with a preference for the afternoon.

Quoted 8 lines
Quoted 8 lines
Quoted 8 lines

We need a volunteer to organize this, as in finding and booking a meeting space. Note that Monday is a public holiday in France (Monday the 25th of May in particular, not all Mondays).

If the number of attendees was small I was thinking of hosting the event in the place where the Ideas on Board team will be staying, but it looks like we're already reaching a fair number of people.

Are we still considering this BoF session ?

We would someone to volunteer organizing this, at @IoB we're quite full for the week and we might have an hard time organizing this one on top of the libcamera workshop.

As Laurent said, that Monday is a public holiday in France, and getting a room somewhere might be complicated.

We can host some people in the location where we're having the yearly IoB get-together, but you should arrange your travel there (35 minutes from Nice by car).

If we get a volunteer we can should maybe a dedicated mail thread as this one was about the Media Summit ?

Quoted 231 lines
Quoted 25 lines
Quoted 25 lines
Quoted 6 lines
Quoted 5 lines

Regards!

Quoted 3 lines

The agenda for the media summit is getting quite full, and I agree with Laurent that 20 minutes is likely not enough. If we can so a session on Monday instead, then that would be a good solution.

Quoted 7 lines

Apart from the time and date the scope of this session would be interesting.

Will this be a birds of a feather session in which the next generation kernel ISP framework will be discussed? Or even the next generation kernel video processing framework, where video processing is image signal processing, encoding/decoding, 2D graphics processing (fisheye correction units, 2D GPU such as the Rockchip RGA3, ...)?

I would focus on Loic's original scope. If the solution can be used for other devices that's great too. I believe that the current multi-context patch series is a good fit for codecs. If we broaden the scope too much right away we'll achieve nothing.

Quoted 6 lines
Quoted 6 lines
Quoted 6 lines

I have never been very enthusiastic about the m2m framework: it's fine for e.g. simple scalers, but it's awkward to use for codecs let alone ISPs.

I always felt that we really need variants of the m2m framework that are customized to specific use-cases: i.e. a codec m2m framework, and (perhaps) an ISP m2m framework.

Quoted 8 lines
Quoted 2 lines
Quoted 2 lines
Quoted 2 lines
Quoted 2 lines

The big problem with that is of course who will do the work. Making new frameworks is difficult and takes a long time.

A couple of weeks ago, I submitted an initial driver for a Qualcomm Offline ISP based on the standard v4l2-m2m framework. Following discussions around which parts could be generalized, I started migrating this work to a new v4l2-isp-m2m framework:
(https://github.com/loicpoulain/linux/commit/5d575d7eff8f2371e91d8237148ffdb44b0af5b0).

I definitely want to discuss this, but I will be available on Monday until 15:00 only.

Quoted 3 lines

The API and overall logic closely mirror v4l2-m2m.c, but are extended to address ISP‑specific requirements such as multi‑device support and multiple queue handling.

That part I don't like. The V4L2 M2M framework is a big mid-layer that prevents drivers from having control of how operations are handled. It does too much, and doesn't give enough flexibility to drivers. It may have been fine when the framework was designed, for the devices we had back then, but today it's just painful. I want to turn this around and give control to the drivers, with helpers they can use to implement parts that are not driver-specific. This needs to be opt-in, not a layer that takes completely control between the uAPI and driver operations.

Let's not reproduce the design mistakes made in the V4L2 M2M framework.

I also think you need to decouple the context handling and scheduling in two separate components. They need to work together, but shouldn't be bundled into a monolithic system. Very importantly, a driver should be able to implement contexts with the multi-context helpers, and implement custom scheduling itself.

Quoted 7 lines

I am planning to submit this work as an RFC
before the Media Summit. At this stage, the framework is still fairly basic and primarily tailored to the Qualcomm use case. There is definitely room for improvement, for example, integrating Jacopo’s multi‑context support, since for now, the Qualcomm driver simply instantiates a single ISP‑M2M context.

Quoted 161 lines

As I am still getting familiar with the media subsystem, this work may overlap with or conflict with ongoing efforts. Synchronizing seems indeed important. Based on my current understanding, there are several related areas of work that appear either complementary or orthogonal:
- Multi‑context support, to instantiate multiple processing sessions on shared hardware/driver.
- Media jobs, to synchronize work across multiple drivers within the same media pipeline.
- ISP M2M, aiming to provide a v4l2-m2m‑like framework specifically for memory‑to‑memory ISP devices.

Quoted 150 lines
Quoted 150 lines

This may be naive and overly optimistic, but I feel there is quite a number of people sharing the same pain points (which are similar to those Loic pointed out). Maybe (hopefully) this birds of a feather session leads to the formation of some work group?

Quoted 145 lines
Quoted 145 lines
Quoted 145 lines
Quoted 145 lines
Quoted 145 lines
Quoted 145 lines · Hans Verkuil
Quoted 144 lines

(Please pass this on to anyone you think might be interested in this!)

Hi all,

This is the fourth version of this announcement, updating the list of attendees and the tentative agenda at the end: please let me know if you see mistakes. Note that there is still time for one or two other topics. Also please check the agenda if you need more (or perhaps less) time for your topic.

This year's Media Summit will be held on Tuesday May 26th the day before the Embedded Recipes Conference in Nice, France:

https://embedded-recipes.org/2026/

The Media Summit will be held at Hotel Campanile and in the same meeting room as last year (Nikaia):

https://nice-aeroport.campanile.com/en-us/

It is close to the Airport and to the Embedded Recipes venue.

The meeting room can hold up to 30 people and I will provide video conferencing support, just like last year. The location and the meeting room was quite nice last year, so I saw no need to change it.

That said, in-person participation is very much preferred. This yearly summit is meant for active media developers to meet face-to-face and to discuss media subsystem issues.

And it is also a good opportunity to talk to each other during the Embedded Recipes conference to discuss topics in a smaller group. But if you are an active media developer and are really not able to attend in person, then remote participation is an option.

If you want to attend the meeting (either in person or remote), then send an email to me directly. The deadline for in-person attendance is May 14 as the hotel needs to know the final number of attendees by then.

There is no registration fee, the meeting room is sponsored by Cisco and Collabora, and the lunch is sponsored by Ideas on Board! Many thanks to our sponsors, it's very much appreciated.

If you have a topic that you want to discuss, just 'Reply All' to this announcement and give the topic title, a short description and a guesstimate of the time you need for your topic.

See last year's Media Summit Report as an example of what to expect:

https://lore.kernel.org/linux-media/[email protected]/

Regards,

Hans

PS: Be aware that May 24 and 25 are public holidays in France. So many shops may be
closed those days.

In-person attendees:
Sakari Ailus <[email protected]> Kieran Bingham <[email protected]> Brandon Brnich <[email protected]>
Rouven Czerwinski <[email protected]> Mehdi Djait <[email protected]> Bryan O'Donoghue <[email protected]> Nicolas Dufresne <[email protected]> Marco Felsch <[email protected]>
Paul Kocialkowski <[email protected]>
Jai Luthra <[email protected]> Jacopo Mondi <[email protected]> Benjamin Mugnier <[email protected]> Beleswar Padhi <[email protected]>
Laurent Pinchart <[email protected]> Loic Poulain <[email protected]> Sven Püschel <[email protected]> Ricardo Ribalda <[email protected]> Michael Riesch <[email protected]> Devarsh Thakkar <[email protected]>
Michael Tretter <[email protected]> Hans Verkuil <[email protected]>

Remote attendees:
Yemike Abhilash Chandra <[email protected]> Rishikesh Donadkar <[email protected]>
Jackson Lee <[email protected]>
Dave Stevenson <[email protected]> (tentative)

Agenda (tentative):

8:45-9:20: Arrive, settle in

9:20-9:30: Short intro (Hans Verkuil)

9:30-9:45: Status of ISP support in V4L2
Presenter: Laurent Pinchart
Description: Summary of ISP-related development in V4L2 since the last Linux Media Summit. This includes a brief overview of technical developments, and a summary of the efforts to engage with vendors.

9:45-10:45: V4L2 Stateless Video Encoding uAPI Progress Update
Presenter: Paul Kocialkowski
Description: An update on the ongonig work to support stateless codecs in V4L2. Some of the remaining open topics will be presented and discussed.

10:45-11:00: break

11:00-11:30: Vulkan Video Codecs
Presenter: Nicolas Dufresne
Description: Vulkan video codecs: what are the viable options for Linux Media and what is in preparation outside of our subsystem. The second aspect is informative as these discussions don't seem to lean toward our subsystem as the foundation. But I think it's rather useful for everyone to understand why and what is included.

11:30-12:00: Protected Video playback on i.MX8MQ
Presenter: Rouven Czerwinski
Description: Introduction to protected video playback
on i.MX8MQ and missing bits for linux-media & protected heap interoperability.

12:00-13:30: Lunch

13:30-14:00: HDCP support for HDMI receivers
Presenter: Hans Verkuil
Description: I have been working on adding HDCP support for HDMI receivers. Specifically the HDCP negotiation between sources and sinks.

14:00-14:30: AI patches
Presenter: Sakari Ailus
Description: What is our policy w.r.t. AI generated patches?

14:30-15:00 Overview of Media CI: where do pipelines run?
Presenter: Ricardo Ribalda
Description: How are jobs in pipelines assigned? How does the infrastructure for Media CI work? Are there things that can be tweaked to make it more reliable?

15:00-15:15: Break

15:15-16:15: Discussion of the media subsystem development process
Presenter: Hans Verkuil
Description: Review of the multi-committer model: current status and next steps. Are there any bottlenecks, any ideas for improvements, w.r.t. the development process?

As you can see, there is still some available time for other topics.

--
Regards,

Laurent Pinchart

#19 lore raw
Quoted 85 lines · Jacopo Mondi

Hello

Quoted 64 lines · Laurent Pinchart
Quoted 63 lines · Loic Poulain
Quoted 53 lines · Laurent Pinchart
Quoted 52 lines · Michael Riesch
Quoted 9 lines · Ricardo Ribalda
Quoted 8 lines · Hans Verkuil
Quoted 7 lines · Laurent Pinchart
Quoted 6 lines · Nicolas Dufresne
Quoted 5 lines · Laurent Pinchart
Quoted 4 lines · Loic Poulain

Hi Hans,

I would be happy to discuss this if a slot is available:

Quoted 13 lines
Quoted 5 lines
Quoted 5 lines
Quoted 5 lines
Quoted 5 lines
Quoted 5 lines

Title: Generic V4L2 ISP M2M framework
Presenter: Loic Poulain
Time estimate: ~20min
Description: During early development of a Qualcomm Offline Image Processing Engine (OPE), we relied on the V4L2 memory‑to‑memory

Quoted 8 lines
Quoted 8 lines
Quoted 8 lines
Quoted 8 lines
Quoted 8 lines

(v4l2‑m2m) framework, which is widely used and provides solid support for buffer management and scheduling. However, applying it to an ISP use case exposes limitations: ISP engines often require a richer media graph, with multiple pads and metadata flows, similar to inline ISP pipelines (params, stats, outputs). This talk proposes discussing the need for and design of a common V4L2 ISP M2M framework to factor out shared functionality across drivers, particularly around buffer/queue management and job scheduling.

It seems that we share some pain points.. :-) :-/

Over the last year, some ideas have been brewing in my mind. Not necessarily *my* ideas, mind you, rather ideas that have been around in linux-media for quite a while, actually. What I would like to prepare for the Media Summit goes along the same lines.

Quoted 21 lines
Quoted 20 lines
Quoted 14 lines
Quoted 7 lines
Quoted 6 lines

That's well aligned with the v4l2-isp framework that Jacopo started, and to the multi-context and media-jobs APIs that we have proposed. I wonder, however, if a short session at the media summit will be enough, or if we should try to organize a half day brainstorming workshop at some point. Depending on when the people interested in this topic plan to arrive, Monday could be an option.

Quoted 6 lines

I'm also/still interested in the multi-context for m2m decoders that have inline post-processing capabilities (current model forces us to waste a lot of RAM). We just restarted some design discussion with the team, with an increased confidence that multi-context is the way. The scheduler could come handy in the future if we get to deal with more multi-stage codecs in the future. I'll be in Nice all day Monday.

Quoted 3 lines

I will unfortunately be available only until 15:00 on Monday, but Jacopo should be available through the day. Let's see who would be interested and available, and try to organize something.

I'm available on Monday as well. I think this is a topic that is well suited to a brainstorm session.

Quoted 6 lines
Quoted 6 lines
Quoted 1 line

I am also available on Monday and would like to attend the session.

I'd be interested too. Right now the plan is to arrive on Monday afternoon. Depending on what time you agree on it may work out anyway. It would be great to know the exact time this session will start (as I might need to adjust my travel arrangements).

I can arrive on Monday, with a preference for the afternoon.

Quoted 8 lines
Quoted 8 lines
Quoted 8 lines

We need a volunteer to organize this, as in finding and booking a meeting space. Note that Monday is a public holiday in France (Monday the 25th of May in particular, not all Mondays).

If the number of attendees was small I was thinking of hosting the event in the place where the Ideas on Board team will be staying, but it looks like we're already reaching a fair number of people.

Are we still considering this BoF session ?

We would someone to volunteer organizing this, at @IoB we're quite full for the week and we might have an hard time organizing this one on top of the libcamera workshop.

As Laurent said, that Monday is a public holiday in France, and getting a room somewhere might be complicated.

Quoted 6 lines

We can host some people in the location where we're having the yearly IoB get-together, but you should arrange your travel there (35 minutes from Nice by car).

If we get a volunteer we can should maybe a dedicated mail thread as this one was about the Media Summit ?

If the number of people can be kept low (say <= 6), then it shouldn't be a problem to just find a hotel restaurant or similar, close to the place of the media summit, and just sit together.

Who would be the key people for this? And who are 'nice to have'? :-) I think I probably fit more in the latter category than the first.

Regards,

Hans

Quoted 234 lines
Quoted 233 lines
Quoted 27 lines
Quoted 27 lines
Quoted 8 lines
Quoted 7 lines

Regards!

Quoted 3 lines

The agenda for the media summit is getting quite full, and I agree with Laurent that 20 minutes is likely not enough. If we can so a session on Monday instead, then that would be a good solution.

Quoted 7 lines

Apart from the time and date the scope of this session would be interesting.

Will this be a birds of a feather session in which the next generation kernel ISP framework will be discussed? Or even the next generation kernel video processing framework, where video processing is image signal processing, encoding/decoding, 2D graphics processing (fisheye correction units, 2D GPU such as the Rockchip RGA3, ...)?

I would focus on Loic's original scope. If the solution can be used for other devices that's great too. I believe that the current multi-context patch series is a good fit for codecs. If we broaden the scope too much right away we'll achieve nothing.

Quoted 6 lines
Quoted 6 lines
Quoted 6 lines

I have never been very enthusiastic about the m2m framework: it's fine for e.g. simple scalers, but it's awkward to use for codecs let alone ISPs.

I always felt that we really need variants of the m2m framework that are customized to specific use-cases: i.e. a codec m2m framework, and (perhaps) an ISP m2m framework.

Quoted 8 lines
Quoted 2 lines
Quoted 2 lines
Quoted 2 lines
Quoted 2 lines

The big problem with that is of course who will do the work. Making new frameworks is difficult and takes a long time.

A couple of weeks ago, I submitted an initial driver for a Qualcomm Offline ISP based on the standard v4l2-m2m framework. Following discussions around which parts could be generalized, I started migrating this work to a new v4l2-isp-m2m framework:
(https://github.com/loicpoulain/linux/commit/5d575d7eff8f2371e91d8237148ffdb44b0af5b0).

I definitely want to discuss this, but I will be available on Monday until 15:00 only.

Quoted 3 lines

The API and overall logic closely mirror v4l2-m2m.c, but are extended to address ISP‑specific requirements such as multi‑device support and multiple queue handling.

That part I don't like. The V4L2 M2M framework is a big mid-layer that prevents drivers from having control of how operations are handled. It does too much, and doesn't give enough flexibility to drivers. It may have been fine when the framework was designed, for the devices we had back then, but today it's just painful. I want to turn this around and give control to the drivers, with helpers they can use to implement parts that are not driver-specific. This needs to be opt-in, not a layer that takes completely control between the uAPI and driver operations.

Let's not reproduce the design mistakes made in the V4L2 M2M framework.

I also think you need to decouple the context handling and scheduling in two separate components. They need to work together, but shouldn't be bundled into a monolithic system. Very importantly, a driver should be able to implement contexts with the multi-context helpers, and implement custom scheduling itself.

Quoted 7 lines

I am planning to submit this work as an RFC
before the Media Summit. At this stage, the framework is still fairly basic and primarily tailored to the Qualcomm use case. There is definitely room for improvement, for example, integrating Jacopo’s multi‑context support, since for now, the Qualcomm driver simply instantiates a single ISP‑M2M context.

Quoted 161 lines

As I am still getting familiar with the media subsystem, this work may overlap with or conflict with ongoing efforts. Synchronizing seems indeed important. Based on my current understanding, there are several related areas of work that appear either complementary or orthogonal:
- Multi‑context support, to instantiate multiple processing sessions on shared hardware/driver.
- Media jobs, to synchronize work across multiple drivers within the same media pipeline.
- ISP M2M, aiming to provide a v4l2-m2m‑like framework specifically for memory‑to‑memory ISP devices.

Quoted 150 lines
Quoted 150 lines

This may be naive and overly optimistic, but I feel there is quite a number of people sharing the same pain points (which are similar to those Loic pointed out). Maybe (hopefully) this birds of a feather session leads to the formation of some work group?

Quoted 145 lines
Quoted 145 lines
Quoted 145 lines
Quoted 145 lines
Quoted 145 lines
Quoted 145 lines · Hans Verkuil
Quoted 144 lines

(Please pass this on to anyone you think might be interested in this!)

Hi all,

This is the fourth version of this announcement, updating the list of attendees and the tentative agenda at the end: please let me know if you see mistakes. Note that there is still time for one or two other topics. Also please check the agenda if you need more (or perhaps less) time for your topic.

This year's Media Summit will be held on Tuesday May 26th the day before the Embedded Recipes Conference in Nice, France:

https://embedded-recipes.org/2026/

The Media Summit will be held at Hotel Campanile and in the same meeting room as last year (Nikaia):

https://nice-aeroport.campanile.com/en-us/

It is close to the Airport and to the Embedded Recipes venue.

The meeting room can hold up to 30 people and I will provide video conferencing support, just like last year. The location and the meeting room was quite nice last year, so I saw no need to change it.

That said, in-person participation is very much preferred. This yearly summit is meant for active media developers to meet face-to-face and to discuss media subsystem issues.

And it is also a good opportunity to talk to each other during the Embedded Recipes conference to discuss topics in a smaller group. But if you are an active media developer and are really not able to attend in person, then remote participation is an option.

If you want to attend the meeting (either in person or remote), then send an email to me directly. The deadline for in-person attendance is May 14 as the hotel needs to know the final number of attendees by then.

There is no registration fee, the meeting room is sponsored by Cisco and Collabora, and the lunch is sponsored by Ideas on Board! Many thanks to our sponsors, it's very much appreciated.

If you have a topic that you want to discuss, just 'Reply All' to this announcement and give the topic title, a short description and a guesstimate of the time you need for your topic.

See last year's Media Summit Report as an example of what to expect:

https://lore.kernel.org/linux-media/[email protected]/

Regards,

Hans

PS: Be aware that May 24 and 25 are public holidays in France. So many shops may be
closed those days.

In-person attendees:
Sakari Ailus <[email protected]> Kieran Bingham <[email protected]> Brandon Brnich <[email protected]>
Rouven Czerwinski <[email protected]> Mehdi Djait <[email protected]> Bryan O'Donoghue <[email protected]> Nicolas Dufresne <[email protected]> Marco Felsch <[email protected]>
Paul Kocialkowski <[email protected]>
Jai Luthra <[email protected]> Jacopo Mondi <[email protected]> Benjamin Mugnier <[email protected]> Beleswar Padhi <[email protected]>
Laurent Pinchart <[email protected]> Loic Poulain <[email protected]> Sven Püschel <[email protected]> Ricardo Ribalda <[email protected]> Michael Riesch <[email protected]> Devarsh Thakkar <[email protected]>
Michael Tretter <[email protected]> Hans Verkuil <[email protected]>

Remote attendees:
Yemike Abhilash Chandra <[email protected]> Rishikesh Donadkar <[email protected]>
Jackson Lee <[email protected]>
Dave Stevenson <[email protected]> (tentative)

Agenda (tentative):

8:45-9:20: Arrive, settle in

9:20-9:30: Short intro (Hans Verkuil)

9:30-9:45: Status of ISP support in V4L2
Presenter: Laurent Pinchart
Description: Summary of ISP-related development in V4L2 since the last Linux Media Summit. This includes a brief overview of technical developments, and a summary of the efforts to engage with vendors.

9:45-10:45: V4L2 Stateless Video Encoding uAPI Progress Update
Presenter: Paul Kocialkowski
Description: An update on the ongonig work to support stateless codecs in V4L2. Some of the remaining open topics will be presented and discussed.

10:45-11:00: break

11:00-11:30: Vulkan Video Codecs
Presenter: Nicolas Dufresne
Description: Vulkan video codecs: what are the viable options for Linux Media and what is in preparation outside of our subsystem. The second aspect is informative as these discussions don't seem to lean toward our subsystem as the foundation. But I think it's rather useful for everyone to understand why and what is included.

11:30-12:00: Protected Video playback on i.MX8MQ
Presenter: Rouven Czerwinski
Description: Introduction to protected video playback
on i.MX8MQ and missing bits for linux-media & protected heap interoperability.

12:00-13:30: Lunch

13:30-14:00: HDCP support for HDMI receivers
Presenter: Hans Verkuil
Description: I have been working on adding HDCP support for HDMI receivers. Specifically the HDCP negotiation between sources and sinks.

14:00-14:30: AI patches
Presenter: Sakari Ailus
Description: What is our policy w.r.t. AI generated patches?

14:30-15:00 Overview of Media CI: where do pipelines run?
Presenter: Ricardo Ribalda
Description: How are jobs in pipelines assigned? How does the infrastructure for Media CI work? Are there things that can be tweaked to make it more reliable?

15:00-15:15: Break

15:15-16:15: Discussion of the media subsystem development process
Presenter: Hans Verkuil
Description: Review of the multi-committer model: current status and next steps. Are there any bottlenecks, any ideas for improvements, w.r.t. the development process?

As you can see, there is still some available time for other topics.

--
Regards,

Laurent Pinchart

#20 lore raw

Le mardi 28 avril 2026 à 15:00 +0200, Hans Verkuil a écrit :

Quoted 93 lines · Jacopo Mondi
Quoted 85 lines

Hello

Quoted 64 lines · Laurent Pinchart
Quoted 63 lines · Loic Poulain
Quoted 53 lines · Laurent Pinchart
Quoted 52 lines · Michael Riesch
Quoted 9 lines · Ricardo Ribalda
Quoted 8 lines · Hans Verkuil
Quoted 7 lines · Laurent Pinchart
Quoted 6 lines · Nicolas Dufresne
Quoted 5 lines · Laurent Pinchart
Quoted 4 lines · Loic Poulain

Hi Hans,

I would be happy to discuss this if a slot is available:

Quoted 13 lines
Quoted 5 lines
Quoted 5 lines
Quoted 5 lines
Quoted 5 lines
Quoted 5 lines

Title: Generic V4L2 ISP M2M framework
Presenter: Loic Poulain
Time estimate: ~20min
Description: During early development of a Qualcomm Offline Image Processing Engine (OPE), we relied on the V4L2 memory‑to‑memory

Quoted 8 lines
Quoted 8 lines
Quoted 8 lines
Quoted 8 lines
Quoted 8 lines

(v4l2‑m2m) framework, which is widely used and provides solid support for buffer management and scheduling. However, applying it to an ISP use case exposes limitations: ISP engines often require a richer media graph, with multiple pads and metadata flows, similar to inline ISP pipelines (params, stats, outputs). This talk proposes discussing the need for and design of a common V4L2 ISP M2M framework to factor out shared functionality across drivers, particularly around buffer/queue management and job scheduling.

It seems that we share some pain points.. :-) :-/

Over the last year, some ideas have been brewing in my mind. Not necessarily *my* ideas, mind you, rather ideas that have been around in linux-media for quite a while, actually. What I would like to prepare for the Media Summit goes along the same lines.

Quoted 21 lines
Quoted 20 lines
Quoted 14 lines
Quoted 7 lines
Quoted 6 lines

That's well aligned with the v4l2-isp framework that Jacopo started, and to the multi-context and media-jobs APIs that we have proposed. I wonder, however, if a short session at the media summit will be enough, or if we should try to organize a half day brainstorming workshop at some point. Depending on when the people interested in this topic plan to arrive, Monday could be an option.

Quoted 6 lines

I'm also/still interested in the multi-context for m2m decoders that have inline post-processing capabilities (current model forces us to waste a lot of RAM). We just restarted some design discussion with the team, with an increased confidence that multi-context is the way. The scheduler could come handy in the future if we get to deal with more multi-stage codecs in the future. I'll be in Nice all day Monday.

Quoted 3 lines

I will unfortunately be available only until 15:00 on Monday, but Jacopo should be available through the day. Let's see who would be interested and available, and try to organize something.

I'm available on Monday as well. I think this is a topic that is well suited to a brainstorm session.

Quoted 6 lines
Quoted 6 lines
Quoted 1 line

I am also available on Monday and would like to attend the session.

I'd be interested too. Right now the plan is to arrive on Monday afternoon. Depending on what time you agree on it may work out anyway. It would be great to know the exact time this session will start (as I might need to adjust my travel arrangements).

I can arrive on Monday, with a preference for the afternoon.

Quoted 8 lines
Quoted 8 lines
Quoted 8 lines

We need a volunteer to organize this, as in finding and booking a meeting space. Note that Monday is a public holiday in France (Monday the 25th of May in particular, not all Mondays).

If the number of attendees was small I was thinking of hosting the event in the place where the Ideas on Board team will be staying, but it looks like we're already reaching a fair number of people.

Are we still considering this BoF session ?

We would someone to volunteer organizing this, at @IoB we're quite full for the week and we might have an hard time organizing this one on top of the libcamera workshop.

As Laurent said, that Monday is a public holiday in France, and getting a room somewhere might be complicated.

Quoted 6 lines

We can host some people in the location where we're having the yearly IoB get-together, but you should arrange your travel there (35 minutes from Nice by car).

If we get a volunteer we can should maybe a dedicated mail thread as this one was about the Media Summit ?

Quoted 6 lines

If the number of people can be kept low (say <= 6), then it shouldn't be a problem to just find a hotel restaurant or similar, close to the place of the media summit, and just sit together.

Who would be the key people for this? And who are 'nice to have'? :-) I think I probably fit more in the latter category than the first.

I was hoping a small number of people and a simple café/lobby too. The mass of people interested in the reply arrive much later, but I'm there all day, and would be more then happy to be able to brainstorm the subject a bit, which is easier in small group.

Nicolas

p.s. once we know how many, if its too big, I can always abuse Mark again and ask him to figure-out something for us.

Quoted 239 lines

Regards,

Hans

Quoted 234 lines
Quoted 233 lines
Quoted 27 lines
Quoted 27 lines
Quoted 8 lines
Quoted 7 lines

Regards!

Quoted 3 lines

The agenda for the media summit is getting quite full, and I agree with Laurent that 20 minutes is likely not enough. If we can so a session on Monday instead, then that would be a good solution.

Quoted 7 lines

Apart from the time and date the scope of this session would be interesting.

Will this be a birds of a feather session in which the next generation kernel ISP framework will be discussed? Or even the next generation kernel video processing framework, where video processing is image signal processing, encoding/decoding, 2D graphics processing (fisheye correction units, 2D GPU such as the Rockchip RGA3, ...)?

I would focus on Loic's original scope. If the solution can be used for other devices that's great too. I believe that the current multi-context patch series is a good fit for codecs. If we broaden the scope too much right away we'll achieve nothing.

Quoted 6 lines
Quoted 6 lines
Quoted 6 lines

I have never been very enthusiastic about the m2m framework: it's fine for e.g. simple scalers, but it's awkward to use for codecs let alone ISPs.

I always felt that we really need variants of the m2m framework that are customized to specific use-cases: i.e. a codec m2m framework, and (perhaps) an ISP m2m framework.

Quoted 8 lines
Quoted 2 lines
Quoted 2 lines
Quoted 2 lines
Quoted 2 lines

The big problem with that is of course who will do the work. Making new frameworks is difficult and takes a long time.

A couple of weeks ago, I submitted an initial driver for a Qualcomm Offline ISP based on the standard v4l2-m2m framework. Following discussions around which parts could be generalized, I started migrating this work to a new v4l2-isp-m2m framework:
(https://github.com/loicpoulain/linux/commit/5d575d7eff8f2371e91d8237148ffdb44b0af5b0).

I definitely want to discuss this, but I will be available on Monday until 15:00 only.

Quoted 3 lines

The API and overall logic closely mirror v4l2-m2m.c, but are extended to address ISP‑specific requirements such as multi‑device support and multiple queue handling.

That part I don't like. The V4L2 M2M framework is a big mid-layer that prevents drivers from having control of how operations are handled. It does too much, and doesn't give enough flexibility to drivers. It may have been fine when the framework was designed, for the devices we had back then, but today it's just painful. I want to turn this around and give control to the drivers, with helpers they can use to implement parts that are not driver-specific. This needs to be opt-in, not a layer that takes completely control between the uAPI and driver operations.

Let's not reproduce the design mistakes made in the V4L2 M2M framework.

I also think you need to decouple the context handling and scheduling in two separate components. They need to work together, but shouldn't be bundled into a monolithic system. Very importantly, a driver should be able to implement contexts with the multi-context helpers, and implement custom scheduling itself.

Quoted 7 lines

I am planning to submit this work as an RFC
before the Media Summit. At this stage, the framework is still fairly basic and primarily tailored to the Qualcomm use case. There is definitely room for improvement, for example, integrating Jacopo’s multi‑context support, since for now, the Qualcomm driver simply instantiates a single ISP‑M2M context.

Quoted 161 lines

As I am still getting familiar with the media subsystem, this work may overlap with or conflict with ongoing efforts. Synchronizing seems indeed important. Based on my current understanding, there are several related areas of work that appear either complementary or orthogonal:
- Multi‑context support, to instantiate multiple processing sessions on shared hardware/driver.
- Media jobs, to synchronize work across multiple drivers within the same media pipeline.
- ISP M2M, aiming to provide a v4l2-m2m‑like framework specifically for memory‑to‑memory ISP devices.

Quoted 150 lines
Quoted 150 lines

This may be naive and overly optimistic, but I feel there is quite a number of people sharing the same pain points (which are similar to those Loic pointed out). Maybe (hopefully) this birds of a feather session leads to the formation of some work group?

Quoted 145 lines
Quoted 145 lines
Quoted 145 lines
Quoted 145 lines
Quoted 145 lines
Quoted 145 lines · Hans Verkuil
Quoted 144 lines

(Please pass this on to anyone you think might be interested in this!)

Hi all,

This is the fourth version of this announcement, updating the list of attendees
and the tentative agenda at the end: please let me know if you see mistakes.
Note that there is still time for one or two other topics. Also please check
the agenda if you need more (or perhaps less) time for your topic.

This year's Media Summit will be held on Tuesday May 26th the day before the
Embedded Recipes Conference in Nice, France:

https://embedded-recipes.org/2026/

The Media Summit will be held at Hotel Campanile and in the same meeting room
as last year (Nikaia):

https://nice-aeroport.campanile.com/en-us/

It is close to the Airport and to the Embedded Recipes venue.

The meeting room can hold up to 30 people and I will provide video conferencing support,
just like last year. The location and the meeting room was quite nice last year, so
I saw no need to change it.

That said, in-person participation is very much preferred. This yearly summit is meant
for active media developers to meet face-to-face and to discuss media subsystem issues.

And it is also a good opportunity to talk to each other during the Embedded Recipes
conference to discuss topics in a smaller group. But if you are an active media developer
and are really not able to attend in person, then remote participation is an option.

If you want to attend the meeting (either in person or remote), then send an email to me
directly. The deadline for in-person attendance is May 14 as the hotel needs to know the
final number of attendees by then.

There is no registration fee, the meeting room is sponsored by Cisco and Collabora, and
the lunch is sponsored by Ideas on Board! Many thanks to our sponsors, it's very much
appreciated.

If you have a topic that you want to discuss, just 'Reply All' to this announcement
and give the topic title, a short description and a guesstimate of the time you need
for your topic.

See last year's Media Summit Report as an example of what to expect:

https://lore.kernel.org/linux-media/[email protected]/

Regards,

        Hans

PS: Be aware that May 24 and 25 are public holidays in France. So many
shops may be
closed those days.

In-person attendees:
Sakari Ailus <[email protected]>
Kieran Bingham <[email protected]>
Brandon Brnich <[email protected]>
Rouven Czerwinski <[email protected]>
Mehdi Djait <[email protected]>
Bryan O'Donoghue <[email protected]>
Nicolas Dufresne <[email protected]>
Marco Felsch <[email protected]>
Paul Kocialkowski <[email protected]>
Jai Luthra <[email protected]>
Jacopo Mondi <[email protected]>
Benjamin Mugnier <[email protected]>
Beleswar Padhi <[email protected]>
Laurent Pinchart <[email protected]>
Loic Poulain <[email protected]>
Sven Püschel <[email protected]>
Ricardo Ribalda <[email protected]>
Michael Riesch <[email protected]>
Devarsh Thakkar <[email protected]>
Michael Tretter <[email protected]>
Hans Verkuil <[email protected]>

Remote attendees:
Yemike Abhilash Chandra <[email protected]>
Rishikesh Donadkar <[email protected]>
Jackson Lee <[email protected]>
Dave Stevenson <[email protected]> (tentative)

Agenda (tentative):

8:45-9:20: Arrive, settle in

9:20-9:30: Short intro (Hans Verkuil)

9:30-9:45: Status of ISP support in V4L2
        Presenter: Laurent Pinchart
        Description: Summary of ISP-related development in V4L2 since the last
        Linux Media Summit. This includes a brief overview of technical
        developments, and a summary of the efforts to engage with vendors.

9:45-10:45: V4L2 Stateless Video Encoding uAPI Progress Update
        Presenter: Paul Kocialkowski
        Description: An update on the ongonig work to support stateless codecs in V4L2.
        Some of the remaining open topics will be presented and discussed.

10:45-11:00: break

11:00-11:30: Vulkan Video Codecs
        Presenter: Nicolas Dufresne
        Description: Vulkan video codecs: what are the viable options for Linux Media
        and what is in preparation outside of our subsystem. The second aspect is
        informative as these discussions don't seem to lean toward our subsystem as the
        foundation. But I think it's rather useful for everyone to understand why and
        what is included.

11:30-12:00: Protected Video playback on i.MX8MQ
        Presenter: Rouven Czerwinski
        Description: Introduction to protected video playback
        on i.MX8MQ and missing bits for linux-media & protected heap interoperability.

12:00-13:30: Lunch

13:30-14:00: HDCP support for HDMI receivers
        Presenter: Hans Verkuil
        Description: I have been working on adding HDCP support for HDMI receivers.
        Specifically the HDCP negotiation between sources and sinks.

14:00-14:30: AI patches
        Presenter: Sakari Ailus
        Description: What is our policy w.r.t. AI generated patches?

14:30-15:00 Overview of Media CI: where do pipelines run?
        Presenter: Ricardo Ribalda
        Description: How are jobs in pipelines assigned? How does the infrastructure
        for Media CI work? Are there things that can be tweaked to make it more
        reliable?

15:00-15:15: Break

15:15-16:15: Discussion of the media subsystem development process
        Presenter: Hans Verkuil
        Description: Review of the multi-committer model: current status and next steps.
        Are there any bottlenecks, any ideas for improvements, w.r.t. the development process?

As you can see, there is still some available time for other topics.

--
Regards,

Laurent Pinchart

#21 lore raw

Hi Folks,

Quoted 99 lines · Nicolas Dufresne
Quoted 97 lines · Hans Verkuil
Quoted 85 lines · Jacopo Mondi

Hello

Quoted 64 lines · Laurent Pinchart
Quoted 63 lines · Loic Poulain
Quoted 53 lines · Laurent Pinchart
Quoted 52 lines · Michael Riesch
Quoted 9 lines · Ricardo Ribalda
Quoted 8 lines · Hans Verkuil
Quoted 7 lines · Laurent Pinchart
Quoted 6 lines · Nicolas Dufresne
Quoted 5 lines · Laurent Pinchart
Quoted 4 lines · Loic Poulain

Hi Hans,

I would be happy to discuss this if a slot is available:

Quoted 13 lines
Quoted 5 lines
Quoted 5 lines
Quoted 5 lines
Quoted 5 lines
Quoted 5 lines

Title: Generic V4L2 ISP M2M framework
Presenter: Loic Poulain
Time estimate: ~20min
Description: During early development of a Qualcomm Offline Image
Processing Engine (OPE), we relied on the V4L2 memory‑to‑memory

Quoted 8 lines
Quoted 8 lines
Quoted 8 lines
Quoted 8 lines
Quoted 8 lines

(v4l2‑m2m) framework, which is widely used and provides solid support
for buffer management and scheduling. However, applying it to an ISP
use case exposes limitations: ISP engines often require a richer media
graph, with multiple pads and metadata flows, similar to inline ISP
pipelines (params, stats, outputs). This talk proposes discussing the
need for and design of a common V4L2 ISP M2M framework to factor out
shared functionality across drivers, particularly around buffer/queue
management and job scheduling.

It seems that we share some pain points.. :-) :-/

Over the last year, some ideas have been brewing in my mind. Not necessarily *my* ideas, mind you, rather ideas that have been around in linux-media for quite a while, actually. What I would like to prepare for the Media Summit goes along the same lines.

Quoted 21 lines
Quoted 20 lines
Quoted 14 lines
Quoted 7 lines
Quoted 6 lines

That's well aligned with the v4l2-isp framework that Jacopo started, and to the multi-context and media-jobs APIs that we have proposed. I wonder, however, if a short session at the media summit will be enough, or if we should try to organize a half day brainstorming workshop at some point. Depending on when the people interested in this topic plan to arrive, Monday could be an option.

Quoted 6 lines

I'm also/still interested in the multi-context for m2m decoders that have inline post-processing capabilities (current model forces us to waste a lot of RAM). We just restarted some design discussion with the team, with an increased confidence that multi-context is the way. The scheduler could come handy in the future if we get to deal with more multi-stage codecs in the future. I'll be in Nice all day Monday.

Quoted 3 lines

I will unfortunately be available only until 15:00 on Monday, but Jacopo should be available through the day. Let's see who would be interested and available, and try to organize something.

I'm available on Monday as well. I think this is a topic that is well suited to a brainstorm session.

Quoted 6 lines
Quoted 6 lines
Quoted 1 line

I am also available on Monday and would like to attend the session.

I'd be interested too. Right now the plan is to arrive on Monday afternoon. Depending on what time you agree on it may work out anyway. It would be great to know the exact time this session will start (as I might need to adjust my travel arrangements).

I can arrive on Monday, with a preference for the afternoon.

Quoted 8 lines
Quoted 8 lines
Quoted 8 lines

We need a volunteer to organize this, as in finding and booking a meeting space. Note that Monday is a public holiday in France (Monday the 25th of May in particular, not all Mondays).

If the number of attendees was small I was thinking of hosting the event in the place where the Ideas on Board team will be staying, but it looks like we're already reaching a fair number of people.

Are we still considering this BoF session ?

We would someone to volunteer organizing this, at @IoB we're quite full for the week and we might have an hard time organizing this one on top of the libcamera workshop.

As Laurent said, that Monday is a public holiday in France, and getting a room somewhere might be complicated.

Quoted 6 lines

We can host some people in the location where we're having the yearly IoB get-together, but you should arrange your travel there (35 minutes from Nice by car).

If we get a volunteer we can should maybe a dedicated mail thread as this one was about the Media Summit ?

If the number of people can be kept low (say <= 6), then it shouldn't be a problem to just find a hotel restaurant or similar, close to the place of the media summit, and just sit together.

Quoted 7 lines
Quoted 2 lines

Who would be the key people for this? And who are 'nice to have'? :-) I think I probably fit more in the latter category than the first.

I was hoping a small number of people and a simple café/lobby too. The mass of people interested in the reply arrive much later, but I'm there all day, and would be more then happy to be able to brainstorm the subject a bit, which is easier in small group.

Is this BoF side session still planned? If there’s still interest, perhaps the easiest option would simply be to meet at the hotel lobby on Monday morning.

Regards,
Loic

#22 lore raw

Hi Loic

Quoted 106 lines · Loic Poulain

Hi Folks,

Quoted 102 lines · Nicolas Dufresne
Quoted 99 lines · Hans Verkuil
Quoted 85 lines · Jacopo Mondi

Hello

Quoted 64 lines · Laurent Pinchart
Quoted 63 lines · Loic Poulain
Quoted 53 lines · Laurent Pinchart
Quoted 52 lines · Michael Riesch
Quoted 9 lines · Ricardo Ribalda
Quoted 8 lines · Hans Verkuil
Quoted 7 lines · Laurent Pinchart
Quoted 6 lines · Nicolas Dufresne
Quoted 5 lines · Laurent Pinchart

On Mon, Apr 13, 2026 at 10:03:52PM +0200, Loic Poulain wrote:
Hi Hans,

I would be happy to discuss this if a slot is available:

Quoted 13 lines
Quoted 5 lines
Quoted 5 lines
Quoted 5 lines
Quoted 5 lines

Title: Generic V4L2 ISP M2M framework
Presenter: Loic Poulain
Time estimate: ~20min
Description: During early development of a Qualcomm Offline Image
Processing Engine (OPE), we relied on the V4L2 memory‑to‑memory

Quoted 8 lines
Quoted 8 lines
Quoted 8 lines
Quoted 8 lines

(v4l2‑m2m) framework, which is widely used and provides solid support
for buffer management and scheduling. However, applying it to an ISP
use case exposes limitations: ISP engines often require a richer media
graph, with multiple pads and metadata flows, similar to inline ISP
pipelines (params, stats, outputs). This talk proposes discussing the
need for and design of a common V4L2 ISP M2M framework to factor out
shared functionality across drivers, particularly around buffer/queue
management and job scheduling.

It seems that we share some pain points.. :-) :-/

Over the last year, some ideas have been brewing in my mind. Not necessarily *my* ideas, mind you, rather ideas that have been around in linux-media for quite a while, actually. What I would like to prepare for the Media Summit goes along the same lines.

Quoted 21 lines
Quoted 20 lines
Quoted 14 lines
Quoted 7 lines
Quoted 6 lines

That's well aligned with the v4l2-isp framework that Jacopo started, and
to the multi-context and media-jobs APIs that we have proposed. I
wonder, however, if a short session at the media summit will be enough,
or if we should try to organize a half day brainstorming workshop at
some point. Depending on when the people interested in this topic plan
to arrive, Monday could be an option.

Quoted 6 lines

I'm also/still interested in the multi-context for m2m decoders that have inline post-processing capabilities (current model forces us to waste a lot of RAM). We just restarted some design discussion with the team, with an increased confidence that multi-context is the way. The scheduler could come handy in the future if we get to deal with more multi-stage codecs in the future. I'll be in Nice all day Monday.

Quoted 3 lines

I will unfortunately be available only until 15:00 on Monday, but Jacopo should be available through the day. Let's see who would be interested and available, and try to organize something.

I'm available on Monday as well. I think this is a topic that is well suited to a brainstorm session.

Quoted 6 lines
Quoted 6 lines
Quoted 1 line

I am also available on Monday and would like to attend the session.

I'd be interested too. Right now the plan is to arrive on Monday afternoon. Depending on what time you agree on it may work out anyway. It would be great to know the exact time this session will start (as I might need to adjust my travel arrangements).

I can arrive on Monday, with a preference for the afternoon.

Quoted 8 lines
Quoted 8 lines
Quoted 8 lines

We need a volunteer to organize this, as in finding and booking a meeting space. Note that Monday is a public holiday in France (Monday the 25th of May in particular, not all Mondays).

If the number of attendees was small I was thinking of hosting the event in the place where the Ideas on Board team will be staying, but it looks like we're already reaching a fair number of people.

Are we still considering this BoF session ?

We would someone to volunteer organizing this, at @IoB we're quite full for the week and we might have an hard time organizing this one on top of the libcamera workshop.

As Laurent said, that Monday is a public holiday in France, and getting a room somewhere might be complicated.

Quoted 6 lines

We can host some people in the location where we're having the yearly IoB get-together, but you should arrange your travel there (35 minutes from Nice by car).

If we get a volunteer we can should maybe a dedicated mail thread as this one was about the Media Summit ?

If the number of people can be kept low (say <= 6), then it shouldn't be a problem to just find a hotel restaurant or similar, close to the place of the media summit, and just sit together.

Who would be the key people for this? And who are 'nice to have'? :-) I think I probably fit more in the latter category than the first.

Quoted 9 lines
Quoted 4 lines

I was hoping a small number of people and a simple café/lobby too. The mass of people interested in the reply arrive much later, but I'm there all day, and would be more then happy to be able to brainstorm the subject a bit, which is easier in small group.

Is this BoF side session still planned? If there’s still interest, perhaps the easiest option would simply be to meet at the hotel lobby on Monday morning.

I'm around Nice like many others on Monday, but I'm not sure how this would feel for people that didn't arrange their travels accordingly because this event was never officially announced.

Quoted 3 lines

Regards,
Loic

#23 lore raw
Quoted 115 lines · Jacopo Mondi

Hi Loic

Quoted 111 lines · Loic Poulain

Hi Folks,

Quoted 106 lines · Nicolas Dufresne
Quoted 93 lines · Hans Verkuil
Quoted 85 lines · Jacopo Mondi

Hello

Quoted 64 lines · Laurent Pinchart
Quoted 63 lines · Loic Poulain
Quoted 53 lines · Laurent Pinchart
Quoted 52 lines · Michael Riesch
Quoted 9 lines · Ricardo Ribalda
Quoted 8 lines · Hans Verkuil
Quoted 7 lines · Laurent Pinchart
Quoted 6 lines · Nicolas Dufresne

Le lundi 13 avril 2026 à 23:19 +0300, Laurent Pinchart a écrit :
On Mon, Apr 13, 2026 at 10:03:52PM +0200, Loic Poulain wrote:
Hi Hans,

I would be happy to discuss this if a slot is available:

Quoted 13 lines
Quoted 5 lines
Quoted 5 lines
Quoted 5 lines

Title: Generic V4L2 ISP M2M framework
Presenter: Loic Poulain
Time estimate: ~20min
Description: During early development of a Qualcomm Offline Image
Processing Engine (OPE), we relied on the V4L2 memory‑to‑memory

Quoted 8 lines
Quoted 8 lines
Quoted 8 lines

(v4l2‑m2m) framework, which is widely used and provides solid support
for buffer management and scheduling. However, applying it to an ISP
use case exposes limitations: ISP engines often require a richer media
graph, with multiple pads and metadata flows, similar to inline ISP
pipelines (params, stats, outputs). This talk proposes discussing the
need for and design of a common V4L2 ISP M2M framework to factor out
shared functionality across drivers, particularly around buffer/queue
management and job scheduling.

It seems that we share some pain points.. :-) :-/

Over the last year, some ideas have been brewing in my mind. Not necessarily *my* ideas, mind you, rather ideas that have been around in linux-media for quite a while, actually. What I would like to prepare for the Media Summit goes along the same lines.

Quoted 21 lines
Quoted 20 lines
Quoted 14 lines
Quoted 13 lines

That's well aligned with the v4l2-isp framework that Jacopo started, and
to the multi-context and media-jobs APIs that we have proposed. I
wonder, however, if a short session at the media summit will be enough,
or if we should try to organize a half day brainstorming workshop at
some point. Depending on when the people interested in this topic plan
to arrive, Monday could be an option.

I'm also/still interested in the multi-context for m2m decoders that have inline
post-processing capabilities (current model forces us to waste a lot of RAM). We
just restarted some design discussion with the team, with an increased
confidence that multi-context is the way. The scheduler could come handy in the
future if we get to deal with more multi-stage codecs in the future. I'll be in
Nice all day Monday.

Quoted 3 lines

I will unfortunately be available only until 15:00 on Monday, but Jacopo should be available through the day. Let's see who would be interested and available, and try to organize something.

I'm available on Monday as well. I think this is a topic that is well suited to a brainstorm session.

Quoted 6 lines
Quoted 6 lines
Quoted 1 line

I am also available on Monday and would like to attend the session.

I'd be interested too. Right now the plan is to arrive on Monday afternoon. Depending on what time you agree on it may work out anyway. It would be great to know the exact time this session will start (as I might need to adjust my travel arrangements).

I can arrive on Monday, with a preference for the afternoon.

Quoted 8 lines
Quoted 8 lines
Quoted 8 lines

We need a volunteer to organize this, as in finding and booking a meeting space. Note that Monday is a public holiday in France (Monday the 25th of May in particular, not all Mondays).

If the number of attendees was small I was thinking of hosting the event in the place where the Ideas on Board team will be staying, but it looks like we're already reaching a fair number of people.

Are we still considering this BoF session ?

We would someone to volunteer organizing this, at @IoB we're quite full for the week and we might have an hard time organizing this one on top of the libcamera workshop.

As Laurent said, that Monday is a public holiday in France, and getting a room somewhere might be complicated.

Quoted 6 lines

We can host some people in the location where we're having the yearly IoB get-together, but you should arrange your travel there (35 minutes from Nice by car).

If we get a volunteer we can should maybe a dedicated mail thread as this one was about the Media Summit ?

Quoted 6 lines

If the number of people can be kept low (say <= 6), then it shouldn't be a problem to just find a hotel restaurant or similar, close to the place of the media summit, and just sit together.

Who would be the key people for this? And who are 'nice to have'? :-) I think I probably fit more in the latter category than the first.

I was hoping a small number of people and a simple café/lobby too. The mass of people interested in the reply arrive much later, but I'm there all day, and would be more then happy to be able to brainstorm the subject a bit, which is easier in small group.

Quoted 8 lines
Quoted 4 lines

Is this BoF side session still planned? If there’s still interest, perhaps the easiest option would simply be to meet at the hotel lobby on Monday morning.

I'm around Nice like many others on Monday, but I'm not sure how this would feel for people that didn't arrange their travels accordingly because this event was never officially announced.

OK, I’ll be at the Campanile lobby tomorrow around 10am anyway, doing some remote work, so feel free to stop by if you’d like to have an informal discussion about how current and future multi-context support should be taken into account, and what could reasonably be generalized as vendor-agnostic helpers/frameworks for M2M ISP engines.

Cheers,
Loic

#24 lore raw
In reply to Loic Poulain

Hi Loic,

Le vendredi 22 mai 2026 à 21:49 +0200, Loic Poulain a écrit :

Quoted 10 lines
Quoted 6 lines

I was hoping a small number of people and a simple café/lobby too. The mass of
people interested in the reply arrive much later, but I'm there all day, and would be more then happy to be able to brainstorm the subject a bit, which is
easier in small group.

Is this BoF side session still planned? If there’s still interest, perhaps the easiest option would simply be to meet at the hotel lobby on Monday morning.

I myself retracted, and will take a rest day touring instead. But I'll be back in Nice in the evening. If there is a meeting point, I'll join.

regards,
Nicolas

#25 lore raw
In reply to Hans Verkuil

Hi

Quoted 40 lines · Hans Verkuil
Quoted 35 lines · Laurent Pinchart
Quoted 27 lines · Nicolas Dufresne

Le lundi 13 avril 2026 à 23:19 +0300, Laurent Pinchart a écrit :

Quoted 19 lines · Loic Poulain
Quoted 4 lines

Hi Hans,

I would be happy to discuss this if a slot is available:

Quoted 13 lines

Title: Generic V4L2 ISP M2M framework
Presenter: Loic Poulain
Time estimate: ~20min
Description: During early development of a Qualcomm Offline Image Processing Engine (OPE), we relied on the V4L2 memory‑to‑memory (v4l2‑m2m) framework, which is widely used and provides solid support for buffer management and scheduling. However, applying it to an ISP use case exposes limitations: ISP engines often require a richer media graph, with multiple pads and metadata flows, similar to inline ISP pipelines (params, stats, outputs). This talk proposes discussing the need for and design of a common V4L2 ISP M2M framework to factor out shared functionality across drivers, particularly around buffer/queue management and job scheduling.

Quoted 6 lines

That's well aligned with the v4l2-isp framework that Jacopo started, and to the multi-context and media-jobs APIs that we have proposed. I wonder, however, if a short session at the media summit will be enough, or if we should try to organize a half day brainstorming workshop at some point. Depending on when the people interested in this topic plan to arrive, Monday could be an option.

Quoted 6 lines

I'm also/still interested in the multi-context for m2m decoders that have inline post-processing capabilities (current model forces us to waste a lot of RAM). We just restarted some design discussion with the team, with an increased confidence that multi-context is the way. The scheduler could come handy in the future if we get to deal with more multi-stage codecs in the future. I'll be in Nice all day Monday.

Quoted 3 lines

I will unfortunately be available only until 15:00 on Monday, but Jacopo should be available through the day. Let's see who would be interested and available, and try to organize something.

Quoted 6 lines

I'm available on Monday as well. I think this is a topic that is well suited to a brainstorm session.

The agenda for the media summit is getting quite full, and I agree with Laurent that 20 minutes is likely not enough. If we can so a session on Monday instead, then that would be a good solution.

I agree a longer time for discussion would be ideal

Quoted 9 lines

I have never been very enthusiastic about the m2m framework: it's fine for e.g. simple scalers, but it's awkward to use for codecs let alone ISPs.

I always felt that we really need variants of the m2m framework that are customized to specific use-cases: i.e. a codec m2m framework, and (perhaps) an ISP m2m framework.

The big problem with that is of course who will do the work. Making new frameworks is difficult and takes a long time.

I would have liked to propose for the media summit a quick discussion about the job scheduler.

--------------------------------------------------------------------------------
A case for a media-job scheduler
================================

A quick 15 minutes presentation of a use case for a media job scheduler.

Dan has proposed last year a framework for scheduling operations across multiple drivers that compose a capture pipeline:
https://www.spinics.net/lists/linux-media/msg279502.html

To better clarify why this is useful, I would like to discuss and describe a practical use case based around the Mali-C55 ISP as integrated in the Renesas RZ/V2H(P) SoC.
--------------------------------------------------------------------------------

I think this could be useful for the linux-media summit, but I can quickly show this on Monday as well as going through the last year presentation about the multi-context framework ?

Quoted 183 lines

Regards,

Hans

Quoted 177 lines
Quoted 176 lines
Quoted 176 lines
Quoted 176 lines · Hans Verkuil
Quoted 174 lines

(Please pass this on to anyone you think might be interested in this!)

Hi all,

This is the fourth version of this announcement, updating the list of attendees
and the tentative agenda at the end: please let me know if you see mistakes.
Note that there is still time for one or two other topics. Also please check
the agenda if you need more (or perhaps less) time for your topic.

This year's Media Summit will be held on Tuesday May 26th the day before the
Embedded Recipes Conference in Nice, France:

https://embedded-recipes.org/2026/

The Media Summit will be held at Hotel Campanile and in the same meeting room
as last year (Nikaia):

https://nice-aeroport.campanile.com/en-us/

It is close to the Airport and to the Embedded Recipes venue.

The meeting room can hold up to 30 people and I will provide video conferencing support,
just like last year. The location and the meeting room was quite nice last year, so
I saw no need to change it.

That said, in-person participation is very much preferred. This yearly summit is meant
for active media developers to meet face-to-face and to discuss media subsystem issues.

And it is also a good opportunity to talk to each other during the Embedded Recipes
conference to discuss topics in a smaller group. But if you are an active media developer
and are really not able to attend in person, then remote participation is an option.

If you want to attend the meeting (either in person or remote), then send an email to me
directly. The deadline for in-person attendance is May 14 as the hotel needs to know the
final number of attendees by then.

There is no registration fee, the meeting room is sponsored by Cisco and Collabora, and
the lunch is sponsored by Ideas on Board! Many thanks to our sponsors, it's very much
appreciated.

If you have a topic that you want to discuss, just 'Reply All' to this announcement
and give the topic title, a short description and a guesstimate of the time you need
for your topic.

See last year's Media Summit Report as an example of what to expect:

https://lore.kernel.org/linux-media/[email protected]/

Regards,

        Hans

PS: Be aware that May 24 and 25 are public holidays in France. So many shops may be
closed those days.

In-person attendees:
Sakari Ailus <[email protected]> Kieran Bingham <[email protected]> Brandon Brnich <[email protected]>
Rouven Czerwinski <[email protected]> Mehdi Djait <[email protected]> Bryan O'Donoghue <[email protected]> Nicolas Dufresne <[email protected]> Marco Felsch <[email protected]>
Paul Kocialkowski <[email protected]>
Jai Luthra <[email protected]> Jacopo Mondi <[email protected]> Benjamin Mugnier <[email protected]> Beleswar Padhi <[email protected]>
Laurent Pinchart <[email protected]> Loic Poulain <[email protected]> Sven Püschel <[email protected]> Ricardo Ribalda <[email protected]> Michael Riesch <[email protected]> Devarsh Thakkar <[email protected]>
Michael Tretter <[email protected]> Hans Verkuil <[email protected]>

Remote attendees:
Yemike Abhilash Chandra <[email protected]> Rishikesh Donadkar <[email protected]>
Jackson Lee <[email protected]>
Dave Stevenson <[email protected]> (tentative)

Agenda (tentative):

8:45-9:20: Arrive, settle in

9:20-9:30: Short intro (Hans Verkuil)

9:30-9:45: Status of ISP support in V4L2
        Presenter: Laurent Pinchart
        Description: Summary of ISP-related development in V4L2 since the last
        Linux Media Summit. This includes a brief overview of technical developments, and a summary of the efforts to engage with vendors.

9:45-10:45: V4L2 Stateless Video Encoding uAPI Progress Update
        Presenter: Paul Kocialkowski
        Description: An update on the ongonig work to support stateless codecs in V4L2.
        Some of the remaining open topics will be presented and discussed.

10:45-11:00: break

11:00-11:30: Vulkan Video Codecs
        Presenter: Nicolas Dufresne
        Description: Vulkan video codecs: what are the viable options for Linux Media
        and what is in preparation outside of our subsystem. The second aspect is
        informative as these discussions don't seem to lean toward our subsystem as the
        foundation. But I think it's rather useful for everyone to understand why and
        what is included.

11:30-12:00: Protected Video playback on i.MX8MQ
        Presenter: Rouven Czerwinski
        Description: Introduction to protected video playback on i.MX8MQ and missing bits for linux-media & protected heap interoperability.

12:00-13:30: Lunch

13:30-14:00: HDCP support for HDMI receivers
        Presenter: Hans Verkuil
        Description: I have been working on adding HDCP support for HDMI receivers.
        Specifically the HDCP negotiation between sources and sinks.

14:00-14:30: AI patches
        Presenter: Sakari Ailus
        Description: What is our policy w.r.t. AI generated patches?

14:30-15:00 Overview of Media CI: where do pipelines run?
        Presenter: Ricardo Ribalda
        Description: How are jobs in pipelines assigned? How does the infrastructure
        for Media CI work? Are there things that can be tweaked to make it more
        reliable?

15:00-15:15: Break

15:15-16:15: Discussion of the media subsystem development process
        Presenter: Hans Verkuil
        Description: Review of the multi-committer model: current status and next steps.
        Are there any bottlenecks, any ideas for improvements, w.r.t. the development process?

As you can see, there is still some available time for other topics.