Skip to contentSkip to conversation

various fixes for atomisp to make it work

PATCH In review Tsuchiya Yuto 7 participants 80 messages Oct 17, 2021 – Dec 1, 2021 1 message not in the archive

Subsystems (6)
lore
Share & tools
lore
#0 lore raw

cover various fixes for atomisp to make it work

Hi all,

This patch series contains fixes for atomisp to work (again). Tested on Microsoft Surface 3 (Windows) and Xiaomi Mi Pad 2 (Android model) with v5.15-rc5. Both are Cherry Trail (ISP2401) devices.

I'm still not used to Linux patch sending flow. Sorry in advance if there is some weirdness :-) but I did my best.

I'll send another series that contains RFC patches later named ("bug reports for atomisp to make it work"). To try to capture images, applying those RFC patches are also needed.

The following 1st-7th patches are fixes for the upstreamed atomisp:

media: atomisp: pci: add missing media_device_cleanup() in
atomisp_unregister_entities()
media: atomisp: pci: fix punit_ddr_dvfs_enable() argument for
mrfld_power up case
media: atomisp: pci: fix inverted logic in buffers_needed()
media: atomisp: pci: do not use err var when checking port validity
for ISP2400
media: atomisp: pci: fix inverted error check for
ia_css_mipi_is_source_port_valid()
media: atomisp: pci: use IA_CSS_ERROR() for error messages in
sh_css_mipi.c
media: atomisp: pci: fix ifdefs in sh_css.c

The following 8th-13th patches partially reverts driver version back to irci_stable_candrpv_0415_20150521_0458:

media: atomisp: pci: make fw ver
irci_stable_candrpv_0415_20150521_0458 work - 1/5
media: atomisp: pci: make fw ver
irci_stable_candrpv_0415_20150521_0458 work - 2/5
media: atomisp: pci: make fw ver
irci_stable_candrpv_0415_20150521_0458 work - 3/5
media: atomisp: pci: make fw ver
irci_stable_candrpv_0415_20150521_0458 work - 4/5
media: atomisp: pci: make fw ver
irci_stable_candrpv_0415_20150521_0458 work - 5/5
media: atomisp: pci: release_version is now
irci_stable_candrpv_0415_20150521_0458

One of the issues on the upstreamed atomisp is, the driver is a result of the following two different versions of driver merged by tools using ifdef ISP2401:

- ISP2400: irci_stable_candrpv_0415_20150521_0458
- ISP2401: irci_master_20150911_0724

and we don't have such firmware made for irci_master_20150911_0724.

I confirmed that the driver version irci_stable_candrpv_0415_20150521_0458 works well on the intel-aero version atomisp for ISP2401, too. Here is my port, if someone is interested [2]:

So, eventually, such ISP version tests caused by just the driver version difference can be removed (not just being unified but removed).

That said, it may take longer time until we remove such tests. So, for now I thought it may be better to focus on just making atomisp work by partially reverting the incompatible things for the firmware version irci_stable_candrpv_0415_20150521_0458.

I added a little bit further note about ifdefs below. Take a look at ("## about (a lot of) ISP2401 ifdef tests").

The following 14th patch is to remove the "trace_printk() being used" kernel warning message:

media: atomisp: pci: Remove remaining instance of call to trace_printk

The following 15th-16th patch adds ACPI variables to atomsip_gmin_platform because surface3 does not describe the variables in DSDT or EFI. I added the second patch marked as "[NOT-FOR-MERGE]" for a surface3 that its DMI table is broken. I know this is just a HACK but included it anyway just for the record.

media: atomsip: pci: add Microsoft Surface 3 ACPI vars [NOT-FOR-MERGE] media: atomsip: pci: add DMI match for Microsoft
Surface 3 with broken DMI (OEMB)

The following last patch is from Alan [1] about 4 years ago. I didn't write this patch in any way but this patch is required for atomisp to work normally. So, I added this just for convenience and reminder. If possible, could someone look into this patch again?

[NOT-FOR-MERGE] atomisp: Fix up the open v load race

[1] https://lore.kernel.org/linux-media/151001137594.77201.4306351721772580664.stgit@alans-desktop/
[2] You can try, but don't have to look into it; I'll try to describe
what is needed in this mail:
https://github.com/kitakar5525/linux-kernel/commits/mainline+aero_atomisp_wo_kapi_changes-2021-10-11

## taking a picture with atomisp

Note that to try to take a picture, please also apply at least the this RFC patch ("[BUG][RFC] media: atomisp: pci: assume run_mode is PREVIEW") I'll send as almost a BUG report later.

You need to use firmware version irci_stable_candrpv_0415_20150521_0458, which is available from the intel-aero [1]

The atomisp (ipu2), like the ipu3, needs userspace support. The libcamera has now decent ipu3 support but does not have atomisp support yet.

I found some userspace tools for atomisp that run on Linux:

- capturev4l2 from intel-aero/sample-apps
(https://github.com/intel-aero/sample-apps/tree/master/capturev4l2)
- hd-camera from intel-aero/sample-apps
(https://github.com/intel-aero/sample-apps/tree/master/hd-camera)
- intel/nvt

    (https://github.com/intel/nvt)

It looks like the nvt is the most feature-rich, like exposure and white balance. Note that current upstreamed atomisp dropped 32-bit support. So, you need to build it with -m64 (change it in Makefile). Here is the example of usage I use on mipad2:

        $ ./v4l2n -o [email protected] \
                --device /dev/video2 \
                --input 0 \
                --exposure=30000,30000,30000,30000 \
                --parm type=1,capturemode=CI_MODE_PREVIEW \
                --fmt type=1,width=1920,height=1080,pixelformat=NV12 \
                --reqbufs count=2,memory=USERPTR \
                --parameters=wb_config.r=32768,wb_config.gr=21043,wb_config.gb=21043,wb_config.b=30863 \
                --capture=2 \

./raw2pnm -x1920 -y1080 -fNV12 testimage_001.raw testimage_001.pnm feh *.pnm # open the converted image
rm testimage*

Note that I see the following warn/err after capture:

        kern  :warn  : [72660.793335] atomisp-isp2 0000:00:03.0: stop stream timeout.
        kern  :err   : [72660.973629] atomisp-isp2 0000:00:03.0: atomisp_reset

but I see the same message on the Android kernel, too. So, I think this is not a real issue (I hope).

[1] https://github.com/intel-aero/meta-intel-aero-base/tree/master/recipes-kernel/linux/linux-yocto

    filename shisp_2401a0_v21.bin

## about (a lot of) ISP2401 ifdef tests

When porting intel-aero version atomisp to mainline, I thought almost all the ifdef ISP2401 things are the result of two different driver version merged by tools.

To confirm that, I tried removing ifdefs for the initial commit of upstreamed atomisp [1]. And I can successfully take a picture there on surface3.

Currently, I can remove ifdefs up to commit bd674b5a413c ("media: atomisp:
cleanup ifdefs from ia_css_debug.c") [2] which is before 641c2292bf19 ("media:
atomisp: get rid of version-dependent globals"). Up to there, I stopped and realized it may take some time to remove ifdefs for current atomisp. So, instead of removing ifdefs, I partially reverted incompatible parts in this series for now.

The ifdefs for the real hardware difference is like the following which were removed or integrated into ifdef ISP2401 on commit 641c2292bf19 ("media: atomisp: get rid of version-dependent globals") and bd674b5a413c ("media: atomisp: cleanup ifdefs from ia_css_debug.c"):

- HAS_NO_INPUT_FORMATTER
- USE_INPUT_SYSTEM_VERSION_2
- USE_INPUT_SYSTEM_VERSION_2401
...

I need to elaborate on this ifdef thing later (and I'll do later), but for now, let's focus on make it just work...

[1] https://github.com/kitakar5525/linux-kernel/commits/mainline+upst_atomisp@a49d25364dfb_first
Note that many of the commits are backports to make it build
on the mainline; commits that remove ifdefs are in the 2nd page.
[2] https://github.com/kitakar5525/linux-kernel/commits/mainline+upst_atomisp@bd674b5a413c_before_get_rid_ver_globals

## for surface3 (and some crystal cove pmic based devices)

For devices which use intel_pmic_bytcrc driver, you need to add i2c address. I sent RFC patch earlier named ("ACPI / PMIC: Add i2c address to intel_pmic_bytcrc driver").

Also, sensor drivers are not upstream. Take a look at my working tree if someone is interested [1].

I made world-facing camera (OV8835) work, which the driver is from the old Android kernel tree. Unfortunately, the user-facing camera (AR0330) is not working yet; the output is completely black. I'm not sure why, maybe the sensor power issue (atomisp_gmin_platform) or sensor driver issue, which the driver is from non-atomisp driver.

[1] https://github.com/kitakar5525/linux-kernel/commits/mainline+upst_atomisp

## for mipad2 (and whiskey cove pmic based devices)

For devices which equip whiskey cove PMIC, you need to add non-upstream regulator driver [1].

[1] work done by jekhor, which seems to be from intel-aero or old Android kernel
https://github.com/jekhor/yogabook-linux-kernel/commit/11c05b365fb2eeb4fced5aa66b362c511be32a34
("intel_soc_pmic_chtwc: Add regulator driver and definition for VPROG1B")

Regards,
Tsuchiya Yuto

Alan (1):
[NOT-FOR-MERGE] atomisp: Fix up the open v load race

Tsuchiya Yuto (16):
media: atomisp: pci: add missing media_device_cleanup() in
atomisp_unregister_entities()
media: atomisp: pci: fix punit_ddr_dvfs_enable() argument for
mrfld_power up case
media: atomisp: pci: fix inverted logic in buffers_needed()
media: atomisp: pci: do not use err var when checking port validity

    for ISP2400
  media: atomisp: pci: fix inverted error check for
    ia_css_mipi_is_source_port_valid()
  media: atomisp: pci: use IA_CSS_ERROR() for error messages in
    sh_css_mipi.c
  media: atomisp: pci: fix ifdefs in sh_css.c
  media: atomisp: pci: make fw ver
    irci_stable_candrpv_0415_20150521_0458 work - 1/5
  media: atomisp: pci: make fw ver
    irci_stable_candrpv_0415_20150521_0458 work - 2/5
  media: atomisp: pci: make fw ver
    irci_stable_candrpv_0415_20150521_0458 work - 3/5
  media: atomisp: pci: make fw ver
    irci_stable_candrpv_0415_20150521_0458 work - 4/5
  media: atomisp: pci: make fw ver
    irci_stable_candrpv_0415_20150521_0458 work - 5/5
  media: atomisp: pci: release_version is now
    irci_stable_candrpv_0415_20150521_0458

media: atomisp: pci: Remove remaining instance of call to trace_printk
media: atomsip: pci: add Microsoft Surface 3 ACPI vars [NOT-FOR-MERGE] media: atomsip: pci: add DMI match for Microsoft
Surface 3 with broken DMI (OEMB)

 .../media/atomisp/pci/atomisp_compat_css20.c  | 10 ---
 .../staging/media/atomisp/pci/atomisp_fops.c  | 12 ++++
 .../media/atomisp/pci/atomisp_gmin_platform.c | 30 ++++++++
 .../media/atomisp/pci/atomisp_internal.h      |  5 ++
 .../staging/media/atomisp/pci/atomisp_v4l2.c  | 19 ++++--
 .../pci/camera/pipe/src/pipe_binarydesc.c     |  5 --
 .../css_2401_system/hive/ia_css_isp_params.c  | 23 -------
 .../media/atomisp/pci/ia_css_acc_types.h      |  5 --
 .../media/atomisp/pci/ia_css_isp_configs.h    |  8 ---
 .../media/atomisp/pci/ia_css_isp_params.h     |  3 -
 .../media/atomisp/pci/ia_css_pipe_public.h    |  3 -
 .../pci/isp/kernels/hdr/ia_css_hdr.host.c     |  1 -
 .../pci/isp/kernels/hdr/ia_css_hdr.host.h     |  1 -
 .../pci/isp/kernels/hdr/ia_css_hdr_param.h    |  1 -
 .../pci/isp/kernels/hdr/ia_css_hdr_types.h    |  1 -
 .../isp/kernels/sc/sc_1.0/ia_css_sc.host.c    | 68 -------------------
 .../isp/kernels/sc/sc_1.0/ia_css_sc.host.h    | 33 ---------
 .../isp/kernels/sc/sc_1.0/ia_css_sc_types.h   | 14 ----
 .../atomisp/pci/isp2401_input_system_global.h | 12 ----
 .../runtime/binary/interface/ia_css_binary.h  |  1 -
 .../atomisp/pci/runtime/binary/src/binary.c   | 14 ----
 .../pci/runtime/isys/src/virtual_isys.c       | 11 ---
 drivers/staging/media/atomisp/pci/sh_css.c    | 31 +++------
 .../media/atomisp/pci/sh_css_firmware.c       | 16 +----
 .../media/atomisp/pci/sh_css_internal.h       |  8 ---
 .../staging/media/atomisp/pci/sh_css_mipi.c   | 67 +++++++++---------
 drivers/staging/media/atomisp/pci/sh_css_sp.c | 22 ------
 27 files changed, 104 insertions(+), 320 deletions(-)
Signature · 1 line
2.33.1
#1 lore raw

PATCH 1/17 media: atomisp: pci: add missing media_device_cleanup() in atomisp_unregister_entities()

After the commit 9832e155f1ed ("[media] media-device: split media initialization and registration"), calling media_device_cleanup() is needed it seems. However, currently it is missing for the module unload path.

Note that for the probe failure path, it is already added in atomisp_register_entities().

This patch adds the missing call of media_device_cleanup() in atomisp_unregister_entities().

Fixes a49d25364dfb ("staging/atomisp: Add support for the Intel IPU v2")
---
 drivers/staging/media/atomisp/pci/atomisp_v4l2.c | 1 +
 1 file changed, 1 insertion(+)
drivers/staging/media/atomisp/pci/atomisp_v4l2.c +1 -0
index 1e324f1f656e..0511c454e769 100644
@@ -1182,6 +1182,7 @@ static void atomisp_unregister_entities(struct atomisp_device *isp)
 
 	v4l2_device_unregister(&isp->v4l2_dev);
 	media_device_unregister(&isp->media_dev);
+	media_device_cleanup(&isp->media_dev);
 }
 
 static int atomisp_register_entities(struct atomisp_device *isp)
Signature · 1 line
2.33.1
#2 lore raw

PATCH 2/17 media: atomisp: pci: fix punit_ddr_dvfs_enable() argument for mrfld_power up case

In reply to Tsuchiya Yuto

When comparing with intel-aero atomisp [1], it looks like punit_ddr_dvfs_enable() should take false as an argument on mrfld_power up case.

Code from the intel-aero kernel [1]:

        int atomisp_mrfld_power_down(struct atomisp_device *isp)
        {
        [...]
        	/*WA:Enable DVFS*/
        	if (IS_CHT)
        		punit_ddr_dvfs_enable(true);

        int atomisp_mrfld_power_up(struct atomisp_device *isp)
        {
        [...]
        	/*WA for PUNIT, if DVFS enabled, ISP timeout observed*/
        	if (IS_CHT)
        		punit_ddr_dvfs_enable(false);

This patch fixes the inverted argument as per the intel-aero code, as well as its comment. While here, fix space issues for comments in atomisp_mrfld_power().

Note that it does not seem to be possible to unify the up/down cases for punit_ddr_dvfs_enable(), i.e., we can't do something like the following:

        if (IS_CHT)
        	punit_ddr_dvfs_enable(!enable);

because according to the intel-aero code [1], the DVFS is disabled before "writing 0x0 to ISPSSPM0 bit[1:0]" and the DVFS is enabled after "writing 0x3 to ISPSSPM0 bit[1:0]".

[1] https://github.com/intel-aero/linux-kernel/blob/a1b673258feb915268377275130c5c5df0eafc82/drivers/media/pci/atomisp/atomisp_driver/atomisp_v4l2.c#L431-L514

Fixes 0f441fd70b1e ("media: atomisp: simplify the power down/up code")
---
 drivers/staging/media/atomisp/pci/atomisp_v4l2.c | 8 ++++----
 1 file changed, 4 insertions(+), 4 deletions(-)
drivers/staging/media/atomisp/pci/atomisp_v4l2.c +4 -4
index 0511c454e769..f5362554638e 100644
@@ -711,15 +711,15 @@ static int atomisp_mrfld_power(struct atomisp_device *isp, bool enable)
 
 	dev_dbg(isp->dev, "IUNIT power-%s.\n", enable ? "on" : "off");
 
-	/*WA:Enable DVFS*/
+	/* WA for PUNIT, if DVFS enabled, ISP timeout observed */
 	if (IS_CHT && enable)
-		punit_ddr_dvfs_enable(true);
+		punit_ddr_dvfs_enable(false);
 
 	/*
 	 * FIXME:WA for ECS28A, with this sleep, CTS
 	 * android.hardware.camera2.cts.CameraDeviceTest#testCameraDeviceAbort
 	 * PASS, no impact on other platforms
-	*/
+	 */
 	if (IS_BYT && enable)
 		msleep(10);
 
@@ -727,7 +727,7 @@ static int atomisp_mrfld_power(struct atomisp_device *isp, bool enable)
 	iosf_mbi_modify(BT_MBI_UNIT_PMC, MBI_REG_READ, MRFLD_ISPSSPM0,
 			val, MRFLD_ISPSSPM0_ISPSSC_MASK);
 
-	/*WA:Enable DVFS*/
+	/* WA:Enable DVFS */
 	if (IS_CHT && !enable)
 		punit_ddr_dvfs_enable(true);
 
Signature · 1 line
2.33.1
#3 lore raw

Re: [PATCH 02/17] media: atomisp: pci: fix punit_ddr_dvfs_enable() argument for mrfld_power up case

Quoted 47 lines · Tsuchiya Yuto

When comparing with intel-aero atomisp [1], it looks like punit_ddr_dvfs_enable() should take false as an argument on mrfld_power up case.

Code from the intel-aero kernel [1]:

        int atomisp_mrfld_power_down(struct atomisp_device *isp)
        {
        [...]
        	/*WA:Enable DVFS*/
        	if (IS_CHT)
        		punit_ddr_dvfs_enable(true);

        int atomisp_mrfld_power_up(struct atomisp_device *isp)
        {
        [...]
        	/*WA for PUNIT, if DVFS enabled, ISP timeout observed*/
        	if (IS_CHT)
        		punit_ddr_dvfs_enable(false);

This patch fixes the inverted argument as per the intel-aero code, as well as its comment. While here, fix space issues for comments in atomisp_mrfld_power().

Note that it does not seem to be possible to unify the up/down cases for punit_ddr_dvfs_enable(), i.e., we can't do something like the following:

        if (IS_CHT)
        	punit_ddr_dvfs_enable(!enable);

because according to the intel-aero code [1], the DVFS is disabled before "writing 0x0 to ISPSSPM0 bit[1:0]" and the DVFS is enabled after "writing 0x3 to ISPSSPM0 bit[1:0]".

[1] https://github.com/intel-aero/linux-kernel/blob/a1b673258feb915268377275130c5c5df0eafc82/drivers/media/pci/atomisp/atomisp_driver/atomisp_v4l2.c#L431-L514

Fixes 0f441fd70b1e ("media: atomisp: simplify the power down/up code")
---
 drivers/staging/media/atomisp/pci/atomisp_v4l2.c | 8 ++++----
 1 file changed, 4 insertions(+), 4 deletions(-)
drivers/staging/media/atomisp/pci/atomisp_v4l2.c +0 -0
index 0511c454e769..f5362554638e 100644

drivers/staging/media/atomisp/pci/atomisp_v4l2.c static int atomisp_mrfld_power(struct atomisp_device *isp, bool enable) · line 714

Quoted 5 lines
drivers/staging/media/atomisp/pci/atomisp_v4l2.c +1 -1
@@ -711,15 +711,15 @@ static int atomisp_mrfld_power(struct atomisp_device *isp, bool enable)
 
 	dev_dbg(isp->dev, "IUNIT power-%s.\n", enable ? "on" : "off");
 
-	/*WA:Enable DVFS*/
+	/* WA for PUNIT, if DVFS enabled, ISP timeout observed */

P-Unit

Quoted 26 lines
drivers/staging/media/atomisp/pci/atomisp_v4l2.c +3 -3
 	if (IS_CHT && enable)
-		punit_ddr_dvfs_enable(true);
+		punit_ddr_dvfs_enable(false);
 
 	/*
 	 * FIXME:WA for ECS28A, with this sleep, CTS
 	 * android.hardware.camera2.cts.CameraDeviceTest#testCameraDeviceAbort
 	 * PASS, no impact on other platforms
-	*/
+	 */
 	if (IS_BYT && enable)
 		msleep(10);
 
@@ -727,7 +727,7 @@ static int atomisp_mrfld_power(struct atomisp_device *isp, bool enable)
 	iosf_mbi_modify(BT_MBI_UNIT_PMC, MBI_REG_READ, MRFLD_ISPSSPM0,
 			val, MRFLD_ISPSSPM0_ISPSSC_MASK);
 
-	/*WA:Enable DVFS*/
+	/* WA:Enable DVFS */
 	if (IS_CHT && !enable)
 		punit_ddr_dvfs_enable(true);
 
Signature · 1 line
2.33.1
Signature · 2 lines
With Best Regards,
Andy Shevchenko
#4 lore raw

Re: [PATCH 02/17] media: atomisp: pci: fix punit_ddr_dvfs_enable() argument for mrfld_power up case

Quoted 49 lines · Andy Shevchenko
Quoted 48 lines · Tsuchiya Yuto

When comparing with intel-aero atomisp [1], it looks like punit_ddr_dvfs_enable() should take false as an argument on mrfld_power up case.

Code from the intel-aero kernel [1]:

        int atomisp_mrfld_power_down(struct atomisp_device *isp)
        {
        [...]
        	/*WA:Enable DVFS*/
        	if (IS_CHT)
        		punit_ddr_dvfs_enable(true);

        int atomisp_mrfld_power_up(struct atomisp_device *isp)
        {
        [...]
        	/*WA for PUNIT, if DVFS enabled, ISP timeout observed*/
        	if (IS_CHT)
        		punit_ddr_dvfs_enable(false);

This patch fixes the inverted argument as per the intel-aero code, as well as its comment. While here, fix space issues for comments in atomisp_mrfld_power().

Note that it does not seem to be possible to unify the up/down cases for punit_ddr_dvfs_enable(), i.e., we can't do something like the following:

        if (IS_CHT)
        	punit_ddr_dvfs_enable(!enable);

because according to the intel-aero code [1], the DVFS is disabled before "writing 0x0 to ISPSSPM0 bit[1:0]" and the DVFS is enabled after "writing 0x3 to ISPSSPM0 bit[1:0]".

[1] https://github.com/intel-aero/linux-kernel/blob/a1b673258feb915268377275130c5c5df0eafc82/drivers/media/pci/atomisp/atomisp_driver/atomisp_v4l2.c#L431-L514

Fixes 0f441fd70b1e ("media: atomisp: simplify the power down/up code")
---
 drivers/staging/media/atomisp/pci/atomisp_v4l2.c | 8 ++++----
 1 file changed, 4 insertions(+), 4 deletions(-)
drivers/staging/media/atomisp/pci/atomisp_v4l2.c +0 -0
index 0511c454e769..f5362554638e 100644
@@ -711,15 +711,15 @@ static int atomisp_mrfld_power(struct atomisp_device *isp, bool enable)
 
Quoted 6 lines

drivers/staging/media/atomisp/pci/atomisp_v4l2.c static int atomisp_mrfld_power(struct atomisp_device *isp, bool enable) · line 714

Quoted 4 lines
drivers/staging/media/atomisp/pci/atomisp_v4l2.c +1 -1
 	dev_dbg(isp->dev, "IUNIT power-%s.\n", enable ? "on" : "off");
 
-	/*WA:Enable DVFS*/
+	/* WA for PUNIT, if DVFS enabled, ISP timeout observed */

P-Unit

Thanks, I'll fix this next time I send.

Quoted 27 lines
Quoted 26 lines
drivers/staging/media/atomisp/pci/atomisp_v4l2.c +3 -3
 	if (IS_CHT && enable)
-		punit_ddr_dvfs_enable(true);
+		punit_ddr_dvfs_enable(false);
 
 	/*
 	 * FIXME:WA for ECS28A, with this sleep, CTS
 	 * android.hardware.camera2.cts.CameraDeviceTest#testCameraDeviceAbort
 	 * PASS, no impact on other platforms
-	*/
+	 */
 	if (IS_BYT && enable)
 		msleep(10);
 
@@ -727,7 +727,7 @@ static int atomisp_mrfld_power(struct atomisp_device *isp, bool enable)
 	iosf_mbi_modify(BT_MBI_UNIT_PMC, MBI_REG_READ, MRFLD_ISPSSPM0,
 			val, MRFLD_ISPSSPM0_ISPSSC_MASK);
 
-	/*WA:Enable DVFS*/
+	/* WA:Enable DVFS */
 	if (IS_CHT && !enable)
 		punit_ddr_dvfs_enable(true);
 
Signature · 1 line
2.33.1
#5 lore raw

Re: [PATCH 02/17] media: atomisp: pci: fix punit_ddr_dvfs_enable() argument for mrfld_power up case

Quoted 50 lines · Tsuchiya Yuto
Quoted 49 lines · Andy Shevchenko
Quoted 48 lines · Tsuchiya Yuto

When comparing with intel-aero atomisp [1], it looks like punit_ddr_dvfs_enable() should take false as an argument on mrfld_power up case.

Code from the intel-aero kernel [1]:

        int atomisp_mrfld_power_down(struct atomisp_device *isp)
        {
        [...]
        	/*WA:Enable DVFS*/
        	if (IS_CHT)
        		punit_ddr_dvfs_enable(true);

        int atomisp_mrfld_power_up(struct atomisp_device *isp)
        {
        [...]
        	/*WA for PUNIT, if DVFS enabled, ISP timeout observed*/
        	if (IS_CHT)
        		punit_ddr_dvfs_enable(false);

This patch fixes the inverted argument as per the intel-aero code, as well as its comment. While here, fix space issues for comments in atomisp_mrfld_power().

Note that it does not seem to be possible to unify the up/down cases for punit_ddr_dvfs_enable(), i.e., we can't do something like the following:

        if (IS_CHT)
        	punit_ddr_dvfs_enable(!enable);

because according to the intel-aero code [1], the DVFS is disabled before "writing 0x0 to ISPSSPM0 bit[1:0]" and the DVFS is enabled after "writing 0x3 to ISPSSPM0 bit[1:0]".

[1] https://github.com/intel-aero/linux-kernel/blob/a1b673258feb915268377275130c5c5df0eafc82/drivers/media/pci/atomisp/atomisp_driver/atomisp_v4l2.c#L431-L514

Fixes 0f441fd70b1e ("media: atomisp: simplify the power down/up code")
---
 drivers/staging/media/atomisp/pci/atomisp_v4l2.c | 8 ++++----
 1 file changed, 4 insertions(+), 4 deletions(-)
drivers/staging/media/atomisp/pci/atomisp_v4l2.c +0 -0
index 0511c454e769..f5362554638e 100644
@@ -711,15 +711,15 @@ static int atomisp_mrfld_power(struct atomisp_device *isp, bool enable)
 
Quoted 8 lines
Quoted 6 lines

drivers/staging/media/atomisp/pci/atomisp_v4l2.c static int atomisp_mrfld_power(struct atomisp_device *isp, bool enable) · line 714

Quoted 4 lines
drivers/staging/media/atomisp/pci/atomisp_v4l2.c +1 -1
 	dev_dbg(isp->dev, "IUNIT power-%s.\n", enable ? "on" : "off");
 
-	/*WA:Enable DVFS*/
+	/* WA for PUNIT, if DVFS enabled, ISP timeout observed */

P-Unit

Thanks, I'll fix this next time I send.

For the record, this is already fixed in the latest media_stage tree.

Quoted 28 lines
Quoted 27 lines
Quoted 26 lines
drivers/staging/media/atomisp/pci/atomisp_v4l2.c +3 -3
 	if (IS_CHT && enable)
-		punit_ddr_dvfs_enable(true);
+		punit_ddr_dvfs_enable(false);
 
 	/*
 	 * FIXME:WA for ECS28A, with this sleep, CTS
 	 * android.hardware.camera2.cts.CameraDeviceTest#testCameraDeviceAbort
 	 * PASS, no impact on other platforms
-	*/
+	 */
 	if (IS_BYT && enable)
 		msleep(10);
 
@@ -727,7 +727,7 @@ static int atomisp_mrfld_power(struct atomisp_device *isp, bool enable)
 	iosf_mbi_modify(BT_MBI_UNIT_PMC, MBI_REG_READ, MRFLD_ISPSSPM0,
 			val, MRFLD_ISPSSPM0_ISPSSC_MASK);
 
-	/*WA:Enable DVFS*/
+	/* WA:Enable DVFS */
 	if (IS_CHT && !enable)
 		punit_ddr_dvfs_enable(true);
 
Signature · 1 line
2.33.1
#6 lore raw

Re: [PATCH 02/17] media: atomisp: pci: fix punit_ddr_dvfs_enable() argument for mrfld_power up case

In reply to Tsuchiya Yuto
Quoted 52 lines · Tsuchiya Yuto

When comparing with intel-aero atomisp [1], it looks like punit_ddr_dvfs_enable() should take false as an argument on mrfld_power up case.

Code from the intel-aero kernel [1]:

        int atomisp_mrfld_power_down(struct atomisp_device *isp)
        {
        [...]
        	/*WA:Enable DVFS*/
        	if (IS_CHT)
        		punit_ddr_dvfs_enable(true);

        int atomisp_mrfld_power_up(struct atomisp_device *isp)
        {
        [...]
        	/*WA for PUNIT, if DVFS enabled, ISP timeout observed*/
        	if (IS_CHT)
        		punit_ddr_dvfs_enable(false);

This patch fixes the inverted argument as per the intel-aero code, as well as its comment. While here, fix space issues for comments in atomisp_mrfld_power().

Note that it does not seem to be possible to unify the up/down cases for punit_ddr_dvfs_enable(), i.e., we can't do something like the following:

        if (IS_CHT)
        	punit_ddr_dvfs_enable(!enable);

because according to the intel-aero code [1], the DVFS is disabled before "writing 0x0 to ISPSSPM0 bit[1:0]" and the DVFS is enabled after "writing 0x3 to ISPSSPM0 bit[1:0]".

[1] https://github.com/intel-aero/linux-kernel/blob/a1b673258feb915268377275130c5c5df0eafc82/drivers/media/pci/atomisp/atomisp_driver/atomisp_v4l2.c#L431-L514

Fixes 0f441fd70b1e ("media: atomisp: simplify the power down/up code")
---
 drivers/staging/media/atomisp/pci/atomisp_v4l2.c | 8 ++++----
 1 file changed, 4 insertions(+), 4 deletions(-)
drivers/staging/media/atomisp/pci/atomisp_v4l2.c +1 -1
index 0511c454e769..f5362554638e 100644
@@ -711,15 +711,15 @@ static int atomisp_mrfld_power(struct atomisp_device *isp, bool enable)
 
 	dev_dbg(isp->dev, "IUNIT power-%s.\n", enable ? "on" : "off");
 
-	/*WA:Enable DVFS*/
+	/* WA for PUNIT, if DVFS enabled, ISP timeout observed */

drivers/staging/media/atomisp/pci/atomisp_v4l2.c static int atomisp_mrfld_power(struct atomisp_device *isp, bool enable) · line 722

Quoted 10 lines
drivers/staging/media/atomisp/pci/atomisp_v4l2.c +2 -2
 	if (IS_CHT && enable)
-		punit_ddr_dvfs_enable(true);
+		punit_ddr_dvfs_enable(false);
 
 	/*
 	 * FIXME:WA for ECS28A, with this sleep, CTS
 	 * android.hardware.camera2.cts.CameraDeviceTest#testCameraDeviceAbort
 	 * PASS, no impact on other platforms
-	*/
+	 */
        ^^^

drivers/staging/media/atomisp/pci/atomisp_v4l2.c static int atomisp_mrfld_power(struct atomisp_device *isp, bool enable) · line 730

Quoted 9 lines
drivers/staging/media/atomisp/pci/atomisp_v4l2.c +1 -1
 	if (IS_BYT && enable)
 		msleep(10);
 
@@ -727,7 +727,7 @@ static int atomisp_mrfld_power(struct atomisp_device *isp, bool enable)
 	iosf_mbi_modify(BT_MBI_UNIT_PMC, MBI_REG_READ, MRFLD_ISPSSPM0,
 			val, MRFLD_ISPSSPM0_ISPSSC_MASK);
 
-	/*WA:Enable DVFS*/
+	/* WA:Enable DVFS */
        ^^^^^^^^^^^^^^^^^^^

These two white space changes are unrelated. Please do them in a separate patch.

regards,
dan carpenter

#7 lore raw

Re: [PATCH 02/17] media: atomisp: pci: fix punit_ddr_dvfs_enable() argument for mrfld_power up case

Quoted 72 lines · Dan Carpenter
Quoted 52 lines · Tsuchiya Yuto

When comparing with intel-aero atomisp [1], it looks like punit_ddr_dvfs_enable() should take false as an argument on mrfld_power up case.

Code from the intel-aero kernel [1]:

        int atomisp_mrfld_power_down(struct atomisp_device *isp)
        {
        [...]
        	/*WA:Enable DVFS*/
        	if (IS_CHT)
        		punit_ddr_dvfs_enable(true);

        int atomisp_mrfld_power_up(struct atomisp_device *isp)
        {
        [...]
        	/*WA for PUNIT, if DVFS enabled, ISP timeout observed*/
        	if (IS_CHT)
        		punit_ddr_dvfs_enable(false);

This patch fixes the inverted argument as per the intel-aero code, as well as its comment. While here, fix space issues for comments in atomisp_mrfld_power().

Note that it does not seem to be possible to unify the up/down cases for punit_ddr_dvfs_enable(), i.e., we can't do something like the following:

        if (IS_CHT)
        	punit_ddr_dvfs_enable(!enable);

because according to the intel-aero code [1], the DVFS is disabled before "writing 0x0 to ISPSSPM0 bit[1:0]" and the DVFS is enabled after "writing 0x3 to ISPSSPM0 bit[1:0]".

[1] https://github.com/intel-aero/linux-kernel/blob/a1b673258feb915268377275130c5c5df0eafc82/drivers/media/pci/atomisp/atomisp_driver/atomisp_v4l2.c#L431-L514

Fixes 0f441fd70b1e ("media: atomisp: simplify the power down/up code")
---
 drivers/staging/media/atomisp/pci/atomisp_v4l2.c | 8 ++++----
 1 file changed, 4 insertions(+), 4 deletions(-)
drivers/staging/media/atomisp/pci/atomisp_v4l2.c +1 -1
index 0511c454e769..f5362554638e 100644
@@ -711,15 +711,15 @@ static int atomisp_mrfld_power(struct atomisp_device *isp, bool enable)
 
 	dev_dbg(isp->dev, "IUNIT power-%s.\n", enable ? "on" : "off");
 
-	/*WA:Enable DVFS*/
+	/* WA for PUNIT, if DVFS enabled, ISP timeout observed */

drivers/staging/media/atomisp/pci/atomisp_v4l2.c static int atomisp_mrfld_power(struct atomisp_device *isp, bool enable) · line 722

Quoted 10 lines
drivers/staging/media/atomisp/pci/atomisp_v4l2.c +2 -2
 	if (IS_CHT && enable)
-		punit_ddr_dvfs_enable(true);
+		punit_ddr_dvfs_enable(false);
 
 	/*
 	 * FIXME:WA for ECS28A, with this sleep, CTS
 	 * android.hardware.camera2.cts.CameraDeviceTest#testCameraDeviceAbort
 	 * PASS, no impact on other platforms
-	*/
+	 */
        ^^^
Quoted 7 lines
drivers/staging/media/atomisp/pci/atomisp_v4l2.c +0 -0
 	if (IS_BYT && enable)
 		msleep(10);
 
@@ -727,7 +727,7 @@ static int atomisp_mrfld_power(struct atomisp_device *isp, bool enable)
 	iosf_mbi_modify(BT_MBI_UNIT_PMC, MBI_REG_READ, MRFLD_ISPSSPM0,
 			val, MRFLD_ISPSSPM0_ISPSSC_MASK);
 
Quoted 5 lines

drivers/staging/media/atomisp/pci/atomisp_v4l2.c static int atomisp_mrfld_power(struct atomisp_device *isp, bool enable) · line 730

Quoted 2 lines
drivers/staging/media/atomisp/pci/atomisp_v4l2.c +1 -1
-	/*WA:Enable DVFS*/
+	/* WA:Enable DVFS */
        ^^^^^^^^^^^^^^^^^^^

These two white space changes are unrelated. Please do them in a separate patch.

Thank you for the review :-)

I thought these space fixes were too trivial for a separate patch, so I made the fix while at it. I have no strong reason not to separate the space fix. I'll do so in v2.

Regards,
Tsuchiya Yuto

#8 lore raw

Re: [PATCH 02/17] media: atomisp: pci: fix punit_ddr_dvfs_enable() argument for mrfld_power up case

Quoted 35 lines · Tsuchiya Yuto
Quoted 29 lines
Quoted 10 lines
drivers/staging/media/atomisp/pci/atomisp_v4l2.c +1 -1
index 0511c454e769..f5362554638e 100644
@@ -711,15 +711,15 @@ static int atomisp_mrfld_power(struct atomisp_device *isp, bool enable)
 
 	dev_dbg(isp->dev, "IUNIT power-%s.\n", enable ? "on" : "off");
 
-	/*WA:Enable DVFS*/
+	/* WA for PUNIT, if DVFS enabled, ISP timeout observed */

drivers/staging/media/atomisp/pci/atomisp_v4l2.c static int atomisp_mrfld_power(struct atomisp_device *isp, bool enable) · line 722

Quoted 10 lines
drivers/staging/media/atomisp/pci/atomisp_v4l2.c +2 -2
 	if (IS_CHT && enable)
-		punit_ddr_dvfs_enable(true);
+		punit_ddr_dvfs_enable(false);
 
 	/*
 	 * FIXME:WA for ECS28A, with this sleep, CTS
 	 * android.hardware.camera2.cts.CameraDeviceTest#testCameraDeviceAbort
 	 * PASS, no impact on other platforms
-	*/
+	 */
        ^^^
Quoted 7 lines
drivers/staging/media/atomisp/pci/atomisp_v4l2.c +0 -0
 	if (IS_BYT && enable)
 		msleep(10);
 
@@ -727,7 +727,7 @@ static int atomisp_mrfld_power(struct atomisp_device *isp, bool enable)
 	iosf_mbi_modify(BT_MBI_UNIT_PMC, MBI_REG_READ, MRFLD_ISPSSPM0,
 			val, MRFLD_ISPSSPM0_ISPSSC_MASK);
 
Quoted 5 lines

drivers/staging/media/atomisp/pci/atomisp_v4l2.c static int atomisp_mrfld_power(struct atomisp_device *isp, bool enable) · line 730

Quoted 2 lines
drivers/staging/media/atomisp/pci/atomisp_v4l2.c +1 -1
-	/*WA:Enable DVFS*/
+	/* WA:Enable DVFS */
        ^^^^^^^^^^^^^^^^^^^

These two white space changes are unrelated. Please do them in a separate patch.

Quoted 5 lines

Thank you for the review :-)

I thought these space fixes were too trivial for a separate patch, so I made the fix while at it. I have no strong reason not to separate the space fix. I'll do so in v2.

Trivial white space patches are fine. We get thousands of those.

This goes through Mauro's tree instead of Greg's and he is definitely more flexible than Greg. Plus the atomisp stuff is broken so no one cares.

But the rules are really clear and it does help in reviewing when people follow them.

When I'm reviewing this patch, the patch description says it is a fix so I review that differently. The fix is very simple and it changes true to false.

The other patch would have been a "change comments" patch. We get thousands of those as I mentioned. My concern there is that a UMN researcher will try to trick us by hiding code in a "change comments" patch so I have a script to review those. It takes one second to run.

But then when I was reviewing this patch I first had to spot the change from true to false before I could review it. That's where most of the time was wasted.

regards,
dan carpenter

#9 lore raw

PATCH 3/17 media: atomisp: pci: fix inverted logic in buffers_needed()

In reply to Tsuchiya Yuto

When config.mode is IA_CSS_INPUT_MODE_BUFFERED_SENSOR, it rather needs buffers. Fix it by inverting the return value.

Fixes 3c0538fbad9f ("media: atomisp: get rid of most checks for ISP2401 version")
---
 drivers/staging/media/atomisp/pci/sh_css_mipi.c | 8 ++++----
 1 file changed, 4 insertions(+), 4 deletions(-)
drivers/staging/media/atomisp/pci/sh_css_mipi.c +4 -4
index 75489f7d75ee..483d40a467c7 100644
@@ -374,17 +374,17 @@ static bool buffers_needed(struct ia_css_pipe *pipe)
 {
 	if (!IS_ISP2401) {
 		if (pipe->stream->config.mode == IA_CSS_INPUT_MODE_BUFFERED_SENSOR)
-			return false;
-		else
 			return true;
+		else
+			return false;
 	}
 
 	if (pipe->stream->config.mode == IA_CSS_INPUT_MODE_BUFFERED_SENSOR ||
 	    pipe->stream->config.mode == IA_CSS_INPUT_MODE_TPG ||
 	    pipe->stream->config.mode == IA_CSS_INPUT_MODE_PRBS)
-		return false;
+		return true;
 
-	return true;
+	return false;
 }
 
 int
Signature · 1 line
2.33.1
#10 lore raw

PATCH 4/17 media: atomisp: pci: do not use err var when checking port validity for ISP2400

In reply to Tsuchiya Yuto

Currently, the port >= N_CSI_PORTS || err checks for ISP2400 are always evaluated as true because the err variable is set to -EINVAL on declaration but the variable is never used until the evaluation.

Looking at the diff of commit 3c0538fbad9f ("media: atomisp: get rid of most checks for ISP2401 version"), the port >= N_CSI_PORTS check is for ISP2400 and the err variable check is for ISP2401. Fix this issue by adding ISP version test there accordingly.

Yes, there are other better ways to fix this issue, like adding support for ISP2400 to ia_css_mipi_is_source_port_valid(). In this way, we can unify the following test:

	if (!IS_ISP2401)
		port = (unsigned int)pipe->stream->config.source.port.port;
	else
		err = ia_css_mipi_is_source_port_valid(pipe, &port);

However, the IS_ISP2401 test here (formerly ifdef ISP2401) is not a result of real hardware difference, but just a result of the following two different versions of driver merged by tools [1]:

- ISP2400: irci_stable_candrpv_0415_20150521_0458
- ISP2401: irci_ecr-master_20150911_0724

We should eventually remove (not unify) such tests caused by just a driver version difference and use just one version of driver. So, for now, let's avoid further unification.

[1] The function ia_css_mipi_is_source_port_valid() and its usage is

    added on updating css version to irci_master_20150701_0213
    https://raw.githubusercontent.com/intel/ProductionKernelQuilts/cht-m1stable-2016_ww31/uefi/cht-m1stable/patches/cam-0439-atomisp2-css2401-and-2401_legacy-irci_master_2015070.patch
    ("atomisp2: css2401 and 2401_legacy-irci_master_20150701_0213")
Fixes 3c0538fbad9f ("media: atomisp: get rid of most checks for ISP2401 version")
---
 drivers/staging/media/atomisp/pci/sh_css_mipi.c | 9 ++++++---
 1 file changed, 6 insertions(+), 3 deletions(-)
drivers/staging/media/atomisp/pci/sh_css_mipi.c +6 -3
index 483d40a467c7..65fc93c5d56b 100644
@@ -430,7 +430,8 @@ allocate_mipi_frames(struct ia_css_pipe *pipe,
 
 	assert(port < N_CSI_PORTS);
 
-	if (port >= N_CSI_PORTS || err) {
+	if ((!IS_ISP2401 && port >= N_CSI_PORTS) ||
+	    (IS_ISP2401 && err)) {
 		ia_css_debug_dtrace(IA_CSS_DEBUG_TRACE_PRIVATE,
 				    "allocate_mipi_frames(%p) exit: error: port is not correct (port=%d).\n",
 				    pipe, port);
@@ -559,7 +560,8 @@ free_mipi_frames(struct ia_css_pipe *pipe)
 
 		assert(port < N_CSI_PORTS);
 
-		if (port >= N_CSI_PORTS || err) {
+		if ((!IS_ISP2401 && port >= N_CSI_PORTS) ||
+		    (IS_ISP2401 && err)) {
 			ia_css_debug_dtrace(IA_CSS_DEBUG_TRACE_PRIVATE,
 					    "free_mipi_frames(%p, %d) exit: error: pipe port is not correct.\n",
 					    pipe, port);
@@ -670,7 +672,8 @@ send_mipi_frames(struct ia_css_pipe *pipe)
 
 	assert(port < N_CSI_PORTS);
 
-	if (port >= N_CSI_PORTS || err) {
+	if ((!IS_ISP2401 && port >= N_CSI_PORTS) ||
+	    (IS_ISP2401 && err)) {
 		IA_CSS_ERROR("send_mipi_frames(%p) exit: invalid port specified (port=%d).\n",
 			     pipe, port);
 		return err;
Signature · 1 line
2.33.1
#11 lore raw

Re: [PATCH 04/17] media: atomisp: pci: do not use err var when checking port validity for ISP2400

Em Mon, 18 Oct 2021 01:19:44 +0900
Tsuchiya Yuto <[email protected]> escreveu:

Quoted 18 lines

Currently, the port >= N_CSI_PORTS || err checks for ISP2400 are always evaluated as true because the err variable is set to -EINVAL on declaration but the variable is never used until the evaluation.

Looking at the diff of commit 3c0538fbad9f ("media: atomisp: get rid of most checks for ISP2401 version"), the port >= N_CSI_PORTS check is for ISP2400 and the err variable check is for ISP2401. Fix this issue by adding ISP version test there accordingly.

Yes, there are other better ways to fix this issue, like adding support for ISP2400 to ia_css_mipi_is_source_port_valid(). In this way, we can unify the following test:

	if (!IS_ISP2401)
		port = (unsigned int)pipe->stream->config.source.port.port;
	else
		err = ia_css_mipi_is_source_port_valid(pipe, &port);
Quoted 6 lines

However, the IS_ISP2401 test here (formerly ifdef ISP2401) is not a result of real hardware difference, but just a result of the following two different versions of driver merged by tools [1]:

- ISP2400: irci_stable_candrpv_0415_20150521_0458
- ISP2401: irci_ecr-master_20150911_0724

No.

While I don't have any internal information from the hardware manufacturer, I guess you misinterpreted things here. 2400 and 2401 are different hardware versions. See atomisp_pci_probe() logic.

Basically, Cherrytail and Anniedale comes with 2401. Older Atom CPUs (Merrifield and Baytrail) comes with 2400.

Quoted 8 lines

We should eventually remove (not unify) such tests caused by just a driver version difference and use just one version of driver. So, for now, let's avoid further unification.

[1] The function ia_css_mipi_is_source_port_valid() and its usage is

    added on updating css version to irci_master_20150701_0213
    https://raw.githubusercontent.com/intel/ProductionKernelQuilts/cht-m1stable-2016_ww31/uefi/cht-m1stable/patches/cam-0439-atomisp2-css2401-and-2401_legacy-irci_master_2015070.patch
    ("atomisp2: css2401 and 2401_legacy-irci_master_20150701_0213")

What happens is that there is a 2401 and a 2401 "legacy". It sounds that this due to some different software stacks that are reflected both at the firmware and at the driver.

-

On other words, this patch requires some rework, as otherwise it will break support for Baytrail.

Also, patch 13 should be dropped, as the firmware versions for 2400 are different - and maybe patches 8 to 12 may need more work in order to not touch 2400.

Regards,
Mauro

#12 lore raw

Re: [PATCH 04/17] media: atomisp: pci: do not use err var when checking port validity for ISP2400

<Adding back people/list to Cc>

Quoted 28 lines · Mauro Carvalho Chehab

Em Mon, 18 Oct 2021 01:19:44 +0900
Tsuchiya Yuto <[email protected]> escreveu:

Quoted 18 lines

Currently, the port >= N_CSI_PORTS || err checks for ISP2400 are always evaluated as true because the err variable is set to -EINVAL on declaration but the variable is never used until the evaluation.

Looking at the diff of commit 3c0538fbad9f ("media: atomisp: get rid of most checks for ISP2401 version"), the port >= N_CSI_PORTS check is for ISP2400 and the err variable check is for ISP2401. Fix this issue by adding ISP version test there accordingly.

Yes, there are other better ways to fix this issue, like adding support for ISP2400 to ia_css_mipi_is_source_port_valid(). In this way, we can unify the following test:

	if (!IS_ISP2401)
		port = (unsigned int)pipe->stream->config.source.port.port;
	else
		err = ia_css_mipi_is_source_port_valid(pipe, &port);
Quoted 6 lines

However, the IS_ISP2401 test here (formerly ifdef ISP2401) is not a result of real hardware difference, but just a result of the following two different versions of driver merged by tools [1]:

- ISP2400: irci_stable_candrpv_0415_20150521_0458
- ISP2401: irci_ecr-master_20150911_0724

Quoted 8 lines

No.

While I don't have any internal information from the hardware manufacturer, I guess you misinterpreted things here. 2400 and 2401 are different hardware versions. See atomisp_pci_probe() logic.

Basically, Cherrytail and Anniedale comes with 2401. Older Atom CPUs (Merrifield and Baytrail) comes with 2400.

Yes, indeed, 2400 and 2401 are different hardware. When they (I mean who originally wrote atomisp driver non-upstream) needed to distinguish between ISP2400 and ISP2401, they used the ifdefs like the following:

- USE_INPUT_SYSTEM_VERSION_2 (for both ISP2400/ISP2401)
- USE_INPUT_SYSTEM_VERSION_2401 (for ISP2401)
...

I think this is a sign that the atomisp driver supports both ISP2400/ISP2401 in a single version.

Indeed, the upstreamed atomisp uses irci_stable_candrpv_0415_20150521_0458 for ISP2400 and IIUC it was working on Bay Trail. On the other hand, intel-aero is a kernel for Cherry Trail and uses the same version irci_stable_candrpv_0415_20150521_0458.

So, both ISP version ISP2400/ISP2401 can be supported by a single driver version.

Quoted 4 lines
Quoted 4 lines

We should eventually remove (not unify) such tests caused by just a driver version difference and use just one version of driver. So, for now, let's avoid further unification.

Quoted 8 lines
Quoted 4 lines

[1] The function ia_css_mipi_is_source_port_valid() and its usage is

    added on updating css version to irci_master_20150701_0213
    https://raw.githubusercontent.com/intel/ProductionKernelQuilts/cht-m1stable-2016_ww31/uefi/cht-m1stable/patches/cam-0439-atomisp2-css2401-and-2401_legacy-irci_master_2015070.patch
    ("atomisp2: css2401 and 2401_legacy-irci_master_20150701_0213")

What happens is that there is a 2401 and a 2401 "legacy". It sounds that this due to some different software stacks that are reflected both at the firmware and at the driver.

Yeah, I'm not sure what the "legacy" is. It might be a reference of ISP2401_NEW_INPUT_SYSTEM (css_2401_csi2p_system) and non-ISP2401_NEW_INPUT_SYSTEM (css_2401_system).

Quoted 4 lines

-

On other words, this patch requires some rework, as otherwise it will break support for Baytrail.

You mean "this patch"? then, I intended this patch is rather a fix for ISP2400 case! The err variable for ISP2400 case is always true because it is not used before the error check:

int
allocate_mipi_frames(struct ia_css_pipe *pipe,
struct ia_css_stream_info *info)
{
int err = -EINVAL;
[...]

        	if (!IS_ISP2401)
        		port = (unsigned int)pipe->stream->config.source.port.port;
        	else
        		err = ia_css_mipi_is_source_port_valid(pipe, &port);
        
        	assert(port < N_CSI_PORTS);
        
        	if (port >= N_CSI_PORTS || err) {
        		ia_css_debug_dtrace(IA_CSS_DEBUG_TRACE_PRIVATE,
        				    "allocate_mipi_frames(%p) exit: error: port is not correct (port=%d).\n",
        				    pipe, port);
        		return -EINVAL;
        	}

The first usage of err variable is ia_css_mipi_is_source_port_valid() for IS_ISP2401 case, but it's not used for ISP2400 case. This causes the evaluation port >= N_CSI_PORTS || err always true for ISP2400 case, meaning it will be always treated as a error.

Quoted 2 lines

Also, patch 13 should be dropped, as the firmware versions for 2400 are different

The firmware version for 2400 on the upstreamed atomisp is irci_stable_candrpv_0415_20150521_0458 :-)

        static const char *isp2400_release_version = STR(irci_stable_candrpv_0415_20150521_0458);
        static const char *isp2401_release_version = STR(irci_ecr - master_20150911_0724);

The intention of that patch is rather, it clarifies ISP2401 is now using the same driver (css) version as ISP2400.

Quoted 2 lines

- and maybe patches 8 to 12 may need more work in order to not touch 2400.

Those patches do not break ISP2400, because what they do for ISP2400 is that, they remove members from structs which were initially inside of ifdef ISP2401. And because these removed members were initially inside of the ifdefs, the usage was also inside the ifdefs.

Regards,
Tsuchiya Yuto

#13 lore raw

Re: [PATCH 04/17] media: atomisp: pci: do not use err var when checking port validity for ISP2400

Em Thu, 28 Oct 2021 13:12:45 +0900
Tsuchiya Yuto <[email protected]> escreveu:

Quoted 44 lines

<Adding back people/list to Cc>

Quoted 28 lines · Mauro Carvalho Chehab

Em Mon, 18 Oct 2021 01:19:44 +0900
Tsuchiya Yuto <[email protected]> escreveu:

Quoted 18 lines

Currently, the port >= N_CSI_PORTS || err checks for ISP2400 are always evaluated as true because the err variable is set to -EINVAL on declaration but the variable is never used until the evaluation.

Looking at the diff of commit 3c0538fbad9f ("media: atomisp: get rid of most checks for ISP2401 version"), the port >= N_CSI_PORTS check is for ISP2400 and the err variable check is for ISP2401. Fix this issue by adding ISP version test there accordingly.

Yes, there are other better ways to fix this issue, like adding support for ISP2400 to ia_css_mipi_is_source_port_valid(). In this way, we can unify the following test:

	if (!IS_ISP2401)
		port = (unsigned int)pipe->stream->config.source.port.port;
	else
		err = ia_css_mipi_is_source_port_valid(pipe, &port);
Quoted 6 lines

However, the IS_ISP2401 test here (formerly ifdef ISP2401) is not a result of real hardware difference, but just a result of the following two different versions of driver merged by tools [1]:

- ISP2400: irci_stable_candrpv_0415_20150521_0458
- ISP2401: irci_ecr-master_20150911_0724

Quoted 8 lines

No.

While I don't have any internal information from the hardware manufacturer, I guess you misinterpreted things here. 2400 and 2401 are different hardware versions. See atomisp_pci_probe() logic.

Basically, Cherrytail and Anniedale comes with 2401. Older Atom CPUs (Merrifield and Baytrail) comes with 2400.

Yes, indeed, 2400 and 2401 are different hardware. When they (I mean who originally wrote atomisp driver non-upstream) needed to distinguish between ISP2400 and ISP2401, they used the ifdefs like the following:

Quoted 6 lines

- USE_INPUT_SYSTEM_VERSION_2 (for both ISP2400/ISP2401)
- USE_INPUT_SYSTEM_VERSION_2401 (for ISP2401)
...

I think this is a sign that the atomisp driver supports both ISP2400/ISP2401 in a single version.

Yes, the driver was written to support both, but it is not that simple.

As far as I heard, the downstream version used some code generator to produce both the firmware and the driver. Those evaluate internally some of the vars. What Alan seems to have done is to generate both ISP2400 and ISP2401 versions and then merge them into a single code, adding the ISP2400 version check.

If you look at the initial committed patch, you'll see things like:

	$ git show a49d25364dfb9f8a64037488a39ab1f56c5fa419
...
	+#ifdef ISP2401
	+
	+#endif

That clearly shows that some tool merged both CSP2400 and 2401 variants into a single driver.

I did a large re-work of converting such ifdefs into runtime if's, as the end goal is to be able have support for both BYT and CHT code compiled at the time time, having the decision of enabling/disabling the needed features in runtime.

This is not complete, though, as there's still a compile-time variable to select the CHT variant: VIDEO_ATOMISP_ISP2401.

I would love to completely get rid of that, but the remaining bits require to be able to test it on both BYT and CHT variants.

-

Now, if we look at the #ifdefs of the original upstreamed version, clearly some of the changes are just improvements on the driver (some are related to the addition of an error-check, for instance), while others seem to be related to different hardware features (like some related to the clock frequencies).

However, for most part, it is almost impossible to know if they're due to a different firmware version or due to different hardware features.

Quoted 2 lines

Indeed, the upstreamed atomisp uses irci_stable_candrpv_0415_20150521_0458 for ISP2400 and IIUC it was working on Bay Trail.

Had you test it on BYT? On what hardware?

Btw, it would help a lot if you could describe exactly what tools are you using to test. That would allow us to also test it on our hardware.

Quoted 3 lines

On the other hand,
intel-aero is a kernel for Cherry Trail and uses the same version irci_stable_candrpv_0415_20150521_0458.

See the Alan's original comment:

+7. The ISP code depends on the exact FW version. The version defined in
+ BYT:
+ drivers/staging/media/atomisp/pci/atomisp2/css2400/sh_css_firmware.c
+ static const char *release_version = STR(irci_stable_candrpv_0415_20150521_0458);
+ CHT:
+ drivers/staging/media/atomisp/pci/atomisp2/css/sh_css_firmware.c
+ static const char *release_version = STR(irci_ecr-master_20150911_0724);
+
+ At some point we may need to round up a few driver versions and see if
+ there are any specific things that can be done to fold in support for
+ multiple firmware versions.

He clearly created it with a different firmware for CHT. Yet, nobody were able to find the exact firmware he used. So, I ended changing some parts of the driver to become closer to the one used by Intel Aero, as the firmware for it is easy to retrieve.

Btw, even if BYT and CHT firmware were produced against the same version of the generator toolset, it doesn't necessarily mean that they're identical.

Quoted 3 lines

So, both ISP version ISP2400/ISP2401 can be supported by a single driver version.

Yes, but they needed to be compiled with a different option right now, as the register addresses are different. That's basically the main reason for VIDEO_ATOMISP_ISP2401 Kconfig option: to select between ISP2400/candrpv register map and ISP2401/ecr-master register map.

Not clear yet if those differences are just due to different firmware versions, just due to different hardware versions or both.

Quoted 9 lines
Quoted 9 lines
Quoted 8 lines

We should eventually remove (not unify) such tests caused by just a driver version difference and use just one version of driver. So, for now, let's avoid further unification.

[1] The function ia_css_mipi_is_source_port_valid() and its usage is

    added on updating css version to irci_master_20150701_0213
    https://raw.githubusercontent.com/intel/ProductionKernelQuilts/cht-m1stable-2016_ww31/uefi/cht-m1stable/patches/cam-0439-atomisp2-css2401-and-2401_legacy-irci_master_2015070.patch
    ("atomisp2: css2401 and 2401_legacy-irci_master_20150701_0213")  
Quoted 7 lines
Quoted 3 lines

What happens is that there is a 2401 and a 2401 "legacy". It sounds that this due to some different software stacks that are reflected both at the firmware and at the driver.

Yeah, I'm not sure what the "legacy" is. It might be a reference of ISP2401_NEW_INPUT_SYSTEM (css_2401_csi2p_system) and non-ISP2401_NEW_INPUT_SYSTEM (css_2401_system).

Maybe.

Quoted 30 lines
Quoted 5 lines

-

On other words, this patch requires some rework, as otherwise it will break support for Baytrail.

You mean "this patch"? then, I intended this patch is rather a fix for ISP2400 case! The err variable for ISP2400 case is always true because it is not used before the error check:

int
allocate_mipi_frames(struct ia_css_pipe *pipe,
struct ia_css_stream_info *info)
{
int err = -EINVAL;
[...]

        	if (!IS_ISP2401)
        		port = (unsigned int)pipe->stream->config.source.port.port;
        	else
        		err = ia_css_mipi_is_source_port_valid(pipe, &port);
        
        	assert(port < N_CSI_PORTS);
        
        	if (port >= N_CSI_PORTS || err) {
        		ia_css_debug_dtrace(IA_CSS_DEBUG_TRACE_PRIVATE,
        				    "allocate_mipi_frames(%p) exit: error: port is not correct (port=%d).\n",
        				    pipe, port);
        		return -EINVAL;
        	}
Quoted 4 lines

The first usage of err variable is ia_css_mipi_is_source_port_valid() for IS_ISP2401 case, but it's not used for ISP2400 case. This causes the evaluation port >= N_CSI_PORTS || err always true for ISP2400 case, meaning it will be always treated as a error.

Ok. So, please make it clearer at the description.

Quoted 4 lines
Quoted 3 lines

Also, patch 13 should be dropped, as the firmware versions for 2400 are different

Quoted 8 lines

The firmware version for 2400 on the upstreamed atomisp is irci_stable_candrpv_0415_20150521_0458 :-)

        static const char *isp2400_release_version = STR(irci_stable_candrpv_0415_20150521_0458);
        static const char *isp2401_release_version = STR(irci_ecr - master_20150911_0724);

The intention of that patch is rather, it clarifies ISP2401 is now using the same driver (css) version as ISP2400.

Ok, I see the point. Yeah, using a single release version makes things better.

Quoted 8 lines
Quoted 3 lines

- and maybe patches 8 to 12 may need more work in order to not touch 2400.

Those patches do not break ISP2400, because what they do for ISP2400 is that, they remove members from structs which were initially inside of ifdef ISP2401. And because these removed members were initially inside of the ifdefs, the usage was also inside the ifdefs.

Had you test them with both ISP2400 and ISP2401 hardware?

Did you compile with both VIDEO_ATOMISP_ISP2401 enabled and disabled?

Regards,
Mauro

#14 lore raw

Re: [PATCH 04/17] media: atomisp: pci: do not use err var when checking port validity for ISP2400

In reply to Tsuchiya Yuto

Em Thu, 28 Oct 2021 13:12:45 +0900
Tsuchiya Yuto <[email protected]> escreveu:

Quoted 44 lines

<Adding back people/list to Cc>

Quoted 28 lines · Mauro Carvalho Chehab

Em Mon, 18 Oct 2021 01:19:44 +0900
Tsuchiya Yuto <[email protected]> escreveu:

Quoted 18 lines

Currently, the port >= N_CSI_PORTS || err checks for ISP2400 are always evaluated as true because the err variable is set to -EINVAL on declaration but the variable is never used until the evaluation.

Looking at the diff of commit 3c0538fbad9f ("media: atomisp: get rid of most checks for ISP2401 version"), the port >= N_CSI_PORTS check is for ISP2400 and the err variable check is for ISP2401. Fix this issue by adding ISP version test there accordingly.

Yes, there are other better ways to fix this issue, like adding support for ISP2400 to ia_css_mipi_is_source_port_valid(). In this way, we can unify the following test:

	if (!IS_ISP2401)
		port = (unsigned int)pipe->stream->config.source.port.port;
	else
		err = ia_css_mipi_is_source_port_valid(pipe, &port);
Quoted 6 lines

However, the IS_ISP2401 test here (formerly ifdef ISP2401) is not a result of real hardware difference, but just a result of the following two different versions of driver merged by tools [1]:

- ISP2400: irci_stable_candrpv_0415_20150521_0458
- ISP2401: irci_ecr-master_20150911_0724

Quoted 8 lines

No.

While I don't have any internal information from the hardware manufacturer, I guess you misinterpreted things here. 2400 and 2401 are different hardware versions. See atomisp_pci_probe() logic.

Basically, Cherrytail and Anniedale comes with 2401. Older Atom CPUs (Merrifield and Baytrail) comes with 2400.

Yes, indeed, 2400 and 2401 are different hardware. When they (I mean who originally wrote atomisp driver non-upstream) needed to distinguish between ISP2400 and ISP2401, they used the ifdefs like the following:

Quoted 6 lines

- USE_INPUT_SYSTEM_VERSION_2 (for both ISP2400/ISP2401)
- USE_INPUT_SYSTEM_VERSION_2401 (for ISP2401)
...

I think this is a sign that the atomisp driver supports both ISP2400/ISP2401 in a single version.

Actually, supporting both on a single version is part of Alan's work.

It seems he used the generation tool to produce a version for 2400, and then re-used it to generate for 2401. It then used some scripting tool to convert the differences on #ifdef ISP2401. See:

a49d25364dfb ("staging/atomisp: Add support for the Intel IPU v2")

There are things there like:

	+#ifdef ISP2401
	+
	+#endif

I did a large cleanup work to get rid of those ifdefs, replacing them by runtime logic.

The end goal is to have a single compile-time driver that works for both 2400 and 2401.

This is not possible yet, as there are some registers that are mapped on different addresses, depending on the hardware version, and making it generic requires a lot of work and tests. So, for now, we need to have a compile-time option to select between both.

Quoted 7 lines

Indeed, the upstreamed atomisp uses irci_stable_candrpv_0415_20150521_0458 for ISP2400 and IIUC it was working on Bay Trail. On the other hand, intel-aero is a kernel for Cherry Trail and uses the same version irci_stable_candrpv_0415_20150521_0458.

So, both ISP version ISP2400/ISP2401 can be supported by a single driver version.

I See. OK!

Quoted 46 lines
Quoted 4 lines
Quoted 4 lines

We should eventually remove (not unify) such tests caused by just a driver version difference and use just one version of driver. So, for now, let's avoid further unification.

Quoted 8 lines
Quoted 4 lines

[1] The function ia_css_mipi_is_source_port_valid() and its usage is

    added on updating css version to irci_master_20150701_0213
    https://raw.githubusercontent.com/intel/ProductionKernelQuilts/cht-m1stable-2016_ww31/uefi/cht-m1stable/patches/cam-0439-atomisp2-css2401-and-2401_legacy-irci_master_2015070.patch
    ("atomisp2: css2401 and 2401_legacy-irci_master_20150701_0213")  

What happens is that there is a 2401 and a 2401 "legacy". It sounds that this due to some different software stacks that are reflected both at the firmware and at the driver.

Yeah, I'm not sure what the "legacy" is. It might be a reference of ISP2401_NEW_INPUT_SYSTEM (css_2401_csi2p_system) and non-ISP2401_NEW_INPUT_SYSTEM (css_2401_system).

Quoted 4 lines

-

On other words, this patch requires some rework, as otherwise it will break support for Baytrail.

You mean "this patch"? then, I intended this patch is rather a fix for ISP2400 case! The err variable for ISP2400 case is always true because it is not used before the error check:

int
allocate_mipi_frames(struct ia_css_pipe *pipe,
struct ia_css_stream_info *info)
{
int err = -EINVAL;
[...]

        	if (!IS_ISP2401)
        		port = (unsigned int)pipe->stream->config.source.port.port;
        	else
        		err = ia_css_mipi_is_source_port_valid(pipe, &port);
        
        	assert(port < N_CSI_PORTS);
        
        	if (port >= N_CSI_PORTS || err) {
        		ia_css_debug_dtrace(IA_CSS_DEBUG_TRACE_PRIVATE,
        				    "allocate_mipi_frames(%p) exit: error: port is not correct (port=%d).\n",
        				    pipe, port);
        		return -EINVAL;
        	}
Quoted 4 lines

The first usage of err variable is ia_css_mipi_is_source_port_valid() for IS_ISP2401 case, but it's not used for ISP2400 case. This causes the evaluation port >= N_CSI_PORTS || err always true for ISP2400 case, meaning it will be always treated as a error.

Ok. Had you test the driver with Baytrail?

Quoted 4 lines
Quoted 3 lines

Also, patch 13 should be dropped, as the firmware versions for 2400 are different

Quoted 8 lines

The firmware version for 2400 on the upstreamed atomisp is irci_stable_candrpv_0415_20150521_0458 :-)

        static const char *isp2400_release_version = STR(irci_stable_candrpv_0415_20150521_0458);
        static const char *isp2401_release_version = STR(irci_ecr - master_20150911_0724);

The intention of that patch is rather, it clarifies ISP2401 is now using the same driver (css) version as ISP2400.

Ok.

Quoted 7 lines
Quoted 2 lines

- and maybe patches 8 to 12 may need more work in order to not touch 2400.

Those patches do not break ISP2400, because what they do for ISP2400 is that, they remove members from structs which were initially inside of ifdef ISP2401. And because these removed members were initially inside of the ifdefs, the usage was also inside the ifdefs.

Did you test on Baytrail (ISP2400), and with the compile-time option enabled/disabled?

Regards,
Mauro

#15 lore raw

Re: [PATCH 04/17] media: atomisp: pci: do not use err var when checking port validity for ISP2400

Quoted 135 lines · Mauro Carvalho Chehab

Em Thu, 28 Oct 2021 13:12:45 +0900
Tsuchiya Yuto <[email protected]> escreveu:

Quoted 44 lines

<Adding back people/list to Cc>

Quoted 28 lines · Mauro Carvalho Chehab

Em Mon, 18 Oct 2021 01:19:44 +0900
Tsuchiya Yuto <[email protected]> escreveu:

Quoted 18 lines

Currently, the port >= N_CSI_PORTS || err checks for ISP2400 are always evaluated as true because the err variable is set to -EINVAL on declaration but the variable is never used until the evaluation.

Looking at the diff of commit 3c0538fbad9f ("media: atomisp: get rid of most checks for ISP2401 version"), the port >= N_CSI_PORTS check is for ISP2400 and the err variable check is for ISP2401. Fix this issue by adding ISP version test there accordingly.

Yes, there are other better ways to fix this issue, like adding support for ISP2400 to ia_css_mipi_is_source_port_valid(). In this way, we can unify the following test:

	if (!IS_ISP2401)
		port = (unsigned int)pipe->stream->config.source.port.port;
	else
		err = ia_css_mipi_is_source_port_valid(pipe, &port);
Quoted 6 lines

However, the IS_ISP2401 test here (formerly ifdef ISP2401) is not a result of real hardware difference, but just a result of the following two different versions of driver merged by tools [1]:

- ISP2400: irci_stable_candrpv_0415_20150521_0458
- ISP2401: irci_ecr-master_20150911_0724

Quoted 8 lines

No.

While I don't have any internal information from the hardware manufacturer, I guess you misinterpreted things here. 2400 and 2401 are different hardware versions. See atomisp_pci_probe() logic.

Basically, Cherrytail and Anniedale comes with 2401. Older Atom CPUs (Merrifield and Baytrail) comes with 2400.

Yes, indeed, 2400 and 2401 are different hardware. When they (I mean who originally wrote atomisp driver non-upstream) needed to distinguish between ISP2400 and ISP2401, they used the ifdefs like the following:

Quoted 6 lines

- USE_INPUT_SYSTEM_VERSION_2 (for both ISP2400/ISP2401)
- USE_INPUT_SYSTEM_VERSION_2401 (for ISP2401)
...

I think this is a sign that the atomisp driver supports both ISP2400/ISP2401 in a single version.

Actually, supporting both on a single version is part of Alan's work.

It seems he used the generation tool to produce a version for 2400, and then re-used it to generate for 2401. It then used some scripting tool to convert the differences on #ifdef ISP2401. See:

a49d25364dfb ("staging/atomisp: Add support for the Intel IPU v2")

There are things there like:

	+#ifdef ISP2401
	+
	+#endif

I did a large cleanup work to get rid of those ifdefs, replacing them by runtime logic.

The end goal is to have a single compile-time driver that works for both 2400 and 2401.

This is not possible yet, as there are some registers that are mapped on different addresses, depending on the hardware version, and making it generic requires a lot of work and tests. So, for now, we need to have a compile-time option to select between both.

Quoted 7 lines

Indeed, the upstreamed atomisp uses irci_stable_candrpv_0415_20150521_0458 for ISP2400 and IIUC it was working on Bay Trail. On the other hand, intel-aero is a kernel for Cherry Trail and uses the same version irci_stable_candrpv_0415_20150521_0458.

So, both ISP version ISP2400/ISP2401 can be supported by a single driver version.

I See. OK!

Quoted 46 lines
Quoted 4 lines
Quoted 4 lines

We should eventually remove (not unify) such tests caused by just a driver version difference and use just one version of driver. So, for now, let's avoid further unification.

Quoted 8 lines
Quoted 4 lines

[1] The function ia_css_mipi_is_source_port_valid() and its usage is

    added on updating css version to irci_master_20150701_0213
    https://raw.githubusercontent.com/intel/ProductionKernelQuilts/cht-m1stable-2016_ww31/uefi/cht-m1stable/patches/cam-0439-atomisp2-css2401-and-2401_legacy-irci_master_2015070.patch
    ("atomisp2: css2401 and 2401_legacy-irci_master_20150701_0213")  

What happens is that there is a 2401 and a 2401 "legacy". It sounds that this due to some different software stacks that are reflected both at the firmware and at the driver.

Yeah, I'm not sure what the "legacy" is. It might be a reference of ISP2401_NEW_INPUT_SYSTEM (css_2401_csi2p_system) and non-ISP2401_NEW_INPUT_SYSTEM (css_2401_system).

Quoted 4 lines

-

On other words, this patch requires some rework, as otherwise it will break support for Baytrail.

You mean "this patch"? then, I intended this patch is rather a fix for ISP2400 case! The err variable for ISP2400 case is always true because it is not used before the error check:

int
allocate_mipi_frames(struct ia_css_pipe *pipe,
struct ia_css_stream_info *info)
{
int err = -EINVAL;
[...]

        	if (!IS_ISP2401)
        		port = (unsigned int)pipe->stream->config.source.port.port;
        	else
        		err = ia_css_mipi_is_source_port_valid(pipe, &port);
        
        	assert(port < N_CSI_PORTS);
        
        	if (port >= N_CSI_PORTS || err) {
        		ia_css_debug_dtrace(IA_CSS_DEBUG_TRACE_PRIVATE,
        				    "allocate_mipi_frames(%p) exit: error: port is not correct (port=%d).\n",
        				    pipe, port);
        		return -EINVAL;
        	}
Quoted 6 lines
Quoted 4 lines

The first usage of err variable is ia_css_mipi_is_source_port_valid() for IS_ISP2401 case, but it's not used for ISP2400 case. This causes the evaluation port >= N_CSI_PORTS || err always true for ISP2400 case, meaning it will be always treated as a error.

Ok. Had you test the driver with Baytrail?

Unfortunately, no. I don't have a Baytrail device to test (yet?). I noticed this issue anyway when I tried removing #ifdef ISP2401.

This is not directly related to this series, but how we should reduce the ifdef usage in the future? Here are my two ideas:

1. (my initial idea) remove #ifdef ISP2401 part and make ISP2401

     part completely irci_stable_candrpv_0415_20150521_0458

this way does not require (relatively) much human work I think.

But as Mauro says, the #ifdef ISP2401 part (irci_ecr-master_20150911_0724) is basically an improved version. So, we may also:

2. continue unifying #ifdef ISP2401 and #ifndef ISP2401 parts

but this way needs more human work I think though. And if we go this way, I also need to rewrite this patch as mentioned in the commit message.

Quoted 18 lines
Quoted 4 lines
Quoted 3 lines

Also, patch 13 should be dropped, as the firmware versions for 2400 are different

Quoted 8 lines

The firmware version for 2400 on the upstreamed atomisp is irci_stable_candrpv_0415_20150521_0458 :-)

        static const char *isp2400_release_version = STR(irci_stable_candrpv_0415_20150521_0458);
        static const char *isp2401_release_version = STR(irci_ecr - master_20150911_0724);

The intention of that patch is rather, it clarifies ISP2401 is now using the same driver (css) version as ISP2400.

Ok.

Quoted 3 lines
Quoted 2 lines

- and maybe patches 8 to 12 may need more work in order to not touch 2400.

Quoted 7 lines
Quoted 4 lines

Those patches do not break ISP2400, because what they do for ISP2400 is that, they remove members from structs which were initially inside of ifdef ISP2401. And because these removed members were initially inside of the ifdefs, the usage was also inside the ifdefs.

Did you test on Baytrail (ISP2400), and with the compile-time option enabled/disabled?

Sorry, I should have clarified on the cover later. For ISP2400, I did compile test only (CONFIG_VIDEO_ATOMISP_ISP2401 enabled/disabled).

Quoted 2 lines

Regards,
Mauro

#16 lore raw

Re: [PATCH 04/17] media: atomisp: pci: do not use err var when checking port validity for ISP2400

Em Mon, 01 Nov 2021 22:38:55 +0900
Tsuchiya Yuto <[email protected]> escreveu:

Quoted 149 lines · Mauro Carvalho Chehab
Quoted 135 lines

Em Thu, 28 Oct 2021 13:12:45 +0900
Tsuchiya Yuto <[email protected]> escreveu:

Quoted 44 lines

<Adding back people/list to Cc>

Quoted 28 lines · Mauro Carvalho Chehab

Em Mon, 18 Oct 2021 01:19:44 +0900
Tsuchiya Yuto <[email protected]> escreveu:

Quoted 18 lines

Currently, the port >= N_CSI_PORTS || err checks for ISP2400 are always evaluated as true because the err variable is set to -EINVAL on declaration but the variable is never used until the evaluation.

Looking at the diff of commit 3c0538fbad9f ("media: atomisp: get rid of most checks for ISP2401 version"), the port >= N_CSI_PORTS check is for ISP2400 and the err variable check is for ISP2401. Fix this issue by adding ISP version test there accordingly.

Yes, there are other better ways to fix this issue, like adding support for ISP2400 to ia_css_mipi_is_source_port_valid(). In this way, we can unify the following test:

	if (!IS_ISP2401)
		port = (unsigned int)pipe->stream->config.source.port.port;
	else
		err = ia_css_mipi_is_source_port_valid(pipe, &port);
Quoted 6 lines

However, the IS_ISP2401 test here (formerly ifdef ISP2401) is not a result of real hardware difference, but just a result of the following two different versions of driver merged by tools [1]:

- ISP2400: irci_stable_candrpv_0415_20150521_0458
- ISP2401: irci_ecr-master_20150911_0724

Quoted 8 lines

No.

While I don't have any internal information from the hardware manufacturer, I guess you misinterpreted things here. 2400 and 2401 are different hardware versions. See atomisp_pci_probe() logic.

Basically, Cherrytail and Anniedale comes with 2401. Older Atom CPUs (Merrifield and Baytrail) comes with 2400.

Yes, indeed, 2400 and 2401 are different hardware. When they (I mean who originally wrote atomisp driver non-upstream) needed to distinguish between ISP2400 and ISP2401, they used the ifdefs like the following:

Quoted 6 lines

- USE_INPUT_SYSTEM_VERSION_2 (for both ISP2400/ISP2401)
- USE_INPUT_SYSTEM_VERSION_2401 (for ISP2401)
...

I think this is a sign that the atomisp driver supports both ISP2400/ISP2401 in a single version.

Actually, supporting both on a single version is part of Alan's work.

It seems he used the generation tool to produce a version for 2400, and then re-used it to generate for 2401. It then used some scripting tool to convert the differences on #ifdef ISP2401. See:

a49d25364dfb ("staging/atomisp: Add support for the Intel IPU v2")

There are things there like:

	+#ifdef ISP2401
	+
	+#endif

I did a large cleanup work to get rid of those ifdefs, replacing them by runtime logic.

The end goal is to have a single compile-time driver that works for both 2400 and 2401.

This is not possible yet, as there are some registers that are mapped on different addresses, depending on the hardware version, and making it generic requires a lot of work and tests. So, for now, we need to have a compile-time option to select between both.

Quoted 7 lines

Indeed, the upstreamed atomisp uses irci_stable_candrpv_0415_20150521_0458 for ISP2400 and IIUC it was working on Bay Trail. On the other hand, intel-aero is a kernel for Cherry Trail and uses the same version irci_stable_candrpv_0415_20150521_0458.

So, both ISP version ISP2400/ISP2401 can be supported by a single driver version.

I See. OK!

Quoted 46 lines
Quoted 4 lines
Quoted 4 lines

We should eventually remove (not unify) such tests caused by just a driver version difference and use just one version of driver. So, for now, let's avoid further unification.

Quoted 8 lines
Quoted 4 lines

[1] The function ia_css_mipi_is_source_port_valid() and its usage is

    added on updating css version to irci_master_20150701_0213
    https://raw.githubusercontent.com/intel/ProductionKernelQuilts/cht-m1stable-2016_ww31/uefi/cht-m1stable/patches/cam-0439-atomisp2-css2401-and-2401_legacy-irci_master_2015070.patch
    ("atomisp2: css2401 and 2401_legacy-irci_master_20150701_0213")    

What happens is that there is a 2401 and a 2401 "legacy". It sounds that this due to some different software stacks that are reflected both at the firmware and at the driver.

Yeah, I'm not sure what the "legacy" is. It might be a reference of ISP2401_NEW_INPUT_SYSTEM (css_2401_csi2p_system) and non-ISP2401_NEW_INPUT_SYSTEM (css_2401_system).

Quoted 4 lines

-

On other words, this patch requires some rework, as otherwise it will break support for Baytrail.

You mean "this patch"? then, I intended this patch is rather a fix for ISP2400 case! The err variable for ISP2400 case is always true because it is not used before the error check:

int
allocate_mipi_frames(struct ia_css_pipe *pipe,
struct ia_css_stream_info *info)
{
int err = -EINVAL;
[...]

        	if (!IS_ISP2401)
        		port = (unsigned int)pipe->stream->config.source.port.port;
        	else
        		err = ia_css_mipi_is_source_port_valid(pipe, &port);
        
        	assert(port < N_CSI_PORTS);
        
        	if (port >= N_CSI_PORTS || err) {
        		ia_css_debug_dtrace(IA_CSS_DEBUG_TRACE_PRIVATE,
        				    "allocate_mipi_frames(%p) exit: error: port is not correct (port=%d).\n",
        				    pipe, port);
        		return -EINVAL;
        	}
Quoted 6 lines
Quoted 4 lines

The first usage of err variable is ia_css_mipi_is_source_port_valid() for IS_ISP2401 case, but it's not used for ISP2400 case. This causes the evaluation port >= N_CSI_PORTS || err always true for ISP2400 case, meaning it will be always treated as a error.

Ok. Had you test the driver with Baytrail?

Unfortunately, no. I don't have a Baytrail device to test (yet?). I noticed this issue anyway when I tried removing #ifdef ISP2401.

This is not directly related to this series, but how we should reduce the ifdef usage in the future? Here are my two ideas:

Quoted 7 lines

1. (my initial idea) remove #ifdef ISP2401 part and make ISP2401

     part completely irci_stable_candrpv_0415_20150521_0458

this way does not require (relatively) much human work I think.

But as Mauro says, the #ifdef ISP2401 part (irci_ecr-master_20150911_0724) is basically an improved version.

No. What I said is that the if (ISP2401) and the remaining ifdefs are because of BYT x CHT. The worse part of them are related to those files (See Makefile):

obj-byt = \
	pci/css_2400_system/hive/ia_css_isp_configs.o \
	pci/css_2400_system/hive/ia_css_isp_params.o \
	pci/css_2400_system/hive/ia_css_isp_states.o \
obj-cht = \
	pci/css_2401_system/hive/ia_css_isp_configs.o \
	pci/css_2401_system/hive/ia_css_isp_params.o \
	pci/css_2401_system/hive/ia_css_isp_states.o \
	pci/css_2401_system/host/csi_rx.o \
	pci/css_2401_system/host/ibuf_ctrl.o \
	pci/css_2401_system/host/isys_dma.o \
	pci/css_2401_system/host/isys_irq.o \
	pci/css_2401_system/host/isys_stream2mmio.o

Those define regmaps for 2400 and 2401. I was able to remove a lot of things from the old css_2400/css_2401 directories, but the ones there at pci/*/css*/ia_css_isp_*.c are a lot more complex, and would require some mapping functions to allow the same driver to work with both BYT and CHT.

The better would be to test the driver first at BYT, fix issues (if any) and then write the mapping code.

Quoted 31 lines

So, we may also:

2. continue unifying #ifdef ISP2401 and #ifndef ISP2401 parts

but this way needs more human work I think though. And if we go this way, I also need to rewrite this patch as mentioned in the commit message.

Quoted 23 lines
Quoted 4 lines
Quoted 3 lines

Also, patch 13 should be dropped, as the firmware versions for 2400 are different

Quoted 8 lines

The firmware version for 2400 on the upstreamed atomisp is irci_stable_candrpv_0415_20150521_0458 :-)

        static const char *isp2400_release_version = STR(irci_stable_candrpv_0415_20150521_0458);
        static const char *isp2401_release_version = STR(irci_ecr - master_20150911_0724);

The intention of that patch is rather, it clarifies ISP2401 is now using the same driver (css) version as ISP2400.

Ok.

Quoted 7 lines
Quoted 2 lines

- and maybe patches 8 to 12 may need more work in order to not touch 2400.

Those patches do not break ISP2400, because what they do for ISP2400 is that, they remove members from structs which were initially inside of ifdef ISP2401. And because these removed members were initially inside of the ifdefs, the usage was also inside the ifdefs.

Quoted 5 lines
Quoted 2 lines

Did you test on Baytrail (ISP2400), and with the compile-time option enabled/disabled?

Sorry, I should have clarified on the cover later. For ISP2400, I did compile test only (CONFIG_VIDEO_ATOMISP_ISP2401 enabled/disabled).

Maybe Hans could help us on that. I guess he has an Asus T100 device, which is BYT based.

Hans, if you're willing to do the tests, you could either use nvt or v4l2grab to test it.

It seems that BYT has an additional issue, though: the ISP seems to require 12 non-visible lines/columns (in addition to 16 ones required by CHT?) for it to work.

So, you may need to tweak the resolution a bit, as otherwise the driver will return an -EINVAL.

See:

	https://git.linuxtv.org/media_stage.git/commit/?id=dcbc4f570495dbd490975979471687cbe2246f99

For the workaround I had to add for CHT to properly report the visible resolution.

Regards,
Mauro

Regards,
Mauro

#17 lore raw

Re: [PATCH 04/17] media: atomisp: pci: do not use err var when checking port validity for ISP2400

Hi,

On 11/1/21 15:10, Mauro Carvalho Chehab wrote:

<snip>

Quoted 19 lines
Quoted 5 lines
Quoted 2 lines

Did you test on Baytrail (ISP2400), and with the compile-time option enabled/disabled?

Sorry, I should have clarified on the cover later. For ISP2400, I did compile test only (CONFIG_VIDEO_ATOMISP_ISP2401 enabled/disabled).

Maybe Hans could help us on that. I guess he has an Asus T100 device, which is BYT based.

Hans, if you're willing to do the tests, you could either use nvt or v4l2grab to test it.

It seems that BYT has an additional issue, though: the ISP seems to require 12 non-visible lines/columns (in addition to 16 ones required by CHT?) for it to work.

So, you may need to tweak the resolution a bit, as otherwise the driver will return an -EINVAL.

Quoted 6 lines

See:

	https://git.linuxtv.org/media_stage.git/commit/?id=dcbc4f570495dbd490975979471687cbe2246f99

For the workaround I had to add for CHT to properly report the visible resolution.

Testing BYT support definitely is on my radar. Note that BYT also has the additional issue that the atomisp2 on BYT can be enumerated as either a PCI dev (which may work) or an ACPI/platform dev which is unsupported in the original atomisp2 code-drop and seems non trivial (because of pci config space writes) to get to work.

On the T100TA the device is actually enumerated as an ACPI/platform device and the BIOS option to change this is hidden. In the mean time I've gained quite a lot of experience with changing hidden BIOS options though, so I can easily put it in PCI mode for testing. But eventually we also need to tackle ACPI enumeration support...

Anyways I've let me self get distracted (hobby time wise) by looking into PMIC/charger/fuel-gauge issues on the Xiaomi Mi Pad 2. I've made a list of 3 (small-ish) loose ends which I want to tie up there and then I plan to start looking into atomisp2 support in my hobby time. ATM my plan is:

-Test on T101HA to reproduce Mauro's work
-Try to get things to work on the T116
-Patch to not load atomisp_foo sensor drivers on !BYT && !CHT

And I've just added:

-Try out BYT support

As 4th item. Eventually I want to look into writing a proper regulator driver for the PMICs and then try to make the atomisp2 code work with the non "atomisp_xxx" versions of the sensor drivers.

Regards,

Hans

#18 lore raw

Re: [PATCH 04/17] media: atomisp: pci: do not use err var when checking port validity for ISP2400

Quoted 1 line · Hans de Goede

On 11/1/21 15:10, Mauro Carvalho Chehab wrote:

...

Quoted 7 lines

Testing BYT support definitely is on my radar. Note that BYT also has the additional issue that the atomisp2 on BYT can be enumerated as either a PCI dev (which may work) or an ACPI/platform dev which is unsupported in the original atomisp2 code-drop and seems non trivial (because of pci config space writes) to get to work.

Quoted 6 lines

On the T100TA the device is actually enumerated as an ACPI/platform device and the BIOS option to change this is hidden. In the mean time I've gained quite a lot of experience with changing hidden BIOS options though, so I can easily put it in PCI mode for testing. But eventually we also need to tackle ACPI enumeration support...

Not sure if you saw my very far from being even tested patch... Share it here just in case. I believe you will have a better idea on how to implement it.

Signature · 2 lines
With Best Regards,
Andy Shevchenko

From 8250354d9faf5ccb21a26b1d8a7a771db24467e5 Mon Sep 17 00:00:00 2001
From: Andy Shevchenko <[email protected]>
Date: Fri, 3 Nov 2017 21:39:47 +0200
Subject: [PATCH 1/1] i915: Enumerate AtomISP when it's an ACPI device

When AtomISP is an ACPI subdevice of graphics, we need to enumerate it in the similar way how it's done for LPE Audio, because interrupt line is provided via GPU register.

---
 drivers/gpu/drm/i915/Makefile    |   3 +
 drivers/gpu/drm/i915/i915_drv.h  |  13 ++
 drivers/gpu/drm/i915/i915_irq.c  |   3 +
 drivers/gpu/drm/i915/intel_isp.c | 244 +++++++++++++++++++++++++++++++
 4 files changed, 263 insertions(+)
 create mode 100644 drivers/gpu/drm/i915/intel_isp.c
drivers/gpu/drm/i915/Makefile +3 -0
index 660bb03de6fc..ef5d578031c1 100644
@@ -317,6 +317,9 @@ i915-y += intel_gvt.o
 include $(src)/gvt/Makefile
 endif
 
+# AtomISP for VLV and CHT
+i915-y += intel_isp.o
+
 obj-$(CONFIG_DRM_I915) += i915.o
 obj-$(CONFIG_DRM_I915_GVT_KVMGT) += gvt/kvmgt.o
 
drivers/gpu/drm/i915/i915_drv.h +13 -0
index 12256218634f..75971879f617 100644
@@ -1236,6 +1236,14 @@ struct drm_i915_private {
 		int	irq;
 	} lpe_audio;
 
+	/* necessary resource sharing with AtomISP driver */
+	struct {
+		bool found;
+		struct resource mmio;
+		struct platform_device *platdev;
+		int irq;
+	} isp;
+
 	struct i915_pmu pmu;
 
 	struct i915_hdcp_comp_master *hdcp_master;
@@ -1962,6 +1970,11 @@ int intel_engine_cmd_parser(struct intel_engine_cs *engine,
 			    bool trampoline);
 #define I915_CMD_PARSER_TRAMPOLINE_SIZE 8
 
+/* intel_isp.c */
+int  intel_isp_init(struct drm_i915_private *dev_priv);
+void intel_isp_teardown(struct drm_i915_private *dev_priv);
+void intel_isp_irq_handler(struct drm_i915_private *dev_priv);
+
 /* intel_device_info.c */
 static inline struct intel_device_info *
 mkwrite_device_info(struct drm_i915_private *dev_priv)
drivers/gpu/drm/i915/i915_irq.c +3 -0
index 77680bca46ee..6e71a86b8584 100644
@@ -1707,6 +1707,9 @@ static irqreturn_t valleyview_irq_handler(int irq, void *arg)
 			   I915_LPE_PIPE_B_INTERRUPT))
 			intel_lpe_audio_irq_handler(dev_priv);
 
+		if (iir & I915_ISP_INTERRUPT)
+			intel_isp_irq_handler(dev_priv);
+
 		/*
 		 * VLV_IIR is single buffered, and reflects the level
 		 * from PIPESTAT/PORT_HOTPLUG_STAT, hence clear it last.
drivers/gpu/drm/i915/intel_isp.c new file +244 -0

244 lines not on this page · raw message

Signature · 1 line
2.33.0
#19 lore raw

Re: [PATCH 04/17] media: atomisp: pci: do not use err var when checking port validity for ISP2400

Hi,

Quoted 19 lines · Andy Shevchenko
Quoted 1 line · Hans de Goede

On 11/1/21 15:10, Mauro Carvalho Chehab wrote:

...

Quoted 7 lines

Testing BYT support definitely is on my radar. Note that BYT also has the additional issue that the atomisp2 on BYT can be enumerated as either a PCI dev (which may work) or an ACPI/platform dev which is unsupported in the original atomisp2 code-drop and seems non trivial (because of pci config space writes) to get to work.

Quoted 6 lines

On the T100TA the device is actually enumerated as an ACPI/platform device and the BIOS option to change this is hidden. In the mean time I've gained quite a lot of experience with changing hidden BIOS options though, so I can easily put it in PCI mode for testing. But eventually we also need to tackle ACPI enumeration support...

Quoted 3 lines

Not sure if you saw my very far from being even tested patch... Share it here just in case. I believe you will have a better idea on how to implement it.

I don't remember seeing that, it is great to at least have a starting point when I get around to looking into this, thank you!

Regards,

Hans

#20 lore raw

Re: [PATCH 04/17] media: atomisp: pci: do not use err var when checking port validity for ISP2400

In reply to Hans de Goede

Em Mon, 1 Nov 2021 20:06:52 +0100
Hans de Goede <[email protected]> escreveu:

Quoted 46 lines

Hi,

On 11/1/21 15:10, Mauro Carvalho Chehab wrote:

<snip>

Quoted 19 lines
Quoted 5 lines
Quoted 2 lines

Did you test on Baytrail (ISP2400), and with the compile-time option enabled/disabled?

Sorry, I should have clarified on the cover later. For ISP2400, I did compile test only (CONFIG_VIDEO_ATOMISP_ISP2401 enabled/disabled).

Maybe Hans could help us on that. I guess he has an Asus T100 device, which is BYT based.

Hans, if you're willing to do the tests, you could either use nvt or v4l2grab to test it.

It seems that BYT has an additional issue, though: the ISP seems to require 12 non-visible lines/columns (in addition to 16 ones required by CHT?) for it to work.

So, you may need to tweak the resolution a bit, as otherwise the driver will return an -EINVAL.

Quoted 6 lines

See:

	https://git.linuxtv.org/media_stage.git/commit/?id=dcbc4f570495dbd490975979471687cbe2246f99

For the workaround I had to add for CHT to properly report the visible resolution.

Testing BYT support definitely is on my radar. Note that BYT also has the additional issue that the atomisp2 on BYT can be enumerated as either a PCI dev (which may work) or an ACPI/platform dev which is unsupported in the original atomisp2 code-drop and seems non trivial (because of pci config space writes) to get to work.

On the T100TA the device is actually enumerated as an ACPI/platform device and the BIOS option to change this is hidden. In the mean time I've gained quite a lot of experience with changing hidden BIOS options though, so I can easily put it in PCI mode for testing. But eventually we also need to tackle ACPI enumeration support...

Quoted 7 lines

Anyways I've let me self get distracted (hobby time wise) by looking into PMIC/charger/fuel-gauge issues on the Xiaomi Mi Pad 2. I've made a list of 3 (small-ish) loose ends which I want to tie up there and then I plan to start looking into atomisp2 support in my hobby time. ATM my plan is:

-Test on T101HA to reproduce Mauro's work

Yeah, it would be great to have a second test on it. I suspect that it should work just fine with USERPTR (with v4l2grab or nvt).

Quoted 1 line

-Try to get things to work on the T116

Didn't test it here either, but won't be able to do in the next couple of weeks.

Quoted 1 line
   -Patch to not load atomisp_foo sensor drivers on !BYT && !CHT

Not sure if it is worth doing it, as there are a lot more to be done before being able to use a generic sensor driver.

Quoted 3 lines

And I've just added:

-Try out BYT support

Thanks!

Quoted 3 lines

As 4th item. Eventually I want to look into writing a proper regulator driver for the PMICs

Yeah, a proper regulator driver would be a lot better than the PMIC ones.

Quoted 2 lines

and then try to make the atomisp2
code work with the non "atomisp_xxx" versions of the sensor drivers.

With a regulator driver, part of the problem will be solved. However, as the ISP driver "eats" 16 lines and 16 columns. It means that the sensor needs to be adjusted for it to provide those extra data. So, the atomisp sensor resolutions are (X + 16) x (Y + 16), e. g. in the case of ov2680, it is set to 1616x1216, while the upstream one is 1600x1200.

Not sure if the selection API currently allows changing that to satisfy atomisp, or if something else would be needed.

Regards,
Mauro

#21 lore raw

Re: [PATCH 04/17] media: atomisp: pci: do not use err var when checking port validity for ISP2400

Hi,

Quoted 2 lines · Mauro Carvalho Chehab

Em Mon, 1 Nov 2021 20:06:52 +0100
Hans de Goede <[email protected]> escreveu:

<snip>

Quoted 4 lines
Quoted 1 line
   -Patch to not load atomisp_foo sensor drivers on !BYT && !CHT

Not sure if it is worth doing it, as there are a lot more to be done before being able to use a generic sensor driver.

As you may know, I'm also working on IPU3 support for $dayjob atm actually :)

So the drivers for e.g. the ov5693 sensor conflict, by adding a small (one line) check to atomisp_ov5693.c to not register the driver at all when not on BYT/CHT we can avoid the conflict on most devices for now. And when actually on BYT/CHT the user will need to blacklist the non atomisp sensor-modules which, well sucks, but atomisp is in staging for a reason ...

So the idea here is that with some small added ugliness to the atomisp_foo.c sensor drivers we can make the 2 drivers co-exist a bit more, allowing e.g. generic distro kernels to (maybe) enable the atomisp2 stuff without regressing the IPU3 support.

###

Since we are discussing this now anyways, the atomisp_foo.c patches would look like this:

#include <linux/platform_data/x86/soc.h>

        if (!soc_intel_is_byt() && !soc_intel_is_cht())
                return -ENODEV;

In the probe() function and change driver.name from e.g. "ov5693" to "atom_ov5693".

Before I spend time on writing patches for this, would patches doing this for conflicting drivers be acceptable ?

Regards,

Hans

#22 lore raw

Re: [PATCH 04/17] media: atomisp: pci: do not use err var when checking port validity for ISP2400

Em Mon, 1 Nov 2021 22:06:12 +0100
Hans de Goede <[email protected]> escreveu:

Quoted 8 lines

Hi,

Quoted 2 lines · Mauro Carvalho Chehab

Em Mon, 1 Nov 2021 20:06:52 +0100
Hans de Goede <[email protected]> escreveu:

<snip>

Quoted 7 lines
Quoted 4 lines
Quoted 1 line
   -Patch to not load atomisp_foo sensor drivers on !BYT && !CHT  

Not sure if it is worth doing it, as there are a lot more to be done before being able to use a generic sensor driver.

As you may know, I'm also working on IPU3 support for $dayjob atm actually :)

Didn't know that... Btw, I have one Dell device with IPU3. It would be great to have it working there ;-)

Quoted 19 lines

So the drivers for e.g. the ov5693 sensor conflict, by adding a small (one line) check to atomisp_ov5693.c to not register the driver at all when not on BYT/CHT we can avoid the conflict on most devices for now. And when actually on BYT/CHT the user will need to blacklist the non atomisp sensor-modules which, well sucks, but atomisp is in staging for a reason ...

So the idea here is that with some small added ugliness to the atomisp_foo.c sensor drivers we can make the 2 drivers co-exist a bit more, allowing e.g. generic distro kernels to (maybe) enable the atomisp2 stuff without regressing the IPU3 support.

###

Since we are discussing this now anyways, the atomisp_foo.c patches would look like this:

#include <linux/platform_data/x86/soc.h>

Quoted 8 lines
        if (!soc_intel_is_byt() && !soc_intel_is_cht())
                return -ENODEV;

In the probe() function and change driver.name from e.g. "ov5693" to "atom_ov5693".

Before I spend time on writing patches for this, would patches doing this for conflicting drivers be acceptable ?

Surely. Yeah, it makes sense to me. Feel free to submit such patches.

Regards,
Mauro

#23 lore raw

Re: [PATCH 04/17] media: atomisp: pci: do not use err var when checking port validity for ISP2400

In reply to Mauro Carvalho Chehab

Sorry for a little late reply. This is hard to explain...

Quoted 2 lines · Mauro Carvalho Chehab

Em Mon, 01 Nov 2021 22:38:55 +0900
Tsuchiya Yuto <[email protected]> escreveu:

[...]

Quoted 8 lines
Quoted 8 lines

This is not directly related to this series, but how we should reduce the ifdef usage in the future? Here are my two ideas:

1. (my initial idea) remove #ifdef ISP2401 part and make ISP2401

     part completely irci_stable_candrpv_0415_20150521_0458
Quoted 7 lines
Quoted 4 lines

this way does not require (relatively) much human work I think.

But as Mauro says, the #ifdef ISP2401 part (irci_ecr-master_20150911_0724) is basically an improved version.

No. What I said is that the if (ISP2401) and the remaining ifdefs are because of BYT x CHT.

I need to elaborate on this. Indeed some of them are really because of BYT x CHT, but others are stuff from irci_ecr-master_20150911_0724.

What I meant when I mentioned "remove #ifdef ISP2401 part" is that, removing things which was _initially_ inside the #ifdef ISP2401 on the initial commit of atomisp.

Also I believe we can remove more if (IS_ISP2401) and /* ISP2401 */ things as well as the some remaining #ifdef ISP2401 things.

I added about this below and hope it clarifies things...

Quoted 18 lines

The worse part of them are related to those files
(See Makefile):

obj-byt = \
	pci/css_2400_system/hive/ia_css_isp_configs.o \
	pci/css_2400_system/hive/ia_css_isp_params.o \
	pci/css_2400_system/hive/ia_css_isp_states.o \
obj-cht = \
	pci/css_2401_system/hive/ia_css_isp_configs.o \
	pci/css_2401_system/hive/ia_css_isp_params.o \
	pci/css_2401_system/hive/ia_css_isp_states.o \
	pci/css_2401_system/host/csi_rx.o \
	pci/css_2401_system/host/ibuf_ctrl.o \
	pci/css_2401_system/host/isys_dma.o \
	pci/css_2401_system/host/isys_irq.o \
	pci/css_2401_system/host/isys_stream2mmio.o
Quoted 16 lines

Those define regmaps for 2400 and 2401. I was able to remove a lot of things from the old css_2400/css_2401 directories, but the ones there at pci/*/css*/ia_css_isp_*.c are a lot more complex, and would require some mapping functions to allow the same driver to work with both BYT and CHT.

The better would be to test the driver first at BYT, fix issues (if any) and then write the mapping code.

Quoted 7 lines

So, we may also:

2. continue unifying #ifdef ISP2401 and #ifndef ISP2401 parts

but this way needs more human work I think though. And if we go this way, I also need to rewrite this patch as mentioned in the commit message.

What the idea #1 want to say is, let's remove things _initially_ within ifdef ISP2401 (so, except things which were added inside it later upstream) including formerly within ifdef ISP2401 things, i.e., if (IS_ISP2401) and things commented with /* ISP2401 */.

However, I don't say we can remove all the ifdefs like things formerly within USE_INPUT_SYSTEM_VERSION_2, USE_INPUT_SYSTEM_VERSION_2401, etc., which later removed/integrated into ifdef ISP2401 on some commits [1]. We may temporarily revert those commits when we want to distinguish between what were formerly within there and what were not.

Such ifdefs were added by them as a real hardware difference. Thus, I agree that we still need the CONFIG_VIDEO_ATOMISP_ISP2401 stuff to support both ISP2400/ISP2401 at the same time.

This is what I meant "reduce the ifdef usage" in a previous mail. So, I'm not talking about if dropping CONFIG_VIDEO_ATOMISP_ISP2401 is doable, but talking about just how to reduce the code.

[1] 641c2292bf19 ("media: atomisp: get rid of version-dependent globals") bd674b5a413c ("media: atomisp: cleanup ifdefs from ia_css_debug.c")

Anyway, if you agree or not on what I'm saying, can I send this patch without code changes in v2, i.e., looks OK for you regarding the code? I'll remove the commit message about irci_stable_candrpv_0415_20150521_0458 vs irci_ecr-master_20150911_0724 in v2 anyway, which needs to be discussed further later.

The following notes are about what I have done until now for removing such tests. (More elaborated version than cover letter). You don't have to see them, but I hope it might clarify things...

## ifdef ISP2401 added in the initial commit of atomisp

The ifdef ISP2401 was the result of merging two different version of driver, added on the initial commit of upstreamed atomisp. And for the ifdef ISP2401, I confirmed I can remove (almost [1]) all of them against the initial commit of atomisp [2][3]

[1] here are the three exceptions:

    ("NOTE: ifdef ISP2400/ISP2401 usage in aero-atomisp")
    https://github.com/kitakar5525/linux-kernel/commit/1a8488cdd31ad38a3805824700b29d1e5213d3f2

[2] ("atomisp: pci: css2400: remove ISP2401 ifdefs")

    https://github.com/kitakar5525/linux-kernel/commit/dd6723fc5b9fe040e33b227b509a7e004243edce
[3] ("atomisp: pci: remove ISP2401 ifdefs for main pci driver")
    https://github.com/kitakar5525/linux-kernel/commit/1734341f84a96945af7635f6fff061db910f746f

Here is the kernel tree if someone is interested:

        https://github.com/kitakar5525/linux-kernel/tree/mainline+upst_atomisp@a49d25364dfb_first

Especially, here is one of the part where this patch is touching for example:

        --- a/drivers/staging/media/atomisp/pci/atomisp2/css2400/sh_css_mipi.c
        +++ b/drivers/staging/media/atomisp/pci/atomisp2/css2400/sh_css_mipi.c
        @@ -416,26 +362,16 @@ allocate_mipi_frames(struct ia_css_pipe *pipe, struct ia_css_stream_info *info)
[...]
        -#ifndef ISP2401
         	port = (unsigned int) pipe->stream->config.source.port.port;
         	assert(port < N_CSI_PORTS);
         	if (port >= N_CSI_PORTS) {
        -#else
        -	if (!ia_css_mipi_is_source_port_valid(pipe, &port)) {
        -#endif
         		ia_css_debug_dtrace(IA_CSS_DEBUG_TRACE_PRIVATE,
         			"allocate_mipi_frames(%p) exit: error: port is not correct (port=%d).\n",
         			pipe, port);

By removing (almost) all of the #ifdef ISP2401 things, (although we still can't remove like former USE_INPUT_SYSTEM_VERSION_2, USE_INPUT_SYSTEM_VERSION_2401) we can reduce the number of ifdefs.

## ifdef ISP2401, if (IS_ISP2401) and /* ISP2401 */ in the recent
atomisp

That is for the initial commit of atomisp. For the recent version of atomisp, we can still remove ifdef ISP2401 things (again, except things which were added inside it later upstream) as well as the former ifdef ISP2401 things, i.e., if (IS_ISP2401) [1] and things commented with [2] /* ISP2401 */.

[1] ("atomisp: pci: remove IS_ISP2401 test")

    https://github.com/kitakar5525/linux-kernel/commit/397e543e493dfd60d91e2b5cc164da342b26906c

[2] ("atomisp: pci: remove /* ISP2401 */ comments and its contents")
https://github.com/kitakar5525/linux-kernel/commit/b3928e3c1a709853971715ce35459b9b79e708f2
These commits were made against
bd674b5a413c ("media: atomisp: cleanup ifdefs from ia_css_debug.c") where I randomely picked.

Here is the kernel tree if someone is interested:

    https://github.com/kitakar5525/linux-kernel/tree/mainline+upst_atomisp@bd674b5a413c_before_get_rid_ver_globals

I confirmed capture is still working here on surface3 (ISP2401). Compile tested for ISP2400. As you can see, there are some WIP and FIXME commits on top of removing such tests though. (The others are backports).

Especially, here is one of the part where this patch is touching for example:

        --- a/drivers/staging/media/atomisp/pci/sh_css_mipi.c
        +++ b/drivers/staging/media/atomisp/pci/sh_css_mipi.c
        @@ -553,10 +548,7 @@ free_mipi_frames(struct ia_css_pipe *pipe) {
         			return err;
         		}
        
        -		if (!IS_ISP2401)
        -			port = (unsigned int)pipe->stream->config.source.port.port;
        -		else
        -			err = ia_css_mipi_is_source_port_valid(pipe, &port);
        +		port = (unsigned int)pipe->stream->config.source.port.port;
        
         		assert(port < N_CSI_PORTS);

So, we can also remove a lot of if (IS_ISP2401) and /* ISP2401 */ things as well as the remaining ifdef ISP2401.

## WIP: removing ifdef ISP2401, if (IS_ISP2401) and /* ISP2401 */
against the latest atomisp

And here is the branch where I'm working on removing such tests against the latest atomisp:

https://github.com/kitakar5525/linux-kernel/commits/mainline+upst_atomisp+remove_unneeded_tests

It'd be the best if I can show you working one, but it currently has seemingly include issues on ISP2400 vs ISP2401 (as well as many WIP commits I added):

	drivers/staging/media/atomisp/pci/runtime/isys/src/isys_init.c: In function ‘ia_css_isys_init’:
	drivers/staging/media/atomisp/pci/runtime/isys/src/isys_init.c:29:9: error: unknown type name ‘backend_channel_cfg_t’
	   29 |         backend_channel_cfg_t backend_ch0;
	      |         ^~~~~~~~~~~~~~~~~~~~~
	drivers/staging/media/atomisp/pci/runtime/isys/src/isys_init.c:30:9: error: unknown type name ‘backend_channel_cfg_t’
	   30 |         backend_channel_cfg_t backend_ch1;
	      |         ^~~~~~~~~~~~~~~~~~~~~
	drivers/staging/media/atomisp/pci/runtime/isys/src/isys_init.c:31:9: error: unknown type name ‘target_cfg2400_t’
	   31 |         target_cfg2400_t targetB;
	      |         ^~~~~~~~~~~~~~~~
	drivers/staging/media/atomisp/pci/runtime/isys/src/isys_init.c:32:9: error: unknown type name ‘target_cfg2400_t’
	   32 |         target_cfg2400_t targetC;
	      |         ^~~~~~~~~~~~~~~~
	[...]

The full output of the make error is here:

("NOTE: issue: some undeclared errors")
https://github.com/kitakar5525/linux-kernel/commit/a932d16681f941161385659b9d0316a3a4975e86

Regards,
Tsuchiya Yuto

Quoted 1 line
Quoted 1 line
Quoted 1 line
#24 lore raw

Re: [PATCH 04/17] media: atomisp: pci: do not use err var when checking port validity for ISP2400

Quoted 3 lines · Tsuchiya Yuto
Quoted 2 lines · Mauro Carvalho Chehab

Em Mon, 01 Nov 2021 22:38:55 +0900
Tsuchiya Yuto <[email protected]> escreveu:

...

Quoted 4 lines

The full output of the make error is here:

("NOTE: issue: some undeclared errors")
https://github.com/kitakar5525/linux-kernel/commit/a932d16681f941161385659b9d0316a3a4975e86

I just realize that we may do at some point

cflags-y += -Werror

to avoid changes that breaks build (with warnings). And also I would suggest to run build with make W=1 C=1 CF=-D__CHECK_ENDIAN__ ...

Signature · 2 lines
With Best Regards,
Andy Shevchenko
#25 lore raw

Re: [PATCH 04/17] media: atomisp: pci: do not use err var when checking port validity for ISP2400

Em Thu, 11 Nov 2021 18:09:49 +0200
Andy Shevchenko <[email protected]> escreveu:

Quoted 9 lines · Tsuchiya Yuto
Quoted 3 lines · Mauro Carvalho Chehab
Quoted 2 lines

Em Mon, 01 Nov 2021 22:38:55 +0900
Tsuchiya Yuto <[email protected]> escreveu:

...

Quoted 2 lines

The full output of the make error is here:

Quoted 8 lines
Quoted 2 lines

("NOTE: issue: some undeclared errors")
https://github.com/kitakar5525/linux-kernel/commit/a932d16681f941161385659b9d0316a3a4975e86

I just realize that we may do at some point

cflags-y += -Werror

to avoid changes that breaks build (with warnings).

No need. Upstream already added Werror. It is just a matter of adding:

CONFIG_WERROR=y

to .config.

Quoted 2 lines

And also I would suggest
to run build with make W=1 C=1 CF=-D__CHECK_ENDIAN__ ...

Yeah, that's good. On media, we also require no (unjustified) sparse and smatch warnings.

Regards,
Mauro

#26 lore raw

Re: [PATCH 04/17] media: atomisp: pci: do not use err var when checking port validity for ISP2400

Quoted 3 lines · Mauro Carvalho Chehab

Em Thu, 11 Nov 2021 18:09:49 +0200
Andy Shevchenko <[email protected]> escreveu:

Quoted 1 line · Tsuchiya Yuto

...

Quoted 4 lines
Quoted 4 lines

I just realize that we may do at some point

cflags-y += -Werror

Quoted 8 lines
Quoted 1 line

to avoid changes that breaks build (with warnings).

No need. Upstream already added Werror. It is just a matter of adding:

CONFIG_WERROR=y

to .config.

Unfortunately this is not gonna work with make W=1.
https://lore.kernel.org/lkml/CAHp75Vef8QW3Y0yA702KUqPDHNRLN0kCv06=cgPpgPbUeAb-dw@mail.gmail.com/T/#u

Quoted 5 lines
Quoted 2 lines

And also I would suggest
to run build with make W=1 C=1 CF=-D__CHECK_ENDIAN__ ...

Yeah, that's good. On media, we also require no (unjustified) sparse and smatch warnings.

Signature · 2 lines
With Best Regards,
Andy Shevchenko
#27 lore raw

Re: [PATCH 04/17] media: atomisp: pci: do not use err var when checking port validity for ISP2400

In reply to Tsuchiya Yuto

Em Thu, 11 Nov 2021 23:34:23 +0900
Tsuchiya Yuto <[email protected]> escreveu:

Quoted 26 lines

Sorry for a little late reply. This is hard to explain...

Quoted 2 lines · Mauro Carvalho Chehab

Em Mon, 01 Nov 2021 22:38:55 +0900
Tsuchiya Yuto <[email protected]> escreveu:

[...]

Quoted 8 lines
Quoted 8 lines

This is not directly related to this series, but how we should reduce the ifdef usage in the future? Here are my two ideas:

1. (my initial idea) remove #ifdef ISP2401 part and make ISP2401

     part completely irci_stable_candrpv_0415_20150521_0458
Quoted 7 lines
Quoted 4 lines

this way does not require (relatively) much human work I think.

But as Mauro says, the #ifdef ISP2401 part (irci_ecr-master_20150911_0724) is basically an improved version.

No. What I said is that the if (ISP2401) and the remaining ifdefs are because of BYT x CHT.

I need to elaborate on this. Indeed some of them are really because of BYT x CHT, but others are stuff from irci_ecr-master_20150911_0724.

Quoted 8 lines

What I meant when I mentioned "remove #ifdef ISP2401 part" is that, removing things which was _initially_ inside the #ifdef ISP2401 on the initial commit of atomisp.

Also I believe we can remove more if (IS_ISP2401) and /* ISP2401 */ things as well as the some remaining #ifdef ISP2401 things.

I added about this below and hope it clarifies things...

It is clearer now. Yeah, we can touch on whatever is inside the ISP2401 ifs, as we can now test them. Touching things for ISP2400 is harder, as we depend on a test platform.

Quoted 54 lines
Quoted 18 lines

The worse part of them are related to those files
(See Makefile):

obj-byt = \
	pci/css_2400_system/hive/ia_css_isp_configs.o \
	pci/css_2400_system/hive/ia_css_isp_params.o \
	pci/css_2400_system/hive/ia_css_isp_states.o \
obj-cht = \
	pci/css_2401_system/hive/ia_css_isp_configs.o \
	pci/css_2401_system/hive/ia_css_isp_params.o \
	pci/css_2401_system/hive/ia_css_isp_states.o \
	pci/css_2401_system/host/csi_rx.o \
	pci/css_2401_system/host/ibuf_ctrl.o \
	pci/css_2401_system/host/isys_dma.o \
	pci/css_2401_system/host/isys_irq.o \
	pci/css_2401_system/host/isys_stream2mmio.o
Quoted 16 lines

Those define regmaps for 2400 and 2401. I was able to remove a lot of things from the old css_2400/css_2401 directories, but the ones there at pci/*/css*/ia_css_isp_*.c are a lot more complex, and would require some mapping functions to allow the same driver to work with both BYT and CHT.

The better would be to test the driver first at BYT, fix issues (if any) and then write the mapping code.

Quoted 7 lines

So, we may also:

2. continue unifying #ifdef ISP2401 and #ifndef ISP2401 parts

but this way needs more human work I think though. And if we go this way, I also need to rewrite this patch as mentioned in the commit message.

What the idea #1 want to say is, let's remove things _initially_ within ifdef ISP2401 (so, except things which were added inside it later upstream) including formerly within ifdef ISP2401 things, i.e., if (IS_ISP2401) and things commented with /* ISP2401 */.

However, I don't say we can remove all the ifdefs like things formerly within USE_INPUT_SYSTEM_VERSION_2, USE_INPUT_SYSTEM_VERSION_2401, etc., which later removed/integrated into ifdef ISP2401 on some commits [1]. We may temporarily revert those commits when we want to distinguish between what were formerly within there and what were not.

Such ifdefs were added by them as a real hardware difference. Thus, I agree that we still need the CONFIG_VIDEO_ATOMISP_ISP2401 stuff to support both ISP2400/ISP2401 at the same time.

This is what I meant "reduce the ifdef usage" in a previous mail. So, I'm not talking about if dropping CONFIG_VIDEO_ATOMISP_ISP2401 is doable, but talking about just how to reduce the code.

Quoted 8 lines

[1] 641c2292bf19 ("media: atomisp: get rid of version-dependent globals") bd674b5a413c ("media: atomisp: cleanup ifdefs from ia_css_debug.c")

Anyway, if you agree or not on what I'm saying, can I send this patch without code changes in v2, i.e., looks OK for you regarding the code? I'll remove the commit message about irci_stable_candrpv_0415_20150521_0458 vs irci_ecr-master_20150911_0724 in v2 anyway, which needs to be discussed further later.

No need for a v2. The /17 patch series was merged already, plus some patches from the /5 that made sense to apply.

Ok, there are some followup patches that could be added, but please send those in separate.

Quoted 11 lines

The following notes are about what I have done until now for removing such tests. (More elaborated version than cover letter). You don't have to see them, but I hope it might clarify things...

## ifdef ISP2401 added in the initial commit of atomisp

The ifdef ISP2401 was the result of merging two different version of driver, added on the initial commit of upstreamed atomisp. And for the ifdef ISP2401, I confirmed I can remove (almost [1]) all of them against the initial commit of atomisp [2][3]

Quoted 8 lines

[1] here are the three exceptions:

    ("NOTE: ifdef ISP2400/ISP2401 usage in aero-atomisp")
    https://github.com/kitakar5525/linux-kernel/commit/1a8488cdd31ad38a3805824700b29d1e5213d3f2

[2] ("atomisp: pci: css2400: remove ISP2401 ifdefs")

    https://github.com/kitakar5525/linux-kernel/commit/dd6723fc5b9fe040e33b227b509a7e004243edce
[3] ("atomisp: pci: remove ISP2401 ifdefs for main pci driver")
    https://github.com/kitakar5525/linux-kernel/commit/1734341f84a96945af7635f6fff061db910f746f

Ok, if there are more if/ifdef ISP2401 that, if reverted will keep the driver running with the firmware we're using, I'm all for it. Just send the patches ;-)

Quoted 23 lines

Here is the kernel tree if someone is interested:

        https://github.com/kitakar5525/linux-kernel/tree/mainline+upst_atomisp@a49d25364dfb_first

Especially, here is one of the part where this patch is touching for example:

        --- a/drivers/staging/media/atomisp/pci/atomisp2/css2400/sh_css_mipi.c
        +++ b/drivers/staging/media/atomisp/pci/atomisp2/css2400/sh_css_mipi.c
        @@ -416,26 +362,16 @@ allocate_mipi_frames(struct ia_css_pipe *pipe, struct ia_css_stream_info *info)
[...]
        -#ifndef ISP2401
         	port = (unsigned int) pipe->stream->config.source.port.port;
         	assert(port < N_CSI_PORTS);
         	if (port >= N_CSI_PORTS) {
        -#else
        -	if (!ia_css_mipi_is_source_port_valid(pipe, &port)) {
        -#endif
         		ia_css_debug_dtrace(IA_CSS_DEBUG_TRACE_PRIVATE,
         			"allocate_mipi_frames(%p) exit: error: port is not correct (port=%d).\n",
         			pipe, port);
Quoted 3 lines

By removing (almost) all of the #ifdef ISP2401 things, (although we still can't remove like former USE_INPUT_SYSTEM_VERSION_2, USE_INPUT_SYSTEM_VERSION_2401) we can reduce the number of ifdefs.

Sounds good to me.

Quoted 53 lines

## ifdef ISP2401, if (IS_ISP2401) and /* ISP2401 */ in the recent
atomisp

That is for the initial commit of atomisp. For the recent version of atomisp, we can still remove ifdef ISP2401 things (again, except things which were added inside it later upstream) as well as the former ifdef ISP2401 things, i.e., if (IS_ISP2401) [1] and things commented with [2] /* ISP2401 */.

[1] ("atomisp: pci: remove IS_ISP2401 test")

    https://github.com/kitakar5525/linux-kernel/commit/397e543e493dfd60d91e2b5cc164da342b26906c

[2] ("atomisp: pci: remove /* ISP2401 */ comments and its contents")
https://github.com/kitakar5525/linux-kernel/commit/b3928e3c1a709853971715ce35459b9b79e708f2
These commits were made against
bd674b5a413c ("media: atomisp: cleanup ifdefs from ia_css_debug.c") where I randomely picked.

Here is the kernel tree if someone is interested:

    https://github.com/kitakar5525/linux-kernel/tree/mainline+upst_atomisp@bd674b5a413c_before_get_rid_ver_globals

I confirmed capture is still working here on surface3 (ISP2401). Compile tested for ISP2400. As you can see, there are some WIP and FIXME commits on top of removing such tests though. (The others are backports).

Especially, here is one of the part where this patch is touching for example:

        --- a/drivers/staging/media/atomisp/pci/sh_css_mipi.c
        +++ b/drivers/staging/media/atomisp/pci/sh_css_mipi.c
        @@ -553,10 +548,7 @@ free_mipi_frames(struct ia_css_pipe *pipe) {
         			return err;
         		}
        
        -		if (!IS_ISP2401)
        -			port = (unsigned int)pipe->stream->config.source.port.port;
        -		else
        -			err = ia_css_mipi_is_source_port_valid(pipe, &port);
        +		port = (unsigned int)pipe->stream->config.source.port.port;
        
         		assert(port < N_CSI_PORTS);

So, we can also remove a lot of if (IS_ISP2401) and /* ISP2401 */ things as well as the remaining ifdef ISP2401.

## WIP: removing ifdef ISP2401, if (IS_ISP2401) and /* ISP2401 */
against the latest atomisp

Quoted 6 lines

And here is the branch where I'm working on removing such tests against the latest atomisp:

https://github.com/kitakar5525/linux-kernel/commits/mainline+upst_atomisp+remove_unneeded_tests

It'd be the best if I can show you working one,

Well, send the ones that were already tested, and won't cause regressions to v4l2grab and camorama (e. g. it shouldn't cause generic V4L2 generic apps to break).

It would be nice to also not break nvt and other original apps for this device, as it could be useful later, in order to be able to test the other pipelines, as currently only the preview one seems to be working properly, at least with generic apps.

Quoted 29 lines

but it currently has
seemingly include issues on ISP2400 vs ISP2401 (as well as many WIP commits I added):

	drivers/staging/media/atomisp/pci/runtime/isys/src/isys_init.c: In function ‘ia_css_isys_init’:
	drivers/staging/media/atomisp/pci/runtime/isys/src/isys_init.c:29:9: error: unknown type name ‘backend_channel_cfg_t’
	   29 |         backend_channel_cfg_t backend_ch0;
	      |         ^~~~~~~~~~~~~~~~~~~~~
	drivers/staging/media/atomisp/pci/runtime/isys/src/isys_init.c:30:9: error: unknown type name ‘backend_channel_cfg_t’
	   30 |         backend_channel_cfg_t backend_ch1;
	      |         ^~~~~~~~~~~~~~~~~~~~~
	drivers/staging/media/atomisp/pci/runtime/isys/src/isys_init.c:31:9: error: unknown type name ‘target_cfg2400_t’
	   31 |         target_cfg2400_t targetB;
	      |         ^~~~~~~~~~~~~~~~
	drivers/staging/media/atomisp/pci/runtime/isys/src/isys_init.c:32:9: error: unknown type name ‘target_cfg2400_t’
	   32 |         target_cfg2400_t targetC;
	      |         ^~~~~~~~~~~~~~~~
	[...]

The full output of the make error is here:

("NOTE: issue: some undeclared errors")
https://github.com/kitakar5525/linux-kernel/commit/a932d16681f941161385659b9d0316a3a4975e86

Regards,
Tsuchiya Yuto

Quoted 1 line
Quoted 1 line
Quoted 1 line
#28 lore raw

Re: [PATCH 04/17] media: atomisp: pci: do not use err var when checking port validity for ISP2400

Hi
Em Thu, 11 Nov 2021 18:38:12 +0000
Mauro Carvalho Chehab <[email protected]> escreveu:

Quoted 9 lines
Quoted 9 lines

The ifdef ISP2401 was the result of merging two different version of driver, added on the initial commit of upstreamed atomisp. And for the ifdef ISP2401, I confirmed I can remove (almost [1]) all of them against the initial commit of atomisp [2][3]

[1] here are the three exceptions:

    ("NOTE: ifdef ISP2400/ISP2401 usage in aero-atomisp")
    https://github.com/kitakar5525/linux-kernel/commit/1a8488cdd31ad38a3805824700b29d1e5213d3f2
Quoted 8 lines
Quoted 4 lines

[2] ("atomisp: pci: css2400: remove ISP2401 ifdefs")

    https://github.com/kitakar5525/linux-kernel/commit/dd6723fc5b9fe040e33b227b509a7e004243edce
[3] ("atomisp: pci: remove ISP2401 ifdefs for main pci driver")
    https://github.com/kitakar5525/linux-kernel/commit/1734341f84a96945af7635f6fff061db910f746f  

Ok, if there are more if/ifdef ISP2401 that, if reverted will keep the driver running with the firmware we're using, I'm all for it. Just send the patches ;-)

I went ahead and solved several INPUT_SYSTEM related ifdefs on a way that it is compatible with Intel Aero firmware for the sh_css* files. Except if I made any mistake, the ifdefs that are related to the input system were already addressed.

I didn't notice any changes when running camorama on the PREVIEW node.

Please test. Feel free to submit fixup patches if needed.

Regards,
Mauro

#29 lore raw

Re: [PATCH 04/17] media: atomisp: pci: do not use err var when checking port validity for ISP2400

I'm really sorry about this delay recently. I can't spare much time now...

Quoted 27 lines · Mauro Carvalho Chehab

Hi
Em Thu, 11 Nov 2021 18:38:12 +0000
Mauro Carvalho Chehab <[email protected]> escreveu:

Quoted 9 lines
Quoted 9 lines

The ifdef ISP2401 was the result of merging two different version of driver, added on the initial commit of upstreamed atomisp. And for the ifdef ISP2401, I confirmed I can remove (almost [1]) all of them against the initial commit of atomisp [2][3]

[1] here are the three exceptions:

    ("NOTE: ifdef ISP2400/ISP2401 usage in aero-atomisp")
    https://github.com/kitakar5525/linux-kernel/commit/1a8488cdd31ad38a3805824700b29d1e5213d3f2
Quoted 8 lines
Quoted 4 lines

[2] ("atomisp: pci: css2400: remove ISP2401 ifdefs")

    https://github.com/kitakar5525/linux-kernel/commit/dd6723fc5b9fe040e33b227b509a7e004243edce
[3] ("atomisp: pci: remove ISP2401 ifdefs for main pci driver")
    https://github.com/kitakar5525/linux-kernel/commit/1734341f84a96945af7635f6fff061db910f746f  

Ok, if there are more if/ifdef ISP2401 that, if reverted will keep the driver running with the firmware we're using, I'm all for it. Just send the patches ;-)

I went ahead and solved several INPUT_SYSTEM related ifdefs on a way that it is compatible with Intel Aero firmware for the sh_css* files. Except if I made any mistake, the ifdefs that are related to the input system were already addressed.

Quoted 4 lines

I didn't notice any changes when running camorama on the PREVIEW node.

Please test. Feel free to submit fixup patches if needed.

Thank you for your work. Just tried now and I also don't notice any issues so far with the latest media_stage tree.

Regards,
Tsuchiya Yuto

#30 lore raw

Re: [PATCH 04/17] media: atomisp: pci: do not use err var when checking port validity for ISP2400

In reply to Mauro Carvalho Chehab
Quoted 105 lines · Mauro Carvalho Chehab

Em Thu, 11 Nov 2021 23:34:23 +0900
Tsuchiya Yuto <[email protected]> escreveu:

Quoted 26 lines

Sorry for a little late reply. This is hard to explain...

Quoted 2 lines · Mauro Carvalho Chehab

Em Mon, 01 Nov 2021 22:38:55 +0900
Tsuchiya Yuto <[email protected]> escreveu:

[...]

Quoted 8 lines
Quoted 8 lines

This is not directly related to this series, but how we should reduce the ifdef usage in the future? Here are my two ideas:

1. (my initial idea) remove #ifdef ISP2401 part and make ISP2401

     part completely irci_stable_candrpv_0415_20150521_0458
Quoted 7 lines
Quoted 4 lines

this way does not require (relatively) much human work I think.

But as Mauro says, the #ifdef ISP2401 part (irci_ecr-master_20150911_0724) is basically an improved version.

No. What I said is that the if (ISP2401) and the remaining ifdefs are because of BYT x CHT.

I need to elaborate on this. Indeed some of them are really because of BYT x CHT, but others are stuff from irci_ecr-master_20150911_0724.

Quoted 8 lines

What I meant when I mentioned "remove #ifdef ISP2401 part" is that, removing things which was _initially_ inside the #ifdef ISP2401 on the initial commit of atomisp.

Also I believe we can remove more if (IS_ISP2401) and /* ISP2401 */ things as well as the some remaining #ifdef ISP2401 things.

I added about this below and hope it clarifies things...

It is clearer now. Yeah, we can touch on whatever is inside the ISP2401 ifs, as we can now test them. Touching things for ISP2400 is harder, as we depend on a test platform.

Quoted 54 lines
Quoted 18 lines

The worse part of them are related to those files
(See Makefile):

obj-byt = \
	pci/css_2400_system/hive/ia_css_isp_configs.o \
	pci/css_2400_system/hive/ia_css_isp_params.o \
	pci/css_2400_system/hive/ia_css_isp_states.o \
obj-cht = \
	pci/css_2401_system/hive/ia_css_isp_configs.o \
	pci/css_2401_system/hive/ia_css_isp_params.o \
	pci/css_2401_system/hive/ia_css_isp_states.o \
	pci/css_2401_system/host/csi_rx.o \
	pci/css_2401_system/host/ibuf_ctrl.o \
	pci/css_2401_system/host/isys_dma.o \
	pci/css_2401_system/host/isys_irq.o \
	pci/css_2401_system/host/isys_stream2mmio.o
Quoted 16 lines

Those define regmaps for 2400 and 2401. I was able to remove a lot of things from the old css_2400/css_2401 directories, but the ones there at pci/*/css*/ia_css_isp_*.c are a lot more complex, and would require some mapping functions to allow the same driver to work with both BYT and CHT.

The better would be to test the driver first at BYT, fix issues (if any) and then write the mapping code.

Quoted 7 lines

So, we may also:

2. continue unifying #ifdef ISP2401 and #ifndef ISP2401 parts

but this way needs more human work I think though. And if we go this way, I also need to rewrite this patch as mentioned in the commit message.

What the idea #1 want to say is, let's remove things _initially_ within ifdef ISP2401 (so, except things which were added inside it later upstream) including formerly within ifdef ISP2401 things, i.e., if (IS_ISP2401) and things commented with /* ISP2401 */.

However, I don't say we can remove all the ifdefs like things formerly within USE_INPUT_SYSTEM_VERSION_2, USE_INPUT_SYSTEM_VERSION_2401, etc., which later removed/integrated into ifdef ISP2401 on some commits [1]. We may temporarily revert those commits when we want to distinguish between what were formerly within there and what were not.

Such ifdefs were added by them as a real hardware difference. Thus, I agree that we still need the CONFIG_VIDEO_ATOMISP_ISP2401 stuff to support both ISP2400/ISP2401 at the same time.

This is what I meant "reduce the ifdef usage" in a previous mail. So, I'm not talking about if dropping CONFIG_VIDEO_ATOMISP_ISP2401 is doable, but talking about just how to reduce the code.

Quoted 8 lines

[1] 641c2292bf19 ("media: atomisp: get rid of version-dependent globals") bd674b5a413c ("media: atomisp: cleanup ifdefs from ia_css_debug.c")

Anyway, if you agree or not on what I'm saying, can I send this patch without code changes in v2, i.e., looks OK for you regarding the code? I'll remove the commit message about irci_stable_candrpv_0415_20150521_0458 vs irci_ecr-master_20150911_0724 in v2 anyway, which needs to be discussed further later.

Quoted 5 lines

No need for a v2. The /17 patch series was merged already, plus some patches from the /5 that made sense to apply.

Ok, there are some followup patches that could be added, but please send those in separate.

OK, thanks. I'll prepare the followup patches as soon as I can.

Quoted 113 lines
Quoted 11 lines

The following notes are about what I have done until now for removing such tests. (More elaborated version than cover letter). You don't have to see them, but I hope it might clarify things...

## ifdef ISP2401 added in the initial commit of atomisp

The ifdef ISP2401 was the result of merging two different version of driver, added on the initial commit of upstreamed atomisp. And for the ifdef ISP2401, I confirmed I can remove (almost [1]) all of them against the initial commit of atomisp [2][3]

Quoted 8 lines

[1] here are the three exceptions:

    ("NOTE: ifdef ISP2400/ISP2401 usage in aero-atomisp")
    https://github.com/kitakar5525/linux-kernel/commit/1a8488cdd31ad38a3805824700b29d1e5213d3f2

[2] ("atomisp: pci: css2400: remove ISP2401 ifdefs")

    https://github.com/kitakar5525/linux-kernel/commit/dd6723fc5b9fe040e33b227b509a7e004243edce
[3] ("atomisp: pci: remove ISP2401 ifdefs for main pci driver")
    https://github.com/kitakar5525/linux-kernel/commit/1734341f84a96945af7635f6fff061db910f746f

Ok, if there are more if/ifdef ISP2401 that, if reverted will keep the driver running with the firmware we're using, I'm all for it. Just send the patches ;-)

Quoted 23 lines

Here is the kernel tree if someone is interested:

        https://github.com/kitakar5525/linux-kernel/tree/mainline+upst_atomisp@a49d25364dfb_first

Especially, here is one of the part where this patch is touching for example:

        --- a/drivers/staging/media/atomisp/pci/atomisp2/css2400/sh_css_mipi.c
        +++ b/drivers/staging/media/atomisp/pci/atomisp2/css2400/sh_css_mipi.c
        @@ -416,26 +362,16 @@ allocate_mipi_frames(struct ia_css_pipe *pipe, struct ia_css_stream_info *info)
[...]
        -#ifndef ISP2401
         	port = (unsigned int) pipe->stream->config.source.port.port;
         	assert(port < N_CSI_PORTS);
         	if (port >= N_CSI_PORTS) {
        -#else
        -	if (!ia_css_mipi_is_source_port_valid(pipe, &port)) {
        -#endif
         		ia_css_debug_dtrace(IA_CSS_DEBUG_TRACE_PRIVATE,
         			"allocate_mipi_frames(%p) exit: error: port is not correct (port=%d).\n",
         			pipe, port);
Quoted 3 lines

By removing (almost) all of the #ifdef ISP2401 things, (although we still can't remove like former USE_INPUT_SYSTEM_VERSION_2, USE_INPUT_SYSTEM_VERSION_2401) we can reduce the number of ifdefs.

Sounds good to me.

Quoted 53 lines

## ifdef ISP2401, if (IS_ISP2401) and /* ISP2401 */ in the recent
atomisp

That is for the initial commit of atomisp. For the recent version of atomisp, we can still remove ifdef ISP2401 things (again, except things which were added inside it later upstream) as well as the former ifdef ISP2401 things, i.e., if (IS_ISP2401) [1] and things commented with [2] /* ISP2401 */.

[1] ("atomisp: pci: remove IS_ISP2401 test")

    https://github.com/kitakar5525/linux-kernel/commit/397e543e493dfd60d91e2b5cc164da342b26906c

[2] ("atomisp: pci: remove /* ISP2401 */ comments and its contents")
https://github.com/kitakar5525/linux-kernel/commit/b3928e3c1a709853971715ce35459b9b79e708f2
These commits were made against
bd674b5a413c ("media: atomisp: cleanup ifdefs from ia_css_debug.c") where I randomely picked.

Here is the kernel tree if someone is interested:

    https://github.com/kitakar5525/linux-kernel/tree/mainline+upst_atomisp@bd674b5a413c_before_get_rid_ver_globals

I confirmed capture is still working here on surface3 (ISP2401). Compile tested for ISP2400. As you can see, there are some WIP and FIXME commits on top of removing such tests though. (The others are backports).

Especially, here is one of the part where this patch is touching for example:

        --- a/drivers/staging/media/atomisp/pci/sh_css_mipi.c
        +++ b/drivers/staging/media/atomisp/pci/sh_css_mipi.c
        @@ -553,10 +548,7 @@ free_mipi_frames(struct ia_css_pipe *pipe) {
         			return err;
         		}
        
        -		if (!IS_ISP2401)
        -			port = (unsigned int)pipe->stream->config.source.port.port;
        -		else
        -			err = ia_css_mipi_is_source_port_valid(pipe, &port);
        +		port = (unsigned int)pipe->stream->config.source.port.port;
        
         		assert(port < N_CSI_PORTS);

So, we can also remove a lot of if (IS_ISP2401) and /* ISP2401 */ things as well as the remaining ifdef ISP2401.

## WIP: removing ifdef ISP2401, if (IS_ISP2401) and /* ISP2401 */
against the latest atomisp

Quoted 6 lines

And here is the branch where I'm working on removing such tests against the latest atomisp:

https://github.com/kitakar5525/linux-kernel/commits/mainline+upst_atomisp+remove_unneeded_tests

It'd be the best if I can show you working one,

Quoted 8 lines

Well, send the ones that were already tested, and won't cause regressions to v4l2grab and camorama (e. g. it shouldn't cause generic V4L2 generic apps to break).

It would be nice to also not break nvt and other original apps for this device, as it could be useful later, in order to be able to test the other pipelines, as currently only the preview one seems to be working properly, at least with generic apps.

Got it :-)

Quoted 29 lines
Quoted 29 lines

but it currently has
seemingly include issues on ISP2400 vs ISP2401 (as well as many WIP commits I added):

	drivers/staging/media/atomisp/pci/runtime/isys/src/isys_init.c: In function ‘ia_css_isys_init’:
	drivers/staging/media/atomisp/pci/runtime/isys/src/isys_init.c:29:9: error: unknown type name ‘backend_channel_cfg_t’
	   29 |         backend_channel_cfg_t backend_ch0;
	      |         ^~~~~~~~~~~~~~~~~~~~~
	drivers/staging/media/atomisp/pci/runtime/isys/src/isys_init.c:30:9: error: unknown type name ‘backend_channel_cfg_t’
	   30 |         backend_channel_cfg_t backend_ch1;
	      |         ^~~~~~~~~~~~~~~~~~~~~
	drivers/staging/media/atomisp/pci/runtime/isys/src/isys_init.c:31:9: error: unknown type name ‘target_cfg2400_t’
	   31 |         target_cfg2400_t targetB;
	      |         ^~~~~~~~~~~~~~~~
	drivers/staging/media/atomisp/pci/runtime/isys/src/isys_init.c:32:9: error: unknown type name ‘target_cfg2400_t’
	   32 |         target_cfg2400_t targetC;
	      |         ^~~~~~~~~~~~~~~~
	[...]

The full output of the make error is here:

("NOTE: issue: some undeclared errors")
https://github.com/kitakar5525/linux-kernel/commit/a932d16681f941161385659b9d0316a3a4975e86

Regards,
Tsuchiya Yuto

Quoted 1 line
Quoted 1 line
Quoted 1 line
#31 lore raw

Re: [PATCH 04/17] media: atomisp: pci: do not use err var when checking port validity for ISP2400

Quoted 106 lines · Tsuchiya Yuto
Quoted 105 lines · Mauro Carvalho Chehab

Em Thu, 11 Nov 2021 23:34:23 +0900
Tsuchiya Yuto <[email protected]> escreveu:

Quoted 26 lines

Sorry for a little late reply. This is hard to explain...

Quoted 2 lines · Mauro Carvalho Chehab

Em Mon, 01 Nov 2021 22:38:55 +0900
Tsuchiya Yuto <[email protected]> escreveu:

[...]

Quoted 8 lines
Quoted 8 lines

This is not directly related to this series, but how we should reduce the ifdef usage in the future? Here are my two ideas:

1. (my initial idea) remove #ifdef ISP2401 part and make ISP2401

     part completely irci_stable_candrpv_0415_20150521_0458
Quoted 7 lines
Quoted 4 lines

this way does not require (relatively) much human work I think.

But as Mauro says, the #ifdef ISP2401 part (irci_ecr-master_20150911_0724) is basically an improved version.

No. What I said is that the if (ISP2401) and the remaining ifdefs are because of BYT x CHT.

I need to elaborate on this. Indeed some of them are really because of BYT x CHT, but others are stuff from irci_ecr-master_20150911_0724.

Quoted 8 lines

What I meant when I mentioned "remove #ifdef ISP2401 part" is that, removing things which was _initially_ inside the #ifdef ISP2401 on the initial commit of atomisp.

Also I believe we can remove more if (IS_ISP2401) and /* ISP2401 */ things as well as the some remaining #ifdef ISP2401 things.

I added about this below and hope it clarifies things...

It is clearer now. Yeah, we can touch on whatever is inside the ISP2401 ifs, as we can now test them. Touching things for ISP2400 is harder, as we depend on a test platform.

Quoted 62 lines
Quoted 18 lines

The worse part of them are related to those files
(See Makefile):

obj-byt = \
	pci/css_2400_system/hive/ia_css_isp_configs.o \
	pci/css_2400_system/hive/ia_css_isp_params.o \
	pci/css_2400_system/hive/ia_css_isp_states.o \
obj-cht = \
	pci/css_2401_system/hive/ia_css_isp_configs.o \
	pci/css_2401_system/hive/ia_css_isp_params.o \
	pci/css_2401_system/hive/ia_css_isp_states.o \
	pci/css_2401_system/host/csi_rx.o \
	pci/css_2401_system/host/ibuf_ctrl.o \
	pci/css_2401_system/host/isys_dma.o \
	pci/css_2401_system/host/isys_irq.o \
	pci/css_2401_system/host/isys_stream2mmio.o
Quoted 16 lines

Those define regmaps for 2400 and 2401. I was able to remove a lot of things from the old css_2400/css_2401 directories, but the ones there at pci/*/css*/ia_css_isp_*.c are a lot more complex, and would require some mapping functions to allow the same driver to work with both BYT and CHT.

The better would be to test the driver first at BYT, fix issues (if any) and then write the mapping code.

Quoted 7 lines

So, we may also:

2. continue unifying #ifdef ISP2401 and #ifndef ISP2401 parts

but this way needs more human work I think though. And if we go this way, I also need to rewrite this patch as mentioned in the commit message.

What the idea #1 want to say is, let's remove things _initially_ within ifdef ISP2401 (so, except things which were added inside it later upstream) including formerly within ifdef ISP2401 things, i.e., if (IS_ISP2401) and things commented with /* ISP2401 */.

However, I don't say we can remove all the ifdefs like things formerly within USE_INPUT_SYSTEM_VERSION_2, USE_INPUT_SYSTEM_VERSION_2401, etc., which later removed/integrated into ifdef ISP2401 on some commits [1]. We may temporarily revert those commits when we want to distinguish between what were formerly within there and what were not.

Such ifdefs were added by them as a real hardware difference. Thus, I agree that we still need the CONFIG_VIDEO_ATOMISP_ISP2401 stuff to support both ISP2400/ISP2401 at the same time.

This is what I meant "reduce the ifdef usage" in a previous mail. So, I'm not talking about if dropping CONFIG_VIDEO_ATOMISP_ISP2401 is doable, but talking about just how to reduce the code.

[1] 641c2292bf19 ("media: atomisp: get rid of version-dependent globals") bd674b5a413c ("media: atomisp: cleanup ifdefs from ia_css_debug.c")

Anyway, if you agree or not on what I'm saying, can I send this patch without code changes in v2, i.e., looks OK for you regarding the code? I'll remove the commit message about irci_stable_candrpv_0415_20150521_0458 vs irci_ecr-master_20150911_0724 in v2 anyway, which needs to be discussed further later.

Quoted 7 lines
Quoted 5 lines

No need for a v2. The /17 patch series was merged already, plus some patches from the /5 that made sense to apply.

Ok, there are some followup patches that could be added, but please send those in separate.

OK, thanks. I'll prepare the followup patches as soon as I can.

Oh, I spoke too soon. The issues pointed out by code review are already fixed/gone by rebase and later patches. Thanks!

Quoted 154 lines
Quoted 113 lines
Quoted 11 lines

The following notes are about what I have done until now for removing such tests. (More elaborated version than cover letter). You don't have to see them, but I hope it might clarify things...

## ifdef ISP2401 added in the initial commit of atomisp

The ifdef ISP2401 was the result of merging two different version of driver, added on the initial commit of upstreamed atomisp. And for the ifdef ISP2401, I confirmed I can remove (almost [1]) all of them against the initial commit of atomisp [2][3]

Quoted 8 lines

[1] here are the three exceptions:

    ("NOTE: ifdef ISP2400/ISP2401 usage in aero-atomisp")
    https://github.com/kitakar5525/linux-kernel/commit/1a8488cdd31ad38a3805824700b29d1e5213d3f2

[2] ("atomisp: pci: css2400: remove ISP2401 ifdefs")

    https://github.com/kitakar5525/linux-kernel/commit/dd6723fc5b9fe040e33b227b509a7e004243edce
[3] ("atomisp: pci: remove ISP2401 ifdefs for main pci driver")
    https://github.com/kitakar5525/linux-kernel/commit/1734341f84a96945af7635f6fff061db910f746f

Ok, if there are more if/ifdef ISP2401 that, if reverted will keep the driver running with the firmware we're using, I'm all for it. Just send the patches ;-)

Quoted 23 lines

Here is the kernel tree if someone is interested:

        https://github.com/kitakar5525/linux-kernel/tree/mainline+upst_atomisp@a49d25364dfb_first

Especially, here is one of the part where this patch is touching for example:

        --- a/drivers/staging/media/atomisp/pci/atomisp2/css2400/sh_css_mipi.c
        +++ b/drivers/staging/media/atomisp/pci/atomisp2/css2400/sh_css_mipi.c
        @@ -416,26 +362,16 @@ allocate_mipi_frames(struct ia_css_pipe *pipe, struct ia_css_stream_info *info)
[...]
        -#ifndef ISP2401
         	port = (unsigned int) pipe->stream->config.source.port.port;
         	assert(port < N_CSI_PORTS);
         	if (port >= N_CSI_PORTS) {
        -#else
        -	if (!ia_css_mipi_is_source_port_valid(pipe, &port)) {
        -#endif
         		ia_css_debug_dtrace(IA_CSS_DEBUG_TRACE_PRIVATE,
         			"allocate_mipi_frames(%p) exit: error: port is not correct (port=%d).\n",
         			pipe, port);
Quoted 3 lines

By removing (almost) all of the #ifdef ISP2401 things, (although we still can't remove like former USE_INPUT_SYSTEM_VERSION_2, USE_INPUT_SYSTEM_VERSION_2401) we can reduce the number of ifdefs.

Sounds good to me.

Quoted 53 lines

## ifdef ISP2401, if (IS_ISP2401) and /* ISP2401 */ in the recent
atomisp

That is for the initial commit of atomisp. For the recent version of atomisp, we can still remove ifdef ISP2401 things (again, except things which were added inside it later upstream) as well as the former ifdef ISP2401 things, i.e., if (IS_ISP2401) [1] and things commented with [2] /* ISP2401 */.

[1] ("atomisp: pci: remove IS_ISP2401 test")

    https://github.com/kitakar5525/linux-kernel/commit/397e543e493dfd60d91e2b5cc164da342b26906c

[2] ("atomisp: pci: remove /* ISP2401 */ comments and its contents")
https://github.com/kitakar5525/linux-kernel/commit/b3928e3c1a709853971715ce35459b9b79e708f2
These commits were made against
bd674b5a413c ("media: atomisp: cleanup ifdefs from ia_css_debug.c") where I randomely picked.

Here is the kernel tree if someone is interested:

    https://github.com/kitakar5525/linux-kernel/tree/mainline+upst_atomisp@bd674b5a413c_before_get_rid_ver_globals

I confirmed capture is still working here on surface3 (ISP2401). Compile tested for ISP2400. As you can see, there are some WIP and FIXME commits on top of removing such tests though. (The others are backports).

Especially, here is one of the part where this patch is touching for example:

        --- a/drivers/staging/media/atomisp/pci/sh_css_mipi.c
        +++ b/drivers/staging/media/atomisp/pci/sh_css_mipi.c
        @@ -553,10 +548,7 @@ free_mipi_frames(struct ia_css_pipe *pipe) {
         			return err;
         		}
        
        -		if (!IS_ISP2401)
        -			port = (unsigned int)pipe->stream->config.source.port.port;
        -		else
        -			err = ia_css_mipi_is_source_port_valid(pipe, &port);
        +		port = (unsigned int)pipe->stream->config.source.port.port;
        
         		assert(port < N_CSI_PORTS);

So, we can also remove a lot of if (IS_ISP2401) and /* ISP2401 */ things as well as the remaining ifdef ISP2401.

## WIP: removing ifdef ISP2401, if (IS_ISP2401) and /* ISP2401 */
against the latest atomisp

Quoted 6 lines

And here is the branch where I'm working on removing such tests against the latest atomisp:

https://github.com/kitakar5525/linux-kernel/commits/mainline+upst_atomisp+remove_unneeded_tests

It'd be the best if I can show you working one,

Quoted 8 lines

Well, send the ones that were already tested, and won't cause regressions to v4l2grab and camorama (e. g. it shouldn't cause generic V4L2 generic apps to break).

It would be nice to also not break nvt and other original apps for this device, as it could be useful later, in order to be able to test the other pipelines, as currently only the preview one seems to be working properly, at least with generic apps.

Got it :-)

Quoted 29 lines
Quoted 29 lines

but it currently has
seemingly include issues on ISP2400 vs ISP2401 (as well as many WIP commits I added):

	drivers/staging/media/atomisp/pci/runtime/isys/src/isys_init.c: In function ‘ia_css_isys_init’:
	drivers/staging/media/atomisp/pci/runtime/isys/src/isys_init.c:29:9: error: unknown type name ‘backend_channel_cfg_t’
	   29 |         backend_channel_cfg_t backend_ch0;
	      |         ^~~~~~~~~~~~~~~~~~~~~
	drivers/staging/media/atomisp/pci/runtime/isys/src/isys_init.c:30:9: error: unknown type name ‘backend_channel_cfg_t’
	   30 |         backend_channel_cfg_t backend_ch1;
	      |         ^~~~~~~~~~~~~~~~~~~~~
	drivers/staging/media/atomisp/pci/runtime/isys/src/isys_init.c:31:9: error: unknown type name ‘target_cfg2400_t’
	   31 |         target_cfg2400_t targetB;
	      |         ^~~~~~~~~~~~~~~~
	drivers/staging/media/atomisp/pci/runtime/isys/src/isys_init.c:32:9: error: unknown type name ‘target_cfg2400_t’
	   32 |         target_cfg2400_t targetC;
	      |         ^~~~~~~~~~~~~~~~
	[...]

The full output of the make error is here:

("NOTE: issue: some undeclared errors")
https://github.com/kitakar5525/linux-kernel/commit/a932d16681f941161385659b9d0316a3a4975e86

Regards,
Tsuchiya Yuto

Quoted 1 line
Quoted 1 line
Quoted 1 line
#32 lore raw

PATCH 5/17 media: atomisp: pci: fix inverted error check for ia_css_mipi_is_source_port_valid()

In reply to Tsuchiya Yuto

The function ia_css_mipi_is_source_port_valid() returns true if the port is valid. So, we can't use the existing err variable as is.

To fix this issue while reusing that variable, invert the return value when assigning it to the variable.

Fixes 3c0538fbad9f ("media: atomisp: get rid of most checks for ISP2401 version")
---
 .../staging/media/atomisp/pci/sh_css_mipi.c   | 24 ++++++++++++-------
 1 file changed, 15 insertions(+), 9 deletions(-)
drivers/staging/media/atomisp/pci/sh_css_mipi.c +15 -9
index 65fc93c5d56b..c1f2f6151c5f 100644
@@ -423,10 +423,12 @@ allocate_mipi_frames(struct ia_css_pipe *pipe,
 		return 0; /* AM TODO: Check  */
 	}
 
-	if (!IS_ISP2401)
+	if (!IS_ISP2401) {
 		port = (unsigned int)pipe->stream->config.source.port.port;
-	else
-		err = ia_css_mipi_is_source_port_valid(pipe, &port);
+	} else {
+		/* Returns true if port is valid. So, invert it */
+		err = !ia_css_mipi_is_source_port_valid(pipe, &port);
+	}
 
 	assert(port < N_CSI_PORTS);
 
@@ -553,10 +555,12 @@ free_mipi_frames(struct ia_css_pipe *pipe)
 			return err;
 		}
 
-		if (!IS_ISP2401)
+		if (!IS_ISP2401) {
 			port = (unsigned int)pipe->stream->config.source.port.port;
-		else
-			err = ia_css_mipi_is_source_port_valid(pipe, &port);
+		} else {
+			/* Returns true if port is valid. So, invert it */
+			err = !ia_css_mipi_is_source_port_valid(pipe, &port);
+		}
 
 		assert(port < N_CSI_PORTS);
 
@@ -665,10 +669,12 @@ send_mipi_frames(struct ia_css_pipe *pipe)
 		/* TODO: AM: maybe this should be returning an error. */
 	}
 
-	if (!IS_ISP2401)
+	if (!IS_ISP2401) {
 		port = (unsigned int)pipe->stream->config.source.port.port;
-	else
-		err = ia_css_mipi_is_source_port_valid(pipe, &port);
+	} else {
+		/* Returns true if port is valid. So, invert it */
+		err = !ia_css_mipi_is_source_port_valid(pipe, &port);
+	}
 
 	assert(port < N_CSI_PORTS);
 
Signature · 1 line
2.33.1
#33 lore raw

Re: [PATCH 05/17] media: atomisp: pci: fix inverted error check for ia_css_mipi_is_source_port_valid()

Quoted 18 lines · Tsuchiya Yuto

The function ia_css_mipi_is_source_port_valid() returns true if the port is valid. So, we can't use the existing err variable as is.

To fix this issue while reusing that variable, invert the return value when assigning it to the variable.

Fixes 3c0538fbad9f ("media: atomisp: get rid of most checks for ISP2401 version")
---
 .../staging/media/atomisp/pci/sh_css_mipi.c   | 24 ++++++++++++-------
 1 file changed, 15 insertions(+), 9 deletions(-)
drivers/staging/media/atomisp/pci/sh_css_mipi.c +0 -0
index 65fc93c5d56b..c1f2f6151c5f 100644
@@ -423,10 +423,12 @@ allocate_mipi_frames(struct ia_css_pipe *pipe,
 		return 0; /* AM TODO: Check  */

drivers/staging/media/atomisp/pci/sh_css_mipi.c allocate_mipi_frames(struct ia_css_pipe *pipe, · line 430

Quoted 10 lines
drivers/staging/media/atomisp/pci/sh_css_mipi.c +4 -3
 	}
 
-	if (!IS_ISP2401)
+	if (!IS_ISP2401) {
 		port = (unsigned int)pipe->stream->config.source.port.port;
-	else
-		err = ia_css_mipi_is_source_port_valid(pipe, &port);
+	} else {
+		/* Returns true if port is valid. So, invert it */
+		err = !ia_css_mipi_is_source_port_valid(pipe, &port);

Don't invert it... This isn't supposed to return 1 on failure it's supposed to return negative error codes.

Quoted 6 lines
drivers/staging/media/atomisp/pci/sh_css_mipi.c +1 -0
+	}
 
 	assert(port < N_CSI_PORTS);
 
@@ -553,10 +555,12 @@ free_mipi_frames(struct ia_css_pipe *pipe)
 			return err;

drivers/staging/media/atomisp/pci/sh_css_mipi.c free_mipi_frames(struct ia_css_pipe *pipe) · line 562

Quoted 10 lines
drivers/staging/media/atomisp/pci/sh_css_mipi.c +4 -3
 		}
 
-		if (!IS_ISP2401)
+		if (!IS_ISP2401) {
 			port = (unsigned int)pipe->stream->config.source.port.port;
-		else
-			err = ia_css_mipi_is_source_port_valid(pipe, &port);
+		} else {
+			/* Returns true if port is valid. So, invert it */
+			err = !ia_css_mipi_is_source_port_valid(pipe, &port);

Presumably the same here?

Quoted 6 lines
drivers/staging/media/atomisp/pci/sh_css_mipi.c +1 -0
+		}
 
 		assert(port < N_CSI_PORTS);
 
@@ -665,10 +669,12 @@ send_mipi_frames(struct ia_css_pipe *pipe)
 		/* TODO: AM: maybe this should be returning an error. */

drivers/staging/media/atomisp/pci/sh_css_mipi.c send_mipi_frames(struct ia_css_pipe *pipe) · line 676

Quoted 10 lines
drivers/staging/media/atomisp/pci/sh_css_mipi.c +4 -3
 	}
 
-	if (!IS_ISP2401)
+	if (!IS_ISP2401) {
 		port = (unsigned int)pipe->stream->config.source.port.port;
-	else
-		err = ia_css_mipi_is_source_port_valid(pipe, &port);
+	} else {
+		/* Returns true if port is valid. So, invert it */
+		err = !ia_css_mipi_is_source_port_valid(pipe, &port);

Same?

drivers/staging/media/atomisp/pci/sh_css_mipi.c allocate_mipi_frames(struct ia_css_pipe *pipe, · line 433

Quoted 3 lines
drivers/staging/media/atomisp/pci/sh_css_mipi.c +1 -0
+	}
 
 	assert(port < N_CSI_PORTS);

regards,
dan carpenter

#34 lore raw

Re: [PATCH 05/17] media: atomisp: pci: fix inverted error check for ia_css_mipi_is_source_port_valid()

Quoted 21 lines · Dan Carpenter
Quoted 20 lines · Tsuchiya Yuto

The function ia_css_mipi_is_source_port_valid() returns true if the port is valid. So, we can't use the existing err variable as is.

To fix this issue while reusing that variable, invert the return value when assigning it to the variable.

Fixes 3c0538fbad9f ("media: atomisp: get rid of most checks for ISP2401 version")
---
 .../staging/media/atomisp/pci/sh_css_mipi.c   | 24 ++++++++++++-------
 1 file changed, 15 insertions(+), 9 deletions(-)
drivers/staging/media/atomisp/pci/sh_css_mipi.c +0 -0
index 65fc93c5d56b..c1f2f6151c5f 100644
@@ -423,10 +423,12 @@ allocate_mipi_frames(struct ia_css_pipe *pipe,
 		return 0; /* AM TODO: Check  */
 	}
 
Quoted 11 lines

drivers/staging/media/atomisp/pci/sh_css_mipi.c allocate_mipi_frames(struct ia_css_pipe *pipe, · line 430

Quoted 8 lines
drivers/staging/media/atomisp/pci/sh_css_mipi.c +4 -3
-	if (!IS_ISP2401)
+	if (!IS_ISP2401) {
 		port = (unsigned int)pipe->stream->config.source.port.port;
-	else
-		err = ia_css_mipi_is_source_port_valid(pipe, &port);
+	} else {
+		/* Returns true if port is valid. So, invert it */
+		err = !ia_css_mipi_is_source_port_valid(pipe, &port);

Don't invert it... This isn't supposed to return 1 on failure it's supposed to return negative error codes.

You mean I should instead modify the return value of ia_css_mipi_is_source_port_valid() ?

Yeah, I also thought that the current true/false return value was a little bit confusing.

In another words, should the function return:

- negative values (maybe -EINVAL for this case) for invalid case
- 0 for valid case

instead? and if we go this way, we should also rename the function name like

- check_ia_css_mipi_source_port_validity

or something. How does this sound?

Regards,
Tsuchiya Yuto

#35 lore raw

Re: [PATCH 05/17] media: atomisp: pci: fix inverted error check for ia_css_mipi_is_source_port_valid()

Quoted 34 lines · Tsuchiya Yuto
Quoted 21 lines · Dan Carpenter
Quoted 20 lines · Tsuchiya Yuto

The function ia_css_mipi_is_source_port_valid() returns true if the port is valid. So, we can't use the existing err variable as is.

To fix this issue while reusing that variable, invert the return value when assigning it to the variable.

Fixes 3c0538fbad9f ("media: atomisp: get rid of most checks for ISP2401 version")
---
 .../staging/media/atomisp/pci/sh_css_mipi.c   | 24 ++++++++++++-------
 1 file changed, 15 insertions(+), 9 deletions(-)
drivers/staging/media/atomisp/pci/sh_css_mipi.c +0 -0
index 65fc93c5d56b..c1f2f6151c5f 100644
@@ -423,10 +423,12 @@ allocate_mipi_frames(struct ia_css_pipe *pipe,
 		return 0; /* AM TODO: Check  */
 	}
 
Quoted 11 lines

drivers/staging/media/atomisp/pci/sh_css_mipi.c allocate_mipi_frames(struct ia_css_pipe *pipe, · line 430

Quoted 8 lines
drivers/staging/media/atomisp/pci/sh_css_mipi.c +4 -3
-	if (!IS_ISP2401)
+	if (!IS_ISP2401) {
 		port = (unsigned int)pipe->stream->config.source.port.port;
-	else
-		err = ia_css_mipi_is_source_port_valid(pipe, &port);
+	} else {
+		/* Returns true if port is valid. So, invert it */
+		err = !ia_css_mipi_is_source_port_valid(pipe, &port);

Don't invert it... This isn't supposed to return 1 on failure it's supposed to return negative error codes.

Quoted 3 lines

You mean I should instead modify the return value of ia_css_mipi_is_source_port_valid() ?

No. ia_css_mipi_is_source_port_valid() is fine. It has a boolean name so returning bool is fine. What I'm saying is that allocate_mipi_frames() should do:

	if (!ia_css_mipi_is_source_port_valid(pipe, &port))
		err = -EINVAL;

Otherwise it returns negative error codes and 1 on failure.

regards,
dan carpenter

#36 lore raw

Re: [PATCH 05/17] media: atomisp: pci: fix inverted error check for ia_css_mipi_is_source_port_valid()

<removed Alan from Cc as the mail address not reachable>

Quoted 39 lines · Dan Carpenter
Quoted 34 lines · Tsuchiya Yuto
Quoted 21 lines · Dan Carpenter
Quoted 20 lines · Tsuchiya Yuto

The function ia_css_mipi_is_source_port_valid() returns true if the port is valid. So, we can't use the existing err variable as is.

To fix this issue while reusing that variable, invert the return value when assigning it to the variable.

Fixes 3c0538fbad9f ("media: atomisp: get rid of most checks for ISP2401 version")
---
 .../staging/media/atomisp/pci/sh_css_mipi.c   | 24 ++++++++++++-------
 1 file changed, 15 insertions(+), 9 deletions(-)
drivers/staging/media/atomisp/pci/sh_css_mipi.c +0 -0
index 65fc93c5d56b..c1f2f6151c5f 100644
@@ -423,10 +423,12 @@ allocate_mipi_frames(struct ia_css_pipe *pipe,
 		return 0; /* AM TODO: Check  */
 	}
 
Quoted 11 lines

drivers/staging/media/atomisp/pci/sh_css_mipi.c allocate_mipi_frames(struct ia_css_pipe *pipe, · line 430

Quoted 8 lines
drivers/staging/media/atomisp/pci/sh_css_mipi.c +4 -3
-	if (!IS_ISP2401)
+	if (!IS_ISP2401) {
 		port = (unsigned int)pipe->stream->config.source.port.port;
-	else
-		err = ia_css_mipi_is_source_port_valid(pipe, &port);
+	} else {
+		/* Returns true if port is valid. So, invert it */
+		err = !ia_css_mipi_is_source_port_valid(pipe, &port);

Don't invert it... This isn't supposed to return 1 on failure it's supposed to return negative error codes.

Quoted 3 lines

You mean I should instead modify the return value of ia_css_mipi_is_source_port_valid() ?

Quoted 8 lines

No. ia_css_mipi_is_source_port_valid() is fine. It has a boolean name so returning bool is fine. What I'm saying is that allocate_mipi_frames() should do:

	if (!ia_css_mipi_is_source_port_valid(pipe, &port))
		err = -EINVAL;

Otherwise it returns negative error codes and 1 on failure.

Ah, I see! Thank you. I feel I'm a stupid... I'll do so in v2.

Regards,
Tsuchiya Yuto

#37 lore raw

Re: [PATCH 05/17] media: atomisp: pci: fix inverted error check for ia_css_mipi_is_source_port_valid()

Quoted 3 lines · Tsuchiya Yuto

Ah, I see! Thank you. I feel I'm a stupid... I'll do so in v2.

Not at all.

It's easy for me to not introduce bugs because I never write new code. I just sit here all day obsessing about error handling.

regards,
dan carpenter

#38 lore raw

Re: [PATCH 05/17] media: atomisp: pci: fix inverted error check for ia_css_mipi_is_source_port_valid()

In reply to Tsuchiya Yuto

Em Tue, 09 Nov 2021 00:25:52 +0900
Tsuchiya Yuto <[email protected]> escreveu:

Quoted 46 lines

<removed Alan from Cc as the mail address not reachable>

Quoted 43 lines · Dan Carpenter
Quoted 34 lines · Tsuchiya Yuto
Quoted 21 lines · Dan Carpenter
Quoted 20 lines · Tsuchiya Yuto

The function ia_css_mipi_is_source_port_valid() returns true if the port is valid. So, we can't use the existing err variable as is.

To fix this issue while reusing that variable, invert the return value when assigning it to the variable.

Fixes 3c0538fbad9f ("media: atomisp: get rid of most checks for ISP2401 version")
---
 .../staging/media/atomisp/pci/sh_css_mipi.c   | 24 ++++++++++++-------
 1 file changed, 15 insertions(+), 9 deletions(-)
drivers/staging/media/atomisp/pci/sh_css_mipi.c +0 -0
index 65fc93c5d56b..c1f2f6151c5f 100644
@@ -423,10 +423,12 @@ allocate_mipi_frames(struct ia_css_pipe *pipe,
 		return 0; /* AM TODO: Check  */
 	}
 
Quoted 11 lines

drivers/staging/media/atomisp/pci/sh_css_mipi.c allocate_mipi_frames(struct ia_css_pipe *pipe, · line 430

Quoted 8 lines
drivers/staging/media/atomisp/pci/sh_css_mipi.c +4 -3
-	if (!IS_ISP2401)
+	if (!IS_ISP2401) {
 		port = (unsigned int)pipe->stream->config.source.port.port;
-	else
-		err = ia_css_mipi_is_source_port_valid(pipe, &port);
+	} else {
+		/* Returns true if port is valid. So, invert it */
+		err = !ia_css_mipi_is_source_port_valid(pipe, &port);  

Don't invert it... This isn't supposed to return 1 on failure it's supposed to return negative error codes.

Quoted 3 lines

You mean I should instead modify the return value of ia_css_mipi_is_source_port_valid() ?

No. ia_css_mipi_is_source_port_valid() is fine. It has a boolean name so returning bool is fine. What I'm saying is that allocate_mipi_frames() should do:

Quoted 6 lines
Quoted 4 lines
	if (!ia_css_mipi_is_source_port_valid(pipe, &port))
		err = -EINVAL;

Otherwise it returns negative error codes and 1 on failure.

Ah, I see! Thank you. I feel I'm a stupid... I'll do so in v2.

I would prefer if you could send such changes on new patches.

Regards,
Mauro

#39 lore raw

Re: [PATCH 05/17] media: atomisp: pci: fix inverted error check for ia_css_mipi_is_source_port_valid()

Quoted 49 lines · Mauro Carvalho Chehab

Em Tue, 09 Nov 2021 00:25:52 +0900
Tsuchiya Yuto <[email protected]> escreveu:

Quoted 46 lines

<removed Alan from Cc as the mail address not reachable>

Quoted 43 lines · Dan Carpenter
Quoted 34 lines · Tsuchiya Yuto
Quoted 21 lines · Dan Carpenter
Quoted 20 lines · Tsuchiya Yuto

The function ia_css_mipi_is_source_port_valid() returns true if the port is valid. So, we can't use the existing err variable as is.

To fix this issue while reusing that variable, invert the return value when assigning it to the variable.

Fixes 3c0538fbad9f ("media: atomisp: get rid of most checks for ISP2401 version")
---
 .../staging/media/atomisp/pci/sh_css_mipi.c   | 24 ++++++++++++-------
 1 file changed, 15 insertions(+), 9 deletions(-)
drivers/staging/media/atomisp/pci/sh_css_mipi.c +0 -0
index 65fc93c5d56b..c1f2f6151c5f 100644
@@ -423,10 +423,12 @@ allocate_mipi_frames(struct ia_css_pipe *pipe,
 		return 0; /* AM TODO: Check  */
 	}
 
Quoted 11 lines

drivers/staging/media/atomisp/pci/sh_css_mipi.c allocate_mipi_frames(struct ia_css_pipe *pipe, · line 430

Quoted 8 lines
drivers/staging/media/atomisp/pci/sh_css_mipi.c +4 -3
-	if (!IS_ISP2401)
+	if (!IS_ISP2401) {
 		port = (unsigned int)pipe->stream->config.source.port.port;
-	else
-		err = ia_css_mipi_is_source_port_valid(pipe, &port);
+	} else {
+		/* Returns true if port is valid. So, invert it */
+		err = !ia_css_mipi_is_source_port_valid(pipe, &port);  

Don't invert it... This isn't supposed to return 1 on failure it's supposed to return negative error codes.

Quoted 3 lines

You mean I should instead modify the return value of ia_css_mipi_is_source_port_valid() ?

No. ia_css_mipi_is_source_port_valid() is fine. It has a boolean name so returning bool is fine. What I'm saying is that allocate_mipi_frames() should do:

Quoted 8 lines
Quoted 6 lines
Quoted 4 lines
	if (!ia_css_mipi_is_source_port_valid(pipe, &port))
		err = -EINVAL;

Otherwise it returns negative error codes and 1 on failure.

Ah, I see! Thank you. I feel I'm a stupid... I'll do so in v2.

I would prefer if you could send such changes on new patches.

I'm a little bit too late, sorry. For the record, the return value issue pointed out here is already gone with patch ("media: atomisp: sh_css_mipi:
cleanup the code") [1]. Thanks!

[1] https://lore.kernel.org/linux-media/b541d4c9923154be7ae0518d01ce994acbef3f9b.1637142905.git.mchehab+huawei@kernel.org/

#40 lore raw

PATCH 6/17 media: atomisp: pci: use IA_CSS_ERROR() for error messages in sh_css_mipi.c

In reply to Tsuchiya Yuto

Some debug messages for error cases (messages contain "error: ") use IA_CSS_DEBUG_TRACE_PRIVATE debug level. This causes these error messages not to appear unless users raise debug output level to 7 or higher (using module parameter, dbg_level=7).

So, use IA_CSS_DEBUG_ERROR debug level (dbg_level=1) instead considering that these are error messages. There is already a macro IA_CSS_ERROR() for this use case. Let's use it. It automatically appends "error: " at the beginning and a newline to a message. Therefore, we can remove them from these messages.

While here, remove the unnecessary newline from one IA_CSS_ERROR() occurrence in the same file.

---
 .../staging/media/atomisp/pci/sh_css_mipi.c   | 32 ++++++++-----------
 1 file changed, 13 insertions(+), 19 deletions(-)
drivers/staging/media/atomisp/pci/sh_css_mipi.c +13 -19
index c1f2f6151c5f..de56a1da754d 100644
@@ -434,9 +434,8 @@ allocate_mipi_frames(struct ia_css_pipe *pipe,
 
 	if ((!IS_ISP2401 && port >= N_CSI_PORTS) ||
 	    (IS_ISP2401 && err)) {
-		ia_css_debug_dtrace(IA_CSS_DEBUG_TRACE_PRIVATE,
-				    "allocate_mipi_frames(%p) exit: error: port is not correct (port=%d).\n",
-				    pipe, port);
+		IA_CSS_ERROR("allocate_mipi_frames(%p) exit: port is not correct (port=%d).",
+			     pipe, port);
 		return -EINVAL;
 	}
 
@@ -497,9 +496,8 @@ allocate_mipi_frames(struct ia_css_pipe *pipe,
 							my_css.mipi_frames[port][j] = NULL;
 						}
 					}
-					ia_css_debug_dtrace(IA_CSS_DEBUG_TRACE_PRIVATE,
-							    "allocate_mipi_frames(%p, %d) exit: error: allocation failed.\n",
-							    pipe, port);
+					IA_CSS_ERROR("allocate_mipi_frames(%p, %d) exit: allocation failed.",
+						     pipe, port);
 					return err;
 				}
 			}
@@ -542,16 +540,14 @@ free_mipi_frames(struct ia_css_pipe *pipe)
 	if (pipe) {
 		assert(pipe->stream);
 		if ((!pipe) || (!pipe->stream)) {
-			ia_css_debug_dtrace(IA_CSS_DEBUG_TRACE_PRIVATE,
-					    "free_mipi_frames(%p) exit: error: pipe or stream is null.\n",
-					    pipe);
+			IA_CSS_ERROR("free_mipi_frames(%p) exit: pipe or stream is null.",
+				     pipe);
 			return -EINVAL;
 		}
 
 		if (!buffers_needed(pipe)) {
-			ia_css_debug_dtrace(IA_CSS_DEBUG_TRACE_PRIVATE,
-					    "free_mipi_frames(%p) exit: error: wrong mode.\n",
-					    pipe);
+			IA_CSS_ERROR("free_mipi_frames(%p) exit: wrong mode.",
+				     pipe);
 			return err;
 		}
 
@@ -566,9 +562,8 @@ free_mipi_frames(struct ia_css_pipe *pipe)
 
 		if ((!IS_ISP2401 && port >= N_CSI_PORTS) ||
 		    (IS_ISP2401 && err)) {
-			ia_css_debug_dtrace(IA_CSS_DEBUG_TRACE_PRIVATE,
-					    "free_mipi_frames(%p, %d) exit: error: pipe port is not correct.\n",
-					    pipe, port);
+			IA_CSS_ERROR("free_mipi_frames(%p, %d) exit: pipe port is not correct.",
+				     pipe, port);
 			return err;
 		}
 
@@ -576,9 +571,8 @@ free_mipi_frames(struct ia_css_pipe *pipe)
 #if !defined(ISP2401)
 			assert(ref_count_mipi_allocation[port] == 1);
 			if (ref_count_mipi_allocation[port] != 1) {
-				ia_css_debug_dtrace(IA_CSS_DEBUG_TRACE_PRIVATE,
-						    "free_mipi_frames(%p) exit: error: wrong ref_count (ref_count=%d).\n",
-						    pipe, ref_count_mipi_allocation[port]);
+				IA_CSS_ERROR("free_mipi_frames(%p) exit: wrong ref_count (ref_count=%d).",
+					     pipe, ref_count_mipi_allocation[port]);
 				return err;
 			}
 #endif
@@ -680,7 +674,7 @@ send_mipi_frames(struct ia_css_pipe *pipe)
 
 	if ((!IS_ISP2401 && port >= N_CSI_PORTS) ||
 	    (IS_ISP2401 && err)) {
-		IA_CSS_ERROR("send_mipi_frames(%p) exit: invalid port specified (port=%d).\n",
+		IA_CSS_ERROR("send_mipi_frames(%p) exit: invalid port specified (port=%d).",
 			     pipe, port);
 		return err;
 	}
Signature · 1 line
2.33.1
#41 lore raw

Re: [PATCH 06/17] media: atomisp: pci: use IA_CSS_ERROR() for error messages in sh_css_mipi.c

Quoted 8 lines · Tsuchiya Yuto
 .../staging/media/atomisp/pci/sh_css_mipi.c   | 32 ++++++++-----------
 1 file changed, 13 insertions(+), 19 deletions(-)
drivers/staging/media/atomisp/pci/sh_css_mipi.c +0 -0
index c1f2f6151c5f..de56a1da754d 100644

drivers/staging/media/atomisp/pci/sh_css_mipi.c allocate_mipi_frames(struct ia_css_pipe *pipe, · line 438

Quoted 8 lines
drivers/staging/media/atomisp/pci/sh_css_mipi.c +2 -3
@@ -434,9 +434,8 @@ allocate_mipi_frames(struct ia_css_pipe *pipe,
 
 	if ((!IS_ISP2401 && port >= N_CSI_PORTS) ||
 	    (IS_ISP2401 && err)) {
-		ia_css_debug_dtrace(IA_CSS_DEBUG_TRACE_PRIVATE,
-				    "allocate_mipi_frames(%p) exit: error: port is not correct (port=%d).\n",
-				    pipe, port);
+		IA_CSS_ERROR("allocate_mipi_frames(%p) exit: port is not correct (port=%d).",
+			     pipe, port);

Not related to this patch but these printks should be using __func__ instead of hard coding it.

regards,
dan carpenter

#42 lore raw

Re: [PATCH 06/17] media: atomisp: pci: use IA_CSS_ERROR() for error messages in sh_css_mipi.c

<removed Alan from Cc as the mail address not reachable>

Quoted 10 lines · Dan Carpenter
Quoted 9 lines · Tsuchiya Yuto
 .../staging/media/atomisp/pci/sh_css_mipi.c   | 32 ++++++++-----------
 1 file changed, 13 insertions(+), 19 deletions(-)
drivers/staging/media/atomisp/pci/sh_css_mipi.c +0 -0
index c1f2f6151c5f..de56a1da754d 100644
@@ -434,9 +434,8 @@ allocate_mipi_frames(struct ia_css_pipe *pipe,
 
Quoted 10 lines

drivers/staging/media/atomisp/pci/sh_css_mipi.c allocate_mipi_frames(struct ia_css_pipe *pipe, · line 438

Quoted 7 lines
drivers/staging/media/atomisp/pci/sh_css_mipi.c +2 -3
 	if ((!IS_ISP2401 && port >= N_CSI_PORTS) ||
 	    (IS_ISP2401 && err)) {
-		ia_css_debug_dtrace(IA_CSS_DEBUG_TRACE_PRIVATE,
-				    "allocate_mipi_frames(%p) exit: error: port is not correct (port=%d).\n",
-				    pipe, port);
+		IA_CSS_ERROR("allocate_mipi_frames(%p) exit: port is not correct (port=%d).",
+			     pipe, port);

Not related to this patch but these printks should be using __func__ instead of hard coding it.

OK, considering that I'll add a separate space issue fix patch in v2 as discussed in another mail, I'll also add the separate fix for minor issue fixes here, including the usage of __func__ and dropping the unneeded newline \n I'm currently doing while here.

Regards,
Tsuchiya Yuto

#43 lore raw

Re: [PATCH 06/17] media: atomisp: pci: use IA_CSS_ERROR() for error messages in sh_css_mipi.c

Em Tue, 09 Nov 2021 00:39:16 +0900
Tsuchiya Yuto <[email protected]> escreveu:

Quoted 24 lines

<removed Alan from Cc as the mail address not reachable>

Quoted 10 lines · Dan Carpenter
Quoted 9 lines · Tsuchiya Yuto
 .../staging/media/atomisp/pci/sh_css_mipi.c   | 32 ++++++++-----------
 1 file changed, 13 insertions(+), 19 deletions(-)
drivers/staging/media/atomisp/pci/sh_css_mipi.c +0 -0
index c1f2f6151c5f..de56a1da754d 100644
@@ -434,9 +434,8 @@ allocate_mipi_frames(struct ia_css_pipe *pipe,
 
Quoted 10 lines

drivers/staging/media/atomisp/pci/sh_css_mipi.c allocate_mipi_frames(struct ia_css_pipe *pipe, · line 438

Quoted 7 lines
drivers/staging/media/atomisp/pci/sh_css_mipi.c +2 -3
 	if ((!IS_ISP2401 && port >= N_CSI_PORTS) ||
 	    (IS_ISP2401 && err)) {
-		ia_css_debug_dtrace(IA_CSS_DEBUG_TRACE_PRIVATE,
-				    "allocate_mipi_frames(%p) exit: error: port is not correct (port=%d).\n",
-				    pipe, port);
+		IA_CSS_ERROR("allocate_mipi_frames(%p) exit: port is not correct (port=%d).",
+			     pipe, port);  

Not related to this patch but these printks should be using __func__ instead of hard coding it.

Quoted 4 lines

OK, considering that I'll add a separate space issue fix patch in v2 as discussed in another mail, I'll also add the separate fix for minor issue fixes here, including the usage of __func__ and dropping the unneeded newline \n I'm currently doing while here.

Better to keep the \n. The right fix - not only here but everywhere - would be to convert all those into dev_info/dev_dbg/..., but this is a huge change.

I would prefer to do such changes on a separate patch series that will do only this kind of changes. After the conversion, the string should finish with a \n. So, dropping it will just make the conversion more error-prone.

Regards,
Mauro

Quoted 4 lines

Regards,
Tsuchiya Yuto

#44 lore raw

PATCH 7/17 media: atomisp: pci: fix ifdefs in sh_css.c

In reply to Tsuchiya Yuto

## if (pipe->stream->config.mode == IA_CSS_INPUT_MODE_TPG) { case

The intel-aero atomisp has #if defined(IS_ISP_2400_SYSTEM) [1]. It is to be defined in the following two places [2]:

- css/hive_isp_css_common/system_global.h
- css/css_2401_csi2p_system/system_global.h

and the former file is to be included on ISP2400 devices, too. So, it is to be defined for both ISP2400 and ISP2401 devices.

Because the upstreamed atomisp driver now supports only ISP2400 and ISP2401, just remove the ISP version test again. This matches the other upstream commits like 3c0538fbad9f ("media: atomisp: get rid of most checks for ISP2401 version").

While here, moved the comment for define GP_ISEL_TPG_MODE to the appropriate place.

[1] https://github.com/intel-aero/linux-kernel/blob/a1b673258feb915268377275130c5c5df0eafc82/drivers/media/pci/atomisp/css/sh_css.c#L552-L558
[2] https://github.com/intel-aero/linux-kernel/search?q=IS_ISP_2400_SYSTEM

## isys_stream_descr->polling_mode case

This does not exist on the intel-aero atomisp. This is because it is based on css version irci_stable_candrpv_0415_20150521_0458.

On the other hand, the upstreamed atomisp is based on the following css version depending on the ISP version using ifdefs:

- ISP2400: irci_stable_candrpv_0415_20150521_0458
- ISP2401: irci_master_20150911_0724

The isys_stream_descr->polling_mode usage was added on updating css version to irci_master_20150701_0213 [3].

So, it is not a ISP version specific thing, but css version specific thing. Because the upstreamed atomisp driver uses irci_master_20150911_0724 for ISP2401, re-add the ISP version check for now.

I say "for now" because ISP2401 should eventually use the same css version with ISP2400 (i.e., irci_stable_candrpv_0415_20150521_0458)

[3] https://raw.githubusercontent.com/intel/ProductionKernelQuilts/cht-m1stable-2016_ww31/uefi/cht-m1stable/patches/cam-0439-atomisp2-css2401-and-2401_legacy-irci_master_2015070.patch
("atomisp2: css2401 and 2401_legacy-irci_master_20150701_0213")
Link to Intel's Android kernel patch.

## coord = &me->config.internal_frame_origin_bqs_on_sctbl; case

it was added on commit 4f744a573db3 ("media: atomisp: make sh_css_sp_init_pipeline() ISP version independent") for ISP2401. Because the upstreamed atomisp for the ISP2401 part is based on irci_master_20150911_0724, hence the difference.

Because the upstreamed atomisp driver uses irci_master_20150911_0724 for ISP2401, revert the test back to if (IS_ISP2401).

Fixes 27333dadef57 ("media: atomisp: adjust some code at sh_css that could be broken")
---
 drivers/staging/media/atomisp/pci/sh_css.c | 27 +++++++++-------------
 1 file changed, 11 insertions(+), 16 deletions(-)
drivers/staging/media/atomisp/pci/sh_css.c +11 -16
index c4b35cbab373..ba25d0da8b81 100644
@@ -522,6 +522,7 @@ ia_css_stream_input_format_bits_per_pixel(struct ia_css_stream *stream)
 	return bpp;
 }
 
+/* TODO: move define to proper file in tools */
 #define GP_ISEL_TPG_MODE 0x90058
 
 #if !defined(ISP2401)
@@ -573,12 +574,8 @@ sh_css_config_input_network(struct ia_css_stream *stream)
 		vblank_cycles = vblank_lines * (width + hblank_cycles);
 		sh_css_sp_configure_sync_gen(width, height, hblank_cycles,
 					     vblank_cycles);
-		if (!IS_ISP2401) {
-			if (pipe->stream->config.mode == IA_CSS_INPUT_MODE_TPG) {
-				/* TODO: move define to proper file in tools */
-				ia_css_device_store_uint32(GP_ISEL_TPG_MODE, 0);
-			}
-		}
+		if (pipe->stream->config.mode == IA_CSS_INPUT_MODE_TPG)
+			ia_css_device_store_uint32(GP_ISEL_TPG_MODE, 0);
 	}
 	ia_css_debug_dtrace(IA_CSS_DEBUG_TRACE_PRIVATE,
 			    "sh_css_config_input_network() leave:\n");
@@ -1009,16 +1006,14 @@ static bool sh_css_translate_stream_cfg_to_isys_stream_descr(
 	 * ia_css_isys_stream_capture_indication() instead of
 	 * ia_css_pipeline_sp_wait_for_isys_stream_N() as isp processing of
 	 * capture takes longer than getting an ISYS frame
-	 *
-	 * Only 2401 relevant ??
 	 */
-#if 0 // FIXME: NOT USED on Yocto Aero
-	isys_stream_descr->polling_mode
-	    = early_polling ? INPUT_SYSTEM_POLL_ON_CAPTURE_REQUEST
-	      : INPUT_SYSTEM_POLL_ON_WAIT_FOR_FRAME;
-	ia_css_debug_dtrace(IA_CSS_DEBUG_TRACE_PRIVATE,
-			    "sh_css_translate_stream_cfg_to_isys_stream_descr() leave:\n");
-#endif
+	if (IS_ISP2401) {
+		isys_stream_descr->polling_mode
+		    = early_polling ? INPUT_SYSTEM_POLL_ON_CAPTURE_REQUEST
+		      : INPUT_SYSTEM_POLL_ON_WAIT_FOR_FRAME;
+		ia_css_debug_dtrace(IA_CSS_DEBUG_TRACE_PRIVATE,
+				    "sh_css_translate_stream_cfg_to_isys_stream_descr() leave:\n");
+	}
 
 	return rc;
 }
@@ -1433,7 +1428,7 @@ static void start_pipe(
 
 	assert(me); /* all callers are in this file and call with non null argument */
 
-	if (!IS_ISP2401) {
+	if (IS_ISP2401) {
 		coord = &me->config.internal_frame_origin_bqs_on_sctbl;
 		params = me->stream->isp_params_configs;
 	}
Signature · 1 line
2.33.1
#45 lore raw

PATCH 8/17 media: atomisp: pci: make fw ver irci_stable_candrpv_0415_20150521_0458 work - 1/5

In reply to Tsuchiya Yuto

This is one of the patches which partially revert incompatible changes in the current css version for ISP2401 (irci_ecr-master_20150911_0724) back to irci_stable_candrpv_0415_20150521_0458.

Some structs are sizeof()ed in sh_css_firmware.c file. So, I guess issues will happen if these sizes are changed. Therefore, keep them the same as css version irci_stable_candrpv_0415_20150521_0458 to make atomisp work for firmware made for such css version since we don't have firmware made for the current css version.

This patch removes luma_only, input_yuv and input_raw from struct ia_css_binary_info as well as its usage [1]. Note that for input_yuv and input_raw, only the definitions were removed because these were not used anywhere.

[1] added on updating css version to irci_master_20150701_0213

    https://raw.githubusercontent.com/intel/ProductionKernelQuilts/cht-m1stable-2016_ww31/uefi/cht-m1stable/patches/cam-0439-atomisp2-css2401-and-2401_legacy-irci_master_2015070.patch
    ("atomisp2: css2401 and 2401_legacy-irci_master_20150701_0213")
---
 .../atomisp/pci/camera/pipe/src/pipe_binarydesc.c  |  5 -----
 .../staging/media/atomisp/pci/ia_css_acc_types.h   |  5 -----
 .../staging/media/atomisp/pci/ia_css_pipe_public.h |  3 ---
 .../pci/runtime/binary/interface/ia_css_binary.h   |  1 -
 .../media/atomisp/pci/runtime/binary/src/binary.c  | 14 --------------
 5 files changed, 28 deletions(-)
drivers/staging/media/atomisp/pci/camera/pipe/src/pipe_binarydesc.c +0 -5
index f20c9b02fbe0..3e3e5a4f8117 100644
@@ -58,7 +58,6 @@ static void pipe_binarydesc_get_offline(
 	descr->enable_dz = true;
 	descr->enable_xnr = false;
 	descr->enable_dpc = false;
-	descr->enable_luma_only = false;
 	descr->enable_tnr = false;
 	descr->enable_capture_pp_bli = false;
 	descr->enable_fractional_ds = false;
@@ -390,8 +389,6 @@ int ia_css_pipe_get_video_binarydesc(
 		    pipe->extra_config.enable_fractional_ds;
 		video_descr->enable_dpc =
 		    pipe->config.enable_dpc;
-		video_descr->enable_luma_only =
-		    pipe->config.enable_luma_only;
 		video_descr->enable_tnr =
 		    pipe->config.enable_tnr;
 
@@ -600,8 +597,6 @@ void ia_css_pipe_get_primary_binarydesc(
 		prim_descr->isp_pipe_version = pipe->config.isp_pipe_version;
 		prim_descr->enable_fractional_ds =
 		    pipe->extra_config.enable_fractional_ds;
-		prim_descr->enable_luma_only =
-		    pipe->config.enable_luma_only;
 		/* We have both striped and non-striped primary binaries,
 		 * if continuous viewfinder is required, then we must select
 		 * a striped one. Otherwise we prefer to use a non-striped
drivers/staging/media/atomisp/pci/ia_css_acc_types.h +0 -5
index 36583ab12e3f..d0ce2f8ba653 100644
@@ -222,11 +222,6 @@ struct ia_css_binary_info {
 	struct ia_css_isp_param_isp_segments	mem_initializers;
 	/* MW: Packing (related) bools in an integer ?? */
 	struct {
-		/* ISP2401 */
-		u8	luma_only;
-		u8	input_yuv;
-		u8	input_raw;
-
 		u8	reduced_pipe;
 		u8	vf_veceven;
 		u8	dis;
drivers/staging/media/atomisp/pci/ia_css_pipe_public.h +0 -3
index 4affd21f9e3f..45e8fe36cb74 100644
@@ -123,9 +123,6 @@ struct ia_css_pipe_config {
 	     processing stages. */
 
 /* ISP2401 */
-	bool enable_luma_only;
-	/** Enabling of monochrome mode for a pipeline. If enabled only luma processing
-	     will be done. */
 	bool enable_tnr;
 	/** Enabling of TNR (temporal noise reduction). This is only applicable to video
 	     pipes. Non video-pipes should always set this parameter to false. */
drivers/staging/media/atomisp/pci/runtime/binary/interface/ia_css_binary.h +0 -1
index b44099dbdacd..6f110d241836 100644
@@ -94,7 +94,6 @@ struct ia_css_binary_descr {
 	bool enable_dpc;
 
 	/* ISP2401 */
-	bool enable_luma_only;
 	bool enable_tnr;
 
 	bool enable_capture_pp_bli;
drivers/staging/media/atomisp/pci/runtime/binary/src/binary.c +0 -14
index 060d38749570..8c0e02e4e1af 100644
@@ -1394,9 +1394,6 @@ static int __ia_css_binary_find(struct ia_css_binary_descr *descr,
 	bool enable_dvs_6axis;
 	bool enable_reduced_pipe;
 	bool enable_capture_pp_bli;
-#ifdef ISP2401
-	bool enable_luma_only;
-#endif
 	int err = -EINVAL;
 	bool continuous;
 	unsigned int isp_pipe_version;
@@ -1450,9 +1447,6 @@ static int __ia_css_binary_find(struct ia_css_binary_descr *descr,
 	enable_dvs_6axis  = descr->enable_dvs_6axis;
 	enable_reduced_pipe = descr->enable_reduced_pipe;
 	enable_capture_pp_bli = descr->enable_capture_pp_bli;
-#ifdef ISP2401
-	enable_luma_only = descr->enable_luma_only;
-#endif
 	continuous = descr->continuous;
 	striped = descr->striped;
 	isp_pipe_version = descr->isp_pipe_version;
@@ -1748,14 +1742,6 @@ static int __ia_css_binary_find(struct ia_css_binary_descr *descr,
 		}
 
 #ifdef ISP2401
-		if (candidate->enable.luma_only != enable_luma_only) {
-			ia_css_debug_dtrace(IA_CSS_DEBUG_TRACE,
-					    "ia_css_binary_find() [%d] continue: %d != %d\n",
-					    __LINE__, candidate->enable.luma_only,
-					    descr->enable_luma_only);
-			continue;
-		}
-
 		if (!candidate->enable.tnr && need_tnr) {
 			ia_css_debug_dtrace(IA_CSS_DEBUG_TRACE,
 					    "ia_css_binary_find() [%d] continue: !%d && %d\n",
Signature · 1 line
2.33.1
#46 lore raw

PATCH 9/17 media: atomisp: pci: make fw ver irci_stable_candrpv_0415_20150521_0458 work - 2/5

In reply to Tsuchiya Yuto

This is one of the patches which partially revert incompatible changes in the current css version for ISP2401 (irci_ecr-master_20150911_0724) back to irci_stable_candrpv_0415_20150521_0458.

Some structs are sizeof()ed in sh_css_firmware.c file. So, I guess issues will happen if these sizes are changed. Therefore, keep them the same as css version irci_stable_candrpv_0415_20150521_0458 to make atomisp work for firmware made for such css version since we don't have firmware made for the current css version.

This patch removes struct ia_css_isp_parameter sc from struct ia_css_config_memory_offsets as well as its usage [1].

[1] added on updating css version to irci_master_20150701_0213

    https://raw.githubusercontent.com/intel/ProductionKernelQuilts/cht-m1stable-2016_ww31/uefi/cht-m1stable/patches/cam-0439-atomisp2-css2401-and-2401_legacy-irci_master_2015070.patch
    ("atomisp2: css2401 and 2401_legacy-irci_master_20150701_0213")
---
 .../media/atomisp/pci/ia_css_isp_configs.h    |  8 ---
 .../isp/kernels/sc/sc_1.0/ia_css_sc.host.c    | 68 -------------------
 .../isp/kernels/sc/sc_1.0/ia_css_sc.host.h    | 33 ---------
 .../isp/kernels/sc/sc_1.0/ia_css_sc_types.h   | 14 ----
 drivers/staging/media/atomisp/pci/sh_css_sp.c |  4 --
 5 files changed, 127 deletions(-)
drivers/staging/media/atomisp/pci/ia_css_isp_configs.h +0 -8
index 1abb2fd6a913..0364b932e79b 100644
@@ -23,10 +23,6 @@
 #include "isp/kernels/raw/raw_1.0/ia_css_raw.host.h"
 #include "isp/kernels/ref/ref_1.0/ia_css_ref.host.h"
 #include "isp/kernels/s3a/s3a_1.0/ia_css_s3a.host.h"
-
-/* ISP2401 */
-#include "isp/kernels/sc/sc_1.0/ia_css_sc.host.h"
-
 #include "isp/kernels/tnr/tnr_1.0/ia_css_tnr.host.h"
 #include "isp/kernels/vf/vf_1.0/ia_css_vf.host.h"
 #include "isp/kernels/iterator/iterator_1.0/ia_css_iterator.host.h"
@@ -73,10 +69,6 @@ struct ia_css_config_memory_offsets {
 		struct ia_css_isp_parameter output0;
 		struct ia_css_isp_parameter output1;
 		struct ia_css_isp_parameter output;
-
-		/* ISP2401 */
-		struct ia_css_isp_parameter sc;
-
 		struct ia_css_isp_parameter raw;
 		struct ia_css_isp_parameter tnr;
 		struct ia_css_isp_parameter ref;
drivers/staging/media/atomisp/pci/isp/kernels/sc/sc_1.0/ia_css_sc.host.c +0 -68

80 lines not on this page · raw message

drivers/staging/media/atomisp/pci/isp/kernels/sc/sc_1.0/ia_css_sc.host.h +0 -33
index f1eb568f23d4..d103103c9a87 100644
@@ -32,39 +32,6 @@ ia_css_sc_dump(
     const struct sh_css_isp_sc_params *sc,
     unsigned int level);
 
-/* @brief Configure the shading correction.
- * @param[out]	to	Parameters used in the shading correction kernel in the isp.
- * @param[in]	from	Parameters passed from the host.
- * @param[in]	size	Size of the sh_css_isp_sc_isp_config structure.
- *
- * This function passes the parameters for the shading correction from the host to the isp.
- */
-/* ISP2401 */
-void
-ia_css_sc_config(
-    struct sh_css_isp_sc_isp_config *to,
-    const struct ia_css_sc_configuration *from,
-    unsigned int size);
-
-/* @brief Configure the shading correction.
- * @param[in]	binary	The binary, which has the shading correction.
- * @param[in]	internal_frame_origin_x_bqs_on_sctbl
- *			X coordinate (in bqs) of the origin of the internal frame on the shading table.
- * @param[in]	internal_frame_origin_y_bqs_on_sctbl
- *			Y coordinate (in bqs) of the origin of the internal frame on the shading table.
- *
- * This function calls the ia_css_configure_sc() function.
- * (The ia_css_configure_sc() function is automatically generated in ia_css_isp.configs.c.)
- * The ia_css_configure_sc() function calls the ia_css_sc_config() function
- * to pass the parameters for the shading correction from the host to the isp.
- */
-/* ISP2401 */
-void
-ia_css_sc_configure(
-    const struct ia_css_binary *binary,
-    u32 internal_frame_origin_x_bqs_on_sctbl,
-    uint32_t internal_frame_origin_y_bqs_on_sctbl);
-
 /* ------ deprecated(bz675) : from ------ */
 void
 sh_css_get_shading_settings(const struct ia_css_isp_parameters *params,
drivers/staging/media/atomisp/pci/isp/kernels/sc/sc_1.0/ia_css_sc_types.h +0 -14
index aae534521b7b..1d70f6b9a0ec 100644
@@ -118,18 +118,4 @@ struct ia_css_shading_settings {
 
 /* ------ deprecated(bz675) : to ------ */
 
-/* Shading Correction configuration.
- *
- *  NOTE: The shading table size is larger than or equal to the internal frame size.
- */
-/* ISP2401 */
-struct ia_css_sc_configuration {
-	u32 internal_frame_origin_x_bqs_on_sctbl; /** Origin X (in bqs) of internal frame on shading table. */
-	u32 internal_frame_origin_y_bqs_on_sctbl; /** Origin Y (in bqs) of internal frame on shading table. */
-	/** NOTE: bqs = size in BQ(Bayer Quad) unit.
-		1BQ means {Gr,R,B,Gb}(2x2 pixels).
-		Horizontal 1 bqs corresponds to horizontal 2 pixels.
-		Vertical 1 bqs corresponds to vertical 2 pixels. */
-};
-
 #endif /* __IA_CSS_SC_TYPES_H */
drivers/staging/media/atomisp/pci/sh_css_sp.c +0 -4
index a73e8ca1e225..13b15a5a33bc 100644
@@ -827,10 +827,6 @@ configure_isp_from_args(
 	ia_css_output1_configure(binary, &args->out_vf_frame->info);
 	ia_css_copy_output_configure(binary, args->copy_output);
 	ia_css_output0_configure(binary, &args->out_frame[0]->info);
-#ifdef ISP2401
-	ia_css_sc_configure(binary, pipeline->shading.internal_frame_origin_x_bqs_on_sctbl,
-			    pipeline->shading.internal_frame_origin_y_bqs_on_sctbl);
-#endif
 	ia_css_iterator_configure(binary, &args->in_frame->info);
 	ia_css_dvs_configure(binary, &args->out_frame[0]->info);
 	ia_css_output_configure(binary, &args->out_frame[0]->info);
Signature · 1 line
2.33.1
#47 lore raw

PATCH 10/17 media: atomisp: pci: make fw ver irci_stable_candrpv_0415_20150521_0458 work - 3/5

In reply to Tsuchiya Yuto

This is one of the patches which partially revert incompatible changes in the current css version for ISP2401 (irci_ecr-master_20150911_0724) back to irci_stable_candrpv_0415_20150521_0458.

Some structs are sizeof()ed in sh_css_firmware.c file. So, I guess issues will happen if these sizes are changed. Therefore, keep them the same as css version irci_stable_candrpv_0415_20150521_0458 to make atomisp work for firmware made for such css version since we don't have firmware made for the current css version.

This patch removes struct ia_css_isp_parameter xnr3 from struct ia_css_memory_offsets as well as its usage [1].

[1] added on updating css version to irci_master_20150701_0213

    https://raw.githubusercontent.com/intel/ProductionKernelQuilts/cht-m1stable-2016_ww31/uefi/cht-m1stable/patches/cam-0439-atomisp2-css2401-and-2401_legacy-irci_master_2015070.patch
    ("atomisp2: css2401 and 2401_legacy-irci_master_20150701_0213")
---
 .../css_2401_system/hive/ia_css_isp_params.c  | 23 -------------------
 .../media/atomisp/pci/ia_css_isp_params.h     |  3 ---
 2 files changed, 26 deletions(-)
drivers/staging/media/atomisp/pci/css_2401_system/hive/ia_css_isp_params.c +0 -23
index d9c672d8904e..503ac65da69b 100644
@@ -1721,29 +1721,6 @@ ia_css_process_xnr3(
 					    "ia_css_process_xnr3() leave:\n");
 		}
 	}
-	{
-		unsigned int size   =
-		    stage->binary->info->mem_offsets.offsets.param->vmem.xnr3.size;
-
-		unsigned int offset =
-		    stage->binary->info->mem_offsets.offsets.param->vmem.xnr3.offset;
-
-		if (size) {
-			ia_css_debug_dtrace(IA_CSS_DEBUG_TRACE_PRIVATE,
-					    "ia_css_process_xnr3() enter:\n");
-
-			ia_css_xnr3_vmem_encode((struct sh_css_isp_xnr3_vmem_params *)
-						&stage->binary->mem_params.params[IA_CSS_PARAM_CLASS_PARAM][IA_CSS_ISP_VMEM].address[offset],
-						&params->xnr3_config,
-						size);
-			params->isp_params_changed = true;
-			params->isp_mem_params_changed[pipe_id][stage->stage_num][IA_CSS_ISP_VMEM] =
-			    true;
-
-			ia_css_debug_dtrace(IA_CSS_DEBUG_TRACE_PRIVATE,
-					    "ia_css_process_xnr3() leave:\n");
-		}
-	}
 }
 
 /* Code generated by genparam/gencode.c:gen_param_process_table() */
drivers/staging/media/atomisp/pci/ia_css_isp_params.h +0 -3
index 6e3082b39ed6..c2de689877d1 100644
@@ -121,9 +121,6 @@ struct ia_css_memory_offsets {
 		struct ia_css_isp_parameter sdis_vertcoef;
 		struct ia_css_isp_parameter sdis2_horicoef;
 		struct ia_css_isp_parameter sdis2_vertcoef;
-
-		/* ISP2401 */
-		struct ia_css_isp_parameter xnr3;
 	} vmem;
 	struct {
 		struct ia_css_isp_parameter bh;
Signature · 1 line
2.33.1
#48 lore raw

PATCH 11/17 media: atomisp: pci: make fw ver irci_stable_candrpv_0415_20150521_0458 work - 4/5

In reply to Tsuchiya Yuto

This is one of the patches which partially revert incompatible changes in the current css version for ISP2401 (irci_ecr-master_20150911_0724) back to irci_stable_candrpv_0415_20150521_0458.

Some structs are sizeof()ed in sh_css_firmware.c file. So, I guess issues will happen if these sizes are changed. Therefore, keep them the same as css version irci_stable_candrpv_0415_20150521_0458 to make atomisp work for firmware made for such css version since we don't have firmware made for the current css version.

This patch removes polling_mode and subscr_index from struct virtual_input_system_stream_s as well as its usage [1]. Note that for subscr_index, only the definition were removed because it was not used anywhere.

[1] added on updating css version to irci_master_20150701_0213

    https://raw.githubusercontent.com/intel/ProductionKernelQuilts/cht-m1stable-2016_ww31/uefi/cht-m1stable/patches/cam-0439-atomisp2-css2401-and-2401_legacy-irci_master_2015070.patch
    ("atomisp2: css2401 and 2401_legacy-irci_master_20150701_0213")
---
 .../atomisp/pci/isp2401_input_system_global.h      | 12 ------------
 .../atomisp/pci/runtime/isys/src/virtual_isys.c    | 11 -----------
 drivers/staging/media/atomisp/pci/sh_css.c         | 14 ++------------
 3 files changed, 2 insertions(+), 35 deletions(-)
drivers/staging/media/atomisp/pci/isp2401_input_system_global.h +0 -12
index f38773842646..e3c86069b390 100644
@@ -44,11 +44,6 @@ typedef enum {
 	N_INPUT_SYSTEM_SOURCE_TYPE
 } input_system_source_type_t;
 
-typedef enum {
-	INPUT_SYSTEM_POLL_ON_WAIT_FOR_FRAME,
-	INPUT_SYSTEM_POLL_ON_CAPTURE_REQUEST,
-} input_system_polling_mode_t;
-
 typedef struct input_system_channel_s input_system_channel_t;
 struct input_system_channel_s {
 	stream2mmio_ID_t	stream2mmio_id;
@@ -111,9 +106,6 @@ struct isp2401_input_system_cfg_s {
 
 	input_system_source_type_t	mode;
 
-	/* ISP2401 */
-	input_system_polling_mode_t	polling_mode;
-
 	bool online;
 	bool raw_packed;
 	s8 linked_isys_stream_id;
@@ -165,10 +157,6 @@ struct virtual_input_system_stream_s {
 	u8 online;
 	s8 linked_isys_stream_id;
 	u8 valid;
-
-	/* ISP2401 */
-	input_system_polling_mode_t	polling_mode;
-	s32 subscr_index;
 };
 
 typedef struct virtual_input_system_stream_cfg_s
drivers/staging/media/atomisp/pci/runtime/isys/src/virtual_isys.c +0 -11
index 82f3c19dc455..8fc7746f8639 100644
@@ -189,17 +189,6 @@ ia_css_isys_error_t ia_css_isys_stream_create(
 		return false;
 	}
 
-#ifdef ISP2401
-	/*
-	 * Early polling is required for timestamp accuracy in certain cause.
-	 * The ISYS HW polling is started on
-	 * ia_css_isys_stream_capture_indication() instead of
-	 * ia_css_pipeline_sp_wait_for_isys_stream_N() as isp processing of
-	 * capture takes longer than getting an ISYS frame
-	 */
-	isys_stream->polling_mode = isys_stream_descr->polling_mode;
-
-#endif
 	/* create metadata channel */
 	if (isys_stream_descr->metadata.enable) {
 		rc = create_input_system_channel(isys_stream_descr, true,
drivers/staging/media/atomisp/pci/sh_css.c +2 -12
index ba25d0da8b81..79003077f390 100644
@@ -1000,20 +1000,10 @@ static bool sh_css_translate_stream_cfg_to_isys_stream_descr(
 	isys_stream_descr->raw_packed = stream_cfg->pack_raw_pixels;
 	isys_stream_descr->linked_isys_stream_id = (int8_t)
 		stream_cfg->isys_config[isys_stream_idx].linked_isys_stream_id;
-	/*
-	 * Early polling is required for timestamp accuracy in certain case.
-	 * The ISYS HW polling is started on
-	 * ia_css_isys_stream_capture_indication() instead of
-	 * ia_css_pipeline_sp_wait_for_isys_stream_N() as isp processing of
-	 * capture takes longer than getting an ISYS frame
-	 */
-	if (IS_ISP2401) {
-		isys_stream_descr->polling_mode
-		    = early_polling ? INPUT_SYSTEM_POLL_ON_CAPTURE_REQUEST
-		      : INPUT_SYSTEM_POLL_ON_WAIT_FOR_FRAME;
+
+	if (IS_ISP2401)
 		ia_css_debug_dtrace(IA_CSS_DEBUG_TRACE_PRIVATE,
 				    "sh_css_translate_stream_cfg_to_isys_stream_descr() leave:\n");
-	}
 
 	return rc;
 }
Signature · 1 line
2.33.1
#49 lore raw

PATCH 12/17 media: atomisp: pci: make fw ver irci_stable_candrpv_0415_20150521_0458 work - 5/5

In reply to Tsuchiya Yuto

This is one of the patches which partially revert incompatible changes in the current css version for ISP2401 (irci_ecr-master_20150911_0724) back to irci_stable_candrpv_0415_20150521_0458.

Some structs are sizeof()ed in sh_css_firmware.c file. So, I guess issues will happen if these sizes are changed. Therefore, keep them the same as css version irci_stable_candrpv_0415_20150521_0458 to make atomisp work for firmware made for such css version since we don't have firmware made for the current css version.

This patch removes the unnamed struct shading from struct sh_css_sp_pipeline as well as its usage [1].

[1] added on updating css version to irci_master_20150701_0213

    https://raw.githubusercontent.com/intel/ProductionKernelQuilts/cht-m1stable-2016_ww31/uefi/cht-m1stable/patches/cam-0439-atomisp2-css2401-and-2401_legacy-irci_master_2015070.patch
    ("atomisp2: css2401 and 2401_legacy-irci_master_20150701_0213")
---
 .../media/atomisp/pci/sh_css_internal.h        |  8 --------
 drivers/staging/media/atomisp/pci/sh_css_sp.c  | 18 ------------------
 2 files changed, 26 deletions(-)
drivers/staging/media/atomisp/pci/sh_css_internal.h +0 -8
index 496faa7297a5..92fb7e67610c 100644
@@ -551,14 +551,6 @@ struct sh_css_sp_pipeline {
 			u32	raw_bit_depth;
 		} raw;
 	} copy;
-
-/* ISP2401 */
-
-	/* Parameters passed to Shading Correction kernel. */
-	struct {
-		u32 internal_frame_origin_x_bqs_on_sctbl; /* Origin X (bqs) of internal frame on shading table */
-		u32 internal_frame_origin_y_bqs_on_sctbl; /* Origin Y (bqs) of internal frame on shading table */
-	} shading;
 };
 
 /*
drivers/staging/media/atomisp/pci/sh_css_sp.c +0 -18
index 13b15a5a33bc..fa74ac172f94 100644
@@ -1308,24 +1308,6 @@ sh_css_sp_init_pipeline(struct ia_css_pipeline *me,
 	}
 #endif
 
-	if (IS_ISP2401) {
-		/* For the shading correction type 1 (the legacy shading table conversion in css is not used),
-		* the parameters are passed to the isp for the shading table centering.
-		*/
-		if (internal_frame_origin_bqs_on_sctbl &&
-		    params && params->shading_settings.enable_shading_table_conversion == 0) {
-			sh_css_sp_group.pipe[thread_id].shading.internal_frame_origin_x_bqs_on_sctbl
-			= (uint32_t)internal_frame_origin_bqs_on_sctbl->x;
-			sh_css_sp_group.pipe[thread_id].shading.internal_frame_origin_y_bqs_on_sctbl
-			= (uint32_t)internal_frame_origin_bqs_on_sctbl->y;
-		} else {
-			sh_css_sp_group.pipe[thread_id].shading.internal_frame_origin_x_bqs_on_sctbl =
-			0;
-			sh_css_sp_group.pipe[thread_id].shading.internal_frame_origin_y_bqs_on_sctbl =
-			0;
-		}
-	}
-
 	IA_CSS_LOG("pipe_id %d port_config %08x",
 		   pipe_id, sh_css_sp_group.pipe[thread_id].inout_port_config);
 
Signature · 1 line
2.33.1
#50 lore raw

PATCH 13/17 media: atomisp: pci: release_version is now irci_stable_candrpv_0415_20150521_0458

In reply to Tsuchiya Yuto

Now that we made atomisp work with firmware version irci_stable_candrpv_0415_20150521_0458 also for ISP2401, the release_version for ISP2401 is not irci_ecr-master_20150911_0724 anymore.

So, use the same release_version for both ISP2400 and ISP2401 (i.e., irci_stable_candrpv_0415_20150521_0458).

Referred to the following diff to make this patch:
- https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/diff/drivers/staging/media/atomisp/pci/sh_css_firmware.c?id=3c0538fbad9f1d07d588f631e380256d941e3d3a
("media: atomisp: get rid of most checks for ISP2401 version")
changes for file sh_css_firmware.c

---
 .../pci/isp/kernels/hdr/ia_css_hdr.host.c        |  1 -
 .../pci/isp/kernels/hdr/ia_css_hdr.host.h        |  1 -
 .../pci/isp/kernels/hdr/ia_css_hdr_param.h       |  1 -
 .../pci/isp/kernels/hdr/ia_css_hdr_types.h       |  1 -
 .../staging/media/atomisp/pci/sh_css_firmware.c  | 16 +---------------
 5 files changed, 1 insertion(+), 19 deletions(-)
drivers/staging/media/atomisp/pci/isp/kernels/hdr/ia_css_hdr.host.c +0 -1
index 698550cc2fcc..85a02b6adb52 100644
@@ -1,6 +1,5 @@
 // SPDX-License-Identifier: GPL-2.0
 /* Release Version: irci_stable_candrpv_0415_20150521_0458 */
-/* Release Version: irci_ecr-master_20150911_0724 */
 /*
  * Support for Intel Camera Imaging ISP subsystem.
  * Copyright (c) 2015, Intel Corporation.
drivers/staging/media/atomisp/pci/isp/kernels/hdr/ia_css_hdr.host.h +0 -1
index 04599ab590cd..83277b683c47 100644
@@ -1,6 +1,5 @@
 /* SPDX-License-Identifier: GPL-2.0 */
 /* Release Version: irci_stable_candrpv_0415_20150521_0458 */
-/* Release Version: irci_ecr-master_20150911_0724 */
 /*
  * Support for Intel Camera Imaging ISP subsystem.
  * Copyright (c) 2015, Intel Corporation.
drivers/staging/media/atomisp/pci/isp/kernels/hdr/ia_css_hdr_param.h +0 -1
index 97a89fd3cfda..998c6d801756 100644
@@ -1,6 +1,5 @@
 /* SPDX-License-Identifier: GPL-2.0 */
 /* Release Version: irci_stable_candrpv_0415_20150521_0458 */
-/* Release Version: irci_ecr-master_20150911_0724 */
 /*
  * Support for Intel Camera Imaging ISP subsystem.
  * Copyright (c) 2015, Intel Corporation.
drivers/staging/media/atomisp/pci/isp/kernels/hdr/ia_css_hdr_types.h +0 -1
index 1b4090880201..175c301ee96a 100644
@@ -1,6 +1,5 @@
 /* SPDX-License-Identifier: GPL-2.0 */
 /* Release Version: irci_stable_candrpv_0415_20150521_0458 */
-/* Release Version: irci_ecr-master_20150911_0724 */
 /*
  * Support for Intel Camera Imaging ISP subsystem.
  * Copyright (c) 2015, Intel Corporation.
drivers/staging/media/atomisp/pci/sh_css_firmware.c +1 -15
index e1a16a50e588..94149647b98b 100644
@@ -56,8 +56,7 @@ static struct firmware_header *firmware_header;
  * which will be replaced with the actual RELEASE_VERSION
  * during package generation. Please do not modify
  */
-static const char *isp2400_release_version = STR(irci_stable_candrpv_0415_20150521_0458);
-static const char *isp2401_release_version = STR(irci_ecr - master_20150911_0724);
+static const char *release_version = STR(irci_stable_candrpv_0415_20150521_0458);
 
 #define MAX_FW_REL_VER_NAME	300
 static char FW_rel_ver_name[MAX_FW_REL_VER_NAME] = "---";
@@ -190,13 +189,6 @@ sh_css_check_firmware_version(struct device *dev, const char *fw_data)
 {
 	struct sh_css_fw_bi_file_h *file_header;
 
-	const char *release_version;
-
-	if (!IS_ISP2401)
-		release_version = isp2400_release_version;
-	else
-		release_version = isp2401_release_version;
-
 	firmware_header = (struct firmware_header *)fw_data;
 	file_header = &firmware_header->file_header;
 
@@ -232,12 +224,6 @@ sh_css_load_firmware(struct device *dev, const char *fw_data,
 	struct ia_css_fw_info *binaries;
 	struct sh_css_fw_bi_file_h *file_header;
 	int ret;
-	const char *release_version;
-
-	if (!IS_ISP2401)
-		release_version = isp2400_release_version;
-	else
-		release_version = isp2401_release_version;
 
 	firmware_header = (struct firmware_header *)fw_data;
 	file_header = &firmware_header->file_header;
Signature · 1 line
2.33.1
#51 lore raw

PATCH 14/17 media: atomisp: pci: Remove remaining instance of call to trace_printk

In reply to Tsuchiya Yuto

(patch based on intel-aero kernel patch:
https://github.com/intel-aero/meta-intel-aero-base/commit/26fc9fe5030b63bc9dcf0b5f32981948911ca272)

Here is the original commit message from the aforementioned patch:

From 26fc9fe5030b63bc9dcf0b5f32981948911ca272 Mon Sep 17 00:00:00 2001
From: Lucas De Marchi <[email protected]>
Date: Fri, 7 Jul 2017 14:23:53 -0700
Subject: [PATCH] linux-yocto: Remove remaining instance of call to
trace_printk

It's not sufficient to leave trace_printk() out of "normal call chains" since the way trace infrastructure works is that it will allocate the trace_printk buffers if the symbol is there (by using a separate section for the function and checking if __start_* and __stop_* symbols are different.

Therefore, even if the default value for the param tells the module to use printk(), just the fact that it can be changed to trace_printk() means the initialization code will be called.

The trace_printk() was replaced by pr_info() on commit 3d81099c75a6 ("media: atomisp: Replace trace_printk by pr_info") for the upstreamed atomisp, too. However, as the aforementioned commit message says, there is still a remaining instance. This causes the "trace_printk() being used" kernel warning message to still appear on the first driver load.

Based on the aforementioned patch, this patch removes the call to ftrace_vprintk(). This removes that kernel warning.

In addition to this, this patch also removes the following now unused things:

- now empty atomisp_css2_dbg_ftrace_print()
- trace_printk option from dbg_func kernel parameter

---
 .../staging/media/atomisp/pci/atomisp_compat_css20.c   | 10 ----------
 drivers/staging/media/atomisp/pci/atomisp_v4l2.c       |  4 ++--
 2 files changed, 2 insertions(+), 12 deletions(-)
drivers/staging/media/atomisp/pci/atomisp_compat_css20.c +0 -10
index 99a632f33d2d..d81d55c6f1fa 100644
@@ -159,13 +159,6 @@ static void atomisp_css2_hw_load(hrt_address addr, void *to, uint32_t n)
 	spin_unlock_irqrestore(&mmio_lock, flags);
 }
 
-static int  __printf(1, 0) atomisp_css2_dbg_ftrace_print(const char *fmt,
-							 va_list args)
-{
-	ftrace_vprintk(fmt, args);
-	return 0;
-}
-
 static int  __printf(1, 0) atomisp_vprintk(const char *fmt, va_list args)
 {
 	vprintk(fmt, args);
@@ -860,9 +853,6 @@ static inline int __set_css_print_env(struct atomisp_device *isp, int opt)
 	if (opt == 0)
 		isp->css_env.isp_css_env.print_env.debug_print = NULL;
 	else if (opt == 1)
-		isp->css_env.isp_css_env.print_env.debug_print =
-		    atomisp_css2_dbg_ftrace_print;
-	else if (opt == 2)
 		isp->css_env.isp_css_env.print_env.debug_print = atomisp_vprintk;
 	else
 		ret = -EINVAL;
drivers/staging/media/atomisp/pci/atomisp_v4l2.c +2 -2
index f5362554638e..720963156d24 100644
@@ -87,10 +87,10 @@ module_param(dbg_level, int, 0644);
 MODULE_PARM_DESC(dbg_level, "debug message level (default:0)");
 
 /* log function switch */
-int dbg_func = 2;
+int dbg_func = 1;
 module_param(dbg_func, int, 0644);
 MODULE_PARM_DESC(dbg_func,
-		 "log function switch non/trace_printk/printk (default:printk)");
+		 "log function switch non/printk (default:printk)");
 
 int mipicsi_flag;
 module_param(mipicsi_flag, int, 0644);
Signature · 1 line
2.33.1

A message that is not in the archive (sent off-list or not yet received): [email protected]

#53 lore raw

Re: [PATCH 14/17] media: atomisp: pci: Remove remaining instance of call to trace_printk

<Adding back people/list to Cc>

Quoted 35 lines · Mauro Carvalho Chehab

Em Mon, 18 Oct 2021 01:19:54 +0900
Tsuchiya Yuto <[email protected]> escreveu:

Quoted 32 lines

(patch based on intel-aero kernel patch:
https://github.com/intel-aero/meta-intel-aero-base/commit/26fc9fe5030b63bc9dcf0b5f32981948911ca272)

Here is the original commit message from the aforementioned patch:

From 26fc9fe5030b63bc9dcf0b5f32981948911ca272 Mon Sep 17 00:00:00 2001
From: Lucas De Marchi <[email protected]>
Date: Fri, 7 Jul 2017 14:23:53 -0700
Subject: [PATCH] linux-yocto: Remove remaining instance of call to
trace_printk

It's not sufficient to leave trace_printk() out of "normal call chains" since the way trace infrastructure works is that it will allocate the trace_printk buffers if the symbol is there (by using a separate section for the function and checking if __start_* and __stop_* symbols are different.

Therefore, even if the default value for the param tells the module to use printk(), just the fact that it can be changed to trace_printk() means the initialization code will be called.

The trace_printk() was replaced by pr_info() on commit 3d81099c75a6 ("media: atomisp: Replace trace_printk by pr_info") for the upstreamed atomisp, too. However, as the aforementioned commit message says, there is still a remaining instance. This causes the "trace_printk() being used" kernel warning message to still appear on the first driver load.

Based on the aforementioned patch, this patch removes the call to ftrace_vprintk(). This removes that kernel warning.

In addition to this, this patch also removes the following now unused things:

Quoted 6 lines
Quoted 2 lines

- now empty atomisp_css2_dbg_ftrace_print()
- trace_printk option from dbg_func kernel parameter

This patch is incomplete. I mean, if the idea is to drop support for trace, dbg_func parameter becomes obsolete, and a lot of code can be dropped/cleaned.

I left __set_css_print_env() and dbg_func module parameter intentionally because there is still the option "non", which means do not use any function to log. Yes, I don't know if it's really useful since the module parameter dbg_level=0 (this is the default value) means no debug output.

However, they (those who originally wrote atomisp) added the option "non" anyway. So, I thought there is a use case for this.

If everyone thinks it's useless, I can additionally remove them. In this case, indeed a lot of code may be additionally removed (I haven't checked yet).

Quoted 2 lines

That's said, I don't see a good reason to drop it, at least while this driver is not 100%.

This driver is not 100% yet, but at least it can capture images now (at least on ISP2401). So, I thought this is the right time to remove it when I wrote this patch.

But yes, we don't necessarily have to drop it. The other idea is hide it by default using a macro, and still can be enabled by manual edit. Here is the example from drivers/usb/dwc2/core.h:

        49-/*
        50- * Suggested defines for tracers:
        51- * - no_printk:    Disable tracing
        52- * - pr_info:      Print this info to the console
        53- * - trace_printk: Print this info to trace buffer (good for verbose logging)
        54- */
        55-
        56:#define DWC2_TRACE_SCHEDULER		no_printk
        57:#define DWC2_TRACE_SCHEDULER_VB		no_printk
        58-
        59-/* Detailed scheduler tracing, but won't overwhelm console */
        60-#define dwc2_sch_dbg(hsotg, fmt, ...)					\
        61:	DWC2_TRACE_SCHEDULER(pr_fmt("%s: SCH: " fmt),			\
        62-			     dev_name(hsotg->dev), ##__VA_ARGS__)
        63-
        64-/* Verbose scheduler tracing */
        65-#define dwc2_sch_vdbg(hsotg, fmt, ...)					\
        66:	DWC2_TRACE_SCHEDULER_VB(pr_fmt("%s: SCH: " fmt),		\
        67-				dev_name(hsotg->dev), ##__VA_ARGS__)

with using pr_info by default for atomisp (the parameter dbg_level is 0 by default, so still no output by default). If this sounds OK, I'd like to try this way.

Quoted 52 lines
Quoted 52 lines
---
 .../staging/media/atomisp/pci/atomisp_compat_css20.c   | 10 ----------
 drivers/staging/media/atomisp/pci/atomisp_v4l2.c       |  4 ++--
 2 files changed, 2 insertions(+), 12 deletions(-)
drivers/staging/media/atomisp/pci/atomisp_compat_css20.c +0 -10
index 99a632f33d2d..d81d55c6f1fa 100644
@@ -159,13 +159,6 @@ static void atomisp_css2_hw_load(hrt_address addr, void *to, uint32_t n)
 	spin_unlock_irqrestore(&mmio_lock, flags);
 }
 
-static int  __printf(1, 0) atomisp_css2_dbg_ftrace_print(const char *fmt,
-							 va_list args)
-{
-	ftrace_vprintk(fmt, args);
-	return 0;
-}
-
 static int  __printf(1, 0) atomisp_vprintk(const char *fmt, va_list args)
 {
 	vprintk(fmt, args);
@@ -860,9 +853,6 @@ static inline int __set_css_print_env(struct atomisp_device *isp, int opt)
 	if (opt == 0)
 		isp->css_env.isp_css_env.print_env.debug_print = NULL;
 	else if (opt == 1)
-		isp->css_env.isp_css_env.print_env.debug_print =
-		    atomisp_css2_dbg_ftrace_print;
-	else if (opt == 2)
 		isp->css_env.isp_css_env.print_env.debug_print = atomisp_vprintk;
 	else
 		ret = -EINVAL;
drivers/staging/media/atomisp/pci/atomisp_v4l2.c +2 -2
index f5362554638e..720963156d24 100644
@@ -87,10 +87,10 @@ module_param(dbg_level, int, 0644);
 MODULE_PARM_DESC(dbg_level, "debug message level (default:0)");
 
 /* log function switch */
-int dbg_func = 2;
+int dbg_func = 1;
 module_param(dbg_func, int, 0644);
 MODULE_PARM_DESC(dbg_func,
-		 "log function switch non/trace_printk/printk (default:printk)");
+		 "log function switch non/printk (default:printk)");
 
 int mipicsi_flag;
 module_param(mipicsi_flag, int, 0644);
#54 lore raw

Re: [PATCH 14/17] media: atomisp: pci: Remove remaining instance of call to trace_printk

Em Thu, 28 Oct 2021 18:34:47 +0900
Tsuchiya Yuto <[email protected]> escreveu:

Quoted 88 lines

<Adding back people/list to Cc>

Quoted 35 lines · Mauro Carvalho Chehab

Em Mon, 18 Oct 2021 01:19:54 +0900
Tsuchiya Yuto <[email protected]> escreveu:

Quoted 32 lines

(patch based on intel-aero kernel patch:
https://github.com/intel-aero/meta-intel-aero-base/commit/26fc9fe5030b63bc9dcf0b5f32981948911ca272)

Here is the original commit message from the aforementioned patch:

From 26fc9fe5030b63bc9dcf0b5f32981948911ca272 Mon Sep 17 00:00:00 2001
From: Lucas De Marchi <[email protected]>
Date: Fri, 7 Jul 2017 14:23:53 -0700
Subject: [PATCH] linux-yocto: Remove remaining instance of call to
trace_printk

It's not sufficient to leave trace_printk() out of "normal call chains" since the way trace infrastructure works is that it will allocate the trace_printk buffers if the symbol is there (by using a separate section for the function and checking if __start_* and __stop_* symbols are different.

Therefore, even if the default value for the param tells the module to use printk(), just the fact that it can be changed to trace_printk() means the initialization code will be called.

The trace_printk() was replaced by pr_info() on commit 3d81099c75a6 ("media: atomisp: Replace trace_printk by pr_info") for the upstreamed atomisp, too. However, as the aforementioned commit message says, there is still a remaining instance. This causes the "trace_printk() being used" kernel warning message to still appear on the first driver load.

Based on the aforementioned patch, this patch removes the call to ftrace_vprintk(). This removes that kernel warning.

In addition to this, this patch also removes the following now unused things:

Quoted 6 lines
Quoted 2 lines

- now empty atomisp_css2_dbg_ftrace_print()
- trace_printk option from dbg_func kernel parameter

This patch is incomplete. I mean, if the idea is to drop support for trace, dbg_func parameter becomes obsolete, and a lot of code can be dropped/cleaned.

I left __set_css_print_env() and dbg_func module parameter intentionally because there is still the option "non", which means do not use any function to log. Yes, I don't know if it's really useful since the module parameter dbg_level=0 (this is the default value) means no debug output.

However, they (those who originally wrote atomisp) added the option "non" anyway. So, I thought there is a use case for this.

If everyone thinks it's useless, I can additionally remove them. In this case, indeed a lot of code may be additionally removed (I haven't checked yet).

Quoted 2 lines

That's said, I don't see a good reason to drop it, at least while this driver is not 100%.

This driver is not 100% yet, but at least it can capture images now (at least on ISP2401). So, I thought this is the right time to remove it when I wrote this patch.

But yes, we don't necessarily have to drop it. The other idea is hide it by default using a macro, and still can be enabled by manual edit. Here is the example from drivers/usb/dwc2/core.h:

        49-/*
        50- * Suggested defines for tracers:
        51- * - no_printk:    Disable tracing
        52- * - pr_info:      Print this info to the console
        53- * - trace_printk: Print this info to trace buffer (good for verbose logging)
        54- */
        55-
        56:#define DWC2_TRACE_SCHEDULER		no_printk
        57:#define DWC2_TRACE_SCHEDULER_VB		no_printk
        58-
        59-/* Detailed scheduler tracing, but won't overwhelm console */
        60-#define dwc2_sch_dbg(hsotg, fmt, ...)					\
        61:	DWC2_TRACE_SCHEDULER(pr_fmt("%s: SCH: " fmt),			\
        62-			     dev_name(hsotg->dev), ##__VA_ARGS__)
        63-
        64-/* Verbose scheduler tracing */
        65-#define dwc2_sch_vdbg(hsotg, fmt, ...)					\
        66:	DWC2_TRACE_SCHEDULER_VB(pr_fmt("%s: SCH: " fmt),		\
        67-				dev_name(hsotg->dev), ##__VA_ARGS__)
Quoted 3 lines

with using pr_info by default for atomisp (the parameter dbg_level is 0 by default, so still no output by default). If this sounds OK, I'd like to try this way.

Let's just postpone this change. It sounds a little early to start cleaning up debug stuff. This can be done any time later, but let's first test it on our devices and ensure that it is stable enough.

Regards,
Mauro

Quoted 55 lines
Quoted 53 lines
Quoted 53 lines
---
 .../staging/media/atomisp/pci/atomisp_compat_css20.c   | 10 ----------
 drivers/staging/media/atomisp/pci/atomisp_v4l2.c       |  4 ++--
 2 files changed, 2 insertions(+), 12 deletions(-)
drivers/staging/media/atomisp/pci/atomisp_compat_css20.c +0 -10
index 99a632f33d2d..d81d55c6f1fa 100644
@@ -159,13 +159,6 @@ static void atomisp_css2_hw_load(hrt_address addr, void *to, uint32_t n)
 	spin_unlock_irqrestore(&mmio_lock, flags);
 }
 
-static int  __printf(1, 0) atomisp_css2_dbg_ftrace_print(const char *fmt,
-							 va_list args)
-{
-	ftrace_vprintk(fmt, args);
-	return 0;
-}
-
 static int  __printf(1, 0) atomisp_vprintk(const char *fmt, va_list args)
 {
 	vprintk(fmt, args);
@@ -860,9 +853,6 @@ static inline int __set_css_print_env(struct atomisp_device *isp, int opt)
 	if (opt == 0)
 		isp->css_env.isp_css_env.print_env.debug_print = NULL;
 	else if (opt == 1)
-		isp->css_env.isp_css_env.print_env.debug_print =
-		    atomisp_css2_dbg_ftrace_print;
-	else if (opt == 2)
 		isp->css_env.isp_css_env.print_env.debug_print = atomisp_vprintk;
 	else
 		ret = -EINVAL;
drivers/staging/media/atomisp/pci/atomisp_v4l2.c +2 -2
index f5362554638e..720963156d24 100644
@@ -87,10 +87,10 @@ module_param(dbg_level, int, 0644);
 MODULE_PARM_DESC(dbg_level, "debug message level (default:0)");
 
 /* log function switch */
-int dbg_func = 2;
+int dbg_func = 1;
 module_param(dbg_func, int, 0644);
 MODULE_PARM_DESC(dbg_func,
-		 "log function switch non/trace_printk/printk (default:printk)");
+		 "log function switch non/printk (default:printk)");
 
 int mipicsi_flag;
 module_param(mipicsi_flag, int, 0644);  
#55 lore raw

Re: [PATCH 14/17] media: atomisp: pci: Remove remaining instance of call to trace_printk

Quoted 91 lines · Mauro Carvalho Chehab

Em Thu, 28 Oct 2021 18:34:47 +0900
Tsuchiya Yuto <[email protected]> escreveu:

Quoted 88 lines

<Adding back people/list to Cc>

Quoted 35 lines · Mauro Carvalho Chehab

Em Mon, 18 Oct 2021 01:19:54 +0900
Tsuchiya Yuto <[email protected]> escreveu:

Quoted 32 lines

(patch based on intel-aero kernel patch:
https://github.com/intel-aero/meta-intel-aero-base/commit/26fc9fe5030b63bc9dcf0b5f32981948911ca272)

Here is the original commit message from the aforementioned patch:

From 26fc9fe5030b63bc9dcf0b5f32981948911ca272 Mon Sep 17 00:00:00 2001
From: Lucas De Marchi <[email protected]>
Date: Fri, 7 Jul 2017 14:23:53 -0700
Subject: [PATCH] linux-yocto: Remove remaining instance of call to
trace_printk

It's not sufficient to leave trace_printk() out of "normal call chains" since the way trace infrastructure works is that it will allocate the trace_printk buffers if the symbol is there (by using a separate section for the function and checking if __start_* and __stop_* symbols are different.

Therefore, even if the default value for the param tells the module to use printk(), just the fact that it can be changed to trace_printk() means the initialization code will be called.

The trace_printk() was replaced by pr_info() on commit 3d81099c75a6 ("media: atomisp: Replace trace_printk by pr_info") for the upstreamed atomisp, too. However, as the aforementioned commit message says, there is still a remaining instance. This causes the "trace_printk() being used" kernel warning message to still appear on the first driver load.

Based on the aforementioned patch, this patch removes the call to ftrace_vprintk(). This removes that kernel warning.

In addition to this, this patch also removes the following now unused things:

Quoted 6 lines
Quoted 2 lines

- now empty atomisp_css2_dbg_ftrace_print()
- trace_printk option from dbg_func kernel parameter

This patch is incomplete. I mean, if the idea is to drop support for trace, dbg_func parameter becomes obsolete, and a lot of code can be dropped/cleaned.

I left __set_css_print_env() and dbg_func module parameter intentionally because there is still the option "non", which means do not use any function to log. Yes, I don't know if it's really useful since the module parameter dbg_level=0 (this is the default value) means no debug output.

However, they (those who originally wrote atomisp) added the option "non" anyway. So, I thought there is a use case for this.

If everyone thinks it's useless, I can additionally remove them. In this case, indeed a lot of code may be additionally removed (I haven't checked yet).

Quoted 2 lines

That's said, I don't see a good reason to drop it, at least while this driver is not 100%.

This driver is not 100% yet, but at least it can capture images now (at least on ISP2401). So, I thought this is the right time to remove it when I wrote this patch.

But yes, we don't necessarily have to drop it. The other idea is hide it by default using a macro, and still can be enabled by manual edit. Here is the example from drivers/usb/dwc2/core.h:

        49-/*
        50- * Suggested defines for tracers:
        51- * - no_printk:    Disable tracing
        52- * - pr_info:      Print this info to the console
        53- * - trace_printk: Print this info to trace buffer (good for verbose logging)
        54- */
        55-
        56:#define DWC2_TRACE_SCHEDULER		no_printk
        57:#define DWC2_TRACE_SCHEDULER_VB		no_printk
        58-
        59-/* Detailed scheduler tracing, but won't overwhelm console */
        60-#define dwc2_sch_dbg(hsotg, fmt, ...)					\
        61:	DWC2_TRACE_SCHEDULER(pr_fmt("%s: SCH: " fmt),			\
        62-			     dev_name(hsotg->dev), ##__VA_ARGS__)
        63-
        64-/* Verbose scheduler tracing */
        65-#define dwc2_sch_vdbg(hsotg, fmt, ...)					\
        66:	DWC2_TRACE_SCHEDULER_VB(pr_fmt("%s: SCH: " fmt),		\
        67-				dev_name(hsotg->dev), ##__VA_ARGS__)
Quoted 7 lines
Quoted 3 lines

with using pr_info by default for atomisp (the parameter dbg_level is 0 by default, so still no output by default). If this sounds OK, I'd like to try this way.

Let's just postpone this change. It sounds a little early to start cleaning up debug stuff. This can be done any time later, but let's first test it on our devices and ensure that it is stable enough.

Got it. First, let's focus on make atomisp work. But I still want to address this a little earlier after we made it work. That kernel warning message "trace_printk() being used" looks kinda scary...

#56 lore raw

PATCH 15/17 media: atomsip: pci: add Microsoft Surface 3 ACPI vars

In reply to Tsuchiya Yuto

Microsoft Surface 3 does not describe CsiPort/CsiLanes in DSDT [1] or EFI, or at least not desctibed in the forms the current atomisp driver expects. This results in the default values (port: 0 lanes: 1) to be used, which does not work.

So, define them ourselves in the driver.

The user-facing camera is AR0330 (2-lane) and the world-facing camera is OV8835 (4-lane).

According to the portconfigs definition in atomisp_csi_lane_config() [atomisp_v4l2.c]:

	} portconfigs[] = {
		/* Tangier/Merrifield available lane configurations */
		{ 0x00, { 4, 1, 0 } },		/* 00000 */
		{ 0x01, { 3, 1, 0 } },		/* 00001 */
		{ 0x02, { 2, 1, 0 } },		/* 00010 */
		{ 0x03, { 1, 1, 0 } },		/* 00011 */
		{ 0x04, { 2, 1, 2 } },		/* 00100 */
		{ 0x08, { 3, 1, 1 } },		/* 01000 */
		{ 0x09, { 2, 1, 1 } },		/* 01001 */
		{ 0x0a, { 1, 1, 1 } },		/* 01010 */

		/* Anniedale/Moorefield only configurations */
		{ 0x10, { 4, 2, 0 } },		/* 10000 */
		{ 0x11, { 3, 2, 0 } },		/* 10001 */
		{ 0x12, { 2, 2, 0 } },		/* 10010 */
		{ 0x13, { 1, 2, 0 } },		/* 10011 */
		{ 0x14, { 2, 2, 2 } },		/* 10100 */
		{ 0x18, { 3, 2, 1 } },		/* 11000 */
		{ 0x19, { 2, 2, 1 } },		/* 11001 */
		{ 0x1a, { 1, 2, 1 } },		/* 11010 */
	};

4-lane camera is always connected to the PRIMARY (port1) port [2]. In this case, 2-lane camera can be connected to the only SECONDARY (port0) port.

So, add these data accordingly as the gmin_cfg_var ACPI variables for Surface 3.

[1] https://github.com/linux-surface/acpidumps/blob/7da48a392b4085c2021952290def1fc28505a643/surface_3/dsdt.dsl#L5879-L6278

[2] Yes, the PRIMARY port is port1 according to atomisp_camera_port

    [atomisp.h]:

	enum atomisp_camera_port {
		ATOMISP_CAMERA_PORT_SECONDARY,
		ATOMISP_CAMERA_PORT_PRIMARY,
		ATOMISP_CAMERA_PORT_TERTIARY,
		ATOMISP_CAMERA_NR_PORTS
	};
---
 .../media/atomisp/pci/atomisp_gmin_platform.c | 19 +++++++++++++++++++
 1 file changed, 19 insertions(+)
drivers/staging/media/atomisp/pci/atomisp_gmin_platform.c +19 -0
index d8c9e31314b2..948eb6f809f5 100644
@@ -321,6 +321,18 @@ static struct gmin_cfg_var i8880_vars[] = {
 	{},
 };
 
+/*
+ * Surface 3 does not describe CsiPort/CsiLanes in both DSDT and EFI.
+ */
+static struct gmin_cfg_var surface3_vars[] = {
+	{"APTA0330:00_CsiPort", "0"},
+	{"APTA0330:00_CsiLanes", "2"},
+
+	{"OVTI8835:00_CsiPort", "1"},
+	{"OVTI8835:00_CsiLanes", "4"},
+	{},
+};
+
 static const struct dmi_system_id gmin_vars[] = {
 	{
 		.ident = "BYT-T FFD8",
@@ -358,6 +370,13 @@ static const struct dmi_system_id gmin_vars[] = {
 		},
 		.driver_data = i8880_vars,
 	},
+	{
+		.ident = "Surface 3",
+		.matches = {
+			DMI_MATCH(DMI_BOARD_NAME, "Surface 3"),
+		},
+		.driver_data = surface3_vars,
+	},
 	{}
 };
 
Signature · 1 line
2.33.1
#57 lore raw

PATCH 16/17 media: atomsip: pci: add DMI match for Microsoft Surface 3 with broken DMI (OEMB)

In reply to Tsuchiya Yuto

This commit is added for Surface 3 with broken DMI table. HACK-ish. Not intended for upstreaming. Thus, NOT-FOR-MERGE. But, if someone knows a nicer way to address this, comments are welcome...

Quoted 1 line

8-----------------------------------------------------------------8<

On some Microsoft Surface 3, the DMI table gets corrupted for unknown reasons and breaks existing DMI matching used for device-specific quirks.

This commit adds the (broken) DMI data into dmi_system_id tables used for quirks so that the driver can enable quirks even on the affected systems.

On affected systems, the DMI data will look like this:

        $ grep . /sys/devices/virtual/dmi/id/{bios_vendor,board_name,board_vendor,\
        chassis_vendor,product_name,sys_vendor}
        /sys/devices/virtual/dmi/id/bios_vendor:American Megatrends Inc.
        /sys/devices/virtual/dmi/id/board_name:OEMB
        /sys/devices/virtual/dmi/id/board_vendor:OEMB
        /sys/devices/virtual/dmi/id/chassis_vendor:OEMB
        /sys/devices/virtual/dmi/id/product_name:OEMB
        /sys/devices/virtual/dmi/id/sys_vendor:OEMB

Expected:

        $ grep . /sys/devices/virtual/dmi/id/{bios_vendor,board_name,board_vendor,\
        chassis_vendor,product_name,sys_vendor}
        /sys/devices/virtual/dmi/id/bios_vendor:American Megatrends Inc.
        /sys/devices/virtual/dmi/id/board_name:Surface 3
        /sys/devices/virtual/dmi/id/board_vendor:Microsoft Corporation
        /sys/devices/virtual/dmi/id/chassis_vendor:Microsoft Corporation
        /sys/devices/virtual/dmi/id/product_name:Surface 3
        /sys/devices/virtual/dmi/id/sys_vendor:Microsoft Corporation
---
 .../staging/media/atomisp/pci/atomisp_gmin_platform.c | 11 +++++++++++
 1 file changed, 11 insertions(+)
drivers/staging/media/atomisp/pci/atomisp_gmin_platform.c +11 -0
index 948eb6f809f5..3868d64cbc2b 100644
@@ -377,6 +377,17 @@ static const struct dmi_system_id gmin_vars[] = {
 		},
 		.driver_data = surface3_vars,
 	},
+	{
+		.ident = "Surface 3",
+		.matches = {
+			/* DMI data for Surface 3 with broken DMI table */
+			DMI_MATCH(DMI_BIOS_VENDOR, "American Megatrends Inc."),
+			DMI_MATCH(DMI_BOARD_NAME, "OEMB"),
+			DMI_MATCH(DMI_PRODUCT_NAME, "OEMB"),
+			DMI_MATCH(DMI_SYS_VENDOR, "OEMB"),
+		},
+		.driver_data = surface3_vars,
+	},
 	{}
 };
 
Signature · 1 line
2.33.1
#58 lore raw

Re: [PATCH 16/17] [NOT-FOR-MERGE] media: atomsip: pci: add DMI match for Microsoft Surface 3 with broken DMI (OEMB)

Hi,

Quoted 15 lines · Tsuchiya Yuto

This commit is added for Surface 3 with broken DMI table. HACK-ish. Not intended for upstreaming. Thus, NOT-FOR-MERGE. But, if someone knows a nicer way to address this, comments are welcome...

Quoted 1 line

8-----------------------------------------------------------------8<

On some Microsoft Surface 3, the DMI table gets corrupted for unknown reasons and breaks existing DMI matching used for device-specific quirks.

This commit adds the (broken) DMI data into dmi_system_id tables used for quirks so that the driver can enable quirks even on the affected systems.

On affected systems, the DMI data will look like this:

Quoted 8 lines
        $ grep . /sys/devices/virtual/dmi/id/{bios_vendor,board_name,board_vendor,\
        chassis_vendor,product_name,sys_vendor}
        /sys/devices/virtual/dmi/id/bios_vendor:American Megatrends Inc.
        /sys/devices/virtual/dmi/id/board_name:OEMB
        /sys/devices/virtual/dmi/id/board_vendor:OEMB
        /sys/devices/virtual/dmi/id/chassis_vendor:OEMB
        /sys/devices/virtual/dmi/id/product_name:OEMB
        /sys/devices/virtual/dmi/id/sys_vendor:OEMB

I wonder what the bios_date field contains ? Typically when the DMI strings are no good (e.g. often they contain "Default String" or "To be filled by OEM") we add a check on the bios-date, which together with the broken strings is considered unique enough to still allow a match with broken strings in the kernel.

Also have you tried doing something like "load bios/setup defaults" in the BIOS setup ? Maybe that helps ?

Regards,

Hans

Quoted 40 lines

Expected:

        $ grep . /sys/devices/virtual/dmi/id/{bios_vendor,board_name,board_vendor,\
        chassis_vendor,product_name,sys_vendor}
        /sys/devices/virtual/dmi/id/bios_vendor:American Megatrends Inc.
        /sys/devices/virtual/dmi/id/board_name:Surface 3
        /sys/devices/virtual/dmi/id/board_vendor:Microsoft Corporation
        /sys/devices/virtual/dmi/id/chassis_vendor:Microsoft Corporation
        /sys/devices/virtual/dmi/id/product_name:Surface 3
        /sys/devices/virtual/dmi/id/sys_vendor:Microsoft Corporation
---
 .../staging/media/atomisp/pci/atomisp_gmin_platform.c | 11 +++++++++++
 1 file changed, 11 insertions(+)
drivers/staging/media/atomisp/pci/atomisp_gmin_platform.c +11 -0
index 948eb6f809f5..3868d64cbc2b 100644
@@ -377,6 +377,17 @@ static const struct dmi_system_id gmin_vars[] = {
 		},
 		.driver_data = surface3_vars,
 	},
+	{
+		.ident = "Surface 3",
+		.matches = {
+			/* DMI data for Surface 3 with broken DMI table */
+			DMI_MATCH(DMI_BIOS_VENDOR, "American Megatrends Inc."),
+			DMI_MATCH(DMI_BOARD_NAME, "OEMB"),
+			DMI_MATCH(DMI_PRODUCT_NAME, "OEMB"),
+			DMI_MATCH(DMI_SYS_VENDOR, "OEMB"),
+		},
+		.driver_data = surface3_vars,
+	},
 	{}
 };
 
#59 lore raw

Re: [PATCH 16/17] [NOT-FOR-MERGE] media: atomsip: pci: add DMI match for Microsoft Surface 3 with broken DMI (OEMB)

Quoted 27 lines · Hans de Goede

Hi,

Quoted 15 lines · Tsuchiya Yuto

This commit is added for Surface 3 with broken DMI table. HACK-ish. Not intended for upstreaming. Thus, NOT-FOR-MERGE. But, if someone knows a nicer way to address this, comments are welcome...

Quoted 1 line

8-----------------------------------------------------------------8<

On some Microsoft Surface 3, the DMI table gets corrupted for unknown reasons and breaks existing DMI matching used for device-specific quirks.

This commit adds the (broken) DMI data into dmi_system_id tables used for quirks so that the driver can enable quirks even on the affected systems.

On affected systems, the DMI data will look like this:

Quoted 8 lines
        $ grep . /sys/devices/virtual/dmi/id/{bios_vendor,board_name,board_vendor,\
        chassis_vendor,product_name,sys_vendor}
        /sys/devices/virtual/dmi/id/bios_vendor:American Megatrends Inc.
        /sys/devices/virtual/dmi/id/board_name:OEMB
        /sys/devices/virtual/dmi/id/board_vendor:OEMB
        /sys/devices/virtual/dmi/id/chassis_vendor:OEMB
        /sys/devices/virtual/dmi/id/product_name:OEMB
        /sys/devices/virtual/dmi/id/sys_vendor:OEMB
Quoted 5 lines

I wonder what the bios_date field contains ? Typically when the DMI strings are no good (e.g. often they contain "Default String" or "To be filled by OEM") we add a check on the bios-date, which together with the broken strings is considered unique enough to still allow a match with broken strings in the kernel.

Thank you so much for the comment :-)

Here is the full output of "/sys/devices/virtual/dmi/id/*" (not showing files that need root permission to read):

        $ grep . /sys/devices/virtual/dmi/id/*
        /sys/devices/virtual/dmi/id/bios_date:03/09/2015
        /sys/devices/virtual/dmi/id/bios_release:5.6
        /sys/devices/virtual/dmi/id/bios_vendor:American Megatrends Inc.
        /sys/devices/virtual/dmi/id/bios_version:1.51116.238
        /sys/devices/virtual/dmi/id/board_name:OEMB
        grep: /sys/devices/virtual/dmi/id/board_serial: Permission denied
        /sys/devices/virtual/dmi/id/board_vendor:OEMB
        /sys/devices/virtual/dmi/id/board_version:00
        grep: /sys/devices/virtual/dmi/id/chassis_serial: Permission denied
        /sys/devices/virtual/dmi/id/chassis_type:9
        /sys/devices/virtual/dmi/id/chassis_vendor:OEMB
        /sys/devices/virtual/dmi/id/modalias:dmi:bvnAmericanMegatrendsInc.:bvr1.51116.238:bd03/09/2015:br5.6:svnOEMB:pnOEMB:pvrB16D0SM1C4G1X1:rvnOEMB:rnOEMB:rvr00:cvnOEMB:ct9:cvr:sku:
        grep: /sys/devices/virtual/dmi/id/power: Is a directory
        /sys/devices/virtual/dmi/id/product_name:OEMB
        grep: /sys/devices/virtual/dmi/id/product_serial: Permission denied
        grep: /sys/devices/virtual/dmi/id/product_uuid: Permission denied
        /sys/devices/virtual/dmi/id/product_version:B16D0SM1C4G1X1
        grep: /sys/devices/virtual/dmi/id/subsystem: Is a directory
        /sys/devices/virtual/dmi/id/sys_vendor:OEMB
        /sys/devices/virtual/dmi/id/uevent:MODALIAS=dmi:bvnAmericanMegatrendsInc.:bvr1.51116.238:bd03/09/2015:br5.6:svnOEMB:pnOEMB:pvrB16D0SM1C4G1X1:rvnOEMB:rnOEMB:rvr00:cvnOEMB:ct9:cvr:sku:

The "bios_date" ("03/09/2015") looks not broken.

I also noticed when writing this mail, regarding the ones that need root permission to read, "board_serial" and "chassis_serial" are now empty. "product_serial" now shows "OEM":

        $ sudo cat /sys/devices/virtual/dmi/id/product_serial
        OEM

"product_uuid" looks not broken.

Quoted 2 lines

Also have you tried doing something like "load bios/setup defaults" in the BIOS setup ? Maybe that helps ?

Unfortunately, there is no option like this...

Regards,
Tsuchiya Yuto

#60 lore raw

Re: [PATCH 16/17] [NOT-FOR-MERGE] media: atomsip: pci: add DMI match for Microsoft Surface 3 with broken DMI (OEMB)

Hi,

Quoted 36 lines · Tsuchiya Yuto
Quoted 27 lines · Hans de Goede

Hi,

Quoted 15 lines · Tsuchiya Yuto

This commit is added for Surface 3 with broken DMI table. HACK-ish. Not intended for upstreaming. Thus, NOT-FOR-MERGE. But, if someone knows a nicer way to address this, comments are welcome...

Quoted 1 line

8-----------------------------------------------------------------8<

On some Microsoft Surface 3, the DMI table gets corrupted for unknown reasons and breaks existing DMI matching used for device-specific quirks.

This commit adds the (broken) DMI data into dmi_system_id tables used for quirks so that the driver can enable quirks even on the affected systems.

On affected systems, the DMI data will look like this:

Quoted 8 lines
        $ grep . /sys/devices/virtual/dmi/id/{bios_vendor,board_name,board_vendor,\
        chassis_vendor,product_name,sys_vendor}
        /sys/devices/virtual/dmi/id/bios_vendor:American Megatrends Inc.
        /sys/devices/virtual/dmi/id/board_name:OEMB
        /sys/devices/virtual/dmi/id/board_vendor:OEMB
        /sys/devices/virtual/dmi/id/chassis_vendor:OEMB
        /sys/devices/virtual/dmi/id/product_name:OEMB
        /sys/devices/virtual/dmi/id/sys_vendor:OEMB
Quoted 5 lines

I wonder what the bios_date field contains ? Typically when the DMI strings are no good (e.g. often they contain "Default String" or "To be filled by OEM") we add a check on the bios-date, which together with the broken strings is considered unique enough to still allow a match with broken strings in the kernel.

Thank you so much for the comment :-)

Quoted 8 lines

Here is the full output of "/sys/devices/virtual/dmi/id/*" (not showing files that need root permission to read):

        $ grep . /sys/devices/virtual/dmi/id/*
        /sys/devices/virtual/dmi/id/bios_date:03/09/2015
        /sys/devices/virtual/dmi/id/bios_release:5.6
        /sys/devices/virtual/dmi/id/bios_vendor:American Megatrends Inc.
        /sys/devices/virtual/dmi/id/bios_version:1.51116.238

Interesting, this is the latest BIOS from july 2019 according to:
https://support.microsoft.com/en-us/surface/surface-3-update-history-5d86a7bc-03f7-2d27-d858-e90ce637fb52
yet the date is still set to 03/09/2015.

I just checked and the BIOS with not corrupted DMI strings also keeps the date at 03/09/2015 in BIOS updates.

So the date is correct, and together with matching a coupleof the OEMB-s (which I've never seen anywhere else either) this should be plenty unique.

So this not only allows adding this mathc to atomisp, but also to fix sound + wmi on bad DMI data OEMB Surface 3-s, by updating this patch:

https://github.com/linux-surface/linux-surface/blob/2fb7e9ae91350098db9a280277f424272816a9ab/patches/5.5/0003-surface3-oemb.patch

To include the BIOS-date match and then submitting this upstream (as 2 separate patches please).

Tsuchiya, I take it that your Surface 3 has the OEMB issue, so you can actually test this ?

If you can prepare 2 patches for the sound + wmi then; and submit them upstream that would be great. Please Cc me on both patches.

Regards,

Hans

Quoted 36 lines

/sys/devices/virtual/dmi/id/board_name:OEMB
grep: /sys/devices/virtual/dmi/id/board_serial: Permission denied
/sys/devices/virtual/dmi/id/board_vendor:OEMB
/sys/devices/virtual/dmi/id/board_version:00
grep: /sys/devices/virtual/dmi/id/chassis_serial: Permission denied
/sys/devices/virtual/dmi/id/chassis_type:9
/sys/devices/virtual/dmi/id/chassis_vendor:OEMB /sys/devices/virtual/dmi/id/modalias:dmi:bvnAmericanMegatrendsInc.:bvr1.51116.238:bd03/09/2015:br5.6:svnOEMB:pnOEMB:pvrB16D0SM1C4G1X1:rvnOEMB:rnOEMB:rvr00:cvnOEMB:ct9:cvr:sku:
grep: /sys/devices/virtual/dmi/id/power: Is a directory
/sys/devices/virtual/dmi/id/product_name:OEMB
grep: /sys/devices/virtual/dmi/id/product_serial: Permission denied
grep: /sys/devices/virtual/dmi/id/product_uuid: Permission denied
/sys/devices/virtual/dmi/id/product_version:B16D0SM1C4G1X1
grep: /sys/devices/virtual/dmi/id/subsystem: Is a directory
/sys/devices/virtual/dmi/id/sys_vendor:OEMB /sys/devices/virtual/dmi/id/uevent:MODALIAS=dmi:bvnAmericanMegatrendsInc.:bvr1.51116.238:bd03/09/2015:br5.6:svnOEMB:pnOEMB:pvrB16D0SM1C4G1X1:rvnOEMB:rnOEMB:rvr00:cvnOEMB:ct9:cvr:sku:

The "bios_date" ("03/09/2015") looks not broken.

I also noticed when writing this mail, regarding the ones that need root permission to read, "board_serial" and "chassis_serial" are now empty. "product_serial" now shows "OEM":

        $ sudo cat /sys/devices/virtual/dmi/id/product_serial
        OEM

"product_uuid" looks not broken.

Quoted 2 lines

Also have you tried doing something like "load bios/setup defaults" in the BIOS setup ? Maybe that helps ?

Unfortunately, there is no option like this...

Regards,
Tsuchiya Yuto

#61 lore raw

Re: [PATCH 16/17] [NOT-FOR-MERGE] media: atomsip: pci: add DMI match for Microsoft Surface 3 with broken DMI (OEMB)

Quoted 48 lines · Hans de Goede

Hi,

Quoted 36 lines · Tsuchiya Yuto
Quoted 27 lines · Hans de Goede

Hi,

Quoted 15 lines · Tsuchiya Yuto

This commit is added for Surface 3 with broken DMI table. HACK-ish. Not intended for upstreaming. Thus, NOT-FOR-MERGE. But, if someone knows a nicer way to address this, comments are welcome...

Quoted 1 line

8-----------------------------------------------------------------8<

On some Microsoft Surface 3, the DMI table gets corrupted for unknown reasons and breaks existing DMI matching used for device-specific quirks.

This commit adds the (broken) DMI data into dmi_system_id tables used for quirks so that the driver can enable quirks even on the affected systems.

On affected systems, the DMI data will look like this:

Quoted 8 lines
        $ grep . /sys/devices/virtual/dmi/id/{bios_vendor,board_name,board_vendor,\
        chassis_vendor,product_name,sys_vendor}
        /sys/devices/virtual/dmi/id/bios_vendor:American Megatrends Inc.
        /sys/devices/virtual/dmi/id/board_name:OEMB
        /sys/devices/virtual/dmi/id/board_vendor:OEMB
        /sys/devices/virtual/dmi/id/chassis_vendor:OEMB
        /sys/devices/virtual/dmi/id/product_name:OEMB
        /sys/devices/virtual/dmi/id/sys_vendor:OEMB
Quoted 5 lines

I wonder what the bios_date field contains ? Typically when the DMI strings are no good (e.g. often they contain "Default String" or "To be filled by OEM") we add a check on the bios-date, which together with the broken strings is considered unique enough to still allow a match with broken strings in the kernel.

Thank you so much for the comment :-)

Quoted 8 lines

Here is the full output of "/sys/devices/virtual/dmi/id/*" (not showing files that need root permission to read):

        $ grep . /sys/devices/virtual/dmi/id/*
        /sys/devices/virtual/dmi/id/bios_date:03/09/2015
        /sys/devices/virtual/dmi/id/bios_release:5.6
        /sys/devices/virtual/dmi/id/bios_vendor:American Megatrends Inc.
        /sys/devices/virtual/dmi/id/bios_version:1.51116.238
Quoted 3 lines

Interesting, this is the latest BIOS from july 2019 according to:
https://support.microsoft.com/en-us/surface/surface-3-update-history-5d86a7bc-03f7-2d27-d858-e90ce637fb52
yet the date is still set to 03/09/2015.

Yeah, I'm a little bit confused about this.

Quoted 10 lines

I just checked and the BIOS with not corrupted DMI strings also keeps the date at 03/09/2015 in BIOS updates.

So the date is correct, and together with matching a coupleof the OEMB-s (which I've never seen anywhere else either) this should be plenty unique.

So this not only allows adding this mathc to atomisp, but also to fix sound + wmi on bad DMI data OEMB Surface 3-s, by updating this patch:

Quoted 7 lines

https://github.com/linux-surface/linux-surface/blob/2fb7e9ae91350098db9a280277f424272816a9ab/patches/5.5/0003-surface3-oemb.patch

To include the BIOS-date match and then submitting this upstream (as 2 separate patches please).

Tsuchiya, I take it that your Surface 3 has the OEMB issue, so you can actually test this ?

Yes, my surface3 is also affected and I can test this.

Quoted 2 lines

If you can prepare 2 patches for the sound + wmi then; and submit them upstream that would be great. Please Cc me on both patches.

Thank you for the suggestion, but I started having a mixed feeling about sending this kind of patches... This "OEMB" issue is not a design by manufacturers, but simply just it got broken after something (maybe a force power off?). On the other hand, I know there are also indeed some people affected by this issue other than me...

If possible, I rather want to fix this broken DMI table, but I couldn't find the way until now though.

But again, thank you for the suggestion. I'll consider sending the patches when I gave up fixing it...

<Below is completely off topic from atomisp>

I think some useful BIOS option might be just hidden. So, I'd like to try this way. I already find the string "Restore Defaults" using uefitool/ifrextract:

    0x13429 	Form: Save & Exit, FormId: 0x2719 {01 86 19 27 4C 00}
    [...]
    0x134E0 		Suppress If {0A 82}
    0x134E2 			QuestionId: 0x1C3 equals value 0x5 {12 06 C3 01 05 00}
    0x134E8 			Ref: Restore Defaults, VarStoreInfo (VarOffset/VarName): 0xFFFF, VarStore: 0x0, QuestionId: 0x1BC, FormId: 0x2719 {0F 0F 5B 00 5C 00 BC 01 00 00 FF FF 00 19 27}
    0x134F7 		End If {29 02}
    [...]

I currently don't know how I can call this. I want to try this way when I have some time...

Regards,
Tsuchiya Yuto

#62 lore raw

Re: [PATCH 16/17] [NOT-FOR-MERGE] media: atomsip: pci: add DMI match for Microsoft Surface 3 with broken DMI (OEMB)

Hi,

Quoted 49 lines · Tsuchiya Yuto
Quoted 48 lines · Hans de Goede

Hi,

Quoted 44 lines · Tsuchiya Yuto
Quoted 27 lines · Hans de Goede

Hi,

Quoted 15 lines · Tsuchiya Yuto

This commit is added for Surface 3 with broken DMI table. HACK-ish. Not intended for upstreaming. Thus, NOT-FOR-MERGE. But, if someone knows a nicer way to address this, comments are welcome...

Quoted 1 line

8-----------------------------------------------------------------8<

On some Microsoft Surface 3, the DMI table gets corrupted for unknown reasons and breaks existing DMI matching used for device-specific quirks.

This commit adds the (broken) DMI data into dmi_system_id tables used for quirks so that the driver can enable quirks even on the affected systems.

On affected systems, the DMI data will look like this:

Quoted 8 lines
        $ grep . /sys/devices/virtual/dmi/id/{bios_vendor,board_name,board_vendor,\
        chassis_vendor,product_name,sys_vendor}
        /sys/devices/virtual/dmi/id/bios_vendor:American Megatrends Inc.
        /sys/devices/virtual/dmi/id/board_name:OEMB
        /sys/devices/virtual/dmi/id/board_vendor:OEMB
        /sys/devices/virtual/dmi/id/chassis_vendor:OEMB
        /sys/devices/virtual/dmi/id/product_name:OEMB
        /sys/devices/virtual/dmi/id/sys_vendor:OEMB
Quoted 5 lines

I wonder what the bios_date field contains ? Typically when the DMI strings are no good (e.g. often they contain "Default String" or "To be filled by OEM") we add a check on the bios-date, which together with the broken strings is considered unique enough to still allow a match with broken strings in the kernel.

Thank you so much for the comment :-)

Here is the full output of "/sys/devices/virtual/dmi/id/*" (not showing files that need root permission to read):

        $ grep . /sys/devices/virtual/dmi/id/*
        /sys/devices/virtual/dmi/id/bios_date:03/09/2015
        /sys/devices/virtual/dmi/id/bios_release:5.6
        /sys/devices/virtual/dmi/id/bios_vendor:American Megatrends Inc.
        /sys/devices/virtual/dmi/id/bios_version:1.51116.238
Quoted 5 lines
Quoted 3 lines

Interesting, this is the latest BIOS from july 2019 according to:
https://support.microsoft.com/en-us/surface/surface-3-update-history-5d86a7bc-03f7-2d27-d858-e90ce637fb52
yet the date is still set to 03/09/2015.

Yeah, I'm a little bit confused about this.

Yes this is unusual, bit it just seems to be how Microsoft does things on the Surface 3.

Quoted 29 lines
Quoted 10 lines

I just checked and the BIOS with not corrupted DMI strings also keeps the date at 03/09/2015 in BIOS updates.

So the date is correct, and together with matching a coupleof the OEMB-s (which I've never seen anywhere else either) this should be plenty unique.

So this not only allows adding this mathc to atomisp, but also to fix sound + wmi on bad DMI data OEMB Surface 3-s, by updating this patch:

Quoted 7 lines

https://github.com/linux-surface/linux-surface/blob/2fb7e9ae91350098db9a280277f424272816a9ab/patches/5.5/0003-surface3-oemb.patch

To include the BIOS-date match and then submitting this upstream (as 2 separate patches please).

Tsuchiya, I take it that your Surface 3 has the OEMB issue, so you can actually test this ?

Yes, my surface3 is also affected and I can test this.

Quoted 2 lines

If you can prepare 2 patches for the sound + wmi then; and submit them upstream that would be great. Please Cc me on both patches.

Thank you for the suggestion, but I started having a mixed feeling about sending this kind of patches... This "OEMB" issue is not a design by manufacturers, but simply just it got broken after something (maybe a force power off?). On the other hand, I know there are also indeed some people affected by this issue other than me...

Quoted 5 lines

If possible, I rather want to fix this broken DMI table, but I couldn't find the way until now though.

But again, thank you for the suggestion. I'll consider sending the patches when I gave up fixing it...

Since other people are affected too, fixing this is only really useful if the fix is doable by others too.

OTOH I just checked:

https://github.com/linuxhw/DMI

Which is a database of all dmidecode-s uploaded to:
https://linux-hardware.org/

And _zero_ of the 56358 dmidecode outputs available there contains OEMB, so this seems to be quite unique to the Surface 3. Which, esp. together with the BIOS date makes the DMI match definitely unique enough. Sometimes DMI strings change on a BIOS update (not break like this, but just change) so having 2 entries for a single device-model is not unheard of.

So my cents is to just go with adding the extra entry to dmi_system_id tables and to not spend too much time on this.

Quoted 14 lines

<Below is completely off topic from atomisp>

I think some useful BIOS option might be just hidden. So, I'd like to try this way. I already find the string "Restore Defaults" using uefitool/ifrextract:

    0x13429 	Form: Save & Exit, FormId: 0x2719 {01 86 19 27 4C 00}
    [...]
    0x134E0 		Suppress If {0A 82}
    0x134E2 			QuestionId: 0x1C3 equals value 0x5 {12 06 C3 01 05 00}
    0x134E8 			Ref: Restore Defaults, VarStoreInfo (VarOffset/VarName): 0xFFFF, VarStore: 0x0, QuestionId: 0x1BC, FormId: 0x2719 {0F 0F 5B 00 5C 00 BC 01 00 00 FF FF 00 19 27}
    0x134F7 		End If {29 02}
    [...]
Quoted 2 lines

I currently don't know how I can call this. I want to try this way when I have some time...

So this is not a normal hidden item which just changes a setting (for which there are known ways to change the setting without flashing the BIOS).

But this is some sorta action item which can only be enabled by flashing a custom BIOS, assuming we can somehow replace the Surface 3 custom setup menu with the standard IFR based menu, which in itself is a problem...

Regards,

Hans

#63 lore raw

Re: [PATCH 16/17] [NOT-FOR-MERGE] media: atomsip: pci: add DMI match for Microsoft Surface 3 with broken DMI (OEMB)

In reply to Tsuchiya Yuto

Hi,

Quoted 15 lines · Tsuchiya Yuto

This commit is added for Surface 3 with broken DMI table. HACK-ish. Not intended for upstreaming. Thus, NOT-FOR-MERGE. But, if someone knows a nicer way to address this, comments are welcome...

Quoted 1 line

8-----------------------------------------------------------------8<

On some Microsoft Surface 3, the DMI table gets corrupted for unknown reasons and breaks existing DMI matching used for device-specific quirks.

This commit adds the (broken) DMI data into dmi_system_id tables used for quirks so that the driver can enable quirks even on the affected systems.

On affected systems, the DMI data will look like this:

Quoted 8 lines
        $ grep . /sys/devices/virtual/dmi/id/{bios_vendor,board_name,board_vendor,\
        chassis_vendor,product_name,sys_vendor}
        /sys/devices/virtual/dmi/id/bios_vendor:American Megatrends Inc.
        /sys/devices/virtual/dmi/id/board_name:OEMB
        /sys/devices/virtual/dmi/id/board_vendor:OEMB
        /sys/devices/virtual/dmi/id/chassis_vendor:OEMB
        /sys/devices/virtual/dmi/id/product_name:OEMB
        /sys/devices/virtual/dmi/id/sys_vendor:OEMB

I wonder what the bios_date field contains ? Typically when the DMI strings are no good (e.g. often they contain "Default String" or "To be filled by OEM") we add a check on the bios-date, which together with the broken strings is considered unique enough to still allow a match with broken strings in the kernel.

Also have you tried doing something like "load bios/setup defaults" in the BIOS setup ? Maybe that helps ?

Regards,

Hans

Quoted 40 lines

Expected:

        $ grep . /sys/devices/virtual/dmi/id/{bios_vendor,board_name,board_vendor,\
        chassis_vendor,product_name,sys_vendor}
        /sys/devices/virtual/dmi/id/bios_vendor:American Megatrends Inc.
        /sys/devices/virtual/dmi/id/board_name:Surface 3
        /sys/devices/virtual/dmi/id/board_vendor:Microsoft Corporation
        /sys/devices/virtual/dmi/id/chassis_vendor:Microsoft Corporation
        /sys/devices/virtual/dmi/id/product_name:Surface 3
        /sys/devices/virtual/dmi/id/sys_vendor:Microsoft Corporation
---
 .../staging/media/atomisp/pci/atomisp_gmin_platform.c | 11 +++++++++++
 1 file changed, 11 insertions(+)
drivers/staging/media/atomisp/pci/atomisp_gmin_platform.c +11 -0
index 948eb6f809f5..3868d64cbc2b 100644
@@ -377,6 +377,17 @@ static const struct dmi_system_id gmin_vars[] = {
 		},
 		.driver_data = surface3_vars,
 	},
+	{
+		.ident = "Surface 3",
+		.matches = {
+			/* DMI data for Surface 3 with broken DMI table */
+			DMI_MATCH(DMI_BIOS_VENDOR, "American Megatrends Inc."),
+			DMI_MATCH(DMI_BOARD_NAME, "OEMB"),
+			DMI_MATCH(DMI_PRODUCT_NAME, "OEMB"),
+			DMI_MATCH(DMI_SYS_VENDOR, "OEMB"),
+		},
+		.driver_data = surface3_vars,
+	},
 	{}
 };
 
author Applied
#64 lore raw

PATCH 17/17 atomisp: Fix up the open v load race

In reply to Tsuchiya Yuto

From: Alan <[email protected]>

Applied this patch as-is for now to pass firmware load on probe. I haven't looked into this and not written by me anyway. Thus, NOT-FOR-MERGE. At least I can say this patch works just fine.

Quoted 1 line

8-----------------------------------------------------------------8<

From: Alan <[email protected]>
Patch from https://lore.kernel.org/linux-media/151001137594.77201.4306351721772580664.stgit@alans-desktop/raw

Here is the original commit message:

Subject: [PATCH 1/3] atomisp: Fix up the open v load race
From: Alan <[email protected]>
Date: Mon, 06 Nov 2017 23:36:36 +0000

This isn't the ideal final solution but it stops the main problem for now where an open (often from udev) races the device initialization and we try and load the firmware twice at the same time. This needless to say doesn't usually end well.

This patch fixes the following "css init failed" error related to firmware load. This issue often occurs when I insmod the module after boot.

	kern  :err   : [  234.658869] atomisp-isp2 0000:00:03.0: css init failed --- bad firmware?
	kern  :err   : [  234.755023] atomisp-isp2 0000:00:03.0: can't change power state from D0 to D3hot (config space inaccessible)
	kern  :err   : [  234.755053] atomisp-isp2 0000:00:03.0: can't change power state from D3cold to D0 (config space inaccessible)
	kern  :err   : [  234.755581] atomisp-isp2 0000:00:03.0: css init failed --- bad firmware?
	kern  :err   : [  234.756146] atomisp-isp2 0000:00:03.0: can't change power state from D3cold to D0 (config space inaccessible)
	kern  :err   : [  234.757115] atomisp-isp2 0000:00:03.0: css init failed --- bad firmware?
	kern  :err   : [  234.757582] atomisp-isp2 0000:00:03.0: can't change power state from D3cold to D0 (config space inaccessible)
	kern  :err   : [  234.758885] atomisp-isp2 0000:00:03.0: css init failed --- bad firmware?
	kern  :err   : [  234.760317] atomisp-isp2 0000:00:03.0: can't change power state from D3cold to D0 (config space inaccessible)
	kern  :err   : [  234.760818] atomisp-isp2 0000:00:03.0: css init failed --- bad firmware?
	kern  :err   : [  234.769102] atomisp-isp2 0000:00:03.0: can't change power state from D3cold to D0 (config space inaccessible)
	kern  :err   : [  234.769527] atomisp-isp2 0000:00:03.0: css init failed --- bad firmware?
	kern  :err   : [  234.771353] atomisp-isp2 0000:00:03.0: can't change power state from D3cold to D0 (config space inaccessible)
	kern  :err   : [  234.771804] atomisp-isp2 0000:00:03.0: css init failed --- bad firmware?
	kern  :err   : [  234.772299] atomisp-isp2 0000:00:03.0: can't change power state from D3cold to D0 (config space inaccessible)
	kern  :err   : [  234.774617] atomisp-isp2 0000:00:03.0: css init failed --- bad firmware?
	kern  :err   : [  234.775090] atomisp-isp2 0000:00:03.0: can't change power state from D3cold to D0 (config space inaccessible)
	kern  :err   : [  234.775607] atomisp-isp2 0000:00:03.0: css init failed --- bad firmware?
	kern  :err   : [  234.776230] atomisp-isp2 0000:00:03.0: can't change power state from D3cold to D0 (config space inaccessible)
	kern  :err   : [  234.779059] atomisp-isp2 0000:00:03.0: css init failed --- bad firmware?
	kern  :err   : [  234.787726] atomisp-isp2 0000:00:03.0: can't change power state from D3cold to D0 (config space inaccessible)
	kern  :err   : [  234.788078] atomisp-isp2 0000:00:03.0: css init failed --- bad firmware?

Patch is adapted to v5.15-rc4.

---
 drivers/staging/media/atomisp/pci/atomisp_fops.c     | 12 ++++++++++++
 drivers/staging/media/atomisp/pci/atomisp_internal.h |  5 +++++
 drivers/staging/media/atomisp/pci/atomisp_v4l2.c     |  6 ++++++
 3 files changed, 23 insertions(+)
drivers/staging/media/atomisp/pci/atomisp_fops.c +12 -0
index f82bf082aa79..62535e0f4429 100644
@@ -772,6 +772,18 @@ static int atomisp_open(struct file *file)
 
 	dev_dbg(isp->dev, "open device %s\n", vdev->name);
 
+	/* Ensure that if we are still loading we block. Once the loading
+	   is over we can proceed. We can't blindly hold the lock until
+	   that occurs as if the load fails we'll deadlock the unload */
+	rt_mutex_lock(&isp->loading);
+	/* Revisit this with a better check once the code structure is
+	   cleaned up a bit more FIXME */
+	if (!isp->ready) {
+		rt_mutex_unlock(&isp->loading);
+		return -ENXIO;
+	}
+	rt_mutex_unlock(&isp->loading);
+
 	rt_mutex_lock(&isp->mutex);
 
 	acc_node = !strcmp(vdev->name, "ATOMISP ISP ACC");
drivers/staging/media/atomisp/pci/atomisp_internal.h +5 -0
index c01db10bb735..356a7f1bb757 100644
@@ -246,6 +246,11 @@ struct atomisp_device {
 	/* Purpose of mutex is to protect and serialize use of isp data
 	 * structures and css API calls. */
 	struct rt_mutex mutex;
+	/* This mutex ensures that we don't allow an open to succeed while
+	 * the initialization process is incomplete */
+	struct rt_mutex loading;
+	/* Set once the ISP is ready to allow opens */
+	bool ready;
 	/*
 	 * Serialise streamoff: mutex is dropped during streamoff to
 	 * cancel the watchdog queue. MUST be acquired BEFORE
drivers/staging/media/atomisp/pci/atomisp_v4l2.c +6 -0
index 720963156d24..e2ccace77a73 100644
@@ -1567,6 +1567,7 @@ static int atomisp_pci_probe(struct pci_dev *pdev, const struct pci_device_id *i
 	dev_dbg(&pdev->dev, "atomisp mmio base: %p\n", isp->base);
 
 	rt_mutex_init(&isp->mutex);
+	rt_mutex_init(&isp->loading);
 	mutex_init(&isp->streamoff_mutex);
 	spin_lock_init(&isp->lock);
 
@@ -1749,6 +1750,8 @@ static int atomisp_pci_probe(struct pci_dev *pdev, const struct pci_device_id *i
 		pci_write_config_dword(pdev, MRFLD_PCI_CSI_AFE_TRIM_CONTROL, csi_afe_trim);
 	}
 
+	rt_mutex_lock(&isp->loading);
+
 	err = atomisp_initialize_modules(isp);
 	if (err < 0) {
 		dev_err(&pdev->dev, "atomisp_initialize_modules (%d)\n", err);
@@ -1806,6 +1809,8 @@ static int atomisp_pci_probe(struct pci_dev *pdev, const struct pci_device_id *i
 	release_firmware(isp->firmware);
 	isp->firmware = NULL;
 	isp->css_env.isp_css_fw.data = NULL;
+	isp->ready = true;
+	rt_mutex_unlock(&isp->loading);
 
 	atomisp_drvfs_init(isp);
 
@@ -1825,6 +1830,7 @@ static int atomisp_pci_probe(struct pci_dev *pdev, const struct pci_device_id *i
 register_entities_fail:
 	atomisp_uninitialize_modules(isp);
 initialize_modules_fail:
+	rt_mutex_unlock(&isp->loading);
 	cpu_latency_qos_remove_request(&isp->pm_qos);
 	atomisp_msi_irq_uninit(isp);
 	pci_free_irq_vectors(pdev);
Signature · 1 line
2.33.1
#65 lore raw
In reply to Tsuchiya Yuto

<Added some more people to the Cc who are also definitely interested in this>

Hi Tsuchiya,

Quoted 8 lines · Tsuchiya Yuto

Hi all,

This patch series contains fixes for atomisp to work (again). Tested on Microsoft Surface 3 (Windows) and Xiaomi Mi Pad 2 (Android model) with v5.15-rc5. Both are Cherry Trail (ISP2401) devices.

I'm still not used to Linux patch sending flow. Sorry in advance if there is some weirdness :-) but I did my best.

You actually did pretty good AFAICT.

Also thank you so much for working on this. Finally getting working atomisp2 support is awesome!

I actually have been working on and off on this myself (even did a bit of work on it this weekend). My plan was to:

1. Find android (5.1) x86 kernel sources which I can build from source and get a working Android (on a device with Android pre-installed) with a kernel build from source -> Done

2. Get a regular Linux distro to boot with the kernel from 1. -> Done (normal Linux v4l2 utils do not give a picture, might be the need to set preview mode)

3. Add ioctl debugging to the kernel from 1. capture a trace to see what Android userspace is doing -> Done . See here for an example log:

https://fedorapeople.org/~jwrdegoede/atomisp-logs-t116/

4. Write a userspace utility mimicking Android userspace, I started on this this weekend

5. Once I've 4. working the plan was a bit vague, the idea was to see if I could use that to quickly get the mainline staging version to work; or alternatively forward port the working Android kernel sources to mainline from scratch.

But it looks like 4 and 5 will no longer be necessary, which is awesome, thank you so much!

I'll try to look into this series in more detail; and try to get thing working on one of my own devices when I can make some time for this.

Quoted 36 lines

I'll send another series that contains RFC patches later named ("bug reports for atomisp to make it work"). To try to capture images, applying those RFC patches are also needed.

The following 1st-7th patches are fixes for the upstreamed atomisp:

media: atomisp: pci: add missing media_device_cleanup() in
atomisp_unregister_entities()
media: atomisp: pci: fix punit_ddr_dvfs_enable() argument for
mrfld_power up case
media: atomisp: pci: fix inverted logic in buffers_needed()
media: atomisp: pci: do not use err var when checking port validity
for ISP2400
media: atomisp: pci: fix inverted error check for
ia_css_mipi_is_source_port_valid()
media: atomisp: pci: use IA_CSS_ERROR() for error messages in
sh_css_mipi.c
media: atomisp: pci: fix ifdefs in sh_css.c

The following 8th-13th patches partially reverts driver version back to irci_stable_candrpv_0415_20150521_0458:

media: atomisp: pci: make fw ver
irci_stable_candrpv_0415_20150521_0458 work - 1/5
media: atomisp: pci: make fw ver
irci_stable_candrpv_0415_20150521_0458 work - 2/5
media: atomisp: pci: make fw ver
irci_stable_candrpv_0415_20150521_0458 work - 3/5
media: atomisp: pci: make fw ver
irci_stable_candrpv_0415_20150521_0458 work - 4/5
media: atomisp: pci: make fw ver
irci_stable_candrpv_0415_20150521_0458 work - 5/5
media: atomisp: pci: release_version is now
irci_stable_candrpv_0415_20150521_0458

Quoted 8 lines

One of the issues on the upstreamed atomisp is, the driver is a result of the following two different versions of driver merged by tools using ifdef ISP2401:

- ISP2400: irci_stable_candrpv_0415_20150521_0458
- ISP2401: irci_master_20150911_0724

and we don't have such firmware made for irci_master_20150911_0724.

Right this is something which I also noticed (but I did not do anything with / about yet)

Quoted 2 lines

I confirmed that the driver version irci_stable_candrpv_0415_20150521_0458 works well on the intel-aero version atomisp for ISP2401, too.

"irci_stable_candrpv_0415_20150521_0458" is also the version of the atomisp firmware shipped in CHT tablets which come with Android pre-installed. So I agree that this is the version which we should go for.

Quoted 5 lines

Here is
my port, if someone is interested [2]:

So, eventually, such ISP version tests caused by just the driver version difference can be removed (not just being unified but removed).

Ack.

Quoted 5 lines

That said, it may take longer time until we remove such tests. So, for now I thought it may be better to focus on just making atomisp work by partially reverting the incompatible things for the firmware version irci_stable_candrpv_0415_20150521_0458.

Ack.

<snip>

Quoted 22 lines

## about (a lot of) ISP2401 ifdef tests

When porting intel-aero version atomisp to mainline, I thought almost all the ifdef ISP2401 things are the result of two different driver version merged by tools.

To confirm that, I tried removing ifdefs for the initial commit of upstreamed atomisp [1]. And I can successfully take a picture there on surface3.

Currently, I can remove ifdefs up to commit bd674b5a413c ("media: atomisp:
cleanup ifdefs from ia_css_debug.c") [2] which is before 641c2292bf19 ("media:
atomisp: get rid of version-dependent globals"). Up to there, I stopped and realized it may take some time to remove ifdefs for current atomisp. So, instead of removing ifdefs, I partially reverted incompatible parts in this series for now.

The ifdefs for the real hardware difference is like the following which were removed or integrated into ifdef ISP2401 on commit 641c2292bf19 ("media: atomisp: get rid of version-dependent globals") and bd674b5a413c ("media: atomisp: cleanup ifdefs from ia_css_debug.c"):

Quoted 7 lines

- HAS_NO_INPUT_FORMATTER
- USE_INPUT_SYSTEM_VERSION_2
- USE_INPUT_SYSTEM_VERSION_2401
...

I need to elaborate on this ifdef thing later (and I'll do later), but for now, let's focus on make it just work...

Just focusing on making it work sounds good to me. I also have quite a few Bay Trail devices, so I would love to also see the 2400 version working.

But one step at a time lets focus on CHT / the 2401 for now.

Quoted 3 lines

For devices which use intel_pmic_bytcrc driver, you need to add i2c address. I sent RFC patch earlier named ("ACPI / PMIC: Add i2c address to intel_pmic_bytcrc driver").

I'll reply to that patch in its own thread (it needs some work, but we should be able to get something ready for upstream easily).

Quoted 13 lines

Also, sensor drivers are not upstream. Take a look at my working tree if someone is interested [1].

I made world-facing camera (OV8835) work, which the driver is from the old Android kernel tree. Unfortunately, the user-facing camera (AR0330) is not working yet; the output is completely black. I'm not sure why, maybe the sensor power issue (atomisp_gmin_platform) or sensor driver issue, which the driver is from non-atomisp driver.

[1] https://github.com/kitakar5525/linux-kernel/commits/mainline+upst_atomisp

## for mipad2 (and whiskey cove pmic based devices)

Quoted 7 lines

For devices which equip whiskey cove PMIC, you need to add non-upstream regulator driver [1].

[1] work done by jekhor, which seems to be from intel-aero or old Android kernel
https://github.com/jekhor/yogabook-linux-kernel/commit/11c05b365fb2eeb4fced5aa66b362c511be32a34
("intel_soc_pmic_chtwc: Add regulator driver and definition for VPROG1B")

Interesting I recently bought a 2nd hand mipad2 myself too. I still need to put Linux on there. I'm definitely motivated to do that now :)

Regards,

Hans

#66 lore raw
Quoted 1 line · Hans de Goede

<Added some more people to the Cc who are also definitely interested in this>

[removed Alan from Cc as not reachable]

As I also mentioned on another thread, sorry, I failed to add people to Cc who I should have definitly added...

And I might have sent all of the emails to people who I should not by blindly using scripts/get_maintainer.pl for the first patch with --cc-cmd...

Sorry if that's the case for some of you...

Quoted 12 lines

Hi Tsuchiya,

Quoted 8 lines · Tsuchiya Yuto

Hi all,

This patch series contains fixes for atomisp to work (again). Tested on Microsoft Surface 3 (Windows) and Xiaomi Mi Pad 2 (Android model) with v5.15-rc5. Both are Cherry Trail (ISP2401) devices.

I'm still not used to Linux patch sending flow. Sorry in advance if there is some weirdness :-) but I did my best.

Quoted 7 lines

You actually did pretty good AFAICT.

Also thank you so much for working on this. Finally getting working atomisp2 support is awesome!

I actually have been working on and off on this myself (even did a bit of work on it this weekend).

Thanks! and I'm glad you're also interested in this!

Quoted 8 lines

1. Find android (5.1) x86 kernel sources which I can build from source and get a working Android (on a device with Android pre-installed) with a kernel build from source -> Done

2. Get a regular Linux distro to boot with the kernel from 1. -> Done (normal Linux v4l2 utils do not give a picture, might be the need to set preview mode)

Quoted 7 lines

3. Add ioctl debugging to the kernel from 1. capture a trace to see what Android userspace is doing -> Done . See here for an example log:

https://fedorapeople.org/~jwrdegoede/atomisp-logs-t116/

4. Write a userspace utility mimicking Android userspace, I started on this this weekend

What I did is rather, as soon as I set up chroot environment on Android kernel (mipad2), I gave up writing userspace tools by myself and searched for an existing ones :D

Quoted 10 lines

5. Once I've 4. working the plan was a bit vague, the idea was to see if I could use that to quickly get the mainline staging version to work; or alternatively forward port the working Android kernel sources to mainline from scratch.

But it looks like 4 and 5 will no longer be necessary, which is awesome, thank you so much!

I'll try to look into this series in more detail; and try to get thing working on one of my own devices when I can make some time for this.

Thanks. It's great if this series is tested by many upstream devs.

Quoted 16 lines
Quoted 4 lines

[...]

Quoted 8 lines

One of the issues on the upstreamed atomisp is, the driver is a result of the following two different versions of driver merged by tools using ifdef ISP2401:

- ISP2400: irci_stable_candrpv_0415_20150521_0458
- ISP2401: irci_master_20150911_0724

and we don't have such firmware made for irci_master_20150911_0724.

Right this is something which I also noticed (but I did not do anything with / about yet)

Quoted 6 lines
Quoted 2 lines

I confirmed that the driver version irci_stable_candrpv_0415_20150521_0458 works well on the intel-aero version atomisp for ISP2401, too.

"irci_stable_candrpv_0415_20150521_0458" is also the version of the atomisp firmware shipped in CHT tablets which come with Android pre-installed. So I agree that this is the version which we should go for.

OK.

Quoted 7 lines
Quoted 7 lines

[...]

## for mipad2 (and whiskey cove pmic based devices)

For devices which equip whiskey cove PMIC, you need to add non-upstream regulator driver [1].

Quoted 7 lines
Quoted 4 lines

[1] work done by jekhor, which seems to be from intel-aero or old Android kernel
https://github.com/jekhor/yogabook-linux-kernel/commit/11c05b365fb2eeb4fced5aa66b362c511be32a34
("intel_soc_pmic_chtwc: Add regulator driver and definition for VPROG1B")

Interesting I recently bought a 2nd hand mipad2 myself too. I still need to put Linux on there. I'm definitely motivated to do that now :)

I'm glad to hear that you also got a mipad2 :) It might be a interesting device to look into. It even won't boot without nomodeset, no battery charging/status on mainline kernel.

By the way, instead of adding whiskey cove regulator driver, we may also add a "hack" like the other PMIC in atomisp_gmin_platform to control regulators [1].

It seems that to do so, it needs to "read" value from the PMIC before writing. So, I'm not sure if this can be achieved easily with the current mainline kernel though.

[1] https://github.com/MiCode/Xiaomi_Kernel_OpenSource/commit/6204d4b7aeefc4db622f8ac57b87bf2c76c6c8aa
("atomisp_platform: add whiskey cove pmic support")

Regards,
Tsuchiya Yuto

#67 lore raw
Quoted 2 lines · Tsuchiya Yuto
Quoted 1 line · Hans de Goede

On 10/17/21 18:19, Tsuchiya Yuto wrote:

...

Quoted 13 lines
Quoted 5 lines
Quoted 5 lines

## for mipad2 (and whiskey cove pmic based devices)

For devices which equip whiskey cove PMIC, you need to add non-upstream regulator driver [1].

Quoted 7 lines
Quoted 4 lines

[1] work done by jekhor, which seems to be from intel-aero or old Android kernel
https://github.com/jekhor/yogabook-linux-kernel/commit/11c05b365fb2eeb4fced5aa66b362c511be32a34
("intel_soc_pmic_chtwc: Add regulator driver and definition for VPROG1B")

Interesting I recently bought a 2nd hand mipad2 myself too. I still need to put Linux on there. I'm definitely motivated to do that now :)

Quoted 7 lines

I'm glad to hear that you also got a mipad2 :) It might be a interesting device to look into. It even won't boot without nomodeset, no battery charging/status on mainline kernel.

By the way, instead of adding whiskey cove regulator driver, we may also add a "hack" like the other PMIC in atomisp_gmin_platform to control regulators [1].

I looked briefly into the code and if we indeed need to turn off or on the regulators it should be a driver.

I don't like having hacks outside of driver/staging to satisfy the one from the staging.

I.o.w. having a regulator driver is a right thing to do in my opinion.

Quoted 6 lines

It seems that to do so, it needs to "read" value from the PMIC before writing. So, I'm not sure if this can be achieved easily with the current mainline kernel though.

[1] https://github.com/MiCode/Xiaomi_Kernel_OpenSource/commit/6204d4b7aeefc4db622f8ac57b87bf2c76c6c8aa
("atomisp_platform: add whiskey cove pmic support")

Signature · 2 lines
With Best Regards,
Andy Shevchenko
#68 lore raw
Quoted 27 lines · Andy Shevchenko
Quoted 2 lines · Tsuchiya Yuto
Quoted 1 line · Hans de Goede

On 10/17/21 18:19, Tsuchiya Yuto wrote:

...

Quoted 13 lines
Quoted 5 lines
Quoted 5 lines

## for mipad2 (and whiskey cove pmic based devices)

For devices which equip whiskey cove PMIC, you need to add non-upstream regulator driver [1].

Quoted 7 lines
Quoted 4 lines

[1] work done by jekhor, which seems to be from intel-aero or old Android kernel
https://github.com/jekhor/yogabook-linux-kernel/commit/11c05b365fb2eeb4fced5aa66b362c511be32a34
("intel_soc_pmic_chtwc: Add regulator driver and definition for VPROG1B")

Interesting I recently bought a 2nd hand mipad2 myself too. I still need to put Linux on there. I'm definitely motivated to do that now :)

Quoted 7 lines

I'm glad to hear that you also got a mipad2 :) It might be a interesting device to look into. It even won't boot without nomodeset, no battery charging/status on mainline kernel.

By the way, instead of adding whiskey cove regulator driver, we may also add a "hack" like the other PMIC in atomisp_gmin_platform to control regulators [1].

Quoted 5 lines

I looked briefly into the code and if we indeed need to turn off or on the regulators it should be a driver.

I don't like having hacks outside of driver/staging to satisfy the one from the staging.

Yeah, if "reading" from the PMIC can't be achieved with the current mainline kernel, it does not make sense to add code for "reading" just for the hack inside atomisp. Rather, in this case, adding the regulator driver is a straightforward way.

We can already write with intel_soc_pmic_exec_mipi_pmic_seq_element(), so what I wondered is, is there equivalent for "read"?

But yes, we should eventually use regulator driver anyway.

Regards,
Tsuchiya Yuto

Quoted 9 lines

I.o.w. having a regulator driver is a right thing to do in my opinion.

Quoted 6 lines

It seems that to do so, it needs to "read" value from the PMIC before writing. So, I'm not sure if this can be achieved easily with the current mainline kernel though.

[1] https://github.com/MiCode/Xiaomi_Kernel_OpenSource/commit/6204d4b7aeefc4db622f8ac57b87bf2c76c6c8aa
("atomisp_platform: add whiskey cove pmic support")

#69 lore raw
In reply to Tsuchiya Yuto
Quoted 9 lines · Tsuchiya Yuto

Hi all,

This patch series contains fixes for atomisp to work (again). Tested on Microsoft Surface 3 (Windows) and Xiaomi Mi Pad 2 (Android model) with v5.15-rc5. Both are Cherry Trail (ISP2401) devices.

I'm still not used to Linux patch sending flow. Sorry in advance if there is some weirdness :-) but I did my best.

I agree with Hans, you did an excellent job!
I will try to find time to look into this. In any case it seems to me that this is a material more likely for v5.17-rc1, rather than v5.16.

Signature · 2 lines
With Best Regards,
Andy Shevchenko
#70 lore raw

Em Mon, 18 Oct 2021 10:56:40 +0300
Andy Shevchenko <[email protected]> escreveu:

Quoted 8 lines · Tsuchiya Yuto
Quoted 7 lines

Hi all,

This patch series contains fixes for atomisp to work (again). Tested on Microsoft Surface 3 (Windows) and Xiaomi Mi Pad 2 (Android model) with v5.15-rc5. Both are Cherry Trail (ISP2401) devices.

Quoted 6 lines
Quoted 2 lines

I'm still not used to Linux patch sending flow. Sorry in advance if there is some weirdness :-) but I did my best.

I agree with Hans, you did an excellent job!
I will try to find time to look into this. In any case it seems to me that this is a material more likely for v5.17-rc1, rather than v5.16.

Yeah, it sounds to late to apply it for 5.16.

Regards,
Mauro

#71 lore raw
Quoted 16 lines · Mauro Carvalho Chehab

Em Mon, 18 Oct 2021 10:56:40 +0300
Andy Shevchenko <[email protected]> escreveu:

Quoted 13 lines · Tsuchiya Yuto
Quoted 9 lines

Hi all,

This patch series contains fixes for atomisp to work (again). Tested on Microsoft Surface 3 (Windows) and Xiaomi Mi Pad 2 (Android model) with v5.15-rc5. Both are Cherry Trail (ISP2401) devices.

I'm still not used to Linux patch sending flow. Sorry in advance if there is some weirdness :-) but I did my best.

I agree with Hans, you did an excellent job!
I will try to find time to look into this.

Thank you :)

Quoted 4 lines
Quoted 2 lines

In any case it seems to me
that this is a material more likely for v5.17-rc1, rather than v5.16.

Yeah, it sounds to late to apply it for 5.16.

I see, but no problem. This series does not contain any fixes for critical issues (like NULL ptr deref)

Regards,
Tsuchiya Yuto

#72 lore raw
In reply to Tsuchiya Yuto

On Mon, Oct 18, 2021 at 01:19:40AM +0900, Tsuchiya Yuto wrote:

Just a remark, your To is not filled. At some point I had written a script [1] to help me with patch series sending, It also tries to be smart to include necessary people and mailing lists (you can always alter it by adding more). [1]: https://github.com/andy-shev/home-bin-tools/blob/master/ge2maintainer.sh

Signature · 2 lines
With Best Regards,
Andy Shevchenko
#73 lore raw
Quoted 6 lines · Andy Shevchenko

On Mon, Oct 18, 2021 at 01:19:40AM +0900, Tsuchiya Yuto wrote:

Just a remark, your To is not filled. At some point I had written a script [1] to help me with patch series sending, It also tries to be smart to include necessary people and mailing lists (you can always alter it by adding more). [1]: https://github.com/andy-shev/home-bin-tools/blob/master/ge2maintainer.sh

Ah thanks. I didn't use To but just used --cc-cmd with scripts/get_maintainer.pl without thinking deeply... I'll definitely try your script next time I send patches.

Regards,
Tsuchiya Yuto

#74 lore raw
In reply to Tsuchiya Yuto

<Fixed Cc list>

Quoted 9 lines · Tsuchiya Yuto

[...]
## taking a picture with atomisp

Note that to try to take a picture, please also apply at least the this RFC patch ("[BUG][RFC] media: atomisp: pci: assume run_mode is PREVIEW") I'll send as almost a BUG report later.

You need to use firmware version irci_stable_candrpv_0415_20150521_0458, which is available from the intel-aero [1]

Just in case, the hash (as well as version) of firmware which I downloaded from intel-aero and I use to capture is the following:

        $ sha256sum /lib/firmware/shisp_2401a0_v21.bin
        e89359f4e4934c410c83d525e283f34c5fcce9cb5caa75ad8a32d66d3842d95c  /lib/firmware/shisp_2401a0_v21.bin
        $ strings /lib/firmware/shisp_2401a0_v21.bin | grep 2015
        irci_stable_candrpv_0415_20150521_0458

Regards,
Tsuchiya Yuto

Quoted 41 lines

The atomisp (ipu2), like the ipu3, needs userspace support. The libcamera has now decent ipu3 support but does not have atomisp support yet.

I found some userspace tools for atomisp that run on Linux:

- capturev4l2 from intel-aero/sample-apps
(https://github.com/intel-aero/sample-apps/tree/master/capturev4l2)
- hd-camera from intel-aero/sample-apps
(https://github.com/intel-aero/sample-apps/tree/master/hd-camera)
- intel/nvt

    (https://github.com/intel/nvt)

It looks like the nvt is the most feature-rich, like exposure and white balance. Note that current upstreamed atomisp dropped 32-bit support. So, you need to build it with -m64 (change it in Makefile). Here is the example of usage I use on mipad2:

        $ ./v4l2n -o [email protected] \
                --device /dev/video2 \
                --input 0 \
                --exposure=30000,30000,30000,30000 \
                --parm type=1,capturemode=CI_MODE_PREVIEW \
                --fmt type=1,width=1920,height=1080,pixelformat=NV12 \
                --reqbufs count=2,memory=USERPTR \
                --parameters=wb_config.r=32768,wb_config.gr=21043,wb_config.gb=21043,wb_config.b=30863 \
                --capture=2 \

./raw2pnm -x1920 -y1080 -fNV12 testimage_001.raw testimage_001.pnm feh *.pnm # open the converted image
rm testimage*

Note that I see the following warn/err after capture:

        kern  :warn  : [72660.793335] atomisp-isp2 0000:00:03.0: stop stream timeout.
        kern  :err   : [72660.973629] atomisp-isp2 0000:00:03.0: atomisp_reset

but I see the same message on the Android kernel, too. So, I think this is not a real issue (I hope).

[1] https://github.com/intel-aero/meta-intel-aero-base/tree/master/recipes-kernel/linux/linux-yocto

    filename shisp_2401a0_v21.bin
#75 lore raw

Em Thu, 28 Oct 2021 13:32:29 +0900
Tsuchiya Yuto <[email protected]> escreveu:

Quoted 16 lines

<Fixed Cc list>

Quoted 9 lines · Tsuchiya Yuto

[...]
## taking a picture with atomisp

Note that to try to take a picture, please also apply at least the this RFC patch ("[BUG][RFC] media: atomisp: pci: assume run_mode is PREVIEW") I'll send as almost a BUG report later.

You need to use firmware version irci_stable_candrpv_0415_20150521_0458, which is available from the intel-aero [1]

Just in case, the hash (as well as version) of firmware which I downloaded from intel-aero and I use to capture is the following:

Quoted 39 lines
        $ sha256sum /lib/firmware/shisp_2401a0_v21.bin
        e89359f4e4934c410c83d525e283f34c5fcce9cb5caa75ad8a32d66d3842d95c  /lib/firmware/shisp_2401a0_v21.bin
        $ strings /lib/firmware/shisp_2401a0_v21.bin | grep 2015
        irci_stable_candrpv_0415_20150521_0458

Regards,
Tsuchiya Yuto

Quoted 30 lines

The atomisp (ipu2), like the ipu3, needs userspace support. The libcamera has now decent ipu3 support but does not have atomisp support yet.

I found some userspace tools for atomisp that run on Linux:

- capturev4l2 from intel-aero/sample-apps
(https://github.com/intel-aero/sample-apps/tree/master/capturev4l2)
- hd-camera from intel-aero/sample-apps
(https://github.com/intel-aero/sample-apps/tree/master/hd-camera)
- intel/nvt

    (https://github.com/intel/nvt)

It looks like the nvt is the most feature-rich, like exposure and white balance. Note that current upstreamed atomisp dropped 32-bit support. So, you need to build it with -m64 (change it in Makefile). Here is the example of usage I use on mipad2:

        $ ./v4l2n -o [email protected] \
                --device /dev/video2 \
                --input 0 \
                --exposure=30000,30000,30000,30000 \
                --parm type=1,capturemode=CI_MODE_PREVIEW \
                --fmt type=1,width=1920,height=1080,pixelformat=NV12 \
                --reqbufs count=2,memory=USERPTR \
                --parameters=wb_config.r=32768,wb_config.gr=21043,wb_config.gb=21043,wb_config.b=30863 \
                --capture=2 \

./raw2pnm -x1920 -y1080 -fNV12 testimage_001.raw testimage_001.pnm feh *.pnm # open the converted image
rm testimage*

Great! that worked for me too on Asus T101HA (CHT). I had to tweak the resolution, as ov2680 sensor has a max of 1616x1216 30fps. I had to use a number smaller than that, though (1600x1200).

I guess the next step is to make a generic app to also work on it.

Quoted 8 lines
Quoted 8 lines

Note that I see the following warn/err after capture:

        kern  :warn  : [72660.793335] atomisp-isp2 0000:00:03.0: stop stream timeout.
        kern  :err   : [72660.973629] atomisp-isp2 0000:00:03.0: atomisp_reset

but I see the same message on the Android kernel, too. So, I think this is not a real issue (I hope).

Same here.

Quoted 5 lines
Quoted 3 lines

[1] https://github.com/intel-aero/meta-intel-aero-base/tree/master/recipes-kernel/linux/linux-yocto

    filename shisp_2401a0_v21.bin  
#76 lore raw
Quoted 24 lines · Mauro Carvalho Chehab

Em Thu, 28 Oct 2021 13:32:29 +0900
Tsuchiya Yuto <[email protected]> escreveu:

Quoted 21 lines

<Fixed Cc list>

Quoted 9 lines · Tsuchiya Yuto

[...]
## taking a picture with atomisp

Note that to try to take a picture, please also apply at least the this RFC patch ("[BUG][RFC] media: atomisp: pci: assume run_mode is PREVIEW") I'll send as almost a BUG report later.

You need to use firmware version irci_stable_candrpv_0415_20150521_0458, which is available from the intel-aero [1]

Just in case, the hash (as well as version) of firmware which I downloaded from intel-aero and I use to capture is the following:

        $ sha256sum /lib/firmware/shisp_2401a0_v21.bin
        e89359f4e4934c410c83d525e283f34c5fcce9cb5caa75ad8a32d66d3842d95c  /lib/firmware/shisp_2401a0_v21.bin
        $ strings /lib/firmware/shisp_2401a0_v21.bin | grep 2015
        irci_stable_candrpv_0415_20150521_0458

Also note that the firmware file from the intel-aero only supports hw_revision 2401a0_v21 as the filename implies. So, if someone have Bay Trail (ISP2400) device to test, you need to get a firmware file (from somewhere like Android installation/image as the initial commit of atomisp mentions) made for version irci_stable_candrpv_0415_20150521_0458 and hw_revision 2400b0_v21 then place it under /lib/firmware

Quoted 27 lines
Quoted 27 lines
Quoted 27 lines

The atomisp (ipu2), like the ipu3, needs userspace support. The libcamera has now decent ipu3 support but does not have atomisp support yet.

I found some userspace tools for atomisp that run on Linux:

- capturev4l2 from intel-aero/sample-apps
(https://github.com/intel-aero/sample-apps/tree/master/capturev4l2)
- hd-camera from intel-aero/sample-apps
(https://github.com/intel-aero/sample-apps/tree/master/hd-camera)
- intel/nvt

    (https://github.com/intel/nvt)

It looks like the nvt is the most feature-rich, like exposure and white balance. Note that current upstreamed atomisp dropped 32-bit support. So, you need to build it with -m64 (change it in Makefile). Here is the example of usage I use on mipad2:

        $ ./v4l2n -o [email protected] \
                --device /dev/video2 \
                --input 0 \
                --exposure=30000,30000,30000,30000 \
                --parm type=1,capturemode=CI_MODE_PREVIEW \
                --fmt type=1,width=1920,height=1080,pixelformat=NV12 \
                --reqbufs count=2,memory=USERPTR \
                --parameters=wb_config.r=32768,wb_config.gr=21043,wb_config.gb=21043,wb_config.b=30863 \
                --capture=2 \
Quoted 7 lines
Quoted 3 lines
Quoted 3 lines

./raw2pnm -x1920 -y1080 -fNV12 testimage_001.raw testimage_001.pnm feh *.pnm # open the converted image
rm testimage*

Great! that worked for me too on Asus T101HA (CHT). I had to tweak the resolution, as ov2680 sensor has a max of 1616x1216 30fps. I had to use a number smaller than that, though (1600x1200).

Ah, glad to hear that!

Quoted 1 line

I guess the next step is to make a generic app to also work on it.

It's great if we can eventually add atomisp support to the libcamera. I think this is the easiest way to support generic apps (I mean, like cheese). Some ipu3 cameras already work on cheese with libcamera. I don't have any knowledge about userspace support though.

Quoted 16 lines
Quoted 8 lines
Quoted 8 lines

Note that I see the following warn/err after capture:

        kern  :warn  : [72660.793335] atomisp-isp2 0000:00:03.0: stop stream timeout.
        kern  :err   : [72660.973629] atomisp-isp2 0000:00:03.0: atomisp_reset

but I see the same message on the Android kernel, too. So, I think this is not a real issue (I hope).

Same here.

Quoted 5 lines
Quoted 3 lines

[1] https://github.com/intel-aero/meta-intel-aero-base/tree/master/recipes-kernel/linux/linux-yocto

    filename shisp_2401a0_v21.bin  
#77 lore raw

Em Sat, 30 Oct 2021 18:50:14 +0900
Tsuchiya Yuto <[email protected]> escreveu:

Quoted 26 lines · Mauro Carvalho Chehab
Quoted 24 lines

Em Thu, 28 Oct 2021 13:32:29 +0900
Tsuchiya Yuto <[email protected]> escreveu:

Quoted 21 lines

<Fixed Cc list>

Quoted 9 lines · Tsuchiya Yuto

[...]
## taking a picture with atomisp

Note that to try to take a picture, please also apply at least the this RFC patch ("[BUG][RFC] media: atomisp: pci: assume run_mode is PREVIEW") I'll send as almost a BUG report later.

You need to use firmware version irci_stable_candrpv_0415_20150521_0458, which is available from the intel-aero [1]

Just in case, the hash (as well as version) of firmware which I downloaded from intel-aero and I use to capture is the following:

        $ sha256sum /lib/firmware/shisp_2401a0_v21.bin
        e89359f4e4934c410c83d525e283f34c5fcce9cb5caa75ad8a32d66d3842d95c  /lib/firmware/shisp_2401a0_v21.bin
        $ strings /lib/firmware/shisp_2401a0_v21.bin | grep 2015
        irci_stable_candrpv_0415_20150521_0458  
Quoted 6 lines

Also note that the firmware file from the intel-aero only supports hw_revision 2401a0_v21 as the filename implies. So, if someone have Bay Trail (ISP2400) device to test, you need to get a firmware file (from somewhere like Android installation/image as the initial commit of atomisp mentions) made for version irci_stable_candrpv_0415_20150521_0458 and hw_revision 2400b0_v21 then place it under /lib/firmware

Yeah, understood.

Quoted 35 lines
Quoted 27 lines
Quoted 27 lines
Quoted 27 lines

The atomisp (ipu2), like the ipu3, needs userspace support. The libcamera has now decent ipu3 support but does not have atomisp support yet.

I found some userspace tools for atomisp that run on Linux:

- capturev4l2 from intel-aero/sample-apps
(https://github.com/intel-aero/sample-apps/tree/master/capturev4l2)
- hd-camera from intel-aero/sample-apps
(https://github.com/intel-aero/sample-apps/tree/master/hd-camera)
- intel/nvt

    (https://github.com/intel/nvt)

It looks like the nvt is the most feature-rich, like exposure and white balance. Note that current upstreamed atomisp dropped 32-bit support. So, you need to build it with -m64 (change it in Makefile). Here is the example of usage I use on mipad2:

        $ ./v4l2n -o [email protected] \
                --device /dev/video2 \
                --input 0 \
                --exposure=30000,30000,30000,30000 \
                --parm type=1,capturemode=CI_MODE_PREVIEW \
                --fmt type=1,width=1920,height=1080,pixelformat=NV12 \
                --reqbufs count=2,memory=USERPTR \
                --parameters=wb_config.r=32768,wb_config.gr=21043,wb_config.gb=21043,wb_config.b=30863 \
                --capture=2 \
Quoted 7 lines
Quoted 3 lines
Quoted 3 lines

./raw2pnm -x1920 -y1080 -fNV12 testimage_001.raw testimage_001.pnm feh *.pnm # open the converted image
rm testimage*

Great! that worked for me too on Asus T101HA (CHT). I had to tweak the resolution, as ov2680 sensor has a max of 1616x1216 30fps. I had to use a number smaller than that, though (1600x1200).

Quoted 8 lines

Ah, glad to hear that!

Quoted 1 line

I guess the next step is to make a generic app to also work on it.

It's great if we can eventually add atomisp support to the libcamera. I think this is the easiest way to support generic apps (I mean, like cheese). Some ipu3 cameras already work on cheese with libcamera. I don't have any knowledge about userspace support though.

There are a lot more to be done in order to make it ready for libcamera (if ever).

See, libcamera assumes that the device exports its internal pipelines via the media controller. The atomisp code setups such pipelines internally, exposing a "normal" [1] V4L2 interface.

[1] Well, it misses several V4L2 ioctl implementations that currently causes generic applications to fail, and mis-implement others, but the idea behind the driver is to fully control the driver via /dev/video? nodes, without requiring the media controller API.

Converting atomisp into a media-controller driver will require a major rework. I suspect that it is a lot easier to make it work with normal V4L2 applications by fixing the ioctl implementation than to port it to MC.

Yet, in order to be able to move it from staging, we'll need to convert it into an MC-controlled driver.

What I'm saying is that, IMHO, we should:

1. Fix the ioctls in order to allow a normal app to use it. I'm already doing some work on this sense. We should ensure that the driver will pass v4l2-compliance tests on this step;

2. remove VIDEO_ATOMISP_ISP2401, making the driver to auto-detect the register address differences between ISP2400 and ISP2401;

3. Cleanup the driver code, removing the abstraction layers inside it;

4. Migrate the sensor drivers out of staging (or re-using existing drivers);

5. Remove the logic which sets up pipelines inside it, moving it to libcamera and implement MC support;

6. Move it out of staging.

This is easily said than done, as steps 2-6 are very complex and will require lots of work. Also, both ISP2400 and 2401 should be tested while doing some of those major reworks, in order to avoid breakages.

Btw, v4l2grab app (at v4l-utils) already works. This is a very simple app, written to allow stream testing. It doesn't do anything fancy, like trying to enumerate the formats, and it needs to be set to a resolution lower than the one announced by the sensor, probably due to some bug at the COPY pipeline settings at atomisp driver.

qv4l2, for instance, causes a driver OOPS when it calls G/S_PRIORITY ioctls.

Regards,
Mauro

#78 lore raw
Quoted 2 lines · Mauro Carvalho Chehab

Em Sat, 30 Oct 2021 18:50:14 +0900
Tsuchiya Yuto <[email protected]> escreveu:

...

Quoted 14 lines

What I'm saying is that, IMHO, we should:

1. Fix the ioctls in order to allow a normal app to use it. I'm already doing some work on this sense. We should ensure that the driver will pass v4l2-compliance tests on this step;

2. remove VIDEO_ATOMISP_ISP2401, making the driver to auto-detect the register address differences between ISP2400 and ISP2401;

3. Cleanup the driver code, removing the abstraction layers inside it;

4. Migrate the sensor drivers out of staging (or re-using existing drivers);

Quoted 8 lines

5. Remove the logic which sets up pipelines inside it, moving it to libcamera and implement MC support;

6. Move it out of staging.

This is easily said than done, as steps 2-6 are very complex and will require lots of work. Also, both ISP2400 and 2401 should be tested while doing some of those major reworks, in order to avoid breakages.

This is a great roadmap nevertheless!
However, we missed one important step here, i.e. persuade Intel to clarify license of the firmware (for distirbution) and make sure we have it in Linux firmware project, so it won't get lost.

Quoted 8 lines

Btw, v4l2grab app (at v4l-utils) already works. This is a very simple app, written to allow stream testing. It doesn't do anything fancy, like trying to enumerate the formats, and it needs to be set to a resolution lower than the one announced by the sensor, probably due to some bug at the COPY pipeline settings at atomisp driver.

qv4l2, for instance, causes a driver OOPS when it calls G/S_PRIORITY ioctls.

Signature · 2 lines
With Best Regards,
Andy Shevchenko
#79 lore raw

Em Sat, 30 Oct 2021 14:01:01 +0300
Andy Shevchenko <[email protected]> escreveu:

Quoted 30 lines
Quoted 2 lines · Mauro Carvalho Chehab

Em Sat, 30 Oct 2021 18:50:14 +0900
Tsuchiya Yuto <[email protected]> escreveu:

...

Quoted 14 lines

What I'm saying is that, IMHO, we should:

1. Fix the ioctls in order to allow a normal app to use it. I'm already doing some work on this sense. We should ensure that the driver will pass v4l2-compliance tests on this step;

2. remove VIDEO_ATOMISP_ISP2401, making the driver to auto-detect the register address differences between ISP2400 and ISP2401;

3. Cleanup the driver code, removing the abstraction layers inside it;

4. Migrate the sensor drivers out of staging (or re-using existing drivers);

Quoted 8 lines

5. Remove the logic which sets up pipelines inside it, moving it to libcamera and implement MC support;

6. Move it out of staging.

This is easily said than done, as steps 2-6 are very complex and will require lots of work. Also, both ISP2400 and 2401 should be tested while doing some of those major reworks, in order to avoid breakages.

Quoted 5 lines

This is a great roadmap nevertheless!

However, we missed one important step here, i.e. persuade Intel to clarify license of the firmware (for distirbution) and make sure we have it in Linux firmware project, so it won't get lost.

Heh, true!

I suspect that the firmare for ISP2401, used on Intel Aero, is probably easier to make it available than the firmware for ISP2400.

At least looking at the github repository for Intel Aero, it says at the package metadata that its content is under GPL:

https://github.com/intel-aero/meta-intel-aero-base/blob/master/LICENSE

The firmware itself is there, at:

https://github.com/intel-aero/meta-intel-aero-base/blob/master/recipes-kernel/linux/linux-yocto/shisp_2401a0_v21.bin

The Yocto's meta package for the firmware blob is at:

https://github.com/intel-aero/packages/tree/master/firmware-atomisp

Also says, on its copyright's notice:

https://github.com/intel-aero/packages/blob/master/firmware-atomisp/debian/copyright

that:

Source: https://github.com/intel-aero/meta-intel-aero-base

Files: *
Copyright: 2016 Intel Corporation
License: GPL-2
/usr/share/common-licenses/GPL-2

Granted, it doesn't make sense to say that a firmware blob is under GPL. My reading is that the original intend was to allow GPL software to use/distribute such firmware, but yeah, someone at Intel should provide the community an explicit authorization to allow distros to start packaging such firmware.

Regards,
Mauro

#80 lore raw
In reply to Tsuchiya Yuto

Em Mon, 18 Oct 2021 01:19:40 +0900
Tsuchiya Yuto <[email protected]> escreveu:

Quoted 6 lines

Hi all,

This patch series contains fixes for atomisp to work (again). Tested on Microsoft Surface 3 (Windows) and Xiaomi Mi Pad 2 (Android model) with v5.15-rc5. Both are Cherry Trail (ISP2401) devices.

After testing this series, I'm opting to merge most patches at the media stage tree:

https://git.linuxtv.org/media_stage.git/log/

That would allow more people to test the changes.

It is probably too late to merge it for 5.16, so I'll likely postpone merging it at media_tree to happen after 5.16-rc1.

Regards,
Mauro

---

I tested it on an Asus T101HA with:
https://github.com/intel/nvt

compiled with -m64, and with the enclosed script:

#!/bin/bash
set -e

FRAMES=10

FORMAT=NV12
WIDTH=1600
HEIGHT=1200

#FORMAT=NV12
#WIDTH=1920
#HEIGHT=1080

./v4l2n -o [email protected] \
                 --device /dev/video2 \
                 --input 0 \
                 --exposure=30000,30000,30000,30000 \
                 --parm type=1,capturemode=CI_MODE_PREVIEW \
                 --fmt type=1,width=$WIDTH,height=$HEIGHT,pixelformat=$FORMAT \
                 --reqbufs count=2,memory=USERPTR \
                 --parameters=wb_config.r=32768,wb_config.gr=21043,wb_config.gb=21043,wb_config.b=30863 \
                 --capture=$FRAMES

for i in $(seq 0 $(($FRAMES - 1))); do

	name="testimage_$(printf "%03i" $i)"

	./raw2pnm -x$WIDTH -y$HEIGHT -f$FORMAT $name.raw $name.pnm

	rm $name.raw

done