Skip to contentSkip to conversation

libv4l, yuv420 and gspca-stv06xx conversion

DISCUSSION Erik Andrén 2 participants 3 messages Mar 23, 2009 – Mar 27, 2009 Media (V4L/DVB)

lore
Share & tools
lore
#0 lore raw

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Hi Hans,
I'm trying to get gstreamer and the yuv420 format conversion in libv4l to play nice with the gspca-stv06xx driver. Currently this is not working.

The resolution of the vv6410 sensor is 356*292 pixels and the native format of the camera is V4L2_PIX_FMT_SGRBG8.
This produces a total image size of 103952 bytes which gets page aligned to 106496.

When requesting to conversion to yuv420 in gstreamer I launch gst-launch with the following parameters:
gst-launch-0.10 -v v4l2src queue-size=4 ! ffmpegcolorspace ! xvimageink

gstreamer then proceeds with complaining that it received a frame of
size 155928 bytes but it expected a frame of size 156512 bytes.

The delivered 155928 size seems sane as 155928 / 356 gives 438 and 155928 / 292 gives 534.

Furthermore, the difference between the received size and the expected size is 584 bytes which is 2x the height.

Anyhow, I hacked libv4l2.c and padded the frame with 584 in order to acheive the requested 156512 bytes. This worked and yielded the attached image.

I'm currently at loss what's the root cause of this.

Could the page align interfer somehow with the frame size? What's the correct image size? The converted image is clearly correct.

Hans,
do you have any ideas on how to further debug this issue?

RGB images work as intended although they need to be whitebalanced.

Thanks,
Erik
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (GNU/Linux)

iEYEARECAAYFAknH5aEACgkQN7qBt+4UG0EQGgCcDdOEhW9Wz/TvU6kGtF3iRJDK ID0An1V+bxCX5zKzBQ1n5L7q1j2dg0Dp
=EegQ
-----END PGP SIGNATURE-----

#1 lore raw
Quoted 26 lines · Erik Andrén

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Hi Hans,
I'm trying to get gstreamer and the yuv420 format conversion in libv4l to play nice with the gspca-stv06xx driver. Currently this is not working.

The resolution of the vv6410 sensor is 356*292 pixels and the native format of the camera is V4L2_PIX_FMT_SGRBG8.
This produces a total image size of 103952 bytes which gets page aligned to 106496.

When requesting to conversion to yuv420 in gstreamer I launch gst-launch with the following parameters:
gst-launch-0.10 -v v4l2src queue-size=4 ! ffmpegcolorspace ! xvimageink

gstreamer then proceeds with complaining that it received a frame of
size 155928 bytes but it expected a frame of size 156512 bytes.

The delivered 155928 size seems sane as 155928 / 356 gives 438 and 155928 / 292 gives 534.

Furthermore, the difference between the received size and the expected size is 584 bytes which is 2x the height.

Quoted 9 lines

Anyhow, I hacked libv4l2.c and padded the frame with 584 in order to acheive the requested 156512 bytes. This worked and yielded the attached image.

I'm currently at loss what's the root cause of this.

Could the page align interfer somehow with the frame size? What's the correct image size? The converted image is clearly correct.

I think that something in the gstreamer stack expect the U and V planes of the YUV planar data, to have each line start 32 bit word aligned. So they expect us to add 2 bytes of padding after each line of U and V data.

That would give us 2 x (292 / 2) extra bytes for the U and for the V plane, so 2 x (2 x (292 / 2)) = 584 bytes of additional data, and would also explain the color banding in the image you've attached.

Now the question is, is gstreamer right in assuming this padding?

The v4l2 standard is pretty clear on this:
http://www.linuxtv.org/downloads/video4linux/API/V4L2_API/spec/c2030.htm#V4L2-PIX-FORMAT

And then the bytesperline description, clearly says the what gstreamer expects is wrong. But what is normal for other YUV420 planar data producing sources?

Regards,

Hans

#2 lore raw

2009/3/25 Hans de Goede <[email protected]>:

Quoted 44 lines · Erik Andrén
Quoted 27 lines

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Hi Hans,
I'm trying to get gstreamer and the yuv420 format conversion in libv4l to play nice with the gspca-stv06xx driver. Currently this is not working.

The resolution of the vv6410 sensor is 356*292 pixels and the native format of the camera is V4L2_PIX_FMT_SGRBG8.
This produces a total image size of 103952 bytes which gets page aligned to 106496.

When requesting to conversion to yuv420 in gstreamer I launch gst-launch with the following parameters:
gst-launch-0.10 -v v4l2src queue-size=4 ! ffmpegcolorspace ! xvimageink

gstreamer then proceeds with complaining that it received a frame of size 155928 bytes but it expected a frame of size 156512 bytes.

The delivered 155928 size seems sane as 155928 / 356 gives 438 and 155928 / 292 gives 534.

Furthermore, the difference between the received size and the expected size is 584 bytes which is 2x the height.

Quoted 9 lines

Anyhow, I hacked libv4l2.c and padded the frame with 584 in order to acheive the requested 156512 bytes. This worked and yielded the attached image.

I'm currently at loss what's the root cause of this.

Could the page align interfer somehow with the frame size? What's the correct image size? The converted image is clearly correct.

I think that something in the gstreamer stack expect the U and V planes of the YUV planar data, to have each line start 32 bit word aligned. So they expect us to add 2 bytes of padding after each line of U and V data.

Quoted 6 lines

That would give us 2 x (292 / 2) extra bytes for the U and for the V plane, so 2 x (2 x (292 / 2)) = 584 bytes of additional data, and would also explain the color banding in the image you've attached.

Now the question is, is gstreamer right in assuming this padding?

You're right in that gstreamer expects:

        outsize = GST_ROUND_UP_4 (*w) * GST_ROUND_UP_2 (*h);
        outsize += 2 * ((GST_ROUND_UP_8 (*w) / 2) * (GST_ROUND_UP_2 (*h) / 2));

I tried to hack around this by changing the 8 to a 4 which produces the same image as when I added the 584 offset.
My take is that the alignment is also used somewhere else in the gstreamer stack. I'll try to post on their devel list and see if I can get any tips on how to resolve this problem.

Best regards,
Erik

Quoted 11 lines

The v4l2 standard is pretty clear on this:
http://www.linuxtv.org/downloads/video4linux/API/V4L2_API/spec/c2030.htm#V4L2-PIX-FORMAT

And then the bytesperline description, clearly says the what gstreamer expects is wrong.
But what is normal for other YUV420 planar data producing sources?

Regards,

Hans