vivid-tpg.c: fix wrong Bt.2020 coefficients

PATCH New Hans Verkuil 1 participant 1 message Mar 20, 2015 Media (V4L/DVB)

Share & tools

Hans Verkuil

author

2015-03-20 16:23 UTC #0 lore raw

PATCH 1/1 vivid-tpg.c: fix wrong Bt.2020 coefficients

Mistyping 0.2627 as 0.2726 I can understand, but -0.4598 as -0.4629? No idea how I managed that. Anyway, these coefficients are now correct again.

Signed-off-by Hans Verkuil <[email protected]>

drivers/media/platform/vivid/vivid-tpg.c +2 -2

index 34493f4..1ab5ddb 100644
@@ -347,9 +347,9 @@ static void color_to_ycbcr(struct tpg_data *tpg, int r, int g, int b,
 		{ COEFF(0.5, 224),    COEFF(-0.445, 224), COEFF(-0.055, 224) },
 	};
 	static const int bt2020[3][3] = {
-		{ COEFF(0.2726, 219),  COEFF(0.6780, 219),  COEFF(0.0593, 219)  },
+		{ COEFF(0.2627, 219),  COEFF(0.6780, 219),  COEFF(0.0593, 219)  },
 		{ COEFF(-0.1396, 224), COEFF(-0.3604, 224), COEFF(0.5, 224)     },
-		{ COEFF(0.5, 224),     COEFF(-0.4629, 224), COEFF(-0.0405, 224) },
+		{ COEFF(0.5, 224),     COEFF(-0.4598, 224), COEFF(-0.0402, 224) },
 	};
 	bool full = tpg->real_quantization == V4L2_QUANTIZATION_FULL_RANGE;
 	unsigned y_offset = full ? 0 : 16;