Add new Corpus recipes to Crystal Forest BSP.

PATCH In review [email protected] 2 participants 8 messages Sep 19, 2012 – Sep 20, 2012

lore

Share & tools

lore

[email protected]

author

2012-09-19 22:46 UTC #0 lore raw

cover Add new Corpus recipes to Crystal Forest BSP.

From: Kishore Bodke <[email protected]>

Hi,

This patch set adds three different types of Corpus files to Crystal Forest BSP, which are basically used to test the Lossless Compression algorithms.

1. calgary-corpus
2. canterbury-corpus
3. silesia-corpus

These have been tested on both Crystal Forest Platforms.

Please pull into meta-intel/master.

Thanks
Kishore.

The following changes since commit c3644c66fad3d9a91259ea382e72304dc6576ca0:

cdv-pvr-driver: fix unpack (2012-09-19 12:24:19 +0100)

are available in the git repository at:

git://git.pokylinux.org/meta-intel-contrib Kishore/CRF-corpus
http://git.pokylinux.org/cgit.cgi/meta-intel-contrib/log/?h=Kishore/CRF-corpus

Kishore Bodke (3):
meta-crystalforest: Add Calgary Corpus recipe.
meta-crystalforest: Add Canterbury Cropus recipe.
meta-crystalforest: Add Silesia Corpus recipe.

 .../calgary-corpus/calgary-corpus.bb               |   27 +++++++++++++
 .../canterbury-corpus/canterbury-corpus.bb         |   40 ++++++++++++++++++++
 .../silesia-corpus/silesia-corpus.bb               |   32 ++++++++++++++++
 3 files changed, 99 insertions(+)
 create mode 100644 meta-crystalforest/recipes-corpus/calgary-corpus/calgary-corpus.bb
 create mode 100644 meta-crystalforest/recipes-corpus/canterbury-corpus/canterbury-corpus.bb
 create mode 100644 meta-crystalforest/recipes-corpus/silesia-corpus/silesia-corpus.bb

Signature · 1 line

1.7.9.5

[email protected]

author

2012-09-19 22:46 UTC #1 lore raw

PATCH 1/3 meta-crystalforest: Add Calgary Corpus recipe.

From: Kishore Bodke <[email protected]>

Add a new recipe Calgary Corpus for Crystal Forest BSP for testing the lossless compression algorithms.

Signed-off-by Kishore Bodke <[email protected]>

---
 .../calgary-corpus/calgary-corpus.bb               |   27 ++++++++++++++++++++
 1 file changed, 27 insertions(+)
 create mode 100644 meta-crystalforest/recipes-corpus/calgary-corpus/calgary-corpus.bb

meta-crystalforest/recipes-corpus/calgary-corpus/calgary-corpus.bb new file +27 -0

new file mode 100644
index 0000000..fbcbda2
@@ -0,0 +1,27 @@
+SUMMARY = "Set of files for testing losless compression algorithms"
+DESCRIPTION = "Set of files for testing losless compression algorithms"
+HOMEPAGE = "http://corpus.canterbury.ac.nz"
+SECTION = "misc"
+LICENSE = "GPLv2"
+LIC_FILES_CHKSUM = "file://${COMMON_LICENSE_DIR}/GPL-2.0;md5=801f80980d171dd6425610833a22dbe6"
+
+S = "${WORKDIR}/corpus"
+
+SRC_URI = "http://corpus.canterbury.ac.nz/resources/calgary.tar.gz"
+
+SRC_URI[md5sum] = "651d06b35d3d39522157cf8dc4a3d01c"
+SRC_URI[sha256sum] = "e109eebdc19c5cee533c58bd6a49a4be3a77cc52f84ba234a089148a4f2093b7"
+
+do_unpack () {
+	
+	mkdir -p ${S}
+	tar -xf ${DL_DIR}/calgary.tar.gz -C ${WORKDIR}/corpus
+}
+
+FILES_${PN} = "/lib/firmware/*" 
+
+do_install () {
+
+	install -d ${D}/lib/firmware
+	install -m 664 ${S}/* ${D}/lib/firmware
+}

Signature · 1 line

1.7.9.5

[email protected]

author

2012-09-19 22:46 UTC #2 lore raw

PATCH 2/3 meta-crystalforest: Add Canterbury Cropus recipe.

From: Kishore Bodke <[email protected]>

Add a new recipe for Crystal Forest BSP for testing the lossless compresstion algorithms with Canterbury Corpus.

Signed-off-by Kishore Bodke <[email protected]>

---
 .../canterbury-corpus/canterbury-corpus.bb         |   40 ++++++++++++++++++++
 1 file changed, 40 insertions(+)
 create mode 100644 meta-crystalforest/recipes-corpus/canterbury-corpus/canterbury-corpus.bb

meta-crystalforest/recipes-corpus/canterbury-corpus/canterbury-corpus.bb new file +40 -0

new file mode 100644
index 0000000..6dfdef2
@@ -0,0 +1,40 @@
+SUMMARY = "Intel Quick Assist Driver - Canterbury Corpus"
+DESCRIPTION = "Set of files for testing losless compression algorithms \
+		for Intel Crystal Forest BSP Quick Assist Technology Software Package"
+
+HOMEPAGE = "http://corpus.canterbury.ac.nz"
+SECTION = "misc"
+LICENSE = "GPLv2"
+
+LIC_FILES_CHKSUM = "file://${COMMON_LICENSE_DIR}/GPL-2.0;md5=801f80980d171dd6425610833a22dbe6"
+
+PR = "r0"
+
+S = "${WORKDIR}/canterbury-corpus"
+
+SRC_URI = "http://corpus.canterbury.ac.nz/resources/cantrbry.tar.gz"
+
+SRC_URI[md5sum] = "442e56cfffdf460d25b0b91650a55908"
+SRC_URI[sha256sum] = "f140e8a5b73d3f53198555a63bfb827889394a42f20825df33c810c3d5e3f8fb"
+
+WARN_QA += "arch"
+
+ERROR_QA = ""
+
+do_package_qa[noexec] = "1"
+
+do_unpack () {
+
+	mkdir -p ${S}
+	tar -xf ${DL_DIR}/cantrbry.tar.gz -C ${S}
+
+}
+
+FILES_${PN} = "/lib/firmware/*"
+
+do_install () {
+
+	install -d ${D}${base_libdir}/firmware
+	install -m 644 ${S}/* ${D}${base_libdir}/firmware
+
+}

Signature · 1 line

1.7.9.5

[email protected]

author

2012-09-19 22:46 UTC #3 lore raw

PATCH 3/3 meta-crystalforest: Add Silesia Corpus recipe.

In reply to [email protected]

From: Kishore Bodke <[email protected]>

Add a new recipe Silesia Corpus for testing with another Data Compression algorithm for Crystal Forest BSP.

Signed-off-by Kishore Bodke <[email protected]>

---
 .../silesia-corpus/silesia-corpus.bb               |   32 ++++++++++++++++++++
 1 file changed, 32 insertions(+)
 create mode 100644 meta-crystalforest/recipes-corpus/silesia-corpus/silesia-corpus.bb

meta-crystalforest/recipes-corpus/silesia-corpus/silesia-corpus.bb new file +32 -0

new file mode 100644
index 0000000..73058eb
@@ -0,0 +1,32 @@
+SUMMARY = "The Data Compression Resource on the Internet"
+DESCRIPTION = "The intention of the Silesia corpus is to provide a data set of files \
+		that covers the typical data types used nowadays. \
+		The sizes of the files are between 6 MB and 51 MB."
+
+HOMEPAGE = "http://www.data-compression.info/index.htm"
+SECTION = "misc"
+LICENSE = "GPLv2"
+LIC_FILES_CHKSUM = "file://${COMMON_LICENSE_DIR}/GPL-2.0;md5=801f80980d171dd6425610833a22dbe6"
+
+PR="r0"
+
+S = "${WORKDIR}/silesia-corpus"
+
+SRC_URI = "http://sun.aei.polsl.pl/~sdeor/corpus/silesia.zip"
+
+SRC_URI[md5sum] = "c240c17d6805fb8a0bde763f1b94cd99"
+SRC_URI[sha256sum] = "0626e25f45c0ffb5dc801f13b7c82a3b75743ba07e3a71835a41e3d9f63c77af"
+
+do_unpack () {
+ 	 mkdir -p ${S}
+	cp ${DL_DIR}/silesia.zip ${S}
+	cd ${S} && unzip silesia.zip
+}
+
+do_install () {
+
+	install -d 			${D}${base_libdir}/firmware
+	install -m 664 ${S}/* 		${D}${base_libdir}/firmware
+}
+
+FILES_${PN} = "/lib/firmware/*"

Signature · 1 line

1.7.9.5

Przemysław Czesnowicz

2012-09-20 10:57 UTC #4 lore raw

In reply to [email protected]

2012/9/19 <[email protected]>:

Quoted 8 lines

From: Kishore Bodke <[email protected]>
Hi,
This patch set adds three different types of Corpus files to Crystal Forest BSP, which are basically used to test the Lossless Compression algorithms.

Quoted 6 lines

1. calgary-corpus
2. canterbury-corpus
3. silesia-corpus
These have been tested on both Crystal Forest Platforms.

Are those for the sample code of QA driver?
If so the sample code needs the corpus to be in one file

tar -xf calgary.tar.gz -O > calgary

Also the CrystalForest software package includes the
calgary and canterbury corpus files, at least in 0.9.0 version

Regards
Przemek

Bodke, Kishore K

author

2012-09-20 16:21 UTC #5 lore raw

Quoted 29 lines

-----Original Message-----
From: Przemysław Czesnowicz [mailto:[email protected]]
Sent: Thursday, September 20, 2012 3:58 AM
To: Bodke, Kishore K
Cc: Zanussi, Tom; Kamble, Nitin A; [email protected]; Samson, Don; Czesnowicz, PrzemyslawX
Subject: Re: [yocto] [PATCH 0/3][meta-intel] Add new Corpus recipes to Crystal Forest BSP.
2012/9/19 <[email protected]>:
Quoted 8 lines
From: Kishore Bodke <[email protected]>
Hi,
This patch set adds three different types of Corpus files to Crystal Forest BSP, which are basically used to test the Lossless Compression algorithms.
Quoted 6 lines
1. calgary-corpus
2. canterbury-corpus
3. silesia-corpus
These have been tested on both Crystal Forest Platforms.
Hi

Quoted 8 lines

Are those for the sample code of QA driver?
If so the sample code needs the corpus to be in one file
tar -xf calgary.tar.gz -O > calgary
Also the CrystalForest software package includes the calgary and canterbury corpus files, at least in 0.9.0 version

Yes. These are for the QuickAssist Driver.
All the sample corpus data files will be installed under /lib/firmware, at least with the 0.9.0-144 version QA driver, that I had tested.

Instead of having all of files in one package and having one recipe, I had split them to multiple recipes.

Thanks
Kishore.

Bodke, Kishore K

author

2012-09-20 17:10 UTC #6 lore raw

Quoted 49 lines

-----Original Message-----
From: [email protected] [mailto:yocto- [email protected]] On Behalf Of Bodke, Kishore K
Sent: Thursday, September 20, 2012 9:21 AM
To: Przemyslaw Czesnowicz
Cc: Samson, Don; Czesnowicz, PrzemyslawX; [email protected]
Subject: Re: [yocto] [PATCH 0/3][meta-intel] Add new Corpus recipes to Crystal Forest BSP.
Quoted 27 lines
-----Original Message-----
From: Przemysław Czesnowicz [mailto:[email protected]]
Sent: Thursday, September 20, 2012 3:58 AM
To: Bodke, Kishore K
Cc: Zanussi, Tom; Kamble, Nitin A; [email protected]; Samson, Don; Czesnowicz, PrzemyslawX
Subject: Re: [yocto] [PATCH 0/3][meta-intel] Add new Corpus recipes to Crystal Forest BSP.
2012/9/19 <[email protected]>:
Quoted 8 lines
From: Kishore Bodke <[email protected]>
Hi,
This patch set adds three different types of Corpus files to Crystal Forest BSP, which are basically used to test the Lossless Compression algorithms.
Quoted 6 lines
1. calgary-corpus
2. canterbury-corpus
3. silesia-corpus
These have been tested on both Crystal Forest Platforms.
Hi
Quoted 8 lines
Are those for the sample code of QA driver?
If so the sample code needs the corpus to be in one file
tar -xf calgary.tar.gz -O > calgary
Also the CrystalForest software package includes the calgary and canterbury corpus files, at least in 0.9.0 version

Quoted 7 lines

Yes. These are for the QuickAssist Driver.
All the sample corpus data files will be installed under /lib/firmware, at least with the 0.9.0-144 version QA driver, that I had tested.
Instead of having all of files in one package and having one recipe, I had split them to multiple recipes.

If you are talking about the Calgary and Canterbury files that are part of QAT Software package, that are present in the sample_code/performance/compression, then, Yes, they will stay inside the QAT Software Package.

But these are the external to the QAT package.

Thanks
Kishore.

Przemysław Czesnowicz

2012-09-20 20:05 UTC #7 lore raw

2012/9/20 Bodke, Kishore K <[email protected]>:

Quoted 57 lines

Quoted 49 lines
-----Original Message-----
From: [email protected] [mailto:yocto- [email protected]] On Behalf Of Bodke, Kishore K
Sent: Thursday, September 20, 2012 9:21 AM
To: Przemyslaw Czesnowicz
Cc: Samson, Don; Czesnowicz, PrzemyslawX; [email protected]
Subject: Re: [yocto] [PATCH 0/3][meta-intel] Add new Corpus recipes to Crystal Forest BSP.
Quoted 27 lines
-----Original Message-----
From: Przemysław Czesnowicz [mailto:[email protected]]
Sent: Thursday, September 20, 2012 3:58 AM
To: Bodke, Kishore K
Cc: Zanussi, Tom; Kamble, Nitin A; [email protected]; Samson, Don; Czesnowicz, PrzemyslawX
Subject: Re: [yocto] [PATCH 0/3][meta-intel] Add new Corpus recipes to Crystal Forest BSP.
2012/9/19 <[email protected]>:
Quoted 8 lines
From: Kishore Bodke <[email protected]>
Hi,
This patch set adds three different types of Corpus files to Crystal Forest BSP, which are basically used to test the Lossless Compression algorithms.
Quoted 6 lines
1. calgary-corpus
2. canterbury-corpus
3. silesia-corpus
These have been tested on both Crystal Forest Platforms.
Hi
Quoted 8 lines
Are those for the sample code of QA driver?
If so the sample code needs the corpus to be in one file
tar -xf calgary.tar.gz -O > calgary
Also the CrystalForest software package includes the calgary and canterbury corpus files, at least in 0.9.0 version
Quoted 7 lines
Yes. These are for the QuickAssist Driver.
All the sample corpus data files will be installed under /lib/firmware, at least with the 0.9.0-144 version QA driver, that I had tested.
Instead of having all of files in one package and having one recipe, I had split them to multiple recipes.

Quoted 7 lines

If you are talking about the Calgary and Canterbury files that are part of QAT Software package, that are present in the sample_code/performance/compression, then, Yes, they will stay inside the QAT Software Package.
But these are the external to the QAT package.
Thanks
Kishore.

Ok, then

Thanks