dtv-scan-tables tar archive

DISCUSSION Oliver Schinagl 2 participants 4 messages Jul 12, 2013 – Jul 15, 2013 1 message not in the archive Media (V4L/DVB)

lore

Share & tools

lore

A message that is not in the archive (sent off-list or not yet received): [email protected]

Oliver Schinagl

author

2013-07-12 09:09 UTC #1 lore raw

Mauro,

I think the archive is generated incorrectly. Could you take a look and see why? I shamefully admit I still am not sure where you did what to generate these ;)

Oliver

-------- Original Message --------
Subject: dtv-scan-tables tar archive
Date: Fri, 12 Jul 2013 10:59:56 +0200
From: Till Maas <[email protected]>
To: Oliver Schinagl <[email protected]>

Hi Oliver,

the tar archives at
http://linuxtv.org/downloads/dtv-scan-tables/
are broken.
xxd dtv-scan-tables-2013-04-12-495e59e.tar | less shows:

| 0000000: 6769 7420 6172 6368 6976 6520 2d2d 666f  git archive --fo
| 0000010: 726d 6174 2074 6172 202d 2d70 7265 6669  rmat tar --prefi
| 0000020: 7820 2f75 7372 2f73 6861 7265 2f64 7662  x /usr/share/dvb
| 0000030: 2f20 4845 4144 0a70 6178 5f67 6c6f 6261  / HEAD.pax_globa
| 0000040: 6c5f 6865 6164 6572 0000 0000 0000 0000  l_header........

It seems like the git archive commandline somehow ended in the tarball. E.g. the tarball should start with pax_global_header and not with "git archive".

Regards
Till

Mauro Carvalho Chehab

2013-07-12 18:55 UTC #2 lore raw

Em Fri, 12 Jul 2013 11:07:55 +0200
Oliver Schinagl <[email protected]> escreveu:

Quoted 5 lines

Mauro,
I think the archive is generated incorrectly. Could you take a look and see why? I shamefully admit I still am not sure where you did what to generate these ;)

Basically, I run a script like the one below once a day at the crontab:

#!/bin/bash
LANG=C PATH=/usr/local/bin:/usr/bin:/bin:/usr/bin/X11:/usr/games

DIR=/some_temp_location/dtv-scan-tables

DATE="git log -n1 '--pretty=format:%h %ai' |perl -ne 'print "$2-$1" if (m/([\da-f]+)\s+(\S+)/)'"

TODAY_TAR=dtv-scan-tables-$DATE.tar
FILE="$TODAY_TAR.bz2"
REPO=/the_www_location/downloads/dtv-scan-tables/

run() {
	echo $@
	$@
	if [ "$?" != "0" ]; then
		echo "Error $?. Please fix."
		exit -1
	fi
}

run cd $DIR
run git pull /git/dtv-scan-tables.git/ master

CHANGES=git log --pretty=oneline -n1
if [ "$CHANGES" = "cat .changes" ]; then
echo "tarball already updated to the latest changeset." echo "Nothing to do."
exit;
fi

git archive --format tar --prefix "/usr/share/dvb/" HEAD >$TODAY_TAR run bzip2 -f $TODAY_TAR

run mv $FILE $REPO
run ln -sf $FILE $REPO/dtv-scan-tables-LATEST.tar.bz2 (cd $REPO; md5sum *.bz2 > md5sum)
echo $CHANGES > .changes

Quoted 25 lines

Oliver
-------- Original Message --------
Subject: dtv-scan-tables tar archive
Date: Fri, 12 Jul 2013 10:59:56 +0200
From: Till Maas <[email protected]>
To: Oliver Schinagl <[email protected]>
Hi Oliver,
the tar archives at
http://linuxtv.org/downloads/dtv-scan-tables/
are broken.
xxd dtv-scan-tables-2013-04-12-495e59e.tar | less shows:
| 0000000: 6769 7420 6172 6368 6976 6520 2d2d 666f  git archive --fo
| 0000010: 726d 6174 2074 6172 202d 2d70 7265 6669  rmat tar --prefi
| 0000020: 7820 2f75 7372 2f73 6861 7265 2f64 7662  x /usr/share/dvb
| 0000030: 2f20 4845 4144 0a70 6178 5f67 6c6f 6261  / HEAD.pax_globa
| 0000040: 6c5f 6865 6164 6572 0000 0000 0000 0000  l_header........

Quoted 3 lines

It seems like the git archive commandline somehow ended in the tarball. E.g. the tarball should start with pax_global_header and not with "git archive".

Thanks for pointing it to me. I fixed the script.

Quoted 10 lines

Regards
Till
--
To unsubscribe from this list: send the line "unsubscribe linux-media" in the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html

Regards,
Mauro

Oliver Schinagl

author

2013-07-15 08:21 UTC #3 lore raw

Quoted 76 lines · Mauro Carvalho Chehab

Em Fri, 12 Jul 2013 11:07:55 +0200
Oliver Schinagl <[email protected]> escreveu:
Quoted 5 lines
Mauro,
I think the archive is generated incorrectly. Could you take a look and see why? I shamefully admit I still am not sure where you did what to generate these ;)
Basically, I run a script like the one below once a day at the crontab:
#!/bin/bash
LANG=C PATH=/usr/local/bin:/usr/bin:/bin:/usr/bin/X11:/usr/games
DIR=/some_temp_location/dtv-scan-tables
DATE="git log -n1 '--pretty=format:%h %ai' |perl -ne 'print "$2-$1" if (m/([\da-f]+)\s+(\S+)/)'"
TODAY_TAR=dtv-scan-tables-$DATE.tar
FILE="$TODAY_TAR.bz2"
REPO=/the_www_location/downloads/dtv-scan-tables/
run() {
	echo $@
	$@
	if [ "$?" != "0" ]; then
		echo "Error $?. Please fix."
		exit -1
	fi
}
run cd $DIR
run git pull /git/dtv-scan-tables.git/ master
CHANGES=git log --pretty=oneline -n1
if [ "$CHANGES" = "cat .changes" ]; then
echo "tarball already updated to the latest changeset." echo "Nothing to do."
exit;
fi
git archive --format tar --prefix "/usr/share/dvb/" HEAD >$TODAY_TAR run bzip2 -f $TODAY_TAR
run mv $FILE $REPO
run ln -sf $FILE $REPO/dtv-scan-tables-LATEST.tar.bz2 (cd $REPO; md5sum *.bz2 > md5sum)
echo $CHANGES > .changes
Quoted 25 lines
Oliver
-------- Original Message --------
Subject: dtv-scan-tables tar archive
Date: Fri, 12 Jul 2013 10:59:56 +0200
From: Till Maas <[email protected]>
To: Oliver Schinagl <[email protected]>
Hi Oliver,
the tar archives at
http://linuxtv.org/downloads/dtv-scan-tables/
are broken.
xxd dtv-scan-tables-2013-04-12-495e59e.tar | less shows:
| 0000000: 6769 7420 6172 6368 6976 6520 2d2d 666f  git archive --fo
| 0000010: 726d 6174 2074 6172 202d 2d70 7265 6669  rmat tar --prefi
| 0000020: 7820 2f75 7372 2f73 6861 7265 2f64 7662  x /usr/share/dvb
| 0000030: 2f20 4845 4144 0a70 6178 5f67 6c6f 6261  / HEAD.pax_globa
| 0000040: 6c5f 6865 6164 6572 0000 0000 0000 0000  l_header........

Quoted 5 lines

Quoted 3 lines
It seems like the git archive commandline somehow ended in the tarball. E.g. the tarball should start with pax_global_header and not with "git archive".
Thanks for pointing it to me. I fixed the script.

Confirmed, it now shows proper archives.

Could you manually remove 'dtv-scan-tables-2013-04-12*' as that is invalid so shouldn't be mirrored/downloaded really.

Thanks,

Oliver

Quoted 20 lines

Quoted 11 lines
Regards
Till
--
To unsubscribe from this list: send the line "unsubscribe linux-media" in the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html
Regards,
Mauro
--
To unsubscribe from this list: send the line "unsubscribe linux-media" in the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html

Mauro Carvalho Chehab

2013-07-15 16:27 UTC #4 lore raw

Em Mon, 15 Jul 2013 10:18:50 +0200
Oliver Schinagl <[email protected]> escreveu:

Quoted 77 lines · Mauro Carvalho Chehab

Quoted 76 lines
Em Fri, 12 Jul 2013 11:07:55 +0200
Oliver Schinagl <[email protected]> escreveu:
Quoted 5 lines
Mauro,
I think the archive is generated incorrectly. Could you take a look and see why? I shamefully admit I still am not sure where you did what to generate these ;)
Basically, I run a script like the one below once a day at the crontab:
#!/bin/bash
LANG=C PATH=/usr/local/bin:/usr/bin:/bin:/usr/bin/X11:/usr/games
DIR=/some_temp_location/dtv-scan-tables
DATE="git log -n1 '--pretty=format:%h %ai' |perl -ne 'print "$2-$1" if (m/([\da-f]+)\s+(\S+)/)'"
TODAY_TAR=dtv-scan-tables-$DATE.tar
FILE="$TODAY_TAR.bz2"
REPO=/the_www_location/downloads/dtv-scan-tables/
run() {
	echo $@
	$@
	if [ "$?" != "0" ]; then
		echo "Error $?. Please fix."
		exit -1
	fi
}
run cd $DIR
run git pull /git/dtv-scan-tables.git/ master
CHANGES=git log --pretty=oneline -n1
if [ "$CHANGES" = "cat .changes" ]; then
echo "tarball already updated to the latest changeset." echo "Nothing to do."
exit;
fi
git archive --format tar --prefix "/usr/share/dvb/" HEAD >$TODAY_TAR run bzip2 -f $TODAY_TAR
run mv $FILE $REPO
run ln -sf $FILE $REPO/dtv-scan-tables-LATEST.tar.bz2 (cd $REPO; md5sum *.bz2 > md5sum)
echo $CHANGES > .changes
Quoted 25 lines
Oliver
-------- Original Message --------
Subject: dtv-scan-tables tar archive
Date: Fri, 12 Jul 2013 10:59:56 +0200
From: Till Maas <[email protected]>
To: Oliver Schinagl <[email protected]>
Hi Oliver,
the tar archives at
http://linuxtv.org/downloads/dtv-scan-tables/
are broken.
xxd dtv-scan-tables-2013-04-12-495e59e.tar | less shows:
| 0000000: 6769 7420 6172 6368 6976 6520 2d2d 666f  git archive --fo
| 0000010: 726d 6174 2074 6172 202d 2d70 7265 6669  rmat tar --prefi
| 0000020: 7820 2f75 7372 2f73 6861 7265 2f64 7662  x /usr/share/dvb
| 0000030: 2f20 4845 4144 0a70 6178 5f67 6c6f 6261  / HEAD.pax_globa
| 0000040: 6c5f 6865 6164 6572 0000 0000 0000 0000  l_header........

Quoted 6 lines

Quoted 5 lines
Quoted 3 lines
It seems like the git archive commandline somehow ended in the tarball. E.g. the tarball should start with pax_global_header and not with "git archive".
Thanks for pointing it to me. I fixed the script.
Confirmed, it now shows proper archives.

Good!

Quoted 2 lines

Could you manually remove 'dtv-scan-tables-2013-04-12*' as that is invalid so shouldn't be mirrored/downloaded really.

Done.

Regards,
Mauro

Quoted 25 lines

Thanks,
Oliver
Quoted 20 lines
Quoted 11 lines
Regards
Till
--
To unsubscribe from this list: send the line "unsubscribe linux-media" in the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html
Regards,
Mauro
--
To unsubscribe from this list: send the line "unsubscribe linux-media" in the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html

Cheers,
Mauro