Skip to content

RFC support/download: reproducible archives whatever tar version (branch yem/dl-git-tar-pax)

Yann E. MORIN buildroot 1 version New

Get series with b4
b4 am [email protected]

Versions newest first

  1. v1 RFC Latest7 patches 0 repliesNew

Patches in v1 No applies recorded yet

#Subject and filesSizeRepliesApplied
1/7core/pkg-infra: prepare for alternate default source archivespackage/pkg-generic.mk+2 -10 replies
2/7WIP: support/download: change format of archives generated from gitpackage/pkg-generic.mk support/download/git+21 -70 replies
3/7WIP: boot+packages: update hash to new git-tarballs formatboot/vexpress-firmware/vexpress-firmware.hash package/18xx-ti-utils/18xx-ti-utils.hash package/aer-inject/aer-inject.hash +58 more+130 -1290 replies
4/7WIP: support/testing: update git-hash checks with new archive formatsupport/testing/tests/download/br2-external/git-hash/package/bad/bad.hash support/testing/tests/download/br2-external/git-hash/package/good/good.hash support/testing/tests/download/br2-external/git-refs/package/git-partial-sha1-branch-head/git-partial-sha1-branch-head.hash +13 more+16 -160 replies
5/7package/open2300: switch to githubpackage/open2300/open2300.hash package/open2300/open2300.mk+4 -71 reply
6/7support/download: change format of archives generated from svnpackage/pkg-generic.mk support/download/svn+9 -50 replies
7/7support/dependencies: drop check for maximal tar versionsupport/dependencies/check-host-tar.sh+1 -130 replies

Reviews trailers per patch

No Reviewed-by, Acked-by or Tested-by trailers for v1 yet.

Read the v1 thread

Cover letter [Buildroot] [PATCH 0/7 RFC] support/download: reproducible archives whatever tar version (branch yem/dl-git-tar-pax)

Hello All!

This series fixes our download backends, git and svn, to generate reproducible archives whatever the tar version, thus removing therequirement for a maximum tar version.

This however changes the actual format of the generated archives, and they are different from the existing ones. So we also change the compression to avoid collision with existign archives on s.b.o, that need to be read by older Buildroot versions.

A huge thank to Vincent for digging up the adequate set of options that allows generating reproducible archives. Thanks! :-)

Note that this series contains commits marked "WIP": they are separate commits for ease of review, but they should ultimately be squashed together of they would not be bisectable.

Regards,
Yann E. MORIN.

The following changes since commit 2e8bf36dc4421f2213f8fa6de91b2c9bf3d64e45

package/zstd: avoid compilation during host-zstd install step (2020-09-28 22:04:15 +0200)

are available in the git repository at:

https://git.busybox.net/~ymorin/git/buildroot

for you to fetch changes up to a71f772a27d008b72b67b081c4a4aaaa9f83ea53

support/dependencies: drop check for maximal tar version (2020-09-28 23:38:40 +0200)

----------------------------------------------------------------
Yann E. MORIN (7):
core/pkg-infra: prepare for alternate default source archives
WIP: support/download: change format of archives generated from git
WIP: boot+packages: update hash to new git-tarballs format
WIP: support/testing: update git-hash checks with new archive format package/open2300: switch to github
support/download: change format of archives generated from svn support/dependencies: drop check for maximal tar version

 boot/vexpress-firmware/vexpress-firmware.hash      |  2 +-
 package/18xx-ti-utils/18xx-ti-utils.hash           |  4 +-
 package/aer-inject/aer-inject.hash                 |  2 +-
 package/am33x-cm3/am33x-cm3.hash                   |  2 +-
 package/armbian-firmware/armbian-firmware.hash     |  2 +-
 package/at/at.hash                                 |  6 +-
 package/bayer2rgb-neon/bayer2rgb-neon.hash         |  4 +-
 package/brickd/brickd.hash                         |  4 +-
 package/c-capnproto/c-capnproto.hash               |  2 +-
 package/dbus-triggerd/dbus-triggerd.hash           |  2 +-
 package/dt-utils/dt-utils.hash                     |  4 +-
 package/dtv-scan-tables/dtv-scan-tables.hash       |  6 +-
 package/flashbench/flashbench.hash                 |  2 +-
 .../imx-alsa-plugins/imx-alsa-plugins.hash         |  2 +-
 package/freescale-imx/imx-lib/imx-lib.hash         |  2 +-
 package/google-breakpad/google-breakpad.hash       |  2 +-
 .../gstreamer1/gst1-interpipe/gst1-interpipe.hash  |  2 +-
 package/gstreamer1/gst1-shark/gst1-shark.hash      |  4 +-
 package/imx-mkimage/imx-mkimage.hash               |  4 +-
 package/kvm-unit-tests/kvm-unit-tests.hash         |  2 +-
 package/kvmtool/kvmtool.hash                       |  2 +-
 package/libbroadvoice/libbroadvoice.hash           |  4 +-
 package/libclc/libclc.hash                         |  4 +-
 package/libg7221/libg7221.hash                     |  4 +-
 package/libilbc/libilbc.hash                       |  4 +-
 package/libsilk/libsilk.hash                       |  4 +-
 package/libsvgtiny/libsvgtiny.hash                 |  4 +-
 package/libuci/libuci.hash                         |  2 +-
 package/libyuv/libyuv.hash                         |  4 +-
 package/linux-firmware/linux-firmware.hash         | 68 +++++++++++-----------
 .../linux-syscall-support.hash                     |  2 +-
 package/minicom/minicom.hash                       |  4 +-
 package/mmc-utils/mmc-utils.hash                   |  4 +-
 package/net-tools/net-tools.hash                   |  2 +-
 package/netcat-openbsd/netcat-openbsd.hash         |  4 +-
 .../netsurf-buildsystem/netsurf-buildsystem.hash   |  2 +-
 package/odhcp6c/odhcp6c.hash                       |  2 +-
 package/open2300/open2300.hash                     |  6 +-
 package/open2300/open2300.mk                       |  5 +-
 package/opkg-utils/opkg-utils.hash                 |  2 +-
 package/piglit/piglit.hash                         |  2 +-
 package/pkg-generic.mk                             |  9 ++-
 package/prelink-cross/prelink-cross.hash           |  2 +-
 package/psplash/psplash.hash                       |  4 +-
 package/qt-webkit-kiosk/qt-webkit-kiosk.hash       |  2 +-
 package/rcw/rcw.hash                               |  4 +-
 package/rtc-tools/rtc-tools.hash                   |  4 +-
 package/rtmpdump/rtmpdump.hash                     |  4 +-
 package/speexdsp/speexdsp.hash                     |  4 +-
 package/stm32flash/stm32flash.hash                 |  4 +-
 package/ti-sgx-demos/ti-sgx-demos.hash             |  4 +-
 package/ti-sgx-km/ti-sgx-km.hash                   |  4 +-
 package/ti-sgx-libgbm/ti-sgx-libgbm.hash           |  4 +-
 package/ti-sgx-um/ti-sgx-um.hash                   |  4 +-
 package/trace-cmd/trace-cmd.hash                   |  6 +-
 package/tremor/tremor.hash                         |  4 +-
 package/ubus/ubus.hash                             |  2 +-
 package/uemacs/uemacs.hash                         |  4 +-
 package/uhttpd/uhttpd.hash                         |  2 +-
 package/ustream-ssl/ustream-ssl.hash               |  4 +-
 package/vboot-utils/vboot-utils.hash               |  2 +-
 package/wilink-bt-firmware/wilink-bt-firmware.hash |  4 +-
 .../xdriver_xf86-video-imx-viv.hash                |  2 +-
 .../xdriver_xf86-video-intel.hash                  |  1 +
 support/dependencies/check-host-tar.sh             | 14 +----
 support/download/git                               | 20 +++++--
 support/download/svn                               | 12 ++--
 .../br2-external/git-hash/package/bad/bad.hash     |  2 +-
 .../br2-external/git-hash/package/good/good.hash   |  2 +-
 .../git-partial-sha1-branch-head.hash              |  2 +-
 .../git-partial-sha1-reachable-by-branch.hash      |  2 +-
 .../git-partial-sha1-reachable-by-tag.hash         |  2 +-
 .../git-partial-sha1-tag-itself.hash               |  2 +-
 .../git-partial-sha1-tag-points-to.hash            |  2 +-
 .../git-sha1-branch-head/git-sha1-branch-head.hash |  2 +-
 .../git-sha1-reachable-by-branch.hash              |  2 +-
 .../git-sha1-reachable-by-tag.hash                 |  2 +-
 .../git-sha1-tag-itself/git-sha1-tag-itself.hash   |  2 +-
 .../git-sha1-tag-points-to.hash                    |  2 +-
 .../git-submodule-disabled.hash                    |  2 +-
 .../git-submodule-enabled.hash                     |  2 +-
 .../git-refs/package/git-tag/git-tag.hash          |  2 +-
 .../git-wrong-content/git-wrong-content.hash       |  2 +-
 83 files changed, 181 insertions(+), 176 deletions(-)
Signature · 6 lines
.-----------------.--------------------.------------------.--------------------.
|  Yann E. MORIN  | Real-Time Embedded | /"\ ASCII RIBBON | Erics' conspiracy: |
| +33 662 376 056 | Software  Designer | \ / CAMPAIGN     |  ___               |
| +33 561 099 427 `------------.-------:  X  AGAINST      |  \e/  There is no  |
| http://ymorin.is-a-geek.org/ | _/*\_ | / \ HTML MAIL    |   v   conspiracy.  |
'------------------------------^-------^------------------^--------------------'