Skip to contentSkip to conversation

musl: Drop MIRRORS

PATCH In review Khem Raj 3 participants 7 messages Sep 22, 2023

lore
Share & tools
lore

Khem Raj

author
#0 lore raw

PATCH 1/1 musl: Drop MIRRORS

When using mirrors fetcher gets into a weird state when shallow clones are enables.

ERROR: Bitbake Fetcher Error: UnpackError('No up to date source found: clone directory not available or not up to date: /mnt/b/yoe/master/downloads/git2/git.musl-libc.org.git.musl.git; shallow clone not available: /mnt/b/yoe/master/downloads/gitshallow_git.musl-libc.org.git.musl.git_79bdacf-1_master.tar.gz', 'git://git.musl-libc.org/git/musl.git;branch=master;protocol=https')

Anyway the mirrors were added as backup when we had issues with musl git in past.

---
 meta/recipes-core/musl/musl_git.bb | 6 +-----
 1 file changed, 1 insertion(+), 5 deletions(-)
meta/recipes-core/musl/musl_git.bb +1 -5
index dbc31e1d83b..72253636dc8 100644
@@ -10,15 +10,11 @@ BASEVER = "1.2.4"
 
 PV = "${BASEVER}+git"
 
-# mirror is at git://github.com/kraj/musl.git
-
-SRC_URI = "git://git.musl-libc.org/git/musl.git;branch=master;protocol=https \
+SRC_URI = "git://git.musl-libc.org/git/musl;branch=master;protocol=https \
            file://0001-Make-dynamic-linker-a-relative-symlink-to-libc.patch \
            file://0002-ldso-Use-syslibdir-and-libdir-as-default-pathes-to-l.patch \
           "
 
-MIRRORS += "git://git.musl-libc.org/git/musl.git git://github.com/kraj/musl.git"
-
 S = "${WORKDIR}/git"
 
 PROVIDES += "virtual/libc virtual/libiconv virtual/libintl virtual/crypt"
Signature · 1 line
2.42.0
#1 lore raw
Quoted 10 lines · Khem Raj

When using mirrors fetcher gets into a weird state when shallow clones are enables.

ERROR: Bitbake Fetcher Error: UnpackError('No up to date source
found: clone directory not available or not up to date:
/mnt/b/yoe/master/downloads/git2/git.musl-libc.org.git.musl.git; shallow clone not available:
/mnt/b/yoe/master/downloads/gitshallow_git.musl- libc.org.git.musl.git_79bdacf-1_master.tar.gz', 'git://git.musl- libc.org/git/musl.git;branch=master;protocol=https')

That sounds like something we should look into and fix?

I don't think it makes sense as a justification in a commit message.

Cheers,

Richard

author
#2 lore raw
Quoted 13 lines · Richard Purdie
Quoted 10 lines · Khem Raj

When using mirrors fetcher gets into a weird state when shallow clones are enables.

ERROR: Bitbake Fetcher Error: UnpackError('No up to date source
found: clone directory not available or not up to date:
/mnt/b/yoe/master/downloads/git2/git.musl-libc.org.git.musl.git; shallow clone not available:
/mnt/b/yoe/master/downloads/gitshallow_git.musl- libc.org.git.musl.git_79bdacf-1_master.tar.gz', 'git://git.musl- libc.org/git/musl.git;branch=master;protocol=https')

Quoted 3 lines

That sounds like something we should look into and fix?

I don't think it makes sense as a justification in a commit message.

I tried to do it in several ways and somehow fetch is failing. Only way I see it work once was when removing the mirrors and rebuilding after -ccleanall
see - https://autobuilder.yoctoproject.org/typhoon/#/builders/64/builds/7836

if I git fetch these repos from any of mirrors or upstream clones work totally fine but git fetcher always complains. No idea whats going on

Quoted 4 lines

Cheers,

Richard

#3 lore raw
Quoted 19 lines · Khem Raj
Quoted 13 lines · Richard Purdie
Quoted 10 lines · Khem Raj

When using mirrors fetcher gets into a weird state when shallow clones are enables.

ERROR: Bitbake Fetcher Error: UnpackError('No up to date source
found: clone directory not available or not up to date:
/mnt/b/yoe/master/downloads/git2/git.musl-libc.org.git.musl.git; shallow clone not available:
/mnt/b/yoe/master/downloads/gitshallow_git.musl- libc.org.git.musl.git_79bdacf-1_master.tar.gz', 'git://git.musl- libc.org/git/musl.git;branch=master;protocol=https')

Quoted 3 lines

That sounds like something we should look into and fix?

I don't think it makes sense as a justification in a commit message.

Quoted 8 lines

I tried to do it in several ways and somehow fetch is failing. Only way I see it work once was when removing the mirrors and rebuilding after -ccleanall
see - https://autobuilder.yoctoproject.org/typhoon/#/builders/64/builds/7836

if I git fetch these repos from any of mirrors or upstream clones work totally fine but git fetcher always complains. No idea whats going on

Please tell me you're not running -c cleanall on the autobuilder infrastructure?

Cheers,

Richard

author
#4 lore raw
Quoted 25 lines · Richard Purdie
Quoted 24 lines · Khem Raj
Quoted 13 lines · Richard Purdie
Quoted 10 lines · Khem Raj

When using mirrors fetcher gets into a weird state when shallow clones are enables.

ERROR: Bitbake Fetcher Error: UnpackError('No up to date source
found: clone directory not available or not up to date:
/mnt/b/yoe/master/downloads/git2/git.musl-libc.org.git.musl.git; shallow clone not available:
/mnt/b/yoe/master/downloads/gitshallow_git.musl- libc.org.git.musl.git_79bdacf-1_master.tar.gz', 'git://git.musl- libc.org/git/musl.git;branch=master;protocol=https')

Quoted 3 lines

That sounds like something we should look into and fix?

I don't think it makes sense as a justification in a commit message.

I tried to do it in several ways and somehow fetch is failing. Only way I see it work once was when removing the mirrors and rebuilding after -ccleanall
see - https://autobuilder.yoctoproject.org/typhoon/#/builders/64/builds/7836

Quoted 6 lines
Quoted 3 lines

if I git fetch these repos from any of mirrors or upstream clones work totally fine but git fetcher always complains. No idea whats going on

Please tell me you're not running -c cleanall on the autobuilder infrastructure?

ofcourse not.

Quoted 4 lines

Cheers,

Richard

#5 lore raw
In reply to Khem Raj

https://autobuilder.yoctoproject.org/typhoon/#/builders/15/builds/8149/steps/11/logs/stdio
https://autobuilder.yoctoproject.org/typhoon/#/builders/64/builds/7837/steps/11/logs/stdio
https://autobuilder.yoctoproject.org/typhoon/#/builders/45/builds/7859/steps/11/logs/stdio
https://autobuilder.yoctoproject.org/typhoon/#/builders/97/builds/7193/steps/13/logs/stdio

Quoted 47 lines · Khem Raj

When using mirrors fetcher gets into a weird state when shallow clones are enables.

ERROR: Bitbake Fetcher Error: UnpackError('No up to date source found: clone directory not available or not up to date: /mnt/b/yoe/master/downloads/git2/git.musl-libc.org.git.musl.git; shallow clone not available: /mnt/b/yoe/master/downloads/gitshallow_git.musl-libc.org.git.musl.git_79bdacf-1_master.tar.gz', 'git://git.musl-libc.org/git/musl.git;branch=master;protocol=https')

Anyway the mirrors were added as backup when we had issues with musl git in past.

---
 meta/recipes-core/musl/musl_git.bb | 6 +-----
 1 file changed, 1 insertion(+), 5 deletions(-)
meta/recipes-core/musl/musl_git.bb +1 -5
index dbc31e1d83b..72253636dc8 100644
@@ -10,15 +10,11 @@ BASEVER = "1.2.4"
 
 PV = "${BASEVER}+git"
 
-# mirror is at git://github.com/kraj/musl.git
-
-SRC_URI = "git://git.musl-libc.org/git/musl.git;branch=master;protocol=https \
+SRC_URI = "git://git.musl-libc.org/git/musl;branch=master;protocol=https \
            file://0001-Make-dynamic-linker-a-relative-symlink-to-libc.patch \
            file://0002-ldso-Use-syslibdir-and-libdir-as-default-pathes-to-l.patch \
           "
 
-MIRRORS += "git://git.musl-libc.org/git/musl.git git://github.com/kraj/musl.git"
-
 S = "${WORKDIR}/git"
 
 PROVIDES += "virtual/libc virtual/libiconv virtual/libintl virtual/crypt"
Signature · 11 lines
2.42.0



-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#188034): https://lists.openembedded.org/g/openembedded-core/message/188034
Mute This Topic: https://lists.openembedded.org/mt/101513420/3617179
Group Owner: [email protected]
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [[email protected]]
-=-=-=-=-=-=-=-=-=-=-=-
Signature · 3 lines
Alexandre Belloni, co-owner and COO, Bootlin
Embedded Linux and Kernel engineering
https://bootlin.com
author
#6 lore raw

yeah I am trying to investigate, locally I reproduced it once but then I did bitbake -ccleanall musl and then it started to work.

I see this in log.do_fetch on AB

http://sprunge.us/c5J8K3

says

fatal: protocol error: bad line length character: erro

Quoted 60 lines · Alexandre Belloni

https://autobuilder.yoctoproject.org/typhoon/#/builders/15/builds/8149/steps/11/logs/stdio
https://autobuilder.yoctoproject.org/typhoon/#/builders/64/builds/7837/steps/11/logs/stdio
https://autobuilder.yoctoproject.org/typhoon/#/builders/45/builds/7859/steps/11/logs/stdio
https://autobuilder.yoctoproject.org/typhoon/#/builders/97/builds/7193/steps/13/logs/stdio

Quoted 39 lines · Khem Raj

When using mirrors fetcher gets into a weird state when shallow clones are enables.

ERROR: Bitbake Fetcher Error: UnpackError('No up to date source found: clone directory not available or not up to date: /mnt/b/yoe/master/downloads/git2/git.musl-libc.org.git.musl.git; shallow clone not available: /mnt/b/yoe/master/downloads/gitshallow_git.musl-libc.org.git.musl.git_79bdacf-1_master.tar.gz', 'git://git.musl-libc.org/git/musl.git;branch=master;protocol=https')

Anyway the mirrors were added as backup when we had issues with musl git in past.

---
 meta/recipes-core/musl/musl_git.bb | 6 +-----
 1 file changed, 1 insertion(+), 5 deletions(-)
meta/recipes-core/musl/musl_git.bb +1 -6
index dbc31e1d83b..72253636dc8 100644
@@ -10,15 +10,11 @@ BASEVER = "1.2.4"
 
 PV = "${BASEVER}+git"
 
-# mirror is at git://github.com/kraj/musl.git
-
-SRC_URI = "git://git.musl-libc.org/git/musl.git;branch=master;protocol=https \
+SRC_URI = "git://git.musl-libc.org/git/musl;branch=master;protocol=https \
            file://0001-Make-dynamic-linker-a-relative-symlink-to-libc.patch \
            file://0002-ldso-Use-syslibdir-and-libdir-as-default-pathes-to-l.patch \
           "
 
-MIRRORS += "git://git.musl-libc.org/git/musl.git git://github.com/kraj/musl.git"
-
 S = "${WORKDIR}/git"
 
 PROVIDES += "virtual/libc virtual/libiconv virtual/libintl virtual/crypt"
--

2.42.0

Quoted 8 lines

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#188034): https://lists.openembedded.org/g/openembedded-core/message/188034
Mute This Topic: https://lists.openembedded.org/mt/101513420/3617179
Group Owner: [email protected]
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [[email protected]]
-=-=-=-=-=-=-=-=-=-=-=-

--
Alexandre Belloni, co-owner and COO, Bootlin
Embedded Linux and Kernel engineering
https://bootlin.com