Skip to contentSkip to conversation

Everything failed in gitlab

cip-dev Pavel Machek 5 participants 10 messages Aug 26, 2020 – Aug 28, 2020

lore
Share & tools
lore
#0 lore raw

Hi!

I tried submitting kernel for testing, and got "everything failed" result after timeout. I believe something is wrong with testing:

https://gitlab.com/cip-project/cip-kernel/linux-cip/-/pipelines/181945390

Any ideas?

Best regards,
Pavel

Signature · 2 lines
(english) http://www.livejournal.com/~pavelmachek
(cesky, pictures) http://atrey.karlin.mff.cuni.cz/~pavel/picture/horses/blog.html

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#5256): https://lists.cip-project.org/g/cip-dev/message/5256
Mute This Topic: https://lists.cip-project.org/mt/76423839/4520388
Group Owner: [email protected]
Unsubscribe: https://lists.cip-project.org/g/cip-dev/leave/8129055/727948398/xyzzy [[email protected]]
-=-=-=-=-=-=-=-=-=-=-=-

#1 lore raw

Hi,

There seems to be a problem with kubernetes running gitlab-runner. AFAUK, this provided by Siemens. Jan, do you have any information about this?

Best regards,
Nobuhiro

Quoted 13 lines

-----Original Message-----
From: [email protected] [mailto:[email protected]] On Behalf Of Pavel Machek
Sent: Wednesday, August 26, 2020 4:25 PM
To: [email protected]; [email protected]
Subject: [cip-dev] Everything failed in gitlab

Hi!

I tried submitting kernel for testing, and got "everything failed" result after timeout. I believe something is wrong with testing:

https://gitlab.com/cip-project/cip-kernel/linux-cip/-/pipelines/181945390

Quoted 7 lines

Any ideas?

Best regards,
Pavel
--
(english) http://www.livejournal.com/~pavelmachek
(cesky, pictures) http://atrey.karlin.mff.cuni.cz/~pavel/picture/horses/blog.html

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#5275): https://lists.cip-project.org/g/cip-dev/message/5275
Mute This Topic: https://lists.cip-project.org/mt/76423839/4520388
Group Owner: [email protected]
Unsubscribe: https://lists.cip-project.org/g/cip-dev/leave/8129055/727948398/xyzzy [[email protected]]
-=-=-=-=-=-=-=-=-=-=-=-

#2 lore raw
Quoted 5 lines · On 27.08.20 08:48, [email protected] wrote:

Hi,

There seems to be a problem with kubernetes running gitlab-runner. AFAUK, this provided by Siemens. Jan, do you have any information about this?

Michael, Quirin, any ideas?

Jan

Quoted 23 lines

Best regards,
Nobuhiro

Quoted 20 lines

-----Original Message-----
From: [email protected] [mailto:[email protected]] On Behalf Of Pavel Machek
Sent: Wednesday, August 26, 2020 4:25 PM
To: [email protected]; [email protected]
Subject: [cip-dev] Everything failed in gitlab

Hi!

I tried submitting kernel for testing, and got "everything failed" result after timeout. I believe something is wrong with testing:

https://gitlab.com/cip-project/cip-kernel/linux-cip/-/pipelines/181945390

Any ideas?

Best regards,
Pavel
--
(english) http://www.livejournal.com/~pavelmachek
(cesky, pictures) http://atrey.karlin.mff.cuni.cz/~pavel/picture/horses/blog.html

Signature · 2 lines
Siemens AG, Corporate Technology, CT RDA IOT SES-DE
Corporate Competence Center Embedded Linux

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#5279): https://lists.cip-project.org/g/cip-dev/message/5279
Mute This Topic: https://lists.cip-project.org/mt/76423839/4520388
Group Owner: [email protected]
Unsubscribe: https://lists.cip-project.org/g/cip-dev/leave/8129055/727948398/xyzzy [[email protected]]
-=-=-=-=-=-=-=-=-=-=-=-

#3 lore raw

Hi,

Quoted 1 line

Michael, Quirin, any ideas?

yes. I took a brief look at the logs and found the problem:

===============================================================================

Aug 27 08:16:05 ip-172-20-42-140 kubelet[2152]: E0827 08:16:05.109337    2152 kuberuntime_manager.go:784] container start failed: ErrImagePull: rpc error: code = Unknown desc = Error response from daemon: Get https://registry.gitlab.com/v2/cip-project/cip-testing/linux-cip-ci/manifests/build-v3: unauthorized: HTTP Basic: Access denied

===============================================================================

=> HTTP Basic: Access denied

Please check your setup/permissions?

HTH,
Michael

Signature · 4 lines
Michael Adler
Siemens AG, Corporate Technology, CT RDA IOT SES-DE, Otto-Hahn-Ring 6, 81739 Munich, Germany

Siemens Aktiengesellschaft: Chairman of the Supervisory Board: Jim Hagemann Snabe; Managing Board: Joe Kaeser, Chairman, President and Chief Executive Officer; Roland Busch, Klaus Helmrich, Cedrik Neike, Ralf P. Thomas; Registered offices: Berlin and Munich, Germany; Commercial registries: Berlin Charlottenburg, HRB 12300, Munich, HRB 6684; WEEE-Reg.-No. DE 23691322

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#5280): https://lists.cip-project.org/g/cip-dev/message/5280
Mute This Topic: https://lists.cip-project.org/mt/76423839/4520388
Group Owner: [email protected]
Unsubscribe: https://lists.cip-project.org/g/cip-dev/leave/8129055/727948398/xyzzy [[email protected]]
-=-=-=-=-=-=-=-=-=-=-=-

#4 lore raw

Hi!

Quoted 11 lines
Quoted 1 line

Michael, Quirin, any ideas?

yes. I took a brief look at the logs and found the problem:

===============================================================================

Aug 27 08:16:05 ip-172-20-42-140 kubelet[2152]: E0827 08:16:05.109337    2152 kuberuntime_manager.go:784] container start failed: ErrImagePull: rpc error: code = Unknown desc = Error response from daemon: Get https://registry.gitlab.com/v2/cip-project/cip-testing/linux-cip-ci/manifests/build-v3: unauthorized: HTTP Basic: Access denied

===============================================================================

=> HTTP Basic: Access denied

Please check your setup/permissions?

I believe that Chris is unavailable this week. Is there anyone else that knows how this is supposed to work?

Best regards,
Pavel

--
DENX Software Engineering GmbH, Managing Director: Wolfgang Denk
HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#5284): https://lists.cip-project.org/g/cip-dev/message/5284
Mute This Topic: https://lists.cip-project.org/mt/76423839/4520388
Group Owner: [email protected]
Unsubscribe: https://lists.cip-project.org/g/cip-dev/leave/8129055/727948398/xyzzy [[email protected]]
-=-=-=-=-=-=-=-=-=-=-=-

#5 lore raw

Hi all,

This is happening not only in cip-testing (kernel test) but also in cip-core[0][1].
I don't manage these runners. Has anyone changed permissions etc?

Best regards,
Nobuhiro

[0]:https://gitlab.com/cip-project/cip-core/isar-cip-core/-/jobs/705783916 [1]:https://gitlab.com/cip-project/cip-core/deby/-/jobs/699772711

2020年8月27日(木) 22:10 Pavel Machek <[email protected]>:

Quoted 25 lines

Hi!

Quoted 11 lines
Quoted 1 line

Michael, Quirin, any ideas?

yes. I took a brief look at the logs and found the problem:

===============================================================================

Aug 27 08:16:05 ip-172-20-42-140 kubelet[2152]: E0827 08:16:05.109337    2152 kuberuntime_manager.go:784] container start failed: ErrImagePull: rpc error: code = Unknown desc = Error response from daemon: Get https://registry.gitlab.com/v2/cip-project/cip-testing/linux-cip-ci/manifests/build-v3: unauthorized: HTTP Basic: Access denied

===============================================================================

=> HTTP Basic: Access denied

Please check your setup/permissions?

I believe that Chris is unavailable this week. Is there anyone else that knows how this is supposed to work?

Best regards,
Pavel

--
DENX Software Engineering GmbH, Managing Director: Wolfgang Denk
HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany

Signature · 3 lines
Nobuhiro Iwamatsu
   iwamatsu at {nigauri.org / debian.org}
   GPG ID: 40AD1FA6

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#5286): https://lists.cip-project.org/g/cip-dev/message/5286
Mute This Topic: https://lists.cip-project.org/mt/76423839/4520388
Group Owner: [email protected]
Unsubscribe: https://lists.cip-project.org/g/cip-dev/leave/8129055/727948398/xyzzy [[email protected]]
-=-=-=-=-=-=-=-=-=-=-=-

#6 lore raw
Quoted 5 lines · Nobuhiro Iwamatsu

Hi all,

This is happening not only in cip-testing (kernel test) but also in cip-core[0][1].
I don't manage these runners. Has anyone changed permissions etc?

I do. Just restarted a build
(https://gitlab.com/cip-project/cip-core/isar-cip-core/-/jobs/707991738), and it is apparently working.

Is there in issue with who is triggering the build and what permission that person has? Just restarted [0], and that also works:

https://gitlab.com/cip-project/cip-core/isar-cip-core/-/jobs/707992917

Jan

Quoted 35 lines

Best regards,
Nobuhiro

[0]:https://gitlab.com/cip-project/cip-core/isar-cip-core/-/jobs/705783916 [1]:https://gitlab.com/cip-project/cip-core/deby/-/jobs/699772711

2020年8月27日(木) 22:10 Pavel Machek <[email protected]>:

Quoted 25 lines

Hi!

Quoted 11 lines
Quoted 1 line

Michael, Quirin, any ideas?

yes. I took a brief look at the logs and found the problem:

===============================================================================

Aug 27 08:16:05 ip-172-20-42-140 kubelet[2152]: E0827 08:16:05.109337    2152 kuberuntime_manager.go:784] container start failed: ErrImagePull: rpc error: code = Unknown desc = Error response from daemon: Get https://registry.gitlab.com/v2/cip-project/cip-testing/linux-cip-ci/manifests/build-v3: unauthorized: HTTP Basic: Access denied

===============================================================================

=> HTTP Basic: Access denied

Please check your setup/permissions?

I believe that Chris is unavailable this week. Is there anyone else that knows how this is supposed to work?

Best regards,
Pavel

--
DENX Software Engineering GmbH, Managing Director: Wolfgang Denk
HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany

Signature · 2 lines
Siemens AG, Corporate Technology, CT RDA IOT SES-DE
Corporate Competence Center Embedded Linux

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#5287): https://lists.cip-project.org/g/cip-dev/message/5287
Mute This Topic: https://lists.cip-project.org/mt/76423839/4520388
Group Owner: [email protected]
Unsubscribe: https://lists.cip-project.org/g/cip-dev/leave/8129055/727948398/xyzzy [[email protected]]
-=-=-=-=-=-=-=-=-=-=-=-

#7 lore raw

Hi Jan,

Quoted 15 lines

-----Original Message-----
From: Jan Kiszka [mailto:[email protected]]
Sent: Friday, August 28, 2020 1:44 PM
To: Nobuhiro Iwamatsu <[email protected]>; [email protected]
Cc: iwamatsu nobuhiro(岩松 信洋 □SWC◯ACT) <[email protected]>; Chris Paterson <[email protected]>; Quirin Gylstorff <[email protected]>
Subject: Re: [cip-dev] Everything failed in gitlab

Quoted 5 lines · Nobuhiro Iwamatsu

Hi all,

This is happening not only in cip-testing (kernel test) but also in cip-core[0][1].
I don't manage these runners. Has anyone changed permissions etc?

Quoted 8 lines

I do. Just restarted a build
(https://gitlab.com/cip-project/cip-core/isar-cip-core/-/jobs/707991738), and it is apparently working.

Is there in issue with who is triggering the build and what permission that person has? Just restarted [0], and that also works:

https://gitlab.com/cip-project/cip-core/isar-cip-core/-/jobs/707992917

Gitlab runner is now working on all repositories.
Thanks!

Quoted 3 lines

Jan

Best regards,
Nobuhiro

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#5288): https://lists.cip-project.org/g/cip-dev/message/5288
Mute This Topic: https://lists.cip-project.org/mt/76423839/4520388
Group Owner: [email protected]
Unsubscribe: https://lists.cip-project.org/g/cip-dev/leave/8129055/727948398/xyzzy [[email protected]]
-=-=-=-=-=-=-=-=-=-=-=-

#8 lore raw
Quoted 21 lines · On 28.08.20 09:11, [email protected] wrote:

Hi Jan,

Quoted 19 lines

-----Original Message-----
From: Jan Kiszka [mailto:[email protected]]
Sent: Friday, August 28, 2020 1:44 PM
To: Nobuhiro Iwamatsu <[email protected]>; [email protected]
Cc: iwamatsu nobuhiro(岩松 信洋 □SWC◯ACT) <[email protected]>; Chris Paterson <[email protected]>; Quirin Gylstorff <[email protected]>
Subject: Re: [cip-dev] Everything failed in gitlab

Quoted 5 lines · Nobuhiro Iwamatsu

Hi all,

This is happening not only in cip-testing (kernel test) but also in cip-core[0][1].
I don't manage these runners. Has anyone changed permissions etc?

I do. Just restarted a build
(https://gitlab.com/cip-project/cip-core/isar-cip-core/-/jobs/707991738), and it is apparently working.

Quoted 8 lines
Quoted 4 lines

Is there in issue with who is triggering the build and what permission that person has? Just restarted [0], and that also works:

https://gitlab.com/cip-project/cip-core/isar-cip-core/-/jobs/707992917

Gitlab runner is now working on all repositories.
Thanks!

...but I didn't change anything for that. I guess is was a temporal hick-up.

Jan

Signature · 2 lines
Siemens AG, Corporate Technology, CT RDA IOT SES-DE
Corporate Competence Center Embedded Linux

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#5289): https://lists.cip-project.org/g/cip-dev/message/5289
Mute This Topic: https://lists.cip-project.org/mt/76423839/4520388
Group Owner: [email protected]
Unsubscribe: https://lists.cip-project.org/g/cip-dev/leave/8129055/727948398/xyzzy [[email protected]]
-=-=-=-=-=-=-=-=-=-=-=-

#9 lore raw

Hi!

Quoted 11 lines
Quoted 11 lines
Quoted 11 lines
Quoted 3 lines

This is happening not only in cip-testing (kernel test) but also in cip-core[0][1].
I don't manage these runners. Has anyone changed permissions etc?

I do. Just restarted a build
(https://gitlab.com/cip-project/cip-core/isar-cip-core/-/jobs/707991738), and it is apparently working.

Is there in issue with who is triggering the build and what permission that person has? Just restarted [0], and that also works:

Quoted 6 lines
Quoted 4 lines
Quoted 1 line

https://gitlab.com/cip-project/cip-core/isar-cip-core/-/jobs/707992917

Gitlab runner is now working on all repositories.
Thanks!

...but I didn't change anything for that. I guess is was a temporal hick-up.

I can confirm that builds now work. Thanks to whoever (or whatever) fixed it :-).

Best regards,
Pavel

Signature · 2 lines
(english) http://www.livejournal.com/~pavelmachek
(cesky, pictures) http://atrey.karlin.mff.cuni.cz/~pavel/picture/horses/blog.html

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#5321): https://lists.cip-project.org/g/cip-dev/message/5321
Mute This Topic: https://lists.cip-project.org/mt/76423839/4520388
Group Owner: [email protected]
Unsubscribe: https://lists.cip-project.org/g/cip-dev/leave/8129055/727948398/xyzzy [[email protected]]
-=-=-=-=-=-=-=-=-=-=-=-