Skip to contentSkip to conversation

Proxy server related package fetching issues

DISCUSSION Chris Morgan 2 participants 4 messages Nov 21, 2013

lore
Share & tools
lore
#0 lore raw

Hello.

I’ve been working to build an angstrom build and have had some issues with our corporate proxy server blocking the fetching of some packages, either because of the protocol/port or because the site was for some reason flagged. In my case it took several hours to determine that the failure wasn’t due to a missing file, I tried on another network connection and everything worked.

I’m posting here to see if anyone has had similar experience and if so, any details you’d be willing to provide, how you detected/debugged the issue and how long it took, and how you resolved the issue.

Thanks,
Chris

#1 lore raw

Dell - Internal Use - Confidential
For my group, I keep a separate git repository updated with all the required sources. I update the sources offline and set bitbake to not use the network. You can usually download the required sources from the yocto project mirror. --
Michael

-----Original Message-----
From: [email protected] [mailto:[email protected]] On Behalf Of Chris Morgan
Sent: Wednesday, November 20, 2013 6:54 PM
To: [email protected]
Subject: [yocto] Proxy server related package fetching issues

Hello.

I've been working to build an angstrom build and have had some issues with our corporate proxy server blocking the fetching of some packages, either because of the protocol/port or because the site was for some reason flagged. In my case it took several hours to determine that the failure wasn't due to a missing file, I tried on another network connection and everything worked.

I'm posting here to see if anyone has had similar experience and if so, any details you'd be willing to provide, how you detected/debugged the issue and how long it took, and how you resolved the issue.

Thanks,
Chris
_______________________________________________
yocto mailing list
[email protected]
https://lists.yoctoproject.org/listinfo/yocto

#2 lore raw

Hi Michael.

You do that because of the same issue where something on the network is blocking the package fetching? When you say you update the sources offline do you mean from a home network or something?

Chris

From: "[email protected]<mailto:[email protected]>" <[email protected]<mailto:[email protected]>>
Date: Thursday, November 21, 2013 at 1:22 PM
To: Chris Morgan <[email protected]<mailto:[email protected]>>, "[email protected]<mailto:[email protected]>" <[email protected]<mailto:[email protected]>>
Subject: RE: Proxy server related package fetching issues

Dell - Internal Use - Confidential
For my group, I keep a separate git repository updated with all the required sources. I update the sources offline and set bitbake to not use the network. You can usually download the required sources from the yocto project mirror. --
Michael

-----Original Message-----
From: [email protected]<mailto:[email protected]> [mailto:[email protected]] On Behalf Of Chris Morgan
Sent: Wednesday, November 20, 2013 6:54 PM
To: [email protected]<mailto:[email protected]>
Subject: [yocto] Proxy server related package fetching issues

Hello.

I’ve been working to build an angstrom build and have had some issues with our corporate proxy server blocking the fetching of some packages, either because of the protocol/port or because the site was for some reason flagged. In my case it took several hours to determine that the failure wasn’t due to a missing file, I tried on another network connection and everything worked.

I’m posting here to see if anyone has had similar experience and if so, any details you’d be willing to provide, how you detected/debugged the issue and how long it took, and how you resolved the issue.

Thanks,
Chris
_______________________________________________
yocto mailing list [email protected]<mailto:[email protected]>
https://lists.yoctoproject.org/listinfo/yocto

#3 lore raw

Dell - Internal Use - Confidential
We have a Microsoft proxy server which requires NTLM authentication, and it is cumbersome in most cases to retrieve sources from the cli tools. Downloading in a browser helps here, then transferring the files to the git repo. (The 'cntlm' package can help here). For git repositories using the 'git' protocol, there is no way to access the files with the proxy, so I normally just download the tarball from the yocto mirror. For extreme cases, I sometimes download at home and bring in on a USB stick. The main point being that the build process has no network access and I populate everything manually:

#don't really disable all network, as we need network to do sstate BB_NO_NETWORK = "0"
INHERIT += "own-mirrors"
SOURCE_MIRROR_URL = file://${TOPDIR}/../sources/<file:///\\$%7bTOPDIR%7d\..\sources\> BB_GENERATE_MIRROR_TARBALLS = "1"

# this disables everything except premirror
BB_FETCH_PREMIRRORONLY = "1"
CONNECTIVITY_CHECK_URIS=""
DISABLE_NETWORK_SANITY = "1"

-----Original Message-----
From: Chris Morgan [mailto:[email protected]]
Sent: Thursday, November 21, 2013 12:26 PM
To: Brown, Michael E; [email protected]
Subject: Re: Proxy server related package fetching issues

Hi Michael.

You do that because of the same issue where something on the network is blocking the package fetching? When you say you update the sources offline do you mean from a home network or something?

Chris

From: "[email protected]<mailto:[email protected]>" <[email protected]<mailto:[email protected]>>

Date: Thursday, November 21, 2013 at 1:22 PM
To: Chris Morgan <[email protected]<mailto:[email protected]>>, "[email protected]<mailto:[email protected]>" <[email protected]<mailto:[email protected]>>

Subject: RE: Proxy server related package fetching issues

Dell - Internal Use - Confidential
For my group, I keep a separate git repository updated with all the required sources. I update the sources offline and set bitbake to not use the network. You can usually download the required sources from the yocto project mirror.

--
Michael

-----Original Message-----
From: [email protected]<mailto:[email protected]> [mailto:[email protected]] On Behalf Of Chris Morgan

Sent: Wednesday, November 20, 2013 6:54 PM
To: [email protected]<mailto:[email protected]>
Subject: [yocto] Proxy server related package fetching issues

Hello.

I've been working to build an angstrom build and have had some issues with our corporate proxy server blocking the fetching of some packages, either because of the protocol/port or because the site was for some reason flagged. In my case it took several hours to determine that the failure wasn't due to a missing file, I tried on another network connection and everything worked.

I'm posting here to see if anyone has had similar experience and if so, any details you'd be willing to provide, how you detected/debugged the issue and how long it took, and how you resolved the issue.

Thanks,
Chris
_______________________________________________
yocto mailing list [email protected]<mailto:[email protected]>
https://lists.yoctoproject.org/listinfo/yocto