Skip to contentSkip to conversation

package/netperf: move SITE so s.b.n

PATCH New Baruch Siach 4 participants 13 messages May 27, 2021 – Jun 10, 2021

lore
Share & tools
lore
#0 lore raw

PATCH 1/1 package/netperf: move SITE so s.b.n

The original site is gone.

Fixes:
http://autobuild.buildroot.net/results/8d4a2ef5a7f50ea21b844d6cf806bb83016ae17b/

---
 package/netperf/netperf.mk | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
package/netperf/netperf.mk +1 -1
index 8b2280830f3c..0c423249c4c9 100644
@@ -5,7 +5,7 @@
 ################################################################################
 
 NETPERF_VERSION = 2.7.0
-NETPERF_SITE = ftp://ftp.netperf.org/netperf
+NETPERF_SITE = http://sources.buildroot.net/netperf
 NETPERF_SOURCE = netperf-$(NETPERF_VERSION).tar.bz2
 # gcc 5+ defaults to gnu99 which breaks netperf
 NETPERF_CONF_ENV = \
Signature · 1 line
2.30.2
#1 lore raw

PATCH 1/1 package/netperf: move SITE so s.b.n

Quoted 15 lines · Baruch Siach

The original site is gone.

Fixes:
http://autobuild.buildroot.net/results/8d4a2ef5a7f50ea21b844d6cf806bb83016ae17b/

---
 package/netperf/netperf.mk | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
package/netperf/netperf.mk +0 -0
index 8b2280830f3c..0c423249c4c9 100644

package/netperf/netperf.mk line 8

Quoted 5 lines
package/netperf/netperf.mk +1 -1
@@ -5,7 +5,7 @@
 ################################################################################
 
 NETPERF_VERSION = 2.7.0
-NETPERF_SITE = ftp://ftp.netperf.org/netperf
+NETPERF_SITE = http://sources.buildroot.net/netperf

I believe upstream moved to https://hewlettpackard.github.io/netperf/

That one *does* have a configure script. Still need to check if the tarball has
the same contents though. The hash doesn't match, that's for sure.

Marked as changes requested.

Regards,
Arnout

Quoted 4 lines
package/netperf/netperf.mk +0 -0
 NETPERF_SOURCE = netperf-$(NETPERF_VERSION).tar.bz2
 # gcc 5+ defaults to gnu99 which breaks netperf
 NETPERF_CONF_ENV = \
#2 lore raw

PATCH 1/1 package/netperf: move SITE so s.b.n

Hi Arnout,

Quoted 18 lines · Arnout Vandecappelle
Quoted 17 lines · Baruch Siach

The original site is gone.

Fixes:
http://autobuild.buildroot.net/results/8d4a2ef5a7f50ea21b844d6cf806bb83016ae17b/

---
 package/netperf/netperf.mk | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
package/netperf/netperf.mk +0 -0
index 8b2280830f3c..0c423249c4c9 100644
@@ -5,7 +5,7 @@
 ################################################################################
 
Quoted 8 lines

package/netperf/netperf.mk line 8

Quoted 3 lines
package/netperf/netperf.mk +1 -1
 NETPERF_VERSION = 2.7.0
-NETPERF_SITE = ftp://ftp.netperf.org/netperf
+NETPERF_SITE = http://sources.buildroot.net/netperf

I believe upstream moved to https://hewlettpackard.github.io/netperf/

That one *does* have a configure script. Still need to check if the tarball has
the same contents though. The hash doesn't match, that's for sure.

So what is the right fix here? The new upstream website does not carry the tarball we use.

baruch

Quoted 10 lines

Marked as changes requested.

Regards,
Arnout

Quoted 4 lines
package/netperf/netperf.mk +0 -0
 NETPERF_SOURCE = netperf-$(NETPERF_VERSION).tar.bz2
 # gcc 5+ defaults to gnu99 which breaks netperf
 NETPERF_CONF_ENV = \
Signature · 3 lines
                                                     ~. .~   Tk Open Systems
=}------------------------------------------------ooO--U--Ooo------------{=
   - baruch at tkos.co.il - tel: +972.52.368.4656, http://www.tkos.co.il -
#3 lore raw

PATCH 1/1 package/netperf: move SITE so s.b.n

Quoted 27 lines · Baruch Siach

Hi Arnout,

Quoted 24 lines · Arnout Vandecappelle
Quoted 15 lines · Baruch Siach

The original site is gone.

Fixes:
http://autobuild.buildroot.net/results/8d4a2ef5a7f50ea21b844d6cf806bb83016ae17b/

---
 package/netperf/netperf.mk | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
package/netperf/netperf.mk +0 -0
index 8b2280830f3c..0c423249c4c9 100644

package/netperf/netperf.mk line 8

Quoted 5 lines
package/netperf/netperf.mk +1 -1
@@ -5,7 +5,7 @@
 ################################################################################
 
 NETPERF_VERSION = 2.7.0
-NETPERF_SITE = ftp://ftp.netperf.org/netperf
+NETPERF_SITE = http://sources.buildroot.net/netperf

I believe upstream moved to https://hewlettpackard.github.io/netperf/

Quoted 5 lines
Quoted 2 lines

That one *does* have a configure script. Still need to check if the tarball has
the same contents though. The hash doesn't match, that's for sure.

So what is the right fix here? The new upstream website does not carry the tarball we use.

If the contents is the same (i.e. extract both tarballs and diff -ru them) then
just update the hash.

NO silly me, that doesn't work, because the hash on s.b.o will be different...
I'll just apply this patch as is then. Sorry for the noise.

Regards,
Arnout

#4 lore raw

PATCH 1/1 package/netperf: move SITE so s.b.n

In reply to Baruch Siach
Quoted 6 lines · Baruch Siach

The original site is gone.

Fixes:
http://autobuild.buildroot.net/results/8d4a2ef5a7f50ea21b844d6cf806bb83016ae17b/

Applied to master, thanks.

Regards,
Arnout

Quoted 18 lines
---
 package/netperf/netperf.mk | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
package/netperf/netperf.mk +1 -1
index 8b2280830f3c..0c423249c4c9 100644
@@ -5,7 +5,7 @@
 ################################################################################
 
 NETPERF_VERSION = 2.7.0
-NETPERF_SITE = ftp://ftp.netperf.org/netperf
+NETPERF_SITE = http://sources.buildroot.net/netperf
 NETPERF_SOURCE = netperf-$(NETPERF_VERSION).tar.bz2
 # gcc 5+ defaults to gnu99 which breaks netperf
 NETPERF_CONF_ENV = \
#5 lore raw

PATCH 1/1 package/netperf: move SITE so s.b.n

Gaah, I hit send too soon...

Quoted 26 lines · Arnout Vandecappelle
Quoted 6 lines · Baruch Siach

The original site is gone.

Fixes:
http://autobuild.buildroot.net/results/8d4a2ef5a7f50ea21b844d6cf806bb83016ae17b/

Applied to master, thanks.

Regards,
Arnout

Quoted 11 lines
---
 package/netperf/netperf.mk | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
package/netperf/netperf.mk +0 -0
index 8b2280830f3c..0c423249c4c9 100644
@@ -5,7 +5,7 @@
 ################################################################################
 
Quoted 3 lines

package/netperf/netperf.mk line 8

Quoted 3 lines
package/netperf/netperf.mk +1 -1
 NETPERF_VERSION = 2.7.0
-NETPERF_SITE = ftp://ftp.netperf.org/netperf
+NETPERF_SITE = http://sources.buildroot.net/netperf

We prefer buildroot.org over buildroot.net nowadays, so I changed that.

Regards,
Arnout

Quoted 4 lines
Quoted 4 lines
package/netperf/netperf.mk +0 -0
 NETPERF_SOURCE = netperf-$(NETPERF_VERSION).tar.bz2
 # gcc 5+ defaults to gnu99 which breaks netperf
 NETPERF_CONF_ENV = \
#6 lore raw

PATCH 1/1 package/netperf: move SITE so s.b.n

Hi Arnout,

Quoted 4 lines · Arnout Vandecappelle
Quoted 2 lines

package/netperf/netperf.mk line 8

Quoted 2 lines
package/netperf/netperf.mk +1 -1
-NETPERF_SITE = ftp://ftp.netperf.org/netperf
+NETPERF_SITE = http://sources.buildroot.net/netperf

We prefer buildroot.org over buildroot.net nowadays, so I changed that.

BR2_BACKUP_SITE still defaults to "http://sources.buildroot.net". Should we change that?

baruch

Signature · 3 lines
                                                     ~. .~   Tk Open Systems
=}------------------------------------------------ooO--U--Ooo------------{=
   - baruch at tkos.co.il - tel: +972.52.368.4656, http://www.tkos.co.il -
#7 lore raw

PATCH 1/1 package/netperf: move SITE so s.b.n

Quoted 10 lines · Baruch Siach

Hi Arnout,

Quoted 4 lines · Arnout Vandecappelle
Quoted 2 lines

package/netperf/netperf.mk line 8

Quoted 2 lines
package/netperf/netperf.mk +1 -1
-NETPERF_SITE = ftp://ftp.netperf.org/netperf
+NETPERF_SITE = http://sources.buildroot.net/netperf

We prefer buildroot.org over buildroot.net nowadays, so I changed that.

BR2_BACKUP_SITE still defaults to "http://sources.buildroot.net". Should we change that?

It's just a nice-to-have. I applied your other patch with buildroot.net.

Regards,
Arnout

#8 lore raw

PATCH 1/1 package/netperf: move SITE so s.b.n

In reply to Baruch Siach
Quoted 11 lines
Quoted 1 line
Quoted 1 line
Quoted 1 line
Quoted 1 line

"Baruch" == Baruch Siach <[email protected]> writes:

Hi Arnout,

Quoted 4 lines · Arnout Vandecappelle
Quoted 2 lines

package/netperf/netperf.mk line 8

Quoted 2 lines
package/netperf/netperf.mk +1 -1
-NETPERF_SITE = ftp://ftp.netperf.org/netperf
+NETPERF_SITE = http://sources.buildroot.net/netperf

We prefer buildroot.org over buildroot.net nowadays, so I changed that.

BR2_BACKUP_SITE still defaults to "http://sources.buildroot.net". Should we change that?

There is a fairly important difference between .net and .org, .net is though the cloudflare cache, but .org goes straight to our upstream server.

Given the extra bandwidth and availibility of Cloudflare, I would prefer we use .net.

Signature · 1 line
Bye, Peter Korsgaard
#9 lore raw

PATCH 1/1 package/netperf: move SITE so s.b.n

Quoted 12 lines · Peter Korsgaard
Quoted 11 lines
Quoted 1 line
Quoted 1 line
Quoted 1 line
Quoted 1 line

"Baruch" == Baruch Siach <[email protected]> writes:

Hi Arnout,

Quoted 4 lines · Arnout Vandecappelle
Quoted 2 lines

package/netperf/netperf.mk line 8

Quoted 2 lines
package/netperf/netperf.mk +1 -1
-NETPERF_SITE = ftp://ftp.netperf.org/netperf
+NETPERF_SITE = http://sources.buildroot.net/netperf

We prefer buildroot.org over buildroot.net nowadays, so I changed that.

BR2_BACKUP_SITE still defaults to "http://sources.buildroot.net". Should we change that?

Quoted 6 lines

There is a fairly important difference between .net and .org, .net is though the cloudflare cache, but .org goes straight to our upstream server.

Given the extra bandwidth and availibility of Cloudflare, I would prefer we use .net.

Wouldn't it be possible to route sources.buildroot.org through cloudflare as well?

Regards,
Arnout

#10 lore raw

PATCH 1/1 package/netperf: move SITE so s.b.n

Quoted 1 line
Quoted 1 line
Quoted 1 line
Quoted 1 line
Quoted 1 line

"Arnout" == Arnout Vandecappelle <[email protected]> writes:

Hi,

Quoted 5 lines
Quoted 5 lines
Quoted 4 lines
Quoted 1 line

We prefer buildroot.org over buildroot.net nowadays, so I changed that.

BR2_BACKUP_SITE still defaults to "http://sources.buildroot.net". Should we change that?

Quoted 8 lines
Quoted 6 lines

There is a fairly important difference between .net and .org, .net is though the cloudflare cache, but .org goes straight to our upstream server.

Given the extra bandwidth and availibility of Cloudflare, I would prefer we use .net.

Wouldn't it be possible to route sources.buildroot.org through cloudflare as well?

It would, but there were some complications back when we set it up, E.G. you need to use cloudflares DNS servers and we didn't originally have control of the buildroot.org.

Only having cloudflare on one of the domains was also quite handy for comparing behaviour when debugging in the beginning.

But yeah, we should probably use the same setup for both domains now. We originally put Cloudflare in front because of bandwidth/latency issues with s.b.o for some users. Given that Cloudflare is a bit controversial, it is maybe worth checking if we should keep on using it or drop it.

According to the Cloudflare stats, ~45% of the requests are cached, saving ~1TB traffic/month.

Thomas, I think you had performance issues in the beginning, can you compare speed again?

Signature · 1 line
Bye, Peter Korsgaard
#11 lore raw

PATCH 1/1 package/netperf: move SITE so s.b.n

Peter, All,

On 2021-06-07 22:22 +0200, Peter Korsgaard spake thusly:

Quoted 6 lines
Quoted 2 lines
Quoted 1 line
Quoted 1 line
Quoted 1 line
Quoted 1 line

"Arnout" == Arnout Vandecappelle <[email protected]> writes:

Wouldn't it be possible to route sources.buildroot.org through cloudflare as well?

It would, but there were some complications back when we set it up, E.G. you need to use cloudflares DNS servers and we didn't originally have control of the buildroot.org.

Quoted 7 lines

Only having cloudflare on one of the domains was also quite handy for comparing behaviour when debugging in the beginning.

But yeah, we should probably use the same setup for both domains now. We originally put Cloudflare in front because of bandwidth/latency issues with s.b.o for some users. Given that Cloudflare is a bit controversial, it is maybe worth checking if we should keep on using it or drop it.

I think we should keep s.b.n, and that we should keep it as the default in all our settings: backup mirror, _SOURCES...

Also, I think we should keep s.b.o as uncached, so that we have a fallback.

Quoted 2 lines

According to the Cloudflare stats, ~45% of the requests are cached, saving ~1TB traffic/month.

I have really no idea whether a less-than-half cache-hit ratio is good or not, especially for our use-case.

However, is this 45% ratio a hit ratio, or a volume ratio?

Also, how much of those are due to our autobuilders? To packages without _SOURCES pointing to sbn (i.e. actual fallbacks)?

Quoted 2 lines

Thomas, I think you had performance issues in the beginning, can you compare speed again?

Here are a few totally non-scientific tests, done on a machine that has no caching proxy, and a direct 1Gbps connection to the internet; both URLs where downloaded using wget:

http://sources.buildroot.net/linux/linux-cip-4.19.98-cip19-rt7.tar.gz (CDN)
- first run (uncached?): 2021-06-08 18:21:12 (6.08 MB/s) - ?linux-cip-4.19.98-cip19-rt7.tar.gz? saved [161511299/161511299]
- second run (cached?): 2021-06-08 18:21:20 (88.5 MB/s) - ?linux-cip-4.19.98-cip19-rt7.tar.gz? saved [161511299/161511299]

http://sources.buildroot.org/linux/linux-cip-4.19.98-cip19-rt7.tar.gz (direct)

  - first run (uncached?):  2021-06-08 18:22:40 (4.36 MB/s) - ?linux-cip-4.19.98-cip19-rt7.tar.gz? saved [161511299/161511299]
  - second run (cached?):   2021-06-08 18:23:00 (16.0 MB/s) - ?linux-cip-4.19.98-cip19-rt7.tar.gz? saved [161511299/161511299]
  - third run (cached?):    2021-06-08 18:24:00 (17.2 MB/s) - ?linux-cip-4.19.98-cip19-rt7.tar.gz? saved [161511299/161511299]

http://sources.buildroot.net/linux/linux-cip-4.19.98-cip19-rt7.tar.gz (CDN, again)
- third run (cached?): 2021-06-08 18:24:17 (92.1 MB/s) - ?linux-cip-4.19.98-cip19-rt7.tar.gz? saved [161511299/161511299]

So, basically, the unseeded s.b.n is ~50% faster than unseeded s.b.o. But once seeded s.b.n is ~20 times faster than unseeded s.b.o, and even ~6 times faster than seeded s.b.o.

So the CDN (s.b.n) does have a positive impact.

Regards,
Yann E. MORIN.

Signature · 6 lines
.-----------------.--------------------.------------------.--------------------.
|  Yann E. MORIN  | Real-Time Embedded | /"\ ASCII RIBBON | Erics' conspiracy: |
| +33 662 376 056 | Software  Designer | \ / CAMPAIGN     |  ___               |
| +33 561 099 427 `------------.-------:  X  AGAINST      |  \e/  There is no  |
| http://ymorin.is-a-geek.org/ | _/*\_ | / \ HTML MAIL    |   v   conspiracy.  |
'------------------------------^-------^------------------^--------------------'