Skip to contentSkip to conversation

Recent kernel SMP scalability Benchmark/White-paper References.

DISCUSSION Austin Gonyou 3 participants 7 messages May 23, 2002 – May 24, 2002

lore
Share & tools
lore
#0 lore raw

I was looking around on google web, google groups, lkml digests, Intel.com, RedHat, SuSe, SGI.com, osdl.com, etc for some benchmarks of recent 2.4.x kernels, say 2.4.x > 16, with references to SMP scalability problems or successes, etc. Mainly centering around 4-way/8-way x86 testing in terms of memory bandwidth/utilization, threading performance, etc.

I've not found much in my search so far, and thought at this point it might be best to ask on this list to help shorten the search a bit, if possible. Of the documents I do have, they're more marketing based and not really *technology* based or touch very heavily as to generic benchmarking of a standard Linux kernel on SMP.

I'm hoping to create a white-paper internally, and hopefully externally at some point, which can be maintained so others don't have to do the same arduous task of trying to find recent data as it pertains to said statistics.

Any help as to recent documentation of this nature would be *overly* appreciated!

In addition to this info, I'm trying to gather information as it pertains to the scalability of Linux kernels on 4/8-way x86 systems versus Solaris Sparc 4/8-way systems with measurements of the same statistics.

I fear I'm searching for a document which does not exist. TIA.

#1 lore raw

Hi Austin,

Check out http://lse.sourceforge.net
and http://sourceforge.net/projects/lse

(lse= linux scalability effort)

That might be more information than you were looking for. Another good resource is the lse mailing list at:
[email protected]

We have bi-weekly conference calls where anyone is welcome to join and ask questions or report your work or whatever.

As a developer working on SMP scalability on Linux I would say it is getting better but we still have work to do.

Hanna Linder
IBM Linux Technology Center

Quoted 34 lines · --On Thursday, May 23, 2002 17:41:55 -0500 Austin Gonyou…

I was looking around on google web, google groups, lkml digests, Intel.com, RedHat, SuSe, SGI.com, osdl.com, etc for some benchmarks of recent 2.4.x kernels, say 2.4.x > 16, with references to SMP scalability problems or successes, etc. Mainly centering around 4-way/8-way x86 testing in terms of memory bandwidth/utilization, threading performance, etc.

I've not found much in my search so far, and thought at this point it might be best to ask on this list to help shorten the search a bit, if possible. Of the documents I do have, they're more marketing based and not really *technology* based or touch very heavily as to generic benchmarking of a standard Linux kernel on SMP.

I'm hoping to create a white-paper internally, and hopefully externally at some point, which can be maintained so others don't have to do the same arduous task of trying to find recent data as it pertains to said statistics.

Any help as to recent documentation of this nature would be *overly* appreciated!

In addition to this info, I'm trying to gather information as it pertains to the scalability of Linux kernels on 4/8-way x86 systems versus Solaris Sparc 4/8-way systems with measurements of the same statistics.

I fear I'm searching for a document which does not exist. TIA.

-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/

#2 lore raw
Quoted 5 lines · Hanna Linder

Hi Austin,

Check out http://lse.sourceforge.net
and http://sourceforge.net/projects/lse

Quoted 9 lines

(lse= linux scalability effort)

That might be more information than you were looking for. Another good resource is the lse mailing list at:
[email protected]

We have bi-weekly conference calls where anyone is welcome to join and ask questions or report your work or whatever.

Kewl, I might just see if I can work that in. I saw the LSE, but the documentation out there hadn't been updated in quite some time as well. Same with the SGI Linux Scalability Project. It is old, and seems to center around only MIPS. :(

Quoted 6 lines

As a developer working on SMP scalability on Linux I would say it is getting better but we still have work to do.

Hanna Linder
IBM Linux Technology Center

Would that be the ^^^ one here in tx?

Austin

#3 lore raw
Quoted 5 lines · --On Thursday, May 23, 2002 11:04 PM -0500 Austin Gonyou…
Quoted 3 lines

We have bi-weekly conference calls where anyone is welcome to join and ask questions or report your work or whatever.

Kewl, I might just see if I can work that in. I saw the LSE, but the

Great.

Quoted 1 line

documentation out there hadn't been updated in quite some time as well.

I have updated some 8-way kernel comparisons running dbench as recently as a couple weeks ago. Although, I do not know of any specific Linux(TM) vs Solaris(TM) benchmark results on the lse web site. ;) What benchmark would reflect your workload?

Speaking of OLS, Is there any interest in an lse-tech BOF or get- to-gether of some sort in Ottawa this summer? It would be nice to put some more faces to names from the conference calls.

Quoted 5 lines
Quoted 4 lines

Hanna Linder
IBM Linux Technology Center

Would that be the ^^^ one here in tx?

Same LTC, different state. The LTC engineers live all over the world. I know some of the guys in Austin...

Hanna

#4 lore raw
Quoted 7 lines · Hanna V Linder
Quoted 1 line

documentation out there hadn't been updated in quite some time as well.

I have updated some 8-way kernel comparisons running dbench as recently as a couple weeks ago. Although, I do not know of any specific Linux(TM) vs Solaris(TM) benchmark results on the lse web site. ;) What benchmark would reflect your workload?

Kewl again. I didn't see them, but thanks anyway. I'll check them out.

Quoted 4 lines

Speaking of OLS, Is there any interest in an lse-tech BOF or get- to-gether of some sort in Ottawa this summer? It would be nice to put some more faces to names from the conference calls.

I wish. My company doesn't *send* me anywhere. :)

One last question for the list. Is there a recent 2.2.x vs. 2.4.x SMP kernel comparison available as well? Recent can be as much as 9-10 mo ago, preferably younger though.

#5 lore raw
In reply to Austin Gonyou
Quoted 6 lines · Austin Gonyou

I was looking around on google web, google groups, lkml digests, Intel.com, RedHat, SuSe, SGI.com, osdl.com, etc for some benchmarks of recent 2.4.x kernels, say 2.4.x > 16, with references to SMP scalability problems or successes, etc. Mainly centering around 4-way/8-way x86 testing in terms of memory bandwidth/utilization, threading performance, etc.

All I've found so far is:

http://www.usenix.org/publications/library/proceedings/als2000/full_papers/bryantscale/bryantscale.pdf

which is based on the 2.2.14-SMP -vs- 2.3.99-SMP kernels.

Quoted 4 lines

I'm hoping to create a white-paper internally, and hopefully externally at some point, which can be maintained so others don't have to do the same arduous task of trying to find recent data as it pertains to said statistics.

If you find anything else, or get forwarded any information, please post the relevant information where possible. There are many of us looking for benchmark information on recent 2.4.x kernels. Seems like a few companies/projects are currently looking at the costs/benefits/risks of moving up to the new kernel.

Regards,

Stephane Charette

#6 lore raw
Quoted 9 lines · Stephane Charette
Quoted 6 lines · Austin Gonyou

I was looking around on google web, google groups, lkml digests, Intel.com, RedHat, SuSe, SGI.com, osdl.com, etc for some benchmarks of recent 2.4.x kernels, say 2.4.x > 16, with references to SMP scalability problems or successes, etc. Mainly centering around 4-way/8-way x86 testing in terms of memory bandwidth/utilization, threading performance, etc.

Quoted 4 lines

All I've found so far is:

http://www.usenix.org/publications/library/proceedings/als2000/full_papers/bryantscale/bryantscale.pdf

Yeah..been there, done that. Most stuff I've found is no newer than 2000. :( I really need something recent.

Quoted 9 lines

which is based on the 2.2.14-SMP -vs- 2.3.99-SMP kernels.

Quoted 4 lines

I'm hoping to create a white-paper internally, and hopefully externally at some point, which can be maintained so others don't have to do the same arduous task of trying to find recent data as it pertains to said statistics.

If you find anything else, or get forwarded any information, please post the relevant information where possible. There are many of us looking for benchmark information on recent 2.4.x kernels. Seems like a few companies/projects are currently looking at the costs/benefits/risks of moving up to the new kernel.

That is the plan. Like with my recently completed Multi-Realm Kerberos install docs that I've been working on, everything I collect will get out for public knowledge.Sharing our experiences is the only way to make the world a better place.

Quoted 3 lines

Regards,

Stephane Charette