Skip to contentSkip to conversation

RFC: starting a kernel-testers group for newbies

DISCUSSION [email protected] 3 participants 3 messages May 1, 2008

lore
Share & tools
lore
#0 lore raw
Quoted 7 lines

I'll try to do this:
- create some Wiki page
- get a mailing list at vger
- point newbies to this mailing list
- tell people there which kernels to test
- figure out and document stuff like how to bisect between -next kernels
- help them to do whatever is required for a proper bug report

good idea :)

one more:
reported bugs sometimes get lost in lkml (or elsewhere) and may not get the attention they need.

maybe there are not enough people who put some steadiness into tracking bugs (i.e. put them in bugzilla and make sure they get tracked/resolved) ?

isn`t that something for kernel-testers, too ?

im quite sure that there are people among them who have fun with helping tracking bugs, even if they lack proper programming skills. imho, its not only a matter of knowledge, but maybe manpower, too.

so, wouldn`t it be helpful if there were more people helping the kernel-developers saving time, e.g. by take over the easier tasks like asking bug-reporters for input, help collection of debug-data, help assigning bugs to the right people etc.....

List:       linux-kernel
Subject:    RFC: starting a kernel-testers group for newbies
From:       Adrian Bunk <bunk () kernel ! org>
Date:       2008-05-01 0:31:25
Message-ID: 20080501003125.GM29330 () cs181133002 ! pp ! htv ! fi

[Download message RAW]

Quoted 26 lines · Linus Torvalds
Quoted 4 lines · Andrew Morton

<jumps up and down>

There should be nothing in 2.6.x-rc1 which wasn't in 2.6.x-mm1!

The problem I see with both -mm and linux-next is that they tend to be better at finding the "physical conflict" kind of issues (ie the merge itself fails) than the "code looks ok but doesn't actually work" kind of issue.

Why?

The tester base is simply too small.

Now, if *that* could be improved, that would be wonderful, but I'm not seeing it as very likely.

I think we have fairly good penetration these days with the regular -git tree, but I think that one is quite frankly a *lot* less scary than -mm or -next are, and there it has been an absolutely huge boon to get the kernel into the Fedora test-builds etc (and I _think_ Ubuntu and SuSE also started something like that).

Quoted 3 lines

So I'm very pessimistic about getting a lot of test coverage before -rc1.

Maybe too pessimistic, who knows?

First of all:
I 100% agree with Andrew that our biggest problems are in reviewing code and resolving bugs, not in finding bugs (we already have far too many unresolved bugs).

But although testing mustn't replace code reviews it is a great help, especially for identifying regressions early.

Finding testers should actually be relatively easy since it doesn't require much knowledge from the testers.

And it could even solve a second problem:

It could be a way for getting newbies into kernel development.

We actually do only rarely have tasks suitable as janitor tasks for newbies, and the results of people who do neither know the kernel nor know C running checkpatch on files in the kernel have already been discussed extensively...

I'll try to do this:
- create some Wiki page
- get a mailing list at vger
- point newbies to this mailing list
- tell people there which kernels to test
- figure out and document stuff like how to bisect between -next kernels
- help them to do whatever is required for a proper bug report

Quoted 1 line

Linus

cu
Adrian

Signature · 3 lines
______________________________________________________
Bis 50 MB Dateianhänge? Kein Problem!
http://freemail.web.de/club/landingpage.htm/?mc=025556
#1 lore raw
Quoted 8 lines · [email protected] wrote:
Quoted 7 lines

I'll try to do this:
- create some Wiki page
- get a mailing list at vger
- point newbies to this mailing list
- tell people there which kernels to test
- figure out and document stuff like how to bisect between -next kernels
- help them to do whatever is required for a proper bug report

Quoted 6 lines

good idea :)

one more:
reported bugs sometimes get lost in lkml (or elsewhere) and may not get the attention they need.

maybe there are not enough people who put some steadiness into tracking bugs (i.e. put them in bugzilla and make sure they get tracked/resolved) ?

I would say that this should be one of the main goals - have a team of people who can consistently be assigned bugs for duplication and verification. Getting newly opened bugs reproduced can be half the solution (and a great way to learn the kernel on the side).

often the reporter of the bug never confirms that the bug is fixed - another place where linux testers can help out...

Auke

#2 lore raw
Quoted 14 lines · Auke
Quoted 13 lines · [email protected] wrote:
Quoted 7 lines

I'll try to do this:
- create some Wiki page
- get a mailing list at vger
- point newbies to this mailing list
- tell people there which kernels to test
- figure out and document stuff like how to bisect between -next kernels
- help them to do whatever is required for a proper bug report

good idea :)

one more:
reported bugs sometimes get lost in lkml (or elsewhere) and may not get the attention they need.

Quoted 7 lines
Quoted 1 line

maybe there are not enough people who put some steadiness into tracking bugs (i.e. put them in bugzilla and make sure they get tracked/resolved) ?

I would say that this should be one of the main goals - have a team of people who can consistently be assigned bugs for duplication and verification. Getting newly opened bugs reproduced can be half the solution (and a great way to learn the kernel on the side).
...

That is already working in the kernel Bugzilla for years (with Andrew currently doing most of the work).

You might be in the lucky and unusual position that you have the hardware for reproducing most bugs in the drivers you maintain, but that's nothing that's generally true.

Bugs in e1000 have a good chance of being resolved, if you want a really bad example think of e.g. a bug in some unmaintained ISA network driver

We already have 1350 open bugs in the kernel Bugzilla, and the real problem is not how to track them but to find someone who resolves them.

Quoted 1 line

Auke

cu
Adrian

Signature · 4 lines
       "Is there not promise of rain?" Ling Tan asked suddenly out
        of the darkness. There had been need of rain for many days.
       "Only a promise," Lao Er said.
                                       Pearl S. Buck - Dragon Seed