Skip to contentSkip to conversation

linux-2.6.27-rc3: kernel BUG at fs/nfs/write.c:252

DISCUSSION Le Rouzic 2 participants 4 messages Aug 22, 2008 – Aug 25, 2008

Subsystems (2)
lore
Share & tools
lore

Le Rouzic

author
#0 lore raw

Hi,
Client and server On Intel X86_64 with linux-2.6.27-rc3.

Doing several stress benchmarks simultaneously:
fsstress
iozone (without -U )
fsx
ffsb
cthon

The server crashed.

Here is the trace on the server:

------------[ cut here ]------------
kernel BUG at fs/nfs/write.c:252!

Entering kdb (current=0xffff8800621c78d0, pid 25953) on processor 1 due to KDB_ENTER()
[1]kdb> bt
Stack traceback for pid 25953
0xffff8800621c78d0 25953 5308 1 1 R 0xffff8800621c7c38 *fsx-linux
sp ip Function (args)
0xffff8800660cdb88 0xffffffff80330871 nfs_do_writepage+0xe7 (0xffffe20001770140, invalid, 0xffff8800660cdd18) 0xffff8800660cdbf0 0xffffffff80330cd0 nfs_writepages_callback+0xf (0xffffe20001770140)
0xffff8800660cdc10 0xffffffff802657f9 write_cache_pages+0x1ca (0xffff880062402468, 0xffff8800660cddc8, 0xffffffff80330cc1, 0xffff8800660cdd18)
0xffff8800660cdd10 0xffffffff80330c95 nfs_writepages+0x72 (0xffff880062402468, 0xffff8800660cddc8)
0xffff8800660cdd90 0xffffffff803315b6 __nfs_write_mapping+0x19 (0xffff880062402468, 0xffff8800660cddc8, invalid) 0xffff8800660cddc0 0xffffffff80331655 nfs_write_mapping+0x68 (0xffff880062402468, invalid)
0xffff8800660cde30 0xffffffff80331675 nfs_wb_nocommit+0x15 (invalid) 0xffff8800660cde40 0xffffffff80327638 nfs_getattr+0x5c (0xffff88007fbbf1c0, invalid, 0xffff8800660cdef8)
0xffff8800660cde80 0xffffffff8028c637 vfs_getattr+0x44 (0xffff88007fbbf1c0, 0xffff8800664e00b8, 0xffff8800660cdef8)
0xffff8800660cdec0 0xffffffff8028c687 vfs_fstat+0x33 (invalid, 0xffff8800660cdef8)
0xffff8800660cdef0 0xffffffff8028c6b8 sys_newfstat+0x1a (invalid, 0x7fffec90f890)
not matched: from 0xffffffff8020bead to 0xffffffff8020bf25 drop_through 0
bb_jmp[7]
bb_special_case: Invalid bb_reg_state.memory, missing trailing entries
bb_special_case: on transfer to int_with_check
system_call_fastpath has memory parameters but no register parameters. Assuming it is a 'pass through' function that does not refer to its register parameters and setting 6 register parameters
kdb_bb: 0xffffffff8020be3b [kernel]system_call_fastpath failed at 0xffffffff8020bec8

Using old style backtrace, unreliable with no arguments
sp ip Function (args)
0xffff8800660cdb88 0xffffffff80330871 nfs_do_writepage+0xe7 0xffff8800660cdbb0 0xffffffff80330871 nfs_do_writepage+0xe7 0xffff8800660cdbf0 0xffffffff80330cd0 nfs_writepages_callback+0xf 0xffff8800660cdc10 0xffffffff802657f9 write_cache_pages+0x1ca 0xffff8800660cdc20 0xffffffff80330cc1 nfs_writepages_callback 0xffff8800660cdc68 0xffffffff8032d3bc nfs_wait_bit_killable 0xffff8800660cdc80 0xffffffff80603a87 out_of_line_wait_on_bit+0x6e 0xffff8800660cdca8 0xffffffff8023f9b8 wake_bit_function 0xffff8800660cdd10 0xffffffff80330c95 nfs_writepages+0x72 0xffff8800660cdd50 0xffffffff80331c41 nfs_flush_one 0xffff8800660cdd90 0xffffffff803315b6 __nfs_write_mapping+0x19 0xffff8800660cddc0 0xffffffff80331655 nfs_write_mapping+0x68 0xffff8800660cde30 0xffffffff80331675 nfs_wb_nocommit+0x15 0xffff8800660cde40 0xffffffff80327638 nfs_getattr+0x5c 0xffff8800660cde80 0xffffffff8028c637 vfs_getattr+0x44 0xffff8800660cdec0 0xffffffff8028c687 vfs_fstat+0x33 0xffff8800660cdef0 0xffffffff8028c6b8 sys_newfstat+0x1a 0xffff8800660cdf40 0xffffffff80242540 up_write+0x9 0xffff8800660cdf50 0xffffffff802731c5 sys_munmap+0x4d

Bug registered at:

-------------------------------------------------------------
Bug:
http://bugzilla.linux-nfs.org/show_bug.cgi?id=168

Best Regards

Signature · 13 lines
-----------------------------------------------------------------
Company : Bull, Architect of an Open World TM (www.bull.com)
Name    : Aime Le Rouzic 
Mail    : Bull - BP 208 - 38432 Echirolles Cedex - France
E-Mail  : [email protected]
Phone   : 33 (4) 76.29.75.51
Fax     : 33 (4) 76.29.75.18
----------------------------------------------------------------- 

_______________________________________________
NFSv4 mailing list
[email protected]
http://linux-nfs.org/cgi-bin/mailman/listinfo/nfsv4
#1 lore raw
Quoted 10 lines · On Fri, Aug 22, 2008 at 09:35:20AM +0200, Le Rouzic wrote:

Hi,
Client and server On Intel X86_64 with linux-2.6.27-rc3.

Doing several stress benchmarks simultaneously:
fsstress
iozone (without -U )
fsx
ffsb
cthon

Quoted 3 lines

The server crashed.

Here is the trace on the server:

You're sure it's the server? This crash is in client code.

--b.

Quoted 88 lines
------------[ cut here ]------------
kernel BUG at fs/nfs/write.c:252!

Entering kdb (current=0xffff8800621c78d0, pid 25953) on processor 1 due to KDB_ENTER()
[1]kdb> bt
Stack traceback for pid 25953
0xffff8800621c78d0 25953 5308 1 1 R 0xffff8800621c7c38 *fsx-linux
sp ip Function (args)
0xffff8800660cdb88 0xffffffff80330871 nfs_do_writepage+0xe7 (0xffffe20001770140, invalid, 0xffff8800660cdd18) 0xffff8800660cdbf0 0xffffffff80330cd0 nfs_writepages_callback+0xf (0xffffe20001770140)
0xffff8800660cdc10 0xffffffff802657f9 write_cache_pages+0x1ca (0xffff880062402468, 0xffff8800660cddc8, 0xffffffff80330cc1, 0xffff8800660cdd18)
0xffff8800660cdd10 0xffffffff80330c95 nfs_writepages+0x72 (0xffff880062402468, 0xffff8800660cddc8)
0xffff8800660cdd90 0xffffffff803315b6 __nfs_write_mapping+0x19 (0xffff880062402468, 0xffff8800660cddc8, invalid) 0xffff8800660cddc0 0xffffffff80331655 nfs_write_mapping+0x68 (0xffff880062402468, invalid)
0xffff8800660cde30 0xffffffff80331675 nfs_wb_nocommit+0x15 (invalid) 0xffff8800660cde40 0xffffffff80327638 nfs_getattr+0x5c (0xffff88007fbbf1c0, invalid, 0xffff8800660cdef8)
0xffff8800660cde80 0xffffffff8028c637 vfs_getattr+0x44 (0xffff88007fbbf1c0, 0xffff8800664e00b8, 0xffff8800660cdef8)
0xffff8800660cdec0 0xffffffff8028c687 vfs_fstat+0x33 (invalid, 0xffff8800660cdef8)
0xffff8800660cdef0 0xffffffff8028c6b8 sys_newfstat+0x1a (invalid, 0x7fffec90f890)
not matched: from 0xffffffff8020bead to 0xffffffff8020bf25 drop_through 0
bb_jmp[7]
bb_special_case: Invalid bb_reg_state.memory, missing trailing entries
bb_special_case: on transfer to int_with_check
system_call_fastpath has memory parameters but no register parameters. Assuming it is a 'pass through' function that does not refer to its register parameters and setting 6 register parameters
kdb_bb: 0xffffffff8020be3b [kernel]system_call_fastpath failed at 0xffffffff8020bec8

Using old style backtrace, unreliable with no arguments
sp ip Function (args)
0xffff8800660cdb88 0xffffffff80330871 nfs_do_writepage+0xe7 0xffff8800660cdbb0 0xffffffff80330871 nfs_do_writepage+0xe7 0xffff8800660cdbf0 0xffffffff80330cd0 nfs_writepages_callback+0xf 0xffff8800660cdc10 0xffffffff802657f9 write_cache_pages+0x1ca 0xffff8800660cdc20 0xffffffff80330cc1 nfs_writepages_callback 0xffff8800660cdc68 0xffffffff8032d3bc nfs_wait_bit_killable 0xffff8800660cdc80 0xffffffff80603a87 out_of_line_wait_on_bit+0x6e 0xffff8800660cdca8 0xffffffff8023f9b8 wake_bit_function 0xffff8800660cdd10 0xffffffff80330c95 nfs_writepages+0x72 0xffff8800660cdd50 0xffffffff80331c41 nfs_flush_one 0xffff8800660cdd90 0xffffffff803315b6 __nfs_write_mapping+0x19 0xffff8800660cddc0 0xffffffff80331655 nfs_write_mapping+0x68 0xffff8800660cde30 0xffffffff80331675 nfs_wb_nocommit+0x15 0xffff8800660cde40 0xffffffff80327638 nfs_getattr+0x5c 0xffff8800660cde80 0xffffffff8028c637 vfs_getattr+0x44 0xffff8800660cdec0 0xffffffff8028c687 vfs_fstat+0x33 0xffff8800660cdef0 0xffffffff8028c6b8 sys_newfstat+0x1a 0xffff8800660cdf40 0xffffffff80242540 up_write+0x9 0xffff8800660cdf50 0xffffffff802731c5 sys_munmap+0x4d

Bug registered at:

------------------------------------------------------------- Bug:
http://bugzilla.linux-nfs.org/show_bug.cgi?id=168

Best Regards

Signature · 13 lines
-----------------------------------------------------------------
Company : Bull, Architect of an Open World TM (www.bull.com)
Name    : Aime Le Rouzic Mail    : Bull - BP 208 - 38432 Echirolles Cedex 
- France
E-Mail  : [email protected]
Phone   : 33 (4) 76.29.75.51
Fax     : 33 (4) 76.29.75.18
----------------------------------------------------------------- 

--
To unsubscribe from this list: send the line "unsubscribe linux-nfs" in
the body of a message to [email protected]
More majordomo info at  http://vger.kernel.org/majordomo-info.html
author
#2 lore raw

J. Bruce Fields a =E9crit :

Quoted 15 lines · On Fri, Aug 22, 2008 at 09:35:20AM +0200, Le Rouzic wrote:

=20

Quoted 12 lines

Hi,
Client and server On Intel X86_64 with linux-2.6.27-rc3.

Doing several stress benchmarks simultaneously:
fsstress
iozone (without -U )
fsx
ffsb
cthon

The server crashed.

Quoted 9 lines
Quoted 3 lines

Here is the trace on the server:
=20

You're sure it's the server? This crash is in client code.

--b.
=20

Hi,
You are right. It's on the client side .
Sorry about that.
I made the confusion because this time I inversed the role of my=20
machines.
I can reproduced it . It happens also faster in loopback.

Cheers

Quoted 6 lines

=20

Quoted 4 lines
------------[ cut here ]------------
kernel BUG at fs/nfs/write.c:252!

Entering kdb (current=3D0xffff8800621c78d0, pid 25953) on processor 1=

due to

Quoted 4 lines
Quoted 4 lines

KDB_ENTER()
[1]kdb> bt
Stack traceback for pid 25953
0xffff8800621c78d0 25953 5308 1 1 R 0xffff8800621c7c38 =

*fsx-linux

Quoted 9 lines
Quoted 9 lines

sp ip Function (args)
0xffff8800660cdb88 0xffffffff80330871 nfs_do_writepage+0xe7 (0xffffe20001770140, invalid, 0xffff8800660cdd18) 0xffff8800660cdbf0 0xffffffff80330cd0 nfs_writepages_callback+0xf (0xffffe20001770140)
0xffff8800660cdc10 0xffffffff802657f9 write_cache_pages+0x1ca (0xffff880062402468, 0xffff8800660cddc8, 0xffffffff80330cc1, 0xffff8800660cdd18)
0xffff8800660cdd10 0xffffffff80330c95 nfs_writepages+0x72 (0xffff8800=

62402468,

Quoted 7 lines
Quoted 7 lines

0xffff8800660cddc8)
0xffff8800660cdd90 0xffffffff803315b6 __nfs_write_mapping+0x19 (0xffff880062402468, 0xffff8800660cddc8, invalid) 0xffff8800660cddc0 0xffffffff80331655 nfs_write_mapping+0x68 (0xffff880062402468, invalid)
0xffff8800660cde30 0xffffffff80331675 nfs_wb_nocommit+0x15 (invalid) 0xffff8800660cde40 0xffffffff80327638 nfs_getattr+0x5c (0xffff88007fb=

bf1c0,

Quoted 2 lines
Quoted 2 lines

invalid, 0xffff8800660cdef8)
0xffff8800660cde80 0xffffffff8028c637 vfs_getattr+0x44 (0xffff88007fb=

bf1c0,

Quoted 6 lines
Quoted 6 lines

0xffff8800664e00b8, 0xffff8800660cdef8)
0xffff8800660cdec0 0xffffffff8028c687 vfs_fstat+0x33 (invalid, 0xffff8800660cdef8)
0xffff8800660cdef0 0xffffffff8028c6b8 sys_newfstat+0x1a (invalid, 0x7fffec90f890)
not matched: from 0xffffffff8020bead to 0xffffffff8020bf25 drop_thro=

ugh 0

Quoted 2 lines
Quoted 2 lines

bb_jmp[7]
bb_special_case: Invalid bb_reg_state.memory, missing trailing entrie=

s

Quoted 2 lines
Quoted 2 lines

bb_special_case: on transfer to int_with_check system_call_fastpath has memory parameters but no register parameter=

s.

Quoted 1 line
Quoted 1 line

Assuming it is a 'pass through' function that does not refer to its =

register

Quoted 35 lines
Quoted 35 lines

parameters and setting 6 register parameters
kdb_bb: 0xffffffff8020be3b [kernel]system_call_fastpath failed at 0xffffffff8020bec8

Using old style backtrace, unreliable with no arguments
sp ip Function (args)
0xffff8800660cdb88 0xffffffff80330871 nfs_do_writepage+0xe7 0xffff8800660cdbb0 0xffffffff80330871 nfs_do_writepage+0xe7 0xffff8800660cdbf0 0xffffffff80330cd0 nfs_writepages_callback+0xf 0xffff8800660cdc10 0xffffffff802657f9 write_cache_pages+0x1ca 0xffff8800660cdc20 0xffffffff80330cc1 nfs_writepages_callback 0xffff8800660cdc68 0xffffffff8032d3bc nfs_wait_bit_killable 0xffff8800660cdc80 0xffffffff80603a87 out_of_line_wait_on_bit+0x6e 0xffff8800660cdca8 0xffffffff8023f9b8 wake_bit_function 0xffff8800660cdd10 0xffffffff80330c95 nfs_writepages+0x72 0xffff8800660cdd50 0xffffffff80331c41 nfs_flush_one 0xffff8800660cdd90 0xffffffff803315b6 __nfs_write_mapping+0x19 0xffff8800660cddc0 0xffffffff80331655 nfs_write_mapping+0x68 0xffff8800660cde30 0xffffffff80331675 nfs_wb_nocommit+0x15 0xffff8800660cde40 0xffffffff80327638 nfs_getattr+0x5c 0xffff8800660cde80 0xffffffff8028c637 vfs_getattr+0x44 0xffff8800660cdec0 0xffffffff8028c687 vfs_fstat+0x33 0xffff8800660cdef0 0xffffffff8028c6b8 sys_newfstat+0x1a 0xffff8800660cdf40 0xffffffff80242540 up_write+0x9 0xffff8800660cdf50 0xffffffff802731c5 sys_munmap+0x4d

Bug registered at:

------------------------------------------------------------- Bug: =20
http://bugzilla.linux-nfs.org/show_bug.cgi?id=3D168=20

Quoted 6 lines
Quoted 6 lines

Best Regards

--=20
-----------------------------------------------------------------
Company : Bull, Architect of an Open World TM (www.bull.com)
Name : Aime Le Rouzic Mail : Bull - BP 208 - 38432 Echirolles C=

edex=20

Quoted 8 lines
Quoted 8 lines

- France
E-Mail : [email protected]
Phone : 33 (4) 76.29.75.51
Fax : 33 (4) 76.29.75.18
-----------------------------------------------------------------=20

--
To unsubscribe from this list: send the line "unsubscribe linux-nfs" =

in

Quoted 6 lines
Quoted 4 lines

the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html
=20

----------------------------------------------------------------------=

---

Quoted 1 line

This SF.Net email is sponsored by the Moblin Your Move Developer's cha=

llenge

Quoted 1 line

Build the coolest Linux based applications with Moblin SDK & win great=

prizes

Quoted 1 line

Grand prize is a trip for two to an Open Source event anywhere in the =

world

Quoted 11 lines

http://moblin-contest.org/redirect.php?banner_id=3D100&url=3D/
_______________________________________________
NFS maillist - [email protected]
https://lists.sourceforge.net/lists/listinfo/nfs
_______________________________________________
Please note that [email protected] is being discontinued. Please subscribe to [email protected] instead.
http://vger.kernel.org/vger-lists.html#linux-nfs

--
To unsubscribe from this list: send the line "unsubscribe linux-nfs" i=

n

Quoted 6 lines

the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html

=20

--=20
-----------------------------------------------------------------
Company : Bull, Architect of an Open World TM (www.bull.com)
Name : Aime Le Rouzic=20
Mail : Bull - BP 208 - 38432 Echirolles Cedex - France
E-Mail : [email protected]
Phone : 33 (4) 76.29.75.51
=46ax : 33 (4) 76.29.75.18
-----------------------------------------------------------------=20

author
#3 lore raw
In reply to J. Bruce Fields

J. Bruce Fields a =E9crit :

Quoted 15 lines · On Fri, Aug 22, 2008 at 09:35:20AM +0200, Le Rouzic wrote:

=20

Quoted 12 lines

Hi,
Client and server On Intel X86_64 with linux-2.6.27-rc3.

Doing several stress benchmarks simultaneously:
fsstress
iozone (without -U )
fsx
ffsb
cthon

The server crashed.

Quoted 9 lines
Quoted 3 lines

Here is the trace on the server:
=20

You're sure it's the server? This crash is in client code.

--b.
=20

Hi,
You are right. It's on the client side .
Sorry about that.
I made the confusion because this time I inversed the role of my=20
machines.
I can reproduced it . It happens also faster in loopback.

Cheers

Quoted 6 lines

=20

Quoted 4 lines
------------[ cut here ]------------
kernel BUG at fs/nfs/write.c:252!

Entering kdb (current=3D0xffff8800621c78d0, pid 25953) on processor 1=

due to

Quoted 4 lines
Quoted 4 lines

KDB_ENTER()
[1]kdb> bt
Stack traceback for pid 25953
0xffff8800621c78d0 25953 5308 1 1 R 0xffff8800621c7c38 =

*fsx-linux

Quoted 9 lines
Quoted 9 lines

sp ip Function (args)
0xffff8800660cdb88 0xffffffff80330871 nfs_do_writepage+0xe7 (0xffffe20001770140, invalid, 0xffff8800660cdd18) 0xffff8800660cdbf0 0xffffffff80330cd0 nfs_writepages_callback+0xf (0xffffe20001770140)
0xffff8800660cdc10 0xffffffff802657f9 write_cache_pages+0x1ca (0xffff880062402468, 0xffff8800660cddc8, 0xffffffff80330cc1, 0xffff8800660cdd18)
0xffff8800660cdd10 0xffffffff80330c95 nfs_writepages+0x72 (0xffff8800=

62402468,

Quoted 7 lines
Quoted 7 lines

0xffff8800660cddc8)
0xffff8800660cdd90 0xffffffff803315b6 __nfs_write_mapping+0x19 (0xffff880062402468, 0xffff8800660cddc8, invalid) 0xffff8800660cddc0 0xffffffff80331655 nfs_write_mapping+0x68 (0xffff880062402468, invalid)
0xffff8800660cde30 0xffffffff80331675 nfs_wb_nocommit+0x15 (invalid) 0xffff8800660cde40 0xffffffff80327638 nfs_getattr+0x5c (0xffff88007fb=

bf1c0,

Quoted 2 lines
Quoted 2 lines

invalid, 0xffff8800660cdef8)
0xffff8800660cde80 0xffffffff8028c637 vfs_getattr+0x44 (0xffff88007fb=

bf1c0,

Quoted 6 lines
Quoted 6 lines

0xffff8800664e00b8, 0xffff8800660cdef8)
0xffff8800660cdec0 0xffffffff8028c687 vfs_fstat+0x33 (invalid, 0xffff8800660cdef8)
0xffff8800660cdef0 0xffffffff8028c6b8 sys_newfstat+0x1a (invalid, 0x7fffec90f890)
not matched: from 0xffffffff8020bead to 0xffffffff8020bf25 drop_thro=

ugh 0

Quoted 2 lines
Quoted 2 lines

bb_jmp[7]
bb_special_case: Invalid bb_reg_state.memory, missing trailing entrie=

s

Quoted 2 lines
Quoted 2 lines

bb_special_case: on transfer to int_with_check system_call_fastpath has memory parameters but no register parameter=

s.

Quoted 1 line
Quoted 1 line

Assuming it is a 'pass through' function that does not refer to its =

register

Quoted 35 lines
Quoted 35 lines

parameters and setting 6 register parameters
kdb_bb: 0xffffffff8020be3b [kernel]system_call_fastpath failed at 0xffffffff8020bec8

Using old style backtrace, unreliable with no arguments
sp ip Function (args)
0xffff8800660cdb88 0xffffffff80330871 nfs_do_writepage+0xe7 0xffff8800660cdbb0 0xffffffff80330871 nfs_do_writepage+0xe7 0xffff8800660cdbf0 0xffffffff80330cd0 nfs_writepages_callback+0xf 0xffff8800660cdc10 0xffffffff802657f9 write_cache_pages+0x1ca 0xffff8800660cdc20 0xffffffff80330cc1 nfs_writepages_callback 0xffff8800660cdc68 0xffffffff8032d3bc nfs_wait_bit_killable 0xffff8800660cdc80 0xffffffff80603a87 out_of_line_wait_on_bit+0x6e 0xffff8800660cdca8 0xffffffff8023f9b8 wake_bit_function 0xffff8800660cdd10 0xffffffff80330c95 nfs_writepages+0x72 0xffff8800660cdd50 0xffffffff80331c41 nfs_flush_one 0xffff8800660cdd90 0xffffffff803315b6 __nfs_write_mapping+0x19 0xffff8800660cddc0 0xffffffff80331655 nfs_write_mapping+0x68 0xffff8800660cde30 0xffffffff80331675 nfs_wb_nocommit+0x15 0xffff8800660cde40 0xffffffff80327638 nfs_getattr+0x5c 0xffff8800660cde80 0xffffffff8028c637 vfs_getattr+0x44 0xffff8800660cdec0 0xffffffff8028c687 vfs_fstat+0x33 0xffff8800660cdef0 0xffffffff8028c6b8 sys_newfstat+0x1a 0xffff8800660cdf40 0xffffffff80242540 up_write+0x9 0xffff8800660cdf50 0xffffffff802731c5 sys_munmap+0x4d

Bug registered at:

------------------------------------------------------------- Bug: =20
http://bugzilla.linux-nfs.org/show_bug.cgi?id=3D168=20

Quoted 6 lines
Quoted 6 lines

Best Regards

--=20
-----------------------------------------------------------------
Company : Bull, Architect of an Open World TM (www.bull.com)
Name : Aime Le Rouzic Mail : Bull - BP 208 - 38432 Echirolles C=

edex=20

Quoted 8 lines
Quoted 8 lines

- France
E-Mail : [email protected]
Phone : 33 (4) 76.29.75.51
Fax : 33 (4) 76.29.75.18
-----------------------------------------------------------------=20

--
To unsubscribe from this list: send the line "unsubscribe linux-nfs" =

in

Quoted 6 lines
Quoted 4 lines

the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html
=20

----------------------------------------------------------------------=

---

Quoted 1 line

This SF.Net email is sponsored by the Moblin Your Move Developer's cha=

llenge

Quoted 1 line

Build the coolest Linux based applications with Moblin SDK & win great=

prizes

Quoted 1 line

Grand prize is a trip for two to an Open Source event anywhere in the =

world

Quoted 11 lines

http://moblin-contest.org/redirect.php?banner_id=3D100&url=3D/
_______________________________________________
NFS maillist - [email protected]
https://lists.sourceforge.net/lists/listinfo/nfs
_______________________________________________
Please note that [email protected] is being discontinued. Please subscribe to [email protected] instead.
http://vger.kernel.org/vger-lists.html#linux-nfs

--
To unsubscribe from this list: send the line "unsubscribe linux-nfs" i=

n

Quoted 6 lines

the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html

=20

--=20
-----------------------------------------------------------------
Company : Bull, Architect of an Open World TM (www.bull.com)
Name : Aime Le Rouzic=20
Mail : Bull - BP 208 - 38432 Echirolles Cedex - France
E-Mail : [email protected]
Phone : 33 (4) 76.29.75.51
=46ax : 33 (4) 76.29.75.18
-----------------------------------------------------------------=20

-----------------------------------------------------------------------=
--
This SF.Net email is sponsored by the Moblin Your Move Developer's chal= lenge
Build the coolest Linux based applications with Moblin SDK & win great = prizes
Grand prize is a trip for two to an Open Source event anywhere in the w= orld
http://moblin-contest.org/redirect.php?banner_id=3D100&url=3D/
_______________________________________________
NFS maillist - [email protected]
https://lists.sourceforge.net/lists/listinfo/nfs
_______________________________________________
Please note that [email protected] is being discontinued. Please subscribe to [email protected] instead.
http://vger.kernel.org/vger-lists.html#linux-nfs