linux-2.6.27-rc3: kernel BUG at fs/nfs/write.c:252
Subsystems (2)
Hi,
Client and server On Intel X86_64 with linux-2.6.27-rc3.
Doing several stress benchmarks simultaneously:
fsstress
iozone (without -U )
fsx
ffsb
cthon
The server crashed.
Here is the trace on the server:
------------[ cut here ]------------ kernel BUG at fs/nfs/write.c:252!
Entering kdb (current=0xffff8800621c78d0, pid 25953) on processor 1 due to KDB_ENTER()
[1]kdb> bt
Stack traceback for pid 259530xffff8800621c78d0 25953 5308 1 1 R 0xffff8800621c7c38 *fsx-linux
sp ip Function (args)0xffff8800660cdb88 0xffffffff80330871 nfs_do_writepage+0xe7 (0xffffe20001770140, invalid, 0xffff8800660cdd18) 0xffff8800660cdbf0 0xffffffff80330cd0 nfs_writepages_callback+0xf (0xffffe20001770140)0xffff8800660cdc10 0xffffffff802657f9 write_cache_pages+0x1ca (0xffff880062402468, 0xffff8800660cddc8, 0xffffffff80330cc1, 0xffff8800660cdd18)0xffff8800660cdd10 0xffffffff80330c95 nfs_writepages+0x72 (0xffff880062402468, 0xffff8800660cddc8)0xffff8800660cdd90 0xffffffff803315b6 __nfs_write_mapping+0x19 (0xffff880062402468, 0xffff8800660cddc8, invalid) 0xffff8800660cddc0 0xffffffff80331655 nfs_write_mapping+0x68 (0xffff880062402468, invalid)0xffff8800660cde30 0xffffffff80331675 nfs_wb_nocommit+0x15 (invalid) 0xffff8800660cde40 0xffffffff80327638 nfs_getattr+0x5c (0xffff88007fbbf1c0, invalid, 0xffff8800660cdef8)0xffff8800660cde80 0xffffffff8028c637 vfs_getattr+0x44 (0xffff88007fbbf1c0, 0xffff8800664e00b8, 0xffff8800660cdef8)0xffff8800660cdec0 0xffffffff8028c687 vfs_fstat+0x33 (invalid, 0xffff8800660cdef8)0xffff8800660cdef0 0xffffffff8028c6b8 sys_newfstat+0x1a (invalid, 0x7fffec90f890)
not matched: from 0xffffffff8020bead to 0xffffffff8020bf25 drop_through 0
bb_jmp[7]bb_special_case: Invalid bb_reg_state.memory, missing trailing entriesbb_special_case: on transfer to int_with_check
system_call_fastpath has memory parameters but no register parameters. Assuming it is a 'pass through' function that does not refer to its register parameters and setting 6 register parameterskdb_bb: 0xffffffff8020be3b [kernel]system_call_fastpath failed at 0xffffffff8020bec8
Using old style backtrace, unreliable with no arguments
sp ip Function (args)0xffff8800660cdb88 0xffffffff80330871 nfs_do_writepage+0xe7 0xffff8800660cdbb0 0xffffffff80330871 nfs_do_writepage+0xe7 0xffff8800660cdbf0 0xffffffff80330cd0 nfs_writepages_callback+0xf 0xffff8800660cdc10 0xffffffff802657f9 write_cache_pages+0x1ca 0xffff8800660cdc20 0xffffffff80330cc1 nfs_writepages_callback 0xffff8800660cdc68 0xffffffff8032d3bc nfs_wait_bit_killable 0xffff8800660cdc80 0xffffffff80603a87 out_of_line_wait_on_bit+0x6e 0xffff8800660cdca8 0xffffffff8023f9b8 wake_bit_function 0xffff8800660cdd10 0xffffffff80330c95 nfs_writepages+0x72 0xffff8800660cdd50 0xffffffff80331c41 nfs_flush_one 0xffff8800660cdd90 0xffffffff803315b6 __nfs_write_mapping+0x19 0xffff8800660cddc0 0xffffffff80331655 nfs_write_mapping+0x68 0xffff8800660cde30 0xffffffff80331675 nfs_wb_nocommit+0x15 0xffff8800660cde40 0xffffffff80327638 nfs_getattr+0x5c 0xffff8800660cde80 0xffffffff8028c637 vfs_getattr+0x44 0xffff8800660cdec0 0xffffffff8028c687 vfs_fstat+0x33 0xffff8800660cdef0 0xffffffff8028c6b8 sys_newfstat+0x1a 0xffff8800660cdf40 0xffffffff80242540 up_write+0x9 0xffff8800660cdf50 0xffffffff802731c5 sys_munmap+0x4d
Bug registered at:
-------------------------------------------------------------
Bug:
http://bugzilla.linux-nfs.org/show_bug.cgi?id=168
Best Regards
Signature · 13 lines
----------------------------------------------------------------- Company : Bull, Architect of an Open World TM (www.bull.com) Name : Aime Le Rouzic Mail : Bull - BP 208 - 38432 Echirolles Cedex - France E-Mail : [email protected] Phone : 33 (4) 76.29.75.51 Fax : 33 (4) 76.29.75.18 ----------------------------------------------------------------- _______________________________________________ NFSv4 mailing list [email protected] http://linux-nfs.org/cgi-bin/mailman/listinfo/nfsv4
Quoted 10 lines · On Fri, Aug 22, 2008 at 09:35:20AM +0200, Le Rouzic wrote:
Hi,
Client and server On IntelX86_64with linux-2.6.27-rc3.Doing several stress benchmarks simultaneously:
fsstress
iozone (without -U )
fsx
ffsb
cthon
Quoted 3 lines
The server crashed.
Here is the trace on the server:
You're sure it's the server? This crash is in client code.
--b.
Quoted 88 lines
------------[ cut here ]------------ kernel BUG at fs/nfs/write.c:252!Entering kdb (current=0xffff8800621c78d0, pid 25953) on processor 1 due to
KDB_ENTER()
[1]kdb> bt
Stack traceback for pid 259530xffff8800621c78d025953 5308 1 1 R0xffff8800621c7c38*fsx-linux
sp ip Function (args)0xffff8800660cdb880xffffffff80330871nfs_do_writepage+0xe7(0xffffe20001770140, invalid,0xffff8800660cdd18)0xffff8800660cdbf00xffffffff80330cd0nfs_writepages_callback+0xf(0xffffe20001770140)0xffff8800660cdc100xffffffff802657f9write_cache_pages+0x1ca(0xffff880062402468,0xffff8800660cddc8,0xffffffff80330cc1,0xffff8800660cdd18)0xffff8800660cdd100xffffffff80330c95nfs_writepages+0x72(0xffff880062402468,0xffff8800660cddc8)0xffff8800660cdd900xffffffff803315b6__nfs_write_mapping+0x19(0xffff880062402468,0xffff8800660cddc8, invalid)0xffff8800660cddc00xffffffff80331655nfs_write_mapping+0x68(0xffff880062402468, invalid)0xffff8800660cde300xffffffff80331675nfs_wb_nocommit+0x15(invalid)0xffff8800660cde400xffffffff80327638nfs_getattr+0x5c(0xffff88007fbbf1c0, invalid,0xffff8800660cdef8)0xffff8800660cde800xffffffff8028c637vfs_getattr+0x44(0xffff88007fbbf1c0,0xffff8800664e00b8,0xffff8800660cdef8)0xffff8800660cdec00xffffffff8028c687vfs_fstat+0x33(invalid,0xffff8800660cdef8)0xffff8800660cdef00xffffffff8028c6b8sys_newfstat+0x1a(invalid,0x7fffec90f890)
not matched: from0xffffffff8020beadto0xffffffff8020bf25drop_through0
bb_jmp[7]bb_special_case: Invalid bb_reg_state.memory, missing trailing entriesbb_special_case: on transfer toint_with_check
system_call_fastpathhas memory parameters but no register parameters. Assuming it is a 'pass through' function that does not refer to its register parameters and setting 6 register parameterskdb_bb:0xffffffff8020be3b[kernel]system_call_fastpath failed at0xffffffff8020bec8Using old style backtrace, unreliable with no arguments
sp ip Function (args)0xffff8800660cdb880xffffffff80330871nfs_do_writepage+0xe70xffff8800660cdbb00xffffffff80330871nfs_do_writepage+0xe70xffff8800660cdbf00xffffffff80330cd0nfs_writepages_callback+0xf0xffff8800660cdc100xffffffff802657f9write_cache_pages+0x1ca0xffff8800660cdc200xffffffff80330cc1nfs_writepages_callback0xffff8800660cdc680xffffffff8032d3bcnfs_wait_bit_killable0xffff8800660cdc800xffffffff80603a87out_of_line_wait_on_bit+0x6e0xffff8800660cdca80xffffffff8023f9b8wake_bit_function0xffff8800660cdd100xffffffff80330c95nfs_writepages+0x720xffff8800660cdd500xffffffff80331c41nfs_flush_one0xffff8800660cdd900xffffffff803315b6__nfs_write_mapping+0x190xffff8800660cddc00xffffffff80331655nfs_write_mapping+0x680xffff8800660cde300xffffffff80331675nfs_wb_nocommit+0x150xffff8800660cde400xffffffff80327638nfs_getattr+0x5c0xffff8800660cde800xffffffff8028c637vfs_getattr+0x440xffff8800660cdec00xffffffff8028c687vfs_fstat+0x330xffff8800660cdef00xffffffff8028c6b8sys_newfstat+0x1a0xffff8800660cdf400xffffffff80242540up_write+0x90xffff8800660cdf500xffffffff802731c5sys_munmap+0x4dBug registered at:
------------------------------------------------------------- Bug:
http://bugzilla.linux-nfs.org/show_bug.cgi?id=168Best Regards
Signature · 13 lines
----------------------------------------------------------------- Company : Bull, Architect of an Open World TM (www.bull.com) Name : Aime Le Rouzic Mail : Bull - BP 208 - 38432 Echirolles Cedex - France E-Mail : [email protected] Phone : 33 (4) 76.29.75.51 Fax : 33 (4) 76.29.75.18 ----------------------------------------------------------------- -- To unsubscribe from this list: send the line "unsubscribe linux-nfs" in the body of a message to [email protected] More majordomo info at http://vger.kernel.org/majordomo-info.html
J. Bruce Fields a =E9crit :
Quoted 15 lines · On Fri, Aug 22, 2008 at 09:35:20AM +0200, Le Rouzic wrote:
=20
Quoted 12 lines
Hi,
Client and server On IntelX86_64with linux-2.6.27-rc3.Doing several stress benchmarks simultaneously:
fsstress
iozone (without -U )
fsx
ffsb
cthonThe server crashed.
Quoted 9 lines
Quoted 3 lines
Here is the trace on the server:
=20You're sure it's the server? This crash is in client code.
--b.
=20
Hi,
You are right. It's on the client side .
Sorry about that.
I made the confusion because this time I inversed the role of my=20
machines.
I can reproduced it . It happens also faster in loopback.
Cheers
Quoted 6 lines
=20
Quoted 4 lines
------------[ cut here ]------------ kernel BUG at fs/nfs/write.c:252!Entering kdb (current=3D0xffff8800621c78d0, pid 25953) on processor 1=
due to
Quoted 4 lines
Quoted 4 lines
KDB_ENTER()
[1]kdb> bt
Stack traceback for pid 259530xffff8800621c78d025953 5308 1 1 R0xffff8800621c7c38=
*fsx-linux
Quoted 9 lines
Quoted 9 lines
sp ip Function (args)
0xffff8800660cdb880xffffffff80330871nfs_do_writepage+0xe7(0xffffe20001770140, invalid,0xffff8800660cdd18)0xffff8800660cdbf00xffffffff80330cd0nfs_writepages_callback+0xf(0xffffe20001770140)0xffff8800660cdc100xffffffff802657f9write_cache_pages+0x1ca(0xffff880062402468,0xffff8800660cddc8,0xffffffff80330cc1,0xffff8800660cdd18)0xffff8800660cdd100xffffffff80330c95nfs_writepages+0x72(0xffff8800=
62402468,
Quoted 7 lines
Quoted 7 lines
0xffff8800660cddc8)0xffff8800660cdd900xffffffff803315b6__nfs_write_mapping+0x19(0xffff880062402468,0xffff8800660cddc8, invalid)0xffff8800660cddc00xffffffff80331655nfs_write_mapping+0x68(0xffff880062402468, invalid)0xffff8800660cde300xffffffff80331675nfs_wb_nocommit+0x15(invalid)0xffff8800660cde400xffffffff80327638nfs_getattr+0x5c(0xffff88007fb=
bf1c0,
Quoted 2 lines
Quoted 2 lines
invalid,
0xffff8800660cdef8)0xffff8800660cde800xffffffff8028c637vfs_getattr+0x44(0xffff88007fb=
bf1c0,
Quoted 6 lines
Quoted 6 lines
0xffff8800664e00b8,0xffff8800660cdef8)0xffff8800660cdec00xffffffff8028c687vfs_fstat+0x33(invalid,0xffff8800660cdef8)0xffff8800660cdef00xffffffff8028c6b8sys_newfstat+0x1a(invalid,0x7fffec90f890)
not matched: from0xffffffff8020beadto0xffffffff8020bf25drop_thro=
ugh 0
Quoted 2 lines
Quoted 2 lines
bb_jmp[7]
bb_special_case: Invalid bb_reg_state.memory, missing trailing entrie=
s
Quoted 2 lines
Quoted 2 lines
bb_special_case: on transfer toint_with_checksystem_call_fastpathhas memory parameters but no register parameter=
s.
Quoted 1 line
Quoted 1 line
Assuming it is a 'pass through' function that does not refer to its =
register
Quoted 35 lines
Quoted 35 lines
parameters and setting 6 register parameters
kdb_bb:0xffffffff8020be3b[kernel]system_call_fastpath failed at0xffffffff8020bec8Using old style backtrace, unreliable with no arguments
sp ip Function (args)0xffff8800660cdb880xffffffff80330871nfs_do_writepage+0xe70xffff8800660cdbb00xffffffff80330871nfs_do_writepage+0xe70xffff8800660cdbf00xffffffff80330cd0nfs_writepages_callback+0xf0xffff8800660cdc100xffffffff802657f9write_cache_pages+0x1ca0xffff8800660cdc200xffffffff80330cc1nfs_writepages_callback0xffff8800660cdc680xffffffff8032d3bcnfs_wait_bit_killable0xffff8800660cdc800xffffffff80603a87out_of_line_wait_on_bit+0x6e0xffff8800660cdca80xffffffff8023f9b8wake_bit_function0xffff8800660cdd100xffffffff80330c95nfs_writepages+0x720xffff8800660cdd500xffffffff80331c41nfs_flush_one0xffff8800660cdd900xffffffff803315b6__nfs_write_mapping+0x190xffff8800660cddc00xffffffff80331655nfs_write_mapping+0x680xffff8800660cde300xffffffff80331675nfs_wb_nocommit+0x150xffff8800660cde400xffffffff80327638nfs_getattr+0x5c0xffff8800660cde800xffffffff8028c637vfs_getattr+0x440xffff8800660cdec00xffffffff8028c687vfs_fstat+0x330xffff8800660cdef00xffffffff8028c6b8sys_newfstat+0x1a0xffff8800660cdf400xffffffff80242540up_write+0x90xffff8800660cdf500xffffffff802731c5sys_munmap+0x4dBug registered at:
------------------------------------------------------------- Bug: =20
http://bugzilla.linux-nfs.org/show_bug.cgi?id=3D168=20
Quoted 6 lines
Quoted 6 lines
Best Regards
--=20
-----------------------------------------------------------------
Company : Bull, Architect of an Open World TM (www.bull.com)
Name : Aime Le Rouzic Mail : Bull - BP 208 - 38432 Echirolles C=
edex=20
Quoted 8 lines
Quoted 8 lines
- France
E-Mail : [email protected]
Phone : 33 (4) 76.29.75.51
Fax : 33 (4) 76.29.75.18
-----------------------------------------------------------------=20--
To unsubscribe from this list: send the line "unsubscribe linux-nfs" =
in
Quoted 6 lines
Quoted 4 lines
the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html
=20----------------------------------------------------------------------=
---
Quoted 1 line
This SF.Net email is sponsored by the Moblin Your Move Developer's cha=
llenge
Quoted 1 line
Build the coolest Linux based applications with Moblin SDK & win great=
prizes
Quoted 1 line
Grand prize is a trip for two to an Open Source event anywhere in the =
world
Quoted 11 lines
http://moblin-contest.org/redirect.php?banner_id=3D100&url=3D/
_______________________________________________
NFS maillist - [email protected]
https://lists.sourceforge.net/lists/listinfo/nfs
_______________________________________________
Please note that [email protected] is being discontinued. Please subscribe to [email protected] instead.
http://vger.kernel.org/vger-lists.html#linux-nfs--
To unsubscribe from this list: send the line "unsubscribe linux-nfs" i=
n
Quoted 6 lines
the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html=20
--=20
-----------------------------------------------------------------
Company : Bull, Architect of an Open World TM (www.bull.com)
Name : Aime Le Rouzic=20
Mail : Bull - BP 208 - 38432 Echirolles Cedex - France
E-Mail : [email protected]
Phone : 33 (4) 76.29.75.51
=46ax : 33 (4) 76.29.75.18
-----------------------------------------------------------------=20
J. Bruce Fields a =E9crit :
Quoted 15 lines · On Fri, Aug 22, 2008 at 09:35:20AM +0200, Le Rouzic wrote:
=20
Quoted 12 lines
Hi,
Client and server On IntelX86_64with linux-2.6.27-rc3.Doing several stress benchmarks simultaneously:
fsstress
iozone (without -U )
fsx
ffsb
cthonThe server crashed.
Quoted 9 lines
Quoted 3 lines
Here is the trace on the server:
=20You're sure it's the server? This crash is in client code.
--b.
=20
Hi,
You are right. It's on the client side .
Sorry about that.
I made the confusion because this time I inversed the role of my=20
machines.
I can reproduced it . It happens also faster in loopback.
Cheers
Quoted 6 lines
=20
Quoted 4 lines
------------[ cut here ]------------ kernel BUG at fs/nfs/write.c:252!Entering kdb (current=3D0xffff8800621c78d0, pid 25953) on processor 1=
due to
Quoted 4 lines
Quoted 4 lines
KDB_ENTER()
[1]kdb> bt
Stack traceback for pid 259530xffff8800621c78d025953 5308 1 1 R0xffff8800621c7c38=
*fsx-linux
Quoted 9 lines
Quoted 9 lines
sp ip Function (args)
0xffff8800660cdb880xffffffff80330871nfs_do_writepage+0xe7(0xffffe20001770140, invalid,0xffff8800660cdd18)0xffff8800660cdbf00xffffffff80330cd0nfs_writepages_callback+0xf(0xffffe20001770140)0xffff8800660cdc100xffffffff802657f9write_cache_pages+0x1ca(0xffff880062402468,0xffff8800660cddc8,0xffffffff80330cc1,0xffff8800660cdd18)0xffff8800660cdd100xffffffff80330c95nfs_writepages+0x72(0xffff8800=
62402468,
Quoted 7 lines
Quoted 7 lines
0xffff8800660cddc8)0xffff8800660cdd900xffffffff803315b6__nfs_write_mapping+0x19(0xffff880062402468,0xffff8800660cddc8, invalid)0xffff8800660cddc00xffffffff80331655nfs_write_mapping+0x68(0xffff880062402468, invalid)0xffff8800660cde300xffffffff80331675nfs_wb_nocommit+0x15(invalid)0xffff8800660cde400xffffffff80327638nfs_getattr+0x5c(0xffff88007fb=
bf1c0,
Quoted 2 lines
Quoted 2 lines
invalid,
0xffff8800660cdef8)0xffff8800660cde800xffffffff8028c637vfs_getattr+0x44(0xffff88007fb=
bf1c0,
Quoted 6 lines
Quoted 6 lines
0xffff8800664e00b8,0xffff8800660cdef8)0xffff8800660cdec00xffffffff8028c687vfs_fstat+0x33(invalid,0xffff8800660cdef8)0xffff8800660cdef00xffffffff8028c6b8sys_newfstat+0x1a(invalid,0x7fffec90f890)
not matched: from0xffffffff8020beadto0xffffffff8020bf25drop_thro=
ugh 0
Quoted 2 lines
Quoted 2 lines
bb_jmp[7]
bb_special_case: Invalid bb_reg_state.memory, missing trailing entrie=
s
Quoted 2 lines
Quoted 2 lines
bb_special_case: on transfer toint_with_checksystem_call_fastpathhas memory parameters but no register parameter=
s.
Quoted 1 line
Quoted 1 line
Assuming it is a 'pass through' function that does not refer to its =
register
Quoted 35 lines
Quoted 35 lines
parameters and setting 6 register parameters
kdb_bb:0xffffffff8020be3b[kernel]system_call_fastpath failed at0xffffffff8020bec8Using old style backtrace, unreliable with no arguments
sp ip Function (args)0xffff8800660cdb880xffffffff80330871nfs_do_writepage+0xe70xffff8800660cdbb00xffffffff80330871nfs_do_writepage+0xe70xffff8800660cdbf00xffffffff80330cd0nfs_writepages_callback+0xf0xffff8800660cdc100xffffffff802657f9write_cache_pages+0x1ca0xffff8800660cdc200xffffffff80330cc1nfs_writepages_callback0xffff8800660cdc680xffffffff8032d3bcnfs_wait_bit_killable0xffff8800660cdc800xffffffff80603a87out_of_line_wait_on_bit+0x6e0xffff8800660cdca80xffffffff8023f9b8wake_bit_function0xffff8800660cdd100xffffffff80330c95nfs_writepages+0x720xffff8800660cdd500xffffffff80331c41nfs_flush_one0xffff8800660cdd900xffffffff803315b6__nfs_write_mapping+0x190xffff8800660cddc00xffffffff80331655nfs_write_mapping+0x680xffff8800660cde300xffffffff80331675nfs_wb_nocommit+0x150xffff8800660cde400xffffffff80327638nfs_getattr+0x5c0xffff8800660cde800xffffffff8028c637vfs_getattr+0x440xffff8800660cdec00xffffffff8028c687vfs_fstat+0x330xffff8800660cdef00xffffffff8028c6b8sys_newfstat+0x1a0xffff8800660cdf400xffffffff80242540up_write+0x90xffff8800660cdf500xffffffff802731c5sys_munmap+0x4dBug registered at:
------------------------------------------------------------- Bug: =20
http://bugzilla.linux-nfs.org/show_bug.cgi?id=3D168=20
Quoted 6 lines
Quoted 6 lines
Best Regards
--=20
-----------------------------------------------------------------
Company : Bull, Architect of an Open World TM (www.bull.com)
Name : Aime Le Rouzic Mail : Bull - BP 208 - 38432 Echirolles C=
edex=20
Quoted 8 lines
Quoted 8 lines
- France
E-Mail : [email protected]
Phone : 33 (4) 76.29.75.51
Fax : 33 (4) 76.29.75.18
-----------------------------------------------------------------=20--
To unsubscribe from this list: send the line "unsubscribe linux-nfs" =
in
Quoted 6 lines
Quoted 4 lines
the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html
=20----------------------------------------------------------------------=
---
Quoted 1 line
This SF.Net email is sponsored by the Moblin Your Move Developer's cha=
llenge
Quoted 1 line
Build the coolest Linux based applications with Moblin SDK & win great=
prizes
Quoted 1 line
Grand prize is a trip for two to an Open Source event anywhere in the =
world
Quoted 11 lines
http://moblin-contest.org/redirect.php?banner_id=3D100&url=3D/
_______________________________________________
NFS maillist - [email protected]
https://lists.sourceforge.net/lists/listinfo/nfs
_______________________________________________
Please note that [email protected] is being discontinued. Please subscribe to [email protected] instead.
http://vger.kernel.org/vger-lists.html#linux-nfs--
To unsubscribe from this list: send the line "unsubscribe linux-nfs" i=
n
Quoted 6 lines
the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html=20
--=20
-----------------------------------------------------------------
Company : Bull, Architect of an Open World TM (www.bull.com)
Name : Aime Le Rouzic=20
Mail : Bull - BP 208 - 38432 Echirolles Cedex - France
E-Mail : [email protected]
Phone : 33 (4) 76.29.75.51
=46ax : 33 (4) 76.29.75.18
-----------------------------------------------------------------=20
-----------------------------------------------------------------------=
--
This SF.Net email is sponsored by the Moblin Your Move Developer's chal= lenge
Build the coolest Linux based applications with Moblin SDK & win great = prizes
Grand prize is a trip for two to an Open Source event anywhere in the w= orld
http://moblin-contest.org/redirect.php?banner_id=3D100&url=3D/
_______________________________________________
NFS maillist - [email protected]
https://lists.sourceforge.net/lists/listinfo/nfs
_______________________________________________
Please note that [email protected] is being discontinued. Please subscribe to [email protected] instead.
http://vger.kernel.org/vger-lists.html#linux-nfs