Skip to contentSkip to conversation

performance problem on nfs in kernel v2.4 and v2.6

DISCUSSION 陈欢 2 participants 2 messages Dec 14, 2005

Subsystems (2)
lore
Share & tools
lore

陈欢

author
#0 lore raw

nfs:

=09
=09I did some test on nfs in linux kernel v2.6 ,but there are some=
problem i can't solve.
=09I need your help!

=09I run iozone on nfs in kernel v2.4.21 and v2.6.11.12 ,the test=
result is as follows:
=09v2.4.21: write performance 106MB/s (wsize,rsize=3D8192)
=09v2.6.11.12: write performance 52MB/s ; (wsize,rsize=3D32768)

=09the iozone test command I use is :
=09=09iozone -c -e -f /mnt/nfs/file1 -s 1g -r 2m -i 0 -w

=09My question is why the performance is lower when using v2.6?

=09The test platform is :
=09=09client: 1G memory,
=09=09server: 4G memory, 146G disk. 2cpu.
=09=09net: 1000Mb

=09When i use the following command to chechk why v2.6 takes much=
more time, I found that the fsync operations takes much more= time. the command is:
=09strace -o result -T write, close, fsync ./iozone -c -e -f=
/mnt/nfs/file1 -s 1g -r 2m -i 0 -w
=09the result of this command is that the time of write is=
6(ms),while the time of sync before close is 6 (s).

=09So what is wrong? how can i see performance improvement of nfs=
in v2.6. Is there any key value I can tune ? Or the problem=
relates to the removal of flushd while introducing pdflush in= client memory management ?

=09Thank you! Waiting for your reply!

------------------------------------------------------------
National Research Center for Intelligent Computing Systems Insitute of Computing Technology
Chinese Academy of Sciences=A1=A1=A1=A1=A1=A1
------------------------------------------------------------
=09=09

=A1=A1=A1=A1=A1=A1=A1=A1=A1=A1=A1=A1=A1=A1=A1=A1 =A1=A1=A1=A1=A1=A1=A1=A1=A1=A1=A1=A1=A1=A1=A1=A1huanchen@ncic.ac.cn =A1=A1=A1=A1=A1=A1=A1=A1=A1=A1=A1=A1=A1=A1=A1=A1=A1=A1=A1=A12005-12-14

-------------------------------------------------------
This SF.net email is sponsored by: Splunk Inc. Do you grep through log files for problems? Stop! Download the new AJAX search engine that makes searching your log files as easy as surfing the web. DOWNLOAD SPLUNK!
http://ads.osdn.com/?ad_id=7637&alloc_id=16865&op=click
_______________________________________________
NFS maillist - [email protected]
https://lists.sourceforge.net/lists/listinfo/nfs

#1 lore raw

huanchen-

you tell us which kernels you've tried, but it's not clear whether you are switching the client or the server kernel.

also, what export options do you use on the server? and what file system?

Quoted 43 lines · 陈欢

nfs:

I did some test on nfs in linux kernel v2.6 ,but there are some problem i can't solve. I need your help!

I run iozone on nfs in kernel v2.4.21 and v2.6.11.12 ,the test result is as follows:
v2.4.21: write performance 106MB/s (wsize,rsize=8192)
v2.6.11.12: write performance 52MB/s ; (wsize,rsize=32768)

the iozone test command I use is :
iozone -c -e -f /mnt/nfs/file1 -s 1g -r 2m -i 0 -w

My question is why the performance is lower when using v2.6?

The test platform is :
client: 1G memory,
server: 4G memory, 146G disk. 2cpu.
net: 1000Mb

When i use the following command to chechk why v2.6 takes much more time, I found that the fsync operations takes much more time. the command is:
strace -o result -T write, close, fsync ./iozone -c -e -f /mnt/nfs/file1 -s 1g -r 2m -i 0 -w
the result of this command is that the time of write is 6(ms),while the time of sync before close is 6 (s).

So what is wrong? how can i see performance improvement of nfs in v2.6. Is there any key value I can tune ? Or the problem relates to the removal of flushd while introducing pdflush in client memory management ?

Thank you! Waiting for your reply!

------------------------------------------------------------
National Research Center for Intelligent Computing Systems Insitute of Computing Technology
Chinese Academy of Sciences
------------------------------------------------------------


        [email protected]
          2005-12-14

Quoted 8 lines

-------------------------------------------------------
This SF.net email is sponsored by: Splunk Inc. Do you grep through log files for problems? Stop! Download the new AJAX search engine that makes searching your log files as easy as surfing the web. DOWNLOAD SPLUNK!
http://ads.osdn.com/?ad_idv37&alloc_id865&op=click
_______________________________________________
NFS maillist - [email protected]
https://lists.sourceforge.net/lists/listinfo/nfs

begin:vcard
fn:Chuck Lever
n:Lever;Chuck
org:Network Appliance, Incorporated;Open Source NFS Client Engineering email;internet:[email protected]
title:Member of Technical Staff
x-mozilla-html:FALSE
url:http://www.monkey.org/~cel
version:2.1
end:vcard