Skip to contentSkip to conversation

Status of >800 mounts

DISCUSSION Michael Blandford 5 participants 11 messages May 6, 2004 – Jun 14, 2004 1 message not in the archive Kernel automounter

lore
Share & tools
lore
#0 lore raw

Hello,

What is the current status of having more than 800 nfs mounts ( on 2.4 and 2.6 )?

I had heard there might be a patch to use one port per server instead of per mount.

Thanks,

Michael

Disclaimer: The content of this message is my personal opinion only and although I am an employee of Intel, the statements I make here in no way represent Intel's position on the issue, nor am I authorized to speak on behalf of Intel on this matter.

#1 lore raw
Quoted 8 lines · Michael Blandford

Hello,

What is the current status of having more than 800 nfs mounts ( on 2.4 and 2.6 )?

I had heard there might be a patch to use one port per server instead of per mount.

i am working on a patch currently which multiplexes nfs connections per sever so you end up with a 800 server limit, similar to the way nfsv4 works now.. i will send it out for review very soon after i ferret out a few bugs.

another idea we had was to add SO_REUSEADDR to rpc sockets so you have more available on a busy system.

Signature · 1 line
Stew Smith
#3 lore raw
In reply to a message not in the archive
Quoted 4 lines · Chris Croswhite

Why only up to 800 (although this is a large number)? There are instances where I could have 1200-1600 clients connecting to the same server (4 way opteron) if I could that many...

this limit has been hardcoded in the sunrpc layer since the birth of time. it starts at 800 and counts down to 0 until it find an unused port. requring a privileged port gets you the default level of security NFSv3 provides...

anybody know why rpc doesn't use the full port 0-1023 range?

--
Stew Smith

maintainer
#4 lore raw
In reply to Stew Smith
Quoted 6 lines · Stew Smith
Quoted 5 lines · Michael Blandford

Hello,

What is the current status of having more than 800 nfs mounts ( on 2.4 and 2.6 )?

Quoted 9 lines
Quoted 3 lines

I had heard there might be a patch to use one port per server instead of per mount.

i am working on a patch currently which multiplexes nfs connections per sever so you end up with a 800 server limit, similar to the way nfsv4 works now.. i will send it out for review very soon after i ferret out a few bugs.

I tried porting a patch of Tronds' for 2.5, forward for 2.6 and backward to 2.4. My understanding of the NFS/rpc code was (is) not sufficient to be confident with this. When I asked for someone to check and comment on what I had done I got only silence. At least I think I posted that to the list?

After that I tried to merge it into a RedHat kernel, which proved to be too much for me to do at the time.

I look forward to seeing your patch.

Ian

#5 lore raw
Quoted 4 lines · Ian Kent
Quoted 4 lines

i am working on a patch currently which multiplexes nfs connections per sever so you end up with a 800 server limit, similar to the way nfsv4 works now.. i will send it out for review very soon after i ferret out a few bugs.

With an early version of Stew's patch, I hit over 2000 simultaneous NFS mounts. Once the last bugs are out, we can call this one closed, I think.

:)

Signature · 4 lines
Tim Hockin
Sun Microsystems, Linux Software Engineering
[email protected]
All opinions are my own, not Sun's
maintainer
#6 lore raw
Quoted 9 lines · Tim Hockin
Quoted 4 lines · Ian Kent
Quoted 4 lines

i am working on a patch currently which multiplexes nfs connections per sever so you end up with a 800 server limit, similar to the way nfsv4 works now.. i will send it out for review very soon after i ferret out a few bugs.

With an early version of Stew's patch, I hit over 2000 simultaneous NFS mounts. Once the last bugs are out, we can call this one closed, I think.

Will it cover 2.4 as well or is it 2.6 only?

Ian

#7 lore raw
Quoted 4 lines · Ian Kent
Quoted 2 lines

With an early version of Stew's patch, I hit over 2000 simultaneous NFS mounts. Once the last bugs are out, we can call this one closed, I think.

Will it cover 2.4 as well or is it 2.6 only?

It's developed on 2.6. The backport is left as an excercize for the user :)

maintainer
#8 lore raw
Quoted 7 lines · Tim Hockin
Quoted 4 lines · Ian Kent
Quoted 2 lines

With an early version of Stew's patch, I hit over 2000 simultaneous NFS mounts. Once the last bugs are out, we can call this one closed, I think.

Will it cover 2.4 as well or is it 2.6 only?

It's developed on 2.6. The backport is left as an excercize for the user :)

Let me at it! Please!

#9 lore raw
In reply to Stew Smith

==> Regarding Re: [autofs] Status of >800 mounts; Stew Smith <[email protected]> adds:

stew.smith> On Thu, May 06, 2004 at 10:48:44AM -0700, Michael Blandford

Quoted 8 lines · stew.smith> wrote:
Quoted 8 lines

Hello,

What is the current status of having more than 800 nfs mounts ( on 2.4 and 2.6 )?

I had heard there might be a patch to use one port per server instead of per mount.

stew.smith> i am working on a patch currently which multiplexes nfs stew.smith> connections per sever so you end up with a 800 server limit, stew.smith> similar to the way nfsv4 works now.. i will send it out for stew.smith> review very soon after i ferret out a few bugs.

stew.smith> another idea we had was to add SO_REUSEADDR to rpc sockets so stew.smith> you have more available on a busy system.

Are you going to post the patches (or have you already) to the linux-nfs list? If enough people find it useful, would be nice to get it upstream.

-Jeff

#10 lore raw
In reply to Stew Smith
Quoted 10 lines · Stew Smith

i am working on a patch currently which multiplexes nfs connections per sever so you end up with a 800 server limit, similar to the way nfsv4 works now.. i will send it out for review very soon after i ferret out a few bugs.

another idea we had was to add SO_REUSEADDR to rpc sockets so you have more available on a busy system.

any updates on this patch?

Michael

Disclaimer: The content of this message is my personal opinion only and although I am an employee of Intel, the statements I make here in no way represent Intel's position on the issue, nor am I authorized to speak on behalf of Intel on this matter.

#11 lore raw
Quoted 7 lines · Michael Blandford
Quoted 5 lines · Stew Smith

i am working on a patch currently which multiplexes nfs connections per sever so you end up with a 800 server limit, similar to the way nfsv4 works now.. i will send it out for review very soon after i ferret out a few bugs.

Quoted 6 lines
Quoted 5 lines

another idea we had was to add SO_REUSEADDR to rpc sockets so you have more available on a busy system.

any updates on this patch?

we have code ready for review and testing but are awaiting legal clearance to release it by Sun.

i will send it out the momment i am able to do so.

thanks,

--Stew