Skip to contentSkip to conversation

cannot fork w/ 1000s of procs (but still mem avail.)

Q Till Immanuel Patzschke 2 participants 2 messages Oct 9, 2001

lore
Share & tools
lore
#0 lore raw

Hi,

hopefully a simple question to answer: I get "cannot fork" messages on my machine running some 20000 processes and threads (1 master proc, 3 threads), where each (master) process opens a socket and does IP traffic over it. Although there is plenty of memory left (4GB box, 2GB used, 0 swap), I get "cannot fork - out of memory" when trying to increase the number of procs. (If none of the procs does IP, I can start more [of course?!].) Anything I can do to increase the number of active processes using IP? Any kernel paramter, limit, sizing?

Many thanks for the help in advance!

Immanuel

--

Till Immanuel Patzschke                 mailto: [email protected]
interNetwork AG                         Phone:  +49-(0)611-1731-121
Bierstadter Str. 7                      Fax:    +49-(0)611-1731-31
D-65189 Wiesbaden                       Web:    http://www.internetwork-ag.de
#1 lore raw
Quoted 8 lines · Till Immanuel Patzschke

hopefully a simple question to answer: I get "cannot fork" messages on my machine running some 20000 processes and threads (1 master proc, 3 threads), where each (master) process opens a socket and does IP traffic over it. Although there is plenty of memory left (4GB box, 2GB used, 0 swap), I get "cannot fork - out of memory" when trying to increase the number of procs. (If none of the procs does IP, I can start more [of course?!].) Anything I can do to increase the number of active processes using IP? Any kernel paramter, limit, sizing?

For efficiency reasons, the kernel and userspace have to share the same 4GB virtual address area. By default this area is split 3:1, with 3GB virtual space available for user programs and 1GB for the kernel.

I suspect in your case it may be worth it to change the kernel to use 2GB of virtual address space for itself and only let userspace have 2GB...

regards,

Rik

Signature · 3 lines
DMCA, SSSCA, W3C?  Who cares?  http://thefreeworld.net/  (volunteers needed)

http://www.surriel.com/		http://distro.conectiva.com/