cannot fork w/ 1000s of procs (but still mem avail.)
Hi,
hopefully a simple question to answer: I get "cannot fork" messages on my machine running some 20000 processes and threads (1 master proc, 3 threads), where each (master) process opens a socket and does IP traffic over it. Although there is plenty of memory left (4GB box, 2GB used, 0 swap), I get "cannot fork - out of memory" when trying to increase the number of procs. (If none of the procs does IP, I can start more [of course?!].) Anything I can do to increase the number of active processes using IP? Any kernel paramter, limit, sizing?
Many thanks for the help in advance!
Immanuel
--
Till Immanuel Patzschke mailto: [email protected] interNetwork AG Phone: +49-(0)611-1731-121 Bierstadter Str. 7 Fax: +49-(0)611-1731-31 D-65189 Wiesbaden Web: http://www.internetwork-ag.de
Quoted 8 lines · Till Immanuel Patzschke
hopefully a simple question to answer: I get "cannot fork" messages on my machine running some 20000 processes and threads (1 master proc, 3 threads), where each (master) process opens a socket and does IP traffic over it. Although there is plenty of memory left (4GB box, 2GB used, 0 swap), I get "cannot fork - out of memory" when trying to increase the number of procs. (If none of the procs does IP, I can start more [of course?!].) Anything I can do to increase the number of active processes using IP? Any kernel paramter, limit, sizing?
For efficiency reasons, the kernel and userspace have to share the same 4GB virtual address area. By default this area is split 3:1, with 3GB virtual space available for user programs and 1GB for the kernel.
I suspect in your case it may be worth it to change the kernel to use 2GB of virtual address space for itself and only let userspace have 2GB...
regards,
Rik
Signature · 3 lines
DMCA, SSSCA, W3C? Who cares? http://thefreeworld.net/ (volunteers needed) http://www.surriel.com/ http://distro.conectiva.com/