Skip to contentSkip to conversation

Comments and questions about tuning IPTables for high volume

DISCUSSION Pete Davis 2 participants 2 messages Dec 17, 2003

lore
Share & tools
lore

Pete Davis

author
#0 lore raw

I have tuned my IPTables box running Redhat 9 on a dual 1ghz box with 1GB and raid1 scsi160 (2x36gb). It is acting as a temporary replacement (to test throughput/prove the proxy is a bottleneck) for our proxy but it is NOT doing anything other than routing with a few firewall rules to block ICMPs and UDP Microsoft ports (lingering Nachi infections). Here are the parameters I have tuned and other pertinent settings:
ulimit -n 8192
/proc/sys/fs/file-max 104851 /proc/sys/net/ipv4/ip_conntrack_max 65528

sysctl ((Not sure exactly what they mean but these were the defaults... Anyone have explanations for them??):
net.ipv4.tcp_wmem 4096 16384 131072
net.core.wmem_default = 65535
net.core.wmem_max = 131071
(the rmem settings are the same)

I have seen up to 9700 connections in ip_conntrack with 95%+ being HTTP connections. The CPU never goes about 5%. It has 800mb+ free.

Questions:
1) Any suggestions on other tuning? It is just a packet processor (router) with a few rules... less than 20 total. It is protected by a firewall so I don't need rule tuning/suggestions just throughput suggestions. It is servicing 6000+ desktops on an uncapped ds3 (normally capped at 15mb/s but uncapped for testing by the ISP).

2) I tuned sysctl for things like source routing, ICMP echo broadcast, 'martians, etc. I turned on syncookies also. Any sysctl things I may have missed for an IPTables firewall?

3) I have tuned the max number of open files and file descriptors but a cat /proc/sys/fs/file-nr says "240 67 104851", or close to it (not much being used). When I do a "lsof | wc -l", I get a number between 300 and
390. Question: I thought that each connection took one or more file descriptors? (I might be confusing it with FreeBSD, which I also use). I thought the max number of open files was necessary for an IPTables firewall/'router' also, correct??

4) When I do a 'vmstat', I see the number of interrupts steadily climbing up (under 'system' the column labeled 'in'). Once it gets near 300-350, it goes back to zero. It doesn't seem to be tied to the number of connections or any other statistic I can find. I suspect the interrupts are related to the NIC. Any ideas what might be going on? Is this even a concern based on the purpose/performance of the box (It has gotten up to 21mb/s to the internet).

BTW, thanks to all for the help on the syslogd problem. It was set up correctly and 'started' working some time between Thursday night and Monday morning... I have no idea why it took a few hours to kick it but thanks to all anyway.

Pete

#1 lore raw
Quoted 3 lines · Pete Davis

Questions:
1) Any suggestions on other tuning?

You may want to have a look at LARTC:
http://www.lartc.org/

I used these tweaks to push a few boxes with less than half the horsepower of yours up speeds of 300 Mb/s. Only problem I had was with logging, but ULOG should cure that.

HTH,
C