strange swap usage with ac branch of 2.4.19-pre9/10
The only thing I have that gives any hint as to what is using memory is /proc/meminfo and free .
total: used: free: shared: buffers: cached:
Mem: 660455424 653500416 6955008 0 5558272 56893440 Swap: 1091526656 48332800 1043193856 MemTotal: 644976 kB MemFree: 6792 kB MemShared: 0 kB Buffers: 5428 kB Cached: 40688 kB SwapCached: 14872 kB Active: 71176 kB Inact_dirty: 26196 kB Inact_clean: 14768 kB Inact_target: 22428 kB HighTotal: 0 kB HighFree: 0 kB LowTotal: 644976 kB LowFree: 6792 kB SwapTotal: 1065944 kB SwapFree: 1018744 kB Committed_AS: 229088 kB
total used free shared buffers cached Mem: 644976 638200 6776 0 7168 42560 -/+ buffers/cache: 588472 56504
Swap: 1065944 56624 1009320
now, usually it's people complaining about all this cache being used in ram and their system swapping despite this cache. But here it's obviously a problem with buffers. I get a gradual increase in buffers as time goes by and after 2 days it is at what it is at now, after X
crashed. I've restarted my normal array of programs I have running all
the time and ps and top both show very little memory being used by any single program, nothing that could account for 560MB of buffers.
So where do these buffers come from and how can I find out? I'm assuming it's a userlevel program causing all this buffer to be used but then if that's the case, why does it not show up as being used by it in ps ?
closing X doesn't seem to release all the buffer or even much, so I assume it's something running as a daemon (mysql or apache or whatever) but then again, they are using almost no memory at all according to ps
USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND root 1 0.0 0.0 1272 436 ? S Jun15 0:07 init [2] root 2 0.0 0.0 0 0 ? SW Jun15 0:01 [keventd] root 3 0.0 0.0 0 0 ? SWN Jun15 0:00 [ksoftirqd_CPU0] root 4 0.0 0.0 0 0 ? SW Jun15 0:04 [kswapd] root 5 0.0 0.0 0 0 ? SW Jun15 0:00 [bdflush] root 6 0.0 0.0 0 0 ? SW Jun15 0:00 [kupdated] root 7 0.0 0.0 0 0 ? SW Jun15 0:01 [kjournald] root 36 0.0 0.0 1512 500 ? S Jun15 0:00 /sbin/devfsd /dev root 69 0.0 0.0 0 0 ? SW Jun15 0:00 [khubd] root 89 0.0 0.0 0 0 ? SW Jun15 0:01 [msp3410 [auto]] root 129 0.0 0.0 0 0 ? SW Jun15 0:03 [kjournald] root 130 0.0 0.0 0 0 ? SW Jun15 0:00 [kjournald] root 131 0.0 0.0 0 0 ? SW Jun15 0:00 [kjournald] root 132 0.0 0.0 0 0 ? SW Jun15 0:01 [kjournald] root 133 0.0 0.0 0 0 ? SW Jun15 0:01 [kjournald] root 134 0.0 0.0 0 0 ? SW Jun15 0:00 [kjournald] root 135 0.0 0.0 0 0 ? SW Jun15 0:00 [kjournald] root 136 0.0 0.0 0 0 ? SW Jun15 0:01 [kjournald] root 137 0.0 0.0 0 0 ? SW Jun15 0:00 [kjournald] daemon 160 0.0 0.0 1384 320 ? S Jun15 0:00 /sbin/portmap root 240 0.0 0.0 2036 580 ? S Jun15 0:00 /sbin/syslogd root 243 0.0 0.0 1968 396 ? S Jun15 0:00 /sbin/klogd root 327 0.0 0.0 1552 448 ? S Jun15 0:00 /usr/sbin/gpm -m /dev/usbmouse -t imps2 root 333 0.0 0.0 1996 500 ? S Jun15 0:00 /usr/sbin/inetd root 355 0.0 0.1 2180 836 ? S Jun15 0:00 /bin/sh /usr/bin/safe_mysqld mysql 392 0.0 0.1 37660 652 ? S Jun15 0:00 /usr/sbin/mysqld --basedir=/usr --datadir=/var/lib/mysql --user=mysql --pid-file=/var/run/mysqld/mysqld.pid --skip-locking mysql 394 0.0 0.1 37660 652 ? S Jun15 0:00 /usr/sbin/mysqld --basedir=/usr --datadir=/var/lib/mysql --user=mysql --pid-file=/var/run/mysqld/mysqld.pid --skip-locking mysql 395 0.0 0.1 37660 652 ? S Jun15 0:00 /usr/sbin/mysqld --basedir=/usr --datadir=/var/lib/mysql --user=mysql --pid-file=/var/run/mysqld/mysqld.pid --skip-locking mysql 396 0.0 0.1 37660 652 ? S Jun15 0:00 /usr/sbin/mysqld --basedir=/usr --datadir=/var/lib/mysql --user=mysql --pid-file=/var/run/mysqld/mysqld.pid --skip-locking root 407 0.0 0.1 2764 716 ? S Jun15 0:00 /usr/sbin/nmbd -D root 409 0.0 0.0 3764 448 ? S Jun15 0:00 /usr/sbin/smbd -D root 415 0.0 0.0 2684 452 ? S Jun15 0:00 /usr/sbin/sshd root 418 0.0 0.3 1976 1968 ? SL Jun15 0:00 /usr/sbin/ntpd nobody 422 0.0 0.0 2624 600 ? S Jun15 0:00 proftpd (accepting connections) daemon 425 0.0 0.0 1384 468 ? S Jun15 0:00 /usr/sbin/atd root 428 0.0 0.0 1652 540 ? S Jun15 0:00 /usr/sbin/cron root 432 0.0 0.1 2240 912 vc/1 S Jun15 0:00 -bash root 433 0.0 0.0 1256 396 vc/2 S Jun15 0:00 /sbin/getty 38400 tty2 root 434 0.0 0.0 1256 396 vc/3 S Jun15 0:00 /sbin/getty 38400 tty3 root 435 0.0 0.0 1256 396 vc/4 S Jun15 0:00 /sbin/getty 38400 tty4 root 436 0.0 0.0 1256 396 vc/5 S Jun15 0:00 /sbin/getty 38400 tty5 root 437 0.0 0.0 1256 396 vc/6 S Jun15 0:00 /sbin/getty 38400 tty6 root 8678 0.0 0.0 5648 620 ? S Jun17 0:00 /usr/local/apache/bin/httpd www-data 8679 0.0 0.1 8392 668 ? S Jun17 0:00 /usr/local/apache/bin/httpd www-data 8680 0.0 0.1 8428 656 ? S Jun17 0:00 /usr/local/apache/bin/httpd www-data 8681 0.0 0.1 8288 648 ? S Jun17 0:00 /usr/local/apache/bin/httpd www-data 8682 0.0 0.1 8388 676 ? S Jun17 0:00 /usr/local/apache/bin/httpd www-data 8683 0.0 0.1 8492 696 ? S Jun17 0:00 /usr/local/apache/bin/httpd www-data 8695 0.0 0.1 8456 664 ? S Jun17 0:00 /usr/local/apache/bin/httpd www-data 8965 0.0 0.1 8388 648 ? S Jun17 0:00 /usr/local/apache/bin/httpd www-data 11351 0.0 0.1 8108 704 ? S Jun17 0:00 /usr/local/apache/bin/httpd www-data 11381 0.0 0.0 0 0 ? Z Jun17 0:00 [httpd <defunct>] root 5705 0.0 0.1 2304 680 vc/1 S 00:28 0:00 /usr/bin/perl ./decibel.pl root 5710 0.0 0.1 2032 756 vc/1 S 00:28 0:00 /bin/sh /usr/bin/X11/startx root 5711 0.0 0.0 2184 548 vc/1 S 00:28 0:00 xinit -- -dpi 100 root 5712 0.8 1.9 83636 12740 ? S< 00:28 0:25 X :0 -dpi 100 root 5717 0.0 0.1 2028 748 vc/1 S 00:28 0:00 sh /root/.xinitrc root 5718 0.0 0.4 6656 2940 vc/1 S 00:28 0:01 sawfish root 5722 0.0 0.3 8100 2412 tty1 S 00:28 0:00 rep /usr/lib/sawfish/1.0.1/i386-pc-linux-gnu/sawfish-menu root 5729 0.0 0.3 5976 1996 vc/1 S 00:28 0:00 /usr/bin/Eterm root 5732 0.0 0.1 2232 1092 pts/0 S 00:28 0:00 -bash root 5740 0.0 0.3 6064 2288 vc/1 S 00:28 0:00 /usr/bin/Eterm root 5743 0.0 0.1 2236 1096 pts/1 S 00:28 0:00 -bash root 5748 0.0 0.2 5976 1732 vc/1 S 00:28 0:00 /usr/bin/Eterm root 5752 0.0 0.1 2228 944 pts/2 S 00:28 0:00 -bash root 5759 0.0 0.2 5916 1860 vc/1 S 00:28 0:01 /usr/bin/Eterm root 5762 0.0 0.1 2228 944 pts/3 S 00:28 0:00 -bash root 5773 0.0 0.2 5740 1896 vc/1 S 00:28 0:00 /usr/bin/Eterm root 5776 0.0 0.1 2228 944 pts/4 S 00:28 0:00 -bash root 5796 0.0 0.2 6336 1760 vc/1 S 00:28 0:00 /usr/bin/Eterm root 5799 0.0 0.1 2228 944 pts/5 S 00:28 0:00 -bash root 5808 0.0 0.5 13368 3284 vc/1 S 00:28 0:00 licq -p gtk_gui root 5809 0.0 0.5 13368 3284 vc/1 S 00:28 0:00 licq -p gtk_gui root 5810 0.0 0.5 13368 3284 vc/1 S 00:28 0:00 licq -p gtk_gui root 5811 0.0 0.5 13368 3284 vc/1 S 00:28 0:00 licq -p gtk_gui root 5812 0.0 0.5 13368 3284 vc/1 S 00:28 0:00 licq -p gtk_gui root 5826 0.0 0.7 9400 4640 vc/1 S 00:29 0:01 gaim safemode 5857 0.0 0.1 2216 944 pts/5 S 00:29 0:00 bash safemode 5861 0.0 0.2 2876 1396 pts/5 S 00:29 0:00 epic diemen.nl.eu.undernet.org safemode 5875 0.0 0.2 4520 1768 ? S 00:29 0:00 xterm -geometry 80x24 -reverse -bg black -fg white -fa lucida console -fs 8 -e /usr/local/libexec/wserv localhost 37758 safemode 5876 0.0 0.0 2004 576 pts/6 S 00:29 0:00 /usr/local/libexec/wserv localhost 37758 safemode 5877 0.0 0.2 4520 1780 ? S 00:29 0:00 xterm -geometry 80x24 -reverse -bg black -fg white -fa lucida console -fs 8 -e /usr/local/libexec/wserv localhost 37760 safemode 5878 0.0 0.0 2004 576 pts/7 S 00:29 0:00 /usr/local/libexec/wserv localhost 37760 safemode 5879 0.0 0.2 4520 1896 ? S 00:29 0:00 xterm -geometry 80x24 -reverse -bg black -fg white -fa lucida console -fs 8 -e /usr/local/libexec/wserv localhost 37762 safemode 5880 0.0 0.0 2004 576 pts/8 S 00:29 0:00 /usr/local/libexec/wserv localhost 37762 root 5897 0.0 0.3 5984 2492 pts/1 S 00:30 0:00 gprocmeter3 root 5912 0.0 0.1 1772 660 pts/3 S 00:30 0:02 telnet icebox 1111 root 5952 0.0 0.0 1772 616 pts/4 S 00:31 0:00 telnet icebox 1111 root 5967 0.0 0.1 2424 740 pts/2 S 00:31 0:00 alsamixer root 5975 0.0 0.6 26812 4308 vc/1 S 00:31 0:00 freeamp root 5977 0.0 0.6 26812 4308 vc/1 S 00:31 0:00 freeamp root 5978 0.0 0.6 26812 4308 vc/1 S 00:31 0:00 freeamp root 5979 0.0 0.6 26812 4308 vc/1 S 00:31 0:00 freeamp root 5980 0.0 0.6 26812 4308 vc/1 S 00:31 0:00 freeamp root 5983 0.0 0.6 26812 4308 vc/1 S 00:31 0:00 freeamp root 5985 0.0 0.6 26812 4308 vc/1 S 00:31 0:00 freeamp root 6015 0.0 1.0 18736 6888 vc/1 S 00:32 0:01 evolution root 6018 0.0 0.1 3312 1108 ? S 00:32 0:00 oafd --ac-activate --ior-output-fd=9 root 6023 0.0 0.5 20664 3592 ? S 00:32 0:00 /usr/lib/evolution/wombat --oaf-activate-iid=OAFIID:Bonobo_Moniker_wombat_Factory --oaf-ior-fd=10 root 6029 0.0 0.4 9716 3020 ? S 00:32 0:00 bonobo-moniker-xmldb --oaf-activate-iid=OAFIID:Bonobo_Moniker_xmldb_Factory --oaf-ior-fd=12 root 6033 0.0 0.8 46132 5564 ? S 00:32 0:00 /usr/lib/evolution/evolution-executive-summary --oaf-activate-iid=OAFIID:GNOME_Evolution_Summary_ShellComponent --oaf-ior-fd=14 root 6037 0.0 0.6 20560 4196 ? S 00:32 0:00 /usr/lib/evolution/evolution-calendar --oaf-activate-iid=OAFIID:GNOME_Evolution_Calendar_ShellComponent --oaf-ior-fd=15 root 6042 0.0 0.5 17276 3384 ? S 00:32 0:00 /usr/lib/evolution/evolution-alarm-notify --oaf-activate-iid=OAFIID:GNOME_Evolution_Calendar_AlarmNotify_Factory --oaf-ior-fd=16 root 6048 0.2 2.5 39092 16476 ? S 00:32 0:05 /usr/lib/evolution/evolution-mail --oaf-activate-iid=OAFIID:GNOME_Evolution_Mail_ShellComponent --oaf-ior-fd=18 root 6053 0.0 0.7 19952 5104 ? S 00:32 0:00 /usr/lib/evolution/evolution-addressbook --oaf-activate-iid=OAFIID:GNOME_Evolution_Addressbook_ShellComponent --oaf-ior-fd=19 root 6058 0.0 2.5 39092 16476 ? S 00:32 0:00 /usr/lib/evolution/evolution-mail --oaf-activate-iid=OAFIID:GNOME_Evolution_Mail_ShellComponent --oaf-ior-fd=18 root 6059 0.0 2.5 39092 16476 ? S 00:32 0:00 /usr/lib/evolution/evolution-mail --oaf-activate-iid=OAFIID:GNOME_Evolution_Mail_ShellComponent --oaf-ior-fd=18 root 6061 0.0 2.5 39092 16476 ? S 00:32 0:00 /usr/lib/evolution/evolution-mail --oaf-activate-iid=OAFIID:GNOME_Evolution_Mail_ShellComponent --oaf-ior-fd=18 root 6062 0.0 2.5 39092 16476 ? S 00:32 0:02 /usr/lib/evolution/evolution-mail --oaf-activate-iid=OAFIID:GNOME_Evolution_Mail_ShellComponent --oaf-ior-fd=18 root 6089 0.0 0.1 2996 1240 ? S 00:32 0:00 /usr/bin/gconfd-1 22 root 6090 0.0 0.8 46132 5564 ? S 00:32 0:00 /usr/lib/evolution/evolution-executive-summary --oaf-activate-iid=OAFIID:GNOME_Evolution_Summary_ShellComponent --oaf-ior-fd=14 root 6091 0.0 0.8 46132 5564 ? S 00:32 0:00 /usr/lib/evolution/evolution-executive-summary --oaf-activate-iid=OAFIID:GNOME_Evolution_Summary_ShellComponent --oaf-ior-fd=14 root 6092 0.0 0.8 46132 5564 ? S 00:32 0:00 /usr/lib/evolution/evolution-executive-summary --oaf-activate-iid=OAFIID:GNOME_Evolution_Summary_ShellComponent --oaf-ior-fd=14 root 6093 0.0 0.8 46132 5564 ? S 00:32 0:00 /usr/lib/evolution/evolution-executive-summary --oaf-activate-iid=OAFIID:GNOME_Evolution_Summary_ShellComponent --oaf-ior-fd=14 root 6094 0.0 0.8 46132 5564 ? S 00:32 0:00 /usr/lib/evolution/evolution-executive-summary --oaf-activate-iid=OAFIID:GNOME_Evolution_Summary_ShellComponent --oaf-ior-fd=14 root 6095 0.0 0.8 46132 5564 ? S 00:32 0:00 /usr/lib/evolution/evolution-executive-summary --oaf-activate-iid=OAFIID:GNOME_Evolution_Summary_ShellComponent --oaf-ior-fd=14 root 6096 0.0 0.8 46132 5564 ? S 00:32 0:00 /usr/lib/evolution/evolution-executive-summary --oaf-activate-iid=OAFIID:GNOME_Evolution_Summary_ShellComponent --oaf-ior-fd=14 root 6097 0.0 0.8 46132 5564 ? S 00:32 0:00 /usr/lib/evolution/evolution-executive-summary --oaf-activate-iid=OAFIID:GNOME_Evolution_Summary_ShellComponent --oaf-ior-fd=14 root 6098 0.0 0.8 46132 5564 ? S 00:32 0:00 /usr/lib/evolution/evolution-executive-summary --oaf-activate-iid=OAFIID:GNOME_Evolution_Summary_ShellComponent --oaf-ior-fd=14 root 6099 0.0 0.8 46132 5564 ? S 00:32 0:00 /usr/lib/evolution/evolution-executive-summary --oaf-activate-iid=OAFIID:GNOME_Evolution_Summary_ShellComponent --oaf-ior-fd=14 root 6100 0.0 0.8 46132 5564 ? S 00:32 0:00 /usr/lib/evolution/evolution-executive-summary --oaf-activate-iid=OAFIID:GNOME_Evolution_Summary_ShellComponent --oaf-ior-fd=14 root 6101 0.0 0.8 46132 5564 ? S 00:32 0:00 /usr/lib/evolution/evolution-executive-summary --oaf-activate-iid=OAFIID:GNOME_Evolution_Summary_ShellComponent --oaf-ior-fd=14 root 6102 0.0 0.8 46132 5564 ? S 00:32 0:00 /usr/lib/evolution/evolution-executive-summary --oaf-activate-iid=OAFIID:GNOME_Evolution_Summary_ShellComponent --oaf-ior-fd=14 root 6103 0.0 0.8 46132 5564 ? S 00:32 0:00 /usr/lib/evolution/evolution-executive-summary --oaf-activate-iid=OAFIID:GNOME_Evolution_Summary_ShellComponent --oaf-ior-fd=14 root 6111 0.1 1.8 36932 12104 tty1 S 00:32 0:04 /usr/lib/mozilla/mozilla-bin root 6162 0.0 1.8 36932 12104 tty1 S 00:32 0:00 /usr/lib/mozilla/mozilla-bin root 6163 0.0 1.8 36932 12104 tty1 S 00:32 0:00 /usr/lib/mozilla/mozilla-bin root 6164 0.0 1.8 36932 12104 tty1 S 00:32 0:00 /usr/lib/mozilla/mozilla-bin root 6166 0.0 1.8 36932 12104 tty1 S 00:32 0:00 /usr/lib/mozilla/mozilla-bin root 6204 0.0 0.2 5704 1744 vc/1 S 00:33 0:00 xawtv -nodga -xv root 6381 0.7 0.9 17572 6264 ? S 00:37 0:16 gnome-gtkhtml-editor --oaf-activate-iid=OAFIID:GNOME_GtkHTML_Editor_Factory --oaf-ior-fd=22 root 7801 0.0 2.5 39092 16476 ? S 01:07 0:00 /usr/lib/evolution/evolution-mail --oaf-activate-iid=OAFIID:GNOME_Evolution_Mail_ShellComponent --oaf-ior-fd=18 root 8159 0.0 0.0 1528 508 vc/1 S 01:15 0:00 sleep 3s root 8160 0.0 0.2 3348 1540 pts/1 R 01:15 0:00 ps aux
A message that is not in the archive (sent off-list or not yet received): [email protected]
I see a growing dentry_cache, but why call it a cache when free shows it as being buffer? This is related to my previous posts about this. Does anyone know what's going on here?
total used free shared buffers cached
Mem: 629 622 7 0 30 65
-/+ buffers/cache: 525 103
Swap: 1040 70 970
slabinfo - version: 1.1
kmem_cache 60 68 112 2 2 1 uhci_urb_priv 3 62 60 1 1 1 tcp_tw_bucket 0 60 128 0 2 1 tcp_bind_bucket 24 112 32 1 1 1 tcp_open_request 0 59 64 0 1 1 inet_peer_cache 0 0 64 0 0 1 ip_fib_hash 9 112 32 1 1 1 ip_dst_cache 73 120 192 4 6 1 arp_cache 2 30 128 1 1 1 blkdev_requests 6144 6150 128 205 205 1 devfsd_event 0 0 20 0 0 1 journal_head 884 3696 48 22 48 1 revoke_table 10 250 12 1 1 1 revoke_record 0 112 32 0 1 1 dnotify_cache 0 0 20 0 0 1 file_lock_cache 11 42 92 1 1 1 fasync_cache 2 202 16 1 1 1 uid_cache 4 112 32 1 1 1 skbuff_head_cache 160 200 192 10 10 1 sock 271 279 832 31 31 2 sigqueue 0 29 132 0 1 1 kiobuf 0 0 64 0 0 1 cdev_cache 32 295 64 4 5 1 bdev_cache 13 59 64 1 1 1 mnt_cache 21 59 64 1 1 1 inode_cache 35683 55398 512 7914 7914 1 dentry_cache 36016 70500 128 2350 2350 1 filp 2494 2520 128 84 84 1 names_cache 0 3 4096 0 3 1 buffer_head 24531 47190 128 1531 1573 1 mm_struct 83 100 192 5 5 1 vm_area_struct 4688 4770 128 157 159 1 fs_cache 82 118 64 2 2 1 files_cache 82 90 448 10 10 1 signal_act 96 102 1344 33 34 1 size-131072(DMA) 0 0 131072 0 0 32 size-131072 0 0 131072 0 0 32 size-65536(DMA) 0 0 65536 0 0 16 size-65536 1 1 65536 1 1 16 size-32768(DMA) 0 0 32768 0 0 8 size-32768 2 2 32768 2 2 8 size-16384(DMA) 0 0 16384 0 0 4 size-16384 6 8 16384 6 8 4 size-8192(DMA) 0 0 8192 0 0 2 size-8192 6 7 8192 6 7 2 size-4096(DMA) 0 0 4096 0 0 1 size-4096 52 61 4096 52 61 1 size-2048(DMA) 0 0 2048 0 0 1 size-2048 51 74 2048 26 37 1 size-1024(DMA) 0 0 1024 0 0 1 size-1024 89 96 1024 23 24 1 size-512(DMA) 0 0 512 0 0 1 size-512 59 64 512 8 8 1 size-256(DMA) 0 0 256 0 0 1 size-256 145 165 256 10 11 1 size-128(DMA) 4 30 128 1 1 1 size-128 2329 2460 128 79 82 1 size-64(DMA) 0 0 64 0 0 1 size-64 1662 3422 64 39 58 1 size-32(DMA) 4 59 64 1 1 1 size-32 6906 12862 64 160 218 1
total: used: free: shared: buffers: cached:
Mem: 660455424 652906496 7548928 0 31686656 97972224 Swap: 1091526656 74035200 1017491456 MemTotal: 644976 kB MemFree: 7372 kB MemShared: 0 kB Buffers: 30944 kB Cached: 68284 kB SwapCached: 27392 kB Active: 145192 kB Inact_dirty: 84108 kB Inact_clean: 22196 kB Inact_target: 50296 kB HighTotal: 0 kB HighFree: 0 kB LowTotal: 644976 kB LowFree: 7372 kB SwapTotal: 1065944 kB SwapFree: 993644 kB Committed_AS: 339068 kB