Skip to contentSkip to conversation

Finding lost memory + kernel messages explained

DISCUSSION Imre Gergely 3 participants 4 messages Apr 9, 2009 – Apr 10, 2009 1 message not in the archive

lore
Share & tools
lore
#0 lore raw

Hi

I've just upgraded my laptop RAM from 1x2GB to 2x2GB. The BIOS says 4096MB, memtest says 4031MB (I'm not sure why, but let's assume it's right).

After Linux boots, Ubuntu 8.10 x86_64, with

Linux gimre-laptop 2.6.27-11-generic #1 SMP Wed Apr 1 20:53:41 UTC 2009 x86_64 GNU/Linux

I look at /proc/meminfo, and I don't have 4031MB:

gimre@gimre-laptop:~$ cat /proc/meminfo
MemTotal:      3989844 kB
MemFree:       3157756 kB

That would be around 3896MB. My question is: where does the memory go? Is it normal to 'lose' that much (~130MB) ?

Here's the dmesg output

http://pastebin.com/m4f7d089a

Also I would like to know more about those kernel messages, what do all those numbers, and memory mappings and all that mean? Is there a comprehensive manual / howto / wiki which explains all the messages in more detail?

One thing I tried was appending iommu=off at boot, which gave me back some 50MB, but there were still 80MB missing and the USB mouse didn't work (among other things I'm sure).

Laptop is a HP Compaq 8510p.

Thanks.

Signature · 4 lines
Imre Gergely
Yahoo!: gergelyimre ICQ#: 101510959
MSN: gergely_imre GoogleTalk: gergelyimre
gpg --keyserver subkeys.pgp.net --recv-keys 0x34525305
#1 lore raw
Quoted 3 lines · Imre Gergely

That would be around 3896MB. My question is: where does the memory go? Is it normal to 'lose' that much (~130MB) ?

I wrote a paper about this topic some time ago.

http://halobates.de/memory.pdf
http://halobates.de/memorywaste.pdf

Quoted 1 line

One thing I tried was appending iommu=off at boot, which gave me back

That means if you have any devices that cannot addresses > 32bit they will panic with that setting.

-Andi

Signature · 1 line
[email protected] -- Speaking for myself only.

A message that is not in the archive (sent off-list or not yet received): [email protected]

#3 lore raw

cc to mailing list restored. please don't drop this.

Quoted 5 lines · Imre Gergely
Quoted 4 lines · Andi Kleen
Quoted 2 lines · Imre Gergely

That would be around 3896MB. My question is: where does the memory go? Is it normal to 'lose' that much (~130MB) ?

Quoted 7 lines
Quoted 4 lines

I wrote a paper about this topic some time ago.

http://halobates.de/memory.pdf
http://halobates.de/memorywaste.pdf

I tried to understand what you wrote there a bit, but it's still pretty confusing ;)

Modern hardware is complicated.

Quoted 5 lines
[    0.004000] Memory: 3980848k/5177344k available (3115k kernel code, 

147212k reserved, 1573k data, 540k init)

There seems to be 5GB of memory, I don't understand where this is coming from. There is a gap in the mapping

PCs have memory holes below 1MB and below 4GB. The 4GB hole can be rather large because it contains IO mappings for all devices.

(lines 16 and 17 in dmesg output on

Quoted 1 line

the pastebin), but why? And what's that 147212k reserved?

The paper explains all this.

-Andi

Signature · 1 line
[email protected] -- Speaking for m1yself only.
#4 lore raw
In reply to Imre Gergely
Quoted 7 lines · Imre Gergely

Hi

I've just upgraded my laptop RAM from 1x2GB to 2x2GB. The BIOS says 4096MB, memtest says 4031MB (I'm not sure why, but let's assume it's right).

After Linux boots, Ubuntu 8.10 x86_64, with

Quoted 7 lines

Linux gimre-laptop 2.6.27-11-generic #1 SMP Wed Apr 1 20:53:41 UTC 2009 x86_64 GNU/Linux

I look at /proc/meminfo, and I don't have 4031MB:

gimre@gimre-laptop:~$ cat /proc/meminfo
MemTotal:      3989844 kB
MemFree:       3157756 kB

Your BIOS e820 memory map has this for usable memory:

0000000000000000 - 000000000009fc00 = 639KB
0000000000100000 - 00000000bffb0000 = 3070.7MB
0000000100000000 - 000000013c000000 = 960MB

total that your BIOS exposes to the OS: 4031 MB

That leaves 131MB, likely about 64MB of that is used for the IOMMU (which you need, since you presumably have devices that can't address memory over the 4GB address), and the rest is likely various kernel data structures (page tables, etc.)

Quoted 15 lines

That would be around 3896MB. My question is: where does the memory go? Is it normal to 'lose' that much (~130MB) ?

Here's the dmesg output

http://pastebin.com/m4f7d089a

Also I would like to know more about those kernel messages, what do all those numbers, and memory mappings and all that mean? Is there a comprehensive manual / howto / wiki which explains all the messages in more detail?

One thing I tried was appending iommu=off at boot, which gave me back some 50MB, but there were still 80MB missing and the USB mouse didn't work (among other things I'm sure).

Laptop is a HP Compaq 8510p.

Thanks.