Skip to contentSkip to conversation

Only 3.2G ram out of 4G seen in an i386 box

DISCUSSION Thomas Stewart 6 participants 10 messages Aug 8, 2006 – Aug 13, 2006

lore
Share & tools
lore
#0 lore raw

Hi,
I have a Dell Optiplex GX280, a Pentium 4 with an Intel chipset. It has 4G of ram. The problem is I can only see 3.2G, even tho the bios reports 4G.

While using debian 2.6.16-2-686:

thomas@coke:~$ uname -a
Linux coke 2.6.16-2-686 #1 Sat Jul 15 21:59:21 UTC 2006 i686 GNU/Linux
thomas@coke:~$ grep MemTotal /proc/meminfo
MemTotal:      3375484 kB

This is expected as the standard debian kernels don't set CONFIG_HIGHMEM64G. My understanding is that this needs to be set for the full 4G to work on i386.

So I downloaded 2.6.18-rc3-git3 and 2.6.18-rc2-mm1 to give them a try. I used the debian config as a starting point for oldconfig. Then from menuconfig, "Processor type and featues" -> "High Memory Support" and selected 64G. I then compiled both, rebooted and got these results:

2.6.18-rc2-mm1 reported MemTotal: 3376192 kB
2.6.18-rc3-git3 reported MemTotal: 3376236 kB

Is there anything I can do to make use of the 800M or so of ram that's unused? Changing to amd64 or anything else that's sane or better does not count ;-)

thomas@coke:~$ cat /proc/cpuinfo
processor       : 0
vendor_id       : GenuineIntel
cpu family      : 15
model           : 3
model name      : Intel(R) Pentium(R) 4 CPU 3.00GHz
stepping        : 4
cpu MHz         : 2992.591
cache size      : 1024 KB
fdiv_bug        : no
hlt_bug         : no
f00f_bug        : no
coma_bug        : no
fpu             : yes
fpu_exception   : yes
cpuid level     : 3
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe constant_tsc pni monitor ds_cpl cid xtpr
bogomips        : 5990.72
thomas@coke:~$ lspci
00:00.0 Host bridge: Intel Corporation 915G/P/GV/GL/PL/910GL Express Memory Controller Hub (rev 04)
00:01.0 PCI bridge: Intel Corporation 915G/P/GV/GL/PL/910GL Express PCI Express Root Port (rev 04)
00:1c.0 PCI bridge: Intel Corporation 82801FB/FBM/FR/FW/FRW (ICH6 Family) PCI Express Port 1 (rev 03)
00:1c.1 PCI bridge: Intel Corporation 82801FB/FBM/FR/FW/FRW (ICH6 Family) PCI Express Port 2 (rev 03)
00:1d.0 USB Controller: Intel Corporation 82801FB/FBM/FR/FW/FRW (ICH6 Family) USB UHCI #1 (rev 03)
00:1d.1 USB Controller: Intel Corporation 82801FB/FBM/FR/FW/FRW (ICH6 Family) USB UHCI #2 (rev 03)
00:1d.2 USB Controller: Intel Corporation 82801FB/FBM/FR/FW/FRW (ICH6 Family) USB UHCI #3 (rev 03)
00:1d.3 USB Controller: Intel Corporation 82801FB/FBM/FR/FW/FRW (ICH6 Family) USB UHCI #4 (rev 03)
00:1d.7 USB Controller: Intel Corporation 82801FB/FBM/FR/FW/FRW (ICH6 Family) USB2 EHCI Controller (rev 03)
00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev d3)
00:1e.2 Multimedia audio controller: Intel Corporation 82801FB/FBM/FR/FW/FRW (ICH6 Family) AC'97 Audio Controller (rev 03)
00:1f.0 ISA bridge: Intel Corporation 82801FB/FR (ICH6/ICH6R) LPC Interface Bridge (rev 03)
00:1f.1 IDE interface: Intel Corporation 82801FB/FBM/FR/FW/FRW (ICH6 Family) IDE Controller (rev 03)
00:1f.2 IDE interface: Intel Corporation 82801FB/FW (ICH6/ICH6W) SATA Controller (rev 03)
00:1f.3 SMBus: Intel Corporation 82801FB/FBM/FR/FW/FRW (ICH6 Family) SMBus Controller (rev 03)
01:00.0 VGA compatible controller: ATI Technologies Inc RV370 5B60 [Radeon X300 (PCIE)]
01:00.1 Display controller: ATI Technologies Inc RV370 [Radeon X300SE]
02:00.0 Ethernet controller: Broadcom Corporation NetXtreme BCM5751 Gigabit Ethernet PCI Express (rev 01)
thomas@coke:~$

Regards
--
Tom
(Please CC me as I'm off the list)

#1 lore raw

Replying to Thomas Stewart:

Quoted 4 lines

Hi,
I have a Dell Optiplex GX280, a Pentium 4 with an Intel chipset. It has 4G of ram. The problem is I can only see 3.2G, even tho the bios reports 4G.

Chipset issue. Some Intel chipsets are doing strange things with memory map. They call this "design flaw" but not offered free replacements yet, so, for example, on SE7221BK1E you can't use more than 3 gigs.

Signature · 2 lines
Paul P 'Stingray' Komkoff Jr // http://stingr.net/key <- my pgp key
 This message represents the official view of the voices in my head
#2 lore raw
Quoted 11 lines

Replying to Thomas Stewart:

Quoted 4 lines

Hi,
I have a Dell Optiplex GX280, a Pentium 4 with an Intel chipset. It has 4G of ram. The problem is I can only see 3.2G, even tho the bios reports 4G.

Chipset issue. Some Intel chipsets are doing strange things with memory map. They call this "design flaw" but not offered free replacements yet, so, for example, on SE7221BK1E you can't use more than 3 gigs.

It is quite funny to read Intel's technical note on this, as they try to
make it seem like they're blaming the operating system. For example:

When the Intel E7221 chipset is populated to its maximum memory capacity of 4 GB (Giga Bytes), the Operating System (OS) may report a significantly lower amount of available memory.

Yeah, that stupid operating system.

These requirements may reduce the addressable memory space available to and reported by the Operating System. These memory ranges, while unavailable to the OS, are still being utilized by subsystems such as I/O, PCI Express and Integrated Graphics and are critical to the proper functioning of the server.

Use of Available memory below 4 GB by system resources is not specific to Intel chipsets, but rather a limitation of existing PC architectures and current limitations of some 32-bit operating systems. Some 32-bit operating systems may not be capable of recognizing greater than 2 GB of memory. This issue potentially impacts any chipset with 4GB maximum memory configuration.

Intel has addressed this from a hardware perspective in future platforms, anticipating that future Operating Systems will provide greater than 4 GB of memory support.

Last but not least, their solution.

Corrective Action / Resolution
Intel Server Board SE7221BK1-E system BIOS will be updated to properly indicate the following information screens augment memory configuration characteristics for the Intel Server Board SE7221BK1-E and Intel Server Platform SR1425BK1-E customers.
Total physical memory populated in the system
Total memory dedicated to motherboard resources
Total memory reported as available to the operating system
This information will align to the INT15h E820h standard that BIOS uses to communicate memory usage to the operating system. This BIOS feature will clarify the memory subsystem support and usage for the end user.

Are these technical notes supposed to be so funny?

DS

#3 lore raw
Quoted 51 lines · David Schwartz
Quoted 11 lines

Replying to Thomas Stewart:

Quoted 4 lines

Hi,
I have a Dell Optiplex GX280, a Pentium 4 with an Intel chipset. It has 4G of ram. The problem is I can only see 3.2G, even tho the bios reports 4G.

Chipset issue. Some Intel chipsets are doing strange things with memory map. They call this "design flaw" but not offered free replacements yet, so, for example, on SE7221BK1E you can't use more than 3 gigs.

It is quite funny to read Intel's technical note on this, as they try to
make it seem like they're blaming the operating system. For example:

When the Intel E7221 chipset is populated to its maximum memory capacity of 4 GB (Giga Bytes), the Operating System (OS) may report a significantly lower amount of available memory.

Yeah, that stupid operating system.

These requirements may reduce the addressable memory space available to and reported by the Operating System. These memory ranges, while unavailable to the OS, are still being utilized by subsystems such as I/O, PCI Express and Integrated Graphics and are critical to the proper functioning of the server.

Use of Available memory below 4 GB by system resources is not specific to Intel chipsets, but rather a limitation of existing PC architectures and current limitations of some 32-bit operating systems. Some 32-bit operating systems may not be capable of recognizing greater than 2 GB of memory. This issue potentially impacts any chipset with 4GB maximum memory configuration.

Intel has addressed this from a hardware perspective in future platforms, anticipating that future Operating Systems will provide greater than 4 GB of memory support.

Last but not least, their solution.

Corrective Action / Resolution
Intel Server Board SE7221BK1-E system BIOS will be updated to properly indicate the following information screens augment memory configuration characteristics for the Intel Server Board SE7221BK1-E and Intel Server Platform SR1425BK1-E customers.
Total physical memory populated in the system
Total memory dedicated to motherboard resources
Total memory reported as available to the operating system
This information will align to the INT15h E820h standard that BIOS uses to communicate memory usage to the operating system. This BIOS feature will clarify the memory subsystem support and usage for the end user.

Quoted 3 lines

Are these technical notes supposed to be so funny?

DS

I guess this is all related to older Intel chipsets, right? I mean the chipset *75X something I'm going to have in the new box I will get soonish will support up to 8 GiB. I hope it does not mean that it will be capped at 7.4GiB although I will only have 4GiB installed for now.

#4 lore raw
Quoted 8 lines · On Wed, 9 Aug 2006 08:51:41 +0200 "gmu 2k6" <[email protected]> wrote:
Quoted 3 lines

Are these technical notes supposed to be so funny?

DS

I guess this is all related to older Intel chipsets, right? I mean the chipset *75X something I'm going to have in the new box I will get soonish will support up to 8 GiB. I hope it does not mean that it will be capped at 7.4GiB although I will only have 4GiB installed for now.

most modern 64 bit x86 systems will relocate this memory hole to somewhere else within the address space (memory hoisting)... You'll probably find the it reappers the first time you buy a system with 1TB of ram...

Quoted 5 lines

-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/

#5 lore raw
Quoted 5 lines · Joel Jaeggli
Quoted 2 lines · On Wed, 9 Aug 2006 08:51:41 +0200 "gmu 2k6" <[email protected]> wrote:
Quoted 2 lines

Are these technical notes supposed to be so funny?

Quoted 8 lines
Quoted 6 lines
Quoted 1 line

DS

I guess this is all related to older Intel chipsets, right? I mean the chipset *75X something I'm going to have in the new box I will get soonish will support up to 8 GiB. I hope it does not mean that it will be capped at 7.4GiB although I will only have 4GiB installed for now.

most modern 64 bit x86 systems will relocate this memory hole to somewhere else within the address space (memory hoisting)... You'll probably find the it reappers the first time you buy a system with 1TB of ram...

so what does it mean that one of Xeons here shows me the full 4GiB as total physical memory via free?

btw, the box I'm getting will have the 975X chip and include 4GiB RAM and if I understood the problem correctly even with 3GiB there will be some memory lost to mapping-issues besides the HI/LO mem kernel-reserving issue.
this is what I get on ia32 P4 with 3GiB
total used free shared buffers cached
Mem: 3116108 2608196 507912 0 246652 2039708
and this is what I get on ia32 Xeon with 4GiB
total used free shared buffers cached
Mem: 4087660 268828 3818832 0 57168 103568

#6 lore raw

gmu 2k6 wrote:
...

Quoted 13 lines

so what does it mean that one of Xeons here shows me the full 4GiB as total physical memory via free?

btw, the box I'm getting will have the 975X chip and include 4GiB RAM and if I understood the problem correctly even with 3GiB there will be some memory lost to mapping-issues besides the HI/LO mem kernel-reserving issue.
this is what I get on ia32 P4 with 3GiB
total used free shared buffers cached
Mem: 3116108 2608196 507912 0 246652 2039708
and this is what I get on ia32 Xeon with 4GiB
total used free shared buffers cached
Mem: 4087660 268828 3818832 0 57168 103568

Hi Gmu,

This is a bit divergent from the discussion, but will hopefully provide some background.

The hardware my employer manufactures asks the BIOS to reserve several largeish ranges (16M and 16M to 512M), and it's been used in various HPC projects where machines typically have a lot of memory installed.

From my experience, most pre 750x-P4-Xeon chipsets did not support any kind of memory remapping, so often the top 0.5-1.5G of ram would be 'lost'. Great fun.
Since then, this functionality has started appearing, more or less randomly. I believe it should be present on all later 75xx chipsets (probably the Core 2 Xeon chipsets as well), but implementation depends on the BIOS (ie the motherboard vendors), and their grasp of what people do with their boards is often quite limited.

On the P4 boards (and again the Core 2 boards as well), this is probably even less ordered as they are 'desktop' boards rather than the more costly 'server' boards.

I'm pretty sure the Athlon64 and Opteron CPUs should support this, but they too depend on BIOS functionality to rearrange the memory tables.

Just out of interest - what chipset does your Xeon system use?

Yours,
-S

Signature · 1 line
Simen Thoresen, Dolphin ICS
#7 lore raw
Quoted 34 lines · Simen Thoresen

gmu 2k6 wrote:
...

Quoted 13 lines

so what does it mean that one of Xeons here shows me the full 4GiB as total physical memory via free?

btw, the box I'm getting will have the 975X chip and include 4GiB RAM and if I understood the problem correctly even with 3GiB there will be some memory lost to mapping-issues besides the HI/LO mem kernel-reserving issue.
this is what I get on ia32 P4 with 3GiB
total used free shared buffers cached
Mem: 3116108 2608196 507912 0 246652 2039708
and this is what I get on ia32 Xeon with 4GiB
total used free shared buffers cached
Mem: 4087660 268828 3818832 0 57168 103568

Hi Gmu,

This is a bit divergent from the discussion, but will hopefully provide some background.

The hardware my employer manufactures asks the BIOS to reserve several largeish ranges (16M and 16M to 512M), and it's been used in various HPC projects where machines typically have a lot of memory installed.

From my experience, most pre 750x-P4-Xeon chipsets did not support any kind
of memory remapping, so often the top 0.5-1.5G of ram would be 'lost'. Great fun.
Since then, this functionality has started appearing, more or less randomly. I believe it should be present on all later 75xx chipsets (probably the Core 2 Xeon chipsets as well), but implementation depends on the BIOS (ie the motherboard vendors), and their grasp of what people do with their boards is often quite limited.

Quoted 8 lines

On the P4 boards (and again the Core 2 boards as well), this is probably even less ordered as they are 'desktop' boards rather than the more costly 'server' boards.

I'm pretty sure the Athlon64 and Opteron CPUs should support this, but they too depend on BIOS functionality to rearrange the memory tables.

Just out of interest - what chipset does your Xeon system use?

lspci of the P4 32bit desktop with 3GiB
00:00.0 Host bridge: Intel Corporation 82875P/E7210 Memory Controller Hub (rev 02)
00:01.0 PCI bridge: Intel Corporation 82875P Processor to AGP Controller (rev 02)
00:1d.0 USB Controller: Intel Corporation 82801EB/ER (ICH5/ICH5R) USB UHCI Controller #1 (rev 02)

lspci of the Xeon 32bit HP Proliant Server with 4GiB:
00:00.0 Host bridge: Intel Corporation E7520 Memory Controller Hub (rev 0c) 00:02.0 PCI bridge: Intel Corporation E7525/E7520/E7320 PCI Express Port A (rev 0c)
00:06.0 PCI bridge: Intel Corporation E7520 PCI Express Port C (rev 0c) 00:1d.0 USB Controller: Intel Corporation 82801EB/ER (ICH5/ICH5R) USB UHCI Controller #1 (rev 02)

lspci of the new box with 975X and Core 2 Duo not available yet for obvious reasons (I don't have the the box yet).

#8 lore raw
Quoted 16 lines · gmu 2k6 wrote:
Quoted 6 lines · Simen Thoresen

gmu 2k6 wrote:
...

Quoted 3 lines

so what does it mean that one of Xeons here shows me the full 4GiB as total physical memory via free?

Just out of interest - what chipset does your Xeon system use?

lspci of the P4 32bit desktop with 3GiB
00:00.0 Host bridge: Intel Corporation 82875P/E7210 Memory Controller Hub (rev 02)
00:01.0 PCI bridge: Intel Corporation 82875P Processor to AGP Controller (rev 02)
00:1d.0 USB Controller: Intel Corporation 82801EB/ER (ICH5/ICH5R) USB UHCI Controller #1 (rev 02)

Quoted 7 lines

lspci of the Xeon 32bit HP Proliant Server with 4GiB:
00:00.0 Host bridge: Intel Corporation E7520 Memory Controller Hub (rev 0c) 00:02.0 PCI bridge: Intel Corporation E7525/E7520/E7320 PCI Express Port A (rev 0c)
00:06.0 PCI bridge: Intel Corporation E7520 PCI Express Port C (rev 0c) 00:1d.0 USB Controller: Intel Corporation 82801EB/ER (ICH5/ICH5R) USB UHCI Controller #1 (rev 02)

We know the E7520 is able to do the remapping, provided the BIOS does not mess it up. I have no idea about the E7210 (or the 875P - I was not aware that they were this closely related), but without checking any docs I'm assuming a 4G memory ceiling and no remapping capability.

Thank you.

Quoted 2 lines

lspci of the new box with 975X and Core 2 Duo not available yet for obvious reasons (I don't have the the box yet).

I'd appreciate if you could send me both lspci and /proc/iomem output when you get one of these with 4G or more ram installed. Off list, please.

Yours,
-S

Quoted 6 lines

-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/

Signature · 1 line
Simen Thoresen, Dolphin ICS
#9 lore raw
In reply to Joel Jaeggli

Hi,

I tried Dell support, but it was unhelpful. I also upgraded the bios to the latest revision, but that changed nothing. I think I'll just have to live with it.

Thanks for the comments.
--
Tom