No Persistent Memory (legacy) even persistent (type 12) was found
A message that is not in the archive (sent off-list or not yet received): [email protected]
Hi:
I am trying to play with the NVDIMM driver and follow instructions in
https://nvdimm.wiki.kernel.org/how_to_choose_the_correct_memmap_kernel_parameter_for_pmem_on_your_system and
https://www.suse.com/communities/blog/nvdimm-enabling-part-2-intel
for setting up an emulated NVDIMM memory.
I claimed the memory range from 0x10000000 -- 0x1fffffff via adding a kernel command line param memmap=256M!256M .
soccerl@ubuntu:~$ dmesg | grep e820 [ 0.000000] e820: BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009ffff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000c0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007eeecfff] usable <------------------------------- * [ 0.000000] BIOS-e820: [mem 0x000000007eeed000-0x000000007eef1fff] ACPI data [ 0.000000] BIOS-e820: [mem 0x000000007eef2000-0x000000007ef1afff] reserved [ 0.000000] BIOS-e820: [mem 0x000000007ef1b000-0x000000007ff9afff] usable [ 0.000000] BIOS-e820: [mem 0x000000007ff9b000-0x000000007ffb6fff] reserved [ 0.000000] BIOS-e820: [mem 0x000000007ffb7000-0x000000007ffb8fff] type 20 [ 0.000000] BIOS-e820: [mem 0x000000007ffb9000-0x000000007ffbafff] reserved [ 0.000000] BIOS-e820: [mem 0x000000007ffbb000-0x000000007ffbbfff] type 20 [ 0.000000] BIOS-e820: [mem 0x000000007ffbc000-0x000000007ffbdfff] reserved [ 0.000000] BIOS-e820: [mem 0x000000007ffbe000-0x000000007ffbefff] type 20 [ 0.000000] BIOS-e820: [mem 0x000000007ffbf000-0x000000007ffc0fff] reserved [ 0.000000] BIOS-e820: [mem 0x000000007ffc1000-0x000000007ffc1fff] type 20 [ 0.000000] BIOS-e820: [mem 0x000000007ffc2000-0x000000007ffc3fff] reserved [ 0.000000] BIOS-e820: [mem 0x000000007ffc4000-0x000000007ffc5fff] type 20 [ 0.000000] BIOS-e820: [mem 0x000000007ffc6000-0x000000007ffc7fff] reserved [ 0.000000] BIOS-e820: [mem 0x000000007ffc8000-0x000000007ffc8fff] type 20 [ 0.000000] BIOS-e820: [mem 0x000000007ffc9000-0x000000007fff2fff] reserved [ 0.000000] BIOS-e820: [mem 0x000000007fff3000-0x000000007fffafff] ACPI data [ 0.000000] BIOS-e820: [mem 0x000000007fffb000-0x000000007fffefff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x000000007ffff000-0x000000007fffffff] usable [ 0.000000] e820: user-defined physical RAM map: [ 0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved [ 0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable [ 0.000000] e820: last_pfn = 0x80000 max_arch_pfn = 0x400000000 [ 0.000000] e820: [mem 0x80000000-0xffffffff] available for PCI devices
soccerl@ubuntu:~$ dmesg | grep user [ 0.000000] e820: user-defined physical RAM map: [ 0.000000] user: [mem 0x0000000000000000-0x000000000009ffff] usable [ 0.000000] user: [mem 0x00000000000c0000-0x00000000000fffff] reserved [ 0.000000] user: [mem 0x0000000000100000-0x000000000fffffff] usable [ 0.000000] user: [mem 0x0000000010000000-0x000000001fffffff] persistent (type 12) <-------- this shows the memmap works as expected [ 0.000000] user: [mem 0x0000000020000000-0x000000007eeecfff] usable [ 0.000000] user: [mem 0x000000007eeed000-0x000000007eef1fff] ACPI data [ 0.000000] user: [mem 0x000000007eef2000-0x000000007ef1afff] reserved [ 0.000000] user: [mem 0x000000007ef1b000-0x000000007ff9afff] usable [ 0.000000] user: [mem 0x000000007ff9b000-0x000000007ffb6fff] reserved [ 0.000000] user: [mem 0x000000007ffb7000-0x000000007ffb8fff] type 20 [ 0.000000] user: [mem 0x000000007ffb9000-0x000000007ffbafff] reserved [ 0.000000] user: [mem 0x000000007ffbb000-0x000000007ffbbfff] type 20 [ 0.000000] user: [mem 0x000000007ffbc000-0x000000007ffbdfff] reserved [ 0.000000] user: [mem 0x000000007ffbe000-0x000000007ffbefff] type 20 [ 0.000000] user: [mem 0x000000007ffbf000-0x000000007ffc0fff] reserved [ 0.000000] user: [mem 0x000000007ffc1000-0x000000007ffc1fff] type 20 [ 0.000000] user: [mem 0x000000007ffc2000-0x000000007ffc3fff] reserved [ 0.000000] user: [mem 0x000000007ffc4000-0x000000007ffc5fff] type 20 [ 0.000000] user: [mem 0x000000007ffc6000-0x000000007ffc7fff] reserved [ 0.000000] user: [mem 0x000000007ffc8000-0x000000007ffc8fff] type 20 [ 0.000000] user: [mem 0x000000007ffc9000-0x000000007fff2fff] reserved [ 0.000000] user: [mem 0x000000007fff3000-0x000000007fffafff] ACPI data [ 0.000000] user: [mem 0x000000007fffb000-0x000000007fffefff] ACPI NVS [ 0.000000] user: [mem 0x000000007ffff000-0x000000007fffffff] usable
However, I could not find any Persistent Memory (legacy) from the iomem output.
I was expecting something like
10000000-1fffffff : Persistent Memory (legacy)
soccerl@ubuntu:~$
soccerl@ubuntu:~$ cat /proc/iomem 00000000-00000000 : reserved 00000000-00000000 : System RAM 00000000-00000000 : reserved 00000000-00000000 : System ROM 00000000-00000000 : System RAM 00000000-00000000 : Kernel code 00000000-00000000 : Kernel data 00000000-00000000 : Kernel bss 00000000-00000000 : System RAM 00000000-00000000 : ACPI Tables 00000000-00000000 : System RAM 00000000-00000000 : reserved 00000000-00000000 : reserved 00000000-00000000 : reserved 00000000-00000000 : reserved 00000000-00000000 : reserved 00000000-00000000 : reserved 00000000-00000000 : ACPI Tables 00000000-00000000 : ACPI Non-volatile Storage 00000000-00000000 : System RAM 00000000-00000000 : 5620e0c7-8062-4dce-aeb7-520c7ef76171 00000000-00000000 : PNP0003:00 00000000-00000000 : Local APIC 00000000-00000000 : PNP0003:00 soccerl@ubuntu:~$
I do have the following kernel config flags set
CONFIG_ARCH_HAS_PMEM_API=yCONFIG_BLK_DEV_PMEM=mCONFIG_LIBNVDIMM=yCONFIG_X86_PMEM_LEGACY=yCONFIG_FS_DAX=yCONFIG_BLK_DEV_RAM_DAX=y
Any idea on what I might have missed?
Thanks
Soccer
soccerl@ubuntu:~/linux$ grep -nr ARCH_HAS_PMEM_API include/config/auto.conf:1664:CONFIG_ARCH_HAS_PMEM_API=y include/generated/autoconf.h:1666:#define CONFIG_ARCH_HAS_PMEM_API 1 include/linux/pmem.h:19:#ifdef CONFIG_ARCH_HAS_PMEM_API include/linux/pmem.h:65: return IS_ENABLED(CONFIG_ARCH_HAS_PMEM_API); carch/x86/include/asm/pmem.h:21:#ifdef CONFIG_ARCH_HAS_PMEM_API arch/x86/include/asm/pmem.h:120:#endif /* CONFIG_ARCH_HAS_PMEM_API */ ^C soccerl@ubuntu:~/linux$ grep -nr BLK_DEV_PMEM Binary file .git/objects/pack/pack-abb253f9f14e0a418077c5478ffad5218cbbaf23.pack matches include/config/tristate.conf:3995:CONFIG_BLK_DEV_PMEM=Y include/config/auto.conf:5771:CONFIG_BLK_DEV_PMEM=y include/generated/autoconf.h:5773:#define CONFIG_BLK_DEV_PMEM 1 ^C soccerl@ubuntu:~/linux$ grep -nr _LIBNVDIMM include/config/tristate.conf:1918:CONFIG_LIBNVDIMM=Y include/config/auto.conf:2778:CONFIG_LIBNVDIMM=y include/generated/autoconf.h:2780:#define CONFIG_LIBNVDIMM 1 include/linux/libnvdimm.h:15:#ifndef __LIBNVDIMM_H__ include/linux/libnvdimm.h:16:#define __LIBNVDIMM_H__ include/linux/libnvdimm.h:163:#endif /* __LIBNVDIMM_H__ */ ^C soccerl@ubuntu:~/linux$ grep -nr X86_PMEM_LEGACY include/config/tristate.conf:4535:CONFIG_X86_PMEM_LEGACY=Y include/config/auto.conf:5502:CONFIG_X86_PMEM_LEGACY_DEVICE=y include/config/auto.conf:6569:CONFIG_X86_PMEM_LEGACY=y include/generated/autoconf.h:5504:#define CONFIG_X86_PMEM_LEGACY_DEVICE 1 include/generated/autoconf.h:6571:#define CONFIG_X86_PMEM_LEGACY 1 ^C soccerl@ubuntu:~/linux$ grep -nr FS_DAX Binary file .git/objects/pack/pack-abb253f9f14e0a418077c5478ffad5218cbbaf23.pack matches include/config/auto.conf:5459:CONFIG_FS_DAX=y include/config/auto.conf:6437:CONFIG_FS_DAX_PMD=y include/generated/autoconf.h:5461:#define CONFIG_FS_DAX 1 include/generated/autoconf.h:6439:#define CONFIG_FS_DAX_PMD 1 ^C soccerl@ubuntu:~/linux$ grep -nr BLK_DEV_RAM_DAX include/config/auto.conf:727:CONFIG_BLK_DEV_RAM_DAX=y include/generated/autoconf.h:729:#define CONFIG_BLK_DEV_RAM_DAX 1 arch/powerpc/configs/mpc512x_defconfig:55:CONFIG_BLK_DEV_RAM_DAX=y
_______________________________________________
Linux-nvdimm mailing list
[email protected]
https://lists.01.org/mailman/listinfo/linux-nvdimm
Quoted 58 lines · Soccer Liu
Hi:
I am trying to play with the NVDIMM driver and follow instructions in
https://nvdimm.wiki.kernel.org/how_to_choose_the_correct_memmap_kernel_parameter_for_pmem_on_your_system and
https://www.suse.com/communities/blog/nvdimm-enabling-part-2-intelfor setting up an emulated NVDIMM memory.
I claimed the memory range from
0x10000000--0x1fffffffvia adding a kernel command line param memmap=256M!256M .soccerl@ubuntu:~$ dmesg | grep e820 [ 0.000000] e820: BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009ffff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000c0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007eeecfff] usable <------------------------------- * [ 0.000000] BIOS-e820: [mem 0x000000007eeed000-0x000000007eef1fff] ACPI data [ 0.000000] BIOS-e820: [mem 0x000000007eef2000-0x000000007ef1afff] reserved [ 0.000000] BIOS-e820: [mem 0x000000007ef1b000-0x000000007ff9afff] usable [ 0.000000] BIOS-e820: [mem 0x000000007ff9b000-0x000000007ffb6fff] reserved [ 0.000000] BIOS-e820: [mem 0x000000007ffb7000-0x000000007ffb8fff] type 20 [ 0.000000] BIOS-e820: [mem 0x000000007ffb9000-0x000000007ffbafff] reserved [ 0.000000] BIOS-e820: [mem 0x000000007ffbb000-0x000000007ffbbfff] type 20 [ 0.000000] BIOS-e820: [mem 0x000000007ffbc000-0x000000007ffbdfff] reserved [ 0.000000] BIOS-e820: [mem 0x000000007ffbe000-0x000000007ffbefff] type 20 [ 0.000000] BIOS-e820: [mem 0x000000007ffbf000-0x000000007ffc0fff] reserved [ 0.000000] BIOS-e820: [mem 0x000000007ffc1000-0x000000007ffc1fff] type 20 [ 0.000000] BIOS-e820: [mem 0x000000007ffc2000-0x000000007ffc3fff] reserved [ 0.000000] BIOS-e820: [mem 0x000000007ffc4000-0x000000007ffc5fff] type 20 [ 0.000000] BIOS-e820: [mem 0x000000007ffc6000-0x000000007ffc7fff] reserved [ 0.000000] BIOS-e820: [mem 0x000000007ffc8000-0x000000007ffc8fff] type 20 [ 0.000000] BIOS-e820: [mem 0x000000007ffc9000-0x000000007fff2fff] reserved [ 0.000000] BIOS-e820: [mem 0x000000007fff3000-0x000000007fffafff] ACPI data [ 0.000000] BIOS-e820: [mem 0x000000007fffb000-0x000000007fffefff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x000000007ffff000-0x000000007fffffff] usable [ 0.000000] e820: user-defined physical RAM map: [ 0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved [ 0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable [ 0.000000] e820: last_pfn = 0x80000 max_arch_pfn = 0x400000000 [ 0.000000] e820: [mem 0x80000000-0xffffffff] available for PCI devicessoccerl@ubuntu:~$ dmesg | grep user [ 0.000000] e820: user-defined physical RAM map: [ 0.000000] user: [mem 0x0000000000000000-0x000000000009ffff] usable [ 0.000000] user: [mem 0x00000000000c0000-0x00000000000fffff] reserved [ 0.000000] user: [mem 0x0000000000100000-0x000000000fffffff] usable [ 0.000000] user: [mem 0x0000000010000000-0x000000001fffffff] persistent (type 12) <-------- this shows the memmap works as expected [ 0.000000] user: [mem 0x0000000020000000-0x000000007eeecfff] usable [ 0.000000] user: [mem 0x000000007eeed000-0x000000007eef1fff] ACPI data [ 0.000000] user: [mem 0x000000007eef2000-0x000000007ef1afff] reserved [ 0.000000] user: [mem 0x000000007ef1b000-0x000000007ff9afff] usable [ 0.000000] user: [mem 0x000000007ff9b000-0x000000007ffb6fff] reserved [ 0.000000] user: [mem 0x000000007ffb7000-0x000000007ffb8fff] type 20 [ 0.000000] user: [mem 0x000000007ffb9000-0x000000007ffbafff] reserved [ 0.000000] user: [mem 0x000000007ffbb000-0x000000007ffbbfff] type 20 [ 0.000000] user: [mem 0x000000007ffbc000-0x000000007ffbdfff] reserved [ 0.000000] user: [mem 0x000000007ffbe000-0x000000007ffbefff] type 20 [ 0.000000] user: [mem 0x000000007ffbf000-0x000000007ffc0fff] reserved [ 0.000000] user: [mem 0x000000007ffc1000-0x000000007ffc1fff] type 20
Quoted 8 lines
[ 0.000000] user: [mem 0x000000007ffc2000-0x000000007ffc3fff] reserved [ 0.000000] user: [mem 0x000000007ffc4000-0x000000007ffc5fff] type 20 [ 0.000000] user: [mem 0x000000007ffc6000-0x000000007ffc7fff] reserved [ 0.000000] user: [mem 0x000000007ffc8000-0x000000007ffc8fff] type 20 [ 0.000000] user: [mem 0x000000007ffc9000-0x000000007fff2fff] reserved [ 0.000000] user: [mem 0x000000007fff3000-0x000000007fffafff] ACPI data [ 0.000000] user: [mem 0x000000007fffb000-0x000000007fffefff] ACPI NVS [ 0.000000] user: [mem 0x000000007ffff000-0x000000007fffffff] usable
This all looks fine. I ran my QEMU guest with this same reservation and it worked, so I don't think it's an issue with the size or placement of the reservation.
Quoted 3 lines
However, I could not find any Persistent Memory (legacy) from the iomem output. I was expecting something like
10000000-1fffffff : Persistent Memory (legacy)
Yep, here are the lines in my guest:
10000000-1fffffff : Persistent Memory (legacy) 10000000-1fffffff : namespace0.0
Quoted 17 lines
soccerl@ubuntu:~$ cat /proc/iomem 00000000-00000000 : reserved 00000000-00000000 : System RAM 00000000-00000000 : reserved 00000000-00000000 : System ROM 00000000-00000000 : System RAM 00000000-00000000 : Kernel code 00000000-00000000 : Kernel data 00000000-00000000 : Kernel bss 00000000-00000000 : System RAM 00000000-00000000 : ACPI Tables 00000000-00000000 : System RAM 00000000-00000000 : reserved 00000000-00000000 : reserved 00000000-00000000 : reserved 00000000-00000000 : reserved 00000000-00000000 : reserved
Quoted 8 lines
00000000-00000000 : reserved 00000000-00000000 : ACPI Tables 00000000-00000000 : ACPI Non-volatile Storage 00000000-00000000 : System RAM 00000000-00000000 : 5620e0c7-8062-4dce-aeb7-520c7ef76171 00000000-00000000 : PNP0003:00 00000000-00000000 : Local APIC 00000000-00000000 : PNP0003:00
Ummm...all the addresses are zero? I don't know what would cause this - a broken kconfig option?
Quoted 10 lines
I do have the following kernel config flags set
CONFIG_ARCH_HAS_PMEM_API=yCONFIG_BLK_DEV_PMEM=mCONFIG_LIBNVDIMM=yCONFIG_X86_PMEM_LEGACY=yCONFIG_FS_DAX=yCONFIG_BLK_DEV_RAM_DAX=yAny idea on what I might have missed?
My best guess is that it's a missed kernel config option. Here are the relevant ones from my v4.9 config:
$ egrep -i 'dax|pmem|nvdimm' .config CONFIG_X86_PMEM_LEGACY_DEVICE=y CONFIG_X86_PMEM_LEGACY=m CONFIG_BLK_DEV_RAM_DAX=y CONFIG_LIBNVDIMM=m CONFIG_BLK_DEV_PMEM=m CONFIG_NVDIMM_PFN=y CONFIG_NVDIMM_DAX=y CONFIG_DEV_DAX=m CONFIG_DEV_DAX_PMEM=m CONFIG_NR_DEV_DAX=32768 CONFIG_FS_DAX=y CONFIG_ARCH_HAS_PMEM_API=y
The DEV_DAX ones won't matter, but I'd verify the rest of them and make sure they're set.
Also, what kernel version are you using?
- Ross
_______________________________________________
Linux-nvdimm mailing list
[email protected]
https://lists.01.org/mailman/listinfo/linux-nvdimm
A message that is not in the archive (sent off-list or not yet received): 20170126233402.GA6659-VuQAYsv1563Yd54FQh9/[email protected]
Ross, Thanks for your reply.Here is the kernel information root@ubuntu:/home/soccerl/linux# make kernelversion 4.10.0-rc3
root@ubuntu:/home/soccerl/linux# uname -a Linux ubuntu 4.10.0-rc3+ #4 SMP Wed Jan 25 22:51:07 PST 2017 x86_64 x86_64 x86_64 GNU/Linux root@ubuntu:/home/soccerl/Linux#// NVDIMM related flags used in my build environment root@ubuntu:/home/soccerl/linux# egrep -i 'dax|pmem|nvdimm' .config CONFIG_X86_PMEM_LEGACY_DEVICE=y CONFIG_X86_PMEM_LEGACY=y CONFIG_BLK_DEV_RAM_DAX=y CONFIG_LIBNVDIMM=y CONFIG_BLK_DEV_PMEM=y CONFIG_NVDIMM_PFN=y CONFIG_NVDIMM_DAX=y CONFIG_DEV_DAX=y CONFIG_DEV_DAX_PMEM=m CONFIG_NR_DEV_DAX=32768 CONFIG_FS_DAX=y CONFIG_FS_DAX_PMD=y CONFIG_ARCH_HAS_PMEM_API=y For the addresses zeros, I found it only happens some boot instances. Here is one instance of non-zero iomem that I got after I reboot my linux box.root@ubuntu:~# cat /proc/iomem 00000000-00000fff : reserved 00001000-0009ffff : System RAM 000c0000-000fffff : reserved 000f0000-000fffff : System ROM 00100000-0fffffff : System RAM 01000000-018a7718 : Kernel code 018a7719-01f6db7f : Kernel data 02101000-02241fff : Kernel bss ----------à I expect a Persistent Memory (legacy) range here, but it’s nowhere to be found. 20000000-7eeecfff : System RAM 7eeed000-7eef1fff : ACPI Tables 7ef1b000-7ff9afff : System RAM 7ffb7000-7ffb8fff : reserved 7ffbb000-7ffbbfff : reserved 7ffbe000-7ffbefff : reserved 7ffc1000-7ffc1fff : reserved 7ffc4000-7ffc5fff : reserved 7ffc8000-7ffc8fff : reserved 7fff3000-7fffafff : ACPI Tables 7fffb000-7fffefff : ACPI Non-volatile Storage 7ffff000-7fffffff : System RAM f8800000-f8ffffff : 5620e0c7-8062-4dce-aeb7-520c7ef76171 fec00000-fec00fff : PNP0003:00 fee00000-fee00fff : Local APIC fee00000-fee00fff : PNP0003:00 root@ubuntu:~#By the way, this is a Linux VM on Hyper-V, I am not sure it that make any difference. ThanksSoccer
On Thursday, January 26, 2017 3:34 PM, Ross Zwisler <[email protected]> wrote:
Quoted 58 lines · Soccer Liu
Hi:
I am trying to play with the NVDIMM driver and follow instructions in
https://nvdimm.wiki.kernel.org/how_to_choose_the_correct_memmap_kernel_parameter_for_pmem_on_your_system and
https://www.suse.com/communities/blog/nvdimm-enabling-part-2-intelfor setting up an emulated NVDIMM memory.
I claimed the memory range from
0x10000000--0x1fffffffvia adding a kernel command line param memmap=256M!256M .soccerl@ubuntu:~$ dmesg | grep e820 [ 0.000000] e820: BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009ffff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000c0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007eeecfff] usable <------------------------------- * [ 0.000000] BIOS-e820: [mem 0x000000007eeed000-0x000000007eef1fff] ACPI data [ 0.000000] BIOS-e820: [mem 0x000000007eef2000-0x000000007ef1afff] reserved [ 0.000000] BIOS-e820: [mem 0x000000007ef1b000-0x000000007ff9afff] usable [ 0.000000] BIOS-e820: [mem 0x000000007ff9b000-0x000000007ffb6fff] reserved [ 0.000000] BIOS-e820: [mem 0x000000007ffb7000-0x000000007ffb8fff] type 20 [ 0.000000] BIOS-e820: [mem 0x000000007ffb9000-0x000000007ffbafff] reserved [ 0.000000] BIOS-e820: [mem 0x000000007ffbb000-0x000000007ffbbfff] type 20 [ 0.000000] BIOS-e820: [mem 0x000000007ffbc000-0x000000007ffbdfff] reserved [ 0.000000] BIOS-e820: [mem 0x000000007ffbe000-0x000000007ffbefff] type 20 [ 0.000000] BIOS-e820: [mem 0x000000007ffbf000-0x000000007ffc0fff] reserved [ 0.000000] BIOS-e820: [mem 0x000000007ffc1000-0x000000007ffc1fff] type 20 [ 0.000000] BIOS-e820: [mem 0x000000007ffc2000-0x000000007ffc3fff] reserved [ 0.000000] BIOS-e820: [mem 0x000000007ffc4000-0x000000007ffc5fff] type 20 [ 0.000000] BIOS-e820: [mem 0x000000007ffc6000-0x000000007ffc7fff] reserved [ 0.000000] BIOS-e820: [mem 0x000000007ffc8000-0x000000007ffc8fff] type 20 [ 0.000000] BIOS-e820: [mem 0x000000007ffc9000-0x000000007fff2fff] reserved [ 0.000000] BIOS-e820: [mem 0x000000007fff3000-0x000000007fffafff] ACPI data [ 0.000000] BIOS-e820: [mem 0x000000007fffb000-0x000000007fffefff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x000000007ffff000-0x000000007fffffff] usable [ 0.000000] e820: user-defined physical RAM map: [ 0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved [ 0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable [ 0.000000] e820: last_pfn = 0x80000 max_arch_pfn = 0x400000000 [ 0.000000] e820: [mem 0x80000000-0xffffffff] available for PCI devicessoccerl@ubuntu:~$ dmesg | grep user [ 0.000000] e820: user-defined physical RAM map: [ 0.000000] user: [mem 0x0000000000000000-0x000000000009ffff] usable [ 0.000000] user: [mem 0x00000000000c0000-0x00000000000fffff] reserved [ 0.000000] user: [mem 0x0000000000100000-0x000000000fffffff] usable [ 0.000000] user: [mem 0x0000000010000000-0x000000001fffffff] persistent (type 12) <-------- this shows the memmap works as expected [ 0.000000] user: [mem 0x0000000020000000-0x000000007eeecfff] usable [ 0.000000] user: [mem 0x000000007eeed000-0x000000007eef1fff] ACPI data [ 0.000000] user: [mem 0x000000007eef2000-0x000000007ef1afff] reserved [ 0.000000] user: [mem 0x000000007ef1b000-0x000000007ff9afff] usable [ 0.000000] user: [mem 0x000000007ff9b000-0x000000007ffb6fff] reserved [ 0.000000] user: [mem 0x000000007ffb7000-0x000000007ffb8fff] type 20 [ 0.000000] user: [mem 0x000000007ffb9000-0x000000007ffbafff] reserved [ 0.000000] user: [mem 0x000000007ffbb000-0x000000007ffbbfff] type 20 [ 0.000000] user: [mem 0x000000007ffbc000-0x000000007ffbdfff] reserved [ 0.000000] user: [mem 0x000000007ffbe000-0x000000007ffbefff] type 20 [ 0.000000] user: [mem 0x000000007ffbf000-0x000000007ffc0fff] reserved [ 0.000000] user: [mem 0x000000007ffc1000-0x000000007ffc1fff] type 20
Quoted 8 lines
[ 0.000000] user: [mem 0x000000007ffc2000-0x000000007ffc3fff] reserved [ 0.000000] user: [mem 0x000000007ffc4000-0x000000007ffc5fff] type 20 [ 0.000000] user: [mem 0x000000007ffc6000-0x000000007ffc7fff] reserved [ 0.000000] user: [mem 0x000000007ffc8000-0x000000007ffc8fff] type 20 [ 0.000000] user: [mem 0x000000007ffc9000-0x000000007fff2fff] reserved [ 0.000000] user: [mem 0x000000007fff3000-0x000000007fffafff] ACPI data [ 0.000000] user: [mem 0x000000007fffb000-0x000000007fffefff] ACPI NVS [ 0.000000] user: [mem 0x000000007ffff000-0x000000007fffffff] usable
This all looks fine. I ran my QEMU guest with this same reservation and it worked, so I don't think it's an issue with the size or placement of the reservation.
Quoted 3 lines
However, I could not find any Persistent Memory (legacy) from the iomem output. I was expecting something like
10000000-1fffffff : Persistent Memory (legacy)
Yep, here are the lines in my guest:
10000000-1fffffff : Persistent Memory (legacy) 10000000-1fffffff : namespace0.0
Quoted 17 lines
soccerl@ubuntu:~$ cat /proc/iomem 00000000-00000000 : reserved 00000000-00000000 : System RAM 00000000-00000000 : reserved 00000000-00000000 : System ROM 00000000-00000000 : System RAM 00000000-00000000 : Kernel code 00000000-00000000 : Kernel data 00000000-00000000 : Kernel bss 00000000-00000000 : System RAM 00000000-00000000 : ACPI Tables 00000000-00000000 : System RAM 00000000-00000000 : reserved 00000000-00000000 : reserved 00000000-00000000 : reserved 00000000-00000000 : reserved 00000000-00000000 : reserved
Quoted 8 lines
00000000-00000000 : reserved 00000000-00000000 : ACPI Tables 00000000-00000000 : ACPI Non-volatile Storage 00000000-00000000 : System RAM 00000000-00000000 : 5620e0c7-8062-4dce-aeb7-520c7ef76171 00000000-00000000 : PNP0003:00 00000000-00000000 : Local APIC 00000000-00000000 : PNP0003:00
Ummm...all the addresses are zero? I don't know what would cause this - a broken kconfig option?
Quoted 10 lines
I do have the following kernel config flags set
CONFIG_ARCH_HAS_PMEM_API=yCONFIG_BLK_DEV_PMEM=mCONFIG_LIBNVDIMM=yCONFIG_X86_PMEM_LEGACY=yCONFIG_FS_DAX=yCONFIG_BLK_DEV_RAM_DAX=yAny idea on what I might have missed?
My best guess is that it's a missed kernel config option. Here are the relevant ones from my v4.9 config:
$ egrep -i 'dax|pmem|nvdimm' .config CONFIG_X86_PMEM_LEGACY_DEVICE=y CONFIG_X86_PMEM_LEGACY=m CONFIG_BLK_DEV_RAM_DAX=y CONFIG_LIBNVDIMM=m CONFIG_BLK_DEV_PMEM=m CONFIG_NVDIMM_PFN=y CONFIG_NVDIMM_DAX=y CONFIG_DEV_DAX=m CONFIG_DEV_DAX_PMEM=m CONFIG_NR_DEV_DAX=32768 CONFIG_FS_DAX=y CONFIG_ARCH_HAS_PMEM_API=y
The DEV_DAX ones won't matter, but I'd verify the rest of them and make sure they're set.
Also, what kernel version are you using?
- Ross
_______________________________________________
Linux-nvdimm mailing list
[email protected]
https://lists.01.org/mailman/listinfo/linux-nvdimm