mmap.2: describe the 5level paging hack
Subsystems (4)
PATCH 1/1 mmap.2: describe the 5level paging hack
The manpage is missing information about the compatibility hack for 5-level paging that went in in 4.14, around commit ee00f4a32a76 ("x86/mm:
Allow userspace have mappings above 47-bit"). Add some information about that.
While I don't think any hardware supporting this is shipping yet (?), I think it's useful to try to write a manpage for this API, partly to figure out how usable that API actually is, and partly because when this hardware does ship, it'd be nice if distro manpages had information about how to use it.
---
This patch goes on top of the patch "[PATCH] mmap.2: fix description of treatment of the hint" that I just sent, but I'm not sending them in a series because I want the first one to go in, and I think this one might be a bit more controversial.
It would be nice if the architecture maintainers and mm folks could have a look at this and check that what I wrote is right - I only looked at the source for this, I haven't tried it.
man2/mmap.2 | 15 +++++++++++++++ 1 file changed, 15 insertions(+)
man2/mmap.2 +15 -0
@@ -67,6 +67,8 @@ is NULL, then the kernel chooses the (page-aligned) address at which to create the mapping; this is the most portable method of creating a new mapping. +On Linux, in this case, the kernel may limit the maximum address that can be +used for allocations to a legacy limit for compatibility reasons. If .I addr is not NULL,
@@ -77,6 +79,19 @@ or equal to the value specified by and attempt to create the mapping there. If another mapping already exists there, the kernel picks a new address, independent of the hint. +However, if a hint above the architecture's legacy address limit is provided +(on x86-64: above 0x7ffffffff000, on arm64: above 0x1000000000000, on ppc64 with +book3s: above 0x7fffffffffff or 0x3fffffffffff, depending on page size), the +kernel is permitted to allocate mappings beyond the architecture's legacy +address limit. The availability of such addresses is hardware-dependent. +Therefore, if you want to be able to use the full virtual address space of +hardware that supports addresses beyond the legacy range, you need to specify an +address above that limit; however, for security reasons, you should avoid +specifying a fixed valid address outside the compatibility range, +since that would reduce the value of userspace address space layout +randomization. Therefore, it is recommended to specify an address +.I beyond +the end of the userspace address space. .\" Before Linux 2.6.24, the address was rounded up to the next page .\" boundary; since 2.6.24, it is rounded down! The address of the new mapping is returned as the result of the call.
Signature · 1 line
2.20.1.791.gb4d0f1c61a-goog
Quoted 5 lines · Jann Horn
The manpage is missing information about the compatibility hack for 5-level paging that went in in 4.14, around commit
ee00f4a32a76("x86/mm:
Allow userspace have mappings above 47-bit"). Add some information about that.
Quoted 7 lines
While I don't think any hardware supporting this is shipping yet (?), I think it's useful to try to write a manpage for this API, partly to figure out how usable that API actually is, and partly because when this hardware does ship, it'd be nice if distro manpages had information about how to use it.
Signed-off-by Jann Horn <[email protected]>
Thanks for doing this.
Quoted 33 lines
---
This patch goes on top of the patch "[PATCH] mmap.2: fix description of treatment of the hint" that I just sent, but I'm not sending them in a series because I want the first one to go in, and I think this one might be a bit more controversial.It would be nice if the architecture maintainers and mm folks could have a look at this and check that what I wrote is right - I only looked at the source for this, I haven't tried it.
man2/mmap.2 | 15 +++++++++++++++ 1 file changed, 15 insertions(+)man2/mmap.2 +5
-0@@ -67,6 +67,8 @@ is NULL, then the kernel chooses the (page-aligned) address at which to create the mapping; this is the most portable method of creating a new mapping. +On Linux, in this case, the kernel may limit the maximum address that can be +used for allocations to a legacy limit for compatibility reasons. If .I addr is not NULL,@@ -77,6 +79,19 @@ or equal to the value specified by and attempt to create the mapping there. If another mapping already exists there, the kernel picks a new address, independent of the hint. +However, if a hint above the architecture's legacy address limit is provided +(on x86-64: above 0x7ffffffff000, on arm64: above 0x1000000000000, on ppc64 with +book3s: above 0x7fffffffffff or 0x3fffffffffff, depending on page size), the
man2/mmap.2 or equal to the value specified by · line 94
Quoted 10 lines
man2/mmap.2 +10
-0+kernel is permitted to allocate mappings beyond the architecture's legacy +address limit. The availability of such addresses is hardware-dependent. +Therefore, if you want to be able to use the full virtual address space of +hardware that supports addresses beyond the legacy range, you need to specify an +address above that limit; however, for security reasons, you should avoid +specifying a fixed valid address outside the compatibility range, +since that would reduce the value of userspace address space layout +randomization. Therefore, it is recommended to specify an address +.I beyond +the end of the userspace address space.
It probably worth recommending (void *) -1 as such address.
Quoted 6 lines
man2/mmap.2 +0
-0.\" Before Linux 2.6.24, the address was rounded up to the next page .\" boundary; since 2.6.24, it is rounded down! The address of the new mapping is returned as the result of the call.Signature · 1 line
2.20.1.791.gb4d0f1c61a-goog
Signature · 1 line
Kirill A. Shutemov
Hi Jann,
Quoted 39 lines · Jann Horn
The manpage is missing information about the compatibility hack for 5-level paging that went in in 4.14, around commit
ee00f4a32a76("x86/mm:
Allow userspace have mappings above 47-bit"). Add some information about that.While I don't think any hardware supporting this is shipping yet (?), I think it's useful to try to write a manpage for this API, partly to figure out how usable that API actually is, and partly because when this hardware does ship, it'd be nice if distro manpages had information about how to use it.
Signed-off-by Jann Horn <[email protected]>---
This patch goes on top of the patch "[PATCH] mmap.2: fix description of treatment of the hint" that I just sent, but I'm not sending them in a series because I want the first one to go in, and I think this one might be a bit more controversial.It would be nice if the architecture maintainers and mm folks could have a look at this and check that what I wrote is right - I only looked at the source for this, I haven't tried it.
man2/mmap.2 | 15 +++++++++++++++ 1 file changed, 15 insertions(+)man2/mmap.2 +2
-0@@ -67,6 +67,8 @@ is NULL, then the kernel chooses the (page-aligned) address at which to create the mapping; this is the most portable method of creating a new mapping. +On Linux, in this case, the kernel may limit the maximum address that can be +used for allocations to a legacy limit for compatibility reasons. If .I addr is not NULL,
man2/mmap.2 or equal to the value specified by · line 86
Quoted 8 lines
man2/mmap.2 +5
-0@@ -77,6 +79,19 @@ or equal to the value specified by and attempt to create the mapping there. If another mapping already exists there, the kernel picks a new address, independent of the hint. +However, if a hint above the architecture's legacy address limit is provided +(on x86-64: above 0x7ffffffff000, on arm64: above 0x1000000000000, on ppc64 with +book3s: above 0x7fffffffffff or 0x3fffffffffff, depending on page size), the +kernel is permitted to allocate mappings beyond the architecture's legacy +address limit.
On arm64 we support 36-bit, 39-bit, 42-bit, 47-bit, 48-bit and 52-bit user virtual addresses, some of which also enforce a particular page size of 4k, 16k or 64k. With the exception of 52-bit, the user virtual address size is fixed at compile time and mmap() can allocate up to the maximum address size.
When 52-bit virtual addressing is configured, we continue to allocate up to 48 bits unless either a hint is passed to mmap() as you describe, or CONFIG_ARM64_FORCE_52BIT=y (this is really intended as a debug option and is hidden behind EXPERT as well as being off by default).
One thing that just occurred to me is that our ASLR code is probably pretty weak for addresses greater than 48 bits because I don't think it was updated when we added 52-bit support. I'll take a deeper look when I get some time.
Will
Quoted 4 lines · Jann Horn
The manpage is missing information about the compatibility hack for 5-level paging that went in in 4.14, around commit
ee00f4a32a76("x86/mm:
Allow userspace have mappings above 47-bit"). Add some information about that.
Thanks for doing this.
Quoted 34 lines
While I don't think any hardware supporting this is shipping yet (?), I think it's useful to try to write a manpage for this API, partly to figure out how usable that API actually is, and partly because when this hardware does ship, it'd be nice if distro manpages had information about how to use it.
Signed-off-by Jann Horn <[email protected]>---
This patch goes on top of the patch "[PATCH] mmap.2: fix description of treatment of the hint" that I just sent, but I'm not sending them in a series because I want the first one to go in, and I think this one might be a bit more controversial.It would be nice if the architecture maintainers and mm folks could have a look at this and check that what I wrote is right - I only looked at the source for this, I haven't tried it.
man2/mmap.2 | 15 +++++++++++++++ 1 file changed, 15 insertions(+)man2/mmap.2 +2
-0@@ -67,6 +67,8 @@ is NULL, then the kernel chooses the (page-aligned) address at which to create the mapping; this is the most portable method of creating a new mapping. +On Linux, in this case, the kernel may limit the maximum address that can be +used for allocations to a legacy limit for compatibility reasons. If .I addr is not NULL,
man2/mmap.2 or equal to the value specified by · line 84
Quoted 6 lines
man2/mmap.2 +3
-0@@ -77,6 +79,19 @@ or equal to the value specified by and attempt to create the mapping there. If another mapping already exists there, the kernel picks a new address, independent of the hint. +However, if a hint above the architecture's legacy address limit is provided +(on x86-64: above 0x7ffffffff000, on arm64: above 0x1000000000000, on ppc64 with +book3s: above 0x7fffffffffff or 0x3fffffffffff, depending on page size), the
It doesn't depend on page size for ppc64(le). With 4K pages the user VM is always 64TB.
So the only boundary for us is at 128T when using 64K pages.
cheers
Quoted 49 lines · Jann Horn
The manpage is missing information about the compatibility hack for 5-level paging that went in in 4.14, around commit
ee00f4a32a76("x86/mm:
Allow userspace have mappings above 47-bit"). Add some information about that.While I don't think any hardware supporting this is shipping yet (?), I think it's useful to try to write a manpage for this API, partly to figure out how usable that API actually is, and partly because when this hardware does ship, it'd be nice if distro manpages had information about how to use it.
Signed-off-by Jann Horn <[email protected]>---
This patch goes on top of the patch "[PATCH] mmap.2: fix description of treatment of the hint" that I just sent, but I'm not sending them in a series because I want the first one to go in, and I think this one might be a bit more controversial.It would be nice if the architecture maintainers and mm folks could have a look at this and check that what I wrote is right - I only looked at the source for this, I haven't tried it.
man2/mmap.2 | 15 +++++++++++++++ 1 file changed, 15 insertions(+)man2/mmap.2 +8
-0@@ -67,6 +67,8 @@ is NULL, then the kernel chooses the (page-aligned) address at which to create the mapping; this is the most portable method of creating a new mapping. +On Linux, in this case, the kernel may limit the maximum address that can be +used for allocations to a legacy limit for compatibility reasons. If .I addr is not NULL,@@ -77,6 +79,19 @@ or equal to the value specified by and attempt to create the mapping there. If another mapping already exists there, the kernel picks a new address, independent of the hint. +However, if a hint above the architecture's legacy address limit is provided +(on x86-64: above 0x7ffffffff000, on arm64: above 0x1000000000000, on ppc64 with +book3s: above 0x7fffffffffff or 0x3fffffffffff, depending on page size), the +kernel is permitted to allocate mappings beyond the architecture's legacy +address limit. The availability of such addresses is hardware-dependent. +Therefore, if you want to be able to use the full virtual address space of
man2/mmap.2 or equal to the value specified by · line 97
Quoted 10 lines
man2/mmap.2 +7
-0+hardware that supports addresses beyond the legacy range, you need to specify an +address above that limit; however, for security reasons, you should avoid +specifying a fixed valid address outside the compatibility range, +since that would reduce the value of userspace address space layout +randomization. Therefore, it is recommended to specify an address +.I beyond +the end of the userspace address space. .\" Before Linux 2.6.24, the address was rounded up to the next page .\" boundary; since 2.6.24, it is rounded down! The address of the new mapping is returned as the result of the call.
Hi Jann,
A few comments came in on this patch. Is there anything from those comments that should be rolled into the text?
Thanks,
Michael
Signature · 3 lines
Michael Kerrisk Linux man-pages maintainer; http://www.kernel.org/doc/man-pages/ Linux/UNIX System Programming Training: http://man7.org/training/
Quoted 63 lines · Michael Kerrisk (man-pages)
Quoted 49 lines · Jann Horn
The manpage is missing information about the compatibility hack for 5-level paging that went in in 4.14, around commit
ee00f4a32a76("x86/mm:
Allow userspace have mappings above 47-bit"). Add some information about that.While I don't think any hardware supporting this is shipping yet (?), I think it's useful to try to write a manpage for this API, partly to figure out how usable that API actually is, and partly because when this hardware does ship, it'd be nice if distro manpages had information about how to use it.
Signed-off-by Jann Horn <[email protected]>---
This patch goes on top of the patch "[PATCH] mmap.2: fix description of treatment of the hint" that I just sent, but I'm not sending them in a series because I want the first one to go in, and I think this one might be a bit more controversial.It would be nice if the architecture maintainers and mm folks could have a look at this and check that what I wrote is right - I only looked at the source for this, I haven't tried it.
man2/mmap.2 | 15 +++++++++++++++ 1 file changed, 15 insertions(+)man2/mmap.2 +8
-0@@ -67,6 +67,8 @@ is NULL, then the kernel chooses the (page-aligned) address at which to create the mapping; this is the most portable method of creating a new mapping. +On Linux, in this case, the kernel may limit the maximum address that can be +used for allocations to a legacy limit for compatibility reasons. If .I addr is not NULL,@@ -77,6 +79,19 @@ or equal to the value specified by and attempt to create the mapping there. If another mapping already exists there, the kernel picks a new address, independent of the hint. +However, if a hint above the architecture's legacy address limit is provided +(on x86-64: above 0x7ffffffff000, on arm64: above 0x1000000000000, on ppc64 with +book3s: above 0x7fffffffffff or 0x3fffffffffff, depending on page size), the +kernel is permitted to allocate mappings beyond the architecture's legacy +address limit. The availability of such addresses is hardware-dependent. +Therefore, if you want to be able to use the full virtual address space ofman2/mmap.2 or equal to the value specified by · line 97
Quoted 10 lines
man2/mmap.2 +7
-0+hardware that supports addresses beyond the legacy range, you need to specify an +address above that limit; however, for security reasons, you should avoid +specifying a fixed valid address outside the compatibility range, +since that would reduce the value of userspace address space layout +randomization. Therefore, it is recommended to specify an address +.I beyond +the end of the userspace address space. .\" Before Linux 2.6.24, the address was rounded up to the next page .\" boundary; since 2.6.24, it is rounded down! The address of the new mapping is returned as the result of the call.Hi Jann,
Quoted 2 lines
A few comments came in on this patch. Is there anything from those comments that should be rolled into the text?
Hi!
Yeah, I think all the feedback on the patch were good points, and I'll have to integrate that into my patch.