sh: Implement __get_user_u64() required for 64-bit get_user()
John Paul Adrian Glaubitz
maintainerPATCH RESEND 1/1 sh: Implement __get_user_u64() required for 64-bit get_user()
Hi!
This is my attempt of implementing a 64-bit get_user() for SH to address the build problem when CONFIG_INFINIBAND_USER_ACCESS is enabled.
I have carefully looked at the existing implementations of __get_user_asm(), __put_user_asm() and the 64-bit __put_user_u64() to come up with the 64-bit __get_user_u64().
I'm admittedly not an expert when it comes to writing GCC contraints, so the code might be completely wrong. However, it builds fine without warnings and fixes the aforementioned issue for me.
Hopefully someone from the more experienced group of kernel developers can review my code and help me get it into proper shape for submission.
Resent because I forgot to add a subject for the first cover text.
Thanks,
Adrian
--
.''`. John Paul Adrian Glaubitz : :' : Debian Developer - [email protected] `. `' Freie Universitaet Berlin - [email protected] `- GPG: 62FF 8A75 84E0 2956 9546 0006 7426 3B37 F5B5 F913
John Paul Adrian Glaubitz
maintainerPATCH 1/1 sh: Implement __get_user_u64() required for 64-bit get_user()
Trying to build the kernel with CONFIG_INFINIBAND_USER_ACCESS enabled fails
ERROR: "__get_user_unknown" [drivers/infiniband/core/ib_uverbs.ko] undefined!
with on SH since the kernel misses a 64-bit implementation of get_user().
Implement the missing 64-bit get_user() as __get_user_u64(), matching the already existing __put_user_u64() which implements the 64-bit put_user().
--- arch/sh/include/asm/uaccess_32.h | 49 ++++++++++++++++++++++++++++++++ 1 file changed, 49 insertions(+)
arch/sh/include/asm/uaccess_32.h +49 -0
@@ -26,6 +26,9 @@ do { \case 4 : \__get_user_asm (x, ptr, retval,"l" ); \break ; \ +case 8 : \ +__get_user_u64 (x, ptr, retval); \ +break ; \default : \__get_user_unknown (); \break ; \
@@ -66,6 +69,52 @@ do { \extern void __get_user_unknown (void ); +#if defined(CONFIG_CPU_LITTLE_ENDIAN ) +#define __get_user_u64 (x, addr, err) \ +({ \ +__asm__ __volatile__( \ + "1:\n\t" \ + "mov.l %2,%R1\n\t" \ + "mov.l %T2,%S1\n\t" \ + "2:\n" \ + ".section .fixup,\"ax\"\n" \ + "3:\n\t" \ + "mov #0, %1\n\t" \ + "mov.l 4f, %0\n\t" \ + "jmp @%0\n\t" \ + " mov %3, %0\n\t" \ + ".balign 4\n" \ + "4: .long 2b\n\t" \ + ".previous\n" \ + ".section __ex_table,\"a\"\n\t" \ + ".long 1b, 3b\n\t" \ + ".previous" \ + :"=&r" (err), "=&r" (x) \ + :"m" (__m(addr)), "i" (-EFAULT), "0" (err)); }) +#else +#define __get_user_u64 (x, addr, err) \ +({ \ +__asm__ __volatile__( \ + "1:\n\t" \ + "mov.l %2,%S1\n\t" \ + "mov.l %T2,%R1\n\t" \ + "2:\n" \ + ".section .fixup,\"ax\"\n" \ + "3:\n\t" \ + "mov #0, %1\n\t" \ + "mov.l 4f, %0\n\t" \ + "jmp @%0\n\t" \ + " mov %3, %0\n\t" \ + ".balign 4\n" \ + "4: .long 2b\n\t" \ + ".previous\n" \ + ".section __ex_table,\"a\"\n\t" \ + ".long 1b, 3b\n\t" \ + ".previous" \ + :"=&r" (err), "=&r" (x) \ + :"m" (__m(addr)), "i" (-EFAULT), "0" (err)); }) +#endif +#define __put_user_size (x,ptr,size,retval) \ do { \ retval = 0; \
Signature · 1 line
2.27.0.rc2
Hi Adrian,
Quoted 10 lines · John Paul Adrian Glaubitz
Trying to build the kernel with
CONFIG_INFINIBAND_USER_ACCESSenabled failsERROR: "
__get_user_unknown" [drivers/infiniband/core/ib_uverbs.ko] undefined!with on SH since the kernel misses a 64-bit implementation of
get_user().Implement the missing 64-bit
get_user()as__get_user_u64(), matching the already existing__put_user_u64()which implements the 64-bitput_user().Signed-off-by John Paul Adrian Glaubitz <[email protected]>
Thanks for your patch!
Quoted 17 lines
arch/sh/include/asm/uaccess_32.h +4
-0@@ -26,6 +26,9 @@ do { \case 4 : \__get_user_asm (x, ptr, retval,"l" ); \break ; \ +case 8 : \ +__get_user_u64 (x, ptr, retval); \ +break ; \default : \__get_user_unknown (); \break ; \@@ -66,6 +69,52 @@ do { \extern void __get_user_unknown (void ); +#if defined(CONFIG_CPU_LITTLE_ENDIAN )
arch/sh/include/asm/uaccess_32.h do { \ · line 82
Quoted 10 lines
arch/sh/include/asm/uaccess_32.h +10
-0+#define __get_user_u64 (x, addr, err) \ +({ \ +__asm__ __volatile__( \ + "1:\n\t" \ + "mov.l %2,%R1\n\t" \ + "mov.l %T2,%S1\n\t" \ + "2:\n" \ + ".section .fixup,\"ax\"\n" \ + "3:\n\t" \ + "mov #0, %1\n\t" \
As this is the 64-bit variant, I think this single move should be replaced by a double move:
"mov #0,%R1\n\t" \
"mov #0,%S1\n\t" \Same for the big endian version below.
Disclaimer: uncompiled, untested, no SH assembler expert.
arch/sh/include/asm/uaccess_32.h do { \ · line 93
Quoted 11 lines
arch/sh/include/asm/uaccess_32.h +11
-0+"mov.l 4f, %0\n\t" \ +"jmp @%0\n\t" \ +" mov %3, %0\n\t" \ +".balign 4\n" \ +"4: .long 2b\n\t" \ +".previous\n" \ +".section __ex_table,\"a\"\n\t" \ +".long 1b, 3b\n\t" \ +".previous" \ + :"=&r" (err), "=&r" (x) \ + :"m" (__m(addr)), "i" (-EFAULT), "0" (err)); })
Gr{oetje,eeting}s,
Geert
Signature · 5 lines
Geert Uytterhoeven -- There's lots of Linux beyond ia32 -- [email protected] In personal conversations with technical people, I call myself a hacker. But when I'm talking to journalists I just say "programmer" or something like that. -- Linus Torvalds
John Paul Adrian Glaubitz
maintainerHi Geert!
Quoted 9 lines · Geert Uytterhoeven
As this is the 64-bit variant, I think this single move should be replaced by a double move:
"mov #0,%R1\n\t" \ "mov #0,%S1\n\t" \Same for the big endian version below.
Disclaimer: uncompiled, untested, no SH assembler expert.
Right, this makes sense. I'll send a new patch shortly.
As for the assembler review, I'll ask Yutaka Niibe who is a friend of mine and one of the original SuperH wizards ;).
Adrian
Signature · 4 lines
.''`. John Paul Adrian Glaubitz : :' : Debian Developer - [email protected] `. `' Freie Universitaet Berlin - [email protected] `- GPG: 62FF 8A75 84E0 2956 9546 0006 7426 3B37 F5B5 F913
John Paul Adrian Glaubitz
maintainerQuoted 6 lines · John Paul Adrian Glaubitz
Hi Geert!
Quoted 3 lines · Geert Uytterhoeven
As this is the 64-bit variant, I think this single move should be replaced by a double move:
Quoted 8 lines
Quoted 6 lines
"mov #0,%R1\n\t" \ "mov #0,%S1\n\t" \Same for the big endian version below.
Disclaimer: uncompiled, untested, no SH assembler expert.
Right, this makes sense. I'll send a new patch shortly.
Hmm, this change is not the case for __put_user_asm() vs. __put_user_u64().
But I have to admit, I don't know what the part below "3:\n\t" is for.
Adrian
Signature · 4 lines
.''`. John Paul Adrian Glaubitz : :' : Debian Developer - [email protected] `. `' Freie Universitaet Berlin - [email protected] `- GPG: 62FF 8A75 84E0 2956 9546 0006 7426 3B37 F5B5 F913
Hi Adrian,
Quoted 8 lines · John Paul Adrian Glaubitz
Quoted 7 lines · John Paul Adrian Glaubitz
Quoted 6 lines · Geert Uytterhoeven
As this is the 64-bit variant, I think this single move should be replaced by a double move:
"mov #0,%R1\n\t" \ "mov #0,%S1\n\t" \
Quoted 8 lines
Quoted 5 lines
Quoted 3 lines
Same for the big endian version below.
Disclaimer: uncompiled, untested, no SH assembler expert.
Right, this makes sense. I'll send a new patch shortly.
Hmm, this change is not the case for
__put_user_asm()vs.__put_user_u64(). But I have to admit, I don't know what the part below "3:\n\t" is for.
It's part of the exception handling, in case the passed (userspace) pointer points to an inaccessible address, and triggers an exception.
For an invalid store, nothing is done, besides returning -EFAULT. Hence there's no "mov #0, %1\n\t" in the put_user case.
For an invalid load, the data is replaced by zero, and -EFAULT is returned.
arch/sh/include/asm/uaccess_32.h do { \ · line 79
Quoted 5 lines
arch/sh/include/asm/uaccess_32.h +5
-0+__asm__ __volatile__( \ +"1:\n\t" \ +"mov.l %2,%R1\n\t" \ +"mov.l %T2,%S1\n\t" \ + "2:\n" \
(reordering the two sections for easier explanation)
Review
Quoted 2 lines
(quoted diff) +2
-0+ ".section __ex_table,\"a\"\n\t" \ + ".long 1b, 3b\n\t" \
In case an exception happens for the instruction at 1b, jump to 3b.
Note that the m68k version has two entries here: one for each half of the 64-bit access[*].
I don't know if that is really needed (and thus SH needs it, too), or if the exception code handles subsequent instructions automatically.
arch/sh/include/asm/uaccess_32.h do { \ · line 82
Quoted 3 lines
arch/sh/include/asm/uaccess_32.h +3
-0+".section .fixup,\"ax\"\n" \ +"3:\n\t" \ +"mov #0, %1\n\t" \
Return zero instead of the data at the (invalid) address.
Review
Quoted 2 lines
(quoted diff) +2
-0+ "mov.l 4f, %0\n\t" \ + "jmp @%0\n\t" \
Resume at 2b.
Remember: branch delay slot, so the instruction below is executed first!
Quoted 1 line
+ " mov %3, %0\n\t" \
Set err to -EFAULT.
arch/sh/include/asm/uaccess_32.h do { \ · line 93
Quoted 7 lines
arch/sh/include/asm/uaccess_32.h +6
-0+".balign 4\n" \ +"4: .long 2b\n\t" \ +".previous\n" \ +".previous" \ + :"=&r" (err), "=&r" (x) \ + :"m" (__m(addr)), "i" (-EFAULT), "0" (err)); })
[*] arch/m68k/include/asm/uaccess_mm.h
"1: "MOVES".l (%2)+,%1\n" \
"2: "MOVES".l (%2),%R1\n" \ " .section __ex_table,\"a\"\n" \
" .align 4\n" \
" .long 1b,10b\n" \
" .long 2b,10b\n" \Gr{oetje,eeting}s,
Geert
Signature · 5 lines
Geert Uytterhoeven -- There's lots of Linux beyond ia32 -- [email protected] In personal conversations with technical people, I call myself a hacker. But when I'm talking to journalists I just say "programmer" or something like that. -- Linus Torvalds
John Paul Adrian Glaubitz
maintainerHi Geert!
Thanks a lot for the explanation!
Quoted 8 lines · Geert Uytterhoeven
Quoted 2 lines
Hmm, this change is not the case for
__put_user_asm()vs.__put_user_u64(). But I have to admit, I don't know what the part below "3:\n\t" is for.It's part of the exception handling, in case the passed (userspace) pointer points to an inaccessible address, and triggers an exception.
For an invalid store, nothing is done, besides returning
-EFAULT. Hence there's no "mov #0, %1\n\t" in theput_usercase.
I have replaced it with two individual mov's now as suggested since I now understand what's happening here.
Quoted 13 lines
For an invalid load, the data is replaced by zero, and
-EFAULTis returned.arch/sh/include/asm/uaccess_32.h do { \ · line 79
Quoted 5 lines
arch/sh/include/asm/uaccess_32.h +5
-0+__asm__ __volatile__( \ +"1:\n\t" \ +"mov.l %2,%R1\n\t" \ +"mov.l %T2,%S1\n\t" \ + "2:\n" \(reordering the two sections for easier explanation)
Review
Quoted 2 lines
(quoted diff) +2
-0+ ".section __ex_table,\"a\"\n\t" \ + ".long 1b, 3b\n\t" \
Quoted 6 lines
In case an exception happens for the instruction at 1b, jump to 3b.
Note that the m68k version has two entries here: one for each half of the 64-bit access[*].
I don't know if that is really needed (and thus SH needs it, too), or if the exception code handles subsequent instructions automatically.
Hmm. I assume this is something one of the SH maintainers or Yutaka Niibe can answer.
Quoted 5 lines
arch/sh/include/asm/uaccess_32.h do { \ · line 82
Quoted 3 lines
arch/sh/include/asm/uaccess_32.h +3
-0+".section .fixup,\"ax\"\n" \ +"3:\n\t" \ +"mov #0, %1\n\t" \Return zero instead of the data at the (invalid) address.
Makes sense.
Quoted 5 lines
Review
Quoted 2 lines
(quoted diff) +2
-0+ "mov.l 4f, %0\n\t" \ + "jmp @%0\n\t" \Resume at 2b.
Remember: branch delay slot, so the instruction below is executed first!
I didn't even know that SH has delay slots.
Quoted 3 lines
Quoted 1 line
+ " mov %3, %0\n\t" \
Set err to
-EFAULT.
Yes.
Quoted 10 lines
arch/sh/include/asm/uaccess_32.h do { \ · line 93
Quoted 7 lines
arch/sh/include/asm/uaccess_32.h +6
-0+".balign 4\n" \ +"4: .long 2b\n\t" \ +".previous\n" \ +".previous" \ + :"=&r" (err), "=&r" (x) \ + :"m" (__m(addr)), "i" (-EFAULT), "0" (err)); })[*]
arch/m68k/include/asm/uaccess_mm.h
Quoted 8 lines
"1: "MOVES".l (%2)+,%1\n" \ "2: "MOVES".l (%2),%R1\n" \" .section __ex_table,\"a\"\n" \ " .align 4\n" \ " .long 1b,10b\n" \ " .long 2b,10b\n" \
Hmm. I'll wait for more feedback whether need to do the same as on m68k here.
Adrian
Signature · 4 lines
.''`. John Paul Adrian Glaubitz : :' : Debian Developer - [email protected] `. `' Freie Universitaet Berlin - [email protected] `- GPG: 62FF 8A75 84E0 2956 9546 0006 7426 3B37 F5B5 F913
Rich Felker
maintainerQuoted 39 lines · Geert Uytterhoeven
Hi Adrian,
Quoted 8 lines · John Paul Adrian Glaubitz
Quoted 7 lines · John Paul Adrian Glaubitz
Quoted 6 lines · Geert Uytterhoeven
As this is the 64-bit variant, I think this single move should be replaced by a double move:
"mov #0,%R1\n\t" \ "mov #0,%S1\n\t" \Quoted 8 lines
Quoted 5 lines
Quoted 3 lines
Same for the big endian version below.
Disclaimer: uncompiled, untested, no SH assembler expert.
Right, this makes sense. I'll send a new patch shortly.
Hmm, this change is not the case for
__put_user_asm()vs.__put_user_u64(). But I have to admit, I don't know what the part below "3:\n\t" is for.It's part of the exception handling, in case the passed (userspace) pointer points to an inaccessible address, and triggers an exception.
For an invalid store, nothing is done, besides returning
-EFAULT. Hence there's no "mov #0, %1\n\t" in theput_usercase.
For an invalid load, the data is replaced by zero, and-EFAULTis returned.arch/sh/include/asm/uaccess_32.h do { \ · line 79
Quoted 5 lines
arch/sh/include/asm/uaccess_32.h +5
-0+__asm__ __volatile__( \ +"1:\n\t" \ +"mov.l %2,%R1\n\t" \ +"mov.l %T2,%S1\n\t" \ + "2:\n" \(reordering the two sections for easier explanation)
Review
Quoted 2 lines
(quoted diff) +2
-0+ ".section __ex_table,\"a\"\n\t" \ + ".long 1b, 3b\n\t" \
Quoted 6 lines
In case an exception happens for the instruction at 1b, jump to 3b.
Note that the m68k version has two entries here: one for each half of the 64-bit access[*].
I don't know if that is really needed (and thus SH needs it, too), or if the exception code handles subsequent instructions automatically.
Can I propose a different solution? For archs where there isn't actually any 64-bit load or store instruction, does it make sense to be writing asm just to do two 32-bit loads/stores, especially when this code is not in a hot path?
What about just having the 64-bit versions call the corresponding 32-bit version twice? (Ideally this would even be arch-generic and could replace the m68k asm.) It would return EFAULT if either of the 32-bit calls did.
Rich
Hi Rich,
Quoted 50 lines · Rich Felker
Quoted 37 lines · Geert Uytterhoeven
Quoted 8 lines · John Paul Adrian Glaubitz
Quoted 7 lines · John Paul Adrian Glaubitz
Quoted 6 lines · Geert Uytterhoeven
As this is the 64-bit variant, I think this single move should be replaced by a double move:
"mov #0,%R1\n\t" \ "mov #0,%S1\n\t" \Quoted 8 lines
Quoted 5 lines
Quoted 3 lines
Same for the big endian version below.
Disclaimer: uncompiled, untested, no SH assembler expert.
Right, this makes sense. I'll send a new patch shortly.
Hmm, this change is not the case for
__put_user_asm()vs.__put_user_u64(). But I have to admit, I don't know what the part below "3:\n\t" is for.It's part of the exception handling, in case the passed (userspace) pointer points to an inaccessible address, and triggers an exception.
For an invalid store, nothing is done, besides returning
-EFAULT. Hence there's no "mov #0, %1\n\t" in theput_usercase.
For an invalid load, the data is replaced by zero, and-EFAULTis returned.arch/sh/include/asm/uaccess_32.h do { \ · line 79
Quoted 5 lines
arch/sh/include/asm/uaccess_32.h +5
-0+__asm__ __volatile__( \ +"1:\n\t" \ +"mov.l %2,%R1\n\t" \ +"mov.l %T2,%S1\n\t" \ + "2:\n" \(reordering the two sections for easier explanation)
Review
Quoted 2 lines
(quoted diff) +2
-0+ ".section __ex_table,\"a\"\n\t" \ + ".long 1b, 3b\n\t" \Quoted 6 lines
In case an exception happens for the instruction at 1b, jump to 3b.
Note that the m68k version has two entries here: one for each half of the 64-bit access[*].
I don't know if that is really needed (and thus SH needs it, too), or if the exception code handles subsequent instructions automatically.Can I propose a different solution? For archs where there isn't actually any 64-bit load or store instruction, does it make sense to be writing asm just to do two 32-bit loads/stores, especially when this code is not in a hot path?
Quoted 4 lines
What about just having the 64-bit versions call the corresponding 32-bit version twice? (Ideally this would even be arch-generic and could replace the m68k asm.) It would return EFAULT if either of the 32-bit calls did.
Yes, that's an option, too.
Gr{oetje,eeting}s,
Geert
Signature · 5 lines
Geert Uytterhoeven -- There's lots of Linux beyond ia32 -- [email protected] In personal conversations with technical people, I call myself a hacker. But when I'm talking to journalists I just say "programmer" or something like that. -- Linus Torvalds
John Paul Adrian Glaubitz
maintainerHello!
Quoted 11 lines · Geert Uytterhoeven
Quoted 9 lines
Can I propose a different solution? For archs where there isn't actually any 64-bit load or store instruction, does it make sense to be writing asm just to do two 32-bit loads/stores, especially when this code is not in a hot path?
What about just having the 64-bit versions call the corresponding 32-bit version twice? (Ideally this would even be arch-generic and could replace the m68k asm.) It would return EFAULT if either of the 32-bit calls did.
Yes, that's an option, too.
That's the solution that Michael Karcher suggested to me as an alternative when I talked to him off-list.
While I understand that it works, I don't like the inconsistency and I also don't see why we should opt for a potentially slower solution when we can used the fastest one.
I'm also not sure how the exception handling would properly work when you have two invocations of __get_user_asm().
My current approach is consistent with the existing code, so I think it's the natural choice. I just need someone with more experience in SH assembler than me that the solution is correct.
I have already pinged Niibe-san in private, he'll hopefully get back to me within the next days.
Adrian
Signature · 4 lines
.''`. John Paul Adrian Glaubitz : :' : Debian Developer - [email protected] `. `' Freie Universitaet Berlin - [email protected] `- GPG: 62FF 8A75 84E0 2956 9546 0006 7426 3B37 F5B5 F913
Rich Felker
maintainerQuoted 25 lines · John Paul Adrian Glaubitz
Hello!
Quoted 11 lines · Geert Uytterhoeven
Quoted 9 lines
Can I propose a different solution? For archs where there isn't actually any 64-bit load or store instruction, does it make sense to be writing asm just to do two 32-bit loads/stores, especially when this code is not in a hot path?
What about just having the 64-bit versions call the corresponding 32-bit version twice? (Ideally this would even be arch-generic and could replace the m68k asm.) It would return EFAULT if either of the 32-bit calls did.
Yes, that's an option, too.
That's the solution that Michael Karcher suggested to me as an alternative when I talked to him off-list.
While I understand that it works, I don't like the inconsistency and I also don't see why we should opt for a potentially slower solution when we can used the fastest one.
I'm also not sure how the exception handling would properly work when you have two invocations of
__get_user_asm().
Quoted 6 lines
My current approach is consistent with the existing code, so I think it's the natural choice. I just need someone with more experience in SH assembler than me that the solution is correct.
I have already pinged Niibe-san in private, he'll hopefully get back to me within the next days.
I don't have an objection to doing it the way you've proposed, but I don't think there's any performance distinction or issue with the two invocations.
Quoted 7 lines · Rich Felker
Quoted 7 lines
Quoted 5 lines
Quoted 4 lines
Can I propose a different solution? For archs where there isn't actually any 64-bit load or store instruction, does it make sense to be writing asm just to do two 32-bit loads/stores, especially when this code is not in a hot path?
Yes, that's an option, too.
That's the solution that Michael Karcher suggested to me as an alternative when I talked to him off-list.
There is a functional argument agains using get_user_32 twice, which I overlooked in my private reply to Adrian. If any of the loads fail, we do not only want err to be set to -EFAULT (which will happen), but we also want a 64-bit zero as result. If one 32-bit read faults, but the other one works, we would get -EFAULT together with 32 valid data bits, and 32 zero bits.
I continue to elaborate on my performance remark, ignoring this functional difference (which is a good reason to not just use two 32-bit accesses, much more so than the performance "issue").
Quoted 3 lines
I don't have an objection to doing it the way you've proposed, but I don't think there's any performance distinction or issue with the two invocations.
Assuming we don't need two exception table entries (put_user_64 currently uses only one, maybe it's wrong), using put_user_32 twice creates an extra unneeded exception table entry, which will "bloat" the exception table. That table is most likely accessed by a binary search algorithm, so the performance loss is marginal, though. Also a bigger table size is cache-unfriendly. (Again, this is likely marginal again, as binary search is already extremely cache-unfriendly).
A similar argument can be made for the exception handler. Even if we need two entries in the exception table, so the first paragraph does not apply, the two entries in the exception table can share the same exception handler (clear the whole 64-bit destination to zero, set -EFAULT, jump past both load instructions), so that part of (admittedly cold) kernel code can get some instructios shorter.
Regards,
Michael Karcher
Rich Felker
maintainerQuoted 9 lines · Michael Karcher
Quoted 7 lines · Rich Felker
Quoted 7 lines
Quoted 5 lines
Quoted 4 lines
Can I propose a different solution? For archs where there isn't actually any 64-bit load or store instruction, does it make sense to be writing asm just to do two 32-bit loads/stores, especially when this code is not in a hot path?
Yes, that's an option, too.
That's the solution that Michael Karcher suggested to me as an alternative when I talked to him off-list.
Quoted 6 lines
There is a functional argument agains using
get_user_32twice, which I overlooked in my private reply to Adrian. If any of the loads fail, we do not only want err to be set to-EFAULT(which will happen), but we also want a 64-bit zero as result. If one 32-bit read faults, but the other one works, we would get-EFAULTtogether with 32 valid data bits, and 32 zero bits.
Indeed, if you do it that way you want to check the return value and set the value to 0 if either faults.
BTW I'm not sure what's supposed to happen on write if half faults after the other half already succeeded... Either a C approach or an asm approach has to consider that.
Quoted 12 lines
Quoted 3 lines
I don't have an objection to doing it the way you've proposed, but I don't think there's any performance distinction or issue with the two invocations.
Assuming we don't need two exception table entries (
put_user_64currently uses only one, maybe it's wrong), usingput_user_32twice creates an extra unneeded exception table entry, which will "bloat" the exception table. That table is most likely accessed by a binary search algorithm, so the performance loss is marginal, though. Also a bigger table size is cache-unfriendly. (Again, this is likely marginal again, as binary search is already extremely cache-unfriendly).
Quoted 6 lines
A similar argument can be made for the exception handler. Even if we need two entries in the exception table, so the first paragraph does not apply, the two entries in the exception table can share the same exception handler (clear the whole 64-bit destination to zero, set
-EFAULT, jump past both load instructions), so that part of (admittedly cold) kernel code can get some instructios shorter.
Indeed. I don't think it's a significant difference but if kernel folks do that's fine. In cases like this my personal preference is to err on the side of less arch-specific asm.
Rich
Quoted 8 lines · Rich Felker
Quoted 6 lines
There is a functional argument agains using
get_user_32twice, which I overlooked in my private reply to Adrian. If any of the loads fail, we do not only want err to be set to-EFAULT(which will happen), but we also want a 64-bit zero as result. If one 32-bit read faults, but the other one works, we would get-EFAULTtogether with 32 valid data bits, and 32 zero bits.Indeed, if you do it that way you want to check the return value and set the value to 0 if either faults.
Indeed. And if you do *that*, the performance of the hot path is affected by the extra check. The performance discussion below only applied to the cold path, so it seems perfectly valid to disregard it in favore of better maintainability. On the other hand, checking the return value has a possibly more serious performance and size (and if you like at the I-Cache, size means performance) impact. When discussing size impact, we should keep in mind that put_user for fixed size is supposed to be inlined, so it's not a one-time cost, but a cost per call. On the other hand, though, put_user for 64-bit values on SH4 seems to be nearly never called, so the impact is still most likely negligible.
Quoted 3 lines
BTW I'm not sure what's supposed to happen on write if half faults after the other half already succeeded... Either a C approach or an asm approach has to consider that.
That's an interesting question. From a kernel developer's point of view, it seems like a valid view to say: "If userspace provides a bad pointer where the kernel has to put the data, it's a problem of userspace. The kernel only needs to tell userspace that the write is incomplete." This is different to the defensive approach used when reading from user space into kernel space. Here forcing the whole 64 bit to be zero makes the kernel itself more robust by removing strange corner cases.
Quoted 3 lines
Indeed. I don't think it's a significant difference but if kernel folks do that's fine. In cases like this my personal preference is to err on the side of less arch-specific asm.
This is a good idea to reduce maintainance cost. I agree it's up to the kernel folks to decide whether:
- Half-zeroed reads of partially faulted 64-bit-reads are acceptable
- Cold error checks in the hot path to ensure full zeroing is acceptable
- maintainance of arch-specific asm on many 32-bit architectures is
acceptable.
I don't want to endorse one of these three options, as I am out of the loop regarding kernel development priorities and philosophy, I just intend to point out the different options the kernel has to pick the one that fits best.
Regards,
Michael Karcher