Two x86 fixes
Subsystems (4)
v6 cover Two x86 fixes
Hi,
This is the v6 of two x86 fixes.
1) x86/delay: Fix the wrong Assembly constraint in delay_loop() function.
2) x86/MCE/AMD: Fix memory leak when threshold_create_bank() fails.
## Changelog
v6:
- Remove unnecessary Cc tags.
- Undo the stable mark for patch 1.
- Update commit message, emphasize the danger when the compiler decides to inline the function.
- Fix the Fixes tag sha1 in patch 1.
- Change the helper function name to __threshold_remove_device().
v5:
- Mark patch #1 for stable.
- Commit message improvement for patch #1 and #2.
- Fold in changes from Yazen and Alviro (for patch #2).
v4:
- Address comment from Greg, sha1 commit Fixes only needs to be 12 chars.
- Add the author of the fixed commit to the CC list.
v3:
- Fold in changes from Alviro, the previous version is still leaking @bank[n].
v2:
- Fix wrong copy/paste.
---
Ammar Faizi (2):
x86/delay: Fix the wrong asm constraint in delay_loop() x86/MCE/AMD: Fix memory leak when threshold_create_bank() fails
arch/x86/kernel/cpu/mce/amd.c | 32 +++++++++++++++++++------------- arch/x86/lib/delay.c | 4 ++-- 2 files changed, 21 insertions(+), 15 deletions(-)
base-commit: 1930a6e739c4b4a654a69164dbe39e554d228915
Signature · 1 line
Ammar Faizi
PATCH v6 1/2 x86/delay: Fix the wrong asm constraint in `delay_loop()`
The asm constraint does not reflect that the asm statement can modify the value of @loops. But the asm statement in delay_loop() does modify the @loops.
Specifiying the wrong constraint may lead to undefined behavior, it may clobber random stuff (e.g. local variable, important temporary value in regs, etc.). This is especially dangerous when the compiler decides to inline the function and since it doesn't know that the value gets modified, it might decide to use it from a register directly without reloading it.
Fix this by changing the constraint from "a" (as an input) to "+a" (as an input and output).
---
v6:
- Remove unnecessary Cc tags.
- Update commit message, emphasize the danger when the compiler decides to inline the function.
- Fix the Fixes tag sha1.
- Remove stable Cc.
--- arch/x86/lib/delay.c | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-)
arch/x86/lib/delay.c +2 -2
@@ -54,8 +54,8 @@ static void delay_loop(u64 __loops)" jnz 2b \n" "3: dec %0 \n" - : /* we don't need output */ - :"a" (loops) + : "+a" (loops) + : ); }
Signature · 1 line
Ammar Faizi
Re: [PATCH v6 1/2] x86/delay: Fix the wrong asm constraint in `delay_loop()`
Quoted 11 lines · Ammar Faizi
The asm constraint does not reflect that the asm statement can modify the value of @loops. But the asm statement in
delay_loop()does modify the @loops.Specifiying the wrong constraint may lead to undefined behavior, it may clobber random stuff (e.g. local variable, important temporary value in regs, etc.). This is especially dangerous when the compiler decides to inline the function and since it doesn't know that the value gets modified, it might decide to use it from a register directly without reloading it.
Quoted 2 lines
Fix this by changing the constraint from "a" (as an input) to "+a" (as an input and output).
Was this found by inspection or was it causing real-world problems?
Re: [PATCH v6 1/2] x86/delay: Fix the wrong asm constraint in `delay_loop()`
Quoted 1 line · Dave Hansen
Was this found by inspection or was it causing real-world problems?
It was found by inspection, no real-world problems found so far.
Signature · 1 line
Ammar Faizi
Re: [PATCH v6 1/2] x86/delay: Fix the wrong asm constraint in `delay_loop()`
In reply to Ammar FaiziQuoted 11 lines · Ammar Faizi
The asm constraint does not reflect that the asm statement can modify the value of @loops. But the asm statement in
delay_loop()does modify the @loops.Specifiying the wrong constraint may lead to undefined behavior, it may clobber random stuff (e.g. local variable, important temporary value in regs, etc.). This is especially dangerous when the compiler decides to inline the function and since it doesn't know that the value gets modified, it might decide to use it from a register directly without reloading it.
Quoted 2 lines
Fix this by changing the constraint from "a" (as an input) to "+a" (as an input and output).
This analysis is plain wrong. The assembly code operates on a register and not on memory:
asm volatile( " test %0,%0 \n" " jz 3f \n" " jmp 1f \n" ".align 16 \n" "1: jmp 2f \n" ".align 16 \n" "2: dec %0 \n" " jnz 2b \n" "3: dec %0 \n" : /* we don't need output */
----> :"a" (loops)
This tells the compiler to use [RE]AX and initialize it from the variable 'loops'. It's never written back because all '%0' in the above assembly are substituted with [RE]AX. This also tells the compiler that the inline assembly clobbers [RE]AX and that's all it needs to know.
Nothing to fix here, whether the code is inlined or not.
Thanks,
tglx
Re: [PATCH v6 1/2] x86/delay: Fix the wrong asm constraint in `delay_loop()`
Quoted 34 lines · Thomas Gleixner
Quoted 11 lines · Ammar Faizi
The asm constraint does not reflect that the asm statement can modify the value of @loops. But the asm statement in
delay_loop()does modify the @loops.Specifiying the wrong constraint may lead to undefined behavior, it may clobber random stuff (e.g. local variable, important temporary value in regs, etc.). This is especially dangerous when the compiler decides to inline the function and since it doesn't know that the value gets modified, it might decide to use it from a register directly without reloading it.
Quoted 2 lines
Fix this by changing the constraint from "a" (as an input) to "+a" (as an input and output).
This analysis is plain wrong. The assembly code operates on a register and not on memory:
asm volatile( " test %0,%0 \n" " jz 3f \n" " jmp 1f \n" ".align 16 \n" "1: jmp 2f \n" ".align 16 \n" "2: dec %0 \n" " jnz 2b \n" "3: dec %0 \n" : /* we don't need output */
Quoted 6 lines
----> :"a" (loops)
This tells the compiler to use [RE]AX and initialize it from the variable 'loops'. It's never written back because all '%0' in the above assembly are substituted with [RE]AX. This also tells the compiler that the inline assembly clobbers [RE]AX and that's all it needs to know.
Hi Thomas,
Thanks for taking a look. I doubt about your sentence "This also tells the compiler that the inline assembly clobbers [RE]AX".
How come it tells the compiler that the inline ASM clobbers [RE]AX?
That's an input constraint. Doesn't that mean it is read-only for the ASM statement? That means the compiler is allowed to assume [RE]AX doesn't change inside the ASM statement.
Those decs do really change the [RE]AX. Please review this again.
Thanks!
Signature · 1 line
Ammar Faizi
Re: [PATCH v6 1/2] x86/delay: Fix the wrong asm constraint in `delay_loop()`
In reply to Thomas GleixnerQuoted 11 lines · Thomas Gleixner
Quoted 10 lines · Ammar Faizi
The asm constraint does not reflect that the asm statement can modify the value of @loops. But the asm statement in
delay_loop()does modify the @loops.Specifiying the wrong constraint may lead to undefined behavior, it may clobber random stuff (e.g. local variable, important temporary value in regs, etc.). This is especially dangerous when the compiler decides to inline the function and since it doesn't know that the value gets modified, it might decide to use it from a register directly without reloading it.
Ignore me, I misread this part of the explanation.
Thanks,
tglx
[tip: x86/misc] x86/delay: Fix the wrong asm constraint in delay_loop()
In reply to Ammar FaiziThe following commit has been merged into the x86/misc branch of tip:
The following commit has been merged into the x86/misc branch of tip:
Commit-ID: b86eb74098a92afd789da02699b4b0dd3f73b889 Gitweb: https://git.kernel.org/tip/b86eb74098a92afd789da02699b4b0dd3f73b889 Author: Ammar Faizi <[email protected]> AuthorDate: Tue, 29 Mar 2022 17:47:04 +07:00 Committer: Borislav Petkov <[email protected]> CommitterDate: Tue, 05 Apr 2022 21:21:57 +02:00
x86/delay: Fix the wrong asm constraint in delay_loop()
The asm constraint does not reflect the fact that the asm statement can modify the value of the local variable loops. Which it does.
Specifying the wrong constraint may lead to undefined behavior, it may clobber random stuff (e.g. local variable, important temporary value in regs, etc.). This is especially dangerous when the compiler decides to inline the function and since it doesn't know that the value gets modified, it might decide to use it from a register directly without reloading it.
Change the constraint to "+a" to denote that the first argument is an input and an output argument.
[ bp: Fix typo, massage commit message. ]
--- arch/x86/lib/delay.c | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-)
arch/x86/lib/delay.c +2 -2
@@ -54,8 +54,8 @@ static void delay_loop(u64 __loops)" jnz 2b \n" "3: dec %0 \n" - : /* we don't need output */ - :"a" (loops) + : "+a" (loops) + : ); }
PATCH v6 2/2 x86/MCE/AMD: Fix memory leak when `threshold_create_bank()` fails
In reply to Ammar FaiziIn mce_threshold_create_device(), if threshold_create_bank() fails, the @bp will be leaked, because the call to mce_threshold_remove_device() will not free the @bp. mce_threshold_remove_device() frees @threshold_banks. At that point, the @bp has not been written to @threshold_banks, @threshold_banks is NULL, so the call is just a nop.
Fix this by extracting the cleanup part into a new static function __threshold_remove_device(), then call it from create/remove device functions.
Also, eliminate the "goto out_err", just early return inside the loop if the creation fails.
---
v6:
- Change the helper function name to __threshold_remove_device().
--- arch/x86/kernel/cpu/mce/amd.c | 32 +++++++++++++++++++------------- 1 file changed, 19 insertions(+), 13 deletions(-)
arch/x86/kernel/cpu/mce/amd.c +19 -13
@@ -1294,10 +1294,23 @@ static void threshold_remove_bank(struct threshold_bank *bank)kfree (bank); } +static void __threshold_remove_device (struct threshold_bank **bp, +unsigned int numbanks) +{ +unsigned int bank; + +for (bank =0 ; bank < numbanks; bank++) { +if (bp[bank]) { +threshold_remove_bank (bp[bank]); + bp[bank] =NULL ; + } + } +kfree (bp); +} +int mce_threshold_remove_device (unsigned int cpu) {struct threshold_bank **bp =this_cpu_read (threshold_banks); -unsigned int bank, numbanks =this_cpu_read (mce_num_banks);if (!bp)return 0 ;
@@ -1308,13 +1321,7 @@ int mce_threshold_remove_device(unsigned int cpu)*/ this_cpu_write (threshold_banks,NULL ); -for (bank =0 ; bank < numbanks; bank++) { -if (bp[bank]) { -threshold_remove_bank (bp[bank]); - bp[bank] =NULL ; - } - } -kfree (bp); +__threshold_remove_device (bp,this_cpu_read (mce_num_banks));return 0 ; }
@@ -1351,15 +1358,14 @@ int mce_threshold_create_device(unsigned int cpu)if (!(this_cpu_read (bank_map) & (1 << bank)))continue ; err =threshold_create_bank (bp, cpu, bank); -if (err) - goto out_err; +if (err) { +__threshold_remove_device (bp, numbanks); +return err; + } }this_cpu_write (threshold_banks, bp);if (thresholding_irq_en) mce_threshold_vector = amd_threshold_interrupt;return 0 ; -out_err: -mce_threshold_remove_device (cpu); -return err; }
Signature · 1 line
Ammar Faizi
Re: [PATCH v6 2/2] x86/MCE/AMD: Fix memory leak when `threshold_create_bank()` fails
Quoted 9 lines · Ammar Faizi
In
mce_threshold_create_device(), ifthreshold_create_bank()fails, the @bp will be leaked, because the call tomce_threshold_remove_device()will not free the @bp.mce_threshold_remove_device()frees @threshold_banks. At that point, the @bp has not been written to @threshold_banks, @threshold_banks is NULL, so the call is just a nop.Fix this by extracting the cleanup part into a new static function
__threshold_remove_device(), then call it from create/remove device functions.
The way simpler fix is to move
arch/x86/kernel/cpu/mce/amd.c int mce_threshold_create_device(unsigned int cpu) · line 1366
Quoted 2 lines
arch/x86/kernel/cpu/mce/amd.c +0
-0}this_cpu_write (threshold_banks, bp);
before the loop. That's safe because the banks cannot yet be reached via an MCE as the vector is not yet enabled:
arch/x86/kernel/cpu/mce/amd.c int mce_threshold_create_device(unsigned int cpu) · line 1369
Quoted 2 lines
arch/x86/kernel/cpu/mce/amd.c +0
-0if (thresholding_irq_en) mce_threshold_vector = amd_threshold_interrupt;
Thanks,
tglx
Re: [PATCH v6 2/2] x86/MCE/AMD: Fix memory leak when `threshold_create_bank()` fails
Quoted 12 lines · Thomas Gleixner
Quoted 9 lines · Ammar Faizi
In
mce_threshold_create_device(), ifthreshold_create_bank()fails, the @bp will be leaked, because the call tomce_threshold_remove_device()will not free the @bp.mce_threshold_remove_device()frees @threshold_banks. At that point, the @bp has not been written to @threshold_banks, @threshold_banks is NULL, so the call is just a nop.Fix this by extracting the cleanup part into a new static function
__threshold_remove_device(), then call it from create/remove device functions.
Quoted 10 lines
The way simpler fix is to move
Quoted 2 lines
} this_cpu_write(threshold_banks, bp);before the loop. That's safe because the banks cannot yet be reached via an MCE as the vector is not yet enabled:
Quoted 2 lines
if (thresholding_irq_en) mce_threshold_vector = amd_threshold_interrupt;
Thomas,
I did like what you said (in the patch v4), but after Yazen and Borislav reviewed it, we got a conclusion that it's not safe.
See [1] and [2] for the full message.
[1]: https://lore.kernel.org/lkml/[email protected]/
[2]: https://lore.kernel.org/lkml/Yh+oyD%2F5M3TW5ZMM@yaz-ubuntu/
Yazen, Borislav, please take a deeper look on this again. I will send a v7 revision to really make it simpler by moving that "per-CPU var write" before the loop.
Thanks!
Signature · 1 line
Ammar Faizi
Re: [PATCH v6 2/2] x86/MCE/AMD: Fix memory leak when `threshold_create_bank()` fails
Quoted 27 lines · Ammar Faizi
Quoted 12 lines · Thomas Gleixner
Quoted 9 lines · Ammar Faizi
In
mce_threshold_create_device(), ifthreshold_create_bank()fails, the @bp will be leaked, because the call tomce_threshold_remove_device()will not free the @bp.mce_threshold_remove_device()frees @threshold_banks. At that point, the @bp has not been written to @threshold_banks, @threshold_banks is NULL, so the call is just a nop.Fix this by extracting the cleanup part into a new static function
__threshold_remove_device(), then call it from create/remove device functions.Quoted 9 lines
The way simpler fix is to move
Quoted 2 lines
}
this_cpu_write(threshold_banks, bp);before the loop. That's safe because the banks cannot yet be reached via an MCE as the vector is not yet enabled:
Quoted 2 lines
if (
thresholding_irq_en)mce_threshold_vector=amd_threshold_interrupt;Thomas,
I did like what you said (in the patch v4), but after Yazen and Borislav reviewed it, we got a conclusion that it's not safe.
Quoted 8 lines
See [1] and [2] for the full message.
[1]: https://lore.kernel.org/lkml/[email protected]/
[2]: https://lore.kernel.org/lkml/Yh+oyD%2F5M3TW5ZMM@yaz-ubuntu/Yazen, Borislav, please take a deeper look on this again. I will send a v7 revision to really make it simpler by moving that "per-CPU var write" before the loop.
(only if it's really safe)
Signature · 1 line
Ammar Faizi
Borislav Petkov
maintainerRe: [PATCH v6 2/2] x86/MCE/AMD: Fix memory leak when `threshold_create_bank()` fails
Quoted 5 lines · Ammar Faizi
Quoted 3 lines
Yazen, Borislav, please take a deeper look on this again. I will send a v7 revision to really make it simpler by moving that "per-CPU var write" before the loop.
(only if it's really safe)
Don't bother - I've discussed it with tglx offlist. The current solution remains.
Signature · 4 lines
Regards/Gruss,
Boris.
https://people.kernel.org/tglx/notes-about-netiquette[tip: ras/core] x86/MCE/AMD: Fix memory leak when threshold_create_bank() fails
In reply to Ammar FaiziThe following commit has been merged into the ras/core branch of tip:
The following commit has been merged into the ras/core branch of tip:
Commit-ID: e5f28623ceb103e13fc3d7bd45edf9818b227fd0 Gitweb: https://git.kernel.org/tip/e5f28623ceb103e13fc3d7bd45edf9818b227fd0 Author: Ammar Faizi <[email protected]> AuthorDate: Tue, 29 Mar 2022 17:47:05 +07:00 Committer: Borislav Petkov <[email protected]> CommitterDate: Tue, 05 Apr 2022 21:24:37 +02:00
x86/MCE/AMD: Fix memory leak when threshold_create_bank() fails
In mce_threshold_create_device(), if threshold_create_bank() fails, the previously allocated threshold banks array @bp will be leaked because the call to mce_threshold_remove_device() will not free it.
This happens because mce_threshold_remove_device() fetches the pointer through the threshold_banks per-CPU variable but bp is written there only after the bank creation is successful, and not before, when threshold_create_bank() fails.
Add a helper which unwinds all the bank creation work previously done and pass into it the previously allocated threshold banks array for freeing.
[ bp: Massage. ]
--- arch/x86/kernel/cpu/mce/amd.c | 32 +++++++++++++++++++------------- 1 file changed, 19 insertions(+), 13 deletions(-)
arch/x86/kernel/cpu/mce/amd.c +19 -13
@@ -1294,10 +1294,23 @@ out_free:kfree (bank); } +static void __threshold_remove_device (struct threshold_bank **bp) +{ +unsigned int bank, numbanks =this_cpu_read (mce_num_banks); + +for (bank =0 ; bank < numbanks; bank++) { +if (!bp[bank]) +continue ; + +threshold_remove_bank (bp[bank]); + bp[bank] =NULL ; + } +kfree (bp); +} +int mce_threshold_remove_device (unsigned int cpu) {struct threshold_bank **bp =this_cpu_read (threshold_banks); -unsigned int bank, numbanks =this_cpu_read (mce_num_banks);if (!bp)return 0 ;
@@ -1308,13 +1321,7 @@ int mce_threshold_remove_device(unsigned int cpu)*/ this_cpu_write (threshold_banks,NULL ); -for (bank =0 ; bank < numbanks; bank++) { -if (bp[bank]) { -threshold_remove_bank (bp[bank]); - bp[bank] =NULL ; - } - } -kfree (bp); +__threshold_remove_device (bp);return 0 ; }
@@ -1351,15 +1358,14 @@ int mce_threshold_create_device(unsigned int cpu)if (!(this_cpu_read (bank_map) & (1 << bank)))continue ; err =threshold_create_bank (bp, cpu, bank); -if (err) - goto out_err; +if (err) { +__threshold_remove_device (bp); +return err; + } }this_cpu_write (threshold_banks, bp);if (thresholding_irq_en) mce_threshold_vector = amd_threshold_interrupt;return 0 ; -out_err: -mce_threshold_remove_device (cpu); -return err; }