5.18.19-rc1 review
Subsystems (5)
Greg Kroah-Hartman
maintainerPATCH 6/6 arm64: kexec_file: use more system keyrings to verify kernel image signature
In reply to Greg Kroah-HartmanFrom: Coiby Xu <[email protected]>
commit 0d519cadf75184a24313568e7f489a7fc9b1be3b upstream.
Currently, when loading a kernel image via the kexec_file_load() system call, arm64 can only use the .builtin_trusted_keys keyring to verify a signature whereas x86 can use three more keyrings i.e. .secondary_trusted_keys, .machine and .platform keyrings. For example, one resulting problem is kexec'ing a kernel image would be rejected with the error "Lockdown: kexec: kexec of unsigned images is restricted; see man kernel_lockdown.7".
This patch set enables arm64 to make use of the same keyrings as x86 to verify the signature kexec'ed kernel image.
--- arch/arm64/kernel/kexec_image.c | 11 +---------- 1 file changed, 1 insertion(+), 10 deletions(-)
arch/arm64/kernel/kexec_image.c +1 -10
@@ -14,7 +14,6 @@#include <linux/kexec.h> #include <linux/pe.h> #include <linux/string.h> -#include <linux/verification.h> #include <asm/byteorder.h> #include <asm/cpufeature.h> #include <asm/image.h>
@@ -130,18 +129,10 @@ static void *image_load(struct kimage *ireturn NULL ; } -#ifdef CONFIG_KEXEC_IMAGE_VERIFY_SIG -static int image_verify_sig (const char *kernel,unsigned long kernel_len) -{ -return verify_pefile_signature (kernel, kernel_len,NULL , -VERIFYING_KEXEC_PE_SIGNATURE ); -} -#endif -const struct kexec_file_ops kexec_image_ops = { .probe = image_probe, .load = image_load, #ifdef CONFIG_KEXEC_IMAGE_VERIFY_SIG - .verify_sig = image_verify_sig, + .verify_sig = kexec_kernel_verify_pe_sig, #endif };
_______________________________________________
kexec mailing list
[email protected]
http://lists.infradead.org/mailman/listinfo/kexec
Greg Kroah-Hartman
maintainercover 5.18.19-rc1 review
-------------------
NOTE, this is the LAST 5.18.y stable release. This tree will be end-of-life after this one. Please move to 5.19.y at this point in time or let us know why that is not possible.
-------------------
This is the start of the stable review cycle for the 5.18.19 release. There are 6 patches in this series, all will be posted as a response to this one. If anyone has any issues with these being applied, please let me know.
Responses should be made by Sun, 21 Aug 2022 15:36:59 +0000. Anything received after that time might be too late.
The whole patch series can be found in one patch at:
https://www.kernel.org/pub/linux/kernel/v5.x/stable-review/patch-5.18.19-rc1.gz
or in the git tree and branch at:
git://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable-rc.git linux-5.18.y
and the diffstat can be found below.
thanks,
greg k-h
-------------
Pseudo-Shortlog of commits:
Greg Kroah-Hartman <[email protected]>
Linux 5.18.19-rc1
Coiby Xu <[email protected]>
arm64: kexec_file: use more system keyrings to verify kernel image signature
Coiby Xu <[email protected]>
kexec, KEYS: make the code in bzImage64_verify_sig generic
Qu Wenruo <[email protected]>
btrfs: raid56: don't trust any cached sector in __raid56_parity_recover()
Qu Wenruo <[email protected]>
btrfs: only write the sectors in the vertical stripe which has data stripes
Jamal Hadi Salim <[email protected]>
net_sched: cls_route: disallow handle of 0
Jens Wiklander <[email protected]>
tee: add overflow check in register_shm_helper()
-------------
Diffstat:
Makefile | 4 +-- arch/arm64/kernel/kexec_image.c | 11 +----- arch/x86/kernel/kexec-bzimage64.c | 20 +---------- drivers/tee/tee_shm.c | 3 ++ fs/btrfs/raid56.c | 74 ++++++++++++++++++++++++++++++--------- include/linux/kexec.h | 7 ++++ kernel/kexec_file.c | 17 +++++++++ net/sched/cls_route.c | 10 ++++++ 8 files changed, 98 insertions(+), 48 deletions(-)
Greg Kroah-Hartman
maintainerPATCH 1/6 tee: add overflow check in register_shm_helper()
From: Jens Wiklander <[email protected]>
commit 573ae4f13f630d6660008f1974c0a8a29c30e18a upstream.
With special lengths supplied by user space, register_shm_helper() has an integer overflow when calculating the number of pages covered by a supplied user space memory region.
This causes internal_get_user_pages_fast() a helper function of pin_user_pages_fast() to do a NULL pointer dereference:
Unable to handle kernel NULL pointer dereference at virtual address 0000000000000010 Modules linked in: CPU: 1 PID: 173 Comm: optee_example_a Not tainted 5.19.0 #11 Hardware name: QEMU QEMU Virtual Machine, BIOS 0.0.0 02/06/2015 pc : internal_get_user_pages_fast+0x474/0xa80 Call trace: internal_get_user_pages_fast+0x474/0xa80 pin_user_pages_fast+0x24/0x4c register_shm_helper+0x194/0x330 tee_shm_register_user_buf+0x78/0x120 tee_ioctl+0xd0/0x11a0 __arm64_sys_ioctl+0xa8/0xec invoke_syscall+0x48/0x114
Fix this by adding an an explicit call to access_ok() in tee_shm_register_user_buf() to catch an invalid user space address early.
--- drivers/tee/tee_shm.c | 3 +++ 1 file changed, 3 insertions(+)
drivers/tee/tee_shm.c +3 -0
@@ -311,6 +311,9 @@ struct tee_shm *tee_shm_register_user_buvoid *ret;int id; +if (!access_ok ((void __user *)addr, length)) +return ERR_PTR (-EFAULT ); +mutex_lock (&teedev->mutex); id =idr_alloc (&teedev->idr,NULL ,1 ,0 ,GFP_KERNEL );mutex_unlock (&teedev->mutex);
Greg Kroah-Hartman
maintainerPATCH 5/6 kexec, KEYS: make the code in bzImage64_verify_sig generic
In reply to Greg Kroah-HartmanFrom: Coiby Xu <[email protected]>
commit c903dae8941deb55043ee46ded29e84e97cd84bb upstream.
commit 278311e417be ("kexec, KEYS: Make use of platform keyring for signature verify") adds platform keyring support on x86 kexec but not arm64.
The code in bzImage64_verify_sig uses the keys on the .builtin_trusted_keys, .machine, if configured and enabled, .secondary_trusted_keys, also if configured, and .platform keyrings to verify the signed kernel image as PE file.
--- arch/x86/kernel/kexec-bzimage64.c | 20 +------------------- include/linux/kexec.h | 7 +++++++ kernel/kexec_file.c | 17 +++++++++++++++++ 3 files changed, 25 insertions(+), 19 deletions(-)
arch/x86/kernel/kexec-bzimage64.c +1 -19
@@ -17,7 +17,6 @@#include <linux/kernel.h> #include <linux/mm.h> #include <linux/efi.h> -#include <linux/verification.h> #include <asm/bootparam.h> #include <asm/setup.h>
@@ -528,28 +527,11 @@ static int bzImage64_cleanup(void *loadereturn 0 ; } -#ifdef CONFIG_KEXEC_BZIMAGE_VERIFY_SIG -static int bzImage64_verify_sig (const char *kernel,unsigned long kernel_len) -{ -int ret; - - ret =verify_pefile_signature (kernel, kernel_len, -VERIFY_USE_SECONDARY_KEYRING , -VERIFYING_KEXEC_PE_SIGNATURE ); -if (ret == -ENOKEY &&IS_ENABLED (CONFIG_INTEGRITY_PLATFORM_KEYRING )) { - ret =verify_pefile_signature (kernel, kernel_len, -VERIFY_USE_PLATFORM_KEYRING , -VERIFYING_KEXEC_PE_SIGNATURE ); - } -return ret; -} -#endif -const struct kexec_file_ops kexec_bzImage64_ops = { .probe = bzImage64_probe, .load = bzImage64_load, .cleanup = bzImage64_cleanup, #ifdef CONFIG_KEXEC_BZIMAGE_VERIFY_SIG - .verify_sig = bzImage64_verify_sig, + .verify_sig = kexec_kernel_verify_pe_sig, #endif };
include/linux/kexec.h +7 -0
@@ -19,6 +19,7 @@#include <asm/io.h> #include <uapi/linux/kexec.h> +#include <linux/verification.h> /* Location of a reserved region to hold the crash kernel. */
@@ -212,6 +213,12 @@ static inline void *arch_kexec_kernel_im }#endif +#ifdef CONFIG_KEXEC_SIG +#ifdef CONFIG_SIGNED_PE_FILE_VERIFICATION +int kexec_kernel_verify_pe_sig (const char *kernel,unsigned long kernel_len); +#endif +#endif +extern int kexec_add_buffer (struct kexec_buf *kbuf);int kexec_locate_mem_hole (struct kexec_buf *kbuf);
kernel/kexec_file.c +17 -0
@@ -123,6 +123,23 @@ void kimage_file_post_load_cleanup(struc }#ifdef CONFIG_KEXEC_SIG +#ifdef CONFIG_SIGNED_PE_FILE_VERIFICATION +int kexec_kernel_verify_pe_sig (const char *kernel,unsigned long kernel_len) +{ +int ret; + + ret =verify_pefile_signature (kernel, kernel_len, +VERIFY_USE_SECONDARY_KEYRING , +VERIFYING_KEXEC_PE_SIGNATURE ); +if (ret == -ENOKEY &&IS_ENABLED (CONFIG_INTEGRITY_PLATFORM_KEYRING )) { + ret =verify_pefile_signature (kernel, kernel_len, +VERIFY_USE_PLATFORM_KEYRING , +VERIFYING_KEXEC_PE_SIGNATURE ); + } +return ret; +} +#endif +static int kexec_image_verify_sig (struct kimage *image,void *buf,unsigned long buf_len) {
_______________________________________________
kexec mailing list
[email protected]
http://lists.infradead.org/mailman/listinfo/kexec
Greg Kroah-Hartman
maintainerPATCH 2/6 net_sched: cls_route: disallow handle of 0
In reply to Greg Kroah-HartmanFrom: Jamal Hadi Salim <[email protected]>
commit 02799571714dc5dd6948824b9d080b44a295f695 upstream.
Follows up on:
https://lore.kernel.org/all/[email protected]/
handle of 0 implies from/to of universe realm which is not very sensible.
Lets see what this patch will do:
$sudo tc qdisc add dev $DEV root handle 1:0 prio
//lets manufacture a way to insert handle of 0
$sudo tc filter add dev $DEV parent 1:0 protocol ip prio 100 \
route to 0 from 0 classid 1:10 action ok
//gets rejected...
Error: handle of 0 is not valid.
We have an error talking to the kernel, -1
//lets create a legit entry..
sudo tc filter add dev $DEV parent 1:0 protocol ip prio 100 route from 10 \
classid 1:10 action ok
//what did the kernel insert?
$sudo tc filter ls dev $DEV parent 1:0
filter protocol ip pref 100 route chain 0
filter protocol ip pref 100 route chain 0 fh 0x000a8000 flowid 1:10 from 10
action order 1: gact action pass
random type none pass val 0
index 1 ref 1 bind 1
//Lets try to replace that legit entry with a handle of 0
$ sudo tc filter replace dev $DEV parent 1:0 protocol ip prio 100 \ handle 0x000a8000 route to 0 from 0 classid 1:10 action drop
Error: Replacing with handle of 0 is invalid.
We have an error talking to the kernel, -1
And last, lets run Cascardo's POC:
$ ./poc 0 0 -22 -22 -22
--- net/sched/cls_route.c | 10 ++++++++++ 1 file changed, 10 insertions(+)
net/sched/cls_route.c +10 -0
@@ -424,6 +424,11 @@ static int route4_set_parms(struct net *return -EINVAL ; } +if (!nhandle) { +NL_SET_ERR_MSG (extack,"Replacing with handle of 0 is invalid" ); +return -EINVAL ; + } + h1 =to_hash (nhandle); b =rtnl_dereference (head->table[h1]);if (!b) {
@@ -477,6 +482,11 @@ static int route4_change(struct net *netint err;bool new = true; +if (!handle) { +NL_SET_ERR_MSG (extack,"Creating with handle of 0 is invalid" ); +return -EINVAL ; + } +if (opt ==NULL )return handle ? -EINVAL :0 ;
Greg Kroah-Hartman
maintainerPATCH 3/6 btrfs: only write the sectors in the vertical stripe which has data stripes
In reply to Greg Kroah-HartmanFrom: Qu Wenruo <[email protected]>
commit bd8f7e627703ca5707833d623efcd43f104c7b3f upstream.
If we have only 8K partial write at the beginning of a full RAID56 stripe, we will write the following contents:
0 8K 32K 64K
Disk 1 (data): |XX| | |
Disk 2 (data): | | | Disk 3 (parity): |XXXXXXXXXXXXXXX|XXXXXXXXXXXXXXX|
|X| means the sector will be written back to disk.
Note that, although we won't write any sectors from disk 2, but we will write the full 64KiB of parity to disk.
This behavior is fine for now, but not for the future (especially for RAID56J, as we waste quite some space to journal the unused parity stripes).
So here we will also utilize the btrfs_raid_bio::dbitmap, anytime we queue a higher level bio into an rbio, we will update rbio::dbitmap to indicate which vertical stripes we need to writeback.
And at finish_rmw(), we also check dbitmap to see if we need to write any sector in the vertical stripe.
So after the patch, above example will only lead to the following writeback pattern:
0 8K 32K 64K
Disk 1 (data): |XX| | |
Disk 2 (data): | | | Disk 3 (parity): |XX| | |
--- fs/btrfs/raid56.c | 55 ++++++++++++++++++++++++++++++++++++++++++++++++++---- 1 file changed, 51 insertions(+), 4 deletions(-)
fs/btrfs/raid56.c +51 -4
@@ -323,6 +323,9 @@ static void merge_rbio(struct btrfs_raid {bio_list_merge (&dest->bio_list, &victim->bio_list); dest->bio_list_bytes += victim->bio_list_bytes; +/* Also inherit the bitmaps from @victim. */ +bitmap_or (dest->dbitmap, victim->dbitmap, dest->dbitmap, + dest->stripe_npages); dest->generic_bio_cnt += victim->generic_bio_cnt;bio_list_init (&victim->bio_list); }
@@ -864,6 +867,12 @@ static void rbio_orig_end_io(struct btrfif (rbio->generic_bio_cnt)btrfs_bio_counter_sub (rbio->bioc->fs_info, rbio->generic_bio_cnt); +/* +* Clear the data bitmap, as the rbio may be cached for later usage. +* do this before before unlock_stripe() so there will be no new bio +* for this bio. +*/ +bitmap_clear (rbio->dbitmap,0 , rbio->stripe_npages);/* * At this moment, rbio->bio_list is empty, however since rbio does not
@@ -1195,6 +1204,9 @@ static noinline void finish_rmw(struct belse BUG (); +/* We should have at least one data sector. */ +ASSERT (bitmap_weight (rbio->dbitmap, rbio->stripe_npages)); +/* at this point we either have a full stripe, * or we've read the full stripe from the drive. * recalculate the parity and write the new results.
@@ -1266,6 +1278,11 @@ static noinline void finish_rmw(struct bfor (stripe =0 ; stripe < rbio->real_stripes; stripe++) {for (pagenr =0 ; pagenr < rbio->stripe_npages; pagenr++) {struct page *page; + +/* This vertical stripe has no data, skip it. */ +if (!test_bit (pagenr, rbio->dbitmap)) +continue ; +if (stripe < rbio->nr_data) { page =page_in_rbio (rbio, stripe, pagenr,1 );if (!page)
@@ -1290,6 +1307,11 @@ static noinline void finish_rmw(struct bfor (pagenr =0 ; pagenr < rbio->stripe_npages; pagenr++) {struct page *page; + +/* This vertical stripe has no data, skip it. */ +if (!test_bit (pagenr, rbio->dbitmap)) +continue ; +if (stripe < rbio->nr_data) { page =page_in_rbio (rbio, stripe, pagenr,1 );if (!page)
@@ -1713,6 +1735,33 @@ static void btrfs_raid_unplug(struct blkrun_plug (plug); } +/* Add the original bio into rbio->bio_list, and update rbio::dbitmap. */ +static void rbio_add_bio (struct btrfs_raid_bio *rbio,struct bio *orig_bio) +{ +const struct btrfs_fs_info *fs_info = rbio->bioc->fs_info; +const u64 orig_logical = orig_bio->bi_iter.bi_sector <<SECTOR_SHIFT ; +const u64 full_stripe_start = rbio->bioc->raid_map[0 ]; +const u32 orig_len = orig_bio->bi_iter.bi_size; +const u32 sectorsize = fs_info->sectorsize; +u64 cur_logical; + +ASSERT (orig_logical >= full_stripe_start && + orig_logical + orig_len <= full_stripe_start + + rbio->nr_data * rbio->stripe_len); + +bio_list_add (&rbio->bio_list, orig_bio); + rbio->bio_list_bytes += orig_bio->bi_iter.bi_size; + +/* Update the dbitmap. */ +for (cur_logical = orig_logical; cur_logical < orig_logical + orig_len; + cur_logical += sectorsize) { +int bit = ((u32)(cur_logical - full_stripe_start) >> + fs_info->sectorsize_bits) % rbio->stripe_npages; + +set_bit (bit, rbio->dbitmap); + } +} +/* * our main entry point for writes from the rest of the FS. */
@@ -1730,9 +1779,8 @@ int raid56_parity_write(struct bio *bio,btrfs_put_bioc (bioc);return PTR_ERR (rbio); } -bio_list_add (&rbio->bio_list, bio); - rbio->bio_list_bytes = bio->bi_iter.bi_size; rbio->operation =BTRFS_RBIO_WRITE ; +rbio_add_bio (rbio, bio);btrfs_bio_counter_inc_noblocked (fs_info); rbio->generic_bio_cnt =1 ;
@@ -2134,8 +2182,7 @@ int raid56_parity_recover(struct bio *bi } rbio->operation =BTRFS_RBIO_READ_REBUILD ; -bio_list_add (&rbio->bio_list, bio); - rbio->bio_list_bytes = bio->bi_iter.bi_size; +rbio_add_bio (rbio, bio); rbio->faila =find_logical_bio_stripe (rbio, bio);if (rbio->faila ==-1 ) {
Greg Kroah-Hartman
maintainerPATCH 4/6 btrfs: raid56: dont trust any cached sector in __raid56_parity_recover()
In reply to Greg Kroah-HartmanFrom: Qu Wenruo <[email protected]>
commit f6065f8edeb25f4a9dfe0b446030ad995a84a088 upstream.
[BUG]
There is a small workload which will always fail with recent kernel:
(A simplified version from btrfs/125 test case)
mkfs.btrfs -f -m raid5 -d raid5 -b 1G $dev1 $dev2 $dev3 mount $dev1 $mnt xfs_io -f -c "pwrite -S 0xee 0 1M" $mnt/file1 sync umount $mnt btrfs dev scan -u $dev3 mount -o degraded $dev1 $mnt xfs_io -f -c "pwrite -S 0xff 0 128M" $mnt/file2 umount $mnt btrfs dev scan mount $dev1 $mnt btrfs balance start --full-balance $mnt umount $mnt
The failure is always failed to read some tree blocks:
BTRFS info (device dm-4): relocating block group 217710592 flags data|raid5 BTRFS error (device dm-4): parent transid verify failed on 38993920 wanted 9 found 7 BTRFS error (device dm-4): parent transid verify failed on 38993920 wanted 9 found 7
...
[CAUSE]
With the recently added debug output, we can see all RAID56 operations related to full stripe 38928384:
56.1183: raid56_read_partial: full_stripe=38928384 devid=2 type=DATA1 offset=0 opf=0x0 physical=9502720 len=65536 56.1185: raid56_read_partial: full_stripe=38928384 devid=3 type=DATA2 offset=16384 opf=0x0 physical=9519104 len=16384 56.1185: raid56_read_partial: full_stripe=38928384 devid=3 type=DATA2 offset=49152 opf=0x0 physical=9551872 len=16384 56.1187: raid56_write_stripe: full_stripe=38928384 devid=3 type=DATA2 offset=0 opf=0x1 physical=9502720 len=16384 56.1188: raid56_write_stripe: full_stripe=38928384 devid=3 type=DATA2 offset=32768 opf=0x1 physical=9535488 len=16384 56.1188: raid56_write_stripe: full_stripe=38928384 devid=1 type=PQ1 offset=0 opf=0x1 physical=30474240 len=16384 56.1189: raid56_write_stripe: full_stripe=38928384 devid=1 type=PQ1 offset=32768 opf=0x1 physical=30507008 len=16384 56.1218: raid56_write_stripe: full_stripe=38928384 devid=3 type=DATA2 offset=49152 opf=0x1 physical=9551872 len=16384 56.1219: raid56_write_stripe: full_stripe=38928384 devid=1 type=PQ1 offset=49152 opf=0x1 physical=30523392 len=16384 56.2721: raid56_parity_recover: full stripe=38928384 eb=39010304 mirror=2
56.2723: raid56_parity_recover: full stripe=38928384 eb=39010304 mirror=2
56.2724: raid56_parity_recover: full stripe=38928384 eb=39010304 mirror=2
Before we enter raid56_parity_recover(), we have triggered some metadata write for the full stripe 38928384, this leads to us to read all the sectors from disk.
Furthermore, btrfs raid56 write will cache its calculated P/Q sectors to avoid unnecessary read.
This means, for that full stripe, after any partial write, we will have stale data, along with P/Q calculated using that stale data.
Thankfully due to patch "btrfs: only write the sectors in the vertical stripe which has data stripes" we haven't submitted all the corrupted P/Q to disk.
When we really need to recover certain range, aka in raid56_parity_recover(), we will use the cached rbio, along with its cached sectors (the full stripe is all cached).
This explains why we have no event raid56_scrub_read_recover() triggered.
Since we have the cached P/Q which is calculated using the stale data, the recovered one will just be stale.
In our particular test case, it will always return the same incorrect metadata, thus causing the same error message "parent transid verify failed on 39010304 wanted 9 found 7" again and again.
[BTRFS DESTRUCTIVE RMW PROBLEM]
Test case btrfs/125 (and above workload) always has its trouble with the destructive read-modify-write (RMW) cycle:
0 32K 64K Data1: | Good | Good | Data2: | Bad | Bad | Parity: | Good | Good |
In above case, if we trigger any write into Data1, we will use the bad data in Data2 to re-generate parity, killing the only chance to recovery Data2, thus Data2 is lost forever.
This destructive RMW cycle is not specific to btrfs RAID56, but there are some btrfs specific behaviors making the case even worse:
- Btrfs will cache sectors for unrelated vertical stripes.
In above example, if we're only writing into 0~32K range, btrfs will still read data range (32K ~ 64K) of Data1, and (64K~128K) of Data2. This behavior is to cache sectors for later update.
Incidentally commit d4e28d9b5f04 ("btrfs: raid56: make steal_rbio() subpage compatible") has a bug which makes RAID56 to never trust the cached sectors, thus slightly improve the situation for recovery.
Unfortunately, follow up fix "btrfs: update stripe_sectors::uptodate in steal_rbio" will revert the behavior back to the old one.
- Btrfs raid56 partial write will update all P/Q sectors and cache them
This means, even if data at (64K ~ 96K) of Data2 is free space, and only (96K ~ 128K) of Data2 is really stale data.
And we write into that (96K ~ 128K), we will update all the parity sectors for the full stripe.
This unnecessary behavior will completely kill the chance of recovery.
Thankfully, an unrelated optimization "btrfs: only write the sectors in the vertical stripe which has data stripes" will prevent submitting the write bio for untouched vertical sectors.
That optimization will keep the on-disk P/Q untouched for a chance for later recovery.
[FIX]
Although we have no good way to completely fix the destructive RMW (unless we go full scrub for each partial write), we can still limit the damage.
With patch "btrfs: only write the sectors in the vertical stripe which has data stripes" now we won't really submit the P/Q of unrelated vertical stripes, so the on-disk P/Q should still be fine.
Now we really need to do is just drop all the cached sectors when doing recovery.
By this, we have a chance to read the original P/Q from disk, and have a chance to recover the stale data, while still keep the cache to speed up regular write path.
In fact, just dropping all the cache for recovery path is good enough to allow the test case btrfs/125 along with the small script to pass reliably.
The lack of metadata write after the degraded mount, and forced metadata COW is saving us this time.
So this patch will fix the behavior by not trust any cache in __raid56_parity_recover(), to solve the problem while still keep the cache useful.
But please note that this test pass DOES NOT mean we have solved the destructive RMW problem, we just do better damage control a little better.
Related patches:
- btrfs: only write the sectors in the vertical stripe
- d4e28d9b5f04 ("btrfs: raid56: make steal_rbio() subpage compatible")
- btrfs: update stripe_sectors::uptodate in steal_rbio
--- fs/btrfs/raid56.c | 19 ++++++------------- 1 file changed, 6 insertions(+), 13 deletions(-)
fs/btrfs/raid56.c +6 -13
@@ -2084,9 +2084,12 @@ static int __raid56_parity_recover(strucatomic_set (&rbio->error,0 );/* -* read everything that hasn't failed. Thanks to the -* stripe cache, it is possible that some or all of these -* pages are going to be uptodate. +* Read everything that hasn't failed. However this time we will +* not trust any cached sector. +* As we may read out some stale data but higher layer is not reading +* that stale part. +* +* So here we always re-read everything in recovery path. */ for (stripe =0 ; stripe < rbio->real_stripes; stripe++) {if (rbio->faila == stripe || rbio->failb == stripe) {
@@ -2095,16 +2098,6 @@ static int __raid56_parity_recover(struc }for (pagenr =0 ; pagenr < rbio->stripe_npages; pagenr++) { -struct page *p; - -/* -* the rmw code may have already read this -* page in -*/ - p =rbio_stripe_page (rbio, stripe, pagenr); -if (PageUptodate (p)) -continue ; - ret =rbio_add_io_page (rbio, &bio_list,rbio_stripe_page (rbio, stripe, pagenr), stripe, pagenr, rbio->stripe_len);
Quoted 15 lines · Greg Kroah-Hartman
-------------------
NOTE, this is the LAST 5.18.y stable release. This tree will be end-of-life after this one. Please move to 5.19.y at this point in time or let us know why that is not possible.
-------------------This is the start of the stable review cycle for the 5.18.19 release. There are 6 patches in this series, all will be posted as a response to this one. If anyone has any issues with these being applied, please let me know.
Responses should be made by Sun, 21 Aug 2022 15:36:59 +0000. Anything received after that time might be too late.
The whole patch series can be found in one patch at:
Quoted 9 lines
https://www.kernel.org/pub/linux/kernel/v5.x/stable-review/patch-5.18.19-rc1.gzor in the git tree and branch at:
git://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable-rc.gitlinux-5.18.y
and the diffstat can be found below.thanks,
greg k-h
Compiled and booted on my test system. No dmesg regressions.
thanks,
-- Shuah
Quoted 16 lines · Greg Kroah-Hartman
-------------------
NOTE, this is the LAST 5.18.y stable release. This tree will be end-of-life after this one. Please move to 5.19.y at this point in time or let us know why that is not possible.
-------------------This is the start of the stable review cycle for the 5.18.19 release. There are 6 patches in this series, all will be posted as a response to this one. If anyone has any issues with these being applied, please let me know.
Responses should be made by Sun, 21 Aug 2022 15:36:59 +0000. Anything received after that time might be too late.
The whole patch series can be found in one patch at:
Quoted 8 lines
https://www.kernel.org/pub/linux/kernel/v5.x/stable-review/patch-5.18.19-rc1.gzor in the git tree and branch at:
git://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable-rc.gitlinux-5.18.y
and the diffstat can be found below.thanks,
greg k-h
Results from Linaro's test farm.
No regressions on arm64, arm, x86_64, and i386.
## Build
* kernel: 5.18.19-rc1
* git: https://gitlab.com/Linaro/lkft/mirrors/stable/linux-stable-rc
* git branch: linux-5.18.y
* git commit: f06dacf3d236cd8b16b2a869572c0e849f2aa156
* git describe: v5.18.18-7-gf06dacf3d236
* test details:
https://qa-reports.linaro.org/lkft/linux-stable-rc-linux-5.18.y/build/v5.18.18-7-gf06dacf3d236
## No test Regressions (compared to v5.18.18)
## No metric Regressions (compared to v5.18.18)
## No test Fixes (compared to v5.18.18)
## No metric Fixes (compared to v5.18.18)
## Test result summary
total: 138885, pass: 123740, fail: 932, skip: 13421, xfail: 792
## Build Summary
* arc: 10 total, 10 passed, 0 failed
* arm: 313 total, 310 passed, 3 failed
* arm64: 76 total, 74 passed, 2 failed
* i386: 64 total, 58 passed, 6 failed
* mips: 50 total, 47 passed, 3 failed
* parisc: 14 total, 14 passed, 0 failed
* powerpc: 65 total, 56 passed, 9 failed
* riscv: 32 total, 27 passed, 5 failed
* s390: 23 total, 20 passed, 3 failed
* sh: 26 total, 24 passed, 2 failed
* sparc: 14 total, 14 passed, 0 failed
* x86_64: 69 total, 67 passed, 2 failed
## Test suites summary
* fwts
* igt-gpu-tools
* kunit
* kvm-unit-tests
* libgpiod
* libgpiod[
* libhugetlbfs
* log-parser-boot
* log-parser-test
* ltp-cap_bounds
* ltp-commands
* ltp-containers
* ltp-controllers
* ltp-cpuhotplug
* ltp-crypto
* ltp-cve
* ltp-dio
* ltp-fcntl-locktests
* ltp-filecaps
* ltp-fs
* ltp-fs_bind
* ltp-fs_perms_simple
* ltp-fsx
* ltp-hugetlb
* ltp-io
* ltp-ipc
* ltp-math
* ltp-mm
* ltp-nptl
* ltp-open-posix-tests
* ltp-pty
* ltp-sched
* ltp-securebits
* ltp-smoke
* ltp-syscalls
* ltp-tracing
* network-basic-tests
* packetdrill
* rcutorture
* ssuite
* v4l2-compliance
* vdso
--
Linaro LKFT
https://lkft.linaro.org
Quoted 15 lines · Greg Kroah-Hartman
-------------------
NOTE, this is the LAST 5.18.y stable release. This tree will be end-of-life after this one. Please move to 5.19.y at this point in time or let us know why that is not possible.
-------------------This is the start of the stable review cycle for the 5.18.19 release. There are 6 patches in this series, all will be posted as a response to this one. If anyone has any issues with these being applied, please let me know.
Responses should be made by Sun, 21 Aug 2022 15:36:59 +0000. Anything received after that time might be too late.
The whole patch series can be found in one patch at:
Quoted 8 lines
https://www.kernel.org/pub/linux/kernel/v5.x/stable-review/patch-5.18.19-rc1.gzor in the git tree and branch at:
git://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable-rc.gitlinux-5.18.y
and the diffstat can be found below.thanks,
greg k-h
Built and booted successfully on RISC-V RV64 (HiFive Unmatched).
Hi Greg,
Quoted 6 lines · Greg Kroah-Hartman
-------------------
NOTE, this is the LAST 5.18.y stable release. This tree will be end-of-life after this one. Please move to 5.19.y at this point in time or let us know why that is not possible.
-------------------
Quoted 7 lines
This is the start of the stable review cycle for the 5.18.19 release. There are 6 patches in this series, all will be posted as a response to this one. If anyone has any issues with these being applied, please let me know.
Responses should be made by Sun, 21 Aug 2022 15:36:59 +0000. Anything received after that time might be too late.
Build test (gcc version 12.2.1 20220819):
mips: 59 configs -> 1 failure
arm: 99 configs -> no failure
arm64: 3 configs -> no failurex86_64: 4 configs -> no failure
alpha allmodconfig -> no failure
csky allmodconfig -> fails
powerpc allmodconfig -> fais
riscv allmodconfig -> no failure
s390 allmodconfig -> no failure
xtensa allmodconfig -> no failure
Note:
csky and mips allmodconfig fails with gcc-12, passes with gcc-11. Already reported for mainline.
powerpc failure is not seen in mainline. Same error as csky and mips.
In function 'memcmp',
inlined from 'bacmp' at ./include/net/bluetooth/bluetooth.h:302:9,
inlined from 'l2cap_global_chan_by_psm' at net/bluetooth/l2cap_core.c:2002:15:./include/linux/fortify-string.h:44:33: error: '__builtin_memcmp' specified bound 6 exceeds source size 0 [-Werror=stringop-overread]
44 | #define __underlying_memcmp __builtin_memcmp
| ^
./include/linux/fortify-string.h:404:16: note: in expansion of macro '__underlying_memcmp'
404 | return __underlying_memcmp(p, q, size);
| ^~~~~~~~~~~~~~~~~~~In function 'memcmp',
inlined from 'bacmp' at ./include/net/bluetooth/bluetooth.h:302:9,
inlined from 'l2cap_global_chan_by_psm' at net/bluetooth/l2cap_core.c:2003:15:./include/linux/fortify-string.h:44:33: error: '__builtin_memcmp' specified bound 6 exceeds source size 0 [-Werror=stringop-overread]
44 | #define __underlying_memcmp __builtin_memcmp
| ^
./include/linux/fortify-string.h:404:16: note: in expansion of macro '__underlying_memcmp'
404 | return __underlying_memcmp(p, q, size);
| ^~~~~~~~~~~~~~~~~~~I am bisecting now to find out what caused it.
Boot test:x86_64: Booted on my test laptop. No regression.x86_64: Booted on qemu. No regression. [1]
mips: Booted on ci20 board. No regression. [2]
[1]. https://openqa.qa.codethink.co.uk/tests/1660
[2]. https://openqa.qa.codethink.co.uk/tests/1667
--
Regards
Sudip
Quoted 18 lines · Sudip Mukherjee (Codethink)
Hi Greg,
Quoted 13 lines · Greg Kroah-Hartman
-------------------
NOTE, this is the LAST 5.18.y stable release. This tree will be end-of-life after this one. Please move to 5.19.y at this point in time or let us know why that is not possible.
-------------------This is the start of the stable review cycle for the 5.18.19 release. There are 6 patches in this series, all will be posted as a response to this one. If anyone has any issues with these being applied, please let me know.
Responses should be made by Sun, 21 Aug 2022 15:36:59 +0000. Anything received after that time might be too late.
<snip>
Quoted 16 lines
powerpc failure is not seen in mainline. Same error as csky and mips.
In function 'memcmp',
inlined from 'bacmp' at./include/net/bluetooth/bluetooth.h:302:9,
inlined from 'l2cap_global_chan_by_psm' atnet/bluetooth/l2cap_core.c:2002:15:./include/linux/fortify-string.h:44:33: error: '__builtin_memcmp' specified bound 6 exceeds source size 0 [-Werror=stringop-overread]44 | #define __underlying_memcmp __builtin_memcmp | ^ ./include/linux/fortify-string.h:404:16: note: in expansion of macro '__underlying_memcmp' 404 | return __underlying_memcmp(p, q, size); | ^~~~~~~~~~~~~~~~~~~In function 'memcmp',
inlined from 'bacmp' at./include/net/bluetooth/bluetooth.h:302:9,
inlined from 'l2cap_global_chan_by_psm' atnet/bluetooth/l2cap_core.c:2003:15:./include/linux/fortify-string.h:44:33: error: '__builtin_memcmp' specified bound 6 exceeds source size 0 [-Werror=stringop-overread]
Quoted 7 lines
44 | #define __underlying_memcmp __builtin_memcmp | ^ ./include/linux/fortify-string.h:404:16: note: in expansion of macro '__underlying_memcmp' 404 | return __underlying_memcmp(p, q, size); | ^~~~~~~~~~~~~~~~~~~I am bisecting now to find out what caused it.
Introduced in v5.18.18 due to 11e008e59970 ("Bluetooth: L2CAP: Fix l2cap_global_chan_by_psm regression").
But v5.19.y and mainline does not show the build failure as they also have 41b7a347bf14 ("powerpc: Book3S 64-bit outline-only KASAN support").
Signature · 2 lines
Regards Sudip
Quoted 6 lines · Greg Kroah-Hartman
-------------------
NOTE, this is the LAST 5.18.y stable release. This tree will be end-of-life after this one. Please move to 5.19.y at this point in time or let us know why that is not possible.
-------------------
Quoted 8 lines
This is the start of the stable review cycle for the 5.18.19 release. There are 6 patches in this series, all will be posted as a response to this one. If anyone has any issues with these being applied, please let me know.
Responses should be made by Sun, 21 Aug 2022 15:36:59 +0000. Anything received after that time might be too late.
Build results:
total: 154 pass: 154 fail: 0 Qemu test results: total: 487 pass: 486 fail: 1
Failed tests:
arm:bletchley-bmc:aspeed_g5_defconfig:notests:usb0:net,nic:aspeed-bmc-facebook-bletchley:rootfs
No new failures. As with v5.15.y, I did not receive this e-mail and had to copy it from lore instead.
Guenter
Greg Kroah-Hartman
maintainerQuoted 45 lines · Sudip Mukherjee
Quoted 18 lines · Sudip Mukherjee (Codethink)
Hi Greg,
Quoted 13 lines · Greg Kroah-Hartman
-------------------
NOTE, this is the LAST 5.18.y stable release. This tree will be end-of-life after this one. Please move to 5.19.y at this point in time or let us know why that is not possible.
-------------------This is the start of the stable review cycle for the 5.18.19 release. There are 6 patches in this series, all will be posted as a response to this one. If anyone has any issues with these being applied, please let me know.
Responses should be made by Sun, 21 Aug 2022 15:36:59 +0000. Anything received after that time might be too late.
<snip>
Quoted 22 lines
powerpc failure is not seen in mainline. Same error as csky and mips.
In function 'memcmp',
inlined from 'bacmp' at./include/net/bluetooth/bluetooth.h:302:9,
inlined from 'l2cap_global_chan_by_psm' atnet/bluetooth/l2cap_core.c:2002:15:./include/linux/fortify-string.h:44:33: error: '__builtin_memcmp' specified bound 6 exceeds source size 0 [-Werror=stringop-overread]44 | #define __underlying_memcmp __builtin_memcmp | ^ ./include/linux/fortify-string.h:404:16: note: in expansion of macro '__underlying_memcmp' 404 | return __underlying_memcmp(p, q, size); | ^~~~~~~~~~~~~~~~~~~In function 'memcmp',
inlined from 'bacmp' at./include/net/bluetooth/bluetooth.h:302:9,
inlined from 'l2cap_global_chan_by_psm' atnet/bluetooth/l2cap_core.c:2003:15:./include/linux/fortify-string.h:44:33: error: '__builtin_memcmp' specified bound 6 exceeds source size 0 [-Werror=stringop-overread]44 | #define __underlying_memcmp __builtin_memcmp | ^ ./include/linux/fortify-string.h:404:16: note: in expansion of macro '__underlying_memcmp' 404 | return __underlying_memcmp(p, q, size); | ^~~~~~~~~~~~~~~~~~~
Quoted 7 lines
Quoted 1 line
I am bisecting now to find out what caused it.
Introduced in v5.18.18 due to
11e008e59970("Bluetooth: L2CAP: Fixl2cap_global_chan_by_psmregression").
But v5.19.y and mainline does not show the build failure as they also have41b7a347bf14("powerpc: Book3S 64-bit outline-only KASAN support").
Ick, that's a mess. This is going to be the last 5.18 tree, so I'm just going to leave this alone...
thanks,
greg k-h